2023-11-28T18:19:38.522 INFO:root:teuthology version: 0.0.1.dev209+g5ae09a5 2023-11-28T18:19:38.523 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_vshankar@teuthology --verbose --name vshankar-2023-11-28_06:23:42-fs-wip-vshankar-testing-20231127.102654-testing-default-smithi --archive /home/teuthworker/archive/vshankar-2023-11-28_06:23:42-fs-wip-vshankar-testing-20231127.102654-testing-default-smithi/7469486 --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/journal-repair} -- /home/teuthworker/archive/vshankar-2023-11-28_06:23:42-fs-wip-vshankar-testing-20231127.102654-testing-default-smithi/7469486/orig.config.yaml 2023-11-28T18:19:38.575 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T18:19:38.652 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2023-11-28_06:23:42-fs-wip-vshankar-testing-20231127.102654-testing-default-smithi/7469486 branch: wip-vshankar-testing-20231127.102654 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/journal-repair} email: vshankar@redhat.com first_in_suite: false job_id: '7469486' kernel: flavor: default kdb: true sha1: 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2023-11-28_06:23:42-fs-wip-vshankar-testing-20231127.102654-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-vshankar-testing-20231127.102654 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - bad backtrace on directory inode - error reading table object - Metadata damage detected - slow requests are blocked - Behind on trimming - error reading sessionmap sha1: 47c1c547372ed5bff7984647dc200bac0e019caf ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 47c1c547372ed5bff7984647dc200bac0e019caf thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20231127.102654 sha1: 47c1c547372ed5bff7984647dc200bac0e019caf owner: scheduled_vshankar@teuthology priority: 100 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 1098 sha1: 47c1c547372ed5bff7984647dc200bac0e019caf sleep_before_teardown: 0 subset: 854/1024 suite: fs suite_branch: wip-vshankar-testing-20231127.102654 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 47c1c547372ed5bff7984647dc200bac0e019caf syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi045.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO16mfo2YJwKMp9bM1nAYO5R82ro39MRsb9PrdrGfzI43Z0tLZWGKA2T5lA7/xusESnDMyyu2qu3FCDOmFHy5fg= smithi190.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHXujc9ROsTW79sBjfOC7xjF7CZ5m3fIs4Q/SQfbq0OH3J5zRh+BxWYYOwmXayzav2UV2K5W6iMSNkNHSZ4j8vI= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_journal_repair teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 5ae09a5cc7064ca2bf994df19f3006b79794789a timestamp: 2023-11-28_06:23:42 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 2023-11-28T18:19:38.652 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa; will attempt to use it 2023-11-28T18:19:38.653 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks 2023-11-28T18:19:38.653 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-11-28T18:19:38.655 INFO:teuthology.task.internal:Checking packages... 2023-11-28T18:19:38.679 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '47c1c547372ed5bff7984647dc200bac0e019caf' 2023-11-28T18:19:38.679 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-11-28T18:19:38.679 INFO:teuthology.packaging:ref: None 2023-11-28T18:19:38.679 INFO:teuthology.packaging:tag: None 2023-11-28T18:19:38.679 INFO:teuthology.packaging:branch: wip-vshankar-testing-20231127.102654 2023-11-28T18:19:38.679 INFO:teuthology.packaging:sha1: 47c1c547372ed5bff7984647dc200bac0e019caf 2023-11-28T18:19:38.679 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-vshankar-testing-20231127.102654 2023-11-28T18:19:38.892 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-7531-g47c1c547-1jammy 2023-11-28T18:19:38.892 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-11-28T18:19:38.898 INFO:teuthology.task.internal:no buildpackages task found 2023-11-28T18:19:38.899 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-11-28T18:19:38.962 INFO:teuthology.task.internal:Saving configuration 2023-11-28T18:19:38.980 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-11-28T18:19:38.987 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-28T18:19:39.013 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi045.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-11-28_06:23:42-fs-wip-vshankar-testing-20231127.102654-testing-default-smithi/7469486', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 18:14:17.617708', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILB+cqLPvQBrNMFgdzirtt1nx+t4oqXfwL8h25ZxC3+n'} 2023-11-28T18:19:39.040 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi190.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-11-28_06:23:42-fs-wip-vshankar-testing-20231127.102654-testing-default-smithi/7469486', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 18:14:17.618887', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOSbhlQnQrmnIQmJ/kqr0C8booVlUEtXuMCUaQ5LrkSD'} 2023-11-28T18:19:39.040 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-11-28T18:19:39.046 INFO:teuthology.task.internal:roles: ubuntu@smithi045.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-11-28T18:19:39.046 INFO:teuthology.task.internal:roles: ubuntu@smithi190.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-11-28T18:19:39.046 INFO:teuthology.run_tasks:Running task console_log... 2023-11-28T18:19:39.113 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fccb8f0b040>, signals=[15]) 2023-11-28T18:19:39.113 INFO:teuthology.run_tasks:Running task internal.connect... 2023-11-28T18:19:39.119 INFO:teuthology.task.internal:Opening connections... 2023-11-28T18:19:39.120 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi045.front.sepia.ceph.com 2023-11-28T18:19:39.122 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T18:19:39.200 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi190.front.sepia.ceph.com 2023-11-28T18:19:39.201 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T18:19:39.277 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-11-28T18:19:39.284 DEBUG:teuthology.orchestra.run.smithi045:> uname -m 2023-11-28T18:19:39.289 INFO:teuthology.orchestra.run.smithi045.stdout:x86_64 2023-11-28T18:19:39.290 DEBUG:teuthology.orchestra.run.smithi045:> cat /etc/os-release 2023-11-28T18:19:39.334 INFO:teuthology.orchestra.run.smithi045.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-28T18:19:39.334 INFO:teuthology.orchestra.run.smithi045.stdout:NAME="Ubuntu" 2023-11-28T18:19:39.334 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION_ID="22.04" 2023-11-28T18:19:39.335 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-28T18:19:39.335 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION_CODENAME=jammy 2023-11-28T18:19:39.335 INFO:teuthology.orchestra.run.smithi045.stdout:ID=ubuntu 2023-11-28T18:19:39.335 INFO:teuthology.orchestra.run.smithi045.stdout:ID_LIKE=debian 2023-11-28T18:19:39.335 INFO:teuthology.orchestra.run.smithi045.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-28T18:19:39.335 INFO:teuthology.orchestra.run.smithi045.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-28T18:19:39.335 INFO:teuthology.orchestra.run.smithi045.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-28T18:19:39.336 INFO:teuthology.orchestra.run.smithi045.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-28T18:19:39.336 INFO:teuthology.orchestra.run.smithi045.stdout:UBUNTU_CODENAME=jammy 2023-11-28T18:19:39.337 INFO:teuthology.lock.ops:Updating smithi045.front.sepia.ceph.com on lock server 2023-11-28T18:19:39.360 DEBUG:teuthology.orchestra.run.smithi190:> uname -m 2023-11-28T18:19:39.365 INFO:teuthology.orchestra.run.smithi190.stdout:x86_64 2023-11-28T18:19:39.365 DEBUG:teuthology.orchestra.run.smithi190:> cat /etc/os-release 2023-11-28T18:19:39.415 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-28T18:19:39.415 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="Ubuntu" 2023-11-28T18:19:39.416 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="22.04" 2023-11-28T18:19:39.416 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-28T18:19:39.416 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_CODENAME=jammy 2023-11-28T18:19:39.416 INFO:teuthology.orchestra.run.smithi190.stdout:ID=ubuntu 2023-11-28T18:19:39.416 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE=debian 2023-11-28T18:19:39.416 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-28T18:19:39.416 INFO:teuthology.orchestra.run.smithi190.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-28T18:19:39.416 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-28T18:19:39.416 INFO:teuthology.orchestra.run.smithi190.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-28T18:19:39.416 INFO:teuthology.orchestra.run.smithi190.stdout:UBUNTU_CODENAME=jammy 2023-11-28T18:19:39.417 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server 2023-11-28T18:19:39.434 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-11-28T18:19:39.444 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-11-28T18:19:39.450 INFO:teuthology.task.internal:Checking for old test directory... 2023-11-28T18:19:39.450 DEBUG:teuthology.orchestra.run.smithi045:> test '!' -e /home/ubuntu/cephtest 2023-11-28T18:19:39.452 DEBUG:teuthology.orchestra.run.smithi190:> test '!' -e /home/ubuntu/cephtest 2023-11-28T18:19:39.462 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-11-28T18:19:39.468 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-11-28T18:19:39.468 DEBUG:teuthology.orchestra.run.smithi045:> test -z $(ls -A /var/lib/ceph) 2023-11-28T18:19:39.500 DEBUG:teuthology.orchestra.run.smithi190:> test -z $(ls -A /var/lib/ceph) 2023-11-28T18:19:39.516 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-11-28T18:19:39.571 INFO:teuthology.run_tasks:Running task kernel... 2023-11-28T18:19:39.586 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': '8247bbb5b470f7e2a1f3eefcc16e24cf1338f606'} 2023-11-28T18:19:39.586 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': '8247bbb5b470f7e2a1f3eefcc16e24cf1338f606'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': '8247bbb5b470f7e2a1f3eefcc16e24cf1338f606'}}, timeout 300 2023-11-28T18:19:39.587 DEBUG:teuthology.orchestra.run.smithi045:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-28T18:19:39.587 DEBUG:teuthology.orchestra.run.smithi190:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-28T18:19:39.592 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T18:19:39.592 DEBUG:teuthology.task.kernel:sha1 for mon.a is 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-28T18:19:39.592 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "8247bbb5b470f7e2a1f3eefcc16e24cf1338f606"... 2023-11-28T18:19:39.592 DEBUG:teuthology.orchestra.run.smithi045:> uname -r 2023-11-28T18:19:39.593 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T18:19:39.594 DEBUG:teuthology.task.kernel:sha1 for mon.b is 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-28T18:19:39.594 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "8247bbb5b470f7e2a1f3eefcc16e24cf1338f606"... 2023-11-28T18:19:39.594 DEBUG:teuthology.orchestra.run.smithi190:> uname -r 2023-11-28T18:19:39.639 INFO:teuthology.orchestra.run.smithi190.stdout:5.15.0-56-generic 2023-11-28T18:19:39.640 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-28T18:19:39.640 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-11-28T18:19:39.640 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-28T18:19:39.647 INFO:teuthology.orchestra.run.smithi045.stdout:5.15.0-56-generic 2023-11-28T18:19:39.647 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-28T18:19:39.647 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-11-28T18:19:39.647 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-28T18:19:39.789 INFO:teuthology.task.kernel:Installing linux-firmware on mon.b... 2023-11-28T18:19:39.790 DEBUG:teuthology.orchestra.run.smithi190:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-11-28T18:19:39.794 INFO:teuthology.task.kernel:Installing linux-firmware on mon.a... 2023-11-28T18:19:39.794 DEBUG:teuthology.orchestra.run.smithi045:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-11-28T18:19:39.810 INFO:teuthology.orchestra.run.smithi190.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2023-11-28T18:19:39.821 INFO:teuthology.orchestra.run.smithi045.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2023-11-28T18:19:39.952 INFO:teuthology.orchestra.run.smithi045.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2023-11-28T18:19:39.952 INFO:teuthology.orchestra.run.smithi045.stderr:hint: is subject to change. To configure the initial branch name to use in all 2023-11-28T18:19:39.952 INFO:teuthology.orchestra.run.smithi045.stderr:hint: of your new repositories, which will suppress this warning, call: 2023-11-28T18:19:39.952 INFO:teuthology.orchestra.run.smithi045.stderr:hint: 2023-11-28T18:19:39.952 INFO:teuthology.orchestra.run.smithi045.stderr:hint: git config --global init.defaultBranch 2023-11-28T18:19:39.952 INFO:teuthology.orchestra.run.smithi045.stderr:hint: 2023-11-28T18:19:39.952 INFO:teuthology.orchestra.run.smithi045.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-11-28T18:19:39.952 INFO:teuthology.orchestra.run.smithi045.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2023-11-28T18:19:39.952 INFO:teuthology.orchestra.run.smithi045.stderr:hint: 2023-11-28T18:19:39.952 INFO:teuthology.orchestra.run.smithi045.stderr:hint: git branch -m 2023-11-28T18:19:39.953 INFO:teuthology.orchestra.run.smithi045.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-11-28T18:19:39.954 DEBUG:teuthology.orchestra.run.smithi045:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-11-28T18:19:39.963 INFO:teuthology.orchestra.run.smithi190.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2023-11-28T18:19:39.963 INFO:teuthology.orchestra.run.smithi190.stderr:hint: is subject to change. To configure the initial branch name to use in all 2023-11-28T18:19:39.963 INFO:teuthology.orchestra.run.smithi190.stderr:hint: of your new repositories, which will suppress this warning, call: 2023-11-28T18:19:39.963 INFO:teuthology.orchestra.run.smithi190.stderr:hint: 2023-11-28T18:19:39.963 INFO:teuthology.orchestra.run.smithi190.stderr:hint: git config --global init.defaultBranch 2023-11-28T18:19:39.963 INFO:teuthology.orchestra.run.smithi190.stderr:hint: 2023-11-28T18:19:39.963 INFO:teuthology.orchestra.run.smithi190.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-11-28T18:19:39.963 INFO:teuthology.orchestra.run.smithi190.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2023-11-28T18:19:39.964 INFO:teuthology.orchestra.run.smithi190.stderr:hint: 2023-11-28T18:19:39.964 INFO:teuthology.orchestra.run.smithi190.stderr:hint: git branch -m 2023-11-28T18:19:39.964 INFO:teuthology.orchestra.run.smithi190.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-11-28T18:19:39.967 DEBUG:teuthology.orchestra.run.smithi190:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-11-28T18:19:40.021 DEBUG:teuthology.orchestra.run.smithi045:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-11-28T18:19:40.030 DEBUG:teuthology.orchestra.run.smithi190:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-11-28T18:19:40.075 DEBUG:teuthology.orchestra.run.smithi045:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-11-28T18:19:40.085 DEBUG:teuthology.orchestra.run.smithi190:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-11-28T18:21:41.788 INFO:teuthology.orchestra.run.smithi190.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-11-28T18:21:41.789 INFO:teuthology.orchestra.run.smithi190.stderr: * [new branch] main -> origin/main 2023-11-28T18:21:41.819 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20190312 -> 20190312 2023-11-28T18:21:41.819 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20190416 -> 20190416 2023-11-28T18:21:41.819 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20190514 -> 20190514 2023-11-28T18:21:41.819 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20190618 -> 20190618 2023-11-28T18:21:41.820 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20190717 -> 20190717 2023-11-28T18:21:41.820 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20190815 -> 20190815 2023-11-28T18:21:41.820 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20190923 -> 20190923 2023-11-28T18:21:41.821 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20191022 -> 20191022 2023-11-28T18:21:41.821 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20191215 -> 20191215 2023-11-28T18:21:41.821 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20200122 -> 20200122 2023-11-28T18:21:41.821 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20200316 -> 20200316 2023-11-28T18:21:41.821 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20200421 -> 20200421 2023-11-28T18:21:41.822 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20200519 -> 20200519 2023-11-28T18:21:41.822 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20200619 -> 20200619 2023-11-28T18:21:41.822 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20200721 -> 20200721 2023-11-28T18:21:41.822 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20200817 -> 20200817 2023-11-28T18:21:41.822 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20200918 -> 20200918 2023-11-28T18:21:41.822 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20201022 -> 20201022 2023-11-28T18:21:41.823 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20201118 -> 20201118 2023-11-28T18:21:41.823 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20201218 -> 20201218 2023-11-28T18:21:41.823 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20210208 -> 20210208 2023-11-28T18:21:41.825 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20210315 -> 20210315 2023-11-28T18:21:41.825 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20210511 -> 20210511 2023-11-28T18:21:41.825 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20210716 -> 20210716 2023-11-28T18:21:41.825 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20210818 -> 20210818 2023-11-28T18:21:41.825 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20210919 -> 20210919 2023-11-28T18:21:41.825 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20211027 -> 20211027 2023-11-28T18:21:41.825 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20211216 -> 20211216 2023-11-28T18:21:41.825 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20220209 -> 20220209 2023-11-28T18:21:41.825 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20220310 -> 20220310 2023-11-28T18:21:41.826 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20220411 -> 20220411 2023-11-28T18:21:41.826 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20220509 -> 20220509 2023-11-28T18:21:41.826 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20220610 -> 20220610 2023-11-28T18:21:41.828 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20220708 -> 20220708 2023-11-28T18:21:41.828 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20220815 -> 20220815 2023-11-28T18:21:41.828 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20220913 -> 20220913 2023-11-28T18:21:41.828 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20221012 -> 20221012 2023-11-28T18:21:41.828 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20221109 -> 20221109 2023-11-28T18:21:41.828 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20221214 -> 20221214 2023-11-28T18:21:41.828 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20230117 -> 20230117 2023-11-28T18:21:41.828 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20230210 -> 20230210 2023-11-28T18:21:41.828 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20230310 -> 20230310 2023-11-28T18:21:41.828 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20230404 -> 20230404 2023-11-28T18:21:41.829 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20230515 -> 20230515 2023-11-28T18:21:41.829 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20230625 -> 20230625 2023-11-28T18:21:41.829 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20230804 -> 20230804 2023-11-28T18:21:41.829 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20230919 -> 20230919 2023-11-28T18:21:41.829 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20231030 -> 20231030 2023-11-28T18:21:41.829 INFO:teuthology.orchestra.run.smithi190.stderr: * [new tag] 20231111 -> 20231111 2023-11-28T18:21:45.804 INFO:teuthology.orchestra.run.smithi190.stderr:Updating files: 51% (1670/3250) Updating files: 52% (1690/3250) Updating files: 53% (1723/3250) Updating files: 54% (1755/3250) Updating files: 55% (1788/3250) Updating files: 56% (1820/3250) Updating files: 57% (1853/3250) Updating files: 58% (1885/3250) Updating files: 59% (1918/3250) Updating files: 60% (1950/3250) Updating files: 61% (1983/3250) Updating files: 62% (2015/3250) Updating files: 63% (2048/3250) Updating files: 64% (2080/3250) Updating files: 65% (2113/3250) Updating files: 65% (2116/3250) Updating files: 66% (2145/3250) Updating files: 67% (2178/3250) Updating files: 68% (2210/3250) Updating files: 69% (2243/3250) Updating files: 70% (2275/3250) Updating files: 71% (2308/3250) Updating files: 72% (2340/3250) Updating files: 73% (2373/3250) Updating files: 74% (2405/3250) Updating files: 75% (2438/3250) Updating files: 76% (2470/3250) Updating files: 77% (2503/3250) Updating files: 78% (2535/3250) Updating files: 79% (2568/3250) Updating files: 80% (2600/3250) Updating files: 81% (2633/3250) Updating files: 81% (2655/3250) Updating files: 82% (2665/3250) Updating files: 83% (2698/3250) Updating files: 84% (2730/3250) Updating files: 85% (2763/3250) Updating files: 86% (2795/3250) Updating files: 87% (2828/3250) Updating files: 88% (2860/3250) Updating files: 89% (2893/3250) Updating files: 90% (2925/3250) Updating files: 91% (2958/3250) Updating files: 92% (2990/3250) Updating files: 93% (3023/3250) Updating files: 94% (3055/3250) Updating files: 95% (3088/3250) Updating files: 96% (3120/3250) Updating files: 97% (3153/3250) Updating files: 98% (3185/3250) Updating files: 99% (3218/3250) Updating files: 100% (3250/3250) Updating files: 100% (3250/3250), done. 2023-11-28T18:21:45.809 INFO:teuthology.orchestra.run.smithi190.stdout:HEAD is now at aae60524 Merge branch 'make-opts' into 'main' 2023-11-28T18:21:45.830 INFO:teuthology.task.kernel:Downloading kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on mon.b... 2023-11-28T18:21:45.830 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-28T18:21:45.976 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/ 2023-11-28T18:21:45.977 DEBUG:teuthology.orchestra.run.smithi190:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-g8247bbb5b470_6.6.0-g8247bbb5b470-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/ --input-file=- 2023-11-28T18:21:45.979 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi190.front.sepia.ceph.com to complete... 2023-11-28T18:21:47.489 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28 18:21:47 URL:https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/linux-image-6.6.0-g8247bbb5b470_6.6.0-g8247bbb5b470-1_amd64.deb [38938726/38938726] -> "/tmp/linux-image.deb" [1] 2023-11-28T18:21:47.489 INFO:teuthology.orchestra.run.smithi190.stderr:FINISHED --2023-11-28 18:21:47-- 2023-11-28T18:21:47.489 INFO:teuthology.orchestra.run.smithi190.stderr:Total wall clock time: 1.5s 2023-11-28T18:21:47.490 INFO:teuthology.orchestra.run.smithi190.stderr:Downloaded: 1 files, 37M in 1.4s (27.5 MB/s) 2023-11-28T18:21:47.492 INFO:teuthology.task.kernel:Installing kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on mon.b... 2023-11-28T18:21:47.492 DEBUG:teuthology.orchestra.run.smithi190:> sudo dpkg -i /tmp/linux-image.deb 2023-11-28T18:21:47.734 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package linux-image-6.6.0-g8247bbb5b470. 2023-11-28T18:21:49.673 INFO:teuthology.orchestra.run.smithi190.stdout:(Reading database ... 129542 files and directories currently installed.) 2023-11-28T18:21:49.677 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-11-28T18:21:49.770 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking linux-image-6.6.0-g8247bbb5b470 (6.6.0-g8247bbb5b470-1) ... 2023-11-28T18:21:53.192 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up linux-image-6.6.0-g8247bbb5b470 (6.6.0-g8247bbb5b470-1) ... 2023-11-28T18:21:53.300 INFO:teuthology.orchestra.run.smithi190.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-28T18:21:59.954 INFO:teuthology.orchestra.run.smithi045.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-11-28T18:21:59.954 INFO:teuthology.orchestra.run.smithi045.stderr: * [new branch] main -> origin/main 2023-11-28T18:21:59.979 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20190312 -> 20190312 2023-11-28T18:21:59.979 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20190416 -> 20190416 2023-11-28T18:21:59.979 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20190514 -> 20190514 2023-11-28T18:21:59.979 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20190618 -> 20190618 2023-11-28T18:21:59.980 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20190717 -> 20190717 2023-11-28T18:21:59.980 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20190815 -> 20190815 2023-11-28T18:21:59.981 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20190923 -> 20190923 2023-11-28T18:21:59.981 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20191022 -> 20191022 2023-11-28T18:21:59.981 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20191215 -> 20191215 2023-11-28T18:21:59.981 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20200122 -> 20200122 2023-11-28T18:21:59.982 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20200316 -> 20200316 2023-11-28T18:21:59.982 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20200421 -> 20200421 2023-11-28T18:21:59.982 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20200519 -> 20200519 2023-11-28T18:21:59.982 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20200619 -> 20200619 2023-11-28T18:21:59.982 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20200721 -> 20200721 2023-11-28T18:21:59.982 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20200817 -> 20200817 2023-11-28T18:21:59.983 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20200918 -> 20200918 2023-11-28T18:21:59.983 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20201022 -> 20201022 2023-11-28T18:21:59.983 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20201118 -> 20201118 2023-11-28T18:21:59.983 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20201218 -> 20201218 2023-11-28T18:21:59.983 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20210208 -> 20210208 2023-11-28T18:21:59.983 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20210315 -> 20210315 2023-11-28T18:21:59.984 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20210511 -> 20210511 2023-11-28T18:21:59.989 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20210716 -> 20210716 2023-11-28T18:21:59.989 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20210818 -> 20210818 2023-11-28T18:21:59.989 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20210919 -> 20210919 2023-11-28T18:21:59.989 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20211027 -> 20211027 2023-11-28T18:21:59.989 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20211216 -> 20211216 2023-11-28T18:21:59.990 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20220209 -> 20220209 2023-11-28T18:21:59.990 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20220310 -> 20220310 2023-11-28T18:21:59.990 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20220411 -> 20220411 2023-11-28T18:21:59.990 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20220509 -> 20220509 2023-11-28T18:21:59.990 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20220610 -> 20220610 2023-11-28T18:21:59.990 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20220708 -> 20220708 2023-11-28T18:21:59.991 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20220815 -> 20220815 2023-11-28T18:21:59.991 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20220913 -> 20220913 2023-11-28T18:21:59.991 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20221012 -> 20221012 2023-11-28T18:21:59.991 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20221109 -> 20221109 2023-11-28T18:21:59.991 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20221214 -> 20221214 2023-11-28T18:21:59.991 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20230117 -> 20230117 2023-11-28T18:21:59.991 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20230210 -> 20230210 2023-11-28T18:21:59.991 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20230310 -> 20230310 2023-11-28T18:21:59.991 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20230404 -> 20230404 2023-11-28T18:21:59.992 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20230515 -> 20230515 2023-11-28T18:21:59.992 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20230625 -> 20230625 2023-11-28T18:21:59.992 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20230804 -> 20230804 2023-11-28T18:21:59.992 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20230919 -> 20230919 2023-11-28T18:21:59.992 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20231030 -> 20231030 2023-11-28T18:21:59.993 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20231111 -> 20231111 2023-11-28T18:22:04.219 INFO:teuthology.orchestra.run.smithi045.stderr:Updating files: 48% (1573/3250) Updating files: 49% (1593/3250) Updating files: 50% (1625/3250) Updating files: 51% (1658/3250) Updating files: 52% (1690/3250) Updating files: 53% (1723/3250) Updating files: 54% (1755/3250) Updating files: 55% (1788/3250) Updating files: 56% (1820/3250) Updating files: 57% (1853/3250) Updating files: 58% (1885/3250) Updating files: 59% (1918/3250) Updating files: 60% (1950/3250) Updating files: 61% (1983/3250) Updating files: 62% (2015/3250) Updating files: 63% (2048/3250) Updating files: 63% (2065/3250) Updating files: 64% (2080/3250) Updating files: 65% (2113/3250) Updating files: 66% (2145/3250) Updating files: 67% (2178/3250) Updating files: 68% (2210/3250) Updating files: 69% (2243/3250) Updating files: 70% (2275/3250) Updating files: 71% (2308/3250) Updating files: 72% (2340/3250) Updating files: 73% (2373/3250) Updating files: 74% (2405/3250) Updating files: 75% (2438/3250) Updating files: 76% (2470/3250) Updating files: 77% (2503/3250) Updating files: 78% (2535/3250) Updating files: 78% (2552/3250) Updating files: 79% (2568/3250) Updating files: 80% (2600/3250) Updating files: 81% (2633/3250) Updating files: 82% (2665/3250) Updating files: 83% (2698/3250) Updating files: 84% (2730/3250) Updating files: 84% (2731/3250) Updating files: 85% (2763/3250) Updating files: 86% (2795/3250) Updating files: 87% (2828/3250) Updating files: 88% (2860/3250) Updating files: 89% (2893/3250) Updating files: 90% (2925/3250) Updating files: 91% (2958/3250) Updating files: 92% (2990/3250) Updating files: 93% (3023/3250) Updating files: 94% (3055/3250) Updating files: 95% (3088/3250) Updating files: 96% (3120/3250) Updating files: 97% (3153/3250) Updating files: 98% (3185/3250) Updating files: 99% (3218/3250) Updating files: 100% (3250/3250) Updating files: 100% (3250/3250), done. 2023-11-28T18:22:04.224 INFO:teuthology.orchestra.run.smithi045.stdout:HEAD is now at aae60524 Merge branch 'make-opts' into 'main' 2023-11-28T18:22:04.247 INFO:teuthology.task.kernel:Downloading kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on mon.a... 2023-11-28T18:22:04.247 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-28T18:22:04.395 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/ 2023-11-28T18:22:04.396 DEBUG:teuthology.orchestra.run.smithi045:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-g8247bbb5b470_6.6.0-g8247bbb5b470-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/ --input-file=- 2023-11-28T18:22:04.399 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi045.front.sepia.ceph.com to complete... 2023-11-28T18:22:05.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28 18:22:05 URL:https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/linux-image-6.6.0-g8247bbb5b470_6.6.0-g8247bbb5b470-1_amd64.deb [38938726/38938726] -> "/tmp/linux-image.deb" [1] 2023-11-28T18:22:05.909 INFO:teuthology.orchestra.run.smithi045.stderr:FINISHED --2023-11-28 18:22:05-- 2023-11-28T18:22:05.909 INFO:teuthology.orchestra.run.smithi045.stderr:Total wall clock time: 1.5s 2023-11-28T18:22:05.909 INFO:teuthology.orchestra.run.smithi045.stderr:Downloaded: 1 files, 37M in 1.4s (27.3 MB/s) 2023-11-28T18:22:05.912 INFO:teuthology.task.kernel:Installing kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on mon.a... 2023-11-28T18:22:05.912 DEBUG:teuthology.orchestra.run.smithi045:> sudo dpkg -i /tmp/linux-image.deb 2023-11-28T18:22:06.164 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package linux-image-6.6.0-g8247bbb5b470. 2023-11-28T18:22:08.153 INFO:teuthology.orchestra.run.smithi045.stdout:(Reading database ... 129542 files and directories currently installed.) 2023-11-28T18:22:08.157 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-11-28T18:22:08.280 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking linux-image-6.6.0-g8247bbb5b470 (6.6.0-g8247bbb5b470-1) ... 2023-11-28T18:22:12.118 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up linux-image-6.6.0-g8247bbb5b470 (6.6.0-g8247bbb5b470-1) ... 2023-11-28T18:22:12.212 INFO:teuthology.orchestra.run.smithi045.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-28T18:22:13.747 INFO:teuthology.orchestra.run.smithi190.stderr:Sourcing file `/etc/default/grub' 2023-11-28T18:22:13.767 INFO:teuthology.orchestra.run.smithi190.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-28T18:22:13.796 INFO:teuthology.orchestra.run.smithi190.stderr:Generating grub configuration file ... 2023-11-28T18:22:14.122 INFO:teuthology.orchestra.run.smithi190.stderr:Found linux image: /boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-28T18:22:14.147 INFO:teuthology.orchestra.run.smithi190.stderr:Found initrd image: /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-28T18:22:14.442 INFO:teuthology.orchestra.run.smithi190.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-28T18:22:14.454 INFO:teuthology.orchestra.run.smithi190.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-28T18:22:14.518 INFO:teuthology.orchestra.run.smithi190.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-28T18:22:14.524 INFO:teuthology.orchestra.run.smithi190.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-28T18:22:14.682 INFO:teuthology.orchestra.run.smithi190.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-28T18:22:14.683 INFO:teuthology.orchestra.run.smithi190.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-11-28T18:22:14.683 INFO:teuthology.orchestra.run.smithi190.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-28T18:22:14.726 INFO:teuthology.orchestra.run.smithi190.stderr:done 2023-11-28T18:22:14.881 DEBUG:teuthology.orchestra.run.smithi190:> dpkg-deb -c /tmp/linux-image.deb 2023-11-28T18:22:14.889 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./ 2023-11-28T18:22:14.889 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./boot/ 2023-11-28T18:22:14.889 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 4415617 2023-11-23 03:47 ./boot/System.map-6.6.0-g8247bbb5b470 2023-11-28T18:22:14.902 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 169214 2023-11-23 03:47 ./boot/config-6.6.0-g8247bbb5b470 2023-11-28T18:22:14.902 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11352832 2023-11-23 03:47 ./boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-28T18:22:14.921 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/ 2023-11-28T18:22:14.921 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/ 2023-11-28T18:22:14.922 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/postinst.d/ 2023-11-28T18:22:14.922 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/postrm.d/ 2023-11-28T18:22:14.922 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/preinst.d/ 2023-11-28T18:22:14.922 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/prerm.d/ 2023-11-28T18:22:14.922 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/ 2023-11-28T18:22:14.922 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/ 2023-11-28T18:22:14.923 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/ 2023-11-28T18:22:14.923 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/ 2023-11-28T18:22:14.923 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/ 2023-11-28T18:22:14.923 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/ 2023-11-28T18:22:14.923 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/ 2023-11-28T18:22:14.923 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 490233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/aesni-intel.ko 2023-11-28T18:22:14.923 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 25329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-11-28T18:22:14.923 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 29529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-11-28T18:22:14.923 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 30313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-11-28T18:22:14.923 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 93113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-11-28T18:22:14.923 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 106729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-11-28T18:22:14.924 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 152241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-11-28T18:22:14.924 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-11-28T18:22:14.924 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-11-28T18:22:14.925 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 83889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-11-28T18:22:14.926 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-11-28T18:22:14.926 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 47225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-11-28T18:22:14.928 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 47209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx2.ko 2023-11-28T18:22:14.928 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 51801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-11-28T18:22:14.929 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 38937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-11-28T18:22:14.929 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 40529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-11-28T18:22:14.929 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 58585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-11-28T18:22:14.929 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 50497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-11-28T18:22:14.929 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 32065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-11-28T18:22:14.929 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-11-28T18:22:14.929 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/ 2023-11-28T18:22:14.929 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/ 2023-11-28T18:22:14.929 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce/ 2023-11-28T18:22:14.929 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 40113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-11-28T18:22:14.929 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpuid.ko 2023-11-28T18:22:14.929 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/msr.ko 2023-11-28T18:22:14.930 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/ 2023-11-28T18:22:14.930 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 354433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-amd.ko 2023-11-28T18:22:14.930 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 881625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-intel.ko 2023-11-28T18:22:14.930 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 2275865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm.ko 2023-11-28T18:22:14.972 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ 2023-11-28T18:22:14.973 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 53697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/af_alg.ko 2023-11-28T18:22:14.973 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 23097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/algif_hash.ko 2023-11-28T18:22:14.973 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/algif_skcipher.ko 2023-11-28T18:22:14.973 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ansi_cprng.ko 2023-11-28T18:22:14.973 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/anubis.ko 2023-11-28T18:22:14.973 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/arc4.ko 2023-11-28T18:22:14.973 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/asymmetric_keys/ 2023-11-28T18:22:14.973 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-11-28T18:22:14.973 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/ 2023-11-28T18:22:14.973 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_memcpy.ko 2023-11-28T18:22:14.973 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_pq.ko 2023-11-28T18:22:14.974 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 21561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_raid6_recov.ko 2023-11-28T18:22:14.974 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_tx.ko 2023-11-28T18:22:14.974 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_xor.ko 2023-11-28T18:22:14.974 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/raid6test.ko 2023-11-28T18:22:14.974 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authenc.ko 2023-11-28T18:22:14.974 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 22577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authencesn.ko 2023-11-28T18:22:14.974 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 21817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blake2b_generic.ko 2023-11-28T18:22:14.974 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_common.ko 2023-11-28T18:22:14.974 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_generic.ko 2023-11-28T18:22:14.974 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 38809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/camellia_generic.ko 2023-11-28T18:22:14.974 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 27321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast5_generic.ko 2023-11-28T18:22:14.974 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast6_generic.ko 2023-11-28T18:22:14.975 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast_common.ko 2023-11-28T18:22:14.975 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 35097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ccm.ko 2023-11-28T18:22:14.975 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cmac.ko 2023-11-28T18:22:14.975 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crc32_generic.ko 2023-11-28T18:22:14.975 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 47505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cryptd.ko 2023-11-28T18:22:14.975 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 39505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_engine.ko 2023-11-28T18:22:14.975 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_simd.ko 2023-11-28T18:22:14.975 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 24737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_user.ko 2023-11-28T18:22:14.975 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cts.ko 2023-11-28T18:22:14.975 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/des_generic.ko 2023-11-28T18:22:14.975 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/dh_generic.ko 2023-11-28T18:22:14.975 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/echainiv.ko 2023-11-28T18:22:14.975 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 25321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/essiv.ko 2023-11-28T18:22:14.976 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/fcrypt.ko 2023-11-28T18:22:14.976 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/khazad.ko 2023-11-28T18:22:14.976 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lrw.ko 2023-11-28T18:22:14.976 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4.ko 2023-11-28T18:22:14.976 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4hc.ko 2023-11-28T18:22:14.976 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/md4.ko 2023-11-28T18:22:14.976 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/michael_mic.ko 2023-11-28T18:22:14.976 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcbc.ko 2023-11-28T18:22:14.976 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcrypt.ko 2023-11-28T18:22:14.976 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/rmd160.ko 2023-11-28T18:22:14.976 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 29393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/seed.ko 2023-11-28T18:22:14.976 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 27081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/serpent_generic.ko 2023-11-28T18:22:14.977 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 149193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tcrypt.ko 2023-11-28T18:22:14.977 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tea.ko 2023-11-28T18:22:14.977 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 28777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_common.ko 2023-11-28T18:22:14.977 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_generic.ko 2023-11-28T18:22:14.977 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/vmac.ko 2023-11-28T18:22:14.977 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 36185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/wp512.ko 2023-11-28T18:22:14.977 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xcbc.ko 2023-11-28T18:22:14.977 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xor.ko 2023-11-28T18:22:14.977 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xts.ko 2023-11-28T18:22:14.977 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xxhash_generic.ko 2023-11-28T18:22:14.977 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ 2023-11-28T18:22:14.977 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/ 2023-11-28T18:22:14.978 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_extlog.ko 2023-11-28T18:22:14.978 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_ipmi.ko 2023-11-28T18:22:14.978 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 28793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_pad.ko 2023-11-28T18:22:14.978 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/apei/ 2023-11-28T18:22:14.978 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 31241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/apei/einj.ko 2023-11-28T18:22:14.978 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/ec_sys.ko 2023-11-28T18:22:14.978 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/platform_profile.ko 2023-11-28T18:22:14.978 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 24401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbs.ko 2023-11-28T18:22:14.978 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbshc.ko 2023-11-28T18:22:14.978 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 103025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/video.ko 2023-11-28T18:22:14.978 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ 2023-11-28T18:22:14.978 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 21601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/acard-ahci.ko 2023-11-28T18:22:14.978 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 88865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ahci.ko 2023-11-28T18:22:14.979 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ahci_platform.ko 2023-11-28T18:22:14.979 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 88289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/libahci.ko 2023-11-28T18:22:14.979 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 34985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/libahci_platform.ko 2023-11-28T18:22:14.979 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_acpi.ko 2023-11-28T18:22:14.979 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 30433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ali.ko 2023-11-28T18:22:14.979 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 33505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_amd.ko 2023-11-28T18:22:14.979 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 21265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_artop.ko 2023-11-28T18:22:14.979 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 21121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atiixp.ko 2023-11-28T18:22:14.979 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 24945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atp867x.ko 2023-11-28T18:22:14.979 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd640.ko 2023-11-28T18:22:14.979 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 25185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd64x.ko 2023-11-28T18:22:14.979 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cypress.ko 2023-11-28T18:22:14.980 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_efar.ko 2023-11-28T18:22:14.980 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 21945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt366.ko 2023-11-28T18:22:14.980 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 33977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt37x.ko 2023-11-28T18:22:14.980 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 23129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x2n.ko 2023-11-28T18:22:14.980 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x3.ko 2023-11-28T18:22:14.980 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it8213.ko 2023-11-28T18:22:14.980 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 35273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it821x.ko 2023-11-28T18:22:14.980 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_jmicron.ko 2023-11-28T18:22:14.980 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 51481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_legacy.ko 2023-11-28T18:22:14.980 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_marvell.ko 2023-11-28T18:22:14.980 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_mpiix.ko 2023-11-28T18:22:14.980 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_netcell.ko 2023-11-28T18:22:14.980 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ninja32.ko 2023-11-28T18:22:14.981 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87410.ko 2023-11-28T18:22:14.981 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87415.ko 2023-11-28T18:22:14.981 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_oldpiix.ko 2023-11-28T18:22:14.981 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_opti.ko 2023-11-28T18:22:14.981 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_optidma.ko 2023-11-28T18:22:14.981 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 32585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pcmcia.ko 2023-11-28T18:22:14.981 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 37793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc2027x.ko 2023-11-28T18:22:14.981 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-11-28T18:22:14.981 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_piccolo.ko 2023-11-28T18:22:14.981 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_radisys.ko 2023-11-28T18:22:14.981 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_rdc.ko 2023-11-28T18:22:14.981 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_rz1000.ko 2023-11-28T18:22:14.981 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sch.ko 2023-11-28T18:22:14.982 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 23097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_serverworks.ko 2023-11-28T18:22:14.982 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 23457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sil680.ko 2023-11-28T18:22:14.982 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sl82c105.ko 2023-11-28T18:22:14.982 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_triflex.ko 2023-11-28T18:22:14.982 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 30433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_via.ko 2023-11-28T18:22:14.982 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 22793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pdc_adma.ko 2023-11-28T18:22:14.982 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 29121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_inic162x.ko 2023-11-28T18:22:14.982 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 83345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_mv.ko 2023-11-28T18:22:14.982 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 70393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_nv.ko 2023-11-28T18:22:14.982 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 37377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_promise.ko 2023-11-28T18:22:14.982 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 23041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_qstor.ko 2023-11-28T18:22:14.982 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 29273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil.ko 2023-11-28T18:22:14.983 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 38337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil24.ko 2023-11-28T18:22:14.983 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sis.ko 2023-11-28T18:22:14.983 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_svw.ko 2023-11-28T18:22:14.983 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 44793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sx4.ko 2023-11-28T18:22:14.983 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_uli.ko 2023-11-28T18:22:14.983 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 35065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_via.ko 2023-11-28T18:22:14.983 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_vsc.ko 2023-11-28T18:22:14.983 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay/ 2023-11-28T18:22:14.983 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay/ks0108.ko 2023-11-28T18:22:14.983 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma/ 2023-11-28T18:22:14.983 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 124473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma/bcma.ko 2023-11-28T18:22:14.983 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/ 2023-11-28T18:22:14.983 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe/ 2023-11-28T18:22:14.983 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 113665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe/aoe.ko 2023-11-28T18:22:14.984 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd/ 2023-11-28T18:22:14.984 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 965585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd/drbd.ko 2023-11-28T18:22:14.984 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 173225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/floppy.ko 2023-11-28T18:22:14.984 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx/ 2023-11-28T18:22:14.984 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 94297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-11-28T18:22:14.984 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 115793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/nbd.ko 2023-11-28T18:22:14.984 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk/ 2023-11-28T18:22:14.984 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 110385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk/null_blk.ko 2023-11-28T18:22:14.984 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 98193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/pktcdvd.ko 2023-11-28T18:22:14.984 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 263769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/rbd.ko 2023-11-28T18:22:14.984 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback/ 2023-11-28T18:22:14.984 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 98145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-11-28T18:22:14.985 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram/ 2023-11-28T18:22:14.985 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 60217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram/zram.ko 2023-11-28T18:22:14.985 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ 2023-11-28T18:22:14.985 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 30705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/applicom.ko 2023-11-28T18:22:14.985 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hangcheck-timer.ko 2023-11-28T18:22:14.985 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/ 2023-11-28T18:22:14.985 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/amd-rng.ko 2023-11-28T18:22:14.985 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/intel-rng.ko 2023-11-28T18:22:14.985 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-11-28T18:22:14.985 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/via-rng.ko 2023-11-28T18:22:14.985 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/virtio-rng.ko 2023-11-28T18:22:14.985 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ 2023-11-28T18:22:14.985 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 30713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-11-28T18:22:14.986 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 148601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-11-28T18:22:14.986 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-11-28T18:22:14.986 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 139313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_si.ko 2023-11-28T18:22:14.986 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 70921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-11-28T18:22:14.986 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 53513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-11-28T18:22:14.986 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 36321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/lp.ko 2023-11-28T18:22:14.986 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave/ 2023-11-28T18:22:14.986 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 84097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave/mwave.ko 2023-11-28T18:22:14.986 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 25873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/nvram.ko 2023-11-28T18:22:14.986 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 32169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ppdev.ko 2023-11-28T18:22:14.986 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 51113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tlclk.ko 2023-11-28T18:22:14.986 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/ 2023-11-28T18:22:14.987 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_atmel.ko 2023-11-28T18:22:14.987 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-11-28T18:22:14.987 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 23473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-11-28T18:22:14.987 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 32985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-11-28T18:22:14.987 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 30121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_infineon.ko 2023-11-28T18:22:14.987 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 22697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_nsc.ko 2023-11-28T18:22:14.987 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 23561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-11-28T18:22:14.987 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/ 2023-11-28T18:22:14.987 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_class.ko 2023-11-28T18:22:14.987 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 50945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_core.ko 2023-11-28T18:22:14.987 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-11-28T18:22:14.987 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/ 2023-11-28T18:22:14.988 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-palmas.ko 2023-11-28T18:22:14.988 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 47849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-si5351.ko 2023-11-28T18:22:14.988 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-twl6040.ko 2023-11-28T18:22:14.988 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-wm831x.ko 2023-11-28T18:22:14.988 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/ 2023-11-28T18:22:14.988 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-11-28T18:22:14.988 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/p4-clockmod.ko 2023-11-28T18:22:14.988 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 25297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/speedstep-lib.ko 2023-11-28T18:22:14.988 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ 2023-11-28T18:22:14.988 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ 2023-11-28T18:22:14.988 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 70801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-11-28T18:22:14.988 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 243025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp.ko 2023-11-28T18:22:14.988 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/ 2023-11-28T18:22:14.988 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/ 2023-11-28T18:22:14.989 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common/ 2023-11-28T18:22:14.989 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 438761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-11-28T18:22:14.989 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-11-28T18:22:14.989 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 24081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-11-28T18:22:14.989 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-aes.ko 2023-11-28T18:22:14.989 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 21537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-sha.ko 2023-11-28T18:22:14.989 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio/ 2023-11-28T18:22:14.989 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 70273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-11-28T18:22:14.989 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca/ 2023-11-28T18:22:14.989 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 29785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca/dca.ko 2023-11-28T18:22:14.989 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ 2023-11-28T18:22:14.989 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw/ 2023-11-28T18:22:14.990 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw/dw_dmac.ko 2023-11-28T18:22:14.990 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat/ 2023-11-28T18:22:14.990 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 122569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat/ioatdma.ko 2023-11-28T18:22:14.990 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/ 2023-11-28T18:22:14.990 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 79953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/amd64_edac.ko 2023-11-28T18:22:14.990 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 35769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/e752x_edac.ko 2023-11-28T18:22:14.990 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 63617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/edac_mce_amd.ko 2023-11-28T18:22:14.990 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3000_edac.ko 2023-11-28T18:22:14.990 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3200_edac.ko 2023-11-28T18:22:14.990 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 22537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5100_edac.ko 2023-11-28T18:22:14.990 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 25657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5400_edac.ko 2023-11-28T18:22:14.990 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 24913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7300_edac.ko 2023-11-28T18:22:14.990 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 52041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7core_edac.ko 2023-11-28T18:22:14.991 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i82975x_edac.ko 2023-11-28T18:22:14.991 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/ie31200_edac.ko 2023-11-28T18:22:14.991 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 56825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/sb_edac.ko 2023-11-28T18:22:14.991 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/x38_edac.ko 2023-11-28T18:22:14.991 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/ 2023-11-28T18:22:14.991 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-gpio.ko 2023-11-28T18:22:14.991 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 27185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max14577.ko 2023-11-28T18:22:14.991 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 29569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max77693.ko 2023-11-28T18:22:14.991 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 24745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max8997.ko 2023-11-28T18:22:14.991 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-palmas.ko 2023-11-28T18:22:14.991 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 23713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-rt8973a.ko 2023-11-28T18:22:14.991 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 27785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-sm5502.ko 2023-11-28T18:22:14.992 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/ 2023-11-28T18:22:14.992 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 34977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/dmi-sysfs.ko 2023-11-28T18:22:14.992 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/efi/ 2023-11-28T18:22:14.992 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/efi/efi-pstore.ko 2023-11-28T18:22:14.992 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/iscsi_ibft.ko 2023-11-28T18:22:14.992 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/ 2023-11-28T18:22:14.992 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-adp5520.ko 2023-11-28T18:22:14.992 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-amd8111.ko 2023-11-28T18:22:14.992 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-arizona.ko 2023-11-28T18:22:14.992 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-da9052.ko 2023-11-28T18:22:14.992 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-da9055.ko 2023-11-28T18:22:14.992 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 22065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-dln2.ko 2023-11-28T18:22:14.992 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 77849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-f7188x.ko 2023-11-28T18:22:14.993 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 28937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-generic.ko 2023-11-28T18:22:14.993 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-ich.ko 2023-11-28T18:22:14.993 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-11-28T18:22:14.993 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-kempld.ko 2023-11-28T18:22:14.993 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-lp3943.ko 2023-11-28T18:22:14.993 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max7300.ko 2023-11-28T18:22:14.993 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max730x.ko 2023-11-28T18:22:14.993 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 22073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max732x.ko 2023-11-28T18:22:14.993 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-11-28T18:22:14.993 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 47073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-pca953x.ko 2023-11-28T18:22:14.993 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-pcf857x.ko 2023-11-28T18:22:14.993 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-rdc321x.ko 2023-11-28T18:22:14.994 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-sch.ko 2023-11-28T18:22:14.994 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-sch311x.ko 2023-11-28T18:22:14.994 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-tps65912.ko 2023-11-28T18:22:14.994 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 21057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-twl4030.ko 2023-11-28T18:22:14.994 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-twl6040.ko 2023-11-28T18:22:14.994 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-viperboard.ko 2023-11-28T18:22:14.994 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-vx855.ko 2023-11-28T18:22:14.994 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm831x.ko 2023-11-28T18:22:14.994 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm8350.ko 2023-11-28T18:22:14.994 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm8994.ko 2023-11-28T18:22:14.994 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/ 2023-11-28T18:22:14.995 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-a4tech.ko 2023-11-28T18:22:14.995 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 39169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-apple.ko 2023-11-28T18:22:14.995 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-appleir.ko 2023-11-28T18:22:14.995 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-aureal.ko 2023-11-28T18:22:14.995 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-axff.ko 2023-11-28T18:22:14.995 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-belkin.ko 2023-11-28T18:22:14.995 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cherry.ko 2023-11-28T18:22:14.995 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-chicony.ko 2023-11-28T18:22:14.995 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 60649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cp2112.ko 2023-11-28T18:22:14.995 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cypress.ko 2023-11-28T18:22:14.995 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-dr.ko 2023-11-28T18:22:14.995 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elecom.ko 2023-11-28T18:22:14.996 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elo.ko 2023-11-28T18:22:14.996 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-emsff.ko 2023-11-28T18:22:14.996 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ezkey.ko 2023-11-28T18:22:14.996 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gaff.ko 2023-11-28T18:22:14.996 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-generic.ko 2023-11-28T18:22:14.996 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gt683r.ko 2023-11-28T18:22:14.996 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gyration.ko 2023-11-28T18:22:14.996 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-kbd.ko 2023-11-28T18:22:14.996 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-mouse.ko 2023-11-28T18:22:14.996 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtekff.ko 2023-11-28T18:22:14.996 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-hyperv.ko 2023-11-28T18:22:14.996 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-icade.ko 2023-11-28T18:22:14.997 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-kensington.ko 2023-11-28T18:22:14.997 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-keytouch.ko 2023-11-28T18:22:14.997 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-kye.ko 2023-11-28T18:22:14.997 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lcpower.ko 2023-11-28T18:22:14.997 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-led.ko 2023-11-28T18:22:14.997 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 42297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lenovo.ko 2023-11-28T18:22:14.997 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 30697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lg-g15.ko 2023-11-28T18:22:14.997 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 58185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-dj.ko 2023-11-28T18:22:14.997 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 101481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-11-28T18:22:14.997 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 80993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech.ko 2023-11-28T18:22:14.997 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 30801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-magicmouse.ko 2023-11-28T18:22:14.997 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 21969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-microsoft.ko 2023-11-28T18:22:14.997 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-monterey.ko 2023-11-28T18:22:14.998 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 50161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-multitouch.ko 2023-11-28T18:22:14.998 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 32593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ntrig.ko 2023-11-28T18:22:14.998 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ortek.ko 2023-11-28T18:22:14.998 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-penmount.ko 2023-11-28T18:22:14.998 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-petalynx.ko 2023-11-28T18:22:14.998 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 72937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-picolcd.ko 2023-11-28T18:22:14.998 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-pl.ko 2023-11-28T18:22:14.998 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-plantronics.ko 2023-11-28T18:22:14.999 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-primax.ko 2023-11-28T18:22:14.999 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 35393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-rmi.ko 2023-11-28T18:22:14.999 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-arvo.ko 2023-11-28T18:22:14.999 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-common.ko 2023-11-28T18:22:14.999 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 31425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-isku.ko 2023-11-28T18:22:14.999 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 29729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kone.ko 2023-11-28T18:22:14.999 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 31129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-11-28T18:22:14.999 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 21137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-konepure.ko 2023-11-28T18:22:14.999 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 29489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-11-28T18:22:14.999 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-lua.ko 2023-11-28T18:22:14.999 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 29313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-pyra.ko 2023-11-28T18:22:14.999 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 27937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-ryos.ko 2023-11-28T18:22:15.000 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-savu.ko 2023-11-28T18:22:15.000 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 23337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat.ko 2023-11-28T18:22:15.000 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-saitek.ko 2023-11-28T18:22:15.000 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-samsung.ko 2023-11-28T18:22:15.000 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 36817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sensor-hub.ko 2023-11-28T18:22:15.000 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sjoy.ko 2023-11-28T18:22:15.000 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 51249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sony.ko 2023-11-28T18:22:15.000 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-speedlink.ko 2023-11-28T18:22:15.000 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 25297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-steelseries.ko 2023-11-28T18:22:15.000 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sunplus.ko 2023-11-28T18:22:15.000 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-thrustmaster.ko 2023-11-28T18:22:15.000 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tivo.ko 2023-11-28T18:22:15.001 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tmff.ko 2023-11-28T18:22:15.001 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-topseed.ko 2023-11-28T18:22:15.001 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-twinhan.ko 2023-11-28T18:22:15.001 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 71073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-uclogic.ko 2023-11-28T18:22:15.001 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-waltop.ko 2023-11-28T18:22:15.001 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 143473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-wiimote.ko 2023-11-28T18:22:15.001 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-xinmo.ko 2023-11-28T18:22:15.001 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zpff.ko 2023-11-28T18:22:15.001 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zydacron.ko 2023-11-28T18:22:15.001 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 267825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid.ko 2023-11-28T18:22:15.001 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 32321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/uhid.ko 2023-11-28T18:22:15.001 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/ 2023-11-28T18:22:15.002 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 125721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbhid.ko 2023-11-28T18:22:15.002 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbkbd.ko 2023-11-28T18:22:15.002 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbmouse.ko 2023-11-28T18:22:15.002 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 217873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/wacom.ko 2023-11-28T18:22:15.002 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/ 2023-11-28T18:22:15.002 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 64201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_balloon.ko 2023-11-28T18:22:15.002 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 89625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_utils.ko 2023-11-28T18:22:15.002 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 305465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_vmbus.ko 2023-11-28T18:22:15.002 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ 2023-11-28T18:22:15.002 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 66521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru.ko 2023-11-28T18:22:15.002 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 61393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru3.ko 2023-11-28T18:22:15.003 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 34745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/acpi_power_meter.ko 2023-11-28T18:22:15.003 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7414.ko 2023-11-28T18:22:15.003 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7418.ko 2023-11-28T18:22:15.003 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 25257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adc128d818.ko 2023-11-28T18:22:15.003 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 31729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1025.ko 2023-11-28T18:22:15.003 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 97977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1026.ko 2023-11-28T18:22:15.003 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1029.ko 2023-11-28T18:22:15.003 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 45553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1031.ko 2023-11-28T18:22:15.003 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm9240.ko 2023-11-28T18:22:15.003 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ads7828.ko 2023-11-28T18:22:15.003 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7410.ko 2023-11-28T18:22:15.003 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 22049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7411.ko 2023-11-28T18:22:15.004 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 74433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7462.ko 2023-11-28T18:22:15.004 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 39585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7470.ko 2023-11-28T18:22:15.004 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 67929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7475.ko 2023-11-28T18:22:15.004 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7x10.ko 2023-11-28T18:22:15.004 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 39073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/amc6821.ko 2023-11-28T18:22:15.004 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 55201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/applesmc.ko 2023-11-28T18:22:15.004 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 49913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asb100.ko 2023-11-28T18:22:15.004 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 58617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asc7621.ko 2023-11-28T18:22:15.005 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 40825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asus_atk0110.ko 2023-11-28T18:22:15.005 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/atxp1.ko 2023-11-28T18:22:15.005 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 28281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/coretemp.ko 2023-11-28T18:22:15.005 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 24593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/da9052-hwmon.ko 2023-11-28T18:22:15.005 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/da9055-hwmon.ko 2023-11-28T18:22:15.005 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 44465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-11-28T18:22:15.005 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 99601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dme1737.ko 2023-11-28T18:22:15.005 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds1621.ko 2023-11-28T18:22:15.005 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds620.ko 2023-11-28T18:22:15.005 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 29777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc1403.ko 2023-11-28T18:22:15.005 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 33185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc2103.ko 2023-11-28T18:22:15.006 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 30321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc6w201.ko 2023-11-28T18:22:15.006 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 66985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71805f.ko 2023-11-28T18:22:15.006 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 94457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71882fg.ko 2023-11-28T18:22:15.006 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 41401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f75375s.ko 2023-11-28T18:22:15.006 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 21305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fam15h_power.ko 2023-11-28T18:22:15.006 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 55449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fschmd.ko 2023-11-28T18:22:15.006 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g760a.ko 2023-11-28T18:22:15.006 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 24017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g762.ko 2023-11-28T18:22:15.006 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 46801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl518sm.ko 2023-11-28T18:22:15.006 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 45529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl520sm.ko 2023-11-28T18:22:15.006 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/hih6130.ko 2023-11-28T18:22:15.006 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/hwmon-vid.ko 2023-11-28T18:22:15.007 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5500_temp.ko 2023-11-28T18:22:15.007 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 22601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5k_amb.ko 2023-11-28T18:22:15.007 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 34529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmaem.ko 2023-11-28T18:22:15.007 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmpex.ko 2023-11-28T18:22:15.007 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 24873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina209.ko 2023-11-28T18:22:15.007 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina2xx.ko 2023-11-28T18:22:15.007 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 130449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/it87.ko 2023-11-28T18:22:15.007 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/jc42.ko 2023-11-28T18:22:15.007 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 24329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k10temp.ko 2023-11-28T18:22:15.007 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k8temp.ko 2023-11-28T18:22:15.007 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lineage-pem.ko 2023-11-28T18:22:15.007 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 48601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm63.ko 2023-11-28T18:22:15.008 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm73.ko 2023-11-28T18:22:15.008 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 36777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm75.ko 2023-11-28T18:22:15.008 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm77.ko 2023-11-28T18:22:15.008 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 34593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm78.ko 2023-11-28T18:22:15.008 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 31745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm80.ko 2023-11-28T18:22:15.008 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm83.ko 2023-11-28T18:22:15.008 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 72833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm85.ko 2023-11-28T18:22:15.008 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 46153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm87.ko 2023-11-28T18:22:15.008 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 37913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm90.ko 2023-11-28T18:22:15.008 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm92.ko 2023-11-28T18:22:15.008 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 108841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm93.ko 2023-11-28T18:22:15.008 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 33393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95234.ko 2023-11-28T18:22:15.009 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95241.ko 2023-11-28T18:22:15.009 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95245.ko 2023-11-28T18:22:15.009 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 24017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc2945.ko 2023-11-28T18:22:15.009 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4151.ko 2023-11-28T18:22:15.009 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4215.ko 2023-11-28T18:22:15.009 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4222.ko 2023-11-28T18:22:15.009 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4245.ko 2023-11-28T18:22:15.009 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4260.ko 2023-11-28T18:22:15.009 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4261.ko 2023-11-28T18:22:15.009 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 33489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max16065.ko 2023-11-28T18:22:15.009 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1619.ko 2023-11-28T18:22:15.009 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 24353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1668.ko 2023-11-28T18:22:15.010 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max197.ko 2023-11-28T18:22:15.010 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 27129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6639.ko 2023-11-28T18:22:15.010 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 23321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6650.ko 2023-11-28T18:22:15.010 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 35777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6697.ko 2023-11-28T18:22:15.010 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/mc13783-adc.ko 2023-11-28T18:22:15.010 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/mcp3021.ko 2023-11-28T18:22:15.010 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-11-28T18:22:15.010 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 44129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6683.ko 2023-11-28T18:22:15.010 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 119817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775-core.ko 2023-11-28T18:22:15.010 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 60705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775.ko 2023-11-28T18:22:15.010 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 59737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct7802.ko 2023-11-28T18:22:15.010 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 82337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87360.ko 2023-11-28T18:22:15.011 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 54433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87427.ko 2023-11-28T18:22:15.011 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pcf8591.ko 2023-11-28T18:22:15.011 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ 2023-11-28T18:22:15.011 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 21353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-11-28T18:22:15.011 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-11-28T18:22:15.011 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 28329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-11-28T18:22:15.011 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max16064.ko 2023-11-28T18:22:15.011 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max34440.ko 2023-11-28T18:22:15.011 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max8688.ko 2023-11-28T18:22:15.011 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-11-28T18:22:15.011 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 82577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-11-28T18:22:15.011 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-11-28T18:22:15.012 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 30729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-11-28T18:22:15.012 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-11-28T18:22:15.012 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-11-28T18:22:15.012 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/powr1220.ko 2023-11-28T18:22:15.012 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5627.ko 2023-11-28T18:22:15.012 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 28817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5636.ko 2023-11-28T18:22:15.012 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 27145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch56xx-common.ko 2023-11-28T18:22:15.012 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 32137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht15.ko 2023-11-28T18:22:15.012 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht21.ko 2023-11-28T18:22:15.012 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/shtc1.ko 2023-11-28T18:22:15.012 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 40105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sis5595.ko 2023-11-28T18:22:15.013 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47b397.ko 2023-11-28T18:22:15.013 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 39193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m1.ko 2023-11-28T18:22:15.013 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 37385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m192.ko 2023-11-28T18:22:15.013 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/thmc50.ko 2023-11-28T18:22:15.013 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp102.ko 2023-11-28T18:22:15.013 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp103.ko 2023-11-28T18:22:15.013 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp401.ko 2023-11-28T18:22:15.013 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp421.ko 2023-11-28T18:22:15.013 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via-cputemp.ko 2023-11-28T18:22:15.013 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 41945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via686a.ko 2023-11-28T18:22:15.013 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 52457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt1211.ko 2023-11-28T18:22:15.013 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 51545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt8231.ko 2023-11-28T18:22:15.014 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 57449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627ehf.ko 2023-11-28T18:22:15.014 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 78873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627hf.ko 2023-11-28T18:22:15.014 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 71345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83781d.ko 2023-11-28T18:22:15.014 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 63225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83791d.ko 2023-11-28T18:22:15.014 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 71321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83792d.ko 2023-11-28T18:22:15.014 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 101473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83793.ko 2023-11-28T18:22:15.014 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 119505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83795.ko 2023-11-28T18:22:15.014 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l785ts.ko 2023-11-28T18:22:15.014 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 35625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l786ng.ko 2023-11-28T18:22:15.014 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-11-28T18:22:15.014 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-11-28T18:22:15.014 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/ 2023-11-28T18:22:15.015 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/ 2023-11-28T18:22:15.015 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-11-28T18:22:15.015 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-11-28T18:22:15.015 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/ 2023-11-28T18:22:15.015 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 27969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-11-28T18:22:15.015 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 28801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-11-28T18:22:15.015 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 27777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-11-28T18:22:15.015 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-11-28T18:22:15.015 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-11-28T18:22:15.015 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-11-28T18:22:15.015 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-11-28T18:22:15.016 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 6929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-11-28T18:22:15.016 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-11-28T18:22:15.016 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 50201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-11-28T18:22:15.016 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 23905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-11-28T18:22:15.016 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-11-28T18:22:15.016 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-11-28T18:22:15.016 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-11-28T18:22:15.016 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-11-28T18:22:15.016 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 62817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-i801.ko 2023-11-28T18:22:15.016 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 22433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-isch.ko 2023-11-28T18:22:15.016 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 47889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-11-28T18:22:15.016 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-11-28T18:22:15.017 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-11-28T18:22:15.017 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 22337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-11-28T18:22:15.017 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-11-28T18:22:15.017 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-parport.ko 2023-11-28T18:22:15.017 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-11-28T18:22:15.017 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 47241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-11-28T18:22:15.017 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-11-28T18:22:15.017 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-11-28T18:22:15.017 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-11-28T18:22:15.017 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 22313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-11-28T18:22:15.017 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 29361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-11-28T18:22:15.017 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-11-28T18:22:15.018 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-11-28T18:22:15.018 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-11-28T18:22:15.018 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-via.ko 2023-11-28T18:22:15.018 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-11-28T18:22:15.018 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-11-28T18:22:15.018 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 47657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-11-28T18:22:15.018 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 22449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-mux.ko 2023-11-28T18:22:15.018 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-smbus.ko 2023-11-28T18:22:15.018 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 27073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-stub.ko 2023-11-28T18:22:15.018 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/ 2023-11-28T18:22:15.018 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-11-28T18:22:15.018 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-11-28T18:22:15.019 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 29737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-11-28T18:22:15.019 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ 2023-11-28T18:22:15.019 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ 2023-11-28T18:22:15.019 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 273609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_cm.ko 2023-11-28T18:22:15.019 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 879969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_core.ko 2023-11-28T18:22:15.019 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 69273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_umad.ko 2023-11-28T18:22:15.019 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 324217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-11-28T18:22:15.019 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 97985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/iw_cm.ko 2023-11-28T18:22:15.019 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 282273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_cm.ko 2023-11-28T18:22:15.019 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 66201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-11-28T18:22:15.019 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ 2023-11-28T18:22:15.019 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4/ 2023-11-28T18:22:15.020 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 493073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-11-28T18:22:15.020 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4/ 2023-11-28T18:22:15.020 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 419737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-11-28T18:22:15.020 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5/ 2023-11-28T18:22:15.020 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 739025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-11-28T18:22:15.020 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca/ 2023-11-28T18:22:15.020 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 296625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-11-28T18:22:15.020 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ocrdma/ 2023-11-28T18:22:15.020 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 153697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-11-28T18:22:15.020 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/usnic/ 2023-11-28T18:22:15.020 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 168969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-11-28T18:22:15.020 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ 2023-11-28T18:22:15.021 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib/ 2023-11-28T18:22:15.021 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 263081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-11-28T18:22:15.076 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser/ 2023-11-28T18:22:15.076 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 100241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-11-28T18:22:15.076 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert/ 2023-11-28T18:22:15.076 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 111425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-11-28T18:22:15.076 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp/ 2023-11-28T18:22:15.076 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 128753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-11-28T18:22:15.076 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt/ 2023-11-28T18:22:15.076 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 129529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-11-28T18:22:15.076 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/ 2023-11-28T18:22:15.076 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/evbug.ko 2023-11-28T18:22:15.077 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 24129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/ff-memless.ko 2023-11-28T18:22:15.077 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/ 2023-11-28T18:22:15.077 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-11-28T18:22:15.077 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/fm801-gp.ko 2023-11-28T18:22:15.077 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 41241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/gameport.ko 2023-11-28T18:22:15.077 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 41801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/joydev.ko 2023-11-28T18:22:15.077 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/ 2023-11-28T18:22:15.077 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-11-28T18:22:15.077 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-11-28T18:22:15.077 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-11-28T18:22:15.077 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 24761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-11-28T18:22:15.077 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 36665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/gpio_keys.ko 2023-11-28T18:22:15.078 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-11-28T18:22:15.078 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lkkbd.ko 2023-11-28T18:22:15.078 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lm8323.ko 2023-11-28T18:22:15.078 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lm8333.ko 2023-11-28T18:22:15.078 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 24265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-11-28T18:22:15.078 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-11-28T18:22:15.078 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-11-28T18:22:15.078 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-11-28T18:22:15.078 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/newtonkbd.ko 2023-11-28T18:22:15.078 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-11-28T18:22:15.078 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/qt1070.ko 2023-11-28T18:22:15.079 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/qt2160.ko 2023-11-28T18:22:15.079 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 23817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-11-28T18:22:15.079 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/stowaway.ko 2023-11-28T18:22:15.079 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/sunkbd.ko 2023-11-28T18:22:15.079 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-11-28T18:22:15.079 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-11-28T18:22:15.079 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-11-28T18:22:15.079 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/xtkbd.ko 2023-11-28T18:22:15.079 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/matrix-keymap.ko 2023-11-28T18:22:15.079 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/ 2023-11-28T18:22:15.079 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 34329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/appletouch.ko 2023-11-28T18:22:15.079 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 34177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/bcm5974.ko 2023-11-28T18:22:15.079 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 123681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/cyapatp.ko 2023-11-28T18:22:15.080 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 89449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/elan_i2c.ko 2023-11-28T18:22:15.080 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/gpio_mouse.ko 2023-11-28T18:22:15.080 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 335929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/psmouse.ko 2023-11-28T18:22:15.080 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/sermouse.ko 2023-11-28T18:22:15.080 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 23881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-11-28T18:22:15.080 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 22569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_usb.ko 2023-11-28T18:22:15.080 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/vsxxxaa.ko 2023-11-28T18:22:15.080 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4/ 2023-11-28T18:22:15.080 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 109873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4/rmi_core.ko 2023-11-28T18:22:15.080 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ 2023-11-28T18:22:15.080 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/altera_ps2.ko 2023-11-28T18:22:15.080 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/arc_ps2.ko 2023-11-28T18:22:15.081 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ct82c710.ko 2023-11-28T18:22:15.081 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-11-28T18:22:15.081 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/parkbd.ko 2023-11-28T18:22:15.081 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/pcips2.ko 2023-11-28T18:22:15.081 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ps2mult.ko 2023-11-28T18:22:15.081 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 24153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/serio_raw.ko 2023-11-28T18:22:15.081 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/serport.ko 2023-11-28T18:22:15.081 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/sparse-keymap.ko 2023-11-28T18:22:15.081 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/ 2023-11-28T18:22:15.081 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd/ 2023-11-28T18:22:15.081 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 39289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd/iommu_v2.ko 2023-11-28T18:22:15.081 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/ 2023-11-28T18:22:15.082 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-88pm860x.ko 2023-11-28T18:22:15.082 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-adp5520.ko 2023-11-28T18:22:15.082 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 59753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-bd2802.ko 2023-11-28T18:22:15.082 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 24785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-blinkm.ko 2023-11-28T18:22:15.082 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-da903x.ko 2023-11-28T18:22:15.082 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-da9052.ko 2023-11-28T18:22:15.082 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-gpio.ko 2023-11-28T18:22:15.082 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3530.ko 2023-11-28T18:22:15.082 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 30505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3533.ko 2023-11-28T18:22:15.082 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm355x.ko 2023-11-28T18:22:15.083 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3642.ko 2023-11-28T18:22:15.083 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lp3944.ko 2023-11-28T18:22:15.083 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lp8788.ko 2023-11-28T18:22:15.083 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-max8997.ko 2023-11-28T18:22:15.083 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-mc13783.ko 2023-11-28T18:22:15.083 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-menf21bmc.ko 2023-11-28T18:22:15.083 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca9532.ko 2023-11-28T18:22:15.083 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca955x.ko 2023-11-28T18:22:15.083 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca963x.ko 2023-11-28T18:22:15.083 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 34433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-ss4200.ko 2023-11-28T18:22:15.083 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 24865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-tca6507.ko 2023-11-28T18:22:15.083 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-wm831x-status.ko 2023-11-28T18:22:15.084 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-wm8350.ko 2023-11-28T18:22:15.084 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ 2023-11-28T18:22:15.084 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-11-28T18:22:15.084 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-11-28T18:22:15.084 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-11-28T18:22:15.084 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 7617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-11-28T18:22:15.084 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-11-28T18:22:15.084 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-11-28T18:22:15.084 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-11-28T18:22:15.084 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-11-28T18:22:15.084 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/ 2023-11-28T18:22:15.084 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache/ 2023-11-28T18:22:15.085 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 654969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache/bcache.ko 2023-11-28T18:22:15.085 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 40577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-bio-prison.ko 2023-11-28T18:22:15.085 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 89601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-bufio.ko 2023-11-28T18:22:15.085 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 47529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache-smq.ko 2023-11-28T18:22:15.085 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 156009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache.ko 2023-11-28T18:22:15.085 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 106897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-crypt.ko 2023-11-28T18:22:15.085 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 21545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-delay.ko 2023-11-28T18:22:15.085 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 53857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-era.ko 2023-11-28T18:22:15.085 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 28465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-flakey.ko 2023-11-28T18:22:15.085 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 41529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-log-userspace.ko 2023-11-28T18:22:15.085 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 32737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-log.ko 2023-11-28T18:22:15.085 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 49545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-mirror.ko 2023-11-28T18:22:15.085 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 78033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-multipath.ko 2023-11-28T18:22:15.086 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-queue-length.ko 2023-11-28T18:22:15.086 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 70825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-raid.ko 2023-11-28T18:22:15.086 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 36297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-region-hash.ko 2023-11-28T18:22:15.086 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-round-robin.ko 2023-11-28T18:22:15.086 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-service-time.ko 2023-11-28T18:22:15.086 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 109529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-snapshot.ko 2023-11-28T18:22:15.086 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-switch.ko 2023-11-28T18:22:15.086 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 181865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-thin-pool.ko 2023-11-28T18:22:15.086 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 51737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-verity.ko 2023-11-28T18:22:15.086 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-zero.ko 2023-11-28T18:22:15.086 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/faulty.ko 2023-11-28T18:22:15.086 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/linear.ko 2023-11-28T18:22:15.087 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 32417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/multipath.ko 2023-11-28T18:22:15.087 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data/ 2023-11-28T18:22:15.087 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 199937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-11-28T18:22:15.087 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 37337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid0.ko 2023-11-28T18:22:15.087 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 113073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid1.ko 2023-11-28T18:22:15.087 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 158681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid10.ko 2023-11-28T18:22:15.087 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 395721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid456.ko 2023-11-28T18:22:15.087 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/ 2023-11-28T18:22:15.087 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/ 2023-11-28T18:22:15.087 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 178137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptbase.ko 2023-11-28T18:22:15.087 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 63385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptctl.ko 2023-11-28T18:22:15.087 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 44665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptfc.ko 2023-11-28T18:22:15.088 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 37225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptlan.ko 2023-11-28T18:22:15.088 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 123321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptsas.ko 2023-11-28T18:22:15.088 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 79041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptscsih.ko 2023-11-28T18:22:15.088 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 53017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptspi.ko 2023-11-28T18:22:15.088 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/ 2023-11-28T18:22:15.088 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm800.ko 2023-11-28T18:22:15.088 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm805.ko 2023-11-28T18:22:15.088 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm80x.ko 2023-11-28T18:22:15.088 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/arizona-i2c.ko 2023-11-28T18:22:15.088 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 123721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/arizona.ko 2023-11-28T18:22:15.088 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/bcm590xx.ko 2023-11-28T18:22:15.088 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/cros_ec_dev.ko 2023-11-28T18:22:15.089 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 34961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/dln2.ko 2023-11-28T18:22:15.089 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/janz-cmodio.ko 2023-11-28T18:22:15.089 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 53585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/kempld-core.ko 2023-11-28T18:22:15.089 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 27529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lm3533-core.ko 2023-11-28T18:22:15.089 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-11-28T18:22:15.089 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lp3943.ko 2023-11-28T18:22:15.089 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 54569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_ich.ko 2023-11-28T18:22:15.089 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_sch.ko 2023-11-28T18:22:15.089 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/max8907.ko 2023-11-28T18:22:15.089 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 29857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/mc13xxx-core.ko 2023-11-28T18:22:15.089 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-11-28T18:22:15.089 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/menf21bmc.ko 2023-11-28T18:22:15.089 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633-adc.ko 2023-11-28T18:22:15.090 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633-gpio.ko 2023-11-28T18:22:15.090 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 34873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633.ko 2023-11-28T18:22:15.090 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-11-28T18:22:15.090 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/retu-mfd.ko 2023-11-28T18:22:15.090 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 80425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/si476x-core.ko 2023-11-28T18:22:15.090 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 48457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/sm501.ko 2023-11-28T18:22:15.090 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-11-28T18:22:15.090 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 51137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/tps65010.ko 2023-11-28T18:22:15.090 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/tps6507x.ko 2023-11-28T18:22:15.090 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/viperboard.ko 2023-11-28T18:22:15.090 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/vx855.ko 2023-11-28T18:22:15.090 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/wl1273-core.ko 2023-11-28T18:22:15.091 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 44345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/wm8994.ko 2023-11-28T18:22:15.091 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ 2023-11-28T18:22:15.091 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-11-28T18:22:15.091 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 48489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ad525x_dpot.ko 2023-11-28T18:22:15.091 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl/ 2023-11-28T18:22:15.091 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 46585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-11-28T18:22:15.091 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds9802als.ko 2023-11-28T18:22:15.091 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 36729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds990x.ko 2023-11-28T18:22:15.091 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 45593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/bh1770glc.ko 2023-11-28T18:22:15.091 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/ 2023-11-28T18:22:15.091 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-11-28T18:22:15.091 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 35281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/core.ko 2023-11-28T18:22:15.091 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710/ 2023-11-28T18:22:15.092 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 25161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710/cb710.ko 2023-11-28T18:22:15.092 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ds1682.ko 2023-11-28T18:22:15.092 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/dummy-irq.ko 2023-11-28T18:22:15.092 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/echo/ 2023-11-28T18:22:15.092 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/echo/echo.ko 2023-11-28T18:22:15.092 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/ 2023-11-28T18:22:15.092 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 37849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/at24.ko 2023-11-28T18:22:15.092 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom.ko 2023-11-28T18:22:15.092 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-11-28T18:22:15.092 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/max6875.ko 2023-11-28T18:22:15.092 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 33009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/enclosure.ko 2023-11-28T18:22:15.092 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/genwqe/ 2023-11-28T18:22:15.092 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 152201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-11-28T18:22:15.093 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/hmc6352.ko 2023-11-28T18:22:15.093 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 31257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/hpilo.ko 2023-11-28T18:22:15.093 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ibmasm/ 2023-11-28T18:22:15.093 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 72129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-11-28T18:22:15.093 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ics932s401.ko 2023-11-28T18:22:15.093 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 21681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29003.ko 2023-11-28T18:22:15.093 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29020.ko 2023-11-28T18:22:15.093 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/ 2023-11-28T18:22:15.093 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 42513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-11-28T18:22:15.093 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-11-28T18:22:15.093 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/ 2023-11-28T18:22:15.093 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 125209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-me.ko 2023-11-28T18:22:15.093 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 56521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-txe.ko 2023-11-28T18:22:15.094 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 310113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei.ko 2023-11-28T18:22:15.094 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 31329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/phantom.ko 2023-11-28T18:22:15.094 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ti-st/ 2023-11-28T18:22:15.094 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 74265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ti-st/st_drv.ko 2023-11-28T18:22:15.094 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 24305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_7xx1.ko 2023-11-28T18:22:15.094 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 28785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_core.ko 2023-11-28T18:22:15.094 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tsl2550.ko 2023-11-28T18:22:15.094 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 48697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_balloon.ko 2023-11-28T18:22:15.094 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci/ 2023-11-28T18:22:15.094 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 183609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-11-28T18:22:15.094 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ 2023-11-28T18:22:15.094 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding/ 2023-11-28T18:22:15.094 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 490129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding/bonding.ko 2023-11-28T18:22:15.095 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/ 2023-11-28T18:22:15.095 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53/ 2023-11-28T18:22:15.095 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 106033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53/b53_common.ko 2023-11-28T18:22:15.095 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 40417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/bcm-sf2.ko 2023-11-28T18:22:15.095 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6060.ko 2023-11-28T18:22:15.095 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx/ 2023-11-28T18:22:15.095 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 453737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-11-28T18:22:15.095 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dummy.ko 2023-11-28T18:22:15.095 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/eql.ko 2023-11-28T18:22:15.095 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ 2023-11-28T18:22:15.095 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/ 2023-11-28T18:22:15.095 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 45785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-11-28T18:22:15.095 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 42105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-11-28T18:22:15.096 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 130553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-11-28T18:22:15.096 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 68849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-11-28T18:22:15.096 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/ 2023-11-28T18:22:15.096 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 37649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/8390.ko 2023-11-28T18:22:15.096 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 59689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-11-28T18:22:15.096 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 27201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-11-28T18:22:15.096 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 99049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-11-28T18:22:15.096 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec/ 2023-11-28T18:22:15.096 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 54521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-11-28T18:22:15.096 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere/ 2023-11-28T18:22:15.096 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 69137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere/et131x.ko 2023-11-28T18:22:15.096 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon/ 2023-11-28T18:22:15.096 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 59585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-11-28T18:22:15.097 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera/ 2023-11-28T18:22:15.097 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 41409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-11-28T18:22:15.097 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/ 2023-11-28T18:22:15.097 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 54609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-11-28T18:22:15.097 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 49289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-11-28T18:22:15.097 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 87297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-11-28T18:22:15.097 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/ 2023-11-28T18:22:15.097 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx/ 2023-11-28T18:22:15.097 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 97337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-11-28T18:22:15.097 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-11-28T18:22:15.097 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 104673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-11-28T18:22:15.097 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-11-28T18:22:15.098 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 90257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-11-28T18:22:15.098 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/ 2023-11-28T18:22:15.098 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 81569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-11-28T18:22:15.098 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 69729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-11-28T18:22:15.098 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/ 2023-11-28T18:22:15.098 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 78401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-11-28T18:22:15.098 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 176761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-11-28T18:22:15.098 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-11-28T18:22:15.098 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 1421497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-11-28T18:22:15.098 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 128569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-11-28T18:22:15.098 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet/ 2023-11-28T18:22:15.098 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 132089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-11-28T18:22:15.099 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 312081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-11-28T18:22:15.099 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/ 2023-11-28T18:22:15.099 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna/ 2023-11-28T18:22:15.099 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 323513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-11-28T18:22:15.099 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/ 2023-11-28T18:22:15.099 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-11-28T18:22:15.099 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 193497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-11-28T18:22:15.099 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-11-28T18:22:15.099 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 347417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-11-28T18:22:15.099 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-11-28T18:22:15.099 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 1044497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-11-28T18:22:15.099 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-11-28T18:22:15.099 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 166193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-11-28T18:22:15.100 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-11-28T18:22:15.100 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 34881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-11-28T18:22:15.100 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/ 2023-11-28T18:22:15.100 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic/ 2023-11-28T18:22:15.100 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 204345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-11-28T18:22:15.100 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/ 2023-11-28T18:22:15.100 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/ 2023-11-28T18:22:15.100 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 69449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-11-28T18:22:15.100 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 61489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-11-28T18:22:15.100 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 141225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-11-28T18:22:15.100 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 51497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-11-28T18:22:15.100 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 62817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-11-28T18:22:15.100 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 31369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-11-28T18:22:15.101 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/ 2023-11-28T18:22:15.101 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 60873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-11-28T18:22:15.101 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 62833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-11-28T18:22:15.101 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 45721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dnet.ko 2023-11-28T18:22:15.101 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 25185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ec_bhf.ko 2023-11-28T18:22:15.101 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/ 2023-11-28T18:22:15.101 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet/ 2023-11-28T18:22:15.101 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 281137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-11-28T18:22:15.101 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 49457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ethoc.ko 2023-11-28T18:22:15.101 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 51737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fealnx.ko 2023-11-28T18:22:15.101 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fujitsu/ 2023-11-28T18:22:15.101 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 45345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-11-28T18:22:15.101 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ 2023-11-28T18:22:15.102 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 90465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e100.ko 2023-11-28T18:22:15.102 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000/ 2023-11-28T18:22:15.102 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 295577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-11-28T18:22:15.102 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e/ 2023-11-28T18:22:15.102 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 584497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-11-28T18:22:15.102 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k/ 2023-11-28T18:22:15.102 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 246209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-11-28T18:22:15.102 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e/ 2023-11-28T18:22:15.102 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 925825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-11-28T18:22:15.102 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf/ 2023-11-28T18:22:15.102 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 302937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-11-28T18:22:15.102 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb/ 2023-11-28T18:22:15.105 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 514641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-11-28T18:22:15.105 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf/ 2023-11-28T18:22:15.105 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 93593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-11-28T18:22:15.105 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-11-28T18:22:15.105 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 734305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-11-28T18:22:15.105 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-11-28T18:22:15.106 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 151769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-11-28T18:22:15.106 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 86921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/jme.ko 2023-11-28T18:22:15.106 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/ 2023-11-28T18:22:15.106 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-11-28T18:22:15.106 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 102289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/skge.ko 2023-11-28T18:22:15.106 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 122649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-11-28T18:22:15.106 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/ 2023-11-28T18:22:15.106 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-11-28T18:22:15.106 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 727601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-11-28T18:22:15.106 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 278937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-11-28T18:22:15.106 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-11-28T18:22:15.106 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-11-28T18:22:15.107 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 1113681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-11-28T18:22:15.107 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ 2023-11-28T18:22:15.107 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 53041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-11-28T18:22:15.107 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 40993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-11-28T18:22:15.107 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-11-28T18:22:15.107 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 95665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-11-28T18:22:15.107 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/ 2023-11-28T18:22:15.107 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-11-28T18:22:15.107 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 108649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-11-28T18:22:15.107 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/ 2023-11-28T18:22:15.107 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 73441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-11-28T18:22:15.107 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 47777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-11-28T18:22:15.108 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion/ 2023-11-28T18:22:15.108 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 150905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-11-28T18:22:15.108 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia/ 2023-11-28T18:22:15.108 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 136721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-11-28T18:22:15.108 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/ 2023-11-28T18:22:15.108 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 50481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-11-28T18:22:15.108 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 43145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-11-28T18:22:15.108 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/ 2023-11-28T18:22:15.108 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-11-28T18:22:15.108 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 227897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-11-28T18:22:15.108 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 87081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-11-28T18:22:15.108 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-11-28T18:22:15.108 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 672049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-11-28T18:22:15.109 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc/ 2023-11-28T18:22:15.109 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 43017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-11-28T18:22:15.109 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/ 2023-11-28T18:22:15.109 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 67385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-11-28T18:22:15.109 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 83985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-11-28T18:22:15.109 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 29321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/atp.ko 2023-11-28T18:22:15.109 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 189801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-11-28T18:22:15.109 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/ 2023-11-28T18:22:15.109 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-11-28T18:22:15.109 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 104241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-11-28T18:22:15.109 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc/ 2023-11-28T18:22:15.109 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 1052497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-11-28T18:22:15.109 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan/ 2023-11-28T18:22:15.110 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 47097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-11-28T18:22:15.110 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/ 2023-11-28T18:22:15.110 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 54817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis190.ko 2023-11-28T18:22:15.110 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 63337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis900.ko 2023-11-28T18:22:15.110 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/ 2023-11-28T18:22:15.110 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 61537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-11-28T18:22:15.110 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 67193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-11-28T18:22:15.110 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 73409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-11-28T18:22:15.110 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 68177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-11-28T18:22:15.110 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/ 2023-11-28T18:22:15.110 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-11-28T18:22:15.110 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-11-28T18:22:15.110 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 39905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-11-28T18:22:15.111 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-11-28T18:22:15.111 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 487025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-11-28T18:22:15.111 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/ 2023-11-28T18:22:15.111 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 103337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/cassini.ko 2023-11-28T18:22:15.111 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 166097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/niu.ko 2023-11-28T18:22:15.111 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 66329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sungem.ko 2023-11-28T18:22:15.111 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 78801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-11-28T18:22:15.111 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti/ 2023-11-28T18:22:15.111 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 50057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-11-28T18:22:15.111 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti/ 2023-11-28T18:22:15.111 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 86529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti/tlan.ko 2023-11-28T18:22:15.111 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/ 2023-11-28T18:22:15.112 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 80273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-11-28T18:22:15.112 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 83633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-11-28T18:22:15.112 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/ 2023-11-28T18:22:15.112 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 46241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-11-28T18:22:15.112 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 30849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-11-28T18:22:15.112 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom/ 2023-11-28T18:22:15.112 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 59993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-11-28T18:22:15.112 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/ 2023-11-28T18:22:15.112 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 41001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/defxx.ko 2023-11-28T18:22:15.112 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/skfp/ 2023-11-28T18:22:15.112 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 216985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/skfp/skfp.ko 2023-11-28T18:22:15.112 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 77345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/geneve.ko 2023-11-28T18:22:15.112 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv/ 2023-11-28T18:22:15.113 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 235521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-11-28T18:22:15.113 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154/ 2023-11-28T18:22:15.113 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154/fakelb.ko 2023-11-28T18:22:15.113 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 25065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ifb.ko 2023-11-28T18:22:15.113 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan/ 2023-11-28T18:22:15.113 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 83769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan/ipvlan.ko 2023-11-28T18:22:15.113 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 62145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvlan.ko 2023-11-28T18:22:15.113 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvtap.ko 2023-11-28T18:22:15.113 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/ 2023-11-28T18:22:15.113 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-11-28T18:22:15.113 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-11-28T18:22:15.113 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-gpio.ko 2023-11-28T18:22:15.113 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-regmap.ko 2023-11-28T18:22:15.113 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio.ko 2023-11-28T18:22:15.114 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mii.ko 2023-11-28T18:22:15.114 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 43953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/netconsole.ko 2023-11-28T18:22:15.114 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/nlmon.ko 2023-11-28T18:22:15.114 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/ 2023-11-28T18:22:15.114 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs-lynx.ko 2023-11-28T18:22:15.114 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 38977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-11-28T18:22:15.114 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/ 2023-11-28T18:22:15.114 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/amd.ko 2023-11-28T18:22:15.114 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 50033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-11-28T18:22:15.114 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 44721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm7xxx.ko 2023-11-28T18:22:15.114 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm87xx.ko 2023-11-28T18:22:15.114 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 42241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/broadcom.ko 2023-11-28T18:22:15.115 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/cicada.ko 2023-11-28T18:22:15.115 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/davicom.ko 2023-11-28T18:22:15.115 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/et1011c.ko 2023-11-28T18:22:15.115 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 24969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/icplus.ko 2023-11-28T18:22:15.115 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/lxt.ko 2023-11-28T18:22:15.115 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 82049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/marvell.ko 2023-11-28T18:22:15.115 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 76113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/micrel.ko 2023-11-28T18:22:15.115 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/national.ko 2023-11-28T18:22:15.115 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 97857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/phylink.ko 2023-11-28T18:22:15.115 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/qsemi.ko 2023-11-28T18:22:15.115 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 50065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/realtek.ko 2023-11-28T18:22:15.115 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 29985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/smsc.ko 2023-11-28T18:22:15.115 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/ste10Xp.ko 2023-11-28T18:22:15.116 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 24289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/vitesse.ko 2023-11-28T18:22:15.116 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/plip/ 2023-11-28T18:22:15.116 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 43505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/plip/plip.ko 2023-11-28T18:22:15.116 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ 2023-11-28T18:22:15.116 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/bsd_comp.ko 2023-11-28T18:22:15.116 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 29713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_async.ko 2023-11-28T18:22:15.116 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_deflate.ko 2023-11-28T18:22:15.116 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_mppe.ko 2023-11-28T18:22:15.116 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 28729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_synctty.ko 2023-11-28T18:22:15.116 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 42545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppoe.ko 2023-11-28T18:22:15.116 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppox.ko 2023-11-28T18:22:15.116 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 32689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pptp.ko 2023-11-28T18:22:15.116 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 28289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/sb1000.ko 2023-11-28T18:22:15.117 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/ 2023-11-28T18:22:15.117 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 42465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/slip.ko 2023-11-28T18:22:15.117 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/sungem_phy.ko 2023-11-28T18:22:15.117 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 64449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/tap.ko 2023-11-28T18:22:15.117 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/ 2023-11-28T18:22:15.117 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 106169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team.ko 2023-11-28T18:22:15.117 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_activebackup.ko 2023-11-28T18:22:15.117 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_broadcast.ko 2023-11-28T18:22:15.117 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 28881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-11-28T18:22:15.117 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_random.ko 2023-11-28T18:22:15.117 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-11-28T18:22:15.117 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 87017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/veth.ko 2023-11-28T18:22:15.117 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3/ 2023-11-28T18:22:15.118 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 144297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-11-28T18:22:15.118 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan/ 2023-11-28T18:22:15.118 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 297329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan/vxlan.ko 2023-11-28T18:22:15.118 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback/ 2023-11-28T18:22:15.118 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 144585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback/xen-netback.ko 2023-11-28T18:22:15.118 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb/ 2023-11-28T18:22:15.118 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb/ntb.ko 2023-11-28T18:22:15.118 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/ 2023-11-28T18:22:15.118 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/ 2023-11-28T18:22:15.118 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 265121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme-core.ko 2023-11-28T18:22:15.118 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 102209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme.ko 2023-11-28T18:22:15.118 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/ 2023-11-28T18:22:15.119 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 133841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport.ko 2023-11-28T18:22:15.119 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_cs.ko 2023-11-28T18:22:15.119 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 84465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_pc.ko 2023-11-28T18:22:15.119 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_serial.ko 2023-11-28T18:22:15.119 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/ 2023-11-28T18:22:15.119 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/ 2023-11-28T18:22:15.119 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 25009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-11-28T18:22:15.119 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-11-28T18:22:15.119 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-11-28T18:22:15.119 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/pci-stub.ko 2023-11-28T18:22:15.119 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 46465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/xen-pcifront.ko 2023-11-28T18:22:15.119 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/ 2023-11-28T18:22:15.119 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/i82092.ko 2023-11-28T18:22:15.120 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 145809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia.ko 2023-11-28T18:22:15.120 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 62137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia_core.ko 2023-11-28T18:22:15.120 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 34345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-11-28T18:22:15.120 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 34265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pd6729.ko 2023-11-28T18:22:15.120 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 112889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/yenta_socket.ko 2023-11-28T18:22:15.120 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/ 2023-11-28T18:22:15.120 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/broadcom/ 2023-11-28T18:22:15.120 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-11-28T18:22:15.120 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/samsung/ 2023-11-28T18:22:15.120 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-11-28T18:22:15.120 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/ 2023-11-28T18:22:15.120 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel/ 2023-11-28T18:22:15.121 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 70153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-11-28T18:22:15.121 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/ 2023-11-28T18:22:15.121 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/ 2023-11-28T18:22:15.121 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 50889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-11-28T18:22:15.121 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec.ko 2023-11-28T18:22:15.121 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 21449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-11-28T18:22:15.121 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 25417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-11-28T18:22:15.121 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-11-28T18:22:15.121 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-11-28T18:22:15.121 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-11-28T18:22:15.121 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/ 2023-11-28T18:22:15.121 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 67097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acer-wmi.ko 2023-11-28T18:22:15.122 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 39145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acerhdf.ko 2023-11-28T18:22:15.122 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 37025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/apple-gmux.ko 2023-11-28T18:22:15.122 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 59665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-laptop.ko 2023-11-28T18:22:15.122 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 31161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-11-28T18:22:15.122 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 127441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-wmi.ko 2023-11-28T18:22:15.122 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 36849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/classmate-laptop.ko 2023-11-28T18:22:15.122 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 49121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-11-28T18:22:15.122 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-11-28T18:22:15.122 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 40265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-11-28T18:22:15.122 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 22521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-11-28T18:22:15.122 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 36593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/hdaps.ko 2023-11-28T18:22:15.122 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/ibm_rtl.ko 2023-11-28T18:22:15.123 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/ 2023-11-28T18:22:15.123 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-11-28T18:22:15.123 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-11-28T18:22:15.123 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 43497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel_ips.ko 2023-11-28T18:22:15.123 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/msi-wmi.ko 2023-11-28T18:22:15.123 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/mxm-wmi.ko 2023-11-28T18:22:15.123 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 34801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-11-28T18:22:15.123 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 42329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-laptop.ko 2023-11-28T18:22:15.123 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-q10.ko 2023-11-28T18:22:15.123 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/topstar-laptop.ko 2023-11-28T18:22:15.123 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-11-28T18:22:15.123 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_haps.ko 2023-11-28T18:22:15.124 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi-bmof.ko 2023-11-28T18:22:15.124 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 57569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi.ko 2023-11-28T18:22:15.124 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/ 2023-11-28T18:22:15.124 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ 2023-11-28T18:22:15.124 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 30281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/88pm860x_battery.ko 2023-11-28T18:22:15.124 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 33985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/88pm860x_charger.ko 2023-11-28T18:22:15.124 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 55057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq2415x_charger.ko 2023-11-28T18:22:15.124 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 54081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq24190_charger.ko 2023-11-28T18:22:15.124 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 21553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq24735-charger.ko 2023-11-28T18:22:15.124 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-11-28T18:22:15.124 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/da9030_battery.ko 2023-11-28T18:22:15.124 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/da9052-battery.ko 2023-11-28T18:22:15.124 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 29281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2760_battery.ko 2023-11-28T18:22:15.125 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 23217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2780_battery.ko 2023-11-28T18:22:15.125 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 23353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2781_battery.ko 2023-11-28T18:22:15.125 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 23649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2782_battery.ko 2023-11-28T18:22:15.125 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/gpio-charger.ko 2023-11-28T18:22:15.125 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/isp1704_charger.ko 2023-11-28T18:22:15.125 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/lp8727_charger.ko 2023-11-28T18:22:15.125 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max14577_charger.ko 2023-11-28T18:22:15.125 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 25897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max17040_battery.ko 2023-11-28T18:22:15.125 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 30289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max17042_battery.ko 2023-11-28T18:22:15.125 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max8903_charger.ko 2023-11-28T18:22:15.125 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 23729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max8925_power.ko 2023-11-28T18:22:15.125 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 21657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/pcf50633-charger.ko 2023-11-28T18:22:15.125 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 38009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/sbs-battery.ko 2023-11-28T18:22:15.126 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 28385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/test_power.ko 2023-11-28T18:22:15.126 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/tps65090-charger.ko 2023-11-28T18:22:15.126 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm831x_backup.ko 2023-11-28T18:22:15.126 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 24521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm831x_power.ko 2023-11-28T18:22:15.126 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 22417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm8350_power.ko 2023-11-28T18:22:15.126 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/ 2023-11-28T18:22:15.126 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 57729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_common.ko 2023-11-28T18:22:15.126 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_msr.ko 2023-11-28T18:22:15.126 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/ 2023-11-28T18:22:15.126 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/ 2023-11-28T18:22:15.126 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-gpio.ko 2023-11-28T18:22:15.127 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-ldisc.ko 2023-11-28T18:22:15.127 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps_parport.ko 2023-11-28T18:22:15.127 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 41873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/pps_core.ko 2023-11-28T18:22:15.127 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ 2023-11-28T18:22:15.127 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 66385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp.ko 2023-11-28T18:22:15.127 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp_kvm.ko 2023-11-28T18:22:15.127 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/ 2023-11-28T18:22:15.127 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 23497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-88pm80x.ko 2023-11-28T18:22:15.127 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 24521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-88pm860x.ko 2023-11-28T18:22:15.127 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-bq32k.ko 2023-11-28T18:22:15.127 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9052.ko 2023-11-28T18:22:15.127 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9055.ko 2023-11-28T18:22:15.128 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9063.ko 2023-11-28T18:22:15.128 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1286.ko 2023-11-28T18:22:15.128 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 68577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1307.ko 2023-11-28T18:22:15.128 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1374.ko 2023-11-28T18:22:15.128 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1511.ko 2023-11-28T18:22:15.128 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1553.ko 2023-11-28T18:22:15.128 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1672.ko 2023-11-28T18:22:15.128 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1742.ko 2023-11-28T18:22:15.128 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds2404.ko 2023-11-28T18:22:15.128 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 23705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds3232.ko 2023-11-28T18:22:15.128 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-em3027.ko 2023-11-28T18:22:15.128 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 24329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-fm3130.ko 2023-11-28T18:22:15.128 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl12022.ko 2023-11-28T18:22:15.129 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 35969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl1208.ko 2023-11-28T18:22:15.129 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-lp8788.ko 2023-11-28T18:22:15.129 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 38097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m41t80.ko 2023-11-28T18:22:15.129 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t35.ko 2023-11-28T18:22:15.129 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t59.ko 2023-11-28T18:22:15.129 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t86.ko 2023-11-28T18:22:15.129 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max6900.ko 2023-11-28T18:22:15.129 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8907.ko 2023-11-28T18:22:15.129 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8925.ko 2023-11-28T18:22:15.129 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 25809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8997.ko 2023-11-28T18:22:15.129 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8998.ko 2023-11-28T18:22:15.129 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-11-28T18:22:15.129 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-msm6242.ko 2023-11-28T18:22:15.130 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-palmas.ko 2023-11-28T18:22:15.130 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 46633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf2127.ko 2023-11-28T18:22:15.130 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf50633.ko 2023-11-28T18:22:15.130 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf85063.ko 2023-11-28T18:22:15.130 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 21825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8523.ko 2023-11-28T18:22:15.130 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 29817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8563.ko 2023-11-28T18:22:15.130 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8583.ko 2023-11-28T18:22:15.130 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rc5t583.ko 2023-11-28T18:22:15.130 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rp5c01.ko 2023-11-28T18:22:15.130 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 33753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rs5c372.ko 2023-11-28T18:22:15.130 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 27833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-11-28T18:22:15.130 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 25257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8025.ko 2023-11-28T18:22:15.131 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8581.ko 2023-11-28T18:22:15.131 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 21617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-s35390a.ko 2023-11-28T18:22:15.131 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-11-28T18:22:15.131 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-tps6586x.ko 2023-11-28T18:22:15.131 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 21337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-tps65910.ko 2023-11-28T18:22:15.131 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-wm831x.ko 2023-11-28T18:22:15.131 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 21089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-wm8350.ko 2023-11-28T18:22:15.131 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 27873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-x1205.ko 2023-11-28T18:22:15.131 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ 2023-11-28T18:22:15.131 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 77617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-9xxx.ko 2023-11-28T18:22:15.131 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 57665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-sas.ko 2023-11-28T18:22:15.131 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 55105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-xxxx.ko 2023-11-28T18:22:15.132 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 135185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/BusLogic.ko 2023-11-28T18:22:15.132 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/a100u2w.ko 2023-11-28T18:22:15.132 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid/ 2023-11-28T18:22:15.132 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 272305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid/aacraid.ko 2023-11-28T18:22:15.132 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 100617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/advansys.ko 2023-11-28T18:22:15.132 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/ 2023-11-28T18:22:15.132 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 356201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-11-28T18:22:15.132 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 295801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-11-28T18:22:15.132 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic94xx/ 2023-11-28T18:22:15.132 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 189185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-11-28T18:22:15.132 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 24073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/am53c974.ko 2023-11-28T18:22:15.132 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr/ 2023-11-28T18:22:15.133 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 106881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-11-28T18:22:15.133 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 38185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/atp870u.ko 2023-11-28T18:22:15.133 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi/ 2023-11-28T18:22:15.133 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 246985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-11-28T18:22:15.133 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa/ 2023-11-28T18:22:15.133 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 1171945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa/bfa.ko 2023-11-28T18:22:15.133 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc/ 2023-11-28T18:22:15.133 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 237273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-11-28T18:22:15.133 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i/ 2023-11-28T18:22:15.133 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 115369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-11-28T18:22:15.133 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 40585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ch.ko 2023-11-28T18:22:15.134 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor/ 2023-11-28T18:22:15.134 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 308921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor/csiostor.ko 2023-11-28T18:22:15.134 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/ 2023-11-28T18:22:15.134 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-11-28T18:22:15.134 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 76145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-11-28T18:22:15.134 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-11-28T18:22:15.134 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 101449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-11-28T18:22:15.134 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 146689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-11-28T18:22:15.134 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 75553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dc395x.ko 2023-11-28T18:22:15.134 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 38073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dmx3191d.ko 2023-11-28T18:22:15.134 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r/ 2023-11-28T18:22:15.134 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 212425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r/esas2r.ko 2023-11-28T18:22:15.135 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 60505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esp_scsi.ko 2023-11-28T18:22:15.135 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/ 2023-11-28T18:22:15.135 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 78209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/fcoe.ko 2023-11-28T18:22:15.135 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 158505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-11-28T18:22:15.135 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fdomain.ko 2023-11-28T18:22:15.135 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic/ 2023-11-28T18:22:15.135 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 263489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic/fnic.ko 2023-11-28T18:22:15.135 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 201817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hpsa.ko 2023-11-28T18:22:15.135 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 51209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hptiop.ko 2023-11-28T18:22:15.135 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 49041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hv_storvsc.ko 2023-11-28T18:22:15.135 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 35337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/imm.ko 2023-11-28T18:22:15.135 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 44057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/initio.ko 2023-11-28T18:22:15.135 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 266537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ipr.ko 2023-11-28T18:22:15.136 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 101881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ips.ko 2023-11-28T18:22:15.136 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci/ 2023-11-28T18:22:15.136 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 317153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci/isci.ko 2023-11-28T18:22:15.136 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-11-28T18:22:15.136 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 52961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_tcp.ko 2023-11-28T18:22:15.136 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc/ 2023-11-28T18:22:15.136 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 314865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc/libfc.ko 2023-11-28T18:22:15.136 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 145585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi.ko 2023-11-28T18:22:15.136 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 53521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi_tcp.ko 2023-11-28T18:22:15.136 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas/ 2023-11-28T18:22:15.136 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 216665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas/libsas.ko 2023-11-28T18:22:15.136 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc/ 2023-11-28T18:22:15.137 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 2197249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc/lpfc.ko 2023-11-28T18:22:15.137 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/ 2023-11-28T18:22:15.137 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 73569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-11-28T18:22:15.137 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 33529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-11-28T18:22:15.137 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 310617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-11-28T18:22:15.137 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 84721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid.ko 2023-11-28T18:22:15.137 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas/ 2023-11-28T18:22:15.137 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 659825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-11-28T18:22:15.137 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas/ 2023-11-28T18:22:15.137 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 119561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas/mvsas.ko 2023-11-28T18:22:15.137 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 78129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvumi.ko 2023-11-28T18:22:15.137 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/ 2023-11-28T18:22:15.137 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 81625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-11-28T18:22:15.138 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-11-28T18:22:15.138 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-11-28T18:22:15.138 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 23857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-11-28T18:22:15.138 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001/ 2023-11-28T18:22:15.138 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 364105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-11-28T18:22:15.138 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 123617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pmcraid.ko 2023-11-28T18:22:15.138 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 34513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ppa.ko 2023-11-28T18:22:15.138 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 55361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla1280.ko 2023-11-28T18:22:15.138 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/ 2023-11-28T18:22:15.138 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 1876689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-11-28T18:22:15.138 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 85289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-11-28T18:22:15.138 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx/ 2023-11-28T18:22:15.139 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 559033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-11-28T18:22:15.139 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qlogicfas408.ko 2023-11-28T18:22:15.139 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/raid_class.ko 2023-11-28T18:22:15.139 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 238761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_debug.ko 2023-11-28T18:22:15.139 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 173937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_fc.ko 2023-11-28T18:22:15.139 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 279313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-11-28T18:22:15.139 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 97729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_sas.ko 2023-11-28T18:22:15.139 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 73881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_spi.ko 2023-11-28T18:22:15.139 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 44993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_srp.ko 2023-11-28T18:22:15.139 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ses.ko 2023-11-28T18:22:15.139 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 115889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/st.ko 2023-11-28T18:22:15.139 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 46825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/stex.ko 2023-11-28T18:22:15.140 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2/ 2023-11-28T18:22:15.140 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 162121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-11-28T18:22:15.140 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 42297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/virtio_scsi.ko 2023-11-28T18:22:15.140 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 50321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/vmw_pvscsi.ko 2023-11-28T18:22:15.140 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 39961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/wd719x.ko 2023-11-28T18:22:15.140 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 50025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/xen-scsifront.ko 2023-11-28T18:22:15.140 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb/ 2023-11-28T18:22:15.140 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 129441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb/ssb.ko 2023-11-28T18:22:15.140 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/ 2023-11-28T18:22:15.140 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi/ 2023-11-28T18:22:15.140 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 736601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-11-28T18:22:15.212 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback/ 2023-11-28T18:22:15.213 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 49985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback/tcm_loop.ko 2023-11-28T18:22:15.213 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 39713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_file.ko 2023-11-28T18:22:15.213 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 43025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_iblock.ko 2023-11-28T18:22:15.213 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 930257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_mod.ko 2023-11-28T18:22:15.213 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 44305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_pscsi.ko 2023-11-28T18:22:15.213 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 122521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_user.ko 2023-11-28T18:22:15.213 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc/ 2023-11-28T18:22:15.213 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 75593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-11-28T18:22:15.213 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/ 2023-11-28T18:22:15.213 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/ 2023-11-28T18:22:15.213 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/ 2023-11-28T18:22:15.214 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 23481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-11-28T18:22:15.214 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 29321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-11-28T18:22:15.214 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-11-28T18:22:15.214 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-11-28T18:22:15.214 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-11-28T18:22:15.214 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-11-28T18:22:15.214 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-11-28T18:22:15.214 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-11-28T18:22:15.214 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-11-28T18:22:15.214 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-11-28T18:22:15.214 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-11-28T18:22:15.215 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 37065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-11-28T18:22:15.215 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 30729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-11-28T18:22:15.215 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-11-28T18:22:15.215 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-11-28T18:22:15.215 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-11-28T18:22:15.215 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ 2023-11-28T18:22:15.215 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless/ 2023-11-28T18:22:15.215 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 78425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-11-28T18:22:15.215 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 57865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/moxa.ko 2023-11-28T18:22:15.215 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 50953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/mxser.ko 2023-11-28T18:22:15.215 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 108601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_gsm.ko 2023-11-28T18:22:15.215 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 31961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_hdlc.ko 2023-11-28T18:22:15.215 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 67929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/nozomi.ko 2023-11-28T18:22:15.216 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/ 2023-11-28T18:22:15.216 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/ 2023-11-28T18:22:15.216 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 35753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-11-28T18:22:15.216 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 59497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-11-28T18:22:15.216 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-11-28T18:22:15.216 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 22577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/altera_uart.ko 2023-11-28T18:22:15.216 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/arc_uart.ko 2023-11-28T18:22:15.216 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 72425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-11-28T18:22:15.216 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm/ 2023-11-28T18:22:15.216 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 103073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm/jsm.ko 2023-11-28T18:22:15.216 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 28785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/rp2.ko 2023-11-28T18:22:15.216 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 52817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/sc16is7xx.ko 2023-11-28T18:22:15.216 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/ 2023-11-28T18:22:15.217 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core/ 2023-11-28T18:22:15.217 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 531265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core/ufshcd-core.ko 2023-11-28T18:22:15.217 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ 2023-11-28T18:22:15.217 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 28481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-11-28T18:22:15.217 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-11-28T18:22:15.217 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/ 2023-11-28T18:22:15.217 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 44513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio.ko 2023-11-28T18:22:15.217 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_aec.ko 2023-11-28T18:22:15.217 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_cif.ko 2023-11-28T18:22:15.217 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_dmem_genirq.ko 2023-11-28T18:22:15.217 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_mf624.ko 2023-11-28T18:22:15.217 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_netx.ko 2023-11-28T18:22:15.218 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_pci_generic.ko 2023-11-28T18:22:15.218 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-11-28T18:22:15.218 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_sercos3.ko 2023-11-28T18:22:15.218 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/ 2023-11-28T18:22:15.218 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/c67x00/ 2023-11-28T18:22:15.218 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 73297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/c67x00/c67x00.ko 2023-11-28T18:22:15.218 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ 2023-11-28T18:22:15.218 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 144377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-11-28T18:22:15.218 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-11-28T18:22:15.218 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-11-28T18:22:15.218 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-11-28T18:22:15.218 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/ 2023-11-28T18:22:15.219 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 87089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-acm.ko 2023-11-28T18:22:15.219 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 51345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-wdm.ko 2023-11-28T18:22:15.219 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 47305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usblp.ko 2023-11-28T18:22:15.219 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 89857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usbtmc.ko 2023-11-28T18:22:15.219 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/common/ 2023-11-28T18:22:15.219 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 22953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/common/ulpi.ko 2023-11-28T18:22:15.219 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc2/ 2023-11-28T18:22:15.219 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-11-28T18:22:15.219 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/ 2023-11-28T18:22:15.219 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-11-28T18:22:15.219 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 30041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-11-28T18:22:15.219 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 448505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3.ko 2023-11-28T18:22:15.220 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/ 2023-11-28T18:22:15.220 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/ 2023-11-28T18:22:15.220 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 60177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/u_ether.ko 2023-11-28T18:22:15.220 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 51881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/u_serial.ko 2023-11-28T18:22:15.220 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 28841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-11-28T18:22:15.220 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 42449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-11-28T18:22:15.220 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 27953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-11-28T18:22:15.220 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 36513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-11-28T18:22:15.220 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 92489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-11-28T18:22:15.220 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 51049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-11-28T18:22:15.220 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 122081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-11-28T18:22:15.220 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 57681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-11-28T18:22:15.221 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 22185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-11-28T18:22:15.221 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 31265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-11-28T18:22:15.221 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 57729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-11-28T18:22:15.221 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 85609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-11-28T18:22:15.221 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-11-28T18:22:15.221 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 58113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-11-28T18:22:15.221 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 67337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-11-28T18:22:15.221 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/ 2023-11-28T18:22:15.221 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 21265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-11-28T18:22:15.221 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-11-28T18:22:15.221 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-11-28T18:22:15.221 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 21657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-11-28T18:22:15.221 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 28401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-11-28T18:22:15.222 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-11-28T18:22:15.222 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-11-28T18:22:15.222 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-11-28T18:22:15.222 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 32073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-11-28T18:22:15.222 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-11-28T18:22:15.222 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-11-28T18:22:15.222 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 27201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-11-28T18:22:15.222 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 62185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-11-28T18:22:15.222 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-11-28T18:22:15.222 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 161225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/libcomposite.ko 2023-11-28T18:22:15.222 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/ 2023-11-28T18:22:15.222 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-11-28T18:22:15.223 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/bdc/ 2023-11-28T18:22:15.223 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 157681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-11-28T18:22:15.223 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 36089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-11-28T18:22:15.223 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 52721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-11-28T18:22:15.223 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 69705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-11-28T18:22:15.223 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 56033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-11-28T18:22:15.223 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 76057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/net2272.ko 2023-11-28T18:22:15.223 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 75073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/net2280.ko 2023-11-28T18:22:15.223 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 73169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-11-28T18:22:15.223 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 65809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-11-28T18:22:15.223 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 66097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-11-28T18:22:15.223 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 81505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-11-28T18:22:15.224 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 156073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-11-28T18:22:15.224 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/ 2023-11-28T18:22:15.224 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/bcma-hcd.ko 2023-11-28T18:22:15.224 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 80113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/isp116x-hcd.ko 2023-11-28T18:22:15.224 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 87353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-11-28T18:22:15.224 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 78873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-11-28T18:22:15.224 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 51329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/sl811-hcd.ko 2023-11-28T18:22:15.224 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/sl811_cs.ko 2023-11-28T18:22:15.224 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/ssb-hcd.ko 2023-11-28T18:22:15.224 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-11-28T18:22:15.224 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/ 2023-11-28T18:22:15.224 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 34585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/mdc800.ko 2023-11-28T18:22:15.224 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 21081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/microtek.ko 2023-11-28T18:22:15.225 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ 2023-11-28T18:22:15.225 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 41721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/adutux.ko 2023-11-28T18:22:15.225 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/appledisplay.ko 2023-11-28T18:22:15.225 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-11-28T18:22:15.225 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 23049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/cytherm.ko 2023-11-28T18:22:15.225 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ehset.ko 2023-11-28T18:22:15.225 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi26.ko 2023-11-28T18:22:15.225 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi62.ko 2023-11-28T18:22:15.225 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ezusb.ko 2023-11-28T18:22:15.225 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/idmouse.ko 2023-11-28T18:22:15.225 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 36553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/iowarrior.ko 2023-11-28T18:22:15.225 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/isight_firmware.ko 2023-11-28T18:22:15.225 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 36529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ldusb.ko 2023-11-28T18:22:15.226 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 36265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/legousbtower.ko 2023-11-28T18:22:15.226 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 27793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/lvstest.ko 2023-11-28T18:22:15.226 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga/ 2023-11-28T18:22:15.226 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 64841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-11-28T18:22:15.226 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/trancevibrator.ko 2023-11-28T18:22:15.226 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usb3503.ko 2023-11-28T18:22:15.226 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usblcd.ko 2023-11-28T18:22:15.226 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 22753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usbsevseg.ko 2023-11-28T18:22:15.226 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 70809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usbtest.ko 2023-11-28T18:22:15.226 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 41905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/uss720.ko 2023-11-28T18:22:15.226 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 27617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/yurex.ko 2023-11-28T18:22:15.227 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/mon/ 2023-11-28T18:22:15.227 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 72953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/mon/usbmon.ko 2023-11-28T18:22:15.227 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/musb/ 2023-11-28T18:22:15.227 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 301697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/musb/musb_hdrc.ko 2023-11-28T18:22:15.227 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/ 2023-11-28T18:22:15.227 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 21105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-generic.ko 2023-11-28T18:22:15.227 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-11-28T18:22:15.227 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-isp1301.ko 2023-11-28T18:22:15.227 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 21745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-tahvo.ko 2023-11-28T18:22:15.227 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ 2023-11-28T18:22:15.227 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/aircable.ko 2023-11-28T18:22:15.227 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 33329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ark3116.ko 2023-11-28T18:22:15.227 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/belkin_sa.ko 2023-11-28T18:22:15.228 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 38105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ch341.ko 2023-11-28T18:22:15.228 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 70257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cp210x.ko 2023-11-28T18:22:15.228 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 31057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cyberjack.ko 2023-11-28T18:22:15.228 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 58217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cypress_m8.ko 2023-11-28T18:22:15.228 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 49817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/digi_acceleport.ko 2023-11-28T18:22:15.228 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/empeg.ko 2023-11-28T18:22:15.228 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 44273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/f81232.ko 2023-11-28T18:22:15.228 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 175137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ftdi_sio.ko 2023-11-28T18:22:15.228 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 53113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/garmin_gps.ko 2023-11-28T18:22:15.228 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 137081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_edgeport.ko 2023-11-28T18:22:15.228 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 124833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_ti.ko 2023-11-28T18:22:15.228 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 67769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipaq.ko 2023-11-28T18:22:15.229 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipw.ko 2023-11-28T18:22:15.229 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ir-usb.ko 2023-11-28T18:22:15.229 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 58233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-11-28T18:22:15.229 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 107521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan.ko 2023-11-28T18:22:15.229 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 35617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan_pda.ko 2023-11-28T18:22:15.229 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 25665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kl5kusb105.ko 2023-11-28T18:22:15.229 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 33689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kobil_sct.ko 2023-11-28T18:22:15.229 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 32953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mct_u232.ko 2023-11-28T18:22:15.229 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 22033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/metro-usb.ko 2023-11-28T18:22:15.229 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 66449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7720.ko 2023-11-28T18:22:15.229 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 78217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7840.ko 2023-11-28T18:22:15.229 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 56337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mxuport.ko 2023-11-28T18:22:15.229 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/navman.ko 2023-11-28T18:22:15.230 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/omninet.ko 2023-11-28T18:22:15.230 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 24633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/opticon.ko 2023-11-28T18:22:15.230 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 191137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/option.ko 2023-11-28T18:22:15.230 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 39073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/oti6858.ko 2023-11-28T18:22:15.230 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 54353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/pl2303.ko 2023-11-28T18:22:15.230 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcaux.ko 2023-11-28T18:22:15.230 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 37825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcserial.ko 2023-11-28T18:22:15.230 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 34321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/quatech2.ko 2023-11-28T18:22:15.230 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/safe_serial.ko 2023-11-28T18:22:15.230 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 51625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/sierra.ko 2023-11-28T18:22:15.230 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 21673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/spcp8x5.ko 2023-11-28T18:22:15.230 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 29993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ssu100.ko 2023-11-28T18:22:15.231 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/symbolserial.ko 2023-11-28T18:22:15.231 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 61489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-11-28T18:22:15.231 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 23729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-11-28T18:22:15.231 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_debug.ko 2023-11-28T18:22:15.231 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 33201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_wwan.ko 2023-11-28T18:22:15.231 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 125609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usbserial.ko 2023-11-28T18:22:15.231 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 28753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/visor.ko 2023-11-28T18:22:15.231 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 37409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/whiteheat.ko 2023-11-28T18:22:15.231 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/wishbone-serial.ko 2023-11-28T18:22:15.231 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/xsens_mt.ko 2023-11-28T18:22:15.231 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ 2023-11-28T18:22:15.231 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 52913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/uas.ko 2023-11-28T18:22:15.232 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-alauda.ko 2023-11-28T18:22:15.232 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-cypress.ko 2023-11-28T18:22:15.232 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 22049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-datafab.ko 2023-11-28T18:22:15.232 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 33497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-11-28T18:22:15.232 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-freecom.ko 2023-11-28T18:22:15.232 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-isd200.ko 2023-11-28T18:22:15.232 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-11-28T18:22:15.232 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-karma.ko 2023-11-28T18:22:15.232 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-onetouch.ko 2023-11-28T18:22:15.232 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 28441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-realtek.ko 2023-11-28T18:22:15.232 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 28905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr09.ko 2023-11-28T18:22:15.232 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr55.ko 2023-11-28T18:22:15.232 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 35337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-usbat.ko 2023-11-28T18:22:15.233 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 179969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/usb-storage.ko 2023-11-28T18:22:15.233 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/ 2023-11-28T18:22:15.233 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 67481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-core.ko 2023-11-28T18:22:15.233 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 72177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-host.ko 2023-11-28T18:22:15.233 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 107001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-11-28T18:22:15.233 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/ 2023-11-28T18:22:15.233 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/ 2023-11-28T18:22:15.233 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 154297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-11-28T18:22:15.233 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 29537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci.ko 2023-11-28T18:22:15.233 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 108737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio.ko 2023-11-28T18:22:15.233 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 77609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-11-28T18:22:15.233 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/ 2023-11-28T18:22:15.233 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 113785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost.ko 2023-11-28T18:22:15.234 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_iotlb.ko 2023-11-28T18:22:15.234 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 58089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_net.ko 2023-11-28T18:22:15.234 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 89249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_scsi.ko 2023-11-28T18:22:15.234 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/ 2023-11-28T18:22:15.234 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/ 2023-11-28T18:22:15.234 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-11-28T18:22:15.234 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/aat2870_bl.ko 2023-11-28T18:22:15.234 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 23305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp5520_bl.ko 2023-11-28T18:22:15.234 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 32609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp8860_bl.ko 2023-11-28T18:22:15.234 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 39993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp8870_bl.ko 2023-11-28T18:22:15.234 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/apple_bl.ko 2023-11-28T18:22:15.234 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/as3711_bl.ko 2023-11-28T18:22:15.235 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/bd6107.ko 2023-11-28T18:22:15.235 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/da903x_bl.ko 2023-11-28T18:22:15.235 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/da9052_bl.ko 2023-11-28T18:22:15.235 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/gpio_backlight.ko 2023-11-28T18:22:15.235 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/kb3886_bl.ko 2023-11-28T18:22:15.235 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 22017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lcd.ko 2023-11-28T18:22:15.235 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 23657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lm3533_bl.ko 2023-11-28T18:22:15.235 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lm3639_bl.ko 2023-11-28T18:22:15.235 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lv5207lp.ko 2023-11-28T18:22:15.235 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/max8925_bl.ko 2023-11-28T18:22:15.235 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/pandora_bl.ko 2023-11-28T18:22:15.235 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-11-28T18:22:15.236 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/platform_lcd.ko 2023-11-28T18:22:15.236 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/wm831x_bl.ko 2023-11-28T18:22:15.236 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/ 2023-11-28T18:22:15.236 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ 2023-11-28T18:22:15.236 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2482.ko 2023-11-28T18:22:15.236 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 38985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2490.ko 2023-11-28T18:22:15.236 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/matrox_w1.ko 2023-11-28T18:22:15.236 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/w1-gpio.ko 2023-11-28T18:22:15.236 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/ 2023-11-28T18:22:15.236 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-11-28T18:22:15.236 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 22745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-11-28T18:22:15.236 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-11-28T18:22:15.237 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-11-28T18:22:15.237 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-11-28T18:22:15.237 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-11-28T18:22:15.237 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-11-28T18:22:15.237 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-11-28T18:22:15.237 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-11-28T18:22:15.237 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 7385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_smem.ko 2023-11-28T18:22:15.237 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 56425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_therm.ko 2023-11-28T18:22:15.237 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 102673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/wire.ko 2023-11-28T18:22:15.237 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ 2023-11-28T18:22:15.237 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/acquirewdt.ko 2023-11-28T18:22:15.237 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/advantechwdt.ko 2023-11-28T18:22:15.237 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim1535_wdt.ko 2023-11-28T18:22:15.238 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 22969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim7101_wdt.ko 2023-11-28T18:22:15.238 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/cpu5wdt.ko 2023-11-28T18:22:15.238 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9052_wdt.ko 2023-11-28T18:22:15.238 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9055_wdt.ko 2023-11-28T18:22:15.238 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9063_wdt.ko 2023-11-28T18:22:15.238 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/dw_wdt.ko 2023-11-28T18:22:15.238 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/eurotechwdt.ko 2023-11-28T18:22:15.238 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 23865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/f71808e_wdt.ko 2023-11-28T18:22:15.238 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 27401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/hpwdt.ko 2023-11-28T18:22:15.238 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/i6300esb.ko 2023-11-28T18:22:15.238 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-11-28T18:22:15.238 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 21913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_wdt.ko 2023-11-28T18:22:15.239 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ib700wdt.ko 2023-11-28T18:22:15.239 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ibmasr.ko 2023-11-28T18:22:15.239 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-11-28T18:22:15.239 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 21225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it8712f_wdt.ko 2023-11-28T18:22:15.239 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it87_wdt.ko 2023-11-28T18:22:15.239 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 21489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/kempld_wdt.ko 2023-11-28T18:22:15.239 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/machzwd.ko 2023-11-28T18:22:15.239 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/mena21_wdt.ko 2023-11-28T18:22:15.239 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-11-28T18:22:15.240 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 24673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/nv_tco.ko 2023-11-28T18:22:15.240 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-11-28T18:22:15.240 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 22265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pc87413_wdt.ko 2023-11-28T18:22:15.240 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 38657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_pci.ko 2023-11-28T18:22:15.240 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 31825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_usb.ko 2023-11-28T18:22:15.240 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/retu_wdt.ko 2023-11-28T18:22:15.240 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-11-28T18:22:15.240 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-11-28T18:22:15.240 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-11-28T18:22:15.240 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 23809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sc1200wdt.ko 2023-11-28T18:22:15.240 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 23321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sch311x_wdt.ko 2023-11-28T18:22:15.240 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 21577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-11-28T18:22:15.240 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/softdog.ko 2023-11-28T18:22:15.241 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 22273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sp5100_tco.ko 2023-11-28T18:22:15.241 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/twl4030_wdt.ko 2023-11-28T18:22:15.241 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/via_wdt.ko 2023-11-28T18:22:15.241 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-11-28T18:22:15.241 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83877f_wdt.ko 2023-11-28T18:22:15.241 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 25409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83977f_wdt.ko 2023-11-28T18:22:15.241 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wafer5823wdt.ko 2023-11-28T18:22:15.241 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 28089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wdt_pci.ko 2023-11-28T18:22:15.241 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wm831x_wdt.ko 2023-11-28T18:22:15.241 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wm8350_wdt.ko 2023-11-28T18:22:15.241 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/xen_wdt.ko 2023-11-28T18:22:15.241 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/ 2023-11-28T18:22:15.242 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-evtchn.ko 2023-11-28T18:22:15.242 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntalloc.ko 2023-11-28T18:22:15.242 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 47865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntdev.ko 2023-11-28T18:22:15.242 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback/ 2023-11-28T18:22:15.242 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 176377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-11-28T18:22:15.242 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 40121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-privcmd.ko 2023-11-28T18:22:15.242 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 71249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-scsiback.ko 2023-11-28T18:22:15.242 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs/ 2023-11-28T18:22:15.242 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs/xenfs.ko 2023-11-28T18:22:15.242 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ 2023-11-28T18:22:15.242 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p/ 2023-11-28T18:22:15.242 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 166425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p/9p.ko 2023-11-28T18:22:15.242 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/adfs/ 2023-11-28T18:22:15.243 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 61073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/adfs/adfs.ko 2023-11-28T18:22:15.243 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs/ 2023-11-28T18:22:15.243 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 163593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs/affs.ko 2023-11-28T18:22:15.243 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/afs/ 2023-11-28T18:22:15.243 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 932817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/afs/kafs.ko 2023-11-28T18:22:15.243 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/autofs/ 2023-11-28T18:22:15.243 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 101057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/autofs/autofs4.ko 2023-11-28T18:22:15.243 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs/ 2023-11-28T18:22:15.243 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 64545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs/befs.ko 2023-11-28T18:22:15.243 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/bfs/ 2023-11-28T18:22:15.243 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 41257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/bfs/bfs.ko 2023-11-28T18:22:15.243 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 34585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/binfmt_misc.ko 2023-11-28T18:22:15.244 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs/ 2023-11-28T18:22:15.244 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 3402729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs/btrfs.ko 2023-11-28T18:22:15.244 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles/ 2023-11-28T18:22:15.244 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 306009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles/cachefiles.ko 2023-11-28T18:22:15.244 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph/ 2023-11-28T18:22:15.244 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 1333017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph/ceph.ko 2023-11-28T18:22:15.244 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda/ 2023-11-28T18:22:15.244 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 100801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda/coda.ko 2023-11-28T18:22:15.244 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/configfs/ 2023-11-28T18:22:15.244 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 108393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/configfs/configfs.ko 2023-11-28T18:22:15.244 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs/ 2023-11-28T18:22:15.244 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 29625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs/cramfs.ko 2023-11-28T18:22:15.244 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm/ 2023-11-28T18:22:15.244 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 642513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm/dlm.ko 2023-11-28T18:22:15.245 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/efs/ 2023-11-28T18:22:15.245 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 36649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/efs/efs.ko 2023-11-28T18:22:15.245 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs/ 2023-11-28T18:22:15.245 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 1505025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs/f2fs.ko 2023-11-28T18:22:15.245 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/ 2023-11-28T18:22:15.245 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 27929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/msdos.ko 2023-11-28T18:22:15.245 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/freevxfs/ 2023-11-28T18:22:15.245 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 42545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/freevxfs/freevxfs.ko 2023-11-28T18:22:15.245 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache/ 2023-11-28T18:22:15.245 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 226481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache/fscache.ko 2023-11-28T18:22:15.245 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/ 2023-11-28T18:22:15.245 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 24489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/cuse.ko 2023-11-28T18:22:15.246 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2/ 2023-11-28T18:22:15.246 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 1231529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2/gfs2.ko 2023-11-28T18:22:15.246 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs/ 2023-11-28T18:22:15.246 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 141209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs/hfs.ko 2023-11-28T18:22:15.246 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus/ 2023-11-28T18:22:15.246 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 222817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus/hfsplus.ko 2023-11-28T18:22:15.246 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hpfs/ 2023-11-28T18:22:15.246 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 192329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hpfs/hpfs.ko 2023-11-28T18:22:15.246 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs/ 2023-11-28T18:22:15.246 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 74065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs/isofs.ko 2023-11-28T18:22:15.246 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs/ 2023-11-28T18:22:15.246 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 419497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs/jfs.ko 2023-11-28T18:22:15.247 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd/ 2023-11-28T18:22:15.247 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 280313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd/lockd.ko 2023-11-28T18:22:15.247 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix/ 2023-11-28T18:22:15.247 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 89193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix/minix.ko 2023-11-28T18:22:15.247 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs/ 2023-11-28T18:22:15.247 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 124649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs/netfs.ko 2023-11-28T18:22:15.247 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/ 2023-11-28T18:22:15.247 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout/ 2023-11-28T18:22:15.247 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 81449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-11-28T18:22:15.247 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout/ 2023-11-28T18:22:15.247 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 59449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-11-28T18:22:15.247 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout/ 2023-11-28T18:22:15.247 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 117465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-11-28T18:22:15.248 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 1055721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfs.ko 2023-11-28T18:22:15.248 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 66441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv2.ko 2023-11-28T18:22:15.248 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 120177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv3.ko 2023-11-28T18:22:15.248 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 2042137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv4.ko 2023-11-28T18:22:15.248 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/ 2023-11-28T18:22:15.248 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/grace.ko 2023-11-28T18:22:15.248 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/nfs_acl.ko 2023-11-28T18:22:15.248 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd/ 2023-11-28T18:22:15.248 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 1516873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd/nfsd.ko 2023-11-28T18:22:15.248 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2/ 2023-11-28T18:22:15.248 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 592833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2/nilfs2.ko 2023-11-28T18:22:15.248 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/ 2023-11-28T18:22:15.248 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-celtic.ko 2023-11-28T18:22:15.249 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-centeuro.ko 2023-11-28T18:22:15.249 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-croatian.ko 2023-11-28T18:22:15.249 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-cyrillic.ko 2023-11-28T18:22:15.249 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-gaelic.ko 2023-11-28T18:22:15.249 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-greek.ko 2023-11-28T18:22:15.249 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-iceland.ko 2023-11-28T18:22:15.249 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-inuit.ko 2023-11-28T18:22:15.249 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-roman.ko 2023-11-28T18:22:15.249 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-romanian.ko 2023-11-28T18:22:15.249 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-turkish.ko 2023-11-28T18:22:15.249 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_ascii.ko 2023-11-28T18:22:15.249 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1250.ko 2023-11-28T18:22:15.250 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1251.ko 2023-11-28T18:22:15.250 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1255.ko 2023-11-28T18:22:15.250 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp737.ko 2023-11-28T18:22:15.250 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp775.ko 2023-11-28T18:22:15.250 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp850.ko 2023-11-28T18:22:15.250 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp852.ko 2023-11-28T18:22:15.250 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp855.ko 2023-11-28T18:22:15.250 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp857.ko 2023-11-28T18:22:15.250 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp860.ko 2023-11-28T18:22:15.250 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp861.ko 2023-11-28T18:22:15.250 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp862.ko 2023-11-28T18:22:15.250 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp863.ko 2023-11-28T18:22:15.250 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp864.ko 2023-11-28T18:22:15.251 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp865.ko 2023-11-28T18:22:15.251 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp866.ko 2023-11-28T18:22:15.251 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp869.ko 2023-11-28T18:22:15.251 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp874.ko 2023-11-28T18:22:15.251 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 94137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp932.ko 2023-11-28T18:22:15.251 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 142673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp936.ko 2023-11-28T18:22:15.251 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 165745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp949.ko 2023-11-28T18:22:15.251 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 118121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp950.ko 2023-11-28T18:22:15.251 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_euc-jp.ko 2023-11-28T18:22:15.251 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-1.ko 2023-11-28T18:22:15.251 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-13.ko 2023-11-28T18:22:15.251 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-14.ko 2023-11-28T18:22:15.252 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-15.ko 2023-11-28T18:22:15.252 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-2.ko 2023-11-28T18:22:15.252 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-3.ko 2023-11-28T18:22:15.252 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-4.ko 2023-11-28T18:22:15.252 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-5.ko 2023-11-28T18:22:15.252 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-6.ko 2023-11-28T18:22:15.252 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-7.ko 2023-11-28T18:22:15.252 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-9.ko 2023-11-28T18:22:15.252 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-r.ko 2023-11-28T18:22:15.252 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-ru.ko 2023-11-28T18:22:15.252 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-u.ko 2023-11-28T18:22:15.252 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 7569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_ucs2_utils.ko 2023-11-28T18:22:15.252 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_utf8.ko 2023-11-28T18:22:15.253 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ntfs/ 2023-11-28T18:22:15.253 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 219417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ntfs/ntfs.ko 2023-11-28T18:22:15.253 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ 2023-11-28T18:22:15.253 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster/ 2023-11-28T18:22:15.253 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 244409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-11-28T18:22:15.253 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm/ 2023-11-28T18:22:15.253 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 440737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-11-28T18:22:15.253 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs/ 2023-11-28T18:22:15.253 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 54049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-11-28T18:22:15.253 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 2592433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2.ko 2023-11-28T18:22:15.253 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-11-28T18:22:15.253 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 31729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-11-28T18:22:15.253 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 35897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-11-28T18:22:15.253 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/omfs/ 2023-11-28T18:22:15.254 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 53433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/omfs/omfs.ko 2023-11-28T18:22:15.254 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs/ 2023-11-28T18:22:15.254 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 352161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs/overlay.ko 2023-11-28T18:22:15.254 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore/ 2023-11-28T18:22:15.254 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 54809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore/ramoops.ko 2023-11-28T18:22:15.254 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx4/ 2023-11-28T18:22:15.254 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx4/qnx4.ko 2023-11-28T18:22:15.254 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx6/ 2023-11-28T18:22:15.254 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 46689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx6/qnx6.ko 2023-11-28T18:22:15.254 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/ 2023-11-28T18:22:15.254 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 30881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_tree.ko 2023-11-28T18:22:15.254 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_v1.ko 2023-11-28T18:22:15.255 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 22017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_v2.ko 2023-11-28T18:22:15.255 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs/ 2023-11-28T18:22:15.255 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 532673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs/reiserfs.ko 2023-11-28T18:22:15.255 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs/ 2023-11-28T18:22:15.255 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 28641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs/romfs.ko 2023-11-28T18:22:15.255 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/ 2023-11-28T18:22:15.255 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client/ 2023-11-28T18:22:15.255 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 2668401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client/cifs.ko 2023-11-28T18:22:15.255 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/ 2023-11-28T18:22:15.255 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 7161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_arc4.ko 2023-11-28T18:22:15.255 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_md4.ko 2023-11-28T18:22:15.255 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs/ 2023-11-28T18:22:15.255 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 134641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs/squashfs.ko 2023-11-28T18:22:15.256 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv/ 2023-11-28T18:22:15.256 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 90721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv/sysv.ko 2023-11-28T18:22:15.256 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf/ 2023-11-28T18:22:15.256 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 247737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf/udf.ko 2023-11-28T18:22:15.256 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs/ 2023-11-28T18:22:15.256 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 162497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs/ufs.ko 2023-11-28T18:22:15.256 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs/ 2023-11-28T18:22:15.256 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 4011017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs/xfs.ko 2023-11-28T18:22:15.256 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/ 2023-11-28T18:22:15.256 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/locking/ 2023-11-28T18:22:15.256 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 75489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/locking/locktorture.ko 2023-11-28T18:22:15.256 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/time/ 2023-11-28T18:22:15.256 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/time/test_udelay.ko 2023-11-28T18:22:15.257 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 60553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/torture.ko 2023-11-28T18:22:15.257 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ 2023-11-28T18:22:15.257 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 6833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc-itu-t.ko 2023-11-28T18:22:15.257 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 6529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc7.ko 2023-11-28T18:22:15.257 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 7025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc8.ko 2023-11-28T18:22:15.257 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/ 2023-11-28T18:22:15.257 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 7097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libarc4.ko 2023-11-28T18:22:15.257 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 37081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libdes.ko 2023-11-28T18:22:15.257 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/interval_tree_test.ko 2023-11-28T18:22:15.257 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/libcrc32c.ko 2023-11-28T18:22:15.257 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 24953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lru_cache.ko 2023-11-28T18:22:15.257 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/ 2023-11-28T18:22:15.257 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 33801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4_compress.ko 2023-11-28T18:22:15.258 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 22633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4hc_compress.ko 2023-11-28T18:22:15.258 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math/ 2023-11-28T18:22:15.258 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 6617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math/cordic.ko 2023-11-28T18:22:15.258 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/memory-notifier-error-inject.ko 2023-11-28T18:22:15.258 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/notifier-error-inject.ko 2023-11-28T18:22:15.258 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/percpu_test.ko 2023-11-28T18:22:15.258 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/pm-notifier-error-inject.ko 2023-11-28T18:22:15.258 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6/ 2023-11-28T18:22:15.258 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 143433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6/raid6_pq.ko 2023-11-28T18:22:15.258 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 21105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/rbtree_test.ko 2023-11-28T18:22:15.258 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon/ 2023-11-28T18:22:15.258 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon/reed_solomon.ko 2023-11-28T18:22:15.258 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 38841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test-kstrtox.ko 2023-11-28T18:22:15.259 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test-string_helpers.ko 2023-11-28T18:22:15.259 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 4760425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_bpf.ko 2023-11-28T18:22:15.259 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 49089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_firmware.ko 2023-11-28T18:22:15.259 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 6369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_module.ko 2023-11-28T18:22:15.259 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_user_copy.ko 2023-11-28T18:22:15.259 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_bm.ko 2023-11-28T18:22:15.259 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_fsm.ko 2023-11-28T18:22:15.259 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_kmp.ko 2023-11-28T18:22:15.259 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/xz/ 2023-11-28T18:22:15.259 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/xz/xz_dec_test.ko 2023-11-28T18:22:15.259 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/mm/ 2023-11-28T18:22:15.259 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/mm/hwpoison-inject.ko 2023-11-28T18:22:15.259 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ 2023-11-28T18:22:15.260 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/ 2023-11-28T18:22:15.260 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 55737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/6lowpan.ko 2023-11-28T18:22:15.260 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 7049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_dest.ko 2023-11-28T18:22:15.260 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 7065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_fragment.ko 2023-11-28T18:22:15.260 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 7049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_hop.ko 2023-11-28T18:22:15.260 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 6985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_ipv6.ko 2023-11-28T18:22:15.260 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 7065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_mobility.ko 2023-11-28T18:22:15.260 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 7001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_routing.ko 2023-11-28T18:22:15.260 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_udp.ko 2023-11-28T18:22:15.260 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/ 2023-11-28T18:22:15.260 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 30385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/garp.ko 2023-11-28T18:22:15.260 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 34809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/mrp.ko 2023-11-28T18:22:15.261 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/p8022.ko 2023-11-28T18:22:15.261 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/psnap.ko 2023-11-28T18:22:15.261 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/stp.ko 2023-11-28T18:22:15.261 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q/ 2023-11-28T18:22:15.261 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 81737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q/8021q.ko 2023-11-28T18:22:15.261 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/ 2023-11-28T18:22:15.261 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 198337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet.ko 2023-11-28T18:22:15.261 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 35977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_fd.ko 2023-11-28T18:22:15.261 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_rdma.ko 2023-11-28T18:22:15.261 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 32337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_virtio.ko 2023-11-28T18:22:15.261 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv/ 2023-11-28T18:22:15.261 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 649297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv/batman-adv.ko 2023-11-28T18:22:15.261 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/ 2023-11-28T18:22:15.262 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 63809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/br_netfilter.ko 2023-11-28T18:22:15.262 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 777689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/bridge.ko 2023-11-28T18:22:15.262 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ 2023-11-28T18:22:15.262 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 7657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-11-28T18:22:15.262 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_among.ko 2023-11-28T18:22:15.262 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arp.ko 2023-11-28T18:22:15.262 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-11-28T18:22:15.262 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-11-28T18:22:15.262 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip.ko 2023-11-28T18:22:15.262 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-11-28T18:22:15.262 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_limit.ko 2023-11-28T18:22:15.262 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_log.ko 2023-11-28T18:22:15.262 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 7585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark.ko 2023-11-28T18:22:15.263 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 7593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-11-28T18:22:15.263 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-11-28T18:22:15.263 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 7537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-11-28T18:22:15.263 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-11-28T18:22:15.263 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_snat.ko 2023-11-28T18:22:15.263 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_stp.ko 2023-11-28T18:22:15.263 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-11-28T18:22:15.263 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-11-28T18:22:15.263 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-11-28T18:22:15.263 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-11-28T18:22:15.263 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 55929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtables.ko 2023-11-28T18:22:15.263 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-11-28T18:22:15.263 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-11-28T18:22:15.263 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph/ 2023-11-28T18:22:15.264 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 1046833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph/libceph.ko 2023-11-28T18:22:15.264 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/ 2023-11-28T18:22:15.264 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 125993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/pktgen.ko 2023-11-28T18:22:15.264 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/ 2023-11-28T18:22:15.264 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 194209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp.ko 2023-11-28T18:22:15.264 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_diag.ko 2023-11-28T18:22:15.264 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 57881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv4.ko 2023-11-28T18:22:15.264 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 60337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv6.ko 2023-11-28T18:22:15.264 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/ 2023-11-28T18:22:15.264 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 390473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/dsa_core.ko 2023-11-28T18:22:15.264 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_brcm.ko 2023-11-28T18:22:15.264 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_dsa.ko 2023-11-28T18:22:15.264 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 7721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_none.ko 2023-11-28T18:22:15.265 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_trailer.ko 2023-11-28T18:22:15.265 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/hsr/ 2023-11-28T18:22:15.265 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 99729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/hsr/hsr.ko 2023-11-28T18:22:15.265 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ 2023-11-28T18:22:15.265 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan/ 2023-11-28T18:22:15.265 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 45233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-11-28T18:22:15.265 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 254625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154.ko 2023-11-28T18:22:15.265 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 47289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154_socket.ko 2023-11-28T18:22:15.265 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ 2023-11-28T18:22:15.265 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ah4.ko 2023-11-28T18:22:15.265 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 38905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/esp4.ko 2023-11-28T18:22:15.265 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 48337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/fou.ko 2023-11-28T18:22:15.265 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/gre.ko 2023-11-28T18:22:15.265 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 48657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/inet_diag.ko 2023-11-28T18:22:15.266 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 60633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_gre.ko 2023-11-28T18:22:15.266 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 61225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_tunnel.ko 2023-11-28T18:22:15.266 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 34505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_vti.ko 2023-11-28T18:22:15.266 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipcomp.ko 2023-11-28T18:22:15.266 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 28841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipip.ko 2023-11-28T18:22:15.266 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ 2023-11-28T18:22:15.266 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 37641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arp_tables.ko 2023-11-28T18:22:15.266 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-11-28T18:22:15.266 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-11-28T18:22:15.266 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 41609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ip_tables.ko 2023-11-28T18:22:15.266 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-11-28T18:22:15.266 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-11-28T18:22:15.266 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-11-28T18:22:15.266 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-11-28T18:22:15.267 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-11-28T18:22:15.267 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-11-28T18:22:15.267 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-11-28T18:22:15.267 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-11-28T18:22:15.267 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-11-28T18:22:15.267 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_security.ko 2023-11-28T18:22:15.267 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-11-28T18:22:15.267 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-11-28T18:22:15.267 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 27625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-11-28T18:22:15.267 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-11-28T18:22:15.267 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-11-28T18:22:15.267 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-11-28T18:22:15.267 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-11-28T18:22:15.267 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-11-28T18:22:15.268 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-11-28T18:22:15.268 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-11-28T18:22:15.268 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-11-28T18:22:15.268 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_bic.ko 2023-11-28T18:22:15.268 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_dctcp.ko 2023-11-28T18:22:15.268 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_diag.ko 2023-11-28T18:22:15.268 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_highspeed.ko 2023-11-28T18:22:15.268 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_htcp.ko 2023-11-28T18:22:15.268 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_hybla.ko 2023-11-28T18:22:15.268 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_illinois.ko 2023-11-28T18:22:15.268 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_lp.ko 2023-11-28T18:22:15.268 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_scalable.ko 2023-11-28T18:22:15.268 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_vegas.ko 2023-11-28T18:22:15.268 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_veno.ko 2023-11-28T18:22:15.269 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_westwood.ko 2023-11-28T18:22:15.269 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_yeah.ko 2023-11-28T18:22:15.269 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 22601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tunnel4.ko 2023-11-28T18:22:15.269 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_diag.ko 2023-11-28T18:22:15.269 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 41665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_tunnel.ko 2023-11-28T18:22:15.269 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/xfrm4_tunnel.ko 2023-11-28T18:22:15.269 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ 2023-11-28T18:22:15.269 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ah6.ko 2023-11-28T18:22:15.269 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 39537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/esp6.ko 2023-11-28T18:22:15.269 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/fou6.ko 2023-11-28T18:22:15.269 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 80897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_gre.ko 2023-11-28T18:22:15.270 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 93577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_tunnel.ko 2023-11-28T18:22:15.270 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-11-28T18:22:15.270 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 53273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_vti.ko 2023-11-28T18:22:15.270 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ipcomp6.ko 2023-11-28T18:22:15.270 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/mip6.ko 2023-11-28T18:22:15.270 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ 2023-11-28T18:22:15.270 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 42169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-11-28T18:22:15.270 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-11-28T18:22:15.270 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-11-28T18:22:15.270 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-11-28T18:22:15.270 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-11-28T18:22:15.270 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 7801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-11-28T18:22:15.270 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-11-28T18:22:15.271 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-11-28T18:22:15.271 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-11-28T18:22:15.271 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-11-28T18:22:15.271 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-11-28T18:22:15.271 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-11-28T18:22:15.271 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-11-28T18:22:15.271 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-11-28T18:22:15.271 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-11-28T18:22:15.271 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-11-28T18:22:15.271 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-11-28T18:22:15.271 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 39113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-11-28T18:22:15.271 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-11-28T18:22:15.271 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-11-28T18:22:15.271 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-11-28T18:22:15.272 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-11-28T18:22:15.272 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-11-28T18:22:15.272 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-11-28T18:22:15.272 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-11-28T18:22:15.272 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 74073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/sit.ko 2023-11-28T18:22:15.272 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 24193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/tunnel6.ko 2023-11-28T18:22:15.272 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 23297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/xfrm6_tunnel.ko 2023-11-28T18:22:15.272 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/key/ 2023-11-28T18:22:15.272 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 82833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/key/af_key.ko 2023-11-28T18:22:15.272 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/ 2023-11-28T18:22:15.272 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 125281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_core.ko 2023-11-28T18:22:15.272 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_debugfs.ko 2023-11-28T18:22:15.272 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 25953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_eth.ko 2023-11-28T18:22:15.273 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 35569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip.ko 2023-11-28T18:22:15.273 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 36713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip6.ko 2023-11-28T18:22:15.273 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 33001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_netlink.ko 2023-11-28T18:22:15.273 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 53241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ppp.ko 2023-11-28T18:22:15.273 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/lapb/ 2023-11-28T18:22:15.273 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 47977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/lapb/lapb.ko 2023-11-28T18:22:15.273 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/ 2023-11-28T18:22:15.273 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 23193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/llc.ko 2023-11-28T18:22:15.273 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 267913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/llc2.ko 2023-11-28T18:22:15.273 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154/ 2023-11-28T18:22:15.273 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 290417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154/mac802154.ko 2023-11-28T18:22:15.273 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls/ 2023-11-28T18:22:15.273 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls/mpls_gso.ko 2023-11-28T18:22:15.273 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ 2023-11-28T18:22:15.274 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ 2023-11-28T18:22:15.274 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 119585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set.ko 2023-11-28T18:22:15.274 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 28353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-11-28T18:22:15.274 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-11-28T18:22:15.274 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-11-28T18:22:15.274 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 100297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-11-28T18:22:15.274 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 101441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-11-28T18:22:15.274 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 102817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-11-28T18:22:15.274 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 103417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-11-28T18:22:15.274 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 112849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-11-28T18:22:15.274 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 60329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-11-28T18:22:15.274 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 109593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-11-28T18:22:15.274 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 113129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-11-28T18:22:15.275 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 112585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-11-28T18:22:15.275 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 111585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-11-28T18:22:15.275 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 114465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-11-28T18:22:15.275 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 30025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-11-28T18:22:15.275 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ 2023-11-28T18:22:15.275 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 411729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs.ko 2023-11-28T18:22:15.275 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-11-28T18:22:15.275 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 7625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-11-28T18:22:15.275 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-11-28T18:22:15.275 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-11-28T18:22:15.275 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-11-28T18:22:15.275 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 7689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-11-28T18:22:15.275 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 7689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-11-28T18:22:15.275 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-11-28T18:22:15.276 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-11-28T18:22:15.276 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 7697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-11-28T18:22:15.276 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-11-28T18:22:15.276 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 7697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-11-28T18:22:15.276 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-11-28T18:22:15.276 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 49257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conncount.ko 2023-11-28T18:22:15.276 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 408257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack.ko 2023-11-28T18:22:15.276 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-11-28T18:22:15.276 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-11-28T18:22:15.276 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 33761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-11-28T18:22:15.276 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 118145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_h323.ko 2023-11-28T18:22:15.276 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 22185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_irc.ko 2023-11-28T18:22:15.276 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-11-28T18:22:15.277 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 107233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-11-28T18:22:15.277 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 33633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-11-28T18:22:15.277 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sane.ko 2023-11-28T18:22:15.277 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 66641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sip.ko 2023-11-28T18:22:15.277 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-11-28T18:22:15.277 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-11-28T18:22:15.277 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_dup_netdev.ko 2023-11-28T18:22:15.277 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 89425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table.ko 2023-11-28T18:22:15.277 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table_inet.ko 2023-11-28T18:22:15.277 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 37129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_log_syslog.ko 2023-11-28T18:22:15.277 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 95353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat.ko 2023-11-28T18:22:15.277 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_amanda.ko 2023-11-28T18:22:15.278 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_ftp.ko 2023-11-28T18:22:15.278 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_irc.ko 2023-11-28T18:22:15.278 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 28929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_sip.ko 2023-11-28T18:22:15.278 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_tftp.ko 2023-11-28T18:22:15.278 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 44065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_synproxy_core.ko 2023-11-28T18:22:15.278 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 615649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_tables.ko 2023-11-28T18:22:15.278 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 42561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink.ko 2023-11-28T18:22:15.278 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 30233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_acct.ko 2023-11-28T18:22:15.278 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 30569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-11-28T18:22:15.278 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 39785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_log.ko 2023-11-28T18:22:15.278 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 22921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_osf.ko 2023-11-28T18:22:15.279 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 49377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_queue.ko 2023-11-28T18:22:15.279 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_chain_nat.ko 2023-11-28T18:22:15.279 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 33209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_compat.ko 2023-11-28T18:22:15.279 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 40721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_ct.ko 2023-11-28T18:22:15.279 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_dup_netdev.ko 2023-11-28T18:22:15.279 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fib.ko 2023-11-28T18:22:15.279 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fwd_netdev.ko 2023-11-28T18:22:15.279 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_hash.ko 2023-11-28T18:22:15.279 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_limit.ko 2023-11-28T18:22:15.279 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_log.ko 2023-11-28T18:22:15.279 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_masq.ko 2023-11-28T18:22:15.279 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_nat.ko 2023-11-28T18:22:15.279 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_numgen.ko 2023-11-28T18:22:15.280 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_osf.ko 2023-11-28T18:22:15.280 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_queue.ko 2023-11-28T18:22:15.280 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_redir.ko 2023-11-28T18:22:15.280 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject.ko 2023-11-28T18:22:15.280 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject_inet.ko 2023-11-28T18:22:15.280 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_socket.ko 2023-11-28T18:22:15.280 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_synproxy.ko 2023-11-28T18:22:15.280 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_tproxy.ko 2023-11-28T18:22:15.280 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 89313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/x_tables.ko 2023-11-28T18:22:15.280 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_AUDIT.ko 2023-11-28T18:22:15.280 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CHECKSUM.ko 2023-11-28T18:22:15.280 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 7729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CLASSIFY.ko 2023-11-28T18:22:15.280 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-11-28T18:22:15.281 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 18169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CT.ko 2023-11-28T18:22:15.281 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_DSCP.ko 2023-11-28T18:22:15.281 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HL.ko 2023-11-28T18:22:15.281 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HMARK.ko 2023-11-28T18:22:15.281 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 38873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_IDLETIMER.ko 2023-11-28T18:22:15.281 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LED.ko 2023-11-28T18:22:15.281 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LOG.ko 2023-11-28T18:22:15.281 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_MASQUERADE.ko 2023-11-28T18:22:15.281 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NETMAP.ko 2023-11-28T18:22:15.281 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFLOG.ko 2023-11-28T18:22:15.281 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFQUEUE.ko 2023-11-28T18:22:15.281 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_RATEEST.ko 2023-11-28T18:22:15.282 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_REDIRECT.ko 2023-11-28T18:22:15.282 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 14337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_SECMARK.ko 2023-11-28T18:22:15.282 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPMSS.ko 2023-11-28T18:22:15.282 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-11-28T18:22:15.282 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TEE.ko 2023-11-28T18:22:15.282 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TPROXY.ko 2023-11-28T18:22:15.282 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TRACE.ko 2023-11-28T18:22:15.282 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_addrtype.ko 2023-11-28T18:22:15.282 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_bpf.ko 2023-11-28T18:22:15.282 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cgroup.ko 2023-11-28T18:22:15.282 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cluster.ko 2023-11-28T18:22:15.282 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 7505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_comment.ko 2023-11-28T18:22:15.282 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connbytes.ko 2023-11-28T18:22:15.283 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlabel.ko 2023-11-28T18:22:15.283 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlimit.ko 2023-11-28T18:22:15.283 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connmark.ko 2023-11-28T18:22:15.283 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_conntrack.ko 2023-11-28T18:22:15.283 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 7817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cpu.ko 2023-11-28T18:22:15.283 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dccp.ko 2023-11-28T18:22:15.283 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 7865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_devgroup.ko 2023-11-28T18:22:15.283 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dscp.ko 2023-11-28T18:22:15.283 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ecn.ko 2023-11-28T18:22:15.283 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_esp.ko 2023-11-28T18:22:15.283 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 43289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hashlimit.ko 2023-11-28T18:22:15.283 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_helper.ko 2023-11-28T18:22:15.283 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 7865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hl.ko 2023-11-28T18:22:15.284 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipcomp.ko 2023-11-28T18:22:15.284 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_iprange.ko 2023-11-28T18:22:15.284 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipvs.ko 2023-11-28T18:22:15.284 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_l2tp.ko 2023-11-28T18:22:15.284 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_length.ko 2023-11-28T18:22:15.284 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_limit.ko 2023-11-28T18:22:15.284 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 7545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mac.ko 2023-11-28T18:22:15.284 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mark.ko 2023-11-28T18:22:15.284 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_multiport.ko 2023-11-28T18:22:15.284 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nat.ko 2023-11-28T18:22:15.284 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nfacct.ko 2023-11-28T18:22:15.284 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_osf.ko 2023-11-28T18:22:15.285 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_owner.ko 2023-11-28T18:22:15.285 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_physdev.ko 2023-11-28T18:22:15.285 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 7633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_pkttype.ko 2023-11-28T18:22:15.285 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_policy.ko 2023-11-28T18:22:15.285 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_quota.ko 2023-11-28T18:22:15.285 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_rateest.ko 2023-11-28T18:22:15.285 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_realm.ko 2023-11-28T18:22:15.285 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 36433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_recent.ko 2023-11-28T18:22:15.285 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_sctp.ko 2023-11-28T18:22:15.285 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 30089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_set.ko 2023-11-28T18:22:15.285 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 16089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_socket.ko 2023-11-28T18:22:15.285 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_state.ko 2023-11-28T18:22:15.285 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_statistic.ko 2023-11-28T18:22:15.286 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_string.ko 2023-11-28T18:22:15.286 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 8553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_tcpmss.ko 2023-11-28T18:22:15.286 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_tcpudp.ko 2023-11-28T18:22:15.286 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_time.ko 2023-11-28T18:22:15.286 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_u32.ko 2023-11-28T18:22:15.286 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink/ 2023-11-28T18:22:15.286 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink/netlink_diag.ko 2023-11-28T18:22:15.286 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh/ 2023-11-28T18:22:15.286 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 12425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh/nsh.ko 2023-11-28T18:22:15.286 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/ 2023-11-28T18:22:15.286 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 380033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/openvswitch.ko 2023-11-28T18:22:15.286 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-geneve.ko 2023-11-28T18:22:15.287 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-gre.ko 2023-11-28T18:22:15.287 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 11793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-vxlan.ko 2023-11-28T18:22:15.287 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet/ 2023-11-28T18:22:15.287 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet/af_packet_diag.ko 2023-11-28T18:22:15.287 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/ 2023-11-28T18:22:15.287 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 110201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/phonet.ko 2023-11-28T18:22:15.287 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 54721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/pn_pep.ko 2023-11-28T18:22:15.287 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/ 2023-11-28T18:22:15.287 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 251481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds.ko 2023-11-28T18:22:15.287 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 164937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_rdma.ko 2023-11-28T18:22:15.287 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 67377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_tcp.ko 2023-11-28T18:22:15.287 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rxrpc/ 2023-11-28T18:22:15.287 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 819657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rxrpc/rxrpc.ko 2023-11-28T18:22:15.287 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/ 2023-11-28T18:22:15.288 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 32241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_csum.ko 2023-11-28T18:22:15.288 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 23577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_gact.ko 2023-11-28T18:22:15.288 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_ipt.ko 2023-11-28T18:22:15.288 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 34097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_mirred.ko 2023-11-28T18:22:15.288 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 23401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_nat.ko 2023-11-28T18:22:15.288 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 43449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_pedit.ko 2023-11-28T18:22:15.288 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 31961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_police.ko 2023-11-28T18:22:15.288 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_simple.ko 2023-11-28T18:22:15.288 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 35297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_skbedit.ko 2023-11-28T18:22:15.288 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 36665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_vlan.ko 2023-11-28T18:22:15.288 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_basic.ko 2023-11-28T18:22:15.288 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 33961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_bpf.ko 2023-11-28T18:22:15.288 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_cgroup.ko 2023-11-28T18:22:15.288 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 31401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_flow.ko 2023-11-28T18:22:15.289 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 31769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_fw.ko 2023-11-28T18:22:15.289 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 38425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_route.ko 2023-11-28T18:22:15.289 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 61409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_u32.ko 2023-11-28T18:22:15.289 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 7441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_cmp.ko 2023-11-28T18:22:15.289 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 13409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_ipset.ko 2023-11-28T18:22:15.289 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 33289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_meta.ko 2023-11-28T18:22:15.289 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 7897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_nbyte.ko 2023-11-28T18:22:15.289 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_text.ko 2023-11-28T18:22:15.289 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 7249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_u32.ko 2023-11-28T18:22:15.289 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 21649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_choke.ko 2023-11-28T18:22:15.289 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_codel.ko 2023-11-28T18:22:15.289 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 34633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_drr.ko 2023-11-28T18:22:15.289 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 33609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_fq.ko 2023-11-28T18:22:15.289 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 31617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_fq_codel.ko 2023-11-28T18:22:15.290 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 35433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_gred.ko 2023-11-28T18:22:15.290 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 49817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hfsc.ko 2023-11-28T18:22:15.290 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 22089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hhf.ko 2023-11-28T18:22:15.290 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 66393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_htb.ko 2023-11-28T18:22:15.290 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_ingress.ko 2023-11-28T18:22:15.290 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 30273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio.ko 2023-11-28T18:22:15.290 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio_lib.ko 2023-11-28T18:22:15.290 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_multiq.ko 2023-11-28T18:22:15.290 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 36137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_netem.ko 2023-11-28T18:22:15.290 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 27497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_pie.ko 2023-11-28T18:22:15.290 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_plug.ko 2023-11-28T18:22:15.290 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_prio.ko 2023-11-28T18:22:15.290 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 48729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_qfq.ko 2023-11-28T18:22:15.291 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 32905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_red.ko 2023-11-28T18:22:15.291 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 26881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfb.ko 2023-11-28T18:22:15.291 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 31353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfq.ko 2023-11-28T18:22:15.291 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 28897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_tbf.ko 2023-11-28T18:22:15.291 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 28105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_teql.ko 2023-11-28T18:22:15.291 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/ 2023-11-28T18:22:15.291 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 929745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp.ko 2023-11-28T18:22:15.291 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 19033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp_diag.ko 2023-11-28T18:22:15.291 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/ 2023-11-28T18:22:15.291 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/ 2023-11-28T18:22:15.291 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 336529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-11-28T18:22:15.291 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 54737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-11-28T18:22:15.291 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 1520097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/sunrpc.ko 2023-11-28T18:22:15.291 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma/ 2023-11-28T18:22:15.292 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 707657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-11-28T18:22:15.292 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/ 2023-11-28T18:22:15.292 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/diag.ko 2023-11-28T18:22:15.292 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 862665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/tipc.ko 2023-11-28T18:22:15.292 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix/ 2023-11-28T18:22:15.292 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix/unix_diag.ko 2023-11-28T18:22:15.292 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/ 2023-11-28T18:22:15.292 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 85409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-11-28T18:22:15.292 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 68049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-11-28T18:22:15.292 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 96193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock.ko 2023-11-28T18:22:15.292 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 10705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_diag.ko 2023-11-28T18:22:15.292 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 17521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_loopback.ko 2023-11-28T18:22:15.292 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/x25/ 2023-11-28T18:22:15.293 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 125177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/x25/x25.ko 2023-11-28T18:22:15.293 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/ 2023-11-28T18:22:15.293 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 22657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_algo.ko 2023-11-28T18:22:15.293 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 20649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_ipcomp.ko 2023-11-28T18:22:15.293 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 102257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_user.ko 2023-11-28T18:22:15.293 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/ 2023-11-28T18:22:15.293 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib/ 2023-11-28T18:22:15.293 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 15537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib/irqbypass.ko 2023-11-28T18:22:15.293 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 640081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.alias 2023-11-28T18:22:15.293 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 624107 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.alias.bin 2023-11-28T18:22:15.293 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 7663 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin 2023-11-28T18:22:15.293 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 23428 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.alias.bin 2023-11-28T18:22:15.293 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 9821 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.bin 2023-11-28T18:22:15.293 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 70004 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.modinfo 2023-11-28T18:22:15.294 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 146313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.dep 2023-11-28T18:22:15.294 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 232548 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.dep.bin 2023-11-28T18:22:15.294 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 210 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.devname 2023-11-28T18:22:15.294 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 72606 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.order 2023-11-28T18:22:15.294 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 879 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.softdep 2023-11-28T18:22:15.294 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 254438 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.symbols 2023-11-28T18:22:15.294 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 309363 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.symbols.bin 2023-11-28T18:22:15.294 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/ 2023-11-28T18:22:15.294 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/ 2023-11-28T18:22:15.294 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/doc/ 2023-11-28T18:22:15.294 INFO:teuthology.orchestra.run.smithi190.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/ 2023-11-28T18:22:15.294 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 172 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/changelog.Debian.gz 2023-11-28T18:22:15.294 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r-- root/root 691 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/copyright 2023-11-28T18:22:15.295 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-g8247bbb5b470 2023-11-28T18:22:15.295 INFO:teuthology.task.kernel:searching for kernel 6.6.0-g8247bbb5b470 2023-11-28T18:22:15.296 DEBUG:teuthology.orchestra.run.smithi190:> egrep '(submenu|menuentry.*6.6.0-g8247bbb5b470).*{' /boot/grub/grub.cfg 2023-11-28T18:22:15.302 INFO:teuthology.orchestra.run.smithi190.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-28T18:22:15.302 INFO:teuthology.orchestra.run.smithi190.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g8247bbb5b470' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g8247bbb5b470-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-28T18:22:15.303 INFO:teuthology.orchestra.run.smithi190.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g8247bbb5b470 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g8247bbb5b470-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-28T18:22:15.303 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-11-28T18:22:15.303 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-g8247bbb5b470 2023-11-28T18:22:15.303 DEBUG:teuthology.orchestra.run.smithi190:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-11-28T18:22:15.346 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi190.front.sepia.ceph.com to complete... 2023-11-28T18:22:15.740 INFO:teuthology.orchestra.run.smithi190.stderr:Sourcing file `/etc/default/grub' 2023-11-28T18:22:15.742 INFO:teuthology.orchestra.run.smithi190.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-28T18:22:15.764 INFO:teuthology.orchestra.run.smithi190.stderr:Generating grub configuration file ... 2023-11-28T18:22:15.965 INFO:teuthology.orchestra.run.smithi190.stderr:Found linux image: /boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-28T18:22:15.972 INFO:teuthology.orchestra.run.smithi190.stderr:Found initrd image: /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-28T18:22:16.220 INFO:teuthology.orchestra.run.smithi190.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-28T18:22:16.226 INFO:teuthology.orchestra.run.smithi190.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-28T18:22:16.267 INFO:teuthology.orchestra.run.smithi190.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-28T18:22:16.273 INFO:teuthology.orchestra.run.smithi190.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-28T18:22:16.413 INFO:teuthology.orchestra.run.smithi190.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-28T18:22:16.413 INFO:teuthology.orchestra.run.smithi190.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-11-28T18:22:16.413 INFO:teuthology.orchestra.run.smithi190.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-28T18:22:16.424 INFO:teuthology.orchestra.run.smithi190.stderr:done 2023-11-28T18:22:33.227 INFO:teuthology.orchestra.run.smithi045.stderr:Sourcing file `/etc/default/grub' 2023-11-28T18:22:33.249 INFO:teuthology.orchestra.run.smithi045.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-28T18:22:33.270 INFO:teuthology.orchestra.run.smithi045.stderr:Generating grub configuration file ... 2023-11-28T18:22:33.576 INFO:teuthology.orchestra.run.smithi045.stderr:Found linux image: /boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-28T18:22:33.596 INFO:teuthology.orchestra.run.smithi045.stderr:Found initrd image: /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-28T18:22:33.898 INFO:teuthology.orchestra.run.smithi045.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-28T18:22:33.908 INFO:teuthology.orchestra.run.smithi045.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-28T18:22:33.970 INFO:teuthology.orchestra.run.smithi045.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-28T18:22:33.974 INFO:teuthology.orchestra.run.smithi045.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-28T18:22:34.130 INFO:teuthology.orchestra.run.smithi045.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-28T18:22:34.130 INFO:teuthology.orchestra.run.smithi045.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-11-28T18:22:34.131 INFO:teuthology.orchestra.run.smithi045.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-28T18:22:34.174 INFO:teuthology.orchestra.run.smithi045.stderr:done 2023-11-28T18:22:34.367 DEBUG:teuthology.orchestra.run.smithi045:> dpkg-deb -c /tmp/linux-image.deb 2023-11-28T18:22:34.376 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./ 2023-11-28T18:22:34.378 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./boot/ 2023-11-28T18:22:34.378 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 4415617 2023-11-23 03:47 ./boot/System.map-6.6.0-g8247bbb5b470 2023-11-28T18:22:34.389 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 169214 2023-11-23 03:47 ./boot/config-6.6.0-g8247bbb5b470 2023-11-28T18:22:34.390 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11352832 2023-11-23 03:47 ./boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-28T18:22:34.412 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/ 2023-11-28T18:22:34.412 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/ 2023-11-28T18:22:34.412 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/postinst.d/ 2023-11-28T18:22:34.412 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/postrm.d/ 2023-11-28T18:22:34.412 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/preinst.d/ 2023-11-28T18:22:34.412 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/prerm.d/ 2023-11-28T18:22:34.412 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/ 2023-11-28T18:22:34.413 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/ 2023-11-28T18:22:34.413 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/ 2023-11-28T18:22:34.413 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/ 2023-11-28T18:22:34.413 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/ 2023-11-28T18:22:34.413 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/ 2023-11-28T18:22:34.413 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/ 2023-11-28T18:22:34.413 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 490233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/aesni-intel.ko 2023-11-28T18:22:34.413 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-11-28T18:22:34.413 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-11-28T18:22:34.413 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-11-28T18:22:34.413 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 93113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-11-28T18:22:34.414 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 106729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-11-28T18:22:34.414 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 152241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-11-28T18:22:34.414 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-11-28T18:22:34.414 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-11-28T18:22:34.414 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 83889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-11-28T18:22:34.414 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-11-28T18:22:34.414 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 47225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-11-28T18:22:34.414 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 47209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx2.ko 2023-11-28T18:22:34.414 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 51801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-11-28T18:22:34.414 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 38937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-11-28T18:22:34.414 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 40529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-11-28T18:22:34.414 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 58585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-11-28T18:22:34.415 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 50497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-11-28T18:22:34.415 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 32065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-11-28T18:22:34.415 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-11-28T18:22:34.415 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/ 2023-11-28T18:22:34.415 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/ 2023-11-28T18:22:34.415 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce/ 2023-11-28T18:22:34.415 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 40113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-11-28T18:22:34.415 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpuid.ko 2023-11-28T18:22:34.415 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/msr.ko 2023-11-28T18:22:34.415 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/ 2023-11-28T18:22:34.415 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 354433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-amd.ko 2023-11-28T18:22:34.416 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 881625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-intel.ko 2023-11-28T18:22:34.416 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 2275865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm.ko 2023-11-28T18:22:34.489 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ 2023-11-28T18:22:34.490 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 53697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/af_alg.ko 2023-11-28T18:22:34.490 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/algif_hash.ko 2023-11-28T18:22:34.490 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/algif_skcipher.ko 2023-11-28T18:22:34.490 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ansi_cprng.ko 2023-11-28T18:22:34.490 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/anubis.ko 2023-11-28T18:22:34.490 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/arc4.ko 2023-11-28T18:22:34.490 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/asymmetric_keys/ 2023-11-28T18:22:34.490 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-11-28T18:22:34.490 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/ 2023-11-28T18:22:34.490 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_memcpy.ko 2023-11-28T18:22:34.490 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_pq.ko 2023-11-28T18:22:34.491 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_raid6_recov.ko 2023-11-28T18:22:34.491 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_tx.ko 2023-11-28T18:22:34.491 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_xor.ko 2023-11-28T18:22:34.491 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/raid6test.ko 2023-11-28T18:22:34.491 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authenc.ko 2023-11-28T18:22:34.491 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authencesn.ko 2023-11-28T18:22:34.491 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blake2b_generic.ko 2023-11-28T18:22:34.491 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_common.ko 2023-11-28T18:22:34.491 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_generic.ko 2023-11-28T18:22:34.491 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 38809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/camellia_generic.ko 2023-11-28T18:22:34.491 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast5_generic.ko 2023-11-28T18:22:34.491 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast6_generic.ko 2023-11-28T18:22:34.492 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast_common.ko 2023-11-28T18:22:34.492 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 35097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ccm.ko 2023-11-28T18:22:34.492 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cmac.ko 2023-11-28T18:22:34.492 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crc32_generic.ko 2023-11-28T18:22:34.492 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 47505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cryptd.ko 2023-11-28T18:22:34.492 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 39505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_engine.ko 2023-11-28T18:22:34.492 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_simd.ko 2023-11-28T18:22:34.492 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_user.ko 2023-11-28T18:22:34.492 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cts.ko 2023-11-28T18:22:34.492 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/des_generic.ko 2023-11-28T18:22:34.492 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/dh_generic.ko 2023-11-28T18:22:34.492 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/echainiv.ko 2023-11-28T18:22:34.492 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/essiv.ko 2023-11-28T18:22:34.493 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/fcrypt.ko 2023-11-28T18:22:34.493 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/khazad.ko 2023-11-28T18:22:34.493 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lrw.ko 2023-11-28T18:22:34.493 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4.ko 2023-11-28T18:22:34.493 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4hc.ko 2023-11-28T18:22:34.493 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/md4.ko 2023-11-28T18:22:34.493 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/michael_mic.ko 2023-11-28T18:22:34.493 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcbc.ko 2023-11-28T18:22:34.493 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcrypt.ko 2023-11-28T18:22:34.493 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/rmd160.ko 2023-11-28T18:22:34.493 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/seed.ko 2023-11-28T18:22:34.494 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/serpent_generic.ko 2023-11-28T18:22:34.494 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 149193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tcrypt.ko 2023-11-28T18:22:34.494 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tea.ko 2023-11-28T18:22:34.494 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_common.ko 2023-11-28T18:22:34.494 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_generic.ko 2023-11-28T18:22:34.494 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/vmac.ko 2023-11-28T18:22:34.494 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/wp512.ko 2023-11-28T18:22:34.494 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xcbc.ko 2023-11-28T18:22:34.494 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xor.ko 2023-11-28T18:22:34.494 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xts.ko 2023-11-28T18:22:34.494 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xxhash_generic.ko 2023-11-28T18:22:34.494 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ 2023-11-28T18:22:34.494 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/ 2023-11-28T18:22:34.495 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_extlog.ko 2023-11-28T18:22:34.495 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_ipmi.ko 2023-11-28T18:22:34.495 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_pad.ko 2023-11-28T18:22:34.495 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/apei/ 2023-11-28T18:22:34.495 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/apei/einj.ko 2023-11-28T18:22:34.495 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/ec_sys.ko 2023-11-28T18:22:34.495 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/platform_profile.ko 2023-11-28T18:22:34.495 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbs.ko 2023-11-28T18:22:34.495 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbshc.ko 2023-11-28T18:22:34.495 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 103025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/video.ko 2023-11-28T18:22:34.495 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ 2023-11-28T18:22:34.495 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/acard-ahci.ko 2023-11-28T18:22:34.496 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 88865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ahci.ko 2023-11-28T18:22:34.496 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ahci_platform.ko 2023-11-28T18:22:34.496 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 88289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/libahci.ko 2023-11-28T18:22:34.496 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/libahci_platform.ko 2023-11-28T18:22:34.496 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_acpi.ko 2023-11-28T18:22:34.496 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ali.ko 2023-11-28T18:22:34.496 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_amd.ko 2023-11-28T18:22:34.496 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_artop.ko 2023-11-28T18:22:34.496 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atiixp.ko 2023-11-28T18:22:34.496 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atp867x.ko 2023-11-28T18:22:34.496 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd640.ko 2023-11-28T18:22:34.496 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd64x.ko 2023-11-28T18:22:34.497 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cypress.ko 2023-11-28T18:22:34.497 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_efar.ko 2023-11-28T18:22:34.497 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt366.ko 2023-11-28T18:22:34.497 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt37x.ko 2023-11-28T18:22:34.497 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x2n.ko 2023-11-28T18:22:34.497 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x3.ko 2023-11-28T18:22:34.497 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it8213.ko 2023-11-28T18:22:34.497 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 35273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it821x.ko 2023-11-28T18:22:34.497 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_jmicron.ko 2023-11-28T18:22:34.497 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 51481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_legacy.ko 2023-11-28T18:22:34.497 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_marvell.ko 2023-11-28T18:22:34.497 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_mpiix.ko 2023-11-28T18:22:34.498 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_netcell.ko 2023-11-28T18:22:34.498 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ninja32.ko 2023-11-28T18:22:34.498 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87410.ko 2023-11-28T18:22:34.498 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87415.ko 2023-11-28T18:22:34.498 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_oldpiix.ko 2023-11-28T18:22:34.498 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_opti.ko 2023-11-28T18:22:34.498 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_optidma.ko 2023-11-28T18:22:34.498 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 32585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pcmcia.ko 2023-11-28T18:22:34.498 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 37793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc2027x.ko 2023-11-28T18:22:34.498 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-11-28T18:22:34.498 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_piccolo.ko 2023-11-28T18:22:34.498 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_radisys.ko 2023-11-28T18:22:34.499 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_rdc.ko 2023-11-28T18:22:34.499 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_rz1000.ko 2023-11-28T18:22:34.499 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sch.ko 2023-11-28T18:22:34.499 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_serverworks.ko 2023-11-28T18:22:34.499 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sil680.ko 2023-11-28T18:22:34.499 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sl82c105.ko 2023-11-28T18:22:34.499 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_triflex.ko 2023-11-28T18:22:34.499 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_via.ko 2023-11-28T18:22:34.499 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pdc_adma.ko 2023-11-28T18:22:34.499 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_inic162x.ko 2023-11-28T18:22:34.499 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 83345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_mv.ko 2023-11-28T18:22:34.499 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 70393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_nv.ko 2023-11-28T18:22:34.499 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 37377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_promise.ko 2023-11-28T18:22:34.500 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_qstor.ko 2023-11-28T18:22:34.500 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil.ko 2023-11-28T18:22:34.500 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 38337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil24.ko 2023-11-28T18:22:34.500 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sis.ko 2023-11-28T18:22:34.500 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_svw.ko 2023-11-28T18:22:34.500 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 44793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sx4.ko 2023-11-28T18:22:34.500 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_uli.ko 2023-11-28T18:22:34.500 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 35065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_via.ko 2023-11-28T18:22:34.500 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_vsc.ko 2023-11-28T18:22:34.500 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay/ 2023-11-28T18:22:34.500 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay/ks0108.ko 2023-11-28T18:22:34.500 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma/ 2023-11-28T18:22:34.501 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 124473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma/bcma.ko 2023-11-28T18:22:34.501 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/ 2023-11-28T18:22:34.501 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe/ 2023-11-28T18:22:34.501 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 113665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe/aoe.ko 2023-11-28T18:22:34.501 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd/ 2023-11-28T18:22:34.501 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 965585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd/drbd.ko 2023-11-28T18:22:34.501 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 173225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/floppy.ko 2023-11-28T18:22:34.501 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx/ 2023-11-28T18:22:34.501 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 94297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-11-28T18:22:34.501 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 115793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/nbd.ko 2023-11-28T18:22:34.501 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk/ 2023-11-28T18:22:34.501 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 110385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk/null_blk.ko 2023-11-28T18:22:34.502 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 98193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/pktcdvd.ko 2023-11-28T18:22:34.502 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 263769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/rbd.ko 2023-11-28T18:22:34.502 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback/ 2023-11-28T18:22:34.502 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 98145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-11-28T18:22:34.502 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram/ 2023-11-28T18:22:34.502 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 60217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram/zram.ko 2023-11-28T18:22:34.502 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ 2023-11-28T18:22:34.502 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/applicom.ko 2023-11-28T18:22:34.502 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hangcheck-timer.ko 2023-11-28T18:22:34.502 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/ 2023-11-28T18:22:34.502 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/amd-rng.ko 2023-11-28T18:22:34.502 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/intel-rng.ko 2023-11-28T18:22:34.502 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-11-28T18:22:34.503 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/via-rng.ko 2023-11-28T18:22:34.503 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/virtio-rng.ko 2023-11-28T18:22:34.503 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ 2023-11-28T18:22:34.503 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-11-28T18:22:34.503 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 148601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-11-28T18:22:34.503 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-11-28T18:22:34.503 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 139313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_si.ko 2023-11-28T18:22:34.503 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 70921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-11-28T18:22:34.503 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 53513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-11-28T18:22:34.503 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/lp.ko 2023-11-28T18:22:34.503 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave/ 2023-11-28T18:22:34.503 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 84097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave/mwave.ko 2023-11-28T18:22:34.504 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/nvram.ko 2023-11-28T18:22:34.504 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 32169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ppdev.ko 2023-11-28T18:22:34.504 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 51113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tlclk.ko 2023-11-28T18:22:34.504 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/ 2023-11-28T18:22:34.504 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_atmel.ko 2023-11-28T18:22:34.504 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-11-28T18:22:34.504 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-11-28T18:22:34.504 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 32985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-11-28T18:22:34.504 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_infineon.ko 2023-11-28T18:22:34.504 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_nsc.ko 2023-11-28T18:22:34.504 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-11-28T18:22:34.504 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/ 2023-11-28T18:22:34.504 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_class.ko 2023-11-28T18:22:34.505 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 50945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_core.ko 2023-11-28T18:22:34.505 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-11-28T18:22:34.505 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/ 2023-11-28T18:22:34.505 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-palmas.ko 2023-11-28T18:22:34.505 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 47849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-si5351.ko 2023-11-28T18:22:34.505 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-twl6040.ko 2023-11-28T18:22:34.505 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-wm831x.ko 2023-11-28T18:22:34.505 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/ 2023-11-28T18:22:34.505 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-11-28T18:22:34.505 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/p4-clockmod.ko 2023-11-28T18:22:34.505 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/speedstep-lib.ko 2023-11-28T18:22:34.505 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ 2023-11-28T18:22:34.505 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ 2023-11-28T18:22:34.506 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 70801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-11-28T18:22:34.506 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 243025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp.ko 2023-11-28T18:22:34.506 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/ 2023-11-28T18:22:34.506 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/ 2023-11-28T18:22:34.506 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common/ 2023-11-28T18:22:34.506 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 438761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-11-28T18:22:34.506 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-11-28T18:22:34.506 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-11-28T18:22:34.506 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-aes.ko 2023-11-28T18:22:34.506 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-sha.ko 2023-11-28T18:22:34.506 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio/ 2023-11-28T18:22:34.506 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 70273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-11-28T18:22:34.507 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca/ 2023-11-28T18:22:34.507 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca/dca.ko 2023-11-28T18:22:34.507 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ 2023-11-28T18:22:34.507 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw/ 2023-11-28T18:22:34.507 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw/dw_dmac.ko 2023-11-28T18:22:34.507 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat/ 2023-11-28T18:22:34.507 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 122569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat/ioatdma.ko 2023-11-28T18:22:34.507 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/ 2023-11-28T18:22:34.507 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 79953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/amd64_edac.ko 2023-11-28T18:22:34.507 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 35769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/e752x_edac.ko 2023-11-28T18:22:34.507 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 63617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/edac_mce_amd.ko 2023-11-28T18:22:34.507 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3000_edac.ko 2023-11-28T18:22:34.508 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3200_edac.ko 2023-11-28T18:22:34.508 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5100_edac.ko 2023-11-28T18:22:34.508 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5400_edac.ko 2023-11-28T18:22:34.508 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7300_edac.ko 2023-11-28T18:22:34.508 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 52041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7core_edac.ko 2023-11-28T18:22:34.508 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i82975x_edac.ko 2023-11-28T18:22:34.508 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/ie31200_edac.ko 2023-11-28T18:22:34.508 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 56825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/sb_edac.ko 2023-11-28T18:22:34.508 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/x38_edac.ko 2023-11-28T18:22:34.508 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/ 2023-11-28T18:22:34.508 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-gpio.ko 2023-11-28T18:22:34.509 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max14577.ko 2023-11-28T18:22:34.509 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max77693.ko 2023-11-28T18:22:34.509 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max8997.ko 2023-11-28T18:22:34.509 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-palmas.ko 2023-11-28T18:22:34.509 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-rt8973a.ko 2023-11-28T18:22:34.509 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-sm5502.ko 2023-11-28T18:22:34.509 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/ 2023-11-28T18:22:34.509 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/dmi-sysfs.ko 2023-11-28T18:22:34.509 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/efi/ 2023-11-28T18:22:34.509 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/efi/efi-pstore.ko 2023-11-28T18:22:34.509 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/iscsi_ibft.ko 2023-11-28T18:22:34.509 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/ 2023-11-28T18:22:34.509 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-adp5520.ko 2023-11-28T18:22:34.510 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-amd8111.ko 2023-11-28T18:22:34.510 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-arizona.ko 2023-11-28T18:22:34.510 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-da9052.ko 2023-11-28T18:22:34.510 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-da9055.ko 2023-11-28T18:22:34.510 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-dln2.ko 2023-11-28T18:22:34.510 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 77849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-f7188x.ko 2023-11-28T18:22:34.510 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-generic.ko 2023-11-28T18:22:34.510 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-ich.ko 2023-11-28T18:22:34.510 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-11-28T18:22:34.510 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-kempld.ko 2023-11-28T18:22:34.510 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-lp3943.ko 2023-11-28T18:22:34.510 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max7300.ko 2023-11-28T18:22:34.511 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max730x.ko 2023-11-28T18:22:34.511 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max732x.ko 2023-11-28T18:22:34.511 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-11-28T18:22:34.511 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 47073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-pca953x.ko 2023-11-28T18:22:34.511 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-pcf857x.ko 2023-11-28T18:22:34.511 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-rdc321x.ko 2023-11-28T18:22:34.511 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-sch.ko 2023-11-28T18:22:34.511 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-sch311x.ko 2023-11-28T18:22:34.511 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-tps65912.ko 2023-11-28T18:22:34.511 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-twl4030.ko 2023-11-28T18:22:34.511 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-twl6040.ko 2023-11-28T18:22:34.511 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-viperboard.ko 2023-11-28T18:22:34.512 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-vx855.ko 2023-11-28T18:22:34.512 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm831x.ko 2023-11-28T18:22:34.512 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm8350.ko 2023-11-28T18:22:34.512 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm8994.ko 2023-11-28T18:22:34.512 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/ 2023-11-28T18:22:34.512 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-a4tech.ko 2023-11-28T18:22:34.512 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 39169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-apple.ko 2023-11-28T18:22:34.512 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-appleir.ko 2023-11-28T18:22:34.512 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-aureal.ko 2023-11-28T18:22:34.512 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-axff.ko 2023-11-28T18:22:34.512 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-belkin.ko 2023-11-28T18:22:34.512 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cherry.ko 2023-11-28T18:22:34.512 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-chicony.ko 2023-11-28T18:22:34.513 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 60649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cp2112.ko 2023-11-28T18:22:34.513 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cypress.ko 2023-11-28T18:22:34.513 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-dr.ko 2023-11-28T18:22:34.513 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elecom.ko 2023-11-28T18:22:34.513 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elo.ko 2023-11-28T18:22:34.513 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-emsff.ko 2023-11-28T18:22:34.513 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ezkey.ko 2023-11-28T18:22:34.513 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gaff.ko 2023-11-28T18:22:34.513 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-generic.ko 2023-11-28T18:22:34.513 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gt683r.ko 2023-11-28T18:22:34.513 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gyration.ko 2023-11-28T18:22:34.513 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-kbd.ko 2023-11-28T18:22:34.514 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-mouse.ko 2023-11-28T18:22:34.514 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtekff.ko 2023-11-28T18:22:34.514 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-hyperv.ko 2023-11-28T18:22:34.514 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-icade.ko 2023-11-28T18:22:34.514 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-kensington.ko 2023-11-28T18:22:34.514 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-keytouch.ko 2023-11-28T18:22:34.514 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-kye.ko 2023-11-28T18:22:34.515 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lcpower.ko 2023-11-28T18:22:34.515 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-led.ko 2023-11-28T18:22:34.515 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 42297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lenovo.ko 2023-11-28T18:22:34.515 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lg-g15.ko 2023-11-28T18:22:34.515 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 58185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-dj.ko 2023-11-28T18:22:34.515 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 101481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-11-28T18:22:34.515 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 80993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech.ko 2023-11-28T18:22:34.515 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-magicmouse.ko 2023-11-28T18:22:34.515 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-microsoft.ko 2023-11-28T18:22:34.515 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-monterey.ko 2023-11-28T18:22:34.515 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 50161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-multitouch.ko 2023-11-28T18:22:34.515 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 32593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ntrig.ko 2023-11-28T18:22:34.516 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ortek.ko 2023-11-28T18:22:34.516 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-penmount.ko 2023-11-28T18:22:34.516 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-petalynx.ko 2023-11-28T18:22:34.516 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 72937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-picolcd.ko 2023-11-28T18:22:34.516 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-pl.ko 2023-11-28T18:22:34.516 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-plantronics.ko 2023-11-28T18:22:34.516 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-primax.ko 2023-11-28T18:22:34.516 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 35393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-rmi.ko 2023-11-28T18:22:34.516 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-arvo.ko 2023-11-28T18:22:34.516 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-common.ko 2023-11-28T18:22:34.516 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-isku.ko 2023-11-28T18:22:34.516 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kone.ko 2023-11-28T18:22:34.516 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-11-28T18:22:34.517 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-konepure.ko 2023-11-28T18:22:34.517 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-11-28T18:22:34.517 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-lua.ko 2023-11-28T18:22:34.517 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-pyra.ko 2023-11-28T18:22:34.517 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-ryos.ko 2023-11-28T18:22:34.517 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-savu.ko 2023-11-28T18:22:34.517 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat.ko 2023-11-28T18:22:34.517 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-saitek.ko 2023-11-28T18:22:34.517 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-samsung.ko 2023-11-28T18:22:34.517 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sensor-hub.ko 2023-11-28T18:22:34.517 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sjoy.ko 2023-11-28T18:22:34.517 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 51249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sony.ko 2023-11-28T18:22:34.518 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-speedlink.ko 2023-11-28T18:22:34.518 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-steelseries.ko 2023-11-28T18:22:34.518 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sunplus.ko 2023-11-28T18:22:34.518 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-thrustmaster.ko 2023-11-28T18:22:34.518 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tivo.ko 2023-11-28T18:22:34.518 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tmff.ko 2023-11-28T18:22:34.518 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-topseed.ko 2023-11-28T18:22:34.518 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-twinhan.ko 2023-11-28T18:22:34.518 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 71073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-uclogic.ko 2023-11-28T18:22:34.518 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-waltop.ko 2023-11-28T18:22:34.518 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 143473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-wiimote.ko 2023-11-28T18:22:34.518 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-xinmo.ko 2023-11-28T18:22:34.519 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zpff.ko 2023-11-28T18:22:34.519 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zydacron.ko 2023-11-28T18:22:34.519 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 267825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid.ko 2023-11-28T18:22:34.519 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 32321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/uhid.ko 2023-11-28T18:22:34.519 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/ 2023-11-28T18:22:34.519 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 125721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbhid.ko 2023-11-28T18:22:34.519 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbkbd.ko 2023-11-28T18:22:34.519 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbmouse.ko 2023-11-28T18:22:34.519 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 217873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/wacom.ko 2023-11-28T18:22:34.519 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/ 2023-11-28T18:22:34.519 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 64201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_balloon.ko 2023-11-28T18:22:34.519 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 89625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_utils.ko 2023-11-28T18:22:34.520 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 305465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_vmbus.ko 2023-11-28T18:22:34.520 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ 2023-11-28T18:22:34.520 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 66521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru.ko 2023-11-28T18:22:34.520 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 61393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru3.ko 2023-11-28T18:22:34.520 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/acpi_power_meter.ko 2023-11-28T18:22:34.520 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7414.ko 2023-11-28T18:22:34.520 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7418.ko 2023-11-28T18:22:34.520 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adc128d818.ko 2023-11-28T18:22:34.520 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1025.ko 2023-11-28T18:22:34.520 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 97977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1026.ko 2023-11-28T18:22:34.520 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1029.ko 2023-11-28T18:22:34.520 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 45553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1031.ko 2023-11-28T18:22:34.520 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm9240.ko 2023-11-28T18:22:34.521 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ads7828.ko 2023-11-28T18:22:34.521 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7410.ko 2023-11-28T18:22:34.521 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7411.ko 2023-11-28T18:22:34.521 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 74433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7462.ko 2023-11-28T18:22:34.521 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 39585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7470.ko 2023-11-28T18:22:34.521 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 67929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7475.ko 2023-11-28T18:22:34.521 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7x10.ko 2023-11-28T18:22:34.521 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 39073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/amc6821.ko 2023-11-28T18:22:34.521 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 55201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/applesmc.ko 2023-11-28T18:22:34.521 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 49913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asb100.ko 2023-11-28T18:22:34.521 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 58617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asc7621.ko 2023-11-28T18:22:34.521 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 40825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asus_atk0110.ko 2023-11-28T18:22:34.522 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/atxp1.ko 2023-11-28T18:22:34.522 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/coretemp.ko 2023-11-28T18:22:34.522 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/da9052-hwmon.ko 2023-11-28T18:22:34.522 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/da9055-hwmon.ko 2023-11-28T18:22:34.522 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 44465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-11-28T18:22:34.522 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 99601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dme1737.ko 2023-11-28T18:22:34.522 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds1621.ko 2023-11-28T18:22:34.522 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds620.ko 2023-11-28T18:22:34.522 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc1403.ko 2023-11-28T18:22:34.522 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc2103.ko 2023-11-28T18:22:34.522 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc6w201.ko 2023-11-28T18:22:34.522 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 66985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71805f.ko 2023-11-28T18:22:34.523 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 94457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71882fg.ko 2023-11-28T18:22:34.523 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 41401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f75375s.ko 2023-11-28T18:22:34.523 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fam15h_power.ko 2023-11-28T18:22:34.523 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 55449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fschmd.ko 2023-11-28T18:22:34.523 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g760a.ko 2023-11-28T18:22:34.523 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g762.ko 2023-11-28T18:22:34.523 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 46801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl518sm.ko 2023-11-28T18:22:34.523 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 45529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl520sm.ko 2023-11-28T18:22:34.523 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/hih6130.ko 2023-11-28T18:22:34.523 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/hwmon-vid.ko 2023-11-28T18:22:34.523 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5500_temp.ko 2023-11-28T18:22:34.523 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5k_amb.ko 2023-11-28T18:22:34.523 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmaem.ko 2023-11-28T18:22:34.524 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmpex.ko 2023-11-28T18:22:34.524 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina209.ko 2023-11-28T18:22:34.524 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina2xx.ko 2023-11-28T18:22:34.524 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 130449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/it87.ko 2023-11-28T18:22:34.524 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/jc42.ko 2023-11-28T18:22:34.524 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k10temp.ko 2023-11-28T18:22:34.524 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k8temp.ko 2023-11-28T18:22:34.524 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lineage-pem.ko 2023-11-28T18:22:34.524 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 48601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm63.ko 2023-11-28T18:22:34.524 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm73.ko 2023-11-28T18:22:34.524 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm75.ko 2023-11-28T18:22:34.524 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm77.ko 2023-11-28T18:22:34.525 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm78.ko 2023-11-28T18:22:34.525 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm80.ko 2023-11-28T18:22:34.525 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm83.ko 2023-11-28T18:22:34.525 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 72833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm85.ko 2023-11-28T18:22:34.525 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 46153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm87.ko 2023-11-28T18:22:34.525 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 37913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm90.ko 2023-11-28T18:22:34.525 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm92.ko 2023-11-28T18:22:34.525 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 108841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm93.ko 2023-11-28T18:22:34.525 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95234.ko 2023-11-28T18:22:34.525 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95241.ko 2023-11-28T18:22:34.525 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95245.ko 2023-11-28T18:22:34.525 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc2945.ko 2023-11-28T18:22:34.525 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4151.ko 2023-11-28T18:22:34.526 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4215.ko 2023-11-28T18:22:34.526 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4222.ko 2023-11-28T18:22:34.526 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4245.ko 2023-11-28T18:22:34.526 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4260.ko 2023-11-28T18:22:34.526 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4261.ko 2023-11-28T18:22:34.526 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max16065.ko 2023-11-28T18:22:34.526 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1619.ko 2023-11-28T18:22:34.526 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1668.ko 2023-11-28T18:22:34.526 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max197.ko 2023-11-28T18:22:34.526 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6639.ko 2023-11-28T18:22:34.526 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6650.ko 2023-11-28T18:22:34.526 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 35777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6697.ko 2023-11-28T18:22:34.527 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/mc13783-adc.ko 2023-11-28T18:22:34.527 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/mcp3021.ko 2023-11-28T18:22:34.527 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-11-28T18:22:34.527 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 44129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6683.ko 2023-11-28T18:22:34.527 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 119817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775-core.ko 2023-11-28T18:22:34.527 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 60705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775.ko 2023-11-28T18:22:34.527 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 59737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct7802.ko 2023-11-28T18:22:34.527 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 82337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87360.ko 2023-11-28T18:22:34.527 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 54433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87427.ko 2023-11-28T18:22:34.527 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pcf8591.ko 2023-11-28T18:22:34.527 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ 2023-11-28T18:22:34.527 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-11-28T18:22:34.528 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-11-28T18:22:34.528 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-11-28T18:22:34.528 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max16064.ko 2023-11-28T18:22:34.528 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max34440.ko 2023-11-28T18:22:34.528 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max8688.ko 2023-11-28T18:22:34.528 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-11-28T18:22:34.528 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 82577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-11-28T18:22:34.528 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-11-28T18:22:34.528 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-11-28T18:22:34.528 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-11-28T18:22:34.528 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-11-28T18:22:34.528 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/powr1220.ko 2023-11-28T18:22:34.529 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5627.ko 2023-11-28T18:22:34.529 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5636.ko 2023-11-28T18:22:34.529 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch56xx-common.ko 2023-11-28T18:22:34.529 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 32137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht15.ko 2023-11-28T18:22:34.529 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht21.ko 2023-11-28T18:22:34.529 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/shtc1.ko 2023-11-28T18:22:34.529 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 40105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sis5595.ko 2023-11-28T18:22:34.529 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47b397.ko 2023-11-28T18:22:34.529 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 39193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m1.ko 2023-11-28T18:22:34.529 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 37385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m192.ko 2023-11-28T18:22:34.529 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/thmc50.ko 2023-11-28T18:22:34.529 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp102.ko 2023-11-28T18:22:34.529 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp103.ko 2023-11-28T18:22:34.530 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp401.ko 2023-11-28T18:22:34.530 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp421.ko 2023-11-28T18:22:34.530 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via-cputemp.ko 2023-11-28T18:22:34.530 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 41945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via686a.ko 2023-11-28T18:22:34.530 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 52457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt1211.ko 2023-11-28T18:22:34.530 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 51545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt8231.ko 2023-11-28T18:22:34.530 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 57449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627ehf.ko 2023-11-28T18:22:34.530 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 78873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627hf.ko 2023-11-28T18:22:34.530 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 71345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83781d.ko 2023-11-28T18:22:34.530 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 63225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83791d.ko 2023-11-28T18:22:34.530 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 71321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83792d.ko 2023-11-28T18:22:34.530 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 101473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83793.ko 2023-11-28T18:22:34.531 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 119505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83795.ko 2023-11-28T18:22:34.531 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l785ts.ko 2023-11-28T18:22:34.531 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 35625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l786ng.ko 2023-11-28T18:22:34.531 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-11-28T18:22:34.531 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-11-28T18:22:34.531 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/ 2023-11-28T18:22:34.531 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/ 2023-11-28T18:22:34.531 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-11-28T18:22:34.531 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-11-28T18:22:34.531 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/ 2023-11-28T18:22:34.531 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-11-28T18:22:34.531 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-11-28T18:22:34.532 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-11-28T18:22:34.532 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-11-28T18:22:34.532 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-11-28T18:22:34.532 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-11-28T18:22:34.532 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-11-28T18:22:34.532 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 6929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-11-28T18:22:34.532 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-11-28T18:22:34.532 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 50201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-11-28T18:22:34.532 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-11-28T18:22:34.532 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-11-28T18:22:34.532 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-11-28T18:22:34.532 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-11-28T18:22:34.532 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-11-28T18:22:34.533 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 62817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-i801.ko 2023-11-28T18:22:34.533 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-isch.ko 2023-11-28T18:22:34.533 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 47889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-11-28T18:22:34.533 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-11-28T18:22:34.533 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-11-28T18:22:34.533 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-11-28T18:22:34.533 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-11-28T18:22:34.533 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-parport.ko 2023-11-28T18:22:34.533 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-11-28T18:22:34.533 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 47241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-11-28T18:22:34.533 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-11-28T18:22:34.533 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-11-28T18:22:34.534 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-11-28T18:22:34.534 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-11-28T18:22:34.534 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-11-28T18:22:34.534 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-11-28T18:22:34.534 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-11-28T18:22:34.534 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-11-28T18:22:34.534 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-via.ko 2023-11-28T18:22:34.534 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-11-28T18:22:34.534 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-11-28T18:22:34.534 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 47657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-11-28T18:22:34.534 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-mux.ko 2023-11-28T18:22:34.534 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-smbus.ko 2023-11-28T18:22:34.534 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-stub.ko 2023-11-28T18:22:34.535 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/ 2023-11-28T18:22:34.535 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-11-28T18:22:34.535 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-11-28T18:22:34.535 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-11-28T18:22:34.535 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ 2023-11-28T18:22:34.535 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ 2023-11-28T18:22:34.535 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 273609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_cm.ko 2023-11-28T18:22:34.535 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 879969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_core.ko 2023-11-28T18:22:34.535 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 69273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_umad.ko 2023-11-28T18:22:34.535 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 324217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-11-28T18:22:34.535 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 97985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/iw_cm.ko 2023-11-28T18:22:34.535 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 282273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_cm.ko 2023-11-28T18:22:34.536 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 66201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-11-28T18:22:34.536 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ 2023-11-28T18:22:34.536 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4/ 2023-11-28T18:22:34.536 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 493073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-11-28T18:22:34.536 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4/ 2023-11-28T18:22:34.536 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 419737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-11-28T18:22:34.536 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5/ 2023-11-28T18:22:34.536 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 739025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-11-28T18:22:34.536 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca/ 2023-11-28T18:22:34.536 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 296625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-11-28T18:22:34.536 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ocrdma/ 2023-11-28T18:22:34.536 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 153697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-11-28T18:22:34.537 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/usnic/ 2023-11-28T18:22:34.537 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 168969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-11-28T18:22:34.537 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ 2023-11-28T18:22:34.537 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib/ 2023-11-28T18:22:34.537 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 263081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-11-28T18:22:34.537 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser/ 2023-11-28T18:22:34.537 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 100241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-11-28T18:22:34.537 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert/ 2023-11-28T18:22:34.537 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 111425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-11-28T18:22:34.537 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp/ 2023-11-28T18:22:34.537 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 128753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-11-28T18:22:34.537 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt/ 2023-11-28T18:22:34.538 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 129529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-11-28T18:22:34.538 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/ 2023-11-28T18:22:34.538 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/evbug.ko 2023-11-28T18:22:34.538 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/ff-memless.ko 2023-11-28T18:22:34.538 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/ 2023-11-28T18:22:34.538 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-11-28T18:22:34.538 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/fm801-gp.ko 2023-11-28T18:22:34.538 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 41241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/gameport.ko 2023-11-28T18:22:34.538 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 41801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/joydev.ko 2023-11-28T18:22:34.538 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/ 2023-11-28T18:22:34.538 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-11-28T18:22:34.538 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-11-28T18:22:34.538 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-11-28T18:22:34.539 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-11-28T18:22:34.539 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/gpio_keys.ko 2023-11-28T18:22:34.539 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-11-28T18:22:34.539 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lkkbd.ko 2023-11-28T18:22:34.539 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lm8323.ko 2023-11-28T18:22:34.539 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lm8333.ko 2023-11-28T18:22:34.539 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-11-28T18:22:34.539 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-11-28T18:22:34.539 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-11-28T18:22:34.539 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-11-28T18:22:34.539 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/newtonkbd.ko 2023-11-28T18:22:34.539 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-11-28T18:22:34.539 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/qt1070.ko 2023-11-28T18:22:34.540 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/qt2160.ko 2023-11-28T18:22:34.540 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-11-28T18:22:34.540 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/stowaway.ko 2023-11-28T18:22:34.540 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/sunkbd.ko 2023-11-28T18:22:34.540 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-11-28T18:22:34.540 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-11-28T18:22:34.540 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-11-28T18:22:34.540 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/xtkbd.ko 2023-11-28T18:22:34.540 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/matrix-keymap.ko 2023-11-28T18:22:34.540 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/ 2023-11-28T18:22:34.540 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/appletouch.ko 2023-11-28T18:22:34.540 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/bcm5974.ko 2023-11-28T18:22:34.541 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 123681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/cyapatp.ko 2023-11-28T18:22:34.541 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 89449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/elan_i2c.ko 2023-11-28T18:22:34.541 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/gpio_mouse.ko 2023-11-28T18:22:34.541 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 335929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/psmouse.ko 2023-11-28T18:22:34.541 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/sermouse.ko 2023-11-28T18:22:34.541 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-11-28T18:22:34.541 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_usb.ko 2023-11-28T18:22:34.541 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/vsxxxaa.ko 2023-11-28T18:22:34.541 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4/ 2023-11-28T18:22:34.541 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 109873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4/rmi_core.ko 2023-11-28T18:22:34.541 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ 2023-11-28T18:22:34.541 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/altera_ps2.ko 2023-11-28T18:22:34.541 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/arc_ps2.ko 2023-11-28T18:22:34.542 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ct82c710.ko 2023-11-28T18:22:34.542 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-11-28T18:22:34.542 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/parkbd.ko 2023-11-28T18:22:34.542 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/pcips2.ko 2023-11-28T18:22:34.542 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ps2mult.ko 2023-11-28T18:22:34.542 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/serio_raw.ko 2023-11-28T18:22:34.542 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/serport.ko 2023-11-28T18:22:34.542 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/sparse-keymap.ko 2023-11-28T18:22:34.542 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/ 2023-11-28T18:22:34.542 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd/ 2023-11-28T18:22:34.542 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 39289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd/iommu_v2.ko 2023-11-28T18:22:34.542 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/ 2023-11-28T18:22:34.543 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-88pm860x.ko 2023-11-28T18:22:34.543 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-adp5520.ko 2023-11-28T18:22:34.543 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 59753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-bd2802.ko 2023-11-28T18:22:34.543 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-blinkm.ko 2023-11-28T18:22:34.543 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-da903x.ko 2023-11-28T18:22:34.543 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-da9052.ko 2023-11-28T18:22:34.543 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-gpio.ko 2023-11-28T18:22:34.543 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3530.ko 2023-11-28T18:22:34.543 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3533.ko 2023-11-28T18:22:34.543 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm355x.ko 2023-11-28T18:22:34.543 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3642.ko 2023-11-28T18:22:34.543 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lp3944.ko 2023-11-28T18:22:34.544 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lp8788.ko 2023-11-28T18:22:34.544 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-max8997.ko 2023-11-28T18:22:34.544 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-mc13783.ko 2023-11-28T18:22:34.544 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-menf21bmc.ko 2023-11-28T18:22:34.544 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca9532.ko 2023-11-28T18:22:34.544 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca955x.ko 2023-11-28T18:22:34.544 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca963x.ko 2023-11-28T18:22:34.544 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-ss4200.ko 2023-11-28T18:22:34.544 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-tca6507.ko 2023-11-28T18:22:34.544 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-wm831x-status.ko 2023-11-28T18:22:34.544 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-wm8350.ko 2023-11-28T18:22:34.544 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ 2023-11-28T18:22:34.544 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-11-28T18:22:34.545 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-11-28T18:22:34.545 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-11-28T18:22:34.545 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-11-28T18:22:34.545 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-11-28T18:22:34.545 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-11-28T18:22:34.545 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-11-28T18:22:34.545 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-11-28T18:22:34.545 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/ 2023-11-28T18:22:34.545 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache/ 2023-11-28T18:22:34.545 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 654969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache/bcache.ko 2023-11-28T18:22:34.545 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 40577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-bio-prison.ko 2023-11-28T18:22:34.545 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 89601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-bufio.ko 2023-11-28T18:22:34.545 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 47529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache-smq.ko 2023-11-28T18:22:34.546 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 156009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache.ko 2023-11-28T18:22:34.546 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 106897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-crypt.ko 2023-11-28T18:22:34.546 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-delay.ko 2023-11-28T18:22:34.546 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 53857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-era.ko 2023-11-28T18:22:34.546 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-flakey.ko 2023-11-28T18:22:34.546 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 41529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-log-userspace.ko 2023-11-28T18:22:34.546 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 32737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-log.ko 2023-11-28T18:22:34.546 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 49545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-mirror.ko 2023-11-28T18:22:34.546 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 78033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-multipath.ko 2023-11-28T18:22:34.546 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-queue-length.ko 2023-11-28T18:22:34.546 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 70825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-raid.ko 2023-11-28T18:22:34.547 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-region-hash.ko 2023-11-28T18:22:34.547 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-round-robin.ko 2023-11-28T18:22:34.547 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-service-time.ko 2023-11-28T18:22:34.547 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 109529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-snapshot.ko 2023-11-28T18:22:34.547 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-switch.ko 2023-11-28T18:22:34.547 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 181865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-thin-pool.ko 2023-11-28T18:22:34.547 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 51737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-verity.ko 2023-11-28T18:22:34.547 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-zero.ko 2023-11-28T18:22:34.547 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/faulty.ko 2023-11-28T18:22:34.547 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/linear.ko 2023-11-28T18:22:34.547 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 32417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/multipath.ko 2023-11-28T18:22:34.547 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data/ 2023-11-28T18:22:34.547 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 199937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-11-28T18:22:34.548 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 37337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid0.ko 2023-11-28T18:22:34.548 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 113073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid1.ko 2023-11-28T18:22:34.548 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 158681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid10.ko 2023-11-28T18:22:34.548 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 395721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid456.ko 2023-11-28T18:22:34.548 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/ 2023-11-28T18:22:34.548 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/ 2023-11-28T18:22:34.548 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 178137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptbase.ko 2023-11-28T18:22:34.548 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 63385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptctl.ko 2023-11-28T18:22:34.548 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 44665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptfc.ko 2023-11-28T18:22:34.548 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 37225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptlan.ko 2023-11-28T18:22:34.548 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 123321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptsas.ko 2023-11-28T18:22:34.548 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 79041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptscsih.ko 2023-11-28T18:22:34.549 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 53017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptspi.ko 2023-11-28T18:22:34.549 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/ 2023-11-28T18:22:34.549 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm800.ko 2023-11-28T18:22:34.549 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm805.ko 2023-11-28T18:22:34.549 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm80x.ko 2023-11-28T18:22:34.549 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/arizona-i2c.ko 2023-11-28T18:22:34.549 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 123721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/arizona.ko 2023-11-28T18:22:34.549 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/bcm590xx.ko 2023-11-28T18:22:34.549 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/cros_ec_dev.ko 2023-11-28T18:22:34.549 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/dln2.ko 2023-11-28T18:22:34.549 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/janz-cmodio.ko 2023-11-28T18:22:34.549 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 53585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/kempld-core.ko 2023-11-28T18:22:34.550 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lm3533-core.ko 2023-11-28T18:22:34.550 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-11-28T18:22:34.550 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lp3943.ko 2023-11-28T18:22:34.550 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 54569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_ich.ko 2023-11-28T18:22:34.550 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_sch.ko 2023-11-28T18:22:34.550 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/max8907.ko 2023-11-28T18:22:34.550 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/mc13xxx-core.ko 2023-11-28T18:22:34.550 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-11-28T18:22:34.550 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/menf21bmc.ko 2023-11-28T18:22:34.550 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633-adc.ko 2023-11-28T18:22:34.550 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633-gpio.ko 2023-11-28T18:22:34.550 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633.ko 2023-11-28T18:22:34.550 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-11-28T18:22:34.551 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/retu-mfd.ko 2023-11-28T18:22:34.551 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 80425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/si476x-core.ko 2023-11-28T18:22:34.551 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 48457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/sm501.ko 2023-11-28T18:22:34.551 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-11-28T18:22:34.551 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 51137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/tps65010.ko 2023-11-28T18:22:34.551 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/tps6507x.ko 2023-11-28T18:22:34.551 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/viperboard.ko 2023-11-28T18:22:34.551 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/vx855.ko 2023-11-28T18:22:34.551 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/wl1273-core.ko 2023-11-28T18:22:34.551 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 44345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/wm8994.ko 2023-11-28T18:22:34.551 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ 2023-11-28T18:22:34.551 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-11-28T18:22:34.552 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 48489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ad525x_dpot.ko 2023-11-28T18:22:34.552 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl/ 2023-11-28T18:22:34.552 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 46585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-11-28T18:22:34.552 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds9802als.ko 2023-11-28T18:22:34.552 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds990x.ko 2023-11-28T18:22:34.552 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 45593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/bh1770glc.ko 2023-11-28T18:22:34.552 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/ 2023-11-28T18:22:34.552 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-11-28T18:22:34.552 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 35281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/core.ko 2023-11-28T18:22:34.552 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710/ 2023-11-28T18:22:34.552 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710/cb710.ko 2023-11-28T18:22:34.552 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ds1682.ko 2023-11-28T18:22:34.552 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/dummy-irq.ko 2023-11-28T18:22:34.553 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/echo/ 2023-11-28T18:22:34.553 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/echo/echo.ko 2023-11-28T18:22:34.553 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/ 2023-11-28T18:22:34.553 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 37849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/at24.ko 2023-11-28T18:22:34.553 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom.ko 2023-11-28T18:22:34.553 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-11-28T18:22:34.553 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/max6875.ko 2023-11-28T18:22:34.553 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/enclosure.ko 2023-11-28T18:22:34.553 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/genwqe/ 2023-11-28T18:22:34.553 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 152201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-11-28T18:22:34.553 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/hmc6352.ko 2023-11-28T18:22:34.553 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/hpilo.ko 2023-11-28T18:22:34.554 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ibmasm/ 2023-11-28T18:22:34.554 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 72129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-11-28T18:22:34.554 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ics932s401.ko 2023-11-28T18:22:34.554 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29003.ko 2023-11-28T18:22:34.554 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29020.ko 2023-11-28T18:22:34.554 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/ 2023-11-28T18:22:34.554 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 42513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-11-28T18:22:34.554 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-11-28T18:22:34.554 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/ 2023-11-28T18:22:34.554 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 125209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-me.ko 2023-11-28T18:22:34.554 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 56521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-txe.ko 2023-11-28T18:22:34.554 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 310113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei.ko 2023-11-28T18:22:34.555 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/phantom.ko 2023-11-28T18:22:34.555 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ti-st/ 2023-11-28T18:22:34.555 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 74265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ti-st/st_drv.ko 2023-11-28T18:22:34.555 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_7xx1.ko 2023-11-28T18:22:34.555 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_core.ko 2023-11-28T18:22:34.555 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tsl2550.ko 2023-11-28T18:22:34.555 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 48697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_balloon.ko 2023-11-28T18:22:34.555 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci/ 2023-11-28T18:22:34.555 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 183609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-11-28T18:22:34.555 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ 2023-11-28T18:22:34.555 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding/ 2023-11-28T18:22:34.555 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 490129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding/bonding.ko 2023-11-28T18:22:34.555 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/ 2023-11-28T18:22:34.556 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53/ 2023-11-28T18:22:34.556 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 106033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53/b53_common.ko 2023-11-28T18:22:34.556 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 40417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/bcm-sf2.ko 2023-11-28T18:22:34.556 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6060.ko 2023-11-28T18:22:34.556 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx/ 2023-11-28T18:22:34.556 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 453737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-11-28T18:22:34.629 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dummy.ko 2023-11-28T18:22:34.629 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/eql.ko 2023-11-28T18:22:34.629 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ 2023-11-28T18:22:34.629 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/ 2023-11-28T18:22:34.629 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 45785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-11-28T18:22:34.629 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 42105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-11-28T18:22:34.629 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 130553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-11-28T18:22:34.630 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 68849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-11-28T18:22:34.630 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/ 2023-11-28T18:22:34.630 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 37649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/8390.ko 2023-11-28T18:22:34.630 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 59689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-11-28T18:22:34.630 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-11-28T18:22:34.630 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 99049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-11-28T18:22:34.630 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec/ 2023-11-28T18:22:34.630 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 54521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-11-28T18:22:34.630 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere/ 2023-11-28T18:22:34.630 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 69137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere/et131x.ko 2023-11-28T18:22:34.630 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon/ 2023-11-28T18:22:34.631 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 59585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-11-28T18:22:34.631 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera/ 2023-11-28T18:22:34.631 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 41409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-11-28T18:22:34.631 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/ 2023-11-28T18:22:34.631 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 54609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-11-28T18:22:34.631 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 49289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-11-28T18:22:34.631 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 87297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-11-28T18:22:34.631 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/ 2023-11-28T18:22:34.631 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx/ 2023-11-28T18:22:34.631 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 97337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-11-28T18:22:34.631 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-11-28T18:22:34.632 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 104673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-11-28T18:22:34.632 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-11-28T18:22:34.632 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 90257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-11-28T18:22:34.632 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/ 2023-11-28T18:22:34.632 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 81569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-11-28T18:22:34.632 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 69729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-11-28T18:22:34.632 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/ 2023-11-28T18:22:34.632 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 78401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-11-28T18:22:34.632 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 176761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-11-28T18:22:34.633 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-11-28T18:22:34.633 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 1421497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-11-28T18:22:34.633 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 128569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-11-28T18:22:34.633 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet/ 2023-11-28T18:22:34.633 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 132089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-11-28T18:22:34.633 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 312081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-11-28T18:22:34.633 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/ 2023-11-28T18:22:34.633 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna/ 2023-11-28T18:22:34.633 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 323513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-11-28T18:22:34.633 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/ 2023-11-28T18:22:34.633 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-11-28T18:22:34.633 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 193497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-11-28T18:22:34.634 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-11-28T18:22:34.634 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 347417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-11-28T18:22:34.634 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-11-28T18:22:34.634 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 1044497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-11-28T18:22:34.634 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-11-28T18:22:34.634 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 166193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-11-28T18:22:34.634 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-11-28T18:22:34.634 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-11-28T18:22:34.634 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/ 2023-11-28T18:22:34.635 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic/ 2023-11-28T18:22:34.635 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 204345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-11-28T18:22:34.635 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/ 2023-11-28T18:22:34.635 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/ 2023-11-28T18:22:34.635 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 69449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-11-28T18:22:34.635 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 61489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-11-28T18:22:34.635 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 141225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-11-28T18:22:34.636 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 51497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-11-28T18:22:34.636 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 62817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-11-28T18:22:34.636 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-11-28T18:22:34.636 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/ 2023-11-28T18:22:34.636 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 60873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-11-28T18:22:34.636 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 62833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-11-28T18:22:34.636 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 45721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dnet.ko 2023-11-28T18:22:34.636 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ec_bhf.ko 2023-11-28T18:22:34.636 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/ 2023-11-28T18:22:34.636 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet/ 2023-11-28T18:22:34.637 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 281137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-11-28T18:22:34.637 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 49457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ethoc.ko 2023-11-28T18:22:34.637 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 51737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fealnx.ko 2023-11-28T18:22:34.637 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fujitsu/ 2023-11-28T18:22:34.637 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 45345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-11-28T18:22:34.637 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ 2023-11-28T18:22:34.637 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 90465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e100.ko 2023-11-28T18:22:34.637 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000/ 2023-11-28T18:22:34.637 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 295577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-11-28T18:22:34.637 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e/ 2023-11-28T18:22:34.637 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 584497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-11-28T18:22:34.637 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k/ 2023-11-28T18:22:34.638 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 246209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-11-28T18:22:34.638 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e/ 2023-11-28T18:22:34.638 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 925825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-11-28T18:22:34.638 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf/ 2023-11-28T18:22:34.638 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 302937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-11-28T18:22:34.638 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb/ 2023-11-28T18:22:34.638 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 514641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-11-28T18:22:34.638 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf/ 2023-11-28T18:22:34.638 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 93593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-11-28T18:22:34.638 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-11-28T18:22:34.639 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 734305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-11-28T18:22:34.639 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-11-28T18:22:34.639 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 151769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-11-28T18:22:34.639 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 86921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/jme.ko 2023-11-28T18:22:34.639 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/ 2023-11-28T18:22:34.640 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-11-28T18:22:34.640 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 102289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/skge.ko 2023-11-28T18:22:34.640 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 122649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-11-28T18:22:34.640 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/ 2023-11-28T18:22:34.641 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-11-28T18:22:34.641 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 727601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-11-28T18:22:34.641 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 278937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-11-28T18:22:34.641 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-11-28T18:22:34.641 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-11-28T18:22:34.642 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 1113681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-11-28T18:22:34.642 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ 2023-11-28T18:22:34.642 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 53041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-11-28T18:22:34.642 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 40993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-11-28T18:22:34.642 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-11-28T18:22:34.643 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 95665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-11-28T18:22:34.643 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/ 2023-11-28T18:22:34.643 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-11-28T18:22:34.643 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 108649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-11-28T18:22:34.644 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/ 2023-11-28T18:22:34.644 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 73441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-11-28T18:22:34.644 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 47777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-11-28T18:22:34.644 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion/ 2023-11-28T18:22:34.645 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 150905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-11-28T18:22:34.645 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia/ 2023-11-28T18:22:34.645 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 136721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-11-28T18:22:34.645 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/ 2023-11-28T18:22:34.645 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 50481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-11-28T18:22:34.645 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 43145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-11-28T18:22:34.645 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/ 2023-11-28T18:22:34.645 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-11-28T18:22:34.645 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 227897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-11-28T18:22:34.645 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 87081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-11-28T18:22:34.645 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-11-28T18:22:34.646 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 672049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-11-28T18:22:34.646 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc/ 2023-11-28T18:22:34.646 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 43017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-11-28T18:22:34.646 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/ 2023-11-28T18:22:34.646 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 67385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-11-28T18:22:34.646 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 83985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-11-28T18:22:34.646 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/atp.ko 2023-11-28T18:22:34.646 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 189801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-11-28T18:22:34.646 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/ 2023-11-28T18:22:34.646 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-11-28T18:22:34.647 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 104241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-11-28T18:22:34.647 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc/ 2023-11-28T18:22:34.647 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 1052497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-11-28T18:22:34.647 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan/ 2023-11-28T18:22:34.647 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 47097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-11-28T18:22:34.647 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/ 2023-11-28T18:22:34.648 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 54817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis190.ko 2023-11-28T18:22:34.648 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 63337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis900.ko 2023-11-28T18:22:34.648 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/ 2023-11-28T18:22:34.648 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 61537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-11-28T18:22:34.648 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 67193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-11-28T18:22:34.648 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 73409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-11-28T18:22:34.648 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 68177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-11-28T18:22:34.649 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/ 2023-11-28T18:22:34.649 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-11-28T18:22:34.649 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-11-28T18:22:34.649 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 39905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-11-28T18:22:34.649 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-11-28T18:22:34.649 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 487025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-11-28T18:22:34.649 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/ 2023-11-28T18:22:34.649 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 103337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/cassini.ko 2023-11-28T18:22:34.649 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 166097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/niu.ko 2023-11-28T18:22:34.649 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 66329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sungem.ko 2023-11-28T18:22:34.649 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 78801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-11-28T18:22:34.650 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti/ 2023-11-28T18:22:34.650 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 50057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-11-28T18:22:34.650 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti/ 2023-11-28T18:22:34.650 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 86529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti/tlan.ko 2023-11-28T18:22:34.650 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/ 2023-11-28T18:22:34.650 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 80273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-11-28T18:22:34.650 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 83633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-11-28T18:22:34.650 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/ 2023-11-28T18:22:34.650 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 46241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-11-28T18:22:34.650 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-11-28T18:22:34.650 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom/ 2023-11-28T18:22:34.650 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 59993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-11-28T18:22:34.651 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/ 2023-11-28T18:22:34.651 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 41001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/defxx.ko 2023-11-28T18:22:34.651 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/skfp/ 2023-11-28T18:22:34.651 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 216985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/skfp/skfp.ko 2023-11-28T18:22:34.651 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 77345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/geneve.ko 2023-11-28T18:22:34.651 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv/ 2023-11-28T18:22:34.651 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 235521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-11-28T18:22:34.651 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154/ 2023-11-28T18:22:34.651 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154/fakelb.ko 2023-11-28T18:22:34.651 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ifb.ko 2023-11-28T18:22:34.651 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan/ 2023-11-28T18:22:34.651 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 83769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan/ipvlan.ko 2023-11-28T18:22:34.652 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 62145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvlan.ko 2023-11-28T18:22:34.652 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvtap.ko 2023-11-28T18:22:34.652 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/ 2023-11-28T18:22:34.652 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-11-28T18:22:34.652 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-11-28T18:22:34.652 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-gpio.ko 2023-11-28T18:22:34.652 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-regmap.ko 2023-11-28T18:22:34.652 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio.ko 2023-11-28T18:22:34.652 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mii.ko 2023-11-28T18:22:34.652 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 43953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/netconsole.ko 2023-11-28T18:22:34.652 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/nlmon.ko 2023-11-28T18:22:34.653 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/ 2023-11-28T18:22:34.653 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs-lynx.ko 2023-11-28T18:22:34.653 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 38977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-11-28T18:22:34.653 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/ 2023-11-28T18:22:34.653 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/amd.ko 2023-11-28T18:22:34.653 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 50033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-11-28T18:22:34.653 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 44721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm7xxx.ko 2023-11-28T18:22:34.653 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm87xx.ko 2023-11-28T18:22:34.653 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 42241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/broadcom.ko 2023-11-28T18:22:34.654 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/cicada.ko 2023-11-28T18:22:34.654 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/davicom.ko 2023-11-28T18:22:34.654 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/et1011c.ko 2023-11-28T18:22:34.654 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/icplus.ko 2023-11-28T18:22:34.654 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/lxt.ko 2023-11-28T18:22:34.654 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 82049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/marvell.ko 2023-11-28T18:22:34.654 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 76113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/micrel.ko 2023-11-28T18:22:34.654 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/national.ko 2023-11-28T18:22:34.654 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 97857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/phylink.ko 2023-11-28T18:22:34.654 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/qsemi.ko 2023-11-28T18:22:34.654 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 50065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/realtek.ko 2023-11-28T18:22:34.655 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/smsc.ko 2023-11-28T18:22:34.655 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/ste10Xp.ko 2023-11-28T18:22:34.655 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/vitesse.ko 2023-11-28T18:22:34.655 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/plip/ 2023-11-28T18:22:34.655 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 43505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/plip/plip.ko 2023-11-28T18:22:34.655 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ 2023-11-28T18:22:34.655 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/bsd_comp.ko 2023-11-28T18:22:34.655 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_async.ko 2023-11-28T18:22:34.656 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_deflate.ko 2023-11-28T18:22:34.656 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_mppe.ko 2023-11-28T18:22:34.656 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_synctty.ko 2023-11-28T18:22:34.656 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 42545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppoe.ko 2023-11-28T18:22:34.656 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppox.ko 2023-11-28T18:22:34.656 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 32689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pptp.ko 2023-11-28T18:22:34.656 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/sb1000.ko 2023-11-28T18:22:34.656 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/ 2023-11-28T18:22:34.656 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 42465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/slip.ko 2023-11-28T18:22:34.656 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/sungem_phy.ko 2023-11-28T18:22:34.656 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 64449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/tap.ko 2023-11-28T18:22:34.657 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/ 2023-11-28T18:22:34.657 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 106169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team.ko 2023-11-28T18:22:34.657 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_activebackup.ko 2023-11-28T18:22:34.657 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_broadcast.ko 2023-11-28T18:22:34.657 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-11-28T18:22:34.657 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_random.ko 2023-11-28T18:22:34.657 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-11-28T18:22:34.657 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 87017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/veth.ko 2023-11-28T18:22:34.657 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3/ 2023-11-28T18:22:34.658 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 144297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-11-28T18:22:34.658 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan/ 2023-11-28T18:22:34.658 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 297329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan/vxlan.ko 2023-11-28T18:22:34.658 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback/ 2023-11-28T18:22:34.658 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 144585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback/xen-netback.ko 2023-11-28T18:22:34.658 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb/ 2023-11-28T18:22:34.659 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb/ntb.ko 2023-11-28T18:22:34.659 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/ 2023-11-28T18:22:34.659 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/ 2023-11-28T18:22:34.659 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 265121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme-core.ko 2023-11-28T18:22:34.659 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 102209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme.ko 2023-11-28T18:22:34.660 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/ 2023-11-28T18:22:34.660 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 133841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport.ko 2023-11-28T18:22:34.660 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_cs.ko 2023-11-28T18:22:34.660 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 84465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_pc.ko 2023-11-28T18:22:34.660 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_serial.ko 2023-11-28T18:22:34.660 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/ 2023-11-28T18:22:34.660 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/ 2023-11-28T18:22:34.660 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-11-28T18:22:34.660 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-11-28T18:22:34.661 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-11-28T18:22:34.661 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/pci-stub.ko 2023-11-28T18:22:34.661 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 46465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/xen-pcifront.ko 2023-11-28T18:22:34.661 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/ 2023-11-28T18:22:34.661 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/i82092.ko 2023-11-28T18:22:34.661 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 145809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia.ko 2023-11-28T18:22:34.661 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 62137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia_core.ko 2023-11-28T18:22:34.661 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-11-28T18:22:34.661 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pd6729.ko 2023-11-28T18:22:34.661 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 112889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/yenta_socket.ko 2023-11-28T18:22:34.661 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/ 2023-11-28T18:22:34.661 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/broadcom/ 2023-11-28T18:22:34.662 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-11-28T18:22:34.662 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/samsung/ 2023-11-28T18:22:34.662 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-11-28T18:22:34.662 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/ 2023-11-28T18:22:34.662 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel/ 2023-11-28T18:22:34.662 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 70153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-11-28T18:22:34.662 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/ 2023-11-28T18:22:34.662 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/ 2023-11-28T18:22:34.662 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 50889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-11-28T18:22:34.662 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec.ko 2023-11-28T18:22:34.663 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-11-28T18:22:34.663 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-11-28T18:22:34.663 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-11-28T18:22:34.663 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-11-28T18:22:34.663 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-11-28T18:22:34.663 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/ 2023-11-28T18:22:34.663 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 67097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acer-wmi.ko 2023-11-28T18:22:34.663 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 39145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acerhdf.ko 2023-11-28T18:22:34.663 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 37025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/apple-gmux.ko 2023-11-28T18:22:34.663 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 59665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-laptop.ko 2023-11-28T18:22:34.663 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-11-28T18:22:34.663 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 127441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-wmi.ko 2023-11-28T18:22:34.664 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/classmate-laptop.ko 2023-11-28T18:22:34.664 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 49121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-11-28T18:22:34.664 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-11-28T18:22:34.664 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 40265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-11-28T18:22:34.664 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-11-28T18:22:34.664 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/hdaps.ko 2023-11-28T18:22:34.664 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/ibm_rtl.ko 2023-11-28T18:22:34.664 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/ 2023-11-28T18:22:34.664 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-11-28T18:22:34.664 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-11-28T18:22:34.664 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 43497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel_ips.ko 2023-11-28T18:22:34.664 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/msi-wmi.ko 2023-11-28T18:22:34.665 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/mxm-wmi.ko 2023-11-28T18:22:34.665 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-11-28T18:22:34.665 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 42329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-laptop.ko 2023-11-28T18:22:34.665 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-q10.ko 2023-11-28T18:22:34.665 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/topstar-laptop.ko 2023-11-28T18:22:34.665 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-11-28T18:22:34.665 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_haps.ko 2023-11-28T18:22:34.665 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi-bmof.ko 2023-11-28T18:22:34.665 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 57569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi.ko 2023-11-28T18:22:34.666 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/ 2023-11-28T18:22:34.666 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ 2023-11-28T18:22:34.666 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/88pm860x_battery.ko 2023-11-28T18:22:34.666 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/88pm860x_charger.ko 2023-11-28T18:22:34.666 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 55057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq2415x_charger.ko 2023-11-28T18:22:34.666 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 54081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq24190_charger.ko 2023-11-28T18:22:34.666 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq24735-charger.ko 2023-11-28T18:22:34.666 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-11-28T18:22:34.666 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/da9030_battery.ko 2023-11-28T18:22:34.666 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/da9052-battery.ko 2023-11-28T18:22:34.667 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2760_battery.ko 2023-11-28T18:22:34.667 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2780_battery.ko 2023-11-28T18:22:34.667 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2781_battery.ko 2023-11-28T18:22:34.667 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2782_battery.ko 2023-11-28T18:22:34.667 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/gpio-charger.ko 2023-11-28T18:22:34.667 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/isp1704_charger.ko 2023-11-28T18:22:34.668 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/lp8727_charger.ko 2023-11-28T18:22:34.668 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max14577_charger.ko 2023-11-28T18:22:34.668 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max17040_battery.ko 2023-11-28T18:22:34.668 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max17042_battery.ko 2023-11-28T18:22:34.668 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max8903_charger.ko 2023-11-28T18:22:34.669 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max8925_power.ko 2023-11-28T18:22:34.669 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/pcf50633-charger.ko 2023-11-28T18:22:34.669 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 38009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/sbs-battery.ko 2023-11-28T18:22:34.669 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/test_power.ko 2023-11-28T18:22:34.669 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/tps65090-charger.ko 2023-11-28T18:22:34.669 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm831x_backup.ko 2023-11-28T18:22:34.669 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm831x_power.ko 2023-11-28T18:22:34.670 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm8350_power.ko 2023-11-28T18:22:34.671 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/ 2023-11-28T18:22:34.671 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 57729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_common.ko 2023-11-28T18:22:34.671 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_msr.ko 2023-11-28T18:22:34.671 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/ 2023-11-28T18:22:34.672 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/ 2023-11-28T18:22:34.672 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-gpio.ko 2023-11-28T18:22:34.672 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-ldisc.ko 2023-11-28T18:22:34.672 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps_parport.ko 2023-11-28T18:22:34.672 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 41873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/pps_core.ko 2023-11-28T18:22:34.673 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ 2023-11-28T18:22:34.673 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 66385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp.ko 2023-11-28T18:22:34.673 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp_kvm.ko 2023-11-28T18:22:34.673 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/ 2023-11-28T18:22:34.673 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-88pm80x.ko 2023-11-28T18:22:34.674 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-88pm860x.ko 2023-11-28T18:22:34.674 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-bq32k.ko 2023-11-28T18:22:34.674 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9052.ko 2023-11-28T18:22:34.674 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9055.ko 2023-11-28T18:22:34.674 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9063.ko 2023-11-28T18:22:34.674 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1286.ko 2023-11-28T18:22:34.675 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 68577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1307.ko 2023-11-28T18:22:34.675 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1374.ko 2023-11-28T18:22:34.675 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1511.ko 2023-11-28T18:22:34.675 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1553.ko 2023-11-28T18:22:34.675 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1672.ko 2023-11-28T18:22:34.676 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1742.ko 2023-11-28T18:22:34.676 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds2404.ko 2023-11-28T18:22:34.676 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds3232.ko 2023-11-28T18:22:34.676 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-em3027.ko 2023-11-28T18:22:34.676 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-fm3130.ko 2023-11-28T18:22:34.677 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl12022.ko 2023-11-28T18:22:34.677 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 35969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl1208.ko 2023-11-28T18:22:34.677 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-lp8788.ko 2023-11-28T18:22:34.678 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 38097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m41t80.ko 2023-11-28T18:22:34.678 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t35.ko 2023-11-28T18:22:34.678 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t59.ko 2023-11-28T18:22:34.678 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t86.ko 2023-11-28T18:22:34.678 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max6900.ko 2023-11-28T18:22:34.678 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8907.ko 2023-11-28T18:22:34.678 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8925.ko 2023-11-28T18:22:34.678 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8997.ko 2023-11-28T18:22:34.678 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8998.ko 2023-11-28T18:22:34.679 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-11-28T18:22:34.679 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-msm6242.ko 2023-11-28T18:22:34.679 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-palmas.ko 2023-11-28T18:22:34.679 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 46633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf2127.ko 2023-11-28T18:22:34.679 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf50633.ko 2023-11-28T18:22:34.679 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf85063.ko 2023-11-28T18:22:34.679 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8523.ko 2023-11-28T18:22:34.679 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8563.ko 2023-11-28T18:22:34.679 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8583.ko 2023-11-28T18:22:34.679 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rc5t583.ko 2023-11-28T18:22:34.679 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rp5c01.ko 2023-11-28T18:22:34.679 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rs5c372.ko 2023-11-28T18:22:34.680 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-11-28T18:22:34.680 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8025.ko 2023-11-28T18:22:34.680 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8581.ko 2023-11-28T18:22:34.680 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-s35390a.ko 2023-11-28T18:22:34.680 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-11-28T18:22:34.680 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-tps6586x.ko 2023-11-28T18:22:34.680 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-tps65910.ko 2023-11-28T18:22:34.680 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-wm831x.ko 2023-11-28T18:22:34.680 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-wm8350.ko 2023-11-28T18:22:34.680 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-x1205.ko 2023-11-28T18:22:34.680 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ 2023-11-28T18:22:34.680 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 77617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-9xxx.ko 2023-11-28T18:22:34.681 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 57665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-sas.ko 2023-11-28T18:22:34.681 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 55105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-xxxx.ko 2023-11-28T18:22:34.681 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 135185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/BusLogic.ko 2023-11-28T18:22:34.681 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/a100u2w.ko 2023-11-28T18:22:34.681 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid/ 2023-11-28T18:22:34.681 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 272305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid/aacraid.ko 2023-11-28T18:22:34.681 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 100617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/advansys.ko 2023-11-28T18:22:34.681 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/ 2023-11-28T18:22:34.681 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 356201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-11-28T18:22:34.681 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 295801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-11-28T18:22:34.681 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic94xx/ 2023-11-28T18:22:34.681 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 189185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-11-28T18:22:34.682 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/am53c974.ko 2023-11-28T18:22:34.682 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr/ 2023-11-28T18:22:34.682 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 106881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-11-28T18:22:34.682 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 38185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/atp870u.ko 2023-11-28T18:22:34.682 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi/ 2023-11-28T18:22:34.682 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 246985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-11-28T18:22:34.682 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa/ 2023-11-28T18:22:34.682 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 1171945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa/bfa.ko 2023-11-28T18:22:34.682 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc/ 2023-11-28T18:22:34.682 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 237273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-11-28T18:22:34.682 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i/ 2023-11-28T18:22:34.683 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 115369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-11-28T18:22:34.683 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 40585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ch.ko 2023-11-28T18:22:34.683 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor/ 2023-11-28T18:22:34.683 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 308921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor/csiostor.ko 2023-11-28T18:22:34.683 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/ 2023-11-28T18:22:34.683 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-11-28T18:22:34.683 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 76145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-11-28T18:22:34.683 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-11-28T18:22:34.683 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 101449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-11-28T18:22:34.683 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 146689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-11-28T18:22:34.683 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 75553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dc395x.ko 2023-11-28T18:22:34.683 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 38073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dmx3191d.ko 2023-11-28T18:22:34.684 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r/ 2023-11-28T18:22:34.684 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 212425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r/esas2r.ko 2023-11-28T18:22:34.684 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 60505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esp_scsi.ko 2023-11-28T18:22:34.684 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/ 2023-11-28T18:22:34.684 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 78209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/fcoe.ko 2023-11-28T18:22:34.684 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 158505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-11-28T18:22:34.684 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fdomain.ko 2023-11-28T18:22:34.684 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic/ 2023-11-28T18:22:34.684 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 263489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic/fnic.ko 2023-11-28T18:22:34.684 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 201817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hpsa.ko 2023-11-28T18:22:34.684 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 51209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hptiop.ko 2023-11-28T18:22:34.684 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 49041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hv_storvsc.ko 2023-11-28T18:22:34.685 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 35337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/imm.ko 2023-11-28T18:22:34.685 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 44057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/initio.ko 2023-11-28T18:22:34.685 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 266537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ipr.ko 2023-11-28T18:22:34.685 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 101881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ips.ko 2023-11-28T18:22:34.685 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci/ 2023-11-28T18:22:34.685 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 317153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci/isci.ko 2023-11-28T18:22:34.685 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-11-28T18:22:34.685 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 52961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_tcp.ko 2023-11-28T18:22:34.685 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc/ 2023-11-28T18:22:34.685 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 314865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc/libfc.ko 2023-11-28T18:22:34.685 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 145585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi.ko 2023-11-28T18:22:34.685 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 53521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi_tcp.ko 2023-11-28T18:22:34.686 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas/ 2023-11-28T18:22:34.686 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 216665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas/libsas.ko 2023-11-28T18:22:34.686 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc/ 2023-11-28T18:22:34.686 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 2197249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc/lpfc.ko 2023-11-28T18:22:34.686 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/ 2023-11-28T18:22:34.686 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 73569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-11-28T18:22:34.686 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-11-28T18:22:34.686 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 310617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-11-28T18:22:34.686 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 84721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid.ko 2023-11-28T18:22:34.686 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas/ 2023-11-28T18:22:34.686 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 659825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-11-28T18:22:34.686 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas/ 2023-11-28T18:22:34.687 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 119561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas/mvsas.ko 2023-11-28T18:22:34.687 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 78129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvumi.ko 2023-11-28T18:22:34.687 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/ 2023-11-28T18:22:34.687 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 81625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-11-28T18:22:34.687 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-11-28T18:22:34.687 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-11-28T18:22:34.687 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-11-28T18:22:34.687 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001/ 2023-11-28T18:22:34.687 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 364105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-11-28T18:22:34.687 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 123617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pmcraid.ko 2023-11-28T18:22:34.687 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ppa.ko 2023-11-28T18:22:34.688 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 55361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla1280.ko 2023-11-28T18:22:34.688 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/ 2023-11-28T18:22:34.688 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 1876689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-11-28T18:22:34.688 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 85289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-11-28T18:22:34.688 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx/ 2023-11-28T18:22:34.688 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 559033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-11-28T18:22:34.688 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qlogicfas408.ko 2023-11-28T18:22:34.688 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/raid_class.ko 2023-11-28T18:22:34.688 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 238761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_debug.ko 2023-11-28T18:22:34.688 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 173937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_fc.ko 2023-11-28T18:22:34.688 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 279313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-11-28T18:22:34.688 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 97729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_sas.ko 2023-11-28T18:22:34.688 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 73881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_spi.ko 2023-11-28T18:22:34.689 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 44993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_srp.ko 2023-11-28T18:22:34.689 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ses.ko 2023-11-28T18:22:34.689 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 115889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/st.ko 2023-11-28T18:22:34.689 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 46825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/stex.ko 2023-11-28T18:22:34.689 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2/ 2023-11-28T18:22:34.689 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 162121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-11-28T18:22:34.689 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 42297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/virtio_scsi.ko 2023-11-28T18:22:34.689 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 50321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/vmw_pvscsi.ko 2023-11-28T18:22:34.689 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 39961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/wd719x.ko 2023-11-28T18:22:34.689 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 50025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/xen-scsifront.ko 2023-11-28T18:22:34.689 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb/ 2023-11-28T18:22:34.690 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 129441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb/ssb.ko 2023-11-28T18:22:34.690 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/ 2023-11-28T18:22:34.690 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi/ 2023-11-28T18:22:34.690 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 736601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-11-28T18:22:34.690 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback/ 2023-11-28T18:22:34.690 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 49985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback/tcm_loop.ko 2023-11-28T18:22:34.690 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 39713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_file.ko 2023-11-28T18:22:34.690 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 43025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_iblock.ko 2023-11-28T18:22:34.690 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 930257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_mod.ko 2023-11-28T18:22:34.690 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 44305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_pscsi.ko 2023-11-28T18:22:34.690 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 122521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_user.ko 2023-11-28T18:22:34.691 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc/ 2023-11-28T18:22:34.691 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 75593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-11-28T18:22:34.691 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/ 2023-11-28T18:22:34.691 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/ 2023-11-28T18:22:34.691 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/ 2023-11-28T18:22:34.691 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-11-28T18:22:34.691 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-11-28T18:22:34.691 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-11-28T18:22:34.691 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-11-28T18:22:34.691 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-11-28T18:22:34.691 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-11-28T18:22:34.692 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-11-28T18:22:34.692 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-11-28T18:22:34.692 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-11-28T18:22:34.692 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-11-28T18:22:34.692 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-11-28T18:22:34.692 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 37065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-11-28T18:22:34.692 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-11-28T18:22:34.692 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-11-28T18:22:34.692 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-11-28T18:22:34.692 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-11-28T18:22:34.692 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ 2023-11-28T18:22:34.692 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless/ 2023-11-28T18:22:34.693 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 78425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-11-28T18:22:34.693 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 57865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/moxa.ko 2023-11-28T18:22:34.693 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 50953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/mxser.ko 2023-11-28T18:22:34.693 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 108601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_gsm.ko 2023-11-28T18:22:34.693 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_hdlc.ko 2023-11-28T18:22:34.693 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 67929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/nozomi.ko 2023-11-28T18:22:34.693 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/ 2023-11-28T18:22:34.693 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/ 2023-11-28T18:22:34.693 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 35753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-11-28T18:22:34.693 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 59497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-11-28T18:22:34.693 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-11-28T18:22:34.693 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/altera_uart.ko 2023-11-28T18:22:34.694 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/arc_uart.ko 2023-11-28T18:22:34.694 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 72425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-11-28T18:22:34.694 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm/ 2023-11-28T18:22:34.694 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 103073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm/jsm.ko 2023-11-28T18:22:34.694 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/rp2.ko 2023-11-28T18:22:34.694 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 52817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/sc16is7xx.ko 2023-11-28T18:22:34.694 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/ 2023-11-28T18:22:34.694 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core/ 2023-11-28T18:22:34.694 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 531265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core/ufshcd-core.ko 2023-11-28T18:22:34.694 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ 2023-11-28T18:22:34.694 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-11-28T18:22:34.694 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-11-28T18:22:34.695 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/ 2023-11-28T18:22:34.695 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 44513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio.ko 2023-11-28T18:22:34.695 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_aec.ko 2023-11-28T18:22:34.695 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_cif.ko 2023-11-28T18:22:34.695 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_dmem_genirq.ko 2023-11-28T18:22:34.695 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_mf624.ko 2023-11-28T18:22:34.695 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_netx.ko 2023-11-28T18:22:34.695 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_pci_generic.ko 2023-11-28T18:22:34.695 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-11-28T18:22:34.695 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_sercos3.ko 2023-11-28T18:22:34.695 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/ 2023-11-28T18:22:34.695 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/c67x00/ 2023-11-28T18:22:34.696 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 73297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/c67x00/c67x00.ko 2023-11-28T18:22:34.696 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ 2023-11-28T18:22:34.696 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 144377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-11-28T18:22:34.696 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-11-28T18:22:34.696 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-11-28T18:22:34.696 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-11-28T18:22:34.696 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/ 2023-11-28T18:22:34.696 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 87089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-acm.ko 2023-11-28T18:22:34.696 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 51345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-wdm.ko 2023-11-28T18:22:34.696 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 47305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usblp.ko 2023-11-28T18:22:34.696 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 89857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usbtmc.ko 2023-11-28T18:22:34.696 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/common/ 2023-11-28T18:22:34.697 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/common/ulpi.ko 2023-11-28T18:22:34.697 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc2/ 2023-11-28T18:22:34.697 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-11-28T18:22:34.697 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/ 2023-11-28T18:22:34.697 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-11-28T18:22:34.697 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-11-28T18:22:34.697 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 448505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3.ko 2023-11-28T18:22:34.697 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/ 2023-11-28T18:22:34.697 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/ 2023-11-28T18:22:34.697 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 60177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/u_ether.ko 2023-11-28T18:22:34.697 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 51881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/u_serial.ko 2023-11-28T18:22:34.698 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-11-28T18:22:34.698 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 42449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-11-28T18:22:34.698 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-11-28T18:22:34.698 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-11-28T18:22:34.698 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 92489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-11-28T18:22:34.698 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 51049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-11-28T18:22:34.698 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 122081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-11-28T18:22:34.698 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 57681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-11-28T18:22:34.698 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-11-28T18:22:34.698 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-11-28T18:22:34.698 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 57729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-11-28T18:22:34.698 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 85609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-11-28T18:22:34.699 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-11-28T18:22:34.699 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 58113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-11-28T18:22:34.699 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 67337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-11-28T18:22:34.699 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/ 2023-11-28T18:22:34.699 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-11-28T18:22:34.699 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-11-28T18:22:34.699 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-11-28T18:22:34.699 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-11-28T18:22:34.699 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-11-28T18:22:34.699 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-11-28T18:22:34.699 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-11-28T18:22:34.699 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-11-28T18:22:34.700 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 32073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-11-28T18:22:34.700 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-11-28T18:22:34.700 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-11-28T18:22:34.700 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-11-28T18:22:34.700 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 62185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-11-28T18:22:34.700 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-11-28T18:22:34.700 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 161225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/libcomposite.ko 2023-11-28T18:22:34.700 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/ 2023-11-28T18:22:34.700 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-11-28T18:22:34.700 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/bdc/ 2023-11-28T18:22:34.700 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 157681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-11-28T18:22:34.700 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-11-28T18:22:34.700 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 52721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-11-28T18:22:34.701 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 69705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-11-28T18:22:34.701 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 56033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-11-28T18:22:34.701 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 76057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/net2272.ko 2023-11-28T18:22:34.701 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 75073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/net2280.ko 2023-11-28T18:22:34.701 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 73169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-11-28T18:22:34.701 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 65809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-11-28T18:22:34.701 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 66097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-11-28T18:22:34.701 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 81505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-11-28T18:22:34.701 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 156073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-11-28T18:22:34.701 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/ 2023-11-28T18:22:34.701 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/bcma-hcd.ko 2023-11-28T18:22:34.701 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 80113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/isp116x-hcd.ko 2023-11-28T18:22:34.702 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 87353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-11-28T18:22:34.702 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 78873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-11-28T18:22:34.702 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 51329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/sl811-hcd.ko 2023-11-28T18:22:34.702 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/sl811_cs.ko 2023-11-28T18:22:34.702 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/ssb-hcd.ko 2023-11-28T18:22:34.702 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-11-28T18:22:34.702 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/ 2023-11-28T18:22:34.702 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/mdc800.ko 2023-11-28T18:22:34.702 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/microtek.ko 2023-11-28T18:22:34.702 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ 2023-11-28T18:22:34.702 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 41721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/adutux.ko 2023-11-28T18:22:34.703 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/appledisplay.ko 2023-11-28T18:22:34.703 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-11-28T18:22:34.703 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/cytherm.ko 2023-11-28T18:22:34.703 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ehset.ko 2023-11-28T18:22:34.703 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi26.ko 2023-11-28T18:22:34.703 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi62.ko 2023-11-28T18:22:34.703 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ezusb.ko 2023-11-28T18:22:34.703 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/idmouse.ko 2023-11-28T18:22:34.703 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/iowarrior.ko 2023-11-28T18:22:34.703 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/isight_firmware.ko 2023-11-28T18:22:34.703 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ldusb.ko 2023-11-28T18:22:34.703 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/legousbtower.ko 2023-11-28T18:22:34.704 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/lvstest.ko 2023-11-28T18:22:34.704 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga/ 2023-11-28T18:22:34.704 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 64841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-11-28T18:22:34.704 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/trancevibrator.ko 2023-11-28T18:22:34.704 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usb3503.ko 2023-11-28T18:22:34.704 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usblcd.ko 2023-11-28T18:22:34.704 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usbsevseg.ko 2023-11-28T18:22:34.704 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 70809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usbtest.ko 2023-11-28T18:22:34.704 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 41905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/uss720.ko 2023-11-28T18:22:34.704 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/yurex.ko 2023-11-28T18:22:34.704 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/mon/ 2023-11-28T18:22:34.704 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 72953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/mon/usbmon.ko 2023-11-28T18:22:34.705 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/musb/ 2023-11-28T18:22:34.705 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 301697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/musb/musb_hdrc.ko 2023-11-28T18:22:34.705 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/ 2023-11-28T18:22:34.705 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-generic.ko 2023-11-28T18:22:34.705 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-11-28T18:22:34.705 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-isp1301.ko 2023-11-28T18:22:34.705 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-tahvo.ko 2023-11-28T18:22:34.705 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ 2023-11-28T18:22:34.705 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/aircable.ko 2023-11-28T18:22:34.705 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ark3116.ko 2023-11-28T18:22:34.705 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/belkin_sa.ko 2023-11-28T18:22:34.705 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 38105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ch341.ko 2023-11-28T18:22:34.706 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 70257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cp210x.ko 2023-11-28T18:22:34.706 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cyberjack.ko 2023-11-28T18:22:34.706 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 58217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cypress_m8.ko 2023-11-28T18:22:34.706 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 49817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/digi_acceleport.ko 2023-11-28T18:22:34.706 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/empeg.ko 2023-11-28T18:22:34.706 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 44273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/f81232.ko 2023-11-28T18:22:34.706 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 175137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ftdi_sio.ko 2023-11-28T18:22:34.706 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 53113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/garmin_gps.ko 2023-11-28T18:22:34.706 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 137081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_edgeport.ko 2023-11-28T18:22:34.706 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 124833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_ti.ko 2023-11-28T18:22:34.706 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 67769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipaq.ko 2023-11-28T18:22:34.706 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipw.ko 2023-11-28T18:22:34.707 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ir-usb.ko 2023-11-28T18:22:34.707 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 58233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-11-28T18:22:34.707 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 107521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan.ko 2023-11-28T18:22:34.707 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 35617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan_pda.ko 2023-11-28T18:22:34.707 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kl5kusb105.ko 2023-11-28T18:22:34.707 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kobil_sct.ko 2023-11-28T18:22:34.707 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 32953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mct_u232.ko 2023-11-28T18:22:34.707 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/metro-usb.ko 2023-11-28T18:22:34.707 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 66449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7720.ko 2023-11-28T18:22:34.707 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 78217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7840.ko 2023-11-28T18:22:34.707 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 56337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mxuport.ko 2023-11-28T18:22:34.707 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/navman.ko 2023-11-28T18:22:34.708 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/omninet.ko 2023-11-28T18:22:34.708 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/opticon.ko 2023-11-28T18:22:34.708 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 191137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/option.ko 2023-11-28T18:22:34.708 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 39073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/oti6858.ko 2023-11-28T18:22:34.708 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 54353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/pl2303.ko 2023-11-28T18:22:34.708 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcaux.ko 2023-11-28T18:22:34.708 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 37825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcserial.ko 2023-11-28T18:22:34.708 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/quatech2.ko 2023-11-28T18:22:34.708 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/safe_serial.ko 2023-11-28T18:22:34.708 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 51625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/sierra.ko 2023-11-28T18:22:34.708 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/spcp8x5.ko 2023-11-28T18:22:34.708 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ssu100.ko 2023-11-28T18:22:34.709 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/symbolserial.ko 2023-11-28T18:22:34.709 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 61489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-11-28T18:22:34.709 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-11-28T18:22:34.709 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_debug.ko 2023-11-28T18:22:34.709 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_wwan.ko 2023-11-28T18:22:34.709 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 125609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usbserial.ko 2023-11-28T18:22:34.709 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/visor.ko 2023-11-28T18:22:34.709 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 37409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/whiteheat.ko 2023-11-28T18:22:34.709 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/wishbone-serial.ko 2023-11-28T18:22:34.709 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/xsens_mt.ko 2023-11-28T18:22:34.709 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ 2023-11-28T18:22:34.709 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 52913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/uas.ko 2023-11-28T18:22:34.710 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-alauda.ko 2023-11-28T18:22:34.710 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-cypress.ko 2023-11-28T18:22:34.710 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-datafab.ko 2023-11-28T18:22:34.710 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-11-28T18:22:34.710 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-freecom.ko 2023-11-28T18:22:34.710 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-isd200.ko 2023-11-28T18:22:34.710 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-11-28T18:22:34.710 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-karma.ko 2023-11-28T18:22:34.710 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-onetouch.ko 2023-11-28T18:22:34.710 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-realtek.ko 2023-11-28T18:22:34.710 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr09.ko 2023-11-28T18:22:34.711 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr55.ko 2023-11-28T18:22:34.711 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 35337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-usbat.ko 2023-11-28T18:22:34.711 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 179969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/usb-storage.ko 2023-11-28T18:22:34.711 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/ 2023-11-28T18:22:34.711 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 67481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-core.ko 2023-11-28T18:22:34.711 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 72177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-host.ko 2023-11-28T18:22:34.711 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 107001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-11-28T18:22:34.711 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/ 2023-11-28T18:22:34.711 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/ 2023-11-28T18:22:34.711 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 154297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-11-28T18:22:34.711 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci.ko 2023-11-28T18:22:34.711 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 108737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio.ko 2023-11-28T18:22:34.711 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 77609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-11-28T18:22:34.712 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/ 2023-11-28T18:22:34.712 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 113785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost.ko 2023-11-28T18:22:34.712 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_iotlb.ko 2023-11-28T18:22:34.712 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 58089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_net.ko 2023-11-28T18:22:34.712 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 89249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_scsi.ko 2023-11-28T18:22:34.712 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/ 2023-11-28T18:22:34.712 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/ 2023-11-28T18:22:34.712 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-11-28T18:22:34.712 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/aat2870_bl.ko 2023-11-28T18:22:34.712 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp5520_bl.ko 2023-11-28T18:22:34.712 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 32609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp8860_bl.ko 2023-11-28T18:22:34.712 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 39993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp8870_bl.ko 2023-11-28T18:22:34.713 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/apple_bl.ko 2023-11-28T18:22:34.713 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/as3711_bl.ko 2023-11-28T18:22:34.713 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/bd6107.ko 2023-11-28T18:22:34.713 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/da903x_bl.ko 2023-11-28T18:22:34.713 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/da9052_bl.ko 2023-11-28T18:22:34.713 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/gpio_backlight.ko 2023-11-28T18:22:34.713 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/kb3886_bl.ko 2023-11-28T18:22:34.713 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lcd.ko 2023-11-28T18:22:34.713 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lm3533_bl.ko 2023-11-28T18:22:34.713 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lm3639_bl.ko 2023-11-28T18:22:34.713 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lv5207lp.ko 2023-11-28T18:22:34.713 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/max8925_bl.ko 2023-11-28T18:22:34.714 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/pandora_bl.ko 2023-11-28T18:22:34.714 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-11-28T18:22:34.714 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/platform_lcd.ko 2023-11-28T18:22:34.714 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/wm831x_bl.ko 2023-11-28T18:22:34.714 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/ 2023-11-28T18:22:34.714 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ 2023-11-28T18:22:34.714 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2482.ko 2023-11-28T18:22:34.714 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 38985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2490.ko 2023-11-28T18:22:34.714 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/matrox_w1.ko 2023-11-28T18:22:34.714 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/w1-gpio.ko 2023-11-28T18:22:34.714 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/ 2023-11-28T18:22:34.715 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-11-28T18:22:34.715 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-11-28T18:22:34.715 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-11-28T18:22:34.715 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-11-28T18:22:34.715 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-11-28T18:22:34.715 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-11-28T18:22:34.715 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-11-28T18:22:34.715 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-11-28T18:22:34.715 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-11-28T18:22:34.715 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_smem.ko 2023-11-28T18:22:34.715 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 56425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_therm.ko 2023-11-28T18:22:34.716 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 102673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/wire.ko 2023-11-28T18:22:34.716 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ 2023-11-28T18:22:34.716 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/acquirewdt.ko 2023-11-28T18:22:34.716 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/advantechwdt.ko 2023-11-28T18:22:34.716 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim1535_wdt.ko 2023-11-28T18:22:34.716 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim7101_wdt.ko 2023-11-28T18:22:34.716 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/cpu5wdt.ko 2023-11-28T18:22:34.716 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9052_wdt.ko 2023-11-28T18:22:34.716 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9055_wdt.ko 2023-11-28T18:22:34.716 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9063_wdt.ko 2023-11-28T18:22:34.716 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/dw_wdt.ko 2023-11-28T18:22:34.717 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/eurotechwdt.ko 2023-11-28T18:22:34.717 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/f71808e_wdt.ko 2023-11-28T18:22:34.717 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/hpwdt.ko 2023-11-28T18:22:34.717 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/i6300esb.ko 2023-11-28T18:22:34.717 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-11-28T18:22:34.717 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_wdt.ko 2023-11-28T18:22:34.717 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ib700wdt.ko 2023-11-28T18:22:34.717 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ibmasr.ko 2023-11-28T18:22:34.717 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-11-28T18:22:34.717 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it8712f_wdt.ko 2023-11-28T18:22:34.717 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it87_wdt.ko 2023-11-28T18:22:34.717 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/kempld_wdt.ko 2023-11-28T18:22:34.718 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/machzwd.ko 2023-11-28T18:22:34.718 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/mena21_wdt.ko 2023-11-28T18:22:34.718 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-11-28T18:22:34.718 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/nv_tco.ko 2023-11-28T18:22:34.718 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-11-28T18:22:34.718 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pc87413_wdt.ko 2023-11-28T18:22:34.718 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 38657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_pci.ko 2023-11-28T18:22:34.718 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_usb.ko 2023-11-28T18:22:34.718 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/retu_wdt.ko 2023-11-28T18:22:34.718 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-11-28T18:22:34.718 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-11-28T18:22:34.718 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-11-28T18:22:34.719 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sc1200wdt.ko 2023-11-28T18:22:34.719 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sch311x_wdt.ko 2023-11-28T18:22:34.719 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-11-28T18:22:34.719 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/softdog.ko 2023-11-28T18:22:34.719 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sp5100_tco.ko 2023-11-28T18:22:34.719 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/twl4030_wdt.ko 2023-11-28T18:22:34.719 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/via_wdt.ko 2023-11-28T18:22:34.719 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-11-28T18:22:34.719 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83877f_wdt.ko 2023-11-28T18:22:34.719 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83977f_wdt.ko 2023-11-28T18:22:34.719 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wafer5823wdt.ko 2023-11-28T18:22:34.719 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wdt_pci.ko 2023-11-28T18:22:34.720 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wm831x_wdt.ko 2023-11-28T18:22:34.720 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wm8350_wdt.ko 2023-11-28T18:22:34.720 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/xen_wdt.ko 2023-11-28T18:22:34.720 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/ 2023-11-28T18:22:34.720 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-evtchn.ko 2023-11-28T18:22:34.720 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntalloc.ko 2023-11-28T18:22:34.720 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 47865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntdev.ko 2023-11-28T18:22:34.720 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback/ 2023-11-28T18:22:34.721 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 176377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-11-28T18:22:34.721 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 40121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-privcmd.ko 2023-11-28T18:22:34.721 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 71249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-scsiback.ko 2023-11-28T18:22:34.721 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs/ 2023-11-28T18:22:34.721 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs/xenfs.ko 2023-11-28T18:22:34.721 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ 2023-11-28T18:22:34.721 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p/ 2023-11-28T18:22:34.721 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 166425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p/9p.ko 2023-11-28T18:22:34.721 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/adfs/ 2023-11-28T18:22:34.721 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 61073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/adfs/adfs.ko 2023-11-28T18:22:34.721 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs/ 2023-11-28T18:22:34.721 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 163593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs/affs.ko 2023-11-28T18:22:34.722 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/afs/ 2023-11-28T18:22:34.722 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 932817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/afs/kafs.ko 2023-11-28T18:22:34.722 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/autofs/ 2023-11-28T18:22:34.722 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 101057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/autofs/autofs4.ko 2023-11-28T18:22:34.722 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs/ 2023-11-28T18:22:34.722 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 64545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs/befs.ko 2023-11-28T18:22:34.722 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/bfs/ 2023-11-28T18:22:34.722 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 41257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/bfs/bfs.ko 2023-11-28T18:22:34.722 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/binfmt_misc.ko 2023-11-28T18:22:34.722 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs/ 2023-11-28T18:22:34.722 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 3402729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs/btrfs.ko 2023-11-28T18:22:34.722 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles/ 2023-11-28T18:22:34.723 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 306009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles/cachefiles.ko 2023-11-28T18:22:34.723 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph/ 2023-11-28T18:22:34.723 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 1333017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph/ceph.ko 2023-11-28T18:22:34.723 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda/ 2023-11-28T18:22:34.723 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 100801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda/coda.ko 2023-11-28T18:22:34.723 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/configfs/ 2023-11-28T18:22:34.723 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 108393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/configfs/configfs.ko 2023-11-28T18:22:34.723 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs/ 2023-11-28T18:22:34.723 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs/cramfs.ko 2023-11-28T18:22:34.723 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm/ 2023-11-28T18:22:34.723 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 642513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm/dlm.ko 2023-11-28T18:22:34.723 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/efs/ 2023-11-28T18:22:34.724 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/efs/efs.ko 2023-11-28T18:22:34.724 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs/ 2023-11-28T18:22:34.724 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 1505025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs/f2fs.ko 2023-11-28T18:22:34.724 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/ 2023-11-28T18:22:34.724 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/msdos.ko 2023-11-28T18:22:34.724 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/freevxfs/ 2023-11-28T18:22:34.724 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 42545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/freevxfs/freevxfs.ko 2023-11-28T18:22:34.724 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache/ 2023-11-28T18:22:34.724 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 226481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache/fscache.ko 2023-11-28T18:22:34.724 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/ 2023-11-28T18:22:34.724 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/cuse.ko 2023-11-28T18:22:34.724 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2/ 2023-11-28T18:22:34.725 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 1231529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2/gfs2.ko 2023-11-28T18:22:34.725 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs/ 2023-11-28T18:22:34.725 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 141209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs/hfs.ko 2023-11-28T18:22:34.725 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus/ 2023-11-28T18:22:34.725 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 222817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus/hfsplus.ko 2023-11-28T18:22:34.725 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hpfs/ 2023-11-28T18:22:34.725 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 192329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hpfs/hpfs.ko 2023-11-28T18:22:34.725 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs/ 2023-11-28T18:22:34.725 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 74065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs/isofs.ko 2023-11-28T18:22:34.725 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs/ 2023-11-28T18:22:34.725 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 419497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs/jfs.ko 2023-11-28T18:22:34.725 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd/ 2023-11-28T18:22:34.726 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 280313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd/lockd.ko 2023-11-28T18:22:34.726 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix/ 2023-11-28T18:22:34.726 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 89193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix/minix.ko 2023-11-28T18:22:34.726 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs/ 2023-11-28T18:22:34.726 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 124649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs/netfs.ko 2023-11-28T18:22:34.726 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/ 2023-11-28T18:22:34.726 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout/ 2023-11-28T18:22:34.726 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 81449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-11-28T18:22:34.726 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout/ 2023-11-28T18:22:34.726 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 59449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-11-28T18:22:34.726 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout/ 2023-11-28T18:22:34.727 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 117465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-11-28T18:22:34.769 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 1055721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfs.ko 2023-11-28T18:22:34.769 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 66441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv2.ko 2023-11-28T18:22:34.769 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 120177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv3.ko 2023-11-28T18:22:34.770 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 2042137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv4.ko 2023-11-28T18:22:34.770 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/ 2023-11-28T18:22:34.770 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/grace.ko 2023-11-28T18:22:34.770 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/nfs_acl.ko 2023-11-28T18:22:34.771 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd/ 2023-11-28T18:22:34.771 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 1516873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd/nfsd.ko 2023-11-28T18:22:34.771 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2/ 2023-11-28T18:22:34.771 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 592833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2/nilfs2.ko 2023-11-28T18:22:34.771 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/ 2023-11-28T18:22:34.771 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-celtic.ko 2023-11-28T18:22:34.772 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-centeuro.ko 2023-11-28T18:22:34.772 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-croatian.ko 2023-11-28T18:22:34.772 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-cyrillic.ko 2023-11-28T18:22:34.772 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-gaelic.ko 2023-11-28T18:22:34.773 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-greek.ko 2023-11-28T18:22:34.773 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-iceland.ko 2023-11-28T18:22:34.773 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-inuit.ko 2023-11-28T18:22:34.773 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-roman.ko 2023-11-28T18:22:34.773 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-romanian.ko 2023-11-28T18:22:34.774 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-turkish.ko 2023-11-28T18:22:34.774 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_ascii.ko 2023-11-28T18:22:34.774 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1250.ko 2023-11-28T18:22:34.774 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1251.ko 2023-11-28T18:22:34.774 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1255.ko 2023-11-28T18:22:34.775 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp737.ko 2023-11-28T18:22:34.775 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp775.ko 2023-11-28T18:22:34.775 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp850.ko 2023-11-28T18:22:34.775 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp852.ko 2023-11-28T18:22:34.775 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp855.ko 2023-11-28T18:22:34.776 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp857.ko 2023-11-28T18:22:34.776 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp860.ko 2023-11-28T18:22:34.776 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp861.ko 2023-11-28T18:22:34.776 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp862.ko 2023-11-28T18:22:34.776 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp863.ko 2023-11-28T18:22:34.777 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp864.ko 2023-11-28T18:22:34.777 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp865.ko 2023-11-28T18:22:34.777 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp866.ko 2023-11-28T18:22:34.777 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp869.ko 2023-11-28T18:22:34.778 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp874.ko 2023-11-28T18:22:34.778 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 94137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp932.ko 2023-11-28T18:22:34.778 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 142673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp936.ko 2023-11-28T18:22:34.778 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 165745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp949.ko 2023-11-28T18:22:34.778 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 118121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp950.ko 2023-11-28T18:22:34.779 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_euc-jp.ko 2023-11-28T18:22:34.779 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-1.ko 2023-11-28T18:22:34.779 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-13.ko 2023-11-28T18:22:34.779 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-14.ko 2023-11-28T18:22:34.780 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-15.ko 2023-11-28T18:22:34.780 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-2.ko 2023-11-28T18:22:34.781 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-3.ko 2023-11-28T18:22:34.781 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-4.ko 2023-11-28T18:22:34.781 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-5.ko 2023-11-28T18:22:34.781 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-6.ko 2023-11-28T18:22:34.781 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-7.ko 2023-11-28T18:22:34.782 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-9.ko 2023-11-28T18:22:34.782 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-r.ko 2023-11-28T18:22:34.782 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-ru.ko 2023-11-28T18:22:34.782 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-u.ko 2023-11-28T18:22:34.782 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_ucs2_utils.ko 2023-11-28T18:22:34.783 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_utf8.ko 2023-11-28T18:22:34.783 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ntfs/ 2023-11-28T18:22:34.783 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 219417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ntfs/ntfs.ko 2023-11-28T18:22:34.783 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ 2023-11-28T18:22:34.783 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster/ 2023-11-28T18:22:34.784 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 244409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-11-28T18:22:34.784 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm/ 2023-11-28T18:22:34.784 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 440737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-11-28T18:22:34.784 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs/ 2023-11-28T18:22:34.784 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 54049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-11-28T18:22:34.785 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 2592433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2.ko 2023-11-28T18:22:34.785 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-11-28T18:22:34.785 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-11-28T18:22:34.785 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 35897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-11-28T18:22:34.785 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/omfs/ 2023-11-28T18:22:34.786 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 53433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/omfs/omfs.ko 2023-11-28T18:22:34.786 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs/ 2023-11-28T18:22:34.786 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 352161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs/overlay.ko 2023-11-28T18:22:34.786 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore/ 2023-11-28T18:22:34.786 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 54809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore/ramoops.ko 2023-11-28T18:22:34.787 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx4/ 2023-11-28T18:22:34.787 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx4/qnx4.ko 2023-11-28T18:22:34.787 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx6/ 2023-11-28T18:22:34.787 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 46689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx6/qnx6.ko 2023-11-28T18:22:34.787 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/ 2023-11-28T18:22:34.787 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_tree.ko 2023-11-28T18:22:34.788 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_v1.ko 2023-11-28T18:22:34.788 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_v2.ko 2023-11-28T18:22:34.788 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs/ 2023-11-28T18:22:34.788 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 532673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs/reiserfs.ko 2023-11-28T18:22:34.788 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs/ 2023-11-28T18:22:34.789 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs/romfs.ko 2023-11-28T18:22:34.789 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/ 2023-11-28T18:22:34.789 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client/ 2023-11-28T18:22:34.789 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 2668401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client/cifs.ko 2023-11-28T18:22:34.789 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/ 2023-11-28T18:22:34.790 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_arc4.ko 2023-11-28T18:22:34.790 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_md4.ko 2023-11-28T18:22:34.790 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs/ 2023-11-28T18:22:34.790 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 134641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs/squashfs.ko 2023-11-28T18:22:34.790 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv/ 2023-11-28T18:22:34.791 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 90721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv/sysv.ko 2023-11-28T18:22:34.791 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf/ 2023-11-28T18:22:34.791 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 247737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf/udf.ko 2023-11-28T18:22:34.791 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs/ 2023-11-28T18:22:34.791 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 162497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs/ufs.ko 2023-11-28T18:22:34.792 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs/ 2023-11-28T18:22:34.792 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 4011017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs/xfs.ko 2023-11-28T18:22:34.792 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/ 2023-11-28T18:22:34.792 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/locking/ 2023-11-28T18:22:34.792 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 75489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/locking/locktorture.ko 2023-11-28T18:22:34.792 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/time/ 2023-11-28T18:22:34.792 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/time/test_udelay.ko 2023-11-28T18:22:34.792 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 60553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/torture.ko 2023-11-28T18:22:34.792 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ 2023-11-28T18:22:34.792 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 6833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc-itu-t.ko 2023-11-28T18:22:34.793 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 6529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc7.ko 2023-11-28T18:22:34.793 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc8.ko 2023-11-28T18:22:34.793 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/ 2023-11-28T18:22:34.793 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libarc4.ko 2023-11-28T18:22:34.793 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 37081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libdes.ko 2023-11-28T18:22:34.793 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/interval_tree_test.ko 2023-11-28T18:22:34.793 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/libcrc32c.ko 2023-11-28T18:22:34.793 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lru_cache.ko 2023-11-28T18:22:34.793 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/ 2023-11-28T18:22:34.793 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4_compress.ko 2023-11-28T18:22:34.793 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4hc_compress.ko 2023-11-28T18:22:34.793 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math/ 2023-11-28T18:22:34.794 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 6617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math/cordic.ko 2023-11-28T18:22:34.794 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/memory-notifier-error-inject.ko 2023-11-28T18:22:34.794 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/notifier-error-inject.ko 2023-11-28T18:22:34.794 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/percpu_test.ko 2023-11-28T18:22:34.794 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/pm-notifier-error-inject.ko 2023-11-28T18:22:34.794 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6/ 2023-11-28T18:22:34.794 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 143433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6/raid6_pq.ko 2023-11-28T18:22:34.794 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/rbtree_test.ko 2023-11-28T18:22:34.794 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon/ 2023-11-28T18:22:34.794 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon/reed_solomon.ko 2023-11-28T18:22:34.794 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 38841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test-kstrtox.ko 2023-11-28T18:22:34.795 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test-string_helpers.ko 2023-11-28T18:22:34.795 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 4760425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_bpf.ko 2023-11-28T18:22:34.795 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 49089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_firmware.ko 2023-11-28T18:22:34.795 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 6369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_module.ko 2023-11-28T18:22:34.795 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_user_copy.ko 2023-11-28T18:22:34.795 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_bm.ko 2023-11-28T18:22:34.795 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_fsm.ko 2023-11-28T18:22:34.795 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_kmp.ko 2023-11-28T18:22:34.795 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/xz/ 2023-11-28T18:22:34.795 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/xz/xz_dec_test.ko 2023-11-28T18:22:34.795 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/mm/ 2023-11-28T18:22:34.796 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/mm/hwpoison-inject.ko 2023-11-28T18:22:34.796 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ 2023-11-28T18:22:34.796 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/ 2023-11-28T18:22:34.796 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 55737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/6lowpan.ko 2023-11-28T18:22:34.796 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_dest.ko 2023-11-28T18:22:34.796 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_fragment.ko 2023-11-28T18:22:34.796 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_hop.ko 2023-11-28T18:22:34.796 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 6985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_ipv6.ko 2023-11-28T18:22:34.796 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_mobility.ko 2023-11-28T18:22:34.796 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_routing.ko 2023-11-28T18:22:34.796 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_udp.ko 2023-11-28T18:22:34.797 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/ 2023-11-28T18:22:34.797 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/garp.ko 2023-11-28T18:22:34.797 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/mrp.ko 2023-11-28T18:22:34.797 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/p8022.ko 2023-11-28T18:22:34.797 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/psnap.ko 2023-11-28T18:22:34.797 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/stp.ko 2023-11-28T18:22:34.797 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q/ 2023-11-28T18:22:34.798 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 81737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q/8021q.ko 2023-11-28T18:22:34.798 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/ 2023-11-28T18:22:34.798 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 198337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet.ko 2023-11-28T18:22:34.798 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 35977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_fd.ko 2023-11-28T18:22:34.799 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_rdma.ko 2023-11-28T18:22:34.799 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 32337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_virtio.ko 2023-11-28T18:22:34.799 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv/ 2023-11-28T18:22:34.799 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 649297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv/batman-adv.ko 2023-11-28T18:22:34.799 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/ 2023-11-28T18:22:34.799 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 63809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/br_netfilter.ko 2023-11-28T18:22:34.799 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 777689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/bridge.ko 2023-11-28T18:22:34.800 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ 2023-11-28T18:22:34.800 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-11-28T18:22:34.800 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_among.ko 2023-11-28T18:22:34.800 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arp.ko 2023-11-28T18:22:34.800 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-11-28T18:22:34.800 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-11-28T18:22:34.801 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip.ko 2023-11-28T18:22:34.801 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-11-28T18:22:34.801 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_limit.ko 2023-11-28T18:22:34.801 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_log.ko 2023-11-28T18:22:34.801 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark.ko 2023-11-28T18:22:34.801 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-11-28T18:22:34.802 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-11-28T18:22:34.802 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-11-28T18:22:34.802 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-11-28T18:22:34.802 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_snat.ko 2023-11-28T18:22:34.802 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_stp.ko 2023-11-28T18:22:34.802 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-11-28T18:22:34.802 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-11-28T18:22:34.802 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-11-28T18:22:34.803 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-11-28T18:22:34.803 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 55929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtables.ko 2023-11-28T18:22:34.803 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-11-28T18:22:34.803 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-11-28T18:22:34.803 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph/ 2023-11-28T18:22:34.803 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 1046833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph/libceph.ko 2023-11-28T18:22:34.804 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/ 2023-11-28T18:22:34.804 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 125993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/pktgen.ko 2023-11-28T18:22:34.804 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/ 2023-11-28T18:22:34.804 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 194209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp.ko 2023-11-28T18:22:34.804 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_diag.ko 2023-11-28T18:22:34.804 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 57881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv4.ko 2023-11-28T18:22:34.804 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 60337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv6.ko 2023-11-28T18:22:34.804 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/ 2023-11-28T18:22:34.804 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 390473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/dsa_core.ko 2023-11-28T18:22:34.804 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_brcm.ko 2023-11-28T18:22:34.805 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_dsa.ko 2023-11-28T18:22:34.806 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_none.ko 2023-11-28T18:22:34.806 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_trailer.ko 2023-11-28T18:22:34.806 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/hsr/ 2023-11-28T18:22:34.806 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 99729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/hsr/hsr.ko 2023-11-28T18:22:34.806 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ 2023-11-28T18:22:34.807 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan/ 2023-11-28T18:22:34.807 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 45233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-11-28T18:22:34.807 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 254625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154.ko 2023-11-28T18:22:34.807 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 47289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154_socket.ko 2023-11-28T18:22:34.807 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ 2023-11-28T18:22:34.807 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ah4.ko 2023-11-28T18:22:34.807 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 38905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/esp4.ko 2023-11-28T18:22:34.807 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 48337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/fou.ko 2023-11-28T18:22:34.807 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/gre.ko 2023-11-28T18:22:34.807 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 48657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/inet_diag.ko 2023-11-28T18:22:34.807 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 60633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_gre.ko 2023-11-28T18:22:34.808 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 61225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_tunnel.ko 2023-11-28T18:22:34.808 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_vti.ko 2023-11-28T18:22:34.808 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipcomp.ko 2023-11-28T18:22:34.808 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipip.ko 2023-11-28T18:22:34.808 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ 2023-11-28T18:22:34.808 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 37641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arp_tables.ko 2023-11-28T18:22:34.808 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-11-28T18:22:34.809 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-11-28T18:22:34.809 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 41609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ip_tables.ko 2023-11-28T18:22:34.809 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-11-28T18:22:34.809 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-11-28T18:22:34.809 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-11-28T18:22:34.809 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-11-28T18:22:34.809 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-11-28T18:22:34.809 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-11-28T18:22:34.809 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-11-28T18:22:34.810 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-11-28T18:22:34.810 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-11-28T18:22:34.810 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_security.ko 2023-11-28T18:22:34.811 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-11-28T18:22:34.811 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-11-28T18:22:34.811 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-11-28T18:22:34.811 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-11-28T18:22:34.811 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-11-28T18:22:34.811 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-11-28T18:22:34.811 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-11-28T18:22:34.811 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-11-28T18:22:34.811 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-11-28T18:22:34.811 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-11-28T18:22:34.811 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-11-28T18:22:34.811 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_bic.ko 2023-11-28T18:22:34.812 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_dctcp.ko 2023-11-28T18:22:34.812 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_diag.ko 2023-11-28T18:22:34.812 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_highspeed.ko 2023-11-28T18:22:34.812 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_htcp.ko 2023-11-28T18:22:34.812 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_hybla.ko 2023-11-28T18:22:34.812 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_illinois.ko 2023-11-28T18:22:34.812 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_lp.ko 2023-11-28T18:22:34.812 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_scalable.ko 2023-11-28T18:22:34.812 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_vegas.ko 2023-11-28T18:22:34.813 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_veno.ko 2023-11-28T18:22:34.813 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_westwood.ko 2023-11-28T18:22:34.813 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_yeah.ko 2023-11-28T18:22:34.813 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tunnel4.ko 2023-11-28T18:22:34.813 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_diag.ko 2023-11-28T18:22:34.813 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 41665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_tunnel.ko 2023-11-28T18:22:34.813 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/xfrm4_tunnel.ko 2023-11-28T18:22:34.814 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ 2023-11-28T18:22:34.814 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ah6.ko 2023-11-28T18:22:34.814 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 39537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/esp6.ko 2023-11-28T18:22:34.814 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/fou6.ko 2023-11-28T18:22:34.814 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 80897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_gre.ko 2023-11-28T18:22:34.814 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 93577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_tunnel.ko 2023-11-28T18:22:34.814 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-11-28T18:22:34.814 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 53273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_vti.ko 2023-11-28T18:22:34.814 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ipcomp6.ko 2023-11-28T18:22:34.814 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/mip6.ko 2023-11-28T18:22:34.815 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ 2023-11-28T18:22:34.815 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 42169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-11-28T18:22:34.815 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-11-28T18:22:34.815 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-11-28T18:22:34.815 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-11-28T18:22:34.815 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-11-28T18:22:34.815 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-11-28T18:22:34.815 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-11-28T18:22:34.816 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-11-28T18:22:34.816 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-11-28T18:22:34.816 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-11-28T18:22:34.816 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-11-28T18:22:34.816 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-11-28T18:22:34.816 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-11-28T18:22:34.816 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-11-28T18:22:34.816 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-11-28T18:22:34.816 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-11-28T18:22:34.816 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-11-28T18:22:34.816 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 39113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-11-28T18:22:34.817 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-11-28T18:22:34.817 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-11-28T18:22:34.817 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-11-28T18:22:34.817 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-11-28T18:22:34.817 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-11-28T18:22:34.817 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-11-28T18:22:34.817 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-11-28T18:22:34.817 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 74073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/sit.ko 2023-11-28T18:22:34.817 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/tunnel6.ko 2023-11-28T18:22:34.817 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/xfrm6_tunnel.ko 2023-11-28T18:22:34.817 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/key/ 2023-11-28T18:22:34.818 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 82833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/key/af_key.ko 2023-11-28T18:22:34.818 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/ 2023-11-28T18:22:34.818 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 125281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_core.ko 2023-11-28T18:22:34.818 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_debugfs.ko 2023-11-28T18:22:34.818 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_eth.ko 2023-11-28T18:22:34.818 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 35569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip.ko 2023-11-28T18:22:34.818 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip6.ko 2023-11-28T18:22:34.819 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_netlink.ko 2023-11-28T18:22:34.819 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 53241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ppp.ko 2023-11-28T18:22:34.819 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/lapb/ 2023-11-28T18:22:34.819 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 47977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/lapb/lapb.ko 2023-11-28T18:22:34.819 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/ 2023-11-28T18:22:34.819 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/llc.ko 2023-11-28T18:22:34.819 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 267913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/llc2.ko 2023-11-28T18:22:34.819 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154/ 2023-11-28T18:22:34.819 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 290417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154/mac802154.ko 2023-11-28T18:22:34.819 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls/ 2023-11-28T18:22:34.820 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls/mpls_gso.ko 2023-11-28T18:22:34.820 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ 2023-11-28T18:22:34.820 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ 2023-11-28T18:22:34.820 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 119585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set.ko 2023-11-28T18:22:34.820 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-11-28T18:22:34.820 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-11-28T18:22:34.820 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-11-28T18:22:34.821 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 100297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-11-28T18:22:34.821 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 101441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-11-28T18:22:34.821 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 102817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-11-28T18:22:34.821 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 103417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-11-28T18:22:34.821 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 112849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-11-28T18:22:34.821 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 60329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-11-28T18:22:34.821 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 109593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-11-28T18:22:34.821 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 113129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-11-28T18:22:34.821 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 112585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-11-28T18:22:34.821 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 111585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-11-28T18:22:34.821 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 114465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-11-28T18:22:34.821 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-11-28T18:22:34.822 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ 2023-11-28T18:22:34.822 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 411729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs.ko 2023-11-28T18:22:34.822 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-11-28T18:22:34.822 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-11-28T18:22:34.822 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-11-28T18:22:34.822 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-11-28T18:22:34.822 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-11-28T18:22:34.822 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-11-28T18:22:34.822 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-11-28T18:22:34.823 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-11-28T18:22:34.823 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-11-28T18:22:34.823 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-11-28T18:22:34.823 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-11-28T18:22:34.823 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-11-28T18:22:34.823 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-11-28T18:22:34.823 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 49257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conncount.ko 2023-11-28T18:22:34.823 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 408257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack.ko 2023-11-28T18:22:34.823 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-11-28T18:22:34.823 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-11-28T18:22:34.824 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-11-28T18:22:34.824 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 118145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_h323.ko 2023-11-28T18:22:34.824 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_irc.ko 2023-11-28T18:22:34.824 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-11-28T18:22:34.824 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 107233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-11-28T18:22:34.824 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-11-28T18:22:34.824 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sane.ko 2023-11-28T18:22:34.824 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 66641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sip.ko 2023-11-28T18:22:34.824 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-11-28T18:22:34.824 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-11-28T18:22:34.824 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_dup_netdev.ko 2023-11-28T18:22:34.825 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 89425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table.ko 2023-11-28T18:22:34.825 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table_inet.ko 2023-11-28T18:22:34.825 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 37129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_log_syslog.ko 2023-11-28T18:22:34.825 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 95353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat.ko 2023-11-28T18:22:34.825 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_amanda.ko 2023-11-28T18:22:34.825 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_ftp.ko 2023-11-28T18:22:34.825 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_irc.ko 2023-11-28T18:22:34.825 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_sip.ko 2023-11-28T18:22:34.825 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_tftp.ko 2023-11-28T18:22:34.825 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 44065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_synproxy_core.ko 2023-11-28T18:22:34.825 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 615649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_tables.ko 2023-11-28T18:22:34.826 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 42561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink.ko 2023-11-28T18:22:34.826 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_acct.ko 2023-11-28T18:22:34.826 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-11-28T18:22:34.826 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 39785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_log.ko 2023-11-28T18:22:34.826 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_osf.ko 2023-11-28T18:22:34.826 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 49377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_queue.ko 2023-11-28T18:22:34.826 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_chain_nat.ko 2023-11-28T18:22:34.826 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_compat.ko 2023-11-28T18:22:34.826 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 40721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_ct.ko 2023-11-28T18:22:34.827 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_dup_netdev.ko 2023-11-28T18:22:34.827 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fib.ko 2023-11-28T18:22:34.827 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fwd_netdev.ko 2023-11-28T18:22:34.827 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_hash.ko 2023-11-28T18:22:34.827 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_limit.ko 2023-11-28T18:22:34.828 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_log.ko 2023-11-28T18:22:34.828 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_masq.ko 2023-11-28T18:22:34.828 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_nat.ko 2023-11-28T18:22:34.828 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_numgen.ko 2023-11-28T18:22:34.828 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_osf.ko 2023-11-28T18:22:34.828 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_queue.ko 2023-11-28T18:22:34.828 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_redir.ko 2023-11-28T18:22:34.828 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject.ko 2023-11-28T18:22:34.828 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject_inet.ko 2023-11-28T18:22:34.828 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_socket.ko 2023-11-28T18:22:34.828 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_synproxy.ko 2023-11-28T18:22:34.829 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_tproxy.ko 2023-11-28T18:22:34.829 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 89313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/x_tables.ko 2023-11-28T18:22:34.829 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_AUDIT.ko 2023-11-28T18:22:34.829 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CHECKSUM.ko 2023-11-28T18:22:34.829 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CLASSIFY.ko 2023-11-28T18:22:34.829 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-11-28T18:22:34.829 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CT.ko 2023-11-28T18:22:34.829 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_DSCP.ko 2023-11-28T18:22:34.829 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HL.ko 2023-11-28T18:22:34.830 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HMARK.ko 2023-11-28T18:22:34.830 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 38873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_IDLETIMER.ko 2023-11-28T18:22:34.830 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LED.ko 2023-11-28T18:22:34.830 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LOG.ko 2023-11-28T18:22:34.830 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_MASQUERADE.ko 2023-11-28T18:22:34.830 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NETMAP.ko 2023-11-28T18:22:34.830 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFLOG.ko 2023-11-28T18:22:34.830 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFQUEUE.ko 2023-11-28T18:22:34.830 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_RATEEST.ko 2023-11-28T18:22:34.831 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_REDIRECT.ko 2023-11-28T18:22:34.831 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_SECMARK.ko 2023-11-28T18:22:34.831 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPMSS.ko 2023-11-28T18:22:34.831 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-11-28T18:22:34.831 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TEE.ko 2023-11-28T18:22:34.831 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TPROXY.ko 2023-11-28T18:22:34.831 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TRACE.ko 2023-11-28T18:22:34.831 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_addrtype.ko 2023-11-28T18:22:34.831 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_bpf.ko 2023-11-28T18:22:34.831 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cgroup.ko 2023-11-28T18:22:34.832 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cluster.ko 2023-11-28T18:22:34.832 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_comment.ko 2023-11-28T18:22:34.832 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connbytes.ko 2023-11-28T18:22:34.832 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlabel.ko 2023-11-28T18:22:34.832 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlimit.ko 2023-11-28T18:22:34.832 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connmark.ko 2023-11-28T18:22:34.832 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_conntrack.ko 2023-11-28T18:22:34.832 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cpu.ko 2023-11-28T18:22:34.832 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dccp.ko 2023-11-28T18:22:34.832 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_devgroup.ko 2023-11-28T18:22:34.832 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dscp.ko 2023-11-28T18:22:34.832 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ecn.ko 2023-11-28T18:22:34.832 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_esp.ko 2023-11-28T18:22:34.833 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 43289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hashlimit.ko 2023-11-28T18:22:34.833 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_helper.ko 2023-11-28T18:22:34.833 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hl.ko 2023-11-28T18:22:34.833 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipcomp.ko 2023-11-28T18:22:34.833 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_iprange.ko 2023-11-28T18:22:34.833 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipvs.ko 2023-11-28T18:22:34.833 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_l2tp.ko 2023-11-28T18:22:34.833 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_length.ko 2023-11-28T18:22:34.833 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_limit.ko 2023-11-28T18:22:34.833 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mac.ko 2023-11-28T18:22:34.833 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mark.ko 2023-11-28T18:22:34.833 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_multiport.ko 2023-11-28T18:22:34.834 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nat.ko 2023-11-28T18:22:34.834 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nfacct.ko 2023-11-28T18:22:34.834 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_osf.ko 2023-11-28T18:22:34.834 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_owner.ko 2023-11-28T18:22:34.834 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_physdev.ko 2023-11-28T18:22:34.834 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_pkttype.ko 2023-11-28T18:22:34.834 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_policy.ko 2023-11-28T18:22:34.834 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_quota.ko 2023-11-28T18:22:34.834 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_rateest.ko 2023-11-28T18:22:34.834 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_realm.ko 2023-11-28T18:22:34.834 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_recent.ko 2023-11-28T18:22:34.834 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_sctp.ko 2023-11-28T18:22:34.834 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_set.ko 2023-11-28T18:22:34.835 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_socket.ko 2023-11-28T18:22:34.835 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_state.ko 2023-11-28T18:22:34.835 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_statistic.ko 2023-11-28T18:22:34.835 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_string.ko 2023-11-28T18:22:34.835 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_tcpmss.ko 2023-11-28T18:22:34.835 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_tcpudp.ko 2023-11-28T18:22:34.835 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_time.ko 2023-11-28T18:22:34.835 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_u32.ko 2023-11-28T18:22:34.835 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink/ 2023-11-28T18:22:34.835 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink/netlink_diag.ko 2023-11-28T18:22:34.835 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh/ 2023-11-28T18:22:34.835 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh/nsh.ko 2023-11-28T18:22:34.835 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/ 2023-11-28T18:22:34.835 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 380033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/openvswitch.ko 2023-11-28T18:22:34.836 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-geneve.ko 2023-11-28T18:22:34.836 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-gre.ko 2023-11-28T18:22:34.836 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-vxlan.ko 2023-11-28T18:22:34.836 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet/ 2023-11-28T18:22:34.836 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet/af_packet_diag.ko 2023-11-28T18:22:34.836 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/ 2023-11-28T18:22:34.836 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 110201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/phonet.ko 2023-11-28T18:22:34.836 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 54721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/pn_pep.ko 2023-11-28T18:22:34.836 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/ 2023-11-28T18:22:34.836 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 251481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds.ko 2023-11-28T18:22:34.836 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 164937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_rdma.ko 2023-11-28T18:22:34.836 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 67377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_tcp.ko 2023-11-28T18:22:34.837 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rxrpc/ 2023-11-28T18:22:34.837 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 819657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rxrpc/rxrpc.ko 2023-11-28T18:22:34.837 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/ 2023-11-28T18:22:34.837 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 32241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_csum.ko 2023-11-28T18:22:34.837 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_gact.ko 2023-11-28T18:22:34.837 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_ipt.ko 2023-11-28T18:22:34.837 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_mirred.ko 2023-11-28T18:22:34.837 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_nat.ko 2023-11-28T18:22:34.837 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 43449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_pedit.ko 2023-11-28T18:22:34.837 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_police.ko 2023-11-28T18:22:34.837 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_simple.ko 2023-11-28T18:22:34.837 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 35297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_skbedit.ko 2023-11-28T18:22:34.837 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_vlan.ko 2023-11-28T18:22:34.837 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_basic.ko 2023-11-28T18:22:34.838 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_bpf.ko 2023-11-28T18:22:34.838 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_cgroup.ko 2023-11-28T18:22:34.838 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_flow.ko 2023-11-28T18:22:34.838 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_fw.ko 2023-11-28T18:22:34.838 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 38425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_route.ko 2023-11-28T18:22:34.838 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 61409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_u32.ko 2023-11-28T18:22:34.838 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_cmp.ko 2023-11-28T18:22:34.838 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_ipset.ko 2023-11-28T18:22:34.838 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_meta.ko 2023-11-28T18:22:34.838 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_nbyte.ko 2023-11-28T18:22:34.838 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_text.ko 2023-11-28T18:22:34.838 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_u32.ko 2023-11-28T18:22:34.838 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_choke.ko 2023-11-28T18:22:34.839 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_codel.ko 2023-11-28T18:22:34.839 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_drr.ko 2023-11-28T18:22:34.839 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_fq.ko 2023-11-28T18:22:34.839 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_fq_codel.ko 2023-11-28T18:22:34.839 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 35433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_gred.ko 2023-11-28T18:22:34.839 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 49817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hfsc.ko 2023-11-28T18:22:34.839 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hhf.ko 2023-11-28T18:22:34.839 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 66393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_htb.ko 2023-11-28T18:22:34.839 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_ingress.ko 2023-11-28T18:22:34.840 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio.ko 2023-11-28T18:22:34.840 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio_lib.ko 2023-11-28T18:22:34.840 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_multiq.ko 2023-11-28T18:22:34.840 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_netem.ko 2023-11-28T18:22:34.840 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_pie.ko 2023-11-28T18:22:34.840 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_plug.ko 2023-11-28T18:22:34.840 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_prio.ko 2023-11-28T18:22:34.840 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 48729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_qfq.ko 2023-11-28T18:22:34.840 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 32905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_red.ko 2023-11-28T18:22:34.841 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfb.ko 2023-11-28T18:22:34.841 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfq.ko 2023-11-28T18:22:34.841 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_tbf.ko 2023-11-28T18:22:34.841 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_teql.ko 2023-11-28T18:22:34.841 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/ 2023-11-28T18:22:34.841 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 929745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp.ko 2023-11-28T18:22:34.841 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp_diag.ko 2023-11-28T18:22:34.841 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/ 2023-11-28T18:22:34.841 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/ 2023-11-28T18:22:34.841 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 336529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-11-28T18:22:34.842 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 54737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-11-28T18:22:34.842 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 1520097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/sunrpc.ko 2023-11-28T18:22:34.842 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma/ 2023-11-28T18:22:34.842 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 707657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-11-28T18:22:34.842 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/ 2023-11-28T18:22:34.842 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/diag.ko 2023-11-28T18:22:34.842 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 862665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/tipc.ko 2023-11-28T18:22:34.842 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix/ 2023-11-28T18:22:34.842 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix/unix_diag.ko 2023-11-28T18:22:34.842 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/ 2023-11-28T18:22:34.842 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 85409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-11-28T18:22:34.842 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 68049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-11-28T18:22:34.843 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 96193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock.ko 2023-11-28T18:22:34.843 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_diag.ko 2023-11-28T18:22:34.843 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_loopback.ko 2023-11-28T18:22:34.843 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/x25/ 2023-11-28T18:22:34.843 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 125177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/x25/x25.ko 2023-11-28T18:22:34.843 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/ 2023-11-28T18:22:34.843 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_algo.ko 2023-11-28T18:22:34.843 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_ipcomp.ko 2023-11-28T18:22:34.843 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 102257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_user.ko 2023-11-28T18:22:34.843 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/ 2023-11-28T18:22:34.843 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib/ 2023-11-28T18:22:34.843 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib/irqbypass.ko 2023-11-28T18:22:34.843 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 640081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.alias 2023-11-28T18:22:34.844 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 624107 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.alias.bin 2023-11-28T18:22:34.844 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7663 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin 2023-11-28T18:22:34.844 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23428 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.alias.bin 2023-11-28T18:22:34.844 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9821 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.bin 2023-11-28T18:22:34.844 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 70004 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.modinfo 2023-11-28T18:22:34.844 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 146313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.dep 2023-11-28T18:22:34.844 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 232548 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.dep.bin 2023-11-28T18:22:34.844 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 210 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.devname 2023-11-28T18:22:34.844 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 72606 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.order 2023-11-28T18:22:34.845 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 879 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.softdep 2023-11-28T18:22:34.845 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 254438 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.symbols 2023-11-28T18:22:34.845 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 309363 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.symbols.bin 2023-11-28T18:22:34.845 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/ 2023-11-28T18:22:34.845 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/ 2023-11-28T18:22:34.845 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/doc/ 2023-11-28T18:22:34.845 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/ 2023-11-28T18:22:34.845 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 172 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/changelog.Debian.gz 2023-11-28T18:22:34.845 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 691 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/copyright 2023-11-28T18:22:34.846 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-g8247bbb5b470 2023-11-28T18:22:34.846 INFO:teuthology.task.kernel:searching for kernel 6.6.0-g8247bbb5b470 2023-11-28T18:22:34.846 DEBUG:teuthology.orchestra.run.smithi045:> egrep '(submenu|menuentry.*6.6.0-g8247bbb5b470).*{' /boot/grub/grub.cfg 2023-11-28T18:22:34.853 INFO:teuthology.orchestra.run.smithi045.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-28T18:22:34.854 INFO:teuthology.orchestra.run.smithi045.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g8247bbb5b470' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g8247bbb5b470-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-28T18:22:34.854 INFO:teuthology.orchestra.run.smithi045.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g8247bbb5b470 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g8247bbb5b470-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-28T18:22:34.855 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-11-28T18:22:34.855 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-g8247bbb5b470 2023-11-28T18:22:34.855 DEBUG:teuthology.orchestra.run.smithi045:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-11-28T18:22:34.899 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi045.front.sepia.ceph.com to complete... 2023-11-28T18:22:35.271 INFO:teuthology.orchestra.run.smithi045.stderr:Sourcing file `/etc/default/grub' 2023-11-28T18:22:35.274 INFO:teuthology.orchestra.run.smithi045.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-28T18:22:35.293 INFO:teuthology.orchestra.run.smithi045.stderr:Generating grub configuration file ... 2023-11-28T18:22:35.502 INFO:teuthology.orchestra.run.smithi045.stderr:Found linux image: /boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-28T18:22:35.509 INFO:teuthology.orchestra.run.smithi045.stderr:Found initrd image: /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-28T18:22:35.722 INFO:teuthology.orchestra.run.smithi045.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-28T18:22:35.727 INFO:teuthology.orchestra.run.smithi045.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-28T18:22:35.768 INFO:teuthology.orchestra.run.smithi045.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-28T18:22:35.774 INFO:teuthology.orchestra.run.smithi045.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-28T18:22:35.923 INFO:teuthology.orchestra.run.smithi045.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-28T18:22:35.923 INFO:teuthology.orchestra.run.smithi045.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-11-28T18:22:35.924 INFO:teuthology.orchestra.run.smithi045.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-28T18:22:35.933 INFO:teuthology.orchestra.run.smithi045.stderr:done 2023-11-28T18:22:37.070 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-11-28T18:22:47.578 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-11-28T18:22:47.578 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2023-11-28T18:22:47.579 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T18:23:06.083 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-11-28T18:23:07.073 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-11-28T18:23:07.073 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2023-11-28T18:23:07.074 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T18:23:15.090 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2023-11-28T18:23:15.091 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T18:23:18.146 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-11-28T18:23:30.158 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2023-11-28T18:23:30.159 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T18:23:48.582 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-11-28T18:24:03.594 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2023-11-28T18:24:03.595 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T18:24:04.154 DEBUG:teuthology.orchestra.run.smithi190:> true 2023-11-28T18:24:04.877 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi190.front.sepia.ceph.com' 2023-11-28T18:24:04.877 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.6.0-g8247bbb5b470"... 2023-11-28T18:24:04.878 DEBUG:teuthology.orchestra.run.smithi190:> uname -r 2023-11-28T18:24:04.925 INFO:teuthology.orchestra.run.smithi190.stdout:6.6.0-g8247bbb5b470 2023-11-28T18:24:04.925 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-g8247bbb5b470 vs 6.6.0-g8247bbb5b470 2023-11-28T18:24:04.926 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-28T18:24:04.926 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-11-28T18:24:05.927 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-11-28T18:24:05.927 DEBUG:teuthology.orchestra.run.smithi190:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-28T18:24:06.020 INFO:teuthology.orchestra.run.smithi190.stdout:ttyS1 2023-11-28T18:24:06.093 DEBUG:teuthology.parallel:result is None 2023-11-28T18:24:07.076 DEBUG:teuthology.orchestra.remote:timed out 2023-11-28T18:24:16.077 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2023-11-28T18:24:16.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T18:24:20.120 DEBUG:teuthology.orchestra.run.smithi045:> true 2023-11-28T18:24:21.005 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi045.front.sepia.ceph.com' 2023-11-28T18:24:21.006 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.6.0-g8247bbb5b470"... 2023-11-28T18:24:21.006 DEBUG:teuthology.orchestra.run.smithi045:> uname -r 2023-11-28T18:24:21.057 INFO:teuthology.orchestra.run.smithi045.stdout:6.6.0-g8247bbb5b470 2023-11-28T18:24:21.057 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-g8247bbb5b470 vs 6.6.0-g8247bbb5b470 2023-11-28T18:24:21.057 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-28T18:24:21.057 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-11-28T18:24:22.058 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-11-28T18:24:22.058 DEBUG:teuthology.orchestra.run.smithi045:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-28T18:24:22.365 INFO:teuthology.orchestra.run.smithi045.stdout:ttyS1 2023-11-28T18:24:22.419 DEBUG:teuthology.parallel:result is None 2023-11-28T18:24:22.419 INFO:teuthology.run_tasks:Running task internal.base... 2023-11-28T18:24:22.428 INFO:teuthology.task.internal:Creating test directory... 2023-11-28T18:24:22.428 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-28T18:24:22.431 DEBUG:teuthology.orchestra.run.smithi190:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-28T18:24:22.441 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-11-28T18:24:22.451 INFO:teuthology.run_tasks:Running task internal.archive... 2023-11-28T18:24:22.460 INFO:teuthology.task.internal:Creating archive directory... 2023-11-28T18:24:22.460 DEBUG:teuthology.orchestra.run.smithi045:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-28T18:24:22.483 DEBUG:teuthology.orchestra.run.smithi190:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-28T18:24:22.507 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-11-28T18:24:22.514 INFO:teuthology.task.internal:Enabling coredump saving... 2023-11-28T18:24:22.514 DEBUG:teuthology.orchestra.run.smithi045:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-28T18:24:22.543 DEBUG:teuthology.orchestra.run.smithi190:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-28T18:24:22.570 INFO:teuthology.orchestra.run.smithi045.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-28T18:24:22.576 INFO:teuthology.orchestra.run.smithi190.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-28T18:24:22.584 INFO:teuthology.orchestra.run.smithi045.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-28T18:24:22.590 INFO:teuthology.orchestra.run.smithi190.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-28T18:24:22.592 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-11-28T18:24:22.600 INFO:teuthology.task.internal:Configuring sudo... 2023-11-28T18:24:22.600 DEBUG:teuthology.orchestra.run.smithi045:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-28T18:24:22.631 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-28T18:24:22.659 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-11-28T18:24:22.667 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-11-28T18:24:22.668 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-28T18:24:22.695 DEBUG:teuthology.orchestra.run.smithi190:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-28T18:24:22.710 DEBUG:teuthology.orchestra.run.smithi045:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-28T18:24:22.757 DEBUG:teuthology.orchestra.run.smithi045:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-28T18:24:22.813 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T18:24:22.813 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-28T18:24:22.895 DEBUG:teuthology.orchestra.run.smithi190:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-28T18:24:22.905 DEBUG:teuthology.orchestra.run.smithi190:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-28T18:24:22.958 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-28T18:24:22.958 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-28T18:24:23.035 DEBUG:teuthology.orchestra.run.smithi045:> sudo service rsyslog restart 2023-11-28T18:24:23.039 DEBUG:teuthology.orchestra.run.smithi190:> sudo service rsyslog restart 2023-11-28T18:24:23.167 INFO:teuthology.run_tasks:Running task internal.timer... 2023-11-28T18:24:23.175 INFO:teuthology.task.internal:Starting timer... 2023-11-28T18:24:23.175 INFO:teuthology.run_tasks:Running task pcp... 2023-11-28T18:24:23.212 INFO:teuthology.run_tasks:Running task selinux... 2023-11-28T18:24:23.252 DEBUG:teuthology.task.selinux:Excluding smithi045: OS 'ubuntu' does not support SELinux 2023-11-28T18:24:23.253 DEBUG:teuthology.task.selinux:Excluding smithi190: OS 'ubuntu' does not support SELinux 2023-11-28T18:24:23.253 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-11-28T18:24:23.253 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-11-28T18:24:23.253 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-11-28T18:24:23.253 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-11-28T18:24:23.264 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-11-28T18:24:23.264 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-11-28T18:24:23.286 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-11-28T18:24:23.288 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi045.front.sepia.ceph.com,smithi190.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-11-28T18:33:14.373 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi045.front.sepia.ceph.com'), Remote(name='ubuntu@smithi190.front.sepia.ceph.com')] 2023-11-28T18:33:14.374 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2023-11-28T18:33:14.375 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T18:33:14.456 DEBUG:teuthology.orchestra.run.smithi045:> true 2023-11-28T18:33:14.576 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi045.front.sepia.ceph.com' 2023-11-28T18:33:14.577 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2023-11-28T18:33:14.577 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T18:33:14.659 DEBUG:teuthology.orchestra.run.smithi190:> true 2023-11-28T18:33:14.789 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi190.front.sepia.ceph.com' 2023-11-28T18:33:14.789 INFO:teuthology.run_tasks:Running task clock... 2023-11-28T18:33:14.800 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-11-28T18:33:14.800 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-28T18:33:14.801 DEBUG:teuthology.orchestra.run.smithi045:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-28T18:33:14.804 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-28T18:33:14.804 DEBUG:teuthology.orchestra.run.smithi190:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-28T18:33:14.843 INFO:teuthology.orchestra.run.smithi045.stdout:28 Nov 18:33:14 ntpd[27881]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-11-28T18:33:14.844 INFO:teuthology.orchestra.run.smithi045.stdout:28 Nov 18:33:14 ntpd[27881]: Command line: ntpd -gq 2023-11-28T18:33:14.844 INFO:teuthology.orchestra.run.smithi045.stdout:28 Nov 18:33:14 ntpd[27881]: ---------------------------------------------------- 2023-11-28T18:33:14.844 INFO:teuthology.orchestra.run.smithi045.stdout:28 Nov 18:33:14 ntpd[27881]: ntp-4 is maintained by Network Time Foundation, 2023-11-28T18:33:14.844 INFO:teuthology.orchestra.run.smithi045.stdout:28 Nov 18:33:14 ntpd[27881]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-11-28T18:33:14.844 INFO:teuthology.orchestra.run.smithi045.stdout:28 Nov 18:33:14 ntpd[27881]: corporation. Support and training for ntp-4 are 2023-11-28T18:33:14.844 INFO:teuthology.orchestra.run.smithi045.stdout:28 Nov 18:33:14 ntpd[27881]: available at https://www.nwtime.org/support 2023-11-28T18:33:14.844 INFO:teuthology.orchestra.run.smithi045.stdout:28 Nov 18:33:14 ntpd[27881]: ---------------------------------------------------- 2023-11-28T18:33:14.845 INFO:teuthology.orchestra.run.smithi045.stdout:28 Nov 18:33:14 ntpd[27881]: proto: precision = 0.044 usec (-24) 2023-11-28T18:33:14.845 INFO:teuthology.orchestra.run.smithi045.stdout:28 Nov 18:33:14 ntpd[27881]: basedate set to 2022-02-04 2023-11-28T18:33:14.845 INFO:teuthology.orchestra.run.smithi045.stdout:28 Nov 18:33:14 ntpd[27881]: gps base set to 2022-02-06 (week 2196) 2023-11-28T18:33:14.845 INFO:teuthology.orchestra.run.smithi045.stdout:28 Nov 18:33:14 ntpd[27881]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-28T18:33:14.845 INFO:teuthology.orchestra.run.smithi045.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-28T18:33:14.845 INFO:teuthology.orchestra.run.smithi045.stderr:restrict ::: KOD does nothing without LIMITED. 2023-11-28T18:33:14.846 INFO:teuthology.orchestra.run.smithi045.stdout:28 Nov 18:33:14 ntpd[27881]: restrict ::: KOD does nothing without LIMITED. 2023-11-28T18:33:14.847 INFO:teuthology.orchestra.run.smithi045.stdout:28 Nov 18:33:14 ntpd[27881]: Listen and drop on 0 v6wildcard [::]:123 2023-11-28T18:33:14.847 INFO:teuthology.orchestra.run.smithi045.stdout:28 Nov 18:33:14 ntpd[27881]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-11-28T18:33:14.847 INFO:teuthology.orchestra.run.smithi045.stdout:28 Nov 18:33:14 ntpd[27881]: Listen normally on 2 lo 127.0.0.1:123 2023-11-28T18:33:14.847 INFO:teuthology.orchestra.run.smithi045.stdout:28 Nov 18:33:14 ntpd[27881]: Listen normally on 3 ens1f0 172.21.15.45:123 2023-11-28T18:33:14.847 INFO:teuthology.orchestra.run.smithi045.stdout:28 Nov 18:33:14 ntpd[27881]: Listen normally on 4 lo [::1]:123 2023-11-28T18:33:14.847 INFO:teuthology.orchestra.run.smithi045.stdout:28 Nov 18:33:14 ntpd[27881]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:12be%4]:123 2023-11-28T18:33:14.848 INFO:teuthology.orchestra.run.smithi045.stdout:28 Nov 18:33:14 ntpd[27881]: Listening on routing socket on fd #22 for interface updates 2023-11-28T18:33:14.872 INFO:teuthology.orchestra.run.smithi190.stdout:28 Nov 18:33:14 ntpd[27975]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-11-28T18:33:14.872 INFO:teuthology.orchestra.run.smithi190.stdout:28 Nov 18:33:14 ntpd[27975]: Command line: ntpd -gq 2023-11-28T18:33:14.872 INFO:teuthology.orchestra.run.smithi190.stdout:28 Nov 18:33:14 ntpd[27975]: ---------------------------------------------------- 2023-11-28T18:33:14.872 INFO:teuthology.orchestra.run.smithi190.stdout:28 Nov 18:33:14 ntpd[27975]: ntp-4 is maintained by Network Time Foundation, 2023-11-28T18:33:14.872 INFO:teuthology.orchestra.run.smithi190.stdout:28 Nov 18:33:14 ntpd[27975]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-11-28T18:33:14.872 INFO:teuthology.orchestra.run.smithi190.stdout:28 Nov 18:33:14 ntpd[27975]: corporation. Support and training for ntp-4 are 2023-11-28T18:33:14.873 INFO:teuthology.orchestra.run.smithi190.stdout:28 Nov 18:33:14 ntpd[27975]: available at https://www.nwtime.org/support 2023-11-28T18:33:14.873 INFO:teuthology.orchestra.run.smithi190.stdout:28 Nov 18:33:14 ntpd[27975]: ---------------------------------------------------- 2023-11-28T18:33:14.873 INFO:teuthology.orchestra.run.smithi190.stdout:28 Nov 18:33:14 ntpd[27975]: proto: precision = 0.041 usec (-24) 2023-11-28T18:33:14.873 INFO:teuthology.orchestra.run.smithi190.stdout:28 Nov 18:33:14 ntpd[27975]: basedate set to 2022-02-04 2023-11-28T18:33:14.874 INFO:teuthology.orchestra.run.smithi190.stdout:28 Nov 18:33:14 ntpd[27975]: gps base set to 2022-02-06 (week 2196) 2023-11-28T18:33:14.874 INFO:teuthology.orchestra.run.smithi190.stdout:28 Nov 18:33:14 ntpd[27975]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-28T18:33:14.874 INFO:teuthology.orchestra.run.smithi190.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-28T18:33:14.874 INFO:teuthology.orchestra.run.smithi190.stderr:restrict ::: KOD does nothing without LIMITED. 2023-11-28T18:33:14.875 INFO:teuthology.orchestra.run.smithi190.stdout:28 Nov 18:33:14 ntpd[27975]: restrict ::: KOD does nothing without LIMITED. 2023-11-28T18:33:14.875 INFO:teuthology.orchestra.run.smithi190.stdout:28 Nov 18:33:14 ntpd[27975]: Listen and drop on 0 v6wildcard [::]:123 2023-11-28T18:33:14.875 INFO:teuthology.orchestra.run.smithi190.stdout:28 Nov 18:33:14 ntpd[27975]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-11-28T18:33:14.875 INFO:teuthology.orchestra.run.smithi190.stdout:28 Nov 18:33:14 ntpd[27975]: Listen normally on 2 lo 127.0.0.1:123 2023-11-28T18:33:14.875 INFO:teuthology.orchestra.run.smithi190.stdout:28 Nov 18:33:14 ntpd[27975]: Listen normally on 3 enp3s0f1 172.21.15.190:123 2023-11-28T18:33:14.875 INFO:teuthology.orchestra.run.smithi190.stdout:28 Nov 18:33:14 ntpd[27975]: Listen normally on 4 lo [::1]:123 2023-11-28T18:33:14.876 INFO:teuthology.orchestra.run.smithi190.stdout:28 Nov 18:33:14 ntpd[27975]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7763%5]:123 2023-11-28T18:33:14.876 INFO:teuthology.orchestra.run.smithi190.stdout:28 Nov 18:33:14 ntpd[27975]: Listening on routing socket on fd #22 for interface updates 2023-11-28T18:33:15.873 INFO:teuthology.orchestra.run.smithi190.stderr:28 Nov 18:33:15 ntpd[27975]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T18:33:15.873 INFO:teuthology.orchestra.run.smithi190.stderr:28 Nov 18:33:15 ntpd[27975]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T18:33:15.873 INFO:teuthology.orchestra.run.smithi190.stderr:28 Nov 18:33:15 ntpd[27975]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T18:33:15.873 INFO:teuthology.orchestra.run.smithi190.stderr:28 Nov 18:33:15 ntpd[27975]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T18:33:15.873 INFO:teuthology.orchestra.run.smithi190.stderr:28 Nov 18:33:15 ntpd[27975]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T18:33:15.873 INFO:teuthology.orchestra.run.smithi190.stderr:28 Nov 18:33:15 ntpd[27975]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T18:33:15.875 INFO:teuthology.orchestra.run.smithi190.stderr:28 Nov 18:33:15 ntpd[27975]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T18:33:15.875 INFO:teuthology.orchestra.run.smithi190.stderr:28 Nov 18:33:15 ntpd[27975]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T18:33:15.875 INFO:teuthology.orchestra.run.smithi190.stderr:28 Nov 18:33:15 ntpd[27975]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T18:33:15.875 INFO:teuthology.orchestra.run.smithi190.stderr:28 Nov 18:33:15 ntpd[27975]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T18:33:15.875 INFO:teuthology.orchestra.run.smithi190.stderr:28 Nov 18:33:15 ntpd[27975]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T18:33:15.875 INFO:teuthology.orchestra.run.smithi190.stderr:28 Nov 18:33:15 ntpd[27975]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T18:33:15.875 INFO:teuthology.orchestra.run.smithi190.stderr:28 Nov 18:33:15 ntpd[27975]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T18:33:15.875 INFO:teuthology.orchestra.run.smithi190.stderr:28 Nov 18:33:15 ntpd[27975]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T18:33:16.844 INFO:teuthology.orchestra.run.smithi045.stderr:28 Nov 18:33:16 ntpd[27881]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T18:33:16.844 INFO:teuthology.orchestra.run.smithi045.stderr:28 Nov 18:33:16 ntpd[27881]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T18:33:17.844 INFO:teuthology.orchestra.run.smithi045.stderr:28 Nov 18:33:17 ntpd[27881]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T18:33:17.844 INFO:teuthology.orchestra.run.smithi045.stderr:28 Nov 18:33:17 ntpd[27881]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T18:33:17.845 INFO:teuthology.orchestra.run.smithi045.stderr:28 Nov 18:33:17 ntpd[27881]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T18:33:17.845 INFO:teuthology.orchestra.run.smithi045.stderr:28 Nov 18:33:17 ntpd[27881]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T18:33:17.845 INFO:teuthology.orchestra.run.smithi045.stderr:28 Nov 18:33:17 ntpd[27881]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T18:33:17.845 INFO:teuthology.orchestra.run.smithi045.stderr:28 Nov 18:33:17 ntpd[27881]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T18:33:17.873 INFO:teuthology.orchestra.run.smithi190.stderr:28 Nov 18:33:17 ntpd[27975]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T18:33:17.874 INFO:teuthology.orchestra.run.smithi190.stderr:28 Nov 18:33:17 ntpd[27975]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T18:33:17.874 INFO:teuthology.orchestra.run.smithi190.stderr:28 Nov 18:33:17 ntpd[27975]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T18:33:17.874 INFO:teuthology.orchestra.run.smithi190.stderr:28 Nov 18:33:17 ntpd[27975]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T18:33:17.874 INFO:teuthology.orchestra.run.smithi190.stderr:28 Nov 18:33:17 ntpd[27975]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T18:33:17.874 INFO:teuthology.orchestra.run.smithi190.stderr:28 Nov 18:33:17 ntpd[27975]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T18:33:17.874 INFO:teuthology.orchestra.run.smithi190.stderr:28 Nov 18:33:17 ntpd[27975]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T18:33:17.874 INFO:teuthology.orchestra.run.smithi190.stderr:28 Nov 18:33:17 ntpd[27975]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T18:33:17.874 INFO:teuthology.orchestra.run.smithi190.stderr:28 Nov 18:33:17 ntpd[27975]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T18:33:17.874 INFO:teuthology.orchestra.run.smithi190.stderr:28 Nov 18:33:17 ntpd[27975]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T18:33:17.874 INFO:teuthology.orchestra.run.smithi190.stderr:28 Nov 18:33:17 ntpd[27975]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T18:33:17.874 INFO:teuthology.orchestra.run.smithi190.stderr:28 Nov 18:33:17 ntpd[27975]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T18:33:18.845 INFO:teuthology.orchestra.run.smithi045.stderr:28 Nov 18:33:18 ntpd[27881]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T18:33:18.845 INFO:teuthology.orchestra.run.smithi045.stderr:28 Nov 18:33:18 ntpd[27881]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T18:33:18.846 INFO:teuthology.orchestra.run.smithi045.stderr:28 Nov 18:33:18 ntpd[27881]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T18:33:18.846 INFO:teuthology.orchestra.run.smithi045.stderr:28 Nov 18:33:18 ntpd[27881]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T18:33:18.846 INFO:teuthology.orchestra.run.smithi045.stderr:28 Nov 18:33:18 ntpd[27881]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T18:33:18.846 INFO:teuthology.orchestra.run.smithi045.stderr:28 Nov 18:33:18 ntpd[27881]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T18:33:18.873 INFO:teuthology.orchestra.run.smithi190.stderr:28 Nov 18:33:18 ntpd[27975]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T18:33:18.874 INFO:teuthology.orchestra.run.smithi190.stderr:28 Nov 18:33:18 ntpd[27975]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T18:33:18.874 INFO:teuthology.orchestra.run.smithi190.stderr:28 Nov 18:33:18 ntpd[27975]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T18:33:18.874 INFO:teuthology.orchestra.run.smithi190.stderr:28 Nov 18:33:18 ntpd[27975]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T18:33:18.874 INFO:teuthology.orchestra.run.smithi190.stderr:28 Nov 18:33:18 ntpd[27975]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T18:33:18.874 INFO:teuthology.orchestra.run.smithi190.stderr:28 Nov 18:33:18 ntpd[27975]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T18:33:19.845 INFO:teuthology.orchestra.run.smithi045.stderr:28 Nov 18:33:19 ntpd[27881]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T18:33:19.845 INFO:teuthology.orchestra.run.smithi045.stderr:28 Nov 18:33:19 ntpd[27881]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T18:33:19.845 INFO:teuthology.orchestra.run.smithi045.stderr:28 Nov 18:33:19 ntpd[27881]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T18:33:19.845 INFO:teuthology.orchestra.run.smithi045.stderr:28 Nov 18:33:19 ntpd[27881]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T18:33:19.845 INFO:teuthology.orchestra.run.smithi045.stderr:28 Nov 18:33:19 ntpd[27881]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T18:33:19.845 INFO:teuthology.orchestra.run.smithi045.stderr:28 Nov 18:33:19 ntpd[27881]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T18:33:19.845 INFO:teuthology.orchestra.run.smithi045.stderr:28 Nov 18:33:19 ntpd[27881]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T18:33:19.845 INFO:teuthology.orchestra.run.smithi045.stderr:28 Nov 18:33:19 ntpd[27881]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T18:33:19.845 INFO:teuthology.orchestra.run.smithi045.stderr:28 Nov 18:33:19 ntpd[27881]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T18:33:19.845 INFO:teuthology.orchestra.run.smithi045.stderr:28 Nov 18:33:19 ntpd[27881]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T18:33:19.845 INFO:teuthology.orchestra.run.smithi045.stderr:28 Nov 18:33:19 ntpd[27881]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T18:33:19.846 INFO:teuthology.orchestra.run.smithi045.stderr:28 Nov 18:33:19 ntpd[27881]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T18:33:19.875 INFO:teuthology.orchestra.run.smithi190.stderr:28 Nov 18:33:19 ntpd[27975]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T18:33:19.875 INFO:teuthology.orchestra.run.smithi190.stderr:28 Nov 18:33:19 ntpd[27975]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T18:33:19.875 INFO:teuthology.orchestra.run.smithi190.stderr:28 Nov 18:33:19 ntpd[27975]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T18:33:19.875 INFO:teuthology.orchestra.run.smithi190.stderr:28 Nov 18:33:19 ntpd[27975]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T18:33:19.875 INFO:teuthology.orchestra.run.smithi190.stderr:28 Nov 18:33:19 ntpd[27975]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T18:33:19.876 INFO:teuthology.orchestra.run.smithi190.stderr:28 Nov 18:33:19 ntpd[27975]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T18:33:19.876 INFO:teuthology.orchestra.run.smithi190.stderr:28 Nov 18:33:19 ntpd[27975]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T18:33:19.877 INFO:teuthology.orchestra.run.smithi190.stderr:28 Nov 18:33:19 ntpd[27975]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T18:33:19.877 INFO:teuthology.orchestra.run.smithi190.stderr:28 Nov 18:33:19 ntpd[27975]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T18:33:19.877 INFO:teuthology.orchestra.run.smithi190.stderr:28 Nov 18:33:19 ntpd[27975]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T18:33:19.877 INFO:teuthology.orchestra.run.smithi190.stderr:28 Nov 18:33:19 ntpd[27975]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T18:33:19.877 INFO:teuthology.orchestra.run.smithi190.stderr:28 Nov 18:33:19 ntpd[27975]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T18:33:20.844 INFO:teuthology.orchestra.run.smithi045.stderr:28 Nov 18:33:20 ntpd[27881]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T18:33:20.844 INFO:teuthology.orchestra.run.smithi045.stderr:28 Nov 18:33:20 ntpd[27881]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T18:33:20.844 INFO:teuthology.orchestra.run.smithi045.stderr:28 Nov 18:33:20 ntpd[27881]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T18:33:20.845 INFO:teuthology.orchestra.run.smithi045.stderr:28 Nov 18:33:20 ntpd[27881]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T18:33:20.845 INFO:teuthology.orchestra.run.smithi045.stderr:28 Nov 18:33:20 ntpd[27881]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T18:33:20.845 INFO:teuthology.orchestra.run.smithi045.stderr:28 Nov 18:33:20 ntpd[27881]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T18:33:20.873 INFO:teuthology.orchestra.run.smithi190.stderr:28 Nov 18:33:20 ntpd[27975]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T18:33:20.873 INFO:teuthology.orchestra.run.smithi190.stderr:28 Nov 18:33:20 ntpd[27975]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T18:33:20.873 INFO:teuthology.orchestra.run.smithi190.stderr:28 Nov 18:33:20 ntpd[27975]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T18:33:20.873 INFO:teuthology.orchestra.run.smithi190.stderr:28 Nov 18:33:20 ntpd[27975]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T18:33:20.874 INFO:teuthology.orchestra.run.smithi190.stderr:28 Nov 18:33:20 ntpd[27975]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T18:33:20.874 INFO:teuthology.orchestra.run.smithi190.stderr:28 Nov 18:33:20 ntpd[27975]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T18:33:21.845 INFO:teuthology.orchestra.run.smithi045.stderr:28 Nov 18:33:21 ntpd[27881]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T18:33:21.845 INFO:teuthology.orchestra.run.smithi045.stderr:28 Nov 18:33:21 ntpd[27881]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T18:33:21.845 INFO:teuthology.orchestra.run.smithi045.stderr:28 Nov 18:33:21 ntpd[27881]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T18:33:21.845 INFO:teuthology.orchestra.run.smithi045.stderr:28 Nov 18:33:21 ntpd[27881]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T18:33:21.845 INFO:teuthology.orchestra.run.smithi045.stderr:28 Nov 18:33:21 ntpd[27881]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T18:33:21.845 INFO:teuthology.orchestra.run.smithi045.stderr:28 Nov 18:33:21 ntpd[27881]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T18:33:21.845 INFO:teuthology.orchestra.run.smithi045.stderr:28 Nov 18:33:21 ntpd[27881]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T18:33:21.845 INFO:teuthology.orchestra.run.smithi045.stderr:28 Nov 18:33:21 ntpd[27881]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T18:33:21.845 INFO:teuthology.orchestra.run.smithi045.stderr:28 Nov 18:33:21 ntpd[27881]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T18:33:21.845 INFO:teuthology.orchestra.run.smithi045.stderr:28 Nov 18:33:21 ntpd[27881]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T18:33:21.846 INFO:teuthology.orchestra.run.smithi045.stderr:28 Nov 18:33:21 ntpd[27881]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T18:33:21.846 INFO:teuthology.orchestra.run.smithi045.stderr:28 Nov 18:33:21 ntpd[27881]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T18:33:21.873 INFO:teuthology.orchestra.run.smithi190.stderr:28 Nov 18:33:21 ntpd[27975]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T18:33:21.874 INFO:teuthology.orchestra.run.smithi190.stderr:28 Nov 18:33:21 ntpd[27975]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T18:33:21.874 INFO:teuthology.orchestra.run.smithi190.stderr:28 Nov 18:33:21 ntpd[27975]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T18:33:21.874 INFO:teuthology.orchestra.run.smithi190.stderr:28 Nov 18:33:21 ntpd[27975]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T18:33:21.874 INFO:teuthology.orchestra.run.smithi190.stderr:28 Nov 18:33:21 ntpd[27975]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T18:33:21.875 INFO:teuthology.orchestra.run.smithi190.stderr:28 Nov 18:33:21 ntpd[27975]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T18:33:21.875 INFO:teuthology.orchestra.run.smithi190.stderr:28 Nov 18:33:21 ntpd[27975]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T18:33:21.875 INFO:teuthology.orchestra.run.smithi190.stderr:28 Nov 18:33:21 ntpd[27975]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T18:33:21.876 INFO:teuthology.orchestra.run.smithi190.stdout:28 Nov 18:33:21 ntpd[27975]: ntpd: time slew -0.002120 s 2023-11-28T18:33:21.876 INFO:teuthology.orchestra.run.smithi190.stdout:ntpd: time slew -0.002120s 2023-11-28T18:33:21.877 INFO:teuthology.orchestra.run.smithi190.stderr:28 Nov 18:33:21 ntpd[27975]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-11-28T18:33:21.877 INFO:teuthology.orchestra.run.smithi190.stderr:28 Nov 18:33:21 ntpd[27975]: can't open /var/log/ntpstats/loopstats.20231128: Permission denied 2023-11-28T18:33:21.967 INFO:teuthology.orchestra.run.smithi190.stdout: remote refid st t when poll reach delay offset jitter 2023-11-28T18:33:21.967 INFO:teuthology.orchestra.run.smithi190.stdout:============================================================================== 2023-11-28T18:33:21.967 INFO:teuthology.orchestra.run.smithi190.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-28T18:33:21.967 INFO:teuthology.orchestra.run.smithi190.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-28T18:33:21.967 INFO:teuthology.orchestra.run.smithi190.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-28T18:33:21.967 INFO:teuthology.orchestra.run.smithi190.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-28T18:33:22.844 INFO:teuthology.orchestra.run.smithi045.stderr:28 Nov 18:33:22 ntpd[27881]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T18:33:22.844 INFO:teuthology.orchestra.run.smithi045.stderr:28 Nov 18:33:22 ntpd[27881]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T18:33:22.844 INFO:teuthology.orchestra.run.smithi045.stderr:28 Nov 18:33:22 ntpd[27881]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T18:33:22.845 INFO:teuthology.orchestra.run.smithi045.stderr:28 Nov 18:33:22 ntpd[27881]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T18:33:22.845 INFO:teuthology.orchestra.run.smithi045.stderr:28 Nov 18:33:22 ntpd[27881]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T18:33:22.845 INFO:teuthology.orchestra.run.smithi045.stderr:28 Nov 18:33:22 ntpd[27881]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T18:33:23.844 INFO:teuthology.orchestra.run.smithi045.stderr:28 Nov 18:33:23 ntpd[27881]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T18:33:23.845 INFO:teuthology.orchestra.run.smithi045.stderr:28 Nov 18:33:23 ntpd[27881]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T18:33:23.845 INFO:teuthology.orchestra.run.smithi045.stderr:28 Nov 18:33:23 ntpd[27881]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T18:33:23.845 INFO:teuthology.orchestra.run.smithi045.stderr:28 Nov 18:33:23 ntpd[27881]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T18:33:23.845 INFO:teuthology.orchestra.run.smithi045.stderr:28 Nov 18:33:23 ntpd[27881]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T18:33:23.845 INFO:teuthology.orchestra.run.smithi045.stderr:28 Nov 18:33:23 ntpd[27881]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T18:33:23.845 INFO:teuthology.orchestra.run.smithi045.stderr:28 Nov 18:33:23 ntpd[27881]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T18:33:23.845 INFO:teuthology.orchestra.run.smithi045.stderr:28 Nov 18:33:23 ntpd[27881]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T18:33:23.845 INFO:teuthology.orchestra.run.smithi045.stdout:28 Nov 18:33:23 ntpd[27881]: ntpd: time slew -0.000352 s 2023-11-28T18:33:23.846 INFO:teuthology.orchestra.run.smithi045.stdout:ntpd: time slew -0.000352s 2023-11-28T18:33:23.846 INFO:teuthology.orchestra.run.smithi045.stderr:28 Nov 18:33:23 ntpd[27881]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-11-28T18:33:23.846 INFO:teuthology.orchestra.run.smithi045.stderr:28 Nov 18:33:23 ntpd[27881]: can't open /var/log/ntpstats/loopstats.20231128: Permission denied 2023-11-28T18:33:23.960 INFO:teuthology.orchestra.run.smithi045.stdout: remote refid st t when poll reach delay offset jitter 2023-11-28T18:33:23.960 INFO:teuthology.orchestra.run.smithi045.stdout:============================================================================== 2023-11-28T18:33:23.960 INFO:teuthology.orchestra.run.smithi045.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-28T18:33:23.960 INFO:teuthology.orchestra.run.smithi045.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-28T18:33:23.960 INFO:teuthology.orchestra.run.smithi045.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-28T18:33:23.960 INFO:teuthology.orchestra.run.smithi045.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-28T18:33:23.961 INFO:teuthology.run_tasks:Running task install... 2023-11-28T18:33:23.970 DEBUG:teuthology.task.install:project ceph 2023-11-28T18:33:23.970 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '47c1c547372ed5bff7984647dc200bac0e019caf'}} 2023-11-28T18:33:23.971 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '47c1c547372ed5bff7984647dc200bac0e019caf'} 2023-11-28T18:33:23.971 INFO:teuthology.task.install:Using flavor: default 2023-11-28T18:33:23.976 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-11-28T18:33:23.976 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-11-28T18:33:23.977 DEBUG:teuthology.orchestra.run.smithi045:> sudo apt-key list | grep Ceph 2023-11-28T18:33:23.977 DEBUG:teuthology.orchestra.run.smithi190:> sudo apt-key list | grep Ceph 2023-11-28T18:33:24.086 INFO:teuthology.orchestra.run.smithi190.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-11-28T18:33:24.112 INFO:teuthology.orchestra.run.smithi045.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-11-28T18:33:24.140 INFO:teuthology.orchestra.run.smithi190.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-11-28T18:33:24.141 INFO:teuthology.orchestra.run.smithi190.stdout:uid [ unknown] Ceph.com (release key) 2023-11-28T18:33:24.142 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-11-28T18:33:24.142 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-11-28T18:33:24.142 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=47c1c547372ed5bff7984647dc200bac0e019caf 2023-11-28T18:33:24.169 INFO:teuthology.orchestra.run.smithi045.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-11-28T18:33:24.169 INFO:teuthology.orchestra.run.smithi045.stdout:uid [ unknown] Ceph.com (release key) 2023-11-28T18:33:24.169 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-11-28T18:33:24.169 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-11-28T18:33:24.170 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=47c1c547372ed5bff7984647dc200bac0e019caf 2023-11-28T18:33:24.376 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default/ 2023-11-28T18:33:24.376 INFO:teuthology.task.install.deb:Package version is 18.0.0-7531-g47c1c547-1jammy 2023-11-28T18:33:24.392 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default/ 2023-11-28T18:33:24.392 INFO:teuthology.task.install.deb:Package version is 18.0.0-7531-g47c1c547-1jammy 2023-11-28T18:33:24.496 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-28T18:33:24.497 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-11-28T18:33:24.500 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T18:33:24.500 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-11-28T18:33:24.519 DEBUG:teuthology.orchestra.run.smithi190:> sudo apt-get update 2023-11-28T18:33:24.521 DEBUG:teuthology.orchestra.run.smithi045:> sudo apt-get update 2023-11-28T18:33:24.714 INFO:teuthology.orchestra.run.smithi190.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-11-28T18:33:24.715 INFO:teuthology.orchestra.run.smithi045.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-11-28T18:33:24.721 INFO:teuthology.orchestra.run.smithi190.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-11-28T18:33:24.723 INFO:teuthology.orchestra.run.smithi190.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-11-28T18:33:24.723 INFO:teuthology.orchestra.run.smithi045.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-11-28T18:33:24.742 INFO:teuthology.orchestra.run.smithi190.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-11-28T18:33:24.743 INFO:teuthology.orchestra.run.smithi045.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-11-28T18:33:24.760 INFO:teuthology.orchestra.run.smithi045.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy InRelease 2023-11-28T18:33:24.781 INFO:teuthology.orchestra.run.smithi045.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-11-28T18:33:24.804 INFO:teuthology.orchestra.run.smithi045.stdout:Ign:6 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy Release.gpg 2023-11-28T18:33:24.825 INFO:teuthology.orchestra.run.smithi045.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,403 B] 2023-11-28T18:33:24.833 INFO:teuthology.orchestra.run.smithi190.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy InRelease 2023-11-28T18:33:24.847 INFO:teuthology.orchestra.run.smithi045.stdout:Hit:8 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-11-28T18:33:24.858 INFO:teuthology.orchestra.run.smithi045.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-11-28T18:33:24.870 INFO:teuthology.orchestra.run.smithi190.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-11-28T18:33:24.915 INFO:teuthology.orchestra.run.smithi190.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy Release.gpg 2023-11-28T18:33:24.963 INFO:teuthology.orchestra.run.smithi190.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,403 B] 2023-11-28T18:33:25.026 INFO:teuthology.orchestra.run.smithi190.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-11-28T18:33:25.326 INFO:teuthology.orchestra.run.smithi190.stdout:Fetched 28.6 kB in 1s (49.0 kB/s) 2023-11-28T18:33:25.343 INFO:teuthology.orchestra.run.smithi045.stdout:Fetched 28.6 kB in 1s (48.0 kB/s) 2023-11-28T18:33:26.256 INFO:teuthology.orchestra.run.smithi190.stdout:Reading package lists... 2023-11-28T18:33:26.271 DEBUG:teuthology.orchestra.run.smithi190:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-7531-g47c1c547-1jammy cephadm=18.0.0-7531-g47c1c547-1jammy ceph-mds=18.0.0-7531-g47c1c547-1jammy ceph-mgr=18.0.0-7531-g47c1c547-1jammy ceph-common=18.0.0-7531-g47c1c547-1jammy ceph-fuse=18.0.0-7531-g47c1c547-1jammy ceph-test=18.0.0-7531-g47c1c547-1jammy ceph-volume=18.0.0-7531-g47c1c547-1jammy radosgw=18.0.0-7531-g47c1c547-1jammy python3-rados=18.0.0-7531-g47c1c547-1jammy python3-rgw=18.0.0-7531-g47c1c547-1jammy python3-cephfs=18.0.0-7531-g47c1c547-1jammy python3-rbd=18.0.0-7531-g47c1c547-1jammy libcephfs2=18.0.0-7531-g47c1c547-1jammy libcephfs-dev=18.0.0-7531-g47c1c547-1jammy librados2=18.0.0-7531-g47c1c547-1jammy librbd1=18.0.0-7531-g47c1c547-1jammy rbd-fuse=18.0.0-7531-g47c1c547-1jammy python3-cephfs=18.0.0-7531-g47c1c547-1jammy cephfs-shell=18.0.0-7531-g47c1c547-1jammy cephfs-top=18.0.0-7531-g47c1c547-1jammy cephfs-mirror=18.0.0-7531-g47c1c547-1jammy 2023-11-28T18:33:26.298 INFO:teuthology.orchestra.run.smithi045.stdout:Reading package lists... 2023-11-28T18:33:26.312 DEBUG:teuthology.orchestra.run.smithi045:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-7531-g47c1c547-1jammy cephadm=18.0.0-7531-g47c1c547-1jammy ceph-mds=18.0.0-7531-g47c1c547-1jammy ceph-mgr=18.0.0-7531-g47c1c547-1jammy ceph-common=18.0.0-7531-g47c1c547-1jammy ceph-fuse=18.0.0-7531-g47c1c547-1jammy ceph-test=18.0.0-7531-g47c1c547-1jammy ceph-volume=18.0.0-7531-g47c1c547-1jammy radosgw=18.0.0-7531-g47c1c547-1jammy python3-rados=18.0.0-7531-g47c1c547-1jammy python3-rgw=18.0.0-7531-g47c1c547-1jammy python3-cephfs=18.0.0-7531-g47c1c547-1jammy python3-rbd=18.0.0-7531-g47c1c547-1jammy libcephfs2=18.0.0-7531-g47c1c547-1jammy libcephfs-dev=18.0.0-7531-g47c1c547-1jammy librados2=18.0.0-7531-g47c1c547-1jammy librbd1=18.0.0-7531-g47c1c547-1jammy rbd-fuse=18.0.0-7531-g47c1c547-1jammy python3-cephfs=18.0.0-7531-g47c1c547-1jammy cephfs-shell=18.0.0-7531-g47c1c547-1jammy cephfs-top=18.0.0-7531-g47c1c547-1jammy cephfs-mirror=18.0.0-7531-g47c1c547-1jammy 2023-11-28T18:33:26.346 INFO:teuthology.orchestra.run.smithi190.stdout:Reading package lists... 2023-11-28T18:33:26.389 INFO:teuthology.orchestra.run.smithi045.stdout:Reading package lists... 2023-11-28T18:33:26.511 INFO:teuthology.orchestra.run.smithi190.stdout:Building dependency tree... 2023-11-28T18:33:26.512 INFO:teuthology.orchestra.run.smithi190.stdout:Reading state information... 2023-11-28T18:33:26.559 INFO:teuthology.orchestra.run.smithi045.stdout:Building dependency tree... 2023-11-28T18:33:26.559 INFO:teuthology.orchestra.run.smithi045.stdout:Reading state information... 2023-11-28T18:33:26.666 INFO:teuthology.orchestra.run.smithi190.stdout:The following packages were automatically installed and are no longer required: 2023-11-28T18:33:26.667 INFO:teuthology.orchestra.run.smithi190.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-28T18:33:26.667 INFO:teuthology.orchestra.run.smithi190.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-28T18:33:26.667 INFO:teuthology.orchestra.run.smithi190.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-28T18:33:26.667 INFO:teuthology.orchestra.run.smithi190.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-28T18:33:26.667 INFO:teuthology.orchestra.run.smithi190.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-28T18:33:26.668 INFO:teuthology.orchestra.run.smithi190.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-28T18:33:26.669 INFO:teuthology.orchestra.run.smithi190.stdout:The following additional packages will be installed: 2023-11-28T18:33:26.670 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-11-28T18:33:26.670 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-11-28T18:33:26.670 INFO:teuthology.orchestra.run.smithi190.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2023-11-28T18:33:26.670 INFO:teuthology.orchestra.run.smithi190.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-11-28T18:33:26.670 INFO:teuthology.orchestra.run.smithi190.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2023-11-28T18:33:26.670 INFO:teuthology.orchestra.run.smithi190.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2023-11-28T18:33:26.671 INFO:teuthology.orchestra.run.smithi190.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-11-28T18:33:26.671 INFO:teuthology.orchestra.run.smithi190.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-11-28T18:33:26.671 INFO:teuthology.orchestra.run.smithi190.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-11-28T18:33:26.671 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-11-28T18:33:26.671 INFO:teuthology.orchestra.run.smithi190.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-11-28T18:33:26.671 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-11-28T18:33:26.672 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-11-28T18:33:26.672 INFO:teuthology.orchestra.run.smithi190.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-11-28T18:33:26.672 INFO:teuthology.orchestra.run.smithi190.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-11-28T18:33:26.672 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-11-28T18:33:26.672 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-11-28T18:33:26.673 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-11-28T18:33:26.673 INFO:teuthology.orchestra.run.smithi190.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-11-28T18:33:26.673 INFO:teuthology.orchestra.run.smithi190.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-11-28T18:33:26.673 INFO:teuthology.orchestra.run.smithi190.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-11-28T18:33:26.673 INFO:teuthology.orchestra.run.smithi190.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-11-28T18:33:26.673 INFO:teuthology.orchestra.run.smithi190.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-11-28T18:33:26.673 INFO:teuthology.orchestra.run.smithi190.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2023-11-28T18:33:26.674 INFO:teuthology.orchestra.run.smithi190.stdout:Suggested packages: 2023-11-28T18:33:26.674 INFO:teuthology.orchestra.run.smithi190.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2023-11-28T18:33:26.674 INFO:teuthology.orchestra.run.smithi190.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2023-11-28T18:33:26.675 INFO:teuthology.orchestra.run.smithi190.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2023-11-28T18:33:26.675 INFO:teuthology.orchestra.run.smithi190.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2023-11-28T18:33:26.675 INFO:teuthology.orchestra.run.smithi190.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2023-11-28T18:33:26.675 INFO:teuthology.orchestra.run.smithi190.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-11-28T18:33:26.675 INFO:teuthology.orchestra.run.smithi190.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2023-11-28T18:33:26.675 INFO:teuthology.orchestra.run.smithi190.stdout:Recommended packages: 2023-11-28T18:33:26.675 INFO:teuthology.orchestra.run.smithi190.stdout: btrfs-tools 2023-11-28T18:33:26.717 INFO:teuthology.orchestra.run.smithi045.stdout:The following packages were automatically installed and are no longer required: 2023-11-28T18:33:26.717 INFO:teuthology.orchestra.run.smithi045.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-28T18:33:26.717 INFO:teuthology.orchestra.run.smithi045.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-28T18:33:26.717 INFO:teuthology.orchestra.run.smithi045.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-28T18:33:26.718 INFO:teuthology.orchestra.run.smithi045.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-28T18:33:26.720 INFO:teuthology.orchestra.run.smithi045.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-28T18:33:26.720 INFO:teuthology.orchestra.run.smithi045.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-28T18:33:26.720 INFO:teuthology.orchestra.run.smithi045.stdout:The following additional packages will be installed: 2023-11-28T18:33:26.720 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-11-28T18:33:26.721 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-11-28T18:33:26.721 INFO:teuthology.orchestra.run.smithi045.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2023-11-28T18:33:26.721 INFO:teuthology.orchestra.run.smithi045.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-11-28T18:33:26.721 INFO:teuthology.orchestra.run.smithi045.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2023-11-28T18:33:26.721 INFO:teuthology.orchestra.run.smithi045.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2023-11-28T18:33:26.722 INFO:teuthology.orchestra.run.smithi045.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-11-28T18:33:26.722 INFO:teuthology.orchestra.run.smithi045.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-11-28T18:33:26.722 INFO:teuthology.orchestra.run.smithi045.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-11-28T18:33:26.722 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-11-28T18:33:26.722 INFO:teuthology.orchestra.run.smithi045.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-11-28T18:33:26.722 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-11-28T18:33:26.722 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-11-28T18:33:26.722 INFO:teuthology.orchestra.run.smithi045.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-11-28T18:33:26.723 INFO:teuthology.orchestra.run.smithi045.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-11-28T18:33:26.723 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-11-28T18:33:26.723 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-11-28T18:33:26.723 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-11-28T18:33:26.723 INFO:teuthology.orchestra.run.smithi045.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-11-28T18:33:26.723 INFO:teuthology.orchestra.run.smithi045.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-11-28T18:33:26.724 INFO:teuthology.orchestra.run.smithi045.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-11-28T18:33:26.724 INFO:teuthology.orchestra.run.smithi045.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-11-28T18:33:26.724 INFO:teuthology.orchestra.run.smithi045.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-11-28T18:33:26.725 INFO:teuthology.orchestra.run.smithi045.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2023-11-28T18:33:26.726 INFO:teuthology.orchestra.run.smithi045.stdout:Suggested packages: 2023-11-28T18:33:26.727 INFO:teuthology.orchestra.run.smithi045.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2023-11-28T18:33:26.727 INFO:teuthology.orchestra.run.smithi045.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2023-11-28T18:33:26.727 INFO:teuthology.orchestra.run.smithi045.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2023-11-28T18:33:26.727 INFO:teuthology.orchestra.run.smithi045.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2023-11-28T18:33:26.727 INFO:teuthology.orchestra.run.smithi045.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2023-11-28T18:33:26.727 INFO:teuthology.orchestra.run.smithi045.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-11-28T18:33:26.728 INFO:teuthology.orchestra.run.smithi045.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2023-11-28T18:33:26.728 INFO:teuthology.orchestra.run.smithi045.stdout:Recommended packages: 2023-11-28T18:33:26.728 INFO:teuthology.orchestra.run.smithi045.stdout: btrfs-tools 2023-11-28T18:33:26.820 INFO:teuthology.orchestra.run.smithi190.stdout:The following NEW packages will be installed: 2023-11-28T18:33:26.820 INFO:teuthology.orchestra.run.smithi190.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-11-28T18:33:26.820 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-11-28T18:33:26.820 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-11-28T18:33:26.820 INFO:teuthology.orchestra.run.smithi190.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-11-28T18:33:26.820 INFO:teuthology.orchestra.run.smithi190.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2023-11-28T18:33:26.820 INFO:teuthology.orchestra.run.smithi190.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-11-28T18:33:26.820 INFO:teuthology.orchestra.run.smithi190.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2023-11-28T18:33:26.820 INFO:teuthology.orchestra.run.smithi190.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2023-11-28T18:33:26.822 INFO:teuthology.orchestra.run.smithi190.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2023-11-28T18:33:26.822 INFO:teuthology.orchestra.run.smithi190.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-11-28T18:33:26.822 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-11-28T18:33:26.822 INFO:teuthology.orchestra.run.smithi190.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-11-28T18:33:26.822 INFO:teuthology.orchestra.run.smithi190.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-11-28T18:33:26.822 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-11-28T18:33:26.822 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-11-28T18:33:26.822 INFO:teuthology.orchestra.run.smithi190.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-11-28T18:33:26.822 INFO:teuthology.orchestra.run.smithi190.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-11-28T18:33:26.823 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-11-28T18:33:26.823 INFO:teuthology.orchestra.run.smithi190.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-11-28T18:33:26.823 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-11-28T18:33:26.823 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-11-28T18:33:26.823 INFO:teuthology.orchestra.run.smithi190.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-11-28T18:33:26.823 INFO:teuthology.orchestra.run.smithi190.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-11-28T18:33:26.823 INFO:teuthology.orchestra.run.smithi190.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-11-28T18:33:26.823 INFO:teuthology.orchestra.run.smithi190.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-11-28T18:33:26.823 INFO:teuthology.orchestra.run.smithi190.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-11-28T18:33:26.823 INFO:teuthology.orchestra.run.smithi190.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-11-28T18:33:26.824 INFO:teuthology.orchestra.run.smithi190.stdout: socat unzip xmlstarlet zip 2023-11-28T18:33:26.874 INFO:teuthology.orchestra.run.smithi045.stdout:The following NEW packages will be installed: 2023-11-28T18:33:26.874 INFO:teuthology.orchestra.run.smithi045.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-11-28T18:33:26.874 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-11-28T18:33:26.874 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-11-28T18:33:26.875 INFO:teuthology.orchestra.run.smithi045.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-11-28T18:33:26.875 INFO:teuthology.orchestra.run.smithi045.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2023-11-28T18:33:26.875 INFO:teuthology.orchestra.run.smithi045.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-11-28T18:33:26.875 INFO:teuthology.orchestra.run.smithi045.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2023-11-28T18:33:26.876 INFO:teuthology.orchestra.run.smithi045.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2023-11-28T18:33:26.876 INFO:teuthology.orchestra.run.smithi045.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2023-11-28T18:33:26.876 INFO:teuthology.orchestra.run.smithi045.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-11-28T18:33:26.877 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-11-28T18:33:26.877 INFO:teuthology.orchestra.run.smithi045.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-11-28T18:33:26.877 INFO:teuthology.orchestra.run.smithi045.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-11-28T18:33:26.878 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-11-28T18:33:26.878 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-11-28T18:33:26.878 INFO:teuthology.orchestra.run.smithi045.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-11-28T18:33:26.878 INFO:teuthology.orchestra.run.smithi045.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-11-28T18:33:26.878 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-11-28T18:33:26.878 INFO:teuthology.orchestra.run.smithi045.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-11-28T18:33:26.878 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-11-28T18:33:26.878 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-11-28T18:33:26.878 INFO:teuthology.orchestra.run.smithi045.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-11-28T18:33:26.878 INFO:teuthology.orchestra.run.smithi045.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-11-28T18:33:26.878 INFO:teuthology.orchestra.run.smithi045.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-11-28T18:33:26.879 INFO:teuthology.orchestra.run.smithi045.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-11-28T18:33:26.879 INFO:teuthology.orchestra.run.smithi045.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-11-28T18:33:26.879 INFO:teuthology.orchestra.run.smithi045.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-11-28T18:33:26.879 INFO:teuthology.orchestra.run.smithi045.stdout: socat unzip xmlstarlet zip 2023-11-28T18:33:27.021 INFO:teuthology.orchestra.run.smithi190.stdout:0 upgraded, 124 newly installed, 0 to remove and 264 not upgraded. 2023-11-28T18:33:27.021 INFO:teuthology.orchestra.run.smithi190.stdout:Need to get 187 MB of archives. 2023-11-28T18:33:27.021 INFO:teuthology.orchestra.run.smithi190.stdout:After this operation, 835 MB of additional disk space will be used. 2023-11-28T18:33:27.021 INFO:teuthology.orchestra.run.smithi190.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-11-28T18:33:27.026 INFO:teuthology.orchestra.run.smithi045.stdout:0 upgraded, 124 newly installed, 0 to remove and 264 not upgraded. 2023-11-28T18:33:27.026 INFO:teuthology.orchestra.run.smithi045.stdout:Need to get 187 MB of archives. 2023-11-28T18:33:27.026 INFO:teuthology.orchestra.run.smithi045.stdout:After this operation, 835 MB of additional disk space will be used. 2023-11-28T18:33:27.027 INFO:teuthology.orchestra.run.smithi045.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-7531-g47c1c547-1jammy [3,466 kB] 2023-11-28T18:33:27.074 INFO:teuthology.orchestra.run.smithi045.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-11-28T18:33:27.103 INFO:teuthology.orchestra.run.smithi190.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-11-28T18:33:27.149 INFO:teuthology.orchestra.run.smithi190.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-11-28T18:33:27.155 INFO:teuthology.orchestra.run.smithi045.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-11-28T18:33:27.171 INFO:teuthology.orchestra.run.smithi190.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-7531-g47c1c547-1jammy [3,466 kB] 2023-11-28T18:33:27.200 INFO:teuthology.orchestra.run.smithi045.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-11-28T18:33:27.255 INFO:teuthology.orchestra.run.smithi045.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-7531-g47c1c547-1jammy [3,111 kB] 2023-11-28T18:33:27.353 INFO:teuthology.orchestra.run.smithi045.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-7531-g47c1c547-1jammy [690 kB] 2023-11-28T18:33:27.355 INFO:teuthology.orchestra.run.smithi190.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-11-28T18:33:27.377 INFO:teuthology.orchestra.run.smithi045.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-7531-g47c1c547-1jammy [356 kB] 2023-11-28T18:33:27.394 INFO:teuthology.orchestra.run.smithi045.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-7531-g47c1c547-1jammy [32.8 kB] 2023-11-28T18:33:27.395 INFO:teuthology.orchestra.run.smithi045.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-7531-g47c1c547-1jammy [180 kB] 2023-11-28T18:33:27.401 INFO:teuthology.orchestra.run.smithi045.stdout:Get:10 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-7531-g47c1c547-1jammy [63.5 kB] 2023-11-28T18:33:27.403 INFO:teuthology.orchestra.run.smithi045.stdout:Get:11 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-7531-g47c1c547-1jammy [330 kB] 2023-11-28T18:33:27.405 INFO:teuthology.orchestra.run.smithi045.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-11-28T18:33:27.414 INFO:teuthology.orchestra.run.smithi045.stdout:Get:13 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-7531-g47c1c547-1jammy [6,233 kB] 2023-11-28T18:33:27.454 INFO:teuthology.orchestra.run.smithi190.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-11-28T18:33:27.468 INFO:teuthology.orchestra.run.smithi190.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-11-28T18:33:27.505 INFO:teuthology.orchestra.run.smithi045.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-11-28T18:33:27.518 INFO:teuthology.orchestra.run.smithi045.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-11-28T18:33:27.520 INFO:teuthology.orchestra.run.smithi190.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-11-28T18:33:27.571 INFO:teuthology.orchestra.run.smithi045.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-11-28T18:33:27.647 INFO:teuthology.orchestra.run.smithi045.stdout:Get:17 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-7531-g47c1c547-1jammy [112 kB] 2023-11-28T18:33:27.649 INFO:teuthology.orchestra.run.smithi045.stdout:Get:18 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-7531-g47c1c547-1jammy [439 kB] 2023-11-28T18:33:27.664 INFO:teuthology.orchestra.run.smithi045.stdout:Get:19 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-7531-g47c1c547-1jammy [22.6 MB] 2023-11-28T18:33:27.695 INFO:teuthology.orchestra.run.smithi190.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-11-28T18:33:27.705 INFO:teuthology.orchestra.run.smithi190.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-11-28T18:33:27.732 INFO:teuthology.orchestra.run.smithi190.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-11-28T18:33:27.740 INFO:teuthology.orchestra.run.smithi190.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-11-28T18:33:27.745 INFO:teuthology.orchestra.run.smithi045.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-11-28T18:33:27.754 INFO:teuthology.orchestra.run.smithi045.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-11-28T18:33:27.782 INFO:teuthology.orchestra.run.smithi045.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-11-28T18:33:27.794 INFO:teuthology.orchestra.run.smithi045.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-11-28T18:33:27.940 INFO:teuthology.orchestra.run.smithi190.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-11-28T18:33:27.958 INFO:teuthology.orchestra.run.smithi045.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-11-28T18:33:28.479 INFO:teuthology.orchestra.run.smithi045.stdout:Get:25 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-7531-g47c1c547-1jammy [6,900 kB] 2023-11-28T18:33:28.525 INFO:teuthology.orchestra.run.smithi190.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2023-11-28T18:33:28.541 INFO:teuthology.orchestra.run.smithi190.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2023-11-28T18:33:28.543 INFO:teuthology.orchestra.run.smithi045.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2023-11-28T18:33:28.556 INFO:teuthology.orchestra.run.smithi190.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2023-11-28T18:33:28.557 INFO:teuthology.orchestra.run.smithi045.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2023-11-28T18:33:28.565 INFO:teuthology.orchestra.run.smithi190.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2023-11-28T18:33:28.566 INFO:teuthology.orchestra.run.smithi190.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2023-11-28T18:33:28.573 INFO:teuthology.orchestra.run.smithi045.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2023-11-28T18:33:28.582 INFO:teuthology.orchestra.run.smithi045.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2023-11-28T18:33:28.582 INFO:teuthology.orchestra.run.smithi045.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2023-11-28T18:33:28.583 INFO:teuthology.orchestra.run.smithi190.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.1 [174 kB] 2023-11-28T18:33:28.599 INFO:teuthology.orchestra.run.smithi045.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.1 [174 kB] 2023-11-28T18:33:28.619 INFO:teuthology.orchestra.run.smithi190.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2023-11-28T18:33:28.632 INFO:teuthology.orchestra.run.smithi190.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-11-28T18:33:28.636 INFO:teuthology.orchestra.run.smithi190.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-11-28T18:33:28.637 INFO:teuthology.orchestra.run.smithi190.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-11-28T18:33:28.637 INFO:teuthology.orchestra.run.smithi045.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2023-11-28T18:33:28.650 INFO:teuthology.orchestra.run.smithi045.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-11-28T18:33:28.653 INFO:teuthology.orchestra.run.smithi045.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-11-28T18:33:28.654 INFO:teuthology.orchestra.run.smithi045.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-11-28T18:33:28.657 INFO:teuthology.orchestra.run.smithi190.stdout:Get:24 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-7531-g47c1c547-1jammy [3,111 kB] 2023-11-28T18:33:28.714 INFO:teuthology.orchestra.run.smithi045.stdout:Get:36 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-7531-g47c1c547-1jammy [238 kB] 2023-11-28T18:33:28.722 INFO:teuthology.orchestra.run.smithi045.stdout:Get:37 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-7531-g47c1c547-1jammy [124 kB] 2023-11-28T18:33:28.726 INFO:teuthology.orchestra.run.smithi045.stdout:Get:38 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-7531-g47c1c547-1jammy [1,496 kB] 2023-11-28T18:33:28.775 INFO:teuthology.orchestra.run.smithi045.stdout:Get:39 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-7531-g47c1c547-1jammy [9,957 kB] 2023-11-28T18:33:28.808 INFO:teuthology.orchestra.run.smithi190.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-11-28T18:33:28.825 INFO:teuthology.orchestra.run.smithi045.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-11-28T18:33:28.890 INFO:teuthology.orchestra.run.smithi190.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-11-28T18:33:28.908 INFO:teuthology.orchestra.run.smithi045.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-11-28T18:33:28.908 INFO:teuthology.orchestra.run.smithi190.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-11-28T18:33:28.914 INFO:teuthology.orchestra.run.smithi045.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-11-28T18:33:28.972 INFO:teuthology.orchestra.run.smithi190.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-11-28T18:33:28.989 INFO:teuthology.orchestra.run.smithi045.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-11-28T18:33:29.008 INFO:teuthology.orchestra.run.smithi190.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-11-28T18:33:29.015 INFO:teuthology.orchestra.run.smithi045.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-11-28T18:33:29.028 INFO:teuthology.orchestra.run.smithi190.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-11-28T18:33:29.031 INFO:teuthology.orchestra.run.smithi045.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-11-28T18:33:29.057 INFO:teuthology.orchestra.run.smithi190.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-11-28T18:33:29.070 INFO:teuthology.orchestra.run.smithi045.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-11-28T18:33:29.134 INFO:teuthology.orchestra.run.smithi045.stdout:Get:47 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-7531-g47c1c547-1jammy [31.9 MB] 2023-11-28T18:33:29.228 INFO:teuthology.orchestra.run.smithi190.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-11-28T18:33:29.243 INFO:teuthology.orchestra.run.smithi190.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-11-28T18:33:29.243 INFO:teuthology.orchestra.run.smithi045.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-11-28T18:33:29.250 INFO:teuthology.orchestra.run.smithi190.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-11-28T18:33:29.255 INFO:teuthology.orchestra.run.smithi190.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-11-28T18:33:29.258 INFO:teuthology.orchestra.run.smithi045.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-11-28T18:33:29.264 INFO:teuthology.orchestra.run.smithi045.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-11-28T18:33:29.269 INFO:teuthology.orchestra.run.smithi045.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-11-28T18:33:29.440 INFO:teuthology.orchestra.run.smithi190.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-11-28T18:33:29.454 INFO:teuthology.orchestra.run.smithi045.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-11-28T18:33:29.522 INFO:teuthology.orchestra.run.smithi190.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-11-28T18:33:29.539 INFO:teuthology.orchestra.run.smithi045.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-11-28T18:33:29.540 INFO:teuthology.orchestra.run.smithi190.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-11-28T18:33:29.553 INFO:teuthology.orchestra.run.smithi045.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-11-28T18:33:29.723 INFO:teuthology.orchestra.run.smithi190.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-11-28T18:33:29.738 INFO:teuthology.orchestra.run.smithi045.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-11-28T18:33:29.775 INFO:teuthology.orchestra.run.smithi190.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-11-28T18:33:29.786 INFO:teuthology.orchestra.run.smithi190.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-11-28T18:33:29.789 INFO:teuthology.orchestra.run.smithi045.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-11-28T18:33:29.801 INFO:teuthology.orchestra.run.smithi045.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-11-28T18:33:29.907 INFO:teuthology.orchestra.run.smithi190.stdout:Get:42 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-7531-g47c1c547-1jammy [690 kB] 2023-11-28T18:33:29.945 INFO:teuthology.orchestra.run.smithi190.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-11-28T18:33:29.945 INFO:teuthology.orchestra.run.smithi190.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-11-28T18:33:29.950 INFO:teuthology.orchestra.run.smithi190.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-11-28T18:33:29.955 INFO:teuthology.orchestra.run.smithi190.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-11-28T18:33:29.960 INFO:teuthology.orchestra.run.smithi045.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-11-28T18:33:29.960 INFO:teuthology.orchestra.run.smithi045.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-11-28T18:33:29.965 INFO:teuthology.orchestra.run.smithi045.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-11-28T18:33:29.972 INFO:teuthology.orchestra.run.smithi045.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-11-28T18:33:29.972 INFO:teuthology.orchestra.run.smithi190.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-11-28T18:33:29.984 INFO:teuthology.orchestra.run.smithi045.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-11-28T18:33:30.154 INFO:teuthology.orchestra.run.smithi190.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-11-28T18:33:30.169 INFO:teuthology.orchestra.run.smithi045.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-11-28T18:33:30.214 INFO:teuthology.orchestra.run.smithi190.stdout:Get:49 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-7531-g47c1c547-1jammy [356 kB] 2023-11-28T18:33:30.277 INFO:teuthology.orchestra.run.smithi045.stdout:Get:64 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-7531-g47c1c547-1jammy [14.0 kB] 2023-11-28T18:33:30.278 INFO:teuthology.orchestra.run.smithi045.stdout:Get:65 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-7531-g47c1c547-1jammy [839 kB] 2023-11-28T18:33:30.296 INFO:teuthology.orchestra.run.smithi045.stdout:Get:66 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-7531-g47c1c547-1jammy [2,144 kB] 2023-11-28T18:33:30.365 INFO:teuthology.orchestra.run.smithi190.stdout:Get:50 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-7531-g47c1c547-1jammy [32.8 kB] 2023-11-28T18:33:30.373 INFO:teuthology.orchestra.run.smithi190.stdout:Get:51 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-7531-g47c1c547-1jammy [180 kB] 2023-11-28T18:33:30.373 INFO:teuthology.orchestra.run.smithi045.stdout:Get:67 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-7531-g47c1c547-1jammy [802 kB] 2023-11-28T18:33:30.401 INFO:teuthology.orchestra.run.smithi045.stdout:Get:68 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-7531-g47c1c547-1jammy [139 kB] 2023-11-28T18:33:30.406 INFO:teuthology.orchestra.run.smithi045.stdout:Get:69 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-7531-g47c1c547-1jammy [1,900 kB] 2023-11-28T18:33:30.418 INFO:teuthology.orchestra.run.smithi190.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2023-11-28T18:33:30.432 INFO:teuthology.orchestra.run.smithi045.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2023-11-28T18:33:30.445 INFO:teuthology.orchestra.run.smithi190.stdout:Get:53 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-7531-g47c1c547-1jammy [63.5 kB] 2023-11-28T18:33:30.471 INFO:teuthology.orchestra.run.smithi190.stdout:Get:54 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-7531-g47c1c547-1jammy [330 kB] 2023-11-28T18:33:30.474 INFO:teuthology.orchestra.run.smithi045.stdout:Get:71 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-7531-g47c1c547-1jammy [8,625 kB] 2023-11-28T18:33:30.553 INFO:teuthology.orchestra.run.smithi190.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-11-28T18:33:30.560 INFO:teuthology.orchestra.run.smithi045.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-11-28T18:33:30.596 INFO:teuthology.orchestra.run.smithi190.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-11-28T18:33:30.603 INFO:teuthology.orchestra.run.smithi045.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-11-28T18:33:30.629 INFO:teuthology.orchestra.run.smithi190.stdout:Get:57 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-7531-g47c1c547-1jammy [6,233 kB] 2023-11-28T18:33:30.686 INFO:teuthology.orchestra.run.smithi190.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-11-28T18:33:30.692 INFO:teuthology.orchestra.run.smithi045.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-11-28T18:33:30.695 INFO:teuthology.orchestra.run.smithi190.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-11-28T18:33:30.701 INFO:teuthology.orchestra.run.smithi045.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-11-28T18:33:30.710 INFO:teuthology.orchestra.run.smithi190.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-11-28T18:33:30.714 INFO:teuthology.orchestra.run.smithi045.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-11-28T18:33:30.751 INFO:teuthology.orchestra.run.smithi190.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-11-28T18:33:30.758 INFO:teuthology.orchestra.run.smithi045.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-11-28T18:33:30.781 INFO:teuthology.orchestra.run.smithi045.stdout:Get:78 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-7531-g47c1c547-1jammy [14.2 kB] 2023-11-28T18:33:30.781 INFO:teuthology.orchestra.run.smithi045.stdout:Get:79 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-7531-g47c1c547-1jammy [48.7 MB] 2023-11-28T18:33:31.016 INFO:teuthology.orchestra.run.smithi190.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-11-28T18:33:31.017 INFO:teuthology.orchestra.run.smithi045.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-11-28T18:33:31.018 INFO:teuthology.orchestra.run.smithi190.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-11-28T18:33:31.019 INFO:teuthology.orchestra.run.smithi045.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-11-28T18:33:31.019 INFO:teuthology.orchestra.run.smithi190.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-11-28T18:33:31.020 INFO:teuthology.orchestra.run.smithi045.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-11-28T18:33:31.183 INFO:teuthology.orchestra.run.smithi190.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-11-28T18:33:31.185 INFO:teuthology.orchestra.run.smithi045.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-11-28T18:33:31.526 INFO:teuthology.orchestra.run.smithi190.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-11-28T18:33:31.529 INFO:teuthology.orchestra.run.smithi045.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-11-28T18:33:31.927 INFO:teuthology.orchestra.run.smithi190.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-11-28T18:33:31.931 INFO:teuthology.orchestra.run.smithi045.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-11-28T18:33:31.937 INFO:teuthology.orchestra.run.smithi190.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-11-28T18:33:31.937 INFO:teuthology.orchestra.run.smithi190.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-11-28T18:33:31.940 INFO:teuthology.orchestra.run.smithi045.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-11-28T18:33:31.941 INFO:teuthology.orchestra.run.smithi045.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-11-28T18:33:32.007 INFO:teuthology.orchestra.run.smithi190.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-11-28T18:33:32.008 INFO:teuthology.orchestra.run.smithi190.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-11-28T18:33:32.008 INFO:teuthology.orchestra.run.smithi190.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-11-28T18:33:32.009 INFO:teuthology.orchestra.run.smithi190.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-11-28T18:33:32.010 INFO:teuthology.orchestra.run.smithi190.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-11-28T18:33:32.010 INFO:teuthology.orchestra.run.smithi045.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-11-28T18:33:32.011 INFO:teuthology.orchestra.run.smithi190.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-11-28T18:33:32.011 INFO:teuthology.orchestra.run.smithi045.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-11-28T18:33:32.012 INFO:teuthology.orchestra.run.smithi045.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-11-28T18:33:32.013 INFO:teuthology.orchestra.run.smithi045.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-11-28T18:33:32.014 INFO:teuthology.orchestra.run.smithi045.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-11-28T18:33:32.015 INFO:teuthology.orchestra.run.smithi045.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-11-28T18:33:32.179 INFO:teuthology.orchestra.run.smithi045.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-11-28T18:33:32.329 INFO:teuthology.orchestra.run.smithi190.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-11-28T18:33:32.382 INFO:teuthology.orchestra.run.smithi045.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-11-28T18:33:32.525 INFO:teuthology.orchestra.run.smithi045.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-7531-g47c1c547-1jammy [121 kB] 2023-11-28T18:33:32.526 INFO:teuthology.orchestra.run.smithi045.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-7531-g47c1c547-1jammy [225 kB] 2023-11-28T18:33:32.528 INFO:teuthology.orchestra.run.smithi045.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-7531-g47c1c547-1jammy [34.0 kB] 2023-11-28T18:33:32.528 INFO:teuthology.orchestra.run.smithi045.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-7531-g47c1c547-1jammy [23.4 kB] 2023-11-28T18:33:32.529 INFO:teuthology.orchestra.run.smithi045.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-7531-g47c1c547-1jammy [38.3 kB] 2023-11-28T18:33:32.529 INFO:teuthology.orchestra.run.smithi045.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-7531-g47c1c547-1jammy [12.3 MB] 2023-11-28T18:33:32.533 INFO:teuthology.orchestra.run.smithi190.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-11-28T18:33:32.697 INFO:teuthology.orchestra.run.smithi045.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-11-28T18:33:32.743 INFO:teuthology.orchestra.run.smithi045.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-11-28T18:33:32.770 INFO:teuthology.orchestra.run.smithi045.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-11-28T18:33:32.778 INFO:teuthology.orchestra.run.smithi045.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-11-28T18:33:32.825 INFO:teuthology.orchestra.run.smithi045.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-11-28T18:33:32.851 INFO:teuthology.orchestra.run.smithi045.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-11-28T18:33:32.852 INFO:teuthology.orchestra.run.smithi045.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2023-11-28T18:33:32.857 INFO:teuthology.orchestra.run.smithi190.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-11-28T18:33:32.860 INFO:teuthology.orchestra.run.smithi045.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2023-11-28T18:33:32.863 INFO:teuthology.orchestra.run.smithi045.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-11-28T18:33:32.903 INFO:teuthology.orchestra.run.smithi190.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-11-28T18:33:32.931 INFO:teuthology.orchestra.run.smithi190.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-11-28T18:33:32.940 INFO:teuthology.orchestra.run.smithi190.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-11-28T18:33:32.963 INFO:teuthology.orchestra.run.smithi045.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-7531-g47c1c547-1jammy [91.4 kB] 2023-11-28T18:33:32.986 INFO:teuthology.orchestra.run.smithi190.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-11-28T18:33:33.015 INFO:teuthology.orchestra.run.smithi190.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-11-28T18:33:33.015 INFO:teuthology.orchestra.run.smithi190.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2023-11-28T18:33:33.020 INFO:teuthology.orchestra.run.smithi190.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2023-11-28T18:33:33.024 INFO:teuthology.orchestra.run.smithi190.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-11-28T18:33:33.059 INFO:teuthology.orchestra.run.smithi045.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2023-11-28T18:33:33.122 INFO:teuthology.orchestra.run.smithi190.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-7531-g47c1c547-1jammy [112 kB] 2023-11-28T18:33:33.123 INFO:teuthology.orchestra.run.smithi190.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-7531-g47c1c547-1jammy [439 kB] 2023-11-28T18:33:33.204 INFO:teuthology.orchestra.run.smithi190.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-7531-g47c1c547-1jammy [22.6 MB] 2023-11-28T18:33:33.223 INFO:teuthology.orchestra.run.smithi190.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2023-11-28T18:33:33.316 INFO:teuthology.orchestra.run.smithi045.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-11-28T18:33:33.478 INFO:teuthology.orchestra.run.smithi190.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-11-28T18:33:33.578 INFO:teuthology.orchestra.run.smithi045.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-11-28T18:33:33.580 INFO:teuthology.orchestra.run.smithi045.stdout:Get:115 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-11-28T18:33:33.596 INFO:teuthology.orchestra.run.smithi045.stdout:Get:116 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-11-28T18:33:33.602 INFO:teuthology.orchestra.run.smithi045.stdout:Get:117 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-11-28T18:33:33.639 INFO:teuthology.orchestra.run.smithi045.stdout:Get:118 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-11-28T18:33:33.653 INFO:teuthology.orchestra.run.smithi045.stdout:Get:119 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-11-28T18:33:33.739 INFO:teuthology.orchestra.run.smithi190.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-11-28T18:33:33.742 INFO:teuthology.orchestra.run.smithi190.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-11-28T18:33:33.744 INFO:teuthology.orchestra.run.smithi045.stdout:Get:120 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-11-28T18:33:33.745 INFO:teuthology.orchestra.run.smithi045.stdout:Get:121 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-11-28T18:33:33.746 INFO:teuthology.orchestra.run.smithi045.stdout:Get:122 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-11-28T18:33:33.758 INFO:teuthology.orchestra.run.smithi190.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-11-28T18:33:33.763 INFO:teuthology.orchestra.run.smithi190.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-11-28T18:33:33.800 INFO:teuthology.orchestra.run.smithi190.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-11-28T18:33:33.817 INFO:teuthology.orchestra.run.smithi190.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-11-28T18:33:33.907 INFO:teuthology.orchestra.run.smithi190.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-11-28T18:33:33.908 INFO:teuthology.orchestra.run.smithi190.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-11-28T18:33:33.910 INFO:teuthology.orchestra.run.smithi190.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-11-28T18:33:33.927 INFO:teuthology.orchestra.run.smithi045.stdout:Get:123 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-11-28T18:33:34.090 INFO:teuthology.orchestra.run.smithi190.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-11-28T18:33:34.189 INFO:teuthology.orchestra.run.smithi045.stdout:Get:124 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-11-28T18:33:34.355 INFO:teuthology.orchestra.run.smithi190.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-11-28T18:33:35.322 INFO:teuthology.orchestra.run.smithi045.stdout:Fetched 187 MB in 8s (24.1 MB/s) 2023-11-28T18:33:35.477 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-pyperclip. 2023-11-28T18:33:35.548 INFO:teuthology.orchestra.run.smithi045.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132930 files and directories currently installed.) 2023-11-28T18:33:35.552 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-11-28T18:33:35.592 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-11-28T18:33:35.928 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-wcwidth. 2023-11-28T18:33:35.942 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-11-28T18:33:35.986 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-28T18:33:36.272 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-cmd2. 2023-11-28T18:33:36.286 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-11-28T18:33:36.322 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-11-28T18:33:36.563 INFO:teuthology.orchestra.run.smithi190.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-7531-g47c1c547-1jammy [6,900 kB] 2023-11-28T18:33:36.633 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-11-28T18:33:36.648 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-11-28T18:33:36.717 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-28T18:33:37.103 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-11-28T18:33:37.119 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-11-28T18:33:37.161 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-28T18:33:37.427 INFO:teuthology.orchestra.run.smithi190.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-7531-g47c1c547-1jammy [238 kB] 2023-11-28T18:33:37.459 INFO:teuthology.orchestra.run.smithi190.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-7531-g47c1c547-1jammy [124 kB] 2023-11-28T18:33:37.463 INFO:teuthology.orchestra.run.smithi190.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-7531-g47c1c547-1jammy [1,496 kB] 2023-11-28T18:33:37.498 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-11-28T18:33:37.513 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-11-28T18:33:37.556 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-28T18:33:37.642 INFO:teuthology.orchestra.run.smithi190.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-7531-g47c1c547-1jammy [9,957 kB] 2023-11-28T18:33:38.018 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-11-28T18:33:38.034 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-28T18:33:38.076 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T18:33:38.454 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-11-28T18:33:38.469 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-28T18:33:38.512 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T18:33:38.792 INFO:teuthology.orchestra.run.smithi190.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-7531-g47c1c547-1jammy [31.9 MB] 2023-11-28T18:33:38.848 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-11-28T18:33:38.864 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-28T18:33:38.906 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T18:33:39.235 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-11-28T18:33:39.250 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-11-28T18:33:39.293 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-28T18:33:39.554 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package librados2. 2023-11-28T18:33:39.569 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../010-librados2_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T18:33:39.603 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking librados2 (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:33:40.023 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package librbd1. 2023-11-28T18:33:40.038 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../011-librbd1_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T18:33:40.081 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking librbd1 (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:33:40.484 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libcephfs2. 2023-11-28T18:33:40.499 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T18:33:40.542 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libcephfs2 (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:33:40.844 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-rados. 2023-11-28T18:33:40.860 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../013-python3-rados_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T18:33:40.902 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-rados (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:33:41.188 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-11-28T18:33:41.204 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-11-28T18:33:41.239 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-ceph-argparse (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:33:41.457 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-cephfs. 2023-11-28T18:33:41.472 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T18:33:41.515 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-cephfs (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:33:41.846 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-ceph-common. 2023-11-28T18:33:41.858 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-11-28T18:33:41.902 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-ceph-common (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:33:42.213 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-prettytable. 2023-11-28T18:33:42.228 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2023-11-28T18:33:42.247 INFO:teuthology.orchestra.run.smithi190.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-7531-g47c1c547-1jammy [14.0 kB] 2023-11-28T18:33:42.247 INFO:teuthology.orchestra.run.smithi190.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-7531-g47c1c547-1jammy [839 kB] 2023-11-28T18:33:42.271 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-11-28T18:33:42.391 INFO:teuthology.orchestra.run.smithi190.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-7531-g47c1c547-1jammy [2,144 kB] 2023-11-28T18:33:42.532 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-rbd. 2023-11-28T18:33:42.547 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T18:33:42.590 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-rbd (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:33:42.729 INFO:teuthology.orchestra.run.smithi190.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-7531-g47c1c547-1jammy [802 kB] 2023-11-28T18:33:42.828 INFO:teuthology.orchestra.run.smithi190.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-7531-g47c1c547-1jammy [139 kB] 2023-11-28T18:33:42.852 INFO:teuthology.orchestra.run.smithi190.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-7531-g47c1c547-1jammy [1,900 kB] 2023-11-28T18:33:43.072 INFO:teuthology.orchestra.run.smithi190.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-7531-g47c1c547-1jammy [8,625 kB] 2023-11-28T18:33:43.151 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-11-28T18:33:43.166 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-11-28T18:33:43.218 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-28T18:33:43.512 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libreadline-dev:amd64. 2023-11-28T18:33:43.527 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2023-11-28T18:33:43.570 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2023-11-28T18:33:43.915 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2023-11-28T18:33:43.930 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2023-11-28T18:33:43.973 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2023-11-28T18:33:44.088 INFO:teuthology.orchestra.run.smithi190.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-7531-g47c1c547-1jammy [14.2 kB] 2023-11-28T18:33:44.088 INFO:teuthology.orchestra.run.smithi190.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-7531-g47c1c547-1jammy [48.7 MB] 2023-11-28T18:33:44.276 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package lua5.1. 2023-11-28T18:33:44.292 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2023-11-28T18:33:44.326 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2023-11-28T18:33:44.620 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package lua-any. 2023-11-28T18:33:44.636 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2023-11-28T18:33:44.679 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking lua-any (27ubuntu1) ... 2023-11-28T18:33:44.956 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package zip. 2023-11-28T18:33:44.971 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2023-11-28T18:33:45.014 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking zip (3.0-12build2) ... 2023-11-28T18:33:45.334 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package unzip. 2023-11-28T18:33:45.349 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.1_amd64.deb ... 2023-11-28T18:33:45.392 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking unzip (6.0-26ubuntu3.1) ... 2023-11-28T18:33:45.795 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package luarocks. 2023-11-28T18:33:45.811 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2023-11-28T18:33:45.845 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2023-11-28T18:33:46.211 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package librgw2. 2023-11-28T18:33:46.225 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../027-librgw2_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T18:33:46.269 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking librgw2 (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:33:46.746 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-rgw. 2023-11-28T18:33:46.762 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../028-python3-rgw_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T18:33:46.804 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-rgw (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:33:47.132 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package liboath0:amd64. 2023-11-28T18:33:47.148 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2023-11-28T18:33:47.190 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-11-28T18:33:47.477 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libradosstriper1. 2023-11-28T18:33:47.492 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../030-libradosstriper1_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T18:33:47.527 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libradosstriper1 (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:33:47.913 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-common. 2023-11-28T18:33:47.928 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../031-ceph-common_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T18:33:47.971 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-common (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:33:49.059 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-base. 2023-11-28T18:33:49.075 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../032-ceph-base_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T18:33:49.127 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-base (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:33:49.821 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-11-28T18:33:49.836 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-11-28T18:33:49.880 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-11-28T18:33:50.132 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-cheroot. 2023-11-28T18:33:50.147 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-11-28T18:33:50.182 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-28T18:33:50.460 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-11-28T18:33:50.475 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-11-28T18:33:50.510 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-11-28T18:33:50.812 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-jaraco.text. 2023-11-28T18:33:50.828 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2023-11-28T18:33:50.871 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-11-28T18:33:51.173 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-11-28T18:33:51.189 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-11-28T18:33:51.232 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-11-28T18:33:51.518 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-tempora. 2023-11-28T18:33:51.534 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2023-11-28T18:33:51.568 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-11-28T18:33:51.837 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-portend. 2023-11-28T18:33:51.852 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2023-11-28T18:33:51.887 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-11-28T18:33:52.181 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-11-28T18:33:52.197 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2023-11-28T18:33:52.239 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-11-28T18:33:52.542 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-cherrypy3. 2023-11-28T18:33:52.558 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2023-11-28T18:33:52.600 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-11-28T18:33:52.970 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-natsort. 2023-11-28T18:33:52.986 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2023-11-28T18:33:53.229 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-11-28T18:33:53.515 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-logutils. 2023-11-28T18:33:53.530 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2023-11-28T18:33:53.565 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-11-28T18:33:53.706 INFO:teuthology.orchestra.run.smithi190.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-7531-g47c1c547-1jammy [121 kB] 2023-11-28T18:33:53.708 INFO:teuthology.orchestra.run.smithi190.stdout:Get:119 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-7531-g47c1c547-1jammy [225 kB] 2023-11-28T18:33:53.746 INFO:teuthology.orchestra.run.smithi190.stdout:Get:120 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-7531-g47c1c547-1jammy [34.0 kB] 2023-11-28T18:33:53.760 INFO:teuthology.orchestra.run.smithi190.stdout:Get:121 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-7531-g47c1c547-1jammy [23.4 kB] 2023-11-28T18:33:53.761 INFO:teuthology.orchestra.run.smithi190.stdout:Get:122 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-7531-g47c1c547-1jammy [38.3 kB] 2023-11-28T18:33:53.778 INFO:teuthology.orchestra.run.smithi190.stdout:Get:123 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-7531-g47c1c547-1jammy [12.3 MB] 2023-11-28T18:33:53.859 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-markupsafe. 2023-11-28T18:33:53.875 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-11-28T18:33:53.917 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-11-28T18:33:54.220 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-mako. 2023-11-28T18:33:54.235 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-11-28T18:33:54.278 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-28T18:33:54.606 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-simplegeneric. 2023-11-28T18:33:54.622 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2023-11-28T18:33:54.681 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-11-28T18:33:54.984 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-singledispatch. 2023-11-28T18:33:55.000 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-11-28T18:33:55.042 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-11-28T18:33:55.328 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-webob. 2023-11-28T18:33:55.344 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-11-28T18:33:55.387 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-11-28T18:33:55.764 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-waitress. 2023-11-28T18:33:55.780 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-11-28T18:33:55.790 INFO:teuthology.orchestra.run.smithi190.stdout:Get:124 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-7531-g47c1c547-1jammy [91.4 kB] 2023-11-28T18:33:55.850 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-28T18:33:56.158 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-tempita. 2023-11-28T18:33:56.174 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-11-28T18:33:56.217 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-11-28T18:33:56.460 INFO:teuthology.orchestra.run.smithi190.stdout:Fetched 187 MB in 29s (6,455 kB/s) 2023-11-28T18:33:56.503 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-paste. 2023-11-28T18:33:56.519 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-11-28T18:33:56.561 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-11-28T18:33:56.588 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pyperclip. 2023-11-28T18:33:56.657 INFO:teuthology.orchestra.run.smithi190.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132930 files and directories currently installed.) 2023-11-28T18:33:56.660 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-11-28T18:33:56.712 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-11-28T18:33:56.889 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-11-28T18:33:56.904 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-11-28T18:33:56.947 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-11-28T18:33:57.014 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-wcwidth. 2023-11-28T18:33:57.029 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-11-28T18:33:57.064 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-28T18:33:57.250 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-pastedeploy. 2023-11-28T18:33:57.266 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2023-11-28T18:33:57.308 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-11-28T18:33:57.383 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-cmd2. 2023-11-28T18:33:57.397 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-11-28T18:33:57.434 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-11-28T18:33:57.629 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-webtest. 2023-11-28T18:33:57.645 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2023-11-28T18:33:57.679 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-11-28T18:33:57.770 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-11-28T18:33:57.783 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-11-28T18:33:57.854 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-28T18:33:57.965 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-pecan. 2023-11-28T18:33:57.981 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-11-28T18:33:58.024 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-11-28T18:33:58.140 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-11-28T18:33:58.153 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-11-28T18:33:58.190 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-28T18:33:58.361 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-certifi. 2023-11-28T18:33:58.377 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2023-11-28T18:33:58.420 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-11-28T18:33:58.547 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-11-28T18:33:58.561 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-11-28T18:33:58.602 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-28T18:33:58.747 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-idna. 2023-11-28T18:33:58.763 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2023-11-28T18:33:58.805 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-idna (3.3-1) ... 2023-11-28T18:33:59.021 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-11-28T18:33:59.035 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-28T18:33:59.087 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T18:33:59.116 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-urllib3. 2023-11-28T18:33:59.132 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2023-11-28T18:33:59.174 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-28T18:33:59.416 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-11-28T18:33:59.429 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-28T18:33:59.474 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T18:33:59.511 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-requests. 2023-11-28T18:33:59.527 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-11-28T18:33:59.603 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-28T18:33:59.844 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-11-28T18:33:59.857 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-28T18:33:59.902 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T18:34:00.247 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-11-28T18:34:00.260 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-11-28T18:34:00.305 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-28T18:34:00.581 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-werkzeug. 2023-11-28T18:34:00.597 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-11-28T18:34:00.616 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package librados2. 2023-11-28T18:34:00.630 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../010-librados2_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T18:34:00.639 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-28T18:34:00.699 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking librados2 (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:34:00.917 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-11-28T18:34:00.933 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-11-28T18:34:00.975 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-mgr-modules-core (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:34:01.119 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package librbd1. 2023-11-28T18:34:01.132 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../011-librbd1_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T18:34:01.182 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking librbd1 (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:34:01.363 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-11-28T18:34:01.378 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T18:34:01.421 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:34:01.707 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-bcrypt. 2023-11-28T18:34:01.715 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libcephfs2. 2023-11-28T18:34:01.723 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-11-28T18:34:01.728 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T18:34:01.765 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-11-28T18:34:01.771 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libcephfs2 (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:34:02.040 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-rados. 2023-11-28T18:34:02.054 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../013-python3-rados_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T18:34:02.076 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-openssl. 2023-11-28T18:34:02.092 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2023-11-28T18:34:02.098 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-rados (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:34:02.134 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-11-28T18:34:02.417 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-11-28T18:34:02.431 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-11-28T18:34:02.471 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-mgr. 2023-11-28T18:34:02.476 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-ceph-argparse (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:34:02.486 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../065-ceph-mgr_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T18:34:02.529 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-mgr (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:34:02.720 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-cephfs. 2023-11-28T18:34:02.734 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T18:34:02.803 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-cephfs (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:34:02.907 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-mon. 2023-11-28T18:34:02.922 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../066-ceph-mon_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T18:34:02.957 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-mon (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:34:03.073 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-ceph-common. 2023-11-28T18:34:03.086 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-11-28T18:34:03.131 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-ceph-common (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:34:03.442 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-prettytable. 2023-11-28T18:34:03.456 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2023-11-28T18:34:03.500 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-11-28T18:34:03.743 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-osd. 2023-11-28T18:34:03.758 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../067-ceph-osd_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T18:34:03.761 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-rbd. 2023-11-28T18:34:03.776 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T18:34:03.801 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-osd (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:34:03.844 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-rbd (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:34:04.172 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-11-28T18:34:04.187 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-11-28T18:34:04.222 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-28T18:34:04.491 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libreadline-dev:amd64. 2023-11-28T18:34:04.506 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2023-11-28T18:34:04.541 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2023-11-28T18:34:04.894 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2023-11-28T18:34:04.909 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2023-11-28T18:34:04.954 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph. 2023-11-28T18:34:04.961 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2023-11-28T18:34:04.970 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../068-ceph_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T18:34:05.013 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:34:05.341 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-fuse. 2023-11-28T18:34:05.356 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package lua5.1. 2023-11-28T18:34:05.356 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../069-ceph-fuse_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T18:34:05.371 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2023-11-28T18:34:05.398 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-fuse (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:34:05.422 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2023-11-28T18:34:05.742 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-mds. 2023-11-28T18:34:05.758 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../070-ceph-mds_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T18:34:05.792 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-mds (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:34:05.808 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package lua-any. 2023-11-28T18:34:05.823 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2023-11-28T18:34:05.867 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking lua-any (27ubuntu1) ... 2023-11-28T18:34:06.154 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package cephadm. 2023-11-28T18:34:06.169 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../071-cephadm_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T18:34:06.177 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package zip. 2023-11-28T18:34:06.192 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2023-11-28T18:34:06.212 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking cephadm (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:34:06.244 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking zip (3.0-12build2) ... 2023-11-28T18:34:06.523 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-asyncssh. 2023-11-28T18:34:06.539 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2023-11-28T18:34:06.622 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package unzip. 2023-11-28T18:34:06.637 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.1_amd64.deb ... 2023-11-28T18:34:06.639 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-11-28T18:34:06.689 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking unzip (6.0-26ubuntu3.1) ... 2023-11-28T18:34:06.950 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python-babel-localedata. 2023-11-28T18:34:06.966 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-11-28T18:34:07.008 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-28T18:34:07.176 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package luarocks. 2023-11-28T18:34:07.190 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2023-11-28T18:34:07.242 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2023-11-28T18:34:07.700 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package librgw2. 2023-11-28T18:34:07.713 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../027-librgw2_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T18:34:07.766 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking librgw2 (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:34:07.996 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-babel. 2023-11-28T18:34:08.011 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-11-28T18:34:08.054 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-11-28T18:34:08.269 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-rgw. 2023-11-28T18:34:08.283 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../028-python3-rgw_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T18:34:08.335 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-rgw (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:34:08.532 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-jinja2. 2023-11-28T18:34:08.547 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1_all.deb ... 2023-11-28T18:34:08.621 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-11-28T18:34:08.730 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package liboath0:amd64. 2023-11-28T18:34:08.744 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2023-11-28T18:34:08.796 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-11-28T18:34:08.976 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-11-28T18:34:08.992 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-11-28T18:34:09.034 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-mgr-cephadm (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:34:09.191 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libradosstriper1. 2023-11-28T18:34:09.206 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../030-libradosstriper1_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T18:34:09.257 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libradosstriper1 (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:34:09.363 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-repoze.lru. 2023-11-28T18:34:09.379 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2023-11-28T18:34:09.421 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-11-28T18:34:09.727 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-common. 2023-11-28T18:34:09.740 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-routes. 2023-11-28T18:34:09.741 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../031-ceph-common_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T18:34:09.756 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-11-28T18:34:09.785 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-common (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:34:09.790 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-11-28T18:34:10.126 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-11-28T18:34:10.142 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-11-28T18:34:10.226 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-mgr-dashboard (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:34:10.654 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-11-28T18:34:10.670 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-11-28T18:34:10.712 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-28T18:34:10.807 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-base. 2023-11-28T18:34:10.821 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../032-ceph-base_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T18:34:10.875 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-base (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:34:11.199 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-joblib. 2023-11-28T18:34:11.215 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-11-28T18:34:11.257 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-11-28T18:34:11.618 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-11-28T18:34:11.634 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-11-28T18:34:11.754 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-11-28T18:34:11.787 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-11-28T18:34:11.801 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-11-28T18:34:11.845 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-11-28T18:34:12.056 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-sklearn. 2023-11-28T18:34:12.072 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-11-28T18:34:12.115 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-28T18:34:12.131 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-cheroot. 2023-11-28T18:34:12.145 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-11-28T18:34:12.180 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-28T18:34:12.492 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-11-28T18:34:12.506 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-11-28T18:34:12.542 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-11-28T18:34:12.807 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-11-28T18:34:12.811 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-jaraco.text. 2023-11-28T18:34:12.822 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-11-28T18:34:12.826 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2023-11-28T18:34:12.865 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:34:12.870 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-11-28T18:34:13.155 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-11-28T18:34:13.170 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-11-28T18:34:13.214 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-11-28T18:34:13.541 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-tempora. 2023-11-28T18:34:13.558 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2023-11-28T18:34:13.600 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-11-28T18:34:13.835 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-cachetools. 2023-11-28T18:34:13.851 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2023-11-28T18:34:13.869 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-portend. 2023-11-28T18:34:13.884 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2023-11-28T18:34:13.892 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-11-28T18:34:13.919 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-11-28T18:34:14.246 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-pyasn1. 2023-11-28T18:34:14.249 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-11-28T18:34:14.262 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2023-11-28T18:34:14.263 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2023-11-28T18:34:14.304 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-11-28T18:34:14.305 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-11-28T18:34:14.650 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-cherrypy3. 2023-11-28T18:34:14.665 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2023-11-28T18:34:14.666 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-11-28T18:34:14.682 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-11-28T18:34:14.708 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-11-28T18:34:14.724 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-11-28T18:34:15.026 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-rsa. 2023-11-28T18:34:15.042 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2023-11-28T18:34:15.062 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-natsort. 2023-11-28T18:34:15.076 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-rsa (4.8-1) ... 2023-11-28T18:34:15.077 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2023-11-28T18:34:15.120 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-11-28T18:34:15.355 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-google-auth. 2023-11-28T18:34:15.371 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2023-11-28T18:34:15.413 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-11-28T18:34:15.431 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-logutils. 2023-11-28T18:34:15.446 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2023-11-28T18:34:15.510 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-11-28T18:34:15.758 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-11-28T18:34:15.774 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-11-28T18:34:15.816 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-28T18:34:15.817 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-markupsafe. 2023-11-28T18:34:15.832 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-11-28T18:34:15.875 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-11-28T18:34:16.127 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-websocket. 2023-11-28T18:34:16.143 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2023-11-28T18:34:16.170 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-mako. 2023-11-28T18:34:16.185 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-11-28T18:34:16.185 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-11-28T18:34:16.220 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-28T18:34:16.505 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-kubernetes. 2023-11-28T18:34:16.506 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-simplegeneric. 2023-11-28T18:34:16.521 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2023-11-28T18:34:16.522 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-11-28T18:34:16.588 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-28T18:34:16.589 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-11-28T18:34:16.875 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-singledispatch. 2023-11-28T18:34:16.890 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-11-28T18:34:16.933 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-11-28T18:34:17.245 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-webob. 2023-11-28T18:34:17.260 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-11-28T18:34:17.260 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-11-28T18:34:17.276 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-11-28T18:34:17.303 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-11-28T18:34:17.309 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:34:17.654 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libonig5:amd64. 2023-11-28T18:34:17.669 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-11-28T18:34:17.672 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-waitress. 2023-11-28T18:34:17.687 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-11-28T18:34:17.712 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-28T18:34:17.733 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-28T18:34:18.025 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-tempita. 2023-11-28T18:34:18.040 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-11-28T18:34:18.049 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libjq1:amd64. 2023-11-28T18:34:18.063 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-11-28T18:34:18.075 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-11-28T18:34:18.106 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-28T18:34:18.353 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-paste. 2023-11-28T18:34:18.359 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package jq. 2023-11-28T18:34:18.370 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-11-28T18:34:18.374 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-11-28T18:34:18.411 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-11-28T18:34:18.417 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-11-28T18:34:18.686 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package socat. 2023-11-28T18:34:18.702 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-11-28T18:34:18.739 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-11-28T18:34:18.745 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-11-28T18:34:18.754 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-11-28T18:34:18.797 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-11-28T18:34:19.023 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package xmlstarlet. 2023-11-28T18:34:19.039 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-11-28T18:34:19.058 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pastedeploy. 2023-11-28T18:34:19.073 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-11-28T18:34:19.073 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2023-11-28T18:34:19.117 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-11-28T18:34:19.402 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-webtest. 2023-11-28T18:34:19.417 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2023-11-28T18:34:19.418 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-test. 2023-11-28T18:34:19.433 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../099-ceph-test_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T18:34:19.469 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-11-28T18:34:19.476 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-test (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:34:19.813 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pecan. 2023-11-28T18:34:19.828 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-11-28T18:34:19.872 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-11-28T18:34:20.235 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-certifi. 2023-11-28T18:34:20.250 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2023-11-28T18:34:20.293 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-11-28T18:34:20.629 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-idna. 2023-11-28T18:34:20.644 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2023-11-28T18:34:20.679 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-idna (3.3-1) ... 2023-11-28T18:34:21.107 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-urllib3. 2023-11-28T18:34:21.121 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2023-11-28T18:34:21.165 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-28T18:34:21.289 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-volume. 2023-11-28T18:34:21.305 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../100-ceph-volume_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-11-28T18:34:21.347 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-volume (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:34:21.443 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-requests. 2023-11-28T18:34:21.458 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-11-28T18:34:21.501 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-28T18:34:21.734 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package cephfs-mirror. 2023-11-28T18:34:21.750 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../101-cephfs-mirror_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T18:34:21.792 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking cephfs-mirror (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:34:21.971 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-werkzeug. 2023-11-28T18:34:21.986 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-11-28T18:34:22.029 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-28T18:34:22.061 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-colorama. 2023-11-28T18:34:22.078 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2023-11-28T18:34:22.120 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-11-28T18:34:22.299 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-11-28T18:34:22.313 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-11-28T18:34:22.357 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-mgr-modules-core (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:34:22.372 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package cephfs-shell. 2023-11-28T18:34:22.388 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../103-cephfs-shell_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-11-28T18:34:22.430 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking cephfs-shell (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:34:22.716 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package cephfs-top. 2023-11-28T18:34:22.728 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-11-28T18:34:22.732 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../104-cephfs-top_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-11-28T18:34:22.743 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T18:34:22.774 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking cephfs-top (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:34:22.787 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:34:23.026 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libcephfs-dev. 2023-11-28T18:34:23.042 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../105-libcephfs-dev_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T18:34:23.085 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libcephfs-dev (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:34:23.089 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-bcrypt. 2023-11-28T18:34:23.103 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-11-28T18:34:23.139 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-11-28T18:34:23.379 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package lua-socket:amd64. 2023-11-28T18:34:23.395 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2023-11-28T18:34:23.429 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2023-11-28T18:34:23.433 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-openssl. 2023-11-28T18:34:23.448 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2023-11-28T18:34:23.491 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-11-28T18:34:23.783 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package lua-sec:amd64. 2023-11-28T18:34:23.799 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2023-11-28T18:34:23.819 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-mgr. 2023-11-28T18:34:23.835 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../065-ceph-mgr_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T18:34:23.841 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2023-11-28T18:34:23.887 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-mgr (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:34:24.281 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-mon. 2023-11-28T18:34:24.296 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../066-ceph-mon_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T18:34:24.339 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-mon (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:34:24.428 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package nvme-cli. 2023-11-28T18:34:24.444 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-11-28T18:34:24.486 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-11-28T18:34:24.908 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package pkg-config. 2023-11-28T18:34:24.923 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2023-11-28T18:34:24.966 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2023-11-28T18:34:25.084 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-osd. 2023-11-28T18:34:25.099 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../067-ceph-osd_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T18:34:25.142 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-osd (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:34:25.194 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-11-28T18:34:25.209 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-11-28T18:34:25.252 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-11-28T18:34:25.705 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-iniconfig. 2023-11-28T18:34:25.721 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2023-11-28T18:34:25.763 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-11-28T18:34:26.065 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-pastescript. 2023-11-28T18:34:26.082 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2023-11-28T18:34:26.123 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-11-28T18:34:26.320 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph. 2023-11-28T18:34:26.335 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../068-ceph_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T18:34:26.378 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:34:26.427 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-pluggy. 2023-11-28T18:34:26.443 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2023-11-28T18:34:26.518 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-11-28T18:34:26.698 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-fuse. 2023-11-28T18:34:26.712 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../069-ceph-fuse_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T18:34:26.756 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-fuse (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:34:26.813 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-psutil. 2023-11-28T18:34:26.829 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-11-28T18:34:26.863 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-11-28T18:34:27.126 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-mds. 2023-11-28T18:34:27.141 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../070-ceph-mds_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T18:34:27.165 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-py. 2023-11-28T18:34:27.182 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2023-11-28T18:34:27.183 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-mds (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:34:27.223 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-py (1.10.0-1) ... 2023-11-28T18:34:27.535 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-pygments. 2023-11-28T18:34:27.544 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package cephadm. 2023-11-28T18:34:27.551 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-11-28T18:34:27.559 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../071-cephadm_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T18:34:27.584 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-11-28T18:34:27.611 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking cephadm (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:34:27.922 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-asyncssh. 2023-11-28T18:34:27.938 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2023-11-28T18:34:27.981 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-11-28T18:34:28.005 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-pyinotify. 2023-11-28T18:34:28.021 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-11-28T18:34:28.055 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-11-28T18:34:28.308 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python-babel-localedata. 2023-11-28T18:34:28.323 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-11-28T18:34:28.349 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-toml. 2023-11-28T18:34:28.365 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2023-11-28T18:34:28.366 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-28T18:34:28.407 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-11-28T18:34:28.727 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-pytest. 2023-11-28T18:34:28.743 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-11-28T18:34:28.784 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-11-28T18:34:29.113 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-simplejson. 2023-11-28T18:34:29.128 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-11-28T18:34:29.171 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-11-28T18:34:29.379 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-babel. 2023-11-28T18:34:29.393 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-11-28T18:34:29.437 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-11-28T18:34:29.440 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-11-28T18:34:29.457 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-11-28T18:34:29.515 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-11-28T18:34:29.739 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-jinja2. 2023-11-28T18:34:29.754 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1_all.deb ... 2023-11-28T18:34:29.798 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-11-28T18:34:30.159 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-11-28T18:34:30.173 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-11-28T18:34:30.217 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-mgr-cephadm (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:34:30.252 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package radosgw. 2023-11-28T18:34:30.267 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../122-radosgw_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T18:34:30.310 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking radosgw (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:34:30.556 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-repoze.lru. 2023-11-28T18:34:30.570 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2023-11-28T18:34:30.614 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-11-28T18:34:30.896 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package rbd-fuse. 2023-11-28T18:34:30.900 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-routes. 2023-11-28T18:34:30.912 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../123-rbd-fuse_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T18:34:30.914 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-11-28T18:34:30.946 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking rbd-fuse (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:34:30.958 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-11-28T18:34:31.225 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-11-28T18:34:31.311 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-11-28T18:34:31.325 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-11-28T18:34:31.386 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-mgr-dashboard (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:34:31.485 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-28T18:34:31.643 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-11-28T18:34:31.806 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-11-28T18:34:31.820 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-11-28T18:34:31.864 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-28T18:34:31.912 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-11-28T18:34:32.339 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-11-28T18:34:32.342 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-joblib. 2023-11-28T18:34:32.356 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-11-28T18:34:32.426 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-11-28T18:34:32.762 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-11-28T18:34:32.776 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-11-28T18:34:32.898 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-11-28T18:34:32.974 INFO:teuthology.orchestra.run.smithi045.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-11-28T18:34:32.988 INFO:teuthology.orchestra.run.smithi045.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2023-11-28T18:34:33.046 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up cephadm (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:34:33.184 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-sklearn. 2023-11-28T18:34:33.197 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-11-28T18:34:33.242 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-28T18:34:33.692 INFO:teuthology.orchestra.run.smithi045.stdout:Adding system user cephadm....done 2023-11-28T18:34:33.843 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-11-28T18:34:33.857 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-11-28T18:34:33.892 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:34:34.160 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-28T18:34:34.445 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-11-28T18:34:34.746 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-11-28T18:34:34.837 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-cachetools. 2023-11-28T18:34:34.852 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2023-11-28T18:34:34.872 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-11-28T18:34:34.895 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-11-28T18:34:35.140 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-11-28T18:34:35.207 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pyasn1. 2023-11-28T18:34:35.223 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2023-11-28T18:34:35.265 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-11-28T18:34:35.408 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-11-28T18:34:35.559 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-py (1.10.0-1) ... 2023-11-28T18:34:35.618 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-11-28T18:34:35.634 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-11-28T18:34:35.676 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-11-28T18:34:35.886 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-11-28T18:34:35.970 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-rsa. 2023-11-28T18:34:35.986 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2023-11-28T18:34:36.029 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-rsa (4.8-1) ... 2023-11-28T18:34:36.271 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-11-28T18:34:36.316 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-google-auth. 2023-11-28T18:34:36.332 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2023-11-28T18:34:36.365 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-11-28T18:34:36.547 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-11-28T18:34:36.685 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-11-28T18:34:36.700 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-11-28T18:34:36.743 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-28T18:34:36.815 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-11-28T18:34:37.099 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up unzip (6.0-26ubuntu3.1) ... 2023-11-28T18:34:37.122 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-websocket. 2023-11-28T18:34:37.137 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2023-11-28T18:34:37.288 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-11-28T18:34:37.470 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-11-28T18:34:37.608 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-kubernetes. 2023-11-28T18:34:37.625 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-11-28T18:34:37.666 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-28T18:34:37.743 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-11-28T18:34:38.019 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-11-28T18:34:38.287 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-ceph-argparse (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:34:38.313 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-11-28T18:34:38.327 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-11-28T18:34:38.362 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:34:38.563 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-28T18:34:38.657 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libonig5:amd64. 2023-11-28T18:34:38.671 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-11-28T18:34:38.689 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2023-11-28T18:34:38.715 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-28T18:34:38.815 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-11-28T18:34:39.076 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libjq1:amd64. 2023-11-28T18:34:39.082 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2023-11-28T18:34:39.091 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-11-28T18:34:39.135 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-28T18:34:39.183 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-11-28T18:34:39.387 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package jq. 2023-11-28T18:34:39.402 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-11-28T18:34:39.446 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-11-28T18:34:39.584 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2023-11-28T18:34:39.698 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package socat. 2023-11-28T18:34:39.713 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-11-28T18:34:39.748 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-11-28T18:34:39.994 INFO:teuthology.orchestra.run.smithi045.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2023-11-28T18:34:40.023 INFO:teuthology.orchestra.run.smithi045.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2023-11-28T18:34:40.059 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package xmlstarlet. 2023-11-28T18:34:40.074 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-11-28T18:34:40.089 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-28T18:34:40.117 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-11-28T18:34:40.190 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-11-28T18:34:40.446 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-test. 2023-11-28T18:34:40.461 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../099-ceph-test_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T18:34:40.496 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-test (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:34:40.583 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-28T18:34:40.709 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-11-28T18:34:40.994 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-11-28T18:34:41.270 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-11-28T18:34:41.613 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up zip (3.0-12build2) ... 2023-11-28T18:34:41.747 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-11-28T18:34:42.334 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-volume. 2023-11-28T18:34:42.350 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../100-ceph-volume_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-11-28T18:34:42.393 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-volume (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:34:42.457 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-11-28T18:34:42.750 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-11-28T18:34:42.771 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package cephfs-mirror. 2023-11-28T18:34:42.787 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../101-cephfs-mirror_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T18:34:42.829 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking cephfs-mirror (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:34:42.876 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-11-28T18:34:43.002 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-28T18:34:43.183 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-colorama. 2023-11-28T18:34:43.198 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2023-11-28T18:34:43.240 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-11-28T18:34:43.311 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-11-28T18:34:43.484 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package cephfs-shell. 2023-11-28T18:34:43.500 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../103-cephfs-shell_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-11-28T18:34:43.542 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking cephfs-shell (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:34:43.721 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-11-28T18:34:43.803 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package cephfs-top. 2023-11-28T18:34:43.819 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../104-cephfs-top_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-11-28T18:34:43.853 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking cephfs-top (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:34:43.989 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-11-28T18:34:44.063 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libcephfs-dev. 2023-11-28T18:34:44.079 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../105-libcephfs-dev_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T18:34:44.122 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libcephfs-dev (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:34:44.390 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-28T18:34:44.458 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package lua-socket:amd64. 2023-11-28T18:34:44.474 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2023-11-28T18:34:44.516 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2023-11-28T18:34:44.758 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-11-28T18:34:44.862 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package lua-sec:amd64. 2023-11-28T18:34:44.877 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2023-11-28T18:34:44.920 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2023-11-28T18:34:45.084 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-28T18:34:45.307 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package nvme-cli. 2023-11-28T18:34:45.323 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-11-28T18:34:45.357 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-11-28T18:34:45.444 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-11-28T18:34:45.737 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-11-28T18:34:45.753 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package pkg-config. 2023-11-28T18:34:45.768 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2023-11-28T18:34:45.803 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2023-11-28T18:34:45.863 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-ceph-common (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:34:46.048 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-11-28T18:34:46.063 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-11-28T18:34:46.106 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-11-28T18:34:46.181 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-idna (3.3-1) ... 2023-11-28T18:34:46.509 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-iniconfig. 2023-11-28T18:34:46.524 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2023-11-28T18:34:46.540 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-28T18:34:46.567 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-11-28T18:34:46.870 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pastescript. 2023-11-28T18:34:46.885 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2023-11-28T18:34:46.928 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-11-28T18:34:47.231 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pluggy. 2023-11-28T18:34:47.246 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2023-11-28T18:34:47.290 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-11-28T18:34:47.626 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-psutil. 2023-11-28T18:34:47.641 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-11-28T18:34:47.684 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-11-28T18:34:47.854 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2023-11-28T18:34:48.003 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-py. 2023-11-28T18:34:48.019 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2023-11-28T18:34:48.062 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-py (1.10.0-1) ... 2023-11-28T18:34:48.082 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T18:34:48.190 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-toml (0.10.2-1) ... 2023-11-28T18:34:48.422 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pygments. 2023-11-28T18:34:48.437 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-11-28T18:34:48.481 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-11-28T18:34:48.503 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-28T18:34:48.634 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-11-28T18:34:48.752 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-28T18:34:48.918 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pyinotify. 2023-11-28T18:34:48.933 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-11-28T18:34:48.976 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-11-28T18:34:49.054 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-11-28T18:34:49.279 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-toml. 2023-11-28T18:34:49.293 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2023-11-28T18:34:49.321 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-11-28T18:34:49.337 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-11-28T18:34:49.598 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T18:34:49.665 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pytest. 2023-11-28T18:34:49.680 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-11-28T18:34:49.723 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-11-28T18:34:49.723 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-11-28T18:34:50.041 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-11-28T18:34:50.051 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-simplejson. 2023-11-28T18:34:50.066 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-11-28T18:34:50.110 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-11-28T18:34:50.309 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-11-28T18:34:50.379 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-11-28T18:34:50.394 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-11-28T18:34:50.437 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-11-28T18:34:50.585 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-11-28T18:34:50.861 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-11-28T18:34:51.116 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package radosgw. 2023-11-28T18:34:51.129 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-11-28T18:34:51.130 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../122-radosgw_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T18:34:51.165 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking radosgw (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:34:51.405 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-28T18:34:51.556 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-11-28T18:34:51.735 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package rbd-fuse. 2023-11-28T18:34:51.750 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../123-rbd-fuse_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T18:34:51.785 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking rbd-fuse (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:34:51.841 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-28T18:34:51.959 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-28T18:34:52.061 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-11-28T18:34:52.259 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-11-28T18:34:52.341 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-28T18:34:52.466 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-11-28T18:34:52.577 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-11-28T18:34:52.732 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-11-28T18:34:52.837 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2023-11-28T18:34:52.954 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2023-11-28T18:34:53.089 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-11-28T18:34:53.136 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-11-28T18:34:53.178 INFO:teuthology.orchestra.run.smithi045.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-11-28T18:34:53.461 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-28T18:34:53.583 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-11-28T18:34:53.728 INFO:teuthology.orchestra.run.smithi190.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-11-28T18:34:53.786 INFO:teuthology.orchestra.run.smithi190.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2023-11-28T18:34:53.834 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up cephadm (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:34:53.993 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-11-28T18:34:54.277 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up lua-any (27ubuntu1) ... 2023-11-28T18:34:54.354 INFO:teuthology.orchestra.run.smithi190.stdout:Adding system user cephadm....done 2023-11-28T18:34:54.405 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-portend (3.0.0-1) ... 2023-11-28T18:34:54.515 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-28T18:34:54.713 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T18:34:54.841 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-11-28T18:34:54.864 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-11-28T18:34:55.084 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-11-28T18:34:55.207 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-11-28T18:34:55.210 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-11-28T18:34:55.469 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-11-28T18:34:55.508 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-28T18:34:55.738 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-11-28T18:34:55.801 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-11-28T18:34:55.889 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-py (1.10.0-1) ... 2023-11-28T18:34:56.004 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-rsa (4.8-1) ... 2023-11-28T18:34:56.207 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-11-28T18:34:56.288 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-11-28T18:34:56.556 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-28T18:34:56.567 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-11-28T18:34:56.808 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-11-28T18:34:56.811 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-11-28T18:34:57.094 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-11-28T18:34:57.210 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-11-28T18:34:57.370 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up unzip (6.0-26ubuntu3.1) ... 2023-11-28T18:34:57.502 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-11-28T18:34:57.613 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-11-28T18:34:57.872 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-28T18:34:57.931 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-11-28T18:34:57.998 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up librados2 (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:34:58.124 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libsqlite3-mod-ceph (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:34:58.199 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-11-28T18:34:58.251 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2023-11-28T18:34:58.467 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-ceph-argparse (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:34:58.594 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libcephfs2 (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:34:58.704 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libradosstriper1 (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:34:58.726 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-28T18:34:58.827 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2023-11-28T18:34:58.830 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-11-28T18:34:58.928 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-11-28T18:34:59.123 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up librbd1 (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:34:59.220 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2023-11-28T18:34:59.233 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-mgr-modules-core (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:34:59.338 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-11-28T18:34:59.358 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-fuse (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:34:59.598 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2023-11-28T18:34:59.605 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-28T18:34:59.605 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-28T18:34:59.984 INFO:teuthology.orchestra.run.smithi190.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2023-11-28T18:35:00.034 INFO:teuthology.orchestra.run.smithi190.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2023-11-28T18:35:00.092 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-28T18:35:00.201 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-11-28T18:35:00.294 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libcephfs-dev (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:35:00.444 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-rados (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:35:00.545 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up librgw2 (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:35:00.561 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-28T18:35:00.671 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up cephfs-top (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:35:00.679 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-11-28T18:35:00.806 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-28T18:35:00.930 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-11-28T18:35:01.207 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-11-28T18:35:01.515 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up zip (3.0-12build2) ... 2023-11-28T18:35:01.641 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-11-28T18:35:02.151 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-rbd (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:35:02.268 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up rbd-fuse (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:35:02.327 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-11-28T18:35:02.403 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-rgw (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:35:02.512 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-cephfs (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:35:02.578 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-11-28T18:35:02.638 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up cephfs-shell (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:35:02.678 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-11-28T18:35:02.765 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-common (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:35:02.796 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-28T18:35:03.114 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-11-28T18:35:03.318 INFO:teuthology.orchestra.run.smithi045.stdout:Adding group ceph....done 2023-11-28T18:35:03.532 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-11-28T18:35:03.703 INFO:teuthology.orchestra.run.smithi045.stdout:Adding system user ceph....done 2023-11-28T18:35:03.792 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-11-28T18:35:03.889 INFO:teuthology.orchestra.run.smithi045.stdout:Setting system user ceph properties....done 2023-11-28T18:35:03.909 INFO:teuthology.orchestra.run.smithi045.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-11-28T18:35:04.060 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-11-28T18:35:04.176 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-28T18:35:04.479 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-11-28T18:35:04.502 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-11-28T18:35:04.829 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-28T18:35:05.172 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-11-28T18:35:05.173 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up cephfs-mirror (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:35:05.390 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-28T18:35:05.390 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-28T18:35:05.481 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-11-28T18:35:05.607 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-ceph-common (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:35:05.917 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-idna (3.3-1) ... 2023-11-28T18:35:06.067 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-test (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:35:06.193 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up radosgw (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:35:06.259 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-28T18:35:06.770 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-28T18:35:06.771 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-28T18:35:07.411 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-base (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:35:07.515 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2023-11-28T18:35:07.758 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T18:35:07.760 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-11-28T18:35:07.892 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-toml (0.10.2-1) ... 2023-11-28T18:35:08.168 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-28T18:35:08.278 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-11-28T18:35:08.379 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-28T18:35:08.454 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-mds (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:35:08.702 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-28T18:35:08.702 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-28T18:35:08.722 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-11-28T18:35:08.998 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-11-28T18:35:09.257 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T18:35:09.382 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-mgr (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:35:09.383 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-11-28T18:35:09.609 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-28T18:35:09.610 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-28T18:35:09.701 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-11-28T18:35:09.969 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-11-28T18:35:10.237 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-11-28T18:35:10.400 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-osd (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:35:10.488 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-11-28T18:35:10.729 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-28T18:35:10.730 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-28T18:35:10.772 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-11-28T18:35:11.048 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-28T18:35:11.174 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-11-28T18:35:11.393 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-mgr-k8sevents (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:35:11.467 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-28T18:35:11.519 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:35:11.593 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-28T18:35:13.277 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-mon (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:35:13.298 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-28T18:35:13.298 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-28T18:35:13.299 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-mgr-cephadm (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:35:13.299 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:35:13.299 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-mgr-dashboard (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:35:13.299 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-volume (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:35:13.299 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-11-28T18:35:13.299 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-11-28T18:35:13.299 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2023-11-28T18:35:13.300 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2023-11-28T18:35:13.300 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-11-28T18:35:13.300 INFO:teuthology.orchestra.run.smithi190.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-11-28T18:35:13.300 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-28T18:35:13.300 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-11-28T18:35:13.300 INFO:teuthology.orchestra.run.smithi045.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2023-11-28T18:35:13.428 INFO:teuthology.orchestra.run.smithi045.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-28T18:35:13.580 INFO:teuthology.orchestra.run.smithi045.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-28T18:35:13.644 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-11-28T18:35:13.903 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up lua-any (27ubuntu1) ... 2023-11-28T18:35:14.012 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-portend (3.0.0-1) ... 2023-11-28T18:35:14.280 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T18:35:14.414 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-11-28T18:35:14.741 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-11-28T18:35:14.765 INFO:teuthology.orchestra.run.smithi045.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-11-28T18:35:15.092 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-28T18:35:15.376 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-11-28T18:35:15.565 INFO:teuthology.orchestra.run.smithi045.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-28T18:35:15.569 DEBUG:teuthology.orchestra.run.smithi045:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-11-28T18:35:15.570 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-rsa (4.8-1) ... 2023-11-28T18:35:15.647 INFO:teuthology.orchestra.run.smithi045.stdout:Reading package lists... 2023-11-28T18:35:15.818 INFO:teuthology.orchestra.run.smithi045.stdout:Building dependency tree... 2023-11-28T18:35:15.819 INFO:teuthology.orchestra.run.smithi045.stdout:Reading state information... 2023-11-28T18:35:15.880 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-11-28T18:35:15.975 INFO:teuthology.orchestra.run.smithi045.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-11-28T18:35:15.975 INFO:teuthology.orchestra.run.smithi045.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-11-28T18:35:15.975 INFO:teuthology.orchestra.run.smithi045.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-11-28T18:35:15.975 INFO:teuthology.orchestra.run.smithi045.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-11-28T18:35:15.975 INFO:teuthology.orchestra.run.smithi045.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-11-28T18:35:15.975 INFO:teuthology.orchestra.run.smithi045.stdout:The following packages were automatically installed and are no longer required: 2023-11-28T18:35:15.975 INFO:teuthology.orchestra.run.smithi045.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-28T18:35:15.976 INFO:teuthology.orchestra.run.smithi045.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-28T18:35:15.976 INFO:teuthology.orchestra.run.smithi045.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-28T18:35:15.976 INFO:teuthology.orchestra.run.smithi045.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-28T18:35:15.977 INFO:teuthology.orchestra.run.smithi045.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-28T18:35:15.977 INFO:teuthology.orchestra.run.smithi045.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-28T18:35:15.977 INFO:teuthology.orchestra.run.smithi045.stdout:The following additional packages will be installed: 2023-11-28T18:35:15.977 INFO:teuthology.orchestra.run.smithi045.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-11-28T18:35:15.977 INFO:teuthology.orchestra.run.smithi045.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-11-28T18:35:15.977 INFO:teuthology.orchestra.run.smithi045.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-11-28T18:35:15.977 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-11-28T18:35:15.977 INFO:teuthology.orchestra.run.smithi045.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-28T18:35:15.978 INFO:teuthology.orchestra.run.smithi045.stdout:Suggested packages: 2023-11-28T18:35:15.978 INFO:teuthology.orchestra.run.smithi045.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-11-28T18:35:15.978 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-11-28T18:35:15.978 INFO:teuthology.orchestra.run.smithi045.stdout: libengine-pkcs11-openssl 2023-11-28T18:35:16.031 INFO:teuthology.orchestra.run.smithi045.stdout:The following NEW packages will be installed: 2023-11-28T18:35:16.031 INFO:teuthology.orchestra.run.smithi045.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-11-28T18:35:16.031 INFO:teuthology.orchestra.run.smithi045.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-11-28T18:35:16.032 INFO:teuthology.orchestra.run.smithi045.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-11-28T18:35:16.032 INFO:teuthology.orchestra.run.smithi045.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-11-28T18:35:16.032 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-11-28T18:35:16.032 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-11-28T18:35:16.032 INFO:teuthology.orchestra.run.smithi045.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-28T18:35:16.033 INFO:teuthology.orchestra.run.smithi045.stdout:The following packages will be upgraded: 2023-11-28T18:35:16.033 INFO:teuthology.orchestra.run.smithi045.stdout: libssl3 2023-11-28T18:35:16.097 INFO:teuthology.orchestra.run.smithi045.stdout:1 upgraded, 39 newly installed, 0 to remove and 263 not upgraded. 2023-11-28T18:35:16.097 INFO:teuthology.orchestra.run.smithi045.stdout:Need to get 54.6 MB of archives. 2023-11-28T18:35:16.097 INFO:teuthology.orchestra.run.smithi045.stdout:After this operation, 202 MB of additional disk space will be used. 2023-11-28T18:35:16.097 INFO:teuthology.orchestra.run.smithi045.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-11-28T18:35:16.158 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-28T18:35:16.236 INFO:teuthology.orchestra.run.smithi045.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2023-11-28T18:35:16.314 INFO:teuthology.orchestra.run.smithi045.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-11-28T18:35:16.327 INFO:teuthology.orchestra.run.smithi045.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-11-28T18:35:16.329 INFO:teuthology.orchestra.run.smithi045.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-11-28T18:35:16.330 INFO:teuthology.orchestra.run.smithi045.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-11-28T18:35:16.332 INFO:teuthology.orchestra.run.smithi045.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-11-28T18:35:16.332 INFO:teuthology.orchestra.run.smithi045.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-11-28T18:35:16.333 INFO:teuthology.orchestra.run.smithi045.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-11-28T18:35:16.334 INFO:teuthology.orchestra.run.smithi045.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-11-28T18:35:16.334 INFO:teuthology.orchestra.run.smithi045.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-11-28T18:35:16.341 INFO:teuthology.orchestra.run.smithi045.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-11-28T18:35:16.365 INFO:teuthology.orchestra.run.smithi045.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-11-28T18:35:16.427 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-11-28T18:35:16.759 INFO:teuthology.orchestra.run.smithi045.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-11-28T18:35:16.761 INFO:teuthology.orchestra.run.smithi045.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-11-28T18:35:16.762 INFO:teuthology.orchestra.run.smithi045.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-11-28T18:35:16.764 INFO:teuthology.orchestra.run.smithi045.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-11-28T18:35:16.765 INFO:teuthology.orchestra.run.smithi045.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-11-28T18:35:16.769 INFO:teuthology.orchestra.run.smithi045.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.9-0ubuntu0.22.04.1 [141 kB] 2023-11-28T18:35:16.773 INFO:teuthology.orchestra.run.smithi045.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-11-28T18:35:16.783 INFO:teuthology.orchestra.run.smithi045.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-11-28T18:35:16.783 INFO:teuthology.orchestra.run.smithi045.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2023-11-28T18:35:16.803 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-11-28T18:35:16.825 INFO:teuthology.orchestra.run.smithi045.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-11-28T18:35:16.827 INFO:teuthology.orchestra.run.smithi045.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-11-28T18:35:16.838 INFO:teuthology.orchestra.run.smithi045.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-11-28T18:35:16.917 INFO:teuthology.orchestra.run.smithi045.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-11-28T18:35:16.921 INFO:teuthology.orchestra.run.smithi045.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-11-28T18:35:16.921 INFO:teuthology.orchestra.run.smithi045.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-11-28T18:35:16.923 INFO:teuthology.orchestra.run.smithi045.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-11-28T18:35:16.923 INFO:teuthology.orchestra.run.smithi045.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.9-0ubuntu0.22.04.1 [1,222 kB] 2023-11-28T18:35:16.934 INFO:teuthology.orchestra.run.smithi045.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-11-28T18:35:16.936 INFO:teuthology.orchestra.run.smithi045.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.9-0ubuntu0.22.04.1 [16.1 MB] 2023-11-28T18:35:17.079 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-11-28T18:35:17.187 INFO:teuthology.orchestra.run.smithi045.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-11-28T18:35:17.188 INFO:teuthology.orchestra.run.smithi045.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-11-28T18:35:17.188 INFO:teuthology.orchestra.run.smithi045.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-11-28T18:35:17.188 INFO:teuthology.orchestra.run.smithi045.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-11-28T18:35:17.188 INFO:teuthology.orchestra.run.smithi045.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-11-28T18:35:17.189 INFO:teuthology.orchestra.run.smithi045.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-11-28T18:35:17.207 INFO:teuthology.orchestra.run.smithi045.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-11-28T18:35:17.207 INFO:teuthology.orchestra.run.smithi045.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-11-28T18:35:17.432 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-28T18:35:17.558 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up librados2 (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:35:17.601 INFO:teuthology.orchestra.run.smithi045.stdout:Preconfiguring packages ... 2023-11-28T18:35:17.684 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libsqlite3-mod-ceph (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:35:17.756 INFO:teuthology.orchestra.run.smithi045.stdout:Fetched 54.6 MB in 1s (46.8 MB/s) 2023-11-28T18:35:17.810 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2023-11-28T18:35:17.880 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package flex. 2023-11-28T18:35:17.954 INFO:teuthology.orchestra.run.smithi045.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140566 files and directories currently installed.) 2023-11-28T18:35:17.958 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-11-28T18:35:18.005 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking flex (2.6.4-8build2) ... 2023-11-28T18:35:18.137 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libcephfs2 (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:35:18.280 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libradosstriper1 (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:35:18.406 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-11-28T18:35:18.574 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-28T18:35:18.700 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up librbd1 (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:35:18.751 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2023-11-28T18:35:18.826 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-mgr-modules-core (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:35:18.951 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-fuse (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:35:19.153 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-28T18:35:19.187 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-28T18:35:19.187 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-28T18:35:19.693 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package bison. 2023-11-28T18:35:19.769 INFO:teuthology.orchestra.run.smithi045.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140639 files and directories currently installed.) 2023-11-28T18:35:19.773 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-11-28T18:35:19.813 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-11-28T18:35:19.845 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libcephfs-dev (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:35:19.971 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-rados (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:35:20.230 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-11-28T18:35:20.245 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-11-28T18:35:20.439 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up librgw2 (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:35:20.448 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-11-28T18:35:20.565 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up cephfs-top (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:35:20.699 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-28T18:35:20.777 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package dump. 2023-11-28T18:35:20.792 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-11-28T18:35:20.835 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking dump (0.4b47-3) ... 2023-11-28T18:35:21.105 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package indent. 2023-11-28T18:35:21.120 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-11-28T18:35:21.164 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-28T18:35:21.441 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-11-28T18:35:21.457 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-11-28T18:35:21.499 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-28T18:35:21.820 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-11-28T18:35:21.836 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-11-28T18:35:21.878 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-28T18:35:21.994 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-rbd (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:35:22.104 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up rbd-fuse (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:35:22.139 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-11-28T18:35:22.155 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-11-28T18:35:22.197 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-11-28T18:35:22.221 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-rgw (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:35:22.372 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-cephfs (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:35:22.498 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up cephfs-shell (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:35:22.558 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libfl2:amd64. 2023-11-28T18:35:22.575 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-11-28T18:35:22.608 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-11-28T18:35:22.624 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-common (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:35:22.819 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-11-28T18:35:22.835 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-11-28T18:35:22.877 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-28T18:35:23.130 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libjson-perl. 2023-11-28T18:35:23.146 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-11-28T18:35:23.161 INFO:teuthology.orchestra.run.smithi190.stdout:Adding group ceph....done 2023-11-28T18:35:23.189 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-11-28T18:35:23.533 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libllvm14:amd64. 2023-11-28T18:35:23.549 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-11-28T18:35:23.592 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-28T18:35:23.595 INFO:teuthology.orchestra.run.smithi190.stdout:Adding system user ceph....done 2023-11-28T18:35:23.789 INFO:teuthology.orchestra.run.smithi190.stdout:Setting system user ceph properties....done 2023-11-28T18:35:23.803 INFO:teuthology.orchestra.run.smithi190.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-11-28T18:35:23.945 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-11-28T18:35:24.333 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-11-28T18:35:24.942 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up cephfs-mirror (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:35:24.944 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-11-28T18:35:24.960 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-28T18:35:25.002 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-28T18:35:25.145 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-28T18:35:25.145 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-28T18:35:25.255 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libmbim-proxy. 2023-11-28T18:35:25.271 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-28T18:35:25.313 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-28T18:35:25.717 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-11-28T18:35:25.733 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-28T18:35:25.775 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-28T18:35:25.778 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-test (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:35:25.979 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up radosgw (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:35:26.111 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libndp0:amd64. 2023-11-28T18:35:26.127 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-11-28T18:35:26.169 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-28T18:35:26.530 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libnm0:amd64. 2023-11-28T18:35:26.547 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-11-28T18:35:26.589 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-28T18:35:26.613 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-28T18:35:26.613 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-28T18:35:26.908 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libpq5:amd64. 2023-11-28T18:35:26.924 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../16-libpq5_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-28T18:35:26.966 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T18:35:27.246 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-base (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:35:27.286 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-11-28T18:35:27.302 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-28T18:35:27.344 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-28T18:35:27.601 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-11-28T18:35:27.655 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libqmi-proxy. 2023-11-28T18:35:27.671 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-28T18:35:27.713 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-28T18:35:27.940 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-11-28T18:35:27.957 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-28T18:35:27.990 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-28T18:35:28.256 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-mds (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:35:28.494 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-11-28T18:35:28.510 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-11-28T18:35:28.512 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-28T18:35:28.512 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-28T18:35:28.552 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-11-28T18:35:28.888 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package modemmanager. 2023-11-28T18:35:28.904 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-28T18:35:28.946 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-28T18:35:29.125 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-mgr (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:35:29.340 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-28T18:35:29.340 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-28T18:35:29.544 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package network-manager. 2023-11-28T18:35:29.560 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-11-28T18:35:29.611 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-11-28T18:35:29.935 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-osd (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:35:30.226 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ppp. 2023-11-28T18:35:30.238 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-28T18:35:30.238 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-28T18:35:30.243 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-11-28T18:35:30.600 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-11-28T18:35:30.845 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-mgr-k8sevents (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:35:30.924 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package pptp-linux. 2023-11-28T18:35:30.939 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-11-28T18:35:30.954 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:35:30.982 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-11-28T18:35:31.082 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-mon (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:35:31.218 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package network-manager-pptp. 2023-11-28T18:35:31.233 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-11-28T18:35:31.272 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-28T18:35:31.272 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-28T18:35:31.276 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-11-28T18:35:31.595 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package postgresql-client-common. 2023-11-28T18:35:31.611 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-11-28T18:35:31.654 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking postgresql-client-common (238) ... 2023-11-28T18:35:31.873 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-mgr-cephadm (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:35:31.943 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package postgresql-client-14. 2023-11-28T18:35:31.959 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../27-postgresql-client-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-28T18:35:32.001 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T18:35:32.016 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:35:32.133 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-mgr-dashboard (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:35:32.251 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-volume (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T18:35:32.531 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package postgresql-common. 2023-11-28T18:35:32.547 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-11-28T18:35:32.599 INFO:teuthology.orchestra.run.smithi045.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-11-28T18:35:32.630 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking postgresql-common (238) ... 2023-11-28T18:35:32.712 INFO:teuthology.orchestra.run.smithi190.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2023-11-28T18:35:32.804 INFO:teuthology.orchestra.run.smithi190.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-28T18:35:32.964 INFO:teuthology.orchestra.run.smithi190.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-28T18:35:33.089 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package postgresql-14. 2023-11-28T18:35:33.105 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../29-postgresql-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-28T18:35:33.151 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T18:35:33.831 INFO:teuthology.orchestra.run.smithi190.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-11-28T18:35:34.243 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package postgresql. 2023-11-28T18:35:34.258 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-11-28T18:35:34.301 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking postgresql (14+238) ... 2023-11-28T18:35:34.532 INFO:teuthology.orchestra.run.smithi190.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-28T18:35:34.536 DEBUG:teuthology.orchestra.run.smithi190:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-11-28T18:35:34.561 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package postgresql-client. 2023-11-28T18:35:34.576 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-11-28T18:35:34.611 INFO:teuthology.orchestra.run.smithi190.stdout:Reading package lists... 2023-11-28T18:35:34.620 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking postgresql-client (14+238) ... 2023-11-28T18:35:34.777 INFO:teuthology.orchestra.run.smithi190.stdout:Building dependency tree... 2023-11-28T18:35:34.778 INFO:teuthology.orchestra.run.smithi190.stdout:Reading state information... 2023-11-28T18:35:34.863 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package postgresql-contrib. 2023-11-28T18:35:34.879 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-11-28T18:35:34.922 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking postgresql-contrib (14+238) ... 2023-11-28T18:35:34.929 INFO:teuthology.orchestra.run.smithi190.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-11-28T18:35:34.930 INFO:teuthology.orchestra.run.smithi190.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-11-28T18:35:34.930 INFO:teuthology.orchestra.run.smithi190.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-11-28T18:35:34.930 INFO:teuthology.orchestra.run.smithi190.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-11-28T18:35:34.930 INFO:teuthology.orchestra.run.smithi190.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-11-28T18:35:34.930 INFO:teuthology.orchestra.run.smithi190.stdout:The following packages were automatically installed and are no longer required: 2023-11-28T18:35:34.930 INFO:teuthology.orchestra.run.smithi190.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-28T18:35:34.930 INFO:teuthology.orchestra.run.smithi190.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-28T18:35:34.930 INFO:teuthology.orchestra.run.smithi190.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-28T18:35:34.930 INFO:teuthology.orchestra.run.smithi190.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-28T18:35:34.931 INFO:teuthology.orchestra.run.smithi190.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-28T18:35:34.931 INFO:teuthology.orchestra.run.smithi190.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-28T18:35:34.931 INFO:teuthology.orchestra.run.smithi190.stdout:The following additional packages will be installed: 2023-11-28T18:35:34.932 INFO:teuthology.orchestra.run.smithi190.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-11-28T18:35:34.932 INFO:teuthology.orchestra.run.smithi190.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-11-28T18:35:34.932 INFO:teuthology.orchestra.run.smithi190.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-11-28T18:35:34.932 INFO:teuthology.orchestra.run.smithi190.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-11-28T18:35:34.932 INFO:teuthology.orchestra.run.smithi190.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-28T18:35:34.932 INFO:teuthology.orchestra.run.smithi190.stdout:Suggested packages: 2023-11-28T18:35:34.932 INFO:teuthology.orchestra.run.smithi190.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-11-28T18:35:34.933 INFO:teuthology.orchestra.run.smithi190.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-11-28T18:35:34.933 INFO:teuthology.orchestra.run.smithi190.stdout: libengine-pkcs11-openssl 2023-11-28T18:35:34.981 INFO:teuthology.orchestra.run.smithi190.stdout:The following NEW packages will be installed: 2023-11-28T18:35:34.981 INFO:teuthology.orchestra.run.smithi190.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-11-28T18:35:34.981 INFO:teuthology.orchestra.run.smithi190.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-11-28T18:35:34.982 INFO:teuthology.orchestra.run.smithi190.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-11-28T18:35:34.982 INFO:teuthology.orchestra.run.smithi190.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-11-28T18:35:34.982 INFO:teuthology.orchestra.run.smithi190.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-11-28T18:35:34.982 INFO:teuthology.orchestra.run.smithi190.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-11-28T18:35:34.982 INFO:teuthology.orchestra.run.smithi190.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-28T18:35:34.983 INFO:teuthology.orchestra.run.smithi190.stdout:The following packages will be upgraded: 2023-11-28T18:35:34.983 INFO:teuthology.orchestra.run.smithi190.stdout: libssl3 2023-11-28T18:35:35.179 INFO:teuthology.orchestra.run.smithi190.stdout:1 upgraded, 39 newly installed, 0 to remove and 263 not upgraded. 2023-11-28T18:35:35.179 INFO:teuthology.orchestra.run.smithi190.stdout:Need to get 54.6 MB of archives. 2023-11-28T18:35:35.181 INFO:teuthology.orchestra.run.smithi190.stdout:After this operation, 202 MB of additional disk space will be used. 2023-11-28T18:35:35.181 INFO:teuthology.orchestra.run.smithi190.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-11-28T18:35:35.208 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package tcl8.6. 2023-11-28T18:35:35.224 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-11-28T18:35:35.275 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-28T18:35:35.569 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package tcl. 2023-11-28T18:35:35.590 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-11-28T18:35:35.646 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-11-28T18:35:35.677 INFO:teuthology.orchestra.run.smithi190.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2023-11-28T18:35:35.937 INFO:teuthology.orchestra.run.smithi190.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-11-28T18:35:35.970 INFO:teuthology.orchestra.run.smithi190.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-11-28T18:35:35.972 INFO:teuthology.orchestra.run.smithi190.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-11-28T18:35:35.977 INFO:teuthology.orchestra.run.smithi190.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-11-28T18:35:35.981 INFO:teuthology.orchestra.run.smithi190.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-11-28T18:35:35.981 INFO:teuthology.orchestra.run.smithi190.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-11-28T18:35:35.984 INFO:teuthology.orchestra.run.smithi190.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-11-28T18:35:35.986 INFO:teuthology.orchestra.run.smithi190.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-11-28T18:35:35.987 INFO:teuthology.orchestra.run.smithi190.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-11-28T18:35:36.152 INFO:teuthology.orchestra.run.smithi190.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-11-28T18:35:36.224 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package wpasupplicant. 2023-11-28T18:35:36.240 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-11-28T18:35:36.282 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-28T18:35:36.491 INFO:teuthology.orchestra.run.smithi190.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-11-28T18:35:36.653 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-11-28T18:35:36.670 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-11-28T18:35:36.711 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-11-28T18:35:37.023 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package usb-modeswitch. 2023-11-28T18:35:37.040 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-11-28T18:35:37.082 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-28T18:35:37.368 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up postgresql-client-common (238) ... 2023-11-28T18:35:37.564 INFO:teuthology.orchestra.run.smithi190.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-11-28T18:35:37.566 INFO:teuthology.orchestra.run.smithi190.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-11-28T18:35:37.566 INFO:teuthology.orchestra.run.smithi190.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-11-28T18:35:37.569 INFO:teuthology.orchestra.run.smithi190.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-11-28T18:35:37.569 INFO:teuthology.orchestra.run.smithi190.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-11-28T18:35:37.574 INFO:teuthology.orchestra.run.smithi190.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.9-0ubuntu0.22.04.1 [141 kB] 2023-11-28T18:35:37.576 INFO:teuthology.orchestra.run.smithi190.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-11-28T18:35:37.588 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up flex (2.6.4-8build2) ... 2023-11-28T18:35:37.594 INFO:teuthology.orchestra.run.smithi190.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-11-28T18:35:37.594 INFO:teuthology.orchestra.run.smithi190.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2023-11-28T18:35:37.714 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-28T18:35:38.220 INFO:teuthology.orchestra.run.smithi190.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-11-28T18:35:38.220 INFO:teuthology.orchestra.run.smithi190.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-11-28T18:35:38.221 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T18:35:38.221 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-11-28T18:35:38.221 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-28T18:35:38.221 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T18:35:38.402 INFO:teuthology.orchestra.run.smithi190.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-11-28T18:35:38.531 INFO:teuthology.orchestra.run.smithi190.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-11-28T18:35:38.542 INFO:teuthology.orchestra.run.smithi190.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-11-28T18:35:38.542 INFO:teuthology.orchestra.run.smithi190.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-11-28T18:35:38.544 INFO:teuthology.orchestra.run.smithi190.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-11-28T18:35:38.544 INFO:teuthology.orchestra.run.smithi190.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.9-0ubuntu0.22.04.1 [1,222 kB] 2023-11-28T18:35:38.578 INFO:teuthology.orchestra.run.smithi190.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-11-28T18:35:38.582 INFO:teuthology.orchestra.run.smithi190.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.9-0ubuntu0.22.04.1 [16.1 MB] 2023-11-28T18:35:39.023 INFO:teuthology.orchestra.run.smithi190.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-11-28T18:35:39.187 INFO:teuthology.orchestra.run.smithi190.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-11-28T18:35:39.202 INFO:teuthology.orchestra.run.smithi045.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-11-28T18:35:39.270 INFO:teuthology.orchestra.run.smithi190.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-11-28T18:35:39.270 INFO:teuthology.orchestra.run.smithi190.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-11-28T18:35:39.299 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-28T18:35:39.351 INFO:teuthology.orchestra.run.smithi190.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-11-28T18:35:39.359 INFO:teuthology.orchestra.run.smithi190.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-11-28T18:35:39.686 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-28T18:35:39.686 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-28T18:35:39.827 INFO:teuthology.orchestra.run.smithi190.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-11-28T18:35:39.829 INFO:teuthology.orchestra.run.smithi190.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-11-28T18:35:40.216 INFO:teuthology.orchestra.run.smithi190.stdout:Preconfiguring packages ... 2023-11-28T18:35:40.363 INFO:teuthology.orchestra.run.smithi190.stdout:Fetched 54.6 MB in 5s (11.3 MB/s) 2023-11-28T18:35:40.402 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-11-28T18:35:40.488 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package flex. 2023-11-28T18:35:40.528 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-28T18:35:40.561 INFO:teuthology.orchestra.run.smithi190.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140566 files and directories currently installed.) 2023-11-28T18:35:40.565 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-11-28T18:35:40.613 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking flex (2.6.4-8build2) ... 2023-11-28T18:35:40.655 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-11-28T18:35:41.115 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-28T18:35:41.126 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-11-28T18:35:41.248 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-11-28T18:35:41.268 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2023-11-28T18:35:41.408 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-28T18:35:41.534 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-11-28T18:35:41.674 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-28T18:35:42.156 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-28T18:35:42.202 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package bison. 2023-11-28T18:35:42.274 INFO:teuthology.orchestra.run.smithi190.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140639 files and directories currently installed.) 2023-11-28T18:35:42.278 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-11-28T18:35:42.282 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up dump (0.4b47-3) ... 2023-11-28T18:35:42.321 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-11-28T18:35:42.411 INFO:teuthology.orchestra.run.smithi045.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-11-28T18:35:42.476 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-28T18:35:42.585 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-28T18:35:42.694 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up tcl (8.6.11+1build2) ... 2023-11-28T18:35:42.738 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-11-28T18:35:42.752 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-11-28T18:35:42.796 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-11-28T18:35:42.820 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libjson-perl (4.04000-1) ... 2023-11-28T18:35:42.946 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-11-28T18:35:43.036 INFO:teuthology.orchestra.run.smithi045.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-11-28T18:35:43.106 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-28T18:35:43.107 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package dump. 2023-11-28T18:35:43.122 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-11-28T18:35:43.158 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking dump (0.4b47-3) ... 2023-11-28T18:35:43.233 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-28T18:35:43.444 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package indent. 2023-11-28T18:35:43.451 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-28T18:35:43.459 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-11-28T18:35:43.502 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-28T18:35:43.560 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-28T18:35:43.661 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-11-28T18:35:43.763 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-11-28T18:35:43.778 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-11-28T18:35:43.821 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-28T18:35:43.829 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up postgresql-client (14+238) ... 2023-11-28T18:35:43.955 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-11-28T18:35:44.184 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-11-28T18:35:44.199 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-11-28T18:35:44.242 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-28T18:35:44.486 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-11-28T18:35:44.502 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-11-28T18:35:44.536 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-11-28T18:35:44.559 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:35:44.559 INFO:teuthology.orchestra.run.smithi045.stdout:The following network interfaces were found in /etc/network/interfaces 2023-11-28T18:35:44.559 INFO:teuthology.orchestra.run.smithi045.stdout:which means they are currently configured by ifupdown: 2023-11-28T18:35:44.559 INFO:teuthology.orchestra.run.smithi045.stdout:- ens1f0 2023-11-28T18:35:44.559 INFO:teuthology.orchestra.run.smithi045.stdout:If you want to manage those interfaces with NetworkManager instead 2023-11-28T18:35:44.559 INFO:teuthology.orchestra.run.smithi045.stdout:remove their configuration from /etc/network/interfaces. 2023-11-28T18:35:44.559 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:35:44.699 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-11-28T18:35:44.864 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libfl2:amd64. 2023-11-28T18:35:44.880 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-11-28T18:35:44.922 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-11-28T18:35:45.113 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-11-28T18:35:45.167 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-11-28T18:35:45.182 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-11-28T18:35:45.225 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-28T18:35:45.494 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libjson-perl. 2023-11-28T18:35:45.510 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-11-28T18:35:45.549 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-11-28T18:35:45.560 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-11-28T18:35:45.872 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libllvm14:amd64. 2023-11-28T18:35:45.888 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-11-28T18:35:45.930 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-28T18:35:46.366 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-28T18:35:46.518 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-28T18:35:46.644 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-11-28T18:35:46.770 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up postgresql-common (238) ... 2023-11-28T18:35:47.308 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-11-28T18:35:47.323 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-28T18:35:47.366 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-28T18:35:47.635 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libmbim-proxy. 2023-11-28T18:35:47.651 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-28T18:35:47.693 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-28T18:35:47.694 INFO:teuthology.orchestra.run.smithi045.stdout:Adding user postgres to group ssl-cert 2023-11-28T18:35:47.932 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:35:47.932 INFO:teuthology.orchestra.run.smithi045.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-11-28T18:35:48.037 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-11-28T18:35:48.053 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-28T18:35:48.087 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-28T18:35:48.210 INFO:teuthology.orchestra.run.smithi045.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-11-28T18:35:48.211 INFO:teuthology.orchestra.run.smithi045.stdout:Removing obsolete dictionary files: 2023-11-28T18:35:48.382 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libndp0:amd64. 2023-11-28T18:35:48.397 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-11-28T18:35:48.440 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-28T18:35:48.776 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libnm0:amd64. 2023-11-28T18:35:48.792 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-11-28T18:35:48.834 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-28T18:35:48.970 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-11-28T18:35:49.255 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libpq5:amd64. 2023-11-28T18:35:49.270 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../16-libpq5_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-28T18:35:49.313 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T18:35:49.472 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T18:35:49.607 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-11-28T18:35:49.622 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-28T18:35:49.665 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-28T18:35:49.847 INFO:teuthology.orchestra.run.smithi045.stdout:Creating new PostgreSQL cluster 14/main ... 2023-11-28T18:35:49.866 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-11-28T18:35:49.922 INFO:teuthology.orchestra.run.smithi045.stdout:The files belonging to this database system will be owned by user "postgres". 2023-11-28T18:35:49.922 INFO:teuthology.orchestra.run.smithi045.stdout:This user must also own the server process. 2023-11-28T18:35:49.922 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:35:49.922 INFO:teuthology.orchestra.run.smithi045.stdout:The database cluster will be initialized with locale "en_US". 2023-11-28T18:35:49.922 INFO:teuthology.orchestra.run.smithi045.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-11-28T18:35:49.923 INFO:teuthology.orchestra.run.smithi045.stdout:The default text search configuration will be set to "english". 2023-11-28T18:35:49.923 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:35:49.923 INFO:teuthology.orchestra.run.smithi045.stdout:Data page checksums are disabled. 2023-11-28T18:35:49.923 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:35:49.923 INFO:teuthology.orchestra.run.smithi045.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-11-28T18:35:49.925 INFO:teuthology.orchestra.run.smithi045.stdout:creating subdirectories ... ok 2023-11-28T18:35:49.926 INFO:teuthology.orchestra.run.smithi045.stdout:selecting dynamic shared memory implementation ... posix 2023-11-28T18:35:49.949 INFO:teuthology.orchestra.run.smithi045.stdout:selecting default max_connections ... 100 2023-11-28T18:35:49.951 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libqmi-proxy. 2023-11-28T18:35:49.966 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-28T18:35:49.985 INFO:teuthology.orchestra.run.smithi045.stdout:selecting default shared_buffers ... 128MB 2023-11-28T18:35:50.000 INFO:teuthology.orchestra.run.smithi045.stdout:selecting default time zone ... Etc/UTC 2023-11-28T18:35:50.000 INFO:teuthology.orchestra.run.smithi045.stdout:creating configuration files ... ok 2023-11-28T18:35:50.009 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-28T18:35:50.183 INFO:teuthology.orchestra.run.smithi045.stdout:running bootstrap script ... ok 2023-11-28T18:35:50.270 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-11-28T18:35:50.285 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-28T18:35:50.328 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-28T18:35:50.813 INFO:teuthology.orchestra.run.smithi045.stdout:performing post-bootstrap initialization ... ok 2023-11-28T18:35:50.839 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-11-28T18:35:50.854 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-11-28T18:35:50.889 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-11-28T18:35:51.267 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package modemmanager. 2023-11-28T18:35:51.282 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-28T18:35:51.326 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-28T18:35:51.477 INFO:teuthology.orchestra.run.smithi045.stdout:syncing data to disk ... ok 2023-11-28T18:35:51.915 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package network-manager. 2023-11-28T18:35:51.930 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-11-28T18:35:51.981 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-11-28T18:35:52.032 INFO:teuthology.orchestra.run.smithi045.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-11-28T18:35:52.630 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ppp. 2023-11-28T18:35:52.645 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-11-28T18:35:52.983 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-11-28T18:35:53.326 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package pptp-linux. 2023-11-28T18:35:53.340 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-11-28T18:35:53.384 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-11-28T18:35:53.637 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package network-manager-pptp. 2023-11-28T18:35:53.651 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-11-28T18:35:53.695 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-11-28T18:35:53.973 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package postgresql-client-common. 2023-11-28T18:35:53.987 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-11-28T18:35:54.023 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking postgresql-client-common (238) ... 2023-11-28T18:35:54.487 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package postgresql-client-14. 2023-11-28T18:35:54.501 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../27-postgresql-client-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-28T18:35:54.545 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T18:35:55.105 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-28T18:35:55.133 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package postgresql-common. 2023-11-28T18:35:55.148 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-11-28T18:35:55.209 INFO:teuthology.orchestra.run.smithi190.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-11-28T18:35:55.231 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up postgresql-contrib (14+238) ... 2023-11-28T18:35:55.239 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking postgresql-common (238) ... 2023-11-28T18:35:55.382 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up postgresql (14+238) ... 2023-11-28T18:35:55.508 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-28T18:35:55.634 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-28T18:35:55.748 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package postgresql-14. 2023-11-28T18:35:55.762 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../29-postgresql-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-28T18:35:55.809 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T18:35:55.903 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-11-28T18:35:55.903 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-11-28T18:35:56.662 INFO:teuthology.orchestra.run.smithi045.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-11-28T18:35:56.867 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package postgresql. 2023-11-28T18:35:56.882 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-11-28T18:35:56.925 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking postgresql (14+238) ... 2023-11-28T18:35:56.939 INFO:teuthology.orchestra.run.smithi045.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-28T18:35:57.099 INFO:teuthology.orchestra.run.smithi045.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-28T18:35:57.169 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package postgresql-client. 2023-11-28T18:35:57.184 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-11-28T18:35:57.219 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking postgresql-client (14+238) ... 2023-11-28T18:35:57.430 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package postgresql-contrib. 2023-11-28T18:35:57.445 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-11-28T18:35:57.480 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking postgresql-contrib (14+238) ... 2023-11-28T18:35:57.815 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package tcl8.6. 2023-11-28T18:35:57.831 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-11-28T18:35:57.873 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-28T18:35:58.168 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package tcl. 2023-11-28T18:35:58.184 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-11-28T18:35:58.231 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-11-28T18:35:58.502 INFO:teuthology.orchestra.run.smithi045.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-11-28T18:35:58.554 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package wpasupplicant. 2023-11-28T18:35:58.570 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-11-28T18:35:58.603 INFO:teuthology.orchestra.run.smithi045.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-11-28T18:35:58.620 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-28T18:35:58.958 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-11-28T18:35:58.974 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-11-28T18:35:59.016 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-11-28T18:35:59.156 INFO:teuthology.orchestra.run.smithi045.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-28T18:35:59.160 DEBUG:teuthology.parallel:result is None 2023-11-28T18:35:59.777 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package usb-modeswitch. 2023-11-28T18:35:59.794 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-11-28T18:35:59.844 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-28T18:36:00.128 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up postgresql-client-common (238) ... 2023-11-28T18:36:00.350 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up flex (2.6.4-8build2) ... 2023-11-28T18:36:00.459 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-28T18:36:00.577 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T18:36:00.728 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-11-28T18:36:00.854 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-28T18:36:00.979 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T18:36:01.985 INFO:teuthology.orchestra.run.smithi190.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-11-28T18:36:02.077 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-28T18:36:02.456 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-28T18:36:02.456 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-28T18:36:03.155 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-11-28T18:36:03.281 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-28T18:36:03.406 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-11-28T18:36:03.532 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-11-28T18:36:03.658 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-11-28T18:36:03.759 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-28T18:36:03.902 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-11-28T18:36:04.574 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-28T18:36:05.025 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up dump (0.4b47-3) ... 2023-11-28T18:36:05.121 INFO:teuthology.orchestra.run.smithi190.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-11-28T18:36:05.169 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-28T18:36:05.295 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-28T18:36:05.470 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up tcl (8.6.11+1build2) ... 2023-11-28T18:36:05.596 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libjson-perl (4.04000-1) ... 2023-11-28T18:36:05.722 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-11-28T18:36:05.812 INFO:teuthology.orchestra.run.smithi190.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-11-28T18:36:05.882 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-28T18:36:06.027 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-28T18:36:06.203 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-28T18:36:06.329 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-28T18:36:06.455 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-11-28T18:36:06.623 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up postgresql-client (14+238) ... 2023-11-28T18:36:06.749 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-11-28T18:36:07.322 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-11-28T18:36:07.322 INFO:teuthology.orchestra.run.smithi190.stdout:The following network interfaces were found in /etc/network/interfaces 2023-11-28T18:36:07.322 INFO:teuthology.orchestra.run.smithi190.stdout:which means they are currently configured by ifupdown: 2023-11-28T18:36:07.322 INFO:teuthology.orchestra.run.smithi190.stdout:- enp3s0f1 2023-11-28T18:36:07.322 INFO:teuthology.orchestra.run.smithi190.stdout:If you want to manage those interfaces with NetworkManager instead 2023-11-28T18:36:07.322 INFO:teuthology.orchestra.run.smithi190.stdout:remove their configuration from /etc/network/interfaces. 2023-11-28T18:36:07.323 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-11-28T18:36:07.455 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-11-28T18:36:07.848 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-11-28T18:36:08.271 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-11-28T18:36:08.951 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-28T18:36:09.094 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-28T18:36:09.237 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-11-28T18:36:09.363 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up postgresql-common (238) ... 2023-11-28T18:36:10.329 INFO:teuthology.orchestra.run.smithi190.stdout:Adding user postgres to group ssl-cert 2023-11-28T18:36:10.576 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-11-28T18:36:10.576 INFO:teuthology.orchestra.run.smithi190.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-11-28T18:36:10.810 INFO:teuthology.orchestra.run.smithi190.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-11-28T18:36:10.810 INFO:teuthology.orchestra.run.smithi190.stdout:Removing obsolete dictionary files: 2023-11-28T18:36:11.487 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-11-28T18:36:11.955 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T18:36:12.295 INFO:teuthology.orchestra.run.smithi190.stdout:Creating new PostgreSQL cluster 14/main ... 2023-11-28T18:36:12.316 INFO:teuthology.orchestra.run.smithi190.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-11-28T18:36:12.374 INFO:teuthology.orchestra.run.smithi190.stdout:The files belonging to this database system will be owned by user "postgres". 2023-11-28T18:36:12.374 INFO:teuthology.orchestra.run.smithi190.stdout:This user must also own the server process. 2023-11-28T18:36:12.374 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-11-28T18:36:12.374 INFO:teuthology.orchestra.run.smithi190.stdout:The database cluster will be initialized with locale "en_US". 2023-11-28T18:36:12.375 INFO:teuthology.orchestra.run.smithi190.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-11-28T18:36:12.375 INFO:teuthology.orchestra.run.smithi190.stdout:The default text search configuration will be set to "english". 2023-11-28T18:36:12.375 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-11-28T18:36:12.375 INFO:teuthology.orchestra.run.smithi190.stdout:Data page checksums are disabled. 2023-11-28T18:36:12.375 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-11-28T18:36:12.375 INFO:teuthology.orchestra.run.smithi190.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-11-28T18:36:12.376 INFO:teuthology.orchestra.run.smithi190.stdout:creating subdirectories ... ok 2023-11-28T18:36:12.376 INFO:teuthology.orchestra.run.smithi190.stdout:selecting dynamic shared memory implementation ... posix 2023-11-28T18:36:12.399 INFO:teuthology.orchestra.run.smithi190.stdout:selecting default max_connections ... 100 2023-11-28T18:36:12.434 INFO:teuthology.orchestra.run.smithi190.stdout:selecting default shared_buffers ... 128MB 2023-11-28T18:36:12.448 INFO:teuthology.orchestra.run.smithi190.stdout:selecting default time zone ... Etc/UTC 2023-11-28T18:36:12.449 INFO:teuthology.orchestra.run.smithi190.stdout:creating configuration files ... ok 2023-11-28T18:36:12.618 INFO:teuthology.orchestra.run.smithi190.stdout:running bootstrap script ... ok 2023-11-28T18:36:13.223 INFO:teuthology.orchestra.run.smithi190.stdout:performing post-bootstrap initialization ... ok 2023-11-28T18:36:13.798 INFO:teuthology.orchestra.run.smithi190.stdout:syncing data to disk ... ok 2023-11-28T18:36:14.332 INFO:teuthology.orchestra.run.smithi190.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-11-28T18:36:17.288 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-28T18:36:17.414 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up postgresql-contrib (14+238) ... 2023-11-28T18:36:17.540 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up postgresql (14+238) ... 2023-11-28T18:36:17.666 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-28T18:36:17.792 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-28T18:36:18.085 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-11-28T18:36:18.086 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-11-28T18:36:18.836 INFO:teuthology.orchestra.run.smithi190.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-11-28T18:36:19.171 INFO:teuthology.orchestra.run.smithi190.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-28T18:36:19.322 INFO:teuthology.orchestra.run.smithi190.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-28T18:36:20.708 INFO:teuthology.orchestra.run.smithi190.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-11-28T18:36:20.808 INFO:teuthology.orchestra.run.smithi190.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-11-28T18:36:21.390 INFO:teuthology.orchestra.run.smithi190.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-28T18:36:21.394 DEBUG:teuthology.parallel:result is None 2023-11-28T18:36:21.395 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=47c1c547372ed5bff7984647dc200bac0e019caf 2023-11-28T18:36:21.631 DEBUG:teuthology.orchestra.run.smithi045:> dpkg-query -W -f '${Version}' ceph 2023-11-28T18:36:21.657 INFO:teuthology.orchestra.run.smithi045.stdout:18.0.0-7531-g47c1c547-1jammy 2023-11-28T18:36:21.657 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7531-g47c1c547-1jammy 2023-11-28T18:36:21.657 INFO:teuthology.task.install:The correct ceph version 18.0.0-7531-g47c1c547-1jammy is installed. 2023-11-28T18:36:21.658 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=47c1c547372ed5bff7984647dc200bac0e019caf 2023-11-28T18:36:21.802 DEBUG:teuthology.orchestra.run.smithi190:> dpkg-query -W -f '${Version}' ceph 2023-11-28T18:36:21.823 INFO:teuthology.orchestra.run.smithi190.stdout:18.0.0-7531-g47c1c547-1jammy 2023-11-28T18:36:21.824 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7531-g47c1c547-1jammy 2023-11-28T18:36:21.824 INFO:teuthology.task.install:The correct ceph version 18.0.0-7531-g47c1c547-1jammy is installed. 2023-11-28T18:36:21.824 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-11-28T18:36:21.824 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T18:36:21.824 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-28T18:36:21.848 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-28T18:36:21.848 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-28T18:36:21.886 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-11-28T18:36:21.887 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T18:36:21.887 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/usr/bin/daemon-helper 2023-11-28T18:36:21.915 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-28T18:36:21.982 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-28T18:36:21.983 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/usr/bin/daemon-helper 2023-11-28T18:36:22.002 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-28T18:36:22.062 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-11-28T18:36:22.062 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T18:36:22.062 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-28T18:36:22.085 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-28T18:36:22.150 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-28T18:36:22.151 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-28T18:36:22.170 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-28T18:36:22.233 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-11-28T18:36:22.234 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T18:36:22.234 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/usr/bin/stdin-killer 2023-11-28T18:36:22.256 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-28T18:36:22.318 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-28T18:36:22.318 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/usr/bin/stdin-killer 2023-11-28T18:36:22.338 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-28T18:36:22.398 INFO:teuthology.run_tasks:Running task ceph... 2023-11-28T18:36:22.475 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-11-28T18:36:22.476 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 777 /var/log/ceph 2023-11-28T18:36:22.479 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod 777 /var/log/ceph 2023-11-28T18:36:22.499 INFO:tasks.ceph:Disabling ceph logrotate... 2023-11-28T18:36:22.499 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-28T18:36:22.544 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-28T18:36:22.563 INFO:tasks.ceph:Creating extra log directories... 2023-11-28T18:36:22.563 DEBUG:teuthology.orchestra.run.smithi045:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-28T18:36:22.608 DEBUG:teuthology.orchestra.run.smithi190:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-28T18:36:22.637 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-11-28T18:36:22.637 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-11-28T18:36:22.637 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-11-28T18:36:22.637 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T18:36:22.637 DEBUG:teuthology.orchestra.run.smithi045:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-28T18:36:22.680 DEBUG:teuthology.orchestra.run.smithi045:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-28T18:36:22.777 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-28T18:36:22.778 DEBUG:teuthology.orchestra.run.smithi190:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-28T18:36:22.786 DEBUG:teuthology.orchestra.run.smithi190:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-28T18:36:22.881 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-11-28T18:36:22.881 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'bad backtrace on directory inode', 'error reading table object', 'Metadata damage detected', 'slow requests are blocked', 'Behind on trimming', 'error reading sessionmap'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-11-28T18:36:22.881 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2023-11-28_06:23:42-fs-wip-vshankar-testing-20231127.102654-testing-default-smithi/7469486', 'branch': 'wip-vshankar-testing-20231127.102654', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/journal-repair}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7469486', 'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '8247bbb5b470f7e2a1f3eefcc16e24cf1338f606'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2023-11-28_06:23:42-fs-wip-vshankar-testing-20231127.102654-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing-20231127.102654'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'bad backtrace on directory inode', 'error reading table object', 'Metadata damage detected', 'slow requests are blocked', 'Behind on trimming', 'error reading sessionmap'], 'sha1': '47c1c547372ed5bff7984647dc200bac0e019caf'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '47c1c547372ed5bff7984647dc200bac0e019caf'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-20231127.102654', 'sha1': '47c1c547372ed5bff7984647dc200bac0e019caf'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 1098, 'sha1': '47c1c547372ed5bff7984647dc200bac0e019caf', 'sleep_before_teardown': 0, 'subset': '854/1024', 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing-20231127.102654', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '47c1c547372ed5bff7984647dc200bac0e019caf', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi045.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO16mfo2YJwKMp9bM1nAYO5R82ro39MRsb9PrdrGfzI43Z0tLZWGKA2T5lA7/xusESnDMyyu2qu3FCDOmFHy5fg=', 'smithi190.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHXujc9ROsTW79sBjfOC7xjF7CZ5m3fIs4Q/SQfbq0OH3J5zRh+BxWYYOwmXayzav2UV2K5W6iMSNkNHSZ4j8vI='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '8247bbb5b470f7e2a1f3eefcc16e24cf1338f606'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '47c1c547372ed5bff7984647dc200bac0e019caf'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'bad backtrace on directory inode', 'error reading table object', 'Metadata damage detected', 'slow requests are blocked', 'Behind on trimming', 'error reading sessionmap'], 'sha1': '47c1c547372ed5bff7984647dc200bac0e019caf', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_journal_repair']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '5ae09a5cc7064ca2bf994df19f3006b79794789a', 'timestamp': '2023-11-28_06:23:42', 'tube': 'smithi', 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.232157'} 2023-11-28T18:36:22.882 DEBUG:teuthology.orchestra.run.smithi045:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-28T18:36:22.886 DEBUG:teuthology.orchestra.run.smithi190:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-28T18:36:22.894 DEBUG:teuthology.orchestra.run.smithi045:> sudo install -d -m0777 -- /var/run/ceph 2023-11-28T18:36:22.936 DEBUG:teuthology.orchestra.run.smithi190:> sudo install -d -m0777 -- /var/run/ceph 2023-11-28T18:36:22.958 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T18:36:22.958 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/scratch_devs of=/dev/stdout 2023-11-28T18:36:23.005 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-28T18:36:23.006 DEBUG:teuthology.orchestra.run.smithi045:> stat /dev/vg_nvme/lv_1 2023-11-28T18:36:23.062 INFO:teuthology.orchestra.run.smithi045.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-28T18:36:23.063 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T18:36:23.063 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 5h/5d Inode: 889 Links: 1 2023-11-28T18:36:23.063 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T18:36:23.063 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2023-11-28 18:29:36.526663101 +0000 2023-11-28T18:36:23.063 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2023-11-28 18:29:36.094666958 +0000 2023-11-28T18:36:23.064 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2023-11-28 18:29:36.094666958 +0000 2023-11-28T18:36:23.064 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: 2023-11-28 18:29:36.094666958 +0000 2023-11-28T18:36:23.064 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-28T18:36:23.126 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records in 2023-11-28T18:36:23.126 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records out 2023-11-28T18:36:23.127 INFO:teuthology.orchestra.run.smithi045.stderr:512 bytes copied, 0.000259021 s, 2.0 MB/s 2023-11-28T18:36:23.127 DEBUG:teuthology.orchestra.run.smithi045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-28T18:36:23.181 DEBUG:teuthology.orchestra.run.smithi045:> stat /dev/vg_nvme/lv_2 2023-11-28T18:36:23.235 INFO:teuthology.orchestra.run.smithi045.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-28T18:36:23.235 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T18:36:23.235 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 5h/5d Inode: 905 Links: 1 2023-11-28T18:36:23.235 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T18:36:23.236 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2023-11-28 18:29:37.222656883 +0000 2023-11-28T18:36:23.236 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2023-11-28 18:29:36.794660706 +0000 2023-11-28T18:36:23.236 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2023-11-28 18:29:36.794660706 +0000 2023-11-28T18:36:23.237 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: 2023-11-28 18:29:36.794660706 +0000 2023-11-28T18:36:23.237 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-28T18:36:23.296 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records in 2023-11-28T18:36:23.297 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records out 2023-11-28T18:36:23.297 INFO:teuthology.orchestra.run.smithi045.stderr:512 bytes copied, 0.00025797 s, 2.0 MB/s 2023-11-28T18:36:23.298 DEBUG:teuthology.orchestra.run.smithi045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-28T18:36:23.355 DEBUG:teuthology.orchestra.run.smithi045:> stat /dev/vg_nvme/lv_3 2023-11-28T18:36:23.406 INFO:teuthology.orchestra.run.smithi045.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-28T18:36:23.406 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T18:36:23.406 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 5h/5d Inode: 923 Links: 1 2023-11-28T18:36:23.406 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T18:36:23.406 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2023-11-28 18:29:37.942650451 +0000 2023-11-28T18:36:23.406 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2023-11-28 18:29:37.494654454 +0000 2023-11-28T18:36:23.406 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2023-11-28 18:29:37.494654454 +0000 2023-11-28T18:36:23.407 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: 2023-11-28 18:29:37.494654454 +0000 2023-11-28T18:36:23.407 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-28T18:36:23.468 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records in 2023-11-28T18:36:23.468 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records out 2023-11-28T18:36:23.468 INFO:teuthology.orchestra.run.smithi045.stderr:512 bytes copied, 0.000251441 s, 2.0 MB/s 2023-11-28T18:36:23.470 DEBUG:teuthology.orchestra.run.smithi045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-28T18:36:23.524 DEBUG:teuthology.orchestra.run.smithi045:> stat /dev/vg_nvme/lv_4 2023-11-28T18:36:23.573 INFO:teuthology.orchestra.run.smithi045.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-28T18:36:23.574 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T18:36:23.574 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 5h/5d Inode: 937 Links: 1 2023-11-28T18:36:23.574 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T18:36:23.574 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2023-11-28 18:29:38.246647736 +0000 2023-11-28T18:36:23.574 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2023-11-28 18:29:38.242647773 +0000 2023-11-28T18:36:23.574 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2023-11-28 18:29:38.242647773 +0000 2023-11-28T18:36:23.574 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: 2023-11-28 18:29:38.242647773 +0000 2023-11-28T18:36:23.574 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-28T18:36:23.636 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records in 2023-11-28T18:36:23.636 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records out 2023-11-28T18:36:23.636 INFO:teuthology.orchestra.run.smithi045.stderr:512 bytes copied, 0.000247076 s, 2.1 MB/s 2023-11-28T18:36:23.638 DEBUG:teuthology.orchestra.run.smithi045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-28T18:36:23.691 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-28T18:36:23.692 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-28T18:36:23.692 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/scratch_devs of=/dev/stdout 2023-11-28T18:36:23.701 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-28T18:36:23.701 DEBUG:teuthology.orchestra.run.smithi190:> stat /dev/vg_nvme/lv_1 2023-11-28T18:36:23.755 INFO:teuthology.orchestra.run.smithi190.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-28T18:36:23.755 INFO:teuthology.orchestra.run.smithi190.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T18:36:23.755 INFO:teuthology.orchestra.run.smithi190.stdout:Device: 5h/5d Inode: 890 Links: 1 2023-11-28T18:36:23.756 INFO:teuthology.orchestra.run.smithi190.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T18:36:23.756 INFO:teuthology.orchestra.run.smithi190.stdout:Access: 2023-11-28 18:29:32.355391923 +0000 2023-11-28T18:36:23.756 INFO:teuthology.orchestra.run.smithi190.stdout:Modify: 2023-11-28 18:29:31.927395746 +0000 2023-11-28T18:36:23.756 INFO:teuthology.orchestra.run.smithi190.stdout:Change: 2023-11-28 18:29:31.927395746 +0000 2023-11-28T18:36:23.756 INFO:teuthology.orchestra.run.smithi190.stdout: Birth: 2023-11-28 18:29:31.927395746 +0000 2023-11-28T18:36:23.756 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-28T18:36:23.818 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records in 2023-11-28T18:36:23.818 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records out 2023-11-28T18:36:23.818 INFO:teuthology.orchestra.run.smithi190.stderr:512 bytes copied, 0.000376374 s, 1.4 MB/s 2023-11-28T18:36:23.819 DEBUG:teuthology.orchestra.run.smithi190:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-28T18:36:23.874 DEBUG:teuthology.orchestra.run.smithi190:> stat /dev/vg_nvme/lv_2 2023-11-28T18:36:23.928 INFO:teuthology.orchestra.run.smithi190.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-28T18:36:23.928 INFO:teuthology.orchestra.run.smithi190.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T18:36:23.928 INFO:teuthology.orchestra.run.smithi190.stdout:Device: 5h/5d Inode: 908 Links: 1 2023-11-28T18:36:23.928 INFO:teuthology.orchestra.run.smithi190.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T18:36:23.928 INFO:teuthology.orchestra.run.smithi190.stdout:Access: 2023-11-28 18:29:33.103385241 +0000 2023-11-28T18:36:23.928 INFO:teuthology.orchestra.run.smithi190.stdout:Modify: 2023-11-28 18:29:32.671389100 +0000 2023-11-28T18:36:23.928 INFO:teuthology.orchestra.run.smithi190.stdout:Change: 2023-11-28 18:29:32.671389100 +0000 2023-11-28T18:36:23.928 INFO:teuthology.orchestra.run.smithi190.stdout: Birth: 2023-11-28 18:29:32.671389100 +0000 2023-11-28T18:36:23.929 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-28T18:36:23.990 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records in 2023-11-28T18:36:23.990 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records out 2023-11-28T18:36:23.990 INFO:teuthology.orchestra.run.smithi190.stderr:512 bytes copied, 0.000381491 s, 1.3 MB/s 2023-11-28T18:36:23.992 DEBUG:teuthology.orchestra.run.smithi190:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-28T18:36:24.050 DEBUG:teuthology.orchestra.run.smithi190:> stat /dev/vg_nvme/lv_3 2023-11-28T18:36:24.103 INFO:teuthology.orchestra.run.smithi190.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-28T18:36:24.104 INFO:teuthology.orchestra.run.smithi190.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T18:36:24.104 INFO:teuthology.orchestra.run.smithi190.stdout:Device: 5h/5d Inode: 924 Links: 1 2023-11-28T18:36:24.104 INFO:teuthology.orchestra.run.smithi190.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T18:36:24.104 INFO:teuthology.orchestra.run.smithi190.stdout:Access: 2023-11-28 18:29:33.787379130 +0000 2023-11-28T18:36:24.104 INFO:teuthology.orchestra.run.smithi190.stdout:Modify: 2023-11-28 18:29:33.379382776 +0000 2023-11-28T18:36:24.104 INFO:teuthology.orchestra.run.smithi190.stdout:Change: 2023-11-28 18:29:33.379382776 +0000 2023-11-28T18:36:24.104 INFO:teuthology.orchestra.run.smithi190.stdout: Birth: 2023-11-28 18:29:33.379382776 +0000 2023-11-28T18:36:24.104 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-28T18:36:24.166 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records in 2023-11-28T18:36:24.167 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records out 2023-11-28T18:36:24.167 INFO:teuthology.orchestra.run.smithi190.stderr:512 bytes copied, 0.000394844 s, 1.3 MB/s 2023-11-28T18:36:24.169 DEBUG:teuthology.orchestra.run.smithi190:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-28T18:36:24.225 DEBUG:teuthology.orchestra.run.smithi190:> stat /dev/vg_nvme/lv_4 2023-11-28T18:36:24.275 INFO:teuthology.orchestra.run.smithi190.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-28T18:36:24.276 INFO:teuthology.orchestra.run.smithi190.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T18:36:24.276 INFO:teuthology.orchestra.run.smithi190.stdout:Device: 5h/5d Inode: 941 Links: 1 2023-11-28T18:36:24.276 INFO:teuthology.orchestra.run.smithi190.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T18:36:24.276 INFO:teuthology.orchestra.run.smithi190.stdout:Access: 2023-11-28 18:29:34.483372915 +0000 2023-11-28T18:36:24.276 INFO:teuthology.orchestra.run.smithi190.stdout:Modify: 2023-11-28 18:29:34.055376738 +0000 2023-11-28T18:36:24.276 INFO:teuthology.orchestra.run.smithi190.stdout:Change: 2023-11-28 18:29:34.055376738 +0000 2023-11-28T18:36:24.276 INFO:teuthology.orchestra.run.smithi190.stdout: Birth: 2023-11-28 18:29:34.055376738 +0000 2023-11-28T18:36:24.276 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-28T18:36:24.338 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records in 2023-11-28T18:36:24.338 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records out 2023-11-28T18:36:24.338 INFO:teuthology.orchestra.run.smithi190.stderr:512 bytes copied, 0.00040182 s, 1.3 MB/s 2023-11-28T18:36:24.340 DEBUG:teuthology.orchestra.run.smithi190:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-28T18:36:24.393 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-28T18:36:24.393 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi045.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi190.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-28T18:36:24.394 INFO:tasks.ceph:Generating config... 2023-11-28T18:36:24.395 INFO:tasks.ceph:[client] client mount timeout = 600 2023-11-28T18:36:24.395 INFO:tasks.ceph:[client] debug client = 20 2023-11-28T18:36:24.395 INFO:tasks.ceph:[client] debug ms = 1 2023-11-28T18:36:24.395 INFO:tasks.ceph:[client] pid file = 2023-11-28T18:36:24.395 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-11-28T18:36:24.395 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-11-28T18:36:24.395 INFO:tasks.ceph:[mds] debug mds = 20 2023-11-28T18:36:24.395 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-11-28T18:36:24.396 INFO:tasks.ceph:[mds] debug ms = 1 2023-11-28T18:36:24.396 INFO:tasks.ceph:[mds] mds debug frag = True 2023-11-28T18:36:24.396 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-11-28T18:36:24.396 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-11-28T18:36:24.396 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-11-28T18:36:24.396 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-11-28T18:36:24.396 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-11-28T18:36:24.396 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-11-28T18:36:24.396 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-11-28T18:36:24.396 INFO:tasks.ceph:[mgr] debug ms = 1 2023-11-28T18:36:24.396 INFO:tasks.ceph:[mon] debug mon = 20 2023-11-28T18:36:24.396 INFO:tasks.ceph:[mon] debug ms = 1 2023-11-28T18:36:24.397 INFO:tasks.ceph:[mon] debug paxos = 20 2023-11-28T18:36:24.397 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-11-28T18:36:24.397 INFO:tasks.ceph:[osd] bdev async discard = True 2023-11-28T18:36:24.397 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-11-28T18:36:24.397 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-11-28T18:36:24.397 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-11-28T18:36:24.397 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-11-28T18:36:24.397 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-11-28T18:36:24.397 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-11-28T18:36:24.397 INFO:tasks.ceph:[osd] debug ms = 1 2023-11-28T18:36:24.397 INFO:tasks.ceph:[osd] debug osd = 20 2023-11-28T18:36:24.397 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-11-28T18:36:24.397 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-11-28T18:36:24.398 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-11-28T18:36:24.398 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-11-28T18:36:24.398 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-11-28T18:36:24.398 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-11-28T18:36:24.398 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-11-28T18:36:24.398 INFO:tasks.ceph:Setting up mon.a... 2023-11-28T18:36:24.398 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-11-28T18:36:24.446 INFO:teuthology.orchestra.run.smithi045.stdout:creating /etc/ceph/ceph.keyring 2023-11-28T18:36:24.459 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-11-28T18:36:24.511 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-28T18:36:24.533 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.45'), ('mon.b', '172.21.15.190'), ('mon.c', '[v2:172.21.15.190:3301,v1:172.21.15.190:6790]')] 2023-11-28T18:36:24.533 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.45,172.21.15.190,[v2:172.21.15.190:3301,v1:172.21.15.190:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-11-28T18:36:24.534 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T18:36:24.534 DEBUG:teuthology.orchestra.run.smithi045:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-11-28T18:36:24.585 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.45 --add b 172.21.15.190 --addv c '[v2:172.21.15.190:3301,v1:172.21.15.190:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-11-28T18:36:24.682 INFO:teuthology.orchestra.run.smithi045.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-11-28T18:36:24.682 INFO:teuthology.orchestra.run.smithi045.stdout:monmaptool: generated fsid d10f5cd6-1d00-4019-99b6-6fa435498a15 2023-11-28T18:36:24.682 INFO:teuthology.orchestra.run.smithi045.stdout:setting min_mon_release = pacific 2023-11-28T18:36:24.682 INFO:teuthology.orchestra.run.smithi045.stdout:epoch 0 2023-11-28T18:36:24.682 INFO:teuthology.orchestra.run.smithi045.stdout:fsid d10f5cd6-1d00-4019-99b6-6fa435498a15 2023-11-28T18:36:24.682 INFO:teuthology.orchestra.run.smithi045.stdout:last_changed 2023-11-28T18:36:24.683090+0000 2023-11-28T18:36:24.682 INFO:teuthology.orchestra.run.smithi045.stdout:created 2023-11-28T18:36:24.683090+0000 2023-11-28T18:36:24.682 INFO:teuthology.orchestra.run.smithi045.stdout:min_mon_release 16 (pacific) 2023-11-28T18:36:24.682 INFO:teuthology.orchestra.run.smithi045.stdout:election_strategy: 1 2023-11-28T18:36:24.683 INFO:teuthology.orchestra.run.smithi045.stdout:0: [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] mon.a 2023-11-28T18:36:24.683 INFO:teuthology.orchestra.run.smithi045.stdout:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2023-11-28T18:36:24.683 INFO:teuthology.orchestra.run.smithi045.stdout:2: [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] mon.c 2023-11-28T18:36:24.683 INFO:teuthology.orchestra.run.smithi045.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-11-28T18:36:24.684 DEBUG:teuthology.orchestra.run.smithi045:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-11-28T18:36:24.693 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID d10f5cd6-1d00-4019-99b6-6fa435498a15... 2023-11-28T18:36:24.694 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-28T18:36:24.744 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-28T18:36:24.786 INFO:teuthology.orchestra.run.smithi045.stdout:[global] 2023-11-28T18:36:24.786 INFO:teuthology.orchestra.run.smithi045.stdout: chdir = "" 2023-11-28T18:36:24.787 INFO:teuthology.orchestra.run.smithi045.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-28T18:36:24.787 INFO:teuthology.orchestra.run.smithi045.stdout: auth supported = cephx 2023-11-28T18:36:24.787 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:36:24.787 INFO:teuthology.orchestra.run.smithi045.stdout: filestore xattr use omap = true 2023-11-28T18:36:24.787 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:36:24.787 INFO:teuthology.orchestra.run.smithi045.stdout: mon clock drift allowed = 1.000 2023-11-28T18:36:24.787 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:36:24.787 INFO:teuthology.orchestra.run.smithi045.stdout: osd crush chooseleaf type = 0 2023-11-28T18:36:24.787 INFO:teuthology.orchestra.run.smithi045.stdout: auth debug = true 2023-11-28T18:36:24.787 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:36:24.787 INFO:teuthology.orchestra.run.smithi045.stdout: ms die on old message = true 2023-11-28T18:36:24.787 INFO:teuthology.orchestra.run.smithi045.stdout: ms die on bug = true 2023-11-28T18:36:24.788 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:36:24.788 INFO:teuthology.orchestra.run.smithi045.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-28T18:36:24.788 INFO:teuthology.orchestra.run.smithi045.stdout: mon pg warn max object skew = 0 2023-11-28T18:36:24.788 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:36:24.788 INFO:teuthology.orchestra.run.smithi045.stdout: # disable pg_autoscaler by default for new pools 2023-11-28T18:36:24.788 INFO:teuthology.orchestra.run.smithi045.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-28T18:36:24.788 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:36:24.788 INFO:teuthology.orchestra.run.smithi045.stdout: osd pool default size = 2 2023-11-28T18:36:24.788 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:36:24.788 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd allow primary affinity = true 2023-11-28T18:36:24.788 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd allow pg remap = true 2023-11-28T18:36:24.788 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on legacy crush tunables = false 2023-11-28T18:36:24.789 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on crush straw calc version zero = false 2023-11-28T18:36:24.789 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on no sortbitwise = false 2023-11-28T18:36:24.789 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on osd down out interval zero = false 2023-11-28T18:36:24.789 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on too few osds = false 2023-11-28T18:36:24.789 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-28T18:36:24.789 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-28T18:36:24.789 INFO:teuthology.orchestra.run.smithi045.stdout: mon_allow_pool_size_one = true 2023-11-28T18:36:24.790 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:36:24.790 INFO:teuthology.orchestra.run.smithi045.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-28T18:36:24.790 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:36:24.790 INFO:teuthology.orchestra.run.smithi045.stdout: osd default data pool replay window = 5 2023-11-28T18:36:24.790 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:36:24.791 INFO:teuthology.orchestra.run.smithi045.stdout: mon allow pool delete = true 2023-11-28T18:36:24.791 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:36:24.791 INFO:teuthology.orchestra.run.smithi045.stdout: mon cluster log file level = debug 2023-11-28T18:36:24.791 INFO:teuthology.orchestra.run.smithi045.stdout: debug asserts on shutdown = true 2023-11-28T18:36:24.791 INFO:teuthology.orchestra.run.smithi045.stdout: mon health detail to clog = false 2023-11-28T18:36:24.791 INFO:teuthology.orchestra.run.smithi045.stdout: mon host = "172.21.15.45,172.21.15.190,[v2:172.21.15.190:3301,v1:172.21.15.190:6790]" 2023-11-28T18:36:24.792 INFO:teuthology.orchestra.run.smithi045.stdout: fsid = d10f5cd6-1d00-4019-99b6-6fa435498a15 2023-11-28T18:36:24.792 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:36:24.792 INFO:teuthology.orchestra.run.smithi045.stdout:[osd] 2023-11-28T18:36:24.792 INFO:teuthology.orchestra.run.smithi045.stdout: osd journal size = 100 2023-11-28T18:36:24.793 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:36:24.793 INFO:teuthology.orchestra.run.smithi045.stdout: osd scrub load threshold = 5.0 2023-11-28T18:36:24.793 INFO:teuthology.orchestra.run.smithi045.stdout: osd scrub max interval = 600 2023-11-28T18:36:24.793 INFO:teuthology.orchestra.run.smithi045.stdout: osd mclock profile = high_recovery_ops 2023-11-28T18:36:24.793 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:36:24.794 INFO:teuthology.orchestra.run.smithi045.stdout: osd recover clone overlap = true 2023-11-28T18:36:24.794 INFO:teuthology.orchestra.run.smithi045.stdout: osd recovery max chunk = 1048576 2023-11-28T18:36:24.794 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:36:24.794 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug shutdown = true 2023-11-28T18:36:24.794 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug op order = true 2023-11-28T18:36:24.795 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug verify stray on activate = true 2023-11-28T18:36:24.795 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug trim objects = true 2023-11-28T18:36:24.795 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:36:24.795 INFO:teuthology.orchestra.run.smithi045.stdout: osd open classes on start = true 2023-11-28T18:36:24.795 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug pg log writeout = true 2023-11-28T18:36:24.795 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:36:24.796 INFO:teuthology.orchestra.run.smithi045.stdout: osd deep scrub update digest min age = 30 2023-11-28T18:36:24.796 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:36:24.796 INFO:teuthology.orchestra.run.smithi045.stdout: osd map max advance = 10 2023-11-28T18:36:24.796 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:36:24.796 INFO:teuthology.orchestra.run.smithi045.stdout: journal zero on create = true 2023-11-28T18:36:24.797 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:36:24.797 INFO:teuthology.orchestra.run.smithi045.stdout: filestore ondisk finisher threads = 3 2023-11-28T18:36:24.797 INFO:teuthology.orchestra.run.smithi045.stdout: filestore apply finisher threads = 3 2023-11-28T18:36:24.797 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:36:24.797 INFO:teuthology.orchestra.run.smithi045.stdout: bdev debug aio = true 2023-11-28T18:36:24.797 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug misdirected ops = true 2023-11-28T18:36:24.798 INFO:teuthology.orchestra.run.smithi045.stdout: bdev async discard = True 2023-11-28T18:36:24.798 INFO:teuthology.orchestra.run.smithi045.stdout: bdev enable discard = True 2023-11-28T18:36:24.798 INFO:teuthology.orchestra.run.smithi045.stdout: bluestore allocator = bitmap 2023-11-28T18:36:24.798 INFO:teuthology.orchestra.run.smithi045.stdout: bluestore block size = 96636764160 2023-11-28T18:36:24.798 INFO:teuthology.orchestra.run.smithi045.stdout: bluestore fsck on mount = True 2023-11-28T18:36:24.799 INFO:teuthology.orchestra.run.smithi045.stdout: debug bluefs = 1/20 2023-11-28T18:36:24.799 INFO:teuthology.orchestra.run.smithi045.stdout: debug bluestore = 1/20 2023-11-28T18:36:24.799 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-11-28T18:36:24.799 INFO:teuthology.orchestra.run.smithi045.stdout: debug osd = 20 2023-11-28T18:36:24.799 INFO:teuthology.orchestra.run.smithi045.stdout: debug rocksdb = 4/10 2023-11-28T18:36:24.800 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd backfillfull_ratio = 0.85 2023-11-28T18:36:24.800 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd full ratio = 0.9 2023-11-28T18:36:24.800 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd nearfull ratio = 0.8 2023-11-28T18:36:24.800 INFO:teuthology.orchestra.run.smithi045.stdout: osd failsafe full ratio = 0.95 2023-11-28T18:36:24.800 INFO:teuthology.orchestra.run.smithi045.stdout: osd objectstore = bluestore 2023-11-28T18:36:24.801 INFO:teuthology.orchestra.run.smithi045.stdout: osd op complaint time = 180 2023-11-28T18:36:24.801 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:36:24.801 INFO:teuthology.orchestra.run.smithi045.stdout:[mgr] 2023-11-28T18:36:24.801 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-11-28T18:36:24.801 INFO:teuthology.orchestra.run.smithi045.stdout: debug mgr = 20 2023-11-28T18:36:24.802 INFO:teuthology.orchestra.run.smithi045.stdout: debug mon = 20 2023-11-28T18:36:24.802 INFO:teuthology.orchestra.run.smithi045.stdout: debug auth = 20 2023-11-28T18:36:24.802 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min pgs per osd = 4 2023-11-28T18:36:24.802 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min bytes per osd = 10 2023-11-28T18:36:24.802 INFO:teuthology.orchestra.run.smithi045.stdout: mgr/telemetry/nag = false 2023-11-28T18:36:24.803 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:36:24.803 INFO:teuthology.orchestra.run.smithi045.stdout:[mon] 2023-11-28T18:36:24.803 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-11-28T18:36:24.803 INFO:teuthology.orchestra.run.smithi045.stdout: debug mon = 20 2023-11-28T18:36:24.804 INFO:teuthology.orchestra.run.smithi045.stdout: debug paxos = 20 2023-11-28T18:36:24.804 INFO:teuthology.orchestra.run.smithi045.stdout: debug auth = 20 2023-11-28T18:36:24.804 INFO:teuthology.orchestra.run.smithi045.stdout: mon data avail warn = 5 2023-11-28T18:36:24.804 INFO:teuthology.orchestra.run.smithi045.stdout: mon mgr mkfs grace = 240 2023-11-28T18:36:24.804 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min pgs per osd = 4 2023-11-28T18:36:24.804 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd reporter subtree level = osd 2023-11-28T18:36:24.805 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd prime pg temp = true 2023-11-28T18:36:24.805 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min bytes per osd = 10 2023-11-28T18:36:24.805 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:36:24.805 INFO:teuthology.orchestra.run.smithi045.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-28T18:36:24.805 INFO:teuthology.orchestra.run.smithi045.stdout: auth mon ticket ttl = 660 # 11m 2023-11-28T18:36:24.805 INFO:teuthology.orchestra.run.smithi045.stdout: auth service ticket ttl = 240 # 4m 2023-11-28T18:36:24.806 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:36:24.806 INFO:teuthology.orchestra.run.smithi045.stdout: # don't complain about insecure global_id in the test suite 2023-11-28T18:36:24.806 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-28T18:36:24.806 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-28T18:36:24.806 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:36:24.807 INFO:teuthology.orchestra.run.smithi045.stdout: # 1m isn't quite enough 2023-11-28T18:36:24.807 INFO:teuthology.orchestra.run.smithi045.stdout: mon_down_mkfs_grace = 2m 2023-11-28T18:36:24.807 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:36:24.807 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_filestore_osds = false 2023-11-28T18:36:24.807 INFO:teuthology.orchestra.run.smithi045.stdout: mon op complaint time = 120 2023-11-28T18:36:24.807 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:36:24.808 INFO:teuthology.orchestra.run.smithi045.stdout:[client] 2023-11-28T18:36:24.808 INFO:teuthology.orchestra.run.smithi045.stdout: rgw cache enabled = true 2023-11-28T18:36:24.808 INFO:teuthology.orchestra.run.smithi045.stdout: rgw enable ops log = true 2023-11-28T18:36:24.808 INFO:teuthology.orchestra.run.smithi045.stdout: rgw enable usage log = true 2023-11-28T18:36:24.808 INFO:teuthology.orchestra.run.smithi045.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-28T18:36:24.808 INFO:teuthology.orchestra.run.smithi045.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-28T18:36:24.809 INFO:teuthology.orchestra.run.smithi045.stdout: client mount timeout = 600 2023-11-28T18:36:24.809 INFO:teuthology.orchestra.run.smithi045.stdout: debug client = 20 2023-11-28T18:36:24.809 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-11-28T18:36:24.809 INFO:teuthology.orchestra.run.smithi045.stdout: pid file = "" 2023-11-28T18:36:24.809 INFO:teuthology.orchestra.run.smithi045.stdout: rados mon op timeout = 900 2023-11-28T18:36:24.810 INFO:teuthology.orchestra.run.smithi045.stdout: rados osd op timeout = 900 2023-11-28T18:36:24.810 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.a] 2023-11-28T18:36:24.810 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.b] 2023-11-28T18:36:24.810 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.c] 2023-11-28T18:36:24.810 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.a] 2023-11-28T18:36:24.810 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.c] 2023-11-28T18:36:24.811 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.b] 2023-11-28T18:36:24.811 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.d] 2023-11-28T18:36:24.811 INFO:teuthology.orchestra.run.smithi045.stdout:[mds] 2023-11-28T18:36:24.811 INFO:teuthology.orchestra.run.smithi045.stdout: debug mds = 20 2023-11-28T18:36:24.811 INFO:teuthology.orchestra.run.smithi045.stdout: debug mds balancer = 20 2023-11-28T18:36:24.812 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-11-28T18:36:24.812 INFO:teuthology.orchestra.run.smithi045.stdout: mds debug frag = True 2023-11-28T18:36:24.812 INFO:teuthology.orchestra.run.smithi045.stdout: mds debug scatterstat = True 2023-11-28T18:36:24.812 INFO:teuthology.orchestra.run.smithi045.stdout: mds op complaint time = 180 2023-11-28T18:36:24.812 INFO:teuthology.orchestra.run.smithi045.stdout: mds verify scatter = True 2023-11-28T18:36:24.812 INFO:teuthology.orchestra.run.smithi045.stdout: osd op complaint time = 180 2023-11-28T18:36:24.813 INFO:teuthology.orchestra.run.smithi045.stdout: rados mon op timeout = 900 2023-11-28T18:36:24.813 INFO:teuthology.orchestra.run.smithi045.stdout: rados osd op timeout = 900 2023-11-28T18:36:24.814 INFO:teuthology.orchestra.run.smithi190.stdout:[global] 2023-11-28T18:36:24.815 INFO:teuthology.orchestra.run.smithi190.stdout: chdir = "" 2023-11-28T18:36:24.815 INFO:teuthology.orchestra.run.smithi190.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-28T18:36:24.815 INFO:teuthology.orchestra.run.smithi190.stdout: auth supported = cephx 2023-11-28T18:36:24.815 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-11-28T18:36:24.815 INFO:teuthology.orchestra.run.smithi190.stdout: filestore xattr use omap = true 2023-11-28T18:36:24.815 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-11-28T18:36:24.816 INFO:teuthology.orchestra.run.smithi190.stdout: mon clock drift allowed = 1.000 2023-11-28T18:36:24.816 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-11-28T18:36:24.816 INFO:teuthology.orchestra.run.smithi190.stdout: osd crush chooseleaf type = 0 2023-11-28T18:36:24.816 INFO:teuthology.orchestra.run.smithi190.stdout: auth debug = true 2023-11-28T18:36:24.816 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-11-28T18:36:24.817 INFO:teuthology.orchestra.run.smithi190.stdout: ms die on old message = true 2023-11-28T18:36:24.817 INFO:teuthology.orchestra.run.smithi190.stdout: ms die on bug = true 2023-11-28T18:36:24.817 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-11-28T18:36:24.817 INFO:teuthology.orchestra.run.smithi190.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-28T18:36:24.817 INFO:teuthology.orchestra.run.smithi190.stdout: mon pg warn max object skew = 0 2023-11-28T18:36:24.817 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-11-28T18:36:24.818 INFO:teuthology.orchestra.run.smithi190.stdout: # disable pg_autoscaler by default for new pools 2023-11-28T18:36:24.818 INFO:teuthology.orchestra.run.smithi190.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-28T18:36:24.818 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-11-28T18:36:24.818 INFO:teuthology.orchestra.run.smithi190.stdout: osd pool default size = 2 2023-11-28T18:36:24.818 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-11-28T18:36:24.819 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd allow primary affinity = true 2023-11-28T18:36:24.819 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd allow pg remap = true 2023-11-28T18:36:24.819 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on legacy crush tunables = false 2023-11-28T18:36:24.819 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on crush straw calc version zero = false 2023-11-28T18:36:24.819 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on no sortbitwise = false 2023-11-28T18:36:24.820 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on osd down out interval zero = false 2023-11-28T18:36:24.820 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on too few osds = false 2023-11-28T18:36:24.820 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-28T18:36:24.820 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-28T18:36:24.820 INFO:teuthology.orchestra.run.smithi190.stdout: mon_allow_pool_size_one = true 2023-11-28T18:36:24.820 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-11-28T18:36:24.821 INFO:teuthology.orchestra.run.smithi190.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-28T18:36:24.822 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-11-28T18:36:24.822 INFO:teuthology.orchestra.run.smithi190.stdout: osd default data pool replay window = 5 2023-11-28T18:36:24.822 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-11-28T18:36:24.822 INFO:teuthology.orchestra.run.smithi190.stdout: mon allow pool delete = true 2023-11-28T18:36:24.822 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-11-28T18:36:24.822 INFO:teuthology.orchestra.run.smithi190.stdout: mon cluster log file level = debug 2023-11-28T18:36:24.823 INFO:teuthology.orchestra.run.smithi190.stdout: debug asserts on shutdown = true 2023-11-28T18:36:24.823 INFO:teuthology.orchestra.run.smithi190.stdout: mon health detail to clog = false 2023-11-28T18:36:24.823 INFO:teuthology.orchestra.run.smithi190.stdout: mon host = "172.21.15.45,172.21.15.190,[v2:172.21.15.190:3301,v1:172.21.15.190:6790]" 2023-11-28T18:36:24.823 INFO:teuthology.orchestra.run.smithi190.stdout: fsid = d10f5cd6-1d00-4019-99b6-6fa435498a15 2023-11-28T18:36:24.823 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-11-28T18:36:24.824 INFO:teuthology.orchestra.run.smithi190.stdout:[osd] 2023-11-28T18:36:24.824 INFO:teuthology.orchestra.run.smithi190.stdout: osd journal size = 100 2023-11-28T18:36:24.824 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-11-28T18:36:24.824 INFO:teuthology.orchestra.run.smithi190.stdout: osd scrub load threshold = 5.0 2023-11-28T18:36:24.824 INFO:teuthology.orchestra.run.smithi190.stdout: osd scrub max interval = 600 2023-11-28T18:36:24.824 INFO:teuthology.orchestra.run.smithi190.stdout: osd mclock profile = high_recovery_ops 2023-11-28T18:36:24.825 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-11-28T18:36:24.825 INFO:teuthology.orchestra.run.smithi190.stdout: osd recover clone overlap = true 2023-11-28T18:36:24.825 INFO:teuthology.orchestra.run.smithi190.stdout: osd recovery max chunk = 1048576 2023-11-28T18:36:24.825 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-11-28T18:36:24.825 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug shutdown = true 2023-11-28T18:36:24.826 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug op order = true 2023-11-28T18:36:24.826 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug verify stray on activate = true 2023-11-28T18:36:24.826 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug trim objects = true 2023-11-28T18:36:24.826 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-11-28T18:36:24.827 INFO:teuthology.orchestra.run.smithi190.stdout: osd open classes on start = true 2023-11-28T18:36:24.827 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug pg log writeout = true 2023-11-28T18:36:24.827 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-11-28T18:36:24.827 INFO:teuthology.orchestra.run.smithi190.stdout: osd deep scrub update digest min age = 30 2023-11-28T18:36:24.827 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-11-28T18:36:24.827 INFO:teuthology.orchestra.run.smithi190.stdout: osd map max advance = 10 2023-11-28T18:36:24.828 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-11-28T18:36:24.828 INFO:teuthology.orchestra.run.smithi190.stdout: journal zero on create = true 2023-11-28T18:36:24.829 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-11-28T18:36:24.829 INFO:teuthology.orchestra.run.smithi190.stdout: filestore ondisk finisher threads = 3 2023-11-28T18:36:24.830 INFO:teuthology.orchestra.run.smithi190.stdout: filestore apply finisher threads = 3 2023-11-28T18:36:24.830 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-11-28T18:36:24.830 INFO:teuthology.orchestra.run.smithi190.stdout: bdev debug aio = true 2023-11-28T18:36:24.831 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug misdirected ops = true 2023-11-28T18:36:24.831 INFO:teuthology.orchestra.run.smithi190.stdout: bdev async discard = True 2023-11-28T18:36:24.831 INFO:teuthology.orchestra.run.smithi190.stdout: bdev enable discard = True 2023-11-28T18:36:24.832 INFO:teuthology.orchestra.run.smithi190.stdout: bluestore allocator = bitmap 2023-11-28T18:36:24.832 INFO:teuthology.orchestra.run.smithi190.stdout: bluestore block size = 96636764160 2023-11-28T18:36:24.832 INFO:teuthology.orchestra.run.smithi190.stdout: bluestore fsck on mount = True 2023-11-28T18:36:24.832 INFO:teuthology.orchestra.run.smithi190.stdout: debug bluefs = 1/20 2023-11-28T18:36:24.832 INFO:teuthology.orchestra.run.smithi190.stdout: debug bluestore = 1/20 2023-11-28T18:36:24.832 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2023-11-28T18:36:24.833 INFO:teuthology.orchestra.run.smithi190.stdout: debug osd = 20 2023-11-28T18:36:24.833 INFO:teuthology.orchestra.run.smithi190.stdout: debug rocksdb = 4/10 2023-11-28T18:36:24.834 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd backfillfull_ratio = 0.85 2023-11-28T18:36:24.834 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd full ratio = 0.9 2023-11-28T18:36:24.834 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd nearfull ratio = 0.8 2023-11-28T18:36:24.834 INFO:teuthology.orchestra.run.smithi190.stdout: osd failsafe full ratio = 0.95 2023-11-28T18:36:24.835 INFO:teuthology.orchestra.run.smithi190.stdout: osd objectstore = bluestore 2023-11-28T18:36:24.835 INFO:teuthology.orchestra.run.smithi190.stdout: osd op complaint time = 180 2023-11-28T18:36:24.835 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-11-28T18:36:24.835 INFO:teuthology.orchestra.run.smithi190.stdout:[mgr] 2023-11-28T18:36:24.835 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2023-11-28T18:36:24.835 INFO:teuthology.orchestra.run.smithi190.stdout: debug mgr = 20 2023-11-28T18:36:24.836 INFO:teuthology.orchestra.run.smithi190.stdout: debug mon = 20 2023-11-28T18:36:24.836 INFO:teuthology.orchestra.run.smithi190.stdout: debug auth = 20 2023-11-28T18:36:24.836 INFO:teuthology.orchestra.run.smithi190.stdout: mon reweight min pgs per osd = 4 2023-11-28T18:36:24.836 INFO:teuthology.orchestra.run.smithi190.stdout: mon reweight min bytes per osd = 10 2023-11-28T18:36:24.836 INFO:teuthology.orchestra.run.smithi190.stdout: mgr/telemetry/nag = false 2023-11-28T18:36:24.837 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-11-28T18:36:24.837 INFO:teuthology.orchestra.run.smithi190.stdout:[mon] 2023-11-28T18:36:24.838 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2023-11-28T18:36:24.838 INFO:teuthology.orchestra.run.smithi190.stdout: debug mon = 20 2023-11-28T18:36:24.838 INFO:teuthology.orchestra.run.smithi190.stdout: debug paxos = 20 2023-11-28T18:36:24.838 INFO:teuthology.orchestra.run.smithi190.stdout: debug auth = 20 2023-11-28T18:36:24.839 INFO:teuthology.orchestra.run.smithi190.stdout: mon data avail warn = 5 2023-11-28T18:36:24.839 INFO:teuthology.orchestra.run.smithi190.stdout: mon mgr mkfs grace = 240 2023-11-28T18:36:24.839 INFO:teuthology.orchestra.run.smithi190.stdout: mon reweight min pgs per osd = 4 2023-11-28T18:36:24.840 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd reporter subtree level = osd 2023-11-28T18:36:24.840 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd prime pg temp = true 2023-11-28T18:36:24.840 INFO:teuthology.orchestra.run.smithi190.stdout: mon reweight min bytes per osd = 10 2023-11-28T18:36:24.840 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-11-28T18:36:24.841 INFO:teuthology.orchestra.run.smithi190.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-28T18:36:24.841 INFO:teuthology.orchestra.run.smithi190.stdout: auth mon ticket ttl = 660 # 11m 2023-11-28T18:36:24.841 INFO:teuthology.orchestra.run.smithi190.stdout: auth service ticket ttl = 240 # 4m 2023-11-28T18:36:24.841 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-11-28T18:36:24.841 INFO:teuthology.orchestra.run.smithi190.stdout: # don't complain about insecure global_id in the test suite 2023-11-28T18:36:24.842 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-28T18:36:24.842 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-28T18:36:24.842 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-11-28T18:36:24.842 INFO:teuthology.orchestra.run.smithi190.stdout: # 1m isn't quite enough 2023-11-28T18:36:24.842 INFO:teuthology.orchestra.run.smithi190.stdout: mon_down_mkfs_grace = 2m 2023-11-28T18:36:24.843 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-11-28T18:36:24.843 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_filestore_osds = false 2023-11-28T18:36:24.843 INFO:teuthology.orchestra.run.smithi190.stdout: mon op complaint time = 120 2023-11-28T18:36:24.843 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-11-28T18:36:24.843 INFO:teuthology.orchestra.run.smithi190.stdout:[client] 2023-11-28T18:36:24.843 INFO:teuthology.orchestra.run.smithi190.stdout: rgw cache enabled = true 2023-11-28T18:36:24.844 INFO:teuthology.orchestra.run.smithi190.stdout: rgw enable ops log = true 2023-11-28T18:36:24.844 INFO:teuthology.orchestra.run.smithi190.stdout: rgw enable usage log = true 2023-11-28T18:36:24.844 INFO:teuthology.orchestra.run.smithi190.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-28T18:36:24.844 INFO:teuthology.orchestra.run.smithi190.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-28T18:36:24.844 INFO:teuthology.orchestra.run.smithi190.stdout: client mount timeout = 600 2023-11-28T18:36:24.844 INFO:teuthology.orchestra.run.smithi190.stdout: debug client = 20 2023-11-28T18:36:24.845 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2023-11-28T18:36:24.845 INFO:teuthology.orchestra.run.smithi190.stdout: pid file = "" 2023-11-28T18:36:24.845 INFO:teuthology.orchestra.run.smithi190.stdout: rados mon op timeout = 900 2023-11-28T18:36:24.845 INFO:teuthology.orchestra.run.smithi190.stdout: rados osd op timeout = 900 2023-11-28T18:36:24.845 INFO:teuthology.orchestra.run.smithi190.stdout:[mon.a] 2023-11-28T18:36:24.846 INFO:teuthology.orchestra.run.smithi190.stdout:[mon.b] 2023-11-28T18:36:24.846 INFO:teuthology.orchestra.run.smithi190.stdout:[mon.c] 2023-11-28T18:36:24.846 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.a] 2023-11-28T18:36:24.846 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.c] 2023-11-28T18:36:24.846 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.b] 2023-11-28T18:36:24.847 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.d] 2023-11-28T18:36:24.847 INFO:teuthology.orchestra.run.smithi190.stdout:[mds] 2023-11-28T18:36:24.847 INFO:teuthology.orchestra.run.smithi190.stdout: debug mds = 20 2023-11-28T18:36:24.847 INFO:teuthology.orchestra.run.smithi190.stdout: debug mds balancer = 20 2023-11-28T18:36:24.847 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2023-11-28T18:36:24.847 INFO:teuthology.orchestra.run.smithi190.stdout: mds debug frag = True 2023-11-28T18:36:24.848 INFO:teuthology.orchestra.run.smithi190.stdout: mds debug scatterstat = True 2023-11-28T18:36:24.848 INFO:teuthology.orchestra.run.smithi190.stdout: mds op complaint time = 180 2023-11-28T18:36:24.848 INFO:teuthology.orchestra.run.smithi190.stdout: mds verify scatter = True 2023-11-28T18:36:24.848 INFO:teuthology.orchestra.run.smithi190.stdout: osd op complaint time = 180 2023-11-28T18:36:24.849 INFO:teuthology.orchestra.run.smithi190.stdout: rados mon op timeout = 900 2023-11-28T18:36:24.849 INFO:teuthology.orchestra.run.smithi190.stdout: rados osd op timeout = 900 2023-11-28T18:36:24.849 INFO:tasks.ceph:Creating admin key on mon.a... 2023-11-28T18:36:24.849 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-11-28T18:36:24.915 INFO:tasks.ceph:Copying monmap to all nodes... 2023-11-28T18:36:24.916 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T18:36:24.916 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-11-28T18:36:24.925 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T18:36:24.925 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-11-28T18:36:24.981 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi045.front.sepia.ceph.com 2023-11-28T18:36:24.981 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T18:36:24.982 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-28T18:36:24.982 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-28T18:36:25.058 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T18:36:25.059 DEBUG:teuthology.orchestra.run.smithi045:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-28T18:36:25.109 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi190.front.sepia.ceph.com 2023-11-28T18:36:25.109 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-28T18:36:25.109 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-28T18:36:25.109 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-28T18:36:25.146 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-28T18:36:25.147 DEBUG:teuthology.orchestra.run.smithi190:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-28T18:36:25.199 INFO:tasks.ceph:Setting up mon nodes... 2023-11-28T18:36:25.199 INFO:tasks.ceph:Setting up mgr nodes... 2023-11-28T18:36:25.199 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-11-28T18:36:25.258 INFO:teuthology.orchestra.run.smithi045.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-11-28T18:36:25.264 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-11-28T18:36:25.325 INFO:teuthology.orchestra.run.smithi190.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-11-28T18:36:25.340 INFO:tasks.ceph:Setting up mds nodes... 2023-11-28T18:36:25.340 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-11-28T18:36:25.399 INFO:teuthology.orchestra.run.smithi045.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-11-28T18:36:25.403 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-11-28T18:36:25.425 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-11-28T18:36:25.527 INFO:teuthology.orchestra.run.smithi045.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-11-28T18:36:25.531 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-11-28T18:36:25.552 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-11-28T18:36:25.613 INFO:teuthology.orchestra.run.smithi190.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-11-28T18:36:25.618 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-11-28T18:36:25.639 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-11-28T18:36:25.738 INFO:teuthology.orchestra.run.smithi190.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-11-28T18:36:25.743 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-11-28T18:36:25.763 INFO:tasks.ceph_client:Setting up client nodes... 2023-11-28T18:36:25.763 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-11-28T18:36:25.809 INFO:teuthology.orchestra.run.smithi045.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-11-28T18:36:25.826 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-11-28T18:36:25.912 INFO:teuthology.orchestra.run.smithi045.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-11-28T18:36:25.930 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-11-28T18:36:25.973 INFO:teuthology.orchestra.run.smithi190.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-11-28T18:36:25.991 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-11-28T18:36:26.076 INFO:teuthology.orchestra.run.smithi190.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-11-28T18:36:26.093 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-11-28T18:36:26.094 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi045.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi190.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-28T18:36:26.094 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-11-28T18:36:26.116 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-28T18:36:26.116 INFO:tasks.ceph:role: osd.0 2023-11-28T18:36:26.116 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi045.front.sepia.ceph.com 2023-11-28T18:36:26.116 DEBUG:teuthology.orchestra.run.smithi045:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-28T18:36:26.177 INFO:teuthology.orchestra.run.smithi045.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T18:36:26.177 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T18:36:26.177 INFO:teuthology.orchestra.run.smithi045.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T18:36:26.177 INFO:teuthology.orchestra.run.smithi045.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T18:36:26.177 INFO:teuthology.orchestra.run.smithi045.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T18:36:26.177 INFO:teuthology.orchestra.run.smithi045.stdout: = sunit=0 swidth=0 blks 2023-11-28T18:36:26.177 INFO:teuthology.orchestra.run.smithi045.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T18:36:26.177 INFO:teuthology.orchestra.run.smithi045.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T18:36:26.178 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T18:36:26.178 INFO:teuthology.orchestra.run.smithi045.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T18:36:26.201 INFO:teuthology.orchestra.run.smithi045.stdout:Discarding blocks...Done. 2023-11-28T18:36:26.206 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi045.front.sepia.ceph.com -o noatime 2023-11-28T18:36:26.206 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-11-28T18:36:26.275 DEBUG:teuthology.orchestra.run.smithi045:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-11-28T18:36:26.333 INFO:teuthology.orchestra.run.smithi045.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T18:36:26.334 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T18:36:26.334 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-11-28T18:36:26.397 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-28T18:36:26.397 INFO:tasks.ceph:role: osd.1 2023-11-28T18:36:26.397 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi045.front.sepia.ceph.com 2023-11-28T18:36:26.397 DEBUG:teuthology.orchestra.run.smithi045:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-28T18:36:26.465 INFO:teuthology.orchestra.run.smithi045.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T18:36:26.465 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T18:36:26.465 INFO:teuthology.orchestra.run.smithi045.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T18:36:26.465 INFO:teuthology.orchestra.run.smithi045.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T18:36:26.465 INFO:teuthology.orchestra.run.smithi045.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T18:36:26.466 INFO:teuthology.orchestra.run.smithi045.stdout: = sunit=0 swidth=0 blks 2023-11-28T18:36:26.466 INFO:teuthology.orchestra.run.smithi045.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T18:36:26.466 INFO:teuthology.orchestra.run.smithi045.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T18:36:26.466 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T18:36:26.467 INFO:teuthology.orchestra.run.smithi045.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T18:36:26.489 INFO:teuthology.orchestra.run.smithi045.stdout:Discarding blocks...Done. 2023-11-28T18:36:26.492 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi045.front.sepia.ceph.com -o noatime 2023-11-28T18:36:26.492 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-11-28T18:36:26.562 DEBUG:teuthology.orchestra.run.smithi045:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-11-28T18:36:26.621 INFO:teuthology.orchestra.run.smithi045.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T18:36:26.621 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T18:36:26.622 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-11-28T18:36:26.685 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-28T18:36:26.685 INFO:tasks.ceph:role: osd.2 2023-11-28T18:36:26.685 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi045.front.sepia.ceph.com 2023-11-28T18:36:26.685 DEBUG:teuthology.orchestra.run.smithi045:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-28T18:36:26.749 INFO:teuthology.orchestra.run.smithi045.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T18:36:26.749 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T18:36:26.749 INFO:teuthology.orchestra.run.smithi045.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T18:36:26.749 INFO:teuthology.orchestra.run.smithi045.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T18:36:26.749 INFO:teuthology.orchestra.run.smithi045.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T18:36:26.749 INFO:teuthology.orchestra.run.smithi045.stdout: = sunit=0 swidth=0 blks 2023-11-28T18:36:26.749 INFO:teuthology.orchestra.run.smithi045.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T18:36:26.749 INFO:teuthology.orchestra.run.smithi045.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T18:36:26.750 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T18:36:26.750 INFO:teuthology.orchestra.run.smithi045.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T18:36:26.773 INFO:teuthology.orchestra.run.smithi045.stdout:Discarding blocks...Done. 2023-11-28T18:36:26.776 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi045.front.sepia.ceph.com -o noatime 2023-11-28T18:36:26.776 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-11-28T18:36:26.843 DEBUG:teuthology.orchestra.run.smithi045:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-11-28T18:36:26.901 INFO:teuthology.orchestra.run.smithi045.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T18:36:26.902 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T18:36:26.902 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-11-28T18:36:26.966 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-28T18:36:26.966 INFO:tasks.ceph:role: osd.3 2023-11-28T18:36:26.966 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi045.front.sepia.ceph.com 2023-11-28T18:36:26.966 DEBUG:teuthology.orchestra.run.smithi045:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-28T18:36:27.028 INFO:teuthology.orchestra.run.smithi045.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T18:36:27.029 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T18:36:27.029 INFO:teuthology.orchestra.run.smithi045.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T18:36:27.029 INFO:teuthology.orchestra.run.smithi045.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T18:36:27.029 INFO:teuthology.orchestra.run.smithi045.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T18:36:27.029 INFO:teuthology.orchestra.run.smithi045.stdout: = sunit=0 swidth=0 blks 2023-11-28T18:36:27.029 INFO:teuthology.orchestra.run.smithi045.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T18:36:27.029 INFO:teuthology.orchestra.run.smithi045.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T18:36:27.029 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T18:36:27.030 INFO:teuthology.orchestra.run.smithi045.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T18:36:27.055 INFO:teuthology.orchestra.run.smithi045.stdout:Discarding blocks...Done. 2023-11-28T18:36:27.057 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi045.front.sepia.ceph.com -o noatime 2023-11-28T18:36:27.058 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-11-28T18:36:27.126 DEBUG:teuthology.orchestra.run.smithi045:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-11-28T18:36:27.185 INFO:teuthology.orchestra.run.smithi045.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T18:36:27.186 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T18:36:27.186 DEBUG:teuthology.orchestra.run.smithi045:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T18:36:27.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:36:27.301+0000 7fb63b1e1640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-11-28T18:36:27.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:36:27.301+0000 7fb63b1e1640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-11-28T18:36:27.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:36:27.301+0000 7fb63b1e1640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-28T18:36:27.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:36:27.301+0000 7fb63b1e1640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-28T18:36:27.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:36:27.301+0000 7fb63b1e1640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-28T18:36:27.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:36:27.301+0000 7fb63b1e1640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-11-28T18:36:30.306 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-11-28T18:36:30.327 DEBUG:teuthology.orchestra.run.smithi045:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T18:36:30.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:36:30.429+0000 7fa75a796640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-11-28T18:36:30.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:36:30.429+0000 7fa75a796640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-11-28T18:36:30.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:36:30.429+0000 7fa75a796640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-28T18:36:30.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:36:30.429+0000 7fa75a796640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-28T18:36:30.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:36:30.429+0000 7fa75a796640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-28T18:36:30.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:36:30.429+0000 7fa75a796640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-11-28T18:36:33.404 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-11-28T18:36:33.427 DEBUG:teuthology.orchestra.run.smithi045:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T18:36:33.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:36:33.525+0000 7f2334895640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-11-28T18:36:33.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:36:33.525+0000 7f2334895640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-11-28T18:36:33.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:36:33.525+0000 7f2334895640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-28T18:36:33.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:36:33.525+0000 7f2334895640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-28T18:36:33.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:36:33.525+0000 7f2334895640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-28T18:36:33.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:36:33.525+0000 7f2334895640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-11-28T18:36:36.540 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-11-28T18:36:36.561 DEBUG:teuthology.orchestra.run.smithi045:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T18:36:36.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:36:36.665+0000 7f28a2cfd640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-11-28T18:36:36.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:36:36.665+0000 7f28a2cfd640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-11-28T18:36:36.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:36:36.665+0000 7f28a2cfd640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-28T18:36:36.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:36:36.665+0000 7f28a2cfd640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-28T18:36:36.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:36:36.665+0000 7f28a2cfd640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-28T18:36:36.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:36:36.665+0000 7f28a2cfd640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-11-28T18:36:39.660 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-11-28T18:36:39.681 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-11-28T18:36:39.704 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-28T18:36:39.705 INFO:tasks.ceph:role: osd.4 2023-11-28T18:36:39.705 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi190.front.sepia.ceph.com 2023-11-28T18:36:39.705 DEBUG:teuthology.orchestra.run.smithi190:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-28T18:36:39.780 INFO:teuthology.orchestra.run.smithi190.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T18:36:39.780 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T18:36:39.780 INFO:teuthology.orchestra.run.smithi190.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T18:36:39.780 INFO:teuthology.orchestra.run.smithi190.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T18:36:39.781 INFO:teuthology.orchestra.run.smithi190.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T18:36:39.781 INFO:teuthology.orchestra.run.smithi190.stdout: = sunit=0 swidth=0 blks 2023-11-28T18:36:39.781 INFO:teuthology.orchestra.run.smithi190.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T18:36:39.781 INFO:teuthology.orchestra.run.smithi190.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T18:36:39.781 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T18:36:39.781 INFO:teuthology.orchestra.run.smithi190.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T18:36:40.234 INFO:teuthology.orchestra.run.smithi190.stdout:Discarding blocks...Done. 2023-11-28T18:36:40.237 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi190.front.sepia.ceph.com -o noatime 2023-11-28T18:36:40.237 DEBUG:teuthology.orchestra.run.smithi190:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-11-28T18:36:40.343 DEBUG:teuthology.orchestra.run.smithi190:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-11-28T18:36:40.360 INFO:teuthology.orchestra.run.smithi190.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T18:36:40.361 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T18:36:40.361 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-11-28T18:36:40.423 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-28T18:36:40.424 INFO:tasks.ceph:role: osd.5 2023-11-28T18:36:40.424 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi190.front.sepia.ceph.com 2023-11-28T18:36:40.424 DEBUG:teuthology.orchestra.run.smithi190:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-28T18:36:40.496 INFO:teuthology.orchestra.run.smithi190.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T18:36:40.496 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T18:36:40.496 INFO:teuthology.orchestra.run.smithi190.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T18:36:40.496 INFO:teuthology.orchestra.run.smithi190.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T18:36:40.496 INFO:teuthology.orchestra.run.smithi190.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T18:36:40.496 INFO:teuthology.orchestra.run.smithi190.stdout: = sunit=0 swidth=0 blks 2023-11-28T18:36:40.496 INFO:teuthology.orchestra.run.smithi190.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T18:36:40.496 INFO:teuthology.orchestra.run.smithi190.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T18:36:40.497 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T18:36:40.497 INFO:teuthology.orchestra.run.smithi190.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T18:36:40.963 INFO:teuthology.orchestra.run.smithi190.stdout:Discarding blocks...Done. 2023-11-28T18:36:40.966 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi190.front.sepia.ceph.com -o noatime 2023-11-28T18:36:40.967 DEBUG:teuthology.orchestra.run.smithi190:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-11-28T18:36:41.129 DEBUG:teuthology.orchestra.run.smithi190:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-11-28T18:36:41.147 INFO:teuthology.orchestra.run.smithi190.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T18:36:41.148 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T18:36:41.149 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-11-28T18:36:41.212 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-28T18:36:41.212 INFO:tasks.ceph:role: osd.6 2023-11-28T18:36:41.212 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi190.front.sepia.ceph.com 2023-11-28T18:36:41.212 DEBUG:teuthology.orchestra.run.smithi190:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-28T18:36:41.287 INFO:teuthology.orchestra.run.smithi190.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T18:36:41.288 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T18:36:41.288 INFO:teuthology.orchestra.run.smithi190.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T18:36:41.288 INFO:teuthology.orchestra.run.smithi190.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T18:36:41.288 INFO:teuthology.orchestra.run.smithi190.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T18:36:41.288 INFO:teuthology.orchestra.run.smithi190.stdout: = sunit=0 swidth=0 blks 2023-11-28T18:36:41.288 INFO:teuthology.orchestra.run.smithi190.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T18:36:41.288 INFO:teuthology.orchestra.run.smithi190.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T18:36:41.288 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T18:36:41.288 INFO:teuthology.orchestra.run.smithi190.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T18:36:41.769 INFO:teuthology.orchestra.run.smithi190.stdout:Discarding blocks...Done. 2023-11-28T18:36:41.772 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi190.front.sepia.ceph.com -o noatime 2023-11-28T18:36:41.772 DEBUG:teuthology.orchestra.run.smithi190:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-11-28T18:36:41.907 DEBUG:teuthology.orchestra.run.smithi190:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-11-28T18:36:41.925 INFO:teuthology.orchestra.run.smithi190.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T18:36:41.925 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T18:36:41.926 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-11-28T18:36:41.998 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-28T18:36:41.998 INFO:tasks.ceph:role: osd.7 2023-11-28T18:36:41.998 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi190.front.sepia.ceph.com 2023-11-28T18:36:41.998 DEBUG:teuthology.orchestra.run.smithi190:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-28T18:36:42.071 INFO:teuthology.orchestra.run.smithi190.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T18:36:42.072 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T18:36:42.072 INFO:teuthology.orchestra.run.smithi190.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T18:36:42.072 INFO:teuthology.orchestra.run.smithi190.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T18:36:42.072 INFO:teuthology.orchestra.run.smithi190.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T18:36:42.072 INFO:teuthology.orchestra.run.smithi190.stdout: = sunit=0 swidth=0 blks 2023-11-28T18:36:42.072 INFO:teuthology.orchestra.run.smithi190.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T18:36:42.072 INFO:teuthology.orchestra.run.smithi190.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T18:36:42.072 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T18:36:42.072 INFO:teuthology.orchestra.run.smithi190.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T18:36:42.506 INFO:teuthology.orchestra.run.smithi190.stdout:Discarding blocks...Done. 2023-11-28T18:36:42.509 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi190.front.sepia.ceph.com -o noatime 2023-11-28T18:36:42.509 DEBUG:teuthology.orchestra.run.smithi190:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-11-28T18:36:42.603 DEBUG:teuthology.orchestra.run.smithi190:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-11-28T18:36:42.667 INFO:teuthology.orchestra.run.smithi190.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T18:36:42.668 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T18:36:42.669 DEBUG:teuthology.orchestra.run.smithi190:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T18:36:42.805 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:36:42.804+0000 7fb4ead31640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-11-28T18:36:42.807 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:36:42.808+0000 7fb4ead31640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-11-28T18:36:42.807 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:36:42.808+0000 7fb4ead31640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-28T18:36:42.807 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:36:42.808+0000 7fb4ead31640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-28T18:36:42.807 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:36:42.808+0000 7fb4ead31640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-28T18:36:42.812 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:36:42.812+0000 7fb4ead31640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-11-28T18:36:45.809 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-11-28T18:36:45.831 DEBUG:teuthology.orchestra.run.smithi190:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T18:36:45.929 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:36:45.928+0000 7f552478f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-11-28T18:36:45.931 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:36:45.928+0000 7f552478f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-11-28T18:36:45.931 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:36:45.928+0000 7f552478f640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-28T18:36:45.931 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:36:45.928+0000 7f552478f640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-28T18:36:45.931 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:36:45.928+0000 7f552478f640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-28T18:36:45.932 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:36:45.932+0000 7f552478f640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-11-28T18:36:48.915 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-11-28T18:36:48.936 DEBUG:teuthology.orchestra.run.smithi190:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T18:36:49.035 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:36:49.035+0000 7f4a1cad4640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-11-28T18:36:49.036 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:36:49.035+0000 7f4a1cad4640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-11-28T18:36:49.036 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:36:49.035+0000 7f4a1cad4640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-28T18:36:49.036 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:36:49.035+0000 7f4a1cad4640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-28T18:36:49.036 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:36:49.035+0000 7f4a1cad4640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-28T18:36:49.037 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:36:49.035+0000 7f4a1cad4640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-11-28T18:36:52.031 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-11-28T18:36:52.054 DEBUG:teuthology.orchestra.run.smithi190:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T18:36:52.152 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:36:52.151+0000 7fd983e2f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-11-28T18:36:52.153 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:36:52.151+0000 7fd983e2f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-11-28T18:36:52.153 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:36:52.151+0000 7fd983e2f640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-28T18:36:52.153 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:36:52.151+0000 7fd983e2f640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-28T18:36:52.154 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:36:52.151+0000 7fd983e2f640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-28T18:36:52.154 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:36:52.151+0000 7fd983e2f640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-11-28T18:36:52.883 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:36:52.888 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:36:55.133 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-11-28T18:36:55.154 INFO:tasks.ceph:Reading keys from all nodes... 2023-11-28T18:36:55.154 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T18:36:55.154 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-11-28T18:36:55.179 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T18:36:55.179 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-11-28T18:36:55.244 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T18:36:55.244 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-11-28T18:36:55.311 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T18:36:55.311 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-11-28T18:36:55.375 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T18:36:55.375 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-11-28T18:36:55.442 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T18:36:55.443 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-11-28T18:36:55.506 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T18:36:55.507 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-11-28T18:36:55.570 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-28T18:36:55.571 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-11-28T18:36:55.593 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-28T18:36:55.593 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-11-28T18:36:55.656 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-28T18:36:55.656 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-11-28T18:36:55.720 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-28T18:36:55.720 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-11-28T18:36:55.784 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-28T18:36:55.784 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-11-28T18:36:55.848 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-28T18:36:55.848 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-11-28T18:36:55.912 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-28T18:36:55.912 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-11-28T18:36:55.976 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T18:36:55.976 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-11-28T18:36:55.985 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T18:36:55.986 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-11-28T18:36:56.039 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-28T18:36:56.039 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-11-28T18:36:56.048 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-28T18:36:56.048 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-11-28T18:36:56.099 INFO:tasks.ceph:Adding keys to all mons... 2023-11-28T18:36:56.100 DEBUG:teuthology.orchestra.run.smithi045:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-28T18:36:56.104 DEBUG:teuthology.orchestra.run.smithi190:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-28T18:36:56.147 INFO:teuthology.orchestra.run.smithi045.stdout:[mgr.y] 2023-11-28T18:36:56.147 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQApM2ZlnK1sDxAAfGqLMBH8IHZdQ7he/TVa6w== 2023-11-28T18:36:56.147 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.a] 2023-11-28T18:36:56.147 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQApM2ZlwyjdFxAAPGPzbFeQHiSnfmd6fx12HA== 2023-11-28T18:36:56.147 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.c] 2023-11-28T18:36:56.147 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQApM2Zl7guBHxAA42VxKvKwW30qtt+nyQZ4Aw== 2023-11-28T18:36:56.147 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.0] 2023-11-28T18:36:56.148 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQArM2ZluGYOEhAAOKSw2u1izQOjdoRctC8s7g== 2023-11-28T18:36:56.148 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.1] 2023-11-28T18:36:56.148 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQAuM2ZlIFuuGRAAK+YCnRUy8yKlojp9gukUYw== 2023-11-28T18:36:56.148 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.2] 2023-11-28T18:36:56.148 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQAxM2ZlOytnHxAAxXh2AsKCqrG5iYdmnF9+Qg== 2023-11-28T18:36:56.148 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.3] 2023-11-28T18:36:56.148 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQA0M2Zl2fnBJxAAv68KZJFnQWwyUupB+whAEg== 2023-11-28T18:36:56.148 INFO:teuthology.orchestra.run.smithi045.stdout:[mgr.x] 2023-11-28T18:36:56.148 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQApM2ZlVReeExAAlYEJ4EwbGHtSUIkimoiJ2Q== 2023-11-28T18:36:56.148 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.b] 2023-11-28T18:36:56.148 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQApM2ZlrJe9JBAAV2uXCF1nOYAUZf9Vm6BIWQ== 2023-11-28T18:36:56.148 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.d] 2023-11-28T18:36:56.148 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQApM2Zl1xU7LBAAHQ+Co90EW5qv+8793OyE/A== 2023-11-28T18:36:56.149 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.4] 2023-11-28T18:36:56.149 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQA6M2ZllZg1MBAAzvMRW0IZnwwqfzhJ7wWjjQ== 2023-11-28T18:36:56.149 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.5] 2023-11-28T18:36:56.149 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQA9M2Zlq0KjNxAAXOkL+JS09zzWRoPlgPGx+A== 2023-11-28T18:36:56.149 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.6] 2023-11-28T18:36:56.149 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQBBM2ZlVUVPAhAAurFCH6ubc+fXb8cUcg2nIg== 2023-11-28T18:36:56.149 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.7] 2023-11-28T18:36:56.149 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQBEM2ZlD846CRAA7GWGdOzRdv8vN7YbQyU4NQ== 2023-11-28T18:36:56.149 INFO:teuthology.orchestra.run.smithi045.stdout:[client.0] 2023-11-28T18:36:56.149 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQApM2ZlTJxNMBAAwJAMWm1Y180iNJmgHnWFnw== 2023-11-28T18:36:56.149 INFO:teuthology.orchestra.run.smithi045.stdout:[client.2] 2023-11-28T18:36:56.149 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQApM2ZlhvR6NhAAbs7Rqb1gatb4fymZ2IHy5w== 2023-11-28T18:36:56.150 INFO:teuthology.orchestra.run.smithi045.stdout:[client.1] 2023-11-28T18:36:56.150 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQApM2Zl7yM7OhAA+Nu2Ay/zIVuRsCk90QGWbg== 2023-11-28T18:36:56.150 INFO:teuthology.orchestra.run.smithi045.stdout:[client.3] 2023-11-28T18:36:56.150 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQAqM2ZlsarFBBAA1avYCNMV4t4UGM00iN6XiQ== 2023-11-28T18:36:56.162 INFO:teuthology.orchestra.run.smithi190.stdout:[mgr.y] 2023-11-28T18:36:56.162 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQApM2ZlnK1sDxAAfGqLMBH8IHZdQ7he/TVa6w== 2023-11-28T18:36:56.162 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.a] 2023-11-28T18:36:56.162 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQApM2ZlwyjdFxAAPGPzbFeQHiSnfmd6fx12HA== 2023-11-28T18:36:56.162 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.c] 2023-11-28T18:36:56.163 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQApM2Zl7guBHxAA42VxKvKwW30qtt+nyQZ4Aw== 2023-11-28T18:36:56.163 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.0] 2023-11-28T18:36:56.163 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQArM2ZluGYOEhAAOKSw2u1izQOjdoRctC8s7g== 2023-11-28T18:36:56.163 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.1] 2023-11-28T18:36:56.163 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQAuM2ZlIFuuGRAAK+YCnRUy8yKlojp9gukUYw== 2023-11-28T18:36:56.163 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.2] 2023-11-28T18:36:56.163 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQAxM2ZlOytnHxAAxXh2AsKCqrG5iYdmnF9+Qg== 2023-11-28T18:36:56.163 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.3] 2023-11-28T18:36:56.163 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQA0M2Zl2fnBJxAAv68KZJFnQWwyUupB+whAEg== 2023-11-28T18:36:56.163 INFO:teuthology.orchestra.run.smithi190.stdout:[mgr.x] 2023-11-28T18:36:56.163 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQApM2ZlVReeExAAlYEJ4EwbGHtSUIkimoiJ2Q== 2023-11-28T18:36:56.163 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.b] 2023-11-28T18:36:56.163 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQApM2ZlrJe9JBAAV2uXCF1nOYAUZf9Vm6BIWQ== 2023-11-28T18:36:56.164 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.d] 2023-11-28T18:36:56.164 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQApM2Zl1xU7LBAAHQ+Co90EW5qv+8793OyE/A== 2023-11-28T18:36:56.164 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.4] 2023-11-28T18:36:56.164 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQA6M2ZllZg1MBAAzvMRW0IZnwwqfzhJ7wWjjQ== 2023-11-28T18:36:56.164 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.5] 2023-11-28T18:36:56.164 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQA9M2Zlq0KjNxAAXOkL+JS09zzWRoPlgPGx+A== 2023-11-28T18:36:56.164 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.6] 2023-11-28T18:36:56.164 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBBM2ZlVUVPAhAAurFCH6ubc+fXb8cUcg2nIg== 2023-11-28T18:36:56.164 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.7] 2023-11-28T18:36:56.164 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBEM2ZlD846CRAA7GWGdOzRdv8vN7YbQyU4NQ== 2023-11-28T18:36:56.164 INFO:teuthology.orchestra.run.smithi190.stdout:[client.0] 2023-11-28T18:36:56.164 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQApM2ZlTJxNMBAAwJAMWm1Y180iNJmgHnWFnw== 2023-11-28T18:36:56.165 INFO:teuthology.orchestra.run.smithi190.stdout:[client.2] 2023-11-28T18:36:56.165 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQApM2ZlhvR6NhAAbs7Rqb1gatb4fymZ2IHy5w== 2023-11-28T18:36:56.165 INFO:teuthology.orchestra.run.smithi190.stdout:[client.1] 2023-11-28T18:36:56.165 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQApM2Zl7yM7OhAA+Nu2Ay/zIVuRsCk90QGWbg== 2023-11-28T18:36:56.165 INFO:teuthology.orchestra.run.smithi190.stdout:[client.3] 2023-11-28T18:36:56.165 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQAqM2ZlsarFBBAA1avYCNMV4t4UGM00iN6XiQ== 2023-11-28T18:36:56.166 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-28T18:36:56.197 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-28T18:36:56.264 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T18:36:56.268 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T18:36:56.328 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T18:36:56.332 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T18:36:56.390 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T18:36:56.394 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T18:36:56.448 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T18:36:56.452 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T18:36:56.506 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T18:36:56.510 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T18:36:56.565 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T18:36:56.569 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T18:36:56.623 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-28T18:36:56.627 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-28T18:36:56.681 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T18:36:56.684 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T18:36:56.741 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T18:36:56.744 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T18:36:56.800 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T18:36:56.804 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T18:36:56.858 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T18:36:56.861 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T18:36:56.915 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T18:36:56.919 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T18:36:56.973 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T18:36:56.977 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T18:36:57.031 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T18:36:57.034 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T18:36:57.091 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T18:36:57.095 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T18:36:57.152 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T18:36:57.155 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T18:36:57.213 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T18:36:57.217 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T18:36:57.273 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-11-28T18:36:57.274 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-11-28T18:36:57.294 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-28T18:36:57.410 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-11-28T18:36:57.432 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-11-28T18:36:57.452 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-28T18:36:57.572 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-11-28T18:36:57.593 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-11-28T18:36:57.659 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-28T18:36:57.774 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-11-28T18:36:57.795 DEBUG:teuthology.orchestra.run.smithi045:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-28T18:36:57.798 DEBUG:teuthology.orchestra.run.smithi190:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-28T18:36:57.847 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-11-28T18:36:57.847 INFO:tasks.ceph.mon.a:Restarting daemon 2023-11-28T18:36:57.847 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-11-28T18:36:57.851 INFO:tasks.ceph.mon.a:Started 2023-11-28T18:36:57.851 INFO:tasks.ceph.mon.b:Restarting daemon 2023-11-28T18:36:57.851 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-11-28T18:36:57.890 INFO:tasks.ceph.mon.b:Started 2023-11-28T18:36:57.890 INFO:tasks.ceph.mon.c:Restarting daemon 2023-11-28T18:36:57.890 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-11-28T18:36:57.894 INFO:tasks.ceph.mon.c:Started 2023-11-28T18:36:57.894 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-11-28T18:36:57.894 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-11-28T18:36:57.894 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-11-28T18:36:57.898 INFO:tasks.ceph.mgr.y:Started 2023-11-28T18:36:57.898 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-11-28T18:36:57.898 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-11-28T18:36:57.902 INFO:tasks.ceph.mgr.x:Started 2023-11-28T18:36:57.902 INFO:tasks.ceph:Setting crush tunables to default 2023-11-28T18:36:57.902 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --cluster ceph osd crush tunables default 2023-11-28T18:36:58.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:36:58.040+0000 7f7ccebd0640 1 Processor -- start 2023-11-28T18:36:58.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:36:58.040+0000 7f7ccebd0640 1 -- start start 2023-11-28T18:36:58.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:36:58.044+0000 7f7ccebd0640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f7cc80cdb90 0x7f7cc80cf8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:36:58.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:36:58.044+0000 7f7ccebd0640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7cc80cfe00 0x7f7cc80d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:36:58.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:36:58.044+0000 7f7ccebd0640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cc80ced20 con 0x7f7cc815dc00 2023-11-28T18:36:58.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:36:58.044+0000 7f7ccebd0640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cc80d0290 con 0x7f7cc80cdb90 2023-11-28T18:36:58.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:36:58.044+0000 7f7ccebd0640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc80d3a10 con 0x7f7cc80cfe00 2023-11-28T18:36:58.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:36:58.044+0000 7f7ccdbce640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f7cc815dc00 0x7f7cc815dfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52948/0 (socket says 172.21.15.45:52948) 2023-11-28T18:36:58.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:36:58.044+0000 7f7ccdbce640 1 -- 172.21.15.45:0/3947658862 learned_addr learned my addr 172.21.15.45:0/3947658862 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:36:58.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:36:58.044+0000 7f7ccd3cd640 1 --2- 172.21.15.45:0/3947658862 >> v2:172.21.15.190:3300/0 conn(0x7f7cc80cdb90 0x7f7cc80cf8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:36:58.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:36:58.044+0000 7f7cce3cf640 1 --2- 172.21.15.45:0/3947658862 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7cc80cfe00 0x7f7cc80d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:36:58.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:36:58.044+0000 7f7ccd3cd640 1 -- 172.21.15.45:0/3947658862 >> v2:172.21.15.190:3300/0 conn(0x7f7cc80cdb90 msgr2=0x7f7cc80cf8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T18:36:58.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:36:58.044+0000 7f7ccd3cd640 1 -- 172.21.15.45:0/3947658862 >> v2:172.21.15.190:3300/0 conn(0x7f7cc80cdb90 msgr2=0x7f7cc80cf8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T18:36:58.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:36:58.044+0000 7f7ccd3cd640 1 --2- 172.21.15.45:0/3947658862 >> v2:172.21.15.190:3300/0 conn(0x7f7cc80cdb90 0x7f7cc80cf8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T18:36:58.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:36:58.044+0000 7f7cce3cf640 1 -- 172.21.15.45:0/3947658862 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7cc80cfe00 msgr2=0x7f7cc80d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T18:36:58.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:36:58.044+0000 7f7cce3cf640 1 -- 172.21.15.45:0/3947658862 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7cc80cfe00 msgr2=0x7f7cc80d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T18:36:58.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:36:58.044+0000 7f7cce3cf640 1 --2- 172.21.15.45:0/3947658862 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7cc80cfe00 0x7f7cc80d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T18:36:58.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:36:58.044+0000 7f7ccd3cd640 1 --2- 172.21.15.45:0/3947658862 >> v2:172.21.15.190:3300/0 conn(0x7f7cc80cdb90 0x7f7cc80cf8c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:36:58.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:36:58.044+0000 7f7cce3cf640 1 --2- 172.21.15.45:0/3947658862 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7cc80cfe00 0x7f7cc80d0c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:36:58.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:36:58.248+0000 7f7cce3cf640 1 --2- 172.21.15.45:0/3947658862 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7cc80cfe00 0x7f7cc80d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:36:58.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:36:58.248+0000 7f7ccd3cd640 1 --2- 172.21.15.45:0/3947658862 >> v2:172.21.15.190:3300/0 conn(0x7f7cc80cdb90 0x7f7cc80cf8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:36:58.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:36:58.248+0000 7f7cce3cf640 1 -- 172.21.15.45:0/3947658862 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7cc80cfe00 msgr2=0x7f7cc80d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T18:36:58.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:36:58.248+0000 7f7cce3cf640 1 -- 172.21.15.45:0/3947658862 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7cc80cfe00 msgr2=0x7f7cc80d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T18:36:58.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:36:58.248+0000 7f7cce3cf640 1 --2- 172.21.15.45:0/3947658862 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7cc80cfe00 0x7f7cc80d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T18:36:58.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:36:58.248+0000 7f7ccd3cd640 1 -- 172.21.15.45:0/3947658862 >> v2:172.21.15.190:3300/0 conn(0x7f7cc80cdb90 msgr2=0x7f7cc80cf8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T18:36:58.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:36:58.248+0000 7f7ccd3cd640 1 -- 172.21.15.45:0/3947658862 >> v2:172.21.15.190:3300/0 conn(0x7f7cc80cdb90 msgr2=0x7f7cc80cf8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T18:36:58.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:36:58.248+0000 7f7ccd3cd640 1 --2- 172.21.15.45:0/3947658862 >> v2:172.21.15.190:3300/0 conn(0x7f7cc80cdb90 0x7f7cc80cf8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T18:36:58.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:36:58.248+0000 7f7cce3cf640 1 --2- 172.21.15.45:0/3947658862 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7cc80cfe00 0x7f7cc80d0c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:36:58.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:36:58.248+0000 7f7ccd3cd640 1 --2- 172.21.15.45:0/3947658862 >> v2:172.21.15.190:3300/0 conn(0x7f7cc80cdb90 0x7f7cc80cf8c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:36:58.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:36:58.652+0000 7f7ccd3cd640 1 --2- 172.21.15.45:0/3947658862 >> v2:172.21.15.190:3300/0 conn(0x7f7cc80cdb90 0x7f7cc80cf8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:36:58.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:36:58.652+0000 7f7cce3cf640 1 --2- 172.21.15.45:0/3947658862 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7cc80cfe00 0x7f7cc80d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:36:58.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:36:58.652+0000 7f7ccd3cd640 1 -- 172.21.15.45:0/3947658862 >> v2:172.21.15.190:3300/0 conn(0x7f7cc80cdb90 msgr2=0x7f7cc80cf8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T18:36:58.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:36:58.652+0000 7f7ccd3cd640 1 -- 172.21.15.45:0/3947658862 >> v2:172.21.15.190:3300/0 conn(0x7f7cc80cdb90 msgr2=0x7f7cc80cf8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T18:36:58.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:36:58.652+0000 7f7ccd3cd640 1 --2- 172.21.15.45:0/3947658862 >> v2:172.21.15.190:3300/0 conn(0x7f7cc80cdb90 0x7f7cc80cf8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T18:36:58.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:36:58.652+0000 7f7cce3cf640 1 -- 172.21.15.45:0/3947658862 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7cc80cfe00 msgr2=0x7f7cc80d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T18:36:58.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:36:58.652+0000 7f7cce3cf640 1 -- 172.21.15.45:0/3947658862 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7cc80cfe00 msgr2=0x7f7cc80d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T18:36:58.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:36:58.652+0000 7f7cce3cf640 1 --2- 172.21.15.45:0/3947658862 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7cc80cfe00 0x7f7cc80d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T18:36:58.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:36:58.652+0000 7f7ccd3cd640 1 --2- 172.21.15.45:0/3947658862 >> v2:172.21.15.190:3300/0 conn(0x7f7cc80cdb90 0x7f7cc80cf8c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:36:58.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:36:58.652+0000 7f7cce3cf640 1 --2- 172.21.15.45:0/3947658862 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7cc80cfe00 0x7f7cc80d0c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:36:59.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:36:59.456+0000 7f7cce3cf640 1 --2- 172.21.15.45:0/3947658862 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7cc80cfe00 0x7f7cc80d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:36:59.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:36:59.456+0000 7f7ccd3cd640 1 --2- 172.21.15.45:0/3947658862 >> v2:172.21.15.190:3300/0 conn(0x7f7cc80cdb90 0x7f7cc80cf8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:36:59.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:36:59.456+0000 7f7cce3cf640 1 -- 172.21.15.45:0/3947658862 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7cc80cfe00 msgr2=0x7f7cc80d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T18:36:59.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:36:59.456+0000 7f7cce3cf640 1 -- 172.21.15.45:0/3947658862 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7cc80cfe00 msgr2=0x7f7cc80d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T18:36:59.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:36:59.456+0000 7f7cce3cf640 1 --2- 172.21.15.45:0/3947658862 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7cc80cfe00 0x7f7cc80d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T18:36:59.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:36:59.456+0000 7f7ccd3cd640 1 -- 172.21.15.45:0/3947658862 >> v2:172.21.15.190:3300/0 conn(0x7f7cc80cdb90 msgr2=0x7f7cc80cf8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T18:36:59.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:36:59.456+0000 7f7ccd3cd640 1 -- 172.21.15.45:0/3947658862 >> v2:172.21.15.190:3300/0 conn(0x7f7cc80cdb90 msgr2=0x7f7cc80cf8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T18:36:59.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:36:59.456+0000 7f7ccd3cd640 1 --2- 172.21.15.45:0/3947658862 >> v2:172.21.15.190:3300/0 conn(0x7f7cc80cdb90 0x7f7cc80cf8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T18:36:59.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:36:59.456+0000 7f7cce3cf640 1 --2- 172.21.15.45:0/3947658862 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7cc80cfe00 0x7f7cc80d0c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:36:59.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:36:59.456+0000 7f7ccd3cd640 1 --2- 172.21.15.45:0/3947658862 >> v2:172.21.15.190:3300/0 conn(0x7f7cc80cdb90 0x7f7cc80cf8c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:37:01.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:01.044+0000 7f7cbf7fe640 1 -- 172.21.15.45:0/3947658862 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7cc80cfe00 msgr2=0x7f7cc80d0c50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:37:01.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:01.044+0000 7f7cbf7fe640 1 --2- 172.21.15.45:0/3947658862 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7cc80cfe00 0x7f7cc80d0c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:01.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:01.044+0000 7f7cbf7fe640 1 -- 172.21.15.45:0/3947658862 >> v2:172.21.15.190:3300/0 conn(0x7f7cc80cdb90 msgr2=0x7f7cc80cf8c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:37:01.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:01.044+0000 7f7cbf7fe640 1 --2- 172.21.15.45:0/3947658862 >> v2:172.21.15.190:3300/0 conn(0x7f7cc80cdb90 0x7f7cc80cf8c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:01.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:01.044+0000 7f7cbf7fe640 1 -- 172.21.15.45:0/3947658862 >> v1:172.21.15.45:6789/0 conn(0x7f7cc815dc00 legacy=0x7f7cc815dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:01.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:01.044+0000 7f7cbf7fe640 1 --2- 172.21.15.45:0/3947658862 >> v2:172.21.15.45:3300/0 conn(0x7f7cac0036b0 0x7f7cac005b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:01.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:01.044+0000 7f7cbf7fe640 1 -- 172.21.15.45:0/3947658862 --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cc815e6f0 con 0x7f7cac006180 2023-11-28T18:37:01.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:01.044+0000 7f7cbf7fe640 1 -- 172.21.15.45:0/3947658862 --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cc80d0290 con 0x7f7cac0036b0 2023-11-28T18:37:01.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:01.044+0000 7f7ccdbce640 1 --2- 172.21.15.45:0/3947658862 >> v2:172.21.15.45:3300/0 conn(0x7f7cac0036b0 0x7f7cac005b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:01.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:01.044+0000 7f7ccdbce640 1 -- 172.21.15.45:0/3947658862 >> v2:172.21.15.45:3300/0 conn(0x7f7cac0036b0 msgr2=0x7f7cac005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T18:37:01.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:01.044+0000 7f7ccdbce640 1 -- 172.21.15.45:0/3947658862 >> v2:172.21.15.45:3300/0 conn(0x7f7cac0036b0 msgr2=0x7f7cac005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T18:37:01.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:01.044+0000 7f7ccdbce640 1 --2- 172.21.15.45:0/3947658862 >> v2:172.21.15.45:3300/0 conn(0x7f7cac0036b0 0x7f7cac005b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T18:37:01.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:01.044+0000 7f7ccdbce640 1 --2- 172.21.15.45:0/3947658862 >> v2:172.21.15.45:3300/0 conn(0x7f7cac0036b0 0x7f7cac005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:37:01.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:01.248+0000 7f7ccdbce640 1 --2- 172.21.15.45:0/3947658862 >> v2:172.21.15.45:3300/0 conn(0x7f7cac0036b0 0x7f7cac005b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:01.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:01.248+0000 7f7ccdbce640 1 -- 172.21.15.45:0/3947658862 >> v2:172.21.15.45:3300/0 conn(0x7f7cac0036b0 msgr2=0x7f7cac005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T18:37:01.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:01.248+0000 7f7ccdbce640 1 -- 172.21.15.45:0/3947658862 >> v2:172.21.15.45:3300/0 conn(0x7f7cac0036b0 msgr2=0x7f7cac005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T18:37:01.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:01.248+0000 7f7ccdbce640 1 --2- 172.21.15.45:0/3947658862 >> v2:172.21.15.45:3300/0 conn(0x7f7cac0036b0 0x7f7cac005b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T18:37:01.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:01.248+0000 7f7ccdbce640 1 --2- 172.21.15.45:0/3947658862 >> v2:172.21.15.45:3300/0 conn(0x7f7cac0036b0 0x7f7cac005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:37:01.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:01.652+0000 7f7ccdbce640 1 --2- 172.21.15.45:0/3947658862 >> v2:172.21.15.45:3300/0 conn(0x7f7cac0036b0 0x7f7cac005b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:01.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:01.652+0000 7f7ccdbce640 1 -- 172.21.15.45:0/3947658862 >> v2:172.21.15.45:3300/0 conn(0x7f7cac0036b0 msgr2=0x7f7cac005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T18:37:01.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:01.652+0000 7f7ccdbce640 1 -- 172.21.15.45:0/3947658862 >> v2:172.21.15.45:3300/0 conn(0x7f7cac0036b0 msgr2=0x7f7cac005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T18:37:01.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:01.652+0000 7f7ccdbce640 1 --2- 172.21.15.45:0/3947658862 >> v2:172.21.15.45:3300/0 conn(0x7f7cac0036b0 0x7f7cac005b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T18:37:01.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:01.652+0000 7f7ccdbce640 1 --2- 172.21.15.45:0/3947658862 >> v2:172.21.15.45:3300/0 conn(0x7f7cac0036b0 0x7f7cac005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:37:02.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:02.456+0000 7f7ccdbce640 1 --2- 172.21.15.45:0/3947658862 >> v2:172.21.15.45:3300/0 conn(0x7f7cac0036b0 0x7f7cac005b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:02.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:02.456+0000 7f7ccdbce640 1 -- 172.21.15.45:0/3947658862 >> v2:172.21.15.45:3300/0 conn(0x7f7cac0036b0 msgr2=0x7f7cac005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T18:37:02.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:02.456+0000 7f7ccdbce640 1 -- 172.21.15.45:0/3947658862 >> v2:172.21.15.45:3300/0 conn(0x7f7cac0036b0 msgr2=0x7f7cac005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T18:37:02.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:02.456+0000 7f7ccdbce640 1 --2- 172.21.15.45:0/3947658862 >> v2:172.21.15.45:3300/0 conn(0x7f7cac0036b0 0x7f7cac005b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T18:37:02.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:02.456+0000 7f7ccdbce640 1 --2- 172.21.15.45:0/3947658862 >> v2:172.21.15.45:3300/0 conn(0x7f7cac0036b0 0x7f7cac005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:37:04.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:04.044+0000 7f7cbf7fe640 1 -- 172.21.15.45:0/3947658862 >> v2:172.21.15.45:3300/0 conn(0x7f7cac0036b0 msgr2=0x7f7cac005b30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:37:04.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:04.044+0000 7f7cbf7fe640 1 --2- 172.21.15.45:0/3947658862 >> v2:172.21.15.45:3300/0 conn(0x7f7cac0036b0 0x7f7cac005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:04.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:04.044+0000 7f7cbf7fe640 1 -- 172.21.15.45:0/3947658862 >> v1:172.21.15.190:6789/0 conn(0x7f7cac006180 legacy=0x7f7cac008640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:04.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:04.044+0000 7f7cce3cf640 1 -- 172.21.15.45:0/3947658862 reap_dead start 2023-11-28T18:37:04.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:04.044+0000 7f7cbf7fe640 1 --2- 172.21.15.45:0/3947658862 >> v2:172.21.15.45:3300/0 conn(0x7f7cac0036b0 0x7f7cac005b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:04.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:04.044+0000 7f7cbf7fe640 1 --2- 172.21.15.45:0/3947658862 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7cac00a740 0x7f7cac0085c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:04.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:04.044+0000 7f7cbf7fe640 1 -- 172.21.15.45:0/3947658862 --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cac00af20 con 0x7f7cc815dc00 2023-11-28T18:37:04.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:04.044+0000 7f7cbf7fe640 1 -- 172.21.15.45:0/3947658862 --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cc80d0290 con 0x7f7cac0036b0 2023-11-28T18:37:04.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:04.044+0000 7f7cbf7fe640 1 -- 172.21.15.45:0/3947658862 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc80d3a10 con 0x7f7cac00a740 2023-11-28T18:37:04.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:04.044+0000 7f7cce3cf640 1 --2- 172.21.15.45:0/3947658862 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7cac00a740 0x7f7cac0085c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:04.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:04.044+0000 7f7ccdbce640 1 --2- 172.21.15.45:0/3947658862 >> v2:172.21.15.45:3300/0 conn(0x7f7cac0036b0 0x7f7cac005b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:04.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:04.044+0000 7f7cce3cf640 1 -- 172.21.15.45:0/3947658862 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7cac00a740 msgr2=0x7f7cac0085c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T18:37:04.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:04.044+0000 7f7cce3cf640 1 -- 172.21.15.45:0/3947658862 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7cac00a740 msgr2=0x7f7cac0085c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T18:37:04.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:04.044+0000 7f7cce3cf640 1 --2- 172.21.15.45:0/3947658862 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7cac00a740 0x7f7cac0085c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T18:37:04.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:04.044+0000 7f7cce3cf640 1 --2- 172.21.15.45:0/3947658862 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7cac00a740 0x7f7cac0085c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:37:04.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:04.044+0000 7f7ccdbce640 1 -- 172.21.15.45:0/3947658862 >> v2:172.21.15.45:3300/0 conn(0x7f7cac0036b0 msgr2=0x7f7cac005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T18:37:04.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:04.044+0000 7f7ccdbce640 1 -- 172.21.15.45:0/3947658862 >> v2:172.21.15.45:3300/0 conn(0x7f7cac0036b0 msgr2=0x7f7cac005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T18:37:04.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:04.044+0000 7f7ccdbce640 1 --2- 172.21.15.45:0/3947658862 >> v2:172.21.15.45:3300/0 conn(0x7f7cac0036b0 0x7f7cac005b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T18:37:04.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:04.044+0000 7f7ccdbce640 1 --2- 172.21.15.45:0/3947658862 >> v2:172.21.15.45:3300/0 conn(0x7f7cac0036b0 0x7f7cac005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:37:04.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:04.248+0000 7f7ccdbce640 1 --2- 172.21.15.45:0/3947658862 >> v2:172.21.15.45:3300/0 conn(0x7f7cac0036b0 0x7f7cac005b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:04.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:04.248+0000 7f7ccdbce640 1 -- 172.21.15.45:0/3947658862 >> v2:172.21.15.45:3300/0 conn(0x7f7cac0036b0 msgr2=0x7f7cac005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T18:37:04.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:04.248+0000 7f7ccdbce640 1 -- 172.21.15.45:0/3947658862 >> v2:172.21.15.45:3300/0 conn(0x7f7cac0036b0 msgr2=0x7f7cac005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T18:37:04.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:04.248+0000 7f7ccdbce640 1 --2- 172.21.15.45:0/3947658862 >> v2:172.21.15.45:3300/0 conn(0x7f7cac0036b0 0x7f7cac005b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T18:37:04.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:04.248+0000 7f7ccdbce640 1 --2- 172.21.15.45:0/3947658862 >> v2:172.21.15.45:3300/0 conn(0x7f7cac0036b0 0x7f7cac005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:37:04.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:04.248+0000 7f7cce3cf640 1 --2- 172.21.15.45:0/3947658862 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7cac00a740 0x7f7cac0085c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:04.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:04.248+0000 7f7cce3cf640 1 -- 172.21.15.45:0/3947658862 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7cac00a740 msgr2=0x7f7cac0085c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T18:37:04.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:04.248+0000 7f7cce3cf640 1 -- 172.21.15.45:0/3947658862 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7cac00a740 msgr2=0x7f7cac0085c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T18:37:04.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:04.248+0000 7f7cce3cf640 1 --2- 172.21.15.45:0/3947658862 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7cac00a740 0x7f7cac0085c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T18:37:04.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:04.248+0000 7f7cce3cf640 1 --2- 172.21.15.45:0/3947658862 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7cac00a740 0x7f7cac0085c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:37:04.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:04.651+0000 7f7ccdbce640 1 --2- 172.21.15.45:0/3947658862 >> v2:172.21.15.45:3300/0 conn(0x7f7cac0036b0 0x7f7cac005b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:04.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:04.651+0000 7f7cce3cf640 1 --2- 172.21.15.45:0/3947658862 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7cac00a740 0x7f7cac0085c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:04.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:04.651+0000 7f7ccdbce640 1 -- 172.21.15.45:0/3947658862 >> v2:172.21.15.45:3300/0 conn(0x7f7cac0036b0 msgr2=0x7f7cac005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T18:37:04.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:04.651+0000 7f7ccdbce640 1 -- 172.21.15.45:0/3947658862 >> v2:172.21.15.45:3300/0 conn(0x7f7cac0036b0 msgr2=0x7f7cac005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T18:37:04.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:04.651+0000 7f7ccdbce640 1 --2- 172.21.15.45:0/3947658862 >> v2:172.21.15.45:3300/0 conn(0x7f7cac0036b0 0x7f7cac005b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T18:37:04.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:04.651+0000 7f7ccdbce640 1 --2- 172.21.15.45:0/3947658862 >> v2:172.21.15.45:3300/0 conn(0x7f7cac0036b0 0x7f7cac005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:37:04.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:04.651+0000 7f7cce3cf640 1 -- 172.21.15.45:0/3947658862 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7cac00a740 msgr2=0x7f7cac0085c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T18:37:04.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:04.651+0000 7f7cce3cf640 1 -- 172.21.15.45:0/3947658862 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7cac00a740 msgr2=0x7f7cac0085c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T18:37:04.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:04.651+0000 7f7cce3cf640 1 --2- 172.21.15.45:0/3947658862 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7cac00a740 0x7f7cac0085c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T18:37:04.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:04.651+0000 7f7cce3cf640 1 --2- 172.21.15.45:0/3947658862 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7cac00a740 0x7f7cac0085c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:37:05.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:05.455+0000 7f7ccdbce640 1 --2- 172.21.15.45:0/3947658862 >> v2:172.21.15.45:3300/0 conn(0x7f7cac0036b0 0x7f7cac005b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:05.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:05.455+0000 7f7ccdbce640 1 -- 172.21.15.45:0/3947658862 >> v2:172.21.15.45:3300/0 conn(0x7f7cac0036b0 msgr2=0x7f7cac005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T18:37:05.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:05.455+0000 7f7ccdbce640 1 -- 172.21.15.45:0/3947658862 >> v2:172.21.15.45:3300/0 conn(0x7f7cac0036b0 msgr2=0x7f7cac005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T18:37:05.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:05.455+0000 7f7ccdbce640 1 --2- 172.21.15.45:0/3947658862 >> v2:172.21.15.45:3300/0 conn(0x7f7cac0036b0 0x7f7cac005b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T18:37:05.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:05.455+0000 7f7cce3cf640 1 --2- 172.21.15.45:0/3947658862 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7cac00a740 0x7f7cac0085c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:05.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:05.455+0000 7f7ccdbce640 1 --2- 172.21.15.45:0/3947658862 >> v2:172.21.15.45:3300/0 conn(0x7f7cac0036b0 0x7f7cac005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:37:05.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:05.455+0000 7f7cce3cf640 1 -- 172.21.15.45:0/3947658862 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7cac00a740 msgr2=0x7f7cac0085c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T18:37:05.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:05.455+0000 7f7cce3cf640 1 -- 172.21.15.45:0/3947658862 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7cac00a740 msgr2=0x7f7cac0085c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T18:37:05.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:05.455+0000 7f7cce3cf640 1 --2- 172.21.15.45:0/3947658862 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7cac00a740 0x7f7cac0085c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T18:37:05.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:05.455+0000 7f7cce3cf640 1 --2- 172.21.15.45:0/3947658862 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7cac00a740 0x7f7cac0085c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:37:07.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:07.043+0000 7f7cbf7fe640 1 -- 172.21.15.45:0/3947658862 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7cac00a740 msgr2=0x7f7cac0085c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:37:07.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:07.043+0000 7f7cbf7fe640 1 --2- 172.21.15.45:0/3947658862 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7cac00a740 0x7f7cac0085c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:07.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:07.043+0000 7f7cbf7fe640 1 -- 172.21.15.45:0/3947658862 >> v2:172.21.15.45:3300/0 conn(0x7f7cac0036b0 msgr2=0x7f7cac005b30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:37:07.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:07.043+0000 7f7cbf7fe640 1 --2- 172.21.15.45:0/3947658862 >> v2:172.21.15.45:3300/0 conn(0x7f7cac0036b0 0x7f7cac005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:07.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:07.043+0000 7f7cbf7fe640 1 -- 172.21.15.45:0/3947658862 >> v1:172.21.15.45:6789/0 conn(0x7f7cc815dc00 legacy=0x7f7cac00a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:07.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:07.043+0000 7f7cbf7fe640 1 --2- 172.21.15.45:0/3947658862 >> v2:172.21.15.190:3300/0 conn(0x7f7cac008e40 0x7f7cac009250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:07.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:07.043+0000 7f7cbf7fe640 1 -- 172.21.15.45:0/3947658862 --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cac00ac10 con 0x7f7cac009920 2023-11-28T18:37:07.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:07.043+0000 7f7cbf7fe640 1 -- 172.21.15.45:0/3947658862 --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cc80d0290 con 0x7f7cac008e40 2023-11-28T18:37:07.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:07.043+0000 7f7ccdbce640 1 --2- 172.21.15.45:0/3947658862 >> v2:172.21.15.190:3300/0 conn(0x7f7cac008e40 0x7f7cac009250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:07.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:07.043+0000 7f7ccdbce640 1 -- 172.21.15.45:0/3947658862 >> v2:172.21.15.190:3300/0 conn(0x7f7cac008e40 msgr2=0x7f7cac009250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T18:37:07.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:07.043+0000 7f7ccdbce640 1 -- 172.21.15.45:0/3947658862 >> v2:172.21.15.190:3300/0 conn(0x7f7cac008e40 msgr2=0x7f7cac009250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T18:37:07.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:07.043+0000 7f7ccdbce640 1 --2- 172.21.15.45:0/3947658862 >> v2:172.21.15.190:3300/0 conn(0x7f7cac008e40 0x7f7cac009250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T18:37:07.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:07.043+0000 7f7ccdbce640 1 --2- 172.21.15.45:0/3947658862 >> v2:172.21.15.190:3300/0 conn(0x7f7cac008e40 0x7f7cac009250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:37:07.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:07.247+0000 7f7ccdbce640 1 --2- 172.21.15.45:0/3947658862 >> v2:172.21.15.190:3300/0 conn(0x7f7cac008e40 0x7f7cac009250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:07.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:07.247+0000 7f7ccdbce640 1 -- 172.21.15.45:0/3947658862 >> v2:172.21.15.190:3300/0 conn(0x7f7cac008e40 msgr2=0x7f7cac009250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T18:37:07.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:07.247+0000 7f7ccdbce640 1 -- 172.21.15.45:0/3947658862 >> v2:172.21.15.190:3300/0 conn(0x7f7cac008e40 msgr2=0x7f7cac009250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T18:37:07.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:07.247+0000 7f7ccdbce640 1 --2- 172.21.15.45:0/3947658862 >> v2:172.21.15.190:3300/0 conn(0x7f7cac008e40 0x7f7cac009250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T18:37:07.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:07.247+0000 7f7ccdbce640 1 --2- 172.21.15.45:0/3947658862 >> v2:172.21.15.190:3300/0 conn(0x7f7cac008e40 0x7f7cac009250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:37:07.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:07.651+0000 7f7ccdbce640 1 --2- 172.21.15.45:0/3947658862 >> v2:172.21.15.190:3300/0 conn(0x7f7cac008e40 0x7f7cac009250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:07.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:07.651+0000 7f7ccdbce640 1 -- 172.21.15.45:0/3947658862 >> v2:172.21.15.190:3300/0 conn(0x7f7cac008e40 msgr2=0x7f7cac009250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T18:37:07.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:07.651+0000 7f7ccdbce640 1 -- 172.21.15.45:0/3947658862 >> v2:172.21.15.190:3300/0 conn(0x7f7cac008e40 msgr2=0x7f7cac009250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T18:37:07.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:07.651+0000 7f7ccdbce640 1 --2- 172.21.15.45:0/3947658862 >> v2:172.21.15.190:3300/0 conn(0x7f7cac008e40 0x7f7cac009250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T18:37:07.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:07.651+0000 7f7ccdbce640 1 --2- 172.21.15.45:0/3947658862 >> v2:172.21.15.190:3300/0 conn(0x7f7cac008e40 0x7f7cac009250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:37:08.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.207+0000 7f7cccbcc640 1 -- 172.21.15.45:0/3947658862 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1532755544 0 0) 0x7f7cac00ac10 con 0x7f7cac009920 2023-11-28T18:37:08.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.207+0000 7f7cccbcc640 1 -- 172.21.15.45:0/3947658862 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7cb4003530 con 0x7f7cac009920 2023-11-28T18:37:08.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.211+0000 7f7cccbcc640 1 -- 172.21.15.45:0/3947658862 <== mon.1 v1:172.21.15.190:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2722177651 0 0) 0x7f7cb4003530 con 0x7f7cac009920 2023-11-28T18:37:08.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.211+0000 7f7cccbcc640 1 -- 172.21.15.45:0/3947658862 >> v2:172.21.15.190:3300/0 conn(0x7f7cac008e40 msgr2=0x7f7cac009250 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:37:08.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.211+0000 7f7cccbcc640 1 --2- 172.21.15.45:0/3947658862 >> v2:172.21.15.190:3300/0 conn(0x7f7cac008e40 0x7f7cac009250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:08.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.211+0000 7f7cccbcc640 1 -- 172.21.15.45:0/3947658862 --> v1:172.21.15.190:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cac014a30 con 0x7f7cac009920 2023-11-28T18:37:08.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.211+0000 7f7cccbcc640 1 -- 172.21.15.45:0/3947658862 <== mon.1 v1:172.21.15.190:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4084481567 0 0) 0x7f7cb800e510 con 0x7f7cac009920 2023-11-28T18:37:08.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.211+0000 7f7cccbcc640 1 -- 172.21.15.45:0/3947658862 >> v1:172.21.15.190:6789/0 conn(0x7f7cac009920 legacy=0x7f7cac012230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:08.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.211+0000 7f7cce3cf640 1 -- 172.21.15.45:0/3947658862 reap_dead start 2023-11-28T18:37:08.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.211+0000 7f7cccbcc640 1 --2- 172.21.15.45:0/3947658862 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7cb4003980 0x7f7cb4003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:08.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.211+0000 7f7cccbcc640 1 --2- 172.21.15.45:0/3947658862 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7cb40047d0 0x7f7cb4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:08.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.211+0000 7f7cccbcc640 1 --2- 172.21.15.45:0/3947658862 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7cb4005260 0x7f7cb400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:08.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.211+0000 7f7cccbcc640 1 -- 172.21.15.45:0/3947658862 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc80d0290 con 0x7f7cb4005260 2023-11-28T18:37:08.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.211+0000 7f7cccbcc640 1 -- 172.21.15.45:0/3947658862 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb400c1b0 con 0x7f7cb40047d0 2023-11-28T18:37:08.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.211+0000 7f7cccbcc640 1 -- 172.21.15.45:0/3947658862 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb400c370 con 0x7f7cb4003980 2023-11-28T18:37:08.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.211+0000 7f7cce3cf640 1 --2- 172.21.15.45:0/3947658862 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7cb4005260 0x7f7cb400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:08.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.211+0000 7f7ccd3cd640 1 --2- 172.21.15.45:0/3947658862 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7cb40047d0 0x7f7cb4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:08.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.211+0000 7f7ccdbce640 1 --2- 172.21.15.45:0/3947658862 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7cb4003980 0x7f7cb4003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:08.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.211+0000 7f7cce3cf640 1 -- 172.21.15.45:0/3947658862 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7cb4003980 msgr2=0x7f7cb4003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:08.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.211+0000 7f7cce3cf640 1 --2- 172.21.15.45:0/3947658862 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7cb4003980 0x7f7cb4003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:08.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.211+0000 7f7cce3cf640 1 -- 172.21.15.45:0/3947658862 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7cb40047d0 msgr2=0x7f7cb4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:08.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.211+0000 7f7cce3cf640 1 --2- 172.21.15.45:0/3947658862 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7cb40047d0 0x7f7cb4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:08.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.211+0000 7f7cce3cf640 1 -- 172.21.15.45:0/3947658862 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb4003530 con 0x7f7cb4005260 2023-11-28T18:37:08.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.215+0000 7f7cce3cf640 1 --2- 172.21.15.45:0/3947658862 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7cb4005260 0x7f7cb400b990 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7cc80d3b50 tx=0x7f7cc001e420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=614fe0930103cf8e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:08.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.215+0000 7f7cccbcc640 1 -- 172.21.15.45:0/3947658862 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc00af410 con 0x7f7cb4005260 2023-11-28T18:37:08.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.215+0000 7f7cccbcc640 1 -- 172.21.15.45:0/3947658862 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cc00a9030 con 0x7f7cb4005260 2023-11-28T18:37:08.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.215+0000 7f7cccbcc640 1 -- 172.21.15.45:0/3947658862 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc00af7d0 con 0x7f7cb4005260 2023-11-28T18:37:08.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.215+0000 7f7ccebd0640 1 -- 172.21.15.45:0/3947658862 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7cb4005260 msgr2=0x7f7cb400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:08.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.215+0000 7f7ccebd0640 1 --2- 172.21.15.45:0/3947658862 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7cb4005260 0x7f7cb400b990 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7cc80d3b50 tx=0x7f7cc001e420 comp rx=0 tx=0).stop 2023-11-28T18:37:08.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.215+0000 7f7ccebd0640 1 -- 172.21.15.45:0/3947658862 shutdown_connections 2023-11-28T18:37:08.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.215+0000 7f7ccebd0640 1 --2- 172.21.15.45:0/3947658862 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7cb4005260 0x7f7cb400b990 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:08.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.215+0000 7f7ccebd0640 1 --2- 172.21.15.45:0/3947658862 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7cb40047d0 0x7f7cb4004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:08.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.215+0000 7f7ccebd0640 1 --2- 172.21.15.45:0/3947658862 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7cb4003980 0x7f7cb4003d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:08.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.215+0000 7f7ccebd0640 1 -- 172.21.15.45:0/3947658862 >> 172.21.15.45:0/3947658862 conn(0x7f7cc809c300 msgr2=0x7f7cc80d2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:08.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.219+0000 7f7ccebd0640 1 -- 172.21.15.45:0/3947658862 shutdown_connections 2023-11-28T18:37:08.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.219+0000 7f7ccebd0640 1 -- 172.21.15.45:0/3947658862 wait complete. 2023-11-28T18:37:08.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.219+0000 7f7ccebd0640 1 Processor -- start 2023-11-28T18:37:08.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.219+0000 7f7ccebd0640 1 -- start start 2023-11-28T18:37:08.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.223+0000 7f7ccebd0640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7cb4003980 0x7f7cc80b68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:08.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.223+0000 7f7ccebd0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7cb40047d0 0x7f7cc815c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:08.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.223+0000 7f7ccebd0640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7cb4005260 0x7f7cc81f2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:08.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.223+0000 7f7ccebd0640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc809fdb0 con 0x7f7cb40047d0 2023-11-28T18:37:08.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.223+0000 7f7ccebd0640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc815ccf0 con 0x7f7cb4003980 2023-11-28T18:37:08.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.223+0000 7f7ccebd0640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc81f3e40 con 0x7f7cb4005260 2023-11-28T18:37:08.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.223+0000 7f7ccd3cd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7cb40047d0 0x7f7cc815c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:08.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.223+0000 7f7ccdbce640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7cb4003980 0x7f7cc80b68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:08.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.223+0000 7f7ccd3cd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7cb40047d0 0x7f7cc815c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40976/0 (socket says 172.21.15.45:40976) 2023-11-28T18:37:08.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.223+0000 7f7ccd3cd640 1 -- 172.21.15.45:0/2824299464 learned_addr learned my addr 172.21.15.45:0/2824299464 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:08.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.223+0000 7f7cce3cf640 1 --2- 172.21.15.45:0/2824299464 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7cb4005260 0x7f7cc81f2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:08.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.223+0000 7f7ccd3cd640 1 -- 172.21.15.45:0/2824299464 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7cb4005260 msgr2=0x7f7cc81f2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:08.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.223+0000 7f7ccd3cd640 1 --2- 172.21.15.45:0/2824299464 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7cb4005260 0x7f7cc81f2f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:08.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.223+0000 7f7ccd3cd640 1 -- 172.21.15.45:0/2824299464 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7cb4003980 msgr2=0x7f7cc80b68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:08.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.223+0000 7f7ccd3cd640 1 --2- 172.21.15.45:0/2824299464 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7cb4003980 0x7f7cc80b68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:08.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.223+0000 7f7ccd3cd640 1 -- 172.21.15.45:0/2824299464 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cc81f3880 con 0x7f7cb40047d0 2023-11-28T18:37:08.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.223+0000 7f7ccd3cd640 1 --2- 172.21.15.45:0/2824299464 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7cb40047d0 0x7f7cc815c7b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7cb80189c0 tx=0x7f7cb8018dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:08.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.223+0000 7f7cbe7fc640 1 -- 172.21.15.45:0/2824299464 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb8016d00 con 0x7f7cb40047d0 2023-11-28T18:37:08.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.223+0000 7f7cbe7fc640 1 -- 172.21.15.45:0/2824299464 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cb800c040 con 0x7f7cb40047d0 2023-11-28T18:37:08.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.223+0000 7f7cbe7fc640 1 -- 172.21.15.45:0/2824299464 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb8020670 con 0x7f7cb40047d0 2023-11-28T18:37:08.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.223+0000 7f7ccebd0640 1 -- 172.21.15.45:0/2824299464 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cc81f3b60 con 0x7f7cb40047d0 2023-11-28T18:37:08.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.223+0000 7f7ccebd0640 1 -- 172.21.15.45:0/2824299464 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cc81f3450 con 0x7f7cb40047d0 2023-11-28T18:37:08.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.223+0000 7f7cbe7fc640 1 -- 172.21.15.45:0/2824299464 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7cb80207d0 con 0x7f7cb40047d0 2023-11-28T18:37:08.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.223+0000 7f7cbe7fc640 1 -- 172.21.15.45:0/2824299464 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f7cb80297f0 con 0x7f7cb40047d0 2023-11-28T18:37:08.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.223+0000 7f7ccebd0640 1 -- 172.21.15.45:0/2824299464 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cc809f830 con 0x7f7cb40047d0 2023-11-28T18:37:08.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.235+0000 7f7cbe7fc640 1 -- 172.21.15.45:0/2824299464 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f7cc809f830 con 0x7f7cb40047d0 2023-11-28T18:37:08.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.323+0000 7f7ccebd0640 1 -- 172.21.15.45:0/2824299464 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f7cc80a0ee0 con 0x7f7cb40047d0 2023-11-28T18:37:08.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.327+0000 7f7cbe7fc640 1 -- 172.21.15.45:0/2824299464 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f7cb800f040 con 0x7f7cb40047d0 2023-11-28T18:37:08.331 INFO:teuthology.orchestra.run.smithi045.stderr:adjusted tunables profile to default 2023-11-28T18:37:08.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.327+0000 7f7ccebd0640 1 -- 172.21.15.45:0/2824299464 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7cb40047d0 msgr2=0x7f7cc815c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:08.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.327+0000 7f7ccebd0640 1 --2- 172.21.15.45:0/2824299464 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7cb40047d0 0x7f7cc815c7b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7cb80189c0 tx=0x7f7cb8018dc0 comp rx=0 tx=0).stop 2023-11-28T18:37:08.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.327+0000 7f7ccebd0640 1 -- 172.21.15.45:0/2824299464 shutdown_connections 2023-11-28T18:37:08.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.327+0000 7f7ccebd0640 1 --2- 172.21.15.45:0/2824299464 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7cb4005260 0x7f7cc81f2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:08.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.327+0000 7f7ccebd0640 1 --2- 172.21.15.45:0/2824299464 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7cb40047d0 0x7f7cc815c7b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:08.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.327+0000 7f7ccebd0640 1 --2- 172.21.15.45:0/2824299464 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7cb4003980 0x7f7cc80b68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:08.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.327+0000 7f7ccebd0640 1 -- 172.21.15.45:0/2824299464 >> 172.21.15.45:0/2824299464 conn(0x7f7cc809c300 msgr2=0x7f7cc80c8690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:08.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.327+0000 7f7ccebd0640 1 -- 172.21.15.45:0/2824299464 shutdown_connections 2023-11-28T18:37:08.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:08.327+0000 7f7ccebd0640 1 -- 172.21.15.45:0/2824299464 wait complete. 2023-11-28T18:37:08.352 INFO:tasks.ceph:check_enable_crimson: False 2023-11-28T18:37:08.352 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-11-28T18:37:08.352 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T18:37:08.352 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-11-28T18:37:08.374 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T18:37:08.374 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-11-28T18:37:08.415 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-11-28T18:37:08.414+0000 7ff4fbc47180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-28T18:37:08.442 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T18:37:08.442 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-11-28T18:37:08.449 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-11-28T18:37:08.443+0000 7f59b9851180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-28T18:37:08.470 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T18:37:08.470 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-11-28T18:37:08.538 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-28T18:37:08.538 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-11-28T18:37:08.559 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-28T18:37:08.560 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-11-28T18:37:08.624 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-28T18:37:08.625 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-11-28T18:37:08.691 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-28T18:37:08.691 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-11-28T18:37:08.751 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new 84465384-103c-4f2c-a45a-96f5bb9c835f 0 2023-11-28T18:37:08.931 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:08.930+0000 7f5883f1d640 1 Processor -- start 2023-11-28T18:37:08.931 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:08.930+0000 7f5883f1d640 1 -- start start 2023-11-28T18:37:08.933 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:08.934+0000 7f5883f1d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f587c15d2f0 0x7f587c0d17f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:08.933 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:08.934+0000 7f5883f1d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f587c0d0330 0x7f587c0b0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:08.933 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:08.934+0000 7f5883f1d640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f587c0aff70 con 0x7f587c0d1d30 2023-11-28T18:37:08.933 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:08.934+0000 7f5883f1d640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f587c0b0210 con 0x7f587c0d0330 2023-11-28T18:37:08.933 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:08.934+0000 7f5883f1d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f587c0b04f0 con 0x7f587c15d2f0 2023-11-28T18:37:08.933 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:08.934+0000 7f5881cb9640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f587c15d2f0 0x7f587c0d17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:08.933 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:08.934+0000 7f58814b8640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f587c0d1d30 0x7f587c0cfc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:41538/0 (socket says 172.21.15.190:41538) 2023-11-28T18:37:08.933 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:08.934+0000 7f58814b8640 1 -- 172.21.15.190:0/1356728250 learned_addr learned my addr 172.21.15.190:0/1356728250 (peer_addr_for_me v1:172.21.15.190:0/0) 2023-11-28T18:37:08.933 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:08.934+0000 7f58824ba640 1 --2- 172.21.15.190:0/1356728250 >> v2:172.21.15.45:3300/0 conn(0x7f587c0d0330 0x7f587c0b0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:08.934 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:08.934+0000 7f5881cb9640 1 -- 172.21.15.190:0/1356728250 >> v2:172.21.15.45:3300/0 conn(0x7f587c0d0330 msgr2=0x7f587c0b0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:08.934 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:08.934+0000 7f5881cb9640 1 --2- 172.21.15.190:0/1356728250 >> v2:172.21.15.45:3300/0 conn(0x7f587c0d0330 0x7f587c0b0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:08.934 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:08.934+0000 7f5881cb9640 1 -- 172.21.15.190:0/1356728250 >> v1:172.21.15.190:6789/0 conn(0x7f587c0d1d30 legacy=0x7f587c0cfc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:08.934 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:08.934+0000 7f5881cb9640 1 -- 172.21.15.190:0/1356728250 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f587c0b07d0 con 0x7f587c15d2f0 2023-11-28T18:37:08.934 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:08.934+0000 7f58824ba640 1 --2- 172.21.15.190:0/1356728250 >> v2:172.21.15.45:3300/0 conn(0x7f587c0d0330 0x7f587c0b0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:37:08.935 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:08.934+0000 7f5881cb9640 1 --2- 172.21.15.190:0/1356728250 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f587c15d2f0 0x7f587c0d17f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f58780097c0 tx=0x7f587801c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5de6d14a41d305f4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:08.936 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:08.938+0000 7f5880cb7640 1 -- 172.21.15.190:0/1356728250 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58780ab620 con 0x7f587c15d2f0 2023-11-28T18:37:08.936 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:08.938+0000 7f5880cb7640 1 -- 172.21.15.190:0/1356728250 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58780ab780 con 0x7f587c15d2f0 2023-11-28T18:37:08.936 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:08.938+0000 7f5880cb7640 1 -- 172.21.15.190:0/1356728250 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58780abb10 con 0x7f587c15d2f0 2023-11-28T18:37:08.937 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:08.938+0000 7f5883f1d640 1 -- 172.21.15.190:0/1356728250 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f587c15d2f0 msgr2=0x7f587c0d17f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:08.937 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:08.938+0000 7f5883f1d640 1 --2- 172.21.15.190:0/1356728250 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f587c15d2f0 0x7f587c0d17f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f58780097c0 tx=0x7f587801c480 comp rx=0 tx=0).stop 2023-11-28T18:37:08.937 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:08.938+0000 7f5883f1d640 1 -- 172.21.15.190:0/1356728250 shutdown_connections 2023-11-28T18:37:08.938 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:08.938+0000 7f5883f1d640 1 --2- 172.21.15.190:0/1356728250 >> v2:172.21.15.45:3300/0 conn(0x7f587c0d0330 0x7f587c0b0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:08.938 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:08.938+0000 7f5883f1d640 1 --2- 172.21.15.190:0/1356728250 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f587c15d2f0 0x7f587c0d17f0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:08.938 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:08.938+0000 7f5883f1d640 1 -- 172.21.15.190:0/1356728250 >> 172.21.15.190:0/1356728250 conn(0x7f587c09c550 msgr2=0x7f587c0d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:08.938 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:08.938+0000 7f5883f1d640 1 -- 172.21.15.190:0/1356728250 shutdown_connections 2023-11-28T18:37:08.939 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:08.938+0000 7f5883f1d640 1 -- 172.21.15.190:0/1356728250 wait complete. 2023-11-28T18:37:08.940 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:08.938+0000 7f5883f1d640 1 Processor -- start 2023-11-28T18:37:08.940 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:08.938+0000 7f5883f1d640 1 -- start start 2023-11-28T18:37:08.940 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:08.938+0000 7f5883f1d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f587c0d0330 0x7f587c154600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:08.940 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:08.938+0000 7f5883f1d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f587c0d1d30 0x7f587c15b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:08.940 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:08.938+0000 7f5883f1d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f587c15d2f0 0x7f587c15bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:08.940 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:08.938+0000 7f5883f1d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f587c0cb100 con 0x7f587c0d0330 2023-11-28T18:37:08.940 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:08.938+0000 7f5883f1d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f587c0b8ba0 con 0x7f587c15d2f0 2023-11-28T18:37:08.941 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:08.938+0000 7f5883f1d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f587c0b90d0 con 0x7f587c0d1d30 2023-11-28T18:37:08.942 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:08.942+0000 7f5881cb9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f587c0d0330 0x7f587c154600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:08.942 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:08.942+0000 7f58814b8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f587c0d1d30 0x7f587c15b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:08.942 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:08.942+0000 7f5881cb9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f587c0d0330 0x7f587c154600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.190:59016/0 (socket says 172.21.15.190:59016) 2023-11-28T18:37:08.943 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:08.942+0000 7f5881cb9640 1 -- 172.21.15.190:0/4067074366 learned_addr learned my addr 172.21.15.190:0/4067074366 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-11-28T18:37:08.943 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:08.942+0000 7f58824ba640 1 --2- 172.21.15.190:0/4067074366 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f587c15d2f0 0x7f587c15bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:08.943 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:08.942+0000 7f58814b8640 1 -- 172.21.15.190:0/4067074366 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f587c15d2f0 msgr2=0x7f587c15bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:08.943 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:08.942+0000 7f58814b8640 1 --2- 172.21.15.190:0/4067074366 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f587c15d2f0 0x7f587c15bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:08.943 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:08.942+0000 7f58814b8640 1 -- 172.21.15.190:0/4067074366 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f587c0d0330 msgr2=0x7f587c154600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:08.943 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:08.942+0000 7f58814b8640 1 --2- 172.21.15.190:0/4067074366 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f587c0d0330 0x7f587c154600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:08.943 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:08.942+0000 7f58814b8640 1 -- 172.21.15.190:0/4067074366 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5878009420 con 0x7f587c0d1d30 2023-11-28T18:37:08.944 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:08.942+0000 7f5881cb9640 1 --2- 172.21.15.190:0/4067074366 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f587c0d0330 0x7f587c154600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:37:08.944 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:08.942+0000 7f58824ba640 1 --2- 172.21.15.190:0/4067074366 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f587c15d2f0 0x7f587c15bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:37:08.944 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:08.942+0000 7f58814b8640 1 --2- 172.21.15.190:0/4067074366 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f587c0d1d30 0x7f587c15b660 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f586c00c430 tx=0x7f586c00c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:08.944 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:08.942+0000 7f58727fc640 1 -- 172.21.15.190:0/4067074366 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586c005cf0 con 0x7f587c0d1d30 2023-11-28T18:37:08.944 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:08.942+0000 7f58727fc640 1 -- 172.21.15.190:0/4067074366 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f586c005e50 con 0x7f587c0d1d30 2023-11-28T18:37:08.944 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:08.942+0000 7f58727fc640 1 -- 172.21.15.190:0/4067074366 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586c0072d0 con 0x7f587c0d1d30 2023-11-28T18:37:08.944 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:08.942+0000 7f5883f1d640 1 -- 172.21.15.190:0/4067074366 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f587c0b8df0 con 0x7f587c0d1d30 2023-11-28T18:37:08.945 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:08.942+0000 7f5883f1d640 1 -- 172.21.15.190:0/4067074366 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f587c154b40 con 0x7f587c0d1d30 2023-11-28T18:37:08.945 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:08.942+0000 7f58727fc640 1 -- 172.21.15.190:0/4067074366 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f586c01c440 con 0x7f587c0d1d30 2023-11-28T18:37:08.945 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:08.942+0000 7f58727fc640 1 -- 172.21.15.190:0/4067074366 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f586c012740 con 0x7f587c0d1d30 2023-11-28T18:37:08.945 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:08.942+0000 7f5883f1d640 1 -- 172.21.15.190:0/4067074366 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f587c067a30 con 0x7f587c0d1d30 2023-11-28T18:37:08.956 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:08.958+0000 7f58727fc640 1 -- 172.21.15.190:0/4067074366 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f586c021060 con 0x7f587c0d1d30 2023-11-28T18:37:09.019 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-11-28T18:37:09.018+0000 7ff4fbc47180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-28T18:37:09.022 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.022+0000 7f5883f1d640 1 -- 172.21.15.190:0/4067074366 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd new", "uuid": "84465384-103c-4f2c-a45a-96f5bb9c835f", "id": 0} v 0) v1 -- 0x7f587c069410 con 0x7f587c0d1d30 2023-11-28T18:37:09.025 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-11-28T18:37:09.019+0000 7f59b9851180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-28T18:37:09.027 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.026+0000 7f58727fc640 1 -- 172.21.15.190:0/4067074366 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "84465384-103c-4f2c-a45a-96f5bb9c835f", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f586c017070 con 0x7f587c0d1d30 2023-11-28T18:37:09.027 INFO:teuthology.orchestra.run.smithi190.stdout:0 2023-11-28T18:37:09.028 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.030+0000 7f5883f1d640 1 -- 172.21.15.190:0/4067074366 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f587c0d1d30 msgr2=0x7f587c15b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:09.028 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.030+0000 7f5883f1d640 1 --2- 172.21.15.190:0/4067074366 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f587c0d1d30 0x7f587c15b660 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f586c00c430 tx=0x7f586c00c8f0 comp rx=0 tx=0).stop 2023-11-28T18:37:09.029 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.030+0000 7f5883f1d640 1 -- 172.21.15.190:0/4067074366 shutdown_connections 2023-11-28T18:37:09.029 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.030+0000 7f5883f1d640 1 --2- 172.21.15.190:0/4067074366 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f587c15d2f0 0x7f587c15bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:09.029 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.030+0000 7f5883f1d640 1 --2- 172.21.15.190:0/4067074366 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f587c0d1d30 0x7f587c15b660 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:09.029 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.030+0000 7f5883f1d640 1 --2- 172.21.15.190:0/4067074366 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f587c0d0330 0x7f587c154600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:09.029 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.030+0000 7f5883f1d640 1 -- 172.21.15.190:0/4067074366 >> 172.21.15.190:0/4067074366 conn(0x7f587c09c550 msgr2=0x7f587c06ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:09.029 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.030+0000 7f5883f1d640 1 -- 172.21.15.190:0/4067074366 shutdown_connections 2023-11-28T18:37:09.029 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.030+0000 7f5883f1d640 1 -- 172.21.15.190:0/4067074366 wait complete. 2023-11-28T18:37:09.047 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new 7d9eed24-a58f-42c7-a787-ac06be8553fc 1 2023-11-28T18:37:09.183 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.182+0000 7f93cb59e640 1 Processor -- start 2023-11-28T18:37:09.183 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.182+0000 7f93cb59e640 1 -- start start 2023-11-28T18:37:09.185 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.182+0000 7f93cb59e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f93cc15dc00 0x7f93cc15dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:09.185 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.182+0000 7f93cb59e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f93cc0cdb90 0x7f93cc0cf8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:09.185 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.186+0000 7f93cb59e640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93cc0d0260 con 0x7f93cc0cfe00 2023-11-28T18:37:09.185 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.186+0000 7f93cb59e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93cc0ced20 con 0x7f93cc15dc00 2023-11-28T18:37:09.185 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.186+0000 7f93cb59e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93cc0d3a10 con 0x7f93cc0cdb90 2023-11-28T18:37:09.185 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.186+0000 7f93c3fff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f93cc0cdb90 0x7f93cc0cf8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:09.185 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.186+0000 7f93cad9d640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f93cc0cfe00 0x7f93cc160d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:41550/0 (socket says 172.21.15.190:41550) 2023-11-28T18:37:09.185 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.186+0000 7f93cad9d640 1 -- 172.21.15.190:0/2393575307 learned_addr learned my addr 172.21.15.190:0/2393575307 (peer_addr_for_me v1:172.21.15.190:0/0) 2023-11-28T18:37:09.185 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.186+0000 7f93ca59c640 1 --2- 172.21.15.190:0/2393575307 >> v2:172.21.15.45:3300/0 conn(0x7f93cc15dc00 0x7f93cc15dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:09.185 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.186+0000 7f93c3fff640 1 -- 172.21.15.190:0/2393575307 >> v2:172.21.15.45:3300/0 conn(0x7f93cc15dc00 msgr2=0x7f93cc15dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:09.186 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.186+0000 7f93c3fff640 1 --2- 172.21.15.190:0/2393575307 >> v2:172.21.15.45:3300/0 conn(0x7f93cc15dc00 0x7f93cc15dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:09.186 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.186+0000 7f93c3fff640 1 -- 172.21.15.190:0/2393575307 >> v1:172.21.15.190:6789/0 conn(0x7f93cc0cfe00 legacy=0x7f93cc160d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:09.186 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.186+0000 7f93c3fff640 1 -- 172.21.15.190:0/2393575307 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93cc0ce110 con 0x7f93cc0cdb90 2023-11-28T18:37:09.186 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.186+0000 7f93c9d9b640 1 -- 172.21.15.190:0/2393575307 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2827665793 0 0) 0x7f93cc0d0260 con 0x7f93cc0cfe00 2023-11-28T18:37:09.188 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.186+0000 7f93c3fff640 1 --2- 172.21.15.190:0/2393575307 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f93cc0cdb90 0x7f93cc0cf8c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f93b40097c0 tx=0x7f93b401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=483ead58f4d3f76e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:09.188 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.186+0000 7f93c9d9b640 1 -- 172.21.15.190:0/2393575307 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b40ab650 con 0x7f93cc0cdb90 2023-11-28T18:37:09.188 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.186+0000 7f93c9d9b640 1 -- 172.21.15.190:0/2393575307 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93b40ab7b0 con 0x7f93cc0cdb90 2023-11-28T18:37:09.188 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.190+0000 7f93c9d9b640 1 -- 172.21.15.190:0/2393575307 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b40abb40 con 0x7f93cc0cdb90 2023-11-28T18:37:09.189 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.190+0000 7f93cb59e640 1 -- 172.21.15.190:0/2393575307 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f93cc0cdb90 msgr2=0x7f93cc0cf8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:09.189 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.190+0000 7f93cb59e640 1 --2- 172.21.15.190:0/2393575307 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f93cc0cdb90 0x7f93cc0cf8c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f93b40097c0 tx=0x7f93b401c450 comp rx=0 tx=0).stop 2023-11-28T18:37:09.189 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.190+0000 7f93cb59e640 1 -- 172.21.15.190:0/2393575307 shutdown_connections 2023-11-28T18:37:09.189 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.190+0000 7f93cb59e640 1 --2- 172.21.15.190:0/2393575307 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f93cc0cdb90 0x7f93cc0cf8c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:09.189 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.190+0000 7f93cb59e640 1 --2- 172.21.15.190:0/2393575307 >> v2:172.21.15.45:3300/0 conn(0x7f93cc15dc00 0x7f93cc15dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:09.189 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.190+0000 7f93cb59e640 1 -- 172.21.15.190:0/2393575307 >> 172.21.15.190:0/2393575307 conn(0x7f93cc09c300 msgr2=0x7f93cc0d2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:09.190 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.190+0000 7f93cb59e640 1 -- 172.21.15.190:0/2393575307 shutdown_connections 2023-11-28T18:37:09.190 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.190+0000 7f93cb59e640 1 -- 172.21.15.190:0/2393575307 wait complete. 2023-11-28T18:37:09.190 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.190+0000 7f93cb59e640 1 Processor -- start 2023-11-28T18:37:09.190 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.190+0000 7f93cb59e640 1 -- start start 2023-11-28T18:37:09.192 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.190+0000 7f93cb59e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93cc0cdb90 0x7f93cc0a03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:09.192 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.190+0000 7f93cb59e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f93cc0cfe00 0x7f93cc152790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:09.193 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.190+0000 7f93cb59e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f93cc15dc00 0x7f93cc0c6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:09.193 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.190+0000 7f93cb59e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93cc153490 con 0x7f93cc0cdb90 2023-11-28T18:37:09.193 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.190+0000 7f93cb59e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93cc0a0920 con 0x7f93cc15dc00 2023-11-28T18:37:09.193 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.190+0000 7f93cb59e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93cc1536e0 con 0x7f93cc0cfe00 2023-11-28T18:37:09.193 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.190+0000 7f93c3fff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f93cc0cfe00 0x7f93cc152790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:09.193 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.190+0000 7f93c3fff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f93cc0cfe00 0x7f93cc152790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:39458/0 (socket says 172.21.15.190:39458) 2023-11-28T18:37:09.193 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.190+0000 7f93cad9d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f93cc15dc00 0x7f93cc0c6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:09.194 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.194+0000 7f93c3fff640 1 -- 172.21.15.190:0/3194934587 learned_addr learned my addr 172.21.15.190:0/3194934587 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-11-28T18:37:09.194 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.194+0000 7f93ca59c640 1 --2- 172.21.15.190:0/3194934587 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93cc0cdb90 0x7f93cc0a03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:09.194 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.194+0000 7f93cad9d640 1 -- 172.21.15.190:0/3194934587 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f93cc0cfe00 msgr2=0x7f93cc152790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:09.194 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.194+0000 7f93cad9d640 1 --2- 172.21.15.190:0/3194934587 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f93cc0cfe00 0x7f93cc152790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:09.194 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.194+0000 7f93cad9d640 1 -- 172.21.15.190:0/3194934587 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93cc0cdb90 msgr2=0x7f93cc0a03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:09.194 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.194+0000 7f93cad9d640 1 --2- 172.21.15.190:0/3194934587 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93cc0cdb90 0x7f93cc0a03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:09.194 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.194+0000 7f93cad9d640 1 -- 172.21.15.190:0/3194934587 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93b4009420 con 0x7f93cc15dc00 2023-11-28T18:37:09.195 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.194+0000 7f93ca59c640 1 --2- 172.21.15.190:0/3194934587 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93cc0cdb90 0x7f93cc0a03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:37:09.195 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.194+0000 7f93cad9d640 1 --2- 172.21.15.190:0/3194934587 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f93cc15dc00 0x7f93cc0c6d10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f93c4002240 tx=0x7f93c400cbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:09.196 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.194+0000 7f93c2ffd640 1 -- 172.21.15.190:0/3194934587 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c400ce30 con 0x7f93cc15dc00 2023-11-28T18:37:09.196 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.194+0000 7f93c2ffd640 1 -- 172.21.15.190:0/3194934587 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93c400a640 con 0x7f93cc15dc00 2023-11-28T18:37:09.196 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.194+0000 7f93c2ffd640 1 -- 172.21.15.190:0/3194934587 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c400a9f0 con 0x7f93cc15dc00 2023-11-28T18:37:09.196 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.194+0000 7f93cb59e640 1 -- 172.21.15.190:0/3194934587 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93cc1539c0 con 0x7f93cc15dc00 2023-11-28T18:37:09.196 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.194+0000 7f93cb59e640 1 -- 172.21.15.190:0/3194934587 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93cc153f80 con 0x7f93cc15dc00 2023-11-28T18:37:09.196 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.194+0000 7f93c2ffd640 1 -- 172.21.15.190:0/3194934587 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f93c40070d0 con 0x7f93cc15dc00 2023-11-28T18:37:09.196 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.194+0000 7f93c2ffd640 1 -- 172.21.15.190:0/3194934587 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f93c4012880 con 0x7f93cc15dc00 2023-11-28T18:37:09.197 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.194+0000 7f93cb59e640 1 -- 172.21.15.190:0/3194934587 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93cc0a0ee0 con 0x7f93cc15dc00 2023-11-28T18:37:09.197 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.198+0000 7f93c2ffd640 1 -- 172.21.15.190:0/3194934587 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f93c4018070 con 0x7f93cc15dc00 2023-11-28T18:37:09.229 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-11-28T18:37:09.223+0000 7f59b9851180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-28T18:37:09.234 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-11-28T18:37:09.234+0000 7ff4fbc47180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-28T18:37:09.266 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.266+0000 7f93cb59e640 1 -- 172.21.15.190:0/3194934587 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7d9eed24-a58f-42c7-a787-ac06be8553fc", "id": 1} v 0) v1 -- 0x7f93cc04e970 con 0x7f93cc15dc00 2023-11-28T18:37:09.271 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.270+0000 7f93c2ffd640 1 -- 172.21.15.190:0/3194934587 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7d9eed24-a58f-42c7-a787-ac06be8553fc", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f93c4012a40 con 0x7f93cc15dc00 2023-11-28T18:37:09.271 INFO:teuthology.orchestra.run.smithi190.stdout:1 2023-11-28T18:37:09.272 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.274+0000 7f93cb59e640 1 -- 172.21.15.190:0/3194934587 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f93cc15dc00 msgr2=0x7f93cc0c6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:09.272 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.274+0000 7f93cb59e640 1 --2- 172.21.15.190:0/3194934587 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f93cc15dc00 0x7f93cc0c6d10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f93c4002240 tx=0x7f93c400cbe0 comp rx=0 tx=0).stop 2023-11-28T18:37:09.272 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.274+0000 7f93cb59e640 1 -- 172.21.15.190:0/3194934587 shutdown_connections 2023-11-28T18:37:09.273 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.274+0000 7f93cb59e640 1 --2- 172.21.15.190:0/3194934587 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f93cc15dc00 0x7f93cc0c6d10 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:09.273 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.274+0000 7f93cb59e640 1 --2- 172.21.15.190:0/3194934587 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f93cc0cfe00 0x7f93cc152790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:09.273 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.274+0000 7f93cb59e640 1 --2- 172.21.15.190:0/3194934587 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93cc0cdb90 0x7f93cc0a03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:09.273 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.274+0000 7f93cb59e640 1 -- 172.21.15.190:0/3194934587 >> 172.21.15.190:0/3194934587 conn(0x7f93cc09c300 msgr2=0x7f93cc0b53b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:09.273 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.274+0000 7f93cb59e640 1 -- 172.21.15.190:0/3194934587 shutdown_connections 2023-11-28T18:37:09.273 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.274+0000 7f93cb59e640 1 -- 172.21.15.190:0/3194934587 wait complete. 2023-11-28T18:37:09.291 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new 575eeccc-4abf-45b4-9caf-f3e797859588 2 2023-11-28T18:37:09.428 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.430+0000 7f6796380640 1 Processor -- start 2023-11-28T18:37:09.428 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.430+0000 7f6796380640 1 -- start start 2023-11-28T18:37:09.430 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.430+0000 7f6796380640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f679015d2f0 0x7f67900d17f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:09.430 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.430+0000 7f6796380640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f67900d0330 0x7f67900b0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:09.430 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.430+0000 7f6796380640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67900aff70 con 0x7f67900d1d30 2023-11-28T18:37:09.430 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.430+0000 7f6796380640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67900b0210 con 0x7f67900d0330 2023-11-28T18:37:09.430 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.430+0000 7f6796380640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67900b04f0 con 0x7f679015d2f0 2023-11-28T18:37:09.430 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.430+0000 7f678ffff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f679015d2f0 0x7f67900d17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:09.430 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.430+0000 7f679491d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f67900d0330 0x7f67900b0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:09.430 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.430+0000 7f678ffff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f679015d2f0 0x7f67900d17f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:39468/0 (socket says 172.21.15.190:39468) 2023-11-28T18:37:09.430 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.430+0000 7f678ffff640 1 -- 172.21.15.190:0/2633449724 learned_addr learned my addr 172.21.15.190:0/2633449724 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-11-28T18:37:09.431 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.430+0000 7f678ffff640 1 -- 172.21.15.190:0/2633449724 >> v2:172.21.15.190:3300/0 conn(0x7f67900d0330 msgr2=0x7f67900b0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:09.431 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.430+0000 7f678ffff640 1 --2- 172.21.15.190:0/2633449724 >> v2:172.21.15.190:3300/0 conn(0x7f67900d0330 0x7f67900b0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:09.431 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.430+0000 7f678ffff640 1 -- 172.21.15.190:0/2633449724 >> v1:172.21.15.45:6789/0 conn(0x7f67900d1d30 legacy=0x7f67900cfc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:09.431 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.430+0000 7f678ffff640 1 -- 172.21.15.190:0/2633449724 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67900b07d0 con 0x7f679015d2f0 2023-11-28T18:37:09.433 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.434+0000 7f678ffff640 1 --2- 172.21.15.190:0/2633449724 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f679015d2f0 0x7f67900d17f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6780009870 tx=0x7f678001c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f229b13355d3652 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:09.434 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.434+0000 7f678effd640 1 -- 172.21.15.190:0/2633449724 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67800aa640 con 0x7f679015d2f0 2023-11-28T18:37:09.434 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.434+0000 7f678effd640 1 -- 172.21.15.190:0/2633449724 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67800aa7a0 con 0x7f679015d2f0 2023-11-28T18:37:09.434 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.434+0000 7f678effd640 1 -- 172.21.15.190:0/2633449724 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67800aab30 con 0x7f679015d2f0 2023-11-28T18:37:09.435 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.434+0000 7f6796380640 1 -- 172.21.15.190:0/2633449724 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f679015d2f0 msgr2=0x7f67900d17f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:09.435 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.434+0000 7f6796380640 1 --2- 172.21.15.190:0/2633449724 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f679015d2f0 0x7f67900d17f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6780009870 tx=0x7f678001c540 comp rx=0 tx=0).stop 2023-11-28T18:37:09.435 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.434+0000 7f6796380640 1 -- 172.21.15.190:0/2633449724 shutdown_connections 2023-11-28T18:37:09.435 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.434+0000 7f6796380640 1 --2- 172.21.15.190:0/2633449724 >> v2:172.21.15.190:3300/0 conn(0x7f67900d0330 0x7f67900b0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:09.435 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.434+0000 7f6796380640 1 --2- 172.21.15.190:0/2633449724 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f679015d2f0 0x7f67900d17f0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:09.435 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.434+0000 7f6796380640 1 -- 172.21.15.190:0/2633449724 >> 172.21.15.190:0/2633449724 conn(0x7f679009c550 msgr2=0x7f67900d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:09.435 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.434+0000 7f6796380640 1 -- 172.21.15.190:0/2633449724 shutdown_connections 2023-11-28T18:37:09.435 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.434+0000 7f6796380640 1 -- 172.21.15.190:0/2633449724 wait complete. 2023-11-28T18:37:09.436 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.438+0000 7f6796380640 1 Processor -- start 2023-11-28T18:37:09.436 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.438+0000 7f6796380640 1 -- start start 2023-11-28T18:37:09.438 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.438+0000 7f6796380640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f67900d0330 0x7f67900c8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:09.438 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.438+0000 7f6796380640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f67900d1d30 0x7f67900cba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:09.438 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.438+0000 7f6796380640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f679015d2f0 0x7f67900cbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:09.438 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.438+0000 7f6796380640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6790154190 con 0x7f679015d2f0 2023-11-28T18:37:09.438 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.438+0000 7f6796380640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67900c87a0 con 0x7f67900d1d30 2023-11-28T18:37:09.438 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.438+0000 7f6796380640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f679015e060 con 0x7f67900d0330 2023-11-28T18:37:09.438 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.438+0000 7f678ffff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f67900d0330 0x7f67900c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:09.439 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.438+0000 7f678ffff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f67900d0330 0x7f67900c8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:39482/0 (socket says 172.21.15.190:39482) 2023-11-28T18:37:09.439 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.438+0000 7f678f7fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f67900d1d30 0x7f67900cba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:09.439 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.438+0000 7f678ffff640 1 -- 172.21.15.190:0/1880729213 learned_addr learned my addr 172.21.15.190:0/1880729213 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-11-28T18:37:09.439 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.438+0000 7f679491d640 1 --2- 172.21.15.190:0/1880729213 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f679015d2f0 0x7f67900cbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:09.439 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.438+0000 7f678ffff640 1 -- 172.21.15.190:0/1880729213 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f67900d1d30 msgr2=0x7f67900cba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:09.439 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.438+0000 7f678ffff640 1 --2- 172.21.15.190:0/1880729213 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f67900d1d30 0x7f67900cba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:09.439 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.438+0000 7f678ffff640 1 -- 172.21.15.190:0/1880729213 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f679015d2f0 msgr2=0x7f67900cbfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:09.439 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.438+0000 7f678ffff640 1 --2- 172.21.15.190:0/1880729213 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f679015d2f0 0x7f67900cbfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:09.439 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.438+0000 7f678ffff640 1 -- 172.21.15.190:0/1880729213 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67800094d0 con 0x7f67900d0330 2023-11-28T18:37:09.440 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.438+0000 7f678ffff640 1 --2- 172.21.15.190:0/1880729213 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f67900d0330 0x7f67900c8260 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f67800ac040 tx=0x7f67800192e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:09.440 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.438+0000 7f678cff9640 1 -- 172.21.15.190:0/1880729213 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67800be610 con 0x7f67900d0330 2023-11-28T18:37:09.440 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.438+0000 7f678cff9640 1 -- 172.21.15.190:0/1880729213 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67800be7b0 con 0x7f67900d0330 2023-11-28T18:37:09.441 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.438+0000 7f678cff9640 1 -- 172.21.15.190:0/1880729213 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67800beb60 con 0x7f67900d0330 2023-11-28T18:37:09.441 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.438+0000 7f6796380640 1 -- 172.21.15.190:0/1880729213 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f679015e340 con 0x7f67900d0330 2023-11-28T18:37:09.441 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.438+0000 7f6796380640 1 -- 172.21.15.190:0/1880729213 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67901543a0 con 0x7f67900d0330 2023-11-28T18:37:09.441 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.438+0000 7f678cff9640 1 -- 172.21.15.190:0/1880729213 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f67800a8050 con 0x7f67900d0330 2023-11-28T18:37:09.441 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.438+0000 7f678cff9640 1 -- 172.21.15.190:0/1880729213 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f67800b4400 con 0x7f67900d0330 2023-11-28T18:37:09.441 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.438+0000 7f6796380640 1 -- 172.21.15.190:0/1880729213 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6790067a30 con 0x7f67900d0330 2023-11-28T18:37:09.442 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.442+0000 7f678cff9640 1 -- 172.21.15.190:0/1880729213 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f67800a6040 con 0x7f67900d0330 2023-11-28T18:37:09.507 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.506+0000 7f6796380640 1 -- 172.21.15.190:0/1880729213 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd new", "uuid": "575eeccc-4abf-45b4-9caf-f3e797859588", "id": 2} v 0) v1 -- 0x7f6790160a00 con 0x7f67900d0330 2023-11-28T18:37:09.512 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.510+0000 7f678cff9640 1 -- 172.21.15.190:0/1880729213 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "575eeccc-4abf-45b4-9caf-f3e797859588", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f67800b45c0 con 0x7f67900d0330 2023-11-28T18:37:09.512 INFO:teuthology.orchestra.run.smithi190.stdout:2 2023-11-28T18:37:09.513 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.514+0000 7f6796380640 1 -- 172.21.15.190:0/1880729213 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f67900d0330 msgr2=0x7f67900c8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:09.513 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.514+0000 7f6796380640 1 --2- 172.21.15.190:0/1880729213 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f67900d0330 0x7f67900c8260 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f67800ac040 tx=0x7f67800192e0 comp rx=0 tx=0).stop 2023-11-28T18:37:09.513 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.514+0000 7f6796380640 1 -- 172.21.15.190:0/1880729213 shutdown_connections 2023-11-28T18:37:09.513 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.514+0000 7f6796380640 1 --2- 172.21.15.190:0/1880729213 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f679015d2f0 0x7f67900cbfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:09.513 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.514+0000 7f6796380640 1 --2- 172.21.15.190:0/1880729213 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f67900d1d30 0x7f67900cba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:09.513 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.514+0000 7f6796380640 1 --2- 172.21.15.190:0/1880729213 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f67900d0330 0x7f67900c8260 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:09.514 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.514+0000 7f6796380640 1 -- 172.21.15.190:0/1880729213 >> 172.21.15.190:0/1880729213 conn(0x7f679009c550 msgr2=0x7f67900b5590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:09.514 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.514+0000 7f6796380640 1 -- 172.21.15.190:0/1880729213 shutdown_connections 2023-11-28T18:37:09.514 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.514+0000 7f6796380640 1 -- 172.21.15.190:0/1880729213 wait complete. 2023-11-28T18:37:09.531 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new 9b0290d6-9a52-4bc8-b2a1-7622c5dc8e0b 3 2023-11-28T18:37:09.668 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.666+0000 7f0f10165640 1 Processor -- start 2023-11-28T18:37:09.668 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.670+0000 7f0f10165640 1 -- start start 2023-11-28T18:37:09.670 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.670+0000 7f0f10165640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0f0815d2f0 0x7f0f080d17f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:09.670 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.670+0000 7f0f10165640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0f080d1d30 0x7f0f080cfc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:09.670 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.670+0000 7f0f10165640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f080aff70 con 0x7f0f0815d6d0 2023-11-28T18:37:09.670 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.670+0000 7f0f10165640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f080b0210 con 0x7f0f0815d2f0 2023-11-28T18:37:09.670 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.670+0000 7f0f10165640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f080b04f0 con 0x7f0f080d1d30 2023-11-28T18:37:09.670 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.670+0000 7f0f0d700640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0f080d1d30 0x7f0f080cfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:09.671 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.670+0000 7f0f0e702640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f0f0815d6d0 0x7f0f080cddb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:41554/0 (socket says 172.21.15.190:41554) 2023-11-28T18:37:09.671 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.670+0000 7f0f0e702640 1 -- 172.21.15.190:0/2605218522 learned_addr learned my addr 172.21.15.190:0/2605218522 (peer_addr_for_me v1:172.21.15.190:0/0) 2023-11-28T18:37:09.671 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.670+0000 7f0f0df01640 1 --2- 172.21.15.190:0/2605218522 >> v2:172.21.15.45:3300/0 conn(0x7f0f0815d2f0 0x7f0f080d17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:09.671 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.670+0000 7f0f0d700640 1 -- 172.21.15.190:0/2605218522 >> v2:172.21.15.45:3300/0 conn(0x7f0f0815d2f0 msgr2=0x7f0f080d17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:09.671 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.670+0000 7f0f0d700640 1 --2- 172.21.15.190:0/2605218522 >> v2:172.21.15.45:3300/0 conn(0x7f0f0815d2f0 0x7f0f080d17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:09.671 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.670+0000 7f0f0d700640 1 -- 172.21.15.190:0/2605218522 >> v1:172.21.15.190:6789/0 conn(0x7f0f0815d6d0 legacy=0x7f0f080cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:09.671 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.670+0000 7f0f0d700640 1 -- 172.21.15.190:0/2605218522 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f080b07d0 con 0x7f0f080d1d30 2023-11-28T18:37:09.671 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.670+0000 7f0f0ceff640 1 -- 172.21.15.190:0/2605218522 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2237721200 0 0) 0x7f0f080aff70 con 0x7f0f0815d6d0 2023-11-28T18:37:09.671 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.670+0000 7f0f0df01640 1 --2- 172.21.15.190:0/2605218522 >> v2:172.21.15.45:3300/0 conn(0x7f0f0815d2f0 0x7f0f080d17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:37:09.673 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.674+0000 7f0f0d700640 1 --2- 172.21.15.190:0/2605218522 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0f080d1d30 0x7f0f080cfc20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0ef80097c0 tx=0x7f0ef801c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c569e460407f0f4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:09.673 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.674+0000 7f0f0ceff640 1 -- 172.21.15.190:0/2605218522 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef80ab620 con 0x7f0f080d1d30 2023-11-28T18:37:09.673 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.674+0000 7f0f0ceff640 1 -- 172.21.15.190:0/2605218522 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ef80ab780 con 0x7f0f080d1d30 2023-11-28T18:37:09.673 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.674+0000 7f0f0ceff640 1 -- 172.21.15.190:0/2605218522 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef80abb10 con 0x7f0f080d1d30 2023-11-28T18:37:09.674 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.674+0000 7f0f10165640 1 -- 172.21.15.190:0/2605218522 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0f080d1d30 msgr2=0x7f0f080cfc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:09.674 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.674+0000 7f0f10165640 1 --2- 172.21.15.190:0/2605218522 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0f080d1d30 0x7f0f080cfc20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0ef80097c0 tx=0x7f0ef801c480 comp rx=0 tx=0).stop 2023-11-28T18:37:09.674 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.674+0000 7f0f10165640 1 -- 172.21.15.190:0/2605218522 shutdown_connections 2023-11-28T18:37:09.674 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.674+0000 7f0f10165640 1 --2- 172.21.15.190:0/2605218522 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0f080d1d30 0x7f0f080cfc20 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:09.675 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.674+0000 7f0f10165640 1 --2- 172.21.15.190:0/2605218522 >> v2:172.21.15.45:3300/0 conn(0x7f0f0815d2f0 0x7f0f080d17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:09.675 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.674+0000 7f0f10165640 1 -- 172.21.15.190:0/2605218522 >> 172.21.15.190:0/2605218522 conn(0x7f0f0809c550 msgr2=0x7f0f080d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:09.675 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.674+0000 7f0f10165640 1 -- 172.21.15.190:0/2605218522 shutdown_connections 2023-11-28T18:37:09.675 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.674+0000 7f0f10165640 1 -- 172.21.15.190:0/2605218522 wait complete. 2023-11-28T18:37:09.676 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.678+0000 7f0f10165640 1 Processor -- start 2023-11-28T18:37:09.676 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.678+0000 7f0f10165640 1 -- start start 2023-11-28T18:37:09.679 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.678+0000 7f0f10165640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0f080d1d30 0x7f0f080c9930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:09.679 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.678+0000 7f0f10165640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f0815d2f0 0x7f0f08155a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:09.679 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.678+0000 7f0f10165640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0f0815d6d0 0x7f0f081f65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:09.679 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.678+0000 7f0f10165640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0815b400 con 0x7f0f0815d2f0 2023-11-28T18:37:09.680 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.678+0000 7f0f10165640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f08155fb0 con 0x7f0f080d1d30 2023-11-28T18:37:09.680 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.678+0000 7f0f10165640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f081f75e0 con 0x7f0f0815d6d0 2023-11-28T18:37:09.680 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.678+0000 7f0f0df01640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0f080d1d30 0x7f0f080c9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:09.680 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.678+0000 7f0f0e702640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0f0815d6d0 0x7f0f081f65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:09.680 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.678+0000 7f0f0df01640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0f080d1d30 0x7f0f080c9930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:56026/0 (socket says 172.21.15.190:56026) 2023-11-28T18:37:09.680 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.678+0000 7f0f0df01640 1 -- 172.21.15.190:0/794995082 learned_addr learned my addr 172.21.15.190:0/794995082 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-11-28T18:37:09.680 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.678+0000 7f0f0d700640 1 --2- 172.21.15.190:0/794995082 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f0815d2f0 0x7f0f08155a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:09.680 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.678+0000 7f0f0df01640 1 -- 172.21.15.190:0/794995082 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0f0815d6d0 msgr2=0x7f0f081f65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:09.680 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.678+0000 7f0f0df01640 1 --2- 172.21.15.190:0/794995082 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0f0815d6d0 0x7f0f081f65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:09.680 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.678+0000 7f0f0df01640 1 -- 172.21.15.190:0/794995082 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f0815d2f0 msgr2=0x7f0f08155a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:09.681 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.678+0000 7f0f0df01640 1 --2- 172.21.15.190:0/794995082 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f0815d2f0 0x7f0f08155a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:09.681 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.678+0000 7f0f0df01640 1 -- 172.21.15.190:0/794995082 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ef8009420 con 0x7f0f080d1d30 2023-11-28T18:37:09.681 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.678+0000 7f0f0e702640 1 --2- 172.21.15.190:0/794995082 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0f0815d6d0 0x7f0f081f65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:37:09.681 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.678+0000 7f0f0df01640 1 --2- 172.21.15.190:0/794995082 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0f080d1d30 0x7f0f080c9930 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0f0400e810 tx=0x7f0f0400ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:09.681 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.678+0000 7f0efe7fc640 1 -- 172.21.15.190:0/794995082 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f0400c8d0 con 0x7f0f080d1d30 2023-11-28T18:37:09.681 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.678+0000 7f0efe7fc640 1 -- 172.21.15.190:0/794995082 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f0400ca30 con 0x7f0f080d1d30 2023-11-28T18:37:09.681 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.678+0000 7f0f10165640 1 -- 172.21.15.190:0/794995082 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f0815b650 con 0x7f0f080d1d30 2023-11-28T18:37:09.681 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.678+0000 7f0efe7fc640 1 -- 172.21.15.190:0/794995082 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f0400cdc0 con 0x7f0f080d1d30 2023-11-28T18:37:09.681 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.678+0000 7f0f10165640 1 -- 172.21.15.190:0/794995082 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f0815bc10 con 0x7f0f080d1d30 2023-11-28T18:37:09.681 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.678+0000 7f0efe7fc640 1 -- 172.21.15.190:0/794995082 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0f0401c750 con 0x7f0f080d1d30 2023-11-28T18:37:09.681 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.678+0000 7f0efe7fc640 1 -- 172.21.15.190:0/794995082 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f0f040135a0 con 0x7f0f080d1d30 2023-11-28T18:37:09.682 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.678+0000 7f0f10165640 1 -- 172.21.15.190:0/794995082 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f08067a30 con 0x7f0f080d1d30 2023-11-28T18:37:09.682 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.682+0000 7f0efe7fc640 1 -- 172.21.15.190:0/794995082 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f0f0403bce0 con 0x7f0f080d1d30 2023-11-28T18:37:09.747 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.746+0000 7f0f10165640 1 -- 172.21.15.190:0/794995082 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9b0290d6-9a52-4bc8-b2a1-7622c5dc8e0b", "id": 3} v 0) v1 -- 0x7f0f08069410 con 0x7f0f080d1d30 2023-11-28T18:37:09.752 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.754+0000 7f0efe7fc640 1 -- 172.21.15.190:0/794995082 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9b0290d6-9a52-4bc8-b2a1-7622c5dc8e0b", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0f0402a070 con 0x7f0f080d1d30 2023-11-28T18:37:09.752 INFO:teuthology.orchestra.run.smithi190.stdout:3 2023-11-28T18:37:09.753 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.754+0000 7f0f10165640 1 -- 172.21.15.190:0/794995082 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0f080d1d30 msgr2=0x7f0f080c9930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:09.754 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.754+0000 7f0f10165640 1 --2- 172.21.15.190:0/794995082 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0f080d1d30 0x7f0f080c9930 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0f0400e810 tx=0x7f0f0400ecd0 comp rx=0 tx=0).stop 2023-11-28T18:37:09.754 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.754+0000 7f0f10165640 1 -- 172.21.15.190:0/794995082 shutdown_connections 2023-11-28T18:37:09.754 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.754+0000 7f0f10165640 1 --2- 172.21.15.190:0/794995082 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0f0815d6d0 0x7f0f081f65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:09.754 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.754+0000 7f0f10165640 1 --2- 172.21.15.190:0/794995082 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f0815d2f0 0x7f0f08155a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:09.754 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.754+0000 7f0f10165640 1 --2- 172.21.15.190:0/794995082 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0f080d1d30 0x7f0f080c9930 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:09.754 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.754+0000 7f0f10165640 1 -- 172.21.15.190:0/794995082 >> 172.21.15.190:0/794995082 conn(0x7f0f0809c550 msgr2=0x7f0f080d0750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:09.754 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.754+0000 7f0f10165640 1 -- 172.21.15.190:0/794995082 shutdown_connections 2023-11-28T18:37:09.754 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.754+0000 7f0f10165640 1 -- 172.21.15.190:0/794995082 wait complete. 2023-11-28T18:37:09.773 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new ce632829-f027-4fbf-a627-02c571aa9d53 4 2023-11-28T18:37:09.900 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-11-28T18:37:09.895+0000 7f59b9851180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-28T18:37:09.902 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-11-28T18:37:09.902+0000 7ff4fbc47180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-28T18:37:09.910 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.910+0000 7f85109f8640 1 Processor -- start 2023-11-28T18:37:09.910 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.910+0000 7f85109f8640 1 -- start start 2023-11-28T18:37:09.912 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.910+0000 7f85109f8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f850c15d2f0 0x7f850c0d17f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:09.912 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.910+0000 7f85109f8640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f850c0d0330 0x7f850c0b0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:09.912 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.910+0000 7f85109f8640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f850c0aff70 con 0x7f850c0d1d30 2023-11-28T18:37:09.912 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.910+0000 7f85109f8640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f850c0b0210 con 0x7f850c0d0330 2023-11-28T18:37:09.912 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.910+0000 7f85109f8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f850c0b04f0 con 0x7f850c15d2f0 2023-11-28T18:37:09.912 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.910+0000 7f850a59c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f850c15d2f0 0x7f850c0d17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:09.912 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.910+0000 7f850a59c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f850c15d2f0 0x7f850c0d17f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:39502/0 (socket says 172.21.15.190:39502) 2023-11-28T18:37:09.912 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.910+0000 7f8509d9b640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f850c0d1d30 0x7f850c0cfc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:41570/0 (socket says 172.21.15.190:41570) 2023-11-28T18:37:09.913 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.910+0000 7f850ad9d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f850c0d0330 0x7f850c0b0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:09.913 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.910+0000 7f850a59c640 1 -- 172.21.15.190:0/2412491583 learned_addr learned my addr 172.21.15.190:0/2412491583 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-11-28T18:37:09.913 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.914+0000 7f850a59c640 1 -- 172.21.15.190:0/2412491583 >> v2:172.21.15.190:3300/0 conn(0x7f850c0d0330 msgr2=0x7f850c0b0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:09.913 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.914+0000 7f850a59c640 1 --2- 172.21.15.190:0/2412491583 >> v2:172.21.15.190:3300/0 conn(0x7f850c0d0330 0x7f850c0b0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:09.913 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.914+0000 7f850a59c640 1 -- 172.21.15.190:0/2412491583 >> v1:172.21.15.190:6789/0 conn(0x7f850c0d1d30 legacy=0x7f850c0cfc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:09.913 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.914+0000 7f850a59c640 1 -- 172.21.15.190:0/2412491583 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f850c0b07d0 con 0x7f850c15d2f0 2023-11-28T18:37:09.915 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.914+0000 7f850a59c640 1 --2- 172.21.15.190:0/2412491583 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f850c15d2f0 0x7f850c0d17f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f84fc009870 tx=0x7f84fc01c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79c5c445669c11be server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:09.915 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.914+0000 7f850959a640 1 -- 172.21.15.190:0/2412491583 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84fc0aa640 con 0x7f850c15d2f0 2023-11-28T18:37:09.916 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.914+0000 7f850959a640 1 -- 172.21.15.190:0/2412491583 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84fc0aa7a0 con 0x7f850c15d2f0 2023-11-28T18:37:09.916 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.914+0000 7f850959a640 1 -- 172.21.15.190:0/2412491583 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84fc0aab30 con 0x7f850c15d2f0 2023-11-28T18:37:09.916 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.918+0000 7f85109f8640 1 -- 172.21.15.190:0/2412491583 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f850c15d2f0 msgr2=0x7f850c0d17f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:09.916 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.918+0000 7f85109f8640 1 --2- 172.21.15.190:0/2412491583 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f850c15d2f0 0x7f850c0d17f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f84fc009870 tx=0x7f84fc01c540 comp rx=0 tx=0).stop 2023-11-28T18:37:09.917 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.918+0000 7f85109f8640 1 -- 172.21.15.190:0/2412491583 shutdown_connections 2023-11-28T18:37:09.917 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.918+0000 7f85109f8640 1 --2- 172.21.15.190:0/2412491583 >> v2:172.21.15.190:3300/0 conn(0x7f850c0d0330 0x7f850c0b0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:09.917 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.918+0000 7f85109f8640 1 --2- 172.21.15.190:0/2412491583 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f850c15d2f0 0x7f850c0d17f0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:09.917 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.918+0000 7f85109f8640 1 -- 172.21.15.190:0/2412491583 >> 172.21.15.190:0/2412491583 conn(0x7f850c09c550 msgr2=0x7f850c0d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:09.917 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.918+0000 7f85109f8640 1 -- 172.21.15.190:0/2412491583 shutdown_connections 2023-11-28T18:37:09.917 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.918+0000 7f85109f8640 1 -- 172.21.15.190:0/2412491583 wait complete. 2023-11-28T18:37:09.918 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.918+0000 7f85109f8640 1 Processor -- start 2023-11-28T18:37:09.918 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.918+0000 7f85109f8640 1 -- start start 2023-11-28T18:37:09.921 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.918+0000 7f85109f8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f850c0d0330 0x7f850c0cc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:09.921 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.918+0000 7f85109f8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f850c0d1d30 0x7f850c0d0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:09.921 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.918+0000 7f85109f8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f850c15d2f0 0x7f850c15a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:09.921 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.918+0000 7f85109f8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f850c0b8350 con 0x7f850c15d2f0 2023-11-28T18:37:09.921 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.918+0000 7f85109f8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f850c0b79f0 con 0x7f850c0d0330 2023-11-28T18:37:09.921 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.918+0000 7f85109f8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f850c0cd060 con 0x7f850c0d1d30 2023-11-28T18:37:09.922 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.918+0000 7f850a59c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f850c0d0330 0x7f850c0cc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:09.922 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.918+0000 7f850a59c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f850c0d0330 0x7f850c0cc9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:56046/0 (socket says 172.21.15.190:56046) 2023-11-28T18:37:09.922 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.918+0000 7f8509d9b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f850c0d1d30 0x7f850c0d0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:09.923 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.918+0000 7f850a59c640 1 -- 172.21.15.190:0/1628689235 learned_addr learned my addr 172.21.15.190:0/1628689235 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-11-28T18:37:09.923 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.922+0000 7f850ad9d640 1 --2- 172.21.15.190:0/1628689235 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f850c15d2f0 0x7f850c15a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:09.923 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.922+0000 7f850a59c640 1 -- 172.21.15.190:0/1628689235 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f850c0d1d30 msgr2=0x7f850c0d0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:09.923 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.922+0000 7f850a59c640 1 --2- 172.21.15.190:0/1628689235 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f850c0d1d30 0x7f850c0d0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:09.923 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.922+0000 7f850a59c640 1 -- 172.21.15.190:0/1628689235 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f850c15d2f0 msgr2=0x7f850c15a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:09.923 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.922+0000 7f850a59c640 1 --2- 172.21.15.190:0/1628689235 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f850c15d2f0 0x7f850c15a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:09.924 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.922+0000 7f850a59c640 1 -- 172.21.15.190:0/1628689235 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84fc0094d0 con 0x7f850c0d0330 2023-11-28T18:37:09.924 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.922+0000 7f850ad9d640 1 --2- 172.21.15.190:0/1628689235 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f850c15d2f0 0x7f850c15a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:37:09.924 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.922+0000 7f850a59c640 1 --2- 172.21.15.190:0/1628689235 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f850c0d0330 0x7f850c0cc9d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f84fc01abf0 tx=0x7f84fc0192e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:09.924 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.922+0000 7f84faffd640 1 -- 172.21.15.190:0/1628689235 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84fc0be610 con 0x7f850c0d0330 2023-11-28T18:37:09.924 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.922+0000 7f84faffd640 1 -- 172.21.15.190:0/1628689235 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84fc0be770 con 0x7f850c0d0330 2023-11-28T18:37:09.924 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.922+0000 7f84faffd640 1 -- 172.21.15.190:0/1628689235 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84fc0beb20 con 0x7f850c0d0330 2023-11-28T18:37:09.924 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.922+0000 7f85109f8640 1 -- 172.21.15.190:0/1628689235 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f850c0b7c90 con 0x7f850c0d0330 2023-11-28T18:37:09.924 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.922+0000 7f85109f8640 1 -- 172.21.15.190:0/1628689235 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f850c155780 con 0x7f850c0d0330 2023-11-28T18:37:09.925 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.922+0000 7f84faffd640 1 -- 172.21.15.190:0/1628689235 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f84fc0a8050 con 0x7f850c0d0330 2023-11-28T18:37:09.925 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.922+0000 7f84faffd640 1 -- 172.21.15.190:0/1628689235 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f84fc0b4400 con 0x7f850c0d0330 2023-11-28T18:37:09.925 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.922+0000 7f85109f8640 1 -- 172.21.15.190:0/1628689235 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f850c067a30 con 0x7f850c0d0330 2023-11-28T18:37:09.925 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.926+0000 7f84faffd640 1 -- 172.21.15.190:0/1628689235 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f84fc0a6040 con 0x7f850c0d0330 2023-11-28T18:37:09.965 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-11-28T18:37:09.959+0000 7f59b9851180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-28T18:37:09.967 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-11-28T18:37:09.966+0000 7ff4fbc47180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-28T18:37:09.990 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.990+0000 7f85109f8640 1 -- 172.21.15.190:0/1628689235 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ce632829-f027-4fbf-a627-02c571aa9d53", "id": 4} v 0) v1 -- 0x7f850c069410 con 0x7f850c0d0330 2023-11-28T18:37:09.995 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.994+0000 7f84faffd640 1 -- 172.21.15.190:0/1628689235 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ce632829-f027-4fbf-a627-02c571aa9d53", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f84fc0b4690 con 0x7f850c0d0330 2023-11-28T18:37:09.995 INFO:teuthology.orchestra.run.smithi190.stdout:4 2023-11-28T18:37:09.996 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.998+0000 7f85109f8640 1 -- 172.21.15.190:0/1628689235 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f850c0d0330 msgr2=0x7f850c0cc9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:09.997 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.998+0000 7f85109f8640 1 --2- 172.21.15.190:0/1628689235 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f850c0d0330 0x7f850c0cc9d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f84fc01abf0 tx=0x7f84fc0192e0 comp rx=0 tx=0).stop 2023-11-28T18:37:09.997 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.998+0000 7f85109f8640 1 -- 172.21.15.190:0/1628689235 shutdown_connections 2023-11-28T18:37:09.997 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.998+0000 7f85109f8640 1 --2- 172.21.15.190:0/1628689235 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f850c15d2f0 0x7f850c15a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:09.997 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.998+0000 7f85109f8640 1 --2- 172.21.15.190:0/1628689235 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f850c0d1d30 0x7f850c0d0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:09.997 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.998+0000 7f85109f8640 1 --2- 172.21.15.190:0/1628689235 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f850c0d0330 0x7f850c0cc9d0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:09.997 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.998+0000 7f85109f8640 1 -- 172.21.15.190:0/1628689235 >> 172.21.15.190:0/1628689235 conn(0x7f850c09c550 msgr2=0x7f850c155ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:09.998 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.998+0000 7f85109f8640 1 -- 172.21.15.190:0/1628689235 shutdown_connections 2023-11-28T18:37:09.998 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:09.998+0000 7f85109f8640 1 -- 172.21.15.190:0/1628689235 wait complete. 2023-11-28T18:37:10.015 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new 8700b609-27be-40bd-a251-4c0ae0a29ead 5 2023-11-28T18:37:10.029 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-11-28T18:37:10.023+0000 7f59b9851180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-28T18:37:10.031 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-11-28T18:37:10.030+0000 7ff4fbc47180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-28T18:37:10.122 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-11-28T18:37:10.119+0000 7f59b9851180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-28T18:37:10.123 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-11-28T18:37:10.122+0000 7ff4fbc47180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-28T18:37:10.152 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.150+0000 7f3ff4b0f640 1 Processor -- start 2023-11-28T18:37:10.152 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.150+0000 7f3ff4b0f640 1 -- start start 2023-11-28T18:37:10.153 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.154+0000 7f3ff4b0f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3ff015d2f0 0x7f3ff00d17f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:10.153 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.154+0000 7f3ff4b0f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3ff00d1d30 0x7f3ff00cfc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:10.154 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.154+0000 7f3ff4b0f640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f3ff015d6d0 0x7f3ff00d0160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:10.154 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.154+0000 7f3ff4b0f640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ff00aff70 con 0x7f3ff00d1d30 2023-11-28T18:37:10.154 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.154+0000 7f3ff4b0f640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ff00b0210 con 0x7f3ff015d6d0 2023-11-28T18:37:10.154 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.154+0000 7f3ff4b0f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff00b04f0 con 0x7f3ff015d2f0 2023-11-28T18:37:10.154 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.154+0000 7f3feed9d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f3ff015d6d0 0x7f3ff00d0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:10.155 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.154+0000 7f3fee59c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3ff015d2f0 0x7f3ff00d17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:10.155 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.154+0000 7f3feed9d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f3ff015d6d0 0x7f3ff00d0160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:56056/0 (socket says 172.21.15.190:56056) 2023-11-28T18:37:10.155 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.154+0000 7f3fee59c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3ff015d2f0 0x7f3ff00d17f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:39514/0 (socket says 172.21.15.190:39514) 2023-11-28T18:37:10.155 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.154+0000 7f3feed9d640 1 -- 172.21.15.190:0/3364285861 learned_addr learned my addr 172.21.15.190:0/3364285861 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-11-28T18:37:10.155 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.154+0000 7f3fedd9b640 1 --2- 172.21.15.190:0/3364285861 >> v2:172.21.15.45:3300/0 conn(0x7f3ff00d1d30 0x7f3ff00cfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:10.156 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.154+0000 7f3fee59c640 1 -- 172.21.15.190:0/3364285861 >> v2:172.21.15.190:3300/0 conn(0x7f3ff015d6d0 msgr2=0x7f3ff00d0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:10.156 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.154+0000 7f3fee59c640 1 --2- 172.21.15.190:0/3364285861 >> v2:172.21.15.190:3300/0 conn(0x7f3ff015d6d0 0x7f3ff00d0160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:10.156 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.154+0000 7f3fee59c640 1 -- 172.21.15.190:0/3364285861 >> v2:172.21.15.45:3300/0 conn(0x7f3ff00d1d30 msgr2=0x7f3ff00cfc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:10.157 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.154+0000 7f3fee59c640 1 --2- 172.21.15.190:0/3364285861 >> v2:172.21.15.45:3300/0 conn(0x7f3ff00d1d30 0x7f3ff00cfc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:10.157 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.154+0000 7f3fee59c640 1 -- 172.21.15.190:0/3364285861 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ff00b07d0 con 0x7f3ff015d2f0 2023-11-28T18:37:10.157 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.154+0000 7f3feed9d640 1 --2- 172.21.15.190:0/3364285861 >> v2:172.21.15.190:3300/0 conn(0x7f3ff015d6d0 0x7f3ff00d0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:37:10.158 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.158+0000 7f3fee59c640 1 --2- 172.21.15.190:0/3364285861 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3ff015d2f0 0x7f3ff00d17f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3ff0160f30 tx=0x7f3fe001c460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7a8550aba30c4c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:10.158 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.158+0000 7f3fed59a640 1 -- 172.21.15.190:0/3364285861 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe00ab600 con 0x7f3ff015d2f0 2023-11-28T18:37:10.159 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.158+0000 7f3fed59a640 1 -- 172.21.15.190:0/3364285861 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fe00a7050 con 0x7f3ff015d2f0 2023-11-28T18:37:10.159 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.158+0000 7f3fed59a640 1 -- 172.21.15.190:0/3364285861 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe00ab980 con 0x7f3ff015d2f0 2023-11-28T18:37:10.159 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.158+0000 7f3ff4b0f640 1 -- 172.21.15.190:0/3364285861 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3ff015d2f0 msgr2=0x7f3ff00d17f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:10.159 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.158+0000 7f3ff4b0f640 1 --2- 172.21.15.190:0/3364285861 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3ff015d2f0 0x7f3ff00d17f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3ff0160f30 tx=0x7f3fe001c460 comp rx=0 tx=0).stop 2023-11-28T18:37:10.160 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.158+0000 7f3ff4b0f640 1 -- 172.21.15.190:0/3364285861 shutdown_connections 2023-11-28T18:37:10.160 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.158+0000 7f3ff4b0f640 1 --2- 172.21.15.190:0/3364285861 >> v2:172.21.15.190:3300/0 conn(0x7f3ff015d6d0 0x7f3ff00d0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:10.160 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.158+0000 7f3ff4b0f640 1 --2- 172.21.15.190:0/3364285861 >> v2:172.21.15.45:3300/0 conn(0x7f3ff00d1d30 0x7f3ff00cfc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:10.160 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.158+0000 7f3ff4b0f640 1 --2- 172.21.15.190:0/3364285861 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3ff015d2f0 0x7f3ff00d17f0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:10.160 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.158+0000 7f3ff4b0f640 1 -- 172.21.15.190:0/3364285861 >> 172.21.15.190:0/3364285861 conn(0x7f3ff009c550 msgr2=0x7f3ff00d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:10.160 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.158+0000 7f3ff4b0f640 1 -- 172.21.15.190:0/3364285861 shutdown_connections 2023-11-28T18:37:10.160 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.158+0000 7f3ff4b0f640 1 -- 172.21.15.190:0/3364285861 wait complete. 2023-11-28T18:37:10.162 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.162+0000 7f3ff4b0f640 1 Processor -- start 2023-11-28T18:37:10.162 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.162+0000 7f3ff4b0f640 1 -- start start 2023-11-28T18:37:10.162 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.162+0000 7f3ff4b0f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3ff00d1d30 0x7f3ff01558e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:10.162 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.162+0000 7f3ff4b0f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3ff015d2f0 0x7f3ff00ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:10.162 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.162+0000 7f3ff4b0f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ff015d6d0 0x7f3ff00b8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:10.162 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.162+0000 7f3ff4b0f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff00cd740 con 0x7f3ff015d6d0 2023-11-28T18:37:10.162 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.162+0000 7f3ff4b0f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff00b7050 con 0x7f3ff015d2f0 2023-11-28T18:37:10.162 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.162+0000 7f3ff4b0f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff00c83e0 con 0x7f3ff00d1d30 2023-11-28T18:37:10.163 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.162+0000 7f3fedd9b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3ff015d2f0 0x7f3ff00ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:10.163 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.162+0000 7f3fee59c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3ff00d1d30 0x7f3ff01558e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:10.163 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.162+0000 7f3fee59c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3ff00d1d30 0x7f3ff01558e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:39520/0 (socket says 172.21.15.190:39520) 2023-11-28T18:37:10.163 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.162+0000 7f3fee59c640 1 -- 172.21.15.190:0/1386074489 learned_addr learned my addr 172.21.15.190:0/1386074489 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-11-28T18:37:10.163 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.162+0000 7f3fedd9b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3ff015d2f0 0x7f3ff00ccc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:56062/0 (socket says 172.21.15.190:56062) 2023-11-28T18:37:10.163 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.162+0000 7f3feed9d640 1 --2- 172.21.15.190:0/1386074489 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ff015d6d0 0x7f3ff00b8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:10.163 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.162+0000 7f3fedd9b640 1 -- 172.21.15.190:0/1386074489 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3ff00d1d30 msgr2=0x7f3ff01558e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:10.163 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.162+0000 7f3fedd9b640 1 --2- 172.21.15.190:0/1386074489 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3ff00d1d30 0x7f3ff01558e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:10.163 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.162+0000 7f3fedd9b640 1 -- 172.21.15.190:0/1386074489 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ff015d6d0 msgr2=0x7f3ff00b8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:10.163 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.162+0000 7f3fedd9b640 1 --2- 172.21.15.190:0/1386074489 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ff015d6d0 0x7f3ff00b8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:10.164 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.162+0000 7f3fedd9b640 1 -- 172.21.15.190:0/1386074489 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe8009b30 con 0x7f3ff015d2f0 2023-11-28T18:37:10.164 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.162+0000 7f3fee59c640 1 --2- 172.21.15.190:0/1386074489 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3ff00d1d30 0x7f3ff01558e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:37:10.164 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.162+0000 7f3fedd9b640 1 --2- 172.21.15.190:0/1386074489 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3ff015d2f0 0x7f3ff00ccc10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3fe400e7f0 tx=0x7f3fe400ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:10.165 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.162+0000 7f3fdeffd640 1 -- 172.21.15.190:0/1386074489 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe400c940 con 0x7f3ff015d2f0 2023-11-28T18:37:10.165 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.162+0000 7f3fdeffd640 1 -- 172.21.15.190:0/1386074489 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fe400caa0 con 0x7f3ff015d2f0 2023-11-28T18:37:10.165 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.162+0000 7f3fdeffd640 1 -- 172.21.15.190:0/1386074489 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe400ce10 con 0x7f3ff015d2f0 2023-11-28T18:37:10.165 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.162+0000 7f3ff4b0f640 1 -- 172.21.15.190:0/1386074489 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fe0009420 con 0x7f3ff015d2f0 2023-11-28T18:37:10.165 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.162+0000 7f3ff4b0f640 1 -- 172.21.15.190:0/1386074489 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ff0155e20 con 0x7f3ff015d2f0 2023-11-28T18:37:10.165 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.162+0000 7f3fdeffd640 1 -- 172.21.15.190:0/1386074489 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3fe4013770 con 0x7f3ff015d2f0 2023-11-28T18:37:10.165 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.162+0000 7f3fdeffd640 1 -- 172.21.15.190:0/1386074489 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f3fe401c7c0 con 0x7f3ff015d2f0 2023-11-28T18:37:10.165 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.162+0000 7f3ff4b0f640 1 -- 172.21.15.190:0/1386074489 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ff0067a30 con 0x7f3ff015d2f0 2023-11-28T18:37:10.166 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.166+0000 7f3fdeffd640 1 -- 172.21.15.190:0/1386074489 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f3fe4021060 con 0x7f3ff015d2f0 2023-11-28T18:37:10.185 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-11-28T18:37:10.179+0000 7f59b9851180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-28T18:37:10.186 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-11-28T18:37:10.186+0000 7ff4fbc47180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-28T18:37:10.234 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.234+0000 7f3ff4b0f640 1 -- 172.21.15.190:0/1386074489 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8700b609-27be-40bd-a251-4c0ae0a29ead", "id": 5} v 0) v1 -- 0x7f3ff00c8550 con 0x7f3ff015d2f0 2023-11-28T18:37:10.239 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.238+0000 7f3fdeffd640 1 -- 172.21.15.190:0/1386074489 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8700b609-27be-40bd-a251-4c0ae0a29ead", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3fe4017070 con 0x7f3ff015d2f0 2023-11-28T18:37:10.239 INFO:teuthology.orchestra.run.smithi190.stdout:5 2023-11-28T18:37:10.240 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.238+0000 7f3ff4b0f640 1 -- 172.21.15.190:0/1386074489 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3ff015d2f0 msgr2=0x7f3ff00ccc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:10.240 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.238+0000 7f3ff4b0f640 1 --2- 172.21.15.190:0/1386074489 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3ff015d2f0 0x7f3ff00ccc10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3fe400e7f0 tx=0x7f3fe400ecb0 comp rx=0 tx=0).stop 2023-11-28T18:37:10.240 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.238+0000 7f3ff4b0f640 1 -- 172.21.15.190:0/1386074489 shutdown_connections 2023-11-28T18:37:10.240 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.242+0000 7f3ff4b0f640 1 --2- 172.21.15.190:0/1386074489 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ff015d6d0 0x7f3ff00b8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:10.240 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.242+0000 7f3ff4b0f640 1 --2- 172.21.15.190:0/1386074489 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3ff015d2f0 0x7f3ff00ccc10 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:10.240 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.242+0000 7f3ff4b0f640 1 --2- 172.21.15.190:0/1386074489 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3ff00d1d30 0x7f3ff01558e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:10.241 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.242+0000 7f3ff4b0f640 1 -- 172.21.15.190:0/1386074489 >> 172.21.15.190:0/1386074489 conn(0x7f3ff009c550 msgr2=0x7f3ff00d0d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:10.241 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.242+0000 7f3ff4b0f640 1 -- 172.21.15.190:0/1386074489 shutdown_connections 2023-11-28T18:37:10.241 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.242+0000 7f3ff4b0f640 1 -- 172.21.15.190:0/1386074489 wait complete. 2023-11-28T18:37:10.259 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new 44ce4a40-e6ff-4f4d-8e8a-7341e5c91f08 6 2023-11-28T18:37:10.279 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-11-28T18:37:10.278+0000 7ff4fbc47180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-28T18:37:10.280 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-11-28T18:37:10.275+0000 7f59b9851180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-28T18:37:10.341 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-11-28T18:37:10.342+0000 7ff4fbc47180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-28T18:37:10.342 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-11-28T18:37:10.339+0000 7f59b9851180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-28T18:37:10.416 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.414+0000 7f3a39ff8640 1 Processor -- start 2023-11-28T18:37:10.416 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.414+0000 7f3a39ff8640 1 -- start start 2023-11-28T18:37:10.418 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.418+0000 7f3a39ff8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3a3415d6d0 0x7f3a340cfc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:10.419 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.418+0000 7f3a39ff8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3a340d0160 0x7f3a340b0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:10.419 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.418+0000 7f3a39ff8640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a340d0580 con 0x7f3a3415d2f0 2023-11-28T18:37:10.419 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.418+0000 7f3a39ff8640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a340aff70 con 0x7f3a3415d6d0 2023-11-28T18:37:10.419 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.418+0000 7f3a39ff8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a340d1f00 con 0x7f3a340d0160 2023-11-28T18:37:10.419 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.418+0000 7f3a337fe640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f3a3415d2f0 0x7f3a340d17f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:41574/0 (socket says 172.21.15.190:41574) 2023-11-28T18:37:10.419 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.418+0000 7f3a337fe640 1 -- 172.21.15.190:0/3502929859 learned_addr learned my addr 172.21.15.190:0/3502929859 (peer_addr_for_me v1:172.21.15.190:0/0) 2023-11-28T18:37:10.419 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.418+0000 7f3a33fff640 1 --2- 172.21.15.190:0/3502929859 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3a340d0160 0x7f3a340b0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:10.419 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.418+0000 7f3a32ffd640 1 --2- 172.21.15.190:0/3502929859 >> v2:172.21.15.45:3300/0 conn(0x7f3a3415d6d0 0x7f3a340cfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:10.419 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.418+0000 7f3a327fc640 1 -- 172.21.15.190:0/3502929859 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3870736308 0 0) 0x7f3a340d0580 con 0x7f3a3415d2f0 2023-11-28T18:37:10.419 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.418+0000 7f3a327fc640 1 -- 172.21.15.190:0/3502929859 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a1c003530 con 0x7f3a3415d2f0 2023-11-28T18:37:10.419 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.418+0000 7f3a33fff640 1 -- 172.21.15.190:0/3502929859 >> v2:172.21.15.45:3300/0 conn(0x7f3a3415d6d0 msgr2=0x7f3a340cfc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:10.420 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.418+0000 7f3a33fff640 1 --2- 172.21.15.190:0/3502929859 >> v2:172.21.15.45:3300/0 conn(0x7f3a3415d6d0 0x7f3a340cfc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:10.420 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.418+0000 7f3a33fff640 1 -- 172.21.15.190:0/3502929859 >> v1:172.21.15.190:6789/0 conn(0x7f3a3415d2f0 legacy=0x7f3a340d17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:10.420 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.418+0000 7f3a33fff640 1 -- 172.21.15.190:0/3502929859 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a340b0210 con 0x7f3a340d0160 2023-11-28T18:37:10.422 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.422+0000 7f3a33fff640 1 --2- 172.21.15.190:0/3502929859 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3a340d0160 0x7f3a340b0cf0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c009d90 tx=0x7f3a2c01c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd5ad807f8d1fddb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:10.422 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.422+0000 7f3a327fc640 1 -- 172.21.15.190:0/3502929859 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a2c0a59e0 con 0x7f3a340d0160 2023-11-28T18:37:10.422 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.422+0000 7f3a327fc640 1 -- 172.21.15.190:0/3502929859 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a2c0a5b40 con 0x7f3a340d0160 2023-11-28T18:37:10.422 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.422+0000 7f3a327fc640 1 -- 172.21.15.190:0/3502929859 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a2c0ad440 con 0x7f3a340d0160 2023-11-28T18:37:10.423 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.422+0000 7f3a39ff8640 1 -- 172.21.15.190:0/3502929859 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3a340d0160 msgr2=0x7f3a340b0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:10.423 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.422+0000 7f3a39ff8640 1 --2- 172.21.15.190:0/3502929859 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3a340d0160 0x7f3a340b0cf0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c009d90 tx=0x7f3a2c01c920 comp rx=0 tx=0).stop 2023-11-28T18:37:10.423 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.422+0000 7f3a39ff8640 1 -- 172.21.15.190:0/3502929859 shutdown_connections 2023-11-28T18:37:10.423 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.422+0000 7f3a39ff8640 1 --2- 172.21.15.190:0/3502929859 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3a340d0160 0x7f3a340b0cf0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:10.423 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.422+0000 7f3a39ff8640 1 --2- 172.21.15.190:0/3502929859 >> v2:172.21.15.45:3300/0 conn(0x7f3a3415d6d0 0x7f3a340cfc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:10.423 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.422+0000 7f3a39ff8640 1 -- 172.21.15.190:0/3502929859 >> 172.21.15.190:0/3502929859 conn(0x7f3a3409c550 msgr2=0x7f3a340d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:10.423 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.422+0000 7f3a39ff8640 1 -- 172.21.15.190:0/3502929859 shutdown_connections 2023-11-28T18:37:10.423 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.422+0000 7f3a39ff8640 1 -- 172.21.15.190:0/3502929859 wait complete. 2023-11-28T18:37:10.424 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.426+0000 7f3a39ff8640 1 Processor -- start 2023-11-28T18:37:10.425 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.426+0000 7f3a39ff8640 1 -- start start 2023-11-28T18:37:10.427 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.426+0000 7f3a39ff8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3a340d0160 0x7f3a340c7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:10.427 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.426+0000 7f3a39ff8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a3415d2f0 0x7f3a340c8d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:10.427 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.426+0000 7f3a39ff8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3a3415d6d0 0x7f3a3415ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:10.428 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.426+0000 7f3a39ff8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a340c9eb0 con 0x7f3a3415d2f0 2023-11-28T18:37:10.428 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.426+0000 7f3a39ff8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a34140790 con 0x7f3a3415d6d0 2023-11-28T18:37:10.428 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.426+0000 7f3a39ff8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a340c9610 con 0x7f3a340d0160 2023-11-28T18:37:10.428 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.426+0000 7f3a337fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3a340d0160 0x7f3a340c7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:10.428 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.426+0000 7f3a337fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3a340d0160 0x7f3a340c7300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:39548/0 (socket says 172.21.15.190:39548) 2023-11-28T18:37:10.428 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.426+0000 7f3a337fe640 1 -- 172.21.15.190:0/483369942 learned_addr learned my addr 172.21.15.190:0/483369942 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-11-28T18:37:10.428 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.426+0000 7f3a33fff640 1 --2- 172.21.15.190:0/483369942 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3a3415d6d0 0x7f3a3415ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:10.428 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.426+0000 7f3a32ffd640 1 --2- 172.21.15.190:0/483369942 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a3415d2f0 0x7f3a340c8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:10.428 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.426+0000 7f3a337fe640 1 -- 172.21.15.190:0/483369942 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3a3415d6d0 msgr2=0x7f3a3415ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:10.428 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.426+0000 7f3a337fe640 1 --2- 172.21.15.190:0/483369942 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3a3415d6d0 0x7f3a3415ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:10.428 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.426+0000 7f3a337fe640 1 -- 172.21.15.190:0/483369942 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a3415d2f0 msgr2=0x7f3a340c8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:10.428 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.426+0000 7f3a337fe640 1 --2- 172.21.15.190:0/483369942 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a3415d2f0 0x7f3a340c8d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:10.429 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.426+0000 7f3a337fe640 1 -- 172.21.15.190:0/483369942 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a2c009a70 con 0x7f3a340d0160 2023-11-28T18:37:10.429 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.426+0000 7f3a32ffd640 1 --2- 172.21.15.190:0/483369942 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a3415d2f0 0x7f3a340c8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:37:10.429 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.426+0000 7f3a33fff640 1 --2- 172.21.15.190:0/483369942 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3a3415d6d0 0x7f3a3415ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:37:10.429 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.426+0000 7f3a337fe640 1 --2- 172.21.15.190:0/483369942 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3a340d0160 0x7f3a340c7300 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3a2400c4d0 tx=0x7f3a2400c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:10.429 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.426+0000 7f3a1bfff640 1 -- 172.21.15.190:0/483369942 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a24005cf0 con 0x7f3a340d0160 2023-11-28T18:37:10.429 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.426+0000 7f3a1bfff640 1 -- 172.21.15.190:0/483369942 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a24005e50 con 0x7f3a340d0160 2023-11-28T18:37:10.429 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.426+0000 7f3a1bfff640 1 -- 172.21.15.190:0/483369942 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a24007270 con 0x7f3a340d0160 2023-11-28T18:37:10.429 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.426+0000 7f3a39ff8640 1 -- 172.21.15.190:0/483369942 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a340c98f0 con 0x7f3a340d0160 2023-11-28T18:37:10.429 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.426+0000 7f3a39ff8640 1 -- 172.21.15.190:0/483369942 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a340c7840 con 0x7f3a340d0160 2023-11-28T18:37:10.429 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.426+0000 7f3a1bfff640 1 -- 172.21.15.190:0/483369942 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3a2401c440 con 0x7f3a340d0160 2023-11-28T18:37:10.429 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.426+0000 7f3a1bfff640 1 -- 172.21.15.190:0/483369942 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f3a2401cce0 con 0x7f3a340d0160 2023-11-28T18:37:10.430 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.430+0000 7f3a39ff8640 1 -- 172.21.15.190:0/483369942 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a34067a30 con 0x7f3a340d0160 2023-11-28T18:37:10.432 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.434+0000 7f3a1bfff640 1 -- 172.21.15.190:0/483369942 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f3a24021060 con 0x7f3a340d0160 2023-11-28T18:37:10.501 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.498+0000 7f3a39ff8640 1 -- 172.21.15.190:0/483369942 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd new", "uuid": "44ce4a40-e6ff-4f4d-8e8a-7341e5c91f08", "id": 6} v 0) v1 -- 0x7f3a34140950 con 0x7f3a340d0160 2023-11-28T18:37:10.503 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.502+0000 7f3a1bfff640 1 -- 172.21.15.190:0/483369942 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "44ce4a40-e6ff-4f4d-8e8a-7341e5c91f08", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3a24017070 con 0x7f3a340d0160 2023-11-28T18:37:10.503 INFO:teuthology.orchestra.run.smithi190.stdout:6 2023-11-28T18:37:10.505 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.506+0000 7f3a39ff8640 1 -- 172.21.15.190:0/483369942 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3a340d0160 msgr2=0x7f3a340c7300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:10.506 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.506+0000 7f3a39ff8640 1 --2- 172.21.15.190:0/483369942 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3a340d0160 0x7f3a340c7300 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3a2400c4d0 tx=0x7f3a2400c990 comp rx=0 tx=0).stop 2023-11-28T18:37:10.506 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.506+0000 7f3a39ff8640 1 -- 172.21.15.190:0/483369942 shutdown_connections 2023-11-28T18:37:10.506 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.506+0000 7f3a39ff8640 1 --2- 172.21.15.190:0/483369942 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3a3415d6d0 0x7f3a3415ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:10.506 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.506+0000 7f3a39ff8640 1 --2- 172.21.15.190:0/483369942 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a3415d2f0 0x7f3a340c8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:10.507 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.506+0000 7f3a39ff8640 1 --2- 172.21.15.190:0/483369942 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3a340d0160 0x7f3a340c7300 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:10.507 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.506+0000 7f3a39ff8640 1 -- 172.21.15.190:0/483369942 >> 172.21.15.190:0/483369942 conn(0x7f3a3409c550 msgr2=0x7f3a3406b350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:10.507 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.506+0000 7f3a39ff8640 1 -- 172.21.15.190:0/483369942 shutdown_connections 2023-11-28T18:37:10.507 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.506+0000 7f3a39ff8640 1 -- 172.21.15.190:0/483369942 wait complete. 2023-11-28T18:37:10.508 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-11-28T18:37:10.503+0000 7f59b9851180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-28T18:37:10.508 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-11-28T18:37:10.506+0000 7ff4fbc47180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-28T18:37:10.524 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new 192238c9-1423-4b7e-ac8f-84ba32113ddf 7 2023-11-28T18:37:10.578 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-11-28T18:37:10.578+0000 7ff4fbc47180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-28T18:37:10.579 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-11-28T18:37:10.575+0000 7f59b9851180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-28T18:37:10.661 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.662+0000 7fc236ddf640 1 Processor -- start 2023-11-28T18:37:10.661 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.662+0000 7fc236ddf640 1 -- start start 2023-11-28T18:37:10.662 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.662+0000 7fc236ddf640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc23015d2f0 0x7fc2300d17f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:10.663 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.662+0000 7fc236ddf640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fc2300d1d30 0x7fc2300cfc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:10.663 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.662+0000 7fc236ddf640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2300aff70 con 0x7fc23015d6d0 2023-11-28T18:37:10.663 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.662+0000 7fc236ddf640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2300b0210 con 0x7fc23015d2f0 2023-11-28T18:37:10.663 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.662+0000 7fc236ddf640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2300b04f0 con 0x7fc2300d1d30 2023-11-28T18:37:10.663 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.662+0000 7fc22ffff640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fc2300d1d30 0x7fc2300cfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:10.663 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.662+0000 7fc22ffff640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fc2300d1d30 0x7fc2300cfc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:60230/0 (socket says 172.21.15.190:60230) 2023-11-28T18:37:10.663 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.662+0000 7fc22ffff640 1 -- 172.21.15.190:0/3600381657 learned_addr learned my addr 172.21.15.190:0/3600381657 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-11-28T18:37:10.663 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.662+0000 7fc234b7b640 1 --2- 172.21.15.190:0/3600381657 >> v2:172.21.15.45:3300/0 conn(0x7fc23015d2f0 0x7fc2300d17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:10.663 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.662+0000 7fc22ffff640 1 -- 172.21.15.190:0/3600381657 >> v2:172.21.15.45:3300/0 conn(0x7fc23015d2f0 msgr2=0x7fc2300d17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:10.663 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.662+0000 7fc22ffff640 1 --2- 172.21.15.190:0/3600381657 >> v2:172.21.15.45:3300/0 conn(0x7fc23015d2f0 0x7fc2300d17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:10.664 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.662+0000 7fc22ffff640 1 -- 172.21.15.190:0/3600381657 >> v1:172.21.15.45:6789/0 conn(0x7fc23015d6d0 legacy=0x7fc2300cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:10.664 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.662+0000 7fc22ffff640 1 -- 172.21.15.190:0/3600381657 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2300b07d0 con 0x7fc2300d1d30 2023-11-28T18:37:10.664 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.662+0000 7fc234b7b640 1 --2- 172.21.15.190:0/3600381657 >> v2:172.21.15.45:3300/0 conn(0x7fc23015d2f0 0x7fc2300d17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:37:10.665 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.666+0000 7fc22ffff640 1 --2- 172.21.15.190:0/3600381657 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2300d1d30 0x7fc2300cfc20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc2300b5da0 tx=0x7fc21c01c500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd9033db563bc3b5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:10.666 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.666+0000 7fc22f7fe640 1 -- 172.21.15.190:0/3600381657 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc21c0a6040 con 0x7fc2300d1d30 2023-11-28T18:37:10.666 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.666+0000 7fc22f7fe640 1 -- 172.21.15.190:0/3600381657 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc21c0aa600 con 0x7fc2300d1d30 2023-11-28T18:37:10.666 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.666+0000 7fc22f7fe640 1 -- 172.21.15.190:0/3600381657 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc21c0aa990 con 0x7fc2300d1d30 2023-11-28T18:37:10.667 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.666+0000 7fc236ddf640 1 -- 172.21.15.190:0/3600381657 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2300d1d30 msgr2=0x7fc2300cfc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:10.667 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.666+0000 7fc236ddf640 1 --2- 172.21.15.190:0/3600381657 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2300d1d30 0x7fc2300cfc20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc2300b5da0 tx=0x7fc21c01c500 comp rx=0 tx=0).stop 2023-11-28T18:37:10.667 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.666+0000 7fc236ddf640 1 -- 172.21.15.190:0/3600381657 shutdown_connections 2023-11-28T18:37:10.667 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.666+0000 7fc236ddf640 1 --2- 172.21.15.190:0/3600381657 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2300d1d30 0x7fc2300cfc20 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:10.667 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.666+0000 7fc236ddf640 1 --2- 172.21.15.190:0/3600381657 >> v2:172.21.15.45:3300/0 conn(0x7fc23015d2f0 0x7fc2300d17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:10.667 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.666+0000 7fc236ddf640 1 -- 172.21.15.190:0/3600381657 >> 172.21.15.190:0/3600381657 conn(0x7fc23009c550 msgr2=0x7fc2300d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:10.667 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.666+0000 7fc236ddf640 1 -- 172.21.15.190:0/3600381657 shutdown_connections 2023-11-28T18:37:10.667 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.666+0000 7fc236ddf640 1 -- 172.21.15.190:0/3600381657 wait complete. 2023-11-28T18:37:10.668 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.670+0000 7fc236ddf640 1 Processor -- start 2023-11-28T18:37:10.668 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.670+0000 7fc236ddf640 1 -- start start 2023-11-28T18:37:10.671 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.670+0000 7fc236ddf640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2300d1d30 0x7fc23014fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:10.671 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.670+0000 7fc236ddf640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc23015d2f0 0x7fc23015bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:10.672 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.670+0000 7fc236ddf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc23015d6d0 0x7fc23015c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:10.672 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.670+0000 7fc236ddf640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2301576f0 con 0x7fc23015d6d0 2023-11-28T18:37:10.672 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.670+0000 7fc236ddf640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc230150530 con 0x7fc2300d1d30 2023-11-28T18:37:10.672 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.670+0000 7fc236ddf640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc23015ee50 con 0x7fc23015d2f0 2023-11-28T18:37:10.672 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.670+0000 7fc234b7b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2300d1d30 0x7fc23014fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:10.672 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.670+0000 7fc22ffff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc23015d2f0 0x7fc23015bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:10.672 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.670+0000 7fc234b7b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2300d1d30 0x7fc23014fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:60246/0 (socket says 172.21.15.190:60246) 2023-11-28T18:37:10.672 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.670+0000 7fc234b7b640 1 -- 172.21.15.190:0/1922660891 learned_addr learned my addr 172.21.15.190:0/1922660891 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-11-28T18:37:10.672 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.670+0000 7fc23537c640 1 --2- 172.21.15.190:0/1922660891 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc23015d6d0 0x7fc23015c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:10.672 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.670+0000 7fc234b7b640 1 -- 172.21.15.190:0/1922660891 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc23015d2f0 msgr2=0x7fc23015bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:10.673 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.670+0000 7fc234b7b640 1 --2- 172.21.15.190:0/1922660891 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc23015d2f0 0x7fc23015bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:10.673 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.670+0000 7fc234b7b640 1 -- 172.21.15.190:0/1922660891 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc23015d6d0 msgr2=0x7fc23015c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:10.673 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.670+0000 7fc234b7b640 1 --2- 172.21.15.190:0/1922660891 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc23015d6d0 0x7fc23015c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:10.673 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.670+0000 7fc234b7b640 1 -- 172.21.15.190:0/1922660891 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc21c0094d0 con 0x7fc2300d1d30 2023-11-28T18:37:10.673 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.670+0000 7fc22ffff640 1 --2- 172.21.15.190:0/1922660891 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc23015d2f0 0x7fc23015bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:37:10.673 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.670+0000 7fc234b7b640 1 --2- 172.21.15.190:0/1922660891 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2300d1d30 0x7fc23014fff0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc22400e810 tx=0x7fc22400ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:10.673 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.670+0000 7fc22d7fa640 1 -- 172.21.15.190:0/1922660891 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22400c8d0 con 0x7fc2300d1d30 2023-11-28T18:37:10.673 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.670+0000 7fc22d7fa640 1 -- 172.21.15.190:0/1922660891 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc22400ca30 con 0x7fc2300d1d30 2023-11-28T18:37:10.673 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.670+0000 7fc22d7fa640 1 -- 172.21.15.190:0/1922660891 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22400cdc0 con 0x7fc2300d1d30 2023-11-28T18:37:10.673 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.670+0000 7fc236ddf640 1 -- 172.21.15.190:0/1922660891 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc23015f130 con 0x7fc2300d1d30 2023-11-28T18:37:10.673 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.670+0000 7fc236ddf640 1 -- 172.21.15.190:0/1922660891 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc23015f6f0 con 0x7fc2300d1d30 2023-11-28T18:37:10.674 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.670+0000 7fc22d7fa640 1 -- 172.21.15.190:0/1922660891 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc22401c750 con 0x7fc2300d1d30 2023-11-28T18:37:10.674 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.670+0000 7fc22d7fa640 1 -- 172.21.15.190:0/1922660891 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fc224013c00 con 0x7fc2300d1d30 2023-11-28T18:37:10.674 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.674+0000 7fc236ddf640 1 -- 172.21.15.190:0/1922660891 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc230067a30 con 0x7fc2300d1d30 2023-11-28T18:37:10.674 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.674+0000 7fc22d7fa640 1 -- 172.21.15.190:0/1922660891 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fc224021060 con 0x7fc2300d1d30 2023-11-28T18:37:10.740 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.738+0000 7fc236ddf640 1 -- 172.21.15.190:0/1922660891 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd new", "uuid": "192238c9-1423-4b7e-ac8f-84ba32113ddf", "id": 7} v 0) v1 -- 0x7fc230069410 con 0x7fc2300d1d30 2023-11-28T18:37:10.745 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.746+0000 7fc22d7fa640 1 -- 172.21.15.190:0/1922660891 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "192238c9-1423-4b7e-ac8f-84ba32113ddf", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc224017070 con 0x7fc2300d1d30 2023-11-28T18:37:10.745 INFO:teuthology.orchestra.run.smithi190.stdout:7 2023-11-28T18:37:10.746 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.746+0000 7fc236ddf640 1 -- 172.21.15.190:0/1922660891 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2300d1d30 msgr2=0x7fc23014fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:10.746 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.746+0000 7fc236ddf640 1 --2- 172.21.15.190:0/1922660891 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2300d1d30 0x7fc23014fff0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc22400e810 tx=0x7fc22400ecd0 comp rx=0 tx=0).stop 2023-11-28T18:37:10.746 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.746+0000 7fc236ddf640 1 -- 172.21.15.190:0/1922660891 shutdown_connections 2023-11-28T18:37:10.747 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.746+0000 7fc236ddf640 1 --2- 172.21.15.190:0/1922660891 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc23015d6d0 0x7fc23015c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:10.747 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.746+0000 7fc236ddf640 1 --2- 172.21.15.190:0/1922660891 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc23015d2f0 0x7fc23015bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:10.747 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.746+0000 7fc236ddf640 1 --2- 172.21.15.190:0/1922660891 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2300d1d30 0x7fc23014fff0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:10.747 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.746+0000 7fc236ddf640 1 -- 172.21.15.190:0/1922660891 >> 172.21.15.190:0/1922660891 conn(0x7fc23009c550 msgr2=0x7fc2300d31a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:10.747 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.746+0000 7fc236ddf640 1 -- 172.21.15.190:0/1922660891 shutdown_connections 2023-11-28T18:37:10.747 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:10.746+0000 7fc236ddf640 1 -- 172.21.15.190:0/1922660891 wait complete. 2023-11-28T18:37:10.764 INFO:tasks.ceph.osd.0:Restarting daemon 2023-11-28T18:37:10.764 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-11-28T18:37:10.768 INFO:tasks.ceph.osd.0:Started 2023-11-28T18:37:10.768 INFO:tasks.ceph.osd.1:Restarting daemon 2023-11-28T18:37:10.768 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-11-28T18:37:10.771 INFO:tasks.ceph.osd.1:Started 2023-11-28T18:37:10.772 INFO:tasks.ceph.osd.2:Restarting daemon 2023-11-28T18:37:10.772 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-11-28T18:37:10.775 INFO:tasks.ceph.osd.2:Started 2023-11-28T18:37:10.776 INFO:tasks.ceph.osd.3:Restarting daemon 2023-11-28T18:37:10.776 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-11-28T18:37:10.779 INFO:tasks.ceph.osd.3:Started 2023-11-28T18:37:10.779 INFO:tasks.ceph.osd.4:Restarting daemon 2023-11-28T18:37:10.779 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-11-28T18:37:10.782 INFO:tasks.ceph.osd.4:Started 2023-11-28T18:37:10.783 INFO:tasks.ceph.osd.5:Restarting daemon 2023-11-28T18:37:10.783 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-11-28T18:37:10.786 INFO:tasks.ceph.osd.5:Started 2023-11-28T18:37:10.786 INFO:tasks.ceph.osd.6:Restarting daemon 2023-11-28T18:37:10.786 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-11-28T18:37:10.791 INFO:tasks.ceph.osd.6:Started 2023-11-28T18:37:10.791 INFO:tasks.ceph.osd.7:Restarting daemon 2023-11-28T18:37:10.791 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-11-28T18:37:10.794 INFO:tasks.ceph.osd.7:Started 2023-11-28T18:37:10.795 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T18:37:10.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:10.979+0000 7ff39ca9c640 1 Processor -- start 2023-11-28T18:37:10.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:10.979+0000 7ff39ca9c640 1 -- start start 2023-11-28T18:37:10.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:10.979+0000 7ff39ca9c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff3900361e0 0x7ff39003b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:10.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:10.979+0000 7ff39ca9c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff39003b990 0x7ff39003be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:10.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:10.979+0000 7ff39ca9c640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3900e3ac0 con 0x7ff3900e36e0 2023-11-28T18:37:10.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:10.979+0000 7ff39ca9c640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff390052a60 con 0x7ff39003b990 2023-11-28T18:37:10.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:10.979+0000 7ff39ca9c640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff390035dc0 con 0x7ff3900361e0 2023-11-28T18:37:10.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:10.979+0000 7ff397fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff39003b990 0x7ff39003be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:10.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:10.979+0000 7ff397fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff39003b990 0x7ff39003be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41034/0 (socket says 172.21.15.45:41034) 2023-11-28T18:37:10.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:10.979+0000 7ff397fff640 1 -- 172.21.15.45:0/160918438 learned_addr learned my addr 172.21.15.45:0/160918438 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:10.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:10.979+0000 7ff396ffd640 1 --2- 172.21.15.45:0/160918438 >> v2:172.21.15.190:3300/0 conn(0x7ff3900361e0 0x7ff39003b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:10.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:10.979+0000 7ff397fff640 1 -- 172.21.15.45:0/160918438 >> v2:172.21.15.190:3300/0 conn(0x7ff3900361e0 msgr2=0x7ff39003b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:10.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:10.979+0000 7ff397fff640 1 --2- 172.21.15.45:0/160918438 >> v2:172.21.15.190:3300/0 conn(0x7ff3900361e0 0x7ff39003b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:10.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:10.979+0000 7ff397fff640 1 -- 172.21.15.45:0/160918438 >> v1:172.21.15.45:6789/0 conn(0x7ff3900e36e0 legacy=0x7ff390055290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:10.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:10.979+0000 7ff397fff640 1 -- 172.21.15.45:0/160918438 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff390039c80 con 0x7ff39003b990 2023-11-28T18:37:10.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:10.983+0000 7ff397fff640 1 --2- 172.21.15.45:0/160918438 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff39003b990 0x7ff39003be00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff398068e60 tx=0x7ff398096ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d8e113d3de5e16f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:10.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:10.983+0000 7ff3967fc640 1 -- 172.21.15.45:0/160918438 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39811f840 con 0x7ff39003b990 2023-11-28T18:37:10.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:10.983+0000 7ff3967fc640 1 -- 172.21.15.45:0/160918438 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff39811f9e0 con 0x7ff39003b990 2023-11-28T18:37:10.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:10.983+0000 7ff3967fc640 1 -- 172.21.15.45:0/160918438 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39811fe30 con 0x7ff39003b990 2023-11-28T18:37:10.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:10.983+0000 7ff39ca9c640 1 -- 172.21.15.45:0/160918438 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff39003b990 msgr2=0x7ff39003be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:10.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:10.983+0000 7ff39ca9c640 1 --2- 172.21.15.45:0/160918438 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff39003b990 0x7ff39003be00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff398068e60 tx=0x7ff398096ad0 comp rx=0 tx=0).stop 2023-11-28T18:37:10.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:10.983+0000 7ff39ca9c640 1 -- 172.21.15.45:0/160918438 shutdown_connections 2023-11-28T18:37:10.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:10.983+0000 7ff39ca9c640 1 --2- 172.21.15.45:0/160918438 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff39003b990 0x7ff39003be00 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:10.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:10.983+0000 7ff39ca9c640 1 --2- 172.21.15.45:0/160918438 >> v2:172.21.15.190:3300/0 conn(0x7ff3900361e0 0x7ff39003b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:10.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:10.983+0000 7ff39ca9c640 1 -- 172.21.15.45:0/160918438 >> 172.21.15.45:0/160918438 conn(0x7ff390056cb0 msgr2=0x7ff3900570c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:10.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:10.983+0000 7ff39ca9c640 1 -- 172.21.15.45:0/160918438 shutdown_connections 2023-11-28T18:37:10.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:10.983+0000 7ff39ca9c640 1 -- 172.21.15.45:0/160918438 wait complete. 2023-11-28T18:37:10.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:10.983+0000 7ff39ca9c640 1 Processor -- start 2023-11-28T18:37:10.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:10.983+0000 7ff39ca9c640 1 -- start start 2023-11-28T18:37:10.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:10.987+0000 7ff39ca9c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3900361e0 0x7ff3900de040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:10.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:10.987+0000 7ff39ca9c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff39003b990 0x7ff39004a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:10.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:10.987+0000 7ff39ca9c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff3900e36e0 0x7ff3900d8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:10.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:10.987+0000 7ff39ca9c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff39004ae70 con 0x7ff3900361e0 2023-11-28T18:37:10.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:10.987+0000 7ff39ca9c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff39004b150 con 0x7ff39003b990 2023-11-28T18:37:10.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:10.987+0000 7ff39ca9c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff39004b430 con 0x7ff3900e36e0 2023-11-28T18:37:10.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:10.987+0000 7ff3977fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3900361e0 0x7ff3900de040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:10.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:10.987+0000 7ff3977fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3900361e0 0x7ff3900de040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41042/0 (socket says 172.21.15.45:41042) 2023-11-28T18:37:10.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:10.987+0000 7ff3977fe640 1 -- 172.21.15.45:0/792941784 learned_addr learned my addr 172.21.15.45:0/792941784 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:10.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:10.987+0000 7ff397fff640 1 --2- 172.21.15.45:0/792941784 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff3900e36e0 0x7ff3900d8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:10.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:10.987+0000 7ff396ffd640 1 --2- 172.21.15.45:0/792941784 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff39003b990 0x7ff39004a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:10.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:10.987+0000 7ff3977fe640 1 -- 172.21.15.45:0/792941784 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff3900e36e0 msgr2=0x7ff3900d8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:10.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:10.987+0000 7ff3977fe640 1 --2- 172.21.15.45:0/792941784 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff3900e36e0 0x7ff3900d8e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:10.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:10.987+0000 7ff3977fe640 1 -- 172.21.15.45:0/792941784 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff39003b990 msgr2=0x7ff39004a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:10.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:10.987+0000 7ff3977fe640 1 --2- 172.21.15.45:0/792941784 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff39003b990 0x7ff39004a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:10.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:10.987+0000 7ff3977fe640 1 -- 172.21.15.45:0/792941784 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff39804f820 con 0x7ff3900361e0 2023-11-28T18:37:10.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:10.987+0000 7ff3977fe640 1 --2- 172.21.15.45:0/792941784 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3900361e0 0x7ff3900de040 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff38c00c370 tx=0x7ff38c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:10.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:10.987+0000 7ff383fff640 1 -- 172.21.15.45:0/792941784 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38c0052d0 con 0x7ff3900361e0 2023-11-28T18:37:10.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:10.987+0000 7ff383fff640 1 -- 172.21.15.45:0/792941784 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff38c005430 con 0x7ff3900361e0 2023-11-28T18:37:10.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:10.987+0000 7ff383fff640 1 -- 172.21.15.45:0/792941784 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38c007260 con 0x7ff3900361e0 2023-11-28T18:37:10.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:10.987+0000 7ff39ca9c640 1 -- 172.21.15.45:0/792941784 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff39004b710 con 0x7ff3900361e0 2023-11-28T18:37:10.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:10.987+0000 7ff39ca9c640 1 -- 172.21.15.45:0/792941784 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3900d9350 con 0x7ff3900361e0 2023-11-28T18:37:10.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:10.987+0000 7ff383fff640 1 -- 172.21.15.45:0/792941784 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff38c0067e0 con 0x7ff3900361e0 2023-11-28T18:37:10.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:10.987+0000 7ff383fff640 1 -- 172.21.15.45:0/792941784 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7ff38c006a90 con 0x7ff3900361e0 2023-11-28T18:37:10.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:10.987+0000 7ff39ca9c640 1 -- 172.21.15.45:0/792941784 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3900d9570 con 0x7ff3900361e0 2023-11-28T18:37:10.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:10.991+0000 7ff383fff640 1 -- 172.21.15.45:0/792941784 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7ff38c020060 con 0x7ff3900361e0 2023-11-28T18:37:11.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:11.047+0000 7ff39ca9c640 1 -- 172.21.15.45:0/792941784 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff3900057c0 con 0x7ff3900361e0 2023-11-28T18:37:11.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:11.047+0000 7ff383fff640 1 -- 172.21.15.45:0/792941784 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7ff3900e3ac0 con 0x7ff3900361e0 2023-11-28T18:37:11.054 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:37:11.054 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":10,"fsid":"d10f5cd6-1d00-4019-99b6-6fa435498a15","created":"2023-11-28T18:37:08.189030+0000","modified":"2023-11-28T18:37:10.742043+0000","last_up_change":"0.000000","last_in_change":"2023-11-28T18:37:10.742043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"84465384-103c-4f2c-a45a-96f5bb9c835f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7d9eed24-a58f-42c7-a787-ac06be8553fc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"575eeccc-4abf-45b4-9caf-f3e797859588","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9b0290d6-9a52-4bc8-b2a1-7622c5dc8e0b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"ce632829-f027-4fbf-a627-02c571aa9d53","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"8700b609-27be-40bd-a251-4c0ae0a29ead","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"44ce4a40-e6ff-4f4d-8e8a-7341e5c91f08","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"192238c9-1423-4b7e-ac8f-84ba32113ddf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T18:37:11.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:11.051+0000 7ff39ca9c640 1 -- 172.21.15.45:0/792941784 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3900361e0 msgr2=0x7ff3900de040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:11.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:11.051+0000 7ff39ca9c640 1 --2- 172.21.15.45:0/792941784 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3900361e0 0x7ff3900de040 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff38c00c370 tx=0x7ff38c00c830 comp rx=0 tx=0).stop 2023-11-28T18:37:11.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:11.051+0000 7ff39ca9c640 1 -- 172.21.15.45:0/792941784 shutdown_connections 2023-11-28T18:37:11.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:11.051+0000 7ff39ca9c640 1 --2- 172.21.15.45:0/792941784 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff3900e36e0 0x7ff3900d8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:11.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:11.051+0000 7ff39ca9c640 1 --2- 172.21.15.45:0/792941784 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff39003b990 0x7ff39004a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:11.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:11.051+0000 7ff39ca9c640 1 --2- 172.21.15.45:0/792941784 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3900361e0 0x7ff3900de040 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:11.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:11.051+0000 7ff39ca9c640 1 -- 172.21.15.45:0/792941784 >> 172.21.15.45:0/792941784 conn(0x7ff390056cb0 msgr2=0x7ff390009b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:11.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:11.051+0000 7ff39ca9c640 1 -- 172.21.15.45:0/792941784 shutdown_connections 2023-11-28T18:37:11.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:11.051+0000 7ff39ca9c640 1 -- 172.21.15.45:0/792941784 wait complete. 2023-11-28T18:37:11.073 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-11-28T18:37:11.073 INFO:tasks.ceph:Waiting for OSDs to come up 2023-11-28T18:37:11.210 INFO:tasks.ceph.mgr.x.smithi190.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-11-28T18:37:11.211 INFO:tasks.ceph.mgr.x.smithi190.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-11-28T18:37:11.211 INFO:tasks.ceph.mgr.x.smithi190.stderr: from numpy import show_config as show_numpy_config 2023-11-28T18:37:11.258 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-11-28T18:37:11.258+0000 7ff4fbc47180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-28T18:37:11.285 INFO:tasks.ceph.mgr.y.smithi045.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-11-28T18:37:11.285 INFO:tasks.ceph.mgr.y.smithi045.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-11-28T18:37:11.285 INFO:tasks.ceph.mgr.y.smithi045.stderr: from numpy import show_config as show_numpy_config 2023-11-28T18:37:11.347 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-11-28T18:37:11.343+0000 7f59b9851180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-28T18:37:11.392 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-11-28T18:37:11.390+0000 7ff4fbc47180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-28T18:37:11.420 INFO:tasks.ceph.osd.1.smithi045.stderr:2023-11-28T18:37:11.415+0000 7fd8e3c2b640 -1 Falling back to public interface 2023-11-28T18:37:11.427 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-11-28T18:37:11.423+0000 7ff984229640 -1 Falling back to public interface 2023-11-28T18:37:11.433 INFO:tasks.ceph.osd.5.smithi190.stderr:2023-11-28T18:37:11.434+0000 7f43a79ef640 -1 Falling back to public interface 2023-11-28T18:37:11.437 INFO:tasks.ceph.osd.4.smithi190.stderr:2023-11-28T18:37:11.438+0000 7ff926120640 -1 Falling back to public interface 2023-11-28T18:37:11.443 INFO:tasks.ceph.osd.2.smithi045.stderr:2023-11-28T18:37:11.439+0000 7f2965507640 -1 Falling back to public interface 2023-11-28T18:37:11.457 INFO:tasks.ceph.osd.6.smithi190.stderr:2023-11-28T18:37:11.458+0000 7f3112e2c640 -1 Falling back to public interface 2023-11-28T18:37:11.459 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-11-28T18:37:11.455+0000 7f00d519f640 -1 Falling back to public interface 2023-11-28T18:37:11.503 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-11-28T18:37:11.499+0000 7f59b9851180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-28T18:37:11.513 INFO:tasks.ceph.osd.7.smithi190.stderr:2023-11-28T18:37:11.514+0000 7f0fe189e640 -1 Falling back to public interface 2023-11-28T18:37:11.564 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-11-28T18:37:11.566+0000 7ff4fbc47180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-28T18:37:11.637 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-11-28T18:37:11.638+0000 7ff4fbc47180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-28T18:37:11.689 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-11-28T18:37:11.683+0000 7f59b9851180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-28T18:37:11.766 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-11-28T18:37:11.763+0000 7f59b9851180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-28T18:37:11.776 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-11-28T18:37:11.774+0000 7ff4fbc47180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-28T18:37:11.879 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-28T18:37:11.912 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-11-28T18:37:11.907+0000 7f59b9851180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-28T18:37:12.011 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:12.007+0000 7f3cc84c9640 1 Processor -- start 2023-11-28T18:37:12.011 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:12.007+0000 7f3cc84c9640 1 -- start start 2023-11-28T18:37:12.013 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:12.007+0000 7f3cc84c9640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3cc00d2ee0 0x7f3cc00d3340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:12.013 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:12.007+0000 7f3cc84c9640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cc00ce510 con 0x7f3cc015d3c0 2023-11-28T18:37:12.013 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:12.007+0000 7f3cc84c9640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cc00cdf00 con 0x7f3cc00cfa90 2023-11-28T18:37:12.013 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:12.007+0000 7f3cc84c9640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc00d07a0 con 0x7f3cc00d2ee0 2023-11-28T18:37:12.013 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:12.007+0000 7f3cc6265640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f3cc015d3c0 0x7f3cc00ce9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:60644/0 (socket says 172.21.15.45:60644) 2023-11-28T18:37:12.013 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:12.007+0000 7f3cc6265640 1 -- 172.21.15.45:0/4074878684 learned_addr learned my addr 172.21.15.45:0/4074878684 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:37:12.014 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:12.007+0000 7f3cc5a64640 1 --2- 172.21.15.45:0/4074878684 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3cc00d2ee0 0x7f3cc00d3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:12.014 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:12.007+0000 7f3cc5263640 1 -- 172.21.15.45:0/4074878684 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1020779240 0 0) 0x7f3cc00ce510 con 0x7f3cc015d3c0 2023-11-28T18:37:12.014 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:12.007+0000 7f3cc5263640 1 -- 172.21.15.45:0/4074878684 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3cac003530 con 0x7f3cc015d3c0 2023-11-28T18:37:12.014 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:12.007+0000 7f3cc5263640 1 -- 172.21.15.45:0/4074878684 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1828679539 0 0) 0x7f3cc00cdf00 con 0x7f3cc00cfa90 2023-11-28T18:37:12.015 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:12.007+0000 7f3cc5263640 1 -- 172.21.15.45:0/4074878684 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3cc00ce510 con 0x7f3cc00cfa90 2023-11-28T18:37:12.015 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:12.007+0000 7f3cc5a64640 1 -- 172.21.15.45:0/4074878684 >> v1:172.21.15.190:6789/0 conn(0x7f3cc00cfa90 legacy=0x7f3cc00cff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:12.015 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:12.007+0000 7f3cc5a64640 1 -- 172.21.15.45:0/4074878684 >> v1:172.21.15.45:6789/0 conn(0x7f3cc015d3c0 legacy=0x7f3cc00ce9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:12.015 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:12.011+0000 7f3cc5a64640 1 -- 172.21.15.45:0/4074878684 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cc00ce1a0 con 0x7f3cc00d2ee0 2023-11-28T18:37:12.016 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:12.011+0000 7f3cc5a64640 1 --2- 172.21.15.45:0/4074878684 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3cc00d2ee0 0x7f3cc00d3340 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3cb00097f0 tx=0x7f3cb001c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4810bf1166c7c98 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:12.017 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:12.011+0000 7f3cc5263640 1 -- 172.21.15.45:0/4074878684 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb00ab600 con 0x7f3cc00d2ee0 2023-11-28T18:37:12.017 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:12.011+0000 7f3cc5263640 1 -- 172.21.15.45:0/4074878684 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cb00a7050 con 0x7f3cc00d2ee0 2023-11-28T18:37:12.017 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:12.011+0000 7f3cc5263640 1 -- 172.21.15.45:0/4074878684 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb00ab980 con 0x7f3cc00d2ee0 2023-11-28T18:37:12.018 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:12.011+0000 7f3cc84c9640 1 -- 172.21.15.45:0/4074878684 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3cc00d2ee0 msgr2=0x7f3cc00d3340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:12.018 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:12.011+0000 7f3cc84c9640 1 --2- 172.21.15.45:0/4074878684 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3cc00d2ee0 0x7f3cc00d3340 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3cb00097f0 tx=0x7f3cb001c4c0 comp rx=0 tx=0).stop 2023-11-28T18:37:12.018 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:12.011+0000 7f3cc84c9640 1 -- 172.21.15.45:0/4074878684 shutdown_connections 2023-11-28T18:37:12.018 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:12.011+0000 7f3cc84c9640 1 --2- 172.21.15.45:0/4074878684 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3cc00d2ee0 0x7f3cc00d3340 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:12.018 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:12.011+0000 7f3cc84c9640 1 -- 172.21.15.45:0/4074878684 >> 172.21.15.45:0/4074878684 conn(0x7f3cc008afa0 msgr2=0x7f3cc009c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:12.018 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:12.015+0000 7f3cc84c9640 1 -- 172.21.15.45:0/4074878684 shutdown_connections 2023-11-28T18:37:12.018 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:12.015+0000 7f3cc84c9640 1 -- 172.21.15.45:0/4074878684 wait complete. 2023-11-28T18:37:12.019 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:12.015+0000 7f3cc84c9640 1 Processor -- start 2023-11-28T18:37:12.019 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:12.015+0000 7f3cc84c9640 1 -- start start 2023-11-28T18:37:12.021 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:12.015+0000 7f3cc84c9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3cc00cfa90 0x7f3cc01605a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:12.021 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:12.015+0000 7f3cc84c9640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3cc00d2ee0 0x7f3cc01487c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:12.021 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:12.015+0000 7f3cc84c9640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3cc015d3c0 0x7f3cc015db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:12.021 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:12.015+0000 7f3cc84c9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc0156fd0 con 0x7f3cc00cfa90 2023-11-28T18:37:12.021 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:12.015+0000 7f3cc84c9640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc0148d00 con 0x7f3cc015d3c0 2023-11-28T18:37:12.021 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:12.015+0000 7f3cc84c9640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc015e040 con 0x7f3cc00d2ee0 2023-11-28T18:37:12.021 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:12.015+0000 7f3cc6265640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3cc00cfa90 0x7f3cc01605a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:12.021 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:12.015+0000 7f3cc6265640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3cc00cfa90 0x7f3cc01605a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41046/0 (socket says 172.21.15.45:41046) 2023-11-28T18:37:12.021 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:12.015+0000 7f3cc6265640 1 -- 172.21.15.45:0/4047255945 learned_addr learned my addr 172.21.15.45:0/4047255945 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:12.021 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:12.015+0000 7f3cc5a64640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3cc00d2ee0 0x7f3cc01487c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:12.021 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:12.015+0000 7f3cc6a66640 1 --2- 172.21.15.45:0/4047255945 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3cc015d3c0 0x7f3cc015db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:12.023 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:12.015+0000 7f3cc5a64640 1 -- 172.21.15.45:0/4047255945 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3cc015d3c0 msgr2=0x7f3cc015db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:12.023 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:12.015+0000 7f3cc5a64640 1 --2- 172.21.15.45:0/4047255945 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3cc015d3c0 0x7f3cc015db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:12.023 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:12.015+0000 7f3cc5a64640 1 -- 172.21.15.45:0/4047255945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3cc00cfa90 msgr2=0x7f3cc01605a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:12.023 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:12.015+0000 7f3cc5a64640 1 --2- 172.21.15.45:0/4047255945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3cc00cfa90 0x7f3cc01605a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:12.023 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:12.015+0000 7f3cc5a64640 1 -- 172.21.15.45:0/4047255945 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cb0009420 con 0x7f3cc00d2ee0 2023-11-28T18:37:12.023 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:12.015+0000 7f3cc6265640 1 --2- 172.21.15.45:0/4047255945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3cc00cfa90 0x7f3cc01605a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:37:12.023 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:12.015+0000 7f3cc5a64640 1 --2- 172.21.15.45:0/4047255945 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3cc00d2ee0 0x7f3cc01487c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3cb00ab000 tx=0x7f3cb0019260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:12.023 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:12.019+0000 7f3cb6ffd640 1 -- 172.21.15.45:0/4047255945 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb00b4630 con 0x7f3cc00d2ee0 2023-11-28T18:37:12.023 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:12.019+0000 7f3cb6ffd640 1 -- 172.21.15.45:0/4047255945 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cb00b4790 con 0x7f3cc00d2ee0 2023-11-28T18:37:12.024 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:12.019+0000 7f3cb6ffd640 1 -- 172.21.15.45:0/4047255945 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb00b4b40 con 0x7f3cc00d2ee0 2023-11-28T18:37:12.024 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:12.019+0000 7f3cc84c9640 1 -- 172.21.15.45:0/4047255945 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cc0156630 con 0x7f3cc00d2ee0 2023-11-28T18:37:12.024 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:12.019+0000 7f3cc84c9640 1 -- 172.21.15.45:0/4047255945 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cc0156bf0 con 0x7f3cc00d2ee0 2023-11-28T18:37:12.024 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:12.019+0000 7f3cb6ffd640 1 -- 172.21.15.45:0/4047255945 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3cb00b2040 con 0x7f3cc00d2ee0 2023-11-28T18:37:12.024 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:12.019+0000 7f3cb6ffd640 1 -- 172.21.15.45:0/4047255945 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f3cb00aaa70 con 0x7f3cc00d2ee0 2023-11-28T18:37:12.024 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:12.019+0000 7f3cc84c9640 1 -- 172.21.15.45:0/4047255945 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cc00694f0 con 0x7f3cc00d2ee0 2023-11-28T18:37:12.025 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:12.019+0000 7f3cb6ffd640 1 -- 172.21.15.45:0/4047255945 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f3cb00b0070 con 0x7f3cc00d2ee0 2023-11-28T18:37:12.084 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:12.079+0000 7f3cc84c9640 1 -- 172.21.15.45:0/4047255945 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3cc00cd450 con 0x7f3cc00d2ee0 2023-11-28T18:37:12.085 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:12.079+0000 7f3cb6ffd640 1 -- 172.21.15.45:0/4047255945 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f3cb00cc090 con 0x7f3cc00d2ee0 2023-11-28T18:37:12.085 INFO:teuthology.misc.health.smithi045.stdout: 2023-11-28T18:37:12.085 INFO:teuthology.misc.health.smithi045.stdout:{"epoch":10,"fsid":"d10f5cd6-1d00-4019-99b6-6fa435498a15","created":"2023-11-28T18:37:08.189030+0000","modified":"2023-11-28T18:37:10.742043+0000","last_up_change":"0.000000","last_in_change":"2023-11-28T18:37:10.742043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"84465384-103c-4f2c-a45a-96f5bb9c835f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7d9eed24-a58f-42c7-a787-ac06be8553fc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"575eeccc-4abf-45b4-9caf-f3e797859588","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9b0290d6-9a52-4bc8-b2a1-7622c5dc8e0b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"ce632829-f027-4fbf-a627-02c571aa9d53","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"8700b609-27be-40bd-a251-4c0ae0a29ead","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"44ce4a40-e6ff-4f4d-8e8a-7341e5c91f08","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"192238c9-1423-4b7e-ac8f-84ba32113ddf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T18:37:12.086 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:12.079+0000 7f3cc84c9640 1 -- 172.21.15.45:0/4047255945 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3cc00d2ee0 msgr2=0x7f3cc01487c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:12.086 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:12.079+0000 7f3cc84c9640 1 --2- 172.21.15.45:0/4047255945 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3cc00d2ee0 0x7f3cc01487c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3cb00ab000 tx=0x7f3cb0019260 comp rx=0 tx=0).stop 2023-11-28T18:37:12.086 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:12.079+0000 7f3cc84c9640 1 -- 172.21.15.45:0/4047255945 shutdown_connections 2023-11-28T18:37:12.086 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:12.079+0000 7f3cc84c9640 1 --2- 172.21.15.45:0/4047255945 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3cc015d3c0 0x7f3cc015db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:12.086 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:12.079+0000 7f3cc84c9640 1 --2- 172.21.15.45:0/4047255945 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3cc00d2ee0 0x7f3cc01487c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:12.086 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:12.079+0000 7f3cc84c9640 1 --2- 172.21.15.45:0/4047255945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3cc00cfa90 0x7f3cc01605a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:12.086 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:12.079+0000 7f3cc84c9640 1 -- 172.21.15.45:0/4047255945 >> 172.21.15.45:0/4047255945 conn(0x7f3cc008afa0 msgr2=0x7f3cc00b1560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:12.086 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:12.083+0000 7f3cc84c9640 1 -- 172.21.15.45:0/4047255945 shutdown_connections 2023-11-28T18:37:12.087 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:12.083+0000 7f3cc84c9640 1 -- 172.21.15.45:0/4047255945 wait complete. 2023-11-28T18:37:12.103 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-28T18:37:12.458 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-11-28T18:37:12.458+0000 7ff4fbc47180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-28T18:37:12.544 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-11-28T18:37:12.546+0000 7ff4fbc47180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-28T18:37:12.624 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-11-28T18:37:12.619+0000 7f59b9851180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-28T18:37:12.715 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-11-28T18:37:12.711+0000 7f59b9851180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-28T18:37:12.735 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-11-28T18:37:12.734+0000 7ff4fbc47180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-28T18:37:12.820 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-11-28T18:37:12.818+0000 7ff4fbc47180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-28T18:37:12.915 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-11-28T18:37:12.911+0000 7f59b9851180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-28T18:37:13.005 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-11-28T18:37:12.999+0000 7f59b9851180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-28T18:37:13.146 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-11-28T18:37:13.145+0000 7ff4fbc47180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-28T18:37:13.215 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-11-28T18:37:13.213+0000 7ff4fbc47180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-28T18:37:13.354 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-11-28T18:37:13.351+0000 7f59b9851180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-28T18:37:13.426 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-11-28T18:37:13.423+0000 7f59b9851180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-28T18:37:14.240 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-11-28T18:37:14.237+0000 7ff4a2828640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-11-28T18:37:14.240 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-11-28T18:37:14.237+0000 7ff4a2828640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-11-28T18:37:15.285 INFO:tasks.ceph.osd.5.smithi190.stderr:2023-11-28T18:37:15.285+0000 7f43a79ef640 -1 osd.5 0 log_to_monitors true 2023-11-28T18:37:15.338 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-11-28T18:37:15.335+0000 7f00d519f640 -1 osd.3 0 log_to_monitors true 2023-11-28T18:37:15.361 INFO:tasks.ceph.osd.2.smithi045.stderr:2023-11-28T18:37:15.355+0000 7f2965507640 -1 osd.2 0 log_to_monitors true 2023-11-28T18:37:15.370 INFO:tasks.ceph.osd.1.smithi045.stderr:2023-11-28T18:37:15.367+0000 7fd8e3c2b640 -1 osd.1 0 log_to_monitors true 2023-11-28T18:37:15.397 INFO:tasks.ceph.osd.4.smithi190.stderr:2023-11-28T18:37:15.397+0000 7ff926120640 -1 osd.4 0 log_to_monitors true 2023-11-28T18:37:15.431 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-11-28T18:37:15.427+0000 7ff984229640 -1 osd.0 0 log_to_monitors true 2023-11-28T18:37:15.433 INFO:tasks.ceph.osd.6.smithi190.stderr:2023-11-28T18:37:15.433+0000 7f3112e2c640 -1 osd.6 0 log_to_monitors true 2023-11-28T18:37:15.457 INFO:tasks.ceph.osd.7.smithi190.stderr:2023-11-28T18:37:15.457+0000 7f0fe189e640 -1 osd.7 0 log_to_monitors true 2023-11-28T18:37:18.911 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-28T18:37:19.123 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:19.119+0000 7f8e9ccc8640 1 Processor -- start 2023-11-28T18:37:19.123 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:19.119+0000 7f8e9ccc8640 1 -- start start 2023-11-28T18:37:19.125 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:19.119+0000 7f8e9ccc8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e9806b0e0 0x7f8e9806c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:19.125 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:19.119+0000 7f8e9ccc8640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f8e98160cc0 0x7f8e981630b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:19.125 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:19.119+0000 7f8e9ccc8640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e980703c0 con 0x7f8e98071460 2023-11-28T18:37:19.125 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:19.119+0000 7f8e9ccc8640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e980706a0 con 0x7f8e98160cc0 2023-11-28T18:37:19.125 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:19.119+0000 7f8e9ccc8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e98070980 con 0x7f8e9806b0e0 2023-11-28T18:37:19.126 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:19.119+0000 7f8e977fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e9806b0e0 0x7f8e9806c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:19.126 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:19.119+0000 7f8e977fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e9806b0e0 0x7f8e9806c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.45:54788/0 (socket says 172.21.15.45:54788) 2023-11-28T18:37:19.126 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:19.119+0000 7f8e977fe640 1 -- 172.21.15.45:0/111206331 learned_addr learned my addr 172.21.15.45:0/111206331 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:19.126 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:19.119+0000 7f8e97fff640 1 --2- 172.21.15.45:0/111206331 >> v2:172.21.15.190:3300/0 conn(0x7f8e98160cc0 0x7f8e981630b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:19.126 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:19.119+0000 7f8e977fe640 1 -- 172.21.15.45:0/111206331 >> v2:172.21.15.190:3300/0 conn(0x7f8e98160cc0 msgr2=0x7f8e981630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:19.127 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:19.119+0000 7f8e977fe640 1 --2- 172.21.15.45:0/111206331 >> v2:172.21.15.190:3300/0 conn(0x7f8e98160cc0 0x7f8e981630b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:19.128 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:19.119+0000 7f8e977fe640 1 -- 172.21.15.45:0/111206331 >> v1:172.21.15.190:6789/0 conn(0x7f8e98071460 legacy=0x7f8e980718c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:19.129 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:19.119+0000 7f8e977fe640 1 -- 172.21.15.45:0/111206331 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e98070c60 con 0x7f8e9806b0e0 2023-11-28T18:37:19.129 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:19.123+0000 7f8e977fe640 1 --2- 172.21.15.45:0/111206331 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e9806b0e0 0x7f8e9806c340 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8e8800d180 tx=0x7f8e8801ebc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c48fe4aa73a51c2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:19.129 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:19.123+0000 7f8e967fc640 1 -- 172.21.15.45:0/111206331 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e980721e0 con 0x7f8e9806b0e0 2023-11-28T18:37:19.130 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:19.123+0000 7f8e967fc640 1 -- 172.21.15.45:0/111206331 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e880ab070 con 0x7f8e9806b0e0 2023-11-28T18:37:19.130 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:19.127+0000 7f8e967fc640 1 -- 172.21.15.45:0/111206331 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e880b1400 con 0x7f8e9806b0e0 2023-11-28T18:37:19.133 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:19.127+0000 7f8e9ccc8640 1 -- 172.21.15.45:0/111206331 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e9806b0e0 msgr2=0x7f8e9806c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:19.133 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:19.127+0000 7f8e9ccc8640 1 --2- 172.21.15.45:0/111206331 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e9806b0e0 0x7f8e9806c340 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8e8800d180 tx=0x7f8e8801ebc0 comp rx=0 tx=0).stop 2023-11-28T18:37:19.134 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:19.127+0000 7f8e9ccc8640 1 -- 172.21.15.45:0/111206331 shutdown_connections 2023-11-28T18:37:19.134 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:19.127+0000 7f8e9ccc8640 1 --2- 172.21.15.45:0/111206331 >> v2:172.21.15.190:3300/0 conn(0x7f8e98160cc0 0x7f8e981630b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:19.134 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:19.127+0000 7f8e9ccc8640 1 --2- 172.21.15.45:0/111206331 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e9806b0e0 0x7f8e9806c340 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:19.134 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:19.127+0000 7f8e9ccc8640 1 -- 172.21.15.45:0/111206331 >> 172.21.15.45:0/111206331 conn(0x7f8e9806a5c0 msgr2=0x7f8e9806a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:19.134 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:19.127+0000 7f8e9ccc8640 1 -- 172.21.15.45:0/111206331 shutdown_connections 2023-11-28T18:37:19.134 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:19.127+0000 7f8e9ccc8640 1 -- 172.21.15.45:0/111206331 wait complete. 2023-11-28T18:37:19.134 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:19.127+0000 7f8e9ccc8640 1 Processor -- start 2023-11-28T18:37:19.136 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:19.127+0000 7f8e9ccc8640 1 -- start start 2023-11-28T18:37:19.136 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:19.131+0000 7f8e9ccc8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e9806b0e0 0x7f8e98137690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:19.136 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:19.131+0000 7f8e9ccc8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e98071460 0x7f8e981494b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:19.136 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:19.131+0000 7f8e9ccc8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e98160cc0 0x7f8e981499f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:19.136 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:19.131+0000 7f8e9ccc8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e98099a10 con 0x7f8e98160cc0 2023-11-28T18:37:19.136 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:19.131+0000 7f8e9ccc8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9814e910 con 0x7f8e98071460 2023-11-28T18:37:19.137 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:19.131+0000 7f8e9ccc8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9814dd00 con 0x7f8e9806b0e0 2023-11-28T18:37:19.137 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:19.131+0000 7f8e977fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e9806b0e0 0x7f8e98137690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:19.137 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:19.131+0000 7f8e977fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e9806b0e0 0x7f8e98137690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.45:54802/0 (socket says 172.21.15.45:54802) 2023-11-28T18:37:19.137 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:19.131+0000 7f8e977fe640 1 -- 172.21.15.45:0/2167518155 learned_addr learned my addr 172.21.15.45:0/2167518155 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:19.137 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:19.131+0000 7f8e97fff640 1 --2- 172.21.15.45:0/2167518155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e98160cc0 0x7f8e981499f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:19.137 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:19.131+0000 7f8e96ffd640 1 --2- 172.21.15.45:0/2167518155 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e98071460 0x7f8e981494b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:19.137 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:19.131+0000 7f8e97fff640 1 -- 172.21.15.45:0/2167518155 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e9806b0e0 msgr2=0x7f8e98137690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:19.137 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:19.131+0000 7f8e97fff640 1 --2- 172.21.15.45:0/2167518155 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e9806b0e0 0x7f8e98137690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:19.137 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:19.131+0000 7f8e97fff640 1 -- 172.21.15.45:0/2167518155 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e98071460 msgr2=0x7f8e981494b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:19.137 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:19.131+0000 7f8e97fff640 1 --2- 172.21.15.45:0/2167518155 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e98071460 0x7f8e981494b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:19.137 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:19.131+0000 7f8e97fff640 1 -- 172.21.15.45:0/2167518155 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e8800bd40 con 0x7f8e98160cc0 2023-11-28T18:37:19.137 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:19.131+0000 7f8e96ffd640 1 --2- 172.21.15.45:0/2167518155 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e98071460 0x7f8e981494b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:37:19.138 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:19.131+0000 7f8e977fe640 1 --2- 172.21.15.45:0/2167518155 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e9806b0e0 0x7f8e98137690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:37:19.138 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:19.131+0000 7f8e97fff640 1 --2- 172.21.15.45:0/2167518155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e98160cc0 0x7f8e981499f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8e980b1930 tx=0x7f8e9000ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:19.138 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:19.135+0000 7f8e7ffff640 1 -- 172.21.15.45:0/2167518155 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9000c730 con 0x7f8e98160cc0 2023-11-28T18:37:19.139 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:19.135+0000 7f8e7ffff640 1 -- 172.21.15.45:0/2167518155 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e9000c8b0 con 0x7f8e98160cc0 2023-11-28T18:37:19.139 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:19.135+0000 7f8e7ffff640 1 -- 172.21.15.45:0/2167518155 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9000cc60 con 0x7f8e98160cc0 2023-11-28T18:37:19.139 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:19.135+0000 7f8e9ccc8640 1 -- 172.21.15.45:0/2167518155 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e9814dfe0 con 0x7f8e98160cc0 2023-11-28T18:37:19.139 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:19.135+0000 7f8e9ccc8640 1 -- 172.21.15.45:0/2167518155 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e9814e5a0 con 0x7f8e98160cc0 2023-11-28T18:37:19.139 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:19.135+0000 7f8e9ccc8640 1 -- 172.21.15.45:0/2167518155 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e98067a30 con 0x7f8e98160cc0 2023-11-28T18:37:19.142 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:19.135+0000 7f8e7ffff640 1 -- 172.21.15.45:0/2167518155 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 86114+0+0 (secure 0 0 0) 0x7f8e90013470 con 0x7f8e98160cc0 2023-11-28T18:37:19.143 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:19.139+0000 7f8e7ffff640 1 --2- 172.21.15.45:0/2167518155 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f8e84066890 0x7f8e84068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:19.143 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:19.139+0000 7f8e7ffff640 1 -- 172.21.15.45:0/2167518155 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f8e90083470 con 0x7f8e98160cc0 2023-11-28T18:37:19.143 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:19.139+0000 7f8e977fe640 1 --2- 172.21.15.45:0/2167518155 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f8e84066890 0x7f8e84068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:19.144 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:19.139+0000 7f8e977fe640 1 --2- 172.21.15.45:0/2167518155 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f8e84066890 0x7f8e84068d50 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8e8801ec00 tx=0x7f8e880a9070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:19.154 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:19.147+0000 7f8e7ffff640 1 -- 172.21.15.45:0/2167518155 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8e900515b0 con 0x7f8e98160cc0 2023-11-28T18:37:19.166 INFO:tasks.ceph.osd.2.smithi045.stderr:2023-11-28T18:37:19.163+0000 7f2960c8d640 -1 osd.2 0 waiting for initial osdmap 2023-11-28T18:37:19.170 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-11-28T18:37:19.167+0000 7ff97f9af640 -1 osd.0 0 waiting for initial osdmap 2023-11-28T18:37:19.170 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-11-28T18:37:19.167+0000 7f00d0925640 -1 osd.3 0 waiting for initial osdmap 2023-11-28T18:37:19.186 INFO:tasks.ceph.osd.1.smithi045.stderr:2023-11-28T18:37:19.183+0000 7fd8de9a0640 -1 osd.1 0 waiting for initial osdmap 2023-11-28T18:37:19.208 INFO:tasks.ceph.osd.2.smithi045.stderr:2023-11-28T18:37:19.203+0000 7f29592da640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T18:37:19.208 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-11-28T18:37:19.203+0000 7f00c8f72640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T18:37:19.215 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-11-28T18:37:19.211+0000 7ff977ffc640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T18:37:19.223 INFO:tasks.ceph.osd.1.smithi045.stderr:2023-11-28T18:37:19.219+0000 7fd8d6fed640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T18:37:19.338 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:19.331+0000 7f8e9ccc8640 1 -- 172.21.15.45:0/2167518155 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8e98067fd0 con 0x7f8e98160cc0 2023-11-28T18:37:19.338 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:19.331+0000 7f8e7ffff640 1 -- 172.21.15.45:0/2167518155 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f8e90021090 con 0x7f8e98160cc0 2023-11-28T18:37:19.338 INFO:teuthology.misc.health.smithi045.stdout: 2023-11-28T18:37:19.338 INFO:teuthology.misc.health.smithi045.stdout:{"epoch":12,"fsid":"d10f5cd6-1d00-4019-99b6-6fa435498a15","created":"2023-11-28T18:37:08.189030+0000","modified":"2023-11-28T18:37:17.246332+0000","last_up_change":"0.000000","last_in_change":"2023-11-28T18:37:10.742043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"84465384-103c-4f2c-a45a-96f5bb9c835f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7d9eed24-a58f-42c7-a787-ac06be8553fc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"575eeccc-4abf-45b4-9caf-f3e797859588","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9b0290d6-9a52-4bc8-b2a1-7622c5dc8e0b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"ce632829-f027-4fbf-a627-02c571aa9d53","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"8700b609-27be-40bd-a251-4c0ae0a29ead","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"44ce4a40-e6ff-4f4d-8e8a-7341e5c91f08","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"192238c9-1423-4b7e-ac8f-84ba32113ddf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T18:37:19.339 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:19.335+0000 7f8e9ccc8640 1 -- 172.21.15.45:0/2167518155 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f8e84066890 msgr2=0x7f8e84068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:19.339 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:19.335+0000 7f8e9ccc8640 1 --2- 172.21.15.45:0/2167518155 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f8e84066890 0x7f8e84068d50 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8e8801ec00 tx=0x7f8e880a9070 comp rx=0 tx=0).stop 2023-11-28T18:37:19.339 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:19.335+0000 7f8e9ccc8640 1 -- 172.21.15.45:0/2167518155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e98160cc0 msgr2=0x7f8e981499f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:19.340 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:19.335+0000 7f8e9ccc8640 1 --2- 172.21.15.45:0/2167518155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e98160cc0 0x7f8e981499f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8e980b1930 tx=0x7f8e9000ec50 comp rx=0 tx=0).stop 2023-11-28T18:37:19.340 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:19.335+0000 7f8e9ccc8640 1 -- 172.21.15.45:0/2167518155 shutdown_connections 2023-11-28T18:37:19.340 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:19.335+0000 7f8e9ccc8640 1 --2- 172.21.15.45:0/2167518155 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f8e84066890 0x7f8e84068d50 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:19.340 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:19.335+0000 7f8e9ccc8640 1 --2- 172.21.15.45:0/2167518155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e98160cc0 0x7f8e981499f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:19.340 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:19.335+0000 7f8e9ccc8640 1 --2- 172.21.15.45:0/2167518155 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e98071460 0x7f8e981494b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:19.340 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:19.335+0000 7f8e9ccc8640 1 --2- 172.21.15.45:0/2167518155 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e9806b0e0 0x7f8e98137690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:19.340 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:19.335+0000 7f8e9ccc8640 1 -- 172.21.15.45:0/2167518155 >> 172.21.15.45:0/2167518155 conn(0x7f8e9806a5c0 msgr2=0x7f8e9806c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:19.340 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:19.335+0000 7f8e9ccc8640 1 -- 172.21.15.45:0/2167518155 shutdown_connections 2023-11-28T18:37:19.340 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:19.335+0000 7f8e9ccc8640 1 -- 172.21.15.45:0/2167518155 wait complete. 2023-11-28T18:37:19.356 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-28T18:37:19.661 INFO:tasks.ceph.osd.6.smithi190.stderr:2023-11-28T18:37:19.661+0000 7f310db52640 -1 osd.6 0 waiting for initial osdmap 2023-11-28T18:37:19.674 INFO:tasks.ceph.osd.7.smithi190.stderr:2023-11-28T18:37:19.673+0000 7f0fdd024640 -1 osd.7 0 waiting for initial osdmap 2023-11-28T18:37:19.675 INFO:tasks.ceph.osd.4.smithi190.stderr:2023-11-28T18:37:19.673+0000 7ff9218a8640 -1 osd.4 0 waiting for initial osdmap 2023-11-28T18:37:19.698 INFO:tasks.ceph.osd.6.smithi190.stderr:2023-11-28T18:37:19.697+0000 7f310619f640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T18:37:19.706 INFO:tasks.ceph.osd.4.smithi190.stderr:2023-11-28T18:37:19.705+0000 7ff919ef5640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T18:37:19.710 INFO:tasks.ceph.osd.5.smithi190.stderr:2023-11-28T18:37:19.709+0000 7f43a49ad640 -1 osd.5 0 waiting for initial osdmap 2023-11-28T18:37:19.714 INFO:tasks.ceph.osd.7.smithi190.stderr:2023-11-28T18:37:19.713+0000 7f0fd5671640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T18:37:19.736 INFO:tasks.ceph.osd.5.smithi190.stderr:2023-11-28T18:37:19.733+0000 7f439b7c4640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T18:37:22.962 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:37:22.966 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:37:26.163 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-28T18:37:26.307 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:26.303+0000 7fdc3a5b5640 1 Processor -- start 2023-11-28T18:37:26.307 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:26.303+0000 7fdc3a5b5640 1 -- start start 2023-11-28T18:37:26.309 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:26.303+0000 7fdc3a5b5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdc340d0560 0x7fdc340b1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:26.309 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:26.303+0000 7fdc3a5b5640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdc3415ef30 0x7fdc340ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:26.309 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:26.303+0000 7fdc3a5b5640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc340cdb10 con 0x7fdc340cf9c0 2023-11-28T18:37:26.310 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:26.303+0000 7fdc3a5b5640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc340cf760 con 0x7fdc340d0560 2023-11-28T18:37:26.310 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:26.303+0000 7fdc3a5b5640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc340cdd40 con 0x7fdc3415ef30 2023-11-28T18:37:26.310 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:26.303+0000 7fdc38db2640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdc340d0560 0x7fdc340b1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:26.310 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:26.303+0000 7fdc38db2640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdc340d0560 0x7fdc340b1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59798/0 (socket says 172.21.15.45:59798) 2023-11-28T18:37:26.310 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:26.303+0000 7fdc38db2640 1 -- 172.21.15.45:0/1583700904 learned_addr learned my addr 172.21.15.45:0/1583700904 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:26.310 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:26.303+0000 7fdc39db4640 1 --2- 172.21.15.45:0/1583700904 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdc3415ef30 0x7fdc340ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:26.310 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:26.303+0000 7fdc38db2640 1 -- 172.21.15.45:0/1583700904 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdc3415ef30 msgr2=0x7fdc340ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:26.310 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:26.303+0000 7fdc38db2640 1 --2- 172.21.15.45:0/1583700904 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdc3415ef30 0x7fdc340ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:26.310 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:26.303+0000 7fdc38db2640 1 -- 172.21.15.45:0/1583700904 >> v1:172.21.15.190:6789/0 conn(0x7fdc340cf9c0 legacy=0x7fdc340cfda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:26.310 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:26.303+0000 7fdc38db2640 1 -- 172.21.15.45:0/1583700904 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc340d19f0 con 0x7fdc340d0560 2023-11-28T18:37:26.312 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:26.307+0000 7fdc38db2640 1 --2- 172.21.15.45:0/1583700904 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc340d0560 0x7fdc340b1de0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fdc24009870 tx=0x7fdc2401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=876d2c88835b0f6a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:26.313 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:26.307+0000 7fdc2bfff640 1 -- 172.21.15.45:0/1583700904 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc240ac440 con 0x7fdc340d0560 2023-11-28T18:37:26.313 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:26.307+0000 7fdc2bfff640 1 -- 172.21.15.45:0/1583700904 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc240ac5a0 con 0x7fdc340d0560 2023-11-28T18:37:26.313 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:26.307+0000 7fdc2bfff640 1 -- 172.21.15.45:0/1583700904 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc240ac930 con 0x7fdc340d0560 2023-11-28T18:37:26.314 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:26.307+0000 7fdc3a5b5640 1 -- 172.21.15.45:0/1583700904 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc340d0560 msgr2=0x7fdc340b1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:26.314 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:26.307+0000 7fdc3a5b5640 1 --2- 172.21.15.45:0/1583700904 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc340d0560 0x7fdc340b1de0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fdc24009870 tx=0x7fdc2401c440 comp rx=0 tx=0).stop 2023-11-28T18:37:26.314 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:26.307+0000 7fdc3a5b5640 1 -- 172.21.15.45:0/1583700904 shutdown_connections 2023-11-28T18:37:26.314 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:26.307+0000 7fdc3a5b5640 1 --2- 172.21.15.45:0/1583700904 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdc3415ef30 0x7fdc340ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:26.314 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:26.307+0000 7fdc3a5b5640 1 --2- 172.21.15.45:0/1583700904 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc340d0560 0x7fdc340b1de0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:26.314 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:26.307+0000 7fdc3a5b5640 1 -- 172.21.15.45:0/1583700904 >> 172.21.15.45:0/1583700904 conn(0x7fdc340d2fb0 msgr2=0x7fdc340d33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:26.314 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:26.307+0000 7fdc3a5b5640 1 -- 172.21.15.45:0/1583700904 shutdown_connections 2023-11-28T18:37:26.314 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:26.307+0000 7fdc3a5b5640 1 -- 172.21.15.45:0/1583700904 wait complete. 2023-11-28T18:37:26.315 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:26.311+0000 7fdc3a5b5640 1 Processor -- start 2023-11-28T18:37:26.315 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:26.311+0000 7fdc3a5b5640 1 -- start start 2023-11-28T18:37:26.319 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:26.311+0000 7fdc3a5b5640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdc340cf9c0 0x7fdc34159540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:26.319 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:26.311+0000 7fdc3a5b5640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdc340d0560 0x7fdc34158040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:26.319 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:26.311+0000 7fdc3a5b5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc3415ef30 0x7fdc340ca290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:26.319 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:26.311+0000 7fdc3a5b5640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc340cbb60 con 0x7fdc3415ef30 2023-11-28T18:37:26.319 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:26.311+0000 7fdc3a5b5640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc340cb740 con 0x7fdc340d0560 2023-11-28T18:37:26.319 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:26.311+0000 7fdc3a5b5640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc340caac0 con 0x7fdc340cf9c0 2023-11-28T18:37:26.319 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:26.311+0000 7fdc39db4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc3415ef30 0x7fdc340ca290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:26.320 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:26.311+0000 7fdc39db4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc3415ef30 0x7fdc340ca290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59802/0 (socket says 172.21.15.45:59802) 2023-11-28T18:37:26.320 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:26.311+0000 7fdc38db2640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdc340d0560 0x7fdc34158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:26.320 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:26.311+0000 7fdc39db4640 1 -- 172.21.15.45:0/1107729718 learned_addr learned my addr 172.21.15.45:0/1107729718 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:26.320 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:26.311+0000 7fdc395b3640 1 --2- 172.21.15.45:0/1107729718 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdc340cf9c0 0x7fdc34159540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:26.320 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:26.311+0000 7fdc39db4640 1 -- 172.21.15.45:0/1107729718 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdc340cf9c0 msgr2=0x7fdc34159540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:26.320 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:26.311+0000 7fdc39db4640 1 --2- 172.21.15.45:0/1107729718 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdc340cf9c0 0x7fdc34159540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:26.320 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:26.311+0000 7fdc39db4640 1 -- 172.21.15.45:0/1107729718 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdc340d0560 msgr2=0x7fdc34158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:26.320 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:26.311+0000 7fdc39db4640 1 --2- 172.21.15.45:0/1107729718 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdc340d0560 0x7fdc34158040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:26.320 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:26.311+0000 7fdc39db4640 1 -- 172.21.15.45:0/1107729718 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc240094d0 con 0x7fdc3415ef30 2023-11-28T18:37:26.320 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:26.311+0000 7fdc39db4640 1 --2- 172.21.15.45:0/1107729718 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc3415ef30 0x7fdc340ca290 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c007e60 tx=0x7fdc2c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:26.320 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:26.311+0000 7fdc29ffb640 1 -- 172.21.15.45:0/1107729718 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc2c014420 con 0x7fdc3415ef30 2023-11-28T18:37:26.321 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:26.311+0000 7fdc29ffb640 1 -- 172.21.15.45:0/1107729718 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc2c0145a0 con 0x7fdc3415ef30 2023-11-28T18:37:26.321 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:26.311+0000 7fdc3a5b5640 1 -- 172.21.15.45:0/1107729718 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc340cada0 con 0x7fdc3415ef30 2023-11-28T18:37:26.321 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:26.311+0000 7fdc29ffb640 1 -- 172.21.15.45:0/1107729718 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc2c014950 con 0x7fdc3415ef30 2023-11-28T18:37:26.321 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:26.315+0000 7fdc3a5b5640 1 -- 172.21.15.45:0/1107729718 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc340cb360 con 0x7fdc3415ef30 2023-11-28T18:37:26.321 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:26.315+0000 7fdc3a5b5640 1 -- 172.21.15.45:0/1107729718 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc340d09d0 con 0x7fdc3415ef30 2023-11-28T18:37:26.322 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:26.315+0000 7fdc29ffb640 1 -- 172.21.15.45:0/1107729718 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fdc2c014ab0 con 0x7fdc3415ef30 2023-11-28T18:37:26.322 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:26.315+0000 7fdc29ffb640 1 --2- 172.21.15.45:0/1107729718 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fdc180668d0 0x7fdc18068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:26.322 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:26.315+0000 7fdc29ffb640 1 -- 172.21.15.45:0/1107729718 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fdc2c0847d0 con 0x7fdc3415ef30 2023-11-28T18:37:26.322 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:26.315+0000 7fdc395b3640 1 --2- 172.21.15.45:0/1107729718 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fdc180668d0 0x7fdc18068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:26.322 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:26.315+0000 7fdc395b3640 1 --2- 172.21.15.45:0/1107729718 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fdc180668d0 0x7fdc18068d90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdc300098e0 tx=0x7fdc30009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:26.325 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:26.319+0000 7fdc29ffb640 1 -- 172.21.15.45:0/1107729718 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdc2c051ea0 con 0x7fdc3415ef30 2023-11-28T18:37:26.485 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:26.479+0000 7fdc3a5b5640 1 -- 172.21.15.45:0/1107729718 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdc340cb880 con 0x7fdc3415ef30 2023-11-28T18:37:26.486 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:26.483+0000 7fdc29ffb640 1 -- 172.21.15.45:0/1107729718 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12814 (secure 0 0 0) 0x7fdc340cb880 con 0x7fdc3415ef30 2023-11-28T18:37:26.486 INFO:teuthology.misc.health.smithi045.stdout: 2023-11-28T18:37:26.487 INFO:teuthology.misc.health.smithi045.stdout:{"epoch":16,"fsid":"d10f5cd6-1d00-4019-99b6-6fa435498a15","created":"2023-11-28T18:37:08.189030+0000","modified":"2023-11-28T18:37:23.325817+0000","last_up_change":"2023-11-28T18:37:20.196124+0000","last_in_change":"2023-11-28T18:37:10.742043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T18:37:21.293917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"84465384-103c-4f2c-a45a-96f5bb9c835f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6809","nonce":555237322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6811","nonce":555237322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6815","nonce":555237322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6813","nonce":555237322}]},"public_addr":"172.21.15.45:6809/555237322","cluster_addr":"172.21.15.45:6811/555237322","heartbeat_back_addr":"172.21.15.45:6815/555237322","heartbeat_front_addr":"172.21.15.45:6813/555237322","state":["exists","up"]},{"osd":1,"uuid":"7d9eed24-a58f-42c7-a787-ac06be8553fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6801","nonce":2857063763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6803","nonce":2857063763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6807","nonce":2857063763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6805","nonce":2857063763}]},"public_addr":"172.21.15.45:6801/2857063763","cluster_addr":"172.21.15.45:6803/2857063763","heartbeat_back_addr":"172.21.15.45:6807/2857063763","heartbeat_front_addr":"172.21.15.45:6805/2857063763","state":["exists","up"]},{"osd":2,"uuid":"575eeccc-4abf-45b4-9caf-f3e797859588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6817","nonce":193884539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6819","nonce":193884539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6823","nonce":193884539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6821","nonce":193884539}]},"public_addr":"172.21.15.45:6817/193884539","cluster_addr":"172.21.15.45:6819/193884539","heartbeat_back_addr":"172.21.15.45:6823/193884539","heartbeat_front_addr":"172.21.15.45:6821/193884539","state":["exists","up"]},{"osd":3,"uuid":"9b0290d6-9a52-4bc8-b2a1-7622c5dc8e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6825","nonce":78541084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6827","nonce":78541084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6831","nonce":78541084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6829","nonce":78541084}]},"public_addr":"172.21.15.45:6825/78541084","cluster_addr":"172.21.15.45:6827/78541084","heartbeat_back_addr":"172.21.15.45:6831/78541084","heartbeat_front_addr":"172.21.15.45:6829/78541084","state":["exists","up"]},{"osd":4,"uuid":"ce632829-f027-4fbf-a627-02c571aa9d53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6809","nonce":1537591987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6811","nonce":1537591987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6815","nonce":1537591987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6813","nonce":1537591987}]},"public_addr":"172.21.15.190:6809/1537591987","cluster_addr":"172.21.15.190:6811/1537591987","heartbeat_back_addr":"172.21.15.190:6815/1537591987","heartbeat_front_addr":"172.21.15.190:6813/1537591987","state":["exists","up"]},{"osd":5,"uuid":"8700b609-27be-40bd-a251-4c0ae0a29ead","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6801","nonce":3296698407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6803","nonce":3296698407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6807","nonce":3296698407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6805","nonce":3296698407}]},"public_addr":"172.21.15.190:6801/3296698407","cluster_addr":"172.21.15.190:6803/3296698407","heartbeat_back_addr":"172.21.15.190:6807/3296698407","heartbeat_front_addr":"172.21.15.190:6805/3296698407","state":["exists","up"]},{"osd":6,"uuid":"44ce4a40-e6ff-4f4d-8e8a-7341e5c91f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6817","nonce":2317686718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6819","nonce":2317686718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6823","nonce":2317686718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6821","nonce":2317686718}]},"public_addr":"172.21.15.190:6817/2317686718","cluster_addr":"172.21.15.190:6819/2317686718","heartbeat_back_addr":"172.21.15.190:6823/2317686718","heartbeat_front_addr":"172.21.15.190:6821/2317686718","state":["exists","up"]},{"osd":7,"uuid":"192238c9-1423-4b7e-ac8f-84ba32113ddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6825","nonce":2493232051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6827","nonce":2493232051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6831","nonce":2493232051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6829","nonce":2493232051}]},"public_addr":"172.21.15.190:6825/2493232051","cluster_addr":"172.21.15.190:6827/2493232051","heartbeat_back_addr":"172.21.15.190:6831/2493232051","heartbeat_front_addr":"172.21.15.190:6829/2493232051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.393552+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.385453+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.361421+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.366408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.363226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.276007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.414605+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.445885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T18:37:26.488 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:26.483+0000 7fdc3a5b5640 1 -- 172.21.15.45:0/1107729718 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fdc180668d0 msgr2=0x7fdc18068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:26.489 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:26.483+0000 7fdc3a5b5640 1 --2- 172.21.15.45:0/1107729718 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fdc180668d0 0x7fdc18068d90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdc300098e0 tx=0x7fdc30009060 comp rx=0 tx=0).stop 2023-11-28T18:37:26.489 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:26.483+0000 7fdc3a5b5640 1 -- 172.21.15.45:0/1107729718 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc3415ef30 msgr2=0x7fdc340ca290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:26.489 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:26.483+0000 7fdc3a5b5640 1 --2- 172.21.15.45:0/1107729718 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc3415ef30 0x7fdc340ca290 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c007e60 tx=0x7fdc2c00e4b0 comp rx=0 tx=0).stop 2023-11-28T18:37:26.489 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:26.483+0000 7fdc3a5b5640 1 -- 172.21.15.45:0/1107729718 shutdown_connections 2023-11-28T18:37:26.489 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:26.483+0000 7fdc3a5b5640 1 --2- 172.21.15.45:0/1107729718 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fdc180668d0 0x7fdc18068d90 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:26.489 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:26.483+0000 7fdc3a5b5640 1 --2- 172.21.15.45:0/1107729718 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc3415ef30 0x7fdc340ca290 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:26.489 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:26.483+0000 7fdc3a5b5640 1 --2- 172.21.15.45:0/1107729718 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdc340d0560 0x7fdc34158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:26.489 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:26.483+0000 7fdc3a5b5640 1 --2- 172.21.15.45:0/1107729718 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdc340cf9c0 0x7fdc34159540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:26.489 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:26.483+0000 7fdc3a5b5640 1 -- 172.21.15.45:0/1107729718 >> 172.21.15.45:0/1107729718 conn(0x7fdc340d2fb0 msgr2=0x7fdc340b3da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:26.489 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:26.483+0000 7fdc3a5b5640 1 -- 172.21.15.45:0/1107729718 shutdown_connections 2023-11-28T18:37:26.490 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T18:37:26.483+0000 7fdc3a5b5640 1 -- 172.21.15.45:0/1107729718 wait complete. 2023-11-28T18:37:26.506 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-11-28T18:37:26.507 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-11-28T18:37:26.507 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-28T18:37:26.507 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-28T18:37:26.511 INFO:tasks.ceph.mds.a:Started 2023-11-28T18:37:26.511 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-28T18:37:26.511 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-28T18:37:26.516 INFO:tasks.ceph.mds.c:Started 2023-11-28T18:37:26.516 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-28T18:37:26.516 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-28T18:37:26.524 INFO:tasks.ceph.mds.b:Started 2023-11-28T18:37:26.524 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-28T18:37:26.524 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-28T18:37:26.528 INFO:tasks.ceph.mds.d:Started 2023-11-28T18:37:26.528 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-11-28T18:37:26.528 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T18:37:26.615 INFO:tasks.ceph.mds.c.smithi045.stdout:starting mds.c at 2023-11-28T18:37:26.616 INFO:tasks.ceph.mds.a.smithi045.stdout:starting mds.a at 2023-11-28T18:37:26.619 INFO:tasks.ceph.mds.b.smithi190.stdout:starting mds.b at 2023-11-28T18:37:26.620 INFO:tasks.ceph.mds.d.smithi190.stdout:starting mds.d at 2023-11-28T18:37:26.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.675+0000 7f93d5180640 1 Processor -- start 2023-11-28T18:37:26.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.675+0000 7f93d5180640 1 -- start start 2023-11-28T18:37:26.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.675+0000 7f93d5180640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f93d0144880 0x7f93d006c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:26.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.675+0000 7f93d5180640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f93d00721c0 0x7f93d006c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:26.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.675+0000 7f93d5180640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f93d00704a0 0x7f93d0070920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:26.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.675+0000 7f93d5180640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93d015f050 con 0x7f93d00721c0 2023-11-28T18:37:26.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.675+0000 7f93d5180640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93d0070e60 con 0x7f93d0144880 2023-11-28T18:37:26.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.675+0000 7f93d5180640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93d0071120 con 0x7f93d00704a0 2023-11-28T18:37:26.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.675+0000 7f93c7fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f93d00721c0 0x7f93d006c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:26.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.675+0000 7f93c7fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f93d00721c0 0x7f93d006c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59836/0 (socket says 172.21.15.45:59836) 2023-11-28T18:37:26.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.675+0000 7f93c7fff640 1 -- 172.21.15.45:0/400073642 learned_addr learned my addr 172.21.15.45:0/400073642 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:26.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.679+0000 7f93cf59e640 1 --2- 172.21.15.45:0/400073642 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f93d00704a0 0x7f93d0070920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:26.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.679+0000 7f93c7fff640 1 -- 172.21.15.45:0/400073642 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f93d00704a0 msgr2=0x7f93d0070920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:26.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.679+0000 7f93ced9d640 1 --2- 172.21.15.45:0/400073642 >> v2:172.21.15.190:3300/0 conn(0x7f93d0144880 0x7f93d006c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:26.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.679+0000 7f93c7fff640 1 --2- 172.21.15.45:0/400073642 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f93d00704a0 0x7f93d0070920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:26.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.679+0000 7f93c7fff640 1 -- 172.21.15.45:0/400073642 >> v2:172.21.15.190:3300/0 conn(0x7f93d0144880 msgr2=0x7f93d006c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:26.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.679+0000 7f93c7fff640 1 --2- 172.21.15.45:0/400073642 >> v2:172.21.15.190:3300/0 conn(0x7f93d0144880 0x7f93d006c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:26.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.679+0000 7f93c7fff640 1 -- 172.21.15.45:0/400073642 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d0071400 con 0x7f93d00721c0 2023-11-28T18:37:26.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.679+0000 7f93cf59e640 1 --2- 172.21.15.45:0/400073642 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f93d00704a0 0x7f93d0070920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:37:26.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.679+0000 7f93ced9d640 1 --2- 172.21.15.45:0/400073642 >> v2:172.21.15.190:3300/0 conn(0x7f93d0144880 0x7f93d006c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:37:26.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.679+0000 7f93c7fff640 1 --2- 172.21.15.45:0/400073642 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93d00721c0 0x7f93d006c840 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f93d0068060 tx=0x7f93b801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0bf039a5611dca6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:26.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.679+0000 7f93ce59c640 1 -- 172.21.15.45:0/400073642 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b80aa5f0 con 0x7f93d00721c0 2023-11-28T18:37:26.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.679+0000 7f93ce59c640 1 -- 172.21.15.45:0/400073642 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93b80aa750 con 0x7f93d00721c0 2023-11-28T18:37:26.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.679+0000 7f93ce59c640 1 -- 172.21.15.45:0/400073642 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b80aaae0 con 0x7f93d00721c0 2023-11-28T18:37:26.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.679+0000 7f93d5180640 1 -- 172.21.15.45:0/400073642 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93d00721c0 msgr2=0x7f93d006c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:26.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.679+0000 7f93d5180640 1 --2- 172.21.15.45:0/400073642 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93d00721c0 0x7f93d006c840 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f93d0068060 tx=0x7f93b801c4d0 comp rx=0 tx=0).stop 2023-11-28T18:37:26.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.679+0000 7f93d5180640 1 -- 172.21.15.45:0/400073642 shutdown_connections 2023-11-28T18:37:26.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.679+0000 7f93d5180640 1 --2- 172.21.15.45:0/400073642 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f93d00704a0 0x7f93d0070920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:26.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.679+0000 7f93d5180640 1 --2- 172.21.15.45:0/400073642 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93d00721c0 0x7f93d006c840 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:26.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.679+0000 7f93d5180640 1 --2- 172.21.15.45:0/400073642 >> v2:172.21.15.190:3300/0 conn(0x7f93d0144880 0x7f93d006c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:26.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.679+0000 7f93d5180640 1 -- 172.21.15.45:0/400073642 >> 172.21.15.45:0/400073642 conn(0x7f93d006a570 msgr2=0x7f93d006a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:26.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.683+0000 7f93d5180640 1 -- 172.21.15.45:0/400073642 shutdown_connections 2023-11-28T18:37:26.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.683+0000 7f93d5180640 1 -- 172.21.15.45:0/400073642 wait complete. 2023-11-28T18:37:26.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.683+0000 7f93d5180640 1 Processor -- start 2023-11-28T18:37:26.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.683+0000 7f93d5180640 1 -- start start 2023-11-28T18:37:26.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.683+0000 7f93d5180640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93d00704a0 0x7f93d013c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:26.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.683+0000 7f93d5180640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f93d00721c0 0x7f93d013a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:26.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.683+0000 7f93d5180640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f93d0144880 0x7f93d0143670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:26.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.683+0000 7f93d5180640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d01f8d10 con 0x7f93d00704a0 2023-11-28T18:37:26.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.683+0000 7f93d5180640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d01f8fd0 con 0x7f93d00721c0 2023-11-28T18:37:26.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.683+0000 7f93d5180640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93d01f92b0 con 0x7f93d0144880 2023-11-28T18:37:26.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.683+0000 7f93ced9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93d00704a0 0x7f93d013c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:26.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.683+0000 7f93ced9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93d00704a0 0x7f93d013c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59840/0 (socket says 172.21.15.45:59840) 2023-11-28T18:37:26.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.683+0000 7f93ced9d640 1 -- 172.21.15.45:0/831341967 learned_addr learned my addr 172.21.15.45:0/831341967 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:26.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.683+0000 7f93c7fff640 1 --2- 172.21.15.45:0/831341967 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f93d00721c0 0x7f93d013a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:26.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.683+0000 7f93cf59e640 1 --2- 172.21.15.45:0/831341967 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f93d0144880 0x7f93d0143670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:26.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.683+0000 7f93ced9d640 1 -- 172.21.15.45:0/831341967 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f93d0144880 msgr2=0x7f93d0143670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:26.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.683+0000 7f93ced9d640 1 --2- 172.21.15.45:0/831341967 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f93d0144880 0x7f93d0143670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:26.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.683+0000 7f93ced9d640 1 -- 172.21.15.45:0/831341967 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f93d00721c0 msgr2=0x7f93d013a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:26.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.683+0000 7f93ced9d640 1 --2- 172.21.15.45:0/831341967 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f93d00721c0 0x7f93d013a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:26.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.683+0000 7f93ced9d640 1 -- 172.21.15.45:0/831341967 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93b80094d0 con 0x7f93d00704a0 2023-11-28T18:37:26.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.683+0000 7f93c7fff640 1 --2- 172.21.15.45:0/831341967 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f93d00721c0 0x7f93d013a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:37:26.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.683+0000 7f93ced9d640 1 --2- 172.21.15.45:0/831341967 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93d00704a0 0x7f93d013c140 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f93c000c7f0 tx=0x7f93c000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:26.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.687+0000 7f93c77fe640 1 -- 172.21.15.45:0/831341967 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c0007820 con 0x7f93d00704a0 2023-11-28T18:37:26.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.687+0000 7f93c77fe640 1 -- 172.21.15.45:0/831341967 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93c0007980 con 0x7f93d00704a0 2023-11-28T18:37:26.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.687+0000 7f93c77fe640 1 -- 172.21.15.45:0/831341967 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c0007d30 con 0x7f93d00704a0 2023-11-28T18:37:26.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.687+0000 7f93d5180640 1 -- 172.21.15.45:0/831341967 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93d01f9590 con 0x7f93d00704a0 2023-11-28T18:37:26.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.687+0000 7f93d5180640 1 -- 172.21.15.45:0/831341967 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93d00af5c0 con 0x7f93d00704a0 2023-11-28T18:37:26.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.687+0000 7f93d5180640 1 -- 172.21.15.45:0/831341967 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93d0164050 con 0x7f93d00704a0 2023-11-28T18:37:26.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.687+0000 7f93c77fe640 1 -- 172.21.15.45:0/831341967 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f93c00113f0 con 0x7f93d00704a0 2023-11-28T18:37:26.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.687+0000 7f93c77fe640 1 --2- 172.21.15.45:0/831341967 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f93b00668d0 0x7f93b0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:26.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.687+0000 7f93c77fe640 1 -- 172.21.15.45:0/831341967 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f93c0084430 con 0x7f93d00704a0 2023-11-28T18:37:26.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.687+0000 7f93c7fff640 1 --2- 172.21.15.45:0/831341967 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f93b00668d0 0x7f93b0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:26.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.691+0000 7f93c7fff640 1 --2- 172.21.15.45:0/831341967 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f93b00668d0 0x7f93b0068d90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f93b80ae000 tx=0x7f93b80a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:26.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.691+0000 7f93c77fe640 1 -- 172.21.15.45:0/831341967 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f93d0164050 con 0x7f93d00704a0 2023-11-28T18:37:26.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.851+0000 7f93d5180640 1 -- 172.21.15.45:0/831341967 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f93d0069480 con 0x7f93d00704a0 2023-11-28T18:37:26.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.851+0000 7f93c77fe640 1 -- 172.21.15.45:0/831341967 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12814 (secure 0 0 0) 0x7f93c0051920 con 0x7f93d00704a0 2023-11-28T18:37:26.858 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:37:26.858 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":16,"fsid":"d10f5cd6-1d00-4019-99b6-6fa435498a15","created":"2023-11-28T18:37:08.189030+0000","modified":"2023-11-28T18:37:23.325817+0000","last_up_change":"2023-11-28T18:37:20.196124+0000","last_in_change":"2023-11-28T18:37:10.742043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T18:37:21.293917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"84465384-103c-4f2c-a45a-96f5bb9c835f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6809","nonce":555237322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6811","nonce":555237322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6815","nonce":555237322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6813","nonce":555237322}]},"public_addr":"172.21.15.45:6809/555237322","cluster_addr":"172.21.15.45:6811/555237322","heartbeat_back_addr":"172.21.15.45:6815/555237322","heartbeat_front_addr":"172.21.15.45:6813/555237322","state":["exists","up"]},{"osd":1,"uuid":"7d9eed24-a58f-42c7-a787-ac06be8553fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6801","nonce":2857063763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6803","nonce":2857063763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6807","nonce":2857063763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6805","nonce":2857063763}]},"public_addr":"172.21.15.45:6801/2857063763","cluster_addr":"172.21.15.45:6803/2857063763","heartbeat_back_addr":"172.21.15.45:6807/2857063763","heartbeat_front_addr":"172.21.15.45:6805/2857063763","state":["exists","up"]},{"osd":2,"uuid":"575eeccc-4abf-45b4-9caf-f3e797859588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6817","nonce":193884539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6819","nonce":193884539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6823","nonce":193884539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6821","nonce":193884539}]},"public_addr":"172.21.15.45:6817/193884539","cluster_addr":"172.21.15.45:6819/193884539","heartbeat_back_addr":"172.21.15.45:6823/193884539","heartbeat_front_addr":"172.21.15.45:6821/193884539","state":["exists","up"]},{"osd":3,"uuid":"9b0290d6-9a52-4bc8-b2a1-7622c5dc8e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6825","nonce":78541084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6827","nonce":78541084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6831","nonce":78541084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6829","nonce":78541084}]},"public_addr":"172.21.15.45:6825/78541084","cluster_addr":"172.21.15.45:6827/78541084","heartbeat_back_addr":"172.21.15.45:6831/78541084","heartbeat_front_addr":"172.21.15.45:6829/78541084","state":["exists","up"]},{"osd":4,"uuid":"ce632829-f027-4fbf-a627-02c571aa9d53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6809","nonce":1537591987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6811","nonce":1537591987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6815","nonce":1537591987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6813","nonce":1537591987}]},"public_addr":"172.21.15.190:6809/1537591987","cluster_addr":"172.21.15.190:6811/1537591987","heartbeat_back_addr":"172.21.15.190:6815/1537591987","heartbeat_front_addr":"172.21.15.190:6813/1537591987","state":["exists","up"]},{"osd":5,"uuid":"8700b609-27be-40bd-a251-4c0ae0a29ead","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6801","nonce":3296698407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6803","nonce":3296698407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6807","nonce":3296698407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6805","nonce":3296698407}]},"public_addr":"172.21.15.190:6801/3296698407","cluster_addr":"172.21.15.190:6803/3296698407","heartbeat_back_addr":"172.21.15.190:6807/3296698407","heartbeat_front_addr":"172.21.15.190:6805/3296698407","state":["exists","up"]},{"osd":6,"uuid":"44ce4a40-e6ff-4f4d-8e8a-7341e5c91f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6817","nonce":2317686718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6819","nonce":2317686718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6823","nonce":2317686718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6821","nonce":2317686718}]},"public_addr":"172.21.15.190:6817/2317686718","cluster_addr":"172.21.15.190:6819/2317686718","heartbeat_back_addr":"172.21.15.190:6823/2317686718","heartbeat_front_addr":"172.21.15.190:6821/2317686718","state":["exists","up"]},{"osd":7,"uuid":"192238c9-1423-4b7e-ac8f-84ba32113ddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6825","nonce":2493232051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6827","nonce":2493232051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6831","nonce":2493232051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6829","nonce":2493232051}]},"public_addr":"172.21.15.190:6825/2493232051","cluster_addr":"172.21.15.190:6827/2493232051","heartbeat_back_addr":"172.21.15.190:6831/2493232051","heartbeat_front_addr":"172.21.15.190:6829/2493232051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.393552+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.385453+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.361421+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.366408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.363226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.276007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.414605+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.445885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T18:37:26.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.855+0000 7f93d5180640 1 -- 172.21.15.45:0/831341967 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f93b00668d0 msgr2=0x7f93b0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:26.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.855+0000 7f93d5180640 1 --2- 172.21.15.45:0/831341967 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f93b00668d0 0x7f93b0068d90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f93b80ae000 tx=0x7f93b80a7000 comp rx=0 tx=0).stop 2023-11-28T18:37:26.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.855+0000 7f93d5180640 1 -- 172.21.15.45:0/831341967 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93d00704a0 msgr2=0x7f93d013c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:26.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.855+0000 7f93d5180640 1 --2- 172.21.15.45:0/831341967 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93d00704a0 0x7f93d013c140 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f93c000c7f0 tx=0x7f93c000ccb0 comp rx=0 tx=0).stop 2023-11-28T18:37:26.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.855+0000 7f93d5180640 1 -- 172.21.15.45:0/831341967 shutdown_connections 2023-11-28T18:37:26.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.855+0000 7f93d5180640 1 --2- 172.21.15.45:0/831341967 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f93b00668d0 0x7f93b0068d90 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:26.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.855+0000 7f93d5180640 1 --2- 172.21.15.45:0/831341967 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f93d0144880 0x7f93d0143670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:26.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.855+0000 7f93d5180640 1 --2- 172.21.15.45:0/831341967 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f93d00721c0 0x7f93d013a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:26.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.855+0000 7f93d5180640 1 --2- 172.21.15.45:0/831341967 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93d00704a0 0x7f93d013c140 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:26.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.855+0000 7f93d5180640 1 -- 172.21.15.45:0/831341967 >> 172.21.15.45:0/831341967 conn(0x7f93d006a570 msgr2=0x7f93d013e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:26.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.855+0000 7f93d5180640 1 -- 172.21.15.45:0/831341967 shutdown_connections 2023-11-28T18:37:26.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:26.855+0000 7f93d5180640 1 -- 172.21.15.45:0/831341967 wait complete. 2023-11-28T18:37:26.879 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T18:37:21.293917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T18:37:26.879 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T18:37:27.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.019+0000 7f542d52a640 1 Processor -- start 2023-11-28T18:37:27.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.019+0000 7f542d52a640 1 -- start start 2023-11-28T18:37:27.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.023+0000 7f542d52a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f542815d2e0 0x7f54280b8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:27.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.023+0000 7f542d52a640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f54280b5280 0x7f54280b5710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:27.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.023+0000 7f542d52a640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54280b7630 con 0x7f54280b6200 2023-11-28T18:37:27.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.023+0000 7f542d52a640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54280b5c50 con 0x7f54280b5280 2023-11-28T18:37:27.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.023+0000 7f542d52a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54280b91e0 con 0x7f542815d2e0 2023-11-28T18:37:27.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.023+0000 7f54277fe640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f54280b5280 0x7f54280b5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:27.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.023+0000 7f5426ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f542815d2e0 0x7f54280b8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:27.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.023+0000 7f54277fe640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f54280b5280 0x7f54280b5710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.45:39692/0 (socket says 172.21.15.45:39692) 2023-11-28T18:37:27.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.023+0000 7f54277fe640 1 -- 172.21.15.45:0/393932089 learned_addr learned my addr 172.21.15.45:0/393932089 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:27.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.023+0000 7f5426ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f542815d2e0 0x7f54280b8ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.45:54860/0 (socket says 172.21.15.45:54860) 2023-11-28T18:37:27.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.023+0000 7f54277fe640 1 -- 172.21.15.45:0/393932089 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f542815d2e0 msgr2=0x7f54280b8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:27.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.023+0000 7f54277fe640 1 --2- 172.21.15.45:0/393932089 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f542815d2e0 0x7f54280b8ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:27.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.023+0000 7f54277fe640 1 -- 172.21.15.45:0/393932089 >> v1:172.21.15.190:6789/0 conn(0x7f54280b6200 legacy=0x7f54280d1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:27.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.023+0000 7f54277fe640 1 -- 172.21.15.45:0/393932089 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54280b6a20 con 0x7f54280b5280 2023-11-28T18:37:27.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.023+0000 7f54267fc640 1 -- 172.21.15.45:0/393932089 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2187204963 0 0) 0x7f54280b7630 con 0x7f54280b6200 2023-11-28T18:37:27.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.027+0000 7f54277fe640 1 --2- 172.21.15.45:0/393932089 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f54280b5280 0x7f54280b5710 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5420009e50 tx=0x7f542001f1f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f271b3f6441bd3d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:27.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.027+0000 7f54267fc640 1 -- 172.21.15.45:0/393932089 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54200af400 con 0x7f54280b5280 2023-11-28T18:37:27.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.027+0000 7f54267fc640 1 -- 172.21.15.45:0/393932089 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54200ab050 con 0x7f54280b5280 2023-11-28T18:37:27.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.027+0000 7f54267fc640 1 -- 172.21.15.45:0/393932089 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54200af780 con 0x7f54280b5280 2023-11-28T18:37:27.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.027+0000 7f542d52a640 1 -- 172.21.15.45:0/393932089 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f54280b5280 msgr2=0x7f54280b5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:27.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.027+0000 7f542d52a640 1 --2- 172.21.15.45:0/393932089 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f54280b5280 0x7f54280b5710 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5420009e50 tx=0x7f542001f1f0 comp rx=0 tx=0).stop 2023-11-28T18:37:27.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.027+0000 7f542d52a640 1 -- 172.21.15.45:0/393932089 shutdown_connections 2023-11-28T18:37:27.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.027+0000 7f542d52a640 1 --2- 172.21.15.45:0/393932089 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f54280b5280 0x7f54280b5710 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:27.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.027+0000 7f542d52a640 1 --2- 172.21.15.45:0/393932089 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f542815d2e0 0x7f54280b8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:27.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.027+0000 7f542d52a640 1 -- 172.21.15.45:0/393932089 >> 172.21.15.45:0/393932089 conn(0x7f54280720a0 msgr2=0x7f54280724b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:27.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.027+0000 7f542d52a640 1 -- 172.21.15.45:0/393932089 shutdown_connections 2023-11-28T18:37:27.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.027+0000 7f542d52a640 1 -- 172.21.15.45:0/393932089 wait complete. 2023-11-28T18:37:27.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.031+0000 7f542d52a640 1 Processor -- start 2023-11-28T18:37:27.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.031+0000 7f542d52a640 1 -- start start 2023-11-28T18:37:27.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.031+0000 7f542d52a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f54280b5280 0x7f54281f5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:27.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.031+0000 7f542d52a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f54280b6200 0x7f5428153900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:27.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.031+0000 7f542d52a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f542815d2e0 0x7f54281555b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:27.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.031+0000 7f542d52a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f542815e6b0 con 0x7f542815d2e0 2023-11-28T18:37:27.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.031+0000 7f542d52a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54280c8c90 con 0x7f54280b6200 2023-11-28T18:37:27.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.031+0000 7f542d52a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54280c8f70 con 0x7f54280b5280 2023-11-28T18:37:27.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.031+0000 7f54277fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f542815d2e0 0x7f54281555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:27.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.031+0000 7f54277fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f542815d2e0 0x7f54281555b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59842/0 (socket says 172.21.15.45:59842) 2023-11-28T18:37:27.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.031+0000 7f54277fe640 1 -- 172.21.15.45:0/540666679 learned_addr learned my addr 172.21.15.45:0/540666679 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:27.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.031+0000 7f541ffff640 1 --2- 172.21.15.45:0/540666679 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f54280b6200 0x7f5428153900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:27.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.031+0000 7f5426ffd640 1 --2- 172.21.15.45:0/540666679 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f54280b5280 0x7f54281f5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:27.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.031+0000 7f541ffff640 1 -- 172.21.15.45:0/540666679 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f54280b5280 msgr2=0x7f54281f5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:27.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.031+0000 7f541ffff640 1 --2- 172.21.15.45:0/540666679 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f54280b5280 0x7f54281f5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:27.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.031+0000 7f541ffff640 1 -- 172.21.15.45:0/540666679 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f542815d2e0 msgr2=0x7f54281555b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:27.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.031+0000 7f541ffff640 1 --2- 172.21.15.45:0/540666679 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f542815d2e0 0x7f54281555b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:27.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.031+0000 7f541ffff640 1 -- 172.21.15.45:0/540666679 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5420009b30 con 0x7f54280b6200 2023-11-28T18:37:27.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.031+0000 7f541ffff640 1 --2- 172.21.15.45:0/540666679 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f54280b6200 0x7f5428153900 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f54100011f0 tx=0x7f541000c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:27.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.031+0000 7f541f7fe640 1 -- 172.21.15.45:0/540666679 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54100054e0 con 0x7f54280b6200 2023-11-28T18:37:27.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.031+0000 7f541f7fe640 1 -- 172.21.15.45:0/540666679 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5410003600 con 0x7f54280b6200 2023-11-28T18:37:27.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.031+0000 7f541f7fe640 1 -- 172.21.15.45:0/540666679 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5410003a30 con 0x7f54280b6200 2023-11-28T18:37:27.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.031+0000 7f542d52a640 1 -- 172.21.15.45:0/540666679 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54280c9250 con 0x7f54280b6200 2023-11-28T18:37:27.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.031+0000 7f542d52a640 1 -- 172.21.15.45:0/540666679 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5428153e40 con 0x7f54280b6200 2023-11-28T18:37:27.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.035+0000 7f542d52a640 1 -- 172.21.15.45:0/540666679 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54281540c0 con 0x7f54280b6200 2023-11-28T18:37:27.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.035+0000 7f541f7fe640 1 -- 172.21.15.45:0/540666679 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f5410003b90 con 0x7f54280b6200 2023-11-28T18:37:27.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.035+0000 7f541f7fe640 1 --2- 172.21.15.45:0/540666679 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f54080668d0 0x7f5408068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:27.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.035+0000 7f541f7fe640 1 -- 172.21.15.45:0/540666679 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f54100835f0 con 0x7f54280b6200 2023-11-28T18:37:27.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.035+0000 7f5426ffd640 1 --2- 172.21.15.45:0/540666679 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f54080668d0 0x7f5408068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:27.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.035+0000 7f5426ffd640 1 --2- 172.21.15.45:0/540666679 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f54080668d0 0x7f5408068d90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f542815e660 tx=0x7f5418009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:27.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.039+0000 7f541f7fe640 1 -- 172.21.15.45:0/540666679 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5410050c20 con 0x7f54280b6200 2023-11-28T18:37:27.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.199+0000 7f542d52a640 1 -- 172.21.15.45:0/540666679 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5428069410 con 0x7f54280b6200 2023-11-28T18:37:27.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.199+0000 7f541f7fe640 1 -- 172.21.15.45:0/540666679 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f54100170a0 con 0x7f54280b6200 2023-11-28T18:37:27.203 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-11-28T18:37:27.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.199+0000 7f542d52a640 1 -- 172.21.15.45:0/540666679 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f54080668d0 msgr2=0x7f5408068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:27.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.199+0000 7f542d52a640 1 --2- 172.21.15.45:0/540666679 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f54080668d0 0x7f5408068d90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f542815e660 tx=0x7f5418009190 comp rx=0 tx=0).stop 2023-11-28T18:37:27.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.199+0000 7f542d52a640 1 -- 172.21.15.45:0/540666679 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f54280b6200 msgr2=0x7f5428153900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:27.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.199+0000 7f542d52a640 1 --2- 172.21.15.45:0/540666679 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f54280b6200 0x7f5428153900 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f54100011f0 tx=0x7f541000c8c0 comp rx=0 tx=0).stop 2023-11-28T18:37:27.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.199+0000 7f542d52a640 1 -- 172.21.15.45:0/540666679 shutdown_connections 2023-11-28T18:37:27.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.199+0000 7f542d52a640 1 --2- 172.21.15.45:0/540666679 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f54080668d0 0x7f5408068d90 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:27.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.199+0000 7f542d52a640 1 --2- 172.21.15.45:0/540666679 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f542815d2e0 0x7f54281555b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:27.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.199+0000 7f542d52a640 1 --2- 172.21.15.45:0/540666679 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f54280b6200 0x7f5428153900 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:27.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.199+0000 7f542d52a640 1 --2- 172.21.15.45:0/540666679 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f54280b5280 0x7f54281f5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:27.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.199+0000 7f542d52a640 1 -- 172.21.15.45:0/540666679 >> 172.21.15.45:0/540666679 conn(0x7f54280720a0 msgr2=0x7f54280b7ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:27.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.199+0000 7f542d52a640 1 -- 172.21.15.45:0/540666679 shutdown_connections 2023-11-28T18:37:27.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.199+0000 7f542d52a640 1 -- 172.21.15.45:0/540666679 wait complete. 2023-11-28T18:37:27.224 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T18:37:27.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.363+0000 7f4822879640 1 Processor -- start 2023-11-28T18:37:27.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.363+0000 7f4822879640 1 -- start start 2023-11-28T18:37:27.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.363+0000 7f4822879640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f481c15d1a0 0x7f481c0aeed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:27.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.363+0000 7f4822879640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f481c06cdc0 0x7f481c0ad5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:27.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.363+0000 7f4822879640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f481c0ade30 con 0x7f481c06b580 2023-11-28T18:37:27.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.363+0000 7f4822879640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f481c06e050 con 0x7f481c06cdc0 2023-11-28T18:37:27.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.363+0000 7f4822879640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f481c0aeab0 con 0x7f481c15d1a0 2023-11-28T18:37:27.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.367+0000 7f481bfff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f481c15d1a0 0x7f481c0aeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:27.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.367+0000 7f481bfff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f481c15d1a0 0x7f481c0aeed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.45:54884/0 (socket says 172.21.15.45:54884) 2023-11-28T18:37:27.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.367+0000 7f481bfff640 1 -- 172.21.15.45:0/341961218 learned_addr learned my addr 172.21.15.45:0/341961218 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:27.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.367+0000 7f481b7fe640 1 --2- 172.21.15.45:0/341961218 >> v2:172.21.15.190:3300/0 conn(0x7f481c06cdc0 0x7f481c0ad5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:27.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.367+0000 7f481bfff640 1 -- 172.21.15.45:0/341961218 >> v2:172.21.15.190:3300/0 conn(0x7f481c06cdc0 msgr2=0x7f481c0ad5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:27.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.367+0000 7f481bfff640 1 --2- 172.21.15.45:0/341961218 >> v2:172.21.15.190:3300/0 conn(0x7f481c06cdc0 0x7f481c0ad5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:27.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.367+0000 7f481bfff640 1 -- 172.21.15.45:0/341961218 >> v1:172.21.15.190:6789/0 conn(0x7f481c06b580 legacy=0x7f481c0b2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:27.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.367+0000 7f481bfff640 1 -- 172.21.15.45:0/341961218 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f481c0ae110 con 0x7f481c15d1a0 2023-11-28T18:37:27.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.367+0000 7f481bfff640 1 --2- 172.21.15.45:0/341961218 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f481c15d1a0 0x7f481c0aeed0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f480c009870 tx=0x7f480c01c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ece12a9a31e6e3a1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:27.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.367+0000 7f481affd640 1 -- 172.21.15.45:0/341961218 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f480c0ac600 con 0x7f481c15d1a0 2023-11-28T18:37:27.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.367+0000 7f481affd640 1 -- 172.21.15.45:0/341961218 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f480c0a8050 con 0x7f481c15d1a0 2023-11-28T18:37:27.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.367+0000 7f481affd640 1 -- 172.21.15.45:0/341961218 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f480c0ac980 con 0x7f481c15d1a0 2023-11-28T18:37:27.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.371+0000 7f4822879640 1 -- 172.21.15.45:0/341961218 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f481c15d1a0 msgr2=0x7f481c0aeed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:27.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.371+0000 7f4822879640 1 --2- 172.21.15.45:0/341961218 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f481c15d1a0 0x7f481c0aeed0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f480c009870 tx=0x7f480c01c4b0 comp rx=0 tx=0).stop 2023-11-28T18:37:27.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.371+0000 7f4822879640 1 -- 172.21.15.45:0/341961218 shutdown_connections 2023-11-28T18:37:27.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.371+0000 7f4822879640 1 --2- 172.21.15.45:0/341961218 >> v2:172.21.15.190:3300/0 conn(0x7f481c06cdc0 0x7f481c0ad5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:27.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.371+0000 7f4822879640 1 --2- 172.21.15.45:0/341961218 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f481c15d1a0 0x7f481c0aeed0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:27.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.371+0000 7f4822879640 1 -- 172.21.15.45:0/341961218 >> 172.21.15.45:0/341961218 conn(0x7f481c0b1b30 msgr2=0x7f481c070d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:27.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.371+0000 7f4822879640 1 -- 172.21.15.45:0/341961218 shutdown_connections 2023-11-28T18:37:27.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.371+0000 7f4822879640 1 -- 172.21.15.45:0/341961218 wait complete. 2023-11-28T18:37:27.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.371+0000 7f4822879640 1 Processor -- start 2023-11-28T18:37:27.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.371+0000 7f4822879640 1 -- start start 2023-11-28T18:37:27.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.371+0000 7f4822879640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f481c06b580 0x7f481c150710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:27.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.371+0000 7f4822879640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f481c06cdc0 0x7f481c152010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:27.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.371+0000 7f4822879640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f481c15d1a0 0x7f481c152550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:27.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.371+0000 7f4822879640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f481c157330 con 0x7f481c06cdc0 2023-11-28T18:37:27.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.371+0000 7f4822879640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f481c150c50 con 0x7f481c06b580 2023-11-28T18:37:27.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.371+0000 7f4822879640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f481c152e90 con 0x7f481c15d1a0 2023-11-28T18:37:27.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.371+0000 7f481b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f481c06cdc0 0x7f481c152010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:27.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.371+0000 7f481b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f481c06cdc0 0x7f481c152010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59846/0 (socket says 172.21.15.45:59846) 2023-11-28T18:37:27.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.371+0000 7f481b7fe640 1 -- 172.21.15.45:0/3756040762 learned_addr learned my addr 172.21.15.45:0/3756040762 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:27.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.375+0000 7f481bfff640 1 --2- 172.21.15.45:0/3756040762 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f481c06b580 0x7f481c150710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:27.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.375+0000 7f4820e16640 1 --2- 172.21.15.45:0/3756040762 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f481c15d1a0 0x7f481c152550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:27.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.375+0000 7f481b7fe640 1 -- 172.21.15.45:0/3756040762 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f481c15d1a0 msgr2=0x7f481c152550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:27.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.375+0000 7f481b7fe640 1 --2- 172.21.15.45:0/3756040762 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f481c15d1a0 0x7f481c152550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:27.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.375+0000 7f481b7fe640 1 -- 172.21.15.45:0/3756040762 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f481c06b580 msgr2=0x7f481c150710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:27.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.375+0000 7f481b7fe640 1 --2- 172.21.15.45:0/3756040762 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f481c06b580 0x7f481c150710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:27.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.375+0000 7f481b7fe640 1 -- 172.21.15.45:0/3756040762 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f480c0094d0 con 0x7f481c06cdc0 2023-11-28T18:37:27.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.375+0000 7f481b7fe640 1 --2- 172.21.15.45:0/3756040762 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f481c06cdc0 0x7f481c152010 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f481000e930 tx=0x7f481000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:27.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.375+0000 7f4818ff9640 1 -- 172.21.15.45:0/3756040762 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4810009690 con 0x7f481c06cdc0 2023-11-28T18:37:27.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.375+0000 7f4818ff9640 1 -- 172.21.15.45:0/3756040762 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f481000ca00 con 0x7f481c06cdc0 2023-11-28T18:37:27.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.375+0000 7f4818ff9640 1 -- 172.21.15.45:0/3756040762 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f481000cd70 con 0x7f481c06cdc0 2023-11-28T18:37:27.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.375+0000 7f4822879640 1 -- 172.21.15.45:0/3756040762 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f481c06bf20 con 0x7f481c06cdc0 2023-11-28T18:37:27.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.375+0000 7f4822879640 1 -- 172.21.15.45:0/3756040762 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f481c156c70 con 0x7f481c06cdc0 2023-11-28T18:37:27.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.375+0000 7f4822879640 1 -- 172.21.15.45:0/3756040762 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f481c069480 con 0x7f481c06cdc0 2023-11-28T18:37:27.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.375+0000 7f4818ff9640 1 -- 172.21.15.45:0/3756040762 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f4810013470 con 0x7f481c06cdc0 2023-11-28T18:37:27.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.375+0000 7f4818ff9640 1 --2- 172.21.15.45:0/3756040762 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f48080668d0 0x7f4808068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:27.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.375+0000 7f4818ff9640 1 -- 172.21.15.45:0/3756040762 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f48100843c0 con 0x7f481c06cdc0 2023-11-28T18:37:27.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.379+0000 7f481bfff640 1 --2- 172.21.15.45:0/3756040762 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f48080668d0 0x7f4808068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:27.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.379+0000 7f481bfff640 1 --2- 172.21.15.45:0/3756040762 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f48080668d0 0x7f4808068d90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f480c0ae000 tx=0x7f480c0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:27.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.379+0000 7f4818ff9640 1 -- 172.21.15.45:0/3756040762 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4810051970 con 0x7f481c06cdc0 2023-11-28T18:37:27.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.571+0000 7f4822879640 1 -- 172.21.15.45:0/3756040762 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f481c0ac660 con 0x7f481c06cdc0 2023-11-28T18:37:27.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.571+0000 7f4818ff9640 1 -- 172.21.15.45:0/3756040762 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1324 (secure 0 0 0) 0x7f4810054f90 con 0x7f481c06cdc0 2023-11-28T18:37:27.576 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:37:27.576 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/1657221272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1657221272},{"type":"v1","addr":"172.21.15.45:6834","nonce":1657221272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-11-28T18:37:27.576 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 2 2023-11-28T18:37:27.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.571+0000 7f4822879640 1 -- 172.21.15.45:0/3756040762 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f48080668d0 msgr2=0x7f4808068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:27.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.571+0000 7f4822879640 1 --2- 172.21.15.45:0/3756040762 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f48080668d0 0x7f4808068d90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f480c0ae000 tx=0x7f480c0a7000 comp rx=0 tx=0).stop 2023-11-28T18:37:27.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.571+0000 7f4822879640 1 -- 172.21.15.45:0/3756040762 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f481c06cdc0 msgr2=0x7f481c152010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:27.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.571+0000 7f4822879640 1 --2- 172.21.15.45:0/3756040762 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f481c06cdc0 0x7f481c152010 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f481000e930 tx=0x7f481000edf0 comp rx=0 tx=0).stop 2023-11-28T18:37:27.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.571+0000 7f4822879640 1 -- 172.21.15.45:0/3756040762 shutdown_connections 2023-11-28T18:37:27.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.571+0000 7f4822879640 1 --2- 172.21.15.45:0/3756040762 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f48080668d0 0x7f4808068d90 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:27.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.571+0000 7f4822879640 1 --2- 172.21.15.45:0/3756040762 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f481c15d1a0 0x7f481c152550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:27.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.571+0000 7f4822879640 1 --2- 172.21.15.45:0/3756040762 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f481c06cdc0 0x7f481c152010 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:27.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.571+0000 7f4822879640 1 --2- 172.21.15.45:0/3756040762 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f481c06b580 0x7f481c150710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:27.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.571+0000 7f4822879640 1 -- 172.21.15.45:0/3756040762 >> 172.21.15.45:0/3756040762 conn(0x7f481c0b1b30 msgr2=0x7f481c159700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:27.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.571+0000 7f4822879640 1 -- 172.21.15.45:0/3756040762 shutdown_connections 2023-11-28T18:37:27.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:27.571+0000 7f4822879640 1 -- 172.21.15.45:0/3756040762 wait complete. 2023-11-28T18:37:29.598 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T18:37:29.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.747+0000 7fe6eb09a640 1 Processor -- start 2023-11-28T18:37:29.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.747+0000 7fe6eb09a640 1 -- start start 2023-11-28T18:37:29.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.747+0000 7fe6eb09a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6e41401c0 0x7fe6e4071f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:29.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.747+0000 7fe6eb09a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe6e406c300 0x7fe6e406c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:29.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.747+0000 7fe6eb09a640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6e4140900 con 0x7fe6e40704a0 2023-11-28T18:37:29.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.747+0000 7fe6eb09a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6e406ccc0 con 0x7fe6e406c300 2023-11-28T18:37:29.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.747+0000 7fe6eb09a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e415dbc0 con 0x7fe6e41401c0 2023-11-28T18:37:29.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.747+0000 7fe6e3fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe6e406c300 0x7fe6e406c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:29.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.747+0000 7fe6e3fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe6e406c300 0x7fe6e406c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48692/0 (socket says 172.21.15.45:48692) 2023-11-28T18:37:29.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.747+0000 7fe6e3fff640 1 -- 172.21.15.45:0/2560971614 learned_addr learned my addr 172.21.15.45:0/2560971614 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:29.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.747+0000 7fe6e9637640 1 --1- 172.21.15.45:0/2560971614 >> v1:172.21.15.45:6789/0 conn(0x7fe6e40704a0 0x7fe6e40708d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:50192/0 (socket says 172.21.15.45:50192) 2023-11-28T18:37:29.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.747+0000 7fe6e8e36640 1 --2- 172.21.15.45:0/2560971614 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6e41401c0 0x7fe6e4071f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:29.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.751+0000 7fe6e3fff640 1 -- 172.21.15.45:0/2560971614 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6e41401c0 msgr2=0x7fe6e4071f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:29.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.751+0000 7fe6e3fff640 1 --2- 172.21.15.45:0/2560971614 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6e41401c0 0x7fe6e4071f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:29.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.751+0000 7fe6e3fff640 1 -- 172.21.15.45:0/2560971614 >> v1:172.21.15.45:6789/0 conn(0x7fe6e40704a0 legacy=0x7fe6e40708d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:29.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.751+0000 7fe6e37fe640 1 -- 172.21.15.45:0/2560971614 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2210428451 0 0) 0x7fe6e4140900 con 0x7fe6e40704a0 2023-11-28T18:37:29.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.751+0000 7fe6e3fff640 1 -- 172.21.15.45:0/2560971614 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e415dea0 con 0x7fe6e406c300 2023-11-28T18:37:29.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.751+0000 7fe6e3fff640 1 --2- 172.21.15.45:0/2560971614 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6e406c300 0x7fe6e406c780 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe6d0009870 tx=0x7fe6d001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65c71c264ef745a0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:29.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.751+0000 7fe6e37fe640 1 -- 172.21.15.45:0/2560971614 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d00aa670 con 0x7fe6e406c300 2023-11-28T18:37:29.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.751+0000 7fe6e37fe640 1 -- 172.21.15.45:0/2560971614 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6d00aa7d0 con 0x7fe6e406c300 2023-11-28T18:37:29.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.751+0000 7fe6e37fe640 1 -- 172.21.15.45:0/2560971614 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d00aab60 con 0x7fe6e406c300 2023-11-28T18:37:29.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.751+0000 7fe6eb09a640 1 -- 172.21.15.45:0/2560971614 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6e406c300 msgr2=0x7fe6e406c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:29.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.751+0000 7fe6eb09a640 1 --2- 172.21.15.45:0/2560971614 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6e406c300 0x7fe6e406c780 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe6d0009870 tx=0x7fe6d001c510 comp rx=0 tx=0).stop 2023-11-28T18:37:29.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.755+0000 7fe6eb09a640 1 -- 172.21.15.45:0/2560971614 shutdown_connections 2023-11-28T18:37:29.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.755+0000 7fe6eb09a640 1 --2- 172.21.15.45:0/2560971614 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6e406c300 0x7fe6e406c780 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:29.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.755+0000 7fe6eb09a640 1 --2- 172.21.15.45:0/2560971614 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6e41401c0 0x7fe6e4071f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:29.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.755+0000 7fe6eb09a640 1 -- 172.21.15.45:0/2560971614 >> 172.21.15.45:0/2560971614 conn(0x7fe6e406a570 msgr2=0x7fe6e406a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:29.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.755+0000 7fe6eb09a640 1 -- 172.21.15.45:0/2560971614 shutdown_connections 2023-11-28T18:37:29.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.755+0000 7fe6eb09a640 1 -- 172.21.15.45:0/2560971614 wait complete. 2023-11-28T18:37:29.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.755+0000 7fe6eb09a640 1 Processor -- start 2023-11-28T18:37:29.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.755+0000 7fe6eb09a640 1 -- start start 2023-11-28T18:37:29.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.755+0000 7fe6eb09a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6e406c300 0x7fe6e413f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:29.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.755+0000 7fe6eb09a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6e40704a0 0x7fe6e4158b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:29.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.755+0000 7fe6eb09a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe6e41401c0 0x7fe6e4159070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:29.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.755+0000 7fe6eb09a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e415c760 con 0x7fe6e40704a0 2023-11-28T18:37:29.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.755+0000 7fe6eb09a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e415b8b0 con 0x7fe6e41401c0 2023-11-28T18:37:29.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.755+0000 7fe6eb09a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e415cbf0 con 0x7fe6e406c300 2023-11-28T18:37:29.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.755+0000 7fe6e3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6e40704a0 0x7fe6e4158b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:29.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.755+0000 7fe6e3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6e40704a0 0x7fe6e4158b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48694/0 (socket says 172.21.15.45:48694) 2023-11-28T18:37:29.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.755+0000 7fe6e3fff640 1 -- 172.21.15.45:0/514466249 learned_addr learned my addr 172.21.15.45:0/514466249 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:29.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.755+0000 7fe6e8e36640 1 --2- 172.21.15.45:0/514466249 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6e406c300 0x7fe6e413f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:29.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.755+0000 7fe6e9637640 1 --2- 172.21.15.45:0/514466249 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe6e41401c0 0x7fe6e4159070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:29.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.755+0000 7fe6e3fff640 1 -- 172.21.15.45:0/514466249 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6e406c300 msgr2=0x7fe6e413f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:29.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.755+0000 7fe6e3fff640 1 --2- 172.21.15.45:0/514466249 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6e406c300 0x7fe6e413f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:29.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.755+0000 7fe6e3fff640 1 -- 172.21.15.45:0/514466249 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe6e41401c0 msgr2=0x7fe6e4159070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:29.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.755+0000 7fe6e3fff640 1 --2- 172.21.15.45:0/514466249 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe6e41401c0 0x7fe6e4159070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:29.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.755+0000 7fe6e3fff640 1 -- 172.21.15.45:0/514466249 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6d00094d0 con 0x7fe6e40704a0 2023-11-28T18:37:29.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.755+0000 7fe6e9637640 1 --2- 172.21.15.45:0/514466249 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe6e41401c0 0x7fe6e4159070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:37:29.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.755+0000 7fe6e3fff640 1 --2- 172.21.15.45:0/514466249 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6e40704a0 0x7fe6e4158b30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe6d001a140 tx=0x7fe6d001ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:29.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.759+0000 7fe6e17fa640 1 -- 172.21.15.45:0/514466249 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d00b3800 con 0x7fe6e40704a0 2023-11-28T18:37:29.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.759+0000 7fe6e17fa640 1 -- 172.21.15.45:0/514466249 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6d00b3960 con 0x7fe6e40704a0 2023-11-28T18:37:29.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.759+0000 7fe6eb09a640 1 -- 172.21.15.45:0/514466249 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6e415bb50 con 0x7fe6e40704a0 2023-11-28T18:37:29.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.759+0000 7fe6e17fa640 1 -- 172.21.15.45:0/514466249 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d00b3d10 con 0x7fe6e40704a0 2023-11-28T18:37:29.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.759+0000 7fe6eb09a640 1 -- 172.21.15.45:0/514466249 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6e415c110 con 0x7fe6e40704a0 2023-11-28T18:37:29.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.759+0000 7fe6eb09a640 1 -- 172.21.15.45:0/514466249 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6e4069480 con 0x7fe6e40704a0 2023-11-28T18:37:29.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.759+0000 7fe6e17fa640 1 -- 172.21.15.45:0/514466249 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe6d00c6390 con 0x7fe6e40704a0 2023-11-28T18:37:29.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.759+0000 7fe6e17fa640 1 --2- 172.21.15.45:0/514466249 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe6c80668d0 0x7fe6c8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:29.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.759+0000 7fe6e17fa640 1 -- 172.21.15.45:0/514466249 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe6d011ed60 con 0x7fe6e40704a0 2023-11-28T18:37:29.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.759+0000 7fe6e8e36640 1 --2- 172.21.15.45:0/514466249 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe6c80668d0 0x7fe6c8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:29.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.763+0000 7fe6e8e36640 1 --2- 172.21.15.45:0/514466249 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe6c80668d0 0x7fe6c8068d90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe6d80079c0 tx=0x7fe6d8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:29.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.767+0000 7fe6e17fa640 1 -- 172.21.15.45:0/514466249 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe6d00ec270 con 0x7fe6e40704a0 2023-11-28T18:37:29.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.959+0000 7fe6eb09a640 1 -- 172.21.15.45:0/514466249 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe6e4157440 con 0x7fe6e40704a0 2023-11-28T18:37:29.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.959+0000 7fe6e17fa640 1 -- 172.21.15.45:0/514466249 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3697 (secure 0 0 0) 0x7fe6d00ef890 con 0x7fe6e40704a0 2023-11-28T18:37:29.965 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:37:29.966 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/972230763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":972230763},{"type":"v1","addr":"172.21.15.45:6835","nonce":972230763}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/4274475693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":4274475693},{"type":"v1","addr":"172.21.15.190:6837","nonce":4274475693}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/3154556740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":3154556740},{"type":"v1","addr":"172.21.15.190:6836","nonce":3154556740}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/1657221272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1657221272},{"type":"v1","addr":"172.21.15.45:6834","nonce":1657221272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-11-28T18:37:29.966 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 3 2023-11-28T18:37:29.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.963+0000 7fe6eb09a640 1 -- 172.21.15.45:0/514466249 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe6c80668d0 msgr2=0x7fe6c8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:29.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.963+0000 7fe6eb09a640 1 --2- 172.21.15.45:0/514466249 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe6c80668d0 0x7fe6c8068d90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe6d80079c0 tx=0x7fe6d8008040 comp rx=0 tx=0).stop 2023-11-28T18:37:29.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.963+0000 7fe6eb09a640 1 -- 172.21.15.45:0/514466249 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6e40704a0 msgr2=0x7fe6e4158b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:29.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.963+0000 7fe6eb09a640 1 --2- 172.21.15.45:0/514466249 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6e40704a0 0x7fe6e4158b30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe6d001a140 tx=0x7fe6d001ad50 comp rx=0 tx=0).stop 2023-11-28T18:37:29.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.963+0000 7fe6eb09a640 1 -- 172.21.15.45:0/514466249 shutdown_connections 2023-11-28T18:37:29.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.963+0000 7fe6eb09a640 1 --2- 172.21.15.45:0/514466249 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe6c80668d0 0x7fe6c8068d90 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:29.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.963+0000 7fe6eb09a640 1 --2- 172.21.15.45:0/514466249 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe6e41401c0 0x7fe6e4159070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:29.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.963+0000 7fe6eb09a640 1 --2- 172.21.15.45:0/514466249 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6e40704a0 0x7fe6e4158b30 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:29.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.963+0000 7fe6eb09a640 1 --2- 172.21.15.45:0/514466249 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6e406c300 0x7fe6e413f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:29.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.963+0000 7fe6eb09a640 1 -- 172.21.15.45:0/514466249 >> 172.21.15.45:0/514466249 conn(0x7fe6e406a570 msgr2=0x7fe6e41425f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:29.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.963+0000 7fe6eb09a640 1 -- 172.21.15.45:0/514466249 shutdown_connections 2023-11-28T18:37:29.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:29.963+0000 7fe6eb09a640 1 -- 172.21.15.45:0/514466249 wait complete. 2023-11-28T18:37:29.987 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T18:37:30.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.127+0000 7fba85580640 1 Processor -- start 2023-11-28T18:37:30.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.127+0000 7fba85580640 1 -- start start 2023-11-28T18:37:30.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.127+0000 7fba85580640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fba8015d240 0x7fba800d2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:30.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.127+0000 7fba85580640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fba800d15e0 0x7fba800b61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:30.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.127+0000 7fba85580640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba800b2a30 con 0x7fba800d11a0 2023-11-28T18:37:30.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.127+0000 7fba85580640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba800d1b40 con 0x7fba800d15e0 2023-11-28T18:37:30.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.127+0000 7fba85580640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba800d1e20 con 0x7fba8015d240 2023-11-28T18:37:30.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.127+0000 7fba7f7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fba800d15e0 0x7fba800b61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:30.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.127+0000 7fba7f7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fba800d15e0 0x7fba800b61d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48706/0 (socket says 172.21.15.45:48706) 2023-11-28T18:37:30.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.127+0000 7fba7f7fe640 1 -- 172.21.15.45:0/963258861 learned_addr learned my addr 172.21.15.45:0/963258861 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:30.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.127+0000 7fba7effd640 1 --2- 172.21.15.45:0/963258861 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fba8015d240 0x7fba800d2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:30.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.127+0000 7fba7f7fe640 1 -- 172.21.15.45:0/963258861 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fba8015d240 msgr2=0x7fba800d2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:30.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.127+0000 7fba7f7fe640 1 --2- 172.21.15.45:0/963258861 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fba8015d240 0x7fba800d2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:30.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.127+0000 7fba7f7fe640 1 -- 172.21.15.45:0/963258861 >> v1:172.21.15.190:6789/0 conn(0x7fba800d11a0 legacy=0x7fba800cde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:30.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.127+0000 7fba7f7fe640 1 -- 172.21.15.45:0/963258861 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba800d2100 con 0x7fba800d15e0 2023-11-28T18:37:30.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.131+0000 7fba7f7fe640 1 --2- 172.21.15.45:0/963258861 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba800d15e0 0x7fba800b61d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fba78009e50 tx=0x7fba7801f1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35bc452c5fd27ec8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:30.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.131+0000 7fba7dffb640 1 -- 172.21.15.45:0/963258861 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba780af400 con 0x7fba800d15e0 2023-11-28T18:37:30.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.131+0000 7fba7dffb640 1 -- 172.21.15.45:0/963258861 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba780ab050 con 0x7fba800d15e0 2023-11-28T18:37:30.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.131+0000 7fba7dffb640 1 -- 172.21.15.45:0/963258861 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba780af780 con 0x7fba800d15e0 2023-11-28T18:37:30.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.131+0000 7fba85580640 1 -- 172.21.15.45:0/963258861 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba800d15e0 msgr2=0x7fba800b61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:30.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.131+0000 7fba85580640 1 --2- 172.21.15.45:0/963258861 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba800d15e0 0x7fba800b61d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fba78009e50 tx=0x7fba7801f1f0 comp rx=0 tx=0).stop 2023-11-28T18:37:30.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.131+0000 7fba85580640 1 -- 172.21.15.45:0/963258861 shutdown_connections 2023-11-28T18:37:30.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.131+0000 7fba85580640 1 --2- 172.21.15.45:0/963258861 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba800d15e0 0x7fba800b61d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:30.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.131+0000 7fba85580640 1 --2- 172.21.15.45:0/963258861 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fba8015d240 0x7fba800d2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:30.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.131+0000 7fba85580640 1 -- 172.21.15.45:0/963258861 >> 172.21.15.45:0/963258861 conn(0x7fba800722a0 msgr2=0x7fba800cfbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:30.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.131+0000 7fba85580640 1 -- 172.21.15.45:0/963258861 shutdown_connections 2023-11-28T18:37:30.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.131+0000 7fba85580640 1 -- 172.21.15.45:0/963258861 wait complete. 2023-11-28T18:37:30.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.131+0000 7fba85580640 1 Processor -- start 2023-11-28T18:37:30.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.131+0000 7fba85580640 1 -- start start 2023-11-28T18:37:30.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.135+0000 7fba85580640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba800d11a0 0x7fba800c81f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:30.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.135+0000 7fba85580640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fba800d15e0 0x7fba800c8730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:30.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.135+0000 7fba85580640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fba8015d240 0x7fba8015e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:30.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.135+0000 7fba85580640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba801f2850 con 0x7fba800d11a0 2023-11-28T18:37:30.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.135+0000 7fba85580640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba800c9420 con 0x7fba8015d240 2023-11-28T18:37:30.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.135+0000 7fba85580640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba800ca5d0 con 0x7fba800d15e0 2023-11-28T18:37:30.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.135+0000 7fba7effd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba800d11a0 0x7fba800c81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:30.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.135+0000 7fba7effd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba800d11a0 0x7fba800c81f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48712/0 (socket says 172.21.15.45:48712) 2023-11-28T18:37:30.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.135+0000 7fba7effd640 1 -- 172.21.15.45:0/3102364871 learned_addr learned my addr 172.21.15.45:0/3102364871 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:30.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.135+0000 7fba7e7fc640 1 --2- 172.21.15.45:0/3102364871 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fba800d15e0 0x7fba800c8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:30.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.135+0000 7fba7f7fe640 1 --2- 172.21.15.45:0/3102364871 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fba8015d240 0x7fba8015e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:30.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.135+0000 7fba7effd640 1 -- 172.21.15.45:0/3102364871 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fba800d15e0 msgr2=0x7fba800c8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:30.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.135+0000 7fba7effd640 1 --2- 172.21.15.45:0/3102364871 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fba800d15e0 0x7fba800c8730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:30.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.135+0000 7fba7effd640 1 -- 172.21.15.45:0/3102364871 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fba8015d240 msgr2=0x7fba8015e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:30.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.135+0000 7fba7effd640 1 --2- 172.21.15.45:0/3102364871 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fba8015d240 0x7fba8015e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:30.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.135+0000 7fba7effd640 1 -- 172.21.15.45:0/3102364871 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba78009b30 con 0x7fba800d11a0 2023-11-28T18:37:30.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.135+0000 7fba7f7fe640 1 --2- 172.21.15.45:0/3102364871 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fba8015d240 0x7fba8015e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:37:30.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.135+0000 7fba7effd640 1 --2- 172.21.15.45:0/3102364871 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba800d11a0 0x7fba800c81f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fba7000d5f0 tx=0x7fba7000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:30.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.135+0000 7fba677fe640 1 -- 172.21.15.45:0/3102364871 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba700125f0 con 0x7fba800d11a0 2023-11-28T18:37:30.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.135+0000 7fba677fe640 1 -- 172.21.15.45:0/3102364871 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba70012750 con 0x7fba800d11a0 2023-11-28T18:37:30.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.135+0000 7fba677fe640 1 -- 172.21.15.45:0/3102364871 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba70012ae0 con 0x7fba800d11a0 2023-11-28T18:37:30.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.135+0000 7fba85580640 1 -- 172.21.15.45:0/3102364871 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba800c96c0 con 0x7fba800d11a0 2023-11-28T18:37:30.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.135+0000 7fba85580640 1 -- 172.21.15.45:0/3102364871 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba80160450 con 0x7fba800d11a0 2023-11-28T18:37:30.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.135+0000 7fba85580640 1 -- 172.21.15.45:0/3102364871 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba80069480 con 0x7fba800d11a0 2023-11-28T18:37:30.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.139+0000 7fba677fe640 1 -- 172.21.15.45:0/3102364871 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fba70012c40 con 0x7fba800d11a0 2023-11-28T18:37:30.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.139+0000 7fba677fe640 1 --2- 172.21.15.45:0/3102364871 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fba6c0668d0 0x7fba6c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:30.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.139+0000 7fba677fe640 1 -- 172.21.15.45:0/3102364871 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fba70084690 con 0x7fba800d11a0 2023-11-28T18:37:30.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.139+0000 7fba7e7fc640 1 --2- 172.21.15.45:0/3102364871 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fba6c0668d0 0x7fba6c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:30.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.139+0000 7fba7e7fc640 1 --2- 172.21.15.45:0/3102364871 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fba6c0668d0 0x7fba6c068d90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fba74000f70 tx=0x7fba74009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:30.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.143+0000 7fba677fe640 1 -- 172.21.15.45:0/3102364871 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fba70051b80 con 0x7fba800d11a0 2023-11-28T18:37:30.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.303+0000 7fba85580640 1 -- 172.21.15.45:0/3102364871 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fba8006a570 con 0x7fba800d11a0 2023-11-28T18:37:30.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.303+0000 7fba677fe640 1 -- 172.21.15.45:0/3102364871 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12814 (secure 0 0 0) 0x7fba70007380 con 0x7fba800d11a0 2023-11-28T18:37:30.309 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:37:30.309 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":16,"fsid":"d10f5cd6-1d00-4019-99b6-6fa435498a15","created":"2023-11-28T18:37:08.189030+0000","modified":"2023-11-28T18:37:23.325817+0000","last_up_change":"2023-11-28T18:37:20.196124+0000","last_in_change":"2023-11-28T18:37:10.742043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T18:37:21.293917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"84465384-103c-4f2c-a45a-96f5bb9c835f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6809","nonce":555237322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6811","nonce":555237322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6815","nonce":555237322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6813","nonce":555237322}]},"public_addr":"172.21.15.45:6809/555237322","cluster_addr":"172.21.15.45:6811/555237322","heartbeat_back_addr":"172.21.15.45:6815/555237322","heartbeat_front_addr":"172.21.15.45:6813/555237322","state":["exists","up"]},{"osd":1,"uuid":"7d9eed24-a58f-42c7-a787-ac06be8553fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6801","nonce":2857063763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6803","nonce":2857063763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6807","nonce":2857063763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6805","nonce":2857063763}]},"public_addr":"172.21.15.45:6801/2857063763","cluster_addr":"172.21.15.45:6803/2857063763","heartbeat_back_addr":"172.21.15.45:6807/2857063763","heartbeat_front_addr":"172.21.15.45:6805/2857063763","state":["exists","up"]},{"osd":2,"uuid":"575eeccc-4abf-45b4-9caf-f3e797859588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6817","nonce":193884539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6819","nonce":193884539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6823","nonce":193884539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6821","nonce":193884539}]},"public_addr":"172.21.15.45:6817/193884539","cluster_addr":"172.21.15.45:6819/193884539","heartbeat_back_addr":"172.21.15.45:6823/193884539","heartbeat_front_addr":"172.21.15.45:6821/193884539","state":["exists","up"]},{"osd":3,"uuid":"9b0290d6-9a52-4bc8-b2a1-7622c5dc8e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6825","nonce":78541084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6827","nonce":78541084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6831","nonce":78541084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6829","nonce":78541084}]},"public_addr":"172.21.15.45:6825/78541084","cluster_addr":"172.21.15.45:6827/78541084","heartbeat_back_addr":"172.21.15.45:6831/78541084","heartbeat_front_addr":"172.21.15.45:6829/78541084","state":["exists","up"]},{"osd":4,"uuid":"ce632829-f027-4fbf-a627-02c571aa9d53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6809","nonce":1537591987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6811","nonce":1537591987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6815","nonce":1537591987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6813","nonce":1537591987}]},"public_addr":"172.21.15.190:6809/1537591987","cluster_addr":"172.21.15.190:6811/1537591987","heartbeat_back_addr":"172.21.15.190:6815/1537591987","heartbeat_front_addr":"172.21.15.190:6813/1537591987","state":["exists","up"]},{"osd":5,"uuid":"8700b609-27be-40bd-a251-4c0ae0a29ead","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6801","nonce":3296698407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6803","nonce":3296698407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6807","nonce":3296698407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6805","nonce":3296698407}]},"public_addr":"172.21.15.190:6801/3296698407","cluster_addr":"172.21.15.190:6803/3296698407","heartbeat_back_addr":"172.21.15.190:6807/3296698407","heartbeat_front_addr":"172.21.15.190:6805/3296698407","state":["exists","up"]},{"osd":6,"uuid":"44ce4a40-e6ff-4f4d-8e8a-7341e5c91f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6817","nonce":2317686718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6819","nonce":2317686718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6823","nonce":2317686718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6821","nonce":2317686718}]},"public_addr":"172.21.15.190:6817/2317686718","cluster_addr":"172.21.15.190:6819/2317686718","heartbeat_back_addr":"172.21.15.190:6823/2317686718","heartbeat_front_addr":"172.21.15.190:6821/2317686718","state":["exists","up"]},{"osd":7,"uuid":"192238c9-1423-4b7e-ac8f-84ba32113ddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6825","nonce":2493232051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6827","nonce":2493232051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6831","nonce":2493232051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6829","nonce":2493232051}]},"public_addr":"172.21.15.190:6825/2493232051","cluster_addr":"172.21.15.190:6827/2493232051","heartbeat_back_addr":"172.21.15.190:6831/2493232051","heartbeat_front_addr":"172.21.15.190:6829/2493232051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.393552+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.385453+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.361421+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.366408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.363226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.276007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.414605+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.445885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T18:37:30.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.307+0000 7fba85580640 1 -- 172.21.15.45:0/3102364871 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fba6c0668d0 msgr2=0x7fba6c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:30.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.307+0000 7fba85580640 1 --2- 172.21.15.45:0/3102364871 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fba6c0668d0 0x7fba6c068d90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fba74000f70 tx=0x7fba74009040 comp rx=0 tx=0).stop 2023-11-28T18:37:30.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.307+0000 7fba85580640 1 -- 172.21.15.45:0/3102364871 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba800d11a0 msgr2=0x7fba800c81f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:30.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.307+0000 7fba85580640 1 --2- 172.21.15.45:0/3102364871 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba800d11a0 0x7fba800c81f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fba7000d5f0 tx=0x7fba7000dab0 comp rx=0 tx=0).stop 2023-11-28T18:37:30.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.307+0000 7fba85580640 1 -- 172.21.15.45:0/3102364871 shutdown_connections 2023-11-28T18:37:30.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.307+0000 7fba85580640 1 --2- 172.21.15.45:0/3102364871 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fba6c0668d0 0x7fba6c068d90 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:30.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.307+0000 7fba85580640 1 --2- 172.21.15.45:0/3102364871 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fba8015d240 0x7fba8015e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:30.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.307+0000 7fba85580640 1 --2- 172.21.15.45:0/3102364871 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fba800d15e0 0x7fba800c8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:30.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.307+0000 7fba85580640 1 --2- 172.21.15.45:0/3102364871 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba800d11a0 0x7fba800c81f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:30.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.307+0000 7fba85580640 1 -- 172.21.15.45:0/3102364871 >> 172.21.15.45:0/3102364871 conn(0x7fba800722a0 msgr2=0x7fba800cd790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:30.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.307+0000 7fba85580640 1 -- 172.21.15.45:0/3102364871 shutdown_connections 2023-11-28T18:37:30.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.307+0000 7fba85580640 1 -- 172.21.15.45:0/3102364871 wait complete. 2023-11-28T18:37:30.331 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T18:37:21.293917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T18:37:30.331 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T18:37:30.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.471+0000 7f6f5d8d6640 1 Processor -- start 2023-11-28T18:37:30.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.471+0000 7f6f5d8d6640 1 -- start start 2023-11-28T18:37:30.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.475+0000 7f6f5d8d6640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f6f580d0330 0x7f6f58168030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:30.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.475+0000 7f6f5d8d6640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f580aff70 con 0x7f6f5815d2f0 2023-11-28T18:37:30.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.475+0000 7f6f5d8d6640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f580d1f00 con 0x7f6f5815d6d0 2023-11-28T18:37:30.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.475+0000 7f6f5d8d6640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f580b0210 con 0x7f6f580d0330 2023-11-28T18:37:30.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.475+0000 7f6f56ffd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f6f5815d2f0 0x7f6f580d17f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:50200/0 (socket says 172.21.15.45:50200) 2023-11-28T18:37:30.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.475+0000 7f6f56ffd640 1 -- 172.21.15.45:0/368977668 learned_addr learned my addr 172.21.15.45:0/368977668 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:37:30.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.475+0000 7f6f577fe640 1 --2- 172.21.15.45:0/368977668 >> v2:172.21.15.190:3300/0 conn(0x7f6f580d0330 0x7f6f58168030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:30.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.475+0000 7f6f567fc640 1 -- 172.21.15.45:0/368977668 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4269405830 0 0) 0x7f6f580aff70 con 0x7f6f5815d2f0 2023-11-28T18:37:30.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.475+0000 7f6f567fc640 1 -- 172.21.15.45:0/368977668 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f44003530 con 0x7f6f5815d2f0 2023-11-28T18:37:30.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.475+0000 7f6f567fc640 1 -- 172.21.15.45:0/368977668 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4209618021 0 0) 0x7f6f44003530 con 0x7f6f5815d2f0 2023-11-28T18:37:30.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.475+0000 7f6f567fc640 1 -- 172.21.15.45:0/368977668 >> v2:172.21.15.190:3300/0 conn(0x7f6f580d0330 msgr2=0x7f6f58168030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:30.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.475+0000 7f6f567fc640 1 --2- 172.21.15.45:0/368977668 >> v2:172.21.15.190:3300/0 conn(0x7f6f580d0330 0x7f6f58168030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:30.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.475+0000 7f6f567fc640 1 -- 172.21.15.45:0/368977668 >> v1:172.21.15.190:6789/0 conn(0x7f6f5815d6d0 legacy=0x7f6f580cfc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:30.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.475+0000 7f6f567fc640 1 -- 172.21.15.45:0/368977668 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f580b04f0 con 0x7f6f5815d2f0 2023-11-28T18:37:30.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.475+0000 7f6f567fc640 1 -- 172.21.15.45:0/368977668 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4084481567 0 0) 0x7f6f48001680 con 0x7f6f5815d2f0 2023-11-28T18:37:30.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.475+0000 7f6f567fc640 1 -- 172.21.15.45:0/368977668 >> v1:172.21.15.45:6789/0 conn(0x7f6f5815d2f0 legacy=0x7f6f580d17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:30.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.475+0000 7f6f567fc640 1 --2- 172.21.15.45:0/368977668 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6f44003980 0x7f6f44003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:30.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.475+0000 7f6f567fc640 1 --2- 172.21.15.45:0/368977668 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f440047d0 0x7f6f44004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:30.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.475+0000 7f6f567fc640 1 --2- 172.21.15.45:0/368977668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f44005190 0x7f6f4400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:30.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.475+0000 7f6f567fc640 1 -- 172.21.15.45:0/368977668 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f580b0210 con 0x7f6f44005190 2023-11-28T18:37:30.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.475+0000 7f6f567fc640 1 -- 172.21.15.45:0/368977668 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4400c030 con 0x7f6f440047d0 2023-11-28T18:37:30.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.475+0000 7f6f567fc640 1 -- 172.21.15.45:0/368977668 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4400c1f0 con 0x7f6f44003980 2023-11-28T18:37:30.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.475+0000 7f6f577fe640 1 --2- 172.21.15.45:0/368977668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f44005190 0x7f6f4400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:30.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.475+0000 7f6f4ffff640 1 --2- 172.21.15.45:0/368977668 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f440047d0 0x7f6f44004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:30.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.475+0000 7f6f56ffd640 1 --2- 172.21.15.45:0/368977668 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6f44003980 0x7f6f44003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:30.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.475+0000 7f6f577fe640 1 -- 172.21.15.45:0/368977668 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6f44003980 msgr2=0x7f6f44003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:30.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.475+0000 7f6f577fe640 1 --2- 172.21.15.45:0/368977668 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6f44003980 0x7f6f44003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:30.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.475+0000 7f6f577fe640 1 -- 172.21.15.45:0/368977668 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f440047d0 msgr2=0x7f6f44004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:30.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.475+0000 7f6f577fe640 1 --2- 172.21.15.45:0/368977668 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f440047d0 0x7f6f44004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:30.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.475+0000 7f6f577fe640 1 -- 172.21.15.45:0/368977668 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f44003530 con 0x7f6f44005190 2023-11-28T18:37:30.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.475+0000 7f6f56ffd640 1 --2- 172.21.15.45:0/368977668 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6f44003980 0x7f6f44003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:37:30.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.479+0000 7f6f577fe640 1 -- 172.21.15.45:0/368977668 reap_dead start 2023-11-28T18:37:30.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.479+0000 7f6f577fe640 1 --2- 172.21.15.45:0/368977668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f44005190 0x7f6f4400b990 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6f50009fc0 tx=0x7f6f5001cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c093396700f9d79 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:30.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.479+0000 7f6f567fc640 1 -- 172.21.15.45:0/368977668 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f500a5cb0 con 0x7f6f44005190 2023-11-28T18:37:30.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.479+0000 7f6f567fc640 1 -- 172.21.15.45:0/368977668 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f5000f040 con 0x7f6f44005190 2023-11-28T18:37:30.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.479+0000 7f6f567fc640 1 -- 172.21.15.45:0/368977668 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f50003be0 con 0x7f6f44005190 2023-11-28T18:37:30.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.479+0000 7f6f5d8d6640 1 -- 172.21.15.45:0/368977668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f44005190 msgr2=0x7f6f4400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:30.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.479+0000 7f6f5d8d6640 1 --2- 172.21.15.45:0/368977668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f44005190 0x7f6f4400b990 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6f50009fc0 tx=0x7f6f5001cca0 comp rx=0 tx=0).stop 2023-11-28T18:37:30.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.479+0000 7f6f5d8d6640 1 -- 172.21.15.45:0/368977668 shutdown_connections 2023-11-28T18:37:30.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.479+0000 7f6f5d8d6640 1 --2- 172.21.15.45:0/368977668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f44005190 0x7f6f4400b990 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:30.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.479+0000 7f6f5d8d6640 1 -- 172.21.15.45:0/368977668 >> 172.21.15.45:0/368977668 conn(0x7f6f5809c550 msgr2=0x7f6f580d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:30.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.479+0000 7f6f5d8d6640 1 -- 172.21.15.45:0/368977668 shutdown_connections 2023-11-28T18:37:30.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.479+0000 7f6f5d8d6640 1 -- 172.21.15.45:0/368977668 wait complete. 2023-11-28T18:37:30.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.483+0000 7f6f5d8d6640 1 Processor -- start 2023-11-28T18:37:30.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.483+0000 7f6f5d8d6640 1 -- start start 2023-11-28T18:37:30.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.483+0000 7f6f5d8d6640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6f44005190 0x7f6f580b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:30.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.483+0000 7f6f5d8d6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f581f5e10 0x7f6f580c8d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:30.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.483+0000 7f6f5d8d6640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f581f6270 0x7f6f580c9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:30.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.483+0000 7f6f5d8d6640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f581f67f0 con 0x7f6f581f5e10 2023-11-28T18:37:30.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.483+0000 7f6f5d8d6640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f581f6ad0 con 0x7f6f581f6270 2023-11-28T18:37:30.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.483+0000 7f6f5d8d6640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f580b6ff0 con 0x7f6f44005190 2023-11-28T18:37:30.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.483+0000 7f6f4ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f581f5e10 0x7f6f580c8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:30.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.483+0000 7f6f4ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f581f5e10 0x7f6f580c8d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48718/0 (socket says 172.21.15.45:48718) 2023-11-28T18:37:30.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.483+0000 7f6f4ffff640 1 -- 172.21.15.45:0/4152987258 learned_addr learned my addr 172.21.15.45:0/4152987258 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:30.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.483+0000 7f6f577fe640 1 --2- 172.21.15.45:0/4152987258 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f581f6270 0x7f6f580c9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:30.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.483+0000 7f6f56ffd640 1 --2- 172.21.15.45:0/4152987258 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6f44005190 0x7f6f580b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:30.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.483+0000 7f6f4ffff640 1 -- 172.21.15.45:0/4152987258 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6f44005190 msgr2=0x7f6f580b77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:30.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.483+0000 7f6f4ffff640 1 --2- 172.21.15.45:0/4152987258 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6f44005190 0x7f6f580b77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:30.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.483+0000 7f6f4ffff640 1 -- 172.21.15.45:0/4152987258 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f581f6270 msgr2=0x7f6f580c9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:30.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.483+0000 7f6f4ffff640 1 --2- 172.21.15.45:0/4152987258 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f581f6270 0x7f6f580c9290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:30.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.483+0000 7f6f4ffff640 1 -- 172.21.15.45:0/4152987258 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f580b72d0 con 0x7f6f581f5e10 2023-11-28T18:37:30.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.483+0000 7f6f577fe640 1 --2- 172.21.15.45:0/4152987258 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f581f6270 0x7f6f580c9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:37:30.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.483+0000 7f6f4ffff640 1 --2- 172.21.15.45:0/4152987258 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f581f5e10 0x7f6f580c8d50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6f4000f5f0 tx=0x7f6f4000fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:30.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.483+0000 7f6f54ff9640 1 -- 172.21.15.45:0/4152987258 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f400052e0 con 0x7f6f581f5e10 2023-11-28T18:37:30.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.483+0000 7f6f54ff9640 1 -- 172.21.15.45:0/4152987258 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f40005440 con 0x7f6f581f5e10 2023-11-28T18:37:30.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.483+0000 7f6f5d8d6640 1 -- 172.21.15.45:0/4152987258 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f580b7d30 con 0x7f6f581f5e10 2023-11-28T18:37:30.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.483+0000 7f6f54ff9640 1 -- 172.21.15.45:0/4152987258 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f40003820 con 0x7f6f581f5e10 2023-11-28T18:37:30.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.483+0000 7f6f5d8d6640 1 -- 172.21.15.45:0/4152987258 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f580b85e0 con 0x7f6f581f5e10 2023-11-28T18:37:30.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.483+0000 7f6f5d8d6640 1 -- 172.21.15.45:0/4152987258 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f58067a30 con 0x7f6f581f5e10 2023-11-28T18:37:30.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.487+0000 7f6f54ff9640 1 -- 172.21.15.45:0/4152987258 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f6f40003980 con 0x7f6f581f5e10 2023-11-28T18:37:30.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.487+0000 7f6f54ff9640 1 --2- 172.21.15.45:0/4152987258 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6f38066900 0x7f6f38068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:30.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.487+0000 7f6f54ff9640 1 -- 172.21.15.45:0/4152987258 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6f400840d0 con 0x7f6f581f5e10 2023-11-28T18:37:30.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.487+0000 7f6f56ffd640 1 --2- 172.21.15.45:0/4152987258 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6f38066900 0x7f6f38068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:30.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.487+0000 7f6f56ffd640 1 --2- 172.21.15.45:0/4152987258 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6f38066900 0x7f6f38068dc0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6f48001000 tx=0x7f6f48009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:30.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.491+0000 7f6f54ff9640 1 -- 172.21.15.45:0/4152987258 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6f400515c0 con 0x7f6f581f5e10 2023-11-28T18:37:30.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.651+0000 7f6f5d8d6640 1 -- 172.21.15.45:0/4152987258 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6f580b6e50 con 0x7f6f581f5e10 2023-11-28T18:37:30.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.651+0000 7f6f54ff9640 1 -- 172.21.15.45:0/4152987258 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6f580b6e50 con 0x7f6f581f5e10 2023-11-28T18:37:30.656 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-11-28T18:37:30.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.651+0000 7f6f5d8d6640 1 -- 172.21.15.45:0/4152987258 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6f38066900 msgr2=0x7f6f38068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:30.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.651+0000 7f6f5d8d6640 1 --2- 172.21.15.45:0/4152987258 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6f38066900 0x7f6f38068dc0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6f48001000 tx=0x7f6f48009040 comp rx=0 tx=0).stop 2023-11-28T18:37:30.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.651+0000 7f6f5d8d6640 1 -- 172.21.15.45:0/4152987258 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f581f5e10 msgr2=0x7f6f580c8d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:30.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.651+0000 7f6f5d8d6640 1 --2- 172.21.15.45:0/4152987258 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f581f5e10 0x7f6f580c8d50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6f4000f5f0 tx=0x7f6f4000fab0 comp rx=0 tx=0).stop 2023-11-28T18:37:30.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.651+0000 7f6f5d8d6640 1 -- 172.21.15.45:0/4152987258 shutdown_connections 2023-11-28T18:37:30.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.651+0000 7f6f5d8d6640 1 --2- 172.21.15.45:0/4152987258 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6f38066900 0x7f6f38068dc0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:30.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.651+0000 7f6f5d8d6640 1 --2- 172.21.15.45:0/4152987258 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f581f6270 0x7f6f580c9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:30.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.651+0000 7f6f5d8d6640 1 --2- 172.21.15.45:0/4152987258 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f581f5e10 0x7f6f580c8d50 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:30.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.651+0000 7f6f5d8d6640 1 --2- 172.21.15.45:0/4152987258 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6f44005190 0x7f6f580b77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:30.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.651+0000 7f6f5d8d6640 1 -- 172.21.15.45:0/4152987258 >> 172.21.15.45:0/4152987258 conn(0x7f6f5809c550 msgr2=0x7f6f580b0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:30.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.651+0000 7f6f5d8d6640 1 -- 172.21.15.45:0/4152987258 shutdown_connections 2023-11-28T18:37:30.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.651+0000 7f6f5d8d6640 1 -- 172.21.15.45:0/4152987258 wait complete. 2023-11-28T18:37:30.676 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-28T18:37:30.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.815+0000 7eff5519d640 1 Processor -- start 2023-11-28T18:37:30.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.815+0000 7eff5519d640 1 -- start start 2023-11-28T18:37:30.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.815+0000 7eff5519d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7eff500b35f0 0x7eff500d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:30.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.815+0000 7eff5519d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff500b3cb0 0x7eff5015f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:30.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.815+0000 7eff5519d640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff500d38c0 con 0x7eff500cf7c0 2023-11-28T18:37:30.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.815+0000 7eff5519d640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff500d40d0 con 0x7eff500b35f0 2023-11-28T18:37:30.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.815+0000 7eff5519d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff500cdcc0 con 0x7eff500b3cb0 2023-11-28T18:37:30.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.815+0000 7eff4ed9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7eff500b35f0 0x7eff500d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:30.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.815+0000 7eff4ed9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7eff500b35f0 0x7eff500d0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48720/0 (socket says 172.21.15.45:48720) 2023-11-28T18:37:30.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.815+0000 7eff4ed9d640 1 -- 172.21.15.45:0/797594579 learned_addr learned my addr 172.21.15.45:0/797594579 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:30.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.815+0000 7eff47fff640 1 --2- 172.21.15.45:0/797594579 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff500b3cb0 0x7eff5015f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:30.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.815+0000 7eff4ed9d640 1 -- 172.21.15.45:0/797594579 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff500b3cb0 msgr2=0x7eff5015f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:30.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.815+0000 7eff4ed9d640 1 --2- 172.21.15.45:0/797594579 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff500b3cb0 0x7eff5015f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:30.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.815+0000 7eff4ed9d640 1 -- 172.21.15.45:0/797594579 >> v1:172.21.15.190:6789/0 conn(0x7eff500cf7c0 legacy=0x7eff500ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:30.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.815+0000 7eff4ed9d640 1 -- 172.21.15.45:0/797594579 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff500d3b10 con 0x7eff500b35f0 2023-11-28T18:37:30.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.815+0000 7eff47fff640 1 --2- 172.21.15.45:0/797594579 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff500b3cb0 0x7eff5015f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:37:30.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.819+0000 7eff4ed9d640 1 --2- 172.21.15.45:0/797594579 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff500b35f0 0x7eff500d0f90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7eff40009870 tx=0x7eff4001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90ae63448f371f40 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:30.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.819+0000 7eff4e59c640 1 -- 172.21.15.45:0/797594579 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff400a9400 con 0x7eff500b35f0 2023-11-28T18:37:30.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.819+0000 7eff4e59c640 1 -- 172.21.15.45:0/797594579 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff400a9560 con 0x7eff500b35f0 2023-11-28T18:37:30.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.819+0000 7eff4e59c640 1 -- 172.21.15.45:0/797594579 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff400a98f0 con 0x7eff500b35f0 2023-11-28T18:37:30.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.819+0000 7eff5519d640 1 -- 172.21.15.45:0/797594579 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff500b35f0 msgr2=0x7eff500d0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:30.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.819+0000 7eff5519d640 1 --2- 172.21.15.45:0/797594579 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff500b35f0 0x7eff500d0f90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7eff40009870 tx=0x7eff4001c540 comp rx=0 tx=0).stop 2023-11-28T18:37:30.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.819+0000 7eff5519d640 1 -- 172.21.15.45:0/797594579 shutdown_connections 2023-11-28T18:37:30.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.819+0000 7eff5519d640 1 --2- 172.21.15.45:0/797594579 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff500b3cb0 0x7eff5015f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:30.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.819+0000 7eff5519d640 1 --2- 172.21.15.45:0/797594579 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff500b35f0 0x7eff500d0f90 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:30.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.819+0000 7eff5519d640 1 -- 172.21.15.45:0/797594579 >> 172.21.15.45:0/797594579 conn(0x7eff5009c4f0 msgr2=0x7eff500d31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:30.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.819+0000 7eff5519d640 1 -- 172.21.15.45:0/797594579 shutdown_connections 2023-11-28T18:37:30.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.819+0000 7eff5519d640 1 -- 172.21.15.45:0/797594579 wait complete. 2023-11-28T18:37:30.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.823+0000 7eff5519d640 1 Processor -- start 2023-11-28T18:37:30.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.823+0000 7eff5519d640 1 -- start start 2023-11-28T18:37:30.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.823+0000 7eff5519d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7eff500b35f0 0x7eff5015b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:30.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.823+0000 7eff5519d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff500b3cb0 0x7eff500b7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:30.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.823+0000 7eff5519d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff500cf7c0 0x7eff500afea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:30.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.823+0000 7eff5519d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff500b90c0 con 0x7eff500cf7c0 2023-11-28T18:37:30.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.823+0000 7eff5519d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff500b8020 con 0x7eff500b35f0 2023-11-28T18:37:30.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.823+0000 7eff5519d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff500b8300 con 0x7eff500b3cb0 2023-11-28T18:37:30.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.823+0000 7eff4f59e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff500cf7c0 0x7eff500afea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:30.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.823+0000 7eff4ed9d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7eff500b35f0 0x7eff5015b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:30.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.823+0000 7eff4f59e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff500cf7c0 0x7eff500afea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48730/0 (socket says 172.21.15.45:48730) 2023-11-28T18:37:30.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.823+0000 7eff4f59e640 1 -- 172.21.15.45:0/2197815726 learned_addr learned my addr 172.21.15.45:0/2197815726 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:30.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.823+0000 7eff47fff640 1 --2- 172.21.15.45:0/2197815726 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff500b3cb0 0x7eff500b7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:30.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.823+0000 7eff4f59e640 1 -- 172.21.15.45:0/2197815726 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff500b3cb0 msgr2=0x7eff500b7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:30.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.823+0000 7eff4f59e640 1 --2- 172.21.15.45:0/2197815726 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff500b3cb0 0x7eff500b7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:30.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.823+0000 7eff4f59e640 1 -- 172.21.15.45:0/2197815726 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7eff500b35f0 msgr2=0x7eff5015b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:30.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.823+0000 7eff4f59e640 1 --2- 172.21.15.45:0/2197815726 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7eff500b35f0 0x7eff5015b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:30.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.823+0000 7eff4f59e640 1 -- 172.21.15.45:0/2197815726 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff400094d0 con 0x7eff500cf7c0 2023-11-28T18:37:30.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.823+0000 7eff4ed9d640 1 --2- 172.21.15.45:0/2197815726 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7eff500b35f0 0x7eff5015b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:37:30.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.823+0000 7eff4f59e640 1 --2- 172.21.15.45:0/2197815726 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff500cf7c0 0x7eff500afea0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7eff4800c730 tx=0x7eff4800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:30.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.823+0000 7eff477fe640 1 -- 172.21.15.45:0/2197815726 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff48003b80 con 0x7eff500cf7c0 2023-11-28T18:37:30.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.823+0000 7eff477fe640 1 -- 172.21.15.45:0/2197815726 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff48003ce0 con 0x7eff500cf7c0 2023-11-28T18:37:30.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.823+0000 7eff5519d640 1 -- 172.21.15.45:0/2197815726 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff500d0160 con 0x7eff500cf7c0 2023-11-28T18:37:30.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.823+0000 7eff477fe640 1 -- 172.21.15.45:0/2197815726 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff48005310 con 0x7eff500cf7c0 2023-11-28T18:37:30.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.823+0000 7eff5519d640 1 -- 172.21.15.45:0/2197815726 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff500b88c0 con 0x7eff500cf7c0 2023-11-28T18:37:30.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.827+0000 7eff5519d640 1 -- 172.21.15.45:0/2197815726 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff50069480 con 0x7eff500cf7c0 2023-11-28T18:37:30.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.827+0000 7eff477fe640 1 -- 172.21.15.45:0/2197815726 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7eff48005680 con 0x7eff500cf7c0 2023-11-28T18:37:30.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.827+0000 7eff477fe640 1 --2- 172.21.15.45:0/2197815726 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7eff300668d0 0x7eff30068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:30.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.827+0000 7eff477fe640 1 -- 172.21.15.45:0/2197815726 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7eff48083ea0 con 0x7eff500cf7c0 2023-11-28T18:37:30.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.827+0000 7eff4ed9d640 1 --2- 172.21.15.45:0/2197815726 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7eff300668d0 0x7eff30068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:30.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.827+0000 7eff4ed9d640 1 --2- 172.21.15.45:0/2197815726 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7eff300668d0 0x7eff30068d90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7eff400ae000 tx=0x7eff400b3040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:30.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.831+0000 7eff477fe640 1 -- 172.21.15.45:0/2197815726 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7eff480514d0 con 0x7eff500cf7c0 2023-11-28T18:37:30.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.991+0000 7eff5519d640 1 -- 172.21.15.45:0/2197815726 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7eff500d0760 con 0x7eff500cf7c0 2023-11-28T18:37:30.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.991+0000 7eff477fe640 1 -- 172.21.15.45:0/2197815726 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7eff48054af0 con 0x7eff500cf7c0 2023-11-28T18:37:30.996 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:37:30.996 INFO:teuthology.orchestra.run.smithi045.stdout:[ 2023-11-28T18:37:30.996 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T18:37:30.997 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 1, 2023-11-28T18:37:30.997 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": ".mgr" 2023-11-28T18:37:30.997 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:37:30.997 INFO:teuthology.orchestra.run.smithi045.stdout:] 2023-11-28T18:37:30.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.995+0000 7eff5519d640 1 -- 172.21.15.45:0/2197815726 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7eff300668d0 msgr2=0x7eff30068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:30.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.995+0000 7eff5519d640 1 --2- 172.21.15.45:0/2197815726 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7eff300668d0 0x7eff30068d90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7eff400ae000 tx=0x7eff400b3040 comp rx=0 tx=0).stop 2023-11-28T18:37:30.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.995+0000 7eff5519d640 1 -- 172.21.15.45:0/2197815726 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff500cf7c0 msgr2=0x7eff500afea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:30.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.995+0000 7eff5519d640 1 --2- 172.21.15.45:0/2197815726 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff500cf7c0 0x7eff500afea0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7eff4800c730 tx=0x7eff4800cbf0 comp rx=0 tx=0).stop 2023-11-28T18:37:30.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.995+0000 7eff5519d640 1 -- 172.21.15.45:0/2197815726 shutdown_connections 2023-11-28T18:37:30.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.995+0000 7eff5519d640 1 --2- 172.21.15.45:0/2197815726 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7eff300668d0 0x7eff30068d90 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:30.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.995+0000 7eff5519d640 1 --2- 172.21.15.45:0/2197815726 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff500cf7c0 0x7eff500afea0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:30.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.995+0000 7eff5519d640 1 --2- 172.21.15.45:0/2197815726 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff500b3cb0 0x7eff500b7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:31.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.995+0000 7eff5519d640 1 --2- 172.21.15.45:0/2197815726 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7eff500b35f0 0x7eff5015b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:31.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.995+0000 7eff5519d640 1 -- 172.21.15.45:0/2197815726 >> 172.21.15.45:0/2197815726 conn(0x7eff5009c4f0 msgr2=0x7eff5006c690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:31.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.995+0000 7eff5519d640 1 -- 172.21.15.45:0/2197815726 shutdown_connections 2023-11-28T18:37:31.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:30.995+0000 7eff5519d640 1 -- 172.21.15.45:0/2197815726 wait complete. 2023-11-28T18:37:31.018 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-28T18:37:31.018 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-28T18:37:31.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.159+0000 7fb1ea780640 1 Processor -- start 2023-11-28T18:37:31.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.159+0000 7fb1ea780640 1 -- start start 2023-11-28T18:37:31.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.163+0000 7fb1ea780640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fb1e41609d0 0x7fb1e40d2840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:31.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.163+0000 7fb1ea780640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb1e40d2d80 0x7fb1e40cda40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:31.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.163+0000 7fb1ea780640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1e40d3b80 con 0x7fb1e40cdf80 2023-11-28T18:37:31.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.163+0000 7fb1ea780640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1e40ce3f0 con 0x7fb1e41609d0 2023-11-28T18:37:31.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.163+0000 7fb1ea780640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e40b64a0 con 0x7fb1e40d2d80 2023-11-28T18:37:31.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.163+0000 7fb1e8d1d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fb1e40cdf80 0x7fb1e40cfba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:50210/0 (socket says 172.21.15.45:50210) 2023-11-28T18:37:31.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.163+0000 7fb1e8d1d640 1 -- 172.21.15.45:0/3671241683 learned_addr learned my addr 172.21.15.45:0/3671241683 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:37:31.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.163+0000 7fb1e3fff640 1 --2- 172.21.15.45:0/3671241683 >> v2:172.21.15.190:3300/0 conn(0x7fb1e41609d0 0x7fb1e40d2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:31.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.163+0000 7fb1e37fe640 1 --2- 172.21.15.45:0/3671241683 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb1e40d2d80 0x7fb1e40cda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:31.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.163+0000 7fb1e2ffd640 1 -- 172.21.15.45:0/3671241683 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4014318580 0 0) 0x7fb1e40d3b80 con 0x7fb1e40cdf80 2023-11-28T18:37:31.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.163+0000 7fb1e2ffd640 1 -- 172.21.15.45:0/3671241683 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1cc003530 con 0x7fb1e40cdf80 2023-11-28T18:37:31.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.163+0000 7fb1e3fff640 1 -- 172.21.15.45:0/3671241683 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb1e40d2d80 msgr2=0x7fb1e40cda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:31.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.163+0000 7fb1e3fff640 1 --2- 172.21.15.45:0/3671241683 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb1e40d2d80 0x7fb1e40cda40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:31.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.163+0000 7fb1e3fff640 1 -- 172.21.15.45:0/3671241683 >> v1:172.21.15.45:6789/0 conn(0x7fb1e40cdf80 legacy=0x7fb1e40cfba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:31.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.163+0000 7fb1e3fff640 1 -- 172.21.15.45:0/3671241683 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e40d32e0 con 0x7fb1e41609d0 2023-11-28T18:37:31.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.167+0000 7fb1e3fff640 1 --2- 172.21.15.45:0/3671241683 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb1e41609d0 0x7fb1e40d2840 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb1d40097c0 tx=0x7fb1d401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b456f08a9e57a4b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:31.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.167+0000 7fb1e2ffd640 1 -- 172.21.15.45:0/3671241683 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d40ab600 con 0x7fb1e41609d0 2023-11-28T18:37:31.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.167+0000 7fb1e2ffd640 1 -- 172.21.15.45:0/3671241683 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1d40a7050 con 0x7fb1e41609d0 2023-11-28T18:37:31.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.167+0000 7fb1e2ffd640 1 -- 172.21.15.45:0/3671241683 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d40ab960 con 0x7fb1e41609d0 2023-11-28T18:37:31.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.167+0000 7fb1ea780640 1 -- 172.21.15.45:0/3671241683 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb1e41609d0 msgr2=0x7fb1e40d2840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:31.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.167+0000 7fb1ea780640 1 --2- 172.21.15.45:0/3671241683 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb1e41609d0 0x7fb1e40d2840 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb1d40097c0 tx=0x7fb1d401c480 comp rx=0 tx=0).stop 2023-11-28T18:37:31.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.167+0000 7fb1ea780640 1 -- 172.21.15.45:0/3671241683 shutdown_connections 2023-11-28T18:37:31.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.167+0000 7fb1ea780640 1 --2- 172.21.15.45:0/3671241683 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb1e40d2d80 0x7fb1e40cda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:31.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.167+0000 7fb1ea780640 1 --2- 172.21.15.45:0/3671241683 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb1e41609d0 0x7fb1e40d2840 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:31.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.167+0000 7fb1ea780640 1 -- 172.21.15.45:0/3671241683 >> 172.21.15.45:0/3671241683 conn(0x7fb1e40720a0 msgr2=0x7fb1e40724b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:31.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.167+0000 7fb1ea780640 1 -- 172.21.15.45:0/3671241683 shutdown_connections 2023-11-28T18:37:31.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.167+0000 7fb1ea780640 1 -- 172.21.15.45:0/3671241683 wait complete. 2023-11-28T18:37:31.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.167+0000 7fb1ea780640 1 Processor -- start 2023-11-28T18:37:31.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.167+0000 7fb1ea780640 1 -- start start 2023-11-28T18:37:31.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.167+0000 7fb1ea780640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb1e40cdf80 0x7fb1e40cc870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:31.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.167+0000 7fb1ea780640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1e40d2d80 0x7fb1e4159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:31.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.167+0000 7fb1ea780640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb1e41609d0 0x7fb1e415a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:31.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.167+0000 7fb1ea780640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e40cd0e0 con 0x7fb1e40d2d80 2023-11-28T18:37:31.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.167+0000 7fb1ea780640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e40c8f60 con 0x7fb1e41609d0 2023-11-28T18:37:31.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.167+0000 7fb1ea780640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e40c9240 con 0x7fb1e40cdf80 2023-11-28T18:37:31.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.171+0000 7fb1e37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1e40d2d80 0x7fb1e4159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:31.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.171+0000 7fb1e3fff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb1e40cdf80 0x7fb1e40cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:31.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.171+0000 7fb1e37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1e40d2d80 0x7fb1e4159dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48736/0 (socket says 172.21.15.45:48736) 2023-11-28T18:37:31.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.171+0000 7fb1e37fe640 1 -- 172.21.15.45:0/3113451404 learned_addr learned my addr 172.21.15.45:0/3113451404 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:31.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.171+0000 7fb1e8d1d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb1e41609d0 0x7fb1e415a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:31.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.171+0000 7fb1e37fe640 1 -- 172.21.15.45:0/3113451404 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb1e40cdf80 msgr2=0x7fb1e40cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:31.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.171+0000 7fb1e37fe640 1 --2- 172.21.15.45:0/3113451404 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb1e40cdf80 0x7fb1e40cc870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:31.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.171+0000 7fb1e37fe640 1 -- 172.21.15.45:0/3113451404 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb1e41609d0 msgr2=0x7fb1e415a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:31.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.171+0000 7fb1e37fe640 1 --2- 172.21.15.45:0/3113451404 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb1e41609d0 0x7fb1e415a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:31.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.171+0000 7fb1e37fe640 1 -- 172.21.15.45:0/3113451404 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d4009420 con 0x7fb1e40d2d80 2023-11-28T18:37:31.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.171+0000 7fb1e37fe640 1 --2- 172.21.15.45:0/3113451404 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1e40d2d80 0x7fb1e4159dc0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb1d800e930 tx=0x7fb1d800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:31.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.171+0000 7fb1e0ff9640 1 -- 172.21.15.45:0/3113451404 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d8009690 con 0x7fb1e40d2d80 2023-11-28T18:37:31.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.171+0000 7fb1e0ff9640 1 -- 172.21.15.45:0/3113451404 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1d800ca00 con 0x7fb1e40d2d80 2023-11-28T18:37:31.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.171+0000 7fb1e0ff9640 1 -- 172.21.15.45:0/3113451404 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d800cd70 con 0x7fb1e40d2d80 2023-11-28T18:37:31.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.171+0000 7fb1ea780640 1 -- 172.21.15.45:0/3113451404 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1e40c9520 con 0x7fb1e40d2d80 2023-11-28T18:37:31.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.171+0000 7fb1ea780640 1 -- 172.21.15.45:0/3113451404 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1e40ccdb0 con 0x7fb1e40d2d80 2023-11-28T18:37:31.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.171+0000 7fb1ea780640 1 -- 172.21.15.45:0/3113451404 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1e4067720 con 0x7fb1e40d2d80 2023-11-28T18:37:31.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.171+0000 7fb1e0ff9640 1 -- 172.21.15.45:0/3113451404 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fb1d8013470 con 0x7fb1e40d2d80 2023-11-28T18:37:31.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.175+0000 7fb1e0ff9640 1 --2- 172.21.15.45:0/3113451404 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fb1d00668d0 0x7fb1d0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:31.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.175+0000 7fb1e0ff9640 1 -- 172.21.15.45:0/3113451404 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb1d80842a0 con 0x7fb1e40d2d80 2023-11-28T18:37:31.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.175+0000 7fb1e3fff640 1 --2- 172.21.15.45:0/3113451404 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fb1d00668d0 0x7fb1d0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:31.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.175+0000 7fb1e3fff640 1 --2- 172.21.15.45:0/3113451404 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fb1d00668d0 0x7fb1d0068d90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb1d40ad000 tx=0x7fb1d4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:31.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.179+0000 7fb1e0ff9640 1 -- 172.21.15.45:0/3113451404 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb1d8051990 con 0x7fb1e40d2d80 2023-11-28T18:37:31.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.335+0000 7fb1ea780640 1 -- 172.21.15.45:0/3113451404 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fb1e4069410 con 0x7fb1e40d2d80 2023-11-28T18:37:31.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.431+0000 7fb1e0ff9640 1 -- 172.21.15.45:0/3113451404 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7fb1d8054fb0 con 0x7fb1e40d2d80 2023-11-28T18:37:31.437 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' created 2023-11-28T18:37:31.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.435+0000 7fb1ea780640 1 -- 172.21.15.45:0/3113451404 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fb1d00668d0 msgr2=0x7fb1d0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:31.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.435+0000 7fb1ea780640 1 --2- 172.21.15.45:0/3113451404 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fb1d00668d0 0x7fb1d0068d90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb1d40ad000 tx=0x7fb1d4008040 comp rx=0 tx=0).stop 2023-11-28T18:37:31.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.435+0000 7fb1ea780640 1 -- 172.21.15.45:0/3113451404 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1e40d2d80 msgr2=0x7fb1e4159dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:31.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.435+0000 7fb1ea780640 1 --2- 172.21.15.45:0/3113451404 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1e40d2d80 0x7fb1e4159dc0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb1d800e930 tx=0x7fb1d800edf0 comp rx=0 tx=0).stop 2023-11-28T18:37:31.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.435+0000 7fb1ea780640 1 -- 172.21.15.45:0/3113451404 shutdown_connections 2023-11-28T18:37:31.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.435+0000 7fb1ea780640 1 --2- 172.21.15.45:0/3113451404 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fb1d00668d0 0x7fb1d0068d90 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:31.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.435+0000 7fb1ea780640 1 --2- 172.21.15.45:0/3113451404 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb1e41609d0 0x7fb1e415a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:31.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.435+0000 7fb1ea780640 1 --2- 172.21.15.45:0/3113451404 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1e40d2d80 0x7fb1e4159dc0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:31.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.435+0000 7fb1ea780640 1 --2- 172.21.15.45:0/3113451404 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb1e40cdf80 0x7fb1e40cc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:31.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.435+0000 7fb1ea780640 1 -- 172.21.15.45:0/3113451404 >> 172.21.15.45:0/3113451404 conn(0x7fb1e40720a0 msgr2=0x7fb1e40b7de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:31.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.435+0000 7fb1ea780640 1 -- 172.21.15.45:0/3113451404 shutdown_connections 2023-11-28T18:37:31.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.435+0000 7fb1ea780640 1 -- 172.21.15.45:0/3113451404 wait complete. 2023-11-28T18:37:31.464 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-28T18:37:31.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.607+0000 7f5e6605f640 1 Processor -- start 2023-11-28T18:37:31.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.607+0000 7f5e6605f640 1 -- start start 2023-11-28T18:37:31.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.611+0000 7f5e6605f640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f5e601597f0 0x7f5e600b4650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:31.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.611+0000 7f5e6605f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5e600ce420 0x7f5e600b4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:31.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.611+0000 7f5e6605f640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e600cbc20 con 0x7f5e600b3f70 2023-11-28T18:37:31.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.611+0000 7f5e6605f640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e60071a40 con 0x7f5e600ce420 2023-11-28T18:37:31.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.611+0000 7f5e6605f640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e60071d20 con 0x7f5e601597f0 2023-11-28T18:37:31.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.611+0000 7f5e5ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5e600ce420 0x7f5e600b4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:31.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.611+0000 7f5e5effd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f5e600b3f70 0x7f5e600b2730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:50218/0 (socket says 172.21.15.45:50218) 2023-11-28T18:37:31.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.611+0000 7f5e5ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5e600ce420 0x7f5e600b4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48738/0 (socket says 172.21.15.45:48738) 2023-11-28T18:37:31.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.611+0000 7f5e5effd640 1 -- 172.21.15.45:0/297398790 learned_addr learned my addr 172.21.15.45:0/297398790 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:37:31.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.611+0000 7f5e5f7fe640 1 --2- 172.21.15.45:0/297398790 >> v2:172.21.15.190:3300/0 conn(0x7f5e601597f0 0x7f5e600b4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:31.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.611+0000 7f5e5ffff640 1 -- 172.21.15.45:0/297398790 >> v2:172.21.15.190:3300/0 conn(0x7f5e601597f0 msgr2=0x7f5e600b4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:31.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.611+0000 7f5e5ffff640 1 --2- 172.21.15.45:0/297398790 >> v2:172.21.15.190:3300/0 conn(0x7f5e601597f0 0x7f5e600b4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:31.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.611+0000 7f5e5ffff640 1 -- 172.21.15.45:0/297398790 >> v1:172.21.15.45:6789/0 conn(0x7f5e600b3f70 legacy=0x7f5e600b2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:31.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.611+0000 7f5e5ffff640 1 -- 172.21.15.45:0/297398790 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e60072000 con 0x7f5e600ce420 2023-11-28T18:37:31.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.615+0000 7f5e5ffff640 1 --2- 172.21.15.45:0/297398790 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e600ce420 0x7f5e600b4b90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5e600b1dc0 tx=0x7f5e5801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9f9da1a5cd80b3d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:31.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.615+0000 7f5e5e7fc640 1 -- 172.21.15.45:0/297398790 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e580a5840 con 0x7f5e600ce420 2023-11-28T18:37:31.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.615+0000 7f5e5e7fc640 1 -- 172.21.15.45:0/297398790 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e580a59a0 con 0x7f5e600ce420 2023-11-28T18:37:31.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.615+0000 7f5e5e7fc640 1 -- 172.21.15.45:0/297398790 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e580a5d30 con 0x7f5e600ce420 2023-11-28T18:37:31.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.615+0000 7f5e6605f640 1 -- 172.21.15.45:0/297398790 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e600ce420 msgr2=0x7f5e600b4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:31.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.615+0000 7f5e6605f640 1 --2- 172.21.15.45:0/297398790 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e600ce420 0x7f5e600b4b90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5e600b1dc0 tx=0x7f5e5801c910 comp rx=0 tx=0).stop 2023-11-28T18:37:31.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.615+0000 7f5e6605f640 1 -- 172.21.15.45:0/297398790 shutdown_connections 2023-11-28T18:37:31.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.615+0000 7f5e6605f640 1 --2- 172.21.15.45:0/297398790 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e600ce420 0x7f5e600b4b90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:31.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.615+0000 7f5e6605f640 1 --2- 172.21.15.45:0/297398790 >> v2:172.21.15.190:3300/0 conn(0x7f5e601597f0 0x7f5e600b4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:31.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.615+0000 7f5e6605f640 1 -- 172.21.15.45:0/297398790 >> 172.21.15.45:0/297398790 conn(0x7f5e600b0d00 msgr2=0x7f5e600b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:31.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.615+0000 7f5e6605f640 1 -- 172.21.15.45:0/297398790 shutdown_connections 2023-11-28T18:37:31.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.615+0000 7f5e6605f640 1 -- 172.21.15.45:0/297398790 wait complete. 2023-11-28T18:37:31.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.615+0000 7f5e6605f640 1 Processor -- start 2023-11-28T18:37:31.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.615+0000 7f5e6605f640 1 -- start start 2023-11-28T18:37:31.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.619+0000 7f5e6605f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e600b3f70 0x7f5e60140710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:31.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.619+0000 7f5e6605f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5e600ce420 0x7f5e6014e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:31.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.619+0000 7f5e6605f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5e601597f0 0x7f5e600cd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:31.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.619+0000 7f5e6605f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6014f120 con 0x7f5e600b3f70 2023-11-28T18:37:31.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.619+0000 7f5e6605f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6014f400 con 0x7f5e601597f0 2023-11-28T18:37:31.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.619+0000 7f5e6605f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6014f6e0 con 0x7f5e600ce420 2023-11-28T18:37:31.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.619+0000 7f5e5f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e600b3f70 0x7f5e60140710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:31.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.619+0000 7f5e5f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e600b3f70 0x7f5e60140710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48752/0 (socket says 172.21.15.45:48752) 2023-11-28T18:37:31.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.619+0000 7f5e5f7fe640 1 -- 172.21.15.45:0/2061344896 learned_addr learned my addr 172.21.15.45:0/2061344896 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:31.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.619+0000 7f5e5f7fe640 1 -- 172.21.15.45:0/2061344896 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5e600ce420 msgr2=0x7f5e6014e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:31.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.619+0000 7f5e5f7fe640 1 --2- 172.21.15.45:0/2061344896 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5e600ce420 0x7f5e6014e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:31.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.619+0000 7f5e5f7fe640 1 -- 172.21.15.45:0/2061344896 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5e601597f0 msgr2=0x7f5e600cd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:31.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.619+0000 7f5e5f7fe640 1 --2- 172.21.15.45:0/2061344896 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5e601597f0 0x7f5e600cd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:31.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.619+0000 7f5e5f7fe640 1 -- 172.21.15.45:0/2061344896 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e58009a70 con 0x7f5e600b3f70 2023-11-28T18:37:31.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.619+0000 7f5e5f7fe640 1 --2- 172.21.15.45:0/2061344896 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e600b3f70 0x7f5e60140710 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5e5000d5f0 tx=0x7f5e5000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:31.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.619+0000 7f5e47fff640 1 -- 172.21.15.45:0/2061344896 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e500125f0 con 0x7f5e600b3f70 2023-11-28T18:37:31.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.619+0000 7f5e47fff640 1 -- 172.21.15.45:0/2061344896 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e50012750 con 0x7f5e600b3f70 2023-11-28T18:37:31.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.619+0000 7f5e6605f640 1 -- 172.21.15.45:0/2061344896 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e6014f9c0 con 0x7f5e600b3f70 2023-11-28T18:37:31.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.619+0000 7f5e47fff640 1 -- 172.21.15.45:0/2061344896 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e50012ae0 con 0x7f5e600b3f70 2023-11-28T18:37:31.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.619+0000 7f5e6605f640 1 -- 172.21.15.45:0/2061344896 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e60140c50 con 0x7f5e600b3f70 2023-11-28T18:37:31.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.619+0000 7f5e6605f640 1 -- 172.21.15.45:0/2061344896 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e6015b1d0 con 0x7f5e600b3f70 2023-11-28T18:37:31.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.619+0000 7f5e47fff640 1 -- 172.21.15.45:0/2061344896 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f5e50012c40 con 0x7f5e600b3f70 2023-11-28T18:37:31.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.623+0000 7f5e47fff640 1 --2- 172.21.15.45:0/2061344896 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f5e4c0668d0 0x7f5e4c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:31.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.623+0000 7f5e47fff640 1 -- 172.21.15.45:0/2061344896 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f5e50084810 con 0x7f5e600b3f70 2023-11-28T18:37:31.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.623+0000 7f5e5effd640 1 --2- 172.21.15.45:0/2061344896 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f5e4c0668d0 0x7f5e4c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:31.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.623+0000 7f5e5effd640 1 --2- 172.21.15.45:0/2061344896 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f5e4c0668d0 0x7f5e4c068d90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5e6014a0d0 tx=0x7f5e54007a50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:31.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.627+0000 7f5e47fff640 1 -- 172.21.15.45:0/2061344896 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5e50051b90 con 0x7f5e600b3f70 2023-11-28T18:37:31.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:31.783+0000 7f5e6605f640 1 -- 172.21.15.45:0/2061344896 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f5e60069480 con 0x7f5e600b3f70 2023-11-28T18:37:32.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:32.435+0000 7f5e47fff640 1 -- 172.21.15.45:0/2061344896 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7f5e500551b0 con 0x7f5e600b3f70 2023-11-28T18:37:32.441 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' created 2023-11-28T18:37:32.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:32.439+0000 7f5e6605f640 1 -- 172.21.15.45:0/2061344896 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f5e4c0668d0 msgr2=0x7f5e4c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:32.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:32.439+0000 7f5e6605f640 1 --2- 172.21.15.45:0/2061344896 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f5e4c0668d0 0x7f5e4c068d90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5e6014a0d0 tx=0x7f5e54007a50 comp rx=0 tx=0).stop 2023-11-28T18:37:32.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:32.439+0000 7f5e6605f640 1 -- 172.21.15.45:0/2061344896 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e600b3f70 msgr2=0x7f5e60140710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:32.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:32.439+0000 7f5e6605f640 1 --2- 172.21.15.45:0/2061344896 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e600b3f70 0x7f5e60140710 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5e5000d5f0 tx=0x7f5e5000dab0 comp rx=0 tx=0).stop 2023-11-28T18:37:32.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:32.439+0000 7f5e6605f640 1 -- 172.21.15.45:0/2061344896 shutdown_connections 2023-11-28T18:37:32.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:32.439+0000 7f5e6605f640 1 --2- 172.21.15.45:0/2061344896 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f5e4c0668d0 0x7f5e4c068d90 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:32.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:32.439+0000 7f5e6605f640 1 --2- 172.21.15.45:0/2061344896 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5e601597f0 0x7f5e600cd2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:32.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:32.439+0000 7f5e6605f640 1 --2- 172.21.15.45:0/2061344896 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5e600ce420 0x7f5e6014e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:32.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:32.439+0000 7f5e6605f640 1 --2- 172.21.15.45:0/2061344896 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e600b3f70 0x7f5e60140710 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:32.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:32.439+0000 7f5e6605f640 1 -- 172.21.15.45:0/2061344896 >> 172.21.15.45:0/2061344896 conn(0x7f5e600b0d00 msgr2=0x7f5e601585d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:32.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:32.439+0000 7f5e6605f640 1 -- 172.21.15.45:0/2061344896 shutdown_connections 2023-11-28T18:37:32.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:32.439+0000 7f5e6605f640 1 -- 172.21.15.45:0/2061344896 wait complete. 2023-11-28T18:37:32.486 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-28T18:37:32.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:32.627+0000 7f3b080d6640 1 Processor -- start 2023-11-28T18:37:32.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:32.627+0000 7f3b080d6640 1 -- start start 2023-11-28T18:37:32.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:32.631+0000 7f3b080d6640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3b000b4780 0x7f3b0006cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:32.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:32.631+0000 7f3b080d6640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3b0015edd0 0x7f3b0015f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:32.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:32.631+0000 7f3b080d6640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b0015e940 con 0x7f3b001469a0 2023-11-28T18:37:32.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:32.631+0000 7f3b080d6640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b0015dd30 con 0x7f3b0015edd0 2023-11-28T18:37:32.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:32.631+0000 7f3b080d6640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0015e010 con 0x7f3b000b4780 2023-11-28T18:37:32.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:32.631+0000 7f3b05e72640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f3b001469a0 0x7f3b000b4070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:50230/0 (socket says 172.21.15.45:50230) 2023-11-28T18:37:32.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:32.631+0000 7f3b05e72640 1 -- 172.21.15.45:0/289273355 learned_addr learned my addr 172.21.15.45:0/289273355 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:37:32.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:32.631+0000 7f3b06673640 1 --2- 172.21.15.45:0/289273355 >> v2:172.21.15.45:3300/0 conn(0x7f3b0015edd0 0x7f3b0015f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:32.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:32.631+0000 7f3b05671640 1 --2- 172.21.15.45:0/289273355 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3b000b4780 0x7f3b0006cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:32.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:32.631+0000 7f3b06673640 1 -- 172.21.15.45:0/289273355 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3b000b4780 msgr2=0x7f3b0006cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:32.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:32.631+0000 7f3b06673640 1 --2- 172.21.15.45:0/289273355 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3b000b4780 0x7f3b0006cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:32.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:32.631+0000 7f3b06673640 1 -- 172.21.15.45:0/289273355 >> v1:172.21.15.45:6789/0 conn(0x7f3b001469a0 legacy=0x7f3b000b4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:32.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:32.631+0000 7f3b06673640 1 -- 172.21.15.45:0/289273355 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b0015e2f0 con 0x7f3b0015edd0 2023-11-28T18:37:32.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:32.631+0000 7f3b04e70640 1 -- 172.21.15.45:0/289273355 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 903064240 0 0) 0x7f3b0015e940 con 0x7f3b001469a0 2023-11-28T18:37:32.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:32.631+0000 7f3b06673640 1 --2- 172.21.15.45:0/289273355 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b0015edd0 0x7f3b0015f220 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3af8009d90 tx=0x7f3af801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97e36119426c8537 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:32.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:32.635+0000 7f3b04e70640 1 -- 172.21.15.45:0/289273355 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af80a5920 con 0x7f3b0015edd0 2023-11-28T18:37:32.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:32.635+0000 7f3b04e70640 1 -- 172.21.15.45:0/289273355 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3af80a5a80 con 0x7f3b0015edd0 2023-11-28T18:37:32.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:32.635+0000 7f3b04e70640 1 -- 172.21.15.45:0/289273355 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af80a5e10 con 0x7f3b0015edd0 2023-11-28T18:37:32.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:32.635+0000 7f3b080d6640 1 -- 172.21.15.45:0/289273355 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b0015edd0 msgr2=0x7f3b0015f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:32.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:32.635+0000 7f3b080d6640 1 --2- 172.21.15.45:0/289273355 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b0015edd0 0x7f3b0015f220 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3af8009d90 tx=0x7f3af801c950 comp rx=0 tx=0).stop 2023-11-28T18:37:32.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:32.635+0000 7f3b080d6640 1 -- 172.21.15.45:0/289273355 shutdown_connections 2023-11-28T18:37:32.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:32.635+0000 7f3b080d6640 1 --2- 172.21.15.45:0/289273355 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b0015edd0 0x7f3b0015f220 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:32.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:32.635+0000 7f3b080d6640 1 --2- 172.21.15.45:0/289273355 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3b000b4780 0x7f3b0006cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:32.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:32.635+0000 7f3b080d6640 1 -- 172.21.15.45:0/289273355 >> 172.21.15.45:0/289273355 conn(0x7f3b00070b80 msgr2=0x7f3b00066360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:32.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:32.635+0000 7f3b080d6640 1 -- 172.21.15.45:0/289273355 shutdown_connections 2023-11-28T18:37:32.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:32.635+0000 7f3b080d6640 1 -- 172.21.15.45:0/289273355 wait complete. 2023-11-28T18:37:32.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:32.635+0000 7f3b080d6640 1 Processor -- start 2023-11-28T18:37:32.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:32.635+0000 7f3b080d6640 1 -- start start 2023-11-28T18:37:32.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:32.635+0000 7f3b080d6640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3b000b4780 0x7f3b0013e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:32.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:32.635+0000 7f3b080d6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b001469a0 0x7f3b00166ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:32.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:32.635+0000 7f3b080d6640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3b0015edd0 0x7f3b00144cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:32.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:32.635+0000 7f3b080d6640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0013e5a0 con 0x7f3b001469a0 2023-11-28T18:37:32.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:32.635+0000 7f3b080d6640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0015bba0 con 0x7f3b0015edd0 2023-11-28T18:37:32.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:32.635+0000 7f3b080d6640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0015be80 con 0x7f3b000b4780 2023-11-28T18:37:32.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:32.635+0000 7f3b05671640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b001469a0 0x7f3b00166ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:32.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:32.635+0000 7f3b05671640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b001469a0 0x7f3b00166ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48772/0 (socket says 172.21.15.45:48772) 2023-11-28T18:37:32.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:32.635+0000 7f3b05671640 1 -- 172.21.15.45:0/158014637 learned_addr learned my addr 172.21.15.45:0/158014637 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:32.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:32.635+0000 7f3b05e72640 1 --2- 172.21.15.45:0/158014637 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3b000b4780 0x7f3b0013e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:32.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:32.635+0000 7f3b06673640 1 --2- 172.21.15.45:0/158014637 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3b0015edd0 0x7f3b00144cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:32.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:32.639+0000 7f3b05671640 1 -- 172.21.15.45:0/158014637 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3b000b4780 msgr2=0x7f3b0013e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:32.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:32.639+0000 7f3b05671640 1 --2- 172.21.15.45:0/158014637 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3b000b4780 0x7f3b0013e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:32.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:32.639+0000 7f3b05671640 1 -- 172.21.15.45:0/158014637 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3b0015edd0 msgr2=0x7f3b00144cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:32.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:32.639+0000 7f3b05671640 1 --2- 172.21.15.45:0/158014637 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3b0015edd0 0x7f3b00144cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:32.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:32.639+0000 7f3b05671640 1 -- 172.21.15.45:0/158014637 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af8009a70 con 0x7f3b001469a0 2023-11-28T18:37:32.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:32.639+0000 7f3b05671640 1 --2- 172.21.15.45:0/158014637 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b001469a0 0x7f3b00166ff0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3af000e930 tx=0x7f3af000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:32.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:32.639+0000 7f3af67fc640 1 -- 172.21.15.45:0/158014637 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af0009690 con 0x7f3b001469a0 2023-11-28T18:37:32.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:32.639+0000 7f3af67fc640 1 -- 172.21.15.45:0/158014637 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3af000ca00 con 0x7f3b001469a0 2023-11-28T18:37:32.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:32.639+0000 7f3b080d6640 1 -- 172.21.15.45:0/158014637 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b0015c160 con 0x7f3b001469a0 2023-11-28T18:37:32.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:32.639+0000 7f3af67fc640 1 -- 172.21.15.45:0/158014637 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af000cd70 con 0x7f3b001469a0 2023-11-28T18:37:32.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:32.639+0000 7f3b080d6640 1 -- 172.21.15.45:0/158014637 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b0015c720 con 0x7f3b001469a0 2023-11-28T18:37:32.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:32.639+0000 7f3b080d6640 1 -- 172.21.15.45:0/158014637 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b00069410 con 0x7f3b001469a0 2023-11-28T18:37:32.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:32.639+0000 7f3af67fc640 1 -- 172.21.15.45:0/158014637 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f3af0013470 con 0x7f3b001469a0 2023-11-28T18:37:32.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:32.639+0000 7f3af67fc640 1 --2- 172.21.15.45:0/158014637 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f3ae40668d0 0x7f3ae4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:32.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:32.639+0000 7f3af67fc640 1 -- 172.21.15.45:0/158014637 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f3af0084620 con 0x7f3b001469a0 2023-11-28T18:37:32.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:32.643+0000 7f3b05e72640 1 --2- 172.21.15.45:0/158014637 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f3ae40668d0 0x7f3ae4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:32.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:32.643+0000 7f3b05e72640 1 --2- 172.21.15.45:0/158014637 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f3ae40668d0 0x7f3ae4068d90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3afc007fd0 tx=0x7f3afc007d60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:32.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:32.647+0000 7f3af67fc640 1 -- 172.21.15.45:0/158014637 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3af0051990 con 0x7f3b001469a0 2023-11-28T18:37:32.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:32.835+0000 7f3b080d6640 1 -- 172.21.15.45:0/158014637 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f3b001424c0 con 0x7f3b001469a0 2023-11-28T18:37:33.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.439+0000 7f3af67fc640 1 -- 172.21.15.45:0/158014637 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f3af0054fb0 con 0x7f3b001469a0 2023-11-28T18:37:33.443 INFO:teuthology.orchestra.run.smithi045.stderr:new fs with metadata pool 2 and data pool 3 2023-11-28T18:37:33.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.439+0000 7f3b080d6640 1 -- 172.21.15.45:0/158014637 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f3ae40668d0 msgr2=0x7f3ae4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:33.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.439+0000 7f3b080d6640 1 --2- 172.21.15.45:0/158014637 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f3ae40668d0 0x7f3ae4068d90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3afc007fd0 tx=0x7f3afc007d60 comp rx=0 tx=0).stop 2023-11-28T18:37:33.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.439+0000 7f3b080d6640 1 -- 172.21.15.45:0/158014637 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b001469a0 msgr2=0x7f3b00166ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:33.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.439+0000 7f3b080d6640 1 --2- 172.21.15.45:0/158014637 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b001469a0 0x7f3b00166ff0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3af000e930 tx=0x7f3af000edf0 comp rx=0 tx=0).stop 2023-11-28T18:37:33.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.439+0000 7f3b080d6640 1 -- 172.21.15.45:0/158014637 shutdown_connections 2023-11-28T18:37:33.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.439+0000 7f3b080d6640 1 --2- 172.21.15.45:0/158014637 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f3ae40668d0 0x7f3ae4068d90 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:33.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.439+0000 7f3b080d6640 1 --2- 172.21.15.45:0/158014637 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3b0015edd0 0x7f3b00144cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:33.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.439+0000 7f3b080d6640 1 --2- 172.21.15.45:0/158014637 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b001469a0 0x7f3b00166ff0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:33.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.439+0000 7f3b080d6640 1 --2- 172.21.15.45:0/158014637 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3b000b4780 0x7f3b0013e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:33.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.439+0000 7f3b080d6640 1 -- 172.21.15.45:0/158014637 >> 172.21.15.45:0/158014637 conn(0x7f3b00070b80 msgr2=0x7f3b0006e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:33.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.439+0000 7f3b080d6640 1 -- 172.21.15.45:0/158014637 shutdown_connections 2023-11-28T18:37:33.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.443+0000 7f3b080d6640 1 -- 172.21.15.45:0/158014637 wait complete. 2023-11-28T18:37:33.476 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T18:37:33.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.615+0000 7f4fe8a6b640 1 Processor -- start 2023-11-28T18:37:33.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.615+0000 7f4fe8a6b640 1 -- start start 2023-11-28T18:37:33.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.619+0000 7f4fe8a6b640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f4fe406d570 0x7f4fe406d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:33.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.619+0000 7f4fe8a6b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4fe4071790 0x7f4fe4071c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:33.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.619+0000 7f4fe8a6b640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fe406df10 con 0x7f4fe4143bc0 2023-11-28T18:37:33.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.619+0000 7f4fe8a6b640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fe4071300 con 0x7f4fe4071790 2023-11-28T18:37:33.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.619+0000 7f4fe8a6b640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fe40706f0 con 0x7f4fe406d570 2023-11-28T18:37:33.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.619+0000 7f4fe2d9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4fe4071790 0x7f4fe4071c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:33.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.619+0000 7f4fe2d9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4fe4071790 0x7f4fe4071c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48784/0 (socket says 172.21.15.45:48784) 2023-11-28T18:37:33.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.619+0000 7f4fe2d9d640 1 -- 172.21.15.45:0/1337149121 learned_addr learned my addr 172.21.15.45:0/1337149121 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:33.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.619+0000 7f4fdbfff640 1 --2- 172.21.15.45:0/1337149121 >> v2:172.21.15.190:3300/0 conn(0x7f4fe406d570 0x7f4fe406d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:33.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.619+0000 7f4fe2d9d640 1 -- 172.21.15.45:0/1337149121 >> v2:172.21.15.190:3300/0 conn(0x7f4fe406d570 msgr2=0x7f4fe406d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:33.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.619+0000 7f4fe2d9d640 1 --2- 172.21.15.45:0/1337149121 >> v2:172.21.15.190:3300/0 conn(0x7f4fe406d570 0x7f4fe406d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:33.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.619+0000 7f4fe2d9d640 1 -- 172.21.15.45:0/1337149121 >> v1:172.21.15.190:6789/0 conn(0x7f4fe4143bc0 legacy=0x7f4fe41442e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:33.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.619+0000 7f4fe2d9d640 1 -- 172.21.15.45:0/1337149121 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fe40709d0 con 0x7f4fe4071790 2023-11-28T18:37:33.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.623+0000 7f4fe2d9d640 1 --2- 172.21.15.45:0/1337149121 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fe4071790 0x7f4fe4071c20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4fe406e890 tx=0x7f4fdc01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3221c6c0c678ed83 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:33.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.623+0000 7f4fe1d9b640 1 -- 172.21.15.45:0/1337149121 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fdc0a5820 con 0x7f4fe4071790 2023-11-28T18:37:33.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.623+0000 7f4fe1d9b640 1 -- 172.21.15.45:0/1337149121 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fdc0a5980 con 0x7f4fe4071790 2023-11-28T18:37:33.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.623+0000 7f4fe1d9b640 1 -- 172.21.15.45:0/1337149121 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fdc0a5d10 con 0x7f4fe4071790 2023-11-28T18:37:33.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.623+0000 7f4fe8a6b640 1 -- 172.21.15.45:0/1337149121 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fe4071790 msgr2=0x7f4fe4071c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:33.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.623+0000 7f4fe8a6b640 1 --2- 172.21.15.45:0/1337149121 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fe4071790 0x7f4fe4071c20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4fe406e890 tx=0x7f4fdc01c960 comp rx=0 tx=0).stop 2023-11-28T18:37:33.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.623+0000 7f4fe8a6b640 1 -- 172.21.15.45:0/1337149121 shutdown_connections 2023-11-28T18:37:33.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.623+0000 7f4fe8a6b640 1 --2- 172.21.15.45:0/1337149121 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fe4071790 0x7f4fe4071c20 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:33.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.623+0000 7f4fe8a6b640 1 --2- 172.21.15.45:0/1337149121 >> v2:172.21.15.190:3300/0 conn(0x7f4fe406d570 0x7f4fe406d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:33.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.623+0000 7f4fe8a6b640 1 -- 172.21.15.45:0/1337149121 >> 172.21.15.45:0/1337149121 conn(0x7f4fe406ab70 msgr2=0x7f4fe40b0b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:33.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.623+0000 7f4fe8a6b640 1 -- 172.21.15.45:0/1337149121 shutdown_connections 2023-11-28T18:37:33.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.623+0000 7f4fe8a6b640 1 -- 172.21.15.45:0/1337149121 wait complete. 2023-11-28T18:37:33.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.623+0000 7f4fe8a6b640 1 Processor -- start 2023-11-28T18:37:33.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.623+0000 7f4fe8a6b640 1 -- start start 2023-11-28T18:37:33.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.627+0000 7f4fe8a6b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4fe406d570 0x7f4fe41594e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:33.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.627+0000 7f4fe8a6b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4fe4071790 0x7f4fe41f6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:33.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.627+0000 7f4fe8a6b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fe4143bc0 0x7f4fe4132260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:33.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.627+0000 7f4fe8a6b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe41f3ec0 con 0x7f4fe4143bc0 2023-11-28T18:37:33.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.627+0000 7f4fe8a6b640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe41f40b0 con 0x7f4fe4071790 2023-11-28T18:37:33.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.627+0000 7f4fe8a6b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe41f4390 con 0x7f4fe406d570 2023-11-28T18:37:33.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.627+0000 7f4fe2d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fe4143bc0 0x7f4fe4132260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:33.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.627+0000 7f4fe2d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fe4143bc0 0x7f4fe4132260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48788/0 (socket says 172.21.15.45:48788) 2023-11-28T18:37:33.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.627+0000 7f4fe2d9d640 1 -- 172.21.15.45:0/3999427465 learned_addr learned my addr 172.21.15.45:0/3999427465 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:33.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.627+0000 7f4fe259c640 1 --2- 172.21.15.45:0/3999427465 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4fe406d570 0x7f4fe41594e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:33.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.627+0000 7f4fdbfff640 1 --2- 172.21.15.45:0/3999427465 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4fe4071790 0x7f4fe41f6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:33.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.627+0000 7f4fe2d9d640 1 -- 172.21.15.45:0/3999427465 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4fe406d570 msgr2=0x7f4fe41594e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:33.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.627+0000 7f4fe2d9d640 1 --2- 172.21.15.45:0/3999427465 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4fe406d570 0x7f4fe41594e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:33.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.627+0000 7f4fe2d9d640 1 -- 172.21.15.45:0/3999427465 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4fe4071790 msgr2=0x7f4fe41f6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:33.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.627+0000 7f4fe2d9d640 1 --2- 172.21.15.45:0/3999427465 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4fe4071790 0x7f4fe41f6a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:33.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.627+0000 7f4fe2d9d640 1 -- 172.21.15.45:0/3999427465 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fdc009b30 con 0x7f4fe4143bc0 2023-11-28T18:37:33.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.627+0000 7f4fe259c640 1 --2- 172.21.15.45:0/3999427465 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4fe406d570 0x7f4fe41594e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:37:33.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.627+0000 7f4fdbfff640 1 --2- 172.21.15.45:0/3999427465 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4fe4071790 0x7f4fe41f6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:37:33.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.627+0000 7f4fe2d9d640 1 --2- 172.21.15.45:0/3999427465 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fe4143bc0 0x7f4fe4132260 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc01a590 tx=0x7f4fdc019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:33.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.627+0000 7f4fdaffd640 1 -- 172.21.15.45:0/3999427465 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fdc0b8670 con 0x7f4fe4143bc0 2023-11-28T18:37:33.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.627+0000 7f4fdaffd640 1 -- 172.21.15.45:0/3999427465 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fdc0b87d0 con 0x7f4fe4143bc0 2023-11-28T18:37:33.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.627+0000 7f4fdaffd640 1 -- 172.21.15.45:0/3999427465 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fdc0b8b80 con 0x7f4fe4143bc0 2023-11-28T18:37:33.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.627+0000 7f4fe8a6b640 1 -- 172.21.15.45:0/3999427465 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fe41f4670 con 0x7f4fe4143bc0 2023-11-28T18:37:33.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.627+0000 7f4fe8a6b640 1 -- 172.21.15.45:0/3999427465 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fe41f4c30 con 0x7f4fe4143bc0 2023-11-28T18:37:33.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.627+0000 7f4fe8a6b640 1 -- 172.21.15.45:0/3999427465 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fe41f4e20 con 0x7f4fe4143bc0 2023-11-28T18:37:33.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.627+0000 7f4fdaffd640 1 -- 172.21.15.45:0/3999427465 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f4fdc0b8ce0 con 0x7f4fe4143bc0 2023-11-28T18:37:33.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.631+0000 7f4fdaffd640 1 --2- 172.21.15.45:0/3999427465 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4fc40668d0 0x7f4fc4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:33.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.631+0000 7f4fdaffd640 1 -- 172.21.15.45:0/3999427465 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4fdc11fb80 con 0x7f4fe4143bc0 2023-11-28T18:37:33.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.631+0000 7f4fe259c640 1 --2- 172.21.15.45:0/3999427465 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4fc40668d0 0x7f4fc4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:33.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.631+0000 7f4fe259c640 1 --2- 172.21.15.45:0/3999427465 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4fc40668d0 0x7f4fc4068d90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4fd4003ec0 tx=0x7f4fd4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:33.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.635+0000 7f4fdaffd640 1 -- 172.21.15.45:0/3999427465 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4fdc0ece40 con 0x7f4fe4143bc0 2023-11-28T18:37:33.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.795+0000 7f4fe8a6b640 1 -- 172.21.15.45:0/3999427465 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4fe41f4e20 con 0x7f4fe4143bc0 2023-11-28T18:37:33.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.795+0000 7f4fdaffd640 1 -- 172.21.15.45:0/3999427465 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16482 (secure 0 0 0) 0x7f4fdc11fe60 con 0x7f4fe4143bc0 2023-11-28T18:37:33.800 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:37:33.800 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":19,"fsid":"d10f5cd6-1d00-4019-99b6-6fa435498a15","created":"2023-11-28T18:37:08.189030+0000","modified":"2023-11-28T18:37:32.842654+0000","last_up_change":"2023-11-28T18:37:20.196124+0000","last_in_change":"2023-11-28T18:37:10.742043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T18:37:21.293917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T18:37:31.384760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T18:37:31.834769+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"84465384-103c-4f2c-a45a-96f5bb9c835f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6809","nonce":555237322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6811","nonce":555237322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6815","nonce":555237322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6813","nonce":555237322}]},"public_addr":"172.21.15.45:6809/555237322","cluster_addr":"172.21.15.45:6811/555237322","heartbeat_back_addr":"172.21.15.45:6815/555237322","heartbeat_front_addr":"172.21.15.45:6813/555237322","state":["exists","up"]},{"osd":1,"uuid":"7d9eed24-a58f-42c7-a787-ac06be8553fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6801","nonce":2857063763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6803","nonce":2857063763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6807","nonce":2857063763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6805","nonce":2857063763}]},"public_addr":"172.21.15.45:6801/2857063763","cluster_addr":"172.21.15.45:6803/2857063763","heartbeat_back_addr":"172.21.15.45:6807/2857063763","heartbeat_front_addr":"172.21.15.45:6805/2857063763","state":["exists","up"]},{"osd":2,"uuid":"575eeccc-4abf-45b4-9caf-f3e797859588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6817","nonce":193884539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6819","nonce":193884539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6823","nonce":193884539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6821","nonce":193884539}]},"public_addr":"172.21.15.45:6817/193884539","cluster_addr":"172.21.15.45:6819/193884539","heartbeat_back_addr":"172.21.15.45:6823/193884539","heartbeat_front_addr":"172.21.15.45:6821/193884539","state":["exists","up"]},{"osd":3,"uuid":"9b0290d6-9a52-4bc8-b2a1-7622c5dc8e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6825","nonce":78541084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6827","nonce":78541084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6831","nonce":78541084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6829","nonce":78541084}]},"public_addr":"172.21.15.45:6825/78541084","cluster_addr":"172.21.15.45:6827/78541084","heartbeat_back_addr":"172.21.15.45:6831/78541084","heartbeat_front_addr":"172.21.15.45:6829/78541084","state":["exists","up"]},{"osd":4,"uuid":"ce632829-f027-4fbf-a627-02c571aa9d53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6809","nonce":1537591987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6811","nonce":1537591987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6815","nonce":1537591987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6813","nonce":1537591987}]},"public_addr":"172.21.15.190:6809/1537591987","cluster_addr":"172.21.15.190:6811/1537591987","heartbeat_back_addr":"172.21.15.190:6815/1537591987","heartbeat_front_addr":"172.21.15.190:6813/1537591987","state":["exists","up"]},{"osd":5,"uuid":"8700b609-27be-40bd-a251-4c0ae0a29ead","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6801","nonce":3296698407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6803","nonce":3296698407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6807","nonce":3296698407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6805","nonce":3296698407}]},"public_addr":"172.21.15.190:6801/3296698407","cluster_addr":"172.21.15.190:6803/3296698407","heartbeat_back_addr":"172.21.15.190:6807/3296698407","heartbeat_front_addr":"172.21.15.190:6805/3296698407","state":["exists","up"]},{"osd":6,"uuid":"44ce4a40-e6ff-4f4d-8e8a-7341e5c91f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6817","nonce":2317686718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6819","nonce":2317686718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6823","nonce":2317686718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6821","nonce":2317686718}]},"public_addr":"172.21.15.190:6817/2317686718","cluster_addr":"172.21.15.190:6819/2317686718","heartbeat_back_addr":"172.21.15.190:6823/2317686718","heartbeat_front_addr":"172.21.15.190:6821/2317686718","state":["exists","up"]},{"osd":7,"uuid":"192238c9-1423-4b7e-ac8f-84ba32113ddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6825","nonce":2493232051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6827","nonce":2493232051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6831","nonce":2493232051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6829","nonce":2493232051}]},"public_addr":"172.21.15.190:6825/2493232051","cluster_addr":"172.21.15.190:6827/2493232051","heartbeat_back_addr":"172.21.15.190:6831/2493232051","heartbeat_front_addr":"172.21.15.190:6829/2493232051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.393552+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.385453+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.361421+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.366408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.363226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.276007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.414605+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.445885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T18:37:33.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.795+0000 7f4fe8a6b640 1 -- 172.21.15.45:0/3999427465 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4fc40668d0 msgr2=0x7f4fc4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:33.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.795+0000 7f4fe8a6b640 1 --2- 172.21.15.45:0/3999427465 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4fc40668d0 0x7f4fc4068d90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4fd4003ec0 tx=0x7f4fd4009040 comp rx=0 tx=0).stop 2023-11-28T18:37:33.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.795+0000 7f4fe8a6b640 1 -- 172.21.15.45:0/3999427465 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fe4143bc0 msgr2=0x7f4fe4132260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:33.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.795+0000 7f4fe8a6b640 1 --2- 172.21.15.45:0/3999427465 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fe4143bc0 0x7f4fe4132260 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc01a590 tx=0x7f4fdc019700 comp rx=0 tx=0).stop 2023-11-28T18:37:33.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.795+0000 7f4fe8a6b640 1 -- 172.21.15.45:0/3999427465 shutdown_connections 2023-11-28T18:37:33.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.795+0000 7f4fe8a6b640 1 --2- 172.21.15.45:0/3999427465 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4fc40668d0 0x7f4fc4068d90 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:33.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.795+0000 7f4fe8a6b640 1 --2- 172.21.15.45:0/3999427465 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fe4143bc0 0x7f4fe4132260 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:33.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.795+0000 7f4fe8a6b640 1 --2- 172.21.15.45:0/3999427465 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4fe4071790 0x7f4fe41f6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:33.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.795+0000 7f4fe8a6b640 1 --2- 172.21.15.45:0/3999427465 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4fe406d570 0x7f4fe41594e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:33.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.795+0000 7f4fe8a6b640 1 -- 172.21.15.45:0/3999427465 >> 172.21.15.45:0/3999427465 conn(0x7f4fe406ab70 msgr2=0x7f4fe4139470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:33.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.795+0000 7f4fe8a6b640 1 -- 172.21.15.45:0/3999427465 shutdown_connections 2023-11-28T18:37:33.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.795+0000 7f4fe8a6b640 1 -- 172.21.15.45:0/3999427465 wait complete. 2023-11-28T18:37:33.821 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T18:37:33.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.959+0000 7ff41b32a640 1 Processor -- start 2023-11-28T18:37:33.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.959+0000 7ff41b32a640 1 -- start start 2023-11-28T18:37:33.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.963+0000 7ff41b32a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff414146c00 0x7ff41415e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:33.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.963+0000 7ff41b32a640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff41406e8f0 0x7ff41406ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:33.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.963+0000 7ff41b32a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff4140b2bb0 0x7ff4140b3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:33.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.963+0000 7ff41b32a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff41415e970 con 0x7ff414146c00 2023-11-28T18:37:33.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.963+0000 7ff41b32a640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4140b3580 con 0x7ff41406e8f0 2023-11-28T18:37:33.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.963+0000 7ff41b32a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff414146fe0 con 0x7ff4140b2bb0 2023-11-28T18:37:33.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.963+0000 7ff4190c6640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff414146c00 0x7ff41415e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:33.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.963+0000 7ff4190c6640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff414146c00 0x7ff41415e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48800/0 (socket says 172.21.15.45:48800) 2023-11-28T18:37:33.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.963+0000 7ff4190c6640 1 -- 172.21.15.45:0/2120228789 learned_addr learned my addr 172.21.15.45:0/2120228789 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:33.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.963+0000 7ff4198c7640 1 --2- 172.21.15.45:0/2120228789 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff4140b2bb0 0x7ff4140b3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:33.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.963+0000 7ff4188c5640 1 --2- 172.21.15.45:0/2120228789 >> v2:172.21.15.190:3300/0 conn(0x7ff41406e8f0 0x7ff41406ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:33.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.963+0000 7ff4190c6640 1 -- 172.21.15.45:0/2120228789 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff4140b2bb0 msgr2=0x7ff4140b3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:33.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.963+0000 7ff4190c6640 1 --2- 172.21.15.45:0/2120228789 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff4140b2bb0 0x7ff4140b3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:33.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.963+0000 7ff4190c6640 1 -- 172.21.15.45:0/2120228789 >> v2:172.21.15.190:3300/0 conn(0x7ff41406e8f0 msgr2=0x7ff41406ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:33.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.963+0000 7ff4190c6640 1 --2- 172.21.15.45:0/2120228789 >> v2:172.21.15.190:3300/0 conn(0x7ff41406e8f0 0x7ff41406ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:33.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.963+0000 7ff4190c6640 1 -- 172.21.15.45:0/2120228789 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff41406f390 con 0x7ff414146c00 2023-11-28T18:37:33.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.963+0000 7ff4198c7640 1 --2- 172.21.15.45:0/2120228789 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff4140b2bb0 0x7ff4140b3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:37:33.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.963+0000 7ff4188c5640 1 --2- 172.21.15.45:0/2120228789 >> v2:172.21.15.190:3300/0 conn(0x7ff41406e8f0 0x7ff41406ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:37:33.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.967+0000 7ff4190c6640 1 --2- 172.21.15.45:0/2120228789 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff414146c00 0x7ff41415e430 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff4140b3ce0 tx=0x7ff41001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=125e769525fcda90 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:33.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.967+0000 7ff40bfff640 1 -- 172.21.15.45:0/2120228789 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4100aa5f0 con 0x7ff414146c00 2023-11-28T18:37:33.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.967+0000 7ff40bfff640 1 -- 172.21.15.45:0/2120228789 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4100aa750 con 0x7ff414146c00 2023-11-28T18:37:33.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.967+0000 7ff40bfff640 1 -- 172.21.15.45:0/2120228789 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4100aaae0 con 0x7ff414146c00 2023-11-28T18:37:33.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.967+0000 7ff41b32a640 1 -- 172.21.15.45:0/2120228789 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff414146c00 msgr2=0x7ff41415e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:33.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.967+0000 7ff41b32a640 1 --2- 172.21.15.45:0/2120228789 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff414146c00 0x7ff41415e430 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff4140b3ce0 tx=0x7ff41001c4d0 comp rx=0 tx=0).stop 2023-11-28T18:37:33.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.967+0000 7ff41b32a640 1 -- 172.21.15.45:0/2120228789 shutdown_connections 2023-11-28T18:37:33.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.967+0000 7ff41b32a640 1 --2- 172.21.15.45:0/2120228789 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff4140b2bb0 0x7ff4140b3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:33.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.967+0000 7ff41b32a640 1 --2- 172.21.15.45:0/2120228789 >> v2:172.21.15.190:3300/0 conn(0x7ff41406e8f0 0x7ff41406ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:33.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.967+0000 7ff41b32a640 1 --2- 172.21.15.45:0/2120228789 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff414146c00 0x7ff41415e430 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:33.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.967+0000 7ff41b32a640 1 -- 172.21.15.45:0/2120228789 >> 172.21.15.45:0/2120228789 conn(0x7ff41406a570 msgr2=0x7ff41406a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:33.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.967+0000 7ff41b32a640 1 -- 172.21.15.45:0/2120228789 shutdown_connections 2023-11-28T18:37:33.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.967+0000 7ff41b32a640 1 -- 172.21.15.45:0/2120228789 wait complete. 2023-11-28T18:37:33.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.967+0000 7ff41b32a640 1 Processor -- start 2023-11-28T18:37:33.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.971+0000 7ff41b32a640 1 -- start start 2023-11-28T18:37:33.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.971+0000 7ff41b32a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff41406e8f0 0x7ff4141f9770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:33.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.971+0000 7ff41b32a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4140b2bb0 0x7ff414167770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:33.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.971+0000 7ff41b32a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff414146c00 0x7ff414167cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:33.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.971+0000 7ff41b32a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4140b5570 con 0x7ff41406e8f0 2023-11-28T18:37:33.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.971+0000 7ff41b32a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4141f9cb0 con 0x7ff4140b2bb0 2023-11-28T18:37:33.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.971+0000 7ff41b32a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4140b4960 con 0x7ff414146c00 2023-11-28T18:37:33.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.971+0000 7ff4190c6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff41406e8f0 0x7ff4141f9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:33.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.971+0000 7ff4190c6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff41406e8f0 0x7ff4141f9770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48804/0 (socket says 172.21.15.45:48804) 2023-11-28T18:37:33.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.971+0000 7ff4190c6640 1 -- 172.21.15.45:0/3663388478 learned_addr learned my addr 172.21.15.45:0/3663388478 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:33.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.971+0000 7ff4198c7640 1 --2- 172.21.15.45:0/3663388478 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff414146c00 0x7ff414167cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:33.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.971+0000 7ff4188c5640 1 --2- 172.21.15.45:0/3663388478 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4140b2bb0 0x7ff414167770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:33.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.971+0000 7ff4190c6640 1 -- 172.21.15.45:0/3663388478 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff414146c00 msgr2=0x7ff414167cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:33.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.971+0000 7ff4190c6640 1 --2- 172.21.15.45:0/3663388478 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff414146c00 0x7ff414167cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:33.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.971+0000 7ff4190c6640 1 -- 172.21.15.45:0/3663388478 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4140b2bb0 msgr2=0x7ff414167770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:33.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.971+0000 7ff4190c6640 1 --2- 172.21.15.45:0/3663388478 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4140b2bb0 0x7ff414167770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:33.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.971+0000 7ff4190c6640 1 -- 172.21.15.45:0/3663388478 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4100094d0 con 0x7ff41406e8f0 2023-11-28T18:37:33.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.971+0000 7ff4190c6640 1 --2- 172.21.15.45:0/3663388478 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff41406e8f0 0x7ff4141f9770 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff41001ab80 tx=0x7ff41001ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:33.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.971+0000 7ff409ffb640 1 -- 172.21.15.45:0/3663388478 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4100b3800 con 0x7ff41406e8f0 2023-11-28T18:37:33.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.971+0000 7ff409ffb640 1 -- 172.21.15.45:0/3663388478 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4100b3980 con 0x7ff41406e8f0 2023-11-28T18:37:33.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.971+0000 7ff41b32a640 1 -- 172.21.15.45:0/3663388478 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4140b4c40 con 0x7ff41406e8f0 2023-11-28T18:37:33.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.971+0000 7ff409ffb640 1 -- 172.21.15.45:0/3663388478 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4100b3d30 con 0x7ff41406e8f0 2023-11-28T18:37:33.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.971+0000 7ff41b32a640 1 -- 172.21.15.45:0/3663388478 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4140b5200 con 0x7ff41406e8f0 2023-11-28T18:37:33.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.971+0000 7ff41b32a640 1 -- 172.21.15.45:0/3663388478 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff414069480 con 0x7ff41406e8f0 2023-11-28T18:37:33.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.975+0000 7ff409ffb640 1 -- 172.21.15.45:0/3663388478 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ff4100c6440 con 0x7ff41406e8f0 2023-11-28T18:37:33.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.975+0000 7ff409ffb640 1 --2- 172.21.15.45:0/3663388478 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff3f8066900 0x7ff3f8068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:33.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.975+0000 7ff409ffb640 1 -- 172.21.15.45:0/3663388478 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff4100a7070 con 0x7ff41406e8f0 2023-11-28T18:37:33.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.975+0000 7ff4188c5640 1 --2- 172.21.15.45:0/3663388478 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff3f8066900 0x7ff3f8068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:33.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.975+0000 7ff4188c5640 1 --2- 172.21.15.45:0/3663388478 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff3f8066900 0x7ff3f8068dc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff4140675f0 tx=0x7ff404008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:33.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:33.983+0000 7ff409ffb640 1 -- 172.21.15.45:0/3663388478 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff4100ec150 con 0x7ff41406e8f0 2023-11-28T18:37:34.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.143+0000 7ff41b32a640 1 -- 172.21.15.45:0/3663388478 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4140d0880 con 0x7ff41406e8f0 2023-11-28T18:37:34.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.143+0000 7ff409ffb640 1 -- 172.21.15.45:0/3663388478 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16469 (secure 0 0 0) 0x7ff4100ef770 con 0x7ff41406e8f0 2023-11-28T18:37:34.148 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:37:34.149 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":20,"fsid":"d10f5cd6-1d00-4019-99b6-6fa435498a15","created":"2023-11-28T18:37:08.189030+0000","modified":"2023-11-28T18:37:33.971141+0000","last_up_change":"2023-11-28T18:37:20.196124+0000","last_in_change":"2023-11-28T18:37:10.742043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T18:37:21.293917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T18:37:31.384760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T18:37:31.834769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"84465384-103c-4f2c-a45a-96f5bb9c835f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6809","nonce":555237322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6811","nonce":555237322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6815","nonce":555237322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6813","nonce":555237322}]},"public_addr":"172.21.15.45:6809/555237322","cluster_addr":"172.21.15.45:6811/555237322","heartbeat_back_addr":"172.21.15.45:6815/555237322","heartbeat_front_addr":"172.21.15.45:6813/555237322","state":["exists","up"]},{"osd":1,"uuid":"7d9eed24-a58f-42c7-a787-ac06be8553fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6801","nonce":2857063763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6803","nonce":2857063763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6807","nonce":2857063763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6805","nonce":2857063763}]},"public_addr":"172.21.15.45:6801/2857063763","cluster_addr":"172.21.15.45:6803/2857063763","heartbeat_back_addr":"172.21.15.45:6807/2857063763","heartbeat_front_addr":"172.21.15.45:6805/2857063763","state":["exists","up"]},{"osd":2,"uuid":"575eeccc-4abf-45b4-9caf-f3e797859588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6817","nonce":193884539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6819","nonce":193884539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6823","nonce":193884539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6821","nonce":193884539}]},"public_addr":"172.21.15.45:6817/193884539","cluster_addr":"172.21.15.45:6819/193884539","heartbeat_back_addr":"172.21.15.45:6823/193884539","heartbeat_front_addr":"172.21.15.45:6821/193884539","state":["exists","up"]},{"osd":3,"uuid":"9b0290d6-9a52-4bc8-b2a1-7622c5dc8e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6825","nonce":78541084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6827","nonce":78541084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6831","nonce":78541084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6829","nonce":78541084}]},"public_addr":"172.21.15.45:6825/78541084","cluster_addr":"172.21.15.45:6827/78541084","heartbeat_back_addr":"172.21.15.45:6831/78541084","heartbeat_front_addr":"172.21.15.45:6829/78541084","state":["exists","up"]},{"osd":4,"uuid":"ce632829-f027-4fbf-a627-02c571aa9d53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6809","nonce":1537591987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6811","nonce":1537591987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6815","nonce":1537591987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6813","nonce":1537591987}]},"public_addr":"172.21.15.190:6809/1537591987","cluster_addr":"172.21.15.190:6811/1537591987","heartbeat_back_addr":"172.21.15.190:6815/1537591987","heartbeat_front_addr":"172.21.15.190:6813/1537591987","state":["exists","up"]},{"osd":5,"uuid":"8700b609-27be-40bd-a251-4c0ae0a29ead","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6801","nonce":3296698407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6803","nonce":3296698407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6807","nonce":3296698407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6805","nonce":3296698407}]},"public_addr":"172.21.15.190:6801/3296698407","cluster_addr":"172.21.15.190:6803/3296698407","heartbeat_back_addr":"172.21.15.190:6807/3296698407","heartbeat_front_addr":"172.21.15.190:6805/3296698407","state":["exists","up"]},{"osd":6,"uuid":"44ce4a40-e6ff-4f4d-8e8a-7341e5c91f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6817","nonce":2317686718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6819","nonce":2317686718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6823","nonce":2317686718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6821","nonce":2317686718}]},"public_addr":"172.21.15.190:6817/2317686718","cluster_addr":"172.21.15.190:6819/2317686718","heartbeat_back_addr":"172.21.15.190:6823/2317686718","heartbeat_front_addr":"172.21.15.190:6821/2317686718","state":["exists","up"]},{"osd":7,"uuid":"192238c9-1423-4b7e-ac8f-84ba32113ddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6825","nonce":2493232051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6827","nonce":2493232051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6831","nonce":2493232051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6829","nonce":2493232051}]},"public_addr":"172.21.15.190:6825/2493232051","cluster_addr":"172.21.15.190:6827/2493232051","heartbeat_back_addr":"172.21.15.190:6831/2493232051","heartbeat_front_addr":"172.21.15.190:6829/2493232051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.393552+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.385453+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.361421+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.366408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.363226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.276007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.414605+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.445885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T18:37:34.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.147+0000 7ff41b32a640 1 -- 172.21.15.45:0/3663388478 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff3f8066900 msgr2=0x7ff3f8068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:34.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.147+0000 7ff41b32a640 1 --2- 172.21.15.45:0/3663388478 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff3f8066900 0x7ff3f8068dc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff4140675f0 tx=0x7ff404008040 comp rx=0 tx=0).stop 2023-11-28T18:37:34.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.147+0000 7ff41b32a640 1 -- 172.21.15.45:0/3663388478 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff41406e8f0 msgr2=0x7ff4141f9770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:34.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.147+0000 7ff41b32a640 1 --2- 172.21.15.45:0/3663388478 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff41406e8f0 0x7ff4141f9770 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff41001ab80 tx=0x7ff41001ad10 comp rx=0 tx=0).stop 2023-11-28T18:37:34.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.147+0000 7ff41b32a640 1 -- 172.21.15.45:0/3663388478 shutdown_connections 2023-11-28T18:37:34.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.147+0000 7ff41b32a640 1 --2- 172.21.15.45:0/3663388478 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff3f8066900 0x7ff3f8068dc0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:34.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.147+0000 7ff41b32a640 1 --2- 172.21.15.45:0/3663388478 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff414146c00 0x7ff414167cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:34.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.147+0000 7ff41b32a640 1 --2- 172.21.15.45:0/3663388478 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4140b2bb0 0x7ff414167770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:34.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.147+0000 7ff41b32a640 1 --2- 172.21.15.45:0/3663388478 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff41406e8f0 0x7ff4141f9770 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:34.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.147+0000 7ff41b32a640 1 -- 172.21.15.45:0/3663388478 >> 172.21.15.45:0/3663388478 conn(0x7ff41406a570 msgr2=0x7ff414145eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:34.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.147+0000 7ff41b32a640 1 -- 172.21.15.45:0/3663388478 shutdown_connections 2023-11-28T18:37:34.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.147+0000 7ff41b32a640 1 -- 172.21.15.45:0/3663388478 wait complete. 2023-11-28T18:37:34.169 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-28T18:37:34.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.311+0000 7fce078c9640 1 Processor -- start 2023-11-28T18:37:34.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.311+0000 7fce078c9640 1 -- start start 2023-11-28T18:37:34.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.311+0000 7fce078c9640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fce000cba50 0x7fce0015be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:34.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.311+0000 7fce078c9640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fce000b4310 0x7fce000b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:34.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.311+0000 7fce078c9640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce000b4c80 con 0x7fce00158ce0 2023-11-28T18:37:34.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.311+0000 7fce078c9640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce0015b6b0 con 0x7fce000b4310 2023-11-28T18:37:34.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.311+0000 7fce078c9640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce0015f450 con 0x7fce000cba50 2023-11-28T18:37:34.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.311+0000 7fce05665640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fce00158ce0 0x7fce0015eb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:50246/0 (socket says 172.21.15.45:50246) 2023-11-28T18:37:34.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.311+0000 7fce05665640 1 -- 172.21.15.45:0/1208786064 learned_addr learned my addr 172.21.15.45:0/1208786064 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:37:34.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.311+0000 7fce05e66640 1 --2- 172.21.15.45:0/1208786064 >> v2:172.21.15.45:3300/0 conn(0x7fce000b4310 0x7fce000b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:34.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.315+0000 7fce04e64640 1 --2- 172.21.15.45:0/1208786064 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fce000cba50 0x7fce0015be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:34.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.315+0000 7fcdf7fff640 1 -- 172.21.15.45:0/1208786064 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3426671842 0 0) 0x7fce000b4c80 con 0x7fce00158ce0 2023-11-28T18:37:34.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.315+0000 7fcdf7fff640 1 -- 172.21.15.45:0/1208786064 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcdec003530 con 0x7fce00158ce0 2023-11-28T18:37:34.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.315+0000 7fce05e66640 1 -- 172.21.15.45:0/1208786064 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fce000cba50 msgr2=0x7fce0015be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:34.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.315+0000 7fce05e66640 1 --2- 172.21.15.45:0/1208786064 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fce000cba50 0x7fce0015be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:34.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.315+0000 7fce05e66640 1 -- 172.21.15.45:0/1208786064 >> v1:172.21.15.45:6789/0 conn(0x7fce00158ce0 legacy=0x7fce0015eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:34.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.315+0000 7fce05e66640 1 -- 172.21.15.45:0/1208786064 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce0015f730 con 0x7fce000b4310 2023-11-28T18:37:34.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.315+0000 7fce05e66640 1 --2- 172.21.15.45:0/1208786064 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce000b4310 0x7fce000b4740 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcdf8009d90 tx=0x7fcdf801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db3ae04cffcfae9f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:34.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.315+0000 7fcdf7fff640 1 -- 172.21.15.45:0/1208786064 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf80a5920 con 0x7fce000b4310 2023-11-28T18:37:34.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.315+0000 7fcdf7fff640 1 -- 172.21.15.45:0/1208786064 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdf80a5a80 con 0x7fce000b4310 2023-11-28T18:37:34.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.315+0000 7fcdf7fff640 1 -- 172.21.15.45:0/1208786064 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf80a5e10 con 0x7fce000b4310 2023-11-28T18:37:34.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.319+0000 7fce078c9640 1 -- 172.21.15.45:0/1208786064 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce000b4310 msgr2=0x7fce000b4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:34.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.319+0000 7fce078c9640 1 --2- 172.21.15.45:0/1208786064 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce000b4310 0x7fce000b4740 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcdf8009d90 tx=0x7fcdf801c950 comp rx=0 tx=0).stop 2023-11-28T18:37:34.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.319+0000 7fce078c9640 1 -- 172.21.15.45:0/1208786064 shutdown_connections 2023-11-28T18:37:34.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.319+0000 7fce078c9640 1 --2- 172.21.15.45:0/1208786064 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce000b4310 0x7fce000b4740 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:34.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.319+0000 7fce078c9640 1 --2- 172.21.15.45:0/1208786064 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fce000cba50 0x7fce0015be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:34.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.319+0000 7fce078c9640 1 -- 172.21.15.45:0/1208786064 >> 172.21.15.45:0/1208786064 conn(0x7fce000b0d00 msgr2=0x7fce000b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:34.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.319+0000 7fce078c9640 1 -- 172.21.15.45:0/1208786064 shutdown_connections 2023-11-28T18:37:34.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.319+0000 7fce078c9640 1 -- 172.21.15.45:0/1208786064 wait complete. 2023-11-28T18:37:34.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.319+0000 7fce078c9640 1 Processor -- start 2023-11-28T18:37:34.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.319+0000 7fce078c9640 1 -- start start 2023-11-28T18:37:34.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.319+0000 7fce078c9640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fce000b4310 0x7fce00153380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:34.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.319+0000 7fce078c9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce000cba50 0x7fce000b3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:34.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.319+0000 7fce078c9640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fce00158ce0 0x7fce0014eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:34.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.319+0000 7fce078c9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce000b3b80 con 0x7fce000cba50 2023-11-28T18:37:34.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.319+0000 7fce078c9640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce00156990 con 0x7fce000b4310 2023-11-28T18:37:34.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.319+0000 7fce078c9640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce00156380 con 0x7fce00158ce0 2023-11-28T18:37:34.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.319+0000 7fce04e64640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce000cba50 0x7fce000b3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:34.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.319+0000 7fce04e64640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce000cba50 0x7fce000b3640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48818/0 (socket says 172.21.15.45:48818) 2023-11-28T18:37:34.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.319+0000 7fce04e64640 1 -- 172.21.15.45:0/1187855144 learned_addr learned my addr 172.21.15.45:0/1187855144 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:34.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.319+0000 7fce05665640 1 --2- 172.21.15.45:0/1187855144 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fce000b4310 0x7fce00153380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:34.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.319+0000 7fce05e66640 1 --2- 172.21.15.45:0/1187855144 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fce00158ce0 0x7fce0014eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:34.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.319+0000 7fce04e64640 1 -- 172.21.15.45:0/1187855144 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fce00158ce0 msgr2=0x7fce0014eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:34.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.319+0000 7fce04e64640 1 --2- 172.21.15.45:0/1187855144 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fce00158ce0 0x7fce0014eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:34.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.319+0000 7fce04e64640 1 -- 172.21.15.45:0/1187855144 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fce000b4310 msgr2=0x7fce00153380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:34.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.319+0000 7fce04e64640 1 --2- 172.21.15.45:0/1187855144 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fce000b4310 0x7fce00153380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:34.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.319+0000 7fce04e64640 1 -- 172.21.15.45:0/1187855144 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdf8009a70 con 0x7fce000cba50 2023-11-28T18:37:34.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.319+0000 7fce05665640 1 --2- 172.21.15.45:0/1187855144 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fce000b4310 0x7fce00153380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:37:34.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.319+0000 7fce04e64640 1 --2- 172.21.15.45:0/1187855144 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce000cba50 0x7fce000b3640 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcdf000e840 tx=0x7fcdf000ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:34.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.323+0000 7fcdf5ffb640 1 -- 172.21.15.45:0/1187855144 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf0009510 con 0x7fce000cba50 2023-11-28T18:37:34.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.323+0000 7fcdf5ffb640 1 -- 172.21.15.45:0/1187855144 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdf000ee90 con 0x7fce000cba50 2023-11-28T18:37:34.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.323+0000 7fce078c9640 1 -- 172.21.15.45:0/1187855144 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce000b3d90 con 0x7fce000cba50 2023-11-28T18:37:34.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.323+0000 7fcdf5ffb640 1 -- 172.21.15.45:0/1187855144 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf000cb80 con 0x7fce000cba50 2023-11-28T18:37:34.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.323+0000 7fce078c9640 1 -- 172.21.15.45:0/1187855144 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce0014f060 con 0x7fce000cba50 2023-11-28T18:37:34.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.323+0000 7fce078c9640 1 -- 172.21.15.45:0/1187855144 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce00156b40 con 0x7fce000cba50 2023-11-28T18:37:34.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.323+0000 7fcdf5ffb640 1 -- 172.21.15.45:0/1187855144 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fcdf000cce0 con 0x7fce000cba50 2023-11-28T18:37:34.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.323+0000 7fcdf5ffb640 1 --2- 172.21.15.45:0/1187855144 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fcde40668d0 0x7fcde4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:34.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.323+0000 7fcdf5ffb640 1 -- 172.21.15.45:0/1187855144 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcdf00845a0 con 0x7fce000cba50 2023-11-28T18:37:34.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.327+0000 7fce05665640 1 --2- 172.21.15.45:0/1187855144 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fcde40668d0 0x7fcde4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:34.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.327+0000 7fce05665640 1 --2- 172.21.15.45:0/1187855144 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fcde40668d0 0x7fcde4068d90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc001210 tx=0x7fcdfc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:34.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.327+0000 7fcdf5ffb640 1 -- 172.21.15.45:0/1187855144 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fce00156b40 con 0x7fce000cba50 2023-11-28T18:37:34.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:34.527+0000 7fce078c9640 1 -- 172.21.15.45:0/1187855144 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fce00156b00 con 0x7fce000cba50 2023-11-28T18:37:35.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:35.451+0000 7fcdf5ffb640 1 -- 172.21.15.45:0/1187855144 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7fcdf0051740 con 0x7fce000cba50 2023-11-28T18:37:35.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:35.455+0000 7fce078c9640 1 -- 172.21.15.45:0/1187855144 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fcde40668d0 msgr2=0x7fcde4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:35.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:35.455+0000 7fce078c9640 1 --2- 172.21.15.45:0/1187855144 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fcde40668d0 0x7fcde4068d90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc001210 tx=0x7fcdfc009040 comp rx=0 tx=0).stop 2023-11-28T18:37:35.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:35.455+0000 7fce078c9640 1 -- 172.21.15.45:0/1187855144 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce000cba50 msgr2=0x7fce000b3640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:35.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:35.455+0000 7fce078c9640 1 --2- 172.21.15.45:0/1187855144 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce000cba50 0x7fce000b3640 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcdf000e840 tx=0x7fcdf000ec40 comp rx=0 tx=0).stop 2023-11-28T18:37:35.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:35.455+0000 7fce078c9640 1 -- 172.21.15.45:0/1187855144 shutdown_connections 2023-11-28T18:37:35.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:35.455+0000 7fce078c9640 1 --2- 172.21.15.45:0/1187855144 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fcde40668d0 0x7fcde4068d90 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:35.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:35.455+0000 7fce078c9640 1 --2- 172.21.15.45:0/1187855144 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fce00158ce0 0x7fce0014eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:35.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:35.455+0000 7fce078c9640 1 --2- 172.21.15.45:0/1187855144 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce000cba50 0x7fce000b3640 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:35.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:35.455+0000 7fce078c9640 1 --2- 172.21.15.45:0/1187855144 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fce000b4310 0x7fce00153380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:35.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:35.455+0000 7fce078c9640 1 -- 172.21.15.45:0/1187855144 >> 172.21.15.45:0/1187855144 conn(0x7fce000b0d00 msgr2=0x7fce00155140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:35.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:35.455+0000 7fce078c9640 1 -- 172.21.15.45:0/1187855144 shutdown_connections 2023-11-28T18:37:35.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:35.455+0000 7fce078c9640 1 -- 172.21.15.45:0/1187855144 wait complete. 2023-11-28T18:37:35.484 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-28T18:37:35.485 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-28T18:37:35.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:35.631+0000 7fbf22632640 1 Processor -- start 2023-11-28T18:37:35.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:35.631+0000 7fbf22632640 1 -- start start 2023-11-28T18:37:35.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:35.631+0000 7fbf22632640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbf1c06bc90 0x7fbf1c168150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:35.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:35.631+0000 7fbf22632640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf1c0af1c0 con 0x7fbf1c0ce9a0 2023-11-28T18:37:35.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:35.631+0000 7fbf22632640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf1c0ae920 con 0x7fbf1c0ced80 2023-11-28T18:37:35.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:35.631+0000 7fbf22632640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf1c0aec00 con 0x7fbf1c06bc90 2023-11-28T18:37:35.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:35.631+0000 7fbf1bfff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fbf1c0ce9a0 0x7fbf1c0ae0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:50250/0 (socket says 172.21.15.45:50250) 2023-11-28T18:37:35.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:35.631+0000 7fbf1bfff640 1 -- 172.21.15.45:0/3693779155 learned_addr learned my addr 172.21.15.45:0/3693779155 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:37:35.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:35.631+0000 7fbf20bcf640 1 --2- 172.21.15.45:0/3693779155 >> v2:172.21.15.45:3300/0 conn(0x7fbf1c06bc90 0x7fbf1c168150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:35.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:35.631+0000 7fbf20bcf640 1 -- 172.21.15.45:0/3693779155 >> v1:172.21.15.190:6789/0 conn(0x7fbf1c0ced80 legacy=0x7fbf1c06b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:35.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:35.631+0000 7fbf20bcf640 1 -- 172.21.15.45:0/3693779155 >> v1:172.21.15.45:6789/0 conn(0x7fbf1c0ce9a0 legacy=0x7fbf1c0ae0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:35.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:35.631+0000 7fbf1affd640 1 -- 172.21.15.45:0/3693779155 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1616012799 0 0) 0x7fbf1c0af1c0 con 0x7fbf1c0ce9a0 2023-11-28T18:37:35.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:35.631+0000 7fbf20bcf640 1 -- 172.21.15.45:0/3693779155 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf1c0aeee0 con 0x7fbf1c06bc90 2023-11-28T18:37:35.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:35.635+0000 7fbf20bcf640 1 --2- 172.21.15.45:0/3693779155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf1c06bc90 0x7fbf1c168150 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbf14009d90 tx=0x7fbf1401c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de9dfd9fb277a517 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:35.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:35.635+0000 7fbf1affd640 1 -- 172.21.15.45:0/3693779155 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf140a58e0 con 0x7fbf1c06bc90 2023-11-28T18:37:35.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:35.635+0000 7fbf1affd640 1 -- 172.21.15.45:0/3693779155 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf140a5a40 con 0x7fbf1c06bc90 2023-11-28T18:37:35.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:35.635+0000 7fbf1affd640 1 -- 172.21.15.45:0/3693779155 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf140a5dd0 con 0x7fbf1c06bc90 2023-11-28T18:37:35.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:35.635+0000 7fbf22632640 1 -- 172.21.15.45:0/3693779155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf1c06bc90 msgr2=0x7fbf1c168150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:35.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:35.635+0000 7fbf22632640 1 --2- 172.21.15.45:0/3693779155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf1c06bc90 0x7fbf1c168150 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbf14009d90 tx=0x7fbf1401c800 comp rx=0 tx=0).stop 2023-11-28T18:37:35.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:35.635+0000 7fbf22632640 1 -- 172.21.15.45:0/3693779155 shutdown_connections 2023-11-28T18:37:35.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:35.635+0000 7fbf22632640 1 --2- 172.21.15.45:0/3693779155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf1c06bc90 0x7fbf1c168150 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:35.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:35.635+0000 7fbf22632640 1 -- 172.21.15.45:0/3693779155 >> 172.21.15.45:0/3693779155 conn(0x7fbf1c0b1b70 msgr2=0x7fbf1c070cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:35.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:35.635+0000 7fbf22632640 1 -- 172.21.15.45:0/3693779155 shutdown_connections 2023-11-28T18:37:35.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:35.635+0000 7fbf22632640 1 -- 172.21.15.45:0/3693779155 wait complete. 2023-11-28T18:37:35.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:35.639+0000 7fbf22632640 1 Processor -- start 2023-11-28T18:37:35.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:35.639+0000 7fbf22632640 1 -- start start 2023-11-28T18:37:35.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:35.639+0000 7fbf22632640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf1c06bc90 0x7fbf1c14a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:35.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:35.639+0000 7fbf22632640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbf1c0ce9a0 0x7fbf1c14e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:35.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:35.639+0000 7fbf22632640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbf1c0ced80 0x7fbf1c14edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:35.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:35.639+0000 7fbf22632640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1c1511c0 con 0x7fbf1c06bc90 2023-11-28T18:37:35.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:35.639+0000 7fbf22632640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1c0cde80 con 0x7fbf1c0ced80 2023-11-28T18:37:35.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:35.639+0000 7fbf22632640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1c0ce160 con 0x7fbf1c0ce9a0 2023-11-28T18:37:35.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:35.639+0000 7fbf1bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf1c06bc90 0x7fbf1c14a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:35.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:35.639+0000 7fbf1bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf1c06bc90 0x7fbf1c14a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48834/0 (socket says 172.21.15.45:48834) 2023-11-28T18:37:35.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:35.639+0000 7fbf1bfff640 1 -- 172.21.15.45:0/2618671714 learned_addr learned my addr 172.21.15.45:0/2618671714 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:35.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:35.639+0000 7fbf20bcf640 1 --2- 172.21.15.45:0/2618671714 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbf1c0ced80 0x7fbf1c14edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:35.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:35.639+0000 7fbf1b7fe640 1 --2- 172.21.15.45:0/2618671714 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbf1c0ce9a0 0x7fbf1c14e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:35.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:35.639+0000 7fbf1bfff640 1 -- 172.21.15.45:0/2618671714 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbf1c0ce9a0 msgr2=0x7fbf1c14e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:35.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:35.639+0000 7fbf1bfff640 1 --2- 172.21.15.45:0/2618671714 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbf1c0ce9a0 0x7fbf1c14e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:35.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:35.639+0000 7fbf1bfff640 1 -- 172.21.15.45:0/2618671714 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbf1c0ced80 msgr2=0x7fbf1c14edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:35.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:35.639+0000 7fbf1bfff640 1 --2- 172.21.15.45:0/2618671714 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbf1c0ced80 0x7fbf1c14edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:35.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:35.639+0000 7fbf1bfff640 1 -- 172.21.15.45:0/2618671714 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf14009a70 con 0x7fbf1c06bc90 2023-11-28T18:37:35.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:35.639+0000 7fbf20bcf640 1 --2- 172.21.15.45:0/2618671714 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbf1c0ced80 0x7fbf1c14edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:37:35.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:35.639+0000 7fbf1bfff640 1 --2- 172.21.15.45:0/2618671714 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf1c06bc90 0x7fbf1c14a090 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c00c410 tx=0x7fbf0c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:35.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:35.639+0000 7fbf18ff9640 1 -- 172.21.15.45:0/2618671714 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0c0074e0 con 0x7fbf1c06bc90 2023-11-28T18:37:35.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:35.639+0000 7fbf18ff9640 1 -- 172.21.15.45:0/2618671714 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf0c007640 con 0x7fbf1c06bc90 2023-11-28T18:37:35.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:35.639+0000 7fbf18ff9640 1 -- 172.21.15.45:0/2618671714 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0c004a30 con 0x7fbf1c06bc90 2023-11-28T18:37:35.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:35.639+0000 7fbf22632640 1 -- 172.21.15.45:0/2618671714 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf1c0ce440 con 0x7fbf1c06bc90 2023-11-28T18:37:35.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:35.639+0000 7fbf22632640 1 -- 172.21.15.45:0/2618671714 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf1c14a5d0 con 0x7fbf1c06bc90 2023-11-28T18:37:35.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:35.639+0000 7fbf22632640 1 -- 172.21.15.45:0/2618671714 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf1c069410 con 0x7fbf1c06bc90 2023-11-28T18:37:35.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:35.643+0000 7fbf18ff9640 1 -- 172.21.15.45:0/2618671714 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fbf0c004b90 con 0x7fbf1c06bc90 2023-11-28T18:37:35.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:35.643+0000 7fbf18ff9640 1 --2- 172.21.15.45:0/2618671714 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbf080668d0 0x7fbf08068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:35.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:35.643+0000 7fbf18ff9640 1 -- 172.21.15.45:0/2618671714 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbf0c084290 con 0x7fbf1c06bc90 2023-11-28T18:37:35.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:35.643+0000 7fbf1b7fe640 1 --2- 172.21.15.45:0/2618671714 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbf080668d0 0x7fbf08068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:35.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:35.643+0000 7fbf1b7fe640 1 --2- 172.21.15.45:0/2618671714 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbf080668d0 0x7fbf08068d90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c150870 tx=0x7fbf10009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:35.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:35.647+0000 7fbf18ff9640 1 -- 172.21.15.45:0/2618671714 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbf0c0514c0 con 0x7fbf1c06bc90 2023-11-28T18:37:35.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:35.835+0000 7fbf22632640 1 -- 172.21.15.45:0/2618671714 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fbf1c151650 con 0x7fbf1c06bc90 2023-11-28T18:37:36.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.459+0000 7fbf18ff9640 1 -- 172.21.15.45:0/2618671714 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7fbf0c054ae0 con 0x7fbf1c06bc90 2023-11-28T18:37:36.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.463+0000 7fbf22632640 1 -- 172.21.15.45:0/2618671714 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbf080668d0 msgr2=0x7fbf08068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:36.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.463+0000 7fbf22632640 1 --2- 172.21.15.45:0/2618671714 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbf080668d0 0x7fbf08068d90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c150870 tx=0x7fbf10009040 comp rx=0 tx=0).stop 2023-11-28T18:37:36.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.463+0000 7fbf22632640 1 -- 172.21.15.45:0/2618671714 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf1c06bc90 msgr2=0x7fbf1c14a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:36.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.463+0000 7fbf22632640 1 --2- 172.21.15.45:0/2618671714 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf1c06bc90 0x7fbf1c14a090 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c00c410 tx=0x7fbf0c00c8d0 comp rx=0 tx=0).stop 2023-11-28T18:37:36.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.463+0000 7fbf22632640 1 -- 172.21.15.45:0/2618671714 shutdown_connections 2023-11-28T18:37:36.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.463+0000 7fbf22632640 1 --2- 172.21.15.45:0/2618671714 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbf080668d0 0x7fbf08068d90 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:36.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.463+0000 7fbf22632640 1 --2- 172.21.15.45:0/2618671714 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbf1c0ced80 0x7fbf1c14edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:36.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.463+0000 7fbf22632640 1 --2- 172.21.15.45:0/2618671714 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbf1c0ce9a0 0x7fbf1c14e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:36.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.463+0000 7fbf22632640 1 --2- 172.21.15.45:0/2618671714 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf1c06bc90 0x7fbf1c14a090 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:36.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.463+0000 7fbf22632640 1 -- 172.21.15.45:0/2618671714 >> 172.21.15.45:0/2618671714 conn(0x7fbf1c0b1b70 msgr2=0x7fbf1c160d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:36.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.463+0000 7fbf22632640 1 -- 172.21.15.45:0/2618671714 shutdown_connections 2023-11-28T18:37:36.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.463+0000 7fbf22632640 1 -- 172.21.15.45:0/2618671714 wait complete. 2023-11-28T18:37:36.491 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-28T18:37:36.491 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T18:37:36.638 INFO:tasks.ceph.mds.c.smithi045.stderr:2023-11-28T18:37:36.631+0000 7f21a298a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T18:37:36.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.635+0000 7ffb054d6640 1 Processor -- start 2023-11-28T18:37:36.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.635+0000 7ffb054d6640 1 -- start start 2023-11-28T18:37:36.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.635+0000 7ffb054d6640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ffb000b35f0 0x7ffb000d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:36.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.635+0000 7ffb054d6640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffb000cfed0 0x7ffb0015f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:36.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.635+0000 7ffb054d6640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb000d38c0 con 0x7ffb000b3cb0 2023-11-28T18:37:36.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.635+0000 7ffb054d6640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb000d40d0 con 0x7ffb000b35f0 2023-11-28T18:37:36.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.635+0000 7ffb054d6640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb000cdcc0 con 0x7ffb000cfed0 2023-11-28T18:37:36.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.635+0000 7ffafeffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ffb000b35f0 0x7ffb000d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:36.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.635+0000 7ffafeffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ffb000b35f0 0x7ffb000d0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48836/0 (socket says 172.21.15.45:48836) 2023-11-28T18:37:36.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.635+0000 7ffafeffd640 1 -- 172.21.15.45:0/1595778202 learned_addr learned my addr 172.21.15.45:0/1595778202 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:36.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.635+0000 7ffaff7fe640 1 --2- 172.21.15.45:0/1595778202 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffb000cfed0 0x7ffb0015f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:36.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.635+0000 7ffafeffd640 1 -- 172.21.15.45:0/1595778202 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffb000cfed0 msgr2=0x7ffb0015f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:36.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.635+0000 7ffafeffd640 1 --2- 172.21.15.45:0/1595778202 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffb000cfed0 0x7ffb0015f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:36.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.635+0000 7ffafeffd640 1 -- 172.21.15.45:0/1595778202 >> v1:172.21.15.190:6789/0 conn(0x7ffb000b3cb0 legacy=0x7ffb000cf7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:36.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.635+0000 7ffafeffd640 1 -- 172.21.15.45:0/1595778202 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb000d3b10 con 0x7ffb000b35f0 2023-11-28T18:37:36.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.635+0000 7ffaff7fe640 1 --2- 172.21.15.45:0/1595778202 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffb000cfed0 0x7ffb0015f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:37:36.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.639+0000 7ffafeffd640 1 --2- 172.21.15.45:0/1595778202 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb000b35f0 0x7ffb000d0f90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ffaf0009870 tx=0x7ffaf001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c54103b349d8f99 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:36.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.639+0000 7ffafe7fc640 1 -- 172.21.15.45:0/1595778202 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf00aa620 con 0x7ffb000b35f0 2023-11-28T18:37:36.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.639+0000 7ffafe7fc640 1 -- 172.21.15.45:0/1595778202 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaf00aa780 con 0x7ffb000b35f0 2023-11-28T18:37:36.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.639+0000 7ffafe7fc640 1 -- 172.21.15.45:0/1595778202 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf00aab10 con 0x7ffb000b35f0 2023-11-28T18:37:36.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.639+0000 7ffb054d6640 1 -- 172.21.15.45:0/1595778202 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb000b35f0 msgr2=0x7ffb000d0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:36.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.639+0000 7ffb054d6640 1 --2- 172.21.15.45:0/1595778202 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb000b35f0 0x7ffb000d0f90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ffaf0009870 tx=0x7ffaf001c500 comp rx=0 tx=0).stop 2023-11-28T18:37:36.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.639+0000 7ffb054d6640 1 -- 172.21.15.45:0/1595778202 shutdown_connections 2023-11-28T18:37:36.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.639+0000 7ffb054d6640 1 --2- 172.21.15.45:0/1595778202 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffb000cfed0 0x7ffb0015f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:36.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.639+0000 7ffb054d6640 1 --2- 172.21.15.45:0/1595778202 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb000b35f0 0x7ffb000d0f90 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:36.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.639+0000 7ffb054d6640 1 -- 172.21.15.45:0/1595778202 >> 172.21.15.45:0/1595778202 conn(0x7ffb0009c4f0 msgr2=0x7ffb000d31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:36.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.639+0000 7ffb054d6640 1 -- 172.21.15.45:0/1595778202 shutdown_connections 2023-11-28T18:37:36.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.639+0000 7ffb054d6640 1 -- 172.21.15.45:0/1595778202 wait complete. 2023-11-28T18:37:36.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.643+0000 7ffb054d6640 1 Processor -- start 2023-11-28T18:37:36.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.643+0000 7ffb054d6640 1 -- start start 2023-11-28T18:37:36.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.643+0000 7ffb054d6640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffb000b35f0 0x7ffb000c8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:36.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.643+0000 7ffb054d6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb000b3cb0 0x7ffb00159b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:36.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.643+0000 7ffb054d6640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb000cfed0 0x7ffb0015a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:36.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.643+0000 7ffb054d6640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0009f130 con 0x7ffb000b3cb0 2023-11-28T18:37:36.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.643+0000 7ffb054d6640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb000c93f0 con 0x7ffb000cfed0 2023-11-28T18:37:36.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.643+0000 7ffb054d6640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0009e280 con 0x7ffb000b35f0 2023-11-28T18:37:36.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.643+0000 7ffaf7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb000b3cb0 0x7ffb00159b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:36.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.643+0000 7ffaf7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb000b3cb0 0x7ffb00159b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48850/0 (socket says 172.21.15.45:48850) 2023-11-28T18:37:36.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.643+0000 7ffaf7fff640 1 -- 172.21.15.45:0/2067619114 learned_addr learned my addr 172.21.15.45:0/2067619114 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:36.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.643+0000 7ffafeffd640 1 --2- 172.21.15.45:0/2067619114 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffb000b35f0 0x7ffb000c8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:36.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.643+0000 7ffaff7fe640 1 --2- 172.21.15.45:0/2067619114 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb000cfed0 0x7ffb0015a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:36.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.643+0000 7ffaf7fff640 1 -- 172.21.15.45:0/2067619114 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffb000b35f0 msgr2=0x7ffb000c8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:36.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.643+0000 7ffaf7fff640 1 --2- 172.21.15.45:0/2067619114 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffb000b35f0 0x7ffb000c8eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:36.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.643+0000 7ffaf7fff640 1 -- 172.21.15.45:0/2067619114 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb000cfed0 msgr2=0x7ffb0015a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:36.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.643+0000 7ffaf7fff640 1 --2- 172.21.15.45:0/2067619114 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb000cfed0 0x7ffb0015a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:36.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.643+0000 7ffaf7fff640 1 -- 172.21.15.45:0/2067619114 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaf00094d0 con 0x7ffb000b3cb0 2023-11-28T18:37:36.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.643+0000 7ffaf7fff640 1 --2- 172.21.15.45:0/2067619114 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb000b3cb0 0x7ffb00159b50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ffae800c450 tx=0x7ffae800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:36.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.643+0000 7ffaf77fe640 1 -- 172.21.15.45:0/2067619114 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae8012830 con 0x7ffb000b3cb0 2023-11-28T18:37:36.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.643+0000 7ffaf77fe640 1 -- 172.21.15.45:0/2067619114 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffae80129b0 con 0x7ffb000b3cb0 2023-11-28T18:37:36.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.643+0000 7ffaf77fe640 1 -- 172.21.15.45:0/2067619114 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae8012d60 con 0x7ffb000b3cb0 2023-11-28T18:37:36.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.643+0000 7ffb054d6640 1 -- 172.21.15.45:0/2067619114 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb0009e520 con 0x7ffb000b3cb0 2023-11-28T18:37:36.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.643+0000 7ffb054d6640 1 -- 172.21.15.45:0/2067619114 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb0009eae0 con 0x7ffb000b3cb0 2023-11-28T18:37:36.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.647+0000 7ffb054d6640 1 -- 172.21.15.45:0/2067619114 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb0009f2e0 con 0x7ffb000b3cb0 2023-11-28T18:37:36.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.647+0000 7ffaf77fe640 1 -- 172.21.15.45:0/2067619114 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ffae801c460 con 0x7ffb000b3cb0 2023-11-28T18:37:36.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.647+0000 7ffaf77fe640 1 --2- 172.21.15.45:0/2067619114 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ffae0066950 0x7ffae0068e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:36.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.647+0000 7ffaf77fe640 1 -- 172.21.15.45:0/2067619114 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffae8084180 con 0x7ffb000b3cb0 2023-11-28T18:37:36.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.647+0000 7ffafeffd640 1 --2- 172.21.15.45:0/2067619114 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ffae0066950 0x7ffae0068e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:36.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.647+0000 7ffafeffd640 1 --2- 172.21.15.45:0/2067619114 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ffae0066950 0x7ffae0068e10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ffaf00ae000 tx=0x7ffaf00b5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:36.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.651+0000 7ffaf77fe640 1 -- 172.21.15.45:0/2067619114 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ffb0009f2e0 con 0x7ffb000b3cb0 2023-11-28T18:37:36.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.839+0000 7ffb054d6640 1 -- 172.21.15.45:0/2067619114 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffb00069480 con 0x7ffb000b3cb0 2023-11-28T18:37:36.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.839+0000 7ffaf77fe640 1 -- 172.21.15.45:0/2067619114 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4910 (secure 0 0 0) 0x7ffae8051450 con 0x7ffb000b3cb0 2023-11-28T18:37:36.845 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:37:36.845 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/972230763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":972230763},{"type":"v1","addr":"172.21.15.45:6835","nonce":972230763}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/4274475693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":4274475693},{"type":"v1","addr":"172.21.15.190:6837","nonce":4274475693}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/3154556740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":3154556740},{"type":"v1","addr":"172.21.15.190:6836","nonce":3154556740}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T18:37:32.842966+0000","modified":"2023-11-28T18:37:35.841966+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6834/1657221272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1657221272},{"type":"v1","addr":"172.21.15.45:6834","nonce":1657221272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T18:37:36.845 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 8 2023-11-28T18:37:36.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.843+0000 7ffb054d6640 1 -- 172.21.15.45:0/2067619114 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ffae0066950 msgr2=0x7ffae0068e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:36.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.843+0000 7ffb054d6640 1 --2- 172.21.15.45:0/2067619114 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ffae0066950 0x7ffae0068e10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ffaf00ae000 tx=0x7ffaf00b5040 comp rx=0 tx=0).stop 2023-11-28T18:37:36.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.843+0000 7ffb054d6640 1 -- 172.21.15.45:0/2067619114 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb000b3cb0 msgr2=0x7ffb00159b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:36.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.843+0000 7ffb054d6640 1 --2- 172.21.15.45:0/2067619114 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb000b3cb0 0x7ffb00159b50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ffae800c450 tx=0x7ffae800c910 comp rx=0 tx=0).stop 2023-11-28T18:37:36.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.843+0000 7ffb054d6640 1 -- 172.21.15.45:0/2067619114 shutdown_connections 2023-11-28T18:37:36.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.843+0000 7ffb054d6640 1 --2- 172.21.15.45:0/2067619114 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ffae0066950 0x7ffae0068e10 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:36.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.843+0000 7ffb054d6640 1 --2- 172.21.15.45:0/2067619114 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb000cfed0 0x7ffb0015a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:36.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.843+0000 7ffb054d6640 1 --2- 172.21.15.45:0/2067619114 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb000b3cb0 0x7ffb00159b50 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:36.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.843+0000 7ffb054d6640 1 --2- 172.21.15.45:0/2067619114 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffb000b35f0 0x7ffb000c8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:36.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.843+0000 7ffb054d6640 1 -- 172.21.15.45:0/2067619114 >> 172.21.15.45:0/2067619114 conn(0x7ffb0009c4f0 msgr2=0x7ffb0015e2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:36.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.843+0000 7ffb054d6640 1 -- 172.21.15.45:0/2067619114 shutdown_connections 2023-11-28T18:37:36.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:36.843+0000 7ffb054d6640 1 -- 172.21.15.45:0/2067619114 wait complete. 2023-11-28T18:37:36.868 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T18:37:37.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.007+0000 7f6dbd29c640 1 Processor -- start 2023-11-28T18:37:37.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.007+0000 7f6dbd29c640 1 -- start start 2023-11-28T18:37:37.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.007+0000 7f6dbd29c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6db80b35f0 0x7f6db80d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:37.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.007+0000 7f6dbd29c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f6db80b3cb0 0x7f6db815f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:37.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.007+0000 7f6dbd29c640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6db80d38c0 con 0x7f6db80cf7c0 2023-11-28T18:37:37.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.007+0000 7f6dbd29c640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6db80d40d0 con 0x7f6db80b3cb0 2023-11-28T18:37:37.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.007+0000 7f6dbd29c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6db80cdcc0 con 0x7f6db80b35f0 2023-11-28T18:37:37.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.007+0000 7f6db77fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f6db80cf7c0 0x7f6db80ce480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:50254/0 (socket says 172.21.15.45:50254) 2023-11-28T18:37:37.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.007+0000 7f6db77fe640 1 -- 172.21.15.45:0/255596905 learned_addr learned my addr 172.21.15.45:0/255596905 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:37:37.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.007+0000 7f6daffff640 1 --2- 172.21.15.45:0/255596905 >> v2:172.21.15.190:3300/0 conn(0x7f6db80b3cb0 0x7f6db815f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:37.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.007+0000 7f6db6ffd640 1 --2- 172.21.15.45:0/255596905 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6db80b35f0 0x7f6db80d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:37.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.007+0000 7f6db67fc640 1 -- 172.21.15.45:0/255596905 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 991615129 0 0) 0x7f6db80d38c0 con 0x7f6db80cf7c0 2023-11-28T18:37:37.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.007+0000 7f6db67fc640 1 -- 172.21.15.45:0/255596905 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6da4003530 con 0x7f6db80cf7c0 2023-11-28T18:37:37.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.007+0000 7f6db67fc640 1 -- 172.21.15.45:0/255596905 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 943438308 0 0) 0x7f6da4003530 con 0x7f6db80cf7c0 2023-11-28T18:37:37.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.007+0000 7f6db6ffd640 1 -- 172.21.15.45:0/255596905 >> v2:172.21.15.190:3300/0 conn(0x7f6db80b3cb0 msgr2=0x7f6db815f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:37.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.007+0000 7f6db6ffd640 1 --2- 172.21.15.45:0/255596905 >> v2:172.21.15.190:3300/0 conn(0x7f6db80b3cb0 0x7f6db815f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:37.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.007+0000 7f6db6ffd640 1 -- 172.21.15.45:0/255596905 >> v1:172.21.15.45:6789/0 conn(0x7f6db80cf7c0 legacy=0x7f6db80ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:37.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.007+0000 7f6db6ffd640 1 -- 172.21.15.45:0/255596905 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db80d3b10 con 0x7f6db80b35f0 2023-11-28T18:37:37.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.007+0000 7f6daffff640 1 --2- 172.21.15.45:0/255596905 >> v2:172.21.15.190:3300/0 conn(0x7f6db80b3cb0 0x7f6db815f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:37:37.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.011+0000 7f6db6ffd640 1 --2- 172.21.15.45:0/255596905 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6db80b35f0 0x7f6db80d0f90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6da80097c0 tx=0x7f6da801c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=947c0c1b660ff64d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:37.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.011+0000 7f6db67fc640 1 -- 172.21.15.45:0/255596905 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db0001a00 con 0x7f6db80b35f0 2023-11-28T18:37:37.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.011+0000 7f6db67fc640 1 -- 172.21.15.45:0/255596905 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6da80a7050 con 0x7f6db80b35f0 2023-11-28T18:37:37.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.011+0000 7f6db67fc640 1 -- 172.21.15.45:0/255596905 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da80ab620 con 0x7f6db80b35f0 2023-11-28T18:37:37.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.011+0000 7f6dbd29c640 1 -- 172.21.15.45:0/255596905 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6db80b35f0 msgr2=0x7f6db80d0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:37.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.011+0000 7f6dbd29c640 1 --2- 172.21.15.45:0/255596905 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6db80b35f0 0x7f6db80d0f90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6da80097c0 tx=0x7f6da801c3a0 comp rx=0 tx=0).stop 2023-11-28T18:37:37.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.011+0000 7f6dbd29c640 1 -- 172.21.15.45:0/255596905 shutdown_connections 2023-11-28T18:37:37.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.011+0000 7f6dbd29c640 1 --2- 172.21.15.45:0/255596905 >> v2:172.21.15.190:3300/0 conn(0x7f6db80b3cb0 0x7f6db815f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:37.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.011+0000 7f6dbd29c640 1 --2- 172.21.15.45:0/255596905 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6db80b35f0 0x7f6db80d0f90 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:37.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.011+0000 7f6dbd29c640 1 -- 172.21.15.45:0/255596905 >> 172.21.15.45:0/255596905 conn(0x7f6db809c4f0 msgr2=0x7f6db80d31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:37.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.011+0000 7f6dbd29c640 1 -- 172.21.15.45:0/255596905 shutdown_connections 2023-11-28T18:37:37.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.011+0000 7f6dbd29c640 1 -- 172.21.15.45:0/255596905 wait complete. 2023-11-28T18:37:37.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.015+0000 7f6dbd29c640 1 Processor -- start 2023-11-28T18:37:37.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.015+0000 7f6dbd29c640 1 -- start start 2023-11-28T18:37:37.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.015+0000 7f6dbd29c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6db80b35f0 0x7f6db8159a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:37.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.015+0000 7f6dbd29c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6db80b3cb0 0x7f6db809cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:37.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.015+0000 7f6dbd29c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6db80cf7c0 0x7f6db809d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:37.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.015+0000 7f6dbd29c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db809ef40 con 0x7f6db80b3cb0 2023-11-28T18:37:37.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.015+0000 7f6dbd29c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db809ec80 con 0x7f6db80cf7c0 2023-11-28T18:37:37.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.015+0000 7f6dbd29c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6db815b520 con 0x7f6db80b35f0 2023-11-28T18:37:37.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.015+0000 7f6daffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6db80b3cb0 0x7f6db809cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:37.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.015+0000 7f6daffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6db80b3cb0 0x7f6db809cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48856/0 (socket says 172.21.15.45:48856) 2023-11-28T18:37:37.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.015+0000 7f6daffff640 1 -- 172.21.15.45:0/999312293 learned_addr learned my addr 172.21.15.45:0/999312293 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:37.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.015+0000 7f6db77fe640 1 --2- 172.21.15.45:0/999312293 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6db80cf7c0 0x7f6db809d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:37.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.015+0000 7f6db6ffd640 1 --2- 172.21.15.45:0/999312293 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6db80b35f0 0x7f6db8159a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:37.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.015+0000 7f6daffff640 1 -- 172.21.15.45:0/999312293 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6db80b35f0 msgr2=0x7f6db8159a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:37.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.015+0000 7f6daffff640 1 --2- 172.21.15.45:0/999312293 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6db80b35f0 0x7f6db8159a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:37.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.015+0000 7f6daffff640 1 -- 172.21.15.45:0/999312293 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6db80cf7c0 msgr2=0x7f6db809d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:37.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.015+0000 7f6daffff640 1 --2- 172.21.15.45:0/999312293 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6db80cf7c0 0x7f6db809d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:37.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.015+0000 7f6daffff640 1 -- 172.21.15.45:0/999312293 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6da0009420 con 0x7f6db80b3cb0 2023-11-28T18:37:37.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.015+0000 7f6daffff640 1 --2- 172.21.15.45:0/999312293 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6db80b3cb0 0x7f6db809cf60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6da000ec10 tx=0x7f6da000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:37.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.015+0000 7f6daf7fe640 1 -- 172.21.15.45:0/999312293 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da000cc30 con 0x7f6db80b3cb0 2023-11-28T18:37:37.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.015+0000 7f6daf7fe640 1 -- 172.21.15.45:0/999312293 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6da000cd90 con 0x7f6db80b3cb0 2023-11-28T18:37:37.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.015+0000 7f6dbd29c640 1 -- 172.21.15.45:0/999312293 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6da8009420 con 0x7f6db80b3cb0 2023-11-28T18:37:37.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.015+0000 7f6daf7fe640 1 -- 172.21.15.45:0/999312293 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da0013690 con 0x7f6db80b3cb0 2023-11-28T18:37:37.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.015+0000 7f6dbd29c640 1 -- 172.21.15.45:0/999312293 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6db815af60 con 0x7f6db80b3cb0 2023-11-28T18:37:37.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.019+0000 7f6dbd29c640 1 -- 172.21.15.45:0/999312293 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6db809f0b0 con 0x7f6db80b3cb0 2023-11-28T18:37:37.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.019+0000 7f6daf7fe640 1 -- 172.21.15.45:0/999312293 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f6da00137f0 con 0x7f6db80b3cb0 2023-11-28T18:37:37.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.019+0000 7f6daf7fe640 1 --2- 172.21.15.45:0/999312293 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6d980668d0 0x7f6d98068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:37.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.019+0000 7f6daf7fe640 1 -- 172.21.15.45:0/999312293 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6da00846a0 con 0x7f6db80b3cb0 2023-11-28T18:37:37.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.019+0000 7f6db6ffd640 1 --2- 172.21.15.45:0/999312293 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6d980668d0 0x7f6d98068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:37.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.019+0000 7f6db6ffd640 1 --2- 172.21.15.45:0/999312293 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6d980668d0 0x7f6d98068d90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6da80ad000 tx=0x7f6da80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:37.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.023+0000 7f6daf7fe640 1 -- 172.21.15.45:0/999312293 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6db809f0b0 con 0x7f6db80b3cb0 2023-11-28T18:37:37.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.179+0000 7f6dbd29c640 1 -- 172.21.15.45:0/999312293 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6db809f080 con 0x7f6db80b3cb0 2023-11-28T18:37:37.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.183+0000 7f6daf7fe640 1 -- 172.21.15.45:0/999312293 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16469 (secure 0 0 0) 0x7f6da0051980 con 0x7f6db80b3cb0 2023-11-28T18:37:37.187 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:37:37.187 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":20,"fsid":"d10f5cd6-1d00-4019-99b6-6fa435498a15","created":"2023-11-28T18:37:08.189030+0000","modified":"2023-11-28T18:37:33.971141+0000","last_up_change":"2023-11-28T18:37:20.196124+0000","last_in_change":"2023-11-28T18:37:10.742043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T18:37:21.293917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T18:37:31.384760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T18:37:31.834769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"84465384-103c-4f2c-a45a-96f5bb9c835f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6809","nonce":555237322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6811","nonce":555237322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6815","nonce":555237322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6813","nonce":555237322}]},"public_addr":"172.21.15.45:6809/555237322","cluster_addr":"172.21.15.45:6811/555237322","heartbeat_back_addr":"172.21.15.45:6815/555237322","heartbeat_front_addr":"172.21.15.45:6813/555237322","state":["exists","up"]},{"osd":1,"uuid":"7d9eed24-a58f-42c7-a787-ac06be8553fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6801","nonce":2857063763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6803","nonce":2857063763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6807","nonce":2857063763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6805","nonce":2857063763}]},"public_addr":"172.21.15.45:6801/2857063763","cluster_addr":"172.21.15.45:6803/2857063763","heartbeat_back_addr":"172.21.15.45:6807/2857063763","heartbeat_front_addr":"172.21.15.45:6805/2857063763","state":["exists","up"]},{"osd":2,"uuid":"575eeccc-4abf-45b4-9caf-f3e797859588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6817","nonce":193884539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6819","nonce":193884539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6823","nonce":193884539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6821","nonce":193884539}]},"public_addr":"172.21.15.45:6817/193884539","cluster_addr":"172.21.15.45:6819/193884539","heartbeat_back_addr":"172.21.15.45:6823/193884539","heartbeat_front_addr":"172.21.15.45:6821/193884539","state":["exists","up"]},{"osd":3,"uuid":"9b0290d6-9a52-4bc8-b2a1-7622c5dc8e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6825","nonce":78541084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6827","nonce":78541084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6831","nonce":78541084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6829","nonce":78541084}]},"public_addr":"172.21.15.45:6825/78541084","cluster_addr":"172.21.15.45:6827/78541084","heartbeat_back_addr":"172.21.15.45:6831/78541084","heartbeat_front_addr":"172.21.15.45:6829/78541084","state":["exists","up"]},{"osd":4,"uuid":"ce632829-f027-4fbf-a627-02c571aa9d53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6809","nonce":1537591987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6811","nonce":1537591987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6815","nonce":1537591987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6813","nonce":1537591987}]},"public_addr":"172.21.15.190:6809/1537591987","cluster_addr":"172.21.15.190:6811/1537591987","heartbeat_back_addr":"172.21.15.190:6815/1537591987","heartbeat_front_addr":"172.21.15.190:6813/1537591987","state":["exists","up"]},{"osd":5,"uuid":"8700b609-27be-40bd-a251-4c0ae0a29ead","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6801","nonce":3296698407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6803","nonce":3296698407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6807","nonce":3296698407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6805","nonce":3296698407}]},"public_addr":"172.21.15.190:6801/3296698407","cluster_addr":"172.21.15.190:6803/3296698407","heartbeat_back_addr":"172.21.15.190:6807/3296698407","heartbeat_front_addr":"172.21.15.190:6805/3296698407","state":["exists","up"]},{"osd":6,"uuid":"44ce4a40-e6ff-4f4d-8e8a-7341e5c91f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6817","nonce":2317686718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6819","nonce":2317686718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6823","nonce":2317686718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6821","nonce":2317686718}]},"public_addr":"172.21.15.190:6817/2317686718","cluster_addr":"172.21.15.190:6819/2317686718","heartbeat_back_addr":"172.21.15.190:6823/2317686718","heartbeat_front_addr":"172.21.15.190:6821/2317686718","state":["exists","up"]},{"osd":7,"uuid":"192238c9-1423-4b7e-ac8f-84ba32113ddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6825","nonce":2493232051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6827","nonce":2493232051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6831","nonce":2493232051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6829","nonce":2493232051}]},"public_addr":"172.21.15.190:6825/2493232051","cluster_addr":"172.21.15.190:6827/2493232051","heartbeat_back_addr":"172.21.15.190:6831/2493232051","heartbeat_front_addr":"172.21.15.190:6829/2493232051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.393552+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.385453+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.361421+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.366408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.363226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.276007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.414605+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.445885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T18:37:37.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.183+0000 7f6dbd29c640 1 -- 172.21.15.45:0/999312293 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6d980668d0 msgr2=0x7f6d98068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:37.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.183+0000 7f6dbd29c640 1 --2- 172.21.15.45:0/999312293 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6d980668d0 0x7f6d98068d90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6da80ad000 tx=0x7f6da80a6000 comp rx=0 tx=0).stop 2023-11-28T18:37:37.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.183+0000 7f6dbd29c640 1 -- 172.21.15.45:0/999312293 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6db80b3cb0 msgr2=0x7f6db809cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:37.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.183+0000 7f6dbd29c640 1 --2- 172.21.15.45:0/999312293 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6db80b3cb0 0x7f6db809cf60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6da000ec10 tx=0x7f6da000c520 comp rx=0 tx=0).stop 2023-11-28T18:37:37.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.183+0000 7f6dbd29c640 1 -- 172.21.15.45:0/999312293 shutdown_connections 2023-11-28T18:37:37.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.183+0000 7f6dbd29c640 1 --2- 172.21.15.45:0/999312293 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6d980668d0 0x7f6d98068d90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:37.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.183+0000 7f6dbd29c640 1 --2- 172.21.15.45:0/999312293 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6db80cf7c0 0x7f6db809d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:37.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.183+0000 7f6dbd29c640 1 --2- 172.21.15.45:0/999312293 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6db80b3cb0 0x7f6db809cf60 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:37.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.183+0000 7f6dbd29c640 1 --2- 172.21.15.45:0/999312293 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6db80b35f0 0x7f6db8159a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:37.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.183+0000 7f6dbd29c640 1 -- 172.21.15.45:0/999312293 >> 172.21.15.45:0/999312293 conn(0x7f6db809c4f0 msgr2=0x7f6db80afde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:37.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.183+0000 7f6dbd29c640 1 -- 172.21.15.45:0/999312293 shutdown_connections 2023-11-28T18:37:37.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.183+0000 7f6dbd29c640 1 -- 172.21.15.45:0/999312293 wait complete. 2023-11-28T18:37:37.209 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-28T18:37:37.209 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T18:37:37.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.347+0000 7fe61d357640 1 Processor -- start 2023-11-28T18:37:37.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.347+0000 7fe61d357640 1 -- start start 2023-11-28T18:37:37.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.347+0000 7fe61d357640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe6180b47a0 0x7fe6180d10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:37.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.347+0000 7fe61d357640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe6180b4b80 0x7fe6180d1620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:37.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.347+0000 7fe61d357640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe618142c40 0x7fe618143090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:37.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.347+0000 7fe61d357640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe61815d800 con 0x7fe6180b47a0 2023-11-28T18:37:37.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.347+0000 7fe61d357640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe618140970 con 0x7fe6180b4b80 2023-11-28T18:37:37.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.347+0000 7fe61d357640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe61815da50 con 0x7fe618142c40 2023-11-28T18:37:37.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.347+0000 7fe616ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe6180b47a0 0x7fe6180d10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:37.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.347+0000 7fe616ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe6180b47a0 0x7fe6180d10e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48860/0 (socket says 172.21.15.45:48860) 2023-11-28T18:37:37.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.347+0000 7fe616ffd640 1 -- 172.21.15.45:0/2737919180 learned_addr learned my addr 172.21.15.45:0/2737919180 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:37.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.347+0000 7fe6177fe640 1 --2- 172.21.15.45:0/2737919180 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe618142c40 0x7fe618143090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:37.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.347+0000 7fe60ffff640 1 --2- 172.21.15.45:0/2737919180 >> v2:172.21.15.190:3300/0 conn(0x7fe6180b4b80 0x7fe6180d1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:37.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.351+0000 7fe616ffd640 1 -- 172.21.15.45:0/2737919180 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe618142c40 msgr2=0x7fe618143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:37.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.351+0000 7fe616ffd640 1 --2- 172.21.15.45:0/2737919180 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe618142c40 0x7fe618143090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:37.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.351+0000 7fe616ffd640 1 -- 172.21.15.45:0/2737919180 >> v2:172.21.15.190:3300/0 conn(0x7fe6180b4b80 msgr2=0x7fe6180d1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:37.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.351+0000 7fe616ffd640 1 --2- 172.21.15.45:0/2737919180 >> v2:172.21.15.190:3300/0 conn(0x7fe6180b4b80 0x7fe6180d1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:37.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.351+0000 7fe616ffd640 1 -- 172.21.15.45:0/2737919180 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe61815dd30 con 0x7fe6180b47a0 2023-11-28T18:37:37.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.351+0000 7fe6177fe640 1 --2- 172.21.15.45:0/2737919180 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe618142c40 0x7fe618143090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:37:37.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.351+0000 7fe616ffd640 1 --2- 172.21.15.45:0/2737919180 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6180b47a0 0x7fe6180d10e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe61806d860 tx=0x7fe60801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dcf8590cf583c55 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:37.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.351+0000 7fe6167fc640 1 -- 172.21.15.45:0/2737919180 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6080ab600 con 0x7fe6180b47a0 2023-11-28T18:37:37.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.351+0000 7fe6167fc640 1 -- 172.21.15.45:0/2737919180 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6080a7050 con 0x7fe6180b47a0 2023-11-28T18:37:37.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.351+0000 7fe6167fc640 1 -- 172.21.15.45:0/2737919180 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6080ab980 con 0x7fe6180b47a0 2023-11-28T18:37:37.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.355+0000 7fe61d357640 1 -- 172.21.15.45:0/2737919180 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6180b47a0 msgr2=0x7fe6180d10e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:37.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.355+0000 7fe61d357640 1 --2- 172.21.15.45:0/2737919180 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6180b47a0 0x7fe6180d10e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe61806d860 tx=0x7fe60801c500 comp rx=0 tx=0).stop 2023-11-28T18:37:37.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.355+0000 7fe61d357640 1 -- 172.21.15.45:0/2737919180 shutdown_connections 2023-11-28T18:37:37.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.355+0000 7fe61d357640 1 --2- 172.21.15.45:0/2737919180 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe618142c40 0x7fe618143090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:37.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.355+0000 7fe61d357640 1 --2- 172.21.15.45:0/2737919180 >> v2:172.21.15.190:3300/0 conn(0x7fe6180b4b80 0x7fe6180d1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:37.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.355+0000 7fe61d357640 1 --2- 172.21.15.45:0/2737919180 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6180b47a0 0x7fe6180d10e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:37.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.355+0000 7fe61d357640 1 -- 172.21.15.45:0/2737919180 >> 172.21.15.45:0/2737919180 conn(0x7fe61806a570 msgr2=0x7fe61806a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:37.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.355+0000 7fe61d357640 1 -- 172.21.15.45:0/2737919180 shutdown_connections 2023-11-28T18:37:37.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.355+0000 7fe61d357640 1 -- 172.21.15.45:0/2737919180 wait complete. 2023-11-28T18:37:37.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.355+0000 7fe61d357640 1 Processor -- start 2023-11-28T18:37:37.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.355+0000 7fe61d357640 1 -- start start 2023-11-28T18:37:37.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.355+0000 7fe61d357640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe6180b47a0 0x7fe61813f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:37.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.355+0000 7fe61d357640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6180b4b80 0x7fe618153fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:37.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.355+0000 7fe61d357640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe618142c40 0x7fe618154510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:37.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.355+0000 7fe61d357640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe61813a770 con 0x7fe618142c40 2023-11-28T18:37:37.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.355+0000 7fe61d357640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6181567d0 con 0x7fe6180b47a0 2023-11-28T18:37:37.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.355+0000 7fe61d357640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe61813fbb0 con 0x7fe6180b4b80 2023-11-28T18:37:37.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.355+0000 7fe6177fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe618142c40 0x7fe618154510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:37.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.355+0000 7fe6177fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe618142c40 0x7fe618154510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48874/0 (socket says 172.21.15.45:48874) 2023-11-28T18:37:37.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.355+0000 7fe6177fe640 1 -- 172.21.15.45:0/2320565049 learned_addr learned my addr 172.21.15.45:0/2320565049 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:37.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.355+0000 7fe616ffd640 1 --2- 172.21.15.45:0/2320565049 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe6180b47a0 0x7fe61813f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:37.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.355+0000 7fe60ffff640 1 --2- 172.21.15.45:0/2320565049 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6180b4b80 0x7fe618153fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:37.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.355+0000 7fe6177fe640 1 -- 172.21.15.45:0/2320565049 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6180b4b80 msgr2=0x7fe618153fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:37.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.355+0000 7fe6177fe640 1 --2- 172.21.15.45:0/2320565049 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6180b4b80 0x7fe618153fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:37.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.355+0000 7fe6177fe640 1 -- 172.21.15.45:0/2320565049 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe6180b47a0 msgr2=0x7fe61813f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:37.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.355+0000 7fe6177fe640 1 --2- 172.21.15.45:0/2320565049 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe6180b47a0 0x7fe61813f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:37.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.355+0000 7fe6177fe640 1 -- 172.21.15.45:0/2320565049 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6080094d0 con 0x7fe618142c40 2023-11-28T18:37:37.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.355+0000 7fe6177fe640 1 --2- 172.21.15.45:0/2320565049 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe618142c40 0x7fe618154510 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe610007ea0 tx=0x7fe610007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:37.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.359+0000 7fe60f7fe640 1 -- 172.21.15.45:0/2320565049 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe610003ba0 con 0x7fe618142c40 2023-11-28T18:37:37.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.359+0000 7fe60f7fe640 1 -- 172.21.15.45:0/2320565049 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe61000f040 con 0x7fe618142c40 2023-11-28T18:37:37.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.359+0000 7fe60f7fe640 1 -- 172.21.15.45:0/2320565049 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61000de70 con 0x7fe618142c40 2023-11-28T18:37:37.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.359+0000 7fe61d357640 1 -- 172.21.15.45:0/2320565049 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe61813a9c0 con 0x7fe618142c40 2023-11-28T18:37:37.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.359+0000 7fe61d357640 1 -- 172.21.15.45:0/2320565049 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe61813ee70 con 0x7fe618142c40 2023-11-28T18:37:37.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.359+0000 7fe61d357640 1 -- 172.21.15.45:0/2320565049 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe618069480 con 0x7fe618142c40 2023-11-28T18:37:37.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.359+0000 7fe60f7fe640 1 -- 172.21.15.45:0/2320565049 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe610004030 con 0x7fe618142c40 2023-11-28T18:37:37.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.359+0000 7fe60f7fe640 1 --2- 172.21.15.45:0/2320565049 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe5f80668d0 0x7fe5f8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:37.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.359+0000 7fe60f7fe640 1 -- 172.21.15.45:0/2320565049 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe610084730 con 0x7fe618142c40 2023-11-28T18:37:37.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.359+0000 7fe616ffd640 1 --2- 172.21.15.45:0/2320565049 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe5f80668d0 0x7fe5f8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:37.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.363+0000 7fe616ffd640 1 --2- 172.21.15.45:0/2320565049 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe5f80668d0 0x7fe5f8068d90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe6080ad000 tx=0x7fe608008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:37.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.363+0000 7fe60f7fe640 1 -- 172.21.15.45:0/2320565049 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe6100518d0 con 0x7fe618142c40 2023-11-28T18:37:37.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.519+0000 7fe61d357640 1 -- 172.21.15.45:0/2320565049 --> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe618070d30 con 0x7fe5f80668d0 2023-11-28T18:37:37.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.531+0000 7fe60f7fe640 1 -- 172.21.15.45:0/2320565049 <== mgr.4100 v2:172.21.15.190:6832/645101166 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264657 (secure 0 0 0) 0x7fe618070d30 con 0x7fe5f80668d0 2023-11-28T18:37:37.535 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:37:37.539 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-11-28T18:37:37.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.531+0000 7fe61d357640 1 -- 172.21.15.45:0/2320565049 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe5f80668d0 msgr2=0x7fe5f8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:37.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.531+0000 7fe61d357640 1 --2- 172.21.15.45:0/2320565049 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe5f80668d0 0x7fe5f8068d90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe6080ad000 tx=0x7fe608008040 comp rx=0 tx=0).stop 2023-11-28T18:37:37.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.531+0000 7fe61d357640 1 -- 172.21.15.45:0/2320565049 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe618142c40 msgr2=0x7fe618154510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:37.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.531+0000 7fe61d357640 1 --2- 172.21.15.45:0/2320565049 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe618142c40 0x7fe618154510 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe610007ea0 tx=0x7fe610007f90 comp rx=0 tx=0).stop 2023-11-28T18:37:37.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.531+0000 7fe61d357640 1 -- 172.21.15.45:0/2320565049 shutdown_connections 2023-11-28T18:37:37.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.531+0000 7fe61d357640 1 --2- 172.21.15.45:0/2320565049 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe5f80668d0 0x7fe5f8068d90 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:37.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.531+0000 7fe61d357640 1 --2- 172.21.15.45:0/2320565049 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe618142c40 0x7fe618154510 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:37.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.531+0000 7fe61d357640 1 --2- 172.21.15.45:0/2320565049 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6180b4b80 0x7fe618153fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:37.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.531+0000 7fe61d357640 1 --2- 172.21.15.45:0/2320565049 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe6180b47a0 0x7fe61813f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:37.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.531+0000 7fe61d357640 1 -- 172.21.15.45:0/2320565049 >> 172.21.15.45:0/2320565049 conn(0x7fe61806a570 msgr2=0x7fe6181415f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:37.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.531+0000 7fe61d357640 1 -- 172.21.15.45:0/2320565049 shutdown_connections 2023-11-28T18:37:37.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.531+0000 7fe61d357640 1 -- 172.21.15.45:0/2320565049 wait complete. 2023-11-28T18:37:37.557 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-11-28T18:37:37.234812+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235628,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739092,"statfs":{"total":773094113280,"available":772852830208,"internally_reserved":0,"allocated":2891776,"data_stored":1752836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.794614"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010341+0000","last_change":"2023-11-28T18:37:33.002234+0000","last_active":"2023-11-28T18:37:34.010341+0000","last_peered":"2023-11-28T18:37:34.010341+0000","last_clean":"2023-11-28T18:37:34.010341+0000","last_became_active":"2023-11-28T18:37:33.001965+0000","last_became_peered":"2023-11-28T18:37:33.001965+0000","last_unstale":"2023-11-28T18:37:34.010341+0000","last_undegraded":"2023-11-28T18:37:34.010341+0000","last_fullsized":"2023-11-28T18:37:34.010341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:12:16.071028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.982842+0000","last_change":"2023-11-28T18:37:32.990938+0000","last_active":"2023-11-28T18:37:33.982842+0000","last_peered":"2023-11-28T18:37:33.982842+0000","last_clean":"2023-11-28T18:37:33.982842+0000","last_became_active":"2023-11-28T18:37:32.990637+0000","last_became_peered":"2023-11-28T18:37:32.990637+0000","last_unstale":"2023-11-28T18:37:33.982842+0000","last_undegraded":"2023-11-28T18:37:33.982842+0000","last_fullsized":"2023-11-28T18:37:33.982842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:36:58.955111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.008845+0000","last_change":"2023-11-28T18:37:32.985400+0000","last_active":"2023-11-28T18:37:34.008845+0000","last_peered":"2023-11-28T18:37:34.008845+0000","last_clean":"2023-11-28T18:37:34.008845+0000","last_became_active":"2023-11-28T18:37:32.985067+0000","last_became_peered":"2023-11-28T18:37:32.985067+0000","last_unstale":"2023-11-28T18:37:34.008845+0000","last_undegraded":"2023-11-28T18:37:34.008845+0000","last_fullsized":"2023-11-28T18:37:34.008845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:51:11.286789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.988275+0000","last_change":"2023-11-28T18:37:33.004974+0000","last_active":"2023-11-28T18:37:33.988275+0000","last_peered":"2023-11-28T18:37:33.988275+0000","last_clean":"2023-11-28T18:37:33.988275+0000","last_became_active":"2023-11-28T18:37:33.002365+0000","last_became_peered":"2023-11-28T18:37:33.002365+0000","last_unstale":"2023-11-28T18:37:33.988275+0000","last_undegraded":"2023-11-28T18:37:33.988275+0000","last_fullsized":"2023-11-28T18:37:33.988275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:51:32.411691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009918+0000","last_change":"2023-11-28T18:37:32.998052+0000","last_active":"2023-11-28T18:37:34.009918+0000","last_peered":"2023-11-28T18:37:34.009918+0000","last_clean":"2023-11-28T18:37:34.009918+0000","last_became_active":"2023-11-28T18:37:32.997591+0000","last_became_peered":"2023-11-28T18:37:32.997591+0000","last_unstale":"2023-11-28T18:37:34.009918+0000","last_undegraded":"2023-11-28T18:37:34.009918+0000","last_fullsized":"2023-11-28T18:37:34.009918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:21:13.521447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.988134+0000","last_change":"2023-11-28T18:37:33.005398+0000","last_active":"2023-11-28T18:37:33.988134+0000","last_peered":"2023-11-28T18:37:33.988134+0000","last_clean":"2023-11-28T18:37:33.988134+0000","last_became_active":"2023-11-28T18:37:33.004918+0000","last_became_peered":"2023-11-28T18:37:33.004918+0000","last_unstale":"2023-11-28T18:37:33.988134+0000","last_undegraded":"2023-11-28T18:37:33.988134+0000","last_fullsized":"2023-11-28T18:37:33.988134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:06:19.804273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009575+0000","last_change":"2023-11-28T18:37:33.005051+0000","last_active":"2023-11-28T18:37:34.009575+0000","last_peered":"2023-11-28T18:37:34.009575+0000","last_clean":"2023-11-28T18:37:34.009575+0000","last_became_active":"2023-11-28T18:37:33.004756+0000","last_became_peered":"2023-11-28T18:37:33.004756+0000","last_unstale":"2023-11-28T18:37:34.009575+0000","last_undegraded":"2023-11-28T18:37:34.009575+0000","last_fullsized":"2023-11-28T18:37:34.009575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:06:19.804273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.008210+0000","last_change":"2023-11-28T18:37:32.999195+0000","last_active":"2023-11-28T18:37:34.008210+0000","last_peered":"2023-11-28T18:37:34.008210+0000","last_clean":"2023-11-28T18:37:34.008210+0000","last_became_active":"2023-11-28T18:37:32.998930+0000","last_became_peered":"2023-11-28T18:37:32.998930+0000","last_unstale":"2023-11-28T18:37:34.008210+0000","last_undegraded":"2023-11-28T18:37:34.008210+0000","last_fullsized":"2023-11-28T18:37:34.008210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:51:11.286789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010398+0000","last_change":"2023-11-28T18:37:33.009782+0000","last_active":"2023-11-28T18:37:34.010398+0000","last_peered":"2023-11-28T18:37:34.010398+0000","last_clean":"2023-11-28T18:37:34.010398+0000","last_became_active":"2023-11-28T18:37:33.009103+0000","last_became_peered":"2023-11-28T18:37:33.009103+0000","last_unstale":"2023-11-28T18:37:34.010398+0000","last_undegraded":"2023-11-28T18:37:34.010398+0000","last_fullsized":"2023-11-28T18:37:34.010398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:23:39.816847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010427+0000","last_change":"2023-11-28T18:37:33.006943+0000","last_active":"2023-11-28T18:37:34.010427+0000","last_peered":"2023-11-28T18:37:34.010427+0000","last_clean":"2023-11-28T18:37:34.010427+0000","last_became_active":"2023-11-28T18:37:33.006661+0000","last_became_peered":"2023-11-28T18:37:33.006661+0000","last_unstale":"2023-11-28T18:37:34.010427+0000","last_undegraded":"2023-11-28T18:37:34.010427+0000","last_fullsized":"2023-11-28T18:37:34.010427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:25:41.022219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010329+0000","last_change":"2023-11-28T18:37:33.007305+0000","last_active":"2023-11-28T18:37:34.010329+0000","last_peered":"2023-11-28T18:37:34.010329+0000","last_clean":"2023-11-28T18:37:34.010329+0000","last_became_active":"2023-11-28T18:37:33.006773+0000","last_became_peered":"2023-11-28T18:37:33.006773+0000","last_unstale":"2023-11-28T18:37:34.010329+0000","last_undegraded":"2023-11-28T18:37:34.010329+0000","last_fullsized":"2023-11-28T18:37:34.010329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:51:11.286789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.987768+0000","last_change":"2023-11-28T18:37:33.003324+0000","last_active":"2023-11-28T18:37:33.987768+0000","last_peered":"2023-11-28T18:37:33.987768+0000","last_clean":"2023-11-28T18:37:33.987768+0000","last_became_active":"2023-11-28T18:37:33.002968+0000","last_became_peered":"2023-11-28T18:37:33.002968+0000","last_unstale":"2023-11-28T18:37:33.987768+0000","last_undegraded":"2023-11-28T18:37:33.987768+0000","last_fullsized":"2023-11-28T18:37:33.987768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:21:08.389536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009332+0000","last_change":"2023-11-28T18:37:32.993427+0000","last_active":"2023-11-28T18:37:34.009332+0000","last_peered":"2023-11-28T18:37:34.009332+0000","last_clean":"2023-11-28T18:37:34.009332+0000","last_became_active":"2023-11-28T18:37:32.992763+0000","last_became_peered":"2023-11-28T18:37:32.992763+0000","last_unstale":"2023-11-28T18:37:34.009332+0000","last_undegraded":"2023-11-28T18:37:34.009332+0000","last_fullsized":"2023-11-28T18:37:34.009332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:18:10.978623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.008553+0000","last_change":"2023-11-28T18:37:32.985751+0000","last_active":"2023-11-28T18:37:34.008553+0000","last_peered":"2023-11-28T18:37:34.008553+0000","last_clean":"2023-11-28T18:37:34.008553+0000","last_became_active":"2023-11-28T18:37:32.985475+0000","last_became_peered":"2023-11-28T18:37:32.985475+0000","last_unstale":"2023-11-28T18:37:34.008553+0000","last_undegraded":"2023-11-28T18:37:34.008553+0000","last_fullsized":"2023-11-28T18:37:34.008553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:00:26.206815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.982473+0000","last_change":"2023-11-28T18:37:32.990177+0000","last_active":"2023-11-28T18:37:33.982473+0000","last_peered":"2023-11-28T18:37:33.982473+0000","last_clean":"2023-11-28T18:37:33.982473+0000","last_became_active":"2023-11-28T18:37:32.989658+0000","last_became_peered":"2023-11-28T18:37:32.989658+0000","last_unstale":"2023-11-28T18:37:33.982473+0000","last_undegraded":"2023-11-28T18:37:33.982473+0000","last_fullsized":"2023-11-28T18:37:33.982473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:41:58.493214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.987415+0000","last_change":"2023-11-28T18:37:33.006137+0000","last_active":"2023-11-28T18:37:33.987415+0000","last_peered":"2023-11-28T18:37:33.987415+0000","last_clean":"2023-11-28T18:37:33.987415+0000","last_became_active":"2023-11-28T18:37:33.005771+0000","last_became_peered":"2023-11-28T18:37:33.005771+0000","last_unstale":"2023-11-28T18:37:33.987415+0000","last_undegraded":"2023-11-28T18:37:33.987415+0000","last_fullsized":"2023-11-28T18:37:33.987415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:46:52.261405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.988766+0000","last_change":"2023-11-28T18:37:32.988077+0000","last_active":"2023-11-28T18:37:33.988766+0000","last_peered":"2023-11-28T18:37:33.988766+0000","last_clean":"2023-11-28T18:37:33.988766+0000","last_became_active":"2023-11-28T18:37:32.987801+0000","last_became_peered":"2023-11-28T18:37:32.987801+0000","last_unstale":"2023-11-28T18:37:33.988766+0000","last_undegraded":"2023-11-28T18:37:33.988766+0000","last_fullsized":"2023-11-28T18:37:33.988766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:23:39.816847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.008414+0000","last_change":"2023-11-28T18:37:32.992425+0000","last_active":"2023-11-28T18:37:34.008414+0000","last_peered":"2023-11-28T18:37:34.008414+0000","last_clean":"2023-11-28T18:37:34.008414+0000","last_became_active":"2023-11-28T18:37:32.992154+0000","last_became_peered":"2023-11-28T18:37:32.992154+0000","last_unstale":"2023-11-28T18:37:34.008414+0000","last_undegraded":"2023-11-28T18:37:34.008414+0000","last_fullsized":"2023-11-28T18:37:34.008414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:50:17.263359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010302+0000","last_change":"2023-11-28T18:37:32.998538+0000","last_active":"2023-11-28T18:37:34.010302+0000","last_peered":"2023-11-28T18:37:34.010302+0000","last_clean":"2023-11-28T18:37:34.010302+0000","last_became_active":"2023-11-28T18:37:32.998182+0000","last_became_peered":"2023-11-28T18:37:32.998182+0000","last_unstale":"2023-11-28T18:37:34.010302+0000","last_undegraded":"2023-11-28T18:37:34.010302+0000","last_fullsized":"2023-11-28T18:37:34.010302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:31:53.513239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010699+0000","last_change":"2023-11-28T18:37:33.001416+0000","last_active":"2023-11-28T18:37:34.010699+0000","last_peered":"2023-11-28T18:37:34.010699+0000","last_clean":"2023-11-28T18:37:34.010699+0000","last_became_active":"2023-11-28T18:37:33.000906+0000","last_became_peered":"2023-11-28T18:37:33.000906+0000","last_unstale":"2023-11-28T18:37:34.010699+0000","last_undegraded":"2023-11-28T18:37:34.010699+0000","last_fullsized":"2023-11-28T18:37:34.010699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:46:52.261405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.008737+0000","last_change":"2023-11-28T18:37:32.993468+0000","last_active":"2023-11-28T18:37:34.008737+0000","last_peered":"2023-11-28T18:37:34.008737+0000","last_clean":"2023-11-28T18:37:34.008737+0000","last_became_active":"2023-11-28T18:37:32.993143+0000","last_became_peered":"2023-11-28T18:37:32.993143+0000","last_unstale":"2023-11-28T18:37:34.008737+0000","last_undegraded":"2023-11-28T18:37:34.008737+0000","last_fullsized":"2023-11-28T18:37:34.008737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:51:55.517713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.988214+0000","last_change":"2023-11-28T18:37:32.986554+0000","last_active":"2023-11-28T18:37:33.988214+0000","last_peered":"2023-11-28T18:37:33.988214+0000","last_clean":"2023-11-28T18:37:33.988214+0000","last_became_active":"2023-11-28T18:37:32.986211+0000","last_became_peered":"2023-11-28T18:37:32.986211+0000","last_unstale":"2023-11-28T18:37:33.988214+0000","last_undegraded":"2023-11-28T18:37:33.988214+0000","last_fullsized":"2023-11-28T18:37:33.988214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:02:53.545778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.008208+0000","last_change":"2023-11-28T18:37:32.995076+0000","last_active":"2023-11-28T18:37:34.008208+0000","last_peered":"2023-11-28T18:37:34.008208+0000","last_clean":"2023-11-28T18:37:34.008208+0000","last_became_active":"2023-11-28T18:37:32.994774+0000","last_became_peered":"2023-11-28T18:37:32.994774+0000","last_unstale":"2023-11-28T18:37:34.008208+0000","last_undegraded":"2023-11-28T18:37:34.008208+0000","last_fullsized":"2023-11-28T18:37:34.008208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:51:55.517713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.987940+0000","last_change":"2023-11-28T18:37:32.991513+0000","last_active":"2023-11-28T18:37:33.987940+0000","last_peered":"2023-11-28T18:37:33.987940+0000","last_clean":"2023-11-28T18:37:33.987940+0000","last_became_active":"2023-11-28T18:37:32.990880+0000","last_became_peered":"2023-11-28T18:37:32.990880+0000","last_unstale":"2023-11-28T18:37:33.987940+0000","last_undegraded":"2023-11-28T18:37:33.987940+0000","last_fullsized":"2023-11-28T18:37:33.987940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:36:58.955111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009754+0000","last_change":"2023-11-28T18:37:32.995075+0000","last_active":"2023-11-28T18:37:34.009754+0000","last_peered":"2023-11-28T18:37:34.009754+0000","last_clean":"2023-11-28T18:37:34.009754+0000","last_became_active":"2023-11-28T18:37:32.994733+0000","last_became_peered":"2023-11-28T18:37:32.994733+0000","last_unstale":"2023-11-28T18:37:34.009754+0000","last_undegraded":"2023-11-28T18:37:34.009754+0000","last_fullsized":"2023-11-28T18:37:34.009754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:51:32.411691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010515+0000","last_change":"2023-11-28T18:37:33.000138+0000","last_active":"2023-11-28T18:37:34.010515+0000","last_peered":"2023-11-28T18:37:34.010515+0000","last_clean":"2023-11-28T18:37:34.010515+0000","last_became_active":"2023-11-28T18:37:32.999035+0000","last_became_peered":"2023-11-28T18:37:32.999035+0000","last_unstale":"2023-11-28T18:37:34.010515+0000","last_undegraded":"2023-11-28T18:37:34.010515+0000","last_fullsized":"2023-11-28T18:37:34.010515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:41:58.493214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.982735+0000","last_change":"2023-11-28T18:37:32.987199+0000","last_active":"2023-11-28T18:37:33.982735+0000","last_peered":"2023-11-28T18:37:33.982735+0000","last_clean":"2023-11-28T18:37:33.982735+0000","last_became_active":"2023-11-28T18:37:32.986904+0000","last_became_peered":"2023-11-28T18:37:32.986904+0000","last_unstale":"2023-11-28T18:37:33.982735+0000","last_undegraded":"2023-11-28T18:37:33.982735+0000","last_fullsized":"2023-11-28T18:37:33.982735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:46:52.261405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009632+0000","last_change":"2023-11-28T18:37:32.993541+0000","last_active":"2023-11-28T18:37:34.009632+0000","last_peered":"2023-11-28T18:37:34.009632+0000","last_clean":"2023-11-28T18:37:34.009632+0000","last_became_active":"2023-11-28T18:37:32.993323+0000","last_became_peered":"2023-11-28T18:37:32.993323+0000","last_unstale":"2023-11-28T18:37:34.009632+0000","last_undegraded":"2023-11-28T18:37:34.009632+0000","last_fullsized":"2023-11-28T18:37:34.009632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:06:19.804273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.008872+0000","last_change":"2023-11-28T18:37:32.987939+0000","last_active":"2023-11-28T18:37:34.008872+0000","last_peered":"2023-11-28T18:37:34.008872+0000","last_clean":"2023-11-28T18:37:34.008872+0000","last_became_active":"2023-11-28T18:37:32.987277+0000","last_became_peered":"2023-11-28T18:37:32.987277+0000","last_unstale":"2023-11-28T18:37:34.008872+0000","last_undegraded":"2023-11-28T18:37:34.008872+0000","last_fullsized":"2023-11-28T18:37:34.008872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:25:41.022219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.988304+0000","last_change":"2023-11-28T18:37:33.008318+0000","last_active":"2023-11-28T18:37:33.988304+0000","last_peered":"2023-11-28T18:37:33.988304+0000","last_clean":"2023-11-28T18:37:33.988304+0000","last_became_active":"2023-11-28T18:37:33.007984+0000","last_became_peered":"2023-11-28T18:37:33.007984+0000","last_unstale":"2023-11-28T18:37:33.988304+0000","last_undegraded":"2023-11-28T18:37:33.988304+0000","last_fullsized":"2023-11-28T18:37:33.988304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:21:13.521447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.008387+0000","last_change":"2023-11-28T18:37:32.999800+0000","last_active":"2023-11-28T18:37:34.008387+0000","last_peered":"2023-11-28T18:37:34.008387+0000","last_clean":"2023-11-28T18:37:34.008387+0000","last_became_active":"2023-11-28T18:37:32.999536+0000","last_became_peered":"2023-11-28T18:37:32.999536+0000","last_unstale":"2023-11-28T18:37:34.008387+0000","last_undegraded":"2023-11-28T18:37:34.008387+0000","last_fullsized":"2023-11-28T18:37:34.008387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:07:42.147988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009871+0000","last_change":"2023-11-28T18:37:32.998966+0000","last_active":"2023-11-28T18:37:34.009871+0000","last_peered":"2023-11-28T18:37:34.009871+0000","last_clean":"2023-11-28T18:37:34.009871+0000","last_became_active":"2023-11-28T18:37:32.993970+0000","last_became_peered":"2023-11-28T18:37:32.993970+0000","last_unstale":"2023-11-28T18:37:34.009871+0000","last_undegraded":"2023-11-28T18:37:34.009871+0000","last_fullsized":"2023-11-28T18:37:34.009871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:31:28.921268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.987253+0000","last_change":"2023-11-28T18:37:32.990285+0000","last_active":"2023-11-28T18:37:33.987253+0000","last_peered":"2023-11-28T18:37:33.987253+0000","last_clean":"2023-11-28T18:37:33.987253+0000","last_became_active":"2023-11-28T18:37:32.989187+0000","last_became_peered":"2023-11-28T18:37:32.989187+0000","last_unstale":"2023-11-28T18:37:33.987253+0000","last_undegraded":"2023-11-28T18:37:33.987253+0000","last_fullsized":"2023-11-28T18:37:33.987253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:18:33.551197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009443+0000","last_change":"2023-11-28T18:37:32.479159+0000","last_active":"2023-11-28T18:37:34.009443+0000","last_peered":"2023-11-28T18:37:34.009443+0000","last_clean":"2023-11-28T18:37:34.009443+0000","last_became_active":"2023-11-28T18:37:32.478817+0000","last_became_peered":"2023-11-28T18:37:32.478817+0000","last_unstale":"2023-11-28T18:37:34.009443+0000","last_undegraded":"2023-11-28T18:37:34.009443+0000","last_fullsized":"2023-11-28T18:37:34.009443+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:22:48.248148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.008990+0000","last_change":"2023-11-28T18:37:32.991264+0000","last_active":"2023-11-28T18:37:34.008990+0000","last_peered":"2023-11-28T18:37:34.008990+0000","last_clean":"2023-11-28T18:37:34.008990+0000","last_became_active":"2023-11-28T18:37:32.990660+0000","last_became_peered":"2023-11-28T18:37:32.990660+0000","last_unstale":"2023-11-28T18:37:34.008990+0000","last_undegraded":"2023-11-28T18:37:34.008990+0000","last_fullsized":"2023-11-28T18:37:34.008990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:18:10.978623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010626+0000","last_change":"2023-11-28T18:37:32.468052+0000","last_active":"2023-11-28T18:37:34.010626+0000","last_peered":"2023-11-28T18:37:34.010626+0000","last_clean":"2023-11-28T18:37:34.010626+0000","last_became_active":"2023-11-28T18:37:32.467747+0000","last_became_peered":"2023-11-28T18:37:32.467747+0000","last_unstale":"2023-11-28T18:37:34.010626+0000","last_undegraded":"2023-11-28T18:37:34.010626+0000","last_fullsized":"2023-11-28T18:37:34.010626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:56:54.321744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.008647+0000","last_change":"2023-11-28T18:37:32.465213+0000","last_active":"2023-11-28T18:37:34.008647+0000","last_peered":"2023-11-28T18:37:34.008647+0000","last_clean":"2023-11-28T18:37:34.008647+0000","last_became_active":"2023-11-28T18:37:32.464911+0000","last_became_peered":"2023-11-28T18:37:32.464911+0000","last_unstale":"2023-11-28T18:37:34.008647+0000","last_undegraded":"2023-11-28T18:37:34.008647+0000","last_fullsized":"2023-11-28T18:37:34.008647+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:16:52.138851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.008326+0000","last_change":"2023-11-28T18:37:32.988182+0000","last_active":"2023-11-28T18:37:34.008326+0000","last_peered":"2023-11-28T18:37:34.008326+0000","last_clean":"2023-11-28T18:37:34.008326+0000","last_became_active":"2023-11-28T18:37:32.987804+0000","last_became_peered":"2023-11-28T18:37:32.987804+0000","last_unstale":"2023-11-28T18:37:34.008326+0000","last_undegraded":"2023-11-28T18:37:34.008326+0000","last_fullsized":"2023-11-28T18:37:34.008326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:25:41.022219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.987941+0000","last_change":"2023-11-28T18:37:32.467329+0000","last_active":"2023-11-28T18:37:33.987941+0000","last_peered":"2023-11-28T18:37:33.987941+0000","last_clean":"2023-11-28T18:37:33.987941+0000","last_became_active":"2023-11-28T18:37:32.467064+0000","last_became_peered":"2023-11-28T18:37:32.467064+0000","last_unstale":"2023-11-28T18:37:33.987941+0000","last_undegraded":"2023-11-28T18:37:33.987941+0000","last_fullsized":"2023-11-28T18:37:33.987941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:56:54.321744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.982413+0000","last_change":"2023-11-28T18:37:32.989944+0000","last_active":"2023-11-28T18:37:33.982413+0000","last_peered":"2023-11-28T18:37:33.982413+0000","last_clean":"2023-11-28T18:37:33.982413+0000","last_became_active":"2023-11-28T18:37:32.989285+0000","last_became_peered":"2023-11-28T18:37:32.989285+0000","last_unstale":"2023-11-28T18:37:33.982413+0000","last_undegraded":"2023-11-28T18:37:33.982413+0000","last_fullsized":"2023-11-28T18:37:33.982413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:51:11.286789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010624+0000","last_change":"2023-11-28T18:37:32.471802+0000","last_active":"2023-11-28T18:37:34.010624+0000","last_peered":"2023-11-28T18:37:34.010624+0000","last_clean":"2023-11-28T18:37:34.010624+0000","last_became_active":"2023-11-28T18:37:32.471420+0000","last_became_peered":"2023-11-28T18:37:32.471420+0000","last_unstale":"2023-11-28T18:37:34.010624+0000","last_undegraded":"2023-11-28T18:37:34.010624+0000","last_fullsized":"2023-11-28T18:37:34.010624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:22:48.248148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.988629+0000","last_change":"2023-11-28T18:37:33.002175+0000","last_active":"2023-11-28T18:37:33.988629+0000","last_peered":"2023-11-28T18:37:33.988629+0000","last_clean":"2023-11-28T18:37:33.988629+0000","last_became_active":"2023-11-28T18:37:33.001279+0000","last_became_peered":"2023-11-28T18:37:33.001279+0000","last_unstale":"2023-11-28T18:37:33.988629+0000","last_undegraded":"2023-11-28T18:37:33.988629+0000","last_fullsized":"2023-11-28T18:37:33.988629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:38:59.556086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.988637+0000","last_change":"2023-11-28T18:37:32.466165+0000","last_active":"2023-11-28T18:37:33.988637+0000","last_peered":"2023-11-28T18:37:33.988637+0000","last_clean":"2023-11-28T18:37:33.988637+0000","last_became_active":"2023-11-28T18:37:32.465812+0000","last_became_peered":"2023-11-28T18:37:32.465812+0000","last_unstale":"2023-11-28T18:37:33.988637+0000","last_undegraded":"2023-11-28T18:37:33.988637+0000","last_fullsized":"2023-11-28T18:37:33.988637+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:51:10.284272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009093+0000","last_change":"2023-11-28T18:37:32.988109+0000","last_active":"2023-11-28T18:37:34.009093+0000","last_peered":"2023-11-28T18:37:34.009093+0000","last_clean":"2023-11-28T18:37:34.009093+0000","last_became_active":"2023-11-28T18:37:32.987621+0000","last_became_peered":"2023-11-28T18:37:32.987621+0000","last_unstale":"2023-11-28T18:37:34.009093+0000","last_undegraded":"2023-11-28T18:37:34.009093+0000","last_fullsized":"2023-11-28T18:37:34.009093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:36:58.955111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.982698+0000","last_change":"2023-11-28T18:37:32.459182+0000","last_active":"2023-11-28T18:37:33.982698+0000","last_peered":"2023-11-28T18:37:33.982698+0000","last_clean":"2023-11-28T18:37:33.982698+0000","last_became_active":"2023-11-28T18:37:32.458898+0000","last_became_peered":"2023-11-28T18:37:32.458898+0000","last_unstale":"2023-11-28T18:37:33.982698+0000","last_undegraded":"2023-11-28T18:37:33.982698+0000","last_fullsized":"2023-11-28T18:37:33.982698+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:31:27.918750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.987863+0000","last_change":"2023-11-28T18:37:32.992373+0000","last_active":"2023-11-28T18:37:33.987863+0000","last_peered":"2023-11-28T18:37:33.987863+0000","last_clean":"2023-11-28T18:37:33.987863+0000","last_became_active":"2023-11-28T18:37:32.992176+0000","last_became_peered":"2023-11-28T18:37:32.992176+0000","last_unstale":"2023-11-28T18:37:33.987863+0000","last_undegraded":"2023-11-28T18:37:33.987863+0000","last_fullsized":"2023-11-28T18:37:33.987863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:07:42.147988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010211+0000","last_change":"2023-11-28T18:37:32.471764+0000","last_active":"2023-11-28T18:37:34.010211+0000","last_peered":"2023-11-28T18:37:34.010211+0000","last_clean":"2023-11-28T18:37:34.010211+0000","last_became_active":"2023-11-28T18:37:32.471432+0000","last_became_peered":"2023-11-28T18:37:32.471432+0000","last_unstale":"2023-11-28T18:37:34.010211+0000","last_undegraded":"2023-11-28T18:37:34.010211+0000","last_fullsized":"2023-11-28T18:37:34.010211+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:50:16.260842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009845+0000","last_change":"2023-11-28T18:37:32.996529+0000","last_active":"2023-11-28T18:37:34.009845+0000","last_peered":"2023-11-28T18:37:34.009845+0000","last_clean":"2023-11-28T18:37:34.009845+0000","last_became_active":"2023-11-28T18:37:32.996242+0000","last_became_peered":"2023-11-28T18:37:32.996242+0000","last_unstale":"2023-11-28T18:37:34.009845+0000","last_undegraded":"2023-11-28T18:37:34.009845+0000","last_fullsized":"2023-11-28T18:37:34.009845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:51:32.411691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009074+0000","last_change":"2023-11-28T18:37:32.473745+0000","last_active":"2023-11-28T18:37:34.009074+0000","last_peered":"2023-11-28T18:37:34.009074+0000","last_clean":"2023-11-28T18:37:34.009074+0000","last_became_active":"2023-11-28T18:37:32.473429+0000","last_became_peered":"2023-11-28T18:37:32.473429+0000","last_unstale":"2023-11-28T18:37:34.009074+0000","last_undegraded":"2023-11-28T18:37:34.009074+0000","last_fullsized":"2023-11-28T18:37:34.009074+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:16:52.138851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.008617+0000","last_change":"2023-11-28T18:37:32.987646+0000","last_active":"2023-11-28T18:37:34.008617+0000","last_peered":"2023-11-28T18:37:34.008617+0000","last_clean":"2023-11-28T18:37:34.008617+0000","last_became_active":"2023-11-28T18:37:32.987313+0000","last_became_peered":"2023-11-28T18:37:32.987313+0000","last_unstale":"2023-11-28T18:37:34.008617+0000","last_undegraded":"2023-11-28T18:37:34.008617+0000","last_fullsized":"2023-11-28T18:37:34.008617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:31:28.921268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.988317+0000","last_change":"2023-11-28T18:37:32.472535+0000","last_active":"2023-11-28T18:37:33.988317+0000","last_peered":"2023-11-28T18:37:33.988317+0000","last_clean":"2023-11-28T18:37:33.988317+0000","last_became_active":"2023-11-28T18:37:32.470189+0000","last_became_peered":"2023-11-28T18:37:32.470189+0000","last_unstale":"2023-11-28T18:37:33.988317+0000","last_undegraded":"2023-11-28T18:37:33.988317+0000","last_fullsized":"2023-11-28T18:37:33.988317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:25:40.019702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010041+0000","last_change":"2023-11-28T18:37:33.007113+0000","last_active":"2023-11-28T18:37:34.010041+0000","last_peered":"2023-11-28T18:37:34.010041+0000","last_clean":"2023-11-28T18:37:34.010041+0000","last_became_active":"2023-11-28T18:37:33.006542+0000","last_became_peered":"2023-11-28T18:37:33.006542+0000","last_unstale":"2023-11-28T18:37:34.010041+0000","last_undegraded":"2023-11-28T18:37:34.010041+0000","last_fullsized":"2023-11-28T18:37:34.010041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:43:32.482112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010033+0000","last_change":"2023-11-28T18:37:32.468727+0000","last_active":"2023-11-28T18:37:34.010033+0000","last_peered":"2023-11-28T18:37:34.010033+0000","last_clean":"2023-11-28T18:37:34.010033+0000","last_became_active":"2023-11-28T18:37:32.467363+0000","last_became_peered":"2023-11-28T18:37:32.467363+0000","last_unstale":"2023-11-28T18:37:34.010033+0000","last_undegraded":"2023-11-28T18:37:34.010033+0000","last_fullsized":"2023-11-28T18:37:34.010033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:16:52.138851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010291+0000","last_change":"2023-11-28T18:37:32.994176+0000","last_active":"2023-11-28T18:37:34.010291+0000","last_peered":"2023-11-28T18:37:34.010291+0000","last_clean":"2023-11-28T18:37:34.010291+0000","last_became_active":"2023-11-28T18:37:32.993577+0000","last_became_peered":"2023-11-28T18:37:32.993577+0000","last_unstale":"2023-11-28T18:37:34.010291+0000","last_undegraded":"2023-11-28T18:37:34.010291+0000","last_fullsized":"2023-11-28T18:37:34.010291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:51:55.517713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.007852+0000","last_change":"2023-11-28T18:37:32.466190+0000","last_active":"2023-11-28T18:37:34.007852+0000","last_peered":"2023-11-28T18:37:34.007852+0000","last_clean":"2023-11-28T18:37:34.007852+0000","last_became_active":"2023-11-28T18:37:32.465855+0000","last_became_peered":"2023-11-28T18:37:32.465855+0000","last_unstale":"2023-11-28T18:37:34.007852+0000","last_undegraded":"2023-11-28T18:37:34.007852+0000","last_fullsized":"2023-11-28T18:37:34.007852+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:18:32.548680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009694+0000","last_change":"2023-11-28T18:37:33.011619+0000","last_active":"2023-11-28T18:37:34.009694+0000","last_peered":"2023-11-28T18:37:34.009694+0000","last_clean":"2023-11-28T18:37:34.009694+0000","last_became_active":"2023-11-28T18:37:33.011164+0000","last_became_peered":"2023-11-28T18:37:33.011164+0000","last_unstale":"2023-11-28T18:37:34.009694+0000","last_undegraded":"2023-11-28T18:37:34.009694+0000","last_fullsized":"2023-11-28T18:37:34.009694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:02:53.545778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.987604+0000","last_change":"2023-11-28T18:37:32.472353+0000","last_active":"2023-11-28T18:37:33.987604+0000","last_peered":"2023-11-28T18:37:33.987604+0000","last_clean":"2023-11-28T18:37:33.987604+0000","last_became_active":"2023-11-28T18:37:32.472028+0000","last_became_peered":"2023-11-28T18:37:32.472028+0000","last_unstale":"2023-11-28T18:37:33.987604+0000","last_undegraded":"2023-11-28T18:37:33.987604+0000","last_fullsized":"2023-11-28T18:37:33.987604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:06:15.023841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010260+0000","last_change":"2023-11-28T18:37:33.006869+0000","last_active":"2023-11-28T18:37:34.010260+0000","last_peered":"2023-11-28T18:37:34.010260+0000","last_clean":"2023-11-28T18:37:34.010260+0000","last_became_active":"2023-11-28T18:37:33.006496+0000","last_became_peered":"2023-11-28T18:37:33.006496+0000","last_unstale":"2023-11-28T18:37:34.010260+0000","last_undegraded":"2023-11-28T18:37:34.010260+0000","last_fullsized":"2023-11-28T18:37:34.010260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:38:59.556086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.008466+0000","last_change":"2023-11-28T18:37:32.461121+0000","last_active":"2023-11-28T18:37:34.008466+0000","last_peered":"2023-11-28T18:37:34.008466+0000","last_clean":"2023-11-28T18:37:34.008466+0000","last_became_active":"2023-11-28T18:37:32.460769+0000","last_became_peered":"2023-11-28T18:37:32.460769+0000","last_unstale":"2023-11-28T18:37:34.008466+0000","last_undegraded":"2023-11-28T18:37:34.008466+0000","last_fullsized":"2023-11-28T18:37:34.008466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:18:56.938399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010480+0000","last_change":"2023-11-28T18:37:33.007274+0000","last_active":"2023-11-28T18:37:34.010480+0000","last_peered":"2023-11-28T18:37:34.010480+0000","last_clean":"2023-11-28T18:37:34.010480+0000","last_became_active":"2023-11-28T18:37:33.007033+0000","last_became_peered":"2023-11-28T18:37:33.007033+0000","last_unstale":"2023-11-28T18:37:34.010480+0000","last_undegraded":"2023-11-28T18:37:34.010480+0000","last_fullsized":"2023-11-28T18:37:34.010480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:31:52.252862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.982789+0000","last_change":"2023-11-28T18:37:32.466332+0000","last_active":"2023-11-28T18:37:33.982789+0000","last_peered":"2023-11-28T18:37:33.982789+0000","last_clean":"2023-11-28T18:37:33.982789+0000","last_became_active":"2023-11-28T18:37:32.464365+0000","last_became_peered":"2023-11-28T18:37:32.464365+0000","last_unstale":"2023-11-28T18:37:33.982789+0000","last_undegraded":"2023-11-28T18:37:33.982789+0000","last_fullsized":"2023-11-28T18:37:33.982789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:51:54.515196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.988455+0000","last_change":"2023-11-28T18:37:33.000939+0000","last_active":"2023-11-28T18:37:33.988455+0000","last_peered":"2023-11-28T18:37:33.988455+0000","last_clean":"2023-11-28T18:37:33.988455+0000","last_became_active":"2023-11-28T18:37:32.994852+0000","last_became_peered":"2023-11-28T18:37:32.994852+0000","last_unstale":"2023-11-28T18:37:33.988455+0000","last_undegraded":"2023-11-28T18:37:33.988455+0000","last_fullsized":"2023-11-28T18:37:33.988455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:43:32.482112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.008261+0000","last_change":"2023-11-28T18:37:32.466158+0000","last_active":"2023-11-28T18:37:34.008261+0000","last_peered":"2023-11-28T18:37:34.008261+0000","last_clean":"2023-11-28T18:37:34.008261+0000","last_became_active":"2023-11-28T18:37:32.465844+0000","last_became_peered":"2023-11-28T18:37:32.465844+0000","last_unstale":"2023-11-28T18:37:34.008261+0000","last_undegraded":"2023-11-28T18:37:34.008261+0000","last_fullsized":"2023-11-28T18:37:34.008261+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:21:07.387019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009932+0000","last_change":"2023-11-28T18:37:33.009557+0000","last_active":"2023-11-28T18:37:34.009932+0000","last_peered":"2023-11-28T18:37:34.009932+0000","last_clean":"2023-11-28T18:37:34.009932+0000","last_became_active":"2023-11-28T18:37:33.008838+0000","last_became_peered":"2023-11-28T18:37:33.008838+0000","last_unstale":"2023-11-28T18:37:34.009932+0000","last_undegraded":"2023-11-28T18:37:34.009932+0000","last_fullsized":"2023-11-28T18:37:34.009932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:20:33.664753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T18:37:32.991019+0000","last_change":"2023-11-28T18:37:22.369132+0000","last_active":"2023-11-28T18:37:32.991019+0000","last_peered":"2023-11-28T18:37:32.991019+0000","last_clean":"2023-11-28T18:37:32.991019+0000","last_became_active":"2023-11-28T18:37:22.368142+0000","last_became_peered":"2023-11-28T18:37:22.368142+0000","last_unstale":"2023-11-28T18:37:32.991019+0000","last_undegraded":"2023-11-28T18:37:32.991019+0000","last_fullsized":"2023-11-28T18:37:32.991019+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:21.313053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:21.313053+0000","last_clean_scrub_stamp":"2023-11-28T18:37:21.313053+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:55:01.432028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.988127+0000","last_change":"2023-11-28T18:37:32.466471+0000","last_active":"2023-11-28T18:37:33.988127+0000","last_peered":"2023-11-28T18:37:33.988127+0000","last_clean":"2023-11-28T18:37:33.988127+0000","last_became_active":"2023-11-28T18:37:32.466153+0000","last_became_peered":"2023-11-28T18:37:32.466153+0000","last_unstale":"2023-11-28T18:37:33.988127+0000","last_undegraded":"2023-11-28T18:37:33.988127+0000","last_fullsized":"2023-11-28T18:37:33.988127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:31:52.780773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009403+0000","last_change":"2023-11-28T18:37:32.999109+0000","last_active":"2023-11-28T18:37:34.009403+0000","last_peered":"2023-11-28T18:37:34.009403+0000","last_clean":"2023-11-28T18:37:34.009403+0000","last_became_active":"2023-11-28T18:37:32.998842+0000","last_became_peered":"2023-11-28T18:37:32.998842+0000","last_unstale":"2023-11-28T18:37:34.009403+0000","last_undegraded":"2023-11-28T18:37:34.009403+0000","last_fullsized":"2023-11-28T18:37:34.009403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:36:58.955111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009483+0000","last_change":"2023-11-28T18:37:32.478867+0000","last_active":"2023-11-28T18:37:34.009483+0000","last_peered":"2023-11-28T18:37:34.009483+0000","last_clean":"2023-11-28T18:37:34.009483+0000","last_became_active":"2023-11-28T18:37:32.478483+0000","last_became_peered":"2023-11-28T18:37:32.478483+0000","last_unstale":"2023-11-28T18:37:34.009483+0000","last_undegraded":"2023-11-28T18:37:34.009483+0000","last_fullsized":"2023-11-28T18:37:34.009483+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:21:07.387019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.008034+0000","last_change":"2023-11-28T18:37:32.984449+0000","last_active":"2023-11-28T18:37:34.008034+0000","last_peered":"2023-11-28T18:37:34.008034+0000","last_clean":"2023-11-28T18:37:34.008034+0000","last_became_active":"2023-11-28T18:37:32.984134+0000","last_became_peered":"2023-11-28T18:37:32.984134+0000","last_unstale":"2023-11-28T18:37:34.008034+0000","last_undegraded":"2023-11-28T18:37:34.008034+0000","last_fullsized":"2023-11-28T18:37:34.008034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:22:49.250665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.008158+0000","last_change":"2023-11-28T18:37:32.455919+0000","last_active":"2023-11-28T18:37:34.008158+0000","last_peered":"2023-11-28T18:37:34.008158+0000","last_clean":"2023-11-28T18:37:34.008158+0000","last_became_active":"2023-11-28T18:37:32.455643+0000","last_became_peered":"2023-11-28T18:37:32.455643+0000","last_unstale":"2023-11-28T18:37:34.008158+0000","last_undegraded":"2023-11-28T18:37:34.008158+0000","last_fullsized":"2023-11-28T18:37:34.008158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:47:06.994491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.982436+0000","last_change":"2023-11-28T18:37:32.985903+0000","last_active":"2023-11-28T18:37:33.982436+0000","last_peered":"2023-11-28T18:37:33.982436+0000","last_clean":"2023-11-28T18:37:33.982436+0000","last_became_active":"2023-11-28T18:37:32.985566+0000","last_became_peered":"2023-11-28T18:37:32.985566+0000","last_unstale":"2023-11-28T18:37:33.982436+0000","last_undegraded":"2023-11-28T18:37:33.982436+0000","last_fullsized":"2023-11-28T18:37:33.982436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:25:41.022219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.988411+0000","last_change":"2023-11-28T18:37:32.470133+0000","last_active":"2023-11-28T18:37:33.988411+0000","last_peered":"2023-11-28T18:37:33.988411+0000","last_clean":"2023-11-28T18:37:33.988411+0000","last_became_active":"2023-11-28T18:37:32.468215+0000","last_became_peered":"2023-11-28T18:37:32.468215+0000","last_unstale":"2023-11-28T18:37:33.988411+0000","last_undegraded":"2023-11-28T18:37:33.988411+0000","last_fullsized":"2023-11-28T18:37:33.988411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:41:57.490696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.987855+0000","last_change":"2023-11-28T18:37:32.983380+0000","last_active":"2023-11-28T18:37:33.987855+0000","last_peered":"2023-11-28T18:37:33.987855+0000","last_clean":"2023-11-28T18:37:33.987855+0000","last_became_active":"2023-11-28T18:37:32.982867+0000","last_became_peered":"2023-11-28T18:37:32.982867+0000","last_unstale":"2023-11-28T18:37:33.987855+0000","last_undegraded":"2023-11-28T18:37:33.987855+0000","last_fullsized":"2023-11-28T18:37:33.987855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:18:57.940916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.982747+0000","last_change":"2023-11-28T18:37:32.471305+0000","last_active":"2023-11-28T18:37:33.982747+0000","last_peered":"2023-11-28T18:37:33.982747+0000","last_clean":"2023-11-28T18:37:33.982747+0000","last_became_active":"2023-11-28T18:37:32.470236+0000","last_became_peered":"2023-11-28T18:37:32.470236+0000","last_unstale":"2023-11-28T18:37:33.982747+0000","last_undegraded":"2023-11-28T18:37:33.982747+0000","last_fullsized":"2023-11-28T18:37:33.982747+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:00:25.204297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.988693+0000","last_change":"2023-11-28T18:37:32.999867+0000","last_active":"2023-11-28T18:37:33.988693+0000","last_peered":"2023-11-28T18:37:33.988693+0000","last_clean":"2023-11-28T18:37:33.988693+0000","last_became_active":"2023-11-28T18:37:32.994734+0000","last_became_peered":"2023-11-28T18:37:32.994734+0000","last_unstale":"2023-11-28T18:37:33.988693+0000","last_undegraded":"2023-11-28T18:37:33.988693+0000","last_fullsized":"2023-11-28T18:37:33.988693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:31:53.513239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010425+0000","last_change":"2023-11-28T18:37:32.481867+0000","last_active":"2023-11-28T18:37:34.010425+0000","last_peered":"2023-11-28T18:37:34.010425+0000","last_clean":"2023-11-28T18:37:34.010425+0000","last_became_active":"2023-11-28T18:37:32.481470+0000","last_became_peered":"2023-11-28T18:37:32.481470+0000","last_unstale":"2023-11-28T18:37:34.010425+0000","last_undegraded":"2023-11-28T18:37:34.010425+0000","last_fullsized":"2023-11-28T18:37:34.010425+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:41:57.490696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.982689+0000","last_change":"2023-11-28T18:37:32.988151+0000","last_active":"2023-11-28T18:37:33.982689+0000","last_peered":"2023-11-28T18:37:33.982689+0000","last_clean":"2023-11-28T18:37:33.982689+0000","last_became_active":"2023-11-28T18:37:32.987895+0000","last_became_peered":"2023-11-28T18:37:32.987895+0000","last_unstale":"2023-11-28T18:37:33.982689+0000","last_undegraded":"2023-11-28T18:37:33.982689+0000","last_fullsized":"2023-11-28T18:37:33.982689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:18:10.978623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.982858+0000","last_change":"2023-11-28T18:37:32.464191+0000","last_active":"2023-11-28T18:37:33.982858+0000","last_peered":"2023-11-28T18:37:33.982858+0000","last_clean":"2023-11-28T18:37:33.982858+0000","last_became_active":"2023-11-28T18:37:32.463835+0000","last_became_peered":"2023-11-28T18:37:32.463835+0000","last_unstale":"2023-11-28T18:37:33.982858+0000","last_undegraded":"2023-11-28T18:37:33.982858+0000","last_fullsized":"2023-11-28T18:37:33.982858+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:22:48.248148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009821+0000","last_change":"2023-11-28T18:37:32.995912+0000","last_active":"2023-11-28T18:37:34.009821+0000","last_peered":"2023-11-28T18:37:34.009821+0000","last_clean":"2023-11-28T18:37:34.009821+0000","last_became_active":"2023-11-28T18:37:32.995582+0000","last_became_peered":"2023-11-28T18:37:32.995582+0000","last_unstale":"2023-11-28T18:37:34.009821+0000","last_undegraded":"2023-11-28T18:37:34.009821+0000","last_fullsized":"2023-11-28T18:37:34.009821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:21:13.521447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010735+0000","last_change":"2023-11-28T18:37:32.474120+0000","last_active":"2023-11-28T18:37:34.010735+0000","last_peered":"2023-11-28T18:37:34.010735+0000","last_clean":"2023-11-28T18:37:34.010735+0000","last_became_active":"2023-11-28T18:37:32.473702+0000","last_became_peered":"2023-11-28T18:37:32.473702+0000","last_unstale":"2023-11-28T18:37:34.010735+0000","last_undegraded":"2023-11-28T18:37:34.010735+0000","last_fullsized":"2023-11-28T18:37:34.010735+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:00:25.204297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009041+0000","last_change":"2023-11-28T18:37:32.987116+0000","last_active":"2023-11-28T18:37:34.009041+0000","last_peered":"2023-11-28T18:37:34.009041+0000","last_clean":"2023-11-28T18:37:34.009041+0000","last_became_active":"2023-11-28T18:37:32.986562+0000","last_became_peered":"2023-11-28T18:37:32.986562+0000","last_unstale":"2023-11-28T18:37:34.009041+0000","last_undegraded":"2023-11-28T18:37:34.009041+0000","last_fullsized":"2023-11-28T18:37:34.009041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:46:52.261405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009479+0000","last_change":"2023-11-28T18:37:32.478702+0000","last_active":"2023-11-28T18:37:34.009479+0000","last_peered":"2023-11-28T18:37:34.009479+0000","last_clean":"2023-11-28T18:37:34.009479+0000","last_became_active":"2023-11-28T18:37:32.478119+0000","last_became_peered":"2023-11-28T18:37:32.478119+0000","last_unstale":"2023-11-28T18:37:34.009479+0000","last_undegraded":"2023-11-28T18:37:34.009479+0000","last_fullsized":"2023-11-28T18:37:34.009479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:47:06.994491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.987532+0000","last_change":"2023-11-28T18:37:32.989092+0000","last_active":"2023-11-28T18:37:33.987532+0000","last_peered":"2023-11-28T18:37:33.987532+0000","last_clean":"2023-11-28T18:37:33.987532+0000","last_became_active":"2023-11-28T18:37:32.988635+0000","last_became_peered":"2023-11-28T18:37:32.988635+0000","last_unstale":"2023-11-28T18:37:33.987532+0000","last_undegraded":"2023-11-28T18:37:33.987532+0000","last_fullsized":"2023-11-28T18:37:33.987532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:47:07.997008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.982526+0000","last_change":"2023-11-28T18:37:32.466953+0000","last_active":"2023-11-28T18:37:33.982526+0000","last_peered":"2023-11-28T18:37:33.982526+0000","last_clean":"2023-11-28T18:37:33.982526+0000","last_became_active":"2023-11-28T18:37:32.466697+0000","last_became_peered":"2023-11-28T18:37:32.466697+0000","last_unstale":"2023-11-28T18:37:33.982526+0000","last_undegraded":"2023-11-28T18:37:33.982526+0000","last_fullsized":"2023-11-28T18:37:33.982526+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:50:16.260842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.008440+0000","last_change":"2023-11-28T18:37:32.990343+0000","last_active":"2023-11-28T18:37:34.008440+0000","last_peered":"2023-11-28T18:37:34.008440+0000","last_clean":"2023-11-28T18:37:34.008440+0000","last_became_active":"2023-11-28T18:37:32.990039+0000","last_became_peered":"2023-11-28T18:37:32.990039+0000","last_unstale":"2023-11-28T18:37:34.008440+0000","last_undegraded":"2023-11-28T18:37:34.008440+0000","last_fullsized":"2023-11-28T18:37:34.008440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:41:58.493214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.982690+0000","last_change":"2023-11-28T18:37:32.469083+0000","last_active":"2023-11-28T18:37:33.982690+0000","last_peered":"2023-11-28T18:37:33.982690+0000","last_clean":"2023-11-28T18:37:33.982690+0000","last_became_active":"2023-11-28T18:37:32.468565+0000","last_became_peered":"2023-11-28T18:37:32.468565+0000","last_unstale":"2023-11-28T18:37:33.982690+0000","last_undegraded":"2023-11-28T18:37:33.982690+0000","last_fullsized":"2023-11-28T18:37:33.982690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:16:52.138851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009395+0000","last_change":"2023-11-28T18:37:32.984344+0000","last_active":"2023-11-28T18:37:34.009395+0000","last_peered":"2023-11-28T18:37:34.009395+0000","last_clean":"2023-11-28T18:37:34.009395+0000","last_became_active":"2023-11-28T18:37:32.983741+0000","last_became_peered":"2023-11-28T18:37:32.983741+0000","last_unstale":"2023-11-28T18:37:34.009395+0000","last_undegraded":"2023-11-28T18:37:34.009395+0000","last_fullsized":"2023-11-28T18:37:34.009395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:46:52.261405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010023+0000","last_change":"2023-11-28T18:37:32.479654+0000","last_active":"2023-11-28T18:37:34.010023+0000","last_peered":"2023-11-28T18:37:34.010023+0000","last_clean":"2023-11-28T18:37:34.010023+0000","last_became_active":"2023-11-28T18:37:32.479338+0000","last_became_peered":"2023-11-28T18:37:32.479338+0000","last_unstale":"2023-11-28T18:37:34.010023+0000","last_undegraded":"2023-11-28T18:37:34.010023+0000","last_fullsized":"2023-11-28T18:37:34.010023+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:46:51.258888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010634+0000","last_change":"2023-11-28T18:37:33.001157+0000","last_active":"2023-11-28T18:37:34.010634+0000","last_peered":"2023-11-28T18:37:34.010634+0000","last_clean":"2023-11-28T18:37:34.010634+0000","last_became_active":"2023-11-28T18:37:33.000865+0000","last_became_peered":"2023-11-28T18:37:33.000865+0000","last_unstale":"2023-11-28T18:37:34.010634+0000","last_undegraded":"2023-11-28T18:37:34.010634+0000","last_fullsized":"2023-11-28T18:37:34.010634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:18:10.978623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.988714+0000","last_change":"2023-11-28T18:37:33.005635+0000","last_active":"2023-11-28T18:37:33.988714+0000","last_peered":"2023-11-28T18:37:33.988714+0000","last_clean":"2023-11-28T18:37:33.988714+0000","last_became_active":"2023-11-28T18:37:33.001121+0000","last_became_peered":"2023-11-28T18:37:33.001121+0000","last_unstale":"2023-11-28T18:37:33.988714+0000","last_undegraded":"2023-11-28T18:37:33.988714+0000","last_fullsized":"2023-11-28T18:37:33.988714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:12:16.071028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009766+0000","last_change":"2023-11-28T18:37:32.481789+0000","last_active":"2023-11-28T18:37:34.009766+0000","last_peered":"2023-11-28T18:37:34.009766+0000","last_clean":"2023-11-28T18:37:34.009766+0000","last_became_active":"2023-11-28T18:37:32.481480+0000","last_became_peered":"2023-11-28T18:37:32.481480+0000","last_unstale":"2023-11-28T18:37:34.009766+0000","last_undegraded":"2023-11-28T18:37:34.009766+0000","last_fullsized":"2023-11-28T18:37:34.009766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:00:25.204297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.988397+0000","last_change":"2023-11-28T18:37:33.005206+0000","last_active":"2023-11-28T18:37:33.988397+0000","last_peered":"2023-11-28T18:37:33.988397+0000","last_clean":"2023-11-28T18:37:33.988397+0000","last_became_active":"2023-11-28T18:37:33.002231+0000","last_became_peered":"2023-11-28T18:37:33.002231+0000","last_unstale":"2023-11-28T18:37:33.988397+0000","last_undegraded":"2023-11-28T18:37:33.988397+0000","last_fullsized":"2023-11-28T18:37:33.988397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:20:33.664753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009927+0000","last_change":"2023-11-28T18:37:32.481872+0000","last_active":"2023-11-28T18:37:34.009927+0000","last_peered":"2023-11-28T18:37:34.009927+0000","last_clean":"2023-11-28T18:37:34.009927+0000","last_became_active":"2023-11-28T18:37:32.481564+0000","last_became_peered":"2023-11-28T18:37:32.481564+0000","last_unstale":"2023-11-28T18:37:34.009927+0000","last_undegraded":"2023-11-28T18:37:34.009927+0000","last_fullsized":"2023-11-28T18:37:34.009927+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:22:48.248148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.008960+0000","last_change":"2023-11-28T18:37:33.001322+0000","last_active":"2023-11-28T18:37:34.008960+0000","last_peered":"2023-11-28T18:37:34.008960+0000","last_clean":"2023-11-28T18:37:34.008960+0000","last_became_active":"2023-11-28T18:37:33.001146+0000","last_became_peered":"2023-11-28T18:37:33.001146+0000","last_unstale":"2023-11-28T18:37:34.008960+0000","last_undegraded":"2023-11-28T18:37:34.008960+0000","last_fullsized":"2023-11-28T18:37:34.008960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:41:58.493214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009749+0000","last_change":"2023-11-28T18:37:32.469287+0000","last_active":"2023-11-28T18:37:34.009749+0000","last_peered":"2023-11-28T18:37:34.009749+0000","last_clean":"2023-11-28T18:37:34.009749+0000","last_became_active":"2023-11-28T18:37:32.468967+0000","last_became_peered":"2023-11-28T18:37:32.468967+0000","last_unstale":"2023-11-28T18:37:34.009749+0000","last_undegraded":"2023-11-28T18:37:34.009749+0000","last_fullsized":"2023-11-28T18:37:34.009749+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:00:25.204297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009695+0000","last_change":"2023-11-28T18:37:32.993786+0000","last_active":"2023-11-28T18:37:34.009695+0000","last_peered":"2023-11-28T18:37:34.009695+0000","last_clean":"2023-11-28T18:37:34.009695+0000","last_became_active":"2023-11-28T18:37:32.992734+0000","last_became_peered":"2023-11-28T18:37:32.992734+0000","last_unstale":"2023-11-28T18:37:34.009695+0000","last_undegraded":"2023-11-28T18:37:34.009695+0000","last_fullsized":"2023-11-28T18:37:34.009695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:02:53.545778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009176+0000","last_change":"2023-11-28T18:37:32.471483+0000","last_active":"2023-11-28T18:37:34.009176+0000","last_peered":"2023-11-28T18:37:34.009176+0000","last_clean":"2023-11-28T18:37:34.009176+0000","last_became_active":"2023-11-28T18:37:32.471207+0000","last_became_peered":"2023-11-28T18:37:32.471207+0000","last_unstale":"2023-11-28T18:37:34.009176+0000","last_undegraded":"2023-11-28T18:37:34.009176+0000","last_fullsized":"2023-11-28T18:37:34.009176+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:07:41.145470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":661860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93999999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":204800,"data_stored":70910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31972,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339868,"statfs":{"total":96636764160,"available":96604024832,"internally_reserved":0,"allocated":811008,"data_stored":661916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T18:37:37.562 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T18:37:37.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.735+0000 7f283392a640 1 Processor -- start 2023-11-28T18:37:37.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.735+0000 7f283392a640 1 -- start start 2023-11-28T18:37:37.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.735+0000 7f283392a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f282c13cf70 0x7f282c06c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:37.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.735+0000 7f283392a640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f282c06c840 0x7f282c15a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:37.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.735+0000 7f283392a640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f282c15b3e0 con 0x7f282c15abb0 2023-11-28T18:37:37.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.735+0000 7f283392a640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f282c13d350 con 0x7f282c06c840 2023-11-28T18:37:37.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.735+0000 7f283392a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f282c140520 con 0x7f282c13cf70 2023-11-28T18:37:37.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.735+0000 7f2831ec7640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f282c15abb0 0x7f282c0715b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:50262/0 (socket says 172.21.15.45:50262) 2023-11-28T18:37:37.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.735+0000 7f2831ec7640 1 -- 172.21.15.45:0/975850227 learned_addr learned my addr 172.21.15.45:0/975850227 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:37:37.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.735+0000 7f2830ec5640 1 --2- 172.21.15.45:0/975850227 >> v2:172.21.15.190:3300/0 conn(0x7f282c06c840 0x7f282c15a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:37.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.735+0000 7f28316c6640 1 --2- 172.21.15.45:0/975850227 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f282c13cf70 0x7f282c06c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:37.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.735+0000 7f2823fff640 1 -- 172.21.15.45:0/975850227 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 534309541 0 0) 0x7f282c15b3e0 con 0x7f282c15abb0 2023-11-28T18:37:37.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.735+0000 7f2823fff640 1 -- 172.21.15.45:0/975850227 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2818003530 con 0x7f282c15abb0 2023-11-28T18:37:37.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.735+0000 7f2823fff640 1 -- 172.21.15.45:0/975850227 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1906185365 0 0) 0x7f2818003530 con 0x7f282c15abb0 2023-11-28T18:37:37.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.735+0000 7f2823fff640 1 -- 172.21.15.45:0/975850227 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f282c13cf70 msgr2=0x7f282c06c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:37.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.735+0000 7f2823fff640 1 --2- 172.21.15.45:0/975850227 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f282c13cf70 0x7f282c06c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:37.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.735+0000 7f2823fff640 1 -- 172.21.15.45:0/975850227 >> v2:172.21.15.190:3300/0 conn(0x7f282c06c840 msgr2=0x7f282c15a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:37.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.735+0000 7f2823fff640 1 --2- 172.21.15.45:0/975850227 >> v2:172.21.15.190:3300/0 conn(0x7f282c06c840 0x7f282c15a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:37.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.739+0000 7f2823fff640 1 -- 172.21.15.45:0/975850227 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f282c06cc80 con 0x7f282c15abb0 2023-11-28T18:37:37.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.739+0000 7f2823fff640 1 -- 172.21.15.45:0/975850227 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4084481567 0 0) 0x7f2824001a00 con 0x7f282c15abb0 2023-11-28T18:37:37.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.739+0000 7f2830ec5640 1 --2- 172.21.15.45:0/975850227 >> v2:172.21.15.190:3300/0 conn(0x7f282c06c840 0x7f282c15a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:37:37.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.739+0000 7f2823fff640 1 -- 172.21.15.45:0/975850227 >> v1:172.21.15.45:6789/0 conn(0x7f282c15abb0 legacy=0x7f282c0715b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:37.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.739+0000 7f2823fff640 1 --2- 172.21.15.45:0/975850227 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28180039b0 0x7f2818003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:37.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.739+0000 7f2823fff640 1 --2- 172.21.15.45:0/975850227 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f28180047d0 0x7f2818004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:37.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.739+0000 7f2823fff640 1 --2- 172.21.15.45:0/975850227 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f282c13cf70 0x7f2818005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:37.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.739+0000 7f2823fff640 1 -- 172.21.15.45:0/975850227 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f282c140520 con 0x7f28180039b0 2023-11-28T18:37:37.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.739+0000 7f2823fff640 1 -- 172.21.15.45:0/975850227 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f281800ba40 con 0x7f28180047d0 2023-11-28T18:37:37.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.739+0000 7f2823fff640 1 -- 172.21.15.45:0/975850227 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f281800bbb0 con 0x7f282c13cf70 2023-11-28T18:37:37.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.739+0000 7f28316c6640 1 --2- 172.21.15.45:0/975850227 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28180039b0 0x7f2818003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:37.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.739+0000 7f2831ec7640 1 --2- 172.21.15.45:0/975850227 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f282c13cf70 0x7f2818005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:37.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.739+0000 7f2830ec5640 1 --2- 172.21.15.45:0/975850227 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f28180047d0 0x7f2818004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:37.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.739+0000 7f28316c6640 1 -- 172.21.15.45:0/975850227 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f282c13cf70 msgr2=0x7f2818005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:37.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.739+0000 7f28316c6640 1 --2- 172.21.15.45:0/975850227 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f282c13cf70 0x7f2818005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:37.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.739+0000 7f28316c6640 1 -- 172.21.15.45:0/975850227 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f28180047d0 msgr2=0x7f2818004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:37.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.739+0000 7f28316c6640 1 --2- 172.21.15.45:0/975850227 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f28180047d0 0x7f2818004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:37.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.739+0000 7f28316c6640 1 -- 172.21.15.45:0/975850227 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2818003530 con 0x7f28180039b0 2023-11-28T18:37:37.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.739+0000 7f28316c6640 1 --2- 172.21.15.45:0/975850227 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28180039b0 0x7f2818003dd0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2828009670 tx=0x7f282801eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98fe7028ecf3cf54 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:37.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.739+0000 7f2823fff640 1 -- 172.21.15.45:0/975850227 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28280a76e0 con 0x7f28180039b0 2023-11-28T18:37:37.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.739+0000 7f2823fff640 1 -- 172.21.15.45:0/975850227 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28280a7840 con 0x7f28180039b0 2023-11-28T18:37:37.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.739+0000 7f2823fff640 1 -- 172.21.15.45:0/975850227 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28280a7bf0 con 0x7f28180039b0 2023-11-28T18:37:37.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.743+0000 7f283392a640 1 -- 172.21.15.45:0/975850227 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28180039b0 msgr2=0x7f2818003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:37.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.743+0000 7f283392a640 1 --2- 172.21.15.45:0/975850227 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28180039b0 0x7f2818003dd0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2828009670 tx=0x7f282801eb90 comp rx=0 tx=0).stop 2023-11-28T18:37:37.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.743+0000 7f2831ec7640 1 -- 172.21.15.45:0/975850227 reap_dead start 2023-11-28T18:37:37.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.743+0000 7f283392a640 1 -- 172.21.15.45:0/975850227 shutdown_connections 2023-11-28T18:37:37.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.743+0000 7f283392a640 1 -- 172.21.15.45:0/975850227 >> 172.21.15.45:0/975850227 conn(0x7f282c06a570 msgr2=0x7f282c06a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:37.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.743+0000 7f283392a640 1 -- 172.21.15.45:0/975850227 shutdown_connections 2023-11-28T18:37:37.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.743+0000 7f283392a640 1 -- 172.21.15.45:0/975850227 wait complete. 2023-11-28T18:37:37.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.743+0000 7f283392a640 1 Processor -- start 2023-11-28T18:37:37.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.743+0000 7f283392a640 1 -- start start 2023-11-28T18:37:37.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.743+0000 7f283392a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f28180039b0 0x7f282c1f55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:37.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.743+0000 7f283392a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f282c0b3940 0x7f282c0b3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:37.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.743+0000 7f283392a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f282c152eb0 0x7f282c153330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:37.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.743+0000 7f283392a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f282c153870 con 0x7f282c152eb0 2023-11-28T18:37:37.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.743+0000 7f283392a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f282c154b70 con 0x7f282c0b3940 2023-11-28T18:37:37.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.743+0000 7f283392a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f282c0b44b0 con 0x7f28180039b0 2023-11-28T18:37:37.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.743+0000 7f2831ec7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f282c152eb0 0x7f282c153330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:37.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.743+0000 7f2831ec7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f282c152eb0 0x7f282c153330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48882/0 (socket says 172.21.15.45:48882) 2023-11-28T18:37:37.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.743+0000 7f2831ec7640 1 -- 172.21.15.45:0/3597508994 learned_addr learned my addr 172.21.15.45:0/3597508994 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:37.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.743+0000 7f28316c6640 1 --2- 172.21.15.45:0/3597508994 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f28180039b0 0x7f282c1f55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:37.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.747+0000 7f2830ec5640 1 --2- 172.21.15.45:0/3597508994 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f282c0b3940 0x7f282c0b3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:37.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.747+0000 7f2831ec7640 1 -- 172.21.15.45:0/3597508994 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f28180039b0 msgr2=0x7f282c1f55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:37.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.747+0000 7f2831ec7640 1 --2- 172.21.15.45:0/3597508994 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f28180039b0 0x7f282c1f55f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:37.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.747+0000 7f2831ec7640 1 -- 172.21.15.45:0/3597508994 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f282c0b3940 msgr2=0x7f282c0b3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:37.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.747+0000 7f2831ec7640 1 --2- 172.21.15.45:0/3597508994 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f282c0b3940 0x7f282c0b3dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:37.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.747+0000 7f2831ec7640 1 -- 172.21.15.45:0/3597508994 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f282c139930 con 0x7f282c152eb0 2023-11-28T18:37:37.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.747+0000 7f2831ec7640 1 --2- 172.21.15.45:0/3597508994 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f282c152eb0 0x7f282c153330 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f282c06e990 tx=0x7f282400e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:37.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.747+0000 7f2821ffb640 1 -- 172.21.15.45:0/3597508994 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f282400eb90 con 0x7f282c152eb0 2023-11-28T18:37:37.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.747+0000 7f2821ffb640 1 -- 172.21.15.45:0/3597508994 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f282400ecf0 con 0x7f282c152eb0 2023-11-28T18:37:37.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.747+0000 7f283392a640 1 -- 172.21.15.45:0/3597508994 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f282c139c10 con 0x7f282c152eb0 2023-11-28T18:37:37.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.747+0000 7f2821ffb640 1 -- 172.21.15.45:0/3597508994 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2824013660 con 0x7f282c152eb0 2023-11-28T18:37:37.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.747+0000 7f283392a640 1 -- 172.21.15.45:0/3597508994 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f282c13a1d0 con 0x7f282c152eb0 2023-11-28T18:37:37.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.747+0000 7f283392a640 1 -- 172.21.15.45:0/3597508994 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f282c069480 con 0x7f282c152eb0 2023-11-28T18:37:37.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.747+0000 7f2821ffb640 1 -- 172.21.15.45:0/3597508994 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f28240137c0 con 0x7f282c152eb0 2023-11-28T18:37:37.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.747+0000 7f2821ffb640 1 --2- 172.21.15.45:0/3597508994 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f2810066900 0x7f2810068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:37.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.747+0000 7f2821ffb640 1 -- 172.21.15.45:0/3597508994 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2824084710 con 0x7f282c152eb0 2023-11-28T18:37:37.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.751+0000 7f28316c6640 1 --2- 172.21.15.45:0/3597508994 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f2810066900 0x7f2810068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:37.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.751+0000 7f28316c6640 1 --2- 172.21.15.45:0/3597508994 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f2810066900 0x7f2810068dc0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f28280b1000 tx=0x7f2828010040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:37.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.751+0000 7f2821ffb640 1 -- 172.21.15.45:0/3597508994 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2824055470 con 0x7f282c152eb0 2023-11-28T18:37:37.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.907+0000 7f283392a640 1 -- 172.21.15.45:0/3597508994 --> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f282c140000 con 0x7f2810066900 2023-11-28T18:37:37.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.915+0000 7f2821ffb640 1 -- 172.21.15.45:0/3597508994 <== mgr.4100 v2:172.21.15.190:6832/645101166 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264657 (secure 0 0 0) 0x7f28280112c0 con 0x7f2810066900 2023-11-28T18:37:37.920 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:37:37.921 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-11-28T18:37:37.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.915+0000 7f283392a640 1 -- 172.21.15.45:0/3597508994 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f2810066900 msgr2=0x7f2810068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:37.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.915+0000 7f283392a640 1 --2- 172.21.15.45:0/3597508994 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f2810066900 0x7f2810068dc0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f28280b1000 tx=0x7f2828010040 comp rx=0 tx=0).stop 2023-11-28T18:37:37.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.915+0000 7f283392a640 1 -- 172.21.15.45:0/3597508994 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f282c152eb0 msgr2=0x7f282c153330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:37.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.915+0000 7f283392a640 1 --2- 172.21.15.45:0/3597508994 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f282c152eb0 0x7f282c153330 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f282c06e990 tx=0x7f282400e530 comp rx=0 tx=0).stop 2023-11-28T18:37:37.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.915+0000 7f283392a640 1 -- 172.21.15.45:0/3597508994 shutdown_connections 2023-11-28T18:37:37.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.915+0000 7f283392a640 1 --2- 172.21.15.45:0/3597508994 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f2810066900 0x7f2810068dc0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:37.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.915+0000 7f283392a640 1 --2- 172.21.15.45:0/3597508994 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f282c152eb0 0x7f282c153330 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:37.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.915+0000 7f283392a640 1 --2- 172.21.15.45:0/3597508994 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f282c0b3940 0x7f282c0b3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:37.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.915+0000 7f283392a640 1 --2- 172.21.15.45:0/3597508994 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f28180039b0 0x7f282c1f55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:37.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.915+0000 7f283392a640 1 -- 172.21.15.45:0/3597508994 >> 172.21.15.45:0/3597508994 conn(0x7f282c06a570 msgr2=0x7f282c0704a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:37.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.915+0000 7f283392a640 1 -- 172.21.15.45:0/3597508994 shutdown_connections 2023-11-28T18:37:37.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:37.915+0000 7f283392a640 1 -- 172.21.15.45:0/3597508994 wait complete. 2023-11-28T18:37:37.940 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-11-28T18:37:37.234812+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235628,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739092,"statfs":{"total":773094113280,"available":772852830208,"internally_reserved":0,"allocated":2891776,"data_stored":1752836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.794614"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010341+0000","last_change":"2023-11-28T18:37:33.002234+0000","last_active":"2023-11-28T18:37:34.010341+0000","last_peered":"2023-11-28T18:37:34.010341+0000","last_clean":"2023-11-28T18:37:34.010341+0000","last_became_active":"2023-11-28T18:37:33.001965+0000","last_became_peered":"2023-11-28T18:37:33.001965+0000","last_unstale":"2023-11-28T18:37:34.010341+0000","last_undegraded":"2023-11-28T18:37:34.010341+0000","last_fullsized":"2023-11-28T18:37:34.010341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:12:16.071028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.982842+0000","last_change":"2023-11-28T18:37:32.990938+0000","last_active":"2023-11-28T18:37:33.982842+0000","last_peered":"2023-11-28T18:37:33.982842+0000","last_clean":"2023-11-28T18:37:33.982842+0000","last_became_active":"2023-11-28T18:37:32.990637+0000","last_became_peered":"2023-11-28T18:37:32.990637+0000","last_unstale":"2023-11-28T18:37:33.982842+0000","last_undegraded":"2023-11-28T18:37:33.982842+0000","last_fullsized":"2023-11-28T18:37:33.982842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:36:58.955111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.008845+0000","last_change":"2023-11-28T18:37:32.985400+0000","last_active":"2023-11-28T18:37:34.008845+0000","last_peered":"2023-11-28T18:37:34.008845+0000","last_clean":"2023-11-28T18:37:34.008845+0000","last_became_active":"2023-11-28T18:37:32.985067+0000","last_became_peered":"2023-11-28T18:37:32.985067+0000","last_unstale":"2023-11-28T18:37:34.008845+0000","last_undegraded":"2023-11-28T18:37:34.008845+0000","last_fullsized":"2023-11-28T18:37:34.008845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:51:11.286789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.988275+0000","last_change":"2023-11-28T18:37:33.004974+0000","last_active":"2023-11-28T18:37:33.988275+0000","last_peered":"2023-11-28T18:37:33.988275+0000","last_clean":"2023-11-28T18:37:33.988275+0000","last_became_active":"2023-11-28T18:37:33.002365+0000","last_became_peered":"2023-11-28T18:37:33.002365+0000","last_unstale":"2023-11-28T18:37:33.988275+0000","last_undegraded":"2023-11-28T18:37:33.988275+0000","last_fullsized":"2023-11-28T18:37:33.988275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:51:32.411691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009918+0000","last_change":"2023-11-28T18:37:32.998052+0000","last_active":"2023-11-28T18:37:34.009918+0000","last_peered":"2023-11-28T18:37:34.009918+0000","last_clean":"2023-11-28T18:37:34.009918+0000","last_became_active":"2023-11-28T18:37:32.997591+0000","last_became_peered":"2023-11-28T18:37:32.997591+0000","last_unstale":"2023-11-28T18:37:34.009918+0000","last_undegraded":"2023-11-28T18:37:34.009918+0000","last_fullsized":"2023-11-28T18:37:34.009918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:21:13.521447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.988134+0000","last_change":"2023-11-28T18:37:33.005398+0000","last_active":"2023-11-28T18:37:33.988134+0000","last_peered":"2023-11-28T18:37:33.988134+0000","last_clean":"2023-11-28T18:37:33.988134+0000","last_became_active":"2023-11-28T18:37:33.004918+0000","last_became_peered":"2023-11-28T18:37:33.004918+0000","last_unstale":"2023-11-28T18:37:33.988134+0000","last_undegraded":"2023-11-28T18:37:33.988134+0000","last_fullsized":"2023-11-28T18:37:33.988134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:06:19.804273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009575+0000","last_change":"2023-11-28T18:37:33.005051+0000","last_active":"2023-11-28T18:37:34.009575+0000","last_peered":"2023-11-28T18:37:34.009575+0000","last_clean":"2023-11-28T18:37:34.009575+0000","last_became_active":"2023-11-28T18:37:33.004756+0000","last_became_peered":"2023-11-28T18:37:33.004756+0000","last_unstale":"2023-11-28T18:37:34.009575+0000","last_undegraded":"2023-11-28T18:37:34.009575+0000","last_fullsized":"2023-11-28T18:37:34.009575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:06:19.804273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.008210+0000","last_change":"2023-11-28T18:37:32.999195+0000","last_active":"2023-11-28T18:37:34.008210+0000","last_peered":"2023-11-28T18:37:34.008210+0000","last_clean":"2023-11-28T18:37:34.008210+0000","last_became_active":"2023-11-28T18:37:32.998930+0000","last_became_peered":"2023-11-28T18:37:32.998930+0000","last_unstale":"2023-11-28T18:37:34.008210+0000","last_undegraded":"2023-11-28T18:37:34.008210+0000","last_fullsized":"2023-11-28T18:37:34.008210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:51:11.286789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010398+0000","last_change":"2023-11-28T18:37:33.009782+0000","last_active":"2023-11-28T18:37:34.010398+0000","last_peered":"2023-11-28T18:37:34.010398+0000","last_clean":"2023-11-28T18:37:34.010398+0000","last_became_active":"2023-11-28T18:37:33.009103+0000","last_became_peered":"2023-11-28T18:37:33.009103+0000","last_unstale":"2023-11-28T18:37:34.010398+0000","last_undegraded":"2023-11-28T18:37:34.010398+0000","last_fullsized":"2023-11-28T18:37:34.010398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:23:39.816847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010427+0000","last_change":"2023-11-28T18:37:33.006943+0000","last_active":"2023-11-28T18:37:34.010427+0000","last_peered":"2023-11-28T18:37:34.010427+0000","last_clean":"2023-11-28T18:37:34.010427+0000","last_became_active":"2023-11-28T18:37:33.006661+0000","last_became_peered":"2023-11-28T18:37:33.006661+0000","last_unstale":"2023-11-28T18:37:34.010427+0000","last_undegraded":"2023-11-28T18:37:34.010427+0000","last_fullsized":"2023-11-28T18:37:34.010427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:25:41.022219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010329+0000","last_change":"2023-11-28T18:37:33.007305+0000","last_active":"2023-11-28T18:37:34.010329+0000","last_peered":"2023-11-28T18:37:34.010329+0000","last_clean":"2023-11-28T18:37:34.010329+0000","last_became_active":"2023-11-28T18:37:33.006773+0000","last_became_peered":"2023-11-28T18:37:33.006773+0000","last_unstale":"2023-11-28T18:37:34.010329+0000","last_undegraded":"2023-11-28T18:37:34.010329+0000","last_fullsized":"2023-11-28T18:37:34.010329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:51:11.286789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.987768+0000","last_change":"2023-11-28T18:37:33.003324+0000","last_active":"2023-11-28T18:37:33.987768+0000","last_peered":"2023-11-28T18:37:33.987768+0000","last_clean":"2023-11-28T18:37:33.987768+0000","last_became_active":"2023-11-28T18:37:33.002968+0000","last_became_peered":"2023-11-28T18:37:33.002968+0000","last_unstale":"2023-11-28T18:37:33.987768+0000","last_undegraded":"2023-11-28T18:37:33.987768+0000","last_fullsized":"2023-11-28T18:37:33.987768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:21:08.389536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009332+0000","last_change":"2023-11-28T18:37:32.993427+0000","last_active":"2023-11-28T18:37:34.009332+0000","last_peered":"2023-11-28T18:37:34.009332+0000","last_clean":"2023-11-28T18:37:34.009332+0000","last_became_active":"2023-11-28T18:37:32.992763+0000","last_became_peered":"2023-11-28T18:37:32.992763+0000","last_unstale":"2023-11-28T18:37:34.009332+0000","last_undegraded":"2023-11-28T18:37:34.009332+0000","last_fullsized":"2023-11-28T18:37:34.009332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:18:10.978623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.008553+0000","last_change":"2023-11-28T18:37:32.985751+0000","last_active":"2023-11-28T18:37:34.008553+0000","last_peered":"2023-11-28T18:37:34.008553+0000","last_clean":"2023-11-28T18:37:34.008553+0000","last_became_active":"2023-11-28T18:37:32.985475+0000","last_became_peered":"2023-11-28T18:37:32.985475+0000","last_unstale":"2023-11-28T18:37:34.008553+0000","last_undegraded":"2023-11-28T18:37:34.008553+0000","last_fullsized":"2023-11-28T18:37:34.008553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:00:26.206815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.982473+0000","last_change":"2023-11-28T18:37:32.990177+0000","last_active":"2023-11-28T18:37:33.982473+0000","last_peered":"2023-11-28T18:37:33.982473+0000","last_clean":"2023-11-28T18:37:33.982473+0000","last_became_active":"2023-11-28T18:37:32.989658+0000","last_became_peered":"2023-11-28T18:37:32.989658+0000","last_unstale":"2023-11-28T18:37:33.982473+0000","last_undegraded":"2023-11-28T18:37:33.982473+0000","last_fullsized":"2023-11-28T18:37:33.982473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:41:58.493214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.987415+0000","last_change":"2023-11-28T18:37:33.006137+0000","last_active":"2023-11-28T18:37:33.987415+0000","last_peered":"2023-11-28T18:37:33.987415+0000","last_clean":"2023-11-28T18:37:33.987415+0000","last_became_active":"2023-11-28T18:37:33.005771+0000","last_became_peered":"2023-11-28T18:37:33.005771+0000","last_unstale":"2023-11-28T18:37:33.987415+0000","last_undegraded":"2023-11-28T18:37:33.987415+0000","last_fullsized":"2023-11-28T18:37:33.987415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:46:52.261405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.988766+0000","last_change":"2023-11-28T18:37:32.988077+0000","last_active":"2023-11-28T18:37:33.988766+0000","last_peered":"2023-11-28T18:37:33.988766+0000","last_clean":"2023-11-28T18:37:33.988766+0000","last_became_active":"2023-11-28T18:37:32.987801+0000","last_became_peered":"2023-11-28T18:37:32.987801+0000","last_unstale":"2023-11-28T18:37:33.988766+0000","last_undegraded":"2023-11-28T18:37:33.988766+0000","last_fullsized":"2023-11-28T18:37:33.988766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:23:39.816847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.008414+0000","last_change":"2023-11-28T18:37:32.992425+0000","last_active":"2023-11-28T18:37:34.008414+0000","last_peered":"2023-11-28T18:37:34.008414+0000","last_clean":"2023-11-28T18:37:34.008414+0000","last_became_active":"2023-11-28T18:37:32.992154+0000","last_became_peered":"2023-11-28T18:37:32.992154+0000","last_unstale":"2023-11-28T18:37:34.008414+0000","last_undegraded":"2023-11-28T18:37:34.008414+0000","last_fullsized":"2023-11-28T18:37:34.008414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:50:17.263359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010302+0000","last_change":"2023-11-28T18:37:32.998538+0000","last_active":"2023-11-28T18:37:34.010302+0000","last_peered":"2023-11-28T18:37:34.010302+0000","last_clean":"2023-11-28T18:37:34.010302+0000","last_became_active":"2023-11-28T18:37:32.998182+0000","last_became_peered":"2023-11-28T18:37:32.998182+0000","last_unstale":"2023-11-28T18:37:34.010302+0000","last_undegraded":"2023-11-28T18:37:34.010302+0000","last_fullsized":"2023-11-28T18:37:34.010302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:31:53.513239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010699+0000","last_change":"2023-11-28T18:37:33.001416+0000","last_active":"2023-11-28T18:37:34.010699+0000","last_peered":"2023-11-28T18:37:34.010699+0000","last_clean":"2023-11-28T18:37:34.010699+0000","last_became_active":"2023-11-28T18:37:33.000906+0000","last_became_peered":"2023-11-28T18:37:33.000906+0000","last_unstale":"2023-11-28T18:37:34.010699+0000","last_undegraded":"2023-11-28T18:37:34.010699+0000","last_fullsized":"2023-11-28T18:37:34.010699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:46:52.261405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.008737+0000","last_change":"2023-11-28T18:37:32.993468+0000","last_active":"2023-11-28T18:37:34.008737+0000","last_peered":"2023-11-28T18:37:34.008737+0000","last_clean":"2023-11-28T18:37:34.008737+0000","last_became_active":"2023-11-28T18:37:32.993143+0000","last_became_peered":"2023-11-28T18:37:32.993143+0000","last_unstale":"2023-11-28T18:37:34.008737+0000","last_undegraded":"2023-11-28T18:37:34.008737+0000","last_fullsized":"2023-11-28T18:37:34.008737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:51:55.517713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.988214+0000","last_change":"2023-11-28T18:37:32.986554+0000","last_active":"2023-11-28T18:37:33.988214+0000","last_peered":"2023-11-28T18:37:33.988214+0000","last_clean":"2023-11-28T18:37:33.988214+0000","last_became_active":"2023-11-28T18:37:32.986211+0000","last_became_peered":"2023-11-28T18:37:32.986211+0000","last_unstale":"2023-11-28T18:37:33.988214+0000","last_undegraded":"2023-11-28T18:37:33.988214+0000","last_fullsized":"2023-11-28T18:37:33.988214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:02:53.545778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.008208+0000","last_change":"2023-11-28T18:37:32.995076+0000","last_active":"2023-11-28T18:37:34.008208+0000","last_peered":"2023-11-28T18:37:34.008208+0000","last_clean":"2023-11-28T18:37:34.008208+0000","last_became_active":"2023-11-28T18:37:32.994774+0000","last_became_peered":"2023-11-28T18:37:32.994774+0000","last_unstale":"2023-11-28T18:37:34.008208+0000","last_undegraded":"2023-11-28T18:37:34.008208+0000","last_fullsized":"2023-11-28T18:37:34.008208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:51:55.517713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.987940+0000","last_change":"2023-11-28T18:37:32.991513+0000","last_active":"2023-11-28T18:37:33.987940+0000","last_peered":"2023-11-28T18:37:33.987940+0000","last_clean":"2023-11-28T18:37:33.987940+0000","last_became_active":"2023-11-28T18:37:32.990880+0000","last_became_peered":"2023-11-28T18:37:32.990880+0000","last_unstale":"2023-11-28T18:37:33.987940+0000","last_undegraded":"2023-11-28T18:37:33.987940+0000","last_fullsized":"2023-11-28T18:37:33.987940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:36:58.955111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009754+0000","last_change":"2023-11-28T18:37:32.995075+0000","last_active":"2023-11-28T18:37:34.009754+0000","last_peered":"2023-11-28T18:37:34.009754+0000","last_clean":"2023-11-28T18:37:34.009754+0000","last_became_active":"2023-11-28T18:37:32.994733+0000","last_became_peered":"2023-11-28T18:37:32.994733+0000","last_unstale":"2023-11-28T18:37:34.009754+0000","last_undegraded":"2023-11-28T18:37:34.009754+0000","last_fullsized":"2023-11-28T18:37:34.009754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:51:32.411691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010515+0000","last_change":"2023-11-28T18:37:33.000138+0000","last_active":"2023-11-28T18:37:34.010515+0000","last_peered":"2023-11-28T18:37:34.010515+0000","last_clean":"2023-11-28T18:37:34.010515+0000","last_became_active":"2023-11-28T18:37:32.999035+0000","last_became_peered":"2023-11-28T18:37:32.999035+0000","last_unstale":"2023-11-28T18:37:34.010515+0000","last_undegraded":"2023-11-28T18:37:34.010515+0000","last_fullsized":"2023-11-28T18:37:34.010515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:41:58.493214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.982735+0000","last_change":"2023-11-28T18:37:32.987199+0000","last_active":"2023-11-28T18:37:33.982735+0000","last_peered":"2023-11-28T18:37:33.982735+0000","last_clean":"2023-11-28T18:37:33.982735+0000","last_became_active":"2023-11-28T18:37:32.986904+0000","last_became_peered":"2023-11-28T18:37:32.986904+0000","last_unstale":"2023-11-28T18:37:33.982735+0000","last_undegraded":"2023-11-28T18:37:33.982735+0000","last_fullsized":"2023-11-28T18:37:33.982735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:46:52.261405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009632+0000","last_change":"2023-11-28T18:37:32.993541+0000","last_active":"2023-11-28T18:37:34.009632+0000","last_peered":"2023-11-28T18:37:34.009632+0000","last_clean":"2023-11-28T18:37:34.009632+0000","last_became_active":"2023-11-28T18:37:32.993323+0000","last_became_peered":"2023-11-28T18:37:32.993323+0000","last_unstale":"2023-11-28T18:37:34.009632+0000","last_undegraded":"2023-11-28T18:37:34.009632+0000","last_fullsized":"2023-11-28T18:37:34.009632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:06:19.804273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.008872+0000","last_change":"2023-11-28T18:37:32.987939+0000","last_active":"2023-11-28T18:37:34.008872+0000","last_peered":"2023-11-28T18:37:34.008872+0000","last_clean":"2023-11-28T18:37:34.008872+0000","last_became_active":"2023-11-28T18:37:32.987277+0000","last_became_peered":"2023-11-28T18:37:32.987277+0000","last_unstale":"2023-11-28T18:37:34.008872+0000","last_undegraded":"2023-11-28T18:37:34.008872+0000","last_fullsized":"2023-11-28T18:37:34.008872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:25:41.022219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.988304+0000","last_change":"2023-11-28T18:37:33.008318+0000","last_active":"2023-11-28T18:37:33.988304+0000","last_peered":"2023-11-28T18:37:33.988304+0000","last_clean":"2023-11-28T18:37:33.988304+0000","last_became_active":"2023-11-28T18:37:33.007984+0000","last_became_peered":"2023-11-28T18:37:33.007984+0000","last_unstale":"2023-11-28T18:37:33.988304+0000","last_undegraded":"2023-11-28T18:37:33.988304+0000","last_fullsized":"2023-11-28T18:37:33.988304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:21:13.521447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.008387+0000","last_change":"2023-11-28T18:37:32.999800+0000","last_active":"2023-11-28T18:37:34.008387+0000","last_peered":"2023-11-28T18:37:34.008387+0000","last_clean":"2023-11-28T18:37:34.008387+0000","last_became_active":"2023-11-28T18:37:32.999536+0000","last_became_peered":"2023-11-28T18:37:32.999536+0000","last_unstale":"2023-11-28T18:37:34.008387+0000","last_undegraded":"2023-11-28T18:37:34.008387+0000","last_fullsized":"2023-11-28T18:37:34.008387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:07:42.147988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009871+0000","last_change":"2023-11-28T18:37:32.998966+0000","last_active":"2023-11-28T18:37:34.009871+0000","last_peered":"2023-11-28T18:37:34.009871+0000","last_clean":"2023-11-28T18:37:34.009871+0000","last_became_active":"2023-11-28T18:37:32.993970+0000","last_became_peered":"2023-11-28T18:37:32.993970+0000","last_unstale":"2023-11-28T18:37:34.009871+0000","last_undegraded":"2023-11-28T18:37:34.009871+0000","last_fullsized":"2023-11-28T18:37:34.009871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:31:28.921268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.987253+0000","last_change":"2023-11-28T18:37:32.990285+0000","last_active":"2023-11-28T18:37:33.987253+0000","last_peered":"2023-11-28T18:37:33.987253+0000","last_clean":"2023-11-28T18:37:33.987253+0000","last_became_active":"2023-11-28T18:37:32.989187+0000","last_became_peered":"2023-11-28T18:37:32.989187+0000","last_unstale":"2023-11-28T18:37:33.987253+0000","last_undegraded":"2023-11-28T18:37:33.987253+0000","last_fullsized":"2023-11-28T18:37:33.987253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:18:33.551197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009443+0000","last_change":"2023-11-28T18:37:32.479159+0000","last_active":"2023-11-28T18:37:34.009443+0000","last_peered":"2023-11-28T18:37:34.009443+0000","last_clean":"2023-11-28T18:37:34.009443+0000","last_became_active":"2023-11-28T18:37:32.478817+0000","last_became_peered":"2023-11-28T18:37:32.478817+0000","last_unstale":"2023-11-28T18:37:34.009443+0000","last_undegraded":"2023-11-28T18:37:34.009443+0000","last_fullsized":"2023-11-28T18:37:34.009443+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:22:48.248148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.008990+0000","last_change":"2023-11-28T18:37:32.991264+0000","last_active":"2023-11-28T18:37:34.008990+0000","last_peered":"2023-11-28T18:37:34.008990+0000","last_clean":"2023-11-28T18:37:34.008990+0000","last_became_active":"2023-11-28T18:37:32.990660+0000","last_became_peered":"2023-11-28T18:37:32.990660+0000","last_unstale":"2023-11-28T18:37:34.008990+0000","last_undegraded":"2023-11-28T18:37:34.008990+0000","last_fullsized":"2023-11-28T18:37:34.008990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:18:10.978623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010626+0000","last_change":"2023-11-28T18:37:32.468052+0000","last_active":"2023-11-28T18:37:34.010626+0000","last_peered":"2023-11-28T18:37:34.010626+0000","last_clean":"2023-11-28T18:37:34.010626+0000","last_became_active":"2023-11-28T18:37:32.467747+0000","last_became_peered":"2023-11-28T18:37:32.467747+0000","last_unstale":"2023-11-28T18:37:34.010626+0000","last_undegraded":"2023-11-28T18:37:34.010626+0000","last_fullsized":"2023-11-28T18:37:34.010626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:56:54.321744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.008647+0000","last_change":"2023-11-28T18:37:32.465213+0000","last_active":"2023-11-28T18:37:34.008647+0000","last_peered":"2023-11-28T18:37:34.008647+0000","last_clean":"2023-11-28T18:37:34.008647+0000","last_became_active":"2023-11-28T18:37:32.464911+0000","last_became_peered":"2023-11-28T18:37:32.464911+0000","last_unstale":"2023-11-28T18:37:34.008647+0000","last_undegraded":"2023-11-28T18:37:34.008647+0000","last_fullsized":"2023-11-28T18:37:34.008647+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:16:52.138851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.008326+0000","last_change":"2023-11-28T18:37:32.988182+0000","last_active":"2023-11-28T18:37:34.008326+0000","last_peered":"2023-11-28T18:37:34.008326+0000","last_clean":"2023-11-28T18:37:34.008326+0000","last_became_active":"2023-11-28T18:37:32.987804+0000","last_became_peered":"2023-11-28T18:37:32.987804+0000","last_unstale":"2023-11-28T18:37:34.008326+0000","last_undegraded":"2023-11-28T18:37:34.008326+0000","last_fullsized":"2023-11-28T18:37:34.008326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:25:41.022219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.987941+0000","last_change":"2023-11-28T18:37:32.467329+0000","last_active":"2023-11-28T18:37:33.987941+0000","last_peered":"2023-11-28T18:37:33.987941+0000","last_clean":"2023-11-28T18:37:33.987941+0000","last_became_active":"2023-11-28T18:37:32.467064+0000","last_became_peered":"2023-11-28T18:37:32.467064+0000","last_unstale":"2023-11-28T18:37:33.987941+0000","last_undegraded":"2023-11-28T18:37:33.987941+0000","last_fullsized":"2023-11-28T18:37:33.987941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:56:54.321744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.982413+0000","last_change":"2023-11-28T18:37:32.989944+0000","last_active":"2023-11-28T18:37:33.982413+0000","last_peered":"2023-11-28T18:37:33.982413+0000","last_clean":"2023-11-28T18:37:33.982413+0000","last_became_active":"2023-11-28T18:37:32.989285+0000","last_became_peered":"2023-11-28T18:37:32.989285+0000","last_unstale":"2023-11-28T18:37:33.982413+0000","last_undegraded":"2023-11-28T18:37:33.982413+0000","last_fullsized":"2023-11-28T18:37:33.982413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:51:11.286789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010624+0000","last_change":"2023-11-28T18:37:32.471802+0000","last_active":"2023-11-28T18:37:34.010624+0000","last_peered":"2023-11-28T18:37:34.010624+0000","last_clean":"2023-11-28T18:37:34.010624+0000","last_became_active":"2023-11-28T18:37:32.471420+0000","last_became_peered":"2023-11-28T18:37:32.471420+0000","last_unstale":"2023-11-28T18:37:34.010624+0000","last_undegraded":"2023-11-28T18:37:34.010624+0000","last_fullsized":"2023-11-28T18:37:34.010624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:22:48.248148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.988629+0000","last_change":"2023-11-28T18:37:33.002175+0000","last_active":"2023-11-28T18:37:33.988629+0000","last_peered":"2023-11-28T18:37:33.988629+0000","last_clean":"2023-11-28T18:37:33.988629+0000","last_became_active":"2023-11-28T18:37:33.001279+0000","last_became_peered":"2023-11-28T18:37:33.001279+0000","last_unstale":"2023-11-28T18:37:33.988629+0000","last_undegraded":"2023-11-28T18:37:33.988629+0000","last_fullsized":"2023-11-28T18:37:33.988629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:38:59.556086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.988637+0000","last_change":"2023-11-28T18:37:32.466165+0000","last_active":"2023-11-28T18:37:33.988637+0000","last_peered":"2023-11-28T18:37:33.988637+0000","last_clean":"2023-11-28T18:37:33.988637+0000","last_became_active":"2023-11-28T18:37:32.465812+0000","last_became_peered":"2023-11-28T18:37:32.465812+0000","last_unstale":"2023-11-28T18:37:33.988637+0000","last_undegraded":"2023-11-28T18:37:33.988637+0000","last_fullsized":"2023-11-28T18:37:33.988637+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:51:10.284272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009093+0000","last_change":"2023-11-28T18:37:32.988109+0000","last_active":"2023-11-28T18:37:34.009093+0000","last_peered":"2023-11-28T18:37:34.009093+0000","last_clean":"2023-11-28T18:37:34.009093+0000","last_became_active":"2023-11-28T18:37:32.987621+0000","last_became_peered":"2023-11-28T18:37:32.987621+0000","last_unstale":"2023-11-28T18:37:34.009093+0000","last_undegraded":"2023-11-28T18:37:34.009093+0000","last_fullsized":"2023-11-28T18:37:34.009093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:36:58.955111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.982698+0000","last_change":"2023-11-28T18:37:32.459182+0000","last_active":"2023-11-28T18:37:33.982698+0000","last_peered":"2023-11-28T18:37:33.982698+0000","last_clean":"2023-11-28T18:37:33.982698+0000","last_became_active":"2023-11-28T18:37:32.458898+0000","last_became_peered":"2023-11-28T18:37:32.458898+0000","last_unstale":"2023-11-28T18:37:33.982698+0000","last_undegraded":"2023-11-28T18:37:33.982698+0000","last_fullsized":"2023-11-28T18:37:33.982698+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:31:27.918750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.987863+0000","last_change":"2023-11-28T18:37:32.992373+0000","last_active":"2023-11-28T18:37:33.987863+0000","last_peered":"2023-11-28T18:37:33.987863+0000","last_clean":"2023-11-28T18:37:33.987863+0000","last_became_active":"2023-11-28T18:37:32.992176+0000","last_became_peered":"2023-11-28T18:37:32.992176+0000","last_unstale":"2023-11-28T18:37:33.987863+0000","last_undegraded":"2023-11-28T18:37:33.987863+0000","last_fullsized":"2023-11-28T18:37:33.987863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:07:42.147988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010211+0000","last_change":"2023-11-28T18:37:32.471764+0000","last_active":"2023-11-28T18:37:34.010211+0000","last_peered":"2023-11-28T18:37:34.010211+0000","last_clean":"2023-11-28T18:37:34.010211+0000","last_became_active":"2023-11-28T18:37:32.471432+0000","last_became_peered":"2023-11-28T18:37:32.471432+0000","last_unstale":"2023-11-28T18:37:34.010211+0000","last_undegraded":"2023-11-28T18:37:34.010211+0000","last_fullsized":"2023-11-28T18:37:34.010211+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:50:16.260842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009845+0000","last_change":"2023-11-28T18:37:32.996529+0000","last_active":"2023-11-28T18:37:34.009845+0000","last_peered":"2023-11-28T18:37:34.009845+0000","last_clean":"2023-11-28T18:37:34.009845+0000","last_became_active":"2023-11-28T18:37:32.996242+0000","last_became_peered":"2023-11-28T18:37:32.996242+0000","last_unstale":"2023-11-28T18:37:34.009845+0000","last_undegraded":"2023-11-28T18:37:34.009845+0000","last_fullsized":"2023-11-28T18:37:34.009845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:51:32.411691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009074+0000","last_change":"2023-11-28T18:37:32.473745+0000","last_active":"2023-11-28T18:37:34.009074+0000","last_peered":"2023-11-28T18:37:34.009074+0000","last_clean":"2023-11-28T18:37:34.009074+0000","last_became_active":"2023-11-28T18:37:32.473429+0000","last_became_peered":"2023-11-28T18:37:32.473429+0000","last_unstale":"2023-11-28T18:37:34.009074+0000","last_undegraded":"2023-11-28T18:37:34.009074+0000","last_fullsized":"2023-11-28T18:37:34.009074+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:16:52.138851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.008617+0000","last_change":"2023-11-28T18:37:32.987646+0000","last_active":"2023-11-28T18:37:34.008617+0000","last_peered":"2023-11-28T18:37:34.008617+0000","last_clean":"2023-11-28T18:37:34.008617+0000","last_became_active":"2023-11-28T18:37:32.987313+0000","last_became_peered":"2023-11-28T18:37:32.987313+0000","last_unstale":"2023-11-28T18:37:34.008617+0000","last_undegraded":"2023-11-28T18:37:34.008617+0000","last_fullsized":"2023-11-28T18:37:34.008617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:31:28.921268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.988317+0000","last_change":"2023-11-28T18:37:32.472535+0000","last_active":"2023-11-28T18:37:33.988317+0000","last_peered":"2023-11-28T18:37:33.988317+0000","last_clean":"2023-11-28T18:37:33.988317+0000","last_became_active":"2023-11-28T18:37:32.470189+0000","last_became_peered":"2023-11-28T18:37:32.470189+0000","last_unstale":"2023-11-28T18:37:33.988317+0000","last_undegraded":"2023-11-28T18:37:33.988317+0000","last_fullsized":"2023-11-28T18:37:33.988317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:25:40.019702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010041+0000","last_change":"2023-11-28T18:37:33.007113+0000","last_active":"2023-11-28T18:37:34.010041+0000","last_peered":"2023-11-28T18:37:34.010041+0000","last_clean":"2023-11-28T18:37:34.010041+0000","last_became_active":"2023-11-28T18:37:33.006542+0000","last_became_peered":"2023-11-28T18:37:33.006542+0000","last_unstale":"2023-11-28T18:37:34.010041+0000","last_undegraded":"2023-11-28T18:37:34.010041+0000","last_fullsized":"2023-11-28T18:37:34.010041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:43:32.482112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010033+0000","last_change":"2023-11-28T18:37:32.468727+0000","last_active":"2023-11-28T18:37:34.010033+0000","last_peered":"2023-11-28T18:37:34.010033+0000","last_clean":"2023-11-28T18:37:34.010033+0000","last_became_active":"2023-11-28T18:37:32.467363+0000","last_became_peered":"2023-11-28T18:37:32.467363+0000","last_unstale":"2023-11-28T18:37:34.010033+0000","last_undegraded":"2023-11-28T18:37:34.010033+0000","last_fullsized":"2023-11-28T18:37:34.010033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:16:52.138851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010291+0000","last_change":"2023-11-28T18:37:32.994176+0000","last_active":"2023-11-28T18:37:34.010291+0000","last_peered":"2023-11-28T18:37:34.010291+0000","last_clean":"2023-11-28T18:37:34.010291+0000","last_became_active":"2023-11-28T18:37:32.993577+0000","last_became_peered":"2023-11-28T18:37:32.993577+0000","last_unstale":"2023-11-28T18:37:34.010291+0000","last_undegraded":"2023-11-28T18:37:34.010291+0000","last_fullsized":"2023-11-28T18:37:34.010291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:51:55.517713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.007852+0000","last_change":"2023-11-28T18:37:32.466190+0000","last_active":"2023-11-28T18:37:34.007852+0000","last_peered":"2023-11-28T18:37:34.007852+0000","last_clean":"2023-11-28T18:37:34.007852+0000","last_became_active":"2023-11-28T18:37:32.465855+0000","last_became_peered":"2023-11-28T18:37:32.465855+0000","last_unstale":"2023-11-28T18:37:34.007852+0000","last_undegraded":"2023-11-28T18:37:34.007852+0000","last_fullsized":"2023-11-28T18:37:34.007852+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:18:32.548680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009694+0000","last_change":"2023-11-28T18:37:33.011619+0000","last_active":"2023-11-28T18:37:34.009694+0000","last_peered":"2023-11-28T18:37:34.009694+0000","last_clean":"2023-11-28T18:37:34.009694+0000","last_became_active":"2023-11-28T18:37:33.011164+0000","last_became_peered":"2023-11-28T18:37:33.011164+0000","last_unstale":"2023-11-28T18:37:34.009694+0000","last_undegraded":"2023-11-28T18:37:34.009694+0000","last_fullsized":"2023-11-28T18:37:34.009694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:02:53.545778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.987604+0000","last_change":"2023-11-28T18:37:32.472353+0000","last_active":"2023-11-28T18:37:33.987604+0000","last_peered":"2023-11-28T18:37:33.987604+0000","last_clean":"2023-11-28T18:37:33.987604+0000","last_became_active":"2023-11-28T18:37:32.472028+0000","last_became_peered":"2023-11-28T18:37:32.472028+0000","last_unstale":"2023-11-28T18:37:33.987604+0000","last_undegraded":"2023-11-28T18:37:33.987604+0000","last_fullsized":"2023-11-28T18:37:33.987604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:06:15.023841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010260+0000","last_change":"2023-11-28T18:37:33.006869+0000","last_active":"2023-11-28T18:37:34.010260+0000","last_peered":"2023-11-28T18:37:34.010260+0000","last_clean":"2023-11-28T18:37:34.010260+0000","last_became_active":"2023-11-28T18:37:33.006496+0000","last_became_peered":"2023-11-28T18:37:33.006496+0000","last_unstale":"2023-11-28T18:37:34.010260+0000","last_undegraded":"2023-11-28T18:37:34.010260+0000","last_fullsized":"2023-11-28T18:37:34.010260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:38:59.556086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.008466+0000","last_change":"2023-11-28T18:37:32.461121+0000","last_active":"2023-11-28T18:37:34.008466+0000","last_peered":"2023-11-28T18:37:34.008466+0000","last_clean":"2023-11-28T18:37:34.008466+0000","last_became_active":"2023-11-28T18:37:32.460769+0000","last_became_peered":"2023-11-28T18:37:32.460769+0000","last_unstale":"2023-11-28T18:37:34.008466+0000","last_undegraded":"2023-11-28T18:37:34.008466+0000","last_fullsized":"2023-11-28T18:37:34.008466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:18:56.938399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010480+0000","last_change":"2023-11-28T18:37:33.007274+0000","last_active":"2023-11-28T18:37:34.010480+0000","last_peered":"2023-11-28T18:37:34.010480+0000","last_clean":"2023-11-28T18:37:34.010480+0000","last_became_active":"2023-11-28T18:37:33.007033+0000","last_became_peered":"2023-11-28T18:37:33.007033+0000","last_unstale":"2023-11-28T18:37:34.010480+0000","last_undegraded":"2023-11-28T18:37:34.010480+0000","last_fullsized":"2023-11-28T18:37:34.010480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:31:52.252862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.982789+0000","last_change":"2023-11-28T18:37:32.466332+0000","last_active":"2023-11-28T18:37:33.982789+0000","last_peered":"2023-11-28T18:37:33.982789+0000","last_clean":"2023-11-28T18:37:33.982789+0000","last_became_active":"2023-11-28T18:37:32.464365+0000","last_became_peered":"2023-11-28T18:37:32.464365+0000","last_unstale":"2023-11-28T18:37:33.982789+0000","last_undegraded":"2023-11-28T18:37:33.982789+0000","last_fullsized":"2023-11-28T18:37:33.982789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:51:54.515196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.988455+0000","last_change":"2023-11-28T18:37:33.000939+0000","last_active":"2023-11-28T18:37:33.988455+0000","last_peered":"2023-11-28T18:37:33.988455+0000","last_clean":"2023-11-28T18:37:33.988455+0000","last_became_active":"2023-11-28T18:37:32.994852+0000","last_became_peered":"2023-11-28T18:37:32.994852+0000","last_unstale":"2023-11-28T18:37:33.988455+0000","last_undegraded":"2023-11-28T18:37:33.988455+0000","last_fullsized":"2023-11-28T18:37:33.988455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:43:32.482112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.008261+0000","last_change":"2023-11-28T18:37:32.466158+0000","last_active":"2023-11-28T18:37:34.008261+0000","last_peered":"2023-11-28T18:37:34.008261+0000","last_clean":"2023-11-28T18:37:34.008261+0000","last_became_active":"2023-11-28T18:37:32.465844+0000","last_became_peered":"2023-11-28T18:37:32.465844+0000","last_unstale":"2023-11-28T18:37:34.008261+0000","last_undegraded":"2023-11-28T18:37:34.008261+0000","last_fullsized":"2023-11-28T18:37:34.008261+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:21:07.387019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009932+0000","last_change":"2023-11-28T18:37:33.009557+0000","last_active":"2023-11-28T18:37:34.009932+0000","last_peered":"2023-11-28T18:37:34.009932+0000","last_clean":"2023-11-28T18:37:34.009932+0000","last_became_active":"2023-11-28T18:37:33.008838+0000","last_became_peered":"2023-11-28T18:37:33.008838+0000","last_unstale":"2023-11-28T18:37:34.009932+0000","last_undegraded":"2023-11-28T18:37:34.009932+0000","last_fullsized":"2023-11-28T18:37:34.009932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:20:33.664753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T18:37:32.991019+0000","last_change":"2023-11-28T18:37:22.369132+0000","last_active":"2023-11-28T18:37:32.991019+0000","last_peered":"2023-11-28T18:37:32.991019+0000","last_clean":"2023-11-28T18:37:32.991019+0000","last_became_active":"2023-11-28T18:37:22.368142+0000","last_became_peered":"2023-11-28T18:37:22.368142+0000","last_unstale":"2023-11-28T18:37:32.991019+0000","last_undegraded":"2023-11-28T18:37:32.991019+0000","last_fullsized":"2023-11-28T18:37:32.991019+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:21.313053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:21.313053+0000","last_clean_scrub_stamp":"2023-11-28T18:37:21.313053+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:55:01.432028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.988127+0000","last_change":"2023-11-28T18:37:32.466471+0000","last_active":"2023-11-28T18:37:33.988127+0000","last_peered":"2023-11-28T18:37:33.988127+0000","last_clean":"2023-11-28T18:37:33.988127+0000","last_became_active":"2023-11-28T18:37:32.466153+0000","last_became_peered":"2023-11-28T18:37:32.466153+0000","last_unstale":"2023-11-28T18:37:33.988127+0000","last_undegraded":"2023-11-28T18:37:33.988127+0000","last_fullsized":"2023-11-28T18:37:33.988127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:31:52.780773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009403+0000","last_change":"2023-11-28T18:37:32.999109+0000","last_active":"2023-11-28T18:37:34.009403+0000","last_peered":"2023-11-28T18:37:34.009403+0000","last_clean":"2023-11-28T18:37:34.009403+0000","last_became_active":"2023-11-28T18:37:32.998842+0000","last_became_peered":"2023-11-28T18:37:32.998842+0000","last_unstale":"2023-11-28T18:37:34.009403+0000","last_undegraded":"2023-11-28T18:37:34.009403+0000","last_fullsized":"2023-11-28T18:37:34.009403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:36:58.955111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009483+0000","last_change":"2023-11-28T18:37:32.478867+0000","last_active":"2023-11-28T18:37:34.009483+0000","last_peered":"2023-11-28T18:37:34.009483+0000","last_clean":"2023-11-28T18:37:34.009483+0000","last_became_active":"2023-11-28T18:37:32.478483+0000","last_became_peered":"2023-11-28T18:37:32.478483+0000","last_unstale":"2023-11-28T18:37:34.009483+0000","last_undegraded":"2023-11-28T18:37:34.009483+0000","last_fullsized":"2023-11-28T18:37:34.009483+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:21:07.387019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.008034+0000","last_change":"2023-11-28T18:37:32.984449+0000","last_active":"2023-11-28T18:37:34.008034+0000","last_peered":"2023-11-28T18:37:34.008034+0000","last_clean":"2023-11-28T18:37:34.008034+0000","last_became_active":"2023-11-28T18:37:32.984134+0000","last_became_peered":"2023-11-28T18:37:32.984134+0000","last_unstale":"2023-11-28T18:37:34.008034+0000","last_undegraded":"2023-11-28T18:37:34.008034+0000","last_fullsized":"2023-11-28T18:37:34.008034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:22:49.250665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.008158+0000","last_change":"2023-11-28T18:37:32.455919+0000","last_active":"2023-11-28T18:37:34.008158+0000","last_peered":"2023-11-28T18:37:34.008158+0000","last_clean":"2023-11-28T18:37:34.008158+0000","last_became_active":"2023-11-28T18:37:32.455643+0000","last_became_peered":"2023-11-28T18:37:32.455643+0000","last_unstale":"2023-11-28T18:37:34.008158+0000","last_undegraded":"2023-11-28T18:37:34.008158+0000","last_fullsized":"2023-11-28T18:37:34.008158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:47:06.994491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.982436+0000","last_change":"2023-11-28T18:37:32.985903+0000","last_active":"2023-11-28T18:37:33.982436+0000","last_peered":"2023-11-28T18:37:33.982436+0000","last_clean":"2023-11-28T18:37:33.982436+0000","last_became_active":"2023-11-28T18:37:32.985566+0000","last_became_peered":"2023-11-28T18:37:32.985566+0000","last_unstale":"2023-11-28T18:37:33.982436+0000","last_undegraded":"2023-11-28T18:37:33.982436+0000","last_fullsized":"2023-11-28T18:37:33.982436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:25:41.022219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.988411+0000","last_change":"2023-11-28T18:37:32.470133+0000","last_active":"2023-11-28T18:37:33.988411+0000","last_peered":"2023-11-28T18:37:33.988411+0000","last_clean":"2023-11-28T18:37:33.988411+0000","last_became_active":"2023-11-28T18:37:32.468215+0000","last_became_peered":"2023-11-28T18:37:32.468215+0000","last_unstale":"2023-11-28T18:37:33.988411+0000","last_undegraded":"2023-11-28T18:37:33.988411+0000","last_fullsized":"2023-11-28T18:37:33.988411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:41:57.490696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.987855+0000","last_change":"2023-11-28T18:37:32.983380+0000","last_active":"2023-11-28T18:37:33.987855+0000","last_peered":"2023-11-28T18:37:33.987855+0000","last_clean":"2023-11-28T18:37:33.987855+0000","last_became_active":"2023-11-28T18:37:32.982867+0000","last_became_peered":"2023-11-28T18:37:32.982867+0000","last_unstale":"2023-11-28T18:37:33.987855+0000","last_undegraded":"2023-11-28T18:37:33.987855+0000","last_fullsized":"2023-11-28T18:37:33.987855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:18:57.940916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.982747+0000","last_change":"2023-11-28T18:37:32.471305+0000","last_active":"2023-11-28T18:37:33.982747+0000","last_peered":"2023-11-28T18:37:33.982747+0000","last_clean":"2023-11-28T18:37:33.982747+0000","last_became_active":"2023-11-28T18:37:32.470236+0000","last_became_peered":"2023-11-28T18:37:32.470236+0000","last_unstale":"2023-11-28T18:37:33.982747+0000","last_undegraded":"2023-11-28T18:37:33.982747+0000","last_fullsized":"2023-11-28T18:37:33.982747+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:00:25.204297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.988693+0000","last_change":"2023-11-28T18:37:32.999867+0000","last_active":"2023-11-28T18:37:33.988693+0000","last_peered":"2023-11-28T18:37:33.988693+0000","last_clean":"2023-11-28T18:37:33.988693+0000","last_became_active":"2023-11-28T18:37:32.994734+0000","last_became_peered":"2023-11-28T18:37:32.994734+0000","last_unstale":"2023-11-28T18:37:33.988693+0000","last_undegraded":"2023-11-28T18:37:33.988693+0000","last_fullsized":"2023-11-28T18:37:33.988693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:31:53.513239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010425+0000","last_change":"2023-11-28T18:37:32.481867+0000","last_active":"2023-11-28T18:37:34.010425+0000","last_peered":"2023-11-28T18:37:34.010425+0000","last_clean":"2023-11-28T18:37:34.010425+0000","last_became_active":"2023-11-28T18:37:32.481470+0000","last_became_peered":"2023-11-28T18:37:32.481470+0000","last_unstale":"2023-11-28T18:37:34.010425+0000","last_undegraded":"2023-11-28T18:37:34.010425+0000","last_fullsized":"2023-11-28T18:37:34.010425+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:41:57.490696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.982689+0000","last_change":"2023-11-28T18:37:32.988151+0000","last_active":"2023-11-28T18:37:33.982689+0000","last_peered":"2023-11-28T18:37:33.982689+0000","last_clean":"2023-11-28T18:37:33.982689+0000","last_became_active":"2023-11-28T18:37:32.987895+0000","last_became_peered":"2023-11-28T18:37:32.987895+0000","last_unstale":"2023-11-28T18:37:33.982689+0000","last_undegraded":"2023-11-28T18:37:33.982689+0000","last_fullsized":"2023-11-28T18:37:33.982689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:18:10.978623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.982858+0000","last_change":"2023-11-28T18:37:32.464191+0000","last_active":"2023-11-28T18:37:33.982858+0000","last_peered":"2023-11-28T18:37:33.982858+0000","last_clean":"2023-11-28T18:37:33.982858+0000","last_became_active":"2023-11-28T18:37:32.463835+0000","last_became_peered":"2023-11-28T18:37:32.463835+0000","last_unstale":"2023-11-28T18:37:33.982858+0000","last_undegraded":"2023-11-28T18:37:33.982858+0000","last_fullsized":"2023-11-28T18:37:33.982858+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:22:48.248148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009821+0000","last_change":"2023-11-28T18:37:32.995912+0000","last_active":"2023-11-28T18:37:34.009821+0000","last_peered":"2023-11-28T18:37:34.009821+0000","last_clean":"2023-11-28T18:37:34.009821+0000","last_became_active":"2023-11-28T18:37:32.995582+0000","last_became_peered":"2023-11-28T18:37:32.995582+0000","last_unstale":"2023-11-28T18:37:34.009821+0000","last_undegraded":"2023-11-28T18:37:34.009821+0000","last_fullsized":"2023-11-28T18:37:34.009821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:21:13.521447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010735+0000","last_change":"2023-11-28T18:37:32.474120+0000","last_active":"2023-11-28T18:37:34.010735+0000","last_peered":"2023-11-28T18:37:34.010735+0000","last_clean":"2023-11-28T18:37:34.010735+0000","last_became_active":"2023-11-28T18:37:32.473702+0000","last_became_peered":"2023-11-28T18:37:32.473702+0000","last_unstale":"2023-11-28T18:37:34.010735+0000","last_undegraded":"2023-11-28T18:37:34.010735+0000","last_fullsized":"2023-11-28T18:37:34.010735+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:00:25.204297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009041+0000","last_change":"2023-11-28T18:37:32.987116+0000","last_active":"2023-11-28T18:37:34.009041+0000","last_peered":"2023-11-28T18:37:34.009041+0000","last_clean":"2023-11-28T18:37:34.009041+0000","last_became_active":"2023-11-28T18:37:32.986562+0000","last_became_peered":"2023-11-28T18:37:32.986562+0000","last_unstale":"2023-11-28T18:37:34.009041+0000","last_undegraded":"2023-11-28T18:37:34.009041+0000","last_fullsized":"2023-11-28T18:37:34.009041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:46:52.261405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009479+0000","last_change":"2023-11-28T18:37:32.478702+0000","last_active":"2023-11-28T18:37:34.009479+0000","last_peered":"2023-11-28T18:37:34.009479+0000","last_clean":"2023-11-28T18:37:34.009479+0000","last_became_active":"2023-11-28T18:37:32.478119+0000","last_became_peered":"2023-11-28T18:37:32.478119+0000","last_unstale":"2023-11-28T18:37:34.009479+0000","last_undegraded":"2023-11-28T18:37:34.009479+0000","last_fullsized":"2023-11-28T18:37:34.009479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:47:06.994491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.987532+0000","last_change":"2023-11-28T18:37:32.989092+0000","last_active":"2023-11-28T18:37:33.987532+0000","last_peered":"2023-11-28T18:37:33.987532+0000","last_clean":"2023-11-28T18:37:33.987532+0000","last_became_active":"2023-11-28T18:37:32.988635+0000","last_became_peered":"2023-11-28T18:37:32.988635+0000","last_unstale":"2023-11-28T18:37:33.987532+0000","last_undegraded":"2023-11-28T18:37:33.987532+0000","last_fullsized":"2023-11-28T18:37:33.987532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:47:07.997008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.982526+0000","last_change":"2023-11-28T18:37:32.466953+0000","last_active":"2023-11-28T18:37:33.982526+0000","last_peered":"2023-11-28T18:37:33.982526+0000","last_clean":"2023-11-28T18:37:33.982526+0000","last_became_active":"2023-11-28T18:37:32.466697+0000","last_became_peered":"2023-11-28T18:37:32.466697+0000","last_unstale":"2023-11-28T18:37:33.982526+0000","last_undegraded":"2023-11-28T18:37:33.982526+0000","last_fullsized":"2023-11-28T18:37:33.982526+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:50:16.260842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.008440+0000","last_change":"2023-11-28T18:37:32.990343+0000","last_active":"2023-11-28T18:37:34.008440+0000","last_peered":"2023-11-28T18:37:34.008440+0000","last_clean":"2023-11-28T18:37:34.008440+0000","last_became_active":"2023-11-28T18:37:32.990039+0000","last_became_peered":"2023-11-28T18:37:32.990039+0000","last_unstale":"2023-11-28T18:37:34.008440+0000","last_undegraded":"2023-11-28T18:37:34.008440+0000","last_fullsized":"2023-11-28T18:37:34.008440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:41:58.493214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.982690+0000","last_change":"2023-11-28T18:37:32.469083+0000","last_active":"2023-11-28T18:37:33.982690+0000","last_peered":"2023-11-28T18:37:33.982690+0000","last_clean":"2023-11-28T18:37:33.982690+0000","last_became_active":"2023-11-28T18:37:32.468565+0000","last_became_peered":"2023-11-28T18:37:32.468565+0000","last_unstale":"2023-11-28T18:37:33.982690+0000","last_undegraded":"2023-11-28T18:37:33.982690+0000","last_fullsized":"2023-11-28T18:37:33.982690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:16:52.138851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009395+0000","last_change":"2023-11-28T18:37:32.984344+0000","last_active":"2023-11-28T18:37:34.009395+0000","last_peered":"2023-11-28T18:37:34.009395+0000","last_clean":"2023-11-28T18:37:34.009395+0000","last_became_active":"2023-11-28T18:37:32.983741+0000","last_became_peered":"2023-11-28T18:37:32.983741+0000","last_unstale":"2023-11-28T18:37:34.009395+0000","last_undegraded":"2023-11-28T18:37:34.009395+0000","last_fullsized":"2023-11-28T18:37:34.009395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:46:52.261405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010023+0000","last_change":"2023-11-28T18:37:32.479654+0000","last_active":"2023-11-28T18:37:34.010023+0000","last_peered":"2023-11-28T18:37:34.010023+0000","last_clean":"2023-11-28T18:37:34.010023+0000","last_became_active":"2023-11-28T18:37:32.479338+0000","last_became_peered":"2023-11-28T18:37:32.479338+0000","last_unstale":"2023-11-28T18:37:34.010023+0000","last_undegraded":"2023-11-28T18:37:34.010023+0000","last_fullsized":"2023-11-28T18:37:34.010023+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:46:51.258888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010634+0000","last_change":"2023-11-28T18:37:33.001157+0000","last_active":"2023-11-28T18:37:34.010634+0000","last_peered":"2023-11-28T18:37:34.010634+0000","last_clean":"2023-11-28T18:37:34.010634+0000","last_became_active":"2023-11-28T18:37:33.000865+0000","last_became_peered":"2023-11-28T18:37:33.000865+0000","last_unstale":"2023-11-28T18:37:34.010634+0000","last_undegraded":"2023-11-28T18:37:34.010634+0000","last_fullsized":"2023-11-28T18:37:34.010634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:18:10.978623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.988714+0000","last_change":"2023-11-28T18:37:33.005635+0000","last_active":"2023-11-28T18:37:33.988714+0000","last_peered":"2023-11-28T18:37:33.988714+0000","last_clean":"2023-11-28T18:37:33.988714+0000","last_became_active":"2023-11-28T18:37:33.001121+0000","last_became_peered":"2023-11-28T18:37:33.001121+0000","last_unstale":"2023-11-28T18:37:33.988714+0000","last_undegraded":"2023-11-28T18:37:33.988714+0000","last_fullsized":"2023-11-28T18:37:33.988714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:12:16.071028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009766+0000","last_change":"2023-11-28T18:37:32.481789+0000","last_active":"2023-11-28T18:37:34.009766+0000","last_peered":"2023-11-28T18:37:34.009766+0000","last_clean":"2023-11-28T18:37:34.009766+0000","last_became_active":"2023-11-28T18:37:32.481480+0000","last_became_peered":"2023-11-28T18:37:32.481480+0000","last_unstale":"2023-11-28T18:37:34.009766+0000","last_undegraded":"2023-11-28T18:37:34.009766+0000","last_fullsized":"2023-11-28T18:37:34.009766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:00:25.204297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.988397+0000","last_change":"2023-11-28T18:37:33.005206+0000","last_active":"2023-11-28T18:37:33.988397+0000","last_peered":"2023-11-28T18:37:33.988397+0000","last_clean":"2023-11-28T18:37:33.988397+0000","last_became_active":"2023-11-28T18:37:33.002231+0000","last_became_peered":"2023-11-28T18:37:33.002231+0000","last_unstale":"2023-11-28T18:37:33.988397+0000","last_undegraded":"2023-11-28T18:37:33.988397+0000","last_fullsized":"2023-11-28T18:37:33.988397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:20:33.664753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009927+0000","last_change":"2023-11-28T18:37:32.481872+0000","last_active":"2023-11-28T18:37:34.009927+0000","last_peered":"2023-11-28T18:37:34.009927+0000","last_clean":"2023-11-28T18:37:34.009927+0000","last_became_active":"2023-11-28T18:37:32.481564+0000","last_became_peered":"2023-11-28T18:37:32.481564+0000","last_unstale":"2023-11-28T18:37:34.009927+0000","last_undegraded":"2023-11-28T18:37:34.009927+0000","last_fullsized":"2023-11-28T18:37:34.009927+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:22:48.248148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.008960+0000","last_change":"2023-11-28T18:37:33.001322+0000","last_active":"2023-11-28T18:37:34.008960+0000","last_peered":"2023-11-28T18:37:34.008960+0000","last_clean":"2023-11-28T18:37:34.008960+0000","last_became_active":"2023-11-28T18:37:33.001146+0000","last_became_peered":"2023-11-28T18:37:33.001146+0000","last_unstale":"2023-11-28T18:37:34.008960+0000","last_undegraded":"2023-11-28T18:37:34.008960+0000","last_fullsized":"2023-11-28T18:37:34.008960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:41:58.493214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009749+0000","last_change":"2023-11-28T18:37:32.469287+0000","last_active":"2023-11-28T18:37:34.009749+0000","last_peered":"2023-11-28T18:37:34.009749+0000","last_clean":"2023-11-28T18:37:34.009749+0000","last_became_active":"2023-11-28T18:37:32.468967+0000","last_became_peered":"2023-11-28T18:37:32.468967+0000","last_unstale":"2023-11-28T18:37:34.009749+0000","last_undegraded":"2023-11-28T18:37:34.009749+0000","last_fullsized":"2023-11-28T18:37:34.009749+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:00:25.204297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009695+0000","last_change":"2023-11-28T18:37:32.993786+0000","last_active":"2023-11-28T18:37:34.009695+0000","last_peered":"2023-11-28T18:37:34.009695+0000","last_clean":"2023-11-28T18:37:34.009695+0000","last_became_active":"2023-11-28T18:37:32.992734+0000","last_became_peered":"2023-11-28T18:37:32.992734+0000","last_unstale":"2023-11-28T18:37:34.009695+0000","last_undegraded":"2023-11-28T18:37:34.009695+0000","last_fullsized":"2023-11-28T18:37:34.009695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:02:53.545778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009176+0000","last_change":"2023-11-28T18:37:32.471483+0000","last_active":"2023-11-28T18:37:34.009176+0000","last_peered":"2023-11-28T18:37:34.009176+0000","last_clean":"2023-11-28T18:37:34.009176+0000","last_became_active":"2023-11-28T18:37:32.471207+0000","last_became_peered":"2023-11-28T18:37:32.471207+0000","last_unstale":"2023-11-28T18:37:34.009176+0000","last_undegraded":"2023-11-28T18:37:34.009176+0000","last_fullsized":"2023-11-28T18:37:34.009176+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:07:41.145470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":661860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93999999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":204800,"data_stored":70910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31972,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339868,"statfs":{"total":96636764160,"available":96604024832,"internally_reserved":0,"allocated":811008,"data_stored":661916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T18:37:37.943 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-28T18:37:37.944 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-11-28T18:37:37.944 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-11-28T18:37:37.944 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-11-28T18:37:37.944 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-11-28T18:37:38.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.123+0000 7fe9780fe640 1 Processor -- start 2023-11-28T18:37:38.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.123+0000 7fe9780fe640 1 -- start start 2023-11-28T18:37:38.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.123+0000 7fe9780fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe97013cf70 0x7fe97006c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:38.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.123+0000 7fe9780fe640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe97006c840 0x7fe97015a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:38.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.123+0000 7fe9780fe640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe97015b3e0 con 0x7fe97015abb0 2023-11-28T18:37:38.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.123+0000 7fe9780fe640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe97013d350 con 0x7fe97006c840 2023-11-28T18:37:38.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.123+0000 7fe9780fe640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe970140520 con 0x7fe97013cf70 2023-11-28T18:37:38.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.123+0000 7fe97669b640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe97015abb0 0x7fe9700715b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57602/0 (socket says 172.21.15.45:57602) 2023-11-28T18:37:38.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.123+0000 7fe97669b640 1 -- 172.21.15.45:0/3660492017 learned_addr learned my addr 172.21.15.45:0/3660492017 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:37:38.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.127+0000 7fe975e9a640 1 --2- 172.21.15.45:0/3660492017 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe97013cf70 0x7fe97006c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:38.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.127+0000 7fe975699640 1 --2- 172.21.15.45:0/3660492017 >> v2:172.21.15.190:3300/0 conn(0x7fe97006c840 0x7fe97015a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:38.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.127+0000 7fe974e98640 1 -- 172.21.15.45:0/3660492017 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 281266936 0 0) 0x7fe97015b3e0 con 0x7fe97015abb0 2023-11-28T18:37:38.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.127+0000 7fe974e98640 1 -- 172.21.15.45:0/3660492017 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe95c005740 con 0x7fe97015abb0 2023-11-28T18:37:38.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.127+0000 7fe974e98640 1 -- 172.21.15.45:0/3660492017 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2381376345 0 0) 0x7fe95c005740 con 0x7fe97015abb0 2023-11-28T18:37:38.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.127+0000 7fe974e98640 1 -- 172.21.15.45:0/3660492017 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe97013cf70 msgr2=0x7fe97006c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:38.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.127+0000 7fe974e98640 1 --2- 172.21.15.45:0/3660492017 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe97013cf70 0x7fe97006c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:38.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.127+0000 7fe974e98640 1 -- 172.21.15.45:0/3660492017 >> v2:172.21.15.190:3300/0 conn(0x7fe97006c840 msgr2=0x7fe97015a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:38.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.127+0000 7fe974e98640 1 --2- 172.21.15.45:0/3660492017 >> v2:172.21.15.190:3300/0 conn(0x7fe97006c840 0x7fe97015a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:38.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.127+0000 7fe974e98640 1 -- 172.21.15.45:0/3660492017 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe97006cc80 con 0x7fe97015abb0 2023-11-28T18:37:38.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.127+0000 7fe974e98640 1 -- 172.21.15.45:0/3660492017 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4084481567 0 0) 0x7fe968001a00 con 0x7fe97015abb0 2023-11-28T18:37:38.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.127+0000 7fe975699640 1 --2- 172.21.15.45:0/3660492017 >> v2:172.21.15.190:3300/0 conn(0x7fe97006c840 0x7fe97015a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:37:38.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.127+0000 7fe974e98640 1 -- 172.21.15.45:0/3660492017 >> v1:172.21.15.45:6789/0 conn(0x7fe97015abb0 legacy=0x7fe9700715b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:38.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.127+0000 7fe974e98640 1 --2- 172.21.15.45:0/3660492017 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe95c005bc0 0x7fe95c005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:38.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.127+0000 7fe974e98640 1 --2- 172.21.15.45:0/3660492017 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe95c0069e0 0x7fe95c006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:38.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.127+0000 7fe974e98640 1 --2- 172.21.15.45:0/3660492017 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe97013cf70 0x7fe95c0073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:38.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.127+0000 7fe974e98640 1 -- 172.21.15.45:0/3660492017 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe970140520 con 0x7fe95c0069e0 2023-11-28T18:37:38.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.127+0000 7fe974e98640 1 -- 172.21.15.45:0/3660492017 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe95c00dba0 con 0x7fe95c005bc0 2023-11-28T18:37:38.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.127+0000 7fe974e98640 1 -- 172.21.15.45:0/3660492017 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe95c00dd10 con 0x7fe97013cf70 2023-11-28T18:37:38.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.127+0000 7fe975699640 1 --2- 172.21.15.45:0/3660492017 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe95c0069e0 0x7fe95c006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:38.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.127+0000 7fe975e9a640 1 --2- 172.21.15.45:0/3660492017 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe95c005bc0 0x7fe95c005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:38.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.127+0000 7fe97669b640 1 --2- 172.21.15.45:0/3660492017 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe97013cf70 0x7fe95c0073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:38.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.127+0000 7fe975699640 1 -- 172.21.15.45:0/3660492017 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe97013cf70 msgr2=0x7fe95c0073a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:38.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.127+0000 7fe975699640 1 --2- 172.21.15.45:0/3660492017 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe97013cf70 0x7fe95c0073a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:38.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.127+0000 7fe975699640 1 -- 172.21.15.45:0/3660492017 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe95c005bc0 msgr2=0x7fe95c005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:38.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.127+0000 7fe975699640 1 --2- 172.21.15.45:0/3660492017 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe95c005bc0 0x7fe95c005fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:38.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.127+0000 7fe975699640 1 -- 172.21.15.45:0/3660492017 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe95c005740 con 0x7fe95c0069e0 2023-11-28T18:37:38.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.131+0000 7fe975699640 1 --2- 172.21.15.45:0/3660492017 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe95c0069e0 0x7fe95c006e60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe960009cb0 tx=0x7fe96001cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3077f966674e4025 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:38.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.131+0000 7fe974e98640 1 -- 172.21.15.45:0/3660492017 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9600a5710 con 0x7fe95c0069e0 2023-11-28T18:37:38.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.131+0000 7fe974e98640 1 -- 172.21.15.45:0/3660492017 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9600a5870 con 0x7fe95c0069e0 2023-11-28T18:37:38.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.131+0000 7fe974e98640 1 -- 172.21.15.45:0/3660492017 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9600a5c20 con 0x7fe95c0069e0 2023-11-28T18:37:38.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.131+0000 7fe9780fe640 1 -- 172.21.15.45:0/3660492017 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe95c0069e0 msgr2=0x7fe95c006e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:38.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.131+0000 7fe9780fe640 1 --2- 172.21.15.45:0/3660492017 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe95c0069e0 0x7fe95c006e60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe960009cb0 tx=0x7fe96001cbe0 comp rx=0 tx=0).stop 2023-11-28T18:37:38.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.131+0000 7fe97669b640 1 -- 172.21.15.45:0/3660492017 reap_dead start 2023-11-28T18:37:38.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.131+0000 7fe9780fe640 1 -- 172.21.15.45:0/3660492017 shutdown_connections 2023-11-28T18:37:38.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.131+0000 7fe9780fe640 1 -- 172.21.15.45:0/3660492017 >> 172.21.15.45:0/3660492017 conn(0x7fe97006a570 msgr2=0x7fe97006a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:38.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.131+0000 7fe9780fe640 1 -- 172.21.15.45:0/3660492017 shutdown_connections 2023-11-28T18:37:38.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.131+0000 7fe9780fe640 1 -- 172.21.15.45:0/3660492017 wait complete. 2023-11-28T18:37:38.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.131+0000 7fe9780fe640 1 Processor -- start 2023-11-28T18:37:38.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.131+0000 7fe9780fe640 1 -- start start 2023-11-28T18:37:38.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.131+0000 7fe9780fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe95c0069e0 0x7fe970138730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:38.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.135+0000 7fe9780fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe9701e7980 0x7fe9701e5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:38.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.135+0000 7fe9780fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe9701e62b0 0x7fe9700b3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:38.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.135+0000 7fe9780fe640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9701552b0 con 0x7fe95c0069e0 2023-11-28T18:37:38.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.135+0000 7fe9780fe640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9701e68e0 con 0x7fe9701e7980 2023-11-28T18:37:38.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.135+0000 7fe9780fe640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9701e6bc0 con 0x7fe9701e62b0 2023-11-28T18:37:38.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.135+0000 7fe975e9a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe95c0069e0 0x7fe970138730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:38.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.135+0000 7fe975e9a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe95c0069e0 0x7fe970138730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57028/0 (socket says 172.21.15.45:57028) 2023-11-28T18:37:38.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.135+0000 7fe975e9a640 1 -- 172.21.15.45:0/1783202099 learned_addr learned my addr 172.21.15.45:0/1783202099 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:38.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.135+0000 7fe97669b640 1 --2- 172.21.15.45:0/1783202099 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe9701e62b0 0x7fe9700b3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:38.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.135+0000 7fe975699640 1 --2- 172.21.15.45:0/1783202099 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe9701e7980 0x7fe9701e5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:38.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.135+0000 7fe975e9a640 1 -- 172.21.15.45:0/1783202099 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe9701e62b0 msgr2=0x7fe9700b3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:38.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.135+0000 7fe975e9a640 1 --2- 172.21.15.45:0/1783202099 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe9701e62b0 0x7fe9700b3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:38.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.135+0000 7fe975e9a640 1 -- 172.21.15.45:0/1783202099 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe9701e7980 msgr2=0x7fe9701e5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:38.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.135+0000 7fe975e9a640 1 --2- 172.21.15.45:0/1783202099 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe9701e7980 0x7fe9701e5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:38.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.135+0000 7fe975e9a640 1 -- 172.21.15.45:0/1783202099 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9701e6ea0 con 0x7fe95c0069e0 2023-11-28T18:37:38.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.135+0000 7fe975e9a640 1 --2- 172.21.15.45:0/1783202099 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe95c0069e0 0x7fe970138730 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe96c0119d0 tx=0x7fe96c011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:38.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.135+0000 7fe9667fc640 1 -- 172.21.15.45:0/1783202099 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96c00fb50 con 0x7fe95c0069e0 2023-11-28T18:37:38.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.135+0000 7fe9667fc640 1 -- 172.21.15.45:0/1783202099 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe96c00fcb0 con 0x7fe95c0069e0 2023-11-28T18:37:38.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.135+0000 7fe9780fe640 1 -- 172.21.15.45:0/1783202099 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9701e7180 con 0x7fe95c0069e0 2023-11-28T18:37:38.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.135+0000 7fe9667fc640 1 -- 172.21.15.45:0/1783202099 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96c014440 con 0x7fe95c0069e0 2023-11-28T18:37:38.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.135+0000 7fe9780fe640 1 -- 172.21.15.45:0/1783202099 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe970138c70 con 0x7fe95c0069e0 2023-11-28T18:37:38.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.135+0000 7fe9780fe640 1 -- 172.21.15.45:0/1783202099 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9700ae9c0 con 0x7fe95c0069e0 2023-11-28T18:37:38.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.135+0000 7fe9667fc640 1 -- 172.21.15.45:0/1783202099 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe96c01d400 con 0x7fe95c0069e0 2023-11-28T18:37:38.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.139+0000 7fe9667fc640 1 --2- 172.21.15.45:0/1783202099 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe954066900 0x7fe954068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:38.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.139+0000 7fe9667fc640 1 -- 172.21.15.45:0/1783202099 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe96c084c10 con 0x7fe95c0069e0 2023-11-28T18:37:38.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.139+0000 7fe975699640 1 --2- 172.21.15.45:0/1783202099 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe954066900 0x7fe954068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:38.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.139+0000 7fe975699640 1 --2- 172.21.15.45:0/1783202099 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe954066900 0x7fe954068dc0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe9600af000 tx=0x7fe9600046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:38.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.143+0000 7fe9667fc640 1 -- 172.21.15.45:0/1783202099 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe96c051f00 con 0x7fe95c0069e0 2023-11-28T18:37:38.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.335+0000 7fe9780fe640 1 -- 172.21.15.45:0/1783202099 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fe970069480 con 0x7fe95c0069e0 2023-11-28T18:37:38.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.339+0000 7fe9667fc640 1 -- 172.21.15.45:0/1783202099 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164973 (secure 0 0 0) 0x7fe96c055520 con 0x7fe95c0069e0 2023-11-28T18:37:38.345 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:37:38.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.339+0000 7fe9780fe640 1 -- 172.21.15.45:0/1783202099 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe954066900 msgr2=0x7fe954068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:38.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.339+0000 7fe9780fe640 1 --2- 172.21.15.45:0/1783202099 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe954066900 0x7fe954068dc0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe9600af000 tx=0x7fe9600046d0 comp rx=0 tx=0).stop 2023-11-28T18:37:38.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.339+0000 7fe9780fe640 1 -- 172.21.15.45:0/1783202099 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe95c0069e0 msgr2=0x7fe970138730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:38.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.339+0000 7fe9780fe640 1 --2- 172.21.15.45:0/1783202099 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe95c0069e0 0x7fe970138730 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe96c0119d0 tx=0x7fe96c011e90 comp rx=0 tx=0).stop 2023-11-28T18:37:38.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.339+0000 7fe9780fe640 1 -- 172.21.15.45:0/1783202099 shutdown_connections 2023-11-28T18:37:38.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.339+0000 7fe9780fe640 1 --2- 172.21.15.45:0/1783202099 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe954066900 0x7fe954068dc0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:38.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.339+0000 7fe9780fe640 1 --2- 172.21.15.45:0/1783202099 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe9701e62b0 0x7fe9700b3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:38.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.339+0000 7fe9780fe640 1 --2- 172.21.15.45:0/1783202099 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe9701e7980 0x7fe9701e5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:38.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.339+0000 7fe9780fe640 1 --2- 172.21.15.45:0/1783202099 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe95c0069e0 0x7fe970138730 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:38.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.339+0000 7fe9780fe640 1 -- 172.21.15.45:0/1783202099 >> 172.21.15.45:0/1783202099 conn(0x7fe97006a570 msgr2=0x7fe970155ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:38.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.339+0000 7fe9780fe640 1 -- 172.21.15.45:0/1783202099 shutdown_connections 2023-11-28T18:37:38.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.339+0000 7fe9780fe640 1 -- 172.21.15.45:0/1783202099 wait complete. 2023-11-28T18:37:38.364 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":5,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":645101166},{"type":"v1","addr":"172.21.15.190:6833","nonce":645101166}]},"active_addr":"172.21.15.190:6833/645101166","active_change":"2023-11-28T18:37:13.218836+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4104,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.190:0","nonce":3115812353}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.190:0","nonce":719029333}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.190:0","nonce":3446525702}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.190:0","nonce":3006696867}]}]} 2023-11-28T18:37:38.370 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-11-28T18:37:38.370 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-11-28T18:37:38.370 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T18:37:38.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.511+0000 7ff2d891d640 1 Processor -- start 2023-11-28T18:37:38.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.511+0000 7ff2d891d640 1 -- start start 2023-11-28T18:37:38.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.511+0000 7ff2d891d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff2d4144880 0x7ff2d406c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:38.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.511+0000 7ff2d891d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff2d40721c0 0x7ff2d406c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:38.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.511+0000 7ff2d891d640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2d4071120 con 0x7ff2d40704a0 2023-11-28T18:37:38.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.511+0000 7ff2d891d640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2d415f050 con 0x7ff2d40721c0 2023-11-28T18:37:38.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.511+0000 7ff2d891d640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2d4071400 con 0x7ff2d4144880 2023-11-28T18:37:38.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.511+0000 7ff2d1d9b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff2d40721c0 0x7ff2d406c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:38.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.511+0000 7ff2d1d9b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff2d40721c0 0x7ff2d406c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57030/0 (socket says 172.21.15.45:57030) 2023-11-28T18:37:38.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.511+0000 7ff2d1d9b640 1 -- 172.21.15.45:0/1195228302 learned_addr learned my addr 172.21.15.45:0/1195228302 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:38.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.511+0000 7ff2d2d9d640 1 --1- 172.21.15.45:0/1195228302 >> v1:172.21.15.45:6789/0 conn(0x7ff2d40704a0 0x7ff2d4070950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57616/0 (socket says 172.21.15.45:57616) 2023-11-28T18:37:38.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.511+0000 7ff2d259c640 1 --2- 172.21.15.45:0/1195228302 >> v2:172.21.15.190:3300/0 conn(0x7ff2d4144880 0x7ff2d406c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:38.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.511+0000 7ff2d1d9b640 1 -- 172.21.15.45:0/1195228302 >> v2:172.21.15.190:3300/0 conn(0x7ff2d4144880 msgr2=0x7ff2d406c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:38.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.511+0000 7ff2d1d9b640 1 --2- 172.21.15.45:0/1195228302 >> v2:172.21.15.190:3300/0 conn(0x7ff2d4144880 0x7ff2d406c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:38.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.511+0000 7ff2d1d9b640 1 -- 172.21.15.45:0/1195228302 >> v1:172.21.15.45:6789/0 conn(0x7ff2d40704a0 legacy=0x7ff2d4070950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:38.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.511+0000 7ff2d159a640 1 -- 172.21.15.45:0/1195228302 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3096599362 0 0) 0x7ff2d4071120 con 0x7ff2d40704a0 2023-11-28T18:37:38.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.511+0000 7ff2d1d9b640 1 -- 172.21.15.45:0/1195228302 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d40716e0 con 0x7ff2d40721c0 2023-11-28T18:37:38.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.515+0000 7ff2d1d9b640 1 --2- 172.21.15.45:0/1195228302 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2d40721c0 0x7ff2d406c840 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4068060 tx=0x7ff2c801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=425c29e258140bfe server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:38.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.515+0000 7ff2d159a640 1 -- 172.21.15.45:0/1195228302 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c80aa430 con 0x7ff2d40721c0 2023-11-28T18:37:38.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.515+0000 7ff2d159a640 1 -- 172.21.15.45:0/1195228302 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2c80aa590 con 0x7ff2d40721c0 2023-11-28T18:37:38.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.515+0000 7ff2d159a640 1 -- 172.21.15.45:0/1195228302 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c80aa920 con 0x7ff2d40721c0 2023-11-28T18:37:38.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.515+0000 7ff2d891d640 1 -- 172.21.15.45:0/1195228302 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2d40721c0 msgr2=0x7ff2d406c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:38.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.515+0000 7ff2d891d640 1 --2- 172.21.15.45:0/1195228302 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2d40721c0 0x7ff2d406c840 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4068060 tx=0x7ff2c801c4d0 comp rx=0 tx=0).stop 2023-11-28T18:37:38.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.515+0000 7ff2d891d640 1 -- 172.21.15.45:0/1195228302 shutdown_connections 2023-11-28T18:37:38.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.515+0000 7ff2d891d640 1 --2- 172.21.15.45:0/1195228302 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2d40721c0 0x7ff2d406c840 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:38.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.515+0000 7ff2d891d640 1 --2- 172.21.15.45:0/1195228302 >> v2:172.21.15.190:3300/0 conn(0x7ff2d4144880 0x7ff2d406c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:38.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.515+0000 7ff2d891d640 1 -- 172.21.15.45:0/1195228302 >> 172.21.15.45:0/1195228302 conn(0x7ff2d406a570 msgr2=0x7ff2d406a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:38.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.515+0000 7ff2d891d640 1 -- 172.21.15.45:0/1195228302 shutdown_connections 2023-11-28T18:37:38.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.515+0000 7ff2d891d640 1 -- 172.21.15.45:0/1195228302 wait complete. 2023-11-28T18:37:38.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.519+0000 7ff2d891d640 1 Processor -- start 2023-11-28T18:37:38.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.519+0000 7ff2d891d640 1 -- start start 2023-11-28T18:37:38.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.519+0000 7ff2d891d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff2d40704a0 0x7ff2d40b2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:38.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.519+0000 7ff2d891d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff2d40721c0 0x7ff2d40add30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:38.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.519+0000 7ff2d891d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2d4144880 0x7ff2d415ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:38.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.519+0000 7ff2d891d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d40ae270 con 0x7ff2d4144880 2023-11-28T18:37:38.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.519+0000 7ff2d891d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d415b060 con 0x7ff2d40704a0 2023-11-28T18:37:38.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.519+0000 7ff2d891d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d40b3210 con 0x7ff2d40721c0 2023-11-28T18:37:38.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.519+0000 7ff2d2d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2d4144880 0x7ff2d415ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:38.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.519+0000 7ff2d259c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff2d40704a0 0x7ff2d40b2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:38.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.519+0000 7ff2d259c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff2d40704a0 0x7ff2d40b2b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.45:42020/0 (socket says 172.21.15.45:42020) 2023-11-28T18:37:38.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.519+0000 7ff2d259c640 1 -- 172.21.15.45:0/1542154893 learned_addr learned my addr 172.21.15.45:0/1542154893 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:38.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.519+0000 7ff2d1d9b640 1 --2- 172.21.15.45:0/1542154893 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff2d40721c0 0x7ff2d40add30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:38.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.519+0000 7ff2d2d9d640 1 -- 172.21.15.45:0/1542154893 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff2d40721c0 msgr2=0x7ff2d40add30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:38.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.519+0000 7ff2d2d9d640 1 --2- 172.21.15.45:0/1542154893 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff2d40721c0 0x7ff2d40add30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:38.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.519+0000 7ff2d2d9d640 1 -- 172.21.15.45:0/1542154893 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff2d40704a0 msgr2=0x7ff2d40b2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:38.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.519+0000 7ff2d2d9d640 1 --2- 172.21.15.45:0/1542154893 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff2d40704a0 0x7ff2d40b2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:38.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.519+0000 7ff2d2d9d640 1 -- 172.21.15.45:0/1542154893 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c80094d0 con 0x7ff2d4144880 2023-11-28T18:37:38.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.519+0000 7ff2d2d9d640 1 --2- 172.21.15.45:0/1542154893 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2d4144880 0x7ff2d415ab20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc00c6e0 tx=0x7ff2cc00cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:38.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.519+0000 7ff2c2ffd640 1 -- 172.21.15.45:0/1542154893 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2cc004d70 con 0x7ff2d4144880 2023-11-28T18:37:38.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.519+0000 7ff2c2ffd640 1 -- 172.21.15.45:0/1542154893 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2cc00a640 con 0x7ff2d4144880 2023-11-28T18:37:38.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.519+0000 7ff2c2ffd640 1 -- 172.21.15.45:0/1542154893 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2cc00aa30 con 0x7ff2d4144880 2023-11-28T18:37:38.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.519+0000 7ff2d891d640 1 -- 172.21.15.45:0/1542154893 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2d40b34f0 con 0x7ff2d4144880 2023-11-28T18:37:38.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.519+0000 7ff2d891d640 1 -- 172.21.15.45:0/1542154893 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2d40b3ab0 con 0x7ff2d4144880 2023-11-28T18:37:38.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.519+0000 7ff2d891d640 1 -- 172.21.15.45:0/1542154893 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2d4141a30 con 0x7ff2d4144880 2023-11-28T18:37:38.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.523+0000 7ff2c2ffd640 1 -- 172.21.15.45:0/1542154893 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ff2cc00ab90 con 0x7ff2d4144880 2023-11-28T18:37:38.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.523+0000 7ff2c2ffd640 1 --2- 172.21.15.45:0/1542154893 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff2b40668d0 0x7ff2b4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:38.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.523+0000 7ff2c2ffd640 1 -- 172.21.15.45:0/1542154893 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff2cc083950 con 0x7ff2d4144880 2023-11-28T18:37:38.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.523+0000 7ff2d259c640 1 --2- 172.21.15.45:0/1542154893 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff2b40668d0 0x7ff2b4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:38.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.523+0000 7ff2d259c640 1 --2- 172.21.15.45:0/1542154893 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff2b40668d0 0x7ff2b4068d90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff2c4009b80 tx=0x7ff2c4009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:38.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.527+0000 7ff2c2ffd640 1 -- 172.21.15.45:0/1542154893 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff2d4141a30 con 0x7ff2d4144880 2023-11-28T18:37:38.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.687+0000 7ff2d891d640 1 -- 172.21.15.45:0/1542154893 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff2d4141a30 con 0x7ff2d4144880 2023-11-28T18:37:38.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.687+0000 7ff2c2ffd640 1 -- 172.21.15.45:0/1542154893 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16469 (secure 0 0 0) 0x7ff2d4141a30 con 0x7ff2d4144880 2023-11-28T18:37:38.693 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:37:38.693 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":20,"fsid":"d10f5cd6-1d00-4019-99b6-6fa435498a15","created":"2023-11-28T18:37:08.189030+0000","modified":"2023-11-28T18:37:33.971141+0000","last_up_change":"2023-11-28T18:37:20.196124+0000","last_in_change":"2023-11-28T18:37:10.742043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T18:37:21.293917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T18:37:31.384760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T18:37:31.834769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"84465384-103c-4f2c-a45a-96f5bb9c835f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6809","nonce":555237322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6811","nonce":555237322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6815","nonce":555237322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6813","nonce":555237322}]},"public_addr":"172.21.15.45:6809/555237322","cluster_addr":"172.21.15.45:6811/555237322","heartbeat_back_addr":"172.21.15.45:6815/555237322","heartbeat_front_addr":"172.21.15.45:6813/555237322","state":["exists","up"]},{"osd":1,"uuid":"7d9eed24-a58f-42c7-a787-ac06be8553fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6801","nonce":2857063763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6803","nonce":2857063763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6807","nonce":2857063763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6805","nonce":2857063763}]},"public_addr":"172.21.15.45:6801/2857063763","cluster_addr":"172.21.15.45:6803/2857063763","heartbeat_back_addr":"172.21.15.45:6807/2857063763","heartbeat_front_addr":"172.21.15.45:6805/2857063763","state":["exists","up"]},{"osd":2,"uuid":"575eeccc-4abf-45b4-9caf-f3e797859588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6817","nonce":193884539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6819","nonce":193884539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6823","nonce":193884539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6821","nonce":193884539}]},"public_addr":"172.21.15.45:6817/193884539","cluster_addr":"172.21.15.45:6819/193884539","heartbeat_back_addr":"172.21.15.45:6823/193884539","heartbeat_front_addr":"172.21.15.45:6821/193884539","state":["exists","up"]},{"osd":3,"uuid":"9b0290d6-9a52-4bc8-b2a1-7622c5dc8e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6825","nonce":78541084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6827","nonce":78541084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6831","nonce":78541084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6829","nonce":78541084}]},"public_addr":"172.21.15.45:6825/78541084","cluster_addr":"172.21.15.45:6827/78541084","heartbeat_back_addr":"172.21.15.45:6831/78541084","heartbeat_front_addr":"172.21.15.45:6829/78541084","state":["exists","up"]},{"osd":4,"uuid":"ce632829-f027-4fbf-a627-02c571aa9d53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6809","nonce":1537591987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6811","nonce":1537591987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6815","nonce":1537591987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6813","nonce":1537591987}]},"public_addr":"172.21.15.190:6809/1537591987","cluster_addr":"172.21.15.190:6811/1537591987","heartbeat_back_addr":"172.21.15.190:6815/1537591987","heartbeat_front_addr":"172.21.15.190:6813/1537591987","state":["exists","up"]},{"osd":5,"uuid":"8700b609-27be-40bd-a251-4c0ae0a29ead","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6801","nonce":3296698407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6803","nonce":3296698407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6807","nonce":3296698407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6805","nonce":3296698407}]},"public_addr":"172.21.15.190:6801/3296698407","cluster_addr":"172.21.15.190:6803/3296698407","heartbeat_back_addr":"172.21.15.190:6807/3296698407","heartbeat_front_addr":"172.21.15.190:6805/3296698407","state":["exists","up"]},{"osd":6,"uuid":"44ce4a40-e6ff-4f4d-8e8a-7341e5c91f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6817","nonce":2317686718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6819","nonce":2317686718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6823","nonce":2317686718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6821","nonce":2317686718}]},"public_addr":"172.21.15.190:6817/2317686718","cluster_addr":"172.21.15.190:6819/2317686718","heartbeat_back_addr":"172.21.15.190:6823/2317686718","heartbeat_front_addr":"172.21.15.190:6821/2317686718","state":["exists","up"]},{"osd":7,"uuid":"192238c9-1423-4b7e-ac8f-84ba32113ddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6825","nonce":2493232051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6827","nonce":2493232051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6831","nonce":2493232051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6829","nonce":2493232051}]},"public_addr":"172.21.15.190:6825/2493232051","cluster_addr":"172.21.15.190:6827/2493232051","heartbeat_back_addr":"172.21.15.190:6831/2493232051","heartbeat_front_addr":"172.21.15.190:6829/2493232051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.393552+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.385453+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.361421+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.366408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.363226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.276007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.414605+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.445885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T18:37:38.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.691+0000 7ff2d891d640 1 -- 172.21.15.45:0/1542154893 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff2b40668d0 msgr2=0x7ff2b4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:38.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.691+0000 7ff2d891d640 1 --2- 172.21.15.45:0/1542154893 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff2b40668d0 0x7ff2b4068d90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff2c4009b80 tx=0x7ff2c4009190 comp rx=0 tx=0).stop 2023-11-28T18:37:38.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.691+0000 7ff2d891d640 1 -- 172.21.15.45:0/1542154893 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2d4144880 msgr2=0x7ff2d415ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:38.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.691+0000 7ff2d891d640 1 --2- 172.21.15.45:0/1542154893 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2d4144880 0x7ff2d415ab20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc00c6e0 tx=0x7ff2cc00cba0 comp rx=0 tx=0).stop 2023-11-28T18:37:38.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.691+0000 7ff2d891d640 1 -- 172.21.15.45:0/1542154893 shutdown_connections 2023-11-28T18:37:38.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.691+0000 7ff2d891d640 1 --2- 172.21.15.45:0/1542154893 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff2b40668d0 0x7ff2b4068d90 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:38.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.691+0000 7ff2d891d640 1 --2- 172.21.15.45:0/1542154893 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2d4144880 0x7ff2d415ab20 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:38.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.691+0000 7ff2d891d640 1 --2- 172.21.15.45:0/1542154893 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff2d40721c0 0x7ff2d40add30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:38.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.691+0000 7ff2d891d640 1 --2- 172.21.15.45:0/1542154893 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff2d40704a0 0x7ff2d40b2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:38.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.691+0000 7ff2d891d640 1 -- 172.21.15.45:0/1542154893 >> 172.21.15.45:0/1542154893 conn(0x7ff2d406a570 msgr2=0x7ff2d406c300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:38.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.691+0000 7ff2d891d640 1 -- 172.21.15.45:0/1542154893 shutdown_connections 2023-11-28T18:37:38.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.691+0000 7ff2d891d640 1 -- 172.21.15.45:0/1542154893 wait complete. 2023-11-28T18:37:38.714 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-11-28T18:37:38.715 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T18:37:38.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.851+0000 7f44bffd8640 1 Processor -- start 2023-11-28T18:37:38.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.851+0000 7f44bffd8640 1 -- start start 2023-11-28T18:37:38.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.855+0000 7f44bffd8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f44b80b35f0 0x7f44b80d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:38.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.855+0000 7f44bffd8640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f44b80b3cb0 0x7f44b815f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:38.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.855+0000 7f44bffd8640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44b80d38c0 con 0x7f44b80cf7c0 2023-11-28T18:37:38.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.855+0000 7f44bffd8640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44b80d40d0 con 0x7f44b80b35f0 2023-11-28T18:37:38.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.855+0000 7f44bffd8640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44b80cdcc0 con 0x7f44b80b3cb0 2023-11-28T18:37:38.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.855+0000 7f44bdd74640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f44b80b35f0 0x7f44b80d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:38.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.855+0000 7f44be575640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f44b80cf7c0 0x7f44b80ce480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57628/0 (socket says 172.21.15.45:57628) 2023-11-28T18:37:38.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.855+0000 7f44be575640 1 -- 172.21.15.45:0/1092400367 learned_addr learned my addr 172.21.15.45:0/1092400367 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:37:38.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.855+0000 7f44bd573640 1 --2- 172.21.15.45:0/1092400367 >> v2:172.21.15.190:3300/0 conn(0x7f44b80b3cb0 0x7f44b815f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:38.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.855+0000 7f44bdd74640 1 -- 172.21.15.45:0/1092400367 >> v2:172.21.15.190:3300/0 conn(0x7f44b80b3cb0 msgr2=0x7f44b815f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:38.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.855+0000 7f44bdd74640 1 --2- 172.21.15.45:0/1092400367 >> v2:172.21.15.190:3300/0 conn(0x7f44b80b3cb0 0x7f44b815f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:38.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.855+0000 7f44bdd74640 1 -- 172.21.15.45:0/1092400367 >> v1:172.21.15.45:6789/0 conn(0x7f44b80cf7c0 legacy=0x7f44b80ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:38.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.855+0000 7f44bcd72640 1 -- 172.21.15.45:0/1092400367 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3325111624 0 0) 0x7f44b80d38c0 con 0x7f44b80cf7c0 2023-11-28T18:37:38.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.855+0000 7f44bdd74640 1 -- 172.21.15.45:0/1092400367 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b80d3b10 con 0x7f44b80b35f0 2023-11-28T18:37:38.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.855+0000 7f44bd573640 1 --2- 172.21.15.45:0/1092400367 >> v2:172.21.15.190:3300/0 conn(0x7f44b80b3cb0 0x7f44b815f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:37:38.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.859+0000 7f44bdd74640 1 --2- 172.21.15.45:0/1092400367 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44b80b35f0 0x7f44b80d0f90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f44b808be20 tx=0x7f44b401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baef195e631b7dc1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:38.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.859+0000 7f44bcd72640 1 -- 172.21.15.45:0/1092400367 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b40ab660 con 0x7f44b80b35f0 2023-11-28T18:37:38.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.859+0000 7f44bcd72640 1 -- 172.21.15.45:0/1092400367 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44b40ab7c0 con 0x7f44b80b35f0 2023-11-28T18:37:38.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.859+0000 7f44bcd72640 1 -- 172.21.15.45:0/1092400367 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b40abb50 con 0x7f44b80b35f0 2023-11-28T18:37:38.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.859+0000 7f44bffd8640 1 -- 172.21.15.45:0/1092400367 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44b80b35f0 msgr2=0x7f44b80d0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:38.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.859+0000 7f44bffd8640 1 --2- 172.21.15.45:0/1092400367 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44b80b35f0 0x7f44b80d0f90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f44b808be20 tx=0x7f44b401c460 comp rx=0 tx=0).stop 2023-11-28T18:37:38.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.859+0000 7f44bffd8640 1 -- 172.21.15.45:0/1092400367 shutdown_connections 2023-11-28T18:37:38.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.859+0000 7f44bffd8640 1 --2- 172.21.15.45:0/1092400367 >> v2:172.21.15.190:3300/0 conn(0x7f44b80b3cb0 0x7f44b815f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:38.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.859+0000 7f44bffd8640 1 --2- 172.21.15.45:0/1092400367 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44b80b35f0 0x7f44b80d0f90 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:38.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.859+0000 7f44bffd8640 1 -- 172.21.15.45:0/1092400367 >> 172.21.15.45:0/1092400367 conn(0x7f44b809c4f0 msgr2=0x7f44b80d31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:38.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.859+0000 7f44bffd8640 1 -- 172.21.15.45:0/1092400367 shutdown_connections 2023-11-28T18:37:38.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.859+0000 7f44bffd8640 1 -- 172.21.15.45:0/1092400367 wait complete. 2023-11-28T18:37:38.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.859+0000 7f44bffd8640 1 Processor -- start 2023-11-28T18:37:38.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.859+0000 7f44bffd8640 1 -- start start 2023-11-28T18:37:38.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.863+0000 7f44bffd8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44b80b35f0 0x7f44b8159930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:38.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.863+0000 7f44bffd8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44b80b3cb0 0x7f44b80b5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:38.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.863+0000 7f44bffd8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44b80cf7c0 0x7f44b80b5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:38.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.863+0000 7f44bffd8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b8159e70 con 0x7f44b80b3cb0 2023-11-28T18:37:38.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.863+0000 7f44bffd8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b815a9e0 con 0x7f44b80b35f0 2023-11-28T18:37:38.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.863+0000 7f44bffd8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44b80b5250 con 0x7f44b80cf7c0 2023-11-28T18:37:38.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.863+0000 7f44bd573640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44b80b3cb0 0x7f44b80b5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:38.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.863+0000 7f44bd573640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44b80b3cb0 0x7f44b80b5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57060/0 (socket says 172.21.15.45:57060) 2023-11-28T18:37:38.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.863+0000 7f44bd573640 1 -- 172.21.15.45:0/3162297757 learned_addr learned my addr 172.21.15.45:0/3162297757 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:38.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.863+0000 7f44be575640 1 --2- 172.21.15.45:0/3162297757 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44b80cf7c0 0x7f44b80b5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:38.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.863+0000 7f44bdd74640 1 --2- 172.21.15.45:0/3162297757 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44b80b35f0 0x7f44b8159930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:38.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.863+0000 7f44bd573640 1 -- 172.21.15.45:0/3162297757 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44b80cf7c0 msgr2=0x7f44b80b5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:38.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.863+0000 7f44bd573640 1 --2- 172.21.15.45:0/3162297757 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44b80cf7c0 0x7f44b80b5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:38.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.863+0000 7f44bd573640 1 -- 172.21.15.45:0/3162297757 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44b80b35f0 msgr2=0x7f44b8159930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:38.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.863+0000 7f44bd573640 1 --2- 172.21.15.45:0/3162297757 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44b80b35f0 0x7f44b8159930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:38.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.863+0000 7f44bd573640 1 -- 172.21.15.45:0/3162297757 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b4009420 con 0x7f44b80b3cb0 2023-11-28T18:37:38.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.863+0000 7f44be575640 1 --2- 172.21.15.45:0/3162297757 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44b80cf7c0 0x7f44b80b5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:37:38.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.863+0000 7f44bd573640 1 --2- 172.21.15.45:0/3162297757 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44b80b3cb0 0x7f44b80b5800 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f44a800e810 tx=0x7f44a800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:38.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.863+0000 7f44ae7fc640 1 -- 172.21.15.45:0/3162297757 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a800c8d0 con 0x7f44b80b3cb0 2023-11-28T18:37:38.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.863+0000 7f44ae7fc640 1 -- 172.21.15.45:0/3162297757 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44a800ca30 con 0x7f44b80b3cb0 2023-11-28T18:37:38.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.863+0000 7f44bffd8640 1 -- 172.21.15.45:0/3162297757 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44b80d0160 con 0x7f44b80b3cb0 2023-11-28T18:37:38.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.863+0000 7f44ae7fc640 1 -- 172.21.15.45:0/3162297757 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a800cdc0 con 0x7f44b80b3cb0 2023-11-28T18:37:38.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.863+0000 7f44bffd8640 1 -- 172.21.15.45:0/3162297757 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44b815aed0 con 0x7f44b80b3cb0 2023-11-28T18:37:38.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.863+0000 7f44bffd8640 1 -- 172.21.15.45:0/3162297757 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44b8069480 con 0x7f44b80b3cb0 2023-11-28T18:37:38.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.863+0000 7f44ae7fc640 1 -- 172.21.15.45:0/3162297757 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f44a8013410 con 0x7f44b80b3cb0 2023-11-28T18:37:38.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.867+0000 7f44ae7fc640 1 --2- 172.21.15.45:0/3162297757 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f449c066900 0x7f449c068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:38.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.867+0000 7f44ae7fc640 1 -- 172.21.15.45:0/3162297757 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f44a8084270 con 0x7f44b80b3cb0 2023-11-28T18:37:38.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.867+0000 7f44bdd74640 1 --2- 172.21.15.45:0/3162297757 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f449c066900 0x7f449c068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:38.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.867+0000 7f44bdd74640 1 --2- 172.21.15.45:0/3162297757 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f449c066900 0x7f449c068dc0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f44b40af000 tx=0x7f44b40a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:38.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:38.871+0000 7f44ae7fc640 1 -- 172.21.15.45:0/3162297757 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f44a80514c0 con 0x7f44b80b3cb0 2023-11-28T18:37:39.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.031+0000 7f44bffd8640 1 -- 172.21.15.45:0/3162297757 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f44b80cf4a0 con 0x7f44b80b3cb0 2023-11-28T18:37:39.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.031+0000 7f44ae7fc640 1 -- 172.21.15.45:0/3162297757 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16469 (secure 0 0 0) 0x7f44a8009480 con 0x7f44b80b3cb0 2023-11-28T18:37:39.036 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:37:39.037 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":20,"fsid":"d10f5cd6-1d00-4019-99b6-6fa435498a15","created":"2023-11-28T18:37:08.189030+0000","modified":"2023-11-28T18:37:33.971141+0000","last_up_change":"2023-11-28T18:37:20.196124+0000","last_in_change":"2023-11-28T18:37:10.742043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T18:37:21.293917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T18:37:31.384760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T18:37:31.834769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"84465384-103c-4f2c-a45a-96f5bb9c835f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6809","nonce":555237322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6811","nonce":555237322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6815","nonce":555237322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6813","nonce":555237322}]},"public_addr":"172.21.15.45:6809/555237322","cluster_addr":"172.21.15.45:6811/555237322","heartbeat_back_addr":"172.21.15.45:6815/555237322","heartbeat_front_addr":"172.21.15.45:6813/555237322","state":["exists","up"]},{"osd":1,"uuid":"7d9eed24-a58f-42c7-a787-ac06be8553fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6801","nonce":2857063763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6803","nonce":2857063763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6807","nonce":2857063763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6805","nonce":2857063763}]},"public_addr":"172.21.15.45:6801/2857063763","cluster_addr":"172.21.15.45:6803/2857063763","heartbeat_back_addr":"172.21.15.45:6807/2857063763","heartbeat_front_addr":"172.21.15.45:6805/2857063763","state":["exists","up"]},{"osd":2,"uuid":"575eeccc-4abf-45b4-9caf-f3e797859588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6817","nonce":193884539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6819","nonce":193884539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6823","nonce":193884539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6821","nonce":193884539}]},"public_addr":"172.21.15.45:6817/193884539","cluster_addr":"172.21.15.45:6819/193884539","heartbeat_back_addr":"172.21.15.45:6823/193884539","heartbeat_front_addr":"172.21.15.45:6821/193884539","state":["exists","up"]},{"osd":3,"uuid":"9b0290d6-9a52-4bc8-b2a1-7622c5dc8e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6825","nonce":78541084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6827","nonce":78541084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6831","nonce":78541084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6829","nonce":78541084}]},"public_addr":"172.21.15.45:6825/78541084","cluster_addr":"172.21.15.45:6827/78541084","heartbeat_back_addr":"172.21.15.45:6831/78541084","heartbeat_front_addr":"172.21.15.45:6829/78541084","state":["exists","up"]},{"osd":4,"uuid":"ce632829-f027-4fbf-a627-02c571aa9d53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6809","nonce":1537591987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6811","nonce":1537591987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6815","nonce":1537591987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6813","nonce":1537591987}]},"public_addr":"172.21.15.190:6809/1537591987","cluster_addr":"172.21.15.190:6811/1537591987","heartbeat_back_addr":"172.21.15.190:6815/1537591987","heartbeat_front_addr":"172.21.15.190:6813/1537591987","state":["exists","up"]},{"osd":5,"uuid":"8700b609-27be-40bd-a251-4c0ae0a29ead","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6801","nonce":3296698407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6803","nonce":3296698407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6807","nonce":3296698407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6805","nonce":3296698407}]},"public_addr":"172.21.15.190:6801/3296698407","cluster_addr":"172.21.15.190:6803/3296698407","heartbeat_back_addr":"172.21.15.190:6807/3296698407","heartbeat_front_addr":"172.21.15.190:6805/3296698407","state":["exists","up"]},{"osd":6,"uuid":"44ce4a40-e6ff-4f4d-8e8a-7341e5c91f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6817","nonce":2317686718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6819","nonce":2317686718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6823","nonce":2317686718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6821","nonce":2317686718}]},"public_addr":"172.21.15.190:6817/2317686718","cluster_addr":"172.21.15.190:6819/2317686718","heartbeat_back_addr":"172.21.15.190:6823/2317686718","heartbeat_front_addr":"172.21.15.190:6821/2317686718","state":["exists","up"]},{"osd":7,"uuid":"192238c9-1423-4b7e-ac8f-84ba32113ddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6825","nonce":2493232051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6827","nonce":2493232051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6831","nonce":2493232051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6829","nonce":2493232051}]},"public_addr":"172.21.15.190:6825/2493232051","cluster_addr":"172.21.15.190:6827/2493232051","heartbeat_back_addr":"172.21.15.190:6831/2493232051","heartbeat_front_addr":"172.21.15.190:6829/2493232051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.393552+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.385453+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.361421+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.366408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.363226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.276007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.414605+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.445885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T18:37:39.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.035+0000 7f44bffd8640 1 -- 172.21.15.45:0/3162297757 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f449c066900 msgr2=0x7f449c068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.035+0000 7f44bffd8640 1 --2- 172.21.15.45:0/3162297757 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f449c066900 0x7f449c068dc0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f44b40af000 tx=0x7f44b40a7000 comp rx=0 tx=0).stop 2023-11-28T18:37:39.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.035+0000 7f44bffd8640 1 -- 172.21.15.45:0/3162297757 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44b80b3cb0 msgr2=0x7f44b80b5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.035+0000 7f44bffd8640 1 --2- 172.21.15.45:0/3162297757 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44b80b3cb0 0x7f44b80b5800 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f44a800e810 tx=0x7f44a800ecd0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.035+0000 7f44bffd8640 1 -- 172.21.15.45:0/3162297757 shutdown_connections 2023-11-28T18:37:39.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.035+0000 7f44bffd8640 1 --2- 172.21.15.45:0/3162297757 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f449c066900 0x7f449c068dc0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.035+0000 7f44bffd8640 1 --2- 172.21.15.45:0/3162297757 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44b80cf7c0 0x7f44b80b5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.035+0000 7f44bffd8640 1 --2- 172.21.15.45:0/3162297757 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44b80b3cb0 0x7f44b80b5800 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.035+0000 7f44bffd8640 1 --2- 172.21.15.45:0/3162297757 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44b80b35f0 0x7f44b8159930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.035+0000 7f44bffd8640 1 -- 172.21.15.45:0/3162297757 >> 172.21.15.45:0/3162297757 conn(0x7f44b809c4f0 msgr2=0x7f44b80d1790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:39.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.035+0000 7f44bffd8640 1 -- 172.21.15.45:0/3162297757 shutdown_connections 2023-11-28T18:37:39.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.035+0000 7f44bffd8640 1 -- 172.21.15.45:0/3162297757 wait complete. 2023-11-28T18:37:39.059 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-11-28T18:37:39.059 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-11-28T18:37:39.060 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-11-28T18:37:39.060 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-11-28T18:37:39.061 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-11-28T18:37:39.061 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-11-28T18:37:39.062 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-11-28T18:37:39.062 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-11-28T18:37:39.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.307+0000 7f6ae759e640 1 Processor -- start 2023-11-28T18:37:39.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.307+0000 7f6ae759e640 1 -- start start 2023-11-28T18:37:39.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.307+0000 7f7c274fe640 1 Processor -- start 2023-11-28T18:37:39.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.307+0000 7f7c274fe640 1 -- start start 2023-11-28T18:37:39.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.307+0000 7f6ae759e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f6ae80cf290 0x7f6ae80ce0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.307+0000 7f6ae759e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ae815d220 0x7f6ae8160ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.307+0000 7f6ae759e640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ae80ce6a0 con 0x7f6ae815ce40 2023-11-28T18:37:39.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.307+0000 7f6ae759e640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ae8070a70 con 0x7f6ae80cf290 2023-11-28T18:37:39.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.307+0000 7f6ae759e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae80b3390 con 0x7f6ae815d220 2023-11-28T18:37:39.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.307+0000 7f6ae659c640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f6ae815ce40 0x7f6ae80ceb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.45:59216/0 (socket says 172.21.15.45:59216) 2023-11-28T18:37:39.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.311+0000 7f6ae659c640 1 -- 172.21.15.45:0/2143394696 learned_addr learned my addr 172.21.15.45:0/2143394696 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:37:39.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.311+0000 7f6ae5d9b640 1 --2- 172.21.15.45:0/2143394696 >> v2:172.21.15.190:3300/0 conn(0x7f6ae80cf290 0x7f6ae80ce0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.311+0000 7f6ae6d9d640 1 --2- 172.21.15.45:0/2143394696 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ae815d220 0x7f6ae8160ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.307+0000 7fe057fff640 1 Processor -- start 2023-11-28T18:37:39.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.311+0000 7fe057fff640 1 -- start start 2023-11-28T18:37:39.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.311+0000 7f7c274fe640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f7c2015bcd0 0x7f7c2006c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.311+0000 7f7c274fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7c2015c0b0 0x7f7c2006c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.311+0000 7f7c274fe640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c20146000 con 0x7f7c20145290 2023-11-28T18:37:39.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.311+0000 7f7c274fe640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c201462e0 con 0x7f7c2015c0b0 2023-11-28T18:37:39.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.311+0000 7f7c274fe640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c201465c0 con 0x7f7c2015bcd0 2023-11-28T18:37:39.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.311+0000 7f6ae5d9b640 1 -- 172.21.15.45:0/2143394696 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ae815d220 msgr2=0x7f6ae8160ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:39.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.311+0000 7f6ae5d9b640 1 --2- 172.21.15.45:0/2143394696 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ae815d220 0x7f6ae8160ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.311+0000 7f6ae5d9b640 1 -- 172.21.15.45:0/2143394696 >> v1:172.21.15.190:6789/0 conn(0x7f6ae815ce40 legacy=0x7f6ae80ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.311+0000 7f6ae5d9b640 1 -- 172.21.15.45:0/2143394696 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae80b3670 con 0x7f6ae80cf290 2023-11-28T18:37:39.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.311+0000 7f7c2529a640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f7c2015bcd0 0x7f7c2006c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.311+0000 7f7c2529a640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f7c2015bcd0 0x7f7c2006c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.45:42058/0 (socket says 172.21.15.45:42058) 2023-11-28T18:37:39.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.311+0000 7f7c24a99640 1 --2- 172.21.15.45:0/2792032859 >> v2:172.21.15.45:3300/0 conn(0x7f7c2015c0b0 0x7f7c2006c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.311+0000 7f7c2529a640 1 -- 172.21.15.45:0/2792032859 learned_addr learned my addr 172.21.15.45:0/2792032859 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:39.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.311+0000 7f7c25a9b640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f7c20145290 0x7f7c20145740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.45:59228/0 (socket says 172.21.15.45:59228) 2023-11-28T18:37:39.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.311+0000 7fe057fff640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe05815d450 0x7fe0580d0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.311+0000 7fe057fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe0580cff60 0x7fe0580b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.311+0000 7fe056ffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe05815d450 0x7fe0580d0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.311+0000 7f7c2529a640 1 -- 172.21.15.45:0/2792032859 >> v2:172.21.15.45:3300/0 conn(0x7f7c2015c0b0 msgr2=0x7f7c2006c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:39.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.311+0000 7fe056ffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe05815d450 0x7fe0580d0d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.45:42064/0 (socket says 172.21.15.45:42064) 2023-11-28T18:37:39.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.311+0000 7fe056ffd640 1 -- 172.21.15.45:0/2280386803 learned_addr learned my addr 172.21.15.45:0/2280386803 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:39.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.311+0000 7f7c17fff640 1 -- 172.21.15.45:0/2792032859 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3617509234 0 0) 0x7f7c20146000 con 0x7f7c20145290 2023-11-28T18:37:39.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.311+0000 7fe057fff640 1 -- 172.21.15.45:0/2280386803 --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0580ced20 con 0x7fe0580d3a40 2023-11-28T18:37:39.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.311+0000 7fe057fff640 1 -- 172.21.15.45:0/2280386803 --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0580d1370 con 0x7fe0580cff60 2023-11-28T18:37:39.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.311+0000 7fe057fff640 1 -- 172.21.15.45:0/2280386803 --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0580cf580 con 0x7fe05815d450 2023-11-28T18:37:39.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.311+0000 7f7c2529a640 1 --2- 172.21.15.45:0/2792032859 >> v2:172.21.15.45:3300/0 conn(0x7f7c2015c0b0 0x7f7c2006c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.311+0000 7f7c2529a640 1 -- 172.21.15.45:0/2792032859 >> v1:172.21.15.190:6789/0 conn(0x7f7c20145290 legacy=0x7f7c20145740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.311+0000 7f7c2529a640 1 -- 172.21.15.45:0/2792032859 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c201468a0 con 0x7f7c2015bcd0 2023-11-28T18:37:39.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.311+0000 7fe056ffd640 1 -- 172.21.15.45:0/2280386803 >> v2:172.21.15.45:3300/0 conn(0x7fe0580cff60 msgr2=0x7fe0580b2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:39.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.311+0000 7fe056ffd640 1 --2- 172.21.15.45:0/2280386803 >> v2:172.21.15.45:3300/0 conn(0x7fe0580cff60 0x7fe0580b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.311+0000 7fe056ffd640 1 -- 172.21.15.45:0/2280386803 >> v1:172.21.15.45:6789/0 conn(0x7fe0580d3a40 legacy=0x7fe0580cf850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:39.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.311+0000 7fe056ffd640 1 -- 172.21.15.45:0/2280386803 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe05815d830 con 0x7fe05815d450 2023-11-28T18:37:39.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.315+0000 7f7c24a99640 1 --2- 172.21.15.45:0/2792032859 >> v2:172.21.15.45:3300/0 conn(0x7f7c2015c0b0 0x7f7c2006c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:37:39.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.315+0000 7f6ae5d9b640 1 --2- 172.21.15.45:0/2143394696 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ae80cf290 0x7f6ae80ce0c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6adc0097c0 tx=0x7f6adc01c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3785117f24a84d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:39.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.315+0000 7f7c2529a640 1 --2- 172.21.15.45:0/2792032859 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7c2015bcd0 0x7f7c2006c300 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7c10009870 tx=0x7f7c1001c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67d901f210bce45 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:39.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.315+0000 7f6ae559a640 1 -- 172.21.15.45:0/2143394696 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6adc0ac640 con 0x7f6ae80cf290 2023-11-28T18:37:39.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.315+0000 7f6ae559a640 1 -- 172.21.15.45:0/2143394696 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6adc0ac7a0 con 0x7f6ae80cf290 2023-11-28T18:37:39.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.315+0000 7f6ae559a640 1 -- 172.21.15.45:0/2143394696 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6adc0acb30 con 0x7f6ae80cf290 2023-11-28T18:37:39.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.315+0000 7f7c17fff640 1 -- 172.21.15.45:0/2792032859 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c100ad680 con 0x7f7c2015bcd0 2023-11-28T18:37:39.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.315+0000 7f7c17fff640 1 -- 172.21.15.45:0/2792032859 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c100ad7e0 con 0x7f7c2015bcd0 2023-11-28T18:37:39.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.315+0000 7f7c17fff640 1 -- 172.21.15.45:0/2792032859 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c100adb70 con 0x7f7c2015bcd0 2023-11-28T18:37:39.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.319+0000 7fe056ffd640 1 --2- 172.21.15.45:0/2280386803 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe05815d450 0x7fe0580d0d00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe05806aae0 tx=0x7fe04c01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d3893c9e5fb7604 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:39.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.319+0000 7f6ae759e640 1 -- 172.21.15.45:0/2143394696 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ae80cf290 msgr2=0x7f6ae80ce0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.319+0000 7f6ae759e640 1 --2- 172.21.15.45:0/2143394696 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ae80cf290 0x7f6ae80ce0c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6adc0097c0 tx=0x7f6adc01c470 comp rx=0 tx=0).stop 2023-11-28T18:37:39.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.319+0000 7fe055ffb640 1 -- 172.21.15.45:0/2280386803 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04c0a6040 con 0x7fe05815d450 2023-11-28T18:37:39.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.319+0000 7f7c274fe640 1 -- 172.21.15.45:0/2792032859 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7c2015bcd0 msgr2=0x7f7c2006c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.319+0000 7f7c274fe640 1 --2- 172.21.15.45:0/2792032859 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7c2015bcd0 0x7f7c2006c300 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7c10009870 tx=0x7f7c1001c490 comp rx=0 tx=0).stop 2023-11-28T18:37:39.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.319+0000 7f7c274fe640 1 -- 172.21.15.45:0/2792032859 shutdown_connections 2023-11-28T18:37:39.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.319+0000 7f6ae759e640 1 -- 172.21.15.45:0/2143394696 shutdown_connections 2023-11-28T18:37:39.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.319+0000 7f6ae759e640 1 --2- 172.21.15.45:0/2143394696 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ae815d220 0x7f6ae8160ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.319+0000 7f6ae759e640 1 --2- 172.21.15.45:0/2143394696 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ae80cf290 0x7f6ae80ce0c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.319+0000 7f6ae759e640 1 -- 172.21.15.45:0/2143394696 >> 172.21.15.45:0/2143394696 conn(0x7f6ae80b0960 msgr2=0x7f6ae80b0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:39.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.319+0000 7fe055ffb640 1 -- 172.21.15.45:0/2280386803 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe04c0aa600 con 0x7fe05815d450 2023-11-28T18:37:39.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.319+0000 7fe055ffb640 1 -- 172.21.15.45:0/2280386803 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04c0aa990 con 0x7fe05815d450 2023-11-28T18:37:39.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.319+0000 7f6ae759e640 1 -- 172.21.15.45:0/2143394696 shutdown_connections 2023-11-28T18:37:39.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.319+0000 7f7c274fe640 1 --2- 172.21.15.45:0/2792032859 >> v2:172.21.15.45:3300/0 conn(0x7f7c2015c0b0 0x7f7c2006c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.319+0000 7f7c274fe640 1 --2- 172.21.15.45:0/2792032859 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7c2015bcd0 0x7f7c2006c300 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.319+0000 7f7c274fe640 1 -- 172.21.15.45:0/2792032859 >> 172.21.15.45:0/2792032859 conn(0x7f7c2006a570 msgr2=0x7f7c2006a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:39.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.319+0000 7fe057fff640 1 -- 172.21.15.45:0/2280386803 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe05815d450 msgr2=0x7fe0580d0d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.319+0000 7f6ae759e640 1 -- 172.21.15.45:0/2143394696 wait complete. 2023-11-28T18:37:39.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.319+0000 7fe057fff640 1 --2- 172.21.15.45:0/2280386803 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe05815d450 0x7fe0580d0d00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe05806aae0 tx=0x7fe04c01c4a0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.319+0000 7fe057fff640 1 -- 172.21.15.45:0/2280386803 shutdown_connections 2023-11-28T18:37:39.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.319+0000 7fe057fff640 1 --2- 172.21.15.45:0/2280386803 >> v2:172.21.15.45:3300/0 conn(0x7fe0580cff60 0x7fe0580b2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.319+0000 7fe057fff640 1 --2- 172.21.15.45:0/2280386803 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe05815d450 0x7fe0580d0d00 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.319+0000 7fe057fff640 1 -- 172.21.15.45:0/2280386803 >> 172.21.15.45:0/2280386803 conn(0x7fe0580d2f20 msgr2=0x7fe0580d3330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:39.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.319+0000 7fe057fff640 1 -- 172.21.15.45:0/2280386803 shutdown_connections 2023-11-28T18:37:39.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.319+0000 7f7c274fe640 1 -- 172.21.15.45:0/2792032859 shutdown_connections 2023-11-28T18:37:39.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.319+0000 7f6bee217640 1 Processor -- start 2023-11-28T18:37:39.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.319+0000 7f6bee217640 1 -- start start 2023-11-28T18:37:39.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.319+0000 7fe057fff640 1 -- 172.21.15.45:0/2280386803 wait complete. 2023-11-28T18:37:39.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.323+0000 7fda23c79640 1 Processor -- start 2023-11-28T18:37:39.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.323+0000 7f6ae759e640 1 Processor -- start 2023-11-28T18:37:39.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.323+0000 7fda23c79640 1 -- start start 2023-11-28T18:37:39.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.323+0000 7f6ae759e640 1 -- start start 2023-11-28T18:37:39.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.319+0000 7f7c274fe640 1 -- 172.21.15.45:0/2792032859 wait complete. 2023-11-28T18:37:39.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.323+0000 7f7c274fe640 1 Processor -- start 2023-11-28T18:37:39.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.323+0000 7f6bee217640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f6be8071980 0x7f6be815e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.323+0000 7f6bee217640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6be8071d60 0x7f6be80b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.323+0000 7f7c274fe640 1 -- start start 2023-11-28T18:37:39.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.323+0000 7fe057fff640 1 Processor -- start 2023-11-28T18:37:39.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.323+0000 7f6bee217640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6be80b3810 0x7f6be80b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.323+0000 7f6bee217640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6be815e7c0 con 0x7f6be8071d60 2023-11-28T18:37:39.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.323+0000 7f6ae759e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ae80cf290 0x7f6ae815e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.323+0000 7f6be77fe640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f6be8071980 0x7f6be815e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.323+0000 7fe057fff640 1 -- start start 2023-11-28T18:37:39.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.323+0000 7f6be77fe640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f6be8071980 0x7f6be815e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.45:42080/0 (socket says 172.21.15.45:42080) 2023-11-28T18:37:39.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.323+0000 7f6be77fe640 1 -- 172.21.15.45:0/2041283416 learned_addr learned my addr 172.21.15.45:0/2041283416 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:39.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.323+0000 7f6ae759e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ae815ce40 0x7f6ae814c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.323+0000 7fda23c79640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda1c1594d0 0x7fda1c0cb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.323+0000 7f6ae759e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ae815d220 0x7f6ae814c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.323+0000 7f6bee217640 1 -- 172.21.15.45:0/2041283416 --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6be80708f0 con 0x7f6be8071980 2023-11-28T18:37:39.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.323+0000 7f6ae659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ae80cf290 0x7f6ae815e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.323+0000 7f6ae759e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae80acc70 con 0x7f6ae80cf290 2023-11-28T18:37:39.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.323+0000 7f6ae759e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae814d2b0 con 0x7f6ae815d220 2023-11-28T18:37:39.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.323+0000 7f6ae759e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae814d590 con 0x7f6ae815ce40 2023-11-28T18:37:39.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.323+0000 7f6bee217640 1 -- 172.21.15.45:0/2041283416 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6be8070bd0 con 0x7f6be80b3810 2023-11-28T18:37:39.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.323+0000 7fda23c79640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fda1c15d1d0 0x7fda1c15d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.323+0000 7f6ae5d9b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ae815ce40 0x7f6ae814c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.323+0000 7f6ae659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ae80cf290 0x7f6ae815e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57090/0 (socket says 172.21.15.45:57090) 2023-11-28T18:37:39.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.323+0000 7f6ae659c640 1 -- 172.21.15.45:0/1182290149 learned_addr learned my addr 172.21.15.45:0/1182290149 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:39.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.323+0000 7f6ae6d9d640 1 --2- 172.21.15.45:0/1182290149 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ae815d220 0x7f6ae814c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.323+0000 7f6be6ffd640 1 --2- 172.21.15.45:0/2041283416 >> v2:172.21.15.45:3300/0 conn(0x7f6be8071d60 0x7f6be80b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.323+0000 7fda23c79640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda1c0ce880 con 0x7fda1c15cdf0 2023-11-28T18:37:39.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.323+0000 7fda22216640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fda1c15d1d0 0x7fda1c15d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7fda22216640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fda1c15d1d0 0x7fda1c15d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.45:42092/0 (socket says 172.21.15.45:42092) 2023-11-28T18:37:39.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7fda22216640 1 -- 172.21.15.45:0/116020862 learned_addr learned my addr 172.21.15.45:0/116020862 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:39.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7fda23c79640 1 -- 172.21.15.45:0/116020862 --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda1c0ce5a0 con 0x7fda1c15d1d0 2023-11-28T18:37:39.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7fda23c79640 1 -- 172.21.15.45:0/116020862 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda1c070fc0 con 0x7fda1c1594d0 2023-11-28T18:37:39.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7fe057fff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe0580cff60 0x7fe0580b5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7fe057fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0580d3a40 0x7fe0580c6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7f7c274fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7c20145290 0x7f7c2015ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7f6ae5d9b640 1 -- 172.21.15.45:0/1182290149 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ae815d220 msgr2=0x7f6ae814c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7f6ae5d9b640 1 --2- 172.21.15.45:0/1182290149 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ae815d220 0x7f6ae814c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7f6ae5d9b640 1 -- 172.21.15.45:0/1182290149 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ae80cf290 msgr2=0x7f6ae815e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7f6ae5d9b640 1 --2- 172.21.15.45:0/1182290149 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ae80cf290 0x7f6ae815e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7f6ae5d9b640 1 -- 172.21.15.45:0/1182290149 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6adc009420 con 0x7f6ae815ce40 2023-11-28T18:37:39.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7f6ae6d9d640 1 --2- 172.21.15.45:0/1182290149 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ae815d220 0x7f6ae814c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:37:39.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7fe057fff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe05815d450 0x7fe058153ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7fe056ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe0580cff60 0x7fe0580b5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.323+0000 7f6be7fff640 1 --2- 172.21.15.45:0/2041283416 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6be80b3810 0x7f6be80b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7f7c2529a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7c20145290 0x7f7c2015ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7f7c2529a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7c20145290 0x7f7c2015ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.45:42094/0 (socket says 172.21.15.45:42094) 2023-11-28T18:37:39.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7f7c2529a640 1 -- 172.21.15.45:0/977381826 learned_addr learned my addr 172.21.15.45:0/977381826 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:39.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7fe056ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe0580cff60 0x7fe0580b5aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.45:60104/0 (socket says 172.21.15.45:60104) 2023-11-28T18:37:39.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7fda21214640 1 --2- 172.21.15.45:0/116020862 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda1c1594d0 0x7fda1c0cb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7f7c274fe640 1 --2- 172.21.15.45:0/977381826 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c2015bcd0 0x7f7c2015c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7f6be77fe640 1 -- 172.21.15.45:0/2041283416 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6be80b3810 msgr2=0x7f6be80b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:39.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7f6be77fe640 1 --2- 172.21.15.45:0/2041283416 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6be80b3810 0x7f6be80b3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7f6be77fe640 1 -- 172.21.15.45:0/2041283416 >> v2:172.21.15.45:3300/0 conn(0x7f6be8071d60 msgr2=0x7f6be80b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:39.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7f6be77fe640 1 --2- 172.21.15.45:0/2041283416 >> v2:172.21.15.45:3300/0 conn(0x7f6be8071d60 0x7f6be80b32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7f6be77fe640 1 -- 172.21.15.45:0/2041283416 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be8070eb0 con 0x7f6be8071980 2023-11-28T18:37:39.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7fe056ffd640 1 -- 172.21.15.45:0/869814524 learned_addr learned my addr 172.21.15.45:0/869814524 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:39.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7fe057fff640 1 -- 172.21.15.45:0/869814524 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0581560a0 con 0x7fe0580d3a40 2023-11-28T18:37:39.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7fe057fff640 1 -- 172.21.15.45:0/869814524 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0580c67a0 con 0x7fe05815d450 2023-11-28T18:37:39.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7fe057fff640 1 -- 172.21.15.45:0/869814524 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe05815dda0 con 0x7fe0580cff60 2023-11-28T18:37:39.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7f7c274fe640 1 --2- 172.21.15.45:0/977381826 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7c2015c0b0 0x7f7c2015cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7fda20a13640 1 -- 172.21.15.45:0/116020862 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3989251961 0 0) 0x7fda1c0ce880 con 0x7fda1c15cdf0 2023-11-28T18:37:39.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7fda20a13640 1 -- 172.21.15.45:0/116020862 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda08003530 con 0x7fda1c15cdf0 2023-11-28T18:37:39.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7f7c274fe640 1 -- 172.21.15.45:0/977381826 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c201608b0 con 0x7f7c2015bcd0 2023-11-28T18:37:39.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7f7c274fe640 1 -- 172.21.15.45:0/977381826 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2015b060 con 0x7f7c20145290 2023-11-28T18:37:39.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7faaa70fe640 1 Processor -- start 2023-11-28T18:37:39.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7f6ae5d9b640 1 --2- 172.21.15.45:0/1182290149 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ae815ce40 0x7f6ae814c110 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6adc0ac000 tx=0x7f6adc019210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:39.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7fe0577fe640 1 --2- 172.21.15.45:0/869814524 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe05815d450 0x7fe058153ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7fe0567fc640 1 --2- 172.21.15.45:0/869814524 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0580d3a40 0x7fe0580c6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7f7c274fe640 1 -- 172.21.15.45:0/977381826 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c20160ec0 con 0x7f7c2015c0b0 2023-11-28T18:37:39.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7f7c25a9b640 1 --2- 172.21.15.45:0/977381826 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7c2015c0b0 0x7f7c2015cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7f6ad6ffd640 1 -- 172.21.15.45:0/1182290149 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6adc0b5600 con 0x7f6ae815ce40 2023-11-28T18:37:39.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7f6ad6ffd640 1 -- 172.21.15.45:0/1182290149 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6adc0b5780 con 0x7f6ae815ce40 2023-11-28T18:37:39.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7f6ad6ffd640 1 -- 172.21.15.45:0/1182290149 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6adc0b5b30 con 0x7f6ae815ce40 2023-11-28T18:37:39.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7f6ae759e640 1 -- 172.21.15.45:0/1182290149 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ae814d870 con 0x7f6ae815ce40 2023-11-28T18:37:39.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7f6ae759e640 1 -- 172.21.15.45:0/1182290149 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ae814c650 con 0x7f6ae815ce40 2023-11-28T18:37:39.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7fe056ffd640 1 -- 172.21.15.45:0/869814524 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe05815d450 msgr2=0x7fe058153ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7fe056ffd640 1 --2- 172.21.15.45:0/869814524 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe05815d450 0x7fe058153ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7fe056ffd640 1 -- 172.21.15.45:0/869814524 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0580d3a40 msgr2=0x7fe0580c6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7fe056ffd640 1 --2- 172.21.15.45:0/869814524 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0580d3a40 0x7fe0580c6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7fe056ffd640 1 -- 172.21.15.45:0/869814524 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe04c0094d0 con 0x7fe0580cff60 2023-11-28T18:37:39.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7fe0567fc640 1 --2- 172.21.15.45:0/869814524 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0580d3a40 0x7fe0580c6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:37:39.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7fe0577fe640 1 --2- 172.21.15.45:0/869814524 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe05815d450 0x7fe058153ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:37:39.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7fe056ffd640 1 --2- 172.21.15.45:0/869814524 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe0580cff60 0x7fe0580b5aa0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe04c01a0d0 tx=0x7fe04c01ace0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:39.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7f7c24a99640 1 --2- 172.21.15.45:0/977381826 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c2015bcd0 0x7f7c2015c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7f7c2529a640 1 -- 172.21.15.45:0/977381826 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7c2015c0b0 msgr2=0x7f7c2015cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7f7c2529a640 1 --2- 172.21.15.45:0/977381826 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7c2015c0b0 0x7f7c2015cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7f7c2529a640 1 -- 172.21.15.45:0/977381826 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c2015bcd0 msgr2=0x7f7c2015c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7f7c2529a640 1 --2- 172.21.15.45:0/977381826 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c2015bcd0 0x7f7c2015c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7f7c2529a640 1 -- 172.21.15.45:0/977381826 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c1c009420 con 0x7f7c20145290 2023-11-28T18:37:39.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7f7c2529a640 1 --2- 172.21.15.45:0/977381826 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7c20145290 0x7f7c2015ab20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7c100190a0 tx=0x7f7c1001acd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:39.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7f7c15ffb640 1 -- 172.21.15.45:0/977381826 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c100b8420 con 0x7f7c20145290 2023-11-28T18:37:39.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7f7c15ffb640 1 -- 172.21.15.45:0/977381826 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c100b85a0 con 0x7f7c20145290 2023-11-28T18:37:39.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7f7c15ffb640 1 -- 172.21.15.45:0/977381826 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c100b8950 con 0x7f7c20145290 2023-11-28T18:37:39.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7fda20a13640 1 -- 172.21.15.45:0/116020862 <== mon.1 v1:172.21.15.190:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1257155871 0 0) 0x7fda08003530 con 0x7fda1c15cdf0 2023-11-28T18:37:39.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7fda22216640 1 -- 172.21.15.45:0/116020862 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda1c1594d0 msgr2=0x7fda1c0cb6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:39.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7fda22216640 1 --2- 172.21.15.45:0/116020862 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda1c1594d0 0x7fda1c0cb6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7fda22216640 1 -- 172.21.15.45:0/116020862 >> v1:172.21.15.190:6789/0 conn(0x7fda1c15cdf0 legacy=0x7fda1c0b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7faaa70fe640 1 -- start start 2023-11-28T18:37:39.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7fe03ffff640 1 -- 172.21.15.45:0/869814524 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04c0b3800 con 0x7fe0580cff60 2023-11-28T18:37:39.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7fe03ffff640 1 -- 172.21.15.45:0/869814524 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe04c0b3960 con 0x7fe0580cff60 2023-11-28T18:37:39.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7fe03ffff640 1 -- 172.21.15.45:0/869814524 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04c0b3cd0 con 0x7fe0580cff60 2023-11-28T18:37:39.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7fe057fff640 1 -- 172.21.15.45:0/869814524 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0581562f0 con 0x7fe0580cff60 2023-11-28T18:37:39.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7fe057fff640 1 -- 172.21.15.45:0/869814524 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0581568b0 con 0x7fe0580cff60 2023-11-28T18:37:39.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.331+0000 7f7c274fe640 1 -- 172.21.15.45:0/977381826 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c100094d0 con 0x7f7c20145290 2023-11-28T18:37:39.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.327+0000 7fda22216640 1 -- 172.21.15.45:0/116020862 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda1c0712a0 con 0x7fda1c15d1d0 2023-11-28T18:37:39.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.331+0000 7f7c274fe640 1 -- 172.21.15.45:0/977381826 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c201604d0 con 0x7f7c20145290 2023-11-28T18:37:39.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.331+0000 7f6ad4ff9640 1 -- 172.21.15.45:0/1182290149 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6ac0000fd0 con 0x7f6ae815ce40 2023-11-28T18:37:39.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.331+0000 7ff92b757640 1 Processor -- start 2023-11-28T18:37:39.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.331+0000 7ff92b757640 1 -- start start 2023-11-28T18:37:39.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.331+0000 7f7c274fe640 1 -- 172.21.15.45:0/977381826 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7c20069480 con 0x7f7c20145290 2023-11-28T18:37:39.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.331+0000 7f6ad6ffd640 1 -- 172.21.15.45:0/1182290149 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f6adc0b3040 con 0x7f6ae815ce40 2023-11-28T18:37:39.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.331+0000 7fe057fff640 1 -- 172.21.15.45:0/869814524 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe0580b2a00 con 0x7fe0580cff60 2023-11-28T18:37:39.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.331+0000 7fda21214640 1 --2- 172.21.15.45:0/116020862 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda1c1594d0 0x7fda1c0cb6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:37:39.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.331+0000 7faaa4e9a640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7faaa015cdf0 0x7faaa00b2000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.45:59246/0 (socket says 172.21.15.45:59246) 2023-11-28T18:37:39.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.331+0000 7faaa4e9a640 1 -- 172.21.15.45:0/3556199316 learned_addr learned my addr 172.21.15.45:0/3556199316 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:37:39.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.331+0000 7faaa70fe640 1 --2- 172.21.15.45:0/3556199316 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faaa00cb6d0 0x7faaa015d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.331+0000 7fe03ffff640 1 -- 172.21.15.45:0/869814524 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe04c0c6430 con 0x7fe0580cff60 2023-11-28T18:37:39.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7faaa569b640 1 --2- 172.21.15.45:0/3556199316 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faaa00cb6d0 0x7faaa015d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7f7c15ffb640 1 -- 172.21.15.45:0/977381826 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f7c100b4040 con 0x7f7c20145290 2023-11-28T18:37:39.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7fda22216640 1 --2- 172.21.15.45:0/116020862 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda1c15d1d0 0x7fda1c15d630 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fda0c009870 tx=0x7fda0c01c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5c73c411f700926 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:39.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7faaa70fe640 1 -- 172.21.15.45:0/3556199316 --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaa00ce880 con 0x7faaa01594d0 2023-11-28T18:37:39.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7faaa70fe640 1 -- 172.21.15.45:0/3556199316 --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaa00ce5a0 con 0x7faaa015cdf0 2023-11-28T18:37:39.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7ff92b757640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9240b35f0 0x7ff9240d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7ff92b757640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff9240cfed0 0x7ff92415f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7ff92b757640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9240d38c0 con 0x7ff9240b3cb0 2023-11-28T18:37:39.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7ff92b757640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9240d40d0 con 0x7ff9240cfed0 2023-11-28T18:37:39.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7ff92b757640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9240cdcc0 con 0x7ff9240b35f0 2023-11-28T18:37:39.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.331+0000 7f6be77fe640 1 --2- 172.21.15.45:0/2041283416 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6be8071980 0x7f6be815e280 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6be806c070 tx=0x7f6bd801c440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e7a679cd268a17b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:39.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7faaa70fe640 1 -- 172.21.15.45:0/3556199316 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaa00cbb60 con 0x7faaa00cb6d0 2023-11-28T18:37:39.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7f6be67fc640 1 -- 172.21.15.45:0/2041283416 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd80ab600 con 0x7f6be8071980 2023-11-28T18:37:39.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7f6be67fc640 1 -- 172.21.15.45:0/2041283416 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bd80ab760 con 0x7f6be8071980 2023-11-28T18:37:39.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7f6be67fc640 1 -- 172.21.15.45:0/2041283416 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd80abaf0 con 0x7f6be8071980 2023-11-28T18:37:39.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7fda20a13640 1 -- 172.21.15.45:0/116020862 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda14001a00 con 0x7fda1c15d1d0 2023-11-28T18:37:39.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7fda20a13640 1 -- 172.21.15.45:0/116020862 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda0c0a7050 con 0x7fda1c15d1d0 2023-11-28T18:37:39.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7fda20a13640 1 -- 172.21.15.45:0/116020862 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0c0ab620 con 0x7fda1c15d1d0 2023-11-28T18:37:39.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7faa9f7fe640 1 -- 172.21.15.45:0/3556199316 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2553598834 0 0) 0x7faaa00ce5a0 con 0x7faaa015cdf0 2023-11-28T18:37:39.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7faa9f7fe640 1 -- 172.21.15.45:0/3556199316 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa88003530 con 0x7faaa015cdf0 2023-11-28T18:37:39.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7fe03ffff640 1 --2- 172.21.15.45:0/869814524 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe044066900 0x7fe044068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7ff9294f3640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9240b35f0 0x7ff9240d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7ff929cf4640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff9240cfed0 0x7ff92415f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7ff929cf4640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff9240cfed0 0x7ff92415f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57120/0 (socket says 172.21.15.45:57120) 2023-11-28T18:37:39.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7ff929cf4640 1 -- 172.21.15.45:0/508058618 learned_addr learned my addr 172.21.15.45:0/508058618 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:39.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7f6ad6ffd640 1 --2- 172.21.15.45:0/1182290149 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6ac80669a0 0x7f6ac8068e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7f6ad6ffd640 1 -- 172.21.15.45:0/1182290149 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6adc11ece0 con 0x7f6ae815ce40 2023-11-28T18:37:39.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7f6ae659c640 1 --2- 172.21.15.45:0/1182290149 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6ac80669a0 0x7f6ac8068e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7f6ad6ffd640 1 --2- 172.21.15.45:0/1182290149 >> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] conn(0x7f6ac806ebc0 0x7f6ac8070fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7f6ad6ffd640 1 -- 172.21.15.45:0/1182290149 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6ac8071690 con 0x7f6ac806ebc0 2023-11-28T18:37:39.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7f6ad6ffd640 1 -- 172.21.15.45:0/1182290149 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6adc11f090 con 0x7f6ae815ce40 2023-11-28T18:37:39.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7faa9f7fe640 1 -- 172.21.15.45:0/3556199316 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2809225238 0 0) 0x7faaa00ce880 con 0x7faaa01594d0 2023-11-28T18:37:39.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7faa9f7fe640 1 -- 172.21.15.45:0/3556199316 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faaa00ce5a0 con 0x7faaa01594d0 2023-11-28T18:37:39.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7faa9f7fe640 1 -- 172.21.15.45:0/3556199316 <== mon.1 v1:172.21.15.190:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 14481478 0 0) 0x7faa88003530 con 0x7faaa015cdf0 2023-11-28T18:37:39.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7faa9f7fe640 1 -- 172.21.15.45:0/3556199316 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faaa00cb6d0 msgr2=0x7faaa015d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:39.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7faa9f7fe640 1 --2- 172.21.15.45:0/3556199316 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faaa00cb6d0 0x7faaa015d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7faa9f7fe640 1 -- 172.21.15.45:0/3556199316 >> v1:172.21.15.45:6789/0 conn(0x7faaa01594d0 legacy=0x7faaa015d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7faa9f7fe640 1 -- 172.21.15.45:0/3556199316 --> v1:172.21.15.190:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaa0070fc0 con 0x7faaa015cdf0 2023-11-28T18:37:39.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7faa9f7fe640 1 -- 172.21.15.45:0/3556199316 <== mon.1 v1:172.21.15.190:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4084481567 0 0) 0x7faa94001680 con 0x7faaa015cdf0 2023-11-28T18:37:39.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7faa9f7fe640 1 -- 172.21.15.45:0/3556199316 >> v1:172.21.15.190:6789/0 conn(0x7faaa015cdf0 legacy=0x7faaa00b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7f7c15ffb640 1 --2- 172.21.15.45:0/977381826 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f7c040668d0 0x7f7c04068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7f6bee217640 1 -- 172.21.15.45:0/2041283416 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6be8071980 msgr2=0x7f6be815e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7f6bee217640 1 --2- 172.21.15.45:0/2041283416 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6be8071980 0x7f6be815e280 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6be806c070 tx=0x7f6bd801c440 comp rx=0 tx=0).stop 2023-11-28T18:37:39.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7f6bee217640 1 -- 172.21.15.45:0/2041283416 shutdown_connections 2023-11-28T18:37:39.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7f6bee217640 1 --2- 172.21.15.45:0/2041283416 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6be80b3810 0x7f6be80b3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7f6bee217640 1 --2- 172.21.15.45:0/2041283416 >> v2:172.21.15.45:3300/0 conn(0x7f6be8071d60 0x7f6be80b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7f6bee217640 1 --2- 172.21.15.45:0/2041283416 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6be8071980 0x7f6be815e280 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7f6bee217640 1 -- 172.21.15.45:0/2041283416 >> 172.21.15.45:0/2041283416 conn(0x7f6be806c300 msgr2=0x7f6be806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:39.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7f249a8d6640 1 Processor -- start 2023-11-28T18:37:39.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7f249a8d6640 1 -- start start 2023-11-28T18:37:39.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7ff929cf4640 1 -- 172.21.15.45:0/508058618 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9240b35f0 msgr2=0x7ff9240d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:39.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7ff929cf4640 1 --2- 172.21.15.45:0/508058618 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9240b35f0 0x7ff9240d0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7ff929cf4640 1 -- 172.21.15.45:0/508058618 >> v1:172.21.15.190:6789/0 conn(0x7ff9240b3cb0 legacy=0x7ff9240cf7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:39.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7ff929cf4640 1 -- 172.21.15.45:0/508058618 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9240d3b10 con 0x7ff9240cfed0 2023-11-28T18:37:39.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7f7c15ffb640 1 -- 172.21.15.45:0/977381826 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7c1011eae0 con 0x7f7c20145290 2023-11-28T18:37:39.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7fda23c79640 1 -- 172.21.15.45:0/116020862 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda1c15d1d0 msgr2=0x7fda1c15d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7fda23c79640 1 --2- 172.21.15.45:0/116020862 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda1c15d1d0 0x7fda1c15d630 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fda0c009870 tx=0x7fda0c01c3f0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7fe03ffff640 1 -- 172.21.15.45:0/869814524 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe04c11f0b0 con 0x7fe0580cff60 2023-11-28T18:37:39.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7fe0567fc640 1 --2- 172.21.15.45:0/869814524 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe044066900 0x7fe044068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7fe03ffff640 1 --2- 172.21.15.45:0/869814524 >> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] conn(0x7fe04406eaa0 0x7fe044070ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7fe03ffff640 1 -- 172.21.15.45:0/869814524 --> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe044071570 con 0x7fe04406eaa0 2023-11-28T18:37:39.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7faa9f7fe640 1 --2- 172.21.15.45:0/3556199316 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faaa00cb6d0 0x7faa88003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7faa9f7fe640 1 --2- 172.21.15.45:0/3556199316 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa880040b0 0x7faa880047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7faa9f7fe640 1 --2- 172.21.15.45:0/3556199316 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faa88004d10 0x7faa88005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7f7c24a99640 1 --2- 172.21.15.45:0/977381826 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f7c040668d0 0x7f7c04068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7faa9f7fe640 1 -- 172.21.15.45:0/3556199316 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa00cbb60 con 0x7faa880040b0 2023-11-28T18:37:39.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7faa9f7fe640 1 -- 172.21.15.45:0/3556199316 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa8800dc80 con 0x7faa88004d10 2023-11-28T18:37:39.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7faa9f7fe640 1 -- 172.21.15.45:0/3556199316 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa8800de40 con 0x7faaa00cb6d0 2023-11-28T18:37:39.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7f6bee217640 1 -- 172.21.15.45:0/2041283416 shutdown_connections 2023-11-28T18:37:39.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7faaa4e9a640 1 --2- 172.21.15.45:0/3556199316 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faaa00cb6d0 0x7faa88003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7faaa569b640 1 --2- 172.21.15.45:0/3556199316 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faa88004d10 0x7faa88005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7f6bee217640 1 -- 172.21.15.45:0/2041283416 wait complete. 2023-11-28T18:37:39.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7fda23c79640 1 -- 172.21.15.45:0/116020862 shutdown_connections 2023-11-28T18:37:39.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7fda23c79640 1 --2- 172.21.15.45:0/116020862 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda1c15d1d0 0x7fda1c15d630 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7fda23c79640 1 --2- 172.21.15.45:0/116020862 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda1c1594d0 0x7fda1c0cb6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7fda23c79640 1 -- 172.21.15.45:0/116020862 >> 172.21.15.45:0/116020862 conn(0x7fda1c06c300 msgr2=0x7fda1c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:39.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7f6ae6d9d640 1 --2- 172.21.15.45:0/1182290149 >> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] conn(0x7f6ac806ebc0 0x7f6ac8070fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7fe03ffff640 1 -- 172.21.15.45:0/869814524 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe04c0a6020 con 0x7fe0580cff60 2023-11-28T18:37:39.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.339+0000 7fe0577fe640 1 --2- 172.21.15.45:0/869814524 >> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] conn(0x7fe04406eaa0 0x7fe044070ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.339+0000 7f7c24a99640 1 --2- 172.21.15.45:0/977381826 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f7c040668d0 0x7f7c04068d90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7c2015c620 tx=0x7f7c1c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:39.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.339+0000 7f7c15ffb640 1 --2- 172.21.15.45:0/977381826 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x7f7c0406eaf0 0x7f7c04070f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7faaa4e9a640 1 -- 172.21.15.45:0/3556199316 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faa88004d10 msgr2=0x7faa88005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:39.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7faaa4e9a640 1 --2- 172.21.15.45:0/3556199316 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faa88004d10 0x7faa88005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7faaa4e9a640 1 -- 172.21.15.45:0/3556199316 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa880040b0 msgr2=0x7faa880047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:39.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7faaa4e9a640 1 --2- 172.21.15.45:0/3556199316 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa880040b0 0x7faa880047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.335+0000 7faaa4e9a640 1 -- 172.21.15.45:0/3556199316 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaa00ce880 con 0x7faaa00cb6d0 2023-11-28T18:37:39.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.339+0000 7fe0567fc640 1 --2- 172.21.15.45:0/869814524 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe044066900 0x7fe044068dc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe058157f80 tx=0x7fe048009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:39.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.339+0000 7f7c15ffb640 1 -- 172.21.15.45:0/977381826 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7c040715c0 con 0x7f7c0406eaf0 2023-11-28T18:37:39.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.339+0000 7f7c15ffb640 1 -- 172.21.15.45:0/977381826 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7c10123280 con 0x7f7c20145290 2023-11-28T18:37:39.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.339+0000 7fda23c79640 1 -- 172.21.15.45:0/116020862 shutdown_connections 2023-11-28T18:37:39.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.339+0000 7f249a8d6640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f249406e590 0x7f249415a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.339+0000 7f249a8d6640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f24940b3700 0x7f249406c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.339+0000 7f249a8d6640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24940726b0 con 0x7f2494072270 2023-11-28T18:37:39.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.339+0000 7f249a8d6640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2494159f20 con 0x7f24940b3700 2023-11-28T18:37:39.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.339+0000 7f249a8d6640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2494159750 con 0x7f249406e590 2023-11-28T18:37:39.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.339+0000 7f2493fff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f249406e590 0x7f249415a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.339+0000 7f2493fff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f249406e590 0x7f249415a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.45:60166/0 (socket says 172.21.15.45:60166) 2023-11-28T18:37:39.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.339+0000 7f2493fff640 1 -- 172.21.15.45:0/2377723306 learned_addr learned my addr 172.21.15.45:0/2377723306 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:39.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.339+0000 7f2498e73640 1 --2- 172.21.15.45:0/2377723306 >> v2:172.21.15.190:3300/0 conn(0x7f24940b3700 0x7f249406c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.339+0000 7fda23c79640 1 -- 172.21.15.45:0/116020862 wait complete. 2023-11-28T18:37:39.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.339+0000 7f7c25a9b640 1 --2- 172.21.15.45:0/977381826 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x7f7c0406eaf0 0x7f7c04070f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.339+0000 7fe0577fe640 1 --2- 172.21.15.45:0/869814524 >> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] conn(0x7fe04406eaa0 0x7fe044070ec0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:39.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.339+0000 7f6bee217640 1 Processor -- start 2023-11-28T18:37:39.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.339+0000 7f2493fff640 1 -- 172.21.15.45:0/2377723306 >> v2:172.21.15.190:3300/0 conn(0x7f24940b3700 msgr2=0x7f249406c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:39.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.339+0000 7f2493fff640 1 --2- 172.21.15.45:0/2377723306 >> v2:172.21.15.190:3300/0 conn(0x7f24940b3700 0x7f249406c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.339+0000 7f2492ffd640 1 -- 172.21.15.45:0/2377723306 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3317461131 0 0) 0x7f24940726b0 con 0x7f2494072270 2023-11-28T18:37:39.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.339+0000 7f2493fff640 1 -- 172.21.15.45:0/2377723306 >> v1:172.21.15.190:6789/0 conn(0x7f2494072270 legacy=0x7f2494159040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.339+0000 7f2493fff640 1 -- 172.21.15.45:0/2377723306 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24940b3b90 con 0x7f249406e590 2023-11-28T18:37:39.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.339+0000 7f2498e73640 1 --2- 172.21.15.45:0/2377723306 >> v2:172.21.15.190:3300/0 conn(0x7f24940b3700 0x7f249406c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:37:39.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.339+0000 7f6ae659c640 1 --2- 172.21.15.45:0/1182290149 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6ac80669a0 0x7f6ac8068e60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6ae81f9890 tx=0x7f6ae0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:39.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.339+0000 7f6ae6d9d640 1 --2- 172.21.15.45:0/1182290149 >> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] conn(0x7f6ac806ebc0 0x7f6ac8070fe0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:39.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.339+0000 7f7c25a9b640 1 --2- 172.21.15.45:0/977381826 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x7f7c0406eaf0 0x7f7c04070f10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:39.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.339+0000 7fe03ffff640 1 -- 172.21.15.45:0/869814524 <== osd.1 v2:172.21.15.45:6800/2857063763 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fe044071570 con 0x7fe04406eaa0 2023-11-28T18:37:39.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.339+0000 7ff929cf4640 1 --2- 172.21.15.45:0/508058618 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9240cfed0 0x7ff92415f0a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff91c009e50 tx=0x7ff91c01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce52a0226bd75599 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:39.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.339+0000 7f6bee217640 1 -- start start 2023-11-28T18:37:39.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.343+0000 7f6ad6ffd640 1 -- 172.21.15.45:0/1182290149 <== osd.0 v2:172.21.15.45:6808/555237322 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f6ac8071690 con 0x7f6ac806ebc0 2023-11-28T18:37:39.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.343+0000 7fda23c79640 1 Processor -- start 2023-11-28T18:37:39.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.343+0000 7faaa4e9a640 1 --2- 172.21.15.45:0/3556199316 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faaa00cb6d0 0x7faa88003b30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7faa9400c160 tx=0x7faa9401cbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f991f36f53c63edd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:39.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.343+0000 7fda23c79640 1 -- start start 2023-11-28T18:37:39.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.343+0000 7ff917fff640 1 -- 172.21.15.45:0/508058618 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91c0a5850 con 0x7ff9240cfed0 2023-11-28T18:37:39.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.343+0000 7ff917fff640 1 -- 172.21.15.45:0/508058618 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff91c0a59b0 con 0x7ff9240cfed0 2023-11-28T18:37:39.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.343+0000 7f7c15ffb640 1 -- 172.21.15.45:0/977381826 <== osd.2 v2:172.21.15.45:6816/193884539 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f7c040715c0 con 0x7f7c0406eaf0 2023-11-28T18:37:39.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.343+0000 7f6bee217640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6be8071980 0x7f6be80cd0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.343+0000 7f6bee217640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6be8071d60 0x7f6be813c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.343+0000 7f6bee217640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6be80b3810 0x7f6be8140ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.343+0000 7f6bee217640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be813cdd0 con 0x7f6be8071980 2023-11-28T18:37:39.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.343+0000 7f6bee217640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be81413e0 con 0x7f6be8071d60 2023-11-28T18:37:39.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.343+0000 7f6bee217640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6be80cd730 con 0x7f6be80b3810 2023-11-28T18:37:39.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.343+0000 7ff917fff640 1 -- 172.21.15.45:0/508058618 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91c0a5d40 con 0x7ff9240cfed0 2023-11-28T18:37:39.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.343+0000 7faa9f7fe640 1 -- 172.21.15.45:0/3556199316 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa940a9030 con 0x7faaa00cb6d0 2023-11-28T18:37:39.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.343+0000 7faa9f7fe640 1 -- 172.21.15.45:0/3556199316 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa940073b0 con 0x7faaa00cb6d0 2023-11-28T18:37:39.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.343+0000 7faa9f7fe640 1 -- 172.21.15.45:0/3556199316 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa940077a0 con 0x7faaa00cb6d0 2023-11-28T18:37:39.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.343+0000 7f6be77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6be8071980 0x7f6be80cd0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.343+0000 7f6be77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6be8071980 0x7f6be80cd0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57146/0 (socket says 172.21.15.45:57146) 2023-11-28T18:37:39.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.343+0000 7f6be77fe640 1 -- 172.21.15.45:0/4136911427 learned_addr learned my addr 172.21.15.45:0/4136911427 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:39.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.343+0000 7f6be77fe640 1 -- 172.21.15.45:0/4136911427 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6be80b3810 msgr2=0x7f6be8140ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.343+0000 7f6be77fe640 1 --2- 172.21.15.45:0/4136911427 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6be80b3810 0x7f6be8140ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.343+0000 7f6be77fe640 1 -- 172.21.15.45:0/4136911427 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6be8071d60 msgr2=0x7f6be813c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.343+0000 7f6be77fe640 1 --2- 172.21.15.45:0/4136911427 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6be8071d60 0x7f6be813c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.343+0000 7f6be77fe640 1 -- 172.21.15.45:0/4136911427 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd80094d0 con 0x7f6be8071980 2023-11-28T18:37:39.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.343+0000 7f6be77fe640 1 --2- 172.21.15.45:0/4136911427 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6be8071980 0x7f6be80cd0e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6bd801aaf0 tx=0x7f6bd801ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:39.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.343+0000 7faaa70fe640 1 -- 172.21.15.45:0/3556199316 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faaa00cb6d0 msgr2=0x7faa88003b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.343+0000 7faaa70fe640 1 --2- 172.21.15.45:0/3556199316 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faaa00cb6d0 0x7faa88003b30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7faa9400c160 tx=0x7faa9401cbc0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.343+0000 7fda23c79640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda1c1594d0 0x7fda1c149d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.343+0000 7fda23c79640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda1c15cdf0 0x7fda1c14f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.343+0000 7fda23c79640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda1c15d1d0 0x7fda1c15bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.343+0000 7fda23c79640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda1c14b340 con 0x7fda1c15cdf0 2023-11-28T18:37:39.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.343+0000 7fda23c79640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda1c14f870 con 0x7fda1c1594d0 2023-11-28T18:37:39.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.343+0000 7fda23c79640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda1c14a730 con 0x7fda1c15d1d0 2023-11-28T18:37:39.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.343+0000 7fda22216640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda1c15d1d0 0x7fda1c15bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.343+0000 7fda22216640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda1c15d1d0 0x7fda1c15bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.45:60182/0 (socket says 172.21.15.45:60182) 2023-11-28T18:37:39.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.343+0000 7fda22216640 1 -- 172.21.15.45:0/2125979401 learned_addr learned my addr 172.21.15.45:0/2125979401 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:39.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.343+0000 7fda21a15640 1 --2- 172.21.15.45:0/2125979401 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda1c1594d0 0x7fda1c149d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.343+0000 7fda22216640 1 -- 172.21.15.45:0/2125979401 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda1c1594d0 msgr2=0x7fda1c149d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.343+0000 7fda22216640 1 --2- 172.21.15.45:0/2125979401 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda1c1594d0 0x7fda1c149d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.343+0000 7fda22216640 1 -- 172.21.15.45:0/2125979401 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda1c15cdf0 msgr2=0x7fda1c14f330 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T18:37:39.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.343+0000 7faaa569b640 1 -- 172.21.15.45:0/3556199316 reap_dead start 2023-11-28T18:37:39.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.347+0000 7fda21214640 1 --2- 172.21.15.45:0/2125979401 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda1c15cdf0 0x7fda1c14f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.347+0000 7fda22216640 1 --2- 172.21.15.45:0/2125979401 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda1c15cdf0 0x7fda1c14f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.347+0000 7fda22216640 1 -- 172.21.15.45:0/2125979401 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda1800ba70 con 0x7fda1c15d1d0 2023-11-28T18:37:39.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.347+0000 7fda21214640 1 --2- 172.21.15.45:0/2125979401 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda1c15cdf0 0x7fda1c14f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:37:39.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.343+0000 7ff92b757640 1 -- 172.21.15.45:0/508058618 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9240cfed0 msgr2=0x7ff92415f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.343+0000 7ff92b757640 1 --2- 172.21.15.45:0/508058618 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9240cfed0 0x7ff92415f0a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff91c009e50 tx=0x7ff91c01c9d0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.347+0000 7ff92b757640 1 -- 172.21.15.45:0/508058618 shutdown_connections 2023-11-28T18:37:39.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.347+0000 7ff92b757640 1 --2- 172.21.15.45:0/508058618 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9240cfed0 0x7ff92415f0a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.347+0000 7ff92b757640 1 --2- 172.21.15.45:0/508058618 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9240b35f0 0x7ff9240d0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.347+0000 7ff92b757640 1 -- 172.21.15.45:0/508058618 >> 172.21.15.45:0/508058618 conn(0x7ff92409c4f0 msgr2=0x7ff9240d31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:39.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.347+0000 7f6bcffff640 1 -- 172.21.15.45:0/4136911427 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd80be5f0 con 0x7f6be8071980 2023-11-28T18:37:39.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.347+0000 7f6bcffff640 1 -- 172.21.15.45:0/4136911427 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bd80be750 con 0x7f6be8071980 2023-11-28T18:37:39.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.347+0000 7faaa70fe640 1 -- 172.21.15.45:0/3556199316 shutdown_connections 2023-11-28T18:37:39.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.347+0000 7faaa70fe640 1 -- 172.21.15.45:0/3556199316 >> 172.21.15.45:0/3556199316 conn(0x7faaa006c300 msgr2=0x7faaa006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:39.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.347+0000 7f6bcffff640 1 -- 172.21.15.45:0/4136911427 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd80beb00 con 0x7f6be8071980 2023-11-28T18:37:39.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.347+0000 7f6bee217640 1 -- 172.21.15.45:0/4136911427 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6be80cda10 con 0x7f6be8071980 2023-11-28T18:37:39.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.347+0000 7faaa70fe640 1 -- 172.21.15.45:0/3556199316 shutdown_connections 2023-11-28T18:37:39.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.347+0000 7f2493fff640 1 --2- 172.21.15.45:0/2377723306 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f249406e590 0x7f249415a340 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f248c009e50 tx=0x7f248c01c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1aece59f01fb1a3b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:39.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.347+0000 7faaa70fe640 1 -- 172.21.15.45:0/3556199316 wait complete. 2023-11-28T18:37:39.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.347+0000 7f6bee217640 1 -- 172.21.15.45:0/4136911427 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6be80cb940 con 0x7f6be8071980 2023-11-28T18:37:39.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.347+0000 7f6bee217640 1 -- 172.21.15.45:0/4136911427 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6be80704a0 con 0x7f6be8071980 2023-11-28T18:37:39.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.347+0000 7ff92b757640 1 -- 172.21.15.45:0/508058618 shutdown_connections 2023-11-28T18:37:39.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.347+0000 7ff92b757640 1 -- 172.21.15.45:0/508058618 wait complete. 2023-11-28T18:37:39.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.347+0000 7f2492ffd640 1 -- 172.21.15.45:0/2377723306 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f248c0a57c0 con 0x7f249406e590 2023-11-28T18:37:39.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.347+0000 7f2492ffd640 1 -- 172.21.15.45:0/2377723306 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f248c0a5920 con 0x7f249406e590 2023-11-28T18:37:39.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.347+0000 7f2492ffd640 1 -- 172.21.15.45:0/2377723306 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f248c0a5cb0 con 0x7f249406e590 2023-11-28T18:37:39.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.347+0000 7fda22216640 1 --2- 172.21.15.45:0/2125979401 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda1c15d1d0 0x7fda1c15bd80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fda0c01aaa0 tx=0x7fda0c019190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:39.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.347+0000 7faaa70fe640 1 Processor -- start 2023-11-28T18:37:39.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.347+0000 7f6bcffff640 1 -- 172.21.15.45:0/4136911427 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f6bd80b43f0 con 0x7f6be8071980 2023-11-28T18:37:39.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.351+0000 7faaa70fe640 1 -- start start 2023-11-28T18:37:39.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.351+0000 7ff92b757640 1 Processor -- start 2023-11-28T18:37:39.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.351+0000 7ff92b757640 1 -- start start 2023-11-28T18:37:39.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.351+0000 7f6bcffff640 1 --2- 172.21.15.45:0/4136911427 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6bd4066920 0x7f6bd4068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.351+0000 7f6bcffff640 1 -- 172.21.15.45:0/4136911427 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6bd811e4f0 con 0x7f6be8071980 2023-11-28T18:37:39.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.351+0000 7f249a8d6640 1 -- 172.21.15.45:0/2377723306 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f249406e590 msgr2=0x7f249415a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.351+0000 7f249a8d6640 1 --2- 172.21.15.45:0/2377723306 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f249406e590 0x7f249415a340 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f248c009e50 tx=0x7f248c01c9e0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.351+0000 7faaa70fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faaa015bf20 0x7faaa0153520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.351+0000 7f249a8d6640 1 -- 172.21.15.45:0/2377723306 shutdown_connections 2023-11-28T18:37:39.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.351+0000 7f249a8d6640 1 --2- 172.21.15.45:0/2377723306 >> v2:172.21.15.190:3300/0 conn(0x7f24940b3700 0x7f249406c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.351+0000 7f249a8d6640 1 --2- 172.21.15.45:0/2377723306 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f249406e590 0x7f249415a340 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.351+0000 7f249a8d6640 1 -- 172.21.15.45:0/2377723306 >> 172.21.15.45:0/2377723306 conn(0x7f249406a570 msgr2=0x7f249406a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:39.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.351+0000 7f6bcffff640 1 --2- 172.21.15.45:0/4136911427 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x7f6bd406eb40 0x7f6bd4070f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.351+0000 7f6bcffff640 1 -- 172.21.15.45:0/4136911427 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6bd4071610 con 0x7f6bd406eb40 2023-11-28T18:37:39.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.351+0000 7f6bcffff640 1 -- 172.21.15.45:0/4136911427 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6bd811e890 con 0x7f6be8071980 2023-11-28T18:37:39.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.351+0000 7faaa70fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faaa015c300 0x7faaa0153a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.351+0000 7faaa70fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faaa01598d0 0x7faaa0159d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.351+0000 7f6be6ffd640 1 --2- 172.21.15.45:0/4136911427 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6bd4066920 0x7f6bd4068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.351+0000 7f249a8d6640 1 -- 172.21.15.45:0/2377723306 shutdown_connections 2023-11-28T18:37:39.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.351+0000 7faaa4e9a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faaa015bf20 0x7faaa0153520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.351+0000 7f249a8d6640 1 -- 172.21.15.45:0/2377723306 wait complete. 2023-11-28T18:37:39.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.351+0000 7faaa4e9a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faaa015bf20 0x7faaa0153520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.45:42140/0 (socket says 172.21.15.45:42140) 2023-11-28T18:37:39.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.351+0000 7faaa4e9a640 1 -- 172.21.15.45:0/3627359330 learned_addr learned my addr 172.21.15.45:0/3627359330 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:39.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.351+0000 7faaa70fe640 1 -- 172.21.15.45:0/3627359330 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa014c5a0 con 0x7faaa015c300 2023-11-28T18:37:39.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.351+0000 7faaa70fe640 1 -- 172.21.15.45:0/3627359330 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa015a600 con 0x7faaa015bf20 2023-11-28T18:37:39.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.351+0000 7faaa70fe640 1 -- 172.21.15.45:0/3627359330 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaa015a8e0 con 0x7faaa01598d0 2023-11-28T18:37:39.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.351+0000 7faa9ffff640 1 --2- 172.21.15.45:0/3627359330 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faaa015c300 0x7faaa0153a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.351+0000 7faaa569b640 1 --2- 172.21.15.45:0/3627359330 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faaa01598d0 0x7faaa0159d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.351+0000 7ff92b757640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff9240b35f0 0x7ff9240cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.351+0000 7ff92b757640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9240b3cb0 0x7ff92415e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.351+0000 7ff92b757640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9240cfed0 0x7ff92409cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.351+0000 7ff92b757640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff924157d70 con 0x7ff9240b3cb0 2023-11-28T18:37:39.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.351+0000 7ff92b757640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff924157160 con 0x7ff9240b35f0 2023-11-28T18:37:39.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.351+0000 7f6be7fff640 1 --2- 172.21.15.45:0/4136911427 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x7f6bd406eb40 0x7f6bd4070f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.351+0000 7ff92b757640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff924157440 con 0x7ff9240cfed0 2023-11-28T18:37:39.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.351+0000 7faaa4e9a640 1 -- 172.21.15.45:0/3627359330 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faaa01598d0 msgr2=0x7faaa0159d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.351+0000 7fda127fc640 1 -- 172.21.15.45:0/2125979401 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0c0abe30 con 0x7fda1c15d1d0 2023-11-28T18:37:39.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.351+0000 7fda127fc640 1 -- 172.21.15.45:0/2125979401 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda0c0b5400 con 0x7fda1c15d1d0 2023-11-28T18:37:39.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.351+0000 7fda127fc640 1 -- 172.21.15.45:0/2125979401 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0c0b5770 con 0x7fda1c15d1d0 2023-11-28T18:37:39.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.351+0000 7faaa4e9a640 1 --2- 172.21.15.45:0/3627359330 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faaa01598d0 0x7faaa0159d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.351+0000 7ff9294f3640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff9240b35f0 0x7ff9240cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.351+0000 7ff9294f3640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff9240b35f0 0x7ff9240cc6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.45:42142/0 (socket says 172.21.15.45:42142) 2023-11-28T18:37:39.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.351+0000 7ff9294f3640 1 -- 172.21.15.45:0/2082686982 learned_addr learned my addr 172.21.15.45:0/2082686982 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:39.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.351+0000 7ff929cf4640 1 --2- 172.21.15.45:0/2082686982 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9240cfed0 0x7ff92409cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.351+0000 7faaa4e9a640 1 -- 172.21.15.45:0/3627359330 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faaa015c300 msgr2=0x7faaa0153a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.351+0000 7ff928cf2640 1 --2- 172.21.15.45:0/2082686982 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9240b3cb0 0x7ff92415e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.351+0000 7ff9294f3640 1 -- 172.21.15.45:0/2082686982 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9240cfed0 msgr2=0x7ff92409cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.351+0000 7ff9294f3640 1 --2- 172.21.15.45:0/2082686982 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9240cfed0 0x7ff92409cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.351+0000 7ff9294f3640 1 -- 172.21.15.45:0/2082686982 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9240b3cb0 msgr2=0x7ff92415e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.351+0000 7ff929cf4640 1 --2- 172.21.15.45:0/2082686982 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9240cfed0 0x7ff92409cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:37:39.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.351+0000 7faaa4e9a640 1 --2- 172.21.15.45:0/3627359330 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faaa015c300 0x7faaa0153a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.351+0000 7faaa4e9a640 1 -- 172.21.15.45:0/3627359330 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaa015abc0 con 0x7faaa015bf20 2023-11-28T18:37:39.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.351+0000 7faa9ffff640 1 --2- 172.21.15.45:0/3627359330 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faaa015c300 0x7faaa0153a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:37:39.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.351+0000 7f6be7fff640 1 --2- 172.21.15.45:0/4136911427 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x7f6bd406eb40 0x7f6bd4070f60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:39.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.351+0000 7ff9294f3640 1 --2- 172.21.15.45:0/2082686982 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9240b3cb0 0x7ff92415e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.351+0000 7ff9294f3640 1 -- 172.21.15.45:0/2082686982 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff91c009b30 con 0x7ff9240b35f0 2023-11-28T18:37:39.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.351+0000 7ff928cf2640 1 --2- 172.21.15.45:0/2082686982 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9240b3cb0 0x7ff92415e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:37:39.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.355+0000 7faaa4e9a640 1 --2- 172.21.15.45:0/3627359330 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faaa015bf20 0x7faaa0153520 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7faa94006040 tx=0x7faa88005800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:39.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.355+0000 7ff9294f3640 1 --2- 172.21.15.45:0/2082686982 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff9240b35f0 0x7ff9240cc6b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff91800c7f0 tx=0x7ff91800ccb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:39.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.355+0000 7fda23c79640 1 -- 172.21.15.45:0/2125979401 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda0c0094d0 con 0x7fda1c15d1d0 2023-11-28T18:37:39.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.355+0000 7faa9d7fa640 1 -- 172.21.15.45:0/3627359330 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa94004cc0 con 0x7faaa015bf20 2023-11-28T18:37:39.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.355+0000 7ff915ffb640 1 -- 172.21.15.45:0/2082686982 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff918004220 con 0x7ff9240b35f0 2023-11-28T18:37:39.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.355+0000 7faa9d7fa640 1 -- 172.21.15.45:0/3627359330 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa94004e20 con 0x7faaa015bf20 2023-11-28T18:37:39.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.355+0000 7ff915ffb640 1 -- 172.21.15.45:0/2082686982 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9180043a0 con 0x7ff9240b35f0 2023-11-28T18:37:39.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.355+0000 7f6bcffff640 1 -- 172.21.15.45:0/4136911427 <== osd.3 v2:172.21.15.45:6824/78541084 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f6bd4071610 con 0x7f6bd406eb40 2023-11-28T18:37:39.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.355+0000 7f249a8d6640 1 Processor -- start 2023-11-28T18:37:39.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.355+0000 7f6be6ffd640 1 --2- 172.21.15.45:0/4136911427 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6bd4066920 0x7f6bd4068de0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6be80677c0 tx=0x7f6bdc009480 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:39.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.355+0000 7faa9d7fa640 1 -- 172.21.15.45:0/3627359330 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa94004cc0 con 0x7faaa015bf20 2023-11-28T18:37:39.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.355+0000 7f249a8d6640 1 -- start start 2023-11-28T18:37:39.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.355+0000 7ff915ffb640 1 -- 172.21.15.45:0/2082686982 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff918004510 con 0x7ff9240b35f0 2023-11-28T18:37:39.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.355+0000 7ff92b757640 1 -- 172.21.15.45:0/2082686982 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff924157720 con 0x7ff9240b35f0 2023-11-28T18:37:39.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.355+0000 7fda23c79640 1 -- 172.21.15.45:0/2125979401 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda1c14acf0 con 0x7fda1c15d1d0 2023-11-28T18:37:39.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.355+0000 7ff92b757640 1 -- 172.21.15.45:0/2082686982 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9240cd370 con 0x7ff9240b35f0 2023-11-28T18:37:39.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.355+0000 7faaa70fe640 1 -- 172.21.15.45:0/3627359330 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaa015aea0 con 0x7faaa015bf20 2023-11-28T18:37:39.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.355+0000 7faaa70fe640 1 -- 172.21.15.45:0/3627359330 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaa00b2000 con 0x7faaa015bf20 2023-11-28T18:37:39.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.359+0000 7faaa70fe640 1 -- 172.21.15.45:0/3627359330 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7faaa015aa50 con 0x7faaa015bf20 2023-11-28T18:37:39.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.355+0000 7f249a8d6640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f249406e590 0x7f24940c3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.359+0000 7f249a8d6640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2494072270 0x7f24941fdef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.359+0000 7f2493fff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f249406e590 0x7f24940c3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.359+0000 7f2493fff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f249406e590 0x7f24940c3f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.45:42148/0 (socket says 172.21.15.45:42148) 2023-11-28T18:37:39.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.359+0000 7fda23c79640 1 -- 172.21.15.45:0/2125979401 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fda1c166190 con 0x7fda1c15d1d0 2023-11-28T18:37:39.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.359+0000 7f2493fff640 1 -- 172.21.15.45:0/3026042925 learned_addr learned my addr 172.21.15.45:0/3026042925 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:39.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.359+0000 7f249a8d6640 1 --2- 172.21.15.45:0/3026042925 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24940b3700 0x7f24941fe430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.359+0000 7f249a8d6640 1 -- 172.21.15.45:0/3026042925 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2494143670 con 0x7f24940b3700 2023-11-28T18:37:39.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.359+0000 7f249a8d6640 1 -- 172.21.15.45:0/3026042925 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24940acb60 con 0x7f249406e590 2023-11-28T18:37:39.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.359+0000 7f249a8d6640 1 -- 172.21.15.45:0/3026042925 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24940ace40 con 0x7f2494072270 2023-11-28T18:37:39.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.359+0000 7ff92b757640 1 -- 172.21.15.45:0/2082686982 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff9240b2fd0 con 0x7ff9240b35f0 2023-11-28T18:37:39.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.359+0000 7f24937fe640 1 --2- 172.21.15.45:0/3026042925 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2494072270 0x7f24941fdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.359+0000 7f2498e73640 1 --2- 172.21.15.45:0/3026042925 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24940b3700 0x7f24941fe430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.359+0000 7f2493fff640 1 -- 172.21.15.45:0/3026042925 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2494072270 msgr2=0x7f24941fdef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.359+0000 7f2493fff640 1 --2- 172.21.15.45:0/3026042925 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2494072270 0x7f24941fdef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.359+0000 7f2493fff640 1 -- 172.21.15.45:0/3026042925 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24940b3700 msgr2=0x7f24941fe430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.359+0000 7f2493fff640 1 --2- 172.21.15.45:0/3026042925 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24940b3700 0x7f24941fe430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.359+0000 7f2493fff640 1 -- 172.21.15.45:0/3026042925 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2488009420 con 0x7f249406e590 2023-11-28T18:37:39.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.359+0000 7fda127fc640 1 -- 172.21.15.45:0/2125979401 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fda0c0b58d0 con 0x7fda1c15d1d0 2023-11-28T18:37:39.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.359+0000 7ff915ffb640 1 -- 172.21.15.45:0/2082686982 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ff918003a70 con 0x7ff9240b35f0 2023-11-28T18:37:39.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.359+0000 7faa9d7fa640 1 -- 172.21.15.45:0/3627359330 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7faa940ac070 con 0x7faaa015bf20 2023-11-28T18:37:39.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.359+0000 7fda127fc640 1 --2- 172.21.15.45:0/2125979401 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fda00066920 0x7fda00068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.359+0000 7fda127fc640 1 -- 172.21.15.45:0/2125979401 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fda1c15dd80 con 0x7fda1c15d1d0 2023-11-28T18:37:39.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.363+0000 7fda127fc640 1 --2- 172.21.15.45:0/2125979401 >> [v2:172.21.15.190:6808/1537591987,v1:172.21.15.190:6809/1537591987] conn(0x7fda0006eb40 0x7fda00070f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.363+0000 7fda127fc640 1 -- 172.21.15.45:0/2125979401 --> [v2:172.21.15.190:6808/1537591987,v1:172.21.15.190:6809/1537591987] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fda00071610 con 0x7fda0006eb40 2023-11-28T18:37:39.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.363+0000 7fda127fc640 1 -- 172.21.15.45:0/2125979401 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fda0c11fae0 con 0x7fda1c15d1d0 2023-11-28T18:37:39.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.363+0000 7fda21a15640 1 --2- 172.21.15.45:0/2125979401 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fda00066920 0x7fda00068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.363+0000 7f2493fff640 1 --2- 172.21.15.45:0/3026042925 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f249406e590 0x7f24940c3f70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f248c0af040 tx=0x7f248c019780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:39.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.363+0000 7fda21214640 1 --2- 172.21.15.45:0/2125979401 >> [v2:172.21.15.190:6808/1537591987,v1:172.21.15.190:6809/1537591987] conn(0x7fda0006eb40 0x7fda00070f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.363+0000 7f2490ff9640 1 -- 172.21.15.45:0/3026042925 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f248c0b8670 con 0x7f249406e590 2023-11-28T18:37:39.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.363+0000 7f2490ff9640 1 -- 172.21.15.45:0/3026042925 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f248c0b87f0 con 0x7f249406e590 2023-11-28T18:37:39.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.363+0000 7ff915ffb640 1 --2- 172.21.15.45:0/2082686982 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff9080669d0 0x7ff908068e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.363+0000 7f2490ff9640 1 -- 172.21.15.45:0/3026042925 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f248c0b8ba0 con 0x7f249406e590 2023-11-28T18:37:39.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.363+0000 7faa9d7fa640 1 --2- 172.21.15.45:0/3627359330 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7faa8c0669c0 0x7faa8c068e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.363+0000 7f249a8d6640 1 -- 172.21.15.45:0/3026042925 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f248c009b30 con 0x7f249406e590 2023-11-28T18:37:39.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.363+0000 7fda21a15640 1 --2- 172.21.15.45:0/2125979401 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fda00066920 0x7fda00068de0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fda14001340 tx=0x7fda14009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:39.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.363+0000 7faa9d7fa640 1 -- 172.21.15.45:0/3627359330 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faa940aa070 con 0x7faaa015bf20 2023-11-28T18:37:39.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.363+0000 7faa9ffff640 1 --2- 172.21.15.45:0/3627359330 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7faa8c0669c0 0x7faa8c068e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.363+0000 7faa9d7fa640 1 --2- 172.21.15.45:0/3627359330 >> [v2:172.21.15.190:6800/3296698407,v1:172.21.15.190:6801/3296698407] conn(0x7faa8c06eb60 0x7faa8c070f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.363+0000 7faa9d7fa640 1 -- 172.21.15.45:0/3627359330 --> [v2:172.21.15.190:6800/3296698407,v1:172.21.15.190:6801/3296698407] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faa8c071630 con 0x7faa8c06eb60 2023-11-28T18:37:39.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.363+0000 7faa9d7fa640 1 -- 172.21.15.45:0/3627359330 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa94004cc0 con 0x7faaa015bf20 2023-11-28T18:37:39.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.363+0000 7ff928cf2640 1 --2- 172.21.15.45:0/2082686982 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff9080669d0 0x7ff908068e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.363+0000 7fda21214640 1 --2- 172.21.15.45:0/2125979401 >> [v2:172.21.15.190:6808/1537591987,v1:172.21.15.190:6809/1537591987] conn(0x7fda0006eb40 0x7fda00070f60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:39.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.363+0000 7faaa569b640 1 --2- 172.21.15.45:0/3627359330 >> [v2:172.21.15.190:6800/3296698407,v1:172.21.15.190:6801/3296698407] conn(0x7faa8c06eb60 0x7faa8c070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.363+0000 7ff915ffb640 1 -- 172.21.15.45:0/2082686982 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff918084350 con 0x7ff9240b35f0 2023-11-28T18:37:39.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.363+0000 7faa9ffff640 1 --2- 172.21.15.45:0/3627359330 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7faa8c0669c0 0x7faa8c068e80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7faa90000f90 tx=0x7faa9000c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:39.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.363+0000 7f249a8d6640 1 -- 172.21.15.45:0/3026042925 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24940ad400 con 0x7f249406e590 2023-11-28T18:37:39.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.363+0000 7ff915ffb640 1 --2- 172.21.15.45:0/2082686982 >> [v2:172.21.15.190:6824/2493232051,v1:172.21.15.190:6825/2493232051] conn(0x7ff90806ebf0 0x7ff908071010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.363+0000 7ff915ffb640 1 -- 172.21.15.45:0/2082686982 --> [v2:172.21.15.190:6824/2493232051,v1:172.21.15.190:6825/2493232051] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff9080716c0 con 0x7ff90806ebf0 2023-11-28T18:37:39.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.363+0000 7ff928cf2640 1 --2- 172.21.15.45:0/2082686982 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff9080669d0 0x7ff908068e90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff9240b8e70 tx=0x7ff920009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:39.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.363+0000 7ff915ffb640 1 -- 172.21.15.45:0/2082686982 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff918086970 con 0x7ff9240b35f0 2023-11-28T18:37:39.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.363+0000 7faaa569b640 1 --2- 172.21.15.45:0/3627359330 >> [v2:172.21.15.190:6800/3296698407,v1:172.21.15.190:6801/3296698407] conn(0x7faa8c06eb60 0x7faa8c070f80 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:39.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.363+0000 7fda127fc640 1 -- 172.21.15.45:0/2125979401 <== osd.4 v2:172.21.15.190:6808/1537591987 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fda00071610 con 0x7fda0006eb40 2023-11-28T18:37:39.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.363+0000 7f249a8d6640 1 -- 172.21.15.45:0/3026042925 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2494069480 con 0x7f249406e590 2023-11-28T18:37:39.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.367+0000 7faa9d7fa640 1 -- 172.21.15.45:0/3627359330 <== osd.5 v2:172.21.15.190:6800/3296698407 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7faa8c071630 con 0x7faa8c06eb60 2023-11-28T18:37:39.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.367+0000 7f2490ff9640 1 -- 172.21.15.45:0/3026042925 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f248c0b8d00 con 0x7f249406e590 2023-11-28T18:37:39.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.367+0000 7ff929cf4640 1 --2- 172.21.15.45:0/2082686982 >> [v2:172.21.15.190:6824/2493232051,v1:172.21.15.190:6825/2493232051] conn(0x7ff90806ebf0 0x7ff908071010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.367+0000 7ff929cf4640 1 --2- 172.21.15.45:0/2082686982 >> [v2:172.21.15.190:6824/2493232051,v1:172.21.15.190:6825/2493232051] conn(0x7ff90806ebf0 0x7ff908071010 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:39.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.367+0000 7f2490ff9640 1 --2- 172.21.15.45:0/3026042925 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f2480066920 0x7f2480068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.367+0000 7f2490ff9640 1 -- 172.21.15.45:0/3026042925 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f248c11f8b0 con 0x7f249406e590 2023-11-28T18:37:39.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.367+0000 7f24937fe640 1 --2- 172.21.15.45:0/3026042925 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f2480066920 0x7f2480068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.367+0000 7f2490ff9640 1 --2- 172.21.15.45:0/3026042925 >> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] conn(0x7f248006eb40 0x7f2480070f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.367+0000 7f2490ff9640 1 -- 172.21.15.45:0/3026042925 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2480071610 con 0x7f248006eb40 2023-11-28T18:37:39.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.367+0000 7f2490ff9640 1 -- 172.21.15.45:0/3026042925 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f248c1242c0 con 0x7f249406e590 2023-11-28T18:37:39.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.367+0000 7ff915ffb640 1 -- 172.21.15.45:0/2082686982 <== osd.7 v2:172.21.15.190:6824/2493232051 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7ff9080716c0 con 0x7ff90806ebf0 2023-11-28T18:37:39.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.367+0000 7f2498e73640 1 --2- 172.21.15.45:0/3026042925 >> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] conn(0x7f248006eb40 0x7f2480070f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.367+0000 7f24937fe640 1 --2- 172.21.15.45:0/3026042925 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f2480066920 0x7f2480068de0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f24941470d0 tx=0x7f2484009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:39.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.371+0000 7f2498e73640 1 --2- 172.21.15.45:0/3026042925 >> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] conn(0x7f248006eb40 0x7f2480070f60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:39.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.375+0000 7f2490ff9640 1 -- 172.21.15.45:0/3026042925 <== osd.6 v2:172.21.15.190:6816/2317686718 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f2480071610 con 0x7f248006eb40 2023-11-28T18:37:39.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.375+0000 7f7c274fe640 1 -- 172.21.15.45:0/977381826 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7c201609f0 con 0x7f7c0406eaf0 2023-11-28T18:37:39.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.375+0000 7fe057fff640 1 -- 172.21.15.45:0/869814524 --> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe058067510 con 0x7fe04406eaa0 2023-11-28T18:37:39.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.375+0000 7f7c15ffb640 1 -- 172.21.15.45:0/977381826 <== osd.2 v2:172.21.15.45:6816/193884539 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7c201609f0 con 0x7f7c0406eaf0 2023-11-28T18:37:39.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.375+0000 7f6ad4ff9640 1 -- 172.21.15.45:0/1182290149 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6ac0002cc0 con 0x7f6ac806ebc0 2023-11-28T18:37:39.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.375+0000 7f7c274fe640 1 -- 172.21.15.45:0/977381826 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x7f7c0406eaf0 msgr2=0x7f7c04070f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.375+0000 7f7c274fe640 1 --2- 172.21.15.45:0/977381826 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x7f7c0406eaf0 0x7f7c04070f10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.375+0000 7f7c274fe640 1 -- 172.21.15.45:0/977381826 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f7c040668d0 msgr2=0x7f7c04068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.375+0000 7f7c274fe640 1 --2- 172.21.15.45:0/977381826 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f7c040668d0 0x7f7c04068d90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7c2015c620 tx=0x7f7c1c008040 comp rx=0 tx=0).stop 2023-11-28T18:37:39.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.375+0000 7f7c274fe640 1 -- 172.21.15.45:0/977381826 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7c20145290 msgr2=0x7f7c2015ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.375+0000 7f7c274fe640 1 --2- 172.21.15.45:0/977381826 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7c20145290 0x7f7c2015ab20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7c100190a0 tx=0x7f7c1001acd0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.375+0000 7f7c25a9b640 1 -- 172.21.15.45:0/977381826 reap_dead start 2023-11-28T18:37:39.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.375+0000 7f7c274fe640 1 -- 172.21.15.45:0/977381826 shutdown_connections 2023-11-28T18:37:39.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.375+0000 7f7c274fe640 1 -- 172.21.15.45:0/977381826 >> 172.21.15.45:0/977381826 conn(0x7f7c2006a570 msgr2=0x7f7c20070d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:39.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.375+0000 7fe03ffff640 1 -- 172.21.15.45:0/869814524 <== osd.1 v2:172.21.15.45:6800/2857063763 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe058067510 con 0x7fe04406eaa0 2023-11-28T18:37:39.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.375+0000 7f7c274fe640 1 -- 172.21.15.45:0/977381826 shutdown_connections 2023-11-28T18:37:39.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.375+0000 7f7c274fe640 1 -- 172.21.15.45:0/977381826 wait complete. 2023-11-28T18:37:39.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.379+0000 7f6ad6ffd640 1 -- 172.21.15.45:0/1182290149 <== osd.0 v2:172.21.15.45:6808/555237322 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6ac0002cc0 con 0x7f6ac806ebc0 2023-11-28T18:37:39.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.379+0000 7fe057fff640 1 -- 172.21.15.45:0/869814524 >> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] conn(0x7fe04406eaa0 msgr2=0x7fe044070ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.379+0000 7fe057fff640 1 --2- 172.21.15.45:0/869814524 >> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] conn(0x7fe04406eaa0 0x7fe044070ec0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.379+0000 7fe057fff640 1 -- 172.21.15.45:0/869814524 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe044066900 msgr2=0x7fe044068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.379+0000 7fe057fff640 1 --2- 172.21.15.45:0/869814524 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe044066900 0x7fe044068dc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe058157f80 tx=0x7fe048009040 comp rx=0 tx=0).stop 2023-11-28T18:37:39.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.379+0000 7fe057fff640 1 -- 172.21.15.45:0/869814524 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe0580cff60 msgr2=0x7fe0580b5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.379+0000 7fe057fff640 1 --2- 172.21.15.45:0/869814524 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe0580cff60 0x7fe0580b5aa0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe04c01a0d0 tx=0x7fe04c01ace0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.379+0000 7fe0577fe640 1 -- 172.21.15.45:0/869814524 reap_dead start 2023-11-28T18:37:39.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.379+0000 7fe057fff640 1 -- 172.21.15.45:0/869814524 shutdown_connections 2023-11-28T18:37:39.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.379+0000 7fe057fff640 1 -- 172.21.15.45:0/869814524 >> 172.21.15.45:0/869814524 conn(0x7fe0580d2f20 msgr2=0x7fe0580b1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:39.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.379+0000 7f6ae759e640 1 -- 172.21.15.45:0/1182290149 >> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] conn(0x7f6ac806ebc0 msgr2=0x7f6ac8070fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.379+0000 7fe057fff640 1 -- 172.21.15.45:0/869814524 shutdown_connections 2023-11-28T18:37:39.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.379+0000 7fe057fff640 1 -- 172.21.15.45:0/869814524 wait complete. 2023-11-28T18:37:39.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.379+0000 7f6ae759e640 1 --2- 172.21.15.45:0/1182290149 >> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] conn(0x7f6ac806ebc0 0x7f6ac8070fe0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.379+0000 7f6ae759e640 1 -- 172.21.15.45:0/1182290149 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6ac80669a0 msgr2=0x7f6ac8068e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.379+0000 7f6ae759e640 1 --2- 172.21.15.45:0/1182290149 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6ac80669a0 0x7f6ac8068e60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6ae81f9890 tx=0x7f6ae0009040 comp rx=0 tx=0).stop 2023-11-28T18:37:39.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.379+0000 7f6ae759e640 1 -- 172.21.15.45:0/1182290149 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ae815ce40 msgr2=0x7f6ae814c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.379+0000 7f6ae759e640 1 --2- 172.21.15.45:0/1182290149 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ae815ce40 0x7f6ae814c110 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6adc0ac000 tx=0x7f6adc019210 comp rx=0 tx=0).stop 2023-11-28T18:37:39.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.379+0000 7f6ae6d9d640 1 -- 172.21.15.45:0/1182290149 reap_dead start 2023-11-28T18:37:39.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.379+0000 7f6ae759e640 1 -- 172.21.15.45:0/1182290149 shutdown_connections 2023-11-28T18:37:39.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.379+0000 7f6ae759e640 1 -- 172.21.15.45:0/1182290149 >> 172.21.15.45:0/1182290149 conn(0x7f6ae80b0960 msgr2=0x7f6ae80cc880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:39.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.387+0000 7f6ae759e640 1 -- 172.21.15.45:0/1182290149 shutdown_connections 2023-11-28T18:37:39.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.387+0000 7f6ae759e640 1 -- 172.21.15.45:0/1182290149 wait complete. 2023-11-28T18:37:39.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.395+0000 7ff92b757640 1 -- 172.21.15.45:0/2082686982 --> [v2:172.21.15.190:6824/2493232051,v1:172.21.15.190:6825/2493232051] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff9241575b0 con 0x7ff90806ebf0 2023-11-28T18:37:39.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.395+0000 7f6bee217640 1 -- 172.21.15.45:0/4136911427 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6be8069480 con 0x7f6bd406eb40 2023-11-28T18:37:39.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.395+0000 7faaa70fe640 1 -- 172.21.15.45:0/3627359330 --> [v2:172.21.15.190:6800/3296698407,v1:172.21.15.190:6801/3296698407] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7faaa0071580 con 0x7faa8c06eb60 2023-11-28T18:37:39.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.395+0000 7faa9d7fa640 1 -- 172.21.15.45:0/3627359330 <== osd.5 v2:172.21.15.190:6800/3296698407 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7faa9801a040 con 0x7faa8c06eb60 2023-11-28T18:37:39.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.395+0000 7ff915ffb640 1 -- 172.21.15.45:0/2082686982 <== osd.7 v2:172.21.15.190:6824/2493232051 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff9241575b0 con 0x7ff90806ebf0 2023-11-28T18:37:39.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.395+0000 7fda23c79640 1 -- 172.21.15.45:0/2125979401 --> [v2:172.21.15.190:6808/1537591987,v1:172.21.15.190:6809/1537591987] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fda1c14b4b0 con 0x7fda0006eb40 2023-11-28T18:37:39.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.395+0000 7f6bcffff640 1 -- 172.21.15.45:0/4136911427 <== osd.3 v2:172.21.15.45:6824/78541084 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6be8069480 con 0x7f6bd406eb40 2023-11-28T18:37:39.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.395+0000 7fda127fc640 1 -- 172.21.15.45:0/2125979401 <== osd.4 v2:172.21.15.190:6808/1537591987 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fda1c14b4b0 con 0x7fda0006eb40 2023-11-28T18:37:39.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.395+0000 7faaa70fe640 1 -- 172.21.15.45:0/3627359330 >> [v2:172.21.15.190:6800/3296698407,v1:172.21.15.190:6801/3296698407] conn(0x7faa8c06eb60 msgr2=0x7faa8c070f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.395+0000 7faaa70fe640 1 --2- 172.21.15.45:0/3627359330 >> [v2:172.21.15.190:6800/3296698407,v1:172.21.15.190:6801/3296698407] conn(0x7faa8c06eb60 0x7faa8c070f80 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.395+0000 7faaa70fe640 1 -- 172.21.15.45:0/3627359330 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7faa8c0669c0 msgr2=0x7faa8c068e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.395+0000 7faaa70fe640 1 --2- 172.21.15.45:0/3627359330 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7faa8c0669c0 0x7faa8c068e80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7faa90000f90 tx=0x7faa9000c040 comp rx=0 tx=0).stop 2023-11-28T18:37:39.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.395+0000 7faaa70fe640 1 -- 172.21.15.45:0/3627359330 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faaa015bf20 msgr2=0x7faaa0153520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.395+0000 7faaa70fe640 1 --2- 172.21.15.45:0/3627359330 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faaa015bf20 0x7faaa0153520 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7faa94006040 tx=0x7faa88005800 comp rx=0 tx=0).stop 2023-11-28T18:37:39.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.395+0000 7fda23c79640 1 -- 172.21.15.45:0/2125979401 >> [v2:172.21.15.190:6808/1537591987,v1:172.21.15.190:6809/1537591987] conn(0x7fda0006eb40 msgr2=0x7fda00070f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.395+0000 7fda23c79640 1 --2- 172.21.15.45:0/2125979401 >> [v2:172.21.15.190:6808/1537591987,v1:172.21.15.190:6809/1537591987] conn(0x7fda0006eb40 0x7fda00070f60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.395+0000 7faaa569b640 1 -- 172.21.15.45:0/3627359330 reap_dead start 2023-11-28T18:37:39.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.395+0000 7faaa70fe640 1 -- 172.21.15.45:0/3627359330 shutdown_connections 2023-11-28T18:37:39.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.395+0000 7faaa70fe640 1 -- 172.21.15.45:0/3627359330 >> 172.21.15.45:0/3627359330 conn(0x7faaa006c300 msgr2=0x7faaa00ccc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:39.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.395+0000 7fda23c79640 1 -- 172.21.15.45:0/2125979401 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fda00066920 msgr2=0x7fda00068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.395+0000 7fda23c79640 1 --2- 172.21.15.45:0/2125979401 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fda00066920 0x7fda00068de0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fda14001340 tx=0x7fda14009040 comp rx=0 tx=0).stop 2023-11-28T18:37:39.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.395+0000 7fda23c79640 1 -- 172.21.15.45:0/2125979401 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda1c15d1d0 msgr2=0x7fda1c15bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.395+0000 7fda23c79640 1 --2- 172.21.15.45:0/2125979401 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda1c15d1d0 0x7fda1c15bd80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fda0c01aaa0 tx=0x7fda0c019190 comp rx=0 tx=0).stop 2023-11-28T18:37:39.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.395+0000 7fda22216640 1 -- 172.21.15.45:0/2125979401 reap_dead start 2023-11-28T18:37:39.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.395+0000 7fda23c79640 1 -- 172.21.15.45:0/2125979401 shutdown_connections 2023-11-28T18:37:39.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.395+0000 7fda23c79640 1 -- 172.21.15.45:0/2125979401 >> 172.21.15.45:0/2125979401 conn(0x7fda1c06c300 msgr2=0x7fda1c0704a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:39.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.395+0000 7f6bee217640 1 -- 172.21.15.45:0/4136911427 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x7f6bd406eb40 msgr2=0x7f6bd4070f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.395+0000 7f6bee217640 1 --2- 172.21.15.45:0/4136911427 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x7f6bd406eb40 0x7f6bd4070f60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.395+0000 7ff92b757640 1 -- 172.21.15.45:0/2082686982 >> [v2:172.21.15.190:6824/2493232051,v1:172.21.15.190:6825/2493232051] conn(0x7ff90806ebf0 msgr2=0x7ff908071010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.395+0000 7ff92b757640 1 --2- 172.21.15.45:0/2082686982 >> [v2:172.21.15.190:6824/2493232051,v1:172.21.15.190:6825/2493232051] conn(0x7ff90806ebf0 0x7ff908071010 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.395+0000 7fda23c79640 1 -- 172.21.15.45:0/2125979401 shutdown_connections 2023-11-28T18:37:39.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.395+0000 7fda23c79640 1 -- 172.21.15.45:0/2125979401 wait complete. 2023-11-28T18:37:39.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.395+0000 7f6bee217640 1 -- 172.21.15.45:0/4136911427 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6bd4066920 msgr2=0x7f6bd4068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.395+0000 7f6bee217640 1 --2- 172.21.15.45:0/4136911427 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6bd4066920 0x7f6bd4068de0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6be80677c0 tx=0x7f6bdc009480 comp rx=0 tx=0).stop 2023-11-28T18:37:39.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.395+0000 7f6bee217640 1 -- 172.21.15.45:0/4136911427 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6be8071980 msgr2=0x7f6be80cd0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.395+0000 7f6bee217640 1 --2- 172.21.15.45:0/4136911427 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6be8071980 0x7f6be80cd0e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6bd801aaf0 tx=0x7f6bd801ac80 comp rx=0 tx=0).stop 2023-11-28T18:37:39.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.395+0000 7ff92b757640 1 -- 172.21.15.45:0/2082686982 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff9080669d0 msgr2=0x7ff908068e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.395+0000 7ff92b757640 1 --2- 172.21.15.45:0/2082686982 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff9080669d0 0x7ff908068e90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff9240b8e70 tx=0x7ff920009040 comp rx=0 tx=0).stop 2023-11-28T18:37:39.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.395+0000 7faaa70fe640 1 -- 172.21.15.45:0/3627359330 shutdown_connections 2023-11-28T18:37:39.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.395+0000 7faaa70fe640 1 -- 172.21.15.45:0/3627359330 wait complete. 2023-11-28T18:37:39.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.395+0000 7ff92b757640 1 -- 172.21.15.45:0/2082686982 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff9240b35f0 msgr2=0x7ff9240cc6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.395+0000 7ff92b757640 1 --2- 172.21.15.45:0/2082686982 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff9240b35f0 0x7ff9240cc6b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff91800c7f0 tx=0x7ff91800ccb0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.395+0000 7f6be7fff640 1 -- 172.21.15.45:0/4136911427 reap_dead start 2023-11-28T18:37:39.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.395+0000 7f6bee217640 1 -- 172.21.15.45:0/4136911427 shutdown_connections 2023-11-28T18:37:39.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.395+0000 7f6bee217640 1 -- 172.21.15.45:0/4136911427 >> 172.21.15.45:0/4136911427 conn(0x7f6be806c300 msgr2=0x7f6be80b2000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:39.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.395+0000 7ff929cf4640 1 -- 172.21.15.45:0/2082686982 reap_dead start 2023-11-28T18:37:39.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.395+0000 7ff92b757640 1 -- 172.21.15.45:0/2082686982 shutdown_connections 2023-11-28T18:37:39.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.395+0000 7ff92b757640 1 -- 172.21.15.45:0/2082686982 >> 172.21.15.45:0/2082686982 conn(0x7ff92409c4f0 msgr2=0x7ff9240b28c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:39.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.399+0000 7ff92b757640 1 -- 172.21.15.45:0/2082686982 shutdown_connections 2023-11-28T18:37:39.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.399+0000 7ff92b757640 1 -- 172.21.15.45:0/2082686982 wait complete. 2023-11-28T18:37:39.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.399+0000 7f6bee217640 1 -- 172.21.15.45:0/4136911427 shutdown_connections 2023-11-28T18:37:39.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.399+0000 7f6bee217640 1 -- 172.21.15.45:0/4136911427 wait complete. 2023-11-28T18:37:39.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.399+0000 7f249a8d6640 1 -- 172.21.15.45:0/3026042925 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f24940b1500 con 0x7f248006eb40 2023-11-28T18:37:39.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.403+0000 7f2490ff9640 1 -- 172.21.15.45:0/3026042925 <== osd.6 v2:172.21.15.190:6816/2317686718 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f24940b1500 con 0x7f248006eb40 2023-11-28T18:37:39.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.407+0000 7f249a8d6640 1 -- 172.21.15.45:0/3026042925 >> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] conn(0x7f248006eb40 msgr2=0x7f2480070f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.407+0000 7f249a8d6640 1 --2- 172.21.15.45:0/3026042925 >> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] conn(0x7f248006eb40 0x7f2480070f60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.407+0000 7f249a8d6640 1 -- 172.21.15.45:0/3026042925 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f2480066920 msgr2=0x7f2480068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.407+0000 7f249a8d6640 1 --2- 172.21.15.45:0/3026042925 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f2480066920 0x7f2480068de0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f24941470d0 tx=0x7f2484009040 comp rx=0 tx=0).stop 2023-11-28T18:37:39.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.407+0000 7f249a8d6640 1 -- 172.21.15.45:0/3026042925 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f249406e590 msgr2=0x7f24940c3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.407+0000 7f249a8d6640 1 --2- 172.21.15.45:0/3026042925 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f249406e590 0x7f24940c3f70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f248c0af040 tx=0x7f248c019780 comp rx=0 tx=0).stop 2023-11-28T18:37:39.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.407+0000 7f2498e73640 1 -- 172.21.15.45:0/3026042925 reap_dead start 2023-11-28T18:37:39.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.407+0000 7f249a8d6640 1 -- 172.21.15.45:0/3026042925 shutdown_connections 2023-11-28T18:37:39.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.407+0000 7f249a8d6640 1 -- 172.21.15.45:0/3026042925 >> 172.21.15.45:0/3026042925 conn(0x7f249406a570 msgr2=0x7f24940b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:39.450 INFO:teuthology.orchestra.run.smithi045.stdout:55834574854 2023-11-28T18:37:39.450 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-28T18:37:39.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.411+0000 7f249a8d6640 1 -- 172.21.15.45:0/3026042925 shutdown_connections 2023-11-28T18:37:39.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.411+0000 7f249a8d6640 1 -- 172.21.15.45:0/3026042925 wait complete. 2023-11-28T18:37:39.452 INFO:teuthology.orchestra.run.smithi045.stdout:55834574854 2023-11-28T18:37:39.452 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-28T18:37:39.453 INFO:teuthology.orchestra.run.smithi045.stdout:55834574855 2023-11-28T18:37:39.453 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-28T18:37:39.454 INFO:teuthology.orchestra.run.smithi045.stdout:55834574853 2023-11-28T18:37:39.454 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-28T18:37:39.455 INFO:teuthology.orchestra.run.smithi045.stdout:55834574854 2023-11-28T18:37:39.455 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-28T18:37:39.456 INFO:teuthology.orchestra.run.smithi045.stdout:55834574854 2023-11-28T18:37:39.456 INFO:teuthology.orchestra.run.smithi045.stdout:55834574856 2023-11-28T18:37:39.457 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-28T18:37:39.457 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-28T18:37:39.458 INFO:teuthology.orchestra.run.smithi045.stdout:55834574854 2023-11-28T18:37:39.459 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-28T18:37:39.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.735+0000 7fd5a73b8640 1 Processor -- start 2023-11-28T18:37:39.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.739+0000 7fd5a73b8640 1 -- start start 2023-11-28T18:37:39.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.739+0000 7fd5a73b8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5980e32b0 0x7fd59803e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.739+0000 7fd5a73b8640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd598053bf0 0x7fd598054050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.739+0000 7fd5a73b8640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd59803bfa0 con 0x7fd5980e6c10 2023-11-28T18:37:39.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.739+0000 7fd5a73b8640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd598058660 con 0x7fd598053bf0 2023-11-28T18:37:39.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.739+0000 7fd5a73b8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd598057dc0 con 0x7fd5980e32b0 2023-11-28T18:37:39.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.739+0000 7fd5a5154640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5980e32b0 0x7fd59803e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.739+0000 7fd5a5154640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5980e32b0 0x7fd59803e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.45:60224/0 (socket says 172.21.15.45:60224) 2023-11-28T18:37:39.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.739+0000 7fd5a5154640 1 -- 172.21.15.45:0/2520280555 learned_addr learned my addr 172.21.15.45:0/2520280555 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:39.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.739+0000 7fd5a4953640 1 --2- 172.21.15.45:0/2520280555 >> v2:172.21.15.190:3300/0 conn(0x7fd598053bf0 0x7fd598054050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.739+0000 7fd5a5154640 1 -- 172.21.15.45:0/2520280555 >> v2:172.21.15.190:3300/0 conn(0x7fd598053bf0 msgr2=0x7fd598054050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:39.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.739+0000 7fd5a5154640 1 --2- 172.21.15.45:0/2520280555 >> v2:172.21.15.190:3300/0 conn(0x7fd598053bf0 0x7fd598054050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.739+0000 7fa88d4ea640 1 Processor -- start 2023-11-28T18:37:39.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.739+0000 7fd5a5154640 1 -- 172.21.15.45:0/2520280555 >> v1:172.21.15.45:6789/0 conn(0x7fd5980e6c10 legacy=0x7fd5980e70a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:37:39.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.739+0000 7fd5a5154640 1 -- 172.21.15.45:0/2520280555 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd598054590 con 0x7fd5980e32b0 2023-11-28T18:37:39.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.743+0000 7fd5a4953640 1 --2- 172.21.15.45:0/2520280555 >> v2:172.21.15.190:3300/0 conn(0x7fd598053bf0 0x7fd598054050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:37:39.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.743+0000 7fa88d4ea640 1 -- start start 2023-11-28T18:37:39.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.743+0000 7fa88d4ea640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa8881594d0 0x7fa8880cb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.743+0000 7fa886ffd640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fa88815cdf0 0x7fa8880b2000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.45:59278/0 (socket says 172.21.15.45:59278) 2023-11-28T18:37:39.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.747+0000 7fa8867fc640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa8881594d0 0x7fa8880cb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.747+0000 7fa8867fc640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa8881594d0 0x7fa8880cb6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.45:42168/0 (socket says 172.21.15.45:42168) 2023-11-28T18:37:39.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.747+0000 7fa88d4ea640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8880ce880 con 0x7fa88815d1d0 2023-11-28T18:37:39.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.747+0000 7fa88d4ea640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa88815dd50 con 0x7fa88815cdf0 2023-11-28T18:37:39.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.747+0000 7fa88d4ea640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8880ce5a0 con 0x7fa8881594d0 2023-11-28T18:37:39.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.747+0000 7fd5a5154640 1 --2- 172.21.15.45:0/2520280555 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5980e32b0 0x7fd59803e820 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd59c009870 tx=0x7fd59c01c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e55c9546ad29f748 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:39.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.747+0000 7fa886ffd640 1 -- 172.21.15.45:0/3822651076 learned_addr learned my addr 172.21.15.45:0/3822651076 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:37:39.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.747+0000 7fd597fff640 1 -- 172.21.15.45:0/2520280555 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59c0aa5f0 con 0x7fd5980e32b0 2023-11-28T18:37:39.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.747+0000 7fa8867fc640 1 -- 172.21.15.45:0/3822651076 >> v1:172.21.15.190:6789/0 conn(0x7fa88815cdf0 legacy=0x7fa8880b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.747+0000 7fa8867fc640 1 -- 172.21.15.45:0/3822651076 >> v1:172.21.15.45:6789/0 conn(0x7fa88815d1d0 legacy=0x7fa88815d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.747+0000 7fa8867fc640 1 -- 172.21.15.45:0/3822651076 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa888070fc0 con 0x7fa8881594d0 2023-11-28T18:37:39.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.747+0000 7fd597fff640 1 -- 172.21.15.45:0/2520280555 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd59c0aa750 con 0x7fd5980e32b0 2023-11-28T18:37:39.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.747+0000 7fd597fff640 1 -- 172.21.15.45:0/2520280555 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59c0aaae0 con 0x7fd5980e32b0 2023-11-28T18:37:39.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.747+0000 7fd5a73b8640 1 -- 172.21.15.45:0/2520280555 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5980e32b0 msgr2=0x7fd59803e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.747+0000 7fd5a73b8640 1 --2- 172.21.15.45:0/2520280555 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5980e32b0 0x7fd59803e820 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd59c009870 tx=0x7fd59c01c4d0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.747+0000 7f9f8aa46640 1 Processor -- start 2023-11-28T18:37:39.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.747+0000 7fd5a73b8640 1 -- 172.21.15.45:0/2520280555 shutdown_connections 2023-11-28T18:37:39.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.747+0000 7fd5a73b8640 1 --2- 172.21.15.45:0/2520280555 >> v2:172.21.15.190:3300/0 conn(0x7fd598053bf0 0x7fd598054050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.747+0000 7fd5a73b8640 1 --2- 172.21.15.45:0/2520280555 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5980e32b0 0x7fd59803e820 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.747+0000 7fd5a73b8640 1 -- 172.21.15.45:0/2520280555 >> 172.21.15.45:0/2520280555 conn(0x7fd5980559c0 msgr2=0x7fd598055dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:39.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.747+0000 7f9f8aa46640 1 -- start start 2023-11-28T18:37:39.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.747+0000 7fd5a73b8640 1 -- 172.21.15.45:0/2520280555 shutdown_connections 2023-11-28T18:37:39.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.747+0000 7fd5a73b8640 1 -- 172.21.15.45:0/2520280555 wait complete. 2023-11-28T18:37:39.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.751+0000 7f9f8aa46640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9f840cfed0 0x7f9f840d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.751+0000 7f9f8aa46640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f840b3cb0 0x7f9f8415f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.751+0000 7f9f8aa46640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f840d38c0 con 0x7f9f840b35f0 2023-11-28T18:37:39.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.751+0000 7f9f8aa46640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f840d40d0 con 0x7f9f840cfed0 2023-11-28T18:37:39.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.751+0000 7f9f8aa46640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f840cdcc0 con 0x7f9f840b3cb0 2023-11-28T18:37:39.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.751+0000 7f9f83fff640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f9f840b35f0 0x7f9f840cf7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.45:59280/0 (socket says 172.21.15.45:59280) 2023-11-28T18:37:39.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.751+0000 7f9f83fff640 1 -- 172.21.15.45:0/150744865 learned_addr learned my addr 172.21.15.45:0/150744865 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:37:39.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.751+0000 7fd5a73b8640 1 Processor -- start 2023-11-28T18:37:39.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.751+0000 7f9f88fe3640 1 --2- 172.21.15.45:0/150744865 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f840b3cb0 0x7f9f8415f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.751+0000 7fd5a73b8640 1 -- start start 2023-11-28T18:37:39.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.751+0000 7fa8867fc640 1 --2- 172.21.15.45:0/3822651076 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa8881594d0 0x7fa8880cb6d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa878006200 tx=0x7fa87801cd60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa01ace47ff7a320 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:39.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.751+0000 7f9f82ffd640 1 -- 172.21.15.45:0/150744865 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1500004620 0 0) 0x7f9f840d38c0 con 0x7f9f840b35f0 2023-11-28T18:37:39.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.751+0000 7f9f837fe640 1 --2- 172.21.15.45:0/150744865 >> v2:172.21.15.45:3300/0 conn(0x7f9f840cfed0 0x7f9f840d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.751+0000 7f9f82ffd640 1 -- 172.21.15.45:0/150744865 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f6c003530 con 0x7f9f840b35f0 2023-11-28T18:37:39.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.751+0000 7fa885ffb640 1 -- 172.21.15.45:0/3822651076 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8780a5e30 con 0x7fa8881594d0 2023-11-28T18:37:39.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.751+0000 7fa885ffb640 1 -- 172.21.15.45:0/3822651076 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8780ad440 con 0x7fa8881594d0 2023-11-28T18:37:39.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.751+0000 7fa885ffb640 1 -- 172.21.15.45:0/3822651076 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8780ad7d0 con 0x7fa8881594d0 2023-11-28T18:37:39.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.751+0000 7fddbe180640 1 Processor -- start 2023-11-28T18:37:39.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.751+0000 7fddbe180640 1 -- start start 2023-11-28T18:37:39.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.751+0000 7fd5a73b8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd598053bf0 0x7fd5980e0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.751+0000 7fd5a73b8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5980e6c10 0x7fd5980e3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.751+0000 7fd5a73b8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd5980e5380 0x7fd5980e5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.755+0000 7fa88d4ea640 1 -- 172.21.15.45:0/3822651076 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa8881594d0 msgr2=0x7fa8880cb6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.755+0000 7fa88d4ea640 1 --2- 172.21.15.45:0/3822651076 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa8881594d0 0x7fa8880cb6d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa878006200 tx=0x7fa87801cd60 comp rx=0 tx=0).stop 2023-11-28T18:37:39.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.755+0000 7f9f82ffd640 1 -- 172.21.15.45:0/150744865 <== mon.1 v1:172.21.15.190:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3127037992 0 0) 0x7f9f6c003530 con 0x7f9f840b35f0 2023-11-28T18:37:39.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.755+0000 7f9f82ffd640 1 -- 172.21.15.45:0/150744865 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f840b3cb0 msgr2=0x7f9f8415f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:39.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.755+0000 7f9f82ffd640 1 --2- 172.21.15.45:0/150744865 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f840b3cb0 0x7f9f8415f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.755+0000 7f9f82ffd640 1 -- 172.21.15.45:0/150744865 >> v2:172.21.15.45:3300/0 conn(0x7f9f840cfed0 msgr2=0x7f9f840d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:39.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.755+0000 7f9f82ffd640 1 --2- 172.21.15.45:0/150744865 >> v2:172.21.15.45:3300/0 conn(0x7f9f840cfed0 0x7f9f840d0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.755+0000 7f9f82ffd640 1 -- 172.21.15.45:0/150744865 --> v1:172.21.15.190:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f840d3b10 con 0x7f9f840b35f0 2023-11-28T18:37:39.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.755+0000 7f9f82ffd640 1 -- 172.21.15.45:0/150744865 <== mon.1 v1:172.21.15.190:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4084481567 0 0) 0x7f9f7c001a00 con 0x7f9f840b35f0 2023-11-28T18:37:39.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.755+0000 7f9f82ffd640 1 -- 172.21.15.45:0/150744865 >> v1:172.21.15.190:6789/0 conn(0x7f9f840b35f0 legacy=0x7f9f840cf7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.755+0000 7f9f82ffd640 1 --2- 172.21.15.45:0/150744865 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f6c003980 0x7f9f6c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.755+0000 7f9f82ffd640 1 --2- 172.21.15.45:0/150744865 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9f6c004370 0x7f9f6c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.755+0000 7f9f82ffd640 1 --2- 172.21.15.45:0/150744865 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f6c004ec0 0x7f9f6c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.755+0000 7f9f82ffd640 1 -- 172.21.15.45:0/150744865 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f840d40d0 con 0x7f9f6c004ec0 2023-11-28T18:37:39.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.755+0000 7f9f82ffd640 1 -- 172.21.15.45:0/150744865 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f840cdcc0 con 0x7f9f6c004370 2023-11-28T18:37:39.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.755+0000 7f9f82ffd640 1 -- 172.21.15.45:0/150744865 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6c00bed0 con 0x7f9f6c003980 2023-11-28T18:37:39.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.755+0000 7fddbe180640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fddb80b3320 0x7fddb80b3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.755+0000 7fd5a73b8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5980e1c60 con 0x7fd598053bf0 2023-11-28T18:37:39.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.755+0000 7fd5a4953640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5980e6c10 0x7fd5980e3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.755+0000 7fd5a5955640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd5980e5380 0x7fd5980e5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.755+0000 7fd5a5955640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd5980e5380 0x7fd5980e5830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.45:42182/0 (socket says 172.21.15.45:42182) 2023-11-28T18:37:39.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.755+0000 7fd5a5955640 1 -- 172.21.15.45:0/2585951824 learned_addr learned my addr 172.21.15.45:0/2585951824 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:39.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.755+0000 7fd5a73b8640 1 -- 172.21.15.45:0/2585951824 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5980e13c0 con 0x7fd5980e5380 2023-11-28T18:37:39.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.755+0000 7fd5a73b8640 1 -- 172.21.15.45:0/2585951824 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5980e16a0 con 0x7fd5980e6c10 2023-11-28T18:37:39.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.755+0000 7fd5a5154640 1 --2- 172.21.15.45:0/2585951824 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd598053bf0 0x7fd5980e0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.755+0000 7fddbe180640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddb814b550 con 0x7fddb8070530 2023-11-28T18:37:39.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.755+0000 7f9f88fe3640 1 --2- 172.21.15.45:0/150744865 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f6c004ec0 0x7f9f6c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.755+0000 7f9f83fff640 1 --2- 172.21.15.45:0/150744865 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f6c003980 0x7f9f6c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.755+0000 7f9f837fe640 1 --2- 172.21.15.45:0/150744865 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9f6c004370 0x7f9f6c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.755+0000 7fddbe180640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddb8071aa0 con 0x7fddb80cccc0 2023-11-28T18:37:39.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.755+0000 7fddbe180640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddb80b3c40 con 0x7fddb80b3320 2023-11-28T18:37:39.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.755+0000 7fd5a5154640 1 -- 172.21.15.45:0/2585951824 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5980e6c10 msgr2=0x7fd5980e3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.755+0000 7fd5a5154640 1 --2- 172.21.15.45:0/2585951824 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5980e6c10 0x7fd5980e3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.755+0000 7fd5a5154640 1 -- 172.21.15.45:0/2585951824 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd5980e5380 msgr2=0x7fd5980e5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.755+0000 7fd5a5154640 1 --2- 172.21.15.45:0/2585951824 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd5980e5380 0x7fd5980e5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.755+0000 7fd5a5154640 1 -- 172.21.15.45:0/2585951824 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd59c0094d0 con 0x7fd598053bf0 2023-11-28T18:37:39.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.755+0000 7fd5a5955640 1 --2- 172.21.15.45:0/2585951824 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd5980e5380 0x7fd5980e5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:37:39.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.755+0000 7fd5a4953640 1 --2- 172.21.15.45:0/2585951824 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5980e6c10 0x7fd5980e3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:37:39.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.755+0000 7fddb77fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fddb80b3320 0x7fddb80b3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.755+0000 7fddb77fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fddb80b3320 0x7fddb80b3700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.45:60264/0 (socket says 172.21.15.45:60264) 2023-11-28T18:37:39.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.755+0000 7fddb77fe640 1 -- 172.21.15.45:0/3399169187 learned_addr learned my addr 172.21.15.45:0/3399169187 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:39.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.755+0000 7f9f88fe3640 1 -- 172.21.15.45:0/150744865 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f6c003980 msgr2=0x7f9f6c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:39.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.755+0000 7f9f88fe3640 1 --2- 172.21.15.45:0/150744865 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f6c003980 0x7f9f6c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.755+0000 7f9f88fe3640 1 -- 172.21.15.45:0/150744865 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9f6c004370 msgr2=0x7f9f6c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:39.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.755+0000 7f9f88fe3640 1 --2- 172.21.15.45:0/150744865 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9f6c004370 0x7f9f6c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.755+0000 7f9f88fe3640 1 -- 172.21.15.45:0/150744865 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f840d3b10 con 0x7f9f6c004ec0 2023-11-28T18:37:39.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.755+0000 7f9f837fe640 1 --2- 172.21.15.45:0/150744865 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9f6c004370 0x7f9f6c004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:37:39.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.755+0000 7fddb77fe640 1 -- 172.21.15.45:0/3399169187 >> v1:172.21.15.190:6789/0 conn(0x7fddb80cccc0 legacy=0x7fddb80cd130 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-28T18:37:39.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.755+0000 7fddb77fe640 1 -- 172.21.15.45:0/3399169187 >> v1:172.21.15.45:6789/0 conn(0x7fddb8070530 legacy=0x7fddb8071390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:39.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.755+0000 7fddb77fe640 1 -- 172.21.15.45:0/3399169187 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb8071d30 con 0x7fddb80b3320 2023-11-28T18:37:39.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.755+0000 7fd5a5154640 1 --2- 172.21.15.45:0/2585951824 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd598053bf0 0x7fd5980e0cc0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd59c0ab000 tx=0x7fd59c01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:39.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.755+0000 7fa88d4ea640 1 -- 172.21.15.45:0/3822651076 shutdown_connections 2023-11-28T18:37:39.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.755+0000 7fa88d4ea640 1 --2- 172.21.15.45:0/3822651076 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa8881594d0 0x7fa8880cb6d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.755+0000 7fa88d4ea640 1 -- 172.21.15.45:0/3822651076 >> 172.21.15.45:0/3822651076 conn(0x7fa88806c300 msgr2=0x7fa88806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:39.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.755+0000 7fd595ffb640 1 -- 172.21.15.45:0/2585951824 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59c0b3800 con 0x7fd598053bf0 2023-11-28T18:37:39.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.755+0000 7fd595ffb640 1 -- 172.21.15.45:0/2585951824 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd59c0b3980 con 0x7fd598053bf0 2023-11-28T18:37:39.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.759+0000 7fd595ffb640 1 -- 172.21.15.45:0/2585951824 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59c0b3d30 con 0x7fd598053bf0 2023-11-28T18:37:39.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.759+0000 7fd5a73b8640 1 -- 172.21.15.45:0/2585951824 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5980e1980 con 0x7fd598053bf0 2023-11-28T18:37:39.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.759+0000 7fa88d4ea640 1 -- 172.21.15.45:0/3822651076 shutdown_connections 2023-11-28T18:37:39.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.759+0000 7fa88d4ea640 1 -- 172.21.15.45:0/3822651076 wait complete. 2023-11-28T18:37:39.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.759+0000 7fd5a73b8640 1 -- 172.21.15.45:0/2585951824 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5980e3ea0 con 0x7fd598053bf0 2023-11-28T18:37:39.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.759+0000 7f1cb55a7640 1 Processor -- start 2023-11-28T18:37:39.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.759+0000 7f10acd72640 1 Processor -- start 2023-11-28T18:37:39.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.759+0000 7fd5a73b8640 1 -- 172.21.15.45:0/2585951824 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd59804c7f0 con 0x7fd598053bf0 2023-11-28T18:37:39.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.759+0000 7f9f88fe3640 1 --2- 172.21.15.45:0/150744865 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f6c004ec0 0x7f9f6c00b990 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9f840b4090 tx=0x7f9f7401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec4d4fdede3bf7fc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:39.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.759+0000 7f10acd72640 1 -- start start 2023-11-28T18:37:39.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.759+0000 7fddb77fe640 1 --2- 172.21.15.45:0/3399169187 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fddb80b3320 0x7fddb80b3700 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fdda00098a0 tx=0x7fdda001c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44ed7796f0d823f3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:39.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.759+0000 7f1cb55a7640 1 -- start start 2023-11-28T18:37:39.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.759+0000 7f1cb55a7640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1ca80e7970 0x7f1ca803b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.759+0000 7f1cb55a7640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1ca80e7d50 0x7f1ca8052a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.759+0000 7f1cb55a7640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ca8056a70 con 0x7f1ca8039b00 2023-11-28T18:37:39.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.759+0000 7f1cb55a7640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ca803bb30 con 0x7f1ca80e7d50 2023-11-28T18:37:39.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.759+0000 7f1cb55a7640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca803be10 con 0x7f1ca80e7970 2023-11-28T18:37:39.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.759+0000 7f9f82ffd640 1 -- 172.21.15.45:0/150744865 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f740a6510 con 0x7f9f6c004ec0 2023-11-28T18:37:39.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.759+0000 7f9f82ffd640 1 -- 172.21.15.45:0/150744865 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f740a6670 con 0x7f9f6c004ec0 2023-11-28T18:37:39.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.759+0000 7f9f82ffd640 1 -- 172.21.15.45:0/150744865 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f740a6a60 con 0x7f9f6c004ec0 2023-11-28T18:37:39.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.759+0000 7fa88d4ea640 1 Processor -- start 2023-11-28T18:37:39.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.763+0000 7f10acd72640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10a80b35f0 0x7f10a80d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.763+0000 7f10acd72640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f10a80cfed0 0x7f10a815f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.763+0000 7f10acd72640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10a80d38c0 con 0x7f10a80b3cb0 2023-11-28T18:37:39.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.763+0000 7f10acd72640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10a80d40d0 con 0x7f10a80cfed0 2023-11-28T18:37:39.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.763+0000 7f10acd72640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10a80cdcc0 con 0x7f10a80b35f0 2023-11-28T18:37:39.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.763+0000 7fddb6ffd640 1 -- 172.21.15.45:0/3399169187 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda00ac640 con 0x7fddb80b3320 2023-11-28T18:37:39.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.763+0000 7fddb6ffd640 1 -- 172.21.15.45:0/3399169187 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdda00ac7a0 con 0x7fddb80b3320 2023-11-28T18:37:39.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.763+0000 7fddb6ffd640 1 -- 172.21.15.45:0/3399169187 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda00acb30 con 0x7fddb80b3320 2023-11-28T18:37:39.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.763+0000 7f1caffff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1ca80e7970 0x7f1ca803b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.763+0000 7f1caffff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1ca80e7970 0x7f1ca803b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.45:60270/0 (socket says 172.21.15.45:60270) 2023-11-28T18:37:39.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.763+0000 7f1caffff640 1 -- 172.21.15.45:0/920593669 learned_addr learned my addr 172.21.15.45:0/920593669 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:39.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.763+0000 7f10a659c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10a80b35f0 0x7f10a80d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.763+0000 7fa88d4ea640 1 -- start start 2023-11-28T18:37:39.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.763+0000 7f10a659c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10a80b35f0 0x7f10a80d0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.45:60272/0 (socket says 172.21.15.45:60272) 2023-11-28T18:37:39.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.763+0000 7f10a659c640 1 -- 172.21.15.45:0/3885436200 learned_addr learned my addr 172.21.15.45:0/3885436200 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:39.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.763+0000 7f1caffff640 1 -- 172.21.15.45:0/920593669 >> v2:172.21.15.45:3300/0 conn(0x7f1ca80e7d50 msgr2=0x7f1ca8052a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:39.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.763+0000 7f1caffff640 1 --2- 172.21.15.45:0/920593669 >> v2:172.21.15.45:3300/0 conn(0x7f1ca80e7d50 0x7f1ca8052a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.763+0000 7f1caffff640 1 -- 172.21.15.45:0/920593669 >> v1:172.21.15.45:6789/0 conn(0x7f1ca8039b00 legacy=0x7f1ca8051300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:39.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.763+0000 7fddbe180640 1 -- 172.21.15.45:0/3399169187 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fddb80b3320 msgr2=0x7fddb80b3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.763+0000 7fddbe180640 1 --2- 172.21.15.45:0/3399169187 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fddb80b3320 0x7fddb80b3700 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fdda00098a0 tx=0x7fdda001c420 comp rx=0 tx=0).stop 2023-11-28T18:37:39.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.763+0000 7fa88d4ea640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa8881594d0 0x7fa888147910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.763+0000 7fa88d4ea640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa88815cdf0 0x7fa88814cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.763+0000 7fa88d4ea640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa88815d1d0 0x7fa88814b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.763+0000 7f1caffff640 1 -- 172.21.15.45:0/920593669 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ca803c0f0 con 0x7f1ca80e7970 2023-11-28T18:37:39.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.763+0000 7fa88d4ea640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa88814c950 con 0x7fa88815cdf0 2023-11-28T18:37:39.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.763+0000 7fa88d4ea640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa888147e50 con 0x7fa88815d1d0 2023-11-28T18:37:39.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.763+0000 7fa88d4ea640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa88814bcd0 con 0x7fa8881594d0 2023-11-28T18:37:39.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.763+0000 7f9f8aa46640 1 -- 172.21.15.45:0/150744865 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f6c004ec0 msgr2=0x7f9f6c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.763+0000 7f9f8aa46640 1 --2- 172.21.15.45:0/150744865 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f6c004ec0 0x7f9f6c00b990 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9f840b4090 tx=0x7f9f7401c910 comp rx=0 tx=0).stop 2023-11-28T18:37:39.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.763+0000 7f9f88fe3640 1 -- 172.21.15.45:0/150744865 reap_dead start 2023-11-28T18:37:39.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.763+0000 7fa886ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa8881594d0 0x7fa888147910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.763+0000 7fa8877fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa88815d1d0 0x7fa88814b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.763+0000 7f10a6d9d640 1 --2- 172.21.15.45:0/3885436200 >> v2:172.21.15.45:3300/0 conn(0x7f10a80cfed0 0x7f10a815f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.763+0000 7fa886ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa8881594d0 0x7fa888147910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.45:60284/0 (socket says 172.21.15.45:60284) 2023-11-28T18:37:39.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.763+0000 7fa886ffd640 1 -- 172.21.15.45:0/3930937248 learned_addr learned my addr 172.21.15.45:0/3930937248 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:39.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.763+0000 7fa8867fc640 1 --2- 172.21.15.45:0/3930937248 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa88815cdf0 0x7fa88814cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.763+0000 7f9f8aa46640 1 -- 172.21.15.45:0/150744865 shutdown_connections 2023-11-28T18:37:39.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.763+0000 7f9f8aa46640 1 -- 172.21.15.45:0/150744865 >> 172.21.15.45:0/150744865 conn(0x7f9f8409c4f0 msgr2=0x7f9f840d31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:39.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.763+0000 7f10a6d9d640 1 -- 172.21.15.45:0/3885436200 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10a80b35f0 msgr2=0x7f10a80d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:39.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.763+0000 7f10a6d9d640 1 --2- 172.21.15.45:0/3885436200 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10a80b35f0 0x7f10a80d0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.763+0000 7f10a6d9d640 1 -- 172.21.15.45:0/3885436200 >> v1:172.21.15.190:6789/0 conn(0x7f10a80b3cb0 legacy=0x7f10a80cf7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.763+0000 7f10a6d9d640 1 -- 172.21.15.45:0/3885436200 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10a80d3b10 con 0x7f10a80cfed0 2023-11-28T18:37:39.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.763+0000 7f9f8aa46640 1 -- 172.21.15.45:0/150744865 shutdown_connections 2023-11-28T18:37:39.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.763+0000 7fa886ffd640 1 -- 172.21.15.45:0/3930937248 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa88815d1d0 msgr2=0x7fa88814b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.763+0000 7fa886ffd640 1 --2- 172.21.15.45:0/3930937248 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa88815d1d0 0x7fa88814b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.763+0000 7fa886ffd640 1 -- 172.21.15.45:0/3930937248 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa88815cdf0 msgr2=0x7fa88814cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.763+0000 7fa886ffd640 1 --2- 172.21.15.45:0/3930937248 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa88815cdf0 0x7fa88814cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.763+0000 7fa886ffd640 1 -- 172.21.15.45:0/3930937248 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa878007470 con 0x7fa8881594d0 2023-11-28T18:37:39.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.763+0000 7fa8867fc640 1 --2- 172.21.15.45:0/3930937248 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa88815cdf0 0x7fa88814cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:37:39.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.763+0000 7fd595ffb640 1 -- 172.21.15.45:0/2585951824 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fd59c0c6390 con 0x7fd598053bf0 2023-11-28T18:37:39.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.763+0000 7fcd6b5d8640 1 Processor -- start 2023-11-28T18:37:39.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.763+0000 7fcd6b5d8640 1 -- start start 2023-11-28T18:37:39.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.767+0000 7fa886ffd640 1 --2- 172.21.15.45:0/3930937248 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa8881594d0 0x7fa888147910 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa88000cb10 tx=0x7fa88000a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:39.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.767+0000 7fddbe180640 1 -- 172.21.15.45:0/3399169187 shutdown_connections 2023-11-28T18:37:39.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.767+0000 7fddbe180640 1 --2- 172.21.15.45:0/3399169187 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fddb80b3320 0x7fddb80b3700 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.767+0000 7fddbe180640 1 -- 172.21.15.45:0/3399169187 >> 172.21.15.45:0/3399169187 conn(0x7fddb806c300 msgr2=0x7fddb806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:39.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.767+0000 7fd595ffb640 1 --2- 172.21.15.45:0/2585951824 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fd5840669d0 0x7fd584068e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.767+0000 7fd595ffb640 1 -- 172.21.15.45:0/2585951824 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd59c0a7070 con 0x7fd598053bf0 2023-11-28T18:37:39.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.763+0000 7f9f8aa46640 1 -- 172.21.15.45:0/150744865 wait complete. 2023-11-28T18:37:39.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.767+0000 7f9f8aa46640 1 Processor -- start 2023-11-28T18:37:39.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.767+0000 7f1caffff640 1 --2- 172.21.15.45:0/920593669 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1ca80e7970 0x7f1ca803b450 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1cb0069370 tx=0x7f1cb0096a50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e76bbe9587af573b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:39.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.767+0000 7f9f8aa46640 1 -- start start 2023-11-28T18:37:39.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.767+0000 7fcd6b5d8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcd6406ca10 0x7fcd64145290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.767+0000 7fcd6b5d8640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd64146000 con 0x7fcd6415bcd0 2023-11-28T18:37:39.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.767+0000 7fcd6b5d8640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd641462e0 con 0x7fcd6415c0b0 2023-11-28T18:37:39.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.767+0000 7fcd6b5d8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd641465c0 con 0x7fcd6406ca10 2023-11-28T18:37:39.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.767+0000 7fcd69b75640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fcd6415c0b0 0x7fcd641457d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.45:59308/0 (socket says 172.21.15.45:59308) 2023-11-28T18:37:39.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.767+0000 7fcd69b75640 1 -- 172.21.15.45:0/2617351403 learned_addr learned my addr 172.21.15.45:0/2617351403 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:37:39.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.767+0000 7fddbe180640 1 -- 172.21.15.45:0/3399169187 shutdown_connections 2023-11-28T18:37:39.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.767+0000 7fddbe180640 1 -- 172.21.15.45:0/3399169187 wait complete. 2023-11-28T18:37:39.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.767+0000 7fddbe180640 1 Processor -- start 2023-11-28T18:37:39.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.767+0000 7f1caeffd640 1 -- 172.21.15.45:0/920593669 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb011f800 con 0x7f1ca80e7970 2023-11-28T18:37:39.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.767+0000 7f1caeffd640 1 -- 172.21.15.45:0/920593669 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cb011f9a0 con 0x7f1ca80e7970 2023-11-28T18:37:39.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.767+0000 7f1caeffd640 1 -- 172.21.15.45:0/920593669 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb011fdf0 con 0x7f1ca80e7970 2023-11-28T18:37:39.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.767+0000 7fcd68b73640 1 --2- 172.21.15.45:0/2617351403 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcd6406ca10 0x7fcd64145290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.767+0000 7fd5a4953640 1 --2- 172.21.15.45:0/2585951824 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fd5840669d0 0x7fd584068e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.767+0000 7ffa7cff8640 1 Processor -- start 2023-11-28T18:37:39.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.767+0000 7ffa7cff8640 1 -- start start 2023-11-28T18:37:39.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.767+0000 7fcd68b73640 1 -- 172.21.15.45:0/2617351403 >> v1:172.21.15.190:6789/0 conn(0x7fcd6415c0b0 legacy=0x7fcd641457d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.767+0000 7fcd68b73640 1 -- 172.21.15.45:0/2617351403 >> v1:172.21.15.45:6789/0 conn(0x7fcd6415bcd0 legacy=0x7fcd6406c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:39.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.767+0000 7fcd63fff640 1 -- 172.21.15.45:0/2617351403 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4034392971 0 0) 0x7fcd641462e0 con 0x7fcd6415c0b0 2023-11-28T18:37:39.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.767+0000 7fcd68b73640 1 -- 172.21.15.45:0/2617351403 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd641468a0 con 0x7fcd6406ca10 2023-11-28T18:37:39.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.767+0000 7f10a6d9d640 1 --2- 172.21.15.45:0/3885436200 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10a80cfed0 0x7f10a815f0a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f10a0009d90 tx=0x7f10a001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7c0f693dbf7cc75 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:39.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.771+0000 7fddbe180640 1 -- start start 2023-11-28T18:37:39.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.771+0000 7f9f8aa46640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f6c004ec0 0x7f9f841ffc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.767+0000 7fa86f7fe640 1 -- 172.21.15.45:0/3930937248 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88000ac70 con 0x7fa8881594d0 2023-11-28T18:37:39.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.767+0000 7fa86f7fe640 1 -- 172.21.15.45:0/3930937248 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa88000add0 con 0x7fa8881594d0 2023-11-28T18:37:39.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.767+0000 7fa86f7fe640 1 -- 172.21.15.45:0/3930937248 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa880012620 con 0x7fa8881594d0 2023-11-28T18:37:39.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.771+0000 7f9f8aa46640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9f840b89e0 0x7f9f8415f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.771+0000 7fa88d4ea640 1 -- 172.21.15.45:0/3930937248 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa88814bfb0 con 0x7fa8881594d0 2023-11-28T18:37:39.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.771+0000 7fa88d4ea640 1 -- 172.21.15.45:0/3930937248 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa88814c570 con 0x7fa8881594d0 2023-11-28T18:37:39.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.771+0000 7f1cb55a7640 1 -- 172.21.15.45:0/920593669 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1ca80e7970 msgr2=0x7f1ca803b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.771+0000 7f1cb55a7640 1 --2- 172.21.15.45:0/920593669 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1ca80e7970 0x7f1ca803b450 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1cb0069370 tx=0x7f1cb0096a50 comp rx=0 tx=0).stop 2023-11-28T18:37:39.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.771+0000 7f9f83fff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f6c004ec0 0x7f9f841ffc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.771+0000 7f9f83fff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f6c004ec0 0x7f9f841ffc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.45:60300/0 (socket says 172.21.15.45:60300) 2023-11-28T18:37:39.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.771+0000 7f9f83fff640 1 -- 172.21.15.45:0/3718407816 learned_addr learned my addr 172.21.15.45:0/3718407816 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:39.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.771+0000 7f9f8aa46640 1 --2- 172.21.15.45:0/3718407816 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f8409f170 0x7f9f8409f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.771+0000 7f9f837fe640 1 --2- 172.21.15.45:0/3718407816 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9f840b89e0 0x7f9f8415f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.771+0000 7ffa7cff8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ffa78070530 0x7ffa78071390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.771+0000 7ffa7cff8640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ffa780cccc0 0x7ffa780cd110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.771+0000 7ffa7cff8640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa7814b550 con 0x7ffa780b3320 2023-11-28T18:37:39.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.771+0000 7f9f8aa46640 1 -- 172.21.15.45:0/3718407816 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f84200140 con 0x7f9f8409f170 2023-11-28T18:37:39.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.771+0000 7f9f8aa46640 1 -- 172.21.15.45:0/3718407816 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8409fb30 con 0x7f9f840b89e0 2023-11-28T18:37:39.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.771+0000 7f9f8aa46640 1 -- 172.21.15.45:0/3718407816 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8409cf60 con 0x7f9f6c004ec0 2023-11-28T18:37:39.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.771+0000 7ffa7cff8640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa78071d30 con 0x7ffa78070530 2023-11-28T18:37:39.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.771+0000 7ffa7cff8640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa78072010 con 0x7ffa780cccc0 2023-11-28T18:37:39.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.771+0000 7f9f88fe3640 1 --2- 172.21.15.45:0/3718407816 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f8409f170 0x7f9f8409f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.771+0000 7f1cb55a7640 1 -- 172.21.15.45:0/920593669 shutdown_connections 2023-11-28T18:37:39.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.771+0000 7f1cb55a7640 1 --2- 172.21.15.45:0/920593669 >> v2:172.21.15.45:3300/0 conn(0x7f1ca80e7d50 0x7f1ca8052a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.771+0000 7f1cb55a7640 1 --2- 172.21.15.45:0/920593669 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1ca80e7970 0x7f1ca803b450 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.771+0000 7f1cb55a7640 1 -- 172.21.15.45:0/920593669 >> 172.21.15.45:0/920593669 conn(0x7f1ca8056cb0 msgr2=0x7f1ca80570c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:39.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.771+0000 7fddbe180640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fddb8070530 0x7fddb8163ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.771+0000 7fddbe180640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fddb80b3320 0x7fddb8202840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.771+0000 7fddbe180640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fddb80cccc0 0x7fddb8146c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.771+0000 7fd5a4953640 1 --2- 172.21.15.45:0/2585951824 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fd5840669d0 0x7fd584068e90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd5980df6a0 tx=0x7fd590008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:39.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.771+0000 7fddbe180640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb8164330 con 0x7fddb80cccc0 2023-11-28T18:37:39.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.771+0000 7fddbe180640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb8161d70 con 0x7fddb80b3320 2023-11-28T18:37:39.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.771+0000 7fddbe180640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddb8162050 con 0x7fddb8070530 2023-11-28T18:37:39.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.771+0000 7f9f83fff640 1 -- 172.21.15.45:0/3718407816 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9f840b89e0 msgr2=0x7f9f8415f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.771+0000 7fddaffff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fddb80b3320 0x7fddb8202840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.771+0000 7fddaffff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fddb80b3320 0x7fddb8202840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.45:42234/0 (socket says 172.21.15.45:42234) 2023-11-28T18:37:39.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.771+0000 7fddaffff640 1 -- 172.21.15.45:0/916772822 learned_addr learned my addr 172.21.15.45:0/916772822 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:39.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.771+0000 7ffa7659c640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7ffa780b3320 0x7ffa780b3700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.45:59320/0 (socket says 172.21.15.45:59320) 2023-11-28T18:37:39.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.771+0000 7ffa7659c640 1 -- 172.21.15.45:0/3369648394 learned_addr learned my addr 172.21.15.45:0/3369648394 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:37:39.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.771+0000 7ffa76d9d640 1 --2- 172.21.15.45:0/3369648394 >> v2:172.21.15.190:3300/0 conn(0x7ffa780cccc0 0x7ffa780cd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.771+0000 7fa88d4ea640 1 -- 172.21.15.45:0/3930937248 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa88814cbc0 con 0x7fa8881594d0 2023-11-28T18:37:39.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.771+0000 7f9f83fff640 1 --2- 172.21.15.45:0/3718407816 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9f840b89e0 0x7f9f8415f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.771+0000 7f9f83fff640 1 -- 172.21.15.45:0/3718407816 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f8409f170 msgr2=0x7f9f8409f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.771+0000 7fddb7fff640 1 --2- 172.21.15.45:0/916772822 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fddb80cccc0 0x7fddb8146c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.771+0000 7f9f83fff640 1 --2- 172.21.15.45:0/3718407816 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f8409f170 0x7f9f8409f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.771+0000 7fddaffff640 1 -- 172.21.15.45:0/916772822 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fddb8070530 msgr2=0x7fddb8163ae0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-28T18:37:39.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.771+0000 7fddaffff640 1 --2- 172.21.15.45:0/916772822 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fddb8070530 0x7fddb8163ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.771+0000 7fddaffff640 1 -- 172.21.15.45:0/916772822 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fddb80cccc0 msgr2=0x7fddb8146c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.771+0000 7fddaffff640 1 --2- 172.21.15.45:0/916772822 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fddb80cccc0 0x7fddb8146c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.771+0000 7fddaffff640 1 -- 172.21.15.45:0/916772822 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdda00094d0 con 0x7fddb80b3320 2023-11-28T18:37:39.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.771+0000 7f9f83fff640 1 -- 172.21.15.45:0/3718407816 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f8409d1b0 con 0x7f9f6c004ec0 2023-11-28T18:37:39.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.771+0000 7f9f837fe640 1 --2- 172.21.15.45:0/3718407816 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9f840b89e0 0x7f9f8415f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:37:39.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.771+0000 7f1cb55a7640 1 -- 172.21.15.45:0/920593669 shutdown_connections 2023-11-28T18:37:39.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.771+0000 7ffa75d9b640 1 --2- 172.21.15.45:0/3369648394 >> v2:172.21.15.45:3300/0 conn(0x7ffa78070530 0x7ffa78071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.771+0000 7fddaffff640 1 --2- 172.21.15.45:0/916772822 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fddb80b3320 0x7fddb8202840 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdda800c410 tx=0x7fdda800c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:39.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.771+0000 7ffa7559a640 1 -- 172.21.15.45:0/3369648394 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1022925491 0 0) 0x7ffa7814b550 con 0x7ffa780b3320 2023-11-28T18:37:39.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.771+0000 7ffa7559a640 1 -- 172.21.15.45:0/3369648394 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa5c003530 con 0x7ffa780b3320 2023-11-28T18:37:39.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.771+0000 7f1cb55a7640 1 -- 172.21.15.45:0/920593669 wait complete. 2023-11-28T18:37:39.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.775+0000 7f9f83fff640 1 --2- 172.21.15.45:0/3718407816 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f6c004ec0 0x7f9f841ffc00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c007b50 tx=0x7f9f7c00e530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:39.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.775+0000 7fddb4ff9640 1 -- 172.21.15.45:0/916772822 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda8011790 con 0x7fddb80b3320 2023-11-28T18:37:39.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.775+0000 7fddb4ff9640 1 -- 172.21.15.45:0/916772822 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdda80118f0 con 0x7fddb80b3320 2023-11-28T18:37:39.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.775+0000 7f9f80ff9640 1 -- 172.21.15.45:0/3718407816 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c00eeb0 con 0x7f9f6c004ec0 2023-11-28T18:37:39.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.775+0000 7ffa7559a640 1 -- 172.21.15.45:0/3369648394 <== mon.1 v1:172.21.15.190:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 872503973 0 0) 0x7ffa5c003530 con 0x7ffa780b3320 2023-11-28T18:37:39.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.775+0000 7ffa7559a640 1 -- 172.21.15.45:0/3369648394 >> v2:172.21.15.190:3300/0 conn(0x7ffa780cccc0 msgr2=0x7ffa780cd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:39.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.775+0000 7ffa7559a640 1 --2- 172.21.15.45:0/3369648394 >> v2:172.21.15.190:3300/0 conn(0x7ffa780cccc0 0x7ffa780cd110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.775+0000 7ffa7559a640 1 -- 172.21.15.45:0/3369648394 >> v2:172.21.15.45:3300/0 conn(0x7ffa78070530 msgr2=0x7ffa78071390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:39.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.775+0000 7ffa7559a640 1 --2- 172.21.15.45:0/3369648394 >> v2:172.21.15.45:3300/0 conn(0x7ffa78070530 0x7ffa78071390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.775+0000 7ffa7559a640 1 -- 172.21.15.45:0/3369648394 --> v1:172.21.15.190:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa780722f0 con 0x7ffa780b3320 2023-11-28T18:37:39.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.775+0000 7ffa7559a640 1 -- 172.21.15.45:0/3369648394 <== mon.1 v1:172.21.15.190:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4084481567 0 0) 0x7ffa64001680 con 0x7ffa780b3320 2023-11-28T18:37:39.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.775+0000 7ffa7559a640 1 -- 172.21.15.45:0/3369648394 >> v1:172.21.15.190:6789/0 conn(0x7ffa780b3320 legacy=0x7ffa780b3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.775+0000 7ffa7559a640 1 --2- 172.21.15.45:0/3369648394 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffa5c003980 0x7ffa5c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.775+0000 7ffa7559a640 1 --2- 172.21.15.45:0/3369648394 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa5c0047d0 0x7ffa5c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.775+0000 7ffa7559a640 1 --2- 172.21.15.45:0/3369648394 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffa5c005190 0x7ffa5c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.775+0000 7ffa7559a640 1 -- 172.21.15.45:0/3369648394 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa78071d30 con 0x7ffa5c0047d0 2023-11-28T18:37:39.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.775+0000 7ffa7559a640 1 -- 172.21.15.45:0/3369648394 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa78072010 con 0x7ffa5c003980 2023-11-28T18:37:39.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.775+0000 7f9f8aa46640 1 -- 172.21.15.45:0/3718407816 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f8409d490 con 0x7f9f6c004ec0 2023-11-28T18:37:39.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.775+0000 7ffa7559a640 1 -- 172.21.15.45:0/3369648394 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5c00bfd0 con 0x7ffa5c005190 2023-11-28T18:37:39.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.775+0000 7fddb4ff9640 1 -- 172.21.15.45:0/916772822 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda8011ce0 con 0x7fddb80b3320 2023-11-28T18:37:39.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.775+0000 7f9f80ff9640 1 -- 172.21.15.45:0/3718407816 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f7c013420 con 0x7f9f6c004ec0 2023-11-28T18:37:39.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.775+0000 7fddbe180640 1 -- 172.21.15.45:0/916772822 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddb8162330 con 0x7fddb80b3320 2023-11-28T18:37:39.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.775+0000 7f9f8aa46640 1 -- 172.21.15.45:0/3718407816 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f8409da50 con 0x7f9f6c004ec0 2023-11-28T18:37:39.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.775+0000 7fddbe180640 1 -- 172.21.15.45:0/916772822 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddb8164020 con 0x7fddb80b3320 2023-11-28T18:37:39.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.775+0000 7ffa75d9b640 1 --2- 172.21.15.45:0/3369648394 >> v2:172.21.15.45:3300/0 conn(0x7ffa78070530 0x7ffa78071390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:37:39.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.775+0000 7ffa76d9d640 1 --2- 172.21.15.45:0/3369648394 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffa5c005190 0x7ffa5c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.775+0000 7fa86f7fe640 1 -- 172.21.15.45:0/3930937248 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa880007070 con 0x7fa8881594d0 2023-11-28T18:37:39.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.775+0000 7fa86f7fe640 1 --2- 172.21.15.45:0/3930937248 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa874066950 0x7fa874068e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.775+0000 7f9f80ff9640 1 -- 172.21.15.45:0/3718407816 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c00eeb0 con 0x7f9f6c004ec0 2023-11-28T18:37:39.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.775+0000 7ffa7659c640 1 --2- 172.21.15.45:0/3369648394 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffa5c003980 0x7ffa5c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.775+0000 7fa86f7fe640 1 -- 172.21.15.45:0/3930937248 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa880084300 con 0x7fa8881594d0 2023-11-28T18:37:39.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.775+0000 7fddbe180640 1 -- 172.21.15.45:0/916772822 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddb81627e0 con 0x7fddb80b3320 2023-11-28T18:37:39.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.775+0000 7ffa76d9d640 1 -- 172.21.15.45:0/3369648394 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffa5c003980 msgr2=0x7ffa5c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:39.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.775+0000 7ffa76d9d640 1 --2- 172.21.15.45:0/3369648394 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffa5c003980 0x7ffa5c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.775+0000 7ffa76d9d640 1 -- 172.21.15.45:0/3369648394 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa5c0047d0 msgr2=0x7ffa5c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:39.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.775+0000 7ffa76d9d640 1 --2- 172.21.15.45:0/3369648394 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa5c0047d0 0x7ffa5c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.775+0000 7ffa76d9d640 1 -- 172.21.15.45:0/3369648394 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa780722f0 con 0x7ffa5c005190 2023-11-28T18:37:39.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.775+0000 7ffa7659c640 1 --2- 172.21.15.45:0/3369648394 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffa5c003980 0x7ffa5c003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:37:39.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.775+0000 7fa8867fc640 1 --2- 172.21.15.45:0/3930937248 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa874066950 0x7fa874068e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.775+0000 7f1cb55a7640 1 Processor -- start 2023-11-28T18:37:39.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.775+0000 7fcd68b73640 1 --2- 172.21.15.45:0/2617351403 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcd6406ca10 0x7fcd64145290 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fcd580097f0 tx=0x7fcd5801c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=adb6461e7c9771e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:39.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.775+0000 7f10a559a640 1 -- 172.21.15.45:0/3885436200 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a00a5a10 con 0x7f10a80cfed0 2023-11-28T18:37:39.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.775+0000 7f10a559a640 1 -- 172.21.15.45:0/3885436200 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10a00a5b70 con 0x7f10a80cfed0 2023-11-28T18:37:39.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.775+0000 7f10a559a640 1 -- 172.21.15.45:0/3885436200 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a00ad440 con 0x7f10a80cfed0 2023-11-28T18:37:39.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.779+0000 7fa8867fc640 1 --2- 172.21.15.45:0/3930937248 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa874066950 0x7fa874068e10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa8780af000 tx=0x7fa8780a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:39.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.779+0000 7f1cb55a7640 1 -- start start 2023-11-28T18:37:39.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.779+0000 7fd595ffb640 1 -- 172.21.15.45:0/2585951824 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd59804c7f0 con 0x7fd598053bf0 2023-11-28T18:37:39.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.779+0000 7f9f80ff9640 1 -- 172.21.15.45:0/3718407816 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f9f7c013590 con 0x7f9f6c004ec0 2023-11-28T18:37:39.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.779+0000 7f9f8aa46640 1 -- 172.21.15.45:0/3718407816 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f64005260 con 0x7f9f6c004ec0 2023-11-28T18:37:39.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.779+0000 7f10acd72640 1 -- 172.21.15.45:0/3885436200 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10a80cfed0 msgr2=0x7f10a815f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.779+0000 7f10acd72640 1 --2- 172.21.15.45:0/3885436200 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10a80cfed0 0x7f10a815f0a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f10a0009d90 tx=0x7f10a001c950 comp rx=0 tx=0).stop 2023-11-28T18:37:39.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.779+0000 7fddb4ff9640 1 -- 172.21.15.45:0/916772822 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fdda801c460 con 0x7fddb80b3320 2023-11-28T18:37:39.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.779+0000 7f1cb55a7640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1ca8039b00 0x7f1ca804a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.779+0000 7f1cb55a7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ca80e7970 0x7f1ca8055c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.779+0000 7f1cb55a7640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1ca80e7d50 0x7f1ca80d30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.779+0000 7f1cb55a7640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca80eb030 con 0x7f1ca80e7970 2023-11-28T18:37:39.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.779+0000 7f1cb55a7640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca80eaa70 con 0x7f1ca80e7d50 2023-11-28T18:37:39.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.779+0000 7f1cb55a7640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca80ead50 con 0x7f1ca8039b00 2023-11-28T18:37:39.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.779+0000 7f10acd72640 1 -- 172.21.15.45:0/3885436200 shutdown_connections 2023-11-28T18:37:39.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.779+0000 7f10acd72640 1 --2- 172.21.15.45:0/3885436200 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10a80cfed0 0x7f10a815f0a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.779+0000 7f10acd72640 1 --2- 172.21.15.45:0/3885436200 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10a80b35f0 0x7f10a80d0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.779+0000 7f10acd72640 1 -- 172.21.15.45:0/3885436200 >> 172.21.15.45:0/3885436200 conn(0x7f10a809c4f0 msgr2=0x7f10a80d31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:39.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.779+0000 7f10acd72640 1 -- 172.21.15.45:0/3885436200 shutdown_connections 2023-11-28T18:37:39.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.779+0000 7f10acd72640 1 -- 172.21.15.45:0/3885436200 wait complete. 2023-11-28T18:37:39.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.779+0000 7fddb4ff9640 1 --2- 172.21.15.45:0/916772822 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fdd980669a0 0x7fdd98068e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.779+0000 7fddb4ff9640 1 -- 172.21.15.45:0/916772822 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdda80840d0 con 0x7fddb80b3320 2023-11-28T18:37:39.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.779+0000 7f9f80ff9640 1 --2- 172.21.15.45:0/3718407816 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9f70066930 0x7f9f70068df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.779+0000 7fddb77fe640 1 --2- 172.21.15.45:0/916772822 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fdd980669a0 0x7fdd98068e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.779+0000 7f1caf7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ca80e7970 0x7f1ca8055c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.779+0000 7f1caffff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1ca8039b00 0x7f1ca804a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.779+0000 7f1cb4da6640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1ca80e7d50 0x7f1ca80d30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.779+0000 7f1caffff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1ca8039b00 0x7f1ca804a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.45:60332/0 (socket says 172.21.15.45:60332) 2023-11-28T18:37:39.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.779+0000 7f1caffff640 1 -- 172.21.15.45:0/734054676 learned_addr learned my addr 172.21.15.45:0/734054676 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:39.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.779+0000 7f1cb4da6640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1ca80e7d50 0x7f1ca80d30c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.45:42244/0 (socket says 172.21.15.45:42244) 2023-11-28T18:37:39.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.779+0000 7f9f837fe640 1 --2- 172.21.15.45:0/3718407816 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9f70066930 0x7f9f70068df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.779+0000 7f1caf7fe640 1 -- 172.21.15.45:0/734054676 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1ca8039b00 msgr2=0x7f1ca804a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.779+0000 7f1caf7fe640 1 --2- 172.21.15.45:0/734054676 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1ca8039b00 0x7f1ca804a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.779+0000 7f1caf7fe640 1 -- 172.21.15.45:0/734054676 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1ca80e7d50 msgr2=0x7f1ca80d30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.779+0000 7f1caf7fe640 1 --2- 172.21.15.45:0/734054676 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1ca80e7d50 0x7f1ca80d30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.779+0000 7f1caf7fe640 1 -- 172.21.15.45:0/734054676 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cb004f820 con 0x7f1ca80e7970 2023-11-28T18:37:39.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.779+0000 7f1caffff640 1 --2- 172.21.15.45:0/734054676 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1ca8039b00 0x7f1ca804a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:37:39.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.779+0000 7ffa76d9d640 1 -- 172.21.15.45:0/3369648394 reap_dead start 2023-11-28T18:37:39.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.779+0000 7fddb77fe640 1 --2- 172.21.15.45:0/916772822 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fdd980669a0 0x7fdd98068e60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdda00ae000 tx=0x7fdda00a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:39.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.779+0000 7f1caf7fe640 1 --2- 172.21.15.45:0/734054676 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ca80e7970 0x7f1ca8055c70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1ca400b3e0 tx=0x7f1ca400b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:39.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.779+0000 7f9f837fe640 1 --2- 172.21.15.45:0/3718407816 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9f70066930 0x7f9f70068df0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9f840b7bb0 tx=0x7f9f78008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:39.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.779+0000 7ffa76d9d640 1 --2- 172.21.15.45:0/3369648394 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffa5c005190 0x7ffa5c00b990 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ffa70009fc0 tx=0x7ffa7001cc70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28d24ea36b0912ef server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:39.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.779+0000 7f1cacff9640 1 -- 172.21.15.45:0/734054676 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca4011830 con 0x7f1ca80e7970 2023-11-28T18:37:39.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.779+0000 7f1cacff9640 1 -- 172.21.15.45:0/734054676 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ca4011990 con 0x7f1ca80e7970 2023-11-28T18:37:39.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.779+0000 7f1cb55a7640 1 -- 172.21.15.45:0/734054676 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ca80e8360 con 0x7f1ca80e7970 2023-11-28T18:37:39.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.779+0000 7f1cacff9640 1 -- 172.21.15.45:0/734054676 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca4011d40 con 0x7f1ca80e7970 2023-11-28T18:37:39.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.783+0000 7f1cb55a7640 1 -- 172.21.15.45:0/734054676 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ca804abb0 con 0x7f1ca80e7970 2023-11-28T18:37:39.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.783+0000 7f9f80ff9640 1 -- 172.21.15.45:0/3718407816 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9f7c055e60 con 0x7f9f6c004ec0 2023-11-28T18:37:39.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.783+0000 7fa86f7fe640 1 -- 172.21.15.45:0/3930937248 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa880051620 con 0x7fa8881594d0 2023-11-28T18:37:39.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.783+0000 7ffa7559a640 1 -- 172.21.15.45:0/3369648394 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa700a5c80 con 0x7ffa5c005190 2023-11-28T18:37:39.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.783+0000 7f1cb55a7640 1 -- 172.21.15.45:0/734054676 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ca80e81c0 con 0x7f1ca80e7970 2023-11-28T18:37:39.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.783+0000 7f10acd72640 1 Processor -- start 2023-11-28T18:37:39.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.783+0000 7f10acd72640 1 -- start start 2023-11-28T18:37:39.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.783+0000 7f1cacff9640 1 -- 172.21.15.45:0/734054676 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f1ca401a400 con 0x7f1ca80e7970 2023-11-28T18:37:39.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.783+0000 7fcd63fff640 1 -- 172.21.15.45:0/2617351403 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd580aa610 con 0x7fcd6406ca10 2023-11-28T18:37:39.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.783+0000 7fddb4ff9640 1 -- 172.21.15.45:0/916772822 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdda8051380 con 0x7fddb80b3320 2023-11-28T18:37:39.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.783+0000 7f10acd72640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f10a80b35f0 0x7f10a814ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.783+0000 7f1cacff9640 1 --2- 172.21.15.45:0/734054676 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1c94066920 0x7f1c94068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.783+0000 7f10acd72640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10a80b3cb0 0x7f10a815ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.783+0000 7f1cacff9640 1 -- 172.21.15.45:0/734054676 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1ca4084280 con 0x7f1ca80e7970 2023-11-28T18:37:39.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.787+0000 7f10a659c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f10a80b35f0 0x7f10a814ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.787+0000 7f10a659c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f10a80b35f0 0x7f10a814ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.45:42250/0 (socket says 172.21.15.45:42250) 2023-11-28T18:37:39.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.787+0000 7f10a659c640 1 -- 172.21.15.45:0/2557161370 learned_addr learned my addr 172.21.15.45:0/2557161370 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:39.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.787+0000 7f1caffff640 1 --2- 172.21.15.45:0/734054676 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1c94066920 0x7f1c94068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.787+0000 7f10a5d9b640 1 --2- 172.21.15.45:0/2557161370 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10a80b3cb0 0x7f10a815ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.787+0000 7f10acd72640 1 --2- 172.21.15.45:0/2557161370 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10a80cfed0 0x7f10a81f79e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.787+0000 7f10acd72640 1 -- 172.21.15.45:0/2557161370 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a8150bd0 con 0x7f10a80cfed0 2023-11-28T18:37:39.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.787+0000 7f10acd72640 1 -- 172.21.15.45:0/2557161370 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a815bf60 con 0x7f10a80b35f0 2023-11-28T18:37:39.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.787+0000 7f10acd72640 1 -- 172.21.15.45:0/2557161370 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10a81f8230 con 0x7f10a80b3cb0 2023-11-28T18:37:39.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.787+0000 7f10a6d9d640 1 --2- 172.21.15.45:0/2557161370 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10a80cfed0 0x7f10a81f79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.787+0000 7f1caffff640 1 --2- 172.21.15.45:0/734054676 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1c94066920 0x7f1c94068de0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1cb0066110 tx=0x7f1cb0121070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:39.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.787+0000 7fcd63fff640 1 -- 172.21.15.45:0/2617351403 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd580a6040 con 0x7fcd6406ca10 2023-11-28T18:37:39.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.787+0000 7fcd63fff640 1 -- 172.21.15.45:0/2617351403 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd580aa990 con 0x7fcd6406ca10 2023-11-28T18:37:39.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.787+0000 7ffa7559a640 1 -- 172.21.15.45:0/3369648394 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa7000f040 con 0x7ffa5c005190 2023-11-28T18:37:39.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.787+0000 7ffa7559a640 1 -- 172.21.15.45:0/3369648394 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa700039a0 con 0x7ffa5c005190 2023-11-28T18:37:39.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.787+0000 7f10a659c640 1 -- 172.21.15.45:0/2557161370 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10a80b3cb0 msgr2=0x7f10a815ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.787+0000 7f10a659c640 1 --2- 172.21.15.45:0/2557161370 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10a80b3cb0 0x7f10a815ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.787+0000 7f10a659c640 1 -- 172.21.15.45:0/2557161370 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10a80cfed0 msgr2=0x7f10a81f79e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.787+0000 7f10a659c640 1 --2- 172.21.15.45:0/2557161370 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10a80cfed0 0x7f10a81f79e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.787+0000 7f10a659c640 1 -- 172.21.15.45:0/2557161370 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10a0009a70 con 0x7f10a80b35f0 2023-11-28T18:37:39.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.787+0000 7f9f80ff9640 1 -- 172.21.15.45:0/3718407816 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9f7c051aa0 con 0x7f9f6c004ec0 2023-11-28T18:37:39.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.787+0000 7fcd6b5d8640 1 -- 172.21.15.45:0/2617351403 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcd6406ca10 msgr2=0x7fcd64145290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.787+0000 7f10a6d9d640 1 --2- 172.21.15.45:0/2557161370 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10a80cfed0 0x7f10a81f79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:37:39.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.787+0000 7f10a5d9b640 1 --2- 172.21.15.45:0/2557161370 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10a80b3cb0 0x7f10a815ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:37:39.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.787+0000 7ffa7cff8640 1 -- 172.21.15.45:0/3369648394 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffa5c005190 msgr2=0x7ffa5c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.787+0000 7ffa7cff8640 1 --2- 172.21.15.45:0/3369648394 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffa5c005190 0x7ffa5c00b990 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ffa70009fc0 tx=0x7ffa7001cc70 comp rx=0 tx=0).stop 2023-11-28T18:37:39.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.787+0000 7fcd6b5d8640 1 --2- 172.21.15.45:0/2617351403 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcd6406ca10 0x7fcd64145290 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fcd580097f0 tx=0x7fcd5801c490 comp rx=0 tx=0).stop 2023-11-28T18:37:39.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.787+0000 7fcd6b5d8640 1 -- 172.21.15.45:0/2617351403 shutdown_connections 2023-11-28T18:37:39.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.787+0000 7fcd6b5d8640 1 --2- 172.21.15.45:0/2617351403 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcd6406ca10 0x7fcd64145290 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.787+0000 7fcd6b5d8640 1 -- 172.21.15.45:0/2617351403 >> 172.21.15.45:0/2617351403 conn(0x7fcd6406a570 msgr2=0x7fcd6406a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:39.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.787+0000 7f10a659c640 1 --2- 172.21.15.45:0/2557161370 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f10a80b35f0 0x7f10a814ff60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f109c00e890 tx=0x7f109c00ed50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:39.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.787+0000 7fcd6b5d8640 1 -- 172.21.15.45:0/2617351403 shutdown_connections 2023-11-28T18:37:39.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.787+0000 7ffa7cff8640 1 -- 172.21.15.45:0/3369648394 shutdown_connections 2023-11-28T18:37:39.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.787+0000 7ffa7cff8640 1 --2- 172.21.15.45:0/3369648394 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffa5c005190 0x7ffa5c00b990 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.787+0000 7ffa7cff8640 1 -- 172.21.15.45:0/3369648394 >> 172.21.15.45:0/3369648394 conn(0x7ffa7806c300 msgr2=0x7ffa7806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:39.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.787+0000 7fcd6b5d8640 1 -- 172.21.15.45:0/2617351403 wait complete. 2023-11-28T18:37:39.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.791+0000 7f1096ffd640 1 -- 172.21.15.45:0/2557161370 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f109c009620 con 0x7f10a80b35f0 2023-11-28T18:37:39.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.791+0000 7f1cacff9640 1 -- 172.21.15.45:0/734054676 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1ca80e81c0 con 0x7f1ca80e7970 2023-11-28T18:37:39.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.791+0000 7f1096ffd640 1 -- 172.21.15.45:0/2557161370 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f109c00c940 con 0x7f10a80b35f0 2023-11-28T18:37:39.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.791+0000 7f1096ffd640 1 -- 172.21.15.45:0/2557161370 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f109c00ccf0 con 0x7f10a80b35f0 2023-11-28T18:37:39.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.791+0000 7f10acd72640 1 -- 172.21.15.45:0/2557161370 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10a8155ac0 con 0x7f10a80b35f0 2023-11-28T18:37:39.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.791+0000 7f10acd72640 1 -- 172.21.15.45:0/2557161370 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10a8150580 con 0x7f10a80b35f0 2023-11-28T18:37:39.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.791+0000 7ffa7cff8640 1 -- 172.21.15.45:0/3369648394 shutdown_connections 2023-11-28T18:37:39.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.791+0000 7fcd6b5d8640 1 Processor -- start 2023-11-28T18:37:39.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.791+0000 7f1094ff9640 1 -- 172.21.15.45:0/2557161370 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10a8069480 con 0x7f10a80b35f0 2023-11-28T18:37:39.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.795+0000 7ffa7cff8640 1 -- 172.21.15.45:0/3369648394 wait complete. 2023-11-28T18:37:39.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.795+0000 7f1096ffd640 1 -- 172.21.15.45:0/2557161370 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f109c013470 con 0x7f10a80b35f0 2023-11-28T18:37:39.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.791+0000 7fcd6b5d8640 1 -- start start 2023-11-28T18:37:39.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.795+0000 7fcd6b5d8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd6406ca10 0x7fcd64070a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.795+0000 7fcd6b5d8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcd6415bcd0 0x7fcd64159610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.795+0000 7fcd6b5d8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcd6415c0b0 0x7fcd6413f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.795+0000 7fcd68b73640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcd6415bcd0 0x7fcd64159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.795+0000 7fcd68b73640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcd6415bcd0 0x7fcd64159610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.45:60356/0 (socket says 172.21.15.45:60356) 2023-11-28T18:37:39.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.795+0000 7fcd69374640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd6406ca10 0x7fcd64070a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.795+0000 7fcd69374640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd6406ca10 0x7fcd64070a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57308/0 (socket says 172.21.15.45:57308) 2023-11-28T18:37:39.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.795+0000 7fcd68b73640 1 -- 172.21.15.45:0/4068668246 learned_addr learned my addr 172.21.15.45:0/4068668246 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:39.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.795+0000 7fcd6b5d8640 1 -- 172.21.15.45:0/4068668246 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd6413e8e0 con 0x7fcd6406ca10 2023-11-28T18:37:39.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.795+0000 7fcd6b5d8640 1 -- 172.21.15.45:0/4068668246 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd641410e0 con 0x7fcd6415c0b0 2023-11-28T18:37:39.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.795+0000 7fcd69b75640 1 --2- 172.21.15.45:0/4068668246 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcd6415c0b0 0x7fcd6413f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.795+0000 7fcd6b5d8640 1 -- 172.21.15.45:0/4068668246 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd64141330 con 0x7fcd6415bcd0 2023-11-28T18:37:39.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.795+0000 7ffa7cff8640 1 Processor -- start 2023-11-28T18:37:39.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.795+0000 7ffa7cff8640 1 -- start start 2023-11-28T18:37:39.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.795+0000 7f1096ffd640 1 --2- 172.21.15.45:0/2557161370 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f10880668d0 0x7f1088068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.795+0000 7fcd69b75640 1 -- 172.21.15.45:0/4068668246 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcd6415bcd0 msgr2=0x7fcd64159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.795+0000 7fcd69b75640 1 --2- 172.21.15.45:0/4068668246 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcd6415bcd0 0x7fcd64159610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.795+0000 7fcd69b75640 1 -- 172.21.15.45:0/4068668246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd6406ca10 msgr2=0x7fcd64070a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.795+0000 7fcd69b75640 1 --2- 172.21.15.45:0/4068668246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd6406ca10 0x7fcd64070a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.795+0000 7fcd69b75640 1 -- 172.21.15.45:0/4068668246 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd58009420 con 0x7fcd6415c0b0 2023-11-28T18:37:39.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.795+0000 7f10a5d9b640 1 --2- 172.21.15.45:0/2557161370 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f10880668d0 0x7f1088068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.799+0000 7f1096ffd640 1 -- 172.21.15.45:0/2557161370 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f109c084660 con 0x7f10a80b35f0 2023-11-28T18:37:39.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.799+0000 7ffa7cff8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffa5c005190 0x7ffa78165190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.799+0000 7ffa7cff8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffa78164920 0x7ffa7815fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.799+0000 7ffa7cff8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa78140bb0 0x7ffa78141040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.799+0000 7ffa7cff8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa78141580 con 0x7ffa78140bb0 2023-11-28T18:37:39.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.799+0000 7ffa7cff8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa781627f0 con 0x7ffa78164920 2023-11-28T18:37:39.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.799+0000 7ffa7cff8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa781607e0 con 0x7ffa5c005190 2023-11-28T18:37:39.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.799+0000 7fcd69b75640 1 --2- 172.21.15.45:0/4068668246 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcd6415c0b0 0x7fcd6413f4b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcd5400c3e0 tx=0x7fcd5400c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:39.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.799+0000 7ffa7659c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffa5c005190 0x7ffa78165190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.799+0000 7ffa7659c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffa5c005190 0x7ffa78165190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.45:60360/0 (socket says 172.21.15.45:60360) 2023-11-28T18:37:39.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.799+0000 7ffa7659c640 1 -- 172.21.15.45:0/784008490 learned_addr learned my addr 172.21.15.45:0/784008490 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:39.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.799+0000 7ffa75d9b640 1 --2- 172.21.15.45:0/784008490 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffa78164920 0x7ffa7815fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.799+0000 7f10a5d9b640 1 --2- 172.21.15.45:0/2557161370 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f10880668d0 0x7f1088068d90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f10a8150530 tx=0x7f1098009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:39.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.799+0000 7ffa76d9d640 1 --2- 172.21.15.45:0/784008490 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa78140bb0 0x7ffa78141040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.799+0000 7ffa7659c640 1 -- 172.21.15.45:0/784008490 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffa78164920 msgr2=0x7ffa7815fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.799+0000 7ffa7659c640 1 --2- 172.21.15.45:0/784008490 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffa78164920 0x7ffa7815fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.799+0000 7ffa7659c640 1 -- 172.21.15.45:0/784008490 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa78140bb0 msgr2=0x7ffa78141040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:39.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.799+0000 7ffa7659c640 1 --2- 172.21.15.45:0/784008490 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa78140bb0 0x7ffa78141040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:39.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.799+0000 7ffa7659c640 1 -- 172.21.15.45:0/784008490 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa78160ac0 con 0x7ffa5c005190 2023-11-28T18:37:39.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.799+0000 7fcd61ffb640 1 -- 172.21.15.45:0/4068668246 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd540074e0 con 0x7fcd6415c0b0 2023-11-28T18:37:39.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.799+0000 7fcd61ffb640 1 -- 172.21.15.45:0/4068668246 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd54007640 con 0x7fcd6415c0b0 2023-11-28T18:37:39.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.799+0000 7fcd6b5d8640 1 -- 172.21.15.45:0/4068668246 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd64141610 con 0x7fcd6415c0b0 2023-11-28T18:37:39.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.799+0000 7fcd6b5d8640 1 -- 172.21.15.45:0/4068668246 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd64141bd0 con 0x7fcd6415c0b0 2023-11-28T18:37:39.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.799+0000 7f1096ffd640 1 -- 172.21.15.45:0/2557161370 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f109c051810 con 0x7f10a80b35f0 2023-11-28T18:37:39.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.799+0000 7fcd61ffb640 1 -- 172.21.15.45:0/4068668246 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd54004a30 con 0x7fcd6415c0b0 2023-11-28T18:37:39.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.799+0000 7ffa7659c640 1 --2- 172.21.15.45:0/784008490 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffa5c005190 0x7ffa78165190 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ffa640017f0 tx=0x7ffa64007810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:39.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.803+0000 7ffa6effd640 1 -- 172.21.15.45:0/784008490 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6400fb80 con 0x7ffa5c005190 2023-11-28T18:37:39.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.803+0000 7ffa6effd640 1 -- 172.21.15.45:0/784008490 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa6400fd00 con 0x7ffa5c005190 2023-11-28T18:37:39.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.803+0000 7ffa6effd640 1 -- 172.21.15.45:0/784008490 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa64013630 con 0x7ffa5c005190 2023-11-28T18:37:39.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.803+0000 7ffa7cff8640 1 -- 172.21.15.45:0/784008490 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa78160da0 con 0x7ffa5c005190 2023-11-28T18:37:39.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.803+0000 7ffa7cff8640 1 -- 172.21.15.45:0/784008490 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa781656d0 con 0x7ffa5c005190 2023-11-28T18:37:39.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.803+0000 7fcd6b5d8640 1 -- 172.21.15.45:0/4068668246 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd44005260 con 0x7fcd6415c0b0 2023-11-28T18:37:39.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.803+0000 7ffa7cff8640 1 -- 172.21.15.45:0/784008490 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa54005260 con 0x7ffa5c005190 2023-11-28T18:37:39.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.803+0000 7fcd61ffb640 1 -- 172.21.15.45:0/4068668246 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fcd54004b90 con 0x7fcd6415c0b0 2023-11-28T18:37:39.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.807+0000 7fcd61ffb640 1 --2- 172.21.15.45:0/4068668246 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fcd500669d0 0x7fcd50068e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.807+0000 7fcd61ffb640 1 -- 172.21.15.45:0/4068668246 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcd54084180 con 0x7fcd6415c0b0 2023-11-28T18:37:39.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.807+0000 7fcd69374640 1 --2- 172.21.15.45:0/4068668246 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fcd500669d0 0x7fcd50068e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.807+0000 7fcd69374640 1 --2- 172.21.15.45:0/4068668246 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fcd500669d0 0x7fcd50068e90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c0012f0 tx=0x7fcd5c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:39.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.807+0000 7ffa6effd640 1 -- 172.21.15.45:0/784008490 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ffa64013790 con 0x7ffa5c005190 2023-11-28T18:37:39.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.811+0000 7fcd61ffb640 1 -- 172.21.15.45:0/4068668246 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcd54051310 con 0x7fcd6415c0b0 2023-11-28T18:37:39.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.811+0000 7ffa6effd640 1 --2- 172.21.15.45:0/784008490 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ffa60066920 0x7ffa60068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:39.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.811+0000 7ffa6effd640 1 -- 172.21.15.45:0/784008490 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffa64085260 con 0x7ffa5c005190 2023-11-28T18:37:39.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.811+0000 7ffa6effd640 1 -- 172.21.15.45:0/784008490 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ffa64085750 con 0x7ffa5c005190 2023-11-28T18:37:39.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.815+0000 7ffa75d9b640 1 --2- 172.21.15.45:0/784008490 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ffa60066920 0x7ffa60068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:39.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:39.819+0000 7ffa75d9b640 1 --2- 172.21.15.45:0/784008490 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ffa60066920 0x7ffa60068de0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ffa78070bf0 tx=0x7ffa68008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:40.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.119+0000 7fddbe180640 1 -- 172.21.15.45:0/916772822 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fddb8161eb0 con 0x7fddb80b3320 2023-11-28T18:37:40.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.119+0000 7fddb4ff9640 1 -- 172.21.15.45:0/916772822 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fddb8161eb0 con 0x7fddb80b3320 2023-11-28T18:37:40.125 INFO:teuthology.orchestra.run.smithi045.stdout:55834574854 2023-11-28T18:37:40.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.123+0000 7fa88d4ea640 1 -- 172.21.15.45:0/3930937248 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa88815c920 con 0x7fa8881594d0 2023-11-28T18:37:40.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.123+0000 7fa86f7fe640 1 -- 172.21.15.45:0/3930937248 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa88005b030 con 0x7fa8881594d0 2023-11-28T18:37:40.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.123+0000 7fd5a73b8640 1 -- 172.21.15.45:0/2585951824 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd59804cbd0 con 0x7fd598053bf0 2023-11-28T18:37:40.130 INFO:teuthology.orchestra.run.smithi045.stdout:55834574853 2023-11-28T18:37:40.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.123+0000 7fddbe180640 1 -- 172.21.15.45:0/916772822 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fdd980669a0 msgr2=0x7fdd98068e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:40.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.123+0000 7fddbe180640 1 --2- 172.21.15.45:0/916772822 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fdd980669a0 0x7fdd98068e60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdda00ae000 tx=0x7fdda00a7000 comp rx=0 tx=0).stop 2023-11-28T18:37:40.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.123+0000 7fddbe180640 1 -- 172.21.15.45:0/916772822 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fddb80b3320 msgr2=0x7fddb8202840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:40.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.123+0000 7fddbe180640 1 --2- 172.21.15.45:0/916772822 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fddb80b3320 0x7fddb8202840 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdda800c410 tx=0x7fdda800c8d0 comp rx=0 tx=0).stop 2023-11-28T18:37:40.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.123+0000 7f1cb55a7640 1 -- 172.21.15.45:0/734054676 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f1ca80e8190 con 0x7f1ca80e7970 2023-11-28T18:37:40.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.123+0000 7fd595ffb640 1 -- 172.21.15.45:0/2585951824 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd59804cbd0 con 0x7fd598053bf0 2023-11-28T18:37:40.132 INFO:teuthology.orchestra.run.smithi045.stdout:55834574853 2023-11-28T18:37:40.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.123+0000 7fddbe180640 1 -- 172.21.15.45:0/916772822 shutdown_connections 2023-11-28T18:37:40.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.123+0000 7fddbe180640 1 --2- 172.21.15.45:0/916772822 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fdd980669a0 0x7fdd98068e60 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:40.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.123+0000 7fddbe180640 1 --2- 172.21.15.45:0/916772822 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fddb80cccc0 0x7fddb8146c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:40.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.127+0000 7fddbe180640 1 --2- 172.21.15.45:0/916772822 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fddb80b3320 0x7fddb8202840 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:40.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.127+0000 7fddbe180640 1 --2- 172.21.15.45:0/916772822 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fddb8070530 0x7fddb8163ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:40.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.127+0000 7fddbe180640 1 -- 172.21.15.45:0/916772822 >> 172.21.15.45:0/916772822 conn(0x7fddb806c300 msgr2=0x7fddb8148b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:40.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.127+0000 7fddbe180640 1 -- 172.21.15.45:0/916772822 shutdown_connections 2023-11-28T18:37:40.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.127+0000 7fddbe180640 1 -- 172.21.15.45:0/916772822 wait complete. 2023-11-28T18:37:40.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.127+0000 7f1cacff9640 1 -- 172.21.15.45:0/734054676 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1ca40515e0 con 0x7f1ca80e7970 2023-11-28T18:37:40.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.127+0000 7fa88d4ea640 1 -- 172.21.15.45:0/3930937248 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa874066950 msgr2=0x7fa874068e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:40.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.127+0000 7fa88d4ea640 1 --2- 172.21.15.45:0/3930937248 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa874066950 0x7fa874068e10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa8780af000 tx=0x7fa8780a7070 comp rx=0 tx=0).stop 2023-11-28T18:37:40.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.127+0000 7fa88d4ea640 1 -- 172.21.15.45:0/3930937248 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa8881594d0 msgr2=0x7fa888147910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:40.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.127+0000 7fa88d4ea640 1 --2- 172.21.15.45:0/3930937248 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa8881594d0 0x7fa888147910 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa88000cb10 tx=0x7fa88000a060 comp rx=0 tx=0).stop 2023-11-28T18:37:40.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.127+0000 7fa88d4ea640 1 -- 172.21.15.45:0/3930937248 shutdown_connections 2023-11-28T18:37:40.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.127+0000 7fa88d4ea640 1 --2- 172.21.15.45:0/3930937248 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa874066950 0x7fa874068e10 secure :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa8780af000 tx=0x7fa8780a7070 comp rx=0 tx=0).stop 2023-11-28T18:37:40.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.127+0000 7fa88d4ea640 1 --2- 172.21.15.45:0/3930937248 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa88815d1d0 0x7fa88814b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:40.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.127+0000 7fa88d4ea640 1 --2- 172.21.15.45:0/3930937248 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa88815cdf0 0x7fa88814cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:40.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.127+0000 7fa88d4ea640 1 --2- 172.21.15.45:0/3930937248 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa8881594d0 0x7fa888147910 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:40.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.127+0000 7fa88d4ea640 1 -- 172.21.15.45:0/3930937248 >> 172.21.15.45:0/3930937248 conn(0x7fa88806c300 msgr2=0x7fa888167590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:40.136 INFO:teuthology.orchestra.run.smithi045.stdout:55834574852 2023-11-28T18:37:40.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.127+0000 7f9f8aa46640 1 -- 172.21.15.45:0/3718407816 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f9f64005510 con 0x7f9f6c004ec0 2023-11-28T18:37:40.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.127+0000 7fa88d4ea640 1 -- 172.21.15.45:0/3930937248 shutdown_connections 2023-11-28T18:37:40.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.127+0000 7fa88d4ea640 1 -- 172.21.15.45:0/3930937248 wait complete. 2023-11-28T18:37:40.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.127+0000 7f9f80ff9640 1 -- 172.21.15.45:0/3718407816 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9f7c0550c0 con 0x7f9f6c004ec0 2023-11-28T18:37:40.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.127+0000 7fd5a73b8640 1 -- 172.21.15.45:0/2585951824 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fd5840669d0 msgr2=0x7fd584068e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:40.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.127+0000 7fd5a73b8640 1 --2- 172.21.15.45:0/2585951824 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fd5840669d0 0x7fd584068e90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd5980df6a0 tx=0x7fd590008040 comp rx=0 tx=0).stop 2023-11-28T18:37:40.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.127+0000 7fd5a73b8640 1 -- 172.21.15.45:0/2585951824 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd598053bf0 msgr2=0x7fd5980e0cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:40.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.127+0000 7fd5a73b8640 1 --2- 172.21.15.45:0/2585951824 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd598053bf0 0x7fd5980e0cc0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd59c0ab000 tx=0x7fd59c01ad10 comp rx=0 tx=0).stop 2023-11-28T18:37:40.138 INFO:teuthology.orchestra.run.smithi045.stdout:55834574853 2023-11-28T18:37:40.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.131+0000 7fd5a73b8640 1 -- 172.21.15.45:0/2585951824 shutdown_connections 2023-11-28T18:37:40.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.131+0000 7fd5a73b8640 1 --2- 172.21.15.45:0/2585951824 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fd5840669d0 0x7fd584068e90 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:40.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.131+0000 7fd5a73b8640 1 --2- 172.21.15.45:0/2585951824 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd5980e5380 0x7fd5980e5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:40.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.131+0000 7fd5a73b8640 1 --2- 172.21.15.45:0/2585951824 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5980e6c10 0x7fd5980e3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:40.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.131+0000 7fd5a73b8640 1 --2- 172.21.15.45:0/2585951824 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd598053bf0 0x7fd5980e0cc0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:40.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.131+0000 7fd5a73b8640 1 -- 172.21.15.45:0/2585951824 >> 172.21.15.45:0/2585951824 conn(0x7fd5980559c0 msgr2=0x7fd598054720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:40.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.131+0000 7fd5a73b8640 1 -- 172.21.15.45:0/2585951824 shutdown_connections 2023-11-28T18:37:40.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.131+0000 7fd5a73b8640 1 -- 172.21.15.45:0/2585951824 wait complete. 2023-11-28T18:37:40.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.131+0000 7f1cb55a7640 1 -- 172.21.15.45:0/734054676 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1c94066920 msgr2=0x7f1c94068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:40.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.131+0000 7f1cb55a7640 1 --2- 172.21.15.45:0/734054676 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1c94066920 0x7f1c94068de0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1cb0066110 tx=0x7f1cb0121070 comp rx=0 tx=0).stop 2023-11-28T18:37:40.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.131+0000 7f1cb55a7640 1 -- 172.21.15.45:0/734054676 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ca80e7970 msgr2=0x7f1ca8055c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:40.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.131+0000 7f1cb55a7640 1 --2- 172.21.15.45:0/734054676 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ca80e7970 0x7f1ca8055c70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1ca400b3e0 tx=0x7f1ca400b7e0 comp rx=0 tx=0).stop 2023-11-28T18:37:40.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.131+0000 7f1cb55a7640 1 -- 172.21.15.45:0/734054676 shutdown_connections 2023-11-28T18:37:40.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.131+0000 7f1cb55a7640 1 --2- 172.21.15.45:0/734054676 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1c94066920 0x7f1c94068de0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:40.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.131+0000 7f1cb55a7640 1 --2- 172.21.15.45:0/734054676 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1ca80e7d50 0x7f1ca80d30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:40.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.131+0000 7f1cb55a7640 1 --2- 172.21.15.45:0/734054676 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ca80e7970 0x7f1ca8055c70 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:40.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.131+0000 7f1cb55a7640 1 --2- 172.21.15.45:0/734054676 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1ca8039b00 0x7f1ca804a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:40.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.131+0000 7f1cb55a7640 1 -- 172.21.15.45:0/734054676 >> 172.21.15.45:0/734054676 conn(0x7f1ca8056cb0 msgr2=0x7f1ca80e7260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:40.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.131+0000 7f1cb55a7640 1 -- 172.21.15.45:0/734054676 shutdown_connections 2023-11-28T18:37:40.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.131+0000 7f1cb55a7640 1 -- 172.21.15.45:0/734054676 wait complete. 2023-11-28T18:37:40.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.131+0000 7f9f8aa46640 1 -- 172.21.15.45:0/3718407816 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9f70066930 msgr2=0x7f9f70068df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:40.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.131+0000 7f9f8aa46640 1 --2- 172.21.15.45:0/3718407816 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9f70066930 0x7f9f70068df0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9f840b7bb0 tx=0x7f9f78008040 comp rx=0 tx=0).stop 2023-11-28T18:37:40.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.131+0000 7f9f8aa46640 1 -- 172.21.15.45:0/3718407816 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f6c004ec0 msgr2=0x7f9f841ffc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:40.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.131+0000 7f9f8aa46640 1 --2- 172.21.15.45:0/3718407816 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f6c004ec0 0x7f9f841ffc00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c007b50 tx=0x7f9f7c00e530 comp rx=0 tx=0).stop 2023-11-28T18:37:40.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.131+0000 7f9f8aa46640 1 -- 172.21.15.45:0/3718407816 shutdown_connections 2023-11-28T18:37:40.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.131+0000 7f9f8aa46640 1 --2- 172.21.15.45:0/3718407816 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9f70066930 0x7f9f70068df0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:40.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.131+0000 7f9f8aa46640 1 --2- 172.21.15.45:0/3718407816 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f8409f170 0x7f9f8409f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:40.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.131+0000 7f9f8aa46640 1 --2- 172.21.15.45:0/3718407816 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9f840b89e0 0x7f9f8415f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:40.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.131+0000 7f9f8aa46640 1 --2- 172.21.15.45:0/3718407816 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f6c004ec0 0x7f9f841ffc00 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:40.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.131+0000 7f9f8aa46640 1 -- 172.21.15.45:0/3718407816 >> 172.21.15.45:0/3718407816 conn(0x7f9f8409c4f0 msgr2=0x7f9f8406c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:40.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.131+0000 7f9f8aa46640 1 -- 172.21.15.45:0/3718407816 shutdown_connections 2023-11-28T18:37:40.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.135+0000 7f9f8aa46640 1 -- 172.21.15.45:0/3718407816 wait complete. 2023-11-28T18:37:40.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.139+0000 7f1094ff9640 1 -- 172.21.15.45:0/2557161370 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f10a80c9f40 con 0x7f10a80b35f0 2023-11-28T18:37:40.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.143+0000 7f1096ffd640 1 -- 172.21.15.45:0/2557161370 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f109c054e30 con 0x7f10a80b35f0 2023-11-28T18:37:40.147 INFO:teuthology.orchestra.run.smithi045.stdout:55834574855 2023-11-28T18:37:40.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.147+0000 7fcd6b5d8640 1 -- 172.21.15.45:0/4068668246 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fcd44005510 con 0x7fcd6415c0b0 2023-11-28T18:37:40.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.147+0000 7ffa7cff8640 1 -- 172.21.15.45:0/784008490 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ffa540057e0 con 0x7ffa5c005190 2023-11-28T18:37:40.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.147+0000 7f1094ff9640 1 -- 172.21.15.45:0/2557161370 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f10880668d0 msgr2=0x7f1088068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:40.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.147+0000 7f1094ff9640 1 --2- 172.21.15.45:0/2557161370 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f10880668d0 0x7f1088068d90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f10a8150530 tx=0x7f1098009040 comp rx=0 tx=0).stop 2023-11-28T18:37:40.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.147+0000 7f1094ff9640 1 -- 172.21.15.45:0/2557161370 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f10a80b35f0 msgr2=0x7f10a814ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:40.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.147+0000 7f1094ff9640 1 --2- 172.21.15.45:0/2557161370 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f10a80b35f0 0x7f10a814ff60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f109c00e890 tx=0x7f109c00ed50 comp rx=0 tx=0).stop 2023-11-28T18:37:40.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.147+0000 7fcd61ffb640 1 -- 172.21.15.45:0/4068668246 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcd54054930 con 0x7fcd6415c0b0 2023-11-28T18:37:40.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.147+0000 7ffa6effd640 1 -- 172.21.15.45:0/784008490 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ffa640524f0 con 0x7ffa5c005190 2023-11-28T18:37:40.154 INFO:teuthology.orchestra.run.smithi045.stdout:55834574853 2023-11-28T18:37:40.154 INFO:teuthology.orchestra.run.smithi045.stdout:55834574853 2023-11-28T18:37:40.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.151+0000 7f1094ff9640 1 -- 172.21.15.45:0/2557161370 shutdown_connections 2023-11-28T18:37:40.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.151+0000 7f1094ff9640 1 --2- 172.21.15.45:0/2557161370 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f10880668d0 0x7f1088068d90 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:40.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.151+0000 7f1094ff9640 1 --2- 172.21.15.45:0/2557161370 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10a80cfed0 0x7f10a81f79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:40.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.151+0000 7f1094ff9640 1 --2- 172.21.15.45:0/2557161370 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10a80b3cb0 0x7f10a815ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:40.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.151+0000 7f1094ff9640 1 --2- 172.21.15.45:0/2557161370 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f10a80b35f0 0x7f10a814ff60 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:40.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.151+0000 7f1094ff9640 1 -- 172.21.15.45:0/2557161370 >> 172.21.15.45:0/2557161370 conn(0x7f10a809c4f0 msgr2=0x7f10a80cf660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:40.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.151+0000 7ffa7cff8640 1 -- 172.21.15.45:0/784008490 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ffa60066920 msgr2=0x7ffa60068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:40.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.151+0000 7f1094ff9640 1 -- 172.21.15.45:0/2557161370 shutdown_connections 2023-11-28T18:37:40.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.151+0000 7f1094ff9640 1 -- 172.21.15.45:0/2557161370 wait complete. 2023-11-28T18:37:40.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.151+0000 7ffa7cff8640 1 --2- 172.21.15.45:0/784008490 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ffa60066920 0x7ffa60068de0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ffa78070bf0 tx=0x7ffa68008040 comp rx=0 tx=0).stop 2023-11-28T18:37:40.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.151+0000 7ffa7cff8640 1 -- 172.21.15.45:0/784008490 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffa5c005190 msgr2=0x7ffa78165190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:40.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.151+0000 7ffa7cff8640 1 --2- 172.21.15.45:0/784008490 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffa5c005190 0x7ffa78165190 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ffa640017f0 tx=0x7ffa64007810 comp rx=0 tx=0).stop 2023-11-28T18:37:40.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.151+0000 7ffa7cff8640 1 -- 172.21.15.45:0/784008490 shutdown_connections 2023-11-28T18:37:40.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.151+0000 7ffa7cff8640 1 --2- 172.21.15.45:0/784008490 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ffa60066920 0x7ffa60068de0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:40.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.151+0000 7ffa7cff8640 1 --2- 172.21.15.45:0/784008490 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa78140bb0 0x7ffa78141040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:40.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.151+0000 7fcd6b5d8640 1 -- 172.21.15.45:0/4068668246 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fcd500669d0 msgr2=0x7fcd50068e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:40.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.151+0000 7fcd6b5d8640 1 --2- 172.21.15.45:0/4068668246 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fcd500669d0 0x7fcd50068e90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c0012f0 tx=0x7fcd5c009040 comp rx=0 tx=0).stop 2023-11-28T18:37:40.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.151+0000 7fcd6b5d8640 1 -- 172.21.15.45:0/4068668246 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcd6415c0b0 msgr2=0x7fcd6413f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:40.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.151+0000 7fcd6b5d8640 1 --2- 172.21.15.45:0/4068668246 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcd6415c0b0 0x7fcd6413f4b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcd5400c3e0 tx=0x7fcd5400c8a0 comp rx=0 tx=0).stop 2023-11-28T18:37:40.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.151+0000 7fcd6b5d8640 1 -- 172.21.15.45:0/4068668246 shutdown_connections 2023-11-28T18:37:40.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.151+0000 7fcd6b5d8640 1 --2- 172.21.15.45:0/4068668246 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fcd500669d0 0x7fcd50068e90 secure :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c0012f0 tx=0x7fcd5c009040 comp rx=0 tx=0).stop 2023-11-28T18:37:40.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.151+0000 7fcd6b5d8640 1 --2- 172.21.15.45:0/4068668246 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcd6415c0b0 0x7fcd6413f4b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:40.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.151+0000 7fcd6b5d8640 1 --2- 172.21.15.45:0/4068668246 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcd6415bcd0 0x7fcd64159610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:40.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.151+0000 7fcd6b5d8640 1 --2- 172.21.15.45:0/4068668246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd6406ca10 0x7fcd64070a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:40.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.151+0000 7fcd6b5d8640 1 -- 172.21.15.45:0/4068668246 >> 172.21.15.45:0/4068668246 conn(0x7fcd6406a570 msgr2=0x7fcd641451b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:40.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.151+0000 7fcd6b5d8640 1 -- 172.21.15.45:0/4068668246 shutdown_connections 2023-11-28T18:37:40.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.151+0000 7fcd6b5d8640 1 -- 172.21.15.45:0/4068668246 wait complete. 2023-11-28T18:37:40.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.151+0000 7ffa7cff8640 1 --2- 172.21.15.45:0/784008490 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffa78164920 0x7ffa7815fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:40.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.151+0000 7ffa7cff8640 1 --2- 172.21.15.45:0/784008490 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffa5c005190 0x7ffa78165190 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:40.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.155+0000 7ffa7cff8640 1 -- 172.21.15.45:0/784008490 >> 172.21.15.45:0/784008490 conn(0x7ffa7806c300 msgr2=0x7ffa781417e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:40.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.155+0000 7ffa7cff8640 1 -- 172.21.15.45:0/784008490 shutdown_connections 2023-11-28T18:37:40.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:40.155+0000 7ffa7cff8640 1 -- 172.21.15.45:0/784008490 wait complete. 2023-11-28T18:37:40.180 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.1 2023-11-28T18:37:40.181 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.0 2023-11-28T18:37:40.182 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.2 2023-11-28T18:37:40.182 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.5 2023-11-28T18:37:40.184 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.7 2023-11-28T18:37:40.191 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.6 2023-11-28T18:37:40.193 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.3 2023-11-28T18:37:40.193 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2023-11-28T18:37:41.181 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-28T18:37:41.182 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-28T18:37:41.182 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-28T18:37:41.183 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-28T18:37:41.186 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-28T18:37:41.192 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-28T18:37:41.193 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-28T18:37:41.194 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-28T18:37:41.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.379+0000 7f0fc929c640 1 Processor -- start 2023-11-28T18:37:41.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.379+0000 7f0fc929c640 1 -- start start 2023-11-28T18:37:41.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.383+0000 7f0fc929c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f0fc4158f90 0x7f0fc4159370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:41.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.383+0000 7f0fc929c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0fc406e250 0x7f0fc40b35d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:41.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.383+0000 7f0fc929c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0fc40b1480 0x7f0fc40b3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:41.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.383+0000 7f0fc929c640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fc40b1c60 con 0x7f0fc40b1480 2023-11-28T18:37:41.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.383+0000 7f0fc929c640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fc406eba0 con 0x7f0fc4158f90 2023-11-28T18:37:41.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.383+0000 7f0fc929c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc4159950 con 0x7f0fc406e250 2023-11-28T18:37:41.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.383+0000 7f0fc3fff640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f0fc4158f90 0x7f0fc4159370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:41.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.383+0000 7f0fc8a9b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0fc40b1480 0x7f0fc40b3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:41.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.383+0000 7f0fc3fff640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f0fc4158f90 0x7f0fc4159370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.45:42292/0 (socket says 172.21.15.45:42292) 2023-11-28T18:37:41.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.383+0000 7f0fc3fff640 1 -- 172.21.15.45:0/371208488 learned_addr learned my addr 172.21.15.45:0/371208488 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:41.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.383+0000 7f0fc3fff640 1 -- 172.21.15.45:0/371208488 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0fc406e250 msgr2=0x7f0fc40b35d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-28T18:37:41.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.387+0000 7f004d2d6640 1 Processor -- start 2023-11-28T18:37:41.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.387+0000 7f004d2d6640 1 -- start start 2023-11-28T18:37:41.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.383+0000 7f0fc3fff640 1 --2- 172.21.15.45:0/371208488 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0fc406e250 0x7f0fc40b35d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.383+0000 7f0fc3fff640 1 -- 172.21.15.45:0/371208488 >> v2:172.21.15.45:3300/0 conn(0x7f0fc40b1480 msgr2=0x7f0fc40b3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:41.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.383+0000 7f0fc3fff640 1 --2- 172.21.15.45:0/371208488 >> v2:172.21.15.45:3300/0 conn(0x7f0fc40b1480 0x7f0fc40b3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.383+0000 7f0fc3fff640 1 -- 172.21.15.45:0/371208488 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc4159c30 con 0x7f0fc4158f90 2023-11-28T18:37:41.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.387+0000 7f004d2d6640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f0048157820 0x7f004815e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:41.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.387+0000 7f004d2d6640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f00480afeb0 0x7f00480b0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:41.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.391+0000 7f004d2d6640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f004815e5c0 con 0x7f0048160c40 2023-11-28T18:37:41.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.391+0000 7f004d2d6640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00480b08a0 con 0x7f00480afeb0 2023-11-28T18:37:41.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.391+0000 7f004d2d6640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f004806c560 con 0x7f0048157820 2023-11-28T18:37:41.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.391+0000 7f0046ffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f0048157820 0x7f004815e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:41.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.391+0000 7f0046ffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f0048157820 0x7f004815e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.45:42298/0 (socket says 172.21.15.45:42298) 2023-11-28T18:37:41.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.391+0000 7f0046ffd640 1 -- 172.21.15.45:0/2828611778 learned_addr learned my addr 172.21.15.45:0/2828611778 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:41.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.391+0000 7f00467fc640 1 --2- 172.21.15.45:0/2828611778 >> v2:172.21.15.45:3300/0 conn(0x7f00480afeb0 0x7f00480b0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:41.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.391+0000 7f0fc3fff640 1 --2- 172.21.15.45:0/371208488 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0fc4158f90 0x7f0fc4159370 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0fc40cda30 tx=0x7f0fb401c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7b5bc3d19df70db server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:41.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.391+0000 7f0046ffd640 1 -- 172.21.15.45:0/2828611778 >> v2:172.21.15.45:3300/0 conn(0x7f00480afeb0 msgr2=0x7f00480b0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:41.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.391+0000 7f0046ffd640 1 --2- 172.21.15.45:0/2828611778 >> v2:172.21.15.45:3300/0 conn(0x7f00480afeb0 0x7f00480b0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.391+0000 7f0046ffd640 1 -- 172.21.15.45:0/2828611778 >> v1:172.21.15.190:6789/0 conn(0x7f0048160c40 legacy=0x7f0048161040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:41.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.391+0000 7f0046ffd640 1 -- 172.21.15.45:0/2828611778 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00480acbb0 con 0x7f0048157820 2023-11-28T18:37:41.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.391+0000 7f0fc2ffd640 1 -- 172.21.15.45:0/371208488 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb4004230 con 0x7f0fc4158f90 2023-11-28T18:37:41.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.391+0000 7f0fc2ffd640 1 -- 172.21.15.45:0/371208488 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fb40a7050 con 0x7f0fc4158f90 2023-11-28T18:37:41.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.391+0000 7f0fc2ffd640 1 -- 172.21.15.45:0/371208488 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb4003620 con 0x7f0fc4158f90 2023-11-28T18:37:41.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.391+0000 7f77ce384640 1 Processor -- start 2023-11-28T18:37:41.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.395+0000 7f0fc929c640 1 -- 172.21.15.45:0/371208488 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0fc4158f90 msgr2=0x7f0fc4159370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:41.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.395+0000 7f0fc929c640 1 --2- 172.21.15.45:0/371208488 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0fc4158f90 0x7f0fc4159370 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0fc40cda30 tx=0x7f0fb401c460 comp rx=0 tx=0).stop 2023-11-28T18:37:41.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.395+0000 7f77ce384640 1 -- start start 2023-11-28T18:37:41.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.395+0000 7f0fc929c640 1 -- 172.21.15.45:0/371208488 shutdown_connections 2023-11-28T18:37:41.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.395+0000 7f0fc929c640 1 --2- 172.21.15.45:0/371208488 >> v2:172.21.15.45:3300/0 conn(0x7f0fc40b1480 0x7f0fc40b3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.395+0000 7f0fc929c640 1 --2- 172.21.15.45:0/371208488 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0fc406e250 0x7f0fc40b35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.395+0000 7f0fc929c640 1 --2- 172.21.15.45:0/371208488 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0fc4158f90 0x7f0fc4159370 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.395+0000 7f0fc929c640 1 -- 172.21.15.45:0/371208488 >> 172.21.15.45:0/371208488 conn(0x7f0fc40b0960 msgr2=0x7f0fc40b0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:41.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.395+0000 7f0fc929c640 1 -- 172.21.15.45:0/371208488 shutdown_connections 2023-11-28T18:37:41.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.395+0000 7f0fc929c640 1 -- 172.21.15.45:0/371208488 wait complete. 2023-11-28T18:37:41.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.395+0000 7f77ce384640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77c80cef60 0x7f77c80d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:41.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.395+0000 7f77ce384640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f77c80cf340 0x7f77c80cb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:41.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.395+0000 7f77ce384640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f77c80b2330 0x7f77c815e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:41.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.395+0000 7f77ce384640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77c80b2750 con 0x7f77c80cf340 2023-11-28T18:37:41.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.395+0000 7f77ce384640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77c806d690 con 0x7f77c80b2330 2023-11-28T18:37:41.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.395+0000 7f77ce384640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77c815f820 con 0x7f77c80cef60 2023-11-28T18:37:41.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.395+0000 7f77cdb83640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f77c80b2330 0x7f77c815e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:41.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.395+0000 7f77ccb81640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f77c80cf340 0x7f77c80cb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:41.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.395+0000 7f77ccb81640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f77c80cf340 0x7f77c80cb7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57342/0 (socket says 172.21.15.45:57342) 2023-11-28T18:37:41.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.399+0000 7f0046ffd640 1 --2- 172.21.15.45:0/2828611778 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0048157820 0x7f004815e080 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f00480ae340 tx=0x7f003801c500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc341fbc9351b1e0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:41.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.395+0000 7f77ccb81640 1 -- 172.21.15.45:0/285471208 learned_addr learned my addr 172.21.15.45:0/285471208 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:41.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.399+0000 7f77cd382640 1 --2- 172.21.15.45:0/285471208 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77c80cef60 0x7f77c80d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:41.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.399+0000 7f77cd382640 1 -- 172.21.15.45:0/285471208 >> v2:172.21.15.190:3300/0 conn(0x7f77c80b2330 msgr2=0x7f77c815e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:41.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.399+0000 7f0fc929c640 1 Processor -- start 2023-11-28T18:37:41.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.399+0000 7f0fc929c640 1 -- start start 2023-11-28T18:37:41.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.399+0000 7f77cd382640 1 --2- 172.21.15.45:0/285471208 >> v2:172.21.15.190:3300/0 conn(0x7f77c80b2330 0x7f77c815e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.399+0000 7f77cd382640 1 -- 172.21.15.45:0/285471208 >> v2:172.21.15.45:3300/0 conn(0x7f77c80cf340 msgr2=0x7f77c80cb7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:41.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.399+0000 7f77cd382640 1 --2- 172.21.15.45:0/285471208 >> v2:172.21.15.45:3300/0 conn(0x7f77c80cf340 0x7f77c80cb7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.399+0000 7f77cd382640 1 -- 172.21.15.45:0/285471208 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c815fb00 con 0x7f77c80cef60 2023-11-28T18:37:41.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.399+0000 7f0045ffb640 1 -- 172.21.15.45:0/2828611778 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00380ab5f0 con 0x7f0048157820 2023-11-28T18:37:41.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.399+0000 7f0045ffb640 1 -- 172.21.15.45:0/2828611778 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00380ab750 con 0x7f0048157820 2023-11-28T18:37:41.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.399+0000 7f0045ffb640 1 -- 172.21.15.45:0/2828611778 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00380ab5f0 con 0x7f0048157820 2023-11-28T18:37:41.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.399+0000 7f004d2d6640 1 -- 172.21.15.45:0/2828611778 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0048157820 msgr2=0x7f004815e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:41.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.399+0000 7f004d2d6640 1 --2- 172.21.15.45:0/2828611778 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0048157820 0x7f004815e080 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f00480ae340 tx=0x7f003801c500 comp rx=0 tx=0).stop 2023-11-28T18:37:41.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.399+0000 7f004d2d6640 1 -- 172.21.15.45:0/2828611778 shutdown_connections 2023-11-28T18:37:41.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.399+0000 7f004d2d6640 1 --2- 172.21.15.45:0/2828611778 >> v2:172.21.15.45:3300/0 conn(0x7f00480afeb0 0x7f00480b0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.399+0000 7f004d2d6640 1 --2- 172.21.15.45:0/2828611778 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0048157820 0x7f004815e080 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.399+0000 7f004d2d6640 1 -- 172.21.15.45:0/2828611778 >> 172.21.15.45:0/2828611778 conn(0x7f00480aea90 msgr2=0x7f0048072300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:41.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.399+0000 7f004d2d6640 1 -- 172.21.15.45:0/2828611778 shutdown_connections 2023-11-28T18:37:41.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.399+0000 7f0fc929c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0fc406e250 0x7f0fc41431f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:41.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.403+0000 7f0fc929c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0fc40b1480 0x7f0fc409b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:41.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.403+0000 7f0fc3fff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0fc406e250 0x7f0fc41431f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:41.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.403+0000 7f0fc3fff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0fc406e250 0x7f0fc41431f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.45:42308/0 (socket says 172.21.15.45:42308) 2023-11-28T18:37:41.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.403+0000 7f0fc3fff640 1 -- 172.21.15.45:0/1429280256 learned_addr learned my addr 172.21.15.45:0/1429280256 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:41.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.403+0000 7f0fc929c640 1 --2- 172.21.15.45:0/1429280256 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0fc4158f90 0x7f0fc409b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:41.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.399+0000 7f004d2d6640 1 -- 172.21.15.45:0/2828611778 wait complete. 2023-11-28T18:37:41.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.403+0000 7f0fc37fe640 1 --2- 172.21.15.45:0/1429280256 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0fc40b1480 0x7f0fc409b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:41.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.403+0000 7f0fc929c640 1 -- 172.21.15.45:0/1429280256 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc40ad5f0 con 0x7f0fc4158f90 2023-11-28T18:37:41.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.403+0000 7f0fc929c640 1 -- 172.21.15.45:0/1429280256 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc4143c80 con 0x7f0fc406e250 2023-11-28T18:37:41.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.403+0000 7f0fc929c640 1 -- 172.21.15.45:0/1429280256 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc4143730 con 0x7f0fc40b1480 2023-11-28T18:37:41.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.403+0000 7f0fc8a9b640 1 --2- 172.21.15.45:0/1429280256 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0fc4158f90 0x7f0fc409b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:41.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.403+0000 7f004d2d6640 1 Processor -- start 2023-11-28T18:37:41.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.403+0000 7f004d2d6640 1 -- start start 2023-11-28T18:37:41.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.403+0000 7f0fc3fff640 1 -- 172.21.15.45:0/1429280256 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0fc40b1480 msgr2=0x7f0fc409b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:41.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.403+0000 7f0fc3fff640 1 --2- 172.21.15.45:0/1429280256 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0fc40b1480 0x7f0fc409b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.403+0000 7f0fc3fff640 1 -- 172.21.15.45:0/1429280256 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0fc4158f90 msgr2=0x7f0fc409b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:41.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.403+0000 7f0fc3fff640 1 --2- 172.21.15.45:0/1429280256 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0fc4158f90 0x7f0fc409b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.403+0000 7f0fc3fff640 1 -- 172.21.15.45:0/1429280256 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fb40094d0 con 0x7f0fc406e250 2023-11-28T18:37:41.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.403+0000 7f0fc3fff640 1 --2- 172.21.15.45:0/1429280256 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0fc406e250 0x7f0fc41431f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0fb40ae040 tx=0x7f0fb4019200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:41.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.403+0000 7f004d2d6640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f00480afeb0 0x7f0048142ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:41.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.403+0000 7f004d2d6640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0048157820 0x7f00480cd100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:41.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.403+0000 7f77cd382640 1 --2- 172.21.15.45:0/285471208 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77c80cef60 0x7f77c80d1920 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f77c80d0da0 tx=0x7f77c401c3d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7dfaff8edb55d5ce server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:41.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.403+0000 7f004d2d6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0048160c40 0x7f004806cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:41.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.403+0000 7f004d2d6640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0048167dc0 con 0x7f0048160c40 2023-11-28T18:37:41.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.403+0000 7f004d2d6640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00480ccc70 con 0x7f0048157820 2023-11-28T18:37:41.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.403+0000 7f004d2d6640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f004815a9c0 con 0x7f00480afeb0 2023-11-28T18:37:41.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.407+0000 7f0fc0ff9640 1 -- 172.21.15.45:0/1429280256 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb4003b70 con 0x7f0fc406e250 2023-11-28T18:37:41.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.407+0000 7f77bffff640 1 -- 172.21.15.45:0/285471208 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c40ad640 con 0x7f77c80cef60 2023-11-28T18:37:41.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.407+0000 7f77bffff640 1 -- 172.21.15.45:0/285471208 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77c40ad7a0 con 0x7f77c80cef60 2023-11-28T18:37:41.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.407+0000 7f77bffff640 1 -- 172.21.15.45:0/285471208 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c40adb30 con 0x7f77c80cef60 2023-11-28T18:37:41.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.407+0000 7f00467fc640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0048157820 0x7f00480cd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:41.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.407+0000 7f0046ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f00480afeb0 0x7f0048142ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:41.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.407+0000 7f0046ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f00480afeb0 0x7f0048142ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.45:60388/0 (socket says 172.21.15.45:60388) 2023-11-28T18:37:41.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.407+0000 7f0046ffd640 1 -- 172.21.15.45:0/2795768785 learned_addr learned my addr 172.21.15.45:0/2795768785 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:41.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.407+0000 7f0fc0ff9640 1 -- 172.21.15.45:0/1429280256 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fb4003cd0 con 0x7f0fc406e250 2023-11-28T18:37:41.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.407+0000 7f0fc0ff9640 1 -- 172.21.15.45:0/1429280256 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb40ab640 con 0x7f0fc406e250 2023-11-28T18:37:41.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.407+0000 7f77ce384640 1 -- 172.21.15.45:0/285471208 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77c80cef60 msgr2=0x7f77c80d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:41.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.407+0000 7f77ce384640 1 --2- 172.21.15.45:0/285471208 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77c80cef60 0x7f77c80d1920 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f77c80d0da0 tx=0x7f77c401c3d0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.407+0000 7f00477fe640 1 --2- 172.21.15.45:0/2795768785 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0048160c40 0x7f004806cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:41.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.407+0000 7f00467fc640 1 -- 172.21.15.45:0/2795768785 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f00480afeb0 msgr2=0x7f0048142ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:41.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.407+0000 7f00467fc640 1 --2- 172.21.15.45:0/2795768785 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f00480afeb0 0x7f0048142ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.407+0000 7f00467fc640 1 -- 172.21.15.45:0/2795768785 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0048160c40 msgr2=0x7f004806cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:41.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.407+0000 7f00467fc640 1 --2- 172.21.15.45:0/2795768785 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0048160c40 0x7f004806cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.407+0000 7f00467fc640 1 -- 172.21.15.45:0/2795768785 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00380094d0 con 0x7f0048157820 2023-11-28T18:37:41.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.407+0000 7f0fc929c640 1 -- 172.21.15.45:0/1429280256 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fc40ac970 con 0x7f0fc406e250 2023-11-28T18:37:41.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.407+0000 7f0fc929c640 1 -- 172.21.15.45:0/1429280256 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fc40acf30 con 0x7f0fc406e250 2023-11-28T18:37:41.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.407+0000 7f77ce384640 1 -- 172.21.15.45:0/285471208 shutdown_connections 2023-11-28T18:37:41.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.407+0000 7f77ce384640 1 --2- 172.21.15.45:0/285471208 >> v2:172.21.15.190:3300/0 conn(0x7f77c80b2330 0x7f77c815e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.407+0000 7f00467fc640 1 --2- 172.21.15.45:0/2795768785 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0048157820 0x7f00480cd100 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f003c00d550 tx=0x7f003c00da10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:41.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.407+0000 7f77ce384640 1 --2- 172.21.15.45:0/285471208 >> v2:172.21.15.45:3300/0 conn(0x7f77c80cf340 0x7f77c80cb7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.407+0000 7f77ce384640 1 --2- 172.21.15.45:0/285471208 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77c80cef60 0x7f77c80d1920 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.407+0000 7f77ce384640 1 -- 172.21.15.45:0/285471208 >> 172.21.15.45:0/285471208 conn(0x7f77c80d0e00 msgr2=0x7f77c80d1210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:41.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.407+0000 7f002f7fe640 1 -- 172.21.15.45:0/2795768785 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003c021480 con 0x7f0048157820 2023-11-28T18:37:41.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.407+0000 7f002f7fe640 1 -- 172.21.15.45:0/2795768785 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f003c01a070 con 0x7f0048157820 2023-11-28T18:37:41.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.407+0000 7f002f7fe640 1 -- 172.21.15.45:0/2795768785 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003c0217e0 con 0x7f0048157820 2023-11-28T18:37:41.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.407+0000 7f0fc929c640 1 -- 172.21.15.45:0/1429280256 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fc409d0c0 con 0x7f0fc406e250 2023-11-28T18:37:41.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.407+0000 7f004d2d6640 1 -- 172.21.15.45:0/2795768785 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00480cc340 con 0x7f0048157820 2023-11-28T18:37:41.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.407+0000 7f004d2d6640 1 -- 172.21.15.45:0/2795768785 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00480cc900 con 0x7f0048157820 2023-11-28T18:37:41.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.411+0000 7f77ce384640 1 -- 172.21.15.45:0/285471208 shutdown_connections 2023-11-28T18:37:41.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.411+0000 7f77ce384640 1 -- 172.21.15.45:0/285471208 wait complete. 2023-11-28T18:37:41.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.411+0000 7f002d7fa640 1 -- 172.21.15.45:0/2795768785 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0048069410 con 0x7f0048157820 2023-11-28T18:37:41.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.411+0000 7f0fc0ff9640 1 -- 172.21.15.45:0/1429280256 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f0fb40ab7a0 con 0x7f0fc406e250 2023-11-28T18:37:41.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.411+0000 7f0fc0ff9640 1 --2- 172.21.15.45:0/1429280256 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f0fb00669a0 0x7f0fb0068e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:41.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.411+0000 7f0fc0ff9640 1 -- 172.21.15.45:0/1429280256 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0fb411e870 con 0x7f0fc406e250 2023-11-28T18:37:41.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.411+0000 7f77ce384640 1 Processor -- start 2023-11-28T18:37:41.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.411+0000 7f002f7fe640 1 -- 172.21.15.45:0/2795768785 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f003c02a3f0 con 0x7f0048157820 2023-11-28T18:37:41.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.411+0000 7f77ce384640 1 -- start start 2023-11-28T18:37:41.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.415+0000 7f0fc37fe640 1 --2- 172.21.15.45:0/1429280256 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f0fb00669a0 0x7f0fb0068e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:41.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.415+0000 7f0fc37fe640 1 --2- 172.21.15.45:0/1429280256 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f0fb00669a0 0x7f0fb0068e60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0fc4150920 tx=0x7f0fb80090e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:41.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.415+0000 7f002f7fe640 1 --2- 172.21.15.45:0/2795768785 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f00340669a0 0x7f0034068e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:41.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.415+0000 7f002f7fe640 1 -- 172.21.15.45:0/2795768785 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f003c01c070 con 0x7f0048157820 2023-11-28T18:37:41.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.415+0000 7f0046ffd640 1 --2- 172.21.15.45:0/2795768785 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f00340669a0 0x7f0034068e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:41.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.415+0000 7f77ce384640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77c80b2330 0x7f77c8147380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:41.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.415+0000 7f002f7fe640 1 -- 172.21.15.45:0/2795768785 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f003c059d60 con 0x7f0048157820 2023-11-28T18:37:41.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.415+0000 7f77ce384640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77c80cef60 0x7f77c80b4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:41.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.415+0000 7f0046ffd640 1 --2- 172.21.15.45:0/2795768785 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f00340669a0 0x7f0034068e60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f003801a130 tx=0x7f00380b6040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:41.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.415+0000 7f77ce384640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77c80cf340 0x7f77c80b62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:41.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.415+0000 7f77ccb81640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77c80cef60 0x7f77c80b4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:41.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.415+0000 7f77ccb81640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77c80cef60 0x7f77c80b4660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.45:60396/0 (socket says 172.21.15.45:60396) 2023-11-28T18:37:41.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.415+0000 7f77cdb83640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77c80cf340 0x7f77c80b62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:41.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.415+0000 7f77ccb81640 1 -- 172.21.15.45:0/4125102760 learned_addr learned my addr 172.21.15.45:0/4125102760 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:41.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.415+0000 7f77ce384640 1 -- 172.21.15.45:0/4125102760 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c80b5240 con 0x7f77c80cf340 2023-11-28T18:37:41.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.415+0000 7f77cd382640 1 --2- 172.21.15.45:0/4125102760 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77c80b2330 0x7f77c8147380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:41.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.419+0000 7f77ce384640 1 -- 172.21.15.45:0/4125102760 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c80b5520 con 0x7f77c80b2330 2023-11-28T18:37:41.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.419+0000 7f77ce384640 1 -- 172.21.15.45:0/4125102760 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77c80b5800 con 0x7f77c80cef60 2023-11-28T18:37:41.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.419+0000 7f77ccb81640 1 -- 172.21.15.45:0/4125102760 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77c80b2330 msgr2=0x7f77c8147380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:41.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.419+0000 7f77ccb81640 1 --2- 172.21.15.45:0/4125102760 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77c80b2330 0x7f77c8147380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.419+0000 7f77ccb81640 1 -- 172.21.15.45:0/4125102760 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77c80cf340 msgr2=0x7f77c80b62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:41.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.419+0000 7f77ccb81640 1 --2- 172.21.15.45:0/4125102760 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77c80cf340 0x7f77c80b62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.419+0000 7f77ccb81640 1 -- 172.21.15.45:0/4125102760 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c4009420 con 0x7f77c80cef60 2023-11-28T18:37:41.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.419+0000 7f77ccb81640 1 --2- 172.21.15.45:0/4125102760 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77c80cef60 0x7f77c80b4660 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f77b800d7d0 tx=0x7f77b800dc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:41.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.419+0000 7f77bdffb640 1 -- 172.21.15.45:0/4125102760 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b80096a0 con 0x7f77c80cef60 2023-11-28T18:37:41.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.419+0000 7f77ce384640 1 -- 172.21.15.45:0/4125102760 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77c80b5ae0 con 0x7f77c80cef60 2023-11-28T18:37:41.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.419+0000 7f0fc0ff9640 1 -- 172.21.15.45:0/1429280256 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0fb40ebb50 con 0x7f0fc406e250 2023-11-28T18:37:41.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.419+0000 7f77bdffb640 1 -- 172.21.15.45:0/4125102760 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77b8009800 con 0x7f77c80cef60 2023-11-28T18:37:41.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.419+0000 7f77bdffb640 1 -- 172.21.15.45:0/4125102760 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b80096a0 con 0x7f77c80cef60 2023-11-28T18:37:41.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.423+0000 7f77ce384640 1 -- 172.21.15.45:0/4125102760 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77c80caef0 con 0x7f77c80cef60 2023-11-28T18:37:41.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.423+0000 7f77ce384640 1 -- 172.21.15.45:0/4125102760 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77c80b6000 con 0x7f77c80cef60 2023-11-28T18:37:41.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.423+0000 7f77bdffb640 1 -- 172.21.15.45:0/4125102760 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f77b8009970 con 0x7f77c80cef60 2023-11-28T18:37:41.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.427+0000 7f77bdffb640 1 --2- 172.21.15.45:0/4125102760 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f77ac066930 0x7f77ac068df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:41.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.427+0000 7f77bdffb640 1 -- 172.21.15.45:0/4125102760 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f77b8054920 con 0x7f77c80cef60 2023-11-28T18:37:41.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.427+0000 7f77cd382640 1 --2- 172.21.15.45:0/4125102760 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f77ac066930 0x7f77ac068df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:41.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.427+0000 7f77cd382640 1 --2- 172.21.15.45:0/4125102760 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f77ac066930 0x7f77ac068df0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f77c40af000 tx=0x7f77c40a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:41.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.431+0000 7f77bdffb640 1 -- 172.21.15.45:0/4125102760 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f77c80b6000 con 0x7f77c80cef60 2023-11-28T18:37:41.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.487+0000 7f1cf9f6f640 1 Processor -- start 2023-11-28T18:37:41.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.487+0000 7f1cf9f6f640 1 -- start start 2023-11-28T18:37:41.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.487+0000 7f1cf9f6f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1cf40b4180 0x7f1cf40c7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:41.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.487+0000 7f1cf8f6d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f1cf40cf9a0 0x7f1cf41605c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57696/0 (socket says 172.21.15.45:57696) 2023-11-28T18:37:41.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.487+0000 7f1cf8f6d640 1 -- 172.21.15.45:0/2495966755 learned_addr learned my addr 172.21.15.45:0/2495966755 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:37:41.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.487+0000 7f1cf976e640 1 --2- 172.21.15.45:0/2495966755 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1cf40b4180 0x7f1cf40c7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:41.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.487+0000 7f1cf9f6f640 1 -- 172.21.15.45:0/2495966755 --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cf40b3f10 con 0x7f1cf40cf9a0 2023-11-28T18:37:41.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.487+0000 7f1cf9f6f640 1 -- 172.21.15.45:0/2495966755 --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cf40b3c30 con 0x7f1cf40b46d0 2023-11-28T18:37:41.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.487+0000 7f1cf9f6f640 1 -- 172.21.15.45:0/2495966755 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf40d3bd0 con 0x7f1cf40b4180 2023-11-28T18:37:41.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.491+0000 7f1cf37fe640 1 -- 172.21.15.45:0/2495966755 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1951918411 0 0) 0x7f1cf40b3f10 con 0x7f1cf40cf9a0 2023-11-28T18:37:41.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.491+0000 7f1cf37fe640 1 -- 172.21.15.45:0/2495966755 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ce0003530 con 0x7f1cf40cf9a0 2023-11-28T18:37:41.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.491+0000 7f1cf976e640 1 -- 172.21.15.45:0/2495966755 >> v1:172.21.15.190:6789/0 conn(0x7f1cf40b46d0 legacy=0x7f1cf40c6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:41.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.491+0000 7f1cf976e640 1 -- 172.21.15.45:0/2495966755 >> v1:172.21.15.45:6789/0 conn(0x7f1cf40cf9a0 legacy=0x7f1cf41605c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:41.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.491+0000 7f1cf976e640 1 -- 172.21.15.45:0/2495966755 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf40ce7d0 con 0x7f1cf40b4180 2023-11-28T18:37:41.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.495+0000 7f07a0e79640 1 Processor -- start 2023-11-28T18:37:41.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.495+0000 7f1cf976e640 1 --2- 172.21.15.45:0/2495966755 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1cf40b4180 0x7f1cf40c7270 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1ce40097f0 tx=0x7f1ce401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=722fa37c626fb4dc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:41.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.499+0000 7f1cf37fe640 1 -- 172.21.15.45:0/2495966755 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce40ab620 con 0x7f1cf40b4180 2023-11-28T18:37:41.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.499+0000 7f1cf37fe640 1 -- 172.21.15.45:0/2495966755 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce40ab780 con 0x7f1cf40b4180 2023-11-28T18:37:41.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.499+0000 7f1cf37fe640 1 -- 172.21.15.45:0/2495966755 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce40ab620 con 0x7f1cf40b4180 2023-11-28T18:37:41.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.495+0000 7f07a0e79640 1 -- start start 2023-11-28T18:37:41.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.499+0000 7f07a0e79640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f079c0b35f0 0x7f079c0d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:41.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.499+0000 7f07a0e79640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f079c0b3cb0 0x7f079c15f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:41.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.499+0000 7f07a0e79640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f079c0cf7c0 0x7f079c0cfc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:41.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.499+0000 7f07a0e79640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f079c0d40d0 con 0x7f079c0b3cb0 2023-11-28T18:37:41.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.499+0000 7f07a0e79640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f079c0d0170 con 0x7f079c0cf7c0 2023-11-28T18:37:41.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.499+0000 7f07a0e79640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f079c0d38c0 con 0x7f079c0b35f0 2023-11-28T18:37:41.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.499+0000 7f1cf9f6f640 1 -- 172.21.15.45:0/2495966755 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1cf40b4180 msgr2=0x7f1cf40c7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:41.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.499+0000 7f1cf9f6f640 1 --2- 172.21.15.45:0/2495966755 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1cf40b4180 0x7f1cf40c7270 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1ce40097f0 tx=0x7f1ce401c480 comp rx=0 tx=0).stop 2023-11-28T18:37:41.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.499+0000 7f1cf9f6f640 1 -- 172.21.15.45:0/2495966755 shutdown_connections 2023-11-28T18:37:41.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.499+0000 7f1cf9f6f640 1 --2- 172.21.15.45:0/2495966755 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1cf40b4180 0x7f1cf40c7270 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.499+0000 7f1cf9f6f640 1 -- 172.21.15.45:0/2495966755 >> 172.21.15.45:0/2495966755 conn(0x7f1cf40d3010 msgr2=0x7f1cf40d3420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:41.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.499+0000 7f079a59c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f079c0b35f0 0x7f079c0d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:41.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.499+0000 7f079ad9d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f079c0cf7c0 0x7f079c0cfc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:41.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.499+0000 7f1cf9f6f640 1 -- 172.21.15.45:0/2495966755 shutdown_connections 2023-11-28T18:37:41.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.499+0000 7f079a59c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f079c0b35f0 0x7f079c0d0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.45:60420/0 (socket says 172.21.15.45:60420) 2023-11-28T18:37:41.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.499+0000 7f079a59c640 1 -- 172.21.15.45:0/519835571 learned_addr learned my addr 172.21.15.45:0/519835571 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:41.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.499+0000 7f0799d9b640 1 --2- 172.21.15.45:0/519835571 >> v2:172.21.15.45:3300/0 conn(0x7f079c0b3cb0 0x7f079c15f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:41.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.503+0000 7f0799d9b640 1 -- 172.21.15.45:0/519835571 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f079c0b35f0 msgr2=0x7f079c0d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:41.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.503+0000 7f0799d9b640 1 --2- 172.21.15.45:0/519835571 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f079c0b35f0 0x7f079c0d0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.503+0000 7f0799d9b640 1 -- 172.21.15.45:0/519835571 >> v2:172.21.15.190:3300/0 conn(0x7f079c0cf7c0 msgr2=0x7f079c0cfc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:41.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.503+0000 7f0799d9b640 1 --2- 172.21.15.45:0/519835571 >> v2:172.21.15.190:3300/0 conn(0x7f079c0cf7c0 0x7f079c0cfc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.499+0000 7f1cf9f6f640 1 -- 172.21.15.45:0/2495966755 wait complete. 2023-11-28T18:37:41.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.503+0000 7f1cf9f6f640 1 Processor -- start 2023-11-28T18:37:41.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.503+0000 7f1cf9f6f640 1 -- start start 2023-11-28T18:37:41.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.503+0000 7f1cf9f6f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1cf40b4180 0x7f1cf40b2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:41.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.507+0000 7f1cf9f6f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1cf40b46d0 0x7f1cf40ca360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:41.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.507+0000 7f1cf9f6f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1cf40cf9a0 0x7f1cf40ca8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:41.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.507+0000 7f1cf9f6f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf40cade0 con 0x7f1cf40b46d0 2023-11-28T18:37:41.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.507+0000 7f1cf9f6f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf40b21b0 con 0x7f1cf40cf9a0 2023-11-28T18:37:41.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.507+0000 7f1cf9f6f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf40c7370 con 0x7f1cf40b4180 2023-11-28T18:37:41.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.507+0000 7f1cf8f6d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1cf40b4180 0x7f1cf40b2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:41.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.507+0000 7f1cf8f6d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1cf40b4180 0x7f1cf40b2640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.45:60434/0 (socket says 172.21.15.45:60434) 2023-11-28T18:37:41.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.507+0000 7f1cf8f6d640 1 -- 172.21.15.45:0/1167830259 learned_addr learned my addr 172.21.15.45:0/1167830259 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:41.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.503+0000 7f0799d9b640 1 -- 172.21.15.45:0/519835571 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f079c0cdcc0 con 0x7f079c0b3cb0 2023-11-28T18:37:41.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.507+0000 7f1cf3fff640 1 --2- 172.21.15.45:0/1167830259 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1cf40b46d0 0x7f1cf40ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:41.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.507+0000 7f1cf8f6d640 1 -- 172.21.15.45:0/1167830259 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1cf40cf9a0 msgr2=0x7f1cf40ca8a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-28T18:37:41.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.507+0000 7f1cf8f6d640 1 --2- 172.21.15.45:0/1167830259 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1cf40cf9a0 0x7f1cf40ca8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.507+0000 7f1cf8f6d640 1 -- 172.21.15.45:0/1167830259 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1cf40b46d0 msgr2=0x7f1cf40ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:41.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.507+0000 7f1cf8f6d640 1 --2- 172.21.15.45:0/1167830259 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1cf40b46d0 0x7f1cf40ca360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.507+0000 7f1cf8f6d640 1 -- 172.21.15.45:0/1167830259 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce4009420 con 0x7f1cf40b4180 2023-11-28T18:37:41.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.507+0000 7f1cf8f6d640 1 --2- 172.21.15.45:0/1167830259 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1cf40b4180 0x7f1cf40b2640 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc00c450 tx=0x7f1cdc00c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:41.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.507+0000 7f1cf17fa640 1 -- 172.21.15.45:0/1167830259 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc005db0 con 0x7f1cf40b4180 2023-11-28T18:37:41.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.507+0000 7f1cf17fa640 1 -- 172.21.15.45:0/1167830259 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cdc007070 con 0x7f1cf40b4180 2023-11-28T18:37:41.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.507+0000 7f1cf17fa640 1 -- 172.21.15.45:0/1167830259 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc007400 con 0x7f1cf40b4180 2023-11-28T18:37:41.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.507+0000 7f1cf9f6f640 1 -- 172.21.15.45:0/1167830259 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cf40b15a0 con 0x7f1cf40b4180 2023-11-28T18:37:41.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.507+0000 7f1cf9f6f640 1 -- 172.21.15.45:0/1167830259 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cf40b1b60 con 0x7f1cf40b4180 2023-11-28T18:37:41.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.511+0000 7f0799d9b640 1 --2- 172.21.15.45:0/519835571 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f079c0b3cb0 0x7f079c15f0a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f079c08c620 tx=0x7f079001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f32198e0f8f51f91 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:41.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.511+0000 7f079959a640 1 -- 172.21.15.45:0/519835571 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07900ab600 con 0x7f079c0b3cb0 2023-11-28T18:37:41.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.511+0000 7f079959a640 1 -- 172.21.15.45:0/519835571 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07900ab760 con 0x7f079c0b3cb0 2023-11-28T18:37:41.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.511+0000 7f079959a640 1 -- 172.21.15.45:0/519835571 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07900abaf0 con 0x7f079c0b3cb0 2023-11-28T18:37:41.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.511+0000 7f1cf9f6f640 1 -- 172.21.15.45:0/1167830259 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cf40a0fc0 con 0x7f1cf40b4180 2023-11-28T18:37:41.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.511+0000 7f07a0e79640 1 -- 172.21.15.45:0/519835571 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f079c0b3cb0 msgr2=0x7f079c15f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:41.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.511+0000 7f07a0e79640 1 --2- 172.21.15.45:0/519835571 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f079c0b3cb0 0x7f079c15f0a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f079c08c620 tx=0x7f079001c440 comp rx=0 tx=0).stop 2023-11-28T18:37:41.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.511+0000 7f07a0e79640 1 -- 172.21.15.45:0/519835571 shutdown_connections 2023-11-28T18:37:41.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.511+0000 7f07a0e79640 1 --2- 172.21.15.45:0/519835571 >> v2:172.21.15.190:3300/0 conn(0x7f079c0cf7c0 0x7f079c0cfc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.515+0000 7f07a0e79640 1 --2- 172.21.15.45:0/519835571 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f079c0b3cb0 0x7f079c15f0a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.515+0000 7f07a0e79640 1 --2- 172.21.15.45:0/519835571 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f079c0b35f0 0x7f079c0d0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.515+0000 7f07a0e79640 1 -- 172.21.15.45:0/519835571 >> 172.21.15.45:0/519835571 conn(0x7f079c09c4f0 msgr2=0x7f079c0d31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:41.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.515+0000 7f07a0e79640 1 -- 172.21.15.45:0/519835571 shutdown_connections 2023-11-28T18:37:41.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.515+0000 7f07a0e79640 1 -- 172.21.15.45:0/519835571 wait complete. 2023-11-28T18:37:41.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.515+0000 7f1cf17fa640 1 -- 172.21.15.45:0/1167830259 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f1cdc007560 con 0x7f1cf40b4180 2023-11-28T18:37:41.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.515+0000 7f1cf17fa640 1 --2- 172.21.15.45:0/1167830259 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1cd40669d0 0x7f1cd4068e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:41.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.515+0000 7f1cf17fa640 1 -- 172.21.15.45:0/1167830259 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1cdc0839b0 con 0x7f1cf40b4180 2023-11-28T18:37:41.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.519+0000 7f1cf3fff640 1 --2- 172.21.15.45:0/1167830259 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1cd40669d0 0x7f1cd4068e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:41.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.519+0000 7f07a0e79640 1 Processor -- start 2023-11-28T18:37:41.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.519+0000 7f07a0e79640 1 -- start start 2023-11-28T18:37:41.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.519+0000 7f1cf3fff640 1 --2- 172.21.15.45:0/1167830259 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1cd40669d0 0x7f1cd4068e90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1cf41fd9e0 tx=0x7f1cec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:41.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.519+0000 7f1cf17fa640 1 -- 172.21.15.45:0/1167830259 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1cdc050c60 con 0x7f1cf40b4180 2023-11-28T18:37:41.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.519+0000 7f07a0e79640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f079c0b35f0 0x7f079c14e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:41.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.519+0000 7f07a0e79640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f079c0b3cb0 0x7f079c1fa830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:41.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.519+0000 7f079a59c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f079c0b35f0 0x7f079c14e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:41.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.523+0000 7f079a59c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f079c0b35f0 0x7f079c14e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.45:60450/0 (socket says 172.21.15.45:60450) 2023-11-28T18:37:41.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.523+0000 7f079a59c640 1 -- 172.21.15.45:0/1149804752 learned_addr learned my addr 172.21.15.45:0/1149804752 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:41.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.523+0000 7f07a0e79640 1 --2- 172.21.15.45:0/1149804752 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f079c0cf7c0 0x7f079c1fd600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:41.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.523+0000 7f0799d9b640 1 --2- 172.21.15.45:0/1149804752 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f079c0b3cb0 0x7f079c1fa830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:41.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.523+0000 7f07a0e79640 1 -- 172.21.15.45:0/1149804752 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f079c15a2c0 con 0x7f079c0b3cb0 2023-11-28T18:37:41.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.523+0000 7f07a0e79640 1 -- 172.21.15.45:0/1149804752 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f079c0cbcc0 con 0x7f079c0cf7c0 2023-11-28T18:37:41.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.523+0000 7f07a0e79640 1 -- 172.21.15.45:0/1149804752 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f079c1fdb40 con 0x7f079c0b35f0 2023-11-28T18:37:41.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.523+0000 7f079a59c640 1 -- 172.21.15.45:0/1149804752 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f079c0cf7c0 msgr2=0x7f079c1fd600 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-28T18:37:41.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.523+0000 7f079a59c640 1 --2- 172.21.15.45:0/1149804752 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f079c0cf7c0 0x7f079c1fd600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.523+0000 7f079a59c640 1 -- 172.21.15.45:0/1149804752 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f079c0b3cb0 msgr2=0x7f079c1fa830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:41.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.523+0000 7f079a59c640 1 --2- 172.21.15.45:0/1149804752 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f079c0b3cb0 0x7f079c1fa830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.523+0000 7f079a59c640 1 -- 172.21.15.45:0/1149804752 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0790009420 con 0x7f079c0b35f0 2023-11-28T18:37:41.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.523+0000 7f079a59c640 1 --2- 172.21.15.45:0/1149804752 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f079c0b35f0 0x7f079c14e410 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f078c00e8e0 tx=0x7f078c00eda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:41.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.523+0000 7f078affd640 1 -- 172.21.15.45:0/1149804752 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f078c00ca00 con 0x7f079c0b35f0 2023-11-28T18:37:41.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.527+0000 7f07a0e79640 1 -- 172.21.15.45:0/1149804752 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f079c159fe0 con 0x7f079c0b35f0 2023-11-28T18:37:41.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.527+0000 7f07a0e79640 1 -- 172.21.15.45:0/1149804752 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f079c0cb8e0 con 0x7f079c0b35f0 2023-11-28T18:37:41.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.527+0000 7f078affd640 1 -- 172.21.15.45:0/1149804752 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f078c00cb60 con 0x7f079c0b35f0 2023-11-28T18:37:41.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.527+0000 7f078affd640 1 -- 172.21.15.45:0/1149804752 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f078c00ca00 con 0x7f079c0b35f0 2023-11-28T18:37:41.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.527+0000 7f9c17d72640 1 Processor -- start 2023-11-28T18:37:41.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.527+0000 7f9c17d72640 1 -- start start 2023-11-28T18:37:41.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.527+0000 7f9c17d72640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9c080df390 0x7f9c08007190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:41.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.531+0000 7f9c17d72640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c08005ea0 con 0x7f9c0804fa80 2023-11-28T18:37:41.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.531+0000 7f9c17d72640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c08006d00 con 0x7f9c0804f5c0 2023-11-28T18:37:41.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.531+0000 7f9c17d72640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c08054390 con 0x7f9c080df390 2023-11-28T18:37:41.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.531+0000 7f078affd640 1 -- 172.21.15.45:0/1149804752 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f078c00ccd0 con 0x7f079c0b35f0 2023-11-28T18:37:41.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.531+0000 7f9c1530d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9c080df390 0x7f9c08007190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:41.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.531+0000 7f9c1630f640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f9c0804f5c0 0x7f9c08038020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.45:59352/0 (socket says 172.21.15.45:59352) 2023-11-28T18:37:41.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.531+0000 7f9c1630f640 1 -- 172.21.15.45:0/2103609929 learned_addr learned my addr 172.21.15.45:0/2103609929 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:37:41.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.531+0000 7f9c1530d640 1 -- 172.21.15.45:0/2103609929 >> v1:172.21.15.190:6789/0 conn(0x7f9c0804f5c0 legacy=0x7f9c08038020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:41.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.531+0000 7f9c1530d640 1 -- 172.21.15.45:0/2103609929 >> v1:172.21.15.45:6789/0 conn(0x7f9c0804fa80 legacy=0x7f9c0804fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:41.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.531+0000 7f9c1530d640 1 -- 172.21.15.45:0/2103609929 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c080060f0 con 0x7f9c080df390 2023-11-28T18:37:41.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.531+0000 7f078affd640 1 --2- 172.21.15.45:0/1149804752 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f077c066930 0x7f077c068df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:41.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.531+0000 7f078affd640 1 -- 172.21.15.45:0/1149804752 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f078c0842f0 con 0x7f079c0b35f0 2023-11-28T18:37:41.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.535+0000 7f07a0e79640 1 -- 172.21.15.45:0/1149804752 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0780005260 con 0x7f079c0b35f0 2023-11-28T18:37:41.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.535+0000 7f0799d9b640 1 --2- 172.21.15.45:0/1149804752 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f077c066930 0x7f077c068df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:41.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.535+0000 7f0799d9b640 1 --2- 172.21.15.45:0/1149804752 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f077c066930 0x7f077c068df0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f07900af000 tx=0x7f07900a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:41.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.535+0000 7f9c1530d640 1 --2- 172.21.15.45:0/2103609929 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c080df390 0x7f9c08007190 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c0097c0 tx=0x7f9c0c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ceee4dd7c2ddca2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:41.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.535+0000 7f9c14b0c640 1 -- 172.21.15.45:0/2103609929 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c0c0ab650 con 0x7f9c080df390 2023-11-28T18:37:41.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.539+0000 7f9c14b0c640 1 -- 172.21.15.45:0/2103609929 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c0c0ab7b0 con 0x7f9c080df390 2023-11-28T18:37:41.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.539+0000 7f9c14b0c640 1 -- 172.21.15.45:0/2103609929 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c0c0abb40 con 0x7f9c080df390 2023-11-28T18:37:41.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.539+0000 7f95c1701640 1 Processor -- start 2023-11-28T18:37:41.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.539+0000 7f078affd640 1 -- 172.21.15.45:0/1149804752 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f078c017080 con 0x7f079c0b35f0 2023-11-28T18:37:41.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.539+0000 7f95c1701640 1 -- start start 2023-11-28T18:37:41.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.539+0000 7f9c17d72640 1 -- 172.21.15.45:0/2103609929 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c080df390 msgr2=0x7f9c08007190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:41.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.539+0000 7f9c17d72640 1 --2- 172.21.15.45:0/2103609929 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c080df390 0x7f9c08007190 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c0097c0 tx=0x7f9c0c01c450 comp rx=0 tx=0).stop 2023-11-28T18:37:41.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.539+0000 7f9c17d72640 1 -- 172.21.15.45:0/2103609929 shutdown_connections 2023-11-28T18:37:41.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.539+0000 7f9c17d72640 1 --2- 172.21.15.45:0/2103609929 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c080df390 0x7f9c08007190 secure :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c0097c0 tx=0x7f9c0c01c450 comp rx=0 tx=0).stop 2023-11-28T18:37:41.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.539+0000 7f9c17d72640 1 -- 172.21.15.45:0/2103609929 >> 172.21.15.45:0/2103609929 conn(0x7f9c08009fc0 msgr2=0x7f9c0800a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:41.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.539+0000 7f9c17d72640 1 -- 172.21.15.45:0/2103609929 shutdown_connections 2023-11-28T18:37:41.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.539+0000 7f9c17d72640 1 -- 172.21.15.45:0/2103609929 wait complete. 2023-11-28T18:37:41.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.539+0000 7f95c1701640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f95bc0d17c0 0x7f95bc0d1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:41.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.543+0000 7f95c1701640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f95bc0cfb00 0x7f95bc0cff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:41.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.543+0000 7f95baffd640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f95bc0b3c00 0x7f95bc0b2a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.45:59366/0 (socket says 172.21.15.45:59366) 2023-11-28T18:37:41.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.543+0000 7f95baffd640 1 -- 172.21.15.45:0/3820082401 learned_addr learned my addr 172.21.15.45:0/3820082401 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:37:41.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.539+0000 7fd82e0bb640 1 Processor -- start 2023-11-28T18:37:41.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.539+0000 7fd82e0bb640 1 -- start start 2023-11-28T18:37:41.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.543+0000 7f95c1701640 1 -- 172.21.15.45:0/3820082401 --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95bc0d0d70 con 0x7f95bc0b3c00 2023-11-28T18:37:41.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.543+0000 7f9c17d72640 1 Processor -- start 2023-11-28T18:37:41.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.543+0000 7f95c1701640 1 -- 172.21.15.45:0/3820082401 --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95bc0d04d0 con 0x7f95bc0d17c0 2023-11-28T18:37:41.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.543+0000 7fd82e0bb640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd8280cf390 0x7fd8281536d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:41.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.543+0000 7fd82e0bb640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd8280cc7e0 0x7fd8280ccbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:41.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.543+0000 7fd82e0bb640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8280b2d00 con 0x7fd82806e330 2023-11-28T18:37:41.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.543+0000 7fd82e0bb640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8280b2f30 con 0x7fd8280cf390 2023-11-28T18:37:41.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.543+0000 7fd82e0bb640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8280b3210 con 0x7fd8280cc7e0 2023-11-28T18:37:41.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.543+0000 7f9c17d72640 1 -- start start 2023-11-28T18:37:41.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.543+0000 7f95c1701640 1 -- 172.21.15.45:0/3820082401 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95bc160fc0 con 0x7f95bc0cfb00 2023-11-28T18:37:41.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.543+0000 7f95bb7fe640 1 --2- 172.21.15.45:0/3820082401 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f95bc0cfb00 0x7f95bc0cff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:41.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.543+0000 7f95b9ffb640 1 -- 172.21.15.45:0/3820082401 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3112852942 0 0) 0x7f95bc0d0d70 con 0x7f95bc0b3c00 2023-11-28T18:37:41.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.543+0000 7fd82c8b8640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd8280cf390 0x7fd8281536d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:41.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.543+0000 7fd82c8b8640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd8280cf390 0x7fd8281536d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.45:42364/0 (socket says 172.21.15.45:42364) 2023-11-28T18:37:41.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.543+0000 7fd82c8b8640 1 -- 172.21.15.45:0/589762692 learned_addr learned my addr 172.21.15.45:0/589762692 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:41.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.543+0000 7fd82d8ba640 1 --2- 172.21.15.45:0/589762692 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd8280cc7e0 0x7fd8280ccbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:41.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.543+0000 7fd82c8b8640 1 -- 172.21.15.45:0/589762692 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd8280cc7e0 msgr2=0x7fd8280ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:41.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.543+0000 7fd82c8b8640 1 --2- 172.21.15.45:0/589762692 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd8280cc7e0 0x7fd8280ccbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.543+0000 7fd82c8b8640 1 -- 172.21.15.45:0/589762692 >> v1:172.21.15.45:6789/0 conn(0x7fd82806e330 legacy=0x7fd8280cec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:41.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.543+0000 7fd82c8b8640 1 -- 172.21.15.45:0/589762692 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8280b3fd0 con 0x7fd8280cf390 2023-11-28T18:37:41.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.543+0000 7f95ba7fc640 1 --2- 172.21.15.45:0/3820082401 >> v2:172.21.15.45:3300/0 conn(0x7f95bc0d17c0 0x7f95bc0d1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:41.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.543+0000 7f95b9ffb640 1 -- 172.21.15.45:0/3820082401 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95a4003530 con 0x7f95bc0b3c00 2023-11-28T18:37:41.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.543+0000 7f95b9ffb640 1 -- 172.21.15.45:0/3820082401 <== mon.1 v1:172.21.15.190:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3092430953 0 0) 0x7f95a4003530 con 0x7f95bc0b3c00 2023-11-28T18:37:41.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.543+0000 7f95b9ffb640 1 -- 172.21.15.45:0/3820082401 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f95bc0cfb00 msgr2=0x7f95bc0cff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:41.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.543+0000 7f95b9ffb640 1 --2- 172.21.15.45:0/3820082401 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f95bc0cfb00 0x7f95bc0cff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.543+0000 7f95b9ffb640 1 -- 172.21.15.45:0/3820082401 >> v2:172.21.15.45:3300/0 conn(0x7f95bc0d17c0 msgr2=0x7f95bc0d1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:41.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.543+0000 7fd82d8ba640 1 --2- 172.21.15.45:0/589762692 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd8280cc7e0 0x7fd8280ccbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:37:41.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.543+0000 7f95b9ffb640 1 --2- 172.21.15.45:0/3820082401 >> v2:172.21.15.45:3300/0 conn(0x7f95bc0d17c0 0x7f95bc0d1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.543+0000 7f95b9ffb640 1 -- 172.21.15.45:0/3820082401 --> v1:172.21.15.190:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95bc0d1330 con 0x7f95bc0b3c00 2023-11-28T18:37:41.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.543+0000 7f9c17d72640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c0804f5c0 0x7f9c0804def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:41.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.543+0000 7f9c17d72640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c0804fa80 0x7f9c0804c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:41.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.547+0000 7f9c17d72640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c08046cf0 0x7f9c080463e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:41.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.547+0000 7f95b9ffb640 1 -- 172.21.15.45:0/3820082401 <== mon.1 v1:172.21.15.190:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4084481567 0 0) 0x7f95b0001680 con 0x7f95bc0b3c00 2023-11-28T18:37:41.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.547+0000 7f95b9ffb640 1 -- 172.21.15.45:0/3820082401 >> v1:172.21.15.190:6789/0 conn(0x7f95bc0b3c00 legacy=0x7f95bc0b2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:41.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.547+0000 7f9c17d72640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0804da60 con 0x7f9c0804f5c0 2023-11-28T18:37:41.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.547+0000 7f9c17d72640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0804ce50 con 0x7f9c0804fa80 2023-11-28T18:37:41.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.547+0000 7f9c17d72640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0804d130 con 0x7f9c08046cf0 2023-11-28T18:37:41.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.547+0000 7f9c1630f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c08046cf0 0x7f9c080463e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:41.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.547+0000 7f9c1530d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c0804fa80 0x7f9c0804c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:41.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.547+0000 7f9c1630f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c08046cf0 0x7f9c080463e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.45:60468/0 (socket says 172.21.15.45:60468) 2023-11-28T18:37:41.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.547+0000 7f9c1630f640 1 -- 172.21.15.45:0/297355760 learned_addr learned my addr 172.21.15.45:0/297355760 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:41.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.547+0000 7f95b9ffb640 1 --2- 172.21.15.45:0/3820082401 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f95a40039b0 0x7f95a4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:41.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.547+0000 7f95b9ffb640 1 --2- 172.21.15.45:0/3820082401 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95a40047d0 0x7f95a4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:41.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.547+0000 7f95b9ffb640 1 --2- 172.21.15.45:0/3820082401 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f95bc0cfb00 0x7f95a4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:41.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.547+0000 7f95b9ffb640 1 -- 172.21.15.45:0/3820082401 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95bc0d04d0 con 0x7f95a40047d0 2023-11-28T18:37:41.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.547+0000 7f95b9ffb640 1 -- 172.21.15.45:0/3820082401 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95bc160fc0 con 0x7f95a40039b0 2023-11-28T18:37:41.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.547+0000 7f95b9ffb640 1 -- 172.21.15.45:0/3820082401 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95a400ba40 con 0x7f95bc0cfb00 2023-11-28T18:37:41.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.547+0000 7f9c1630f640 1 -- 172.21.15.45:0/297355760 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c0804fa80 msgr2=0x7f9c0804c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:41.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.547+0000 7f9c1630f640 1 --2- 172.21.15.45:0/297355760 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c0804fa80 0x7f9c0804c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.547+0000 7f9c1630f640 1 -- 172.21.15.45:0/297355760 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c0804f5c0 msgr2=0x7f9c0804def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:41.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.547+0000 7f9c1630f640 1 --2- 172.21.15.45:0/297355760 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c0804f5c0 0x7f9c0804def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.547+0000 7f9c1630f640 1 -- 172.21.15.45:0/297355760 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c0c009420 con 0x7f9c08046cf0 2023-11-28T18:37:41.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.547+0000 7f95ba7fc640 1 --2- 172.21.15.45:0/3820082401 >> v2:172.21.15.45:3300/0 conn(0x7f95bc0d17c0 0x7f95bc0d1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:37:41.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.547+0000 7f95bb7fe640 1 --2- 172.21.15.45:0/3820082401 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f95bc0cfb00 0x7f95a4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:41.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.547+0000 7f9c1630f640 1 --2- 172.21.15.45:0/297355760 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c08046cf0 0x7f9c080463e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9c0000c400 tx=0x7f9c0000c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:41.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.547+0000 7f9c067fc640 1 -- 172.21.15.45:0/297355760 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c00005cf0 con 0x7f9c08046cf0 2023-11-28T18:37:41.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.547+0000 7f9c067fc640 1 -- 172.21.15.45:0/297355760 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c00005e50 con 0x7f9c08046cf0 2023-11-28T18:37:41.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.547+0000 7f9c067fc640 1 -- 172.21.15.45:0/297355760 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c000072d0 con 0x7f9c08046cf0 2023-11-28T18:37:41.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.547+0000 7f95baffd640 1 --2- 172.21.15.45:0/3820082401 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f95a40039b0 0x7f95a4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:41.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.547+0000 7f95ba7fc640 1 --2- 172.21.15.45:0/3820082401 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95a40047d0 0x7f95a4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:41.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.547+0000 7f9c17d72640 1 -- 172.21.15.45:0/297355760 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c08007850 con 0x7f9c08046cf0 2023-11-28T18:37:41.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.547+0000 7f9c17d72640 1 -- 172.21.15.45:0/297355760 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c0804d6f0 con 0x7f9c08046cf0 2023-11-28T18:37:41.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.547+0000 7f95baffd640 1 -- 172.21.15.45:0/3820082401 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f95bc0cfb00 msgr2=0x7f95a4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:41.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.547+0000 7f95baffd640 1 --2- 172.21.15.45:0/3820082401 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f95bc0cfb00 0x7f95a4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.547+0000 7f95baffd640 1 -- 172.21.15.45:0/3820082401 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95a40047d0 msgr2=0x7f95a4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:41.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.547+0000 7f95baffd640 1 --2- 172.21.15.45:0/3820082401 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95a40047d0 0x7f95a4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.547+0000 7f95baffd640 1 -- 172.21.15.45:0/3820082401 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a4003530 con 0x7f95a40039b0 2023-11-28T18:37:41.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.551+0000 7f95ba7fc640 1 --2- 172.21.15.45:0/3820082401 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95a40047d0 0x7f95a4004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:37:41.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.551+0000 7f9c17d72640 1 -- 172.21.15.45:0/297355760 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c08047b20 con 0x7f9c08046cf0 2023-11-28T18:37:41.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.551+0000 7f9c067fc640 1 -- 172.21.15.45:0/297355760 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f9c00007430 con 0x7f9c08046cf0 2023-11-28T18:37:41.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.555+0000 7f9c067fc640 1 --2- 172.21.15.45:0/297355760 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9bf40668d0 0x7f9bf4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:41.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.555+0000 7f95baffd640 1 --2- 172.21.15.45:0/3820082401 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f95a40039b0 0x7f95a4003dd0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f95b000c0e0 tx=0x7f95b001f2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4e3f6d4313781ca server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:41.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.555+0000 7f9c067fc640 1 -- 172.21.15.45:0/297355760 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9c00014000 con 0x7f9c08046cf0 2023-11-28T18:37:41.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.555+0000 7f9c15b0e640 1 --2- 172.21.15.45:0/297355760 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9bf40668d0 0x7f9bf4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:41.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.555+0000 7fd82c8b8640 1 --2- 172.21.15.45:0/589762692 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd8280cf390 0x7fd8281536d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd820009870 tx=0x7fd82001ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1441457c416d21eb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:41.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.555+0000 7f95b9ffb640 1 -- 172.21.15.45:0/3820082401 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b00058e0 con 0x7f95a40039b0 2023-11-28T18:37:41.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.555+0000 7f95b9ffb640 1 -- 172.21.15.45:0/3820082401 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95b0005a60 con 0x7f95a40039b0 2023-11-28T18:37:41.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.555+0000 7f95b9ffb640 1 -- 172.21.15.45:0/3820082401 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b0005e50 con 0x7f95a40039b0 2023-11-28T18:37:41.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.555+0000 7f9c15b0e640 1 --2- 172.21.15.45:0/297355760 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9bf40668d0 0x7f9bf4068d90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9c1004fba0 tx=0x7f9c10072e60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:41.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.555+0000 7fd827fff640 1 -- 172.21.15.45:0/589762692 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8200a89b0 con 0x7fd8280cf390 2023-11-28T18:37:41.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.555+0000 7fd827fff640 1 -- 172.21.15.45:0/589762692 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8200a8b10 con 0x7fd8280cf390 2023-11-28T18:37:41.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.555+0000 7fd82e0bb640 1 -- 172.21.15.45:0/589762692 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd8280cf390 msgr2=0x7fd8281536d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:41.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.555+0000 7f95c1701640 1 -- 172.21.15.45:0/3820082401 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f95a40039b0 msgr2=0x7f95a4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:41.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.555+0000 7f95c1701640 1 --2- 172.21.15.45:0/3820082401 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f95a40039b0 0x7f95a4003dd0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f95b000c0e0 tx=0x7f95b001f2d0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.555+0000 7f95bb7fe640 1 -- 172.21.15.45:0/3820082401 reap_dead start 2023-11-28T18:37:41.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.555+0000 7fd827fff640 1 -- 172.21.15.45:0/589762692 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8200a89b0 con 0x7fd8280cf390 2023-11-28T18:37:41.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.555+0000 7fd82e0bb640 1 --2- 172.21.15.45:0/589762692 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd8280cf390 0x7fd8281536d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd820009870 tx=0x7fd82001ecf0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.555+0000 7f95c1701640 1 -- 172.21.15.45:0/3820082401 shutdown_connections 2023-11-28T18:37:41.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.555+0000 7f95c1701640 1 -- 172.21.15.45:0/3820082401 >> 172.21.15.45:0/3820082401 conn(0x7f95bc09c470 msgr2=0x7f95bc0d31a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:41.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.555+0000 7fd82e0bb640 1 -- 172.21.15.45:0/589762692 shutdown_connections 2023-11-28T18:37:41.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.555+0000 7fd82e0bb640 1 --2- 172.21.15.45:0/589762692 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd8280cc7e0 0x7fd8280ccbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.555+0000 7fd82e0bb640 1 --2- 172.21.15.45:0/589762692 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd8280cf390 0x7fd8281536d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.555+0000 7fd82e0bb640 1 -- 172.21.15.45:0/589762692 >> 172.21.15.45:0/589762692 conn(0x7fd8280b0960 msgr2=0x7fd8280b0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:41.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.555+0000 7fd82e0bb640 1 -- 172.21.15.45:0/589762692 shutdown_connections 2023-11-28T18:37:41.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.555+0000 7fd82e0bb640 1 -- 172.21.15.45:0/589762692 wait complete. 2023-11-28T18:37:41.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.559+0000 7f95c1701640 1 -- 172.21.15.45:0/3820082401 shutdown_connections 2023-11-28T18:37:41.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.559+0000 7f95c1701640 1 -- 172.21.15.45:0/3820082401 wait complete. 2023-11-28T18:37:41.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.559+0000 7fd82e0bb640 1 Processor -- start 2023-11-28T18:37:41.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.559+0000 7f95c1701640 1 Processor -- start 2023-11-28T18:37:41.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.559+0000 7fd82e0bb640 1 -- start start 2023-11-28T18:37:41.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.563+0000 7f95c1701640 1 -- start start 2023-11-28T18:37:41.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.563+0000 7f95c1701640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f95a40039b0 0x7f95bc0cb610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:41.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.563+0000 7fd82e0bb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd82806e330 0x7fd828159b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:41.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.563+0000 7fd82e0bb640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd8280cc7e0 0x7fd8280716f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:41.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.563+0000 7fd82e0bb640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd8280cf390 0x7fd828070280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:41.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.563+0000 7fd82e0bb640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd828099eb0 con 0x7fd82806e330 2023-11-28T18:37:41.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.563+0000 7fd82e0bb640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd828149c00 con 0x7fd8280cf390 2023-11-28T18:37:41.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.563+0000 7fd82e0bb640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd828149640 con 0x7fd8280cc7e0 2023-11-28T18:37:41.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.563+0000 7f95c1701640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f95bc0b8300 0x7f95bc0b8780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:41.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.563+0000 7f95baffd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f95a40039b0 0x7f95bc0cb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:41.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.563+0000 7f95baffd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f95a40039b0 0x7f95bc0cb610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.45:42372/0 (socket says 172.21.15.45:42372) 2023-11-28T18:37:41.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.563+0000 7f95baffd640 1 -- 172.21.15.45:0/159793353 learned_addr learned my addr 172.21.15.45:0/159793353 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:41.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.563+0000 7f95c1701640 1 --2- 172.21.15.45:0/159793353 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95bc0c7ae0 0x7f95bc0c7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:41.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.563+0000 7f9c067fc640 1 -- 172.21.15.45:0/297355760 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9c00050c30 con 0x7f9c08046cf0 2023-11-28T18:37:41.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.563+0000 7fd82c8b8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd8280cc7e0 0x7fd8280716f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:41.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.563+0000 7fd82c8b8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd8280cc7e0 0x7fd8280716f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.45:60486/0 (socket says 172.21.15.45:60486) 2023-11-28T18:37:41.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.563+0000 7fd82c8b8640 1 -- 172.21.15.45:0/754232601 learned_addr learned my addr 172.21.15.45:0/754232601 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:41.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.563+0000 7fd82d8ba640 1 --2- 172.21.15.45:0/754232601 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd8280cf390 0x7fd828070280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:41.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.563+0000 7f95ba7fc640 1 --2- 172.21.15.45:0/159793353 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f95bc0b8300 0x7f95bc0b8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:41.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.563+0000 7f95c1701640 1 -- 172.21.15.45:0/159793353 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95bc0b8cc0 con 0x7f95bc0c7ae0 2023-11-28T18:37:41.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.563+0000 7f95c1701640 1 -- 172.21.15.45:0/159793353 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95bc0ca570 con 0x7f95a40039b0 2023-11-28T18:37:41.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.563+0000 7f95c1701640 1 -- 172.21.15.45:0/159793353 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95bc0ca850 con 0x7f95bc0b8300 2023-11-28T18:37:41.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.563+0000 7f95bb7fe640 1 --2- 172.21.15.45:0/159793353 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95bc0c7ae0 0x7f95bc0c7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:41.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.563+0000 7fd82c8b8640 1 -- 172.21.15.45:0/754232601 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd8280cf390 msgr2=0x7fd828070280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:41.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.563+0000 7fd82c8b8640 1 --2- 172.21.15.45:0/754232601 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd8280cf390 0x7fd828070280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.563+0000 7fd82c8b8640 1 -- 172.21.15.45:0/754232601 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd82806e330 msgr2=0x7fd828159b20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T18:37:41.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.567+0000 7fd82d0b9640 1 --2- 172.21.15.45:0/754232601 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd82806e330 0x7fd828159b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:41.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.567+0000 7fd82c8b8640 1 --2- 172.21.15.45:0/754232601 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd82806e330 0x7fd828159b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.567+0000 7f95ba7fc640 1 -- 172.21.15.45:0/159793353 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f95a40039b0 msgr2=0x7f95bc0cb610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:41.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.567+0000 7f95ba7fc640 1 --2- 172.21.15.45:0/159793353 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f95a40039b0 0x7f95bc0cb610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.567+0000 7f95ba7fc640 1 -- 172.21.15.45:0/159793353 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95bc0c7ae0 msgr2=0x7f95bc0c7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:41.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.567+0000 7f95ba7fc640 1 --2- 172.21.15.45:0/159793353 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95bc0c7ae0 0x7f95bc0c7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.567+0000 7f95ba7fc640 1 -- 172.21.15.45:0/159793353 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95bc0cab30 con 0x7f95bc0b8300 2023-11-28T18:37:41.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.567+0000 7fd82c8b8640 1 -- 172.21.15.45:0/754232601 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8200094d0 con 0x7fd8280cc7e0 2023-11-28T18:37:41.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.567+0000 7fd82d0b9640 1 --2- 172.21.15.45:0/754232601 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd82806e330 0x7fd828159b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:37:41.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.567+0000 7f95ba7fc640 1 --2- 172.21.15.45:0/159793353 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f95bc0b8300 0x7f95bc0b8780 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f95ac00f530 tx=0x7f95ac00f9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:41.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.567+0000 7fd82c8b8640 1 --2- 172.21.15.45:0/754232601 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd8280cc7e0 0x7fd8280716f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd82001d3a0 tx=0x7fd82001ba90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:41.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.567+0000 7fd825ffb640 1 -- 172.21.15.45:0/754232601 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd820003820 con 0x7fd8280cc7e0 2023-11-28T18:37:41.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.567+0000 7fd825ffb640 1 -- 172.21.15.45:0/754232601 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd820003980 con 0x7fd8280cc7e0 2023-11-28T18:37:41.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.567+0000 7fd825ffb640 1 -- 172.21.15.45:0/754232601 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd820003cf0 con 0x7fd8280cc7e0 2023-11-28T18:37:41.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.567+0000 7f95a37fe640 1 -- 172.21.15.45:0/159793353 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ac004220 con 0x7f95bc0b8300 2023-11-28T18:37:41.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.567+0000 7f95a37fe640 1 -- 172.21.15.45:0/159793353 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95ac00c030 con 0x7f95bc0b8300 2023-11-28T18:37:41.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.567+0000 7f95a37fe640 1 -- 172.21.15.45:0/159793353 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ac014690 con 0x7f95bc0b8300 2023-11-28T18:37:41.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.567+0000 7fd82e0bb640 1 -- 172.21.15.45:0/754232601 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd828149920 con 0x7fd8280cc7e0 2023-11-28T18:37:41.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.567+0000 7fd82e0bb640 1 -- 172.21.15.45:0/754232601 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8281492d0 con 0x7fd8280cc7e0 2023-11-28T18:37:41.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.567+0000 7f95c1701640 1 -- 172.21.15.45:0/159793353 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95bc0cae10 con 0x7f95bc0b8300 2023-11-28T18:37:41.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.571+0000 7f95c1701640 1 -- 172.21.15.45:0/159793353 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95bc0c84d0 con 0x7f95bc0b8300 2023-11-28T18:37:41.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.571+0000 7f95c1701640 1 -- 172.21.15.45:0/159793353 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95bc0cb330 con 0x7f95bc0b8300 2023-11-28T18:37:41.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.571+0000 7fd825ffb640 1 -- 172.21.15.45:0/754232601 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fd8200bb480 con 0x7fd8280cc7e0 2023-11-28T18:37:41.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.571+0000 7fd82e0bb640 1 -- 172.21.15.45:0/754232601 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd82809d0c0 con 0x7fd8280cc7e0 2023-11-28T18:37:41.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.571+0000 7fd825ffb640 1 --2- 172.21.15.45:0/754232601 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fd814066920 0x7fd814068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:41.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.575+0000 7fd825ffb640 1 -- 172.21.15.45:0/754232601 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd820122820 con 0x7fd8280cc7e0 2023-11-28T18:37:41.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.575+0000 7fd82d0b9640 1 --2- 172.21.15.45:0/754232601 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fd814066920 0x7fd814068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:41.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.575+0000 7f95a37fe640 1 -- 172.21.15.45:0/159793353 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f95ac0147f0 con 0x7f95bc0b8300 2023-11-28T18:37:41.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.575+0000 7fd82d0b9640 1 --2- 172.21.15.45:0/754232601 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fd814066920 0x7fd814068de0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd818007fd0 tx=0x7fd818009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:41.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.575+0000 7f95a37fe640 1 --2- 172.21.15.45:0/159793353 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f95a8066900 0x7f95a8068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:41.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.575+0000 7f95a37fe640 1 -- 172.21.15.45:0/159793353 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f95ac084270 con 0x7f95bc0b8300 2023-11-28T18:37:41.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.575+0000 7f95baffd640 1 --2- 172.21.15.45:0/159793353 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f95a8066900 0x7f95a8068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:41.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.579+0000 7fd825ffb640 1 -- 172.21.15.45:0/754232601 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd8200efad0 con 0x7fd8280cc7e0 2023-11-28T18:37:41.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.583+0000 7f95baffd640 1 --2- 172.21.15.45:0/159793353 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f95a8066900 0x7f95a8068dc0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f95b0001c50 tx=0x7f95b00aa070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:41.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.583+0000 7f95a37fe640 1 -- 172.21.15.45:0/159793353 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f95bc0cb330 con 0x7f95bc0b8300 2023-11-28T18:37:41.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.723+0000 7f002d7fa640 1 -- 172.21.15.45:0/2795768785 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f00480ccdb0 con 0x7f0048157820 2023-11-28T18:37:41.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.723+0000 7f002f7fe640 1 -- 172.21.15.45:0/2795768785 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f003c05d380 con 0x7f0048157820 2023-11-28T18:37:41.729 INFO:teuthology.orchestra.run.smithi045.stdout:55834574853 2023-11-28T18:37:41.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.727+0000 7f002d7fa640 1 -- 172.21.15.45:0/2795768785 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f00340669a0 msgr2=0x7f0034068e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:41.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.727+0000 7f002d7fa640 1 --2- 172.21.15.45:0/2795768785 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f00340669a0 0x7f0034068e60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f003801a130 tx=0x7f00380b6040 comp rx=0 tx=0).stop 2023-11-28T18:37:41.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.727+0000 7f002d7fa640 1 -- 172.21.15.45:0/2795768785 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0048157820 msgr2=0x7f00480cd100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:41.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.727+0000 7f002d7fa640 1 --2- 172.21.15.45:0/2795768785 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0048157820 0x7f00480cd100 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f003c00d550 tx=0x7f003c00da10 comp rx=0 tx=0).stop 2023-11-28T18:37:41.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.731+0000 7f002d7fa640 1 -- 172.21.15.45:0/2795768785 shutdown_connections 2023-11-28T18:37:41.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.731+0000 7f002d7fa640 1 --2- 172.21.15.45:0/2795768785 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f00340669a0 0x7f0034068e60 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.731+0000 7f002d7fa640 1 --2- 172.21.15.45:0/2795768785 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0048160c40 0x7f004806cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.731+0000 7f002d7fa640 1 --2- 172.21.15.45:0/2795768785 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0048157820 0x7f00480cd100 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.731+0000 7f002d7fa640 1 --2- 172.21.15.45:0/2795768785 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f00480afeb0 0x7f0048142ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.731+0000 7f002d7fa640 1 -- 172.21.15.45:0/2795768785 >> 172.21.15.45:0/2795768785 conn(0x7f00480aea90 msgr2=0x7f0048161040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:41.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.735+0000 7f002d7fa640 1 -- 172.21.15.45:0/2795768785 shutdown_connections 2023-11-28T18:37:41.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.735+0000 7f002d7fa640 1 -- 172.21.15.45:0/2795768785 wait complete. 2023-11-28T18:37:41.770 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.2 2023-11-28T18:37:41.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.763+0000 7f0fc929c640 1 -- 172.21.15.45:0/1429280256 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0fc404e970 con 0x7f0fc406e250 2023-11-28T18:37:41.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.763+0000 7f0fc0ff9640 1 -- 172.21.15.45:0/1429280256 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0fb40b9090 con 0x7f0fc406e250 2023-11-28T18:37:41.770 INFO:teuthology.orchestra.run.smithi045.stdout:55834574853 2023-11-28T18:37:41.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.767+0000 7f0fc929c640 1 -- 172.21.15.45:0/1429280256 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f0fb00669a0 msgr2=0x7f0fb0068e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:41.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.767+0000 7f0fc929c640 1 --2- 172.21.15.45:0/1429280256 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f0fb00669a0 0x7f0fb0068e60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0fc4150920 tx=0x7f0fb80090e0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.767+0000 7f0fc929c640 1 -- 172.21.15.45:0/1429280256 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0fc406e250 msgr2=0x7f0fc41431f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:41.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.767+0000 7f0fc929c640 1 --2- 172.21.15.45:0/1429280256 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0fc406e250 0x7f0fc41431f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0fb40ae040 tx=0x7f0fb4019200 comp rx=0 tx=0).stop 2023-11-28T18:37:41.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.767+0000 7f0fc929c640 1 -- 172.21.15.45:0/1429280256 shutdown_connections 2023-11-28T18:37:41.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.771+0000 7f0fc929c640 1 --2- 172.21.15.45:0/1429280256 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f0fb00669a0 0x7f0fb0068e60 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.771+0000 7f0fc929c640 1 --2- 172.21.15.45:0/1429280256 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0fc4158f90 0x7f0fc409b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.771+0000 7f0fc929c640 1 --2- 172.21.15.45:0/1429280256 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0fc40b1480 0x7f0fc409b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.771+0000 7f0fc929c640 1 --2- 172.21.15.45:0/1429280256 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0fc406e250 0x7f0fc41431f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.771+0000 7f0fc929c640 1 -- 172.21.15.45:0/1429280256 >> 172.21.15.45:0/1429280256 conn(0x7f0fc40b0960 msgr2=0x7f0fc4166ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:41.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.771+0000 7f0fc929c640 1 -- 172.21.15.45:0/1429280256 shutdown_connections 2023-11-28T18:37:41.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.775+0000 7f0fc929c640 1 -- 172.21.15.45:0/1429280256 wait complete. 2023-11-28T18:37:41.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.795+0000 7f77ce384640 1 -- 172.21.15.45:0/4125102760 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f77c80b5940 con 0x7f77c80cef60 2023-11-28T18:37:41.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.795+0000 7f77bdffb640 1 -- 172.21.15.45:0/4125102760 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f77c80b5940 con 0x7f77c80cef60 2023-11-28T18:37:41.799 INFO:teuthology.orchestra.run.smithi045.stdout:55834574854 2023-11-28T18:37:41.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.799+0000 7f77ce384640 1 -- 172.21.15.45:0/4125102760 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f77ac066930 msgr2=0x7f77ac068df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:41.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.799+0000 7f77ce384640 1 --2- 172.21.15.45:0/4125102760 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f77ac066930 0x7f77ac068df0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f77c40af000 tx=0x7f77c40a7070 comp rx=0 tx=0).stop 2023-11-28T18:37:41.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.799+0000 7f77ce384640 1 -- 172.21.15.45:0/4125102760 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77c80cef60 msgr2=0x7f77c80b4660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:41.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.799+0000 7f77ce384640 1 --2- 172.21.15.45:0/4125102760 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77c80cef60 0x7f77c80b4660 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f77b800d7d0 tx=0x7f77b800dc90 comp rx=0 tx=0).stop 2023-11-28T18:37:41.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.799+0000 7f77ce384640 1 -- 172.21.15.45:0/4125102760 shutdown_connections 2023-11-28T18:37:41.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.799+0000 7f77ce384640 1 --2- 172.21.15.45:0/4125102760 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f77ac066930 0x7f77ac068df0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.799+0000 7f77ce384640 1 --2- 172.21.15.45:0/4125102760 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77c80cf340 0x7f77c80b62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.799+0000 7f77ce384640 1 --2- 172.21.15.45:0/4125102760 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77c80cef60 0x7f77c80b4660 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.799+0000 7f77ce384640 1 --2- 172.21.15.45:0/4125102760 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77c80b2330 0x7f77c8147380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.799+0000 7f77ce384640 1 -- 172.21.15.45:0/4125102760 >> 172.21.15.45:0/4125102760 conn(0x7f77c80d0e00 msgr2=0x7f77c806b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:41.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.799+0000 7f77ce384640 1 -- 172.21.15.45:0/4125102760 shutdown_connections 2023-11-28T18:37:41.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.799+0000 7f77ce384640 1 -- 172.21.15.45:0/4125102760 wait complete. 2023-11-28T18:37:41.808 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.1 2023-11-28T18:37:41.834 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.0 2023-11-28T18:37:41.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.839+0000 7f95c1701640 1 -- 172.21.15.45:0/159793353 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f95bc0ca990 con 0x7f95bc0b8300 2023-11-28T18:37:41.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.839+0000 7f95a37fe640 1 -- 172.21.15.45:0/159793353 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f95bc0ca990 con 0x7f95bc0b8300 2023-11-28T18:37:41.844 INFO:teuthology.orchestra.run.smithi045.stdout:55834574855 2023-11-28T18:37:41.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.843+0000 7f95c1701640 1 -- 172.21.15.45:0/159793353 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f95a8066900 msgr2=0x7f95a8068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:41.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.843+0000 7f95c1701640 1 --2- 172.21.15.45:0/159793353 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f95a8066900 0x7f95a8068dc0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f95b0001c50 tx=0x7f95b00aa070 comp rx=0 tx=0).stop 2023-11-28T18:37:41.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.843+0000 7f95c1701640 1 -- 172.21.15.45:0/159793353 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f95bc0b8300 msgr2=0x7f95bc0b8780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:41.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.843+0000 7f95c1701640 1 --2- 172.21.15.45:0/159793353 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f95bc0b8300 0x7f95bc0b8780 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f95ac00f530 tx=0x7f95ac00f9f0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.843+0000 7f95c1701640 1 -- 172.21.15.45:0/159793353 shutdown_connections 2023-11-28T18:37:41.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.843+0000 7f95c1701640 1 --2- 172.21.15.45:0/159793353 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f95a8066900 0x7f95a8068dc0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.843+0000 7f95c1701640 1 --2- 172.21.15.45:0/159793353 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95bc0c7ae0 0x7f95bc0c7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.843+0000 7f95c1701640 1 --2- 172.21.15.45:0/159793353 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f95bc0b8300 0x7f95bc0b8780 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.843+0000 7f95c1701640 1 --2- 172.21.15.45:0/159793353 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f95a40039b0 0x7f95bc0cb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.843+0000 7f95c1701640 1 -- 172.21.15.45:0/159793353 >> 172.21.15.45:0/159793353 conn(0x7f95bc09c470 msgr2=0x7f95bc0d3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:41.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.843+0000 7f95c1701640 1 -- 172.21.15.45:0/159793353 shutdown_connections 2023-11-28T18:37:41.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.843+0000 7f95c1701640 1 -- 172.21.15.45:0/159793353 wait complete. 2023-11-28T18:37:41.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.851+0000 7fd82e0bb640 1 -- 172.21.15.45:0/754232601 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fd82809d0c0 con 0x7fd8280cc7e0 2023-11-28T18:37:41.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.851+0000 7fd825ffb640 1 -- 172.21.15.45:0/754232601 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd8200f30f0 con 0x7fd8280cc7e0 2023-11-28T18:37:41.856 INFO:teuthology.orchestra.run.smithi045.stdout:55834574853 2023-11-28T18:37:41.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.855+0000 7fd82e0bb640 1 -- 172.21.15.45:0/754232601 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fd814066920 msgr2=0x7fd814068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:41.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.855+0000 7fd82e0bb640 1 --2- 172.21.15.45:0/754232601 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fd814066920 0x7fd814068de0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd818007fd0 tx=0x7fd818009040 comp rx=0 tx=0).stop 2023-11-28T18:37:41.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.855+0000 7fd82e0bb640 1 -- 172.21.15.45:0/754232601 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd8280cc7e0 msgr2=0x7fd8280716f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:41.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.855+0000 7fd82e0bb640 1 --2- 172.21.15.45:0/754232601 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd8280cc7e0 0x7fd8280716f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd82001d3a0 tx=0x7fd82001ba90 comp rx=0 tx=0).stop 2023-11-28T18:37:41.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.855+0000 7fd82e0bb640 1 -- 172.21.15.45:0/754232601 shutdown_connections 2023-11-28T18:37:41.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.855+0000 7fd82e0bb640 1 --2- 172.21.15.45:0/754232601 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fd814066920 0x7fd814068de0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.855+0000 7fd82e0bb640 1 --2- 172.21.15.45:0/754232601 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd8280cf390 0x7fd828070280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.855+0000 7fd82e0bb640 1 --2- 172.21.15.45:0/754232601 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd8280cc7e0 0x7fd8280716f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.855+0000 7fd82e0bb640 1 --2- 172.21.15.45:0/754232601 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd82806e330 0x7fd828159b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.855+0000 7fd82e0bb640 1 -- 172.21.15.45:0/754232601 >> 172.21.15.45:0/754232601 conn(0x7fd8280b0960 msgr2=0x7fd8280add50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:41.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.855+0000 7fd82e0bb640 1 -- 172.21.15.45:0/754232601 shutdown_connections 2023-11-28T18:37:41.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.855+0000 7fd82e0bb640 1 -- 172.21.15.45:0/754232601 wait complete. 2023-11-28T18:37:41.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.871+0000 7f1cf9f6f640 1 -- 172.21.15.45:0/1167830259 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f1cf404e970 con 0x7f1cf40b4180 2023-11-28T18:37:41.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.871+0000 7f1cf17fa640 1 -- 172.21.15.45:0/1167830259 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1cdc050c60 con 0x7f1cf40b4180 2023-11-28T18:37:41.875 INFO:teuthology.orchestra.run.smithi045.stdout:55834574852 2023-11-28T18:37:41.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.875+0000 7f1cf9f6f640 1 -- 172.21.15.45:0/1167830259 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1cd40669d0 msgr2=0x7f1cd4068e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:41.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.875+0000 7f1cf9f6f640 1 --2- 172.21.15.45:0/1167830259 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1cd40669d0 0x7f1cd4068e90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1cf41fd9e0 tx=0x7f1cec009040 comp rx=0 tx=0).stop 2023-11-28T18:37:41.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.875+0000 7f1cf9f6f640 1 -- 172.21.15.45:0/1167830259 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1cf40b4180 msgr2=0x7f1cf40b2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:41.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.875+0000 7f1cf9f6f640 1 --2- 172.21.15.45:0/1167830259 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1cf40b4180 0x7f1cf40b2640 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc00c450 tx=0x7f1cdc00c910 comp rx=0 tx=0).stop 2023-11-28T18:37:41.880 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.6 2023-11-28T18:37:41.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.875+0000 7f1cf9f6f640 1 -- 172.21.15.45:0/1167830259 shutdown_connections 2023-11-28T18:37:41.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.875+0000 7f1cf9f6f640 1 --2- 172.21.15.45:0/1167830259 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1cd40669d0 0x7f1cd4068e90 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.875+0000 7f1cf9f6f640 1 --2- 172.21.15.45:0/1167830259 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1cf40cf9a0 0x7f1cf40ca8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.875+0000 7f1cf9f6f640 1 --2- 172.21.15.45:0/1167830259 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1cf40b46d0 0x7f1cf40ca360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.875+0000 7f1cf9f6f640 1 --2- 172.21.15.45:0/1167830259 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1cf40b4180 0x7f1cf40b2640 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.875+0000 7f1cf9f6f640 1 -- 172.21.15.45:0/1167830259 >> 172.21.15.45:0/1167830259 conn(0x7f1cf40d3010 msgr2=0x7f1cf40c8fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:41.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.875+0000 7f1cf9f6f640 1 -- 172.21.15.45:0/1167830259 shutdown_connections 2023-11-28T18:37:41.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.875+0000 7f1cf9f6f640 1 -- 172.21.15.45:0/1167830259 wait complete. 2023-11-28T18:37:41.881 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2023-11-28T18:37:41.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.875+0000 7f9c17d72640 1 -- 172.21.15.45:0/297355760 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9c0804d270 con 0x7f9c08046cf0 2023-11-28T18:37:41.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.879+0000 7f9c067fc640 1 -- 172.21.15.45:0/297355760 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9c0804d270 con 0x7f9c08046cf0 2023-11-28T18:37:41.882 INFO:teuthology.orchestra.run.smithi045.stdout:55834574853 2023-11-28T18:37:41.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.879+0000 7f9c17d72640 1 -- 172.21.15.45:0/297355760 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9bf40668d0 msgr2=0x7f9bf4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:41.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.879+0000 7f9c17d72640 1 --2- 172.21.15.45:0/297355760 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9bf40668d0 0x7f9bf4068d90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9c1004fba0 tx=0x7f9c10072e60 comp rx=0 tx=0).stop 2023-11-28T18:37:41.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.879+0000 7f9c17d72640 1 -- 172.21.15.45:0/297355760 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c08046cf0 msgr2=0x7f9c080463e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:41.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.879+0000 7f9c17d72640 1 --2- 172.21.15.45:0/297355760 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c08046cf0 0x7f9c080463e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9c0000c400 tx=0x7f9c0000c8c0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.879+0000 7f9c17d72640 1 -- 172.21.15.45:0/297355760 shutdown_connections 2023-11-28T18:37:41.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.879+0000 7f9c17d72640 1 --2- 172.21.15.45:0/297355760 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9bf40668d0 0x7f9bf4068d90 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.879+0000 7f9c17d72640 1 --2- 172.21.15.45:0/297355760 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c08046cf0 0x7f9c080463e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.879+0000 7f9c17d72640 1 --2- 172.21.15.45:0/297355760 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c0804fa80 0x7f9c0804c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.879+0000 7f9c17d72640 1 --2- 172.21.15.45:0/297355760 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c0804f5c0 0x7f9c0804def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.879+0000 7f9c17d72640 1 -- 172.21.15.45:0/297355760 >> 172.21.15.45:0/297355760 conn(0x7f9c08009fc0 msgr2=0x7f9c080535f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:41.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.879+0000 7f9c17d72640 1 -- 172.21.15.45:0/297355760 shutdown_connections 2023-11-28T18:37:41.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.879+0000 7f9c17d72640 1 -- 172.21.15.45:0/297355760 wait complete. 2023-11-28T18:37:41.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.879+0000 7f07a0e79640 1 -- 172.21.15.45:0/1149804752 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f0780005510 con 0x7f079c0b35f0 2023-11-28T18:37:41.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.879+0000 7f078affd640 1 -- 172.21.15.45:0/1149804752 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f078c021020 con 0x7f079c0b35f0 2023-11-28T18:37:41.886 INFO:teuthology.orchestra.run.smithi045.stdout:55834574853 2023-11-28T18:37:41.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.883+0000 7f07a0e79640 1 -- 172.21.15.45:0/1149804752 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f077c066930 msgr2=0x7f077c068df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:41.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.883+0000 7f07a0e79640 1 --2- 172.21.15.45:0/1149804752 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f077c066930 0x7f077c068df0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f07900af000 tx=0x7f07900a7000 comp rx=0 tx=0).stop 2023-11-28T18:37:41.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.883+0000 7f07a0e79640 1 -- 172.21.15.45:0/1149804752 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f079c0b35f0 msgr2=0x7f079c14e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:41.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.883+0000 7f07a0e79640 1 --2- 172.21.15.45:0/1149804752 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f079c0b35f0 0x7f079c14e410 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f078c00e8e0 tx=0x7f078c00eda0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.883+0000 7f07a0e79640 1 -- 172.21.15.45:0/1149804752 shutdown_connections 2023-11-28T18:37:41.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.883+0000 7f07a0e79640 1 --2- 172.21.15.45:0/1149804752 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f077c066930 0x7f077c068df0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.883+0000 7f07a0e79640 1 --2- 172.21.15.45:0/1149804752 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f079c0cf7c0 0x7f079c1fd600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.883+0000 7f07a0e79640 1 --2- 172.21.15.45:0/1149804752 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f079c0b3cb0 0x7f079c1fa830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.883+0000 7f07a0e79640 1 --2- 172.21.15.45:0/1149804752 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f079c0b35f0 0x7f079c14e410 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:41.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.883+0000 7f07a0e79640 1 -- 172.21.15.45:0/1149804752 >> 172.21.15.45:0/1149804752 conn(0x7f079c09c4f0 msgr2=0x7f079c0afde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:41.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.883+0000 7f07a0e79640 1 -- 172.21.15.45:0/1149804752 shutdown_connections 2023-11-28T18:37:41.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:41.883+0000 7f07a0e79640 1 -- 172.21.15.45:0/1149804752 wait complete. 2023-11-28T18:37:41.905 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.5 2023-11-28T18:37:41.909 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.3 2023-11-28T18:37:41.911 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.7 2023-11-28T18:37:42.770 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-28T18:37:42.809 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-28T18:37:42.835 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-28T18:37:42.880 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-28T18:37:42.882 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-28T18:37:42.905 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-28T18:37:42.910 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-28T18:37:42.912 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-28T18:37:42.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:42.923+0000 7f1b69996640 1 Processor -- start 2023-11-28T18:37:42.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:42.927+0000 7f1b69996640 1 -- start start 2023-11-28T18:37:42.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:42.927+0000 7f1b69996640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1b640b3c00 0x7f1b640b2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:42.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:42.927+0000 7f1b69996640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f1b640b2f80 0x7f1b640d17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:42.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:42.927+0000 7f1b69996640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b640d0d70 con 0x7f1b640d1d00 2023-11-28T18:37:42.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:42.927+0000 7f1b69996640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b640d2170 con 0x7f1b640b3c00 2023-11-28T18:37:42.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:42.927+0000 7f1b69996640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b64160fc0 con 0x7f1b640b2f80 2023-11-28T18:37:42.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:42.927+0000 7f1b637fe640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f1b640d1d00 0x7f1b640cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.45:59378/0 (socket says 172.21.15.45:59378) 2023-11-28T18:37:42.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:42.927+0000 7f1b627fc640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f1b640b2f80 0x7f1b640d17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:42.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:42.927+0000 7f1b627fc640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f1b640b2f80 0x7f1b640d17c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.45:42378/0 (socket says 172.21.15.45:42378) 2023-11-28T18:37:42.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:42.927+0000 7f1b627fc640 1 -- 172.21.15.45:0/1166130899 learned_addr learned my addr 172.21.15.45:0/1166130899 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:42.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:42.931+0000 7f1b61ffb640 1 -- 172.21.15.45:0/1166130899 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4248887039 0 0) 0x7f1b640d0d70 con 0x7f1b640d1d00 2023-11-28T18:37:42.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:42.931+0000 7f1b61ffb640 1 -- 172.21.15.45:0/1166130899 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b50003530 con 0x7f1b640d1d00 2023-11-28T18:37:42.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:42.931+0000 7f1b627fc640 1 -- 172.21.15.45:0/1166130899 >> v2:172.21.15.45:3300/0 conn(0x7f1b640b3c00 msgr2=0x7f1b640b2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:42.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:42.931+0000 7f1b627fc640 1 --2- 172.21.15.45:0/1166130899 >> v2:172.21.15.45:3300/0 conn(0x7f1b640b3c00 0x7f1b640b2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:42.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:42.931+0000 7f1b627fc640 1 -- 172.21.15.45:0/1166130899 >> v1:172.21.15.190:6789/0 conn(0x7f1b640d1d00 legacy=0x7f1b640cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:42.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:42.931+0000 7f1b627fc640 1 -- 172.21.15.45:0/1166130899 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b640d1330 con 0x7f1b640b2f80 2023-11-28T18:37:42.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:42.935+0000 7f1b627fc640 1 --2- 172.21.15.45:0/1166130899 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b640b2f80 0x7f1b640d17c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1b64073f40 tx=0x7f1b5401c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de2d5ee870b1dd18 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:42.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:42.935+0000 7f1b61ffb640 1 -- 172.21.15.45:0/1166130899 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b540aa430 con 0x7f1b640b2f80 2023-11-28T18:37:42.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:42.935+0000 7f1b61ffb640 1 -- 172.21.15.45:0/1166130899 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b540aa590 con 0x7f1b640b2f80 2023-11-28T18:37:42.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:42.935+0000 7f1b61ffb640 1 -- 172.21.15.45:0/1166130899 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b540aa920 con 0x7f1b640b2f80 2023-11-28T18:37:42.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:42.935+0000 7f1b69996640 1 -- 172.21.15.45:0/1166130899 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b640b2f80 msgr2=0x7f1b640d17c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:42.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:42.935+0000 7f1b69996640 1 --2- 172.21.15.45:0/1166130899 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b640b2f80 0x7f1b640d17c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1b64073f40 tx=0x7f1b5401c510 comp rx=0 tx=0).stop 2023-11-28T18:37:42.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:42.939+0000 7f1b69996640 1 -- 172.21.15.45:0/1166130899 shutdown_connections 2023-11-28T18:37:42.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:42.939+0000 7f1b69996640 1 --2- 172.21.15.45:0/1166130899 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b640b2f80 0x7f1b640d17c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:42.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:42.939+0000 7f1b69996640 1 --2- 172.21.15.45:0/1166130899 >> v2:172.21.15.45:3300/0 conn(0x7f1b640b3c00 0x7f1b640b2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:42.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:42.939+0000 7f1b69996640 1 -- 172.21.15.45:0/1166130899 >> 172.21.15.45:0/1166130899 conn(0x7f1b6409c470 msgr2=0x7f1b640d31a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:42.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:42.939+0000 7f1b69996640 1 -- 172.21.15.45:0/1166130899 shutdown_connections 2023-11-28T18:37:42.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:42.939+0000 7f1b69996640 1 -- 172.21.15.45:0/1166130899 wait complete. 2023-11-28T18:37:42.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:42.939+0000 7f1b69996640 1 Processor -- start 2023-11-28T18:37:42.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:42.943+0000 7f1b69996640 1 -- start start 2023-11-28T18:37:42.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:42.943+0000 7f1b69996640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b640b2f80 0x7f1b6415cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:42.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:42.943+0000 7f1b69996640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b640b3c00 0x7f1b640c8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:42.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:42.943+0000 7f1b69996640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b640d1d00 0x7f1b640c8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:42.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:42.943+0000 7f1b637fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b640d1d00 0x7f1b640c8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:42.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:42.943+0000 7f1b637fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b640d1d00 0x7f1b640c8cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57486/0 (socket says 172.21.15.45:57486) 2023-11-28T18:37:42.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:42.947+0000 7f1b627fc640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b640b3c00 0x7f1b640c8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:42.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:42.947+0000 7f1b62ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b640b2f80 0x7f1b6415cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:42.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:42.947+0000 7f1b627fc640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b640b3c00 0x7f1b640c8420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.45:42390/0 (socket says 172.21.15.45:42390) 2023-11-28T18:37:42.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:42.947+0000 7f1b62ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b640b2f80 0x7f1b6415cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.45:60508/0 (socket says 172.21.15.45:60508) 2023-11-28T18:37:42.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:42.947+0000 7f1b637fe640 1 -- 172.21.15.45:0/224252116 learned_addr learned my addr 172.21.15.45:0/224252116 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:42.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:42.947+0000 7f1b69996640 1 -- 172.21.15.45:0/224252116 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b640c7ca0 con 0x7f1b640d1d00 2023-11-28T18:37:42.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:42.947+0000 7f1b69996640 1 -- 172.21.15.45:0/224252116 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b6415d490 con 0x7f1b640b3c00 2023-11-28T18:37:42.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:42.947+0000 7f1b69996640 1 -- 172.21.15.45:0/224252116 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b640c7400 con 0x7f1b640b2f80 2023-11-28T18:37:42.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:42.947+0000 7f1b637fe640 1 -- 172.21.15.45:0/224252116 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b640b2f80 msgr2=0x7f1b6415cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:42.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:42.947+0000 7f1b637fe640 1 --2- 172.21.15.45:0/224252116 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b640b2f80 0x7f1b6415cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:42.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:42.947+0000 7f1b637fe640 1 -- 172.21.15.45:0/224252116 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b640b3c00 msgr2=0x7f1b640c8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:42.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:42.947+0000 7f1b637fe640 1 --2- 172.21.15.45:0/224252116 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b640b3c00 0x7f1b640c8420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:42.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:42.947+0000 7f1b637fe640 1 -- 172.21.15.45:0/224252116 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b540094d0 con 0x7f1b640d1d00 2023-11-28T18:37:42.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:42.947+0000 7f1b627fc640 1 --2- 172.21.15.45:0/224252116 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b640b3c00 0x7f1b640c8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:37:42.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:42.947+0000 7f1b637fe640 1 --2- 172.21.15.45:0/224252116 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b640d1d00 0x7f1b640c8cb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c00c730 tx=0x7f1b5c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:42.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:42.947+0000 7f1b5bfff640 1 -- 172.21.15.45:0/224252116 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c004d70 con 0x7f1b640d1d00 2023-11-28T18:37:42.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:42.947+0000 7f1b5bfff640 1 -- 172.21.15.45:0/224252116 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b5c00a640 con 0x7f1b640d1d00 2023-11-28T18:37:42.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:42.947+0000 7f1b5bfff640 1 -- 172.21.15.45:0/224252116 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c00a9f0 con 0x7f1b640d1d00 2023-11-28T18:37:42.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:42.947+0000 7f1b69996640 1 -- 172.21.15.45:0/224252116 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b640c76e0 con 0x7f1b640d1d00 2023-11-28T18:37:42.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:42.947+0000 7f1b69996640 1 -- 172.21.15.45:0/224252116 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b640cb460 con 0x7f1b640d1d00 2023-11-28T18:37:42.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:42.951+0000 7f1b69996640 1 -- 172.21.15.45:0/224252116 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b640cb2c0 con 0x7f1b640d1d00 2023-11-28T18:37:42.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:42.951+0000 7f1b5bfff640 1 -- 172.21.15.45:0/224252116 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f1b5c00ab50 con 0x7f1b640d1d00 2023-11-28T18:37:42.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:42.955+0000 7f1b5bfff640 1 --2- 172.21.15.45:0/224252116 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1b440668d0 0x7f1b44068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:42.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:42.955+0000 7f1b5bfff640 1 -- 172.21.15.45:0/224252116 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1b5c083760 con 0x7f1b640d1d00 2023-11-28T18:37:42.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:42.955+0000 7f1b62ffd640 1 --2- 172.21.15.45:0/224252116 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1b440668d0 0x7f1b44068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:42.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:42.959+0000 7f1b62ffd640 1 --2- 172.21.15.45:0/224252116 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1b440668d0 0x7f1b44068d90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c009990 tx=0x7f1b4c009110 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:42.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:42.963+0000 7f1b5bfff640 1 -- 172.21.15.45:0/224252116 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1b640cb2c0 con 0x7f1b640d1d00 2023-11-28T18:37:43.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.015+0000 7f41565aa640 1 Processor -- start 2023-11-28T18:37:43.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.015+0000 7f41565aa640 1 -- start start 2023-11-28T18:37:43.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.015+0000 7f41565aa640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f415015cdf0 0x7f41500cb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:43.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.015+0000 7f414ffff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f415015cdf0 0x7f41500cb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:43.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.015+0000 7f414ffff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f415015cdf0 0x7f41500cb6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.45:60512/0 (socket says 172.21.15.45:60512) 2023-11-28T18:37:43.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.015+0000 7f414ffff640 1 -- 172.21.15.45:0/3054077904 learned_addr learned my addr 172.21.15.45:0/3054077904 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:43.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.015+0000 7f41565aa640 1 --2- 172.21.15.45:0/3054077904 >> v2:172.21.15.190:3300/0 conn(0x7f415015d1d0 0x7f415015d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:43.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.019+0000 7f41565aa640 1 -- 172.21.15.45:0/3054077904 --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41500ce880 con 0x7f41501594d0 2023-11-28T18:37:43.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.019+0000 7f4154b47640 1 --2- 172.21.15.45:0/3054077904 >> v2:172.21.15.190:3300/0 conn(0x7f415015d1d0 0x7f415015d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:43.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.019+0000 7f41565aa640 1 -- 172.21.15.45:0/3054077904 --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41500ce5a0 con 0x7f415015d1d0 2023-11-28T18:37:43.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.019+0000 7f41565aa640 1 -- 172.21.15.45:0/3054077904 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4150070fc0 con 0x7f415015cdf0 2023-11-28T18:37:43.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.019+0000 7f414ffff640 1 -- 172.21.15.45:0/3054077904 >> v2:172.21.15.190:3300/0 conn(0x7f415015d1d0 msgr2=0x7f415015d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:43.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.019+0000 7f414ffff640 1 --2- 172.21.15.45:0/3054077904 >> v2:172.21.15.190:3300/0 conn(0x7f415015d1d0 0x7f415015d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.019+0000 7f414ffff640 1 -- 172.21.15.45:0/3054077904 >> v1:172.21.15.45:6789/0 conn(0x7f41501594d0 legacy=0x7f41500b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:43.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.019+0000 7f414ffff640 1 -- 172.21.15.45:0/3054077904 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41500712a0 con 0x7f415015cdf0 2023-11-28T18:37:43.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.023+0000 7f4154b47640 1 --2- 172.21.15.45:0/3054077904 >> v2:172.21.15.190:3300/0 conn(0x7f415015d1d0 0x7f415015d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:37:43.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.027+0000 7f414ffff640 1 --2- 172.21.15.45:0/3054077904 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f415015cdf0 0x7f41500cb6d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f41400091e0 tx=0x7f414001d6c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dcdcee8b65f1c9dd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:43.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.027+0000 7f414effd640 1 -- 172.21.15.45:0/3054077904 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41400a6750 con 0x7f415015cdf0 2023-11-28T18:37:43.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.027+0000 7f414effd640 1 -- 172.21.15.45:0/3054077904 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41400a68b0 con 0x7f415015cdf0 2023-11-28T18:37:43.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.027+0000 7f414effd640 1 -- 172.21.15.45:0/3054077904 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41400a6c40 con 0x7f415015cdf0 2023-11-28T18:37:43.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.027+0000 7f41565aa640 1 -- 172.21.15.45:0/3054077904 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f415015cdf0 msgr2=0x7f41500cb6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:43.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.027+0000 7f41565aa640 1 --2- 172.21.15.45:0/3054077904 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f415015cdf0 0x7f41500cb6d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f41400091e0 tx=0x7f414001d6c0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.031+0000 7f41565aa640 1 -- 172.21.15.45:0/3054077904 shutdown_connections 2023-11-28T18:37:43.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.031+0000 7f41565aa640 1 --2- 172.21.15.45:0/3054077904 >> v2:172.21.15.190:3300/0 conn(0x7f415015d1d0 0x7f415015d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.031+0000 7f41565aa640 1 --2- 172.21.15.45:0/3054077904 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f415015cdf0 0x7f41500cb6d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.031+0000 7f41565aa640 1 -- 172.21.15.45:0/3054077904 >> 172.21.15.45:0/3054077904 conn(0x7f415006c300 msgr2=0x7f415006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:43.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.031+0000 7f41565aa640 1 -- 172.21.15.45:0/3054077904 shutdown_connections 2023-11-28T18:37:43.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.031+0000 7f41565aa640 1 -- 172.21.15.45:0/3054077904 wait complete. 2023-11-28T18:37:43.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.031+0000 7f41565aa640 1 Processor -- start 2023-11-28T18:37:43.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.035+0000 7f41565aa640 1 -- start start 2023-11-28T18:37:43.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.035+0000 7f41565aa640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f41501594d0 0x7f415014b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:43.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.035+0000 7f41565aa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f415015cdf0 0x7f415014d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:43.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.035+0000 7f414ffff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f41501594d0 0x7f415014b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:43.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.035+0000 7f414ffff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f41501594d0 0x7f415014b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.45:42400/0 (socket says 172.21.15.45:42400) 2023-11-28T18:37:43.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.035+0000 7f414f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f415015cdf0 0x7f415014d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:43.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.039+0000 7f414f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f415015cdf0 0x7f415014d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57488/0 (socket says 172.21.15.45:57488) 2023-11-28T18:37:43.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.039+0000 7f414ffff640 1 -- 172.21.15.45:0/749457225 learned_addr learned my addr 172.21.15.45:0/749457225 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:43.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.039+0000 7f41565aa640 1 --2- 172.21.15.45:0/749457225 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f415015d1d0 0x7f415014a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:43.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.039+0000 7f41565aa640 1 -- 172.21.15.45:0/749457225 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f415014b030 con 0x7f415015cdf0 2023-11-28T18:37:43.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.039+0000 7f4154b47640 1 --2- 172.21.15.45:0/749457225 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f415015d1d0 0x7f415014a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:43.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.039+0000 7f41565aa640 1 -- 172.21.15.45:0/749457225 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f415014bf60 con 0x7f41501594d0 2023-11-28T18:37:43.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.039+0000 7f41565aa640 1 -- 172.21.15.45:0/749457225 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f415014c2b0 con 0x7f415015d1d0 2023-11-28T18:37:43.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.039+0000 7f414ffff640 1 -- 172.21.15.45:0/749457225 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f415015d1d0 msgr2=0x7f415014a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:43.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.039+0000 7f414ffff640 1 --2- 172.21.15.45:0/749457225 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f415015d1d0 0x7f415014a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.039+0000 7f414ffff640 1 -- 172.21.15.45:0/749457225 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f415015cdf0 msgr2=0x7f415014d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:43.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.039+0000 7f414ffff640 1 --2- 172.21.15.45:0/749457225 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f415015cdf0 0x7f415014d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.039+0000 7f414ffff640 1 -- 172.21.15.45:0/749457225 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4148009a70 con 0x7f41501594d0 2023-11-28T18:37:43.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.039+0000 7f414ffff640 1 --2- 172.21.15.45:0/749457225 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f41501594d0 0x7f415014b980 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f414001bd70 tx=0x7f414001bf00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:43.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.039+0000 7f414cff9640 1 -- 172.21.15.45:0/749457225 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41400b7660 con 0x7f41501594d0 2023-11-28T18:37:43.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.039+0000 7f414cff9640 1 -- 172.21.15.45:0/749457225 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41400b77c0 con 0x7f41501594d0 2023-11-28T18:37:43.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.039+0000 7f414cff9640 1 -- 172.21.15.45:0/749457225 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41400b7b70 con 0x7f41501594d0 2023-11-28T18:37:43.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.039+0000 7f41565aa640 1 -- 172.21.15.45:0/749457225 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4140009d60 con 0x7f41501594d0 2023-11-28T18:37:43.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.043+0000 7f41565aa640 1 -- 172.21.15.45:0/749457225 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f415014c870 con 0x7f41501594d0 2023-11-28T18:37:43.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.043+0000 7f41367fc640 1 -- 172.21.15.45:0/749457225 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4150069480 con 0x7f41501594d0 2023-11-28T18:37:43.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.043+0000 7f414cff9640 1 -- 172.21.15.45:0/749457225 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f41400b5070 con 0x7f41501594d0 2023-11-28T18:37:43.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.047+0000 7f414cff9640 1 --2- 172.21.15.45:0/749457225 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f413c066900 0x7f413c068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:43.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.047+0000 7f414cff9640 1 -- 172.21.15.45:0/749457225 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f415015dd80 con 0x7f41501594d0 2023-11-28T18:37:43.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.047+0000 7f414f7fe640 1 --2- 172.21.15.45:0/749457225 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f413c066900 0x7f413c068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:43.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.051+0000 7f414f7fe640 1 --2- 172.21.15.45:0/749457225 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f413c066900 0x7f413c068dc0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4144007fd0 tx=0x7f4144009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:43.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.051+0000 7f414cff9640 1 -- 172.21.15.45:0/749457225 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f41400ebee0 con 0x7f41501594d0 2023-11-28T18:37:43.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.087+0000 7f06053b5640 1 Processor -- start 2023-11-28T18:37:43.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.087+0000 7f06053b5640 1 -- start start 2023-11-28T18:37:43.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.091+0000 7f06053b5640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f06000713b0 0x7f0600071790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:43.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.091+0000 7f06053b5640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06000702f0 con 0x7f060008a380 2023-11-28T18:37:43.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.091+0000 7f0604bb4640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f06000cc380 0x7f06000cc810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.45:59390/0 (socket says 172.21.15.45:59390) 2023-11-28T18:37:43.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.091+0000 7f0604bb4640 1 -- 172.21.15.45:0/2856671110 learned_addr learned my addr 172.21.15.45:0/2856671110 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:37:43.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.091+0000 7f06053b5640 1 -- 172.21.15.45:0/2856671110 --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0600071cd0 con 0x7f06000cc380 2023-11-28T18:37:43.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.091+0000 7f06053b5640 1 -- 172.21.15.45:0/2856671110 --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f060006e410 con 0x7f06000713b0 2023-11-28T18:37:43.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.091+0000 7f05fffff640 1 --2- 172.21.15.45:0/2856671110 >> v2:172.21.15.190:3300/0 conn(0x7f06000713b0 0x7f0600071790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:43.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.091+0000 7f05feffd640 1 -- 172.21.15.45:0/2856671110 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3723621247 0 0) 0x7f0600071cd0 con 0x7f06000cc380 2023-11-28T18:37:43.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.091+0000 7f05feffd640 1 -- 172.21.15.45:0/2856671110 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05e8003530 con 0x7f06000cc380 2023-11-28T18:37:43.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.095+0000 7f05feffd640 1 -- 172.21.15.45:0/2856671110 <== mon.1 v1:172.21.15.190:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2880774605 0 0) 0x7f05e8003530 con 0x7f06000cc380 2023-11-28T18:37:43.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.095+0000 7f05feffd640 1 -- 172.21.15.45:0/2856671110 >> v2:172.21.15.190:3300/0 conn(0x7f06000713b0 msgr2=0x7f0600071790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:43.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.095+0000 7f05feffd640 1 --2- 172.21.15.45:0/2856671110 >> v2:172.21.15.190:3300/0 conn(0x7f06000713b0 0x7f0600071790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.095+0000 7f05feffd640 1 -- 172.21.15.45:0/2856671110 >> v1:172.21.15.45:6789/0 conn(0x7f060008a380 legacy=0x7f060006dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:43.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.095+0000 7f05feffd640 1 -- 172.21.15.45:0/2856671110 --> v1:172.21.15.190:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0600070540 con 0x7f06000cc380 2023-11-28T18:37:43.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.095+0000 7f05feffd640 1 -- 172.21.15.45:0/2856671110 <== mon.1 v1:172.21.15.190:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4084481567 0 0) 0x7f05f4004ce0 con 0x7f06000cc380 2023-11-28T18:37:43.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.095+0000 7f05feffd640 1 -- 172.21.15.45:0/2856671110 >> v1:172.21.15.190:6789/0 conn(0x7f06000cc380 legacy=0x7f06000cc810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:43.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.095+0000 7f05feffd640 1 --2- 172.21.15.45:0/2856671110 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05e8003b50 0x7f05e8005f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:43.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.095+0000 7f05feffd640 1 --2- 172.21.15.45:0/2856671110 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f05e8006680 0x7f05e8008b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:43.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.095+0000 7f05feffd640 1 --2- 172.21.15.45:0/2856671110 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f05e8009310 0x7f05e800b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:43.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.095+0000 7f05feffd640 1 -- 172.21.15.45:0/2856671110 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f060006e410 con 0x7f05e8003b50 2023-11-28T18:37:43.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.095+0000 7f05feffd640 1 -- 172.21.15.45:0/2856671110 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e800c0b0 con 0x7f05e8009310 2023-11-28T18:37:43.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.095+0000 7f05feffd640 1 -- 172.21.15.45:0/2856671110 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05e800c270 con 0x7f05e8006680 2023-11-28T18:37:43.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.095+0000 7f0604bb4640 1 --2- 172.21.15.45:0/2856671110 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f05e8009310 0x7f05e800b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:43.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.095+0000 7f05ff7fe640 1 --2- 172.21.15.45:0/2856671110 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f05e8006680 0x7f05e8008b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:43.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.095+0000 7f0604bb4640 1 -- 172.21.15.45:0/2856671110 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f05e8006680 msgr2=0x7f05e8008b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:43.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.095+0000 7f0604bb4640 1 --2- 172.21.15.45:0/2856671110 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f05e8006680 0x7f05e8008b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.095+0000 7f0604bb4640 1 -- 172.21.15.45:0/2856671110 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05e8003b50 msgr2=0x7f05e8005f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:43.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.095+0000 7f0604bb4640 1 --2- 172.21.15.45:0/2856671110 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05e8003b50 0x7f05e8005f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.095+0000 7f0604bb4640 1 -- 172.21.15.45:0/2856671110 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0600070540 con 0x7f05e8009310 2023-11-28T18:37:43.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.099+0000 7f0604bb4640 1 -- 172.21.15.45:0/2856671110 reap_dead start 2023-11-28T18:37:43.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.099+0000 7f0604bb4640 1 --2- 172.21.15.45:0/2856671110 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f05e8009310 0x7f05e800b7d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f05f400d350 tx=0x7f05f401d280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b15501c3c27c91bf server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:43.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.099+0000 7f05feffd640 1 -- 172.21.15.45:0/2856671110 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f40ac620 con 0x7f05e8009310 2023-11-28T18:37:43.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.103+0000 7f05feffd640 1 -- 172.21.15.45:0/2856671110 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05f40a8070 con 0x7f05e8009310 2023-11-28T18:37:43.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.103+0000 7f05feffd640 1 -- 172.21.15.45:0/2856671110 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f40ac620 con 0x7f05e8009310 2023-11-28T18:37:43.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.103+0000 7f06053b5640 1 -- 172.21.15.45:0/2856671110 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f05e8009310 msgr2=0x7f05e800b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:43.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.103+0000 7f06053b5640 1 --2- 172.21.15.45:0/2856671110 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f05e8009310 0x7f05e800b7d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f05f400d350 tx=0x7f05f401d280 comp rx=0 tx=0).stop 2023-11-28T18:37:43.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.103+0000 7f06053b5640 1 -- 172.21.15.45:0/2856671110 shutdown_connections 2023-11-28T18:37:43.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.103+0000 7f06053b5640 1 --2- 172.21.15.45:0/2856671110 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f05e8009310 0x7f05e800b7d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.103+0000 7f06053b5640 1 -- 172.21.15.45:0/2856671110 >> 172.21.15.45:0/2856671110 conn(0x7f06000b0b20 msgr2=0x7f06000b0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:43.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.103+0000 7f06053b5640 1 -- 172.21.15.45:0/2856671110 shutdown_connections 2023-11-28T18:37:43.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.103+0000 7f06053b5640 1 -- 172.21.15.45:0/2856671110 wait complete. 2023-11-28T18:37:43.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.107+0000 7f06053b5640 1 Processor -- start 2023-11-28T18:37:43.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.107+0000 7f06053b5640 1 -- start start 2023-11-28T18:37:43.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.111+0000 7f06053b5640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f05e8009310 0x7f0600157490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:43.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.111+0000 7f06053b5640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0600174530 0x7f0600169400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:43.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.111+0000 7f06053b5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0600158cc0 0x7f0600159140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:43.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.111+0000 7f06053b5640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0600169940 con 0x7f0600158cc0 2023-11-28T18:37:43.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.111+0000 7f06053b5640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06001749b0 con 0x7f0600174530 2023-11-28T18:37:43.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.111+0000 7f06053b5640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0600159680 con 0x7f05e8009310 2023-11-28T18:37:43.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.111+0000 7f05ff7fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0600174530 0x7f0600169400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:43.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.111+0000 7f05fffff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f05e8009310 0x7f0600157490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:43.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.111+0000 7f05ff7fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0600174530 0x7f0600169400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.45:42422/0 (socket says 172.21.15.45:42422) 2023-11-28T18:37:43.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.111+0000 7f05ff7fe640 1 -- 172.21.15.45:0/3123239922 learned_addr learned my addr 172.21.15.45:0/3123239922 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:43.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.111+0000 7f0604bb4640 1 --2- 172.21.15.45:0/3123239922 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0600158cc0 0x7f0600159140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:43.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.111+0000 7f05ff7fe640 1 -- 172.21.15.45:0/3123239922 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f05e8009310 msgr2=0x7f0600157490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:43.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.111+0000 7f05ff7fe640 1 --2- 172.21.15.45:0/3123239922 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f05e8009310 0x7f0600157490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.111+0000 7f05ff7fe640 1 -- 172.21.15.45:0/3123239922 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0600158cc0 msgr2=0x7f0600159140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:43.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.111+0000 7f05ff7fe640 1 --2- 172.21.15.45:0/3123239922 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0600158cc0 0x7f0600159140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.111+0000 7f05ff7fe640 1 -- 172.21.15.45:0/3123239922 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0600173ff0 con 0x7f0600174530 2023-11-28T18:37:43.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.115+0000 7f05ff7fe640 1 --2- 172.21.15.45:0/3123239922 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0600174530 0x7f0600169400 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f05f800e7c0 tx=0x7f05f800ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:43.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.115+0000 7f05fcff9640 1 -- 172.21.15.45:0/3123239922 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f800eed0 con 0x7f0600174530 2023-11-28T18:37:43.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.115+0000 7f06053b5640 1 -- 172.21.15.45:0/3123239922 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f060015a440 con 0x7f0600174530 2023-11-28T18:37:43.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.115+0000 7f06053b5640 1 -- 172.21.15.45:0/3123239922 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0600157de0 con 0x7f0600174530 2023-11-28T18:37:43.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.115+0000 7f05fcff9640 1 -- 172.21.15.45:0/3123239922 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05f800eed0 con 0x7f0600174530 2023-11-28T18:37:43.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.115+0000 7f05fcff9640 1 -- 172.21.15.45:0/3123239922 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f800c8d0 con 0x7f0600174530 2023-11-28T18:37:43.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.119+0000 7f06053b5640 1 -- 172.21.15.45:0/3123239922 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05e0005260 con 0x7f0600174530 2023-11-28T18:37:43.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.119+0000 7f05fcff9640 1 -- 172.21.15.45:0/3123239922 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f05f800ca30 con 0x7f0600174530 2023-11-28T18:37:43.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.123+0000 7f05fcff9640 1 --2- 172.21.15.45:0/3123239922 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f05ec0669c0 0x7f05ec068e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:43.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.123+0000 7f05fcff9640 1 -- 172.21.15.45:0/3123239922 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f05f8084680 con 0x7f0600174530 2023-11-28T18:37:43.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.123+0000 7f05fffff640 1 --2- 172.21.15.45:0/3123239922 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f05ec0669c0 0x7f05ec068e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:43.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.123+0000 7f05fffff640 1 --2- 172.21.15.45:0/3123239922 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f05ec0669c0 0x7f05ec068e80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f05f00047c0 tx=0x7f05f000f040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:43.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.127+0000 7f05fcff9640 1 -- 172.21.15.45:0/3123239922 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f05f80518e0 con 0x7f0600174530 2023-11-28T18:37:43.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.159+0000 7f8699ff8640 1 Processor -- start 2023-11-28T18:37:43.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.163+0000 7f8699ff8640 1 -- start start 2023-11-28T18:37:43.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.167+0000 7f8699ff8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f868c0e30a0 0x7f868c054200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:43.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.167+0000 7f8699ff8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f868c0e6c00 0x7f868c0e7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:43.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.167+0000 7f8699ff8640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f868c037b00 con 0x7f868c0e77f0 2023-11-28T18:37:43.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.167+0000 7f8699ff8640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f868c0e75d0 con 0x7f868c0e6c00 2023-11-28T18:37:43.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.167+0000 7f8699ff8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f868c04fb10 con 0x7f868c0e30a0 2023-11-28T18:37:43.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.167+0000 7f86937fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f868c0e30a0 0x7f868c054200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:43.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.167+0000 7f86937fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f868c0e30a0 0x7f868c054200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.45:60552/0 (socket says 172.21.15.45:60552) 2023-11-28T18:37:43.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.167+0000 7f86937fe640 1 -- 172.21.15.45:0/3363432180 learned_addr learned my addr 172.21.15.45:0/3363432180 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:43.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.167+0000 7f86937fe640 1 -- 172.21.15.45:0/3363432180 >> v2:172.21.15.45:3300/0 conn(0x7f868c0e6c00 msgr2=0x7f868c0e7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:43.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.167+0000 7f86937fe640 1 --2- 172.21.15.45:0/3363432180 >> v2:172.21.15.45:3300/0 conn(0x7f868c0e6c00 0x7f868c0e7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.167+0000 7f86937fe640 1 -- 172.21.15.45:0/3363432180 >> v1:172.21.15.190:6789/0 conn(0x7f868c0e77f0 legacy=0x7f868c04f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:43.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.167+0000 7f86937fe640 1 -- 172.21.15.45:0/3363432180 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f868c04f770 con 0x7f868c0e30a0 2023-11-28T18:37:43.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.171+0000 7f8e37c9a640 1 Processor -- start 2023-11-28T18:37:43.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.171+0000 7f8e37c9a640 1 -- start start 2023-11-28T18:37:43.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.171+0000 7f86937fe640 1 --2- 172.21.15.45:0/3363432180 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f868c0e30a0 0x7f868c054200 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8694068c20 tx=0x7f86940a1b70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7299cc85d41f2cf server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:43.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.171+0000 7f86927fc640 1 -- 172.21.15.45:0/3363432180 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f869412b850 con 0x7f868c0e30a0 2023-11-28T18:37:43.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.171+0000 7f86927fc640 1 -- 172.21.15.45:0/3363432180 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f869412b9f0 con 0x7f868c0e30a0 2023-11-28T18:37:43.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.171+0000 7f86927fc640 1 -- 172.21.15.45:0/3363432180 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f869412be20 con 0x7f868c0e30a0 2023-11-28T18:37:43.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.175+0000 7f8699ff8640 1 -- 172.21.15.45:0/3363432180 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f868c0e30a0 msgr2=0x7f868c054200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:43.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.175+0000 7f8699ff8640 1 --2- 172.21.15.45:0/3363432180 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f868c0e30a0 0x7f868c054200 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8694068c20 tx=0x7f86940a1b70 comp rx=0 tx=0).stop 2023-11-28T18:37:43.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.175+0000 7f8e37c9a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e3015bcd0 0x7f8e3006c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:43.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.175+0000 7f8699ff8640 1 -- 172.21.15.45:0/3363432180 shutdown_connections 2023-11-28T18:37:43.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.175+0000 7f8699ff8640 1 --2- 172.21.15.45:0/3363432180 >> v2:172.21.15.45:3300/0 conn(0x7f868c0e6c00 0x7f868c0e7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.175+0000 7f8699ff8640 1 --2- 172.21.15.45:0/3363432180 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f868c0e30a0 0x7f868c054200 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.175+0000 7f8699ff8640 1 -- 172.21.15.45:0/3363432180 >> 172.21.15.45:0/3363432180 conn(0x7f868c009f90 msgr2=0x7f868c00a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:43.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.175+0000 7f8699ff8640 1 -- 172.21.15.45:0/3363432180 shutdown_connections 2023-11-28T18:37:43.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.175+0000 7f8699ff8640 1 -- 172.21.15.45:0/3363432180 wait complete. 2023-11-28T18:37:43.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.175+0000 7f8fd92bb640 1 Processor -- start 2023-11-28T18:37:43.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.175+0000 7f8fd92bb640 1 -- start start 2023-11-28T18:37:43.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.175+0000 7f8e37c9a640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e30146000 con 0x7f8e301459a0 2023-11-28T18:37:43.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.175+0000 7f8e37c9a640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e301462e0 con 0x7f8e3015c0b0 2023-11-28T18:37:43.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.175+0000 7f8e37c9a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e301465c0 con 0x7f8e3015bcd0 2023-11-28T18:37:43.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.175+0000 7f8e35a36640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e3015bcd0 0x7f8e3006c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:43.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.175+0000 7f8e35a36640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e3015bcd0 0x7f8e3006c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.45:60562/0 (socket says 172.21.15.45:60562) 2023-11-28T18:37:43.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.175+0000 7f8e35a36640 1 -- 172.21.15.45:0/2303368188 learned_addr learned my addr 172.21.15.45:0/2303368188 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:43.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.175+0000 7f30aa1d8640 1 Processor -- start 2023-11-28T18:37:43.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.175+0000 7f30aa1d8640 1 -- start start 2023-11-28T18:37:43.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.175+0000 7f8e35a36640 1 -- 172.21.15.45:0/2303368188 >> v1:172.21.15.190:6789/0 conn(0x7f8e3015c0b0 legacy=0x7f8e30145290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:43.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.175+0000 7f8fd92bb640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f8fd40cfc60 0x7f8fd40b46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:43.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.179+0000 7f8e35a36640 1 -- 172.21.15.45:0/2303368188 >> v1:172.21.15.45:6789/0 conn(0x7f8e301459a0 legacy=0x7f8e300b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:43.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.175+0000 7f8e34a34640 1 -- 172.21.15.45:0/2303368188 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 330942156 0 0) 0x7f8e301462e0 con 0x7f8e3015c0b0 2023-11-28T18:37:43.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.179+0000 7f8e35a36640 1 -- 172.21.15.45:0/2303368188 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e301468a0 con 0x7f8e3015bcd0 2023-11-28T18:37:43.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.179+0000 7f8fd2ffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f8fd40cfc60 0x7f8fd40b46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:43.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.179+0000 7f8fd2ffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f8fd40cfc60 0x7f8fd40b46c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.45:42428/0 (socket says 172.21.15.45:42428) 2023-11-28T18:37:43.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.179+0000 7f8fd2ffd640 1 -- 172.21.15.45:0/715169838 learned_addr learned my addr 172.21.15.45:0/715169838 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:43.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.179+0000 7f8fd92bb640 1 -- 172.21.15.45:0/715169838 --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fd40cf0f0 con 0x7f8fd40d0040 2023-11-28T18:37:43.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.179+0000 7f8fd92bb640 1 -- 172.21.15.45:0/715169838 --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fd40ce820 con 0x7f8fd40d38b0 2023-11-28T18:37:43.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.179+0000 7f8fd92bb640 1 -- 172.21.15.45:0/715169838 --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fd40d1e30 con 0x7f8fd40cfc60 2023-11-28T18:37:43.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.179+0000 7f30aa1d8640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f30a415d4d0 0x7f30a40b62d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:43.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.179+0000 7f30aa1d8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f30a40d1500 0x7f30a40d1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:43.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.179+0000 7f30aa1d8640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30a40d2230 con 0x7f30a40b5220 2023-11-28T18:37:43.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.179+0000 7f8fd2ffd640 1 -- 172.21.15.45:0/715169838 >> v1:172.21.15.190:6789/0 conn(0x7f8fd40d38b0 legacy=0x7f8fd40d1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:43.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.179+0000 7f8fd2ffd640 1 -- 172.21.15.45:0/715169838 >> v1:172.21.15.45:6789/0 conn(0x7f8fd40d0040 legacy=0x7f8fd40d1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:43.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.179+0000 7f8fd2ffd640 1 -- 172.21.15.45:0/715169838 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fd40d3e50 con 0x7f8fd40cfc60 2023-11-28T18:37:43.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.179+0000 7f30aa1d8640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30a40d3120 con 0x7f30a415d4d0 2023-11-28T18:37:43.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.179+0000 7f30aa1d8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30a40d2780 con 0x7f30a40d1500 2023-11-28T18:37:43.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.179+0000 7f30a37fe640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f30a40b5220 0x7f30a40b5600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.45:59434/0 (socket says 172.21.15.45:59434) 2023-11-28T18:37:43.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.179+0000 7f30a37fe640 1 -- 172.21.15.45:0/4146519463 learned_addr learned my addr 172.21.15.45:0/4146519463 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:37:43.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.179+0000 7f30a2ffd640 1 --2- 172.21.15.45:0/4146519463 >> v2:172.21.15.190:3300/0 conn(0x7f30a415d4d0 0x7f30a40b62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:43.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.179+0000 7f30a3fff640 1 --2- 172.21.15.45:0/4146519463 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f30a40d1500 0x7f30a40d1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:43.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.179+0000 7f8699ff8640 1 Processor -- start 2023-11-28T18:37:43.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.179+0000 7f8699ff8640 1 -- start start 2023-11-28T18:37:43.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.179+0000 7f8699ff8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f868c0e30a0 0x7f868c04abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:43.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.183+0000 7f8699ff8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f868c0e6c00 0x7f868c0db0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:43.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.183+0000 7f86937fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f868c0e30a0 0x7f868c04abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:43.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.183+0000 7f30a2ffd640 1 -- 172.21.15.45:0/4146519463 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f30a40d1500 msgr2=0x7f30a40d1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:43.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.183+0000 7f30a2ffd640 1 --2- 172.21.15.45:0/4146519463 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f30a40d1500 0x7f30a40d1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.183+0000 7f30a2ffd640 1 -- 172.21.15.45:0/4146519463 >> v1:172.21.15.190:6789/0 conn(0x7f30a40b5220 legacy=0x7f30a40b5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:43.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.183+0000 7f30a2ffd640 1 -- 172.21.15.45:0/4146519463 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30a40d2a60 con 0x7f30a415d4d0 2023-11-28T18:37:43.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.183+0000 7f86937fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f868c0e30a0 0x7f868c04abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.45:60580/0 (socket says 172.21.15.45:60580) 2023-11-28T18:37:43.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.183+0000 7f8fd2ffd640 1 --2- 172.21.15.45:0/715169838 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8fd40cfc60 0x7f8fd40b46c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc009870 tx=0x7f8fbc01c3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97253fb5c060f331 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:43.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.183+0000 7f8692ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f868c0e6c00 0x7f868c0db0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:43.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.183+0000 7f86937fe640 1 -- 172.21.15.45:0/11167811 learned_addr learned my addr 172.21.15.45:0/11167811 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:43.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.183+0000 7f8699ff8640 1 --2- 172.21.15.45:0/11167811 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f868c0e77f0 0x7f868c0db5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:43.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.183+0000 7f8699ff8640 1 -- 172.21.15.45:0/11167811 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868c0dc460 con 0x7f868c0e6c00 2023-11-28T18:37:43.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.183+0000 7f8699ff8640 1 -- 172.21.15.45:0/11167811 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868c0383e0 con 0x7f868c0e77f0 2023-11-28T18:37:43.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.183+0000 7f8699ff8640 1 -- 172.21.15.45:0/11167811 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f868c04eb40 con 0x7f868c0e30a0 2023-11-28T18:37:43.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.183+0000 7f8693fff640 1 --2- 172.21.15.45:0/11167811 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f868c0e77f0 0x7f868c0db5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:43.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.183+0000 7f86937fe640 1 -- 172.21.15.45:0/11167811 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f868c0e77f0 msgr2=0x7f868c0db5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:43.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.183+0000 7f86937fe640 1 --2- 172.21.15.45:0/11167811 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f868c0e77f0 0x7f868c0db5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.183+0000 7f86937fe640 1 -- 172.21.15.45:0/11167811 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f868c0e6c00 msgr2=0x7f868c0db0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:43.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.183+0000 7f86937fe640 1 --2- 172.21.15.45:0/11167811 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f868c0e6c00 0x7f868c0db0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.183+0000 7f86937fe640 1 -- 172.21.15.45:0/11167811 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8694068920 con 0x7f868c0e30a0 2023-11-28T18:37:43.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.183+0000 7f8fd27fc640 1 -- 172.21.15.45:0/715169838 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fbc0ac410 con 0x7f8fd40cfc60 2023-11-28T18:37:43.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.183+0000 7f8fd27fc640 1 -- 172.21.15.45:0/715169838 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fbc0ac570 con 0x7f8fd40cfc60 2023-11-28T18:37:43.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.183+0000 7f8fd27fc640 1 -- 172.21.15.45:0/715169838 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fbc0ac900 con 0x7f8fd40cfc60 2023-11-28T18:37:43.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.183+0000 7f86937fe640 1 --2- 172.21.15.45:0/11167811 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f868c0e30a0 0x7f868c04abf0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8694069370 tx=0x7f86940a0400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:43.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.183+0000 7f8fd92bb640 1 -- 172.21.15.45:0/715169838 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8fd40cfc60 msgr2=0x7f8fd40b46c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:43.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.183+0000 7f8fd92bb640 1 --2- 172.21.15.45:0/715169838 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8fd40cfc60 0x7f8fd40b46c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc009870 tx=0x7f8fbc01c3b0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.187+0000 7f8fd92bb640 1 -- 172.21.15.45:0/715169838 shutdown_connections 2023-11-28T18:37:43.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.187+0000 7f8fd92bb640 1 --2- 172.21.15.45:0/715169838 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8fd40cfc60 0x7f8fd40b46c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.187+0000 7f8fd92bb640 1 -- 172.21.15.45:0/715169838 >> 172.21.15.45:0/715169838 conn(0x7f8fd409c470 msgr2=0x7f8fd40d31a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:43.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.187+0000 7f1b86617640 1 Processor -- start 2023-11-28T18:37:43.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.187+0000 7f8fd92bb640 1 -- 172.21.15.45:0/715169838 shutdown_connections 2023-11-28T18:37:43.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.187+0000 7f867bfff640 1 -- 172.21.15.45:0/11167811 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f869413f070 con 0x7f868c0e30a0 2023-11-28T18:37:43.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.187+0000 7f867bfff640 1 -- 172.21.15.45:0/11167811 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8694133790 con 0x7f868c0e30a0 2023-11-28T18:37:43.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.187+0000 7f867bfff640 1 -- 172.21.15.45:0/11167811 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8694133940 con 0x7f868c0e30a0 2023-11-28T18:37:43.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.187+0000 7f8699ff8640 1 -- 172.21.15.45:0/11167811 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f868c0e6460 con 0x7f868c0e30a0 2023-11-28T18:37:43.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.187+0000 7f1b86617640 1 -- start start 2023-11-28T18:37:43.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.187+0000 7f8fd92bb640 1 -- 172.21.15.45:0/715169838 wait complete. 2023-11-28T18:37:43.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.187+0000 7f8e35a36640 1 --2- 172.21.15.45:0/2303368188 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e3015bcd0 0x7f8e3006c300 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8e240098a0 tx=0x7f8e2401c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10a7e60fbb42c1b7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:43.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.187+0000 7f8e34a34640 1 -- 172.21.15.45:0/2303368188 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e240ad660 con 0x7f8e3015bcd0 2023-11-28T18:37:43.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.187+0000 7f8e34a34640 1 -- 172.21.15.45:0/2303368188 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e240ad7c0 con 0x7f8e3015bcd0 2023-11-28T18:37:43.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.187+0000 7f8e34a34640 1 -- 172.21.15.45:0/2303368188 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e240adb50 con 0x7f8e3015bcd0 2023-11-28T18:37:43.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.187+0000 7f1b86617640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b800b3cb0 0x7f1b800d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:43.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.187+0000 7f1b86617640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b800d38c0 con 0x7f1b800b35f0 2023-11-28T18:37:43.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.187+0000 7f1b86617640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b800cdcc0 con 0x7f1b800cfed0 2023-11-28T18:37:43.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.187+0000 7f1b86617640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b800d40d0 con 0x7f1b800b3cb0 2023-11-28T18:37:43.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.187+0000 7f1b84bb4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b800b3cb0 0x7f1b800d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:43.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.187+0000 7f1b84bb4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b800b3cb0 0x7f1b800d0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.45:60594/0 (socket says 172.21.15.45:60594) 2023-11-28T18:37:43.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.187+0000 7f1b84bb4640 1 -- 172.21.15.45:0/61851902 learned_addr learned my addr 172.21.15.45:0/61851902 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:43.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.187+0000 7f8fd92bb640 1 Processor -- start 2023-11-28T18:37:43.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.187+0000 7f8e37c9a640 1 -- 172.21.15.45:0/2303368188 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e3015bcd0 msgr2=0x7f8e3006c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:43.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.187+0000 7f8e37c9a640 1 --2- 172.21.15.45:0/2303368188 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e3015bcd0 0x7f8e3006c300 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8e240098a0 tx=0x7f8e2401c560 comp rx=0 tx=0).stop 2023-11-28T18:37:43.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.187+0000 7f8fd92bb640 1 -- start start 2023-11-28T18:37:43.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.191+0000 7f867bfff640 1 -- 172.21.15.45:0/11167811 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f8694133aa0 con 0x7f868c0e30a0 2023-11-28T18:37:43.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.191+0000 7f8699ff8640 1 -- 172.21.15.45:0/11167811 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f868c0e5d90 con 0x7f868c0e30a0 2023-11-28T18:37:43.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.191+0000 7f8e37c9a640 1 -- 172.21.15.45:0/2303368188 shutdown_connections 2023-11-28T18:37:43.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.191+0000 7f8e37c9a640 1 --2- 172.21.15.45:0/2303368188 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e3015bcd0 0x7f8e3006c300 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.191+0000 7f8e37c9a640 1 -- 172.21.15.45:0/2303368188 >> 172.21.15.45:0/2303368188 conn(0x7f8e3006a570 msgr2=0x7f8e3006a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:43.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.191+0000 7f8e37c9a640 1 -- 172.21.15.45:0/2303368188 shutdown_connections 2023-11-28T18:37:43.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.191+0000 7f1b84bb4640 1 -- 172.21.15.45:0/61851902 >> v1:172.21.15.190:6789/0 conn(0x7f1b800cfed0 legacy=0x7f1b800ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:43.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.191+0000 7f867bfff640 1 --2- 172.21.15.45:0/11167811 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f8680066920 0x7f8680068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:43.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.191+0000 7f1b84bb4640 1 -- 172.21.15.45:0/61851902 >> v1:172.21.15.45:6789/0 conn(0x7f1b800b35f0 legacy=0x7f1b800cf7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:43.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.191+0000 7f1b84bb4640 1 -- 172.21.15.45:0/61851902 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b800d3b10 con 0x7f1b800b3cb0 2023-11-28T18:37:43.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.191+0000 7f8699ff8640 1 -- 172.21.15.45:0/11167811 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f868c0e62c0 con 0x7f868c0e30a0 2023-11-28T18:37:43.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.191+0000 7f8692ffd640 1 --2- 172.21.15.45:0/11167811 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f8680066920 0x7f8680068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:43.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.191+0000 7f8fd92bb640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8fd40cfc60 0x7f8fd40ccad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:43.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.191+0000 7f867bfff640 1 -- 172.21.15.45:0/11167811 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8694175500 con 0x7f868c0e30a0 2023-11-28T18:37:43.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.191+0000 7f8692ffd640 1 --2- 172.21.15.45:0/11167811 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f8680066920 0x7f8680068de0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f868c0375a0 tx=0x7f8684009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:43.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.191+0000 7f8fd92bb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fd40d0040 0x7f8fd40ca710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:43.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.191+0000 7f8fd92bb640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8fd40d38b0 0x7f8fd415e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:43.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.191+0000 7f8fd2ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8fd40cfc60 0x7f8fd40ccad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:43.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.191+0000 7f8fd2ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8fd40cfc60 0x7f8fd40ccad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.45:60596/0 (socket says 172.21.15.45:60596) 2023-11-28T18:37:43.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.191+0000 7f8fd2ffd640 1 -- 172.21.15.45:0/2288598709 learned_addr learned my addr 172.21.15.45:0/2288598709 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:43.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.191+0000 7f8fd92bb640 1 -- 172.21.15.45:0/2288598709 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd415e540 con 0x7f8fd40d0040 2023-11-28T18:37:43.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.191+0000 7f8fd92bb640 1 -- 172.21.15.45:0/2288598709 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd40cd0b0 con 0x7f8fd40d38b0 2023-11-28T18:37:43.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.191+0000 7f8fd92bb640 1 -- 172.21.15.45:0/2288598709 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd415d520 con 0x7f8fd40cfc60 2023-11-28T18:37:43.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.191+0000 7f8fca7fc640 1 --2- 172.21.15.45:0/2288598709 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fd40d0040 0x7f8fd40ca710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:43.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.191+0000 7f8fd37fe640 1 --2- 172.21.15.45:0/2288598709 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8fd40d38b0 0x7f8fd415e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:43.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.191+0000 7f8fca7fc640 1 -- 172.21.15.45:0/2288598709 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8fd40cfc60 msgr2=0x7f8fd40ccad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:43.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.191+0000 7f8fca7fc640 1 --2- 172.21.15.45:0/2288598709 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8fd40cfc60 0x7f8fd40ccad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.191+0000 7f8fca7fc640 1 -- 172.21.15.45:0/2288598709 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8fd40d38b0 msgr2=0x7f8fd415e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:43.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.191+0000 7f8fca7fc640 1 --2- 172.21.15.45:0/2288598709 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8fd40d38b0 0x7f8fd415e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.191+0000 7f8fca7fc640 1 -- 172.21.15.45:0/2288598709 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fbc0094d0 con 0x7f8fd40d0040 2023-11-28T18:37:43.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.191+0000 7f30a2ffd640 1 --2- 172.21.15.45:0/4146519463 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f30a415d4d0 0x7f30a40b62d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f30980097c0 tx=0x7f309801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85a891b9654e1f1e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:43.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.191+0000 7f8e37c9a640 1 -- 172.21.15.45:0/2303368188 wait complete. 2023-11-28T18:37:43.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.191+0000 7f8e37c9a640 1 Processor -- start 2023-11-28T18:37:43.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.195+0000 7f8fca7fc640 1 --2- 172.21.15.45:0/2288598709 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fd40d0040 0x7f8fd40ca710 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8fc400c360 tx=0x7f8fc400c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:43.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.195+0000 7f30a27fc640 1 -- 172.21.15.45:0/4146519463 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30980ab670 con 0x7f30a415d4d0 2023-11-28T18:37:43.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.195+0000 7f30a27fc640 1 -- 172.21.15.45:0/4146519463 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30980ab7d0 con 0x7f30a415d4d0 2023-11-28T18:37:43.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.195+0000 7f30a27fc640 1 -- 172.21.15.45:0/4146519463 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30980abb60 con 0x7f30a415d4d0 2023-11-28T18:37:43.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.195+0000 7f8e37c9a640 1 -- start start 2023-11-28T18:37:43.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.195+0000 7f8fcbfff640 1 -- 172.21.15.45:0/2288598709 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc4003600 con 0x7f8fd40d0040 2023-11-28T18:37:43.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.195+0000 7f8fcbfff640 1 -- 172.21.15.45:0/2288598709 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fc4003760 con 0x7f8fd40d0040 2023-11-28T18:37:43.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.195+0000 7f8fcbfff640 1 -- 172.21.15.45:0/2288598709 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc4003b50 con 0x7f8fd40d0040 2023-11-28T18:37:43.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.195+0000 7f8fd92bb640 1 -- 172.21.15.45:0/2288598709 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fd415d800 con 0x7f8fd40d0040 2023-11-28T18:37:43.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.195+0000 7f8fd92bb640 1 -- 172.21.15.45:0/2288598709 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fd415e960 con 0x7f8fd40d0040 2023-11-28T18:37:43.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.195+0000 7f30aa1d8640 1 -- 172.21.15.45:0/4146519463 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f30a415d4d0 msgr2=0x7f30a40b62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:43.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.195+0000 7f30aa1d8640 1 --2- 172.21.15.45:0/4146519463 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f30a415d4d0 0x7f30a40b62d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f30980097c0 tx=0x7f309801c450 comp rx=0 tx=0).stop 2023-11-28T18:37:43.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.195+0000 7f30aa1d8640 1 -- 172.21.15.45:0/4146519463 shutdown_connections 2023-11-28T18:37:43.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.195+0000 7f30aa1d8640 1 --2- 172.21.15.45:0/4146519463 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f30a40d1500 0x7f30a40d1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.195+0000 7f30aa1d8640 1 --2- 172.21.15.45:0/4146519463 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f30a415d4d0 0x7f30a40b62d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.195+0000 7f30aa1d8640 1 -- 172.21.15.45:0/4146519463 >> 172.21.15.45:0/4146519463 conn(0x7f30a40720a0 msgr2=0x7f30a40724b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:43.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.195+0000 7f30aa1d8640 1 -- 172.21.15.45:0/4146519463 shutdown_connections 2023-11-28T18:37:43.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.195+0000 7f30aa1d8640 1 -- 172.21.15.45:0/4146519463 wait complete. 2023-11-28T18:37:43.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.195+0000 7f8fd92bb640 1 -- 172.21.15.45:0/2288598709 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fb8005260 con 0x7f8fd40d0040 2023-11-28T18:37:43.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.195+0000 7f8e37c9a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e301459a0 0x7f8e301338e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:43.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.195+0000 7f1b84bb4640 1 --2- 172.21.15.45:0/61851902 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b800b3cb0 0x7f1b800d0f90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1b700098a0 tx=0x7f1b7001c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef585331621e2874 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:43.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.195+0000 7f8e37c9a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e3015bcd0 0x7f8e301f42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:43.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.199+0000 7f867bfff640 1 -- 172.21.15.45:0/11167811 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f868c0e62c0 con 0x7f868c0e30a0 2023-11-28T18:37:43.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.195+0000 7f8e35a36640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e301459a0 0x7f8e301338e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:43.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.199+0000 7f8e35a36640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e301459a0 0x7f8e301338e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.45:60604/0 (socket says 172.21.15.45:60604) 2023-11-28T18:37:43.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.199+0000 7f8e35a36640 1 -- 172.21.15.45:0/631141016 learned_addr learned my addr 172.21.15.45:0/631141016 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:43.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.199+0000 7f8e37c9a640 1 --2- 172.21.15.45:0/631141016 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e3015c0b0 0x7f8e3015a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:43.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.199+0000 7f8fcbfff640 1 -- 172.21.15.45:0/2288598709 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f8fc4003cb0 con 0x7f8fd40d0040 2023-11-28T18:37:43.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.199+0000 7f30aa1d8640 1 Processor -- start 2023-11-28T18:37:43.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.199+0000 7f8e37c9a640 1 -- 172.21.15.45:0/631141016 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e30204420 con 0x7f8e3015bcd0 2023-11-28T18:37:43.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.199+0000 7f8e37c9a640 1 -- 172.21.15.45:0/631141016 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e30204700 con 0x7f8e3015c0b0 2023-11-28T18:37:43.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.199+0000 7f8fcbfff640 1 --2- 172.21.15.45:0/2288598709 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f8fb40669a0 0x7f8fb4068e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:43.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.199+0000 7f8fcbfff640 1 -- 172.21.15.45:0/2288598709 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8fc4083a00 con 0x7f8fd40d0040 2023-11-28T18:37:43.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.199+0000 7f30aa1d8640 1 -- start start 2023-11-28T18:37:43.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.199+0000 7f8e35235640 1 --2- 172.21.15.45:0/631141016 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e3015bcd0 0x7f8e301f42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:43.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.199+0000 7f8e37c9a640 1 -- 172.21.15.45:0/631141016 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e302049e0 con 0x7f8e301459a0 2023-11-28T18:37:43.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.199+0000 7f8e36237640 1 --2- 172.21.15.45:0/631141016 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e3015c0b0 0x7f8e3015a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:43.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.199+0000 7f8fd2ffd640 1 --2- 172.21.15.45:0/2288598709 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f8fb40669a0 0x7f8fb4068e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:43.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.199+0000 7f8e35a36640 1 -- 172.21.15.45:0/631141016 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e3015c0b0 msgr2=0x7f8e3015a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:43.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.199+0000 7f8e35a36640 1 --2- 172.21.15.45:0/631141016 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e3015c0b0 0x7f8e3015a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.199+0000 7f8fd2ffd640 1 --2- 172.21.15.45:0/2288598709 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f8fb40669a0 0x7f8fb4068e60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc009870 tx=0x7f8fbc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:43.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.199+0000 7f8e35a36640 1 -- 172.21.15.45:0/631141016 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e3015bcd0 msgr2=0x7f8e301f42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:43.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.199+0000 7f8e35a36640 1 --2- 172.21.15.45:0/631141016 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e3015bcd0 0x7f8e301f42f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.199+0000 7f8e35a36640 1 -- 172.21.15.45:0/631141016 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e240094d0 con 0x7f8e301459a0 2023-11-28T18:37:43.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.199+0000 7f8e36237640 1 --2- 172.21.15.45:0/631141016 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e3015c0b0 0x7f8e3015a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:37:43.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.199+0000 7f8e35a36640 1 --2- 172.21.15.45:0/631141016 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e301459a0 0x7f8e301338e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8e2401a190 tx=0x7f8e24019300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:43.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.199+0000 7f1b7effd640 1 -- 172.21.15.45:0/61851902 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b700ab670 con 0x7f1b800b3cb0 2023-11-28T18:37:43.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.199+0000 7f1b7effd640 1 -- 172.21.15.45:0/61851902 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b700ab7d0 con 0x7f1b800b3cb0 2023-11-28T18:37:43.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.199+0000 7f1b7effd640 1 -- 172.21.15.45:0/61851902 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b700abb60 con 0x7f1b800b3cb0 2023-11-28T18:37:43.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.199+0000 7f30aa1d8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f30a40b5220 0x7f30a414ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:43.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.199+0000 7f30aa1d8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f30a40d1500 0x7f30a4154680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:43.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.203+0000 7f30aa1d8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30a415d4d0 0x7f30a415b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:43.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.203+0000 7f30a2ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f30a40d1500 0x7f30a4154680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:43.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.203+0000 7f30a2ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f30a40d1500 0x7f30a4154680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.45:60612/0 (socket says 172.21.15.45:60612) 2023-11-28T18:37:43.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.203+0000 7f30a37fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f30a40b5220 0x7f30a414ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:43.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.203+0000 7f30aa1d8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a4157600 con 0x7f30a415d4d0 2023-11-28T18:37:43.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.203+0000 7f30a2ffd640 1 -- 172.21.15.45:0/1682013530 learned_addr learned my addr 172.21.15.45:0/1682013530 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:43.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.203+0000 7f30aa1d8640 1 -- 172.21.15.45:0/1682013530 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a4154f60 con 0x7f30a40b5220 2023-11-28T18:37:43.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.203+0000 7f30aa1d8640 1 -- 172.21.15.45:0/1682013530 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30a4155240 con 0x7f30a40d1500 2023-11-28T18:37:43.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.203+0000 7f30a3fff640 1 --2- 172.21.15.45:0/1682013530 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30a415d4d0 0x7f30a415b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:43.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.203+0000 7f8e227fc640 1 -- 172.21.15.45:0/631141016 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e240bd070 con 0x7f8e301459a0 2023-11-28T18:37:43.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.203+0000 7f8e227fc640 1 -- 172.21.15.45:0/631141016 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e240b7610 con 0x7f8e301459a0 2023-11-28T18:37:43.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.203+0000 7f8e227fc640 1 -- 172.21.15.45:0/631141016 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e240b79c0 con 0x7f8e301459a0 2023-11-28T18:37:43.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.203+0000 7f30a2ffd640 1 -- 172.21.15.45:0/1682013530 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f30a40b5220 msgr2=0x7f30a414ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:43.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.203+0000 7f30a2ffd640 1 --2- 172.21.15.45:0/1682013530 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f30a40b5220 0x7f30a414ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.203+0000 7f30a2ffd640 1 -- 172.21.15.45:0/1682013530 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30a415d4d0 msgr2=0x7f30a415b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:43.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.203+0000 7f30a2ffd640 1 --2- 172.21.15.45:0/1682013530 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30a415d4d0 0x7f30a415b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.203+0000 7f30a2ffd640 1 -- 172.21.15.45:0/1682013530 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3098009420 con 0x7f30a40d1500 2023-11-28T18:37:43.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.203+0000 7f30a3fff640 1 --2- 172.21.15.45:0/1682013530 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30a415d4d0 0x7f30a415b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:37:43.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.203+0000 7f30a37fe640 1 --2- 172.21.15.45:0/1682013530 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f30a40b5220 0x7f30a414ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:37:43.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.203+0000 7f30a2ffd640 1 --2- 172.21.15.45:0/1682013530 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f30a40d1500 0x7f30a4154680 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f309801ab00 tx=0x7f30980191f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:43.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.203+0000 7f308bfff640 1 -- 172.21.15.45:0/1682013530 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30980abe10 con 0x7f30a40d1500 2023-11-28T18:37:43.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.203+0000 7f308bfff640 1 -- 172.21.15.45:0/1682013530 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30980bf450 con 0x7f30a40d1500 2023-11-28T18:37:43.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.203+0000 7f308bfff640 1 -- 172.21.15.45:0/1682013530 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30980bf7e0 con 0x7f30a40d1500 2023-11-28T18:37:43.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.203+0000 7f30aa1d8640 1 -- 172.21.15.45:0/1682013530 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30a4157290 con 0x7f30a40d1500 2023-11-28T18:37:43.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.203+0000 7f30aa1d8640 1 -- 172.21.15.45:0/1682013530 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30a4154bc0 con 0x7f30a40d1500 2023-11-28T18:37:43.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.203+0000 7f8e37c9a640 1 -- 172.21.15.45:0/631141016 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e30204cc0 con 0x7f8e301459a0 2023-11-28T18:37:43.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.203+0000 7f8e37c9a640 1 -- 172.21.15.45:0/631141016 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e3015a800 con 0x7f8e301459a0 2023-11-28T18:37:43.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.203+0000 7f1b86617640 1 -- 172.21.15.45:0/61851902 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b800b3cb0 msgr2=0x7f1b800d0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:43.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.203+0000 7f1b86617640 1 --2- 172.21.15.45:0/61851902 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b800b3cb0 0x7f1b800d0f90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1b700098a0 tx=0x7f1b7001c4b0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.203+0000 7f1b86617640 1 -- 172.21.15.45:0/61851902 shutdown_connections 2023-11-28T18:37:43.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.203+0000 7f1b86617640 1 --2- 172.21.15.45:0/61851902 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b800b3cb0 0x7f1b800d0f90 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.203+0000 7f1b86617640 1 -- 172.21.15.45:0/61851902 >> 172.21.15.45:0/61851902 conn(0x7f1b8009c4f0 msgr2=0x7f1b800d31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:43.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.207+0000 7f8e37c9a640 1 -- 172.21.15.45:0/631141016 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e18005260 con 0x7f8e301459a0 2023-11-28T18:37:43.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.207+0000 7f8fcbfff640 1 -- 172.21.15.45:0/2288598709 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8fc4050cd0 con 0x7f8fd40d0040 2023-11-28T18:37:43.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.207+0000 7f30aa1d8640 1 -- 172.21.15.45:0/1682013530 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30a4157420 con 0x7f30a40d1500 2023-11-28T18:37:43.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.207+0000 7f308bfff640 1 -- 172.21.15.45:0/1682013530 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f30980bf940 con 0x7f30a40d1500 2023-11-28T18:37:43.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.207+0000 7f1b86617640 1 -- 172.21.15.45:0/61851902 shutdown_connections 2023-11-28T18:37:43.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.207+0000 7f308bfff640 1 --2- 172.21.15.45:0/1682013530 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f30900668d0 0x7f3090068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:43.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.207+0000 7f308bfff640 1 -- 172.21.15.45:0/1682013530 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f309811ec10 con 0x7f30a40d1500 2023-11-28T18:37:43.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.207+0000 7f8e227fc640 1 -- 172.21.15.45:0/631141016 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f8e240b7b20 con 0x7f8e301459a0 2023-11-28T18:37:43.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.207+0000 7f1b86617640 1 -- 172.21.15.45:0/61851902 wait complete. 2023-11-28T18:37:43.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.211+0000 7f8e227fc640 1 --2- 172.21.15.45:0/631141016 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f8e14066920 0x7f8e14068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:43.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.211+0000 7f8e227fc640 1 -- 172.21.15.45:0/631141016 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8e2411e090 con 0x7f8e301459a0 2023-11-28T18:37:43.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.211+0000 7f1b86617640 1 Processor -- start 2023-11-28T18:37:43.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.211+0000 7f30a37fe640 1 --2- 172.21.15.45:0/1682013530 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f30900668d0 0x7f3090068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:43.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.211+0000 7f8e35235640 1 --2- 172.21.15.45:0/631141016 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f8e14066920 0x7f8e14068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:43.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.211+0000 7f1b86617640 1 -- start start 2023-11-28T18:37:43.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.211+0000 7f30a37fe640 1 --2- 172.21.15.45:0/1682013530 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f30900668d0 0x7f3090068d90 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3094005890 tx=0x7f3094009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:43.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.211+0000 7f8e35235640 1 --2- 172.21.15.45:0/631141016 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f8e14066920 0x7f8e14068de0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8e30145120 tx=0x7f8e2c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:43.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.211+0000 7f1b86617640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b800b35f0 0x7f1b800b1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:43.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.211+0000 7f1b86617640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b800b3cb0 0x7f1b80156250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:43.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.211+0000 7f8e227fc640 1 -- 172.21.15.45:0/631141016 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8e24123060 con 0x7f8e301459a0 2023-11-28T18:37:43.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.211+0000 7f1b86617640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b800cfed0 0x7f1b80156790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:43.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.215+0000 7f1b7f7fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b800b3cb0 0x7f1b80156250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:43.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.215+0000 7f1b7f7fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b800b3cb0 0x7f1b80156250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.45:60622/0 (socket says 172.21.15.45:60622) 2023-11-28T18:37:43.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.215+0000 7f1b7f7fe640 1 -- 172.21.15.45:0/3877182283 learned_addr learned my addr 172.21.15.45:0/3877182283 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:43.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.215+0000 7f1b84bb4640 1 --2- 172.21.15.45:0/3877182283 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b800cfed0 0x7f1b80156790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:43.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.215+0000 7f1b86617640 1 -- 172.21.15.45:0/3877182283 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b80156cd0 con 0x7f1b800b35f0 2023-11-28T18:37:43.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.215+0000 7f1b86617640 1 -- 172.21.15.45:0/3877182283 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8009de50 con 0x7f1b800cfed0 2023-11-28T18:37:43.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.215+0000 7f1b86617640 1 -- 172.21.15.45:0/3877182283 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8015cb70 con 0x7f1b800b3cb0 2023-11-28T18:37:43.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.215+0000 7f1b7ffff640 1 --2- 172.21.15.45:0/3877182283 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b800b35f0 0x7f1b800b1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:43.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.215+0000 7f1b7f7fe640 1 -- 172.21.15.45:0/3877182283 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b800cfed0 msgr2=0x7f1b80156790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:43.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.215+0000 7f1b7f7fe640 1 --2- 172.21.15.45:0/3877182283 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b800cfed0 0x7f1b80156790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.215+0000 7f1b7f7fe640 1 -- 172.21.15.45:0/3877182283 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b800b35f0 msgr2=0x7f1b800b1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:43.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.215+0000 7f1b7f7fe640 1 --2- 172.21.15.45:0/3877182283 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b800b35f0 0x7f1b800b1220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.215+0000 7f1b7f7fe640 1 -- 172.21.15.45:0/3877182283 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b700094d0 con 0x7f1b800b3cb0 2023-11-28T18:37:43.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.215+0000 7f1b84bb4640 1 --2- 172.21.15.45:0/3877182283 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b800cfed0 0x7f1b80156790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:37:43.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.215+0000 7f1b7ffff640 1 --2- 172.21.15.45:0/3877182283 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b800b35f0 0x7f1b800b1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:37:43.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.215+0000 7f1b7f7fe640 1 --2- 172.21.15.45:0/3877182283 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b800b3cb0 0x7f1b80156250 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1b7400b440 tx=0x7f1b7400b900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:43.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.215+0000 7f1b7cff9640 1 -- 172.21.15.45:0/3877182283 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b74011890 con 0x7f1b800b3cb0 2023-11-28T18:37:43.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.219+0000 7f1b7cff9640 1 -- 172.21.15.45:0/3877182283 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b740119f0 con 0x7f1b800b3cb0 2023-11-28T18:37:43.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.219+0000 7f1b86617640 1 -- 172.21.15.45:0/3877182283 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b8015c2d0 con 0x7f1b800b3cb0 2023-11-28T18:37:43.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.219+0000 7f1b86617640 1 -- 172.21.15.45:0/3877182283 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b8015c890 con 0x7f1b800b3cb0 2023-11-28T18:37:43.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.219+0000 7f1b7cff9640 1 -- 172.21.15.45:0/3877182283 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b74011da0 con 0x7f1b800b3cb0 2023-11-28T18:37:43.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.219+0000 7f308bfff640 1 -- 172.21.15.45:0/1682013530 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f30980ebe50 con 0x7f30a40d1500 2023-11-28T18:37:43.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.219+0000 7f1b7cff9640 1 -- 172.21.15.45:0/3877182283 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f1b7401a400 con 0x7f1b800b3cb0 2023-11-28T18:37:43.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.223+0000 7f1b7cff9640 1 --2- 172.21.15.45:0/3877182283 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1b6c0669a0 0x7f1b6c068e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:43.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.223+0000 7f1b7cff9640 1 -- 172.21.15.45:0/3877182283 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1b740846a0 con 0x7f1b800b3cb0 2023-11-28T18:37:43.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.223+0000 7f1b7ffff640 1 --2- 172.21.15.45:0/3877182283 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1b6c0669a0 0x7f1b6c068e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:43.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.223+0000 7f1b86617640 1 -- 172.21.15.45:0/3877182283 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b60005260 con 0x7f1b800b3cb0 2023-11-28T18:37:43.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.227+0000 7f1b7ffff640 1 --2- 172.21.15.45:0/3877182283 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1b6c0669a0 0x7f1b6c068e60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1b78007fd0 tx=0x7f1b78009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:43.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.231+0000 7f1b7cff9640 1 -- 172.21.15.45:0/3877182283 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1b74051950 con 0x7f1b800b3cb0 2023-11-28T18:37:43.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.295+0000 7f1b69996640 1 -- 172.21.15.45:0/224252116 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1b640cb2c0 con 0x7f1b640d1d00 2023-11-28T18:37:43.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.295+0000 7f1b5bfff640 1 -- 172.21.15.45:0/224252116 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1b640cb2c0 con 0x7f1b640d1d00 2023-11-28T18:37:43.303 INFO:teuthology.orchestra.run.smithi045.stdout:55834574855 2023-11-28T18:37:43.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.299+0000 7f1b69996640 1 -- 172.21.15.45:0/224252116 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1b440668d0 msgr2=0x7f1b44068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:43.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.299+0000 7f1b69996640 1 --2- 172.21.15.45:0/224252116 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1b440668d0 0x7f1b44068d90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c009990 tx=0x7f1b4c009110 comp rx=0 tx=0).stop 2023-11-28T18:37:43.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.299+0000 7f1b69996640 1 -- 172.21.15.45:0/224252116 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b640d1d00 msgr2=0x7f1b640c8cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:43.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.299+0000 7f1b69996640 1 --2- 172.21.15.45:0/224252116 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b640d1d00 0x7f1b640c8cb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c00c730 tx=0x7f1b5c00cbf0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.299+0000 7f1b69996640 1 -- 172.21.15.45:0/224252116 shutdown_connections 2023-11-28T18:37:43.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.299+0000 7f1b69996640 1 --2- 172.21.15.45:0/224252116 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1b440668d0 0x7f1b44068d90 secure :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c009990 tx=0x7f1b4c009110 comp rx=0 tx=0).stop 2023-11-28T18:37:43.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.299+0000 7f1b69996640 1 --2- 172.21.15.45:0/224252116 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b640d1d00 0x7f1b640c8cb0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.299+0000 7f1b69996640 1 --2- 172.21.15.45:0/224252116 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b640b3c00 0x7f1b640c8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.299+0000 7f1b69996640 1 --2- 172.21.15.45:0/224252116 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b640b2f80 0x7f1b6415cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.299+0000 7f1b69996640 1 -- 172.21.15.45:0/224252116 >> 172.21.15.45:0/224252116 conn(0x7f1b6409c470 msgr2=0x7f1b640d3ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:43.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.299+0000 7f1b69996640 1 -- 172.21.15.45:0/224252116 shutdown_connections 2023-11-28T18:37:43.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.299+0000 7f1b69996640 1 -- 172.21.15.45:0/224252116 wait complete. 2023-11-28T18:37:43.339 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.2 2023-11-28T18:37:43.339 DEBUG:teuthology.parallel:result is None 2023-11-28T18:37:43.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.399+0000 7f41367fc640 1 -- 172.21.15.45:0/749457225 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4150069480 con 0x7f41501594d0 2023-11-28T18:37:43.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.403+0000 7f414cff9640 1 -- 172.21.15.45:0/749457225 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f41400ec080 con 0x7f41501594d0 2023-11-28T18:37:43.407 INFO:teuthology.orchestra.run.smithi045.stdout:55834574855 2023-11-28T18:37:43.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.403+0000 7f41367fc640 1 -- 172.21.15.45:0/749457225 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f413c066900 msgr2=0x7f413c068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:43.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.403+0000 7f41367fc640 1 --2- 172.21.15.45:0/749457225 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f413c066900 0x7f413c068dc0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4144007fd0 tx=0x7f4144009040 comp rx=0 tx=0).stop 2023-11-28T18:37:43.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.403+0000 7f41367fc640 1 -- 172.21.15.45:0/749457225 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f41501594d0 msgr2=0x7f415014b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:43.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.403+0000 7f41367fc640 1 --2- 172.21.15.45:0/749457225 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f41501594d0 0x7f415014b980 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f414001bd70 tx=0x7f414001bf00 comp rx=0 tx=0).stop 2023-11-28T18:37:43.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.407+0000 7f41367fc640 1 -- 172.21.15.45:0/749457225 shutdown_connections 2023-11-28T18:37:43.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.407+0000 7f41367fc640 1 --2- 172.21.15.45:0/749457225 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f413c066900 0x7f413c068dc0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.407+0000 7f41367fc640 1 --2- 172.21.15.45:0/749457225 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f415015d1d0 0x7f415014a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.407+0000 7f41367fc640 1 --2- 172.21.15.45:0/749457225 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f415015cdf0 0x7f415014d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.407+0000 7f41367fc640 1 --2- 172.21.15.45:0/749457225 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f41501594d0 0x7f415014b980 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.407+0000 7f41367fc640 1 -- 172.21.15.45:0/749457225 >> 172.21.15.45:0/749457225 conn(0x7f415006c300 msgr2=0x7f41500b3890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:43.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.407+0000 7f41367fc640 1 -- 172.21.15.45:0/749457225 shutdown_connections 2023-11-28T18:37:43.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.407+0000 7f41367fc640 1 -- 172.21.15.45:0/749457225 wait complete. 2023-11-28T18:37:43.441 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.1 2023-11-28T18:37:43.441 DEBUG:teuthology.parallel:result is None 2023-11-28T18:37:43.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.447+0000 7f1b86617640 1 -- 172.21.15.45:0/3877182283 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f1b60005510 con 0x7f1b800b3cb0 2023-11-28T18:37:43.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.447+0000 7f1b7cff9640 1 -- 172.21.15.45:0/3877182283 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1b74015030 con 0x7f1b800b3cb0 2023-11-28T18:37:43.453 INFO:teuthology.orchestra.run.smithi045.stdout:55834574855 2023-11-28T18:37:43.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.451+0000 7f06053b5640 1 -- 172.21.15.45:0/3123239922 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f05e0005510 con 0x7f0600174530 2023-11-28T18:37:43.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.451+0000 7f05fcff9640 1 -- 172.21.15.45:0/3123239922 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f05f8054f00 con 0x7f0600174530 2023-11-28T18:37:43.455 INFO:teuthology.orchestra.run.smithi045.stdout:55834574856 2023-11-28T18:37:43.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.451+0000 7f1b86617640 1 -- 172.21.15.45:0/3877182283 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1b6c0669a0 msgr2=0x7f1b6c068e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:43.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.451+0000 7f1b86617640 1 --2- 172.21.15.45:0/3877182283 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1b6c0669a0 0x7f1b6c068e60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1b78007fd0 tx=0x7f1b78009040 comp rx=0 tx=0).stop 2023-11-28T18:37:43.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.451+0000 7f1b86617640 1 -- 172.21.15.45:0/3877182283 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b800b3cb0 msgr2=0x7f1b80156250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:43.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.451+0000 7f1b86617640 1 --2- 172.21.15.45:0/3877182283 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b800b3cb0 0x7f1b80156250 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1b7400b440 tx=0x7f1b7400b900 comp rx=0 tx=0).stop 2023-11-28T18:37:43.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.451+0000 7f1b86617640 1 -- 172.21.15.45:0/3877182283 shutdown_connections 2023-11-28T18:37:43.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.451+0000 7f1b86617640 1 --2- 172.21.15.45:0/3877182283 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1b6c0669a0 0x7f1b6c068e60 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.451+0000 7f1b86617640 1 --2- 172.21.15.45:0/3877182283 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b800cfed0 0x7f1b80156790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.451+0000 7f1b86617640 1 --2- 172.21.15.45:0/3877182283 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b800b3cb0 0x7f1b80156250 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.451+0000 7f1b86617640 1 --2- 172.21.15.45:0/3877182283 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b800b35f0 0x7f1b800b1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.451+0000 7f1b86617640 1 -- 172.21.15.45:0/3877182283 >> 172.21.15.45:0/3877182283 conn(0x7f1b8009c4f0 msgr2=0x7f1b800ce480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:43.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.451+0000 7f1b86617640 1 -- 172.21.15.45:0/3877182283 shutdown_connections 2023-11-28T18:37:43.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.451+0000 7f1b86617640 1 -- 172.21.15.45:0/3877182283 wait complete. 2023-11-28T18:37:43.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.451+0000 7f06053b5640 1 -- 172.21.15.45:0/3123239922 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f05ec0669c0 msgr2=0x7f05ec068e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:43.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.451+0000 7f06053b5640 1 --2- 172.21.15.45:0/3123239922 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f05ec0669c0 0x7f05ec068e80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f05f00047c0 tx=0x7f05f000f040 comp rx=0 tx=0).stop 2023-11-28T18:37:43.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.451+0000 7f06053b5640 1 -- 172.21.15.45:0/3123239922 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0600174530 msgr2=0x7f0600169400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:43.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.451+0000 7f06053b5640 1 --2- 172.21.15.45:0/3123239922 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0600174530 0x7f0600169400 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f05f800e7c0 tx=0x7f05f800ec80 comp rx=0 tx=0).stop 2023-11-28T18:37:43.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.451+0000 7f06053b5640 1 -- 172.21.15.45:0/3123239922 shutdown_connections 2023-11-28T18:37:43.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.451+0000 7f06053b5640 1 --2- 172.21.15.45:0/3123239922 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f05ec0669c0 0x7f05ec068e80 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.451+0000 7f06053b5640 1 --2- 172.21.15.45:0/3123239922 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0600158cc0 0x7f0600159140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.451+0000 7f06053b5640 1 --2- 172.21.15.45:0/3123239922 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0600174530 0x7f0600169400 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.451+0000 7f06053b5640 1 --2- 172.21.15.45:0/3123239922 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f05e8009310 0x7f0600157490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.451+0000 7f06053b5640 1 -- 172.21.15.45:0/3123239922 >> 172.21.15.45:0/3123239922 conn(0x7f06000b0b20 msgr2=0x7f060006c560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:43.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.455+0000 7f06053b5640 1 -- 172.21.15.45:0/3123239922 shutdown_connections 2023-11-28T18:37:43.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.455+0000 7f06053b5640 1 -- 172.21.15.45:0/3123239922 wait complete. 2023-11-28T18:37:43.487 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.7 2023-11-28T18:37:43.487 DEBUG:teuthology.parallel:result is None 2023-11-28T18:37:43.489 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574856 for osd.0 2023-11-28T18:37:43.489 DEBUG:teuthology.parallel:result is None 2023-11-28T18:37:43.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.523+0000 7f8699ff8640 1 -- 172.21.15.45:0/11167811 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f868c0089b0 con 0x7f868c0e30a0 2023-11-28T18:37:43.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.523+0000 7f867bfff640 1 -- 172.21.15.45:0/11167811 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f868c0e62c0 con 0x7f868c0e30a0 2023-11-28T18:37:43.528 INFO:teuthology.orchestra.run.smithi045.stdout:55834574857 2023-11-28T18:37:43.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.523+0000 7f8699ff8640 1 -- 172.21.15.45:0/11167811 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f8680066920 msgr2=0x7f8680068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:43.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.523+0000 7f8699ff8640 1 --2- 172.21.15.45:0/11167811 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f8680066920 0x7f8680068de0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f868c0375a0 tx=0x7f8684009040 comp rx=0 tx=0).stop 2023-11-28T18:37:43.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.523+0000 7f8699ff8640 1 -- 172.21.15.45:0/11167811 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f868c0e30a0 msgr2=0x7f868c04abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:43.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.523+0000 7f8699ff8640 1 --2- 172.21.15.45:0/11167811 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f868c0e30a0 0x7f868c04abf0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8694069370 tx=0x7f86940a0400 comp rx=0 tx=0).stop 2023-11-28T18:37:43.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.527+0000 7f8699ff8640 1 -- 172.21.15.45:0/11167811 shutdown_connections 2023-11-28T18:37:43.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.527+0000 7f8699ff8640 1 --2- 172.21.15.45:0/11167811 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f8680066920 0x7f8680068de0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.527+0000 7f8699ff8640 1 --2- 172.21.15.45:0/11167811 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f868c0e77f0 0x7f868c0db5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.527+0000 7f8699ff8640 1 --2- 172.21.15.45:0/11167811 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f868c0e6c00 0x7f868c0db0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.527+0000 7f8699ff8640 1 --2- 172.21.15.45:0/11167811 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f868c0e30a0 0x7f868c04abf0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.527+0000 7f8699ff8640 1 -- 172.21.15.45:0/11167811 >> 172.21.15.45:0/11167811 conn(0x7f868c009f90 msgr2=0x7f868c038b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:43.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.527+0000 7f8699ff8640 1 -- 172.21.15.45:0/11167811 shutdown_connections 2023-11-28T18:37:43.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.527+0000 7f8699ff8640 1 -- 172.21.15.45:0/11167811 wait complete. 2023-11-28T18:37:43.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.531+0000 7f30aa1d8640 1 -- 172.21.15.45:0/1682013530 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f30a4155380 con 0x7f30a40d1500 2023-11-28T18:37:43.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.535+0000 7f308bfff640 1 -- 172.21.15.45:0/1682013530 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f30a4155380 con 0x7f30a40d1500 2023-11-28T18:37:43.538 INFO:teuthology.orchestra.run.smithi045.stdout:55834574854 2023-11-28T18:37:43.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.535+0000 7f30aa1d8640 1 -- 172.21.15.45:0/1682013530 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f30900668d0 msgr2=0x7f3090068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:43.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.535+0000 7f30aa1d8640 1 --2- 172.21.15.45:0/1682013530 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f30900668d0 0x7f3090068d90 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3094005890 tx=0x7f3094009040 comp rx=0 tx=0).stop 2023-11-28T18:37:43.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.535+0000 7f30aa1d8640 1 -- 172.21.15.45:0/1682013530 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f30a40d1500 msgr2=0x7f30a4154680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:43.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.535+0000 7f30aa1d8640 1 --2- 172.21.15.45:0/1682013530 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f30a40d1500 0x7f30a4154680 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f309801ab00 tx=0x7f30980191f0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.535+0000 7f30aa1d8640 1 -- 172.21.15.45:0/1682013530 shutdown_connections 2023-11-28T18:37:43.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.535+0000 7f30aa1d8640 1 --2- 172.21.15.45:0/1682013530 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f30900668d0 0x7f3090068d90 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.535+0000 7f30aa1d8640 1 --2- 172.21.15.45:0/1682013530 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30a415d4d0 0x7f30a415b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.535+0000 7f30aa1d8640 1 --2- 172.21.15.45:0/1682013530 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f30a40d1500 0x7f30a4154680 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.535+0000 7f30aa1d8640 1 --2- 172.21.15.45:0/1682013530 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f30a40b5220 0x7f30a414ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.535+0000 7f30aa1d8640 1 -- 172.21.15.45:0/1682013530 >> 172.21.15.45:0/1682013530 conn(0x7f30a40720a0 msgr2=0x7f30a4156640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:43.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.535+0000 7f30aa1d8640 1 -- 172.21.15.45:0/1682013530 shutdown_connections 2023-11-28T18:37:43.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.535+0000 7f30aa1d8640 1 -- 172.21.15.45:0/1682013530 wait complete. 2023-11-28T18:37:43.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.539+0000 7f8fd92bb640 1 -- 172.21.15.45:0/2288598709 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f8fb8005510 con 0x7f8fd40d0040 2023-11-28T18:37:43.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.539+0000 7f8fcbfff640 1 -- 172.21.15.45:0/2288598709 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8fc4017090 con 0x7f8fd40d0040 2023-11-28T18:37:43.543 INFO:teuthology.orchestra.run.smithi045.stdout:55834574855 2023-11-28T18:37:43.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.539+0000 7f8fd92bb640 1 -- 172.21.15.45:0/2288598709 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f8fb40669a0 msgr2=0x7f8fb4068e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:43.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.539+0000 7f8fd92bb640 1 --2- 172.21.15.45:0/2288598709 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f8fb40669a0 0x7f8fb4068e60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc009870 tx=0x7f8fbc008040 comp rx=0 tx=0).stop 2023-11-28T18:37:43.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.539+0000 7f8fd92bb640 1 -- 172.21.15.45:0/2288598709 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fd40d0040 msgr2=0x7f8fd40ca710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:43.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.539+0000 7f8fd92bb640 1 --2- 172.21.15.45:0/2288598709 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fd40d0040 0x7f8fd40ca710 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8fc400c360 tx=0x7f8fc400c820 comp rx=0 tx=0).stop 2023-11-28T18:37:43.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.539+0000 7f8fd92bb640 1 -- 172.21.15.45:0/2288598709 shutdown_connections 2023-11-28T18:37:43.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.539+0000 7f8fd92bb640 1 --2- 172.21.15.45:0/2288598709 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f8fb40669a0 0x7f8fb4068e60 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.539+0000 7f8fd92bb640 1 --2- 172.21.15.45:0/2288598709 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8fd40d38b0 0x7f8fd415e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.539+0000 7f8fd92bb640 1 --2- 172.21.15.45:0/2288598709 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fd40d0040 0x7f8fd40ca710 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.539+0000 7f8fd92bb640 1 --2- 172.21.15.45:0/2288598709 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8fd40cfc60 0x7f8fd40ccad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.539+0000 7f8fd92bb640 1 -- 172.21.15.45:0/2288598709 >> 172.21.15.45:0/2288598709 conn(0x7f8fd409c470 msgr2=0x7f8fd406b270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:43.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.543+0000 7f8fd92bb640 1 -- 172.21.15.45:0/2288598709 shutdown_connections 2023-11-28T18:37:43.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.543+0000 7f8fd92bb640 1 -- 172.21.15.45:0/2288598709 wait complete. 2023-11-28T18:37:43.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.543+0000 7f8e37c9a640 1 -- 172.21.15.45:0/631141016 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8e180057e0 con 0x7f8e301459a0 2023-11-28T18:37:43.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.543+0000 7f8e227fc640 1 -- 172.21.15.45:0/631141016 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8e240eb370 con 0x7f8e301459a0 2023-11-28T18:37:43.549 INFO:teuthology.orchestra.run.smithi045.stdout:55834574855 2023-11-28T18:37:43.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.547+0000 7f8e37c9a640 1 -- 172.21.15.45:0/631141016 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f8e14066920 msgr2=0x7f8e14068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:43.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.547+0000 7f8e37c9a640 1 --2- 172.21.15.45:0/631141016 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f8e14066920 0x7f8e14068de0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8e30145120 tx=0x7f8e2c009040 comp rx=0 tx=0).stop 2023-11-28T18:37:43.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.547+0000 7f8e37c9a640 1 -- 172.21.15.45:0/631141016 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e301459a0 msgr2=0x7f8e301338e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:43.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.547+0000 7f8e37c9a640 1 --2- 172.21.15.45:0/631141016 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e301459a0 0x7f8e301338e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8e2401a190 tx=0x7f8e24019300 comp rx=0 tx=0).stop 2023-11-28T18:37:43.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.547+0000 7f8e37c9a640 1 -- 172.21.15.45:0/631141016 shutdown_connections 2023-11-28T18:37:43.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.547+0000 7f8e37c9a640 1 --2- 172.21.15.45:0/631141016 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f8e14066920 0x7f8e14068de0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.547+0000 7f8e37c9a640 1 --2- 172.21.15.45:0/631141016 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e3015c0b0 0x7f8e3015a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.547+0000 7f8e37c9a640 1 --2- 172.21.15.45:0/631141016 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e3015bcd0 0x7f8e301f42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.547+0000 7f8e37c9a640 1 --2- 172.21.15.45:0/631141016 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e301459a0 0x7f8e301338e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.547+0000 7f8e37c9a640 1 -- 172.21.15.45:0/631141016 >> 172.21.15.45:0/631141016 conn(0x7f8e3006a570 msgr2=0x7f8e30070dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:43.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.547+0000 7f8e37c9a640 1 -- 172.21.15.45:0/631141016 shutdown_connections 2023-11-28T18:37:43.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.547+0000 7f8e37c9a640 1 -- 172.21.15.45:0/631141016 wait complete. 2023-11-28T18:37:43.555 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574857 for osd.6 2023-11-28T18:37:43.555 DEBUG:teuthology.parallel:result is None 2023-11-28T18:37:43.567 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.5 2023-11-28T18:37:43.567 DEBUG:teuthology.parallel:result is None 2023-11-28T18:37:43.572 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.4 2023-11-28T18:37:43.573 DEBUG:teuthology.parallel:result is None 2023-11-28T18:37:43.575 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.3 2023-11-28T18:37:43.575 DEBUG:teuthology.parallel:result is None 2023-11-28T18:37:43.576 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-28T18:37:43.576 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T18:37:43.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.755+0000 7fbdb6009640 1 Processor -- start 2023-11-28T18:37:43.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.755+0000 7fbdb6009640 1 -- start start 2023-11-28T18:37:43.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.755+0000 7fbdb6009640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbdb015ad80 0x7fbdb0164e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:43.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.755+0000 7fbdb6009640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdb015b1b0 con 0x7fbdb013cf70 2023-11-28T18:37:43.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.755+0000 7fbdb6009640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdb015b3e0 con 0x7fbdb006ca10 2023-11-28T18:37:43.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.755+0000 7fbdb6009640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdb013d350 con 0x7fbdb015ad80 2023-11-28T18:37:43.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.755+0000 7fbdaf7fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fbdb013cf70 0x7fbdb006c300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57764/0 (socket says 172.21.15.45:57764) 2023-11-28T18:37:43.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.755+0000 7fbdaf7fe640 1 -- 172.21.15.45:0/2043695136 learned_addr learned my addr 172.21.15.45:0/2043695136 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:37:43.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.755+0000 7fbdaffff640 1 --2- 172.21.15.45:0/2043695136 >> v2:172.21.15.45:3300/0 conn(0x7fbdb015ad80 0x7fbdb0164e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:43.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.759+0000 7fbdaffff640 1 -- 172.21.15.45:0/2043695136 >> v1:172.21.15.190:6789/0 conn(0x7fbdb006ca10 legacy=0x7fbdb015a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:43.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.759+0000 7fbdaffff640 1 -- 172.21.15.45:0/2043695136 >> v1:172.21.15.45:6789/0 conn(0x7fbdb013cf70 legacy=0x7fbdb006c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:43.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.759+0000 7fbdaffff640 1 -- 172.21.15.45:0/2043695136 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdb013f760 con 0x7fbdb015ad80 2023-11-28T18:37:43.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.759+0000 7fbdaffff640 1 --2- 172.21.15.45:0/2043695136 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbdb015ad80 0x7fbdb0164e30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbda8009d90 tx=0x7fbda801ead0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fb8f756d20a6cef server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:43.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.759+0000 7fbdae7fc640 1 -- 172.21.15.45:0/2043695136 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda80a7990 con 0x7fbdb015ad80 2023-11-28T18:37:43.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.759+0000 7fbdae7fc640 1 -- 172.21.15.45:0/2043695136 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbda80a7af0 con 0x7fbdb015ad80 2023-11-28T18:37:43.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.759+0000 7fbdae7fc640 1 -- 172.21.15.45:0/2043695136 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda80a7e80 con 0x7fbdb015ad80 2023-11-28T18:37:43.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.759+0000 7fbdb6009640 1 -- 172.21.15.45:0/2043695136 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbdb015ad80 msgr2=0x7fbdb0164e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:43.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.759+0000 7fbdb6009640 1 --2- 172.21.15.45:0/2043695136 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbdb015ad80 0x7fbdb0164e30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbda8009d90 tx=0x7fbda801ead0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.763+0000 7fbdb6009640 1 -- 172.21.15.45:0/2043695136 shutdown_connections 2023-11-28T18:37:43.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.763+0000 7fbdb6009640 1 --2- 172.21.15.45:0/2043695136 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbdb015ad80 0x7fbdb0164e30 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.763+0000 7fbdb6009640 1 -- 172.21.15.45:0/2043695136 >> 172.21.15.45:0/2043695136 conn(0x7fbdb006a570 msgr2=0x7fbdb006a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:43.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.763+0000 7fbdb6009640 1 -- 172.21.15.45:0/2043695136 shutdown_connections 2023-11-28T18:37:43.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.763+0000 7fbdb6009640 1 -- 172.21.15.45:0/2043695136 wait complete. 2023-11-28T18:37:43.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.763+0000 7fbdb6009640 1 Processor -- start 2023-11-28T18:37:43.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.763+0000 7fbdb6009640 1 -- start start 2023-11-28T18:37:43.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.763+0000 7fbdb6009640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbdb006ca10 0x7fbdb013b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:43.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.763+0000 7fbdb6009640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbdb013cf70 0x7fbdb014eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:43.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.763+0000 7fbdb6009640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbdb015ad80 0x7fbdb01360d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:43.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.763+0000 7fbdb6009640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb0158ad0 con 0x7fbdb013cf70 2023-11-28T18:37:43.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.763+0000 7fbdb6009640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb014f860 con 0x7fbdb006ca10 2023-11-28T18:37:43.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.763+0000 7fbdb6009640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb014fb40 con 0x7fbdb015ad80 2023-11-28T18:37:43.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.763+0000 7fbdaeffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbdb013cf70 0x7fbdb014eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:43.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.763+0000 7fbdaeffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbdb013cf70 0x7fbdb014eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57588/0 (socket says 172.21.15.45:57588) 2023-11-28T18:37:43.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.763+0000 7fbdaeffd640 1 -- 172.21.15.45:0/894351771 learned_addr learned my addr 172.21.15.45:0/894351771 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:43.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.763+0000 7fbdaf7fe640 1 --2- 172.21.15.45:0/894351771 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbdb006ca10 0x7fbdb013b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:43.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.763+0000 7fbdaffff640 1 --2- 172.21.15.45:0/894351771 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbdb015ad80 0x7fbdb01360d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:43.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.763+0000 7fbdaeffd640 1 -- 172.21.15.45:0/894351771 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbdb015ad80 msgr2=0x7fbdb01360d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:43.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.763+0000 7fbdaeffd640 1 --2- 172.21.15.45:0/894351771 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbdb015ad80 0x7fbdb01360d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.763+0000 7fbdaeffd640 1 -- 172.21.15.45:0/894351771 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbdb006ca10 msgr2=0x7fbdb013b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:43.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.763+0000 7fbdaeffd640 1 --2- 172.21.15.45:0/894351771 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbdb006ca10 0x7fbdb013b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.763+0000 7fbdaeffd640 1 -- 172.21.15.45:0/894351771 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda8009a70 con 0x7fbdb013cf70 2023-11-28T18:37:43.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.767+0000 7fbdaeffd640 1 --2- 172.21.15.45:0/894351771 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbdb013cf70 0x7fbdb014eea0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbda400c500 tx=0x7fbda400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:43.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.767+0000 7fbd97fff640 1 -- 172.21.15.45:0/894351771 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda4005220 con 0x7fbdb013cf70 2023-11-28T18:37:43.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.767+0000 7fbd97fff640 1 -- 172.21.15.45:0/894351771 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbda4005380 con 0x7fbdb013cf70 2023-11-28T18:37:43.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.767+0000 7fbd97fff640 1 -- 172.21.15.45:0/894351771 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda4007270 con 0x7fbdb013cf70 2023-11-28T18:37:43.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.767+0000 7fbdb6009640 1 -- 172.21.15.45:0/894351771 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdb014fe20 con 0x7fbdb013cf70 2023-11-28T18:37:43.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.767+0000 7fbdb6009640 1 -- 172.21.15.45:0/894351771 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdb01f5450 con 0x7fbdb013cf70 2023-11-28T18:37:43.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.767+0000 7fbdb6009640 1 -- 172.21.15.45:0/894351771 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdb0069480 con 0x7fbdb013cf70 2023-11-28T18:37:43.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.767+0000 7fbd97fff640 1 -- 172.21.15.45:0/894351771 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fbda40073d0 con 0x7fbdb013cf70 2023-11-28T18:37:43.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.767+0000 7fbd97fff640 1 --2- 172.21.15.45:0/894351771 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbd9c066900 0x7fbd9c068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:43.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.767+0000 7fbd97fff640 1 -- 172.21.15.45:0/894351771 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbda4083c20 con 0x7fbdb013cf70 2023-11-28T18:37:43.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.767+0000 7fbdaf7fe640 1 --2- 172.21.15.45:0/894351771 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbd9c066900 0x7fbd9c068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:43.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.771+0000 7fbdaf7fe640 1 --2- 172.21.15.45:0/894351771 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbd9c066900 0x7fbd9c068dc0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbda0005890 tx=0x7fbda0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:43.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.771+0000 7fbd97fff640 1 -- 172.21.15.45:0/894351771 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbda4050e80 con 0x7fbdb013cf70 2023-11-28T18:37:43.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.923+0000 7fbdb6009640 1 -- 172.21.15.45:0/894351771 --> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbdb0070cb0 con 0x7fbd9c066900 2023-11-28T18:37:43.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.931+0000 7fbd97fff640 1 -- 172.21.15.45:0/894351771 <== mgr.4100 v2:172.21.15.190:6832/645101166 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264592 (secure 0 0 0) 0x7fbda0001510 con 0x7fbd9c066900 2023-11-28T18:37:43.940 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:37:43.941 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-11-28T18:37:43.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.935+0000 7fbdb6009640 1 -- 172.21.15.45:0/894351771 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbd9c066900 msgr2=0x7fbd9c068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:43.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.935+0000 7fbdb6009640 1 --2- 172.21.15.45:0/894351771 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbd9c066900 0x7fbd9c068dc0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbda0005890 tx=0x7fbda0009040 comp rx=0 tx=0).stop 2023-11-28T18:37:43.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.935+0000 7fbdb6009640 1 -- 172.21.15.45:0/894351771 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbdb013cf70 msgr2=0x7fbdb014eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:43.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.935+0000 7fbdb6009640 1 --2- 172.21.15.45:0/894351771 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbdb013cf70 0x7fbdb014eea0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbda400c500 tx=0x7fbda400c9c0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.935+0000 7fbdb6009640 1 -- 172.21.15.45:0/894351771 shutdown_connections 2023-11-28T18:37:43.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.935+0000 7fbdb6009640 1 --2- 172.21.15.45:0/894351771 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbd9c066900 0x7fbd9c068dc0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.935+0000 7fbdb6009640 1 --2- 172.21.15.45:0/894351771 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbdb015ad80 0x7fbdb01360d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.935+0000 7fbdb6009640 1 --2- 172.21.15.45:0/894351771 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbdb013cf70 0x7fbdb014eea0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.935+0000 7fbdb6009640 1 --2- 172.21.15.45:0/894351771 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbdb006ca10 0x7fbdb013b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:43.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.935+0000 7fbdb6009640 1 -- 172.21.15.45:0/894351771 >> 172.21.15.45:0/894351771 conn(0x7fbdb006a570 msgr2=0x7fbdb013d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:43.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.935+0000 7fbdb6009640 1 -- 172.21.15.45:0/894351771 shutdown_connections 2023-11-28T18:37:43.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:43.935+0000 7fbdb6009640 1 -- 172.21.15.45:0/894351771 wait complete. 2023-11-28T18:37:43.961 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-11-28T18:37:43.236516+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235628,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739092,"statfs":{"total":773094113280,"available":772852830208,"internally_reserved":0,"allocated":2891776,"data_stored":1752836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002496"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010341+0000","last_change":"2023-11-28T18:37:33.002234+0000","last_active":"2023-11-28T18:37:34.010341+0000","last_peered":"2023-11-28T18:37:34.010341+0000","last_clean":"2023-11-28T18:37:34.010341+0000","last_became_active":"2023-11-28T18:37:33.001965+0000","last_became_peered":"2023-11-28T18:37:33.001965+0000","last_unstale":"2023-11-28T18:37:34.010341+0000","last_undegraded":"2023-11-28T18:37:34.010341+0000","last_fullsized":"2023-11-28T18:37:34.010341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:12:16.071028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.982842+0000","last_change":"2023-11-28T18:37:32.990938+0000","last_active":"2023-11-28T18:37:33.982842+0000","last_peered":"2023-11-28T18:37:33.982842+0000","last_clean":"2023-11-28T18:37:33.982842+0000","last_became_active":"2023-11-28T18:37:32.990637+0000","last_became_peered":"2023-11-28T18:37:32.990637+0000","last_unstale":"2023-11-28T18:37:33.982842+0000","last_undegraded":"2023-11-28T18:37:33.982842+0000","last_fullsized":"2023-11-28T18:37:33.982842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:36:58.955111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.008845+0000","last_change":"2023-11-28T18:37:32.985400+0000","last_active":"2023-11-28T18:37:34.008845+0000","last_peered":"2023-11-28T18:37:34.008845+0000","last_clean":"2023-11-28T18:37:34.008845+0000","last_became_active":"2023-11-28T18:37:32.985067+0000","last_became_peered":"2023-11-28T18:37:32.985067+0000","last_unstale":"2023-11-28T18:37:34.008845+0000","last_undegraded":"2023-11-28T18:37:34.008845+0000","last_fullsized":"2023-11-28T18:37:34.008845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:51:11.286789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.988275+0000","last_change":"2023-11-28T18:37:33.004974+0000","last_active":"2023-11-28T18:37:33.988275+0000","last_peered":"2023-11-28T18:37:33.988275+0000","last_clean":"2023-11-28T18:37:33.988275+0000","last_became_active":"2023-11-28T18:37:33.002365+0000","last_became_peered":"2023-11-28T18:37:33.002365+0000","last_unstale":"2023-11-28T18:37:33.988275+0000","last_undegraded":"2023-11-28T18:37:33.988275+0000","last_fullsized":"2023-11-28T18:37:33.988275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:51:32.411691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009918+0000","last_change":"2023-11-28T18:37:32.998052+0000","last_active":"2023-11-28T18:37:34.009918+0000","last_peered":"2023-11-28T18:37:34.009918+0000","last_clean":"2023-11-28T18:37:34.009918+0000","last_became_active":"2023-11-28T18:37:32.997591+0000","last_became_peered":"2023-11-28T18:37:32.997591+0000","last_unstale":"2023-11-28T18:37:34.009918+0000","last_undegraded":"2023-11-28T18:37:34.009918+0000","last_fullsized":"2023-11-28T18:37:34.009918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:21:13.521447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.988134+0000","last_change":"2023-11-28T18:37:33.005398+0000","last_active":"2023-11-28T18:37:33.988134+0000","last_peered":"2023-11-28T18:37:33.988134+0000","last_clean":"2023-11-28T18:37:33.988134+0000","last_became_active":"2023-11-28T18:37:33.004918+0000","last_became_peered":"2023-11-28T18:37:33.004918+0000","last_unstale":"2023-11-28T18:37:33.988134+0000","last_undegraded":"2023-11-28T18:37:33.988134+0000","last_fullsized":"2023-11-28T18:37:33.988134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:06:19.804273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009575+0000","last_change":"2023-11-28T18:37:33.005051+0000","last_active":"2023-11-28T18:37:34.009575+0000","last_peered":"2023-11-28T18:37:34.009575+0000","last_clean":"2023-11-28T18:37:34.009575+0000","last_became_active":"2023-11-28T18:37:33.004756+0000","last_became_peered":"2023-11-28T18:37:33.004756+0000","last_unstale":"2023-11-28T18:37:34.009575+0000","last_undegraded":"2023-11-28T18:37:34.009575+0000","last_fullsized":"2023-11-28T18:37:34.009575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:06:19.804273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.008210+0000","last_change":"2023-11-28T18:37:32.999195+0000","last_active":"2023-11-28T18:37:34.008210+0000","last_peered":"2023-11-28T18:37:34.008210+0000","last_clean":"2023-11-28T18:37:34.008210+0000","last_became_active":"2023-11-28T18:37:32.998930+0000","last_became_peered":"2023-11-28T18:37:32.998930+0000","last_unstale":"2023-11-28T18:37:34.008210+0000","last_undegraded":"2023-11-28T18:37:34.008210+0000","last_fullsized":"2023-11-28T18:37:34.008210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:51:11.286789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010398+0000","last_change":"2023-11-28T18:37:33.009782+0000","last_active":"2023-11-28T18:37:34.010398+0000","last_peered":"2023-11-28T18:37:34.010398+0000","last_clean":"2023-11-28T18:37:34.010398+0000","last_became_active":"2023-11-28T18:37:33.009103+0000","last_became_peered":"2023-11-28T18:37:33.009103+0000","last_unstale":"2023-11-28T18:37:34.010398+0000","last_undegraded":"2023-11-28T18:37:34.010398+0000","last_fullsized":"2023-11-28T18:37:34.010398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:23:39.816847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010427+0000","last_change":"2023-11-28T18:37:33.006943+0000","last_active":"2023-11-28T18:37:34.010427+0000","last_peered":"2023-11-28T18:37:34.010427+0000","last_clean":"2023-11-28T18:37:34.010427+0000","last_became_active":"2023-11-28T18:37:33.006661+0000","last_became_peered":"2023-11-28T18:37:33.006661+0000","last_unstale":"2023-11-28T18:37:34.010427+0000","last_undegraded":"2023-11-28T18:37:34.010427+0000","last_fullsized":"2023-11-28T18:37:34.010427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:25:41.022219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010329+0000","last_change":"2023-11-28T18:37:33.007305+0000","last_active":"2023-11-28T18:37:34.010329+0000","last_peered":"2023-11-28T18:37:34.010329+0000","last_clean":"2023-11-28T18:37:34.010329+0000","last_became_active":"2023-11-28T18:37:33.006773+0000","last_became_peered":"2023-11-28T18:37:33.006773+0000","last_unstale":"2023-11-28T18:37:34.010329+0000","last_undegraded":"2023-11-28T18:37:34.010329+0000","last_fullsized":"2023-11-28T18:37:34.010329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:51:11.286789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.987768+0000","last_change":"2023-11-28T18:37:33.003324+0000","last_active":"2023-11-28T18:37:33.987768+0000","last_peered":"2023-11-28T18:37:33.987768+0000","last_clean":"2023-11-28T18:37:33.987768+0000","last_became_active":"2023-11-28T18:37:33.002968+0000","last_became_peered":"2023-11-28T18:37:33.002968+0000","last_unstale":"2023-11-28T18:37:33.987768+0000","last_undegraded":"2023-11-28T18:37:33.987768+0000","last_fullsized":"2023-11-28T18:37:33.987768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:21:08.389536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009332+0000","last_change":"2023-11-28T18:37:32.993427+0000","last_active":"2023-11-28T18:37:34.009332+0000","last_peered":"2023-11-28T18:37:34.009332+0000","last_clean":"2023-11-28T18:37:34.009332+0000","last_became_active":"2023-11-28T18:37:32.992763+0000","last_became_peered":"2023-11-28T18:37:32.992763+0000","last_unstale":"2023-11-28T18:37:34.009332+0000","last_undegraded":"2023-11-28T18:37:34.009332+0000","last_fullsized":"2023-11-28T18:37:34.009332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:18:10.978623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.008553+0000","last_change":"2023-11-28T18:37:32.985751+0000","last_active":"2023-11-28T18:37:34.008553+0000","last_peered":"2023-11-28T18:37:34.008553+0000","last_clean":"2023-11-28T18:37:34.008553+0000","last_became_active":"2023-11-28T18:37:32.985475+0000","last_became_peered":"2023-11-28T18:37:32.985475+0000","last_unstale":"2023-11-28T18:37:34.008553+0000","last_undegraded":"2023-11-28T18:37:34.008553+0000","last_fullsized":"2023-11-28T18:37:34.008553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:00:26.206815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.982473+0000","last_change":"2023-11-28T18:37:32.990177+0000","last_active":"2023-11-28T18:37:33.982473+0000","last_peered":"2023-11-28T18:37:33.982473+0000","last_clean":"2023-11-28T18:37:33.982473+0000","last_became_active":"2023-11-28T18:37:32.989658+0000","last_became_peered":"2023-11-28T18:37:32.989658+0000","last_unstale":"2023-11-28T18:37:33.982473+0000","last_undegraded":"2023-11-28T18:37:33.982473+0000","last_fullsized":"2023-11-28T18:37:33.982473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:41:58.493214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.987415+0000","last_change":"2023-11-28T18:37:33.006137+0000","last_active":"2023-11-28T18:37:33.987415+0000","last_peered":"2023-11-28T18:37:33.987415+0000","last_clean":"2023-11-28T18:37:33.987415+0000","last_became_active":"2023-11-28T18:37:33.005771+0000","last_became_peered":"2023-11-28T18:37:33.005771+0000","last_unstale":"2023-11-28T18:37:33.987415+0000","last_undegraded":"2023-11-28T18:37:33.987415+0000","last_fullsized":"2023-11-28T18:37:33.987415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:46:52.261405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.988766+0000","last_change":"2023-11-28T18:37:32.988077+0000","last_active":"2023-11-28T18:37:33.988766+0000","last_peered":"2023-11-28T18:37:33.988766+0000","last_clean":"2023-11-28T18:37:33.988766+0000","last_became_active":"2023-11-28T18:37:32.987801+0000","last_became_peered":"2023-11-28T18:37:32.987801+0000","last_unstale":"2023-11-28T18:37:33.988766+0000","last_undegraded":"2023-11-28T18:37:33.988766+0000","last_fullsized":"2023-11-28T18:37:33.988766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:23:39.816847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.008414+0000","last_change":"2023-11-28T18:37:32.992425+0000","last_active":"2023-11-28T18:37:34.008414+0000","last_peered":"2023-11-28T18:37:34.008414+0000","last_clean":"2023-11-28T18:37:34.008414+0000","last_became_active":"2023-11-28T18:37:32.992154+0000","last_became_peered":"2023-11-28T18:37:32.992154+0000","last_unstale":"2023-11-28T18:37:34.008414+0000","last_undegraded":"2023-11-28T18:37:34.008414+0000","last_fullsized":"2023-11-28T18:37:34.008414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:50:17.263359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010302+0000","last_change":"2023-11-28T18:37:32.998538+0000","last_active":"2023-11-28T18:37:34.010302+0000","last_peered":"2023-11-28T18:37:34.010302+0000","last_clean":"2023-11-28T18:37:34.010302+0000","last_became_active":"2023-11-28T18:37:32.998182+0000","last_became_peered":"2023-11-28T18:37:32.998182+0000","last_unstale":"2023-11-28T18:37:34.010302+0000","last_undegraded":"2023-11-28T18:37:34.010302+0000","last_fullsized":"2023-11-28T18:37:34.010302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:31:53.513239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010699+0000","last_change":"2023-11-28T18:37:33.001416+0000","last_active":"2023-11-28T18:37:34.010699+0000","last_peered":"2023-11-28T18:37:34.010699+0000","last_clean":"2023-11-28T18:37:34.010699+0000","last_became_active":"2023-11-28T18:37:33.000906+0000","last_became_peered":"2023-11-28T18:37:33.000906+0000","last_unstale":"2023-11-28T18:37:34.010699+0000","last_undegraded":"2023-11-28T18:37:34.010699+0000","last_fullsized":"2023-11-28T18:37:34.010699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:46:52.261405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.008737+0000","last_change":"2023-11-28T18:37:32.993468+0000","last_active":"2023-11-28T18:37:34.008737+0000","last_peered":"2023-11-28T18:37:34.008737+0000","last_clean":"2023-11-28T18:37:34.008737+0000","last_became_active":"2023-11-28T18:37:32.993143+0000","last_became_peered":"2023-11-28T18:37:32.993143+0000","last_unstale":"2023-11-28T18:37:34.008737+0000","last_undegraded":"2023-11-28T18:37:34.008737+0000","last_fullsized":"2023-11-28T18:37:34.008737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:51:55.517713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.988214+0000","last_change":"2023-11-28T18:37:32.986554+0000","last_active":"2023-11-28T18:37:33.988214+0000","last_peered":"2023-11-28T18:37:33.988214+0000","last_clean":"2023-11-28T18:37:33.988214+0000","last_became_active":"2023-11-28T18:37:32.986211+0000","last_became_peered":"2023-11-28T18:37:32.986211+0000","last_unstale":"2023-11-28T18:37:33.988214+0000","last_undegraded":"2023-11-28T18:37:33.988214+0000","last_fullsized":"2023-11-28T18:37:33.988214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:02:53.545778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.008208+0000","last_change":"2023-11-28T18:37:32.995076+0000","last_active":"2023-11-28T18:37:34.008208+0000","last_peered":"2023-11-28T18:37:34.008208+0000","last_clean":"2023-11-28T18:37:34.008208+0000","last_became_active":"2023-11-28T18:37:32.994774+0000","last_became_peered":"2023-11-28T18:37:32.994774+0000","last_unstale":"2023-11-28T18:37:34.008208+0000","last_undegraded":"2023-11-28T18:37:34.008208+0000","last_fullsized":"2023-11-28T18:37:34.008208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:51:55.517713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.987940+0000","last_change":"2023-11-28T18:37:32.991513+0000","last_active":"2023-11-28T18:37:33.987940+0000","last_peered":"2023-11-28T18:37:33.987940+0000","last_clean":"2023-11-28T18:37:33.987940+0000","last_became_active":"2023-11-28T18:37:32.990880+0000","last_became_peered":"2023-11-28T18:37:32.990880+0000","last_unstale":"2023-11-28T18:37:33.987940+0000","last_undegraded":"2023-11-28T18:37:33.987940+0000","last_fullsized":"2023-11-28T18:37:33.987940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:36:58.955111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009754+0000","last_change":"2023-11-28T18:37:32.995075+0000","last_active":"2023-11-28T18:37:34.009754+0000","last_peered":"2023-11-28T18:37:34.009754+0000","last_clean":"2023-11-28T18:37:34.009754+0000","last_became_active":"2023-11-28T18:37:32.994733+0000","last_became_peered":"2023-11-28T18:37:32.994733+0000","last_unstale":"2023-11-28T18:37:34.009754+0000","last_undegraded":"2023-11-28T18:37:34.009754+0000","last_fullsized":"2023-11-28T18:37:34.009754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:51:32.411691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010515+0000","last_change":"2023-11-28T18:37:33.000138+0000","last_active":"2023-11-28T18:37:34.010515+0000","last_peered":"2023-11-28T18:37:34.010515+0000","last_clean":"2023-11-28T18:37:34.010515+0000","last_became_active":"2023-11-28T18:37:32.999035+0000","last_became_peered":"2023-11-28T18:37:32.999035+0000","last_unstale":"2023-11-28T18:37:34.010515+0000","last_undegraded":"2023-11-28T18:37:34.010515+0000","last_fullsized":"2023-11-28T18:37:34.010515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:41:58.493214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.982735+0000","last_change":"2023-11-28T18:37:32.987199+0000","last_active":"2023-11-28T18:37:33.982735+0000","last_peered":"2023-11-28T18:37:33.982735+0000","last_clean":"2023-11-28T18:37:33.982735+0000","last_became_active":"2023-11-28T18:37:32.986904+0000","last_became_peered":"2023-11-28T18:37:32.986904+0000","last_unstale":"2023-11-28T18:37:33.982735+0000","last_undegraded":"2023-11-28T18:37:33.982735+0000","last_fullsized":"2023-11-28T18:37:33.982735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:46:52.261405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009632+0000","last_change":"2023-11-28T18:37:32.993541+0000","last_active":"2023-11-28T18:37:34.009632+0000","last_peered":"2023-11-28T18:37:34.009632+0000","last_clean":"2023-11-28T18:37:34.009632+0000","last_became_active":"2023-11-28T18:37:32.993323+0000","last_became_peered":"2023-11-28T18:37:32.993323+0000","last_unstale":"2023-11-28T18:37:34.009632+0000","last_undegraded":"2023-11-28T18:37:34.009632+0000","last_fullsized":"2023-11-28T18:37:34.009632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:06:19.804273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.008872+0000","last_change":"2023-11-28T18:37:32.987939+0000","last_active":"2023-11-28T18:37:34.008872+0000","last_peered":"2023-11-28T18:37:34.008872+0000","last_clean":"2023-11-28T18:37:34.008872+0000","last_became_active":"2023-11-28T18:37:32.987277+0000","last_became_peered":"2023-11-28T18:37:32.987277+0000","last_unstale":"2023-11-28T18:37:34.008872+0000","last_undegraded":"2023-11-28T18:37:34.008872+0000","last_fullsized":"2023-11-28T18:37:34.008872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:25:41.022219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.988304+0000","last_change":"2023-11-28T18:37:33.008318+0000","last_active":"2023-11-28T18:37:33.988304+0000","last_peered":"2023-11-28T18:37:33.988304+0000","last_clean":"2023-11-28T18:37:33.988304+0000","last_became_active":"2023-11-28T18:37:33.007984+0000","last_became_peered":"2023-11-28T18:37:33.007984+0000","last_unstale":"2023-11-28T18:37:33.988304+0000","last_undegraded":"2023-11-28T18:37:33.988304+0000","last_fullsized":"2023-11-28T18:37:33.988304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:21:13.521447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.008387+0000","last_change":"2023-11-28T18:37:32.999800+0000","last_active":"2023-11-28T18:37:34.008387+0000","last_peered":"2023-11-28T18:37:34.008387+0000","last_clean":"2023-11-28T18:37:34.008387+0000","last_became_active":"2023-11-28T18:37:32.999536+0000","last_became_peered":"2023-11-28T18:37:32.999536+0000","last_unstale":"2023-11-28T18:37:34.008387+0000","last_undegraded":"2023-11-28T18:37:34.008387+0000","last_fullsized":"2023-11-28T18:37:34.008387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:07:42.147988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009871+0000","last_change":"2023-11-28T18:37:32.998966+0000","last_active":"2023-11-28T18:37:34.009871+0000","last_peered":"2023-11-28T18:37:34.009871+0000","last_clean":"2023-11-28T18:37:34.009871+0000","last_became_active":"2023-11-28T18:37:32.993970+0000","last_became_peered":"2023-11-28T18:37:32.993970+0000","last_unstale":"2023-11-28T18:37:34.009871+0000","last_undegraded":"2023-11-28T18:37:34.009871+0000","last_fullsized":"2023-11-28T18:37:34.009871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:31:28.921268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.987253+0000","last_change":"2023-11-28T18:37:32.990285+0000","last_active":"2023-11-28T18:37:33.987253+0000","last_peered":"2023-11-28T18:37:33.987253+0000","last_clean":"2023-11-28T18:37:33.987253+0000","last_became_active":"2023-11-28T18:37:32.989187+0000","last_became_peered":"2023-11-28T18:37:32.989187+0000","last_unstale":"2023-11-28T18:37:33.987253+0000","last_undegraded":"2023-11-28T18:37:33.987253+0000","last_fullsized":"2023-11-28T18:37:33.987253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:18:33.551197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009443+0000","last_change":"2023-11-28T18:37:32.479159+0000","last_active":"2023-11-28T18:37:34.009443+0000","last_peered":"2023-11-28T18:37:34.009443+0000","last_clean":"2023-11-28T18:37:34.009443+0000","last_became_active":"2023-11-28T18:37:32.478817+0000","last_became_peered":"2023-11-28T18:37:32.478817+0000","last_unstale":"2023-11-28T18:37:34.009443+0000","last_undegraded":"2023-11-28T18:37:34.009443+0000","last_fullsized":"2023-11-28T18:37:34.009443+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:22:48.248148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.008990+0000","last_change":"2023-11-28T18:37:32.991264+0000","last_active":"2023-11-28T18:37:34.008990+0000","last_peered":"2023-11-28T18:37:34.008990+0000","last_clean":"2023-11-28T18:37:34.008990+0000","last_became_active":"2023-11-28T18:37:32.990660+0000","last_became_peered":"2023-11-28T18:37:32.990660+0000","last_unstale":"2023-11-28T18:37:34.008990+0000","last_undegraded":"2023-11-28T18:37:34.008990+0000","last_fullsized":"2023-11-28T18:37:34.008990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:18:10.978623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010626+0000","last_change":"2023-11-28T18:37:32.468052+0000","last_active":"2023-11-28T18:37:34.010626+0000","last_peered":"2023-11-28T18:37:34.010626+0000","last_clean":"2023-11-28T18:37:34.010626+0000","last_became_active":"2023-11-28T18:37:32.467747+0000","last_became_peered":"2023-11-28T18:37:32.467747+0000","last_unstale":"2023-11-28T18:37:34.010626+0000","last_undegraded":"2023-11-28T18:37:34.010626+0000","last_fullsized":"2023-11-28T18:37:34.010626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:56:54.321744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.008647+0000","last_change":"2023-11-28T18:37:32.465213+0000","last_active":"2023-11-28T18:37:34.008647+0000","last_peered":"2023-11-28T18:37:34.008647+0000","last_clean":"2023-11-28T18:37:34.008647+0000","last_became_active":"2023-11-28T18:37:32.464911+0000","last_became_peered":"2023-11-28T18:37:32.464911+0000","last_unstale":"2023-11-28T18:37:34.008647+0000","last_undegraded":"2023-11-28T18:37:34.008647+0000","last_fullsized":"2023-11-28T18:37:34.008647+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:16:52.138851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.008326+0000","last_change":"2023-11-28T18:37:32.988182+0000","last_active":"2023-11-28T18:37:34.008326+0000","last_peered":"2023-11-28T18:37:34.008326+0000","last_clean":"2023-11-28T18:37:34.008326+0000","last_became_active":"2023-11-28T18:37:32.987804+0000","last_became_peered":"2023-11-28T18:37:32.987804+0000","last_unstale":"2023-11-28T18:37:34.008326+0000","last_undegraded":"2023-11-28T18:37:34.008326+0000","last_fullsized":"2023-11-28T18:37:34.008326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:25:41.022219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.987941+0000","last_change":"2023-11-28T18:37:32.467329+0000","last_active":"2023-11-28T18:37:33.987941+0000","last_peered":"2023-11-28T18:37:33.987941+0000","last_clean":"2023-11-28T18:37:33.987941+0000","last_became_active":"2023-11-28T18:37:32.467064+0000","last_became_peered":"2023-11-28T18:37:32.467064+0000","last_unstale":"2023-11-28T18:37:33.987941+0000","last_undegraded":"2023-11-28T18:37:33.987941+0000","last_fullsized":"2023-11-28T18:37:33.987941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:56:54.321744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.982413+0000","last_change":"2023-11-28T18:37:32.989944+0000","last_active":"2023-11-28T18:37:33.982413+0000","last_peered":"2023-11-28T18:37:33.982413+0000","last_clean":"2023-11-28T18:37:33.982413+0000","last_became_active":"2023-11-28T18:37:32.989285+0000","last_became_peered":"2023-11-28T18:37:32.989285+0000","last_unstale":"2023-11-28T18:37:33.982413+0000","last_undegraded":"2023-11-28T18:37:33.982413+0000","last_fullsized":"2023-11-28T18:37:33.982413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:51:11.286789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010624+0000","last_change":"2023-11-28T18:37:32.471802+0000","last_active":"2023-11-28T18:37:34.010624+0000","last_peered":"2023-11-28T18:37:34.010624+0000","last_clean":"2023-11-28T18:37:34.010624+0000","last_became_active":"2023-11-28T18:37:32.471420+0000","last_became_peered":"2023-11-28T18:37:32.471420+0000","last_unstale":"2023-11-28T18:37:34.010624+0000","last_undegraded":"2023-11-28T18:37:34.010624+0000","last_fullsized":"2023-11-28T18:37:34.010624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:22:48.248148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.988629+0000","last_change":"2023-11-28T18:37:33.002175+0000","last_active":"2023-11-28T18:37:33.988629+0000","last_peered":"2023-11-28T18:37:33.988629+0000","last_clean":"2023-11-28T18:37:33.988629+0000","last_became_active":"2023-11-28T18:37:33.001279+0000","last_became_peered":"2023-11-28T18:37:33.001279+0000","last_unstale":"2023-11-28T18:37:33.988629+0000","last_undegraded":"2023-11-28T18:37:33.988629+0000","last_fullsized":"2023-11-28T18:37:33.988629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:38:59.556086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.988637+0000","last_change":"2023-11-28T18:37:32.466165+0000","last_active":"2023-11-28T18:37:33.988637+0000","last_peered":"2023-11-28T18:37:33.988637+0000","last_clean":"2023-11-28T18:37:33.988637+0000","last_became_active":"2023-11-28T18:37:32.465812+0000","last_became_peered":"2023-11-28T18:37:32.465812+0000","last_unstale":"2023-11-28T18:37:33.988637+0000","last_undegraded":"2023-11-28T18:37:33.988637+0000","last_fullsized":"2023-11-28T18:37:33.988637+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:51:10.284272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009093+0000","last_change":"2023-11-28T18:37:32.988109+0000","last_active":"2023-11-28T18:37:34.009093+0000","last_peered":"2023-11-28T18:37:34.009093+0000","last_clean":"2023-11-28T18:37:34.009093+0000","last_became_active":"2023-11-28T18:37:32.987621+0000","last_became_peered":"2023-11-28T18:37:32.987621+0000","last_unstale":"2023-11-28T18:37:34.009093+0000","last_undegraded":"2023-11-28T18:37:34.009093+0000","last_fullsized":"2023-11-28T18:37:34.009093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:36:58.955111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.982698+0000","last_change":"2023-11-28T18:37:32.459182+0000","last_active":"2023-11-28T18:37:33.982698+0000","last_peered":"2023-11-28T18:37:33.982698+0000","last_clean":"2023-11-28T18:37:33.982698+0000","last_became_active":"2023-11-28T18:37:32.458898+0000","last_became_peered":"2023-11-28T18:37:32.458898+0000","last_unstale":"2023-11-28T18:37:33.982698+0000","last_undegraded":"2023-11-28T18:37:33.982698+0000","last_fullsized":"2023-11-28T18:37:33.982698+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:31:27.918750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.987863+0000","last_change":"2023-11-28T18:37:32.992373+0000","last_active":"2023-11-28T18:37:33.987863+0000","last_peered":"2023-11-28T18:37:33.987863+0000","last_clean":"2023-11-28T18:37:33.987863+0000","last_became_active":"2023-11-28T18:37:32.992176+0000","last_became_peered":"2023-11-28T18:37:32.992176+0000","last_unstale":"2023-11-28T18:37:33.987863+0000","last_undegraded":"2023-11-28T18:37:33.987863+0000","last_fullsized":"2023-11-28T18:37:33.987863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:07:42.147988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010211+0000","last_change":"2023-11-28T18:37:32.471764+0000","last_active":"2023-11-28T18:37:34.010211+0000","last_peered":"2023-11-28T18:37:34.010211+0000","last_clean":"2023-11-28T18:37:34.010211+0000","last_became_active":"2023-11-28T18:37:32.471432+0000","last_became_peered":"2023-11-28T18:37:32.471432+0000","last_unstale":"2023-11-28T18:37:34.010211+0000","last_undegraded":"2023-11-28T18:37:34.010211+0000","last_fullsized":"2023-11-28T18:37:34.010211+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:50:16.260842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009845+0000","last_change":"2023-11-28T18:37:32.996529+0000","last_active":"2023-11-28T18:37:34.009845+0000","last_peered":"2023-11-28T18:37:34.009845+0000","last_clean":"2023-11-28T18:37:34.009845+0000","last_became_active":"2023-11-28T18:37:32.996242+0000","last_became_peered":"2023-11-28T18:37:32.996242+0000","last_unstale":"2023-11-28T18:37:34.009845+0000","last_undegraded":"2023-11-28T18:37:34.009845+0000","last_fullsized":"2023-11-28T18:37:34.009845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:51:32.411691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009074+0000","last_change":"2023-11-28T18:37:32.473745+0000","last_active":"2023-11-28T18:37:34.009074+0000","last_peered":"2023-11-28T18:37:34.009074+0000","last_clean":"2023-11-28T18:37:34.009074+0000","last_became_active":"2023-11-28T18:37:32.473429+0000","last_became_peered":"2023-11-28T18:37:32.473429+0000","last_unstale":"2023-11-28T18:37:34.009074+0000","last_undegraded":"2023-11-28T18:37:34.009074+0000","last_fullsized":"2023-11-28T18:37:34.009074+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:16:52.138851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.008617+0000","last_change":"2023-11-28T18:37:32.987646+0000","last_active":"2023-11-28T18:37:34.008617+0000","last_peered":"2023-11-28T18:37:34.008617+0000","last_clean":"2023-11-28T18:37:34.008617+0000","last_became_active":"2023-11-28T18:37:32.987313+0000","last_became_peered":"2023-11-28T18:37:32.987313+0000","last_unstale":"2023-11-28T18:37:34.008617+0000","last_undegraded":"2023-11-28T18:37:34.008617+0000","last_fullsized":"2023-11-28T18:37:34.008617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:31:28.921268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.988317+0000","last_change":"2023-11-28T18:37:32.472535+0000","last_active":"2023-11-28T18:37:33.988317+0000","last_peered":"2023-11-28T18:37:33.988317+0000","last_clean":"2023-11-28T18:37:33.988317+0000","last_became_active":"2023-11-28T18:37:32.470189+0000","last_became_peered":"2023-11-28T18:37:32.470189+0000","last_unstale":"2023-11-28T18:37:33.988317+0000","last_undegraded":"2023-11-28T18:37:33.988317+0000","last_fullsized":"2023-11-28T18:37:33.988317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:25:40.019702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010041+0000","last_change":"2023-11-28T18:37:33.007113+0000","last_active":"2023-11-28T18:37:34.010041+0000","last_peered":"2023-11-28T18:37:34.010041+0000","last_clean":"2023-11-28T18:37:34.010041+0000","last_became_active":"2023-11-28T18:37:33.006542+0000","last_became_peered":"2023-11-28T18:37:33.006542+0000","last_unstale":"2023-11-28T18:37:34.010041+0000","last_undegraded":"2023-11-28T18:37:34.010041+0000","last_fullsized":"2023-11-28T18:37:34.010041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:43:32.482112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010033+0000","last_change":"2023-11-28T18:37:32.468727+0000","last_active":"2023-11-28T18:37:34.010033+0000","last_peered":"2023-11-28T18:37:34.010033+0000","last_clean":"2023-11-28T18:37:34.010033+0000","last_became_active":"2023-11-28T18:37:32.467363+0000","last_became_peered":"2023-11-28T18:37:32.467363+0000","last_unstale":"2023-11-28T18:37:34.010033+0000","last_undegraded":"2023-11-28T18:37:34.010033+0000","last_fullsized":"2023-11-28T18:37:34.010033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:16:52.138851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010291+0000","last_change":"2023-11-28T18:37:32.994176+0000","last_active":"2023-11-28T18:37:34.010291+0000","last_peered":"2023-11-28T18:37:34.010291+0000","last_clean":"2023-11-28T18:37:34.010291+0000","last_became_active":"2023-11-28T18:37:32.993577+0000","last_became_peered":"2023-11-28T18:37:32.993577+0000","last_unstale":"2023-11-28T18:37:34.010291+0000","last_undegraded":"2023-11-28T18:37:34.010291+0000","last_fullsized":"2023-11-28T18:37:34.010291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:51:55.517713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.007852+0000","last_change":"2023-11-28T18:37:32.466190+0000","last_active":"2023-11-28T18:37:34.007852+0000","last_peered":"2023-11-28T18:37:34.007852+0000","last_clean":"2023-11-28T18:37:34.007852+0000","last_became_active":"2023-11-28T18:37:32.465855+0000","last_became_peered":"2023-11-28T18:37:32.465855+0000","last_unstale":"2023-11-28T18:37:34.007852+0000","last_undegraded":"2023-11-28T18:37:34.007852+0000","last_fullsized":"2023-11-28T18:37:34.007852+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:18:32.548680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009694+0000","last_change":"2023-11-28T18:37:33.011619+0000","last_active":"2023-11-28T18:37:34.009694+0000","last_peered":"2023-11-28T18:37:34.009694+0000","last_clean":"2023-11-28T18:37:34.009694+0000","last_became_active":"2023-11-28T18:37:33.011164+0000","last_became_peered":"2023-11-28T18:37:33.011164+0000","last_unstale":"2023-11-28T18:37:34.009694+0000","last_undegraded":"2023-11-28T18:37:34.009694+0000","last_fullsized":"2023-11-28T18:37:34.009694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:02:53.545778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.987604+0000","last_change":"2023-11-28T18:37:32.472353+0000","last_active":"2023-11-28T18:37:33.987604+0000","last_peered":"2023-11-28T18:37:33.987604+0000","last_clean":"2023-11-28T18:37:33.987604+0000","last_became_active":"2023-11-28T18:37:32.472028+0000","last_became_peered":"2023-11-28T18:37:32.472028+0000","last_unstale":"2023-11-28T18:37:33.987604+0000","last_undegraded":"2023-11-28T18:37:33.987604+0000","last_fullsized":"2023-11-28T18:37:33.987604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:06:15.023841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010260+0000","last_change":"2023-11-28T18:37:33.006869+0000","last_active":"2023-11-28T18:37:34.010260+0000","last_peered":"2023-11-28T18:37:34.010260+0000","last_clean":"2023-11-28T18:37:34.010260+0000","last_became_active":"2023-11-28T18:37:33.006496+0000","last_became_peered":"2023-11-28T18:37:33.006496+0000","last_unstale":"2023-11-28T18:37:34.010260+0000","last_undegraded":"2023-11-28T18:37:34.010260+0000","last_fullsized":"2023-11-28T18:37:34.010260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:38:59.556086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.008466+0000","last_change":"2023-11-28T18:37:32.461121+0000","last_active":"2023-11-28T18:37:34.008466+0000","last_peered":"2023-11-28T18:37:34.008466+0000","last_clean":"2023-11-28T18:37:34.008466+0000","last_became_active":"2023-11-28T18:37:32.460769+0000","last_became_peered":"2023-11-28T18:37:32.460769+0000","last_unstale":"2023-11-28T18:37:34.008466+0000","last_undegraded":"2023-11-28T18:37:34.008466+0000","last_fullsized":"2023-11-28T18:37:34.008466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:18:56.938399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010480+0000","last_change":"2023-11-28T18:37:33.007274+0000","last_active":"2023-11-28T18:37:34.010480+0000","last_peered":"2023-11-28T18:37:34.010480+0000","last_clean":"2023-11-28T18:37:34.010480+0000","last_became_active":"2023-11-28T18:37:33.007033+0000","last_became_peered":"2023-11-28T18:37:33.007033+0000","last_unstale":"2023-11-28T18:37:34.010480+0000","last_undegraded":"2023-11-28T18:37:34.010480+0000","last_fullsized":"2023-11-28T18:37:34.010480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:31:52.252862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.982789+0000","last_change":"2023-11-28T18:37:32.466332+0000","last_active":"2023-11-28T18:37:33.982789+0000","last_peered":"2023-11-28T18:37:33.982789+0000","last_clean":"2023-11-28T18:37:33.982789+0000","last_became_active":"2023-11-28T18:37:32.464365+0000","last_became_peered":"2023-11-28T18:37:32.464365+0000","last_unstale":"2023-11-28T18:37:33.982789+0000","last_undegraded":"2023-11-28T18:37:33.982789+0000","last_fullsized":"2023-11-28T18:37:33.982789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:51:54.515196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.988455+0000","last_change":"2023-11-28T18:37:33.000939+0000","last_active":"2023-11-28T18:37:33.988455+0000","last_peered":"2023-11-28T18:37:33.988455+0000","last_clean":"2023-11-28T18:37:33.988455+0000","last_became_active":"2023-11-28T18:37:32.994852+0000","last_became_peered":"2023-11-28T18:37:32.994852+0000","last_unstale":"2023-11-28T18:37:33.988455+0000","last_undegraded":"2023-11-28T18:37:33.988455+0000","last_fullsized":"2023-11-28T18:37:33.988455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:43:32.482112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.008261+0000","last_change":"2023-11-28T18:37:32.466158+0000","last_active":"2023-11-28T18:37:34.008261+0000","last_peered":"2023-11-28T18:37:34.008261+0000","last_clean":"2023-11-28T18:37:34.008261+0000","last_became_active":"2023-11-28T18:37:32.465844+0000","last_became_peered":"2023-11-28T18:37:32.465844+0000","last_unstale":"2023-11-28T18:37:34.008261+0000","last_undegraded":"2023-11-28T18:37:34.008261+0000","last_fullsized":"2023-11-28T18:37:34.008261+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:21:07.387019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009932+0000","last_change":"2023-11-28T18:37:33.009557+0000","last_active":"2023-11-28T18:37:34.009932+0000","last_peered":"2023-11-28T18:37:34.009932+0000","last_clean":"2023-11-28T18:37:34.009932+0000","last_became_active":"2023-11-28T18:37:33.008838+0000","last_became_peered":"2023-11-28T18:37:33.008838+0000","last_unstale":"2023-11-28T18:37:34.009932+0000","last_undegraded":"2023-11-28T18:37:34.009932+0000","last_fullsized":"2023-11-28T18:37:34.009932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:20:33.664753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T18:37:32.991019+0000","last_change":"2023-11-28T18:37:22.369132+0000","last_active":"2023-11-28T18:37:32.991019+0000","last_peered":"2023-11-28T18:37:32.991019+0000","last_clean":"2023-11-28T18:37:32.991019+0000","last_became_active":"2023-11-28T18:37:22.368142+0000","last_became_peered":"2023-11-28T18:37:22.368142+0000","last_unstale":"2023-11-28T18:37:32.991019+0000","last_undegraded":"2023-11-28T18:37:32.991019+0000","last_fullsized":"2023-11-28T18:37:32.991019+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:21.313053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:21.313053+0000","last_clean_scrub_stamp":"2023-11-28T18:37:21.313053+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:55:01.432028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.988127+0000","last_change":"2023-11-28T18:37:32.466471+0000","last_active":"2023-11-28T18:37:33.988127+0000","last_peered":"2023-11-28T18:37:33.988127+0000","last_clean":"2023-11-28T18:37:33.988127+0000","last_became_active":"2023-11-28T18:37:32.466153+0000","last_became_peered":"2023-11-28T18:37:32.466153+0000","last_unstale":"2023-11-28T18:37:33.988127+0000","last_undegraded":"2023-11-28T18:37:33.988127+0000","last_fullsized":"2023-11-28T18:37:33.988127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:31:52.780773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009403+0000","last_change":"2023-11-28T18:37:32.999109+0000","last_active":"2023-11-28T18:37:34.009403+0000","last_peered":"2023-11-28T18:37:34.009403+0000","last_clean":"2023-11-28T18:37:34.009403+0000","last_became_active":"2023-11-28T18:37:32.998842+0000","last_became_peered":"2023-11-28T18:37:32.998842+0000","last_unstale":"2023-11-28T18:37:34.009403+0000","last_undegraded":"2023-11-28T18:37:34.009403+0000","last_fullsized":"2023-11-28T18:37:34.009403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:36:58.955111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009483+0000","last_change":"2023-11-28T18:37:32.478867+0000","last_active":"2023-11-28T18:37:34.009483+0000","last_peered":"2023-11-28T18:37:34.009483+0000","last_clean":"2023-11-28T18:37:34.009483+0000","last_became_active":"2023-11-28T18:37:32.478483+0000","last_became_peered":"2023-11-28T18:37:32.478483+0000","last_unstale":"2023-11-28T18:37:34.009483+0000","last_undegraded":"2023-11-28T18:37:34.009483+0000","last_fullsized":"2023-11-28T18:37:34.009483+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:21:07.387019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.008034+0000","last_change":"2023-11-28T18:37:32.984449+0000","last_active":"2023-11-28T18:37:34.008034+0000","last_peered":"2023-11-28T18:37:34.008034+0000","last_clean":"2023-11-28T18:37:34.008034+0000","last_became_active":"2023-11-28T18:37:32.984134+0000","last_became_peered":"2023-11-28T18:37:32.984134+0000","last_unstale":"2023-11-28T18:37:34.008034+0000","last_undegraded":"2023-11-28T18:37:34.008034+0000","last_fullsized":"2023-11-28T18:37:34.008034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:22:49.250665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.008158+0000","last_change":"2023-11-28T18:37:32.455919+0000","last_active":"2023-11-28T18:37:34.008158+0000","last_peered":"2023-11-28T18:37:34.008158+0000","last_clean":"2023-11-28T18:37:34.008158+0000","last_became_active":"2023-11-28T18:37:32.455643+0000","last_became_peered":"2023-11-28T18:37:32.455643+0000","last_unstale":"2023-11-28T18:37:34.008158+0000","last_undegraded":"2023-11-28T18:37:34.008158+0000","last_fullsized":"2023-11-28T18:37:34.008158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:47:06.994491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.982436+0000","last_change":"2023-11-28T18:37:32.985903+0000","last_active":"2023-11-28T18:37:33.982436+0000","last_peered":"2023-11-28T18:37:33.982436+0000","last_clean":"2023-11-28T18:37:33.982436+0000","last_became_active":"2023-11-28T18:37:32.985566+0000","last_became_peered":"2023-11-28T18:37:32.985566+0000","last_unstale":"2023-11-28T18:37:33.982436+0000","last_undegraded":"2023-11-28T18:37:33.982436+0000","last_fullsized":"2023-11-28T18:37:33.982436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:25:41.022219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.988411+0000","last_change":"2023-11-28T18:37:32.470133+0000","last_active":"2023-11-28T18:37:33.988411+0000","last_peered":"2023-11-28T18:37:33.988411+0000","last_clean":"2023-11-28T18:37:33.988411+0000","last_became_active":"2023-11-28T18:37:32.468215+0000","last_became_peered":"2023-11-28T18:37:32.468215+0000","last_unstale":"2023-11-28T18:37:33.988411+0000","last_undegraded":"2023-11-28T18:37:33.988411+0000","last_fullsized":"2023-11-28T18:37:33.988411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:41:57.490696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.987855+0000","last_change":"2023-11-28T18:37:32.983380+0000","last_active":"2023-11-28T18:37:33.987855+0000","last_peered":"2023-11-28T18:37:33.987855+0000","last_clean":"2023-11-28T18:37:33.987855+0000","last_became_active":"2023-11-28T18:37:32.982867+0000","last_became_peered":"2023-11-28T18:37:32.982867+0000","last_unstale":"2023-11-28T18:37:33.987855+0000","last_undegraded":"2023-11-28T18:37:33.987855+0000","last_fullsized":"2023-11-28T18:37:33.987855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:18:57.940916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.982747+0000","last_change":"2023-11-28T18:37:32.471305+0000","last_active":"2023-11-28T18:37:33.982747+0000","last_peered":"2023-11-28T18:37:33.982747+0000","last_clean":"2023-11-28T18:37:33.982747+0000","last_became_active":"2023-11-28T18:37:32.470236+0000","last_became_peered":"2023-11-28T18:37:32.470236+0000","last_unstale":"2023-11-28T18:37:33.982747+0000","last_undegraded":"2023-11-28T18:37:33.982747+0000","last_fullsized":"2023-11-28T18:37:33.982747+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:00:25.204297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.988693+0000","last_change":"2023-11-28T18:37:32.999867+0000","last_active":"2023-11-28T18:37:33.988693+0000","last_peered":"2023-11-28T18:37:33.988693+0000","last_clean":"2023-11-28T18:37:33.988693+0000","last_became_active":"2023-11-28T18:37:32.994734+0000","last_became_peered":"2023-11-28T18:37:32.994734+0000","last_unstale":"2023-11-28T18:37:33.988693+0000","last_undegraded":"2023-11-28T18:37:33.988693+0000","last_fullsized":"2023-11-28T18:37:33.988693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:31:53.513239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010425+0000","last_change":"2023-11-28T18:37:32.481867+0000","last_active":"2023-11-28T18:37:34.010425+0000","last_peered":"2023-11-28T18:37:34.010425+0000","last_clean":"2023-11-28T18:37:34.010425+0000","last_became_active":"2023-11-28T18:37:32.481470+0000","last_became_peered":"2023-11-28T18:37:32.481470+0000","last_unstale":"2023-11-28T18:37:34.010425+0000","last_undegraded":"2023-11-28T18:37:34.010425+0000","last_fullsized":"2023-11-28T18:37:34.010425+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:41:57.490696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.982689+0000","last_change":"2023-11-28T18:37:32.988151+0000","last_active":"2023-11-28T18:37:33.982689+0000","last_peered":"2023-11-28T18:37:33.982689+0000","last_clean":"2023-11-28T18:37:33.982689+0000","last_became_active":"2023-11-28T18:37:32.987895+0000","last_became_peered":"2023-11-28T18:37:32.987895+0000","last_unstale":"2023-11-28T18:37:33.982689+0000","last_undegraded":"2023-11-28T18:37:33.982689+0000","last_fullsized":"2023-11-28T18:37:33.982689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:18:10.978623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:35.265746+0000","last_change":"2023-11-28T18:37:32.464191+0000","last_active":"2023-11-28T18:37:35.265746+0000","last_peered":"2023-11-28T18:37:35.265746+0000","last_clean":"2023-11-28T18:37:35.265746+0000","last_became_active":"2023-11-28T18:37:32.463835+0000","last_became_peered":"2023-11-28T18:37:32.463835+0000","last_unstale":"2023-11-28T18:37:35.265746+0000","last_undegraded":"2023-11-28T18:37:35.265746+0000","last_fullsized":"2023-11-28T18:37:35.265746+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:22:48.248148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009821+0000","last_change":"2023-11-28T18:37:32.995912+0000","last_active":"2023-11-28T18:37:34.009821+0000","last_peered":"2023-11-28T18:37:34.009821+0000","last_clean":"2023-11-28T18:37:34.009821+0000","last_became_active":"2023-11-28T18:37:32.995582+0000","last_became_peered":"2023-11-28T18:37:32.995582+0000","last_unstale":"2023-11-28T18:37:34.009821+0000","last_undegraded":"2023-11-28T18:37:34.009821+0000","last_fullsized":"2023-11-28T18:37:34.009821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:21:13.521447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010735+0000","last_change":"2023-11-28T18:37:32.474120+0000","last_active":"2023-11-28T18:37:34.010735+0000","last_peered":"2023-11-28T18:37:34.010735+0000","last_clean":"2023-11-28T18:37:34.010735+0000","last_became_active":"2023-11-28T18:37:32.473702+0000","last_became_peered":"2023-11-28T18:37:32.473702+0000","last_unstale":"2023-11-28T18:37:34.010735+0000","last_undegraded":"2023-11-28T18:37:34.010735+0000","last_fullsized":"2023-11-28T18:37:34.010735+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:00:25.204297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009041+0000","last_change":"2023-11-28T18:37:32.987116+0000","last_active":"2023-11-28T18:37:34.009041+0000","last_peered":"2023-11-28T18:37:34.009041+0000","last_clean":"2023-11-28T18:37:34.009041+0000","last_became_active":"2023-11-28T18:37:32.986562+0000","last_became_peered":"2023-11-28T18:37:32.986562+0000","last_unstale":"2023-11-28T18:37:34.009041+0000","last_undegraded":"2023-11-28T18:37:34.009041+0000","last_fullsized":"2023-11-28T18:37:34.009041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:46:52.261405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009479+0000","last_change":"2023-11-28T18:37:32.478702+0000","last_active":"2023-11-28T18:37:34.009479+0000","last_peered":"2023-11-28T18:37:34.009479+0000","last_clean":"2023-11-28T18:37:34.009479+0000","last_became_active":"2023-11-28T18:37:32.478119+0000","last_became_peered":"2023-11-28T18:37:32.478119+0000","last_unstale":"2023-11-28T18:37:34.009479+0000","last_undegraded":"2023-11-28T18:37:34.009479+0000","last_fullsized":"2023-11-28T18:37:34.009479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:47:06.994491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.987532+0000","last_change":"2023-11-28T18:37:32.989092+0000","last_active":"2023-11-28T18:37:33.987532+0000","last_peered":"2023-11-28T18:37:33.987532+0000","last_clean":"2023-11-28T18:37:33.987532+0000","last_became_active":"2023-11-28T18:37:32.988635+0000","last_became_peered":"2023-11-28T18:37:32.988635+0000","last_unstale":"2023-11-28T18:37:33.987532+0000","last_undegraded":"2023-11-28T18:37:33.987532+0000","last_fullsized":"2023-11-28T18:37:33.987532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:47:07.997008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.982526+0000","last_change":"2023-11-28T18:37:32.466953+0000","last_active":"2023-11-28T18:37:33.982526+0000","last_peered":"2023-11-28T18:37:33.982526+0000","last_clean":"2023-11-28T18:37:33.982526+0000","last_became_active":"2023-11-28T18:37:32.466697+0000","last_became_peered":"2023-11-28T18:37:32.466697+0000","last_unstale":"2023-11-28T18:37:33.982526+0000","last_undegraded":"2023-11-28T18:37:33.982526+0000","last_fullsized":"2023-11-28T18:37:33.982526+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:50:16.260842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.008440+0000","last_change":"2023-11-28T18:37:32.990343+0000","last_active":"2023-11-28T18:37:34.008440+0000","last_peered":"2023-11-28T18:37:34.008440+0000","last_clean":"2023-11-28T18:37:34.008440+0000","last_became_active":"2023-11-28T18:37:32.990039+0000","last_became_peered":"2023-11-28T18:37:32.990039+0000","last_unstale":"2023-11-28T18:37:34.008440+0000","last_undegraded":"2023-11-28T18:37:34.008440+0000","last_fullsized":"2023-11-28T18:37:34.008440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:41:58.493214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.982690+0000","last_change":"2023-11-28T18:37:32.469083+0000","last_active":"2023-11-28T18:37:33.982690+0000","last_peered":"2023-11-28T18:37:33.982690+0000","last_clean":"2023-11-28T18:37:33.982690+0000","last_became_active":"2023-11-28T18:37:32.468565+0000","last_became_peered":"2023-11-28T18:37:32.468565+0000","last_unstale":"2023-11-28T18:37:33.982690+0000","last_undegraded":"2023-11-28T18:37:33.982690+0000","last_fullsized":"2023-11-28T18:37:33.982690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:16:52.138851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009395+0000","last_change":"2023-11-28T18:37:32.984344+0000","last_active":"2023-11-28T18:37:34.009395+0000","last_peered":"2023-11-28T18:37:34.009395+0000","last_clean":"2023-11-28T18:37:34.009395+0000","last_became_active":"2023-11-28T18:37:32.983741+0000","last_became_peered":"2023-11-28T18:37:32.983741+0000","last_unstale":"2023-11-28T18:37:34.009395+0000","last_undegraded":"2023-11-28T18:37:34.009395+0000","last_fullsized":"2023-11-28T18:37:34.009395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:46:52.261405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010023+0000","last_change":"2023-11-28T18:37:32.479654+0000","last_active":"2023-11-28T18:37:34.010023+0000","last_peered":"2023-11-28T18:37:34.010023+0000","last_clean":"2023-11-28T18:37:34.010023+0000","last_became_active":"2023-11-28T18:37:32.479338+0000","last_became_peered":"2023-11-28T18:37:32.479338+0000","last_unstale":"2023-11-28T18:37:34.010023+0000","last_undegraded":"2023-11-28T18:37:34.010023+0000","last_fullsized":"2023-11-28T18:37:34.010023+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:46:51.258888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010634+0000","last_change":"2023-11-28T18:37:33.001157+0000","last_active":"2023-11-28T18:37:34.010634+0000","last_peered":"2023-11-28T18:37:34.010634+0000","last_clean":"2023-11-28T18:37:34.010634+0000","last_became_active":"2023-11-28T18:37:33.000865+0000","last_became_peered":"2023-11-28T18:37:33.000865+0000","last_unstale":"2023-11-28T18:37:34.010634+0000","last_undegraded":"2023-11-28T18:37:34.010634+0000","last_fullsized":"2023-11-28T18:37:34.010634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:18:10.978623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.988714+0000","last_change":"2023-11-28T18:37:33.005635+0000","last_active":"2023-11-28T18:37:33.988714+0000","last_peered":"2023-11-28T18:37:33.988714+0000","last_clean":"2023-11-28T18:37:33.988714+0000","last_became_active":"2023-11-28T18:37:33.001121+0000","last_became_peered":"2023-11-28T18:37:33.001121+0000","last_unstale":"2023-11-28T18:37:33.988714+0000","last_undegraded":"2023-11-28T18:37:33.988714+0000","last_fullsized":"2023-11-28T18:37:33.988714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:12:16.071028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009766+0000","last_change":"2023-11-28T18:37:32.481789+0000","last_active":"2023-11-28T18:37:34.009766+0000","last_peered":"2023-11-28T18:37:34.009766+0000","last_clean":"2023-11-28T18:37:34.009766+0000","last_became_active":"2023-11-28T18:37:32.481480+0000","last_became_peered":"2023-11-28T18:37:32.481480+0000","last_unstale":"2023-11-28T18:37:34.009766+0000","last_undegraded":"2023-11-28T18:37:34.009766+0000","last_fullsized":"2023-11-28T18:37:34.009766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:00:25.204297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.988397+0000","last_change":"2023-11-28T18:37:33.005206+0000","last_active":"2023-11-28T18:37:33.988397+0000","last_peered":"2023-11-28T18:37:33.988397+0000","last_clean":"2023-11-28T18:37:33.988397+0000","last_became_active":"2023-11-28T18:37:33.002231+0000","last_became_peered":"2023-11-28T18:37:33.002231+0000","last_unstale":"2023-11-28T18:37:33.988397+0000","last_undegraded":"2023-11-28T18:37:33.988397+0000","last_fullsized":"2023-11-28T18:37:33.988397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:20:33.664753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009927+0000","last_change":"2023-11-28T18:37:32.481872+0000","last_active":"2023-11-28T18:37:34.009927+0000","last_peered":"2023-11-28T18:37:34.009927+0000","last_clean":"2023-11-28T18:37:34.009927+0000","last_became_active":"2023-11-28T18:37:32.481564+0000","last_became_peered":"2023-11-28T18:37:32.481564+0000","last_unstale":"2023-11-28T18:37:34.009927+0000","last_undegraded":"2023-11-28T18:37:34.009927+0000","last_fullsized":"2023-11-28T18:37:34.009927+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:22:48.248148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.008960+0000","last_change":"2023-11-28T18:37:33.001322+0000","last_active":"2023-11-28T18:37:34.008960+0000","last_peered":"2023-11-28T18:37:34.008960+0000","last_clean":"2023-11-28T18:37:34.008960+0000","last_became_active":"2023-11-28T18:37:33.001146+0000","last_became_peered":"2023-11-28T18:37:33.001146+0000","last_unstale":"2023-11-28T18:37:34.008960+0000","last_undegraded":"2023-11-28T18:37:34.008960+0000","last_fullsized":"2023-11-28T18:37:34.008960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:41:58.493214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009749+0000","last_change":"2023-11-28T18:37:32.469287+0000","last_active":"2023-11-28T18:37:34.009749+0000","last_peered":"2023-11-28T18:37:34.009749+0000","last_clean":"2023-11-28T18:37:34.009749+0000","last_became_active":"2023-11-28T18:37:32.468967+0000","last_became_peered":"2023-11-28T18:37:32.468967+0000","last_unstale":"2023-11-28T18:37:34.009749+0000","last_undegraded":"2023-11-28T18:37:34.009749+0000","last_fullsized":"2023-11-28T18:37:34.009749+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:00:25.204297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009695+0000","last_change":"2023-11-28T18:37:32.993786+0000","last_active":"2023-11-28T18:37:34.009695+0000","last_peered":"2023-11-28T18:37:34.009695+0000","last_clean":"2023-11-28T18:37:34.009695+0000","last_became_active":"2023-11-28T18:37:32.992734+0000","last_became_peered":"2023-11-28T18:37:32.992734+0000","last_unstale":"2023-11-28T18:37:34.009695+0000","last_undegraded":"2023-11-28T18:37:34.009695+0000","last_fullsized":"2023-11-28T18:37:34.009695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:02:53.545778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009176+0000","last_change":"2023-11-28T18:37:32.471483+0000","last_active":"2023-11-28T18:37:34.009176+0000","last_peered":"2023-11-28T18:37:34.009176+0000","last_clean":"2023-11-28T18:37:34.009176+0000","last_became_active":"2023-11-28T18:37:32.471207+0000","last_became_peered":"2023-11-28T18:37:32.471207+0000","last_unstale":"2023-11-28T18:37:34.009176+0000","last_undegraded":"2023-11-28T18:37:34.009176+0000","last_fullsized":"2023-11-28T18:37:34.009176+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:07:41.145470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":661860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97699999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":204800,"data_stored":70910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31972,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339868,"statfs":{"total":96636764160,"available":96604024832,"internally_reserved":0,"allocated":811008,"data_stored":661916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T18:37:43.965 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T18:37:44.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.139+0000 7f6828e46640 1 Processor -- start 2023-11-28T18:37:44.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.139+0000 7f6828e46640 1 -- start start 2023-11-28T18:37:44.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.139+0000 7f6828e46640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f682413cf70 0x7f682406c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:44.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.139+0000 7f6828e46640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f682415ad80 0x7f68240cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:44.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.139+0000 7f6828e46640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f682415b3e0 con 0x7f682406c840 2023-11-28T18:37:44.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.139+0000 7f6828e46640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f682413d350 con 0x7f682415ad80 2023-11-28T18:37:44.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.139+0000 7f6828e46640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f682415b1f0 con 0x7f682413cf70 2023-11-28T18:37:44.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.139+0000 7f6822d9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f682415ad80 0x7f68240cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:44.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.143+0000 7f6822d9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f682415ad80 0x7f68240cd8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57604/0 (socket says 172.21.15.45:57604) 2023-11-28T18:37:44.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.143+0000 7f6822d9d640 1 -- 172.21.15.45:0/305417900 learned_addr learned my addr 172.21.15.45:0/305417900 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:44.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.143+0000 7f682259c640 1 --2- 172.21.15.45:0/305417900 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f682413cf70 0x7f682406c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:44.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.143+0000 7f6822d9d640 1 -- 172.21.15.45:0/305417900 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f682413cf70 msgr2=0x7f682406c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:44.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.143+0000 7f6822d9d640 1 --2- 172.21.15.45:0/305417900 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f682413cf70 0x7f682406c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:44.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.143+0000 7f6822d9d640 1 -- 172.21.15.45:0/305417900 >> v1:172.21.15.190:6789/0 conn(0x7f682406c840 legacy=0x7f682415a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:44.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.143+0000 7f6822d9d640 1 -- 172.21.15.45:0/305417900 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f682406cc80 con 0x7f682415ad80 2023-11-28T18:37:44.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.143+0000 7f6822d9d640 1 --2- 172.21.15.45:0/305417900 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f682415ad80 0x7f68240cd8c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f681c009e50 tx=0x7f681c01c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a1d3bb9c20430ad server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:44.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.143+0000 7f6821d9b640 1 -- 172.21.15.45:0/305417900 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681c0a5730 con 0x7f682415ad80 2023-11-28T18:37:44.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.143+0000 7f6821d9b640 1 -- 172.21.15.45:0/305417900 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f681c0a5890 con 0x7f682415ad80 2023-11-28T18:37:44.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.143+0000 7f6821d9b640 1 -- 172.21.15.45:0/305417900 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681c0a5c20 con 0x7f682415ad80 2023-11-28T18:37:44.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.147+0000 7f6828e46640 1 -- 172.21.15.45:0/305417900 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f682415ad80 msgr2=0x7f68240cd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:44.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.147+0000 7f6828e46640 1 --2- 172.21.15.45:0/305417900 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f682415ad80 0x7f68240cd8c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f681c009e50 tx=0x7f681c01c980 comp rx=0 tx=0).stop 2023-11-28T18:37:44.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.147+0000 7f6828e46640 1 -- 172.21.15.45:0/305417900 shutdown_connections 2023-11-28T18:37:44.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.147+0000 7f6828e46640 1 --2- 172.21.15.45:0/305417900 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f682415ad80 0x7f68240cd8c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:44.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.147+0000 7f6828e46640 1 --2- 172.21.15.45:0/305417900 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f682413cf70 0x7f682406c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:44.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.147+0000 7f6828e46640 1 -- 172.21.15.45:0/305417900 >> 172.21.15.45:0/305417900 conn(0x7f682406a570 msgr2=0x7f682406a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:44.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.147+0000 7f6828e46640 1 -- 172.21.15.45:0/305417900 shutdown_connections 2023-11-28T18:37:44.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.147+0000 7f6828e46640 1 -- 172.21.15.45:0/305417900 wait complete. 2023-11-28T18:37:44.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.147+0000 7f6828e46640 1 Processor -- start 2023-11-28T18:37:44.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.147+0000 7f6828e46640 1 -- start start 2023-11-28T18:37:44.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.147+0000 7f6828e46640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f682406c840 0x7f68241340b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:44.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.147+0000 7f6828e46640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f682413cf70 0x7f68241501d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:44.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.147+0000 7f6828e46640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f682415ad80 0x7f682413eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:44.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.147+0000 7f6828e46640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6824137fa0 con 0x7f682415ad80 2023-11-28T18:37:44.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.147+0000 7f6828e46640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6824150710 con 0x7f682406c840 2023-11-28T18:37:44.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.147+0000 7f6828e46640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6824137360 con 0x7f682413cf70 2023-11-28T18:37:44.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.147+0000 7f6822d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f682415ad80 0x7f682413eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:44.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.147+0000 7f682259c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f682406c840 0x7f68241340b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:44.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.147+0000 7f681bfff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f682413cf70 0x7f68241501d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:44.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.147+0000 7f6822d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f682415ad80 0x7f682413eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57608/0 (socket says 172.21.15.45:57608) 2023-11-28T18:37:44.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.147+0000 7f6822d9d640 1 -- 172.21.15.45:0/381344172 learned_addr learned my addr 172.21.15.45:0/381344172 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:44.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.151+0000 7f6822d9d640 1 -- 172.21.15.45:0/381344172 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f682413cf70 msgr2=0x7f68241501d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:44.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.151+0000 7f6822d9d640 1 --2- 172.21.15.45:0/381344172 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f682413cf70 0x7f68241501d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:44.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.151+0000 7f6822d9d640 1 -- 172.21.15.45:0/381344172 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f682406c840 msgr2=0x7f68241340b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:44.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.151+0000 7f6822d9d640 1 --2- 172.21.15.45:0/381344172 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f682406c840 0x7f68241340b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:44.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.151+0000 7f6822d9d640 1 -- 172.21.15.45:0/381344172 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f681c009b30 con 0x7f682415ad80 2023-11-28T18:37:44.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.151+0000 7f682259c640 1 --2- 172.21.15.45:0/381344172 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f682406c840 0x7f68241340b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:37:44.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.151+0000 7f6822d9d640 1 --2- 172.21.15.45:0/381344172 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f682415ad80 0x7f682413eda0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f681c01a5b0 tx=0x7f681c019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:44.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.151+0000 7f681affd640 1 -- 172.21.15.45:0/381344172 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681c0b8670 con 0x7f682415ad80 2023-11-28T18:37:44.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.151+0000 7f681affd640 1 -- 172.21.15.45:0/381344172 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f681c0b87d0 con 0x7f682415ad80 2023-11-28T18:37:44.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.151+0000 7f681affd640 1 -- 172.21.15.45:0/381344172 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681c0b8b60 con 0x7f682415ad80 2023-11-28T18:37:44.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.151+0000 7f6828e46640 1 -- 172.21.15.45:0/381344172 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6824137600 con 0x7f682415ad80 2023-11-28T18:37:44.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.151+0000 7f6828e46640 1 -- 172.21.15.45:0/381344172 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6824137bc0 con 0x7f682415ad80 2023-11-28T18:37:44.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.151+0000 7f6828e46640 1 -- 172.21.15.45:0/381344172 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68241380e0 con 0x7f682415ad80 2023-11-28T18:37:44.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.151+0000 7f681affd640 1 -- 172.21.15.45:0/381344172 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f681c0b8cc0 con 0x7f682415ad80 2023-11-28T18:37:44.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.151+0000 7f681affd640 1 --2- 172.21.15.45:0/381344172 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6804066900 0x7f6804068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:44.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.151+0000 7f681affd640 1 -- 172.21.15.45:0/381344172 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f681c11f790 con 0x7f682415ad80 2023-11-28T18:37:44.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.155+0000 7f682259c640 1 --2- 172.21.15.45:0/381344172 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6804066900 0x7f6804068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:44.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.155+0000 7f682259c640 1 --2- 172.21.15.45:0/381344172 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6804066900 0x7f6804068dc0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6824070fc0 tx=0x7f6814009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:44.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.155+0000 7f681affd640 1 -- 172.21.15.45:0/381344172 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f68241380e0 con 0x7f682415ad80 2023-11-28T18:37:44.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.311+0000 7f6828e46640 1 -- 172.21.15.45:0/381344172 --> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f68240b43f0 con 0x7f6804066900 2023-11-28T18:37:44.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.319+0000 7f681affd640 1 -- 172.21.15.45:0/381344172 <== mgr.4100 v2:172.21.15.190:6832/645101166 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264592 (secure 0 0 0) 0x7f68240b43f0 con 0x7f6804066900 2023-11-28T18:37:44.324 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:37:44.327 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-11-28T18:37:44.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.319+0000 7f6828e46640 1 -- 172.21.15.45:0/381344172 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6804066900 msgr2=0x7f6804068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:44.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.319+0000 7f6828e46640 1 --2- 172.21.15.45:0/381344172 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6804066900 0x7f6804068dc0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6824070fc0 tx=0x7f6814009190 comp rx=0 tx=0).stop 2023-11-28T18:37:44.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.319+0000 7f6828e46640 1 -- 172.21.15.45:0/381344172 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f682415ad80 msgr2=0x7f682413eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:44.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.319+0000 7f6828e46640 1 --2- 172.21.15.45:0/381344172 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f682415ad80 0x7f682413eda0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f681c01a5b0 tx=0x7f681c019720 comp rx=0 tx=0).stop 2023-11-28T18:37:44.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.319+0000 7f6828e46640 1 -- 172.21.15.45:0/381344172 shutdown_connections 2023-11-28T18:37:44.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.319+0000 7f6828e46640 1 --2- 172.21.15.45:0/381344172 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6804066900 0x7f6804068dc0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:44.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.319+0000 7f6828e46640 1 --2- 172.21.15.45:0/381344172 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f682415ad80 0x7f682413eda0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:44.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.319+0000 7f6828e46640 1 --2- 172.21.15.45:0/381344172 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f682413cf70 0x7f68241501d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:44.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.319+0000 7f6828e46640 1 --2- 172.21.15.45:0/381344172 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f682406c840 0x7f68241340b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:44.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.319+0000 7f6828e46640 1 -- 172.21.15.45:0/381344172 >> 172.21.15.45:0/381344172 conn(0x7f682406a570 msgr2=0x7f682415b670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:44.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.319+0000 7f6828e46640 1 -- 172.21.15.45:0/381344172 shutdown_connections 2023-11-28T18:37:44.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.319+0000 7f6828e46640 1 -- 172.21.15.45:0/381344172 wait complete. 2023-11-28T18:37:44.345 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-11-28T18:37:43.236516+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235628,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739092,"statfs":{"total":773094113280,"available":772852830208,"internally_reserved":0,"allocated":2891776,"data_stored":1752836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002496"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010341+0000","last_change":"2023-11-28T18:37:33.002234+0000","last_active":"2023-11-28T18:37:34.010341+0000","last_peered":"2023-11-28T18:37:34.010341+0000","last_clean":"2023-11-28T18:37:34.010341+0000","last_became_active":"2023-11-28T18:37:33.001965+0000","last_became_peered":"2023-11-28T18:37:33.001965+0000","last_unstale":"2023-11-28T18:37:34.010341+0000","last_undegraded":"2023-11-28T18:37:34.010341+0000","last_fullsized":"2023-11-28T18:37:34.010341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:12:16.071028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.982842+0000","last_change":"2023-11-28T18:37:32.990938+0000","last_active":"2023-11-28T18:37:33.982842+0000","last_peered":"2023-11-28T18:37:33.982842+0000","last_clean":"2023-11-28T18:37:33.982842+0000","last_became_active":"2023-11-28T18:37:32.990637+0000","last_became_peered":"2023-11-28T18:37:32.990637+0000","last_unstale":"2023-11-28T18:37:33.982842+0000","last_undegraded":"2023-11-28T18:37:33.982842+0000","last_fullsized":"2023-11-28T18:37:33.982842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:36:58.955111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.008845+0000","last_change":"2023-11-28T18:37:32.985400+0000","last_active":"2023-11-28T18:37:34.008845+0000","last_peered":"2023-11-28T18:37:34.008845+0000","last_clean":"2023-11-28T18:37:34.008845+0000","last_became_active":"2023-11-28T18:37:32.985067+0000","last_became_peered":"2023-11-28T18:37:32.985067+0000","last_unstale":"2023-11-28T18:37:34.008845+0000","last_undegraded":"2023-11-28T18:37:34.008845+0000","last_fullsized":"2023-11-28T18:37:34.008845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:51:11.286789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.988275+0000","last_change":"2023-11-28T18:37:33.004974+0000","last_active":"2023-11-28T18:37:33.988275+0000","last_peered":"2023-11-28T18:37:33.988275+0000","last_clean":"2023-11-28T18:37:33.988275+0000","last_became_active":"2023-11-28T18:37:33.002365+0000","last_became_peered":"2023-11-28T18:37:33.002365+0000","last_unstale":"2023-11-28T18:37:33.988275+0000","last_undegraded":"2023-11-28T18:37:33.988275+0000","last_fullsized":"2023-11-28T18:37:33.988275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:51:32.411691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009918+0000","last_change":"2023-11-28T18:37:32.998052+0000","last_active":"2023-11-28T18:37:34.009918+0000","last_peered":"2023-11-28T18:37:34.009918+0000","last_clean":"2023-11-28T18:37:34.009918+0000","last_became_active":"2023-11-28T18:37:32.997591+0000","last_became_peered":"2023-11-28T18:37:32.997591+0000","last_unstale":"2023-11-28T18:37:34.009918+0000","last_undegraded":"2023-11-28T18:37:34.009918+0000","last_fullsized":"2023-11-28T18:37:34.009918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:21:13.521447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.988134+0000","last_change":"2023-11-28T18:37:33.005398+0000","last_active":"2023-11-28T18:37:33.988134+0000","last_peered":"2023-11-28T18:37:33.988134+0000","last_clean":"2023-11-28T18:37:33.988134+0000","last_became_active":"2023-11-28T18:37:33.004918+0000","last_became_peered":"2023-11-28T18:37:33.004918+0000","last_unstale":"2023-11-28T18:37:33.988134+0000","last_undegraded":"2023-11-28T18:37:33.988134+0000","last_fullsized":"2023-11-28T18:37:33.988134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:06:19.804273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009575+0000","last_change":"2023-11-28T18:37:33.005051+0000","last_active":"2023-11-28T18:37:34.009575+0000","last_peered":"2023-11-28T18:37:34.009575+0000","last_clean":"2023-11-28T18:37:34.009575+0000","last_became_active":"2023-11-28T18:37:33.004756+0000","last_became_peered":"2023-11-28T18:37:33.004756+0000","last_unstale":"2023-11-28T18:37:34.009575+0000","last_undegraded":"2023-11-28T18:37:34.009575+0000","last_fullsized":"2023-11-28T18:37:34.009575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:06:19.804273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.008210+0000","last_change":"2023-11-28T18:37:32.999195+0000","last_active":"2023-11-28T18:37:34.008210+0000","last_peered":"2023-11-28T18:37:34.008210+0000","last_clean":"2023-11-28T18:37:34.008210+0000","last_became_active":"2023-11-28T18:37:32.998930+0000","last_became_peered":"2023-11-28T18:37:32.998930+0000","last_unstale":"2023-11-28T18:37:34.008210+0000","last_undegraded":"2023-11-28T18:37:34.008210+0000","last_fullsized":"2023-11-28T18:37:34.008210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:51:11.286789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010398+0000","last_change":"2023-11-28T18:37:33.009782+0000","last_active":"2023-11-28T18:37:34.010398+0000","last_peered":"2023-11-28T18:37:34.010398+0000","last_clean":"2023-11-28T18:37:34.010398+0000","last_became_active":"2023-11-28T18:37:33.009103+0000","last_became_peered":"2023-11-28T18:37:33.009103+0000","last_unstale":"2023-11-28T18:37:34.010398+0000","last_undegraded":"2023-11-28T18:37:34.010398+0000","last_fullsized":"2023-11-28T18:37:34.010398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:23:39.816847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010427+0000","last_change":"2023-11-28T18:37:33.006943+0000","last_active":"2023-11-28T18:37:34.010427+0000","last_peered":"2023-11-28T18:37:34.010427+0000","last_clean":"2023-11-28T18:37:34.010427+0000","last_became_active":"2023-11-28T18:37:33.006661+0000","last_became_peered":"2023-11-28T18:37:33.006661+0000","last_unstale":"2023-11-28T18:37:34.010427+0000","last_undegraded":"2023-11-28T18:37:34.010427+0000","last_fullsized":"2023-11-28T18:37:34.010427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:25:41.022219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010329+0000","last_change":"2023-11-28T18:37:33.007305+0000","last_active":"2023-11-28T18:37:34.010329+0000","last_peered":"2023-11-28T18:37:34.010329+0000","last_clean":"2023-11-28T18:37:34.010329+0000","last_became_active":"2023-11-28T18:37:33.006773+0000","last_became_peered":"2023-11-28T18:37:33.006773+0000","last_unstale":"2023-11-28T18:37:34.010329+0000","last_undegraded":"2023-11-28T18:37:34.010329+0000","last_fullsized":"2023-11-28T18:37:34.010329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:51:11.286789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.987768+0000","last_change":"2023-11-28T18:37:33.003324+0000","last_active":"2023-11-28T18:37:33.987768+0000","last_peered":"2023-11-28T18:37:33.987768+0000","last_clean":"2023-11-28T18:37:33.987768+0000","last_became_active":"2023-11-28T18:37:33.002968+0000","last_became_peered":"2023-11-28T18:37:33.002968+0000","last_unstale":"2023-11-28T18:37:33.987768+0000","last_undegraded":"2023-11-28T18:37:33.987768+0000","last_fullsized":"2023-11-28T18:37:33.987768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:21:08.389536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009332+0000","last_change":"2023-11-28T18:37:32.993427+0000","last_active":"2023-11-28T18:37:34.009332+0000","last_peered":"2023-11-28T18:37:34.009332+0000","last_clean":"2023-11-28T18:37:34.009332+0000","last_became_active":"2023-11-28T18:37:32.992763+0000","last_became_peered":"2023-11-28T18:37:32.992763+0000","last_unstale":"2023-11-28T18:37:34.009332+0000","last_undegraded":"2023-11-28T18:37:34.009332+0000","last_fullsized":"2023-11-28T18:37:34.009332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:18:10.978623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.008553+0000","last_change":"2023-11-28T18:37:32.985751+0000","last_active":"2023-11-28T18:37:34.008553+0000","last_peered":"2023-11-28T18:37:34.008553+0000","last_clean":"2023-11-28T18:37:34.008553+0000","last_became_active":"2023-11-28T18:37:32.985475+0000","last_became_peered":"2023-11-28T18:37:32.985475+0000","last_unstale":"2023-11-28T18:37:34.008553+0000","last_undegraded":"2023-11-28T18:37:34.008553+0000","last_fullsized":"2023-11-28T18:37:34.008553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:00:26.206815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.982473+0000","last_change":"2023-11-28T18:37:32.990177+0000","last_active":"2023-11-28T18:37:33.982473+0000","last_peered":"2023-11-28T18:37:33.982473+0000","last_clean":"2023-11-28T18:37:33.982473+0000","last_became_active":"2023-11-28T18:37:32.989658+0000","last_became_peered":"2023-11-28T18:37:32.989658+0000","last_unstale":"2023-11-28T18:37:33.982473+0000","last_undegraded":"2023-11-28T18:37:33.982473+0000","last_fullsized":"2023-11-28T18:37:33.982473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:41:58.493214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.987415+0000","last_change":"2023-11-28T18:37:33.006137+0000","last_active":"2023-11-28T18:37:33.987415+0000","last_peered":"2023-11-28T18:37:33.987415+0000","last_clean":"2023-11-28T18:37:33.987415+0000","last_became_active":"2023-11-28T18:37:33.005771+0000","last_became_peered":"2023-11-28T18:37:33.005771+0000","last_unstale":"2023-11-28T18:37:33.987415+0000","last_undegraded":"2023-11-28T18:37:33.987415+0000","last_fullsized":"2023-11-28T18:37:33.987415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:46:52.261405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.988766+0000","last_change":"2023-11-28T18:37:32.988077+0000","last_active":"2023-11-28T18:37:33.988766+0000","last_peered":"2023-11-28T18:37:33.988766+0000","last_clean":"2023-11-28T18:37:33.988766+0000","last_became_active":"2023-11-28T18:37:32.987801+0000","last_became_peered":"2023-11-28T18:37:32.987801+0000","last_unstale":"2023-11-28T18:37:33.988766+0000","last_undegraded":"2023-11-28T18:37:33.988766+0000","last_fullsized":"2023-11-28T18:37:33.988766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:23:39.816847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.008414+0000","last_change":"2023-11-28T18:37:32.992425+0000","last_active":"2023-11-28T18:37:34.008414+0000","last_peered":"2023-11-28T18:37:34.008414+0000","last_clean":"2023-11-28T18:37:34.008414+0000","last_became_active":"2023-11-28T18:37:32.992154+0000","last_became_peered":"2023-11-28T18:37:32.992154+0000","last_unstale":"2023-11-28T18:37:34.008414+0000","last_undegraded":"2023-11-28T18:37:34.008414+0000","last_fullsized":"2023-11-28T18:37:34.008414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:50:17.263359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010302+0000","last_change":"2023-11-28T18:37:32.998538+0000","last_active":"2023-11-28T18:37:34.010302+0000","last_peered":"2023-11-28T18:37:34.010302+0000","last_clean":"2023-11-28T18:37:34.010302+0000","last_became_active":"2023-11-28T18:37:32.998182+0000","last_became_peered":"2023-11-28T18:37:32.998182+0000","last_unstale":"2023-11-28T18:37:34.010302+0000","last_undegraded":"2023-11-28T18:37:34.010302+0000","last_fullsized":"2023-11-28T18:37:34.010302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:31:53.513239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010699+0000","last_change":"2023-11-28T18:37:33.001416+0000","last_active":"2023-11-28T18:37:34.010699+0000","last_peered":"2023-11-28T18:37:34.010699+0000","last_clean":"2023-11-28T18:37:34.010699+0000","last_became_active":"2023-11-28T18:37:33.000906+0000","last_became_peered":"2023-11-28T18:37:33.000906+0000","last_unstale":"2023-11-28T18:37:34.010699+0000","last_undegraded":"2023-11-28T18:37:34.010699+0000","last_fullsized":"2023-11-28T18:37:34.010699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:46:52.261405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.008737+0000","last_change":"2023-11-28T18:37:32.993468+0000","last_active":"2023-11-28T18:37:34.008737+0000","last_peered":"2023-11-28T18:37:34.008737+0000","last_clean":"2023-11-28T18:37:34.008737+0000","last_became_active":"2023-11-28T18:37:32.993143+0000","last_became_peered":"2023-11-28T18:37:32.993143+0000","last_unstale":"2023-11-28T18:37:34.008737+0000","last_undegraded":"2023-11-28T18:37:34.008737+0000","last_fullsized":"2023-11-28T18:37:34.008737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:51:55.517713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.988214+0000","last_change":"2023-11-28T18:37:32.986554+0000","last_active":"2023-11-28T18:37:33.988214+0000","last_peered":"2023-11-28T18:37:33.988214+0000","last_clean":"2023-11-28T18:37:33.988214+0000","last_became_active":"2023-11-28T18:37:32.986211+0000","last_became_peered":"2023-11-28T18:37:32.986211+0000","last_unstale":"2023-11-28T18:37:33.988214+0000","last_undegraded":"2023-11-28T18:37:33.988214+0000","last_fullsized":"2023-11-28T18:37:33.988214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:02:53.545778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.008208+0000","last_change":"2023-11-28T18:37:32.995076+0000","last_active":"2023-11-28T18:37:34.008208+0000","last_peered":"2023-11-28T18:37:34.008208+0000","last_clean":"2023-11-28T18:37:34.008208+0000","last_became_active":"2023-11-28T18:37:32.994774+0000","last_became_peered":"2023-11-28T18:37:32.994774+0000","last_unstale":"2023-11-28T18:37:34.008208+0000","last_undegraded":"2023-11-28T18:37:34.008208+0000","last_fullsized":"2023-11-28T18:37:34.008208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:51:55.517713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.987940+0000","last_change":"2023-11-28T18:37:32.991513+0000","last_active":"2023-11-28T18:37:33.987940+0000","last_peered":"2023-11-28T18:37:33.987940+0000","last_clean":"2023-11-28T18:37:33.987940+0000","last_became_active":"2023-11-28T18:37:32.990880+0000","last_became_peered":"2023-11-28T18:37:32.990880+0000","last_unstale":"2023-11-28T18:37:33.987940+0000","last_undegraded":"2023-11-28T18:37:33.987940+0000","last_fullsized":"2023-11-28T18:37:33.987940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:36:58.955111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009754+0000","last_change":"2023-11-28T18:37:32.995075+0000","last_active":"2023-11-28T18:37:34.009754+0000","last_peered":"2023-11-28T18:37:34.009754+0000","last_clean":"2023-11-28T18:37:34.009754+0000","last_became_active":"2023-11-28T18:37:32.994733+0000","last_became_peered":"2023-11-28T18:37:32.994733+0000","last_unstale":"2023-11-28T18:37:34.009754+0000","last_undegraded":"2023-11-28T18:37:34.009754+0000","last_fullsized":"2023-11-28T18:37:34.009754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:51:32.411691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010515+0000","last_change":"2023-11-28T18:37:33.000138+0000","last_active":"2023-11-28T18:37:34.010515+0000","last_peered":"2023-11-28T18:37:34.010515+0000","last_clean":"2023-11-28T18:37:34.010515+0000","last_became_active":"2023-11-28T18:37:32.999035+0000","last_became_peered":"2023-11-28T18:37:32.999035+0000","last_unstale":"2023-11-28T18:37:34.010515+0000","last_undegraded":"2023-11-28T18:37:34.010515+0000","last_fullsized":"2023-11-28T18:37:34.010515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:41:58.493214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.982735+0000","last_change":"2023-11-28T18:37:32.987199+0000","last_active":"2023-11-28T18:37:33.982735+0000","last_peered":"2023-11-28T18:37:33.982735+0000","last_clean":"2023-11-28T18:37:33.982735+0000","last_became_active":"2023-11-28T18:37:32.986904+0000","last_became_peered":"2023-11-28T18:37:32.986904+0000","last_unstale":"2023-11-28T18:37:33.982735+0000","last_undegraded":"2023-11-28T18:37:33.982735+0000","last_fullsized":"2023-11-28T18:37:33.982735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:46:52.261405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009632+0000","last_change":"2023-11-28T18:37:32.993541+0000","last_active":"2023-11-28T18:37:34.009632+0000","last_peered":"2023-11-28T18:37:34.009632+0000","last_clean":"2023-11-28T18:37:34.009632+0000","last_became_active":"2023-11-28T18:37:32.993323+0000","last_became_peered":"2023-11-28T18:37:32.993323+0000","last_unstale":"2023-11-28T18:37:34.009632+0000","last_undegraded":"2023-11-28T18:37:34.009632+0000","last_fullsized":"2023-11-28T18:37:34.009632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:06:19.804273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.008872+0000","last_change":"2023-11-28T18:37:32.987939+0000","last_active":"2023-11-28T18:37:34.008872+0000","last_peered":"2023-11-28T18:37:34.008872+0000","last_clean":"2023-11-28T18:37:34.008872+0000","last_became_active":"2023-11-28T18:37:32.987277+0000","last_became_peered":"2023-11-28T18:37:32.987277+0000","last_unstale":"2023-11-28T18:37:34.008872+0000","last_undegraded":"2023-11-28T18:37:34.008872+0000","last_fullsized":"2023-11-28T18:37:34.008872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:25:41.022219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.988304+0000","last_change":"2023-11-28T18:37:33.008318+0000","last_active":"2023-11-28T18:37:33.988304+0000","last_peered":"2023-11-28T18:37:33.988304+0000","last_clean":"2023-11-28T18:37:33.988304+0000","last_became_active":"2023-11-28T18:37:33.007984+0000","last_became_peered":"2023-11-28T18:37:33.007984+0000","last_unstale":"2023-11-28T18:37:33.988304+0000","last_undegraded":"2023-11-28T18:37:33.988304+0000","last_fullsized":"2023-11-28T18:37:33.988304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:21:13.521447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.008387+0000","last_change":"2023-11-28T18:37:32.999800+0000","last_active":"2023-11-28T18:37:34.008387+0000","last_peered":"2023-11-28T18:37:34.008387+0000","last_clean":"2023-11-28T18:37:34.008387+0000","last_became_active":"2023-11-28T18:37:32.999536+0000","last_became_peered":"2023-11-28T18:37:32.999536+0000","last_unstale":"2023-11-28T18:37:34.008387+0000","last_undegraded":"2023-11-28T18:37:34.008387+0000","last_fullsized":"2023-11-28T18:37:34.008387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:07:42.147988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009871+0000","last_change":"2023-11-28T18:37:32.998966+0000","last_active":"2023-11-28T18:37:34.009871+0000","last_peered":"2023-11-28T18:37:34.009871+0000","last_clean":"2023-11-28T18:37:34.009871+0000","last_became_active":"2023-11-28T18:37:32.993970+0000","last_became_peered":"2023-11-28T18:37:32.993970+0000","last_unstale":"2023-11-28T18:37:34.009871+0000","last_undegraded":"2023-11-28T18:37:34.009871+0000","last_fullsized":"2023-11-28T18:37:34.009871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:31:28.921268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.987253+0000","last_change":"2023-11-28T18:37:32.990285+0000","last_active":"2023-11-28T18:37:33.987253+0000","last_peered":"2023-11-28T18:37:33.987253+0000","last_clean":"2023-11-28T18:37:33.987253+0000","last_became_active":"2023-11-28T18:37:32.989187+0000","last_became_peered":"2023-11-28T18:37:32.989187+0000","last_unstale":"2023-11-28T18:37:33.987253+0000","last_undegraded":"2023-11-28T18:37:33.987253+0000","last_fullsized":"2023-11-28T18:37:33.987253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:18:33.551197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009443+0000","last_change":"2023-11-28T18:37:32.479159+0000","last_active":"2023-11-28T18:37:34.009443+0000","last_peered":"2023-11-28T18:37:34.009443+0000","last_clean":"2023-11-28T18:37:34.009443+0000","last_became_active":"2023-11-28T18:37:32.478817+0000","last_became_peered":"2023-11-28T18:37:32.478817+0000","last_unstale":"2023-11-28T18:37:34.009443+0000","last_undegraded":"2023-11-28T18:37:34.009443+0000","last_fullsized":"2023-11-28T18:37:34.009443+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:22:48.248148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.008990+0000","last_change":"2023-11-28T18:37:32.991264+0000","last_active":"2023-11-28T18:37:34.008990+0000","last_peered":"2023-11-28T18:37:34.008990+0000","last_clean":"2023-11-28T18:37:34.008990+0000","last_became_active":"2023-11-28T18:37:32.990660+0000","last_became_peered":"2023-11-28T18:37:32.990660+0000","last_unstale":"2023-11-28T18:37:34.008990+0000","last_undegraded":"2023-11-28T18:37:34.008990+0000","last_fullsized":"2023-11-28T18:37:34.008990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:18:10.978623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010626+0000","last_change":"2023-11-28T18:37:32.468052+0000","last_active":"2023-11-28T18:37:34.010626+0000","last_peered":"2023-11-28T18:37:34.010626+0000","last_clean":"2023-11-28T18:37:34.010626+0000","last_became_active":"2023-11-28T18:37:32.467747+0000","last_became_peered":"2023-11-28T18:37:32.467747+0000","last_unstale":"2023-11-28T18:37:34.010626+0000","last_undegraded":"2023-11-28T18:37:34.010626+0000","last_fullsized":"2023-11-28T18:37:34.010626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:56:54.321744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.008647+0000","last_change":"2023-11-28T18:37:32.465213+0000","last_active":"2023-11-28T18:37:34.008647+0000","last_peered":"2023-11-28T18:37:34.008647+0000","last_clean":"2023-11-28T18:37:34.008647+0000","last_became_active":"2023-11-28T18:37:32.464911+0000","last_became_peered":"2023-11-28T18:37:32.464911+0000","last_unstale":"2023-11-28T18:37:34.008647+0000","last_undegraded":"2023-11-28T18:37:34.008647+0000","last_fullsized":"2023-11-28T18:37:34.008647+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:16:52.138851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.008326+0000","last_change":"2023-11-28T18:37:32.988182+0000","last_active":"2023-11-28T18:37:34.008326+0000","last_peered":"2023-11-28T18:37:34.008326+0000","last_clean":"2023-11-28T18:37:34.008326+0000","last_became_active":"2023-11-28T18:37:32.987804+0000","last_became_peered":"2023-11-28T18:37:32.987804+0000","last_unstale":"2023-11-28T18:37:34.008326+0000","last_undegraded":"2023-11-28T18:37:34.008326+0000","last_fullsized":"2023-11-28T18:37:34.008326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:25:41.022219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.987941+0000","last_change":"2023-11-28T18:37:32.467329+0000","last_active":"2023-11-28T18:37:33.987941+0000","last_peered":"2023-11-28T18:37:33.987941+0000","last_clean":"2023-11-28T18:37:33.987941+0000","last_became_active":"2023-11-28T18:37:32.467064+0000","last_became_peered":"2023-11-28T18:37:32.467064+0000","last_unstale":"2023-11-28T18:37:33.987941+0000","last_undegraded":"2023-11-28T18:37:33.987941+0000","last_fullsized":"2023-11-28T18:37:33.987941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:56:54.321744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.982413+0000","last_change":"2023-11-28T18:37:32.989944+0000","last_active":"2023-11-28T18:37:33.982413+0000","last_peered":"2023-11-28T18:37:33.982413+0000","last_clean":"2023-11-28T18:37:33.982413+0000","last_became_active":"2023-11-28T18:37:32.989285+0000","last_became_peered":"2023-11-28T18:37:32.989285+0000","last_unstale":"2023-11-28T18:37:33.982413+0000","last_undegraded":"2023-11-28T18:37:33.982413+0000","last_fullsized":"2023-11-28T18:37:33.982413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:51:11.286789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010624+0000","last_change":"2023-11-28T18:37:32.471802+0000","last_active":"2023-11-28T18:37:34.010624+0000","last_peered":"2023-11-28T18:37:34.010624+0000","last_clean":"2023-11-28T18:37:34.010624+0000","last_became_active":"2023-11-28T18:37:32.471420+0000","last_became_peered":"2023-11-28T18:37:32.471420+0000","last_unstale":"2023-11-28T18:37:34.010624+0000","last_undegraded":"2023-11-28T18:37:34.010624+0000","last_fullsized":"2023-11-28T18:37:34.010624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:22:48.248148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.988629+0000","last_change":"2023-11-28T18:37:33.002175+0000","last_active":"2023-11-28T18:37:33.988629+0000","last_peered":"2023-11-28T18:37:33.988629+0000","last_clean":"2023-11-28T18:37:33.988629+0000","last_became_active":"2023-11-28T18:37:33.001279+0000","last_became_peered":"2023-11-28T18:37:33.001279+0000","last_unstale":"2023-11-28T18:37:33.988629+0000","last_undegraded":"2023-11-28T18:37:33.988629+0000","last_fullsized":"2023-11-28T18:37:33.988629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:38:59.556086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.988637+0000","last_change":"2023-11-28T18:37:32.466165+0000","last_active":"2023-11-28T18:37:33.988637+0000","last_peered":"2023-11-28T18:37:33.988637+0000","last_clean":"2023-11-28T18:37:33.988637+0000","last_became_active":"2023-11-28T18:37:32.465812+0000","last_became_peered":"2023-11-28T18:37:32.465812+0000","last_unstale":"2023-11-28T18:37:33.988637+0000","last_undegraded":"2023-11-28T18:37:33.988637+0000","last_fullsized":"2023-11-28T18:37:33.988637+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:51:10.284272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009093+0000","last_change":"2023-11-28T18:37:32.988109+0000","last_active":"2023-11-28T18:37:34.009093+0000","last_peered":"2023-11-28T18:37:34.009093+0000","last_clean":"2023-11-28T18:37:34.009093+0000","last_became_active":"2023-11-28T18:37:32.987621+0000","last_became_peered":"2023-11-28T18:37:32.987621+0000","last_unstale":"2023-11-28T18:37:34.009093+0000","last_undegraded":"2023-11-28T18:37:34.009093+0000","last_fullsized":"2023-11-28T18:37:34.009093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:36:58.955111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.982698+0000","last_change":"2023-11-28T18:37:32.459182+0000","last_active":"2023-11-28T18:37:33.982698+0000","last_peered":"2023-11-28T18:37:33.982698+0000","last_clean":"2023-11-28T18:37:33.982698+0000","last_became_active":"2023-11-28T18:37:32.458898+0000","last_became_peered":"2023-11-28T18:37:32.458898+0000","last_unstale":"2023-11-28T18:37:33.982698+0000","last_undegraded":"2023-11-28T18:37:33.982698+0000","last_fullsized":"2023-11-28T18:37:33.982698+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:31:27.918750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.987863+0000","last_change":"2023-11-28T18:37:32.992373+0000","last_active":"2023-11-28T18:37:33.987863+0000","last_peered":"2023-11-28T18:37:33.987863+0000","last_clean":"2023-11-28T18:37:33.987863+0000","last_became_active":"2023-11-28T18:37:32.992176+0000","last_became_peered":"2023-11-28T18:37:32.992176+0000","last_unstale":"2023-11-28T18:37:33.987863+0000","last_undegraded":"2023-11-28T18:37:33.987863+0000","last_fullsized":"2023-11-28T18:37:33.987863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:07:42.147988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010211+0000","last_change":"2023-11-28T18:37:32.471764+0000","last_active":"2023-11-28T18:37:34.010211+0000","last_peered":"2023-11-28T18:37:34.010211+0000","last_clean":"2023-11-28T18:37:34.010211+0000","last_became_active":"2023-11-28T18:37:32.471432+0000","last_became_peered":"2023-11-28T18:37:32.471432+0000","last_unstale":"2023-11-28T18:37:34.010211+0000","last_undegraded":"2023-11-28T18:37:34.010211+0000","last_fullsized":"2023-11-28T18:37:34.010211+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:50:16.260842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009845+0000","last_change":"2023-11-28T18:37:32.996529+0000","last_active":"2023-11-28T18:37:34.009845+0000","last_peered":"2023-11-28T18:37:34.009845+0000","last_clean":"2023-11-28T18:37:34.009845+0000","last_became_active":"2023-11-28T18:37:32.996242+0000","last_became_peered":"2023-11-28T18:37:32.996242+0000","last_unstale":"2023-11-28T18:37:34.009845+0000","last_undegraded":"2023-11-28T18:37:34.009845+0000","last_fullsized":"2023-11-28T18:37:34.009845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:51:32.411691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009074+0000","last_change":"2023-11-28T18:37:32.473745+0000","last_active":"2023-11-28T18:37:34.009074+0000","last_peered":"2023-11-28T18:37:34.009074+0000","last_clean":"2023-11-28T18:37:34.009074+0000","last_became_active":"2023-11-28T18:37:32.473429+0000","last_became_peered":"2023-11-28T18:37:32.473429+0000","last_unstale":"2023-11-28T18:37:34.009074+0000","last_undegraded":"2023-11-28T18:37:34.009074+0000","last_fullsized":"2023-11-28T18:37:34.009074+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:16:52.138851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.008617+0000","last_change":"2023-11-28T18:37:32.987646+0000","last_active":"2023-11-28T18:37:34.008617+0000","last_peered":"2023-11-28T18:37:34.008617+0000","last_clean":"2023-11-28T18:37:34.008617+0000","last_became_active":"2023-11-28T18:37:32.987313+0000","last_became_peered":"2023-11-28T18:37:32.987313+0000","last_unstale":"2023-11-28T18:37:34.008617+0000","last_undegraded":"2023-11-28T18:37:34.008617+0000","last_fullsized":"2023-11-28T18:37:34.008617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:31:28.921268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.988317+0000","last_change":"2023-11-28T18:37:32.472535+0000","last_active":"2023-11-28T18:37:33.988317+0000","last_peered":"2023-11-28T18:37:33.988317+0000","last_clean":"2023-11-28T18:37:33.988317+0000","last_became_active":"2023-11-28T18:37:32.470189+0000","last_became_peered":"2023-11-28T18:37:32.470189+0000","last_unstale":"2023-11-28T18:37:33.988317+0000","last_undegraded":"2023-11-28T18:37:33.988317+0000","last_fullsized":"2023-11-28T18:37:33.988317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:25:40.019702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010041+0000","last_change":"2023-11-28T18:37:33.007113+0000","last_active":"2023-11-28T18:37:34.010041+0000","last_peered":"2023-11-28T18:37:34.010041+0000","last_clean":"2023-11-28T18:37:34.010041+0000","last_became_active":"2023-11-28T18:37:33.006542+0000","last_became_peered":"2023-11-28T18:37:33.006542+0000","last_unstale":"2023-11-28T18:37:34.010041+0000","last_undegraded":"2023-11-28T18:37:34.010041+0000","last_fullsized":"2023-11-28T18:37:34.010041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:43:32.482112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010033+0000","last_change":"2023-11-28T18:37:32.468727+0000","last_active":"2023-11-28T18:37:34.010033+0000","last_peered":"2023-11-28T18:37:34.010033+0000","last_clean":"2023-11-28T18:37:34.010033+0000","last_became_active":"2023-11-28T18:37:32.467363+0000","last_became_peered":"2023-11-28T18:37:32.467363+0000","last_unstale":"2023-11-28T18:37:34.010033+0000","last_undegraded":"2023-11-28T18:37:34.010033+0000","last_fullsized":"2023-11-28T18:37:34.010033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:16:52.138851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010291+0000","last_change":"2023-11-28T18:37:32.994176+0000","last_active":"2023-11-28T18:37:34.010291+0000","last_peered":"2023-11-28T18:37:34.010291+0000","last_clean":"2023-11-28T18:37:34.010291+0000","last_became_active":"2023-11-28T18:37:32.993577+0000","last_became_peered":"2023-11-28T18:37:32.993577+0000","last_unstale":"2023-11-28T18:37:34.010291+0000","last_undegraded":"2023-11-28T18:37:34.010291+0000","last_fullsized":"2023-11-28T18:37:34.010291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:51:55.517713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.007852+0000","last_change":"2023-11-28T18:37:32.466190+0000","last_active":"2023-11-28T18:37:34.007852+0000","last_peered":"2023-11-28T18:37:34.007852+0000","last_clean":"2023-11-28T18:37:34.007852+0000","last_became_active":"2023-11-28T18:37:32.465855+0000","last_became_peered":"2023-11-28T18:37:32.465855+0000","last_unstale":"2023-11-28T18:37:34.007852+0000","last_undegraded":"2023-11-28T18:37:34.007852+0000","last_fullsized":"2023-11-28T18:37:34.007852+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:18:32.548680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009694+0000","last_change":"2023-11-28T18:37:33.011619+0000","last_active":"2023-11-28T18:37:34.009694+0000","last_peered":"2023-11-28T18:37:34.009694+0000","last_clean":"2023-11-28T18:37:34.009694+0000","last_became_active":"2023-11-28T18:37:33.011164+0000","last_became_peered":"2023-11-28T18:37:33.011164+0000","last_unstale":"2023-11-28T18:37:34.009694+0000","last_undegraded":"2023-11-28T18:37:34.009694+0000","last_fullsized":"2023-11-28T18:37:34.009694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:02:53.545778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.987604+0000","last_change":"2023-11-28T18:37:32.472353+0000","last_active":"2023-11-28T18:37:33.987604+0000","last_peered":"2023-11-28T18:37:33.987604+0000","last_clean":"2023-11-28T18:37:33.987604+0000","last_became_active":"2023-11-28T18:37:32.472028+0000","last_became_peered":"2023-11-28T18:37:32.472028+0000","last_unstale":"2023-11-28T18:37:33.987604+0000","last_undegraded":"2023-11-28T18:37:33.987604+0000","last_fullsized":"2023-11-28T18:37:33.987604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:06:15.023841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010260+0000","last_change":"2023-11-28T18:37:33.006869+0000","last_active":"2023-11-28T18:37:34.010260+0000","last_peered":"2023-11-28T18:37:34.010260+0000","last_clean":"2023-11-28T18:37:34.010260+0000","last_became_active":"2023-11-28T18:37:33.006496+0000","last_became_peered":"2023-11-28T18:37:33.006496+0000","last_unstale":"2023-11-28T18:37:34.010260+0000","last_undegraded":"2023-11-28T18:37:34.010260+0000","last_fullsized":"2023-11-28T18:37:34.010260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:38:59.556086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.008466+0000","last_change":"2023-11-28T18:37:32.461121+0000","last_active":"2023-11-28T18:37:34.008466+0000","last_peered":"2023-11-28T18:37:34.008466+0000","last_clean":"2023-11-28T18:37:34.008466+0000","last_became_active":"2023-11-28T18:37:32.460769+0000","last_became_peered":"2023-11-28T18:37:32.460769+0000","last_unstale":"2023-11-28T18:37:34.008466+0000","last_undegraded":"2023-11-28T18:37:34.008466+0000","last_fullsized":"2023-11-28T18:37:34.008466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:18:56.938399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010480+0000","last_change":"2023-11-28T18:37:33.007274+0000","last_active":"2023-11-28T18:37:34.010480+0000","last_peered":"2023-11-28T18:37:34.010480+0000","last_clean":"2023-11-28T18:37:34.010480+0000","last_became_active":"2023-11-28T18:37:33.007033+0000","last_became_peered":"2023-11-28T18:37:33.007033+0000","last_unstale":"2023-11-28T18:37:34.010480+0000","last_undegraded":"2023-11-28T18:37:34.010480+0000","last_fullsized":"2023-11-28T18:37:34.010480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:31:52.252862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.982789+0000","last_change":"2023-11-28T18:37:32.466332+0000","last_active":"2023-11-28T18:37:33.982789+0000","last_peered":"2023-11-28T18:37:33.982789+0000","last_clean":"2023-11-28T18:37:33.982789+0000","last_became_active":"2023-11-28T18:37:32.464365+0000","last_became_peered":"2023-11-28T18:37:32.464365+0000","last_unstale":"2023-11-28T18:37:33.982789+0000","last_undegraded":"2023-11-28T18:37:33.982789+0000","last_fullsized":"2023-11-28T18:37:33.982789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:51:54.515196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.988455+0000","last_change":"2023-11-28T18:37:33.000939+0000","last_active":"2023-11-28T18:37:33.988455+0000","last_peered":"2023-11-28T18:37:33.988455+0000","last_clean":"2023-11-28T18:37:33.988455+0000","last_became_active":"2023-11-28T18:37:32.994852+0000","last_became_peered":"2023-11-28T18:37:32.994852+0000","last_unstale":"2023-11-28T18:37:33.988455+0000","last_undegraded":"2023-11-28T18:37:33.988455+0000","last_fullsized":"2023-11-28T18:37:33.988455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:43:32.482112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.008261+0000","last_change":"2023-11-28T18:37:32.466158+0000","last_active":"2023-11-28T18:37:34.008261+0000","last_peered":"2023-11-28T18:37:34.008261+0000","last_clean":"2023-11-28T18:37:34.008261+0000","last_became_active":"2023-11-28T18:37:32.465844+0000","last_became_peered":"2023-11-28T18:37:32.465844+0000","last_unstale":"2023-11-28T18:37:34.008261+0000","last_undegraded":"2023-11-28T18:37:34.008261+0000","last_fullsized":"2023-11-28T18:37:34.008261+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:21:07.387019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009932+0000","last_change":"2023-11-28T18:37:33.009557+0000","last_active":"2023-11-28T18:37:34.009932+0000","last_peered":"2023-11-28T18:37:34.009932+0000","last_clean":"2023-11-28T18:37:34.009932+0000","last_became_active":"2023-11-28T18:37:33.008838+0000","last_became_peered":"2023-11-28T18:37:33.008838+0000","last_unstale":"2023-11-28T18:37:34.009932+0000","last_undegraded":"2023-11-28T18:37:34.009932+0000","last_fullsized":"2023-11-28T18:37:34.009932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:20:33.664753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T18:37:32.991019+0000","last_change":"2023-11-28T18:37:22.369132+0000","last_active":"2023-11-28T18:37:32.991019+0000","last_peered":"2023-11-28T18:37:32.991019+0000","last_clean":"2023-11-28T18:37:32.991019+0000","last_became_active":"2023-11-28T18:37:22.368142+0000","last_became_peered":"2023-11-28T18:37:22.368142+0000","last_unstale":"2023-11-28T18:37:32.991019+0000","last_undegraded":"2023-11-28T18:37:32.991019+0000","last_fullsized":"2023-11-28T18:37:32.991019+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:21.313053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:21.313053+0000","last_clean_scrub_stamp":"2023-11-28T18:37:21.313053+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:55:01.432028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.988127+0000","last_change":"2023-11-28T18:37:32.466471+0000","last_active":"2023-11-28T18:37:33.988127+0000","last_peered":"2023-11-28T18:37:33.988127+0000","last_clean":"2023-11-28T18:37:33.988127+0000","last_became_active":"2023-11-28T18:37:32.466153+0000","last_became_peered":"2023-11-28T18:37:32.466153+0000","last_unstale":"2023-11-28T18:37:33.988127+0000","last_undegraded":"2023-11-28T18:37:33.988127+0000","last_fullsized":"2023-11-28T18:37:33.988127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:31:52.780773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009403+0000","last_change":"2023-11-28T18:37:32.999109+0000","last_active":"2023-11-28T18:37:34.009403+0000","last_peered":"2023-11-28T18:37:34.009403+0000","last_clean":"2023-11-28T18:37:34.009403+0000","last_became_active":"2023-11-28T18:37:32.998842+0000","last_became_peered":"2023-11-28T18:37:32.998842+0000","last_unstale":"2023-11-28T18:37:34.009403+0000","last_undegraded":"2023-11-28T18:37:34.009403+0000","last_fullsized":"2023-11-28T18:37:34.009403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:36:58.955111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009483+0000","last_change":"2023-11-28T18:37:32.478867+0000","last_active":"2023-11-28T18:37:34.009483+0000","last_peered":"2023-11-28T18:37:34.009483+0000","last_clean":"2023-11-28T18:37:34.009483+0000","last_became_active":"2023-11-28T18:37:32.478483+0000","last_became_peered":"2023-11-28T18:37:32.478483+0000","last_unstale":"2023-11-28T18:37:34.009483+0000","last_undegraded":"2023-11-28T18:37:34.009483+0000","last_fullsized":"2023-11-28T18:37:34.009483+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:21:07.387019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.008034+0000","last_change":"2023-11-28T18:37:32.984449+0000","last_active":"2023-11-28T18:37:34.008034+0000","last_peered":"2023-11-28T18:37:34.008034+0000","last_clean":"2023-11-28T18:37:34.008034+0000","last_became_active":"2023-11-28T18:37:32.984134+0000","last_became_peered":"2023-11-28T18:37:32.984134+0000","last_unstale":"2023-11-28T18:37:34.008034+0000","last_undegraded":"2023-11-28T18:37:34.008034+0000","last_fullsized":"2023-11-28T18:37:34.008034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:22:49.250665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.008158+0000","last_change":"2023-11-28T18:37:32.455919+0000","last_active":"2023-11-28T18:37:34.008158+0000","last_peered":"2023-11-28T18:37:34.008158+0000","last_clean":"2023-11-28T18:37:34.008158+0000","last_became_active":"2023-11-28T18:37:32.455643+0000","last_became_peered":"2023-11-28T18:37:32.455643+0000","last_unstale":"2023-11-28T18:37:34.008158+0000","last_undegraded":"2023-11-28T18:37:34.008158+0000","last_fullsized":"2023-11-28T18:37:34.008158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:47:06.994491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.982436+0000","last_change":"2023-11-28T18:37:32.985903+0000","last_active":"2023-11-28T18:37:33.982436+0000","last_peered":"2023-11-28T18:37:33.982436+0000","last_clean":"2023-11-28T18:37:33.982436+0000","last_became_active":"2023-11-28T18:37:32.985566+0000","last_became_peered":"2023-11-28T18:37:32.985566+0000","last_unstale":"2023-11-28T18:37:33.982436+0000","last_undegraded":"2023-11-28T18:37:33.982436+0000","last_fullsized":"2023-11-28T18:37:33.982436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:25:41.022219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.988411+0000","last_change":"2023-11-28T18:37:32.470133+0000","last_active":"2023-11-28T18:37:33.988411+0000","last_peered":"2023-11-28T18:37:33.988411+0000","last_clean":"2023-11-28T18:37:33.988411+0000","last_became_active":"2023-11-28T18:37:32.468215+0000","last_became_peered":"2023-11-28T18:37:32.468215+0000","last_unstale":"2023-11-28T18:37:33.988411+0000","last_undegraded":"2023-11-28T18:37:33.988411+0000","last_fullsized":"2023-11-28T18:37:33.988411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:41:57.490696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.987855+0000","last_change":"2023-11-28T18:37:32.983380+0000","last_active":"2023-11-28T18:37:33.987855+0000","last_peered":"2023-11-28T18:37:33.987855+0000","last_clean":"2023-11-28T18:37:33.987855+0000","last_became_active":"2023-11-28T18:37:32.982867+0000","last_became_peered":"2023-11-28T18:37:32.982867+0000","last_unstale":"2023-11-28T18:37:33.987855+0000","last_undegraded":"2023-11-28T18:37:33.987855+0000","last_fullsized":"2023-11-28T18:37:33.987855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:18:57.940916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.982747+0000","last_change":"2023-11-28T18:37:32.471305+0000","last_active":"2023-11-28T18:37:33.982747+0000","last_peered":"2023-11-28T18:37:33.982747+0000","last_clean":"2023-11-28T18:37:33.982747+0000","last_became_active":"2023-11-28T18:37:32.470236+0000","last_became_peered":"2023-11-28T18:37:32.470236+0000","last_unstale":"2023-11-28T18:37:33.982747+0000","last_undegraded":"2023-11-28T18:37:33.982747+0000","last_fullsized":"2023-11-28T18:37:33.982747+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:00:25.204297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.988693+0000","last_change":"2023-11-28T18:37:32.999867+0000","last_active":"2023-11-28T18:37:33.988693+0000","last_peered":"2023-11-28T18:37:33.988693+0000","last_clean":"2023-11-28T18:37:33.988693+0000","last_became_active":"2023-11-28T18:37:32.994734+0000","last_became_peered":"2023-11-28T18:37:32.994734+0000","last_unstale":"2023-11-28T18:37:33.988693+0000","last_undegraded":"2023-11-28T18:37:33.988693+0000","last_fullsized":"2023-11-28T18:37:33.988693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:31:53.513239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010425+0000","last_change":"2023-11-28T18:37:32.481867+0000","last_active":"2023-11-28T18:37:34.010425+0000","last_peered":"2023-11-28T18:37:34.010425+0000","last_clean":"2023-11-28T18:37:34.010425+0000","last_became_active":"2023-11-28T18:37:32.481470+0000","last_became_peered":"2023-11-28T18:37:32.481470+0000","last_unstale":"2023-11-28T18:37:34.010425+0000","last_undegraded":"2023-11-28T18:37:34.010425+0000","last_fullsized":"2023-11-28T18:37:34.010425+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:41:57.490696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.982689+0000","last_change":"2023-11-28T18:37:32.988151+0000","last_active":"2023-11-28T18:37:33.982689+0000","last_peered":"2023-11-28T18:37:33.982689+0000","last_clean":"2023-11-28T18:37:33.982689+0000","last_became_active":"2023-11-28T18:37:32.987895+0000","last_became_peered":"2023-11-28T18:37:32.987895+0000","last_unstale":"2023-11-28T18:37:33.982689+0000","last_undegraded":"2023-11-28T18:37:33.982689+0000","last_fullsized":"2023-11-28T18:37:33.982689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:18:10.978623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:35.265746+0000","last_change":"2023-11-28T18:37:32.464191+0000","last_active":"2023-11-28T18:37:35.265746+0000","last_peered":"2023-11-28T18:37:35.265746+0000","last_clean":"2023-11-28T18:37:35.265746+0000","last_became_active":"2023-11-28T18:37:32.463835+0000","last_became_peered":"2023-11-28T18:37:32.463835+0000","last_unstale":"2023-11-28T18:37:35.265746+0000","last_undegraded":"2023-11-28T18:37:35.265746+0000","last_fullsized":"2023-11-28T18:37:35.265746+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:22:48.248148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009821+0000","last_change":"2023-11-28T18:37:32.995912+0000","last_active":"2023-11-28T18:37:34.009821+0000","last_peered":"2023-11-28T18:37:34.009821+0000","last_clean":"2023-11-28T18:37:34.009821+0000","last_became_active":"2023-11-28T18:37:32.995582+0000","last_became_peered":"2023-11-28T18:37:32.995582+0000","last_unstale":"2023-11-28T18:37:34.009821+0000","last_undegraded":"2023-11-28T18:37:34.009821+0000","last_fullsized":"2023-11-28T18:37:34.009821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:21:13.521447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010735+0000","last_change":"2023-11-28T18:37:32.474120+0000","last_active":"2023-11-28T18:37:34.010735+0000","last_peered":"2023-11-28T18:37:34.010735+0000","last_clean":"2023-11-28T18:37:34.010735+0000","last_became_active":"2023-11-28T18:37:32.473702+0000","last_became_peered":"2023-11-28T18:37:32.473702+0000","last_unstale":"2023-11-28T18:37:34.010735+0000","last_undegraded":"2023-11-28T18:37:34.010735+0000","last_fullsized":"2023-11-28T18:37:34.010735+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:00:25.204297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009041+0000","last_change":"2023-11-28T18:37:32.987116+0000","last_active":"2023-11-28T18:37:34.009041+0000","last_peered":"2023-11-28T18:37:34.009041+0000","last_clean":"2023-11-28T18:37:34.009041+0000","last_became_active":"2023-11-28T18:37:32.986562+0000","last_became_peered":"2023-11-28T18:37:32.986562+0000","last_unstale":"2023-11-28T18:37:34.009041+0000","last_undegraded":"2023-11-28T18:37:34.009041+0000","last_fullsized":"2023-11-28T18:37:34.009041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:46:52.261405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009479+0000","last_change":"2023-11-28T18:37:32.478702+0000","last_active":"2023-11-28T18:37:34.009479+0000","last_peered":"2023-11-28T18:37:34.009479+0000","last_clean":"2023-11-28T18:37:34.009479+0000","last_became_active":"2023-11-28T18:37:32.478119+0000","last_became_peered":"2023-11-28T18:37:32.478119+0000","last_unstale":"2023-11-28T18:37:34.009479+0000","last_undegraded":"2023-11-28T18:37:34.009479+0000","last_fullsized":"2023-11-28T18:37:34.009479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:47:06.994491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.987532+0000","last_change":"2023-11-28T18:37:32.989092+0000","last_active":"2023-11-28T18:37:33.987532+0000","last_peered":"2023-11-28T18:37:33.987532+0000","last_clean":"2023-11-28T18:37:33.987532+0000","last_became_active":"2023-11-28T18:37:32.988635+0000","last_became_peered":"2023-11-28T18:37:32.988635+0000","last_unstale":"2023-11-28T18:37:33.987532+0000","last_undegraded":"2023-11-28T18:37:33.987532+0000","last_fullsized":"2023-11-28T18:37:33.987532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:47:07.997008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.982526+0000","last_change":"2023-11-28T18:37:32.466953+0000","last_active":"2023-11-28T18:37:33.982526+0000","last_peered":"2023-11-28T18:37:33.982526+0000","last_clean":"2023-11-28T18:37:33.982526+0000","last_became_active":"2023-11-28T18:37:32.466697+0000","last_became_peered":"2023-11-28T18:37:32.466697+0000","last_unstale":"2023-11-28T18:37:33.982526+0000","last_undegraded":"2023-11-28T18:37:33.982526+0000","last_fullsized":"2023-11-28T18:37:33.982526+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:50:16.260842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.008440+0000","last_change":"2023-11-28T18:37:32.990343+0000","last_active":"2023-11-28T18:37:34.008440+0000","last_peered":"2023-11-28T18:37:34.008440+0000","last_clean":"2023-11-28T18:37:34.008440+0000","last_became_active":"2023-11-28T18:37:32.990039+0000","last_became_peered":"2023-11-28T18:37:32.990039+0000","last_unstale":"2023-11-28T18:37:34.008440+0000","last_undegraded":"2023-11-28T18:37:34.008440+0000","last_fullsized":"2023-11-28T18:37:34.008440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:41:58.493214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.982690+0000","last_change":"2023-11-28T18:37:32.469083+0000","last_active":"2023-11-28T18:37:33.982690+0000","last_peered":"2023-11-28T18:37:33.982690+0000","last_clean":"2023-11-28T18:37:33.982690+0000","last_became_active":"2023-11-28T18:37:32.468565+0000","last_became_peered":"2023-11-28T18:37:32.468565+0000","last_unstale":"2023-11-28T18:37:33.982690+0000","last_undegraded":"2023-11-28T18:37:33.982690+0000","last_fullsized":"2023-11-28T18:37:33.982690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:16:52.138851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009395+0000","last_change":"2023-11-28T18:37:32.984344+0000","last_active":"2023-11-28T18:37:34.009395+0000","last_peered":"2023-11-28T18:37:34.009395+0000","last_clean":"2023-11-28T18:37:34.009395+0000","last_became_active":"2023-11-28T18:37:32.983741+0000","last_became_peered":"2023-11-28T18:37:32.983741+0000","last_unstale":"2023-11-28T18:37:34.009395+0000","last_undegraded":"2023-11-28T18:37:34.009395+0000","last_fullsized":"2023-11-28T18:37:34.009395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:46:52.261405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010023+0000","last_change":"2023-11-28T18:37:32.479654+0000","last_active":"2023-11-28T18:37:34.010023+0000","last_peered":"2023-11-28T18:37:34.010023+0000","last_clean":"2023-11-28T18:37:34.010023+0000","last_became_active":"2023-11-28T18:37:32.479338+0000","last_became_peered":"2023-11-28T18:37:32.479338+0000","last_unstale":"2023-11-28T18:37:34.010023+0000","last_undegraded":"2023-11-28T18:37:34.010023+0000","last_fullsized":"2023-11-28T18:37:34.010023+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:46:51.258888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.010634+0000","last_change":"2023-11-28T18:37:33.001157+0000","last_active":"2023-11-28T18:37:34.010634+0000","last_peered":"2023-11-28T18:37:34.010634+0000","last_clean":"2023-11-28T18:37:34.010634+0000","last_became_active":"2023-11-28T18:37:33.000865+0000","last_became_peered":"2023-11-28T18:37:33.000865+0000","last_unstale":"2023-11-28T18:37:34.010634+0000","last_undegraded":"2023-11-28T18:37:34.010634+0000","last_fullsized":"2023-11-28T18:37:34.010634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:18:10.978623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.988714+0000","last_change":"2023-11-28T18:37:33.005635+0000","last_active":"2023-11-28T18:37:33.988714+0000","last_peered":"2023-11-28T18:37:33.988714+0000","last_clean":"2023-11-28T18:37:33.988714+0000","last_became_active":"2023-11-28T18:37:33.001121+0000","last_became_peered":"2023-11-28T18:37:33.001121+0000","last_unstale":"2023-11-28T18:37:33.988714+0000","last_undegraded":"2023-11-28T18:37:33.988714+0000","last_fullsized":"2023-11-28T18:37:33.988714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:12:16.071028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009766+0000","last_change":"2023-11-28T18:37:32.481789+0000","last_active":"2023-11-28T18:37:34.009766+0000","last_peered":"2023-11-28T18:37:34.009766+0000","last_clean":"2023-11-28T18:37:34.009766+0000","last_became_active":"2023-11-28T18:37:32.481480+0000","last_became_peered":"2023-11-28T18:37:32.481480+0000","last_unstale":"2023-11-28T18:37:34.009766+0000","last_undegraded":"2023-11-28T18:37:34.009766+0000","last_fullsized":"2023-11-28T18:37:34.009766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:00:25.204297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:33.988397+0000","last_change":"2023-11-28T18:37:33.005206+0000","last_active":"2023-11-28T18:37:33.988397+0000","last_peered":"2023-11-28T18:37:33.988397+0000","last_clean":"2023-11-28T18:37:33.988397+0000","last_became_active":"2023-11-28T18:37:33.002231+0000","last_became_peered":"2023-11-28T18:37:33.002231+0000","last_unstale":"2023-11-28T18:37:33.988397+0000","last_undegraded":"2023-11-28T18:37:33.988397+0000","last_fullsized":"2023-11-28T18:37:33.988397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:20:33.664753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009927+0000","last_change":"2023-11-28T18:37:32.481872+0000","last_active":"2023-11-28T18:37:34.009927+0000","last_peered":"2023-11-28T18:37:34.009927+0000","last_clean":"2023-11-28T18:37:34.009927+0000","last_became_active":"2023-11-28T18:37:32.481564+0000","last_became_peered":"2023-11-28T18:37:32.481564+0000","last_unstale":"2023-11-28T18:37:34.009927+0000","last_undegraded":"2023-11-28T18:37:34.009927+0000","last_fullsized":"2023-11-28T18:37:34.009927+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:22:48.248148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.008960+0000","last_change":"2023-11-28T18:37:33.001322+0000","last_active":"2023-11-28T18:37:34.008960+0000","last_peered":"2023-11-28T18:37:34.008960+0000","last_clean":"2023-11-28T18:37:34.008960+0000","last_became_active":"2023-11-28T18:37:33.001146+0000","last_became_peered":"2023-11-28T18:37:33.001146+0000","last_unstale":"2023-11-28T18:37:34.008960+0000","last_undegraded":"2023-11-28T18:37:34.008960+0000","last_fullsized":"2023-11-28T18:37:34.008960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:41:58.493214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009749+0000","last_change":"2023-11-28T18:37:32.469287+0000","last_active":"2023-11-28T18:37:34.009749+0000","last_peered":"2023-11-28T18:37:34.009749+0000","last_clean":"2023-11-28T18:37:34.009749+0000","last_became_active":"2023-11-28T18:37:32.468967+0000","last_became_peered":"2023-11-28T18:37:32.468967+0000","last_unstale":"2023-11-28T18:37:34.009749+0000","last_undegraded":"2023-11-28T18:37:34.009749+0000","last_fullsized":"2023-11-28T18:37:34.009749+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:00:25.204297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009695+0000","last_change":"2023-11-28T18:37:32.993786+0000","last_active":"2023-11-28T18:37:34.009695+0000","last_peered":"2023-11-28T18:37:34.009695+0000","last_clean":"2023-11-28T18:37:34.009695+0000","last_became_active":"2023-11-28T18:37:32.992734+0000","last_became_peered":"2023-11-28T18:37:32.992734+0000","last_unstale":"2023-11-28T18:37:34.009695+0000","last_undegraded":"2023-11-28T18:37:34.009695+0000","last_fullsized":"2023-11-28T18:37:34.009695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:32.437423+0000","last_clean_scrub_stamp":"2023-11-28T18:37:32.437423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:02:53.545778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T18:37:34.009176+0000","last_change":"2023-11-28T18:37:32.471483+0000","last_active":"2023-11-28T18:37:34.009176+0000","last_peered":"2023-11-28T18:37:34.009176+0000","last_clean":"2023-11-28T18:37:34.009176+0000","last_became_active":"2023-11-28T18:37:32.471207+0000","last_became_peered":"2023-11-28T18:37:32.471207+0000","last_unstale":"2023-11-28T18:37:34.009176+0000","last_undegraded":"2023-11-28T18:37:34.009176+0000","last_fullsized":"2023-11-28T18:37:34.009176+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:31.434906+0000","last_clean_scrub_stamp":"2023-11-28T18:37:31.434906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:07:41.145470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":661860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97699999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":204800,"data_stored":70910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31972,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339868,"statfs":{"total":96636764160,"available":96604024832,"internally_reserved":0,"allocated":811008,"data_stored":661916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T18:37:44.350 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-28T18:37:44.350 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-11-28T18:37:44.350 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-11-28T18:37:44.350 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T18:37:44.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.523+0000 7f4e99b96640 1 Processor -- start 2023-11-28T18:37:44.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.523+0000 7f4e99b96640 1 -- start start 2023-11-28T18:37:44.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.523+0000 7f4e99b96640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4e940b35f0 0x7f4e940d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:44.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.523+0000 7f4e99b96640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f4e940b3cb0 0x7f4e9415f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:44.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.523+0000 7f4e99b96640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e940cf7c0 0x7f4e940cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:44.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.523+0000 7f4e99b96640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e940d40d0 con 0x7f4e940b35f0 2023-11-28T18:37:44.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.523+0000 7f4e99b96640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e940d0150 con 0x7f4e940b3cb0 2023-11-28T18:37:44.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.523+0000 7f4e99b96640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e940d38c0 con 0x7f4e940cf7c0 2023-11-28T18:37:44.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.523+0000 7f4e937fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4e940b35f0 0x7f4e940d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:44.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.523+0000 7f4e937fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4e940b35f0 0x7f4e940d0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57616/0 (socket says 172.21.15.45:57616) 2023-11-28T18:37:44.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.523+0000 7f4e937fe640 1 -- 172.21.15.45:0/1759276403 learned_addr learned my addr 172.21.15.45:0/1759276403 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:44.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.523+0000 7f4e92ffd640 1 --2- 172.21.15.45:0/1759276403 >> v2:172.21.15.190:3300/0 conn(0x7f4e940b3cb0 0x7f4e9415f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:44.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.523+0000 7f4e93fff640 1 --2- 172.21.15.45:0/1759276403 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e940cf7c0 0x7f4e940cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:44.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.523+0000 7f4e937fe640 1 -- 172.21.15.45:0/1759276403 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e940cf7c0 msgr2=0x7f4e940cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:44.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.523+0000 7f4e937fe640 1 --2- 172.21.15.45:0/1759276403 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e940cf7c0 0x7f4e940cfc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:44.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.523+0000 7f4e937fe640 1 -- 172.21.15.45:0/1759276403 >> v2:172.21.15.190:3300/0 conn(0x7f4e940b3cb0 msgr2=0x7f4e9415f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:44.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.523+0000 7f4e937fe640 1 --2- 172.21.15.45:0/1759276403 >> v2:172.21.15.190:3300/0 conn(0x7f4e940b3cb0 0x7f4e9415f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:44.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.523+0000 7f4e937fe640 1 -- 172.21.15.45:0/1759276403 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e940cdcc0 con 0x7f4e940b35f0 2023-11-28T18:37:44.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.523+0000 7f4e93fff640 1 --2- 172.21.15.45:0/1759276403 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e940cf7c0 0x7f4e940cfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:37:44.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.523+0000 7f4e92ffd640 1 --2- 172.21.15.45:0/1759276403 >> v2:172.21.15.190:3300/0 conn(0x7f4e940b3cb0 0x7f4e9415f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:37:44.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.527+0000 7f4e937fe640 1 --2- 172.21.15.45:0/1759276403 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e940b35f0 0x7f4e940d0f90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4e9408be20 tx=0x7f4e8401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb18958e29a6fa64 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:44.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.527+0000 7f4e927fc640 1 -- 172.21.15.45:0/1759276403 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e840aa620 con 0x7f4e940b35f0 2023-11-28T18:37:44.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.527+0000 7f4e927fc640 1 -- 172.21.15.45:0/1759276403 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e840aa780 con 0x7f4e940b35f0 2023-11-28T18:37:44.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.527+0000 7f4e927fc640 1 -- 172.21.15.45:0/1759276403 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e840aab10 con 0x7f4e940b35f0 2023-11-28T18:37:44.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.527+0000 7f4e99b96640 1 -- 172.21.15.45:0/1759276403 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e940b35f0 msgr2=0x7f4e940d0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:44.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.527+0000 7f4e99b96640 1 --2- 172.21.15.45:0/1759276403 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e940b35f0 0x7f4e940d0f90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4e9408be20 tx=0x7f4e8401c500 comp rx=0 tx=0).stop 2023-11-28T18:37:44.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.527+0000 7f4e99b96640 1 -- 172.21.15.45:0/1759276403 shutdown_connections 2023-11-28T18:37:44.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.527+0000 7f4e99b96640 1 --2- 172.21.15.45:0/1759276403 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e940cf7c0 0x7f4e940cfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:44.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.527+0000 7f4e99b96640 1 --2- 172.21.15.45:0/1759276403 >> v2:172.21.15.190:3300/0 conn(0x7f4e940b3cb0 0x7f4e9415f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:44.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.527+0000 7f4e99b96640 1 --2- 172.21.15.45:0/1759276403 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e940b35f0 0x7f4e940d0f90 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:44.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.527+0000 7f4e99b96640 1 -- 172.21.15.45:0/1759276403 >> 172.21.15.45:0/1759276403 conn(0x7f4e9409c4f0 msgr2=0x7f4e940d31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:44.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.527+0000 7f4e99b96640 1 -- 172.21.15.45:0/1759276403 shutdown_connections 2023-11-28T18:37:44.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.527+0000 7f4e99b96640 1 -- 172.21.15.45:0/1759276403 wait complete. 2023-11-28T18:37:44.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.531+0000 7f4e99b96640 1 Processor -- start 2023-11-28T18:37:44.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.531+0000 7f4e99b96640 1 -- start start 2023-11-28T18:37:44.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.531+0000 7f4e99b96640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e940b35f0 0x7f4e940cbce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:44.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.531+0000 7f4e99b96640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e940b3cb0 0x7f4e940a0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:44.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.531+0000 7f4e99b96640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4e940cf7c0 0x7f4e9415a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:44.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.531+0000 7f4e99b96640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e940ccc90 con 0x7f4e940b35f0 2023-11-28T18:37:44.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.531+0000 7f4e99b96640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e940a0f70 con 0x7f4e940cf7c0 2023-11-28T18:37:44.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.531+0000 7f4e99b96640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e94146310 con 0x7f4e940b3cb0 2023-11-28T18:37:44.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.531+0000 7f4e937fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e940b35f0 0x7f4e940cbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:44.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.531+0000 7f4e937fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e940b35f0 0x7f4e940cbce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57624/0 (socket says 172.21.15.45:57624) 2023-11-28T18:37:44.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.531+0000 7f4e937fe640 1 -- 172.21.15.45:0/2599074729 learned_addr learned my addr 172.21.15.45:0/2599074729 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:44.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.531+0000 7f4e92ffd640 1 --2- 172.21.15.45:0/2599074729 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e940b3cb0 0x7f4e940a0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:44.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.531+0000 7f4e93fff640 1 --2- 172.21.15.45:0/2599074729 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4e940cf7c0 0x7f4e9415a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:44.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.531+0000 7f4e937fe640 1 -- 172.21.15.45:0/2599074729 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e940b3cb0 msgr2=0x7f4e940a0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:44.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.531+0000 7f4e937fe640 1 --2- 172.21.15.45:0/2599074729 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e940b3cb0 0x7f4e940a0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:44.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.531+0000 7f4e937fe640 1 -- 172.21.15.45:0/2599074729 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4e940cf7c0 msgr2=0x7f4e9415a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:44.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.531+0000 7f4e937fe640 1 --2- 172.21.15.45:0/2599074729 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4e940cf7c0 0x7f4e9415a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:44.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.531+0000 7f4e937fe640 1 -- 172.21.15.45:0/2599074729 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e840094d0 con 0x7f4e940b35f0 2023-11-28T18:37:44.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.531+0000 7f4e92ffd640 1 --2- 172.21.15.45:0/2599074729 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e940b3cb0 0x7f4e940a0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:37:44.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.531+0000 7f4e93fff640 1 --2- 172.21.15.45:0/2599074729 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4e940cf7c0 0x7f4e9415a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:37:44.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.531+0000 7f4e937fe640 1 --2- 172.21.15.45:0/2599074729 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e940b35f0 0x7f4e940cbce0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4e8401abb0 tx=0x7f4e8401ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:44.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.531+0000 7f4e7bfff640 1 -- 172.21.15.45:0/2599074729 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e840bd5f0 con 0x7f4e940b35f0 2023-11-28T18:37:44.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.531+0000 7f4e7bfff640 1 -- 172.21.15.45:0/2599074729 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e840bd750 con 0x7f4e940b35f0 2023-11-28T18:37:44.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.531+0000 7f4e99b96640 1 -- 172.21.15.45:0/2599074729 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e940cc3f0 con 0x7f4e940b35f0 2023-11-28T18:37:44.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.531+0000 7f4e7bfff640 1 -- 172.21.15.45:0/2599074729 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e840bdb00 con 0x7f4e940b35f0 2023-11-28T18:37:44.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.531+0000 7f4e99b96640 1 -- 172.21.15.45:0/2599074729 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e940cc9b0 con 0x7f4e940b35f0 2023-11-28T18:37:44.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.535+0000 7f4e99b96640 1 -- 172.21.15.45:0/2599074729 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e94146170 con 0x7f4e940b35f0 2023-11-28T18:37:44.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.535+0000 7f4e7bfff640 1 -- 172.21.15.45:0/2599074729 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f4e840b33f0 con 0x7f4e940b35f0 2023-11-28T18:37:44.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.535+0000 7f4e7bfff640 1 --2- 172.21.15.45:0/2599074729 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4e800668d0 0x7f4e80068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:44.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.535+0000 7f4e7bfff640 1 -- 172.21.15.45:0/2599074729 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4e8411ef90 con 0x7f4e940b35f0 2023-11-28T18:37:44.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.535+0000 7f4e92ffd640 1 --2- 172.21.15.45:0/2599074729 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4e800668d0 0x7f4e80068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:44.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.535+0000 7f4e92ffd640 1 --2- 172.21.15.45:0/2599074729 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4e800668d0 0x7f4e80068d90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4e940cd280 tx=0x7f4e88008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:44.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.539+0000 7f4e7bfff640 1 -- 172.21.15.45:0/2599074729 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4e94146170 con 0x7f4e940b35f0 2023-11-28T18:37:44.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.731+0000 7f4e99b96640 1 -- 172.21.15.45:0/2599074729 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f4e94146170 con 0x7f4e940b35f0 2023-11-28T18:37:44.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.731+0000 7f4e7bfff640 1 -- 172.21.15.45:0/2599074729 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f4e94146170 con 0x7f4e940b35f0 2023-11-28T18:37:44.735 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:37:44.735 INFO:teuthology.orchestra.run.smithi045.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-11-28T18:37:44.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.731+0000 7f4e99b96640 1 -- 172.21.15.45:0/2599074729 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4e800668d0 msgr2=0x7f4e80068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:44.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.731+0000 7f4e99b96640 1 --2- 172.21.15.45:0/2599074729 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4e800668d0 0x7f4e80068d90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4e940cd280 tx=0x7f4e88008040 comp rx=0 tx=0).stop 2023-11-28T18:37:44.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.731+0000 7f4e99b96640 1 -- 172.21.15.45:0/2599074729 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e940b35f0 msgr2=0x7f4e940cbce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:44.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.731+0000 7f4e99b96640 1 --2- 172.21.15.45:0/2599074729 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e940b35f0 0x7f4e940cbce0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4e8401abb0 tx=0x7f4e8401ad40 comp rx=0 tx=0).stop 2023-11-28T18:37:44.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.731+0000 7f4e99b96640 1 -- 172.21.15.45:0/2599074729 shutdown_connections 2023-11-28T18:37:44.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.731+0000 7f4e99b96640 1 --2- 172.21.15.45:0/2599074729 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4e800668d0 0x7f4e80068d90 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:44.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.731+0000 7f4e99b96640 1 --2- 172.21.15.45:0/2599074729 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4e940cf7c0 0x7f4e9415a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:44.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.731+0000 7f4e99b96640 1 --2- 172.21.15.45:0/2599074729 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e940b3cb0 0x7f4e940a0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:44.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.731+0000 7f4e99b96640 1 --2- 172.21.15.45:0/2599074729 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e940b35f0 0x7f4e940cbce0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:44.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.731+0000 7f4e99b96640 1 -- 172.21.15.45:0/2599074729 >> 172.21.15.45:0/2599074729 conn(0x7f4e9409c4f0 msgr2=0x7f4e940734a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:44.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.731+0000 7f4e99b96640 1 -- 172.21.15.45:0/2599074729 shutdown_connections 2023-11-28T18:37:44.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.731+0000 7f4e99b96640 1 -- 172.21.15.45:0/2599074729 wait complete. 2023-11-28T18:37:44.756 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-11-28T18:37:44.757 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T18:37:44.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.895+0000 7fe325501640 1 Processor -- start 2023-11-28T18:37:44.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.895+0000 7fe325501640 1 -- start start 2023-11-28T18:37:44.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.895+0000 7fe325501640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe3200b35f0 0x7fe3200d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:44.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.895+0000 7fe325501640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3200b3cb0 0x7fe32015f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:44.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.895+0000 7fe325501640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3200d38c0 con 0x7fe3200cf7c0 2023-11-28T18:37:44.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.895+0000 7fe325501640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3200d40d0 con 0x7fe3200b35f0 2023-11-28T18:37:44.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.895+0000 7fe325501640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3200cdcc0 con 0x7fe3200b3cb0 2023-11-28T18:37:44.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.895+0000 7fe31effd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe3200b35f0 0x7fe3200d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:44.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.895+0000 7fe31f7fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe3200cf7c0 0x7fe3200ce480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57770/0 (socket says 172.21.15.45:57770) 2023-11-28T18:37:44.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.895+0000 7fe31f7fe640 1 -- 172.21.15.45:0/1068270921 learned_addr learned my addr 172.21.15.45:0/1068270921 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:37:44.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.895+0000 7fe317fff640 1 --2- 172.21.15.45:0/1068270921 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3200b3cb0 0x7fe32015f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:44.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.895+0000 7fe31effd640 1 -- 172.21.15.45:0/1068270921 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3200b3cb0 msgr2=0x7fe32015f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:44.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.895+0000 7fe31effd640 1 --2- 172.21.15.45:0/1068270921 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3200b3cb0 0x7fe32015f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:44.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.895+0000 7fe31effd640 1 -- 172.21.15.45:0/1068270921 >> v1:172.21.15.45:6789/0 conn(0x7fe3200cf7c0 legacy=0x7fe3200ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:44.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.895+0000 7fe31effd640 1 -- 172.21.15.45:0/1068270921 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3200d3b10 con 0x7fe3200b35f0 2023-11-28T18:37:44.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.895+0000 7fe317fff640 1 --2- 172.21.15.45:0/1068270921 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3200b3cb0 0x7fe32015f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:37:44.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.895+0000 7fe31e7fc640 1 -- 172.21.15.45:0/1068270921 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 71833463 0 0) 0x7fe3200d38c0 con 0x7fe3200cf7c0 2023-11-28T18:37:44.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.899+0000 7fe31effd640 1 --2- 172.21.15.45:0/1068270921 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3200b35f0 0x7fe3200d0f90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe3100097c0 tx=0x7fe31001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d59f3dca3cb050e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:44.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.899+0000 7fe31e7fc640 1 -- 172.21.15.45:0/1068270921 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3100ab680 con 0x7fe3200b35f0 2023-11-28T18:37:44.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.899+0000 7fe31e7fc640 1 -- 172.21.15.45:0/1068270921 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3100ab7e0 con 0x7fe3200b35f0 2023-11-28T18:37:44.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.899+0000 7fe31e7fc640 1 -- 172.21.15.45:0/1068270921 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3100abb70 con 0x7fe3200b35f0 2023-11-28T18:37:44.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.899+0000 7fe325501640 1 -- 172.21.15.45:0/1068270921 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3200b35f0 msgr2=0x7fe3200d0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:44.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.899+0000 7fe325501640 1 --2- 172.21.15.45:0/1068270921 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3200b35f0 0x7fe3200d0f90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe3100097c0 tx=0x7fe31001c480 comp rx=0 tx=0).stop 2023-11-28T18:37:44.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.899+0000 7fe325501640 1 -- 172.21.15.45:0/1068270921 shutdown_connections 2023-11-28T18:37:44.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.899+0000 7fe325501640 1 --2- 172.21.15.45:0/1068270921 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3200b3cb0 0x7fe32015f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:44.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.899+0000 7fe325501640 1 --2- 172.21.15.45:0/1068270921 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3200b35f0 0x7fe3200d0f90 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:44.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.899+0000 7fe325501640 1 -- 172.21.15.45:0/1068270921 >> 172.21.15.45:0/1068270921 conn(0x7fe32009c4f0 msgr2=0x7fe3200d31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:44.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.899+0000 7fe325501640 1 -- 172.21.15.45:0/1068270921 shutdown_connections 2023-11-28T18:37:44.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.899+0000 7fe325501640 1 -- 172.21.15.45:0/1068270921 wait complete. 2023-11-28T18:37:44.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.903+0000 7fe325501640 1 Processor -- start 2023-11-28T18:37:44.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.903+0000 7fe325501640 1 -- start start 2023-11-28T18:37:44.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.903+0000 7fe325501640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3200b35f0 0x7fe32015b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:44.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.903+0000 7fe325501640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3200b3cb0 0x7fe3200cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:44.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.903+0000 7fe325501640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3200cf7c0 0x7fe3200cc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:44.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.903+0000 7fe325501640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe32015b820 con 0x7fe3200cf7c0 2023-11-28T18:37:44.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.903+0000 7fe325501640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe32015a520 con 0x7fe3200b35f0 2023-11-28T18:37:44.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.903+0000 7fe325501640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe32015a800 con 0x7fe3200b3cb0 2023-11-28T18:37:44.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.903+0000 7fe31f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3200cf7c0 0x7fe3200cc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:44.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.903+0000 7fe31f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3200cf7c0 0x7fe3200cc1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57640/0 (socket says 172.21.15.45:57640) 2023-11-28T18:37:44.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.903+0000 7fe31f7fe640 1 -- 172.21.15.45:0/401523447 learned_addr learned my addr 172.21.15.45:0/401523447 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:44.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.903+0000 7fe31effd640 1 --2- 172.21.15.45:0/401523447 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3200b35f0 0x7fe32015b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:44.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.903+0000 7fe317fff640 1 --2- 172.21.15.45:0/401523447 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3200b3cb0 0x7fe3200cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:44.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.903+0000 7fe31f7fe640 1 -- 172.21.15.45:0/401523447 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3200b3cb0 msgr2=0x7fe3200cbca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:44.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.903+0000 7fe31f7fe640 1 --2- 172.21.15.45:0/401523447 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3200b3cb0 0x7fe3200cbca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:44.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.903+0000 7fe31f7fe640 1 -- 172.21.15.45:0/401523447 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3200b35f0 msgr2=0x7fe32015b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:44.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.903+0000 7fe31f7fe640 1 --2- 172.21.15.45:0/401523447 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3200b35f0 0x7fe32015b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:44.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.903+0000 7fe31f7fe640 1 -- 172.21.15.45:0/401523447 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe310009420 con 0x7fe3200cf7c0 2023-11-28T18:37:44.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.903+0000 7fe31effd640 1 --2- 172.21.15.45:0/401523447 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3200b35f0 0x7fe32015b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:37:44.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.903+0000 7fe31f7fe640 1 --2- 172.21.15.45:0/401523447 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3200cf7c0 0x7fe3200cc1e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe318001570 tx=0x7fe31800cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:44.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.903+0000 7fe3177fe640 1 -- 172.21.15.45:0/401523447 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31800cea0 con 0x7fe3200cf7c0 2023-11-28T18:37:44.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.903+0000 7fe3177fe640 1 -- 172.21.15.45:0/401523447 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe31800a5e0 con 0x7fe3200cf7c0 2023-11-28T18:37:44.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.903+0000 7fe325501640 1 -- 172.21.15.45:0/401523447 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe32015aae0 con 0x7fe3200cf7c0 2023-11-28T18:37:44.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.903+0000 7fe3177fe640 1 -- 172.21.15.45:0/401523447 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31800a990 con 0x7fe3200cf7c0 2023-11-28T18:37:44.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.903+0000 7fe325501640 1 -- 172.21.15.45:0/401523447 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3200b5070 con 0x7fe3200cf7c0 2023-11-28T18:37:44.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.907+0000 7fe325501640 1 -- 172.21.15.45:0/401523447 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe320069480 con 0x7fe3200cf7c0 2023-11-28T18:37:44.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.907+0000 7fe3177fe640 1 -- 172.21.15.45:0/401523447 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe31800aaf0 con 0x7fe3200cf7c0 2023-11-28T18:37:44.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.907+0000 7fe3177fe640 1 --2- 172.21.15.45:0/401523447 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe3000668d0 0x7fe300068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:44.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.907+0000 7fe3177fe640 1 -- 172.21.15.45:0/401523447 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe318083c30 con 0x7fe3200cf7c0 2023-11-28T18:37:44.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.907+0000 7fe31effd640 1 --2- 172.21.15.45:0/401523447 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe3000668d0 0x7fe300068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:44.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.911+0000 7fe31effd640 1 --2- 172.21.15.45:0/401523447 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe3000668d0 0x7fe300068d90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe3100af000 tx=0x7fe3100a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:44.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:44.911+0000 7fe3177fe640 1 -- 172.21.15.45:0/401523447 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe318050dd0 con 0x7fe3200cf7c0 2023-11-28T18:37:45.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.071+0000 7fe325501640 1 -- 172.21.15.45:0/401523447 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe32009ca30 con 0x7fe3200cf7c0 2023-11-28T18:37:45.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.071+0000 7fe3177fe640 1 -- 172.21.15.45:0/401523447 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16469 (secure 0 0 0) 0x7fe318018020 con 0x7fe3200cf7c0 2023-11-28T18:37:45.078 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:37:45.078 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":20,"fsid":"d10f5cd6-1d00-4019-99b6-6fa435498a15","created":"2023-11-28T18:37:08.189030+0000","modified":"2023-11-28T18:37:33.971141+0000","last_up_change":"2023-11-28T18:37:20.196124+0000","last_in_change":"2023-11-28T18:37:10.742043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T18:37:21.293917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T18:37:31.384760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T18:37:31.834769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"84465384-103c-4f2c-a45a-96f5bb9c835f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6809","nonce":555237322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6811","nonce":555237322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6815","nonce":555237322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6813","nonce":555237322}]},"public_addr":"172.21.15.45:6809/555237322","cluster_addr":"172.21.15.45:6811/555237322","heartbeat_back_addr":"172.21.15.45:6815/555237322","heartbeat_front_addr":"172.21.15.45:6813/555237322","state":["exists","up"]},{"osd":1,"uuid":"7d9eed24-a58f-42c7-a787-ac06be8553fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6801","nonce":2857063763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6803","nonce":2857063763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6807","nonce":2857063763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6805","nonce":2857063763}]},"public_addr":"172.21.15.45:6801/2857063763","cluster_addr":"172.21.15.45:6803/2857063763","heartbeat_back_addr":"172.21.15.45:6807/2857063763","heartbeat_front_addr":"172.21.15.45:6805/2857063763","state":["exists","up"]},{"osd":2,"uuid":"575eeccc-4abf-45b4-9caf-f3e797859588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6817","nonce":193884539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6819","nonce":193884539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6823","nonce":193884539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6821","nonce":193884539}]},"public_addr":"172.21.15.45:6817/193884539","cluster_addr":"172.21.15.45:6819/193884539","heartbeat_back_addr":"172.21.15.45:6823/193884539","heartbeat_front_addr":"172.21.15.45:6821/193884539","state":["exists","up"]},{"osd":3,"uuid":"9b0290d6-9a52-4bc8-b2a1-7622c5dc8e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6825","nonce":78541084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6827","nonce":78541084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6831","nonce":78541084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6829","nonce":78541084}]},"public_addr":"172.21.15.45:6825/78541084","cluster_addr":"172.21.15.45:6827/78541084","heartbeat_back_addr":"172.21.15.45:6831/78541084","heartbeat_front_addr":"172.21.15.45:6829/78541084","state":["exists","up"]},{"osd":4,"uuid":"ce632829-f027-4fbf-a627-02c571aa9d53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6809","nonce":1537591987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6811","nonce":1537591987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6815","nonce":1537591987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6813","nonce":1537591987}]},"public_addr":"172.21.15.190:6809/1537591987","cluster_addr":"172.21.15.190:6811/1537591987","heartbeat_back_addr":"172.21.15.190:6815/1537591987","heartbeat_front_addr":"172.21.15.190:6813/1537591987","state":["exists","up"]},{"osd":5,"uuid":"8700b609-27be-40bd-a251-4c0ae0a29ead","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6801","nonce":3296698407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6803","nonce":3296698407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6807","nonce":3296698407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6805","nonce":3296698407}]},"public_addr":"172.21.15.190:6801/3296698407","cluster_addr":"172.21.15.190:6803/3296698407","heartbeat_back_addr":"172.21.15.190:6807/3296698407","heartbeat_front_addr":"172.21.15.190:6805/3296698407","state":["exists","up"]},{"osd":6,"uuid":"44ce4a40-e6ff-4f4d-8e8a-7341e5c91f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6817","nonce":2317686718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6819","nonce":2317686718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6823","nonce":2317686718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6821","nonce":2317686718}]},"public_addr":"172.21.15.190:6817/2317686718","cluster_addr":"172.21.15.190:6819/2317686718","heartbeat_back_addr":"172.21.15.190:6823/2317686718","heartbeat_front_addr":"172.21.15.190:6821/2317686718","state":["exists","up"]},{"osd":7,"uuid":"192238c9-1423-4b7e-ac8f-84ba32113ddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6825","nonce":2493232051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6827","nonce":2493232051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6831","nonce":2493232051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6829","nonce":2493232051}]},"public_addr":"172.21.15.190:6825/2493232051","cluster_addr":"172.21.15.190:6827/2493232051","heartbeat_back_addr":"172.21.15.190:6831/2493232051","heartbeat_front_addr":"172.21.15.190:6829/2493232051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.393552+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.385453+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.361421+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.366408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.363226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.276007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.414605+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.445885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T18:37:45.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.075+0000 7fe325501640 1 -- 172.21.15.45:0/401523447 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe3000668d0 msgr2=0x7fe300068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:45.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.075+0000 7fe325501640 1 --2- 172.21.15.45:0/401523447 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe3000668d0 0x7fe300068d90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe3100af000 tx=0x7fe3100a7000 comp rx=0 tx=0).stop 2023-11-28T18:37:45.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.075+0000 7fe325501640 1 -- 172.21.15.45:0/401523447 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3200cf7c0 msgr2=0x7fe3200cc1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:45.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.075+0000 7fe325501640 1 --2- 172.21.15.45:0/401523447 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3200cf7c0 0x7fe3200cc1e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe318001570 tx=0x7fe31800cc50 comp rx=0 tx=0).stop 2023-11-28T18:37:45.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.075+0000 7fe325501640 1 -- 172.21.15.45:0/401523447 shutdown_connections 2023-11-28T18:37:45.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.075+0000 7fe325501640 1 --2- 172.21.15.45:0/401523447 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe3000668d0 0x7fe300068d90 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:45.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.075+0000 7fe325501640 1 --2- 172.21.15.45:0/401523447 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3200cf7c0 0x7fe3200cc1e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:45.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.075+0000 7fe325501640 1 --2- 172.21.15.45:0/401523447 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3200b3cb0 0x7fe3200cbca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:45.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.075+0000 7fe325501640 1 --2- 172.21.15.45:0/401523447 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3200b35f0 0x7fe32015b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:45.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.075+0000 7fe325501640 1 -- 172.21.15.45:0/401523447 >> 172.21.15.45:0/401523447 conn(0x7fe32009c4f0 msgr2=0x7fe32006b350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:45.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.075+0000 7fe325501640 1 -- 172.21.15.45:0/401523447 shutdown_connections 2023-11-28T18:37:45.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.075+0000 7fe325501640 1 -- 172.21.15.45:0/401523447 wait complete. 2023-11-28T18:37:45.099 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T18:37:21.293917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T18:37:31.384760+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T18:37:31.834769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T18:37:45.100 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T18:37:45.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.239+0000 7fa0180e3640 1 Processor -- start 2023-11-28T18:37:45.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.243+0000 7fa0180e3640 1 -- start start 2023-11-28T18:37:45.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.243+0000 7fa0180e3640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa0100b4310 0x7fa0100b4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:45.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.243+0000 7fa0180e3640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0100b4ca0 con 0x7fa010158ce0 2023-11-28T18:37:45.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.243+0000 7fa0180e3640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa01015b6b0 con 0x7fa0100cba50 2023-11-28T18:37:45.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.243+0000 7fa0180e3640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa01015c550 con 0x7fa0100b4310 2023-11-28T18:37:45.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.243+0000 7fa015e7f640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fa010158ce0 0x7fa01015eb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57784/0 (socket says 172.21.15.45:57784) 2023-11-28T18:37:45.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.243+0000 7fa015e7f640 1 -- 172.21.15.45:0/2762248313 learned_addr learned my addr 172.21.15.45:0/2762248313 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:37:45.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.243+0000 7fa016680640 1 --2- 172.21.15.45:0/2762248313 >> v2:172.21.15.45:3300/0 conn(0x7fa0100b4310 0x7fa0100b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:45.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.243+0000 7fa014e7d640 1 -- 172.21.15.45:0/2762248313 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4101452144 0 0) 0x7fa00c001120 con 0x7fa010158ce0 2023-11-28T18:37:45.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.243+0000 7fa014e7d640 1 -- 172.21.15.45:0/2762248313 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ffc003530 con 0x7fa010158ce0 2023-11-28T18:37:45.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.243+0000 7fa016680640 1 -- 172.21.15.45:0/2762248313 >> v1:172.21.15.190:6789/0 conn(0x7fa0100cba50 legacy=0x7fa01015be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:45.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.243+0000 7fa016680640 1 -- 172.21.15.45:0/2762248313 >> v1:172.21.15.45:6789/0 conn(0x7fa010158ce0 legacy=0x7fa01015eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:45.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.243+0000 7fa016680640 1 -- 172.21.15.45:0/2762248313 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa01015f450 con 0x7fa0100b4310 2023-11-28T18:37:45.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.247+0000 7fa016680640 1 --2- 172.21.15.45:0/2762248313 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0100b4310 0x7fa0100b4760 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa008009d90 tx=0x7fa00801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9b53cf0ec95bc58 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:45.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.247+0000 7fa014e7d640 1 -- 172.21.15.45:0/2762248313 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0080a58c0 con 0x7fa0100b4310 2023-11-28T18:37:45.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.247+0000 7fa014e7d640 1 -- 172.21.15.45:0/2762248313 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0080a5a20 con 0x7fa0100b4310 2023-11-28T18:37:45.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.247+0000 7fa014e7d640 1 -- 172.21.15.45:0/2762248313 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0080a5db0 con 0x7fa0100b4310 2023-11-28T18:37:45.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.247+0000 7fa0180e3640 1 -- 172.21.15.45:0/2762248313 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0100b4310 msgr2=0x7fa0100b4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:45.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.247+0000 7fa0180e3640 1 --2- 172.21.15.45:0/2762248313 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0100b4310 0x7fa0100b4760 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa008009d90 tx=0x7fa00801c910 comp rx=0 tx=0).stop 2023-11-28T18:37:45.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.247+0000 7fa0180e3640 1 -- 172.21.15.45:0/2762248313 shutdown_connections 2023-11-28T18:37:45.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.247+0000 7fa0180e3640 1 --2- 172.21.15.45:0/2762248313 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0100b4310 0x7fa0100b4760 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:45.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.247+0000 7fa0180e3640 1 -- 172.21.15.45:0/2762248313 >> 172.21.15.45:0/2762248313 conn(0x7fa0100b0d00 msgr2=0x7fa0100b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:45.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.247+0000 7fa0180e3640 1 -- 172.21.15.45:0/2762248313 shutdown_connections 2023-11-28T18:37:45.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.247+0000 7fa0180e3640 1 -- 172.21.15.45:0/2762248313 wait complete. 2023-11-28T18:37:45.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.247+0000 7fa0180e3640 1 Processor -- start 2023-11-28T18:37:45.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.247+0000 7fa0180e3640 1 -- start start 2023-11-28T18:37:45.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.251+0000 7fa0180e3640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa0100b4310 0x7fa010153b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:45.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.251+0000 7fa0180e3640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa0100cba50 0x7fa0100c5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:45.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.251+0000 7fa0180e3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa010158ce0 0x7fa01015d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:45.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.251+0000 7fa0180e3640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa010165630 con 0x7fa010158ce0 2023-11-28T18:37:45.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.251+0000 7fa0180e3640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa010165350 con 0x7fa0100cba50 2023-11-28T18:37:45.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.251+0000 7fa0180e3640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0100c4b20 con 0x7fa0100b4310 2023-11-28T18:37:45.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.251+0000 7fa016680640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa010158ce0 0x7fa01015d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:45.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.251+0000 7fa016680640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa010158ce0 0x7fa01015d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57664/0 (socket says 172.21.15.45:57664) 2023-11-28T18:37:45.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.251+0000 7fa016680640 1 -- 172.21.15.45:0/3608003418 learned_addr learned my addr 172.21.15.45:0/3608003418 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:45.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.251+0000 7fa01567e640 1 --2- 172.21.15.45:0/3608003418 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa0100cba50 0x7fa0100c5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:45.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.251+0000 7fa015e7f640 1 --2- 172.21.15.45:0/3608003418 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa0100b4310 0x7fa010153b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:45.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.251+0000 7fa016680640 1 -- 172.21.15.45:0/3608003418 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa0100b4310 msgr2=0x7fa010153b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:45.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.251+0000 7fa016680640 1 --2- 172.21.15.45:0/3608003418 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa0100b4310 0x7fa010153b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:45.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.251+0000 7fa016680640 1 -- 172.21.15.45:0/3608003418 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa0100cba50 msgr2=0x7fa0100c5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:45.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.251+0000 7fa016680640 1 --2- 172.21.15.45:0/3608003418 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa0100cba50 0x7fa0100c5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:45.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.251+0000 7fa016680640 1 -- 172.21.15.45:0/3608003418 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa008009a70 con 0x7fa010158ce0 2023-11-28T18:37:45.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.251+0000 7fa015e7f640 1 --2- 172.21.15.45:0/3608003418 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa0100b4310 0x7fa010153b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:37:45.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.251+0000 7fa016680640 1 --2- 172.21.15.45:0/3608003418 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa010158ce0 0x7fa01015d770 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa00801a540 tx=0x7fa0080196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:45.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.251+0000 7fa0067fc640 1 -- 172.21.15.45:0/3608003418 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0080b9860 con 0x7fa010158ce0 2023-11-28T18:37:45.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.251+0000 7fa0067fc640 1 -- 172.21.15.45:0/3608003418 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0080b99c0 con 0x7fa010158ce0 2023-11-28T18:37:45.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.251+0000 7fa0067fc640 1 -- 172.21.15.45:0/3608003418 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0080b9d50 con 0x7fa010158ce0 2023-11-28T18:37:45.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.251+0000 7fa0180e3640 1 -- 172.21.15.45:0/3608003418 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0100c4e00 con 0x7fa010158ce0 2023-11-28T18:37:45.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.251+0000 7fa0180e3640 1 -- 172.21.15.45:0/3608003418 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0101540b0 con 0x7fa010158ce0 2023-11-28T18:37:45.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.251+0000 7fa0180e3640 1 -- 172.21.15.45:0/3608003418 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0100c4980 con 0x7fa010158ce0 2023-11-28T18:37:45.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.251+0000 7fa0067fc640 1 -- 172.21.15.45:0/3608003418 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa0080c4460 con 0x7fa010158ce0 2023-11-28T18:37:45.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.255+0000 7fa0067fc640 1 --2- 172.21.15.45:0/3608003418 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9ff4066900 0x7f9ff4068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:45.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.255+0000 7fa0067fc640 1 -- 172.21.15.45:0/3608003418 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa00811f820 con 0x7fa010158ce0 2023-11-28T18:37:45.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.255+0000 7fa015e7f640 1 --2- 172.21.15.45:0/3608003418 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9ff4066900 0x7f9ff4068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:45.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.255+0000 7fa015e7f640 1 --2- 172.21.15.45:0/3608003418 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9ff4066900 0x7f9ff4068dc0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa00c007fd0 tx=0x7fa00c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:45.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.259+0000 7fa0067fc640 1 -- 172.21.15.45:0/3608003418 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa0100c4980 con 0x7fa010158ce0 2023-11-28T18:37:45.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.419+0000 7fa0180e3640 1 -- 172.21.15.45:0/3608003418 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa0100c5320 con 0x7fa010158ce0 2023-11-28T18:37:45.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.419+0000 7fa0067fc640 1 -- 172.21.15.45:0/3608003418 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa0100c5320 con 0x7fa010158ce0 2023-11-28T18:37:45.423 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-11-28T18:37:45.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.419+0000 7fa0180e3640 1 -- 172.21.15.45:0/3608003418 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9ff4066900 msgr2=0x7f9ff4068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:45.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.419+0000 7fa0180e3640 1 --2- 172.21.15.45:0/3608003418 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9ff4066900 0x7f9ff4068dc0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa00c007fd0 tx=0x7fa00c009040 comp rx=0 tx=0).stop 2023-11-28T18:37:45.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.419+0000 7fa0180e3640 1 -- 172.21.15.45:0/3608003418 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa010158ce0 msgr2=0x7fa01015d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:45.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.419+0000 7fa0180e3640 1 --2- 172.21.15.45:0/3608003418 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa010158ce0 0x7fa01015d770 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa00801a540 tx=0x7fa0080196b0 comp rx=0 tx=0).stop 2023-11-28T18:37:45.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.419+0000 7fa0180e3640 1 -- 172.21.15.45:0/3608003418 shutdown_connections 2023-11-28T18:37:45.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.419+0000 7fa0180e3640 1 --2- 172.21.15.45:0/3608003418 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9ff4066900 0x7f9ff4068dc0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:45.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.419+0000 7fa0180e3640 1 --2- 172.21.15.45:0/3608003418 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa010158ce0 0x7fa01015d770 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:45.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.419+0000 7fa0180e3640 1 --2- 172.21.15.45:0/3608003418 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa0100cba50 0x7fa0100c5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:45.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.419+0000 7fa0180e3640 1 --2- 172.21.15.45:0/3608003418 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa0100b4310 0x7fa010153b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:45.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.419+0000 7fa0180e3640 1 -- 172.21.15.45:0/3608003418 >> 172.21.15.45:0/3608003418 conn(0x7fa0100b0d00 msgr2=0x7fa01015e7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:45.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.419+0000 7fa0180e3640 1 -- 172.21.15.45:0/3608003418 shutdown_connections 2023-11-28T18:37:45.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.419+0000 7fa0180e3640 1 -- 172.21.15.45:0/3608003418 wait complete. 2023-11-28T18:37:45.444 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T18:37:45.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.583+0000 7f831cfd1640 1 Processor -- start 2023-11-28T18:37:45.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.583+0000 7f831cfd1640 1 -- start start 2023-11-28T18:37:45.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.587+0000 7f831cfd1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f83180cba50 0x7f831815be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:45.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.587+0000 7f831cfd1640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f83180b4310 0x7f83180b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:45.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.587+0000 7f831cfd1640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83180b4c80 con 0x7f8318158ce0 2023-11-28T18:37:45.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.587+0000 7f831cfd1640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f831815b6b0 con 0x7f83180b4310 2023-11-28T18:37:45.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.587+0000 7f831cfd1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f831815f450 con 0x7f83180cba50 2023-11-28T18:37:45.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.587+0000 7f8316d9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f83180b4310 0x7f83180b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:45.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.587+0000 7f8316d9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f83180b4310 0x7f83180b4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57668/0 (socket says 172.21.15.45:57668) 2023-11-28T18:37:45.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.587+0000 7f8316d9d640 1 -- 172.21.15.45:0/4250262577 learned_addr learned my addr 172.21.15.45:0/4250262577 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:45.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.587+0000 7f8315d9b640 1 --2- 172.21.15.45:0/4250262577 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f83180cba50 0x7f831815be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:45.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.587+0000 7f8316d9d640 1 -- 172.21.15.45:0/4250262577 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f83180cba50 msgr2=0x7f831815be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:45.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.587+0000 7f8316d9d640 1 --2- 172.21.15.45:0/4250262577 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f83180cba50 0x7f831815be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:45.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.587+0000 7f8316d9d640 1 -- 172.21.15.45:0/4250262577 >> v1:172.21.15.190:6789/0 conn(0x7f8318158ce0 legacy=0x7f831815eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:45.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.587+0000 7f8316d9d640 1 -- 172.21.15.45:0/4250262577 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f831815f730 con 0x7f83180b4310 2023-11-28T18:37:45.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.591+0000 7f8316d9d640 1 --2- 172.21.15.45:0/4250262577 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83180b4310 0x7f83180b4740 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8310009e50 tx=0x7f831001ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c36de8ce3bea0e7f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:45.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.591+0000 7f831559a640 1 -- 172.21.15.45:0/4250262577 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83100a57f0 con 0x7f83180b4310 2023-11-28T18:37:45.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.591+0000 7f831559a640 1 -- 172.21.15.45:0/4250262577 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83100a5950 con 0x7f83180b4310 2023-11-28T18:37:45.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.591+0000 7f831559a640 1 -- 172.21.15.45:0/4250262577 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83100a5ce0 con 0x7f83180b4310 2023-11-28T18:37:45.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.591+0000 7f831cfd1640 1 -- 172.21.15.45:0/4250262577 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83180b4310 msgr2=0x7f83180b4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:45.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.591+0000 7f831cfd1640 1 --2- 172.21.15.45:0/4250262577 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83180b4310 0x7f83180b4740 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8310009e50 tx=0x7f831001ca10 comp rx=0 tx=0).stop 2023-11-28T18:37:45.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.591+0000 7f831cfd1640 1 -- 172.21.15.45:0/4250262577 shutdown_connections 2023-11-28T18:37:45.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.591+0000 7f831cfd1640 1 --2- 172.21.15.45:0/4250262577 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83180b4310 0x7f83180b4740 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:45.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.591+0000 7f831cfd1640 1 --2- 172.21.15.45:0/4250262577 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f83180cba50 0x7f831815be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:45.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.591+0000 7f831cfd1640 1 -- 172.21.15.45:0/4250262577 >> 172.21.15.45:0/4250262577 conn(0x7f83180b0d00 msgr2=0x7f83180b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:45.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.591+0000 7f831cfd1640 1 -- 172.21.15.45:0/4250262577 shutdown_connections 2023-11-28T18:37:45.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.591+0000 7f831cfd1640 1 -- 172.21.15.45:0/4250262577 wait complete. 2023-11-28T18:37:45.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.591+0000 7f831cfd1640 1 Processor -- start 2023-11-28T18:37:45.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.595+0000 7f831cfd1640 1 -- start start 2023-11-28T18:37:45.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.595+0000 7f831cfd1640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f83180b4310 0x7f83180b3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:45.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.595+0000 7f831cfd1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83180cba50 0x7f831815cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:45.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.595+0000 7f831cfd1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8318158ce0 0x7f8318153fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:45.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.595+0000 7f831cfd1640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f831815d5b0 con 0x7f83180cba50 2023-11-28T18:37:45.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.595+0000 7f831cfd1640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83180b3c60 con 0x7f83180b4310 2023-11-28T18:37:45.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.595+0000 7f831cfd1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83181511e0 con 0x7f8318158ce0 2023-11-28T18:37:45.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.595+0000 7f8315d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83180cba50 0x7f831815cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:45.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.595+0000 7f8315d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83180cba50 0x7f831815cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57682/0 (socket says 172.21.15.45:57682) 2023-11-28T18:37:45.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.595+0000 7f8315d9b640 1 -- 172.21.15.45:0/1327874967 learned_addr learned my addr 172.21.15.45:0/1327874967 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:45.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.595+0000 7f8316d9d640 1 --2- 172.21.15.45:0/1327874967 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8318158ce0 0x7f8318153fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:45.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.595+0000 7f831659c640 1 --2- 172.21.15.45:0/1327874967 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f83180b4310 0x7f83180b3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:45.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.595+0000 7f8315d9b640 1 -- 172.21.15.45:0/1327874967 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8318158ce0 msgr2=0x7f8318153fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:45.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.595+0000 7f8315d9b640 1 --2- 172.21.15.45:0/1327874967 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8318158ce0 0x7f8318153fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:45.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.595+0000 7f8315d9b640 1 -- 172.21.15.45:0/1327874967 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f83180b4310 msgr2=0x7f83180b3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:45.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.595+0000 7f8315d9b640 1 --2- 172.21.15.45:0/1327874967 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f83180b4310 0x7f83180b3720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:45.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.595+0000 7f8315d9b640 1 -- 172.21.15.45:0/1327874967 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8310009b30 con 0x7f83180cba50 2023-11-28T18:37:45.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.595+0000 7f8316d9d640 1 --2- 172.21.15.45:0/1327874967 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8318158ce0 0x7f8318153fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:37:45.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.595+0000 7f831659c640 1 --2- 172.21.15.45:0/1327874967 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f83180b4310 0x7f83180b3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:37:45.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.595+0000 7f8315d9b640 1 --2- 172.21.15.45:0/1327874967 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83180cba50 0x7f831815cd60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f830c006e90 tx=0x7f830c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:45.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.595+0000 7f8306ffd640 1 -- 172.21.15.45:0/1327874967 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f830c00b6c0 con 0x7f83180cba50 2023-11-28T18:37:45.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.595+0000 7f8306ffd640 1 -- 172.21.15.45:0/1327874967 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f830c00b840 con 0x7f83180cba50 2023-11-28T18:37:45.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.595+0000 7f831cfd1640 1 -- 172.21.15.45:0/1327874967 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8318150650 con 0x7f83180cba50 2023-11-28T18:37:45.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.595+0000 7f8306ffd640 1 -- 172.21.15.45:0/1327874967 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f830c00bbf0 con 0x7f83180cba50 2023-11-28T18:37:45.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.595+0000 7f831cfd1640 1 -- 172.21.15.45:0/1327874967 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8318150b90 con 0x7f83180cba50 2023-11-28T18:37:45.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.595+0000 7f831cfd1640 1 -- 172.21.15.45:0/1327874967 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8318158530 con 0x7f83180cba50 2023-11-28T18:37:45.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.599+0000 7f8306ffd640 1 -- 172.21.15.45:0/1327874967 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f830c00bd50 con 0x7f83180cba50 2023-11-28T18:37:45.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.599+0000 7f8306ffd640 1 --2- 172.21.15.45:0/1327874967 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f82f80668d0 0x7f82f8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:45.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.599+0000 7f8306ffd640 1 -- 172.21.15.45:0/1327874967 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f830c084880 con 0x7f83180cba50 2023-11-28T18:37:45.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.599+0000 7f831659c640 1 --2- 172.21.15.45:0/1327874967 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f82f80668d0 0x7f82f8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:45.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.599+0000 7f831659c640 1 --2- 172.21.15.45:0/1327874967 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f82f80668d0 0x7f82f8068d90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8308000f70 tx=0x7f8308009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:45.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.603+0000 7f8306ffd640 1 -- 172.21.15.45:0/1327874967 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f830c051b50 con 0x7f83180cba50 2023-11-28T18:37:45.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.763+0000 7f831cfd1640 1 -- 172.21.15.45:0/1327874967 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8318151350 con 0x7f83180cba50 2023-11-28T18:37:45.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.763+0000 7f8306ffd640 1 -- 172.21.15.45:0/1327874967 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f830c055170 con 0x7f83180cba50 2023-11-28T18:37:45.767 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-11-28T18:37:45.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.763+0000 7f831cfd1640 1 -- 172.21.15.45:0/1327874967 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f82f80668d0 msgr2=0x7f82f8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:45.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.763+0000 7f831cfd1640 1 --2- 172.21.15.45:0/1327874967 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f82f80668d0 0x7f82f8068d90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8308000f70 tx=0x7f8308009040 comp rx=0 tx=0).stop 2023-11-28T18:37:45.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.763+0000 7f831cfd1640 1 -- 172.21.15.45:0/1327874967 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83180cba50 msgr2=0x7f831815cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:45.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.763+0000 7f831cfd1640 1 --2- 172.21.15.45:0/1327874967 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83180cba50 0x7f831815cd60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f830c006e90 tx=0x7f830c00dc60 comp rx=0 tx=0).stop 2023-11-28T18:37:45.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.763+0000 7f831cfd1640 1 -- 172.21.15.45:0/1327874967 shutdown_connections 2023-11-28T18:37:45.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.763+0000 7f831cfd1640 1 --2- 172.21.15.45:0/1327874967 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f82f80668d0 0x7f82f8068d90 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:45.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.763+0000 7f831cfd1640 1 --2- 172.21.15.45:0/1327874967 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8318158ce0 0x7f8318153fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:45.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.763+0000 7f831cfd1640 1 --2- 172.21.15.45:0/1327874967 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83180cba50 0x7f831815cd60 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:45.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.763+0000 7f831cfd1640 1 --2- 172.21.15.45:0/1327874967 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f83180b4310 0x7f83180b3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:45.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.763+0000 7f831cfd1640 1 -- 172.21.15.45:0/1327874967 >> 172.21.15.45:0/1327874967 conn(0x7f83180b0d00 msgr2=0x7f83180cbec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:45.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.763+0000 7f831cfd1640 1 -- 172.21.15.45:0/1327874967 shutdown_connections 2023-11-28T18:37:45.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.763+0000 7f831cfd1640 1 -- 172.21.15.45:0/1327874967 wait complete. 2023-11-28T18:37:45.788 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T18:37:45.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.927+0000 7ff4edd57640 1 Processor -- start 2023-11-28T18:37:45.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.927+0000 7ff4edd57640 1 -- start start 2023-11-28T18:37:45.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.931+0000 7ff4edd57640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff4e813f630 0x7ff4e80ce240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:45.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.931+0000 7ff4edd57640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4e813d2f0 con 0x7ff4e815adf0 2023-11-28T18:37:45.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.931+0000 7ff4edd57640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4e80cddb0 con 0x7ff4e8071dd0 2023-11-28T18:37:45.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.931+0000 7ff4edd57640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4e8140560 con 0x7ff4e813f630 2023-11-28T18:37:45.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.931+0000 7ff4e6ffd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff4e815adf0 0x7ff4e813d5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57800/0 (socket says 172.21.15.45:57800) 2023-11-28T18:37:45.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.931+0000 7ff4e6ffd640 1 -- 172.21.15.45:0/489106717 learned_addr learned my addr 172.21.15.45:0/489106717 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:37:45.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.931+0000 7ff4e7fff640 1 --2- 172.21.15.45:0/489106717 >> v2:172.21.15.45:3300/0 conn(0x7ff4e813f630 0x7ff4e80ce240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:45.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.931+0000 7ff4e67fc640 1 -- 172.21.15.45:0/489106717 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 193564054 0 0) 0x7ff4e813d2f0 con 0x7ff4e815adf0 2023-11-28T18:37:45.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.931+0000 7ff4e67fc640 1 -- 172.21.15.45:0/489106717 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4d0005740 con 0x7ff4e815adf0 2023-11-28T18:37:45.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.931+0000 7ff4e7fff640 1 -- 172.21.15.45:0/489106717 >> v1:172.21.15.190:6789/0 conn(0x7ff4e8071dd0 legacy=0x7ff4e80721b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:45.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.931+0000 7ff4e7fff640 1 -- 172.21.15.45:0/489106717 >> v1:172.21.15.45:6789/0 conn(0x7ff4e815adf0 legacy=0x7ff4e813d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:45.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.931+0000 7ff4e7fff640 1 -- 172.21.15.45:0/489106717 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4e813ffa0 con 0x7ff4e813f630 2023-11-28T18:37:45.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.931+0000 7ff4e7fff640 1 --2- 172.21.15.45:0/489106717 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4e813f630 0x7ff4e80ce240 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff4e0009d90 tx=0x7ff4e001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8098e36ce8949250 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:45.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.935+0000 7ff4e67fc640 1 -- 172.21.15.45:0/489106717 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e00a5800 con 0x7ff4e813f630 2023-11-28T18:37:45.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.935+0000 7ff4e67fc640 1 -- 172.21.15.45:0/489106717 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e00a5960 con 0x7ff4e813f630 2023-11-28T18:37:45.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.935+0000 7ff4e67fc640 1 -- 172.21.15.45:0/489106717 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e00a5cf0 con 0x7ff4e813f630 2023-11-28T18:37:45.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.935+0000 7ff4edd57640 1 -- 172.21.15.45:0/489106717 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4e813f630 msgr2=0x7ff4e80ce240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:45.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.935+0000 7ff4edd57640 1 --2- 172.21.15.45:0/489106717 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4e813f630 0x7ff4e80ce240 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff4e0009d90 tx=0x7ff4e001c950 comp rx=0 tx=0).stop 2023-11-28T18:37:45.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.935+0000 7ff4edd57640 1 -- 172.21.15.45:0/489106717 shutdown_connections 2023-11-28T18:37:45.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.935+0000 7ff4edd57640 1 --2- 172.21.15.45:0/489106717 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4e813f630 0x7ff4e80ce240 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:45.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.935+0000 7ff4edd57640 1 -- 172.21.15.45:0/489106717 >> 172.21.15.45:0/489106717 conn(0x7ff4e80b0d00 msgr2=0x7ff4e80b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:45.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.935+0000 7ff4edd57640 1 -- 172.21.15.45:0/489106717 shutdown_connections 2023-11-28T18:37:45.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.935+0000 7ff4edd57640 1 -- 172.21.15.45:0/489106717 wait complete. 2023-11-28T18:37:45.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.935+0000 7ff4edd57640 1 Processor -- start 2023-11-28T18:37:45.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.935+0000 7ff4edd57640 1 -- start start 2023-11-28T18:37:45.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.935+0000 7ff4edd57640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4e8071dd0 0x7ff4e8141860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:45.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.935+0000 7ff4edd57640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff4e813f630 0x7ff4e8138ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:45.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.935+0000 7ff4edd57640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4e815adf0 0x7ff4e80b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:45.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.935+0000 7ff4edd57640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e8139020 con 0x7ff4e8071dd0 2023-11-28T18:37:45.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.935+0000 7ff4edd57640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e80b3320 con 0x7ff4e815adf0 2023-11-28T18:37:45.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.935+0000 7ff4edd57640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e80b3600 con 0x7ff4e813f630 2023-11-28T18:37:45.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.935+0000 7ff4e77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4e8071dd0 0x7ff4e8141860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:45.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.935+0000 7ff4e77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4e8071dd0 0x7ff4e8141860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57704/0 (socket says 172.21.15.45:57704) 2023-11-28T18:37:45.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.935+0000 7ff4e77fe640 1 -- 172.21.15.45:0/1521520789 learned_addr learned my addr 172.21.15.45:0/1521520789 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:45.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.939+0000 7ff4e6ffd640 1 --2- 172.21.15.45:0/1521520789 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff4e813f630 0x7ff4e8138ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:45.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.939+0000 7ff4e7fff640 1 --2- 172.21.15.45:0/1521520789 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4e815adf0 0x7ff4e80b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:45.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.939+0000 7ff4e77fe640 1 -- 172.21.15.45:0/1521520789 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff4e813f630 msgr2=0x7ff4e8138ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:45.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.939+0000 7ff4e77fe640 1 --2- 172.21.15.45:0/1521520789 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff4e813f630 0x7ff4e8138ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:45.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.939+0000 7ff4e77fe640 1 -- 172.21.15.45:0/1521520789 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4e815adf0 msgr2=0x7ff4e80b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:45.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.939+0000 7ff4e77fe640 1 --2- 172.21.15.45:0/1521520789 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4e815adf0 0x7ff4e80b43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:45.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.939+0000 7ff4e77fe640 1 -- 172.21.15.45:0/1521520789 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4e0009a70 con 0x7ff4e8071dd0 2023-11-28T18:37:45.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.939+0000 7ff4e77fe640 1 --2- 172.21.15.45:0/1521520789 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4e8071dd0 0x7ff4e8141860 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff4d800c500 tx=0x7ff4d800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:45.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.939+0000 7ff4cffff640 1 -- 172.21.15.45:0/1521520789 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d8005220 con 0x7ff4e8071dd0 2023-11-28T18:37:45.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.939+0000 7ff4cffff640 1 -- 172.21.15.45:0/1521520789 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4d8005380 con 0x7ff4e8071dd0 2023-11-28T18:37:45.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.939+0000 7ff4cffff640 1 -- 172.21.15.45:0/1521520789 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d8007270 con 0x7ff4e8071dd0 2023-11-28T18:37:45.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.939+0000 7ff4edd57640 1 -- 172.21.15.45:0/1521520789 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4e80b38e0 con 0x7ff4e8071dd0 2023-11-28T18:37:45.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.939+0000 7ff4edd57640 1 -- 172.21.15.45:0/1521520789 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4e80b3ea0 con 0x7ff4e8071dd0 2023-11-28T18:37:45.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.939+0000 7ff4edd57640 1 -- 172.21.15.45:0/1521520789 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4e8069410 con 0x7ff4e8071dd0 2023-11-28T18:37:45.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.939+0000 7ff4cffff640 1 -- 172.21.15.45:0/1521520789 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ff4d80073d0 con 0x7ff4e8071dd0 2023-11-28T18:37:45.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.939+0000 7ff4cffff640 1 --2- 172.21.15.45:0/1521520789 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff4d40668d0 0x7ff4d4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:45.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.943+0000 7ff4cffff640 1 -- 172.21.15.45:0/1521520789 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff4d8083790 con 0x7ff4e8071dd0 2023-11-28T18:37:45.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.943+0000 7ff4e6ffd640 1 --2- 172.21.15.45:0/1521520789 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff4d40668d0 0x7ff4d4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:45.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.943+0000 7ff4e6ffd640 1 --2- 172.21.15.45:0/1521520789 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff4d40668d0 0x7ff4d4068d90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff4e813f500 tx=0x7ff4dc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:45.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:45.943+0000 7ff4cffff640 1 -- 172.21.15.45:0/1521520789 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff4d80509e0 con 0x7ff4e8071dd0 2023-11-28T18:37:46.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.103+0000 7ff4edd57640 1 -- 172.21.15.45:0/1521520789 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff4e806e750 con 0x7ff4e8071dd0 2023-11-28T18:37:46.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.103+0000 7ff4cffff640 1 -- 172.21.15.45:0/1521520789 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff4d8072020 con 0x7ff4e8071dd0 2023-11-28T18:37:46.107 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-11-28T18:37:46.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.103+0000 7ff4edd57640 1 -- 172.21.15.45:0/1521520789 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff4d40668d0 msgr2=0x7ff4d4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:46.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.103+0000 7ff4edd57640 1 --2- 172.21.15.45:0/1521520789 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff4d40668d0 0x7ff4d4068d90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff4e813f500 tx=0x7ff4dc009040 comp rx=0 tx=0).stop 2023-11-28T18:37:46.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.103+0000 7ff4edd57640 1 -- 172.21.15.45:0/1521520789 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4e8071dd0 msgr2=0x7ff4e8141860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:46.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.103+0000 7ff4edd57640 1 --2- 172.21.15.45:0/1521520789 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4e8071dd0 0x7ff4e8141860 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff4d800c500 tx=0x7ff4d800c9c0 comp rx=0 tx=0).stop 2023-11-28T18:37:46.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.103+0000 7ff4edd57640 1 -- 172.21.15.45:0/1521520789 shutdown_connections 2023-11-28T18:37:46.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.103+0000 7ff4edd57640 1 --2- 172.21.15.45:0/1521520789 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff4d40668d0 0x7ff4d4068d90 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:46.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.103+0000 7ff4edd57640 1 --2- 172.21.15.45:0/1521520789 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4e815adf0 0x7ff4e80b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:46.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.103+0000 7ff4edd57640 1 --2- 172.21.15.45:0/1521520789 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff4e813f630 0x7ff4e8138ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:46.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.103+0000 7ff4edd57640 1 --2- 172.21.15.45:0/1521520789 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4e8071dd0 0x7ff4e8141860 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:46.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.103+0000 7ff4edd57640 1 -- 172.21.15.45:0/1521520789 >> 172.21.15.45:0/1521520789 conn(0x7ff4e80b0d00 msgr2=0x7ff4e813b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:46.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.103+0000 7ff4edd57640 1 -- 172.21.15.45:0/1521520789 shutdown_connections 2023-11-28T18:37:46.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.103+0000 7ff4edd57640 1 -- 172.21.15.45:0/1521520789 wait complete. 2023-11-28T18:37:46.128 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T18:37:46.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.267+0000 7f03122fe640 1 Processor -- start 2023-11-28T18:37:46.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.267+0000 7f03122fe640 1 -- start start 2023-11-28T18:37:46.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.267+0000 7f03122fe640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f030c0b35f0 0x7f030c0d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:46.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.267+0000 7f03122fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f030c0cfed0 0x7f030c15f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:46.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.267+0000 7f03122fe640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f030c0d38c0 con 0x7f030c0b3cb0 2023-11-28T18:37:46.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.267+0000 7f03122fe640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f030c0d40d0 con 0x7f030c0cfed0 2023-11-28T18:37:46.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.267+0000 7f03122fe640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f030c0cdcc0 con 0x7f030c0b35f0 2023-11-28T18:37:46.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.267+0000 7f031089b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f030c0cfed0 0x7f030c15f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:46.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.267+0000 7f031089b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f030c0cfed0 0x7f030c15f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57720/0 (socket says 172.21.15.45:57720) 2023-11-28T18:37:46.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.267+0000 7f031089b640 1 -- 172.21.15.45:0/3757051696 learned_addr learned my addr 172.21.15.45:0/3757051696 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:46.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.267+0000 7f030bfff640 1 --2- 172.21.15.45:0/3757051696 >> v2:172.21.15.190:3300/0 conn(0x7f030c0b35f0 0x7f030c0d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:46.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.267+0000 7f031089b640 1 -- 172.21.15.45:0/3757051696 >> v2:172.21.15.190:3300/0 conn(0x7f030c0b35f0 msgr2=0x7f030c0d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:46.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.267+0000 7f031089b640 1 --2- 172.21.15.45:0/3757051696 >> v2:172.21.15.190:3300/0 conn(0x7f030c0b35f0 0x7f030c0d0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:46.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.267+0000 7f031089b640 1 -- 172.21.15.45:0/3757051696 >> v1:172.21.15.190:6789/0 conn(0x7f030c0b3cb0 legacy=0x7f030c0cf7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:46.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.267+0000 7f031089b640 1 -- 172.21.15.45:0/3757051696 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f030c0d3b10 con 0x7f030c0cfed0 2023-11-28T18:37:46.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.271+0000 7f031089b640 1 --2- 172.21.15.45:0/3757051696 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f030c0cfed0 0x7f030c15f0a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f030c08ca20 tx=0x7f030401c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82de475f92c8d1e3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:46.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.271+0000 7f030affd640 1 -- 172.21.15.45:0/3757051696 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03040a5850 con 0x7f030c0cfed0 2023-11-28T18:37:46.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.271+0000 7f030affd640 1 -- 172.21.15.45:0/3757051696 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03040a59b0 con 0x7f030c0cfed0 2023-11-28T18:37:46.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.271+0000 7f030affd640 1 -- 172.21.15.45:0/3757051696 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03040a5d40 con 0x7f030c0cfed0 2023-11-28T18:37:46.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.271+0000 7f03122fe640 1 -- 172.21.15.45:0/3757051696 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f030c0cfed0 msgr2=0x7f030c15f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:46.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.271+0000 7f03122fe640 1 --2- 172.21.15.45:0/3757051696 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f030c0cfed0 0x7f030c15f0a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f030c08ca20 tx=0x7f030401c990 comp rx=0 tx=0).stop 2023-11-28T18:37:46.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.271+0000 7f03122fe640 1 -- 172.21.15.45:0/3757051696 shutdown_connections 2023-11-28T18:37:46.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.271+0000 7f03122fe640 1 --2- 172.21.15.45:0/3757051696 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f030c0cfed0 0x7f030c15f0a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:46.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.271+0000 7f03122fe640 1 --2- 172.21.15.45:0/3757051696 >> v2:172.21.15.190:3300/0 conn(0x7f030c0b35f0 0x7f030c0d0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:46.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.271+0000 7f03122fe640 1 -- 172.21.15.45:0/3757051696 >> 172.21.15.45:0/3757051696 conn(0x7f030c09c4f0 msgr2=0x7f030c0d31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:46.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.271+0000 7f03122fe640 1 -- 172.21.15.45:0/3757051696 shutdown_connections 2023-11-28T18:37:46.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.271+0000 7f03122fe640 1 -- 172.21.15.45:0/3757051696 wait complete. 2023-11-28T18:37:46.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.271+0000 7f03122fe640 1 Processor -- start 2023-11-28T18:37:46.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.275+0000 7f03122fe640 1 -- start start 2023-11-28T18:37:46.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.275+0000 7f03122fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f030c0b35f0 0x7f030c0b83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:46.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.275+0000 7f03122fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f030c0b3cb0 0x7f030c15a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:46.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.275+0000 7f03122fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f030c0cfed0 0x7f030c159a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:46.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.275+0000 7f03122fe640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f030c0b88e0 con 0x7f030c0b35f0 2023-11-28T18:37:46.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.275+0000 7f03122fe640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f030c15a710 con 0x7f030c0b3cb0 2023-11-28T18:37:46.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.275+0000 7f03122fe640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f030c15b4c0 con 0x7f030c0cfed0 2023-11-28T18:37:46.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.275+0000 7f030bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f030c0b35f0 0x7f030c0b83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:46.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.275+0000 7f030bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f030c0b35f0 0x7f030c0b83a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57736/0 (socket says 172.21.15.45:57736) 2023-11-28T18:37:46.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.275+0000 7f030bfff640 1 -- 172.21.15.45:0/460921828 learned_addr learned my addr 172.21.15.45:0/460921828 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:46.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.275+0000 7f031089b640 1 --2- 172.21.15.45:0/460921828 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f030c0cfed0 0x7f030c159a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:46.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.275+0000 7f030b7fe640 1 --2- 172.21.15.45:0/460921828 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f030c0b3cb0 0x7f030c15a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:46.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.275+0000 7f030bfff640 1 -- 172.21.15.45:0/460921828 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f030c0cfed0 msgr2=0x7f030c159a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:46.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.275+0000 7f030bfff640 1 --2- 172.21.15.45:0/460921828 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f030c0cfed0 0x7f030c159a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:46.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.275+0000 7f030bfff640 1 -- 172.21.15.45:0/460921828 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f030c0b3cb0 msgr2=0x7f030c15a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:46.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.275+0000 7f030bfff640 1 --2- 172.21.15.45:0/460921828 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f030c0b3cb0 0x7f030c15a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:46.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.275+0000 7f030bfff640 1 -- 172.21.15.45:0/460921828 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0304009b30 con 0x7f030c0b35f0 2023-11-28T18:37:46.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.275+0000 7f030bfff640 1 --2- 172.21.15.45:0/460921828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f030c0b35f0 0x7f030c0b83a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f02fc00c7f0 tx=0x7f02fc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:46.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.275+0000 7f0308ff9640 1 -- 172.21.15.45:0/460921828 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02fc004220 con 0x7f030c0b35f0 2023-11-28T18:37:46.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.275+0000 7f0308ff9640 1 -- 172.21.15.45:0/460921828 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02fc0043a0 con 0x7f030c0b35f0 2023-11-28T18:37:46.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.275+0000 7f03122fe640 1 -- 172.21.15.45:0/460921828 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f030c15a940 con 0x7f030c0b35f0 2023-11-28T18:37:46.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.275+0000 7f0308ff9640 1 -- 172.21.15.45:0/460921828 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02fc004510 con 0x7f030c0b35f0 2023-11-28T18:37:46.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.275+0000 7f03122fe640 1 -- 172.21.15.45:0/460921828 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f030c15af00 con 0x7f030c0b35f0 2023-11-28T18:37:46.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.275+0000 7f03122fe640 1 -- 172.21.15.45:0/460921828 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f030c069480 con 0x7f030c0b35f0 2023-11-28T18:37:46.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.279+0000 7f0308ff9640 1 -- 172.21.15.45:0/460921828 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f02fc003a70 con 0x7f030c0b35f0 2023-11-28T18:37:46.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.279+0000 7f0308ff9640 1 --2- 172.21.15.45:0/460921828 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f02f80668d0 0x7f02f8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:46.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.279+0000 7f0308ff9640 1 -- 172.21.15.45:0/460921828 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f02fc084420 con 0x7f030c0b35f0 2023-11-28T18:37:46.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.279+0000 7f030b7fe640 1 --2- 172.21.15.45:0/460921828 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f02f80668d0 0x7f02f8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:46.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.279+0000 7f030b7fe640 1 --2- 172.21.15.45:0/460921828 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f02f80668d0 0x7f02f8068d90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f030c0b71c0 tx=0x7f0300009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:46.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.283+0000 7f0308ff9640 1 -- 172.21.15.45:0/460921828 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f02fc051670 con 0x7f030c0b35f0 2023-11-28T18:37:46.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.471+0000 7f03122fe640 1 -- 172.21.15.45:0/460921828 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f030c0d0760 con 0x7f030c0b35f0 2023-11-28T18:37:46.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.475+0000 7f0308ff9640 1 -- 172.21.15.45:0/460921828 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4910 (secure 0 0 0) 0x7f02fc054c90 con 0x7f030c0b35f0 2023-11-28T18:37:46.478 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:37:46.479 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/972230763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":972230763},{"type":"v1","addr":"172.21.15.45:6835","nonce":972230763}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/4274475693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":4274475693},{"type":"v1","addr":"172.21.15.190:6837","nonce":4274475693}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/3154556740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":3154556740},{"type":"v1","addr":"172.21.15.190:6836","nonce":3154556740}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T18:37:32.842966+0000","modified":"2023-11-28T18:37:35.841966+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6834/1657221272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1657221272},{"type":"v1","addr":"172.21.15.45:6834","nonce":1657221272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T18:37:46.479 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 8 2023-11-28T18:37:46.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.475+0000 7f03122fe640 1 -- 172.21.15.45:0/460921828 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f02f80668d0 msgr2=0x7f02f8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:46.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.475+0000 7f03122fe640 1 --2- 172.21.15.45:0/460921828 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f02f80668d0 0x7f02f8068d90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f030c0b71c0 tx=0x7f0300009040 comp rx=0 tx=0).stop 2023-11-28T18:37:46.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.475+0000 7f03122fe640 1 -- 172.21.15.45:0/460921828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f030c0b35f0 msgr2=0x7f030c0b83a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:46.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.475+0000 7f03122fe640 1 --2- 172.21.15.45:0/460921828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f030c0b35f0 0x7f030c0b83a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f02fc00c7f0 tx=0x7f02fc00ccb0 comp rx=0 tx=0).stop 2023-11-28T18:37:46.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.475+0000 7f03122fe640 1 -- 172.21.15.45:0/460921828 shutdown_connections 2023-11-28T18:37:46.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.475+0000 7f03122fe640 1 --2- 172.21.15.45:0/460921828 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f02f80668d0 0x7f02f8068d90 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:46.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.475+0000 7f03122fe640 1 --2- 172.21.15.45:0/460921828 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f030c0cfed0 0x7f030c159a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:46.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.475+0000 7f03122fe640 1 --2- 172.21.15.45:0/460921828 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f030c0b3cb0 0x7f030c15a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:46.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.475+0000 7f03122fe640 1 --2- 172.21.15.45:0/460921828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f030c0b35f0 0x7f030c0b83a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:46.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.475+0000 7f03122fe640 1 -- 172.21.15.45:0/460921828 >> 172.21.15.45:0/460921828 conn(0x7f030c09c4f0 msgr2=0x7f030c0afe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:46.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.475+0000 7f03122fe640 1 -- 172.21.15.45:0/460921828 shutdown_connections 2023-11-28T18:37:46.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.475+0000 7f03122fe640 1 -- 172.21.15.45:0/460921828 wait complete. 2023-11-28T18:37:46.500 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T18:37:46.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.639+0000 7f719a479640 1 Processor -- start 2023-11-28T18:37:46.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.639+0000 7f719a479640 1 -- start start 2023-11-28T18:37:46.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.639+0000 7f719a479640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f71940b35f0 0x7f71940d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:46.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.639+0000 7f719a479640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f71940cfed0 0x7f719415f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:46.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.639+0000 7f719a479640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71940d38c0 con 0x7f71940b3cb0 2023-11-28T18:37:46.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.639+0000 7f719a479640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71940d40d0 con 0x7f71940b35f0 2023-11-28T18:37:46.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.639+0000 7f719a479640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71940cdcc0 con 0x7f71940cfed0 2023-11-28T18:37:46.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.639+0000 7f71937fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f71940b3cb0 0x7f71940cf7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57816/0 (socket says 172.21.15.45:57816) 2023-11-28T18:37:46.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.639+0000 7f71937fe640 1 -- 172.21.15.45:0/3205411411 learned_addr learned my addr 172.21.15.45:0/3205411411 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:37:46.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.639+0000 7f7193fff640 1 --2- 172.21.15.45:0/3205411411 >> v2:172.21.15.190:3300/0 conn(0x7f71940b35f0 0x7f71940d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:46.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.639+0000 7f7198a16640 1 --2- 172.21.15.45:0/3205411411 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f71940cfed0 0x7f719415f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:46.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.639+0000 7f7192ffd640 1 -- 172.21.15.45:0/3205411411 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 553820106 0 0) 0x7f71940d38c0 con 0x7f71940b3cb0 2023-11-28T18:37:46.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.639+0000 7f7192ffd640 1 -- 172.21.15.45:0/3205411411 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f717c003530 con 0x7f71940b3cb0 2023-11-28T18:37:46.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.639+0000 7f7193fff640 1 -- 172.21.15.45:0/3205411411 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f71940cfed0 msgr2=0x7f719415f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:46.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.639+0000 7f7193fff640 1 --2- 172.21.15.45:0/3205411411 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f71940cfed0 0x7f719415f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:46.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.639+0000 7f7193fff640 1 -- 172.21.15.45:0/3205411411 >> v1:172.21.15.45:6789/0 conn(0x7f71940b3cb0 legacy=0x7f71940cf7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:46.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.639+0000 7f7193fff640 1 -- 172.21.15.45:0/3205411411 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71940d3b10 con 0x7f71940b35f0 2023-11-28T18:37:46.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.643+0000 7f7193fff640 1 --2- 172.21.15.45:0/3205411411 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f71940b35f0 0x7f71940d0f90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f71840097c0 tx=0x7f718401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55d44e5ef37aa319 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:46.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.643+0000 7f7192ffd640 1 -- 172.21.15.45:0/3205411411 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71840ab680 con 0x7f71940b35f0 2023-11-28T18:37:46.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.643+0000 7f7192ffd640 1 -- 172.21.15.45:0/3205411411 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71840ab7e0 con 0x7f71940b35f0 2023-11-28T18:37:46.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.643+0000 7f7192ffd640 1 -- 172.21.15.45:0/3205411411 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71840abb50 con 0x7f71940b35f0 2023-11-28T18:37:46.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.643+0000 7f719a479640 1 -- 172.21.15.45:0/3205411411 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f71940b35f0 msgr2=0x7f71940d0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:46.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.643+0000 7f719a479640 1 --2- 172.21.15.45:0/3205411411 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f71940b35f0 0x7f71940d0f90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f71840097c0 tx=0x7f718401c480 comp rx=0 tx=0).stop 2023-11-28T18:37:46.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.643+0000 7f719a479640 1 -- 172.21.15.45:0/3205411411 shutdown_connections 2023-11-28T18:37:46.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.643+0000 7f719a479640 1 --2- 172.21.15.45:0/3205411411 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f71940cfed0 0x7f719415f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:46.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.643+0000 7f719a479640 1 --2- 172.21.15.45:0/3205411411 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f71940b35f0 0x7f71940d0f90 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:46.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.643+0000 7f719a479640 1 -- 172.21.15.45:0/3205411411 >> 172.21.15.45:0/3205411411 conn(0x7f719409c4f0 msgr2=0x7f71940d31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:46.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.643+0000 7f719a479640 1 -- 172.21.15.45:0/3205411411 shutdown_connections 2023-11-28T18:37:46.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.643+0000 7f719a479640 1 -- 172.21.15.45:0/3205411411 wait complete. 2023-11-28T18:37:46.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.647+0000 7f719a479640 1 Processor -- start 2023-11-28T18:37:46.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.647+0000 7f719a479640 1 -- start start 2023-11-28T18:37:46.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.647+0000 7f719a479640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f71940b35f0 0x7f7194152470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:46.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.647+0000 7f719a479640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f71940b3cb0 0x7f719406c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:46.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.647+0000 7f719a479640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f71940cfed0 0x7f719406ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:46.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.647+0000 7f719a479640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71940b5cc0 con 0x7f71940b3cb0 2023-11-28T18:37:46.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.647+0000 7f719a479640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71940cb7c0 con 0x7f71940cfed0 2023-11-28T18:37:46.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.647+0000 7f719a479640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71941529b0 con 0x7f71940b35f0 2023-11-28T18:37:46.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.647+0000 7f71937fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f71940b3cb0 0x7f719406c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:46.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.647+0000 7f71937fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f71940b3cb0 0x7f719406c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57742/0 (socket says 172.21.15.45:57742) 2023-11-28T18:37:46.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.647+0000 7f71937fe640 1 -- 172.21.15.45:0/1523586205 learned_addr learned my addr 172.21.15.45:0/1523586205 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:46.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.647+0000 7f7193fff640 1 --2- 172.21.15.45:0/1523586205 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f71940b35f0 0x7f7194152470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:46.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.647+0000 7f7198a16640 1 --2- 172.21.15.45:0/1523586205 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f71940cfed0 0x7f719406ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:46.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.647+0000 7f71937fe640 1 -- 172.21.15.45:0/1523586205 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f71940b35f0 msgr2=0x7f7194152470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:46.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.647+0000 7f71937fe640 1 --2- 172.21.15.45:0/1523586205 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f71940b35f0 0x7f7194152470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:46.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.647+0000 7f71937fe640 1 -- 172.21.15.45:0/1523586205 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f71940cfed0 msgr2=0x7f719406ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:46.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.647+0000 7f71937fe640 1 --2- 172.21.15.45:0/1523586205 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f71940cfed0 0x7f719406ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:46.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.647+0000 7f71937fe640 1 -- 172.21.15.45:0/1523586205 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7184009420 con 0x7f71940b3cb0 2023-11-28T18:37:46.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.647+0000 7f71937fe640 1 --2- 172.21.15.45:0/1523586205 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f71940b3cb0 0x7f719406c7b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f718800c450 tx=0x7f718800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:46.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.647+0000 7f7190ff9640 1 -- 172.21.15.45:0/1523586205 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7188005cf0 con 0x7f71940b3cb0 2023-11-28T18:37:46.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.647+0000 7f7190ff9640 1 -- 172.21.15.45:0/1523586205 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7188005e50 con 0x7f71940b3cb0 2023-11-28T18:37:46.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.647+0000 7f719a479640 1 -- 172.21.15.45:0/1523586205 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71940caf20 con 0x7f71940b3cb0 2023-11-28T18:37:46.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.647+0000 7f7190ff9640 1 -- 172.21.15.45:0/1523586205 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7188007290 con 0x7f71940b3cb0 2023-11-28T18:37:46.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.647+0000 7f719a479640 1 -- 172.21.15.45:0/1523586205 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71940cb4e0 con 0x7f71940b3cb0 2023-11-28T18:37:46.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.651+0000 7f719a479640 1 -- 172.21.15.45:0/1523586205 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7194069480 con 0x7f71940b3cb0 2023-11-28T18:37:46.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.651+0000 7f7190ff9640 1 -- 172.21.15.45:0/1523586205 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f71880073f0 con 0x7f71940b3cb0 2023-11-28T18:37:46.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.651+0000 7f7190ff9640 1 --2- 172.21.15.45:0/1523586205 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f71800668d0 0x7f7180068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:46.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.651+0000 7f7190ff9640 1 -- 172.21.15.45:0/1523586205 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f71880839a0 con 0x7f71940b3cb0 2023-11-28T18:37:46.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.651+0000 7f7193fff640 1 --2- 172.21.15.45:0/1523586205 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f71800668d0 0x7f7180068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:46.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.651+0000 7f7193fff640 1 --2- 172.21.15.45:0/1523586205 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f71800668d0 0x7f7180068d90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f71840af000 tx=0x7f71840a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:46.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.655+0000 7f7190ff9640 1 -- 172.21.15.45:0/1523586205 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7188050bf0 con 0x7f71940b3cb0 2023-11-28T18:37:46.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.811+0000 7f719a479640 1 -- 172.21.15.45:0/1523586205 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f71940d0760 con 0x7f71940b3cb0 2023-11-28T18:37:46.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.815+0000 7f7190ff9640 1 -- 172.21.15.45:0/1523586205 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16469 (secure 0 0 0) 0x7f7188017070 con 0x7f71940b3cb0 2023-11-28T18:37:46.819 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:37:46.819 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":20,"fsid":"d10f5cd6-1d00-4019-99b6-6fa435498a15","created":"2023-11-28T18:37:08.189030+0000","modified":"2023-11-28T18:37:33.971141+0000","last_up_change":"2023-11-28T18:37:20.196124+0000","last_in_change":"2023-11-28T18:37:10.742043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T18:37:21.293917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T18:37:31.384760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T18:37:31.834769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"84465384-103c-4f2c-a45a-96f5bb9c835f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6809","nonce":555237322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6811","nonce":555237322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6815","nonce":555237322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6813","nonce":555237322}]},"public_addr":"172.21.15.45:6809/555237322","cluster_addr":"172.21.15.45:6811/555237322","heartbeat_back_addr":"172.21.15.45:6815/555237322","heartbeat_front_addr":"172.21.15.45:6813/555237322","state":["exists","up"]},{"osd":1,"uuid":"7d9eed24-a58f-42c7-a787-ac06be8553fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6801","nonce":2857063763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6803","nonce":2857063763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6807","nonce":2857063763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6805","nonce":2857063763}]},"public_addr":"172.21.15.45:6801/2857063763","cluster_addr":"172.21.15.45:6803/2857063763","heartbeat_back_addr":"172.21.15.45:6807/2857063763","heartbeat_front_addr":"172.21.15.45:6805/2857063763","state":["exists","up"]},{"osd":2,"uuid":"575eeccc-4abf-45b4-9caf-f3e797859588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6817","nonce":193884539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6819","nonce":193884539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6823","nonce":193884539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6821","nonce":193884539}]},"public_addr":"172.21.15.45:6817/193884539","cluster_addr":"172.21.15.45:6819/193884539","heartbeat_back_addr":"172.21.15.45:6823/193884539","heartbeat_front_addr":"172.21.15.45:6821/193884539","state":["exists","up"]},{"osd":3,"uuid":"9b0290d6-9a52-4bc8-b2a1-7622c5dc8e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6825","nonce":78541084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6827","nonce":78541084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6831","nonce":78541084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6829","nonce":78541084}]},"public_addr":"172.21.15.45:6825/78541084","cluster_addr":"172.21.15.45:6827/78541084","heartbeat_back_addr":"172.21.15.45:6831/78541084","heartbeat_front_addr":"172.21.15.45:6829/78541084","state":["exists","up"]},{"osd":4,"uuid":"ce632829-f027-4fbf-a627-02c571aa9d53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6809","nonce":1537591987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6811","nonce":1537591987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6815","nonce":1537591987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6813","nonce":1537591987}]},"public_addr":"172.21.15.190:6809/1537591987","cluster_addr":"172.21.15.190:6811/1537591987","heartbeat_back_addr":"172.21.15.190:6815/1537591987","heartbeat_front_addr":"172.21.15.190:6813/1537591987","state":["exists","up"]},{"osd":5,"uuid":"8700b609-27be-40bd-a251-4c0ae0a29ead","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6801","nonce":3296698407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6803","nonce":3296698407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6807","nonce":3296698407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6805","nonce":3296698407}]},"public_addr":"172.21.15.190:6801/3296698407","cluster_addr":"172.21.15.190:6803/3296698407","heartbeat_back_addr":"172.21.15.190:6807/3296698407","heartbeat_front_addr":"172.21.15.190:6805/3296698407","state":["exists","up"]},{"osd":6,"uuid":"44ce4a40-e6ff-4f4d-8e8a-7341e5c91f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6817","nonce":2317686718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6819","nonce":2317686718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6823","nonce":2317686718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6821","nonce":2317686718}]},"public_addr":"172.21.15.190:6817/2317686718","cluster_addr":"172.21.15.190:6819/2317686718","heartbeat_back_addr":"172.21.15.190:6823/2317686718","heartbeat_front_addr":"172.21.15.190:6821/2317686718","state":["exists","up"]},{"osd":7,"uuid":"192238c9-1423-4b7e-ac8f-84ba32113ddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6825","nonce":2493232051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6827","nonce":2493232051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6831","nonce":2493232051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6829","nonce":2493232051}]},"public_addr":"172.21.15.190:6825/2493232051","cluster_addr":"172.21.15.190:6827/2493232051","heartbeat_back_addr":"172.21.15.190:6831/2493232051","heartbeat_front_addr":"172.21.15.190:6829/2493232051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.393552+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.385453+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.361421+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.366408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.363226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.276007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.414605+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.445885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T18:37:46.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.815+0000 7f719a479640 1 -- 172.21.15.45:0/1523586205 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f71800668d0 msgr2=0x7f7180068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:46.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.815+0000 7f719a479640 1 --2- 172.21.15.45:0/1523586205 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f71800668d0 0x7f7180068d90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f71840af000 tx=0x7f71840a7000 comp rx=0 tx=0).stop 2023-11-28T18:37:46.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.815+0000 7f719a479640 1 -- 172.21.15.45:0/1523586205 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f71940b3cb0 msgr2=0x7f719406c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:46.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.815+0000 7f719a479640 1 --2- 172.21.15.45:0/1523586205 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f71940b3cb0 0x7f719406c7b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f718800c450 tx=0x7f718800c910 comp rx=0 tx=0).stop 2023-11-28T18:37:46.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.815+0000 7f719a479640 1 -- 172.21.15.45:0/1523586205 shutdown_connections 2023-11-28T18:37:46.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.815+0000 7f719a479640 1 --2- 172.21.15.45:0/1523586205 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f71800668d0 0x7f7180068d90 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:46.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.815+0000 7f719a479640 1 --2- 172.21.15.45:0/1523586205 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f71940cfed0 0x7f719406ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:46.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.815+0000 7f719a479640 1 --2- 172.21.15.45:0/1523586205 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f71940b3cb0 0x7f719406c7b0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:46.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.815+0000 7f719a479640 1 --2- 172.21.15.45:0/1523586205 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f71940b35f0 0x7f7194152470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:46.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.815+0000 7f719a479640 1 -- 172.21.15.45:0/1523586205 >> 172.21.15.45:0/1523586205 conn(0x7f719409c4f0 msgr2=0x7f71940d3280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:46.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.815+0000 7f719a479640 1 -- 172.21.15.45:0/1523586205 shutdown_connections 2023-11-28T18:37:46.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.815+0000 7f719a479640 1 -- 172.21.15.45:0/1523586205 wait complete. 2023-11-28T18:37:46.840 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T18:37:21.293917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T18:37:31.384760+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T18:37:31.834769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T18:37:46.840 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T18:37:46.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.979+0000 7f2e85a9c640 1 Processor -- start 2023-11-28T18:37:46.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.983+0000 7f2e85a9c640 1 -- start start 2023-11-28T18:37:46.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.983+0000 7f2e85a9c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e800b4780 0x7f2e8006cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:46.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.983+0000 7f2e85a9c640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e8015e940 con 0x7f2e801469a0 2023-11-28T18:37:46.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.983+0000 7f2e85a9c640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e8015dd30 con 0x7f2e8015edd0 2023-11-28T18:37:46.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.983+0000 7f2e85a9c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8015e010 con 0x7f2e800b4780 2023-11-28T18:37:46.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.983+0000 7f2e7f7fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f2e801469a0 0x7f2e800b4070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57828/0 (socket says 172.21.15.45:57828) 2023-11-28T18:37:46.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.983+0000 7f2e7f7fe640 1 -- 172.21.15.45:0/801092268 learned_addr learned my addr 172.21.15.45:0/801092268 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:37:46.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.983+0000 7f2e7effd640 1 --2- 172.21.15.45:0/801092268 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e800b4780 0x7f2e8006cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:46.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.983+0000 7f2e7e7fc640 1 -- 172.21.15.45:0/801092268 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3443699957 0 0) 0x7f2e8015e940 con 0x7f2e801469a0 2023-11-28T18:37:46.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.983+0000 7f2e7e7fc640 1 -- 172.21.15.45:0/801092268 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e68003530 con 0x7f2e801469a0 2023-11-28T18:37:46.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.983+0000 7f2e7e7fc640 1 -- 172.21.15.45:0/801092268 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4178371487 0 0) 0x7f2e68003530 con 0x7f2e801469a0 2023-11-28T18:37:46.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.983+0000 7f2e7e7fc640 1 -- 172.21.15.45:0/801092268 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e800b4780 msgr2=0x7f2e8006cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:46.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.983+0000 7f2e7e7fc640 1 --2- 172.21.15.45:0/801092268 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e800b4780 0x7f2e8006cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:46.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.983+0000 7f2e7e7fc640 1 -- 172.21.15.45:0/801092268 >> v1:172.21.15.190:6789/0 conn(0x7f2e8015edd0 legacy=0x7f2e8015f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:46.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.983+0000 7f2e7e7fc640 1 -- 172.21.15.45:0/801092268 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e8015e2f0 con 0x7f2e801469a0 2023-11-28T18:37:46.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.983+0000 7f2e7e7fc640 1 -- 172.21.15.45:0/801092268 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4084481567 0 0) 0x7f2e70001680 con 0x7f2e801469a0 2023-11-28T18:37:46.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.983+0000 7f2e7e7fc640 1 -- 172.21.15.45:0/801092268 >> v1:172.21.15.45:6789/0 conn(0x7f2e801469a0 legacy=0x7f2e800b4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:46.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.983+0000 7f2e7e7fc640 1 --2- 172.21.15.45:0/801092268 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e800b4780 0x7f2e680039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:46.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.983+0000 7f2e7e7fc640 1 --2- 172.21.15.45:0/801092268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e68003ef0 0x7f2e680047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:46.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.983+0000 7f2e7e7fc640 1 --2- 172.21.15.45:0/801092268 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2e68004d10 0x7f2e68005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:46.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.983+0000 7f2e7e7fc640 1 -- 172.21.15.45:0/801092268 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8015e010 con 0x7f2e68003ef0 2023-11-28T18:37:46.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.983+0000 7f2e7e7fc640 1 -- 172.21.15.45:0/801092268 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6800b9f0 con 0x7f2e68004d10 2023-11-28T18:37:46.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.983+0000 7f2e7e7fc640 1 -- 172.21.15.45:0/801092268 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6800bbb0 con 0x7f2e800b4780 2023-11-28T18:37:46.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.983+0000 7f2e7effd640 1 --2- 172.21.15.45:0/801092268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e68003ef0 0x7f2e680047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:46.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.983+0000 7f2e7ffff640 1 --2- 172.21.15.45:0/801092268 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2e68004d10 0x7f2e68005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:46.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.983+0000 7f2e7f7fe640 1 --2- 172.21.15.45:0/801092268 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e800b4780 0x7f2e680039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:46.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.983+0000 7f2e7effd640 1 -- 172.21.15.45:0/801092268 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e800b4780 msgr2=0x7f2e680039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:46.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.983+0000 7f2e7effd640 1 --2- 172.21.15.45:0/801092268 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e800b4780 0x7f2e680039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:46.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.983+0000 7f2e7effd640 1 -- 172.21.15.45:0/801092268 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2e68004d10 msgr2=0x7f2e68005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:46.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.983+0000 7f2e7effd640 1 --2- 172.21.15.45:0/801092268 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2e68004d10 0x7f2e68005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:46.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.983+0000 7f2e7effd640 1 -- 172.21.15.45:0/801092268 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e68003530 con 0x7f2e68003ef0 2023-11-28T18:37:46.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.987+0000 7f2e7effd640 1 --2- 172.21.15.45:0/801092268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e68003ef0 0x7f2e680047d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2e74009ae0 tx=0x7f2e7401c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64b23f6051f62148 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:46.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.987+0000 7f2e7e7fc640 1 -- 172.21.15.45:0/801092268 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e740a5580 con 0x7f2e68003ef0 2023-11-28T18:37:46.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.987+0000 7f2e7e7fc640 1 -- 172.21.15.45:0/801092268 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e740a56e0 con 0x7f2e68003ef0 2023-11-28T18:37:46.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.987+0000 7f2e7e7fc640 1 -- 172.21.15.45:0/801092268 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e740a5a90 con 0x7f2e68003ef0 2023-11-28T18:37:46.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.987+0000 7f2e85a9c640 1 -- 172.21.15.45:0/801092268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e68003ef0 msgr2=0x7f2e680047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:46.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.987+0000 7f2e85a9c640 1 --2- 172.21.15.45:0/801092268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e68003ef0 0x7f2e680047d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2e74009ae0 tx=0x7f2e7401c990 comp rx=0 tx=0).stop 2023-11-28T18:37:46.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.987+0000 7f2e7ffff640 1 -- 172.21.15.45:0/801092268 reap_dead start 2023-11-28T18:37:46.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.987+0000 7f2e85a9c640 1 -- 172.21.15.45:0/801092268 shutdown_connections 2023-11-28T18:37:46.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.987+0000 7f2e85a9c640 1 -- 172.21.15.45:0/801092268 >> 172.21.15.45:0/801092268 conn(0x7f2e80070b80 msgr2=0x7f2e80066360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:46.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.987+0000 7f2e85a9c640 1 -- 172.21.15.45:0/801092268 shutdown_connections 2023-11-28T18:37:46.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.987+0000 7f2e85a9c640 1 -- 172.21.15.45:0/801092268 wait complete. 2023-11-28T18:37:46.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.991+0000 7f2e85a9c640 1 Processor -- start 2023-11-28T18:37:46.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.991+0000 7f2e85a9c640 1 -- start start 2023-11-28T18:37:46.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.991+0000 7f2e85a9c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e68003ef0 0x7f2e80143d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:46.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.991+0000 7f2e85a9c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e8013d890 0x7f2e8013bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:46.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.991+0000 7f2e85a9c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2e8013c320 0x7f2e8013e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:46.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.991+0000 7f2e85a9c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8013f570 con 0x7f2e8013d890 2023-11-28T18:37:46.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.991+0000 7f2e85a9c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8013cad0 con 0x7f2e8013c320 2023-11-28T18:37:46.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.991+0000 7f2e85a9c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8013cdb0 con 0x7f2e68003ef0 2023-11-28T18:37:46.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.991+0000 7f2e7effd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e8013d890 0x7f2e8013bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:46.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.991+0000 7f2e7effd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e8013d890 0x7f2e8013bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57754/0 (socket says 172.21.15.45:57754) 2023-11-28T18:37:46.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.991+0000 7f2e7effd640 1 -- 172.21.15.45:0/1056697890 learned_addr learned my addr 172.21.15.45:0/1056697890 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:46.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.991+0000 7f2e7f7fe640 1 --2- 172.21.15.45:0/1056697890 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e68003ef0 0x7f2e80143d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:46.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.991+0000 7f2e7ffff640 1 --2- 172.21.15.45:0/1056697890 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2e8013c320 0x7f2e8013e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:46.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.991+0000 7f2e7effd640 1 -- 172.21.15.45:0/1056697890 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e68003ef0 msgr2=0x7f2e80143d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:46.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.991+0000 7f2e7effd640 1 --2- 172.21.15.45:0/1056697890 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e68003ef0 0x7f2e80143d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:46.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.991+0000 7f2e7effd640 1 -- 172.21.15.45:0/1056697890 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2e8013c320 msgr2=0x7f2e8013e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:46.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.991+0000 7f2e7effd640 1 --2- 172.21.15.45:0/1056697890 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2e8013c320 0x7f2e8013e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:46.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.991+0000 7f2e7effd640 1 -- 172.21.15.45:0/1056697890 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e8013d090 con 0x7f2e8013d890 2023-11-28T18:37:46.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.991+0000 7f2e7effd640 1 --2- 172.21.15.45:0/1056697890 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e8013d890 0x7f2e8013bde0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2e74009ae0 tx=0x7f2e68005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:46.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.991+0000 7f2e67fff640 1 -- 172.21.15.45:0/1056697890 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e740a5580 con 0x7f2e8013d890 2023-11-28T18:37:46.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.991+0000 7f2e67fff640 1 -- 172.21.15.45:0/1056697890 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e74004230 con 0x7f2e8013d890 2023-11-28T18:37:46.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.991+0000 7f2e67fff640 1 -- 172.21.15.45:0/1056697890 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e74003620 con 0x7f2e8013d890 2023-11-28T18:37:46.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.991+0000 7f2e85a9c640 1 -- 172.21.15.45:0/1056697890 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e8013d370 con 0x7f2e8013d890 2023-11-28T18:37:46.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.991+0000 7f2e85a9c640 1 -- 172.21.15.45:0/1056697890 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e80144270 con 0x7f2e8013d890 2023-11-28T18:37:46.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.995+0000 7f2e85a9c640 1 -- 172.21.15.45:0/1056697890 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e80144460 con 0x7f2e8013d890 2023-11-28T18:37:46.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.995+0000 7f2e67fff640 1 -- 172.21.15.45:0/1056697890 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f2e740b4040 con 0x7f2e8013d890 2023-11-28T18:37:47.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.995+0000 7f2e67fff640 1 --2- 172.21.15.45:0/1056697890 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f2e6c066900 0x7f2e6c068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:47.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.995+0000 7f2e67fff640 1 -- 172.21.15.45:0/1056697890 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2e7411ddf0 con 0x7f2e8013d890 2023-11-28T18:37:47.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.995+0000 7f2e7f7fe640 1 --2- 172.21.15.45:0/1056697890 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f2e6c066900 0x7f2e6c068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:47.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.995+0000 7f2e7f7fe640 1 --2- 172.21.15.45:0/1056697890 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f2e6c066900 0x7f2e6c068dc0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2e70001060 tx=0x7f2e70000f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:47.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:46.999+0000 7f2e67fff640 1 -- 172.21.15.45:0/1056697890 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2e80144460 con 0x7f2e8013d890 2023-11-28T18:37:47.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.159+0000 7f2e85a9c640 1 -- 172.21.15.45:0/1056697890 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2e80144460 con 0x7f2e8013d890 2023-11-28T18:37:47.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.159+0000 7f2e67fff640 1 -- 172.21.15.45:0/1056697890 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2e80144460 con 0x7f2e8013d890 2023-11-28T18:37:47.164 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-11-28T18:37:47.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.159+0000 7f2e85a9c640 1 -- 172.21.15.45:0/1056697890 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f2e6c066900 msgr2=0x7f2e6c068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:47.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.159+0000 7f2e85a9c640 1 --2- 172.21.15.45:0/1056697890 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f2e6c066900 0x7f2e6c068dc0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2e70001060 tx=0x7f2e70000f90 comp rx=0 tx=0).stop 2023-11-28T18:37:47.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.159+0000 7f2e85a9c640 1 -- 172.21.15.45:0/1056697890 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e8013d890 msgr2=0x7f2e8013bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:47.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.159+0000 7f2e85a9c640 1 --2- 172.21.15.45:0/1056697890 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e8013d890 0x7f2e8013bde0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2e74009ae0 tx=0x7f2e68005800 comp rx=0 tx=0).stop 2023-11-28T18:37:47.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.159+0000 7f2e85a9c640 1 -- 172.21.15.45:0/1056697890 shutdown_connections 2023-11-28T18:37:47.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.159+0000 7f2e85a9c640 1 --2- 172.21.15.45:0/1056697890 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f2e6c066900 0x7f2e6c068dc0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:47.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.159+0000 7f2e85a9c640 1 --2- 172.21.15.45:0/1056697890 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2e8013c320 0x7f2e8013e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:47.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.159+0000 7f2e85a9c640 1 --2- 172.21.15.45:0/1056697890 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e8013d890 0x7f2e8013bde0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:47.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.159+0000 7f2e85a9c640 1 --2- 172.21.15.45:0/1056697890 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e68003ef0 0x7f2e80143d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:47.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.159+0000 7f2e85a9c640 1 -- 172.21.15.45:0/1056697890 >> 172.21.15.45:0/1056697890 conn(0x7f2e80070b80 msgr2=0x7f2e800b22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:47.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.159+0000 7f2e85a9c640 1 -- 172.21.15.45:0/1056697890 shutdown_connections 2023-11-28T18:37:47.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.159+0000 7f2e85a9c640 1 -- 172.21.15.45:0/1056697890 wait complete. 2023-11-28T18:37:47.185 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T18:37:47.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.327+0000 7f6ab2196640 1 Processor -- start 2023-11-28T18:37:47.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.327+0000 7f6ab2196640 1 -- start start 2023-11-28T18:37:47.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.327+0000 7f6ab2196640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6aac158ce0 0x7f6aac15eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:47.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.327+0000 7f6ab2196640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6aac15b6b0 con 0x7f6aac0b4310 2023-11-28T18:37:47.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.327+0000 7f6ab2196640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6aac15c550 con 0x7f6aac0cba50 2023-11-28T18:37:47.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.327+0000 7f6ab2196640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6aac15f450 con 0x7f6aac158ce0 2023-11-28T18:37:47.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.331+0000 7f6aabfff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f6aac0b4310 0x7f6aac070430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57842/0 (socket says 172.21.15.45:57842) 2023-11-28T18:37:47.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.331+0000 7f6aabfff640 1 -- 172.21.15.45:0/483300634 learned_addr learned my addr 172.21.15.45:0/483300634 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:37:47.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.331+0000 7f6aab7fe640 1 --2- 172.21.15.45:0/483300634 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6aac158ce0 0x7f6aac15eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:47.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.331+0000 7f6aaaffd640 1 -- 172.21.15.45:0/483300634 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2873520207 0 0) 0x7f6aac15b6b0 con 0x7f6aac0b4310 2023-11-28T18:37:47.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.331+0000 7f6aaaffd640 1 -- 172.21.15.45:0/483300634 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a98003530 con 0x7f6aac0b4310 2023-11-28T18:37:47.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.331+0000 7f6aaaffd640 1 -- 172.21.15.45:0/483300634 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2873735024 0 0) 0x7f6a98003530 con 0x7f6aac0b4310 2023-11-28T18:37:47.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.331+0000 7f6aab7fe640 1 -- 172.21.15.45:0/483300634 >> v1:172.21.15.190:6789/0 conn(0x7f6aac0cba50 legacy=0x7f6aac15be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:47.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.331+0000 7f6aab7fe640 1 -- 172.21.15.45:0/483300634 >> v1:172.21.15.45:6789/0 conn(0x7f6aac0b4310 legacy=0x7f6aac070430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:47.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.331+0000 7f6aab7fe640 1 -- 172.21.15.45:0/483300634 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aac15f730 con 0x7f6aac158ce0 2023-11-28T18:37:47.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.331+0000 7f6aab7fe640 1 --2- 172.21.15.45:0/483300634 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6aac158ce0 0x7f6aac15eb90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c0097f0 tx=0x7f6a9c01c3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7f99f674abc8243 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:47.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.335+0000 7f6aaaffd640 1 -- 172.21.15.45:0/483300634 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa4001a00 con 0x7f6aac158ce0 2023-11-28T18:37:47.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.335+0000 7f6aaaffd640 1 -- 172.21.15.45:0/483300634 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a9c0a7050 con 0x7f6aac158ce0 2023-11-28T18:37:47.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.335+0000 7f6aaaffd640 1 -- 172.21.15.45:0/483300634 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9c004250 con 0x7f6aac158ce0 2023-11-28T18:37:47.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.335+0000 7f6ab2196640 1 -- 172.21.15.45:0/483300634 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6aac158ce0 msgr2=0x7f6aac15eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:47.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.335+0000 7f6ab2196640 1 --2- 172.21.15.45:0/483300634 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6aac158ce0 0x7f6aac15eb90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c0097f0 tx=0x7f6a9c01c3b0 comp rx=0 tx=0).stop 2023-11-28T18:37:47.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.335+0000 7f6ab2196640 1 -- 172.21.15.45:0/483300634 shutdown_connections 2023-11-28T18:37:47.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.335+0000 7f6ab2196640 1 --2- 172.21.15.45:0/483300634 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6aac158ce0 0x7f6aac15eb90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:47.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.335+0000 7f6ab2196640 1 -- 172.21.15.45:0/483300634 >> 172.21.15.45:0/483300634 conn(0x7f6aac0b0d00 msgr2=0x7f6aac0b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:47.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.335+0000 7f6ab2196640 1 -- 172.21.15.45:0/483300634 shutdown_connections 2023-11-28T18:37:47.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.335+0000 7f6ab2196640 1 -- 172.21.15.45:0/483300634 wait complete. 2023-11-28T18:37:47.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.335+0000 7f6ab2196640 1 Processor -- start 2023-11-28T18:37:47.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.335+0000 7f6ab2196640 1 -- start start 2023-11-28T18:37:47.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.335+0000 7f6ab2196640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6aac0b4310 0x7f6aac145180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:47.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.335+0000 7f6ab2196640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6aac0cba50 0x7f6aac146c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:47.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.335+0000 7f6ab2196640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6aac158ce0 0x7f6aac148630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:47.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.335+0000 7f6ab2196640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aac15d810 con 0x7f6aac158ce0 2023-11-28T18:37:47.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.335+0000 7f6ab2196640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aac1456c0 con 0x7f6aac0b4310 2023-11-28T18:37:47.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.335+0000 7f6ab2196640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6aac147180 con 0x7f6aac0cba50 2023-11-28T18:37:47.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.335+0000 7f6aabfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6aac158ce0 0x7f6aac148630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:47.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.335+0000 7f6aabfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6aac158ce0 0x7f6aac148630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57764/0 (socket says 172.21.15.45:57764) 2023-11-28T18:37:47.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.335+0000 7f6aabfff640 1 -- 172.21.15.45:0/3910191417 learned_addr learned my addr 172.21.15.45:0/3910191417 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:47.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.339+0000 7f6aab7fe640 1 --2- 172.21.15.45:0/3910191417 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6aac0b4310 0x7f6aac145180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:47.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.339+0000 7f6aa3fff640 1 --2- 172.21.15.45:0/3910191417 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6aac0cba50 0x7f6aac146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:47.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.339+0000 7f6aabfff640 1 -- 172.21.15.45:0/3910191417 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6aac0cba50 msgr2=0x7f6aac146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:47.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.339+0000 7f6aabfff640 1 --2- 172.21.15.45:0/3910191417 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6aac0cba50 0x7f6aac146c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:47.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.339+0000 7f6aabfff640 1 -- 172.21.15.45:0/3910191417 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6aac0b4310 msgr2=0x7f6aac145180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:47.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.339+0000 7f6aabfff640 1 --2- 172.21.15.45:0/3910191417 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6aac0b4310 0x7f6aac145180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:47.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.339+0000 7f6aabfff640 1 -- 172.21.15.45:0/3910191417 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a9c009420 con 0x7f6aac158ce0 2023-11-28T18:37:47.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.339+0000 7f6aab7fe640 1 --2- 172.21.15.45:0/3910191417 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6aac0b4310 0x7f6aac145180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:37:47.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.339+0000 7f6aabfff640 1 --2- 172.21.15.45:0/3910191417 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6aac158ce0 0x7f6aac148630 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6aa40018a0 tx=0x7f6aa400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:47.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.339+0000 7f6aa8ff9640 1 -- 172.21.15.45:0/3910191417 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa4012400 con 0x7f6aac158ce0 2023-11-28T18:37:47.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.339+0000 7f6aa8ff9640 1 -- 172.21.15.45:0/3910191417 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aa4012560 con 0x7f6aac158ce0 2023-11-28T18:37:47.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.339+0000 7f6aa8ff9640 1 -- 172.21.15.45:0/3910191417 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa4012910 con 0x7f6aac158ce0 2023-11-28T18:37:47.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.339+0000 7f6ab2196640 1 -- 172.21.15.45:0/3910191417 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6aac15cc00 con 0x7f6aac158ce0 2023-11-28T18:37:47.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.339+0000 7f6ab2196640 1 -- 172.21.15.45:0/3910191417 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6aac15d1c0 con 0x7f6aac158ce0 2023-11-28T18:37:47.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.339+0000 7f6ab2196640 1 -- 172.21.15.45:0/3910191417 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6aac15d980 con 0x7f6aac158ce0 2023-11-28T18:37:47.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.339+0000 7f6aa8ff9640 1 -- 172.21.15.45:0/3910191417 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f6aa4012a70 con 0x7f6aac158ce0 2023-11-28T18:37:47.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.339+0000 7f6aa8ff9640 1 --2- 172.21.15.45:0/3910191417 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6a8c066900 0x7f6a8c068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:47.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.339+0000 7f6aa8ff9640 1 -- 172.21.15.45:0/3910191417 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6aa4084c00 con 0x7f6aac158ce0 2023-11-28T18:37:47.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.343+0000 7f6aab7fe640 1 --2- 172.21.15.45:0/3910191417 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6a8c066900 0x7f6a8c068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:47.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.343+0000 7f6aab7fe640 1 --2- 172.21.15.45:0/3910191417 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6a8c066900 0x7f6a8c068dc0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c0ad000 tx=0x7f6a9c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:47.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.343+0000 7f6aa8ff9640 1 -- 172.21.15.45:0/3910191417 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6aa408b080 con 0x7f6aac158ce0 2023-11-28T18:37:47.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.499+0000 7f6ab2196640 1 -- 172.21.15.45:0/3910191417 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6aac069410 con 0x7f6aac158ce0 2023-11-28T18:37:47.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.499+0000 7f6aa8ff9640 1 -- 172.21.15.45:0/3910191417 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6aa4051ed0 con 0x7f6aac158ce0 2023-11-28T18:37:47.506 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-11-28T18:37:47.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.503+0000 7f6ab2196640 1 -- 172.21.15.45:0/3910191417 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6a8c066900 msgr2=0x7f6a8c068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:47.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.503+0000 7f6ab2196640 1 --2- 172.21.15.45:0/3910191417 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6a8c066900 0x7f6a8c068dc0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c0ad000 tx=0x7f6a9c008040 comp rx=0 tx=0).stop 2023-11-28T18:37:47.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.503+0000 7f6ab2196640 1 -- 172.21.15.45:0/3910191417 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6aac158ce0 msgr2=0x7f6aac148630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:47.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.503+0000 7f6ab2196640 1 --2- 172.21.15.45:0/3910191417 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6aac158ce0 0x7f6aac148630 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6aa40018a0 tx=0x7f6aa400a430 comp rx=0 tx=0).stop 2023-11-28T18:37:47.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.503+0000 7f6ab2196640 1 -- 172.21.15.45:0/3910191417 shutdown_connections 2023-11-28T18:37:47.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.503+0000 7f6ab2196640 1 --2- 172.21.15.45:0/3910191417 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6a8c066900 0x7f6a8c068dc0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:47.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.503+0000 7f6ab2196640 1 --2- 172.21.15.45:0/3910191417 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6aac158ce0 0x7f6aac148630 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:47.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.503+0000 7f6ab2196640 1 --2- 172.21.15.45:0/3910191417 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6aac0cba50 0x7f6aac146c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:47.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.503+0000 7f6ab2196640 1 --2- 172.21.15.45:0/3910191417 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6aac0b4310 0x7f6aac145180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:47.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.503+0000 7f6ab2196640 1 -- 172.21.15.45:0/3910191417 >> 172.21.15.45:0/3910191417 conn(0x7f6aac0b0d00 msgr2=0x7f6aac1591e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:47.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.503+0000 7f6ab2196640 1 -- 172.21.15.45:0/3910191417 shutdown_connections 2023-11-28T18:37:47.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.503+0000 7f6ab2196640 1 -- 172.21.15.45:0/3910191417 wait complete. 2023-11-28T18:37:47.527 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T18:37:47.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.666+0000 7fec3425f640 1 Processor -- start 2023-11-28T18:37:47.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.666+0000 7fec3425f640 1 -- start start 2023-11-28T18:37:47.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.670+0000 7fec3425f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fec2c14b220 0x7fec2c0b3e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:47.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.670+0000 7fec3425f640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec2c0b2000 con 0x7fec2c0b4390 2023-11-28T18:37:47.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.670+0000 7fec3425f640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec2c0b22a0 con 0x7fec2c14ac20 2023-11-28T18:37:47.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.670+0000 7fec3425f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec2c0b4820 con 0x7fec2c14b220 2023-11-28T18:37:47.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.670+0000 7fec327fc640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fec2c0b4390 0x7fec2c070430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57846/0 (socket says 172.21.15.45:57846) 2023-11-28T18:37:47.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.670+0000 7fec327fc640 1 -- 172.21.15.45:0/802087166 learned_addr learned my addr 172.21.15.45:0/802087166 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:37:47.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.670+0000 7fec317fa640 1 --2- 172.21.15.45:0/802087166 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fec2c14b220 0x7fec2c0b3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:47.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.670+0000 7fec30ff9640 1 -- 172.21.15.45:0/802087166 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1643919124 0 0) 0x7fec2c0b2000 con 0x7fec2c0b4390 2023-11-28T18:37:47.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.670+0000 7fec30ff9640 1 -- 172.21.15.45:0/802087166 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec18003530 con 0x7fec2c0b4390 2023-11-28T18:37:47.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.670+0000 7fec30ff9640 1 -- 172.21.15.45:0/802087166 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1158062770 0 0) 0x7fec18003530 con 0x7fec2c0b4390 2023-11-28T18:37:47.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.670+0000 7fec30ff9640 1 -- 172.21.15.45:0/802087166 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fec2c14b220 msgr2=0x7fec2c0b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:47.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.670+0000 7fec30ff9640 1 --2- 172.21.15.45:0/802087166 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fec2c14b220 0x7fec2c0b3e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:47.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.670+0000 7fec30ff9640 1 -- 172.21.15.45:0/802087166 >> v1:172.21.15.190:6789/0 conn(0x7fec2c14ac20 legacy=0x7fec2c165a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:47.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.670+0000 7fec30ff9640 1 -- 172.21.15.45:0/802087166 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec2c0b2580 con 0x7fec2c0b4390 2023-11-28T18:37:47.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.670+0000 7fec30ff9640 1 -- 172.21.15.45:0/802087166 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4084481567 0 0) 0x7fec24001a00 con 0x7fec2c0b4390 2023-11-28T18:37:47.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.670+0000 7fec30ff9640 1 -- 172.21.15.45:0/802087166 >> v1:172.21.15.45:6789/0 conn(0x7fec2c0b4390 legacy=0x7fec2c070430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:47.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.670+0000 7fec30ff9640 1 --2- 172.21.15.45:0/802087166 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec180039b0 0x7fec18003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:47.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.670+0000 7fec30ff9640 1 --2- 172.21.15.45:0/802087166 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fec18004360 0x7fec180047f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:47.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.670+0000 7fec30ff9640 1 --2- 172.21.15.45:0/802087166 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fec18004f50 0x7fec1800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:47.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.670+0000 7fec30ff9640 1 -- 172.21.15.45:0/802087166 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec2c0b4820 con 0x7fec180039b0 2023-11-28T18:37:47.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.670+0000 7fec30ff9640 1 -- 172.21.15.45:0/802087166 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec18005670 con 0x7fec18004f50 2023-11-28T18:37:47.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.670+0000 7fec30ff9640 1 -- 172.21.15.45:0/802087166 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec1800bf20 con 0x7fec18004360 2023-11-28T18:37:47.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.670+0000 7fec31ffb640 1 --2- 172.21.15.45:0/802087166 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec180039b0 0x7fec18003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:47.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.670+0000 7fec327fc640 1 --2- 172.21.15.45:0/802087166 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fec18004f50 0x7fec1800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:47.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.670+0000 7fec317fa640 1 --2- 172.21.15.45:0/802087166 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fec18004360 0x7fec180047f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:47.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.670+0000 7fec31ffb640 1 -- 172.21.15.45:0/802087166 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fec18004360 msgr2=0x7fec180047f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:47.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.670+0000 7fec31ffb640 1 --2- 172.21.15.45:0/802087166 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fec18004360 0x7fec180047f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:47.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.670+0000 7fec31ffb640 1 -- 172.21.15.45:0/802087166 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fec18004f50 msgr2=0x7fec1800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:47.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.670+0000 7fec31ffb640 1 --2- 172.21.15.45:0/802087166 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fec18004f50 0x7fec1800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:47.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.670+0000 7fec31ffb640 1 -- 172.21.15.45:0/802087166 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec18003530 con 0x7fec180039b0 2023-11-28T18:37:47.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.674+0000 7fec31ffb640 1 --2- 172.21.15.45:0/802087166 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec180039b0 0x7fec18003d90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fec28001860 tx=0x7fec2801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1c613137f07e5cd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:47.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.674+0000 7fec30ff9640 1 -- 172.21.15.45:0/802087166 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec280ab600 con 0x7fec180039b0 2023-11-28T18:37:47.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.674+0000 7fec30ff9640 1 -- 172.21.15.45:0/802087166 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec280a7050 con 0x7fec180039b0 2023-11-28T18:37:47.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.674+0000 7fec30ff9640 1 -- 172.21.15.45:0/802087166 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec280ab9a0 con 0x7fec180039b0 2023-11-28T18:37:47.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.674+0000 7fec3425f640 1 -- 172.21.15.45:0/802087166 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec180039b0 msgr2=0x7fec18003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:47.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.674+0000 7fec3425f640 1 --2- 172.21.15.45:0/802087166 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec180039b0 0x7fec18003d90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fec28001860 tx=0x7fec2801c500 comp rx=0 tx=0).stop 2023-11-28T18:37:47.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.674+0000 7fec327fc640 1 -- 172.21.15.45:0/802087166 reap_dead start 2023-11-28T18:37:47.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.674+0000 7fec3425f640 1 -- 172.21.15.45:0/802087166 shutdown_connections 2023-11-28T18:37:47.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.674+0000 7fec3425f640 1 -- 172.21.15.45:0/802087166 >> 172.21.15.45:0/802087166 conn(0x7fec2c0b0d00 msgr2=0x7fec2c0b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:47.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.674+0000 7fec3425f640 1 -- 172.21.15.45:0/802087166 shutdown_connections 2023-11-28T18:37:47.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.674+0000 7fec3425f640 1 -- 172.21.15.45:0/802087166 wait complete. 2023-11-28T18:37:47.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.674+0000 7fec3425f640 1 Processor -- start 2023-11-28T18:37:47.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.674+0000 7fec3425f640 1 -- start start 2023-11-28T18:37:47.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.678+0000 7fec3425f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec180039b0 0x7fec2c0c9a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:47.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.678+0000 7fec3425f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fec2c137690 0x7fec2c146a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:47.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.678+0000 7fec3425f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fec2c1490f0 0x7fec2c149570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:47.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.678+0000 7fec3425f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec2c0c7e10 con 0x7fec180039b0 2023-11-28T18:37:47.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.678+0000 7fec3425f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec2c149ab0 con 0x7fec2c137690 2023-11-28T18:37:47.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.678+0000 7fec3425f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec2c0cacc0 con 0x7fec2c1490f0 2023-11-28T18:37:47.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.678+0000 7fec31ffb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec180039b0 0x7fec2c0c9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:47.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.678+0000 7fec31ffb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec180039b0 0x7fec2c0c9a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57794/0 (socket says 172.21.15.45:57794) 2023-11-28T18:37:47.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.678+0000 7fec31ffb640 1 -- 172.21.15.45:0/391427348 learned_addr learned my addr 172.21.15.45:0/391427348 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:47.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.678+0000 7fec31ffb640 1 -- 172.21.15.45:0/391427348 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fec2c1490f0 msgr2=0x7fec2c149570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:47.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.678+0000 7fec31ffb640 1 --2- 172.21.15.45:0/391427348 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fec2c1490f0 0x7fec2c149570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:47.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.678+0000 7fec31ffb640 1 -- 172.21.15.45:0/391427348 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fec2c137690 msgr2=0x7fec2c146a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:47.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.678+0000 7fec31ffb640 1 --2- 172.21.15.45:0/391427348 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fec2c137690 0x7fec2c146a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:47.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.678+0000 7fec31ffb640 1 -- 172.21.15.45:0/391427348 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec2c0ca0b0 con 0x7fec180039b0 2023-11-28T18:37:47.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.678+0000 7fec31ffb640 1 --2- 172.21.15.45:0/391427348 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec180039b0 0x7fec2c0c9a40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fec2801c330 tx=0x7fec18005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:47.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.678+0000 7fec227fc640 1 -- 172.21.15.45:0/391427348 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec28005390 con 0x7fec180039b0 2023-11-28T18:37:47.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.678+0000 7fec227fc640 1 -- 172.21.15.45:0/391427348 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec280aba80 con 0x7fec180039b0 2023-11-28T18:37:47.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.678+0000 7fec3425f640 1 -- 172.21.15.45:0/391427348 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec2c0ca390 con 0x7fec180039b0 2023-11-28T18:37:47.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.678+0000 7fec227fc640 1 -- 172.21.15.45:0/391427348 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec280abdf0 con 0x7fec180039b0 2023-11-28T18:37:47.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.678+0000 7fec3425f640 1 -- 172.21.15.45:0/391427348 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec2c0ca950 con 0x7fec180039b0 2023-11-28T18:37:47.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.678+0000 7fec3425f640 1 -- 172.21.15.45:0/391427348 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec2c069410 con 0x7fec180039b0 2023-11-28T18:37:47.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.678+0000 7fec227fc640 1 -- 172.21.15.45:0/391427348 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fec280b2050 con 0x7fec180039b0 2023-11-28T18:37:47.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.682+0000 7fec227fc640 1 --2- 172.21.15.45:0/391427348 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fec10066900 0x7fec10068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:47.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.682+0000 7fec227fc640 1 -- 172.21.15.45:0/391427348 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fec2811e160 con 0x7fec180039b0 2023-11-28T18:37:47.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.682+0000 7fec317fa640 1 --2- 172.21.15.45:0/391427348 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fec10066900 0x7fec10068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:47.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.682+0000 7fec317fa640 1 --2- 172.21.15.45:0/391427348 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fec10066900 0x7fec10068dc0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fec2c166630 tx=0x7fec1c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:47.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.686+0000 7fec227fc640 1 -- 172.21.15.45:0/391427348 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fec280eb560 con 0x7fec180039b0 2023-11-28T18:37:47.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.842+0000 7fec3425f640 1 -- 172.21.15.45:0/391427348 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fec2c146fc0 con 0x7fec180039b0 2023-11-28T18:37:47.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.842+0000 7fec227fc640 1 -- 172.21.15.45:0/391427348 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fec280eeb80 con 0x7fec180039b0 2023-11-28T18:37:47.848 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-11-28T18:37:47.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.842+0000 7fec3425f640 1 -- 172.21.15.45:0/391427348 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fec10066900 msgr2=0x7fec10068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:47.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.842+0000 7fec3425f640 1 --2- 172.21.15.45:0/391427348 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fec10066900 0x7fec10068dc0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fec2c166630 tx=0x7fec1c008040 comp rx=0 tx=0).stop 2023-11-28T18:37:47.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.842+0000 7fec3425f640 1 -- 172.21.15.45:0/391427348 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec180039b0 msgr2=0x7fec2c0c9a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:47.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.842+0000 7fec3425f640 1 --2- 172.21.15.45:0/391427348 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec180039b0 0x7fec2c0c9a40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fec2801c330 tx=0x7fec18005800 comp rx=0 tx=0).stop 2023-11-28T18:37:47.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.842+0000 7fec3425f640 1 -- 172.21.15.45:0/391427348 shutdown_connections 2023-11-28T18:37:47.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.842+0000 7fec3425f640 1 --2- 172.21.15.45:0/391427348 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fec10066900 0x7fec10068dc0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:47.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.842+0000 7fec3425f640 1 --2- 172.21.15.45:0/391427348 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fec2c1490f0 0x7fec2c149570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:47.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.842+0000 7fec3425f640 1 --2- 172.21.15.45:0/391427348 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fec2c137690 0x7fec2c146a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:47.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.842+0000 7fec3425f640 1 --2- 172.21.15.45:0/391427348 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec180039b0 0x7fec2c0c9a40 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:47.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.842+0000 7fec3425f640 1 -- 172.21.15.45:0/391427348 >> 172.21.15.45:0/391427348 conn(0x7fec2c0b0d00 msgr2=0x7fec2c070330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:47.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.842+0000 7fec3425f640 1 -- 172.21.15.45:0/391427348 shutdown_connections 2023-11-28T18:37:47.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:47.842+0000 7fec3425f640 1 -- 172.21.15.45:0/391427348 wait complete. 2023-11-28T18:37:47.869 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T18:37:48.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.006+0000 7fd9ea479640 1 Processor -- start 2023-11-28T18:37:48.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.006+0000 7fd9ea479640 1 -- start start 2023-11-28T18:37:48.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.010+0000 7fd9ea479640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd9e40b32c0 0x7fd9e4160f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:48.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.010+0000 7fd9ea479640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9e4146fe0 con 0x7fd9e4146c00 2023-11-28T18:37:48.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.010+0000 7fd9ea479640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9e415e8b0 con 0x7fd9e415e430 2023-11-28T18:37:48.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.010+0000 7fd9ea479640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9e406f390 con 0x7fd9e40b32c0 2023-11-28T18:37:48.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.010+0000 7fd9e3fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd9e4146c00 0x7fd9e406e8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51072/0 (socket says 172.21.15.45:51072) 2023-11-28T18:37:48.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.010+0000 7fd9e3fff640 1 -- 172.21.15.45:0/786230951 learned_addr learned my addr 172.21.15.45:0/786230951 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:37:48.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.010+0000 7fd9e8a16640 1 --2- 172.21.15.45:0/786230951 >> v2:172.21.15.45:3300/0 conn(0x7fd9e40b32c0 0x7fd9e4160f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:48.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.010+0000 7fd9e2ffd640 1 -- 172.21.15.45:0/786230951 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 437792421 0 0) 0x7fd9e4146fe0 con 0x7fd9e4146c00 2023-11-28T18:37:48.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.010+0000 7fd9e2ffd640 1 -- 172.21.15.45:0/786230951 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9cc003530 con 0x7fd9e4146c00 2023-11-28T18:37:48.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.010+0000 7fd9e8a16640 1 -- 172.21.15.45:0/786230951 >> v1:172.21.15.190:6789/0 conn(0x7fd9e415e430 legacy=0x7fd9e40b2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:48.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.010+0000 7fd9e8a16640 1 -- 172.21.15.45:0/786230951 >> v1:172.21.15.45:6789/0 conn(0x7fd9e4146c00 legacy=0x7fd9e406e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:48.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.010+0000 7fd9e8a16640 1 -- 172.21.15.45:0/786230951 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9e406f670 con 0x7fd9e40b32c0 2023-11-28T18:37:48.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.014+0000 7fd9e8a16640 1 --2- 172.21.15.45:0/786230951 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9e40b32c0 0x7fd9e4160f10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc009d90 tx=0x7fd9dc01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64a267d1b213e687 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:48.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.014+0000 7fd9e2ffd640 1 -- 172.21.15.45:0/786230951 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9dc0a5900 con 0x7fd9e40b32c0 2023-11-28T18:37:48.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.014+0000 7fd9e2ffd640 1 -- 172.21.15.45:0/786230951 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9dc0a5a60 con 0x7fd9e40b32c0 2023-11-28T18:37:48.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.014+0000 7fd9e2ffd640 1 -- 172.21.15.45:0/786230951 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9dc0a5df0 con 0x7fd9e40b32c0 2023-11-28T18:37:48.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.014+0000 7fd9ea479640 1 -- 172.21.15.45:0/786230951 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9e40b32c0 msgr2=0x7fd9e4160f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:48.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.014+0000 7fd9ea479640 1 --2- 172.21.15.45:0/786230951 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9e40b32c0 0x7fd9e4160f10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc009d90 tx=0x7fd9dc01c920 comp rx=0 tx=0).stop 2023-11-28T18:37:48.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.014+0000 7fd9ea479640 1 -- 172.21.15.45:0/786230951 shutdown_connections 2023-11-28T18:37:48.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.014+0000 7fd9ea479640 1 --2- 172.21.15.45:0/786230951 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9e40b32c0 0x7fd9e4160f10 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:48.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.014+0000 7fd9ea479640 1 -- 172.21.15.45:0/786230951 >> 172.21.15.45:0/786230951 conn(0x7fd9e406a570 msgr2=0x7fd9e406a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:48.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.014+0000 7fd9ea479640 1 -- 172.21.15.45:0/786230951 shutdown_connections 2023-11-28T18:37:48.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.014+0000 7fd9ea479640 1 -- 172.21.15.45:0/786230951 wait complete. 2023-11-28T18:37:48.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.014+0000 7fd9ea479640 1 Processor -- start 2023-11-28T18:37:48.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.014+0000 7fd9ea479640 1 -- start start 2023-11-28T18:37:48.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.014+0000 7fd9ea479640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd9e40b32c0 0x7fd9e4159320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:48.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.014+0000 7fd9ea479640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd9e4146c00 0x7fd9e4159860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:48.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.014+0000 7fd9ea479640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9e415e430 0x7fd9e415fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:48.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.014+0000 7fd9ea479640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e41566a0 con 0x7fd9e415e430 2023-11-28T18:37:48.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.014+0000 7fd9ea479640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e4156940 con 0x7fd9e40b32c0 2023-11-28T18:37:48.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.014+0000 7fd9ea479640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e4156c20 con 0x7fd9e4146c00 2023-11-28T18:37:48.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.014+0000 7fd9e8a16640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9e415e430 0x7fd9e415fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:48.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.018+0000 7fd9e8a16640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9e415e430 0x7fd9e415fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38888/0 (socket says 172.21.15.45:38888) 2023-11-28T18:37:48.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.018+0000 7fd9e8a16640 1 -- 172.21.15.45:0/3160210904 learned_addr learned my addr 172.21.15.45:0/3160210904 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:48.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.018+0000 7fd9e3fff640 1 --2- 172.21.15.45:0/3160210904 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd9e40b32c0 0x7fd9e4159320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:48.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.018+0000 7fd9e37fe640 1 --2- 172.21.15.45:0/3160210904 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd9e4146c00 0x7fd9e4159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:48.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.018+0000 7fd9e8a16640 1 -- 172.21.15.45:0/3160210904 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd9e4146c00 msgr2=0x7fd9e4159860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:48.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.018+0000 7fd9e8a16640 1 --2- 172.21.15.45:0/3160210904 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd9e4146c00 0x7fd9e4159860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:48.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.018+0000 7fd9e8a16640 1 -- 172.21.15.45:0/3160210904 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd9e40b32c0 msgr2=0x7fd9e4159320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:48.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.018+0000 7fd9e8a16640 1 --2- 172.21.15.45:0/3160210904 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd9e40b32c0 0x7fd9e4159320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:48.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.018+0000 7fd9e8a16640 1 -- 172.21.15.45:0/3160210904 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9dc009a70 con 0x7fd9e415e430 2023-11-28T18:37:48.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.018+0000 7fd9e8a16640 1 --2- 172.21.15.45:0/3160210904 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9e415e430 0x7fd9e415fde0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc0b0040 tx=0x7fd9dc0196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:48.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.018+0000 7fd9e0ff9640 1 -- 172.21.15.45:0/3160210904 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9dc0b9860 con 0x7fd9e415e430 2023-11-28T18:37:48.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.018+0000 7fd9e0ff9640 1 -- 172.21.15.45:0/3160210904 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9dc0a58f0 con 0x7fd9e415e430 2023-11-28T18:37:48.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.018+0000 7fd9e0ff9640 1 -- 172.21.15.45:0/3160210904 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9dc0b9c00 con 0x7fd9e415e430 2023-11-28T18:37:48.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.018+0000 7fd9ea479640 1 -- 172.21.15.45:0/3160210904 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9e4156f00 con 0x7fd9e415e430 2023-11-28T18:37:48.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.018+0000 7fd9ea479640 1 -- 172.21.15.45:0/3160210904 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9e4157700 con 0x7fd9e415e430 2023-11-28T18:37:48.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.018+0000 7fd9ea479640 1 -- 172.21.15.45:0/3160210904 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9e4069480 con 0x7fd9e415e430 2023-11-28T18:37:48.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.018+0000 7fd9e0ff9640 1 -- 172.21.15.45:0/3160210904 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fd9dc0ad440 con 0x7fd9e415e430 2023-11-28T18:37:48.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.018+0000 7fd9e0ff9640 1 --2- 172.21.15.45:0/3160210904 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fd9d00668d0 0x7fd9d0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:48.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.018+0000 7fd9e0ff9640 1 -- 172.21.15.45:0/3160210904 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd9dc11f730 con 0x7fd9e415e430 2023-11-28T18:37:48.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.022+0000 7fd9e3fff640 1 --2- 172.21.15.45:0/3160210904 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fd9d00668d0 0x7fd9d0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:48.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.022+0000 7fd9e3fff640 1 --2- 172.21.15.45:0/3160210904 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fd9d00668d0 0x7fd9d0068d90 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd9d40011f0 tx=0x7fd9d4007d40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:48.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.026+0000 7fd9e0ff9640 1 -- 172.21.15.45:0/3160210904 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd9dc0eca80 con 0x7fd9e415e430 2023-11-28T18:37:48.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.214+0000 7fd9ea479640 1 -- 172.21.15.45:0/3160210904 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd9e40b04f0 con 0x7fd9e415e430 2023-11-28T18:37:48.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.214+0000 7fd9e0ff9640 1 -- 172.21.15.45:0/3160210904 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4910 (secure 0 0 0) 0x7fd9dc0f00a0 con 0x7fd9e415e430 2023-11-28T18:37:48.220 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:37:48.220 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/972230763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":972230763},{"type":"v1","addr":"172.21.15.45:6835","nonce":972230763}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/4274475693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":4274475693},{"type":"v1","addr":"172.21.15.190:6837","nonce":4274475693}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/3154556740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":3154556740},{"type":"v1","addr":"172.21.15.190:6836","nonce":3154556740}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T18:37:32.842966+0000","modified":"2023-11-28T18:37:35.841966+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6834/1657221272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1657221272},{"type":"v1","addr":"172.21.15.45:6834","nonce":1657221272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T18:37:48.221 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 8 2023-11-28T18:37:48.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.214+0000 7fd9ea479640 1 -- 172.21.15.45:0/3160210904 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fd9d00668d0 msgr2=0x7fd9d0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:48.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.214+0000 7fd9ea479640 1 --2- 172.21.15.45:0/3160210904 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fd9d00668d0 0x7fd9d0068d90 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd9d40011f0 tx=0x7fd9d4007d40 comp rx=0 tx=0).stop 2023-11-28T18:37:48.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.214+0000 7fd9ea479640 1 -- 172.21.15.45:0/3160210904 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9e415e430 msgr2=0x7fd9e415fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:48.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.214+0000 7fd9ea479640 1 --2- 172.21.15.45:0/3160210904 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9e415e430 0x7fd9e415fde0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc0b0040 tx=0x7fd9dc0196c0 comp rx=0 tx=0).stop 2023-11-28T18:37:48.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.214+0000 7fd9ea479640 1 -- 172.21.15.45:0/3160210904 shutdown_connections 2023-11-28T18:37:48.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.214+0000 7fd9ea479640 1 --2- 172.21.15.45:0/3160210904 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fd9d00668d0 0x7fd9d0068d90 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:48.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.214+0000 7fd9ea479640 1 --2- 172.21.15.45:0/3160210904 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9e415e430 0x7fd9e415fde0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:48.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.214+0000 7fd9ea479640 1 --2- 172.21.15.45:0/3160210904 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd9e4146c00 0x7fd9e4159860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:48.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.214+0000 7fd9ea479640 1 --2- 172.21.15.45:0/3160210904 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd9e40b32c0 0x7fd9e4159320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:48.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.214+0000 7fd9ea479640 1 -- 172.21.15.45:0/3160210904 >> 172.21.15.45:0/3160210904 conn(0x7fd9e406a570 msgr2=0x7fd9e406e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:48.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.218+0000 7fd9ea479640 1 -- 172.21.15.45:0/3160210904 shutdown_connections 2023-11-28T18:37:48.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.218+0000 7fd9ea479640 1 -- 172.21.15.45:0/3160210904 wait complete. 2023-11-28T18:37:48.242 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T18:37:48.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.378+0000 7f11e9dd8640 1 Processor -- start 2023-11-28T18:37:48.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.378+0000 7f11e9dd8640 1 -- start start 2023-11-28T18:37:48.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.378+0000 7f11e9dd8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f11e40cfed0 0x7f11e40d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:48.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.378+0000 7f11e9dd8640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11e40d38c0 con 0x7f11e40b3cb0 2023-11-28T18:37:48.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.378+0000 7f11e9dd8640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11e40cdcc0 con 0x7f11e40b35f0 2023-11-28T18:37:48.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.378+0000 7f11e9dd8640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11e40d40d0 con 0x7f11e40cfed0 2023-11-28T18:37:48.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.378+0000 7f11e2ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f11e40cfed0 0x7f11e40d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:48.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.378+0000 7f11e2ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f11e40cfed0 0x7f11e40d0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38894/0 (socket says 172.21.15.45:38894) 2023-11-28T18:37:48.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.378+0000 7f11e3fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f11e40b3cb0 0x7f11e40ce480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51078/0 (socket says 172.21.15.45:51078) 2023-11-28T18:37:48.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.378+0000 7f11e2ffd640 1 -- 172.21.15.45:0/1775313881 learned_addr learned my addr 172.21.15.45:0/1775313881 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:48.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.378+0000 7f11e2ffd640 1 -- 172.21.15.45:0/1775313881 >> v1:172.21.15.190:6789/0 conn(0x7f11e40b35f0 legacy=0x7f11e40cf7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:48.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.378+0000 7f11e2ffd640 1 -- 172.21.15.45:0/1775313881 >> v1:172.21.15.45:6789/0 conn(0x7f11e40b3cb0 legacy=0x7f11e40ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:48.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.378+0000 7f11e2ffd640 1 -- 172.21.15.45:0/1775313881 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11e40d3b10 con 0x7f11e40cfed0 2023-11-28T18:37:48.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.382+0000 7f11e2ffd640 1 --2- 172.21.15.45:0/1775313881 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11e40cfed0 0x7f11e40d0f90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f11d8009870 tx=0x7f11d801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3dabc7c4bb1abb3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:48.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.382+0000 7f11e27fc640 1 -- 172.21.15.45:0/1775313881 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d80aa670 con 0x7f11e40cfed0 2023-11-28T18:37:48.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.382+0000 7f11e27fc640 1 -- 172.21.15.45:0/1775313881 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11d80aa7d0 con 0x7f11e40cfed0 2023-11-28T18:37:48.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.382+0000 7f11e27fc640 1 -- 172.21.15.45:0/1775313881 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d80aab60 con 0x7f11e40cfed0 2023-11-28T18:37:48.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.382+0000 7f11e9dd8640 1 -- 172.21.15.45:0/1775313881 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11e40cfed0 msgr2=0x7f11e40d0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:48.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.382+0000 7f11e9dd8640 1 --2- 172.21.15.45:0/1775313881 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11e40cfed0 0x7f11e40d0f90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f11d8009870 tx=0x7f11d801c510 comp rx=0 tx=0).stop 2023-11-28T18:37:48.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.382+0000 7f11e9dd8640 1 -- 172.21.15.45:0/1775313881 shutdown_connections 2023-11-28T18:37:48.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.382+0000 7f11e9dd8640 1 --2- 172.21.15.45:0/1775313881 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11e40cfed0 0x7f11e40d0f90 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:48.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.382+0000 7f11e9dd8640 1 -- 172.21.15.45:0/1775313881 >> 172.21.15.45:0/1775313881 conn(0x7f11e409c4f0 msgr2=0x7f11e40d31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:48.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.382+0000 7f11e9dd8640 1 -- 172.21.15.45:0/1775313881 shutdown_connections 2023-11-28T18:37:48.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.382+0000 7f11e9dd8640 1 -- 172.21.15.45:0/1775313881 wait complete. 2023-11-28T18:37:48.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.386+0000 7f11e9dd8640 1 Processor -- start 2023-11-28T18:37:48.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.386+0000 7f11e9dd8640 1 -- start start 2023-11-28T18:37:48.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.386+0000 7f11e9dd8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11e40b35f0 0x7f11e40c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:48.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.386+0000 7f11e9dd8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f11e40b3cb0 0x7f11e40b8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:48.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.386+0000 7f11e9dd8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f11e40cfed0 0x7f11e415dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:48.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.386+0000 7f11e9dd8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e40b4f20 con 0x7f11e40b35f0 2023-11-28T18:37:48.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.386+0000 7f11e9dd8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e40b5200 con 0x7f11e40cfed0 2023-11-28T18:37:48.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.386+0000 7f11e9dd8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11e40b54e0 con 0x7f11e40b3cb0 2023-11-28T18:37:48.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.386+0000 7f11e37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11e40b35f0 0x7f11e40c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:48.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.386+0000 7f11e37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11e40b35f0 0x7f11e40c8c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38900/0 (socket says 172.21.15.45:38900) 2023-11-28T18:37:48.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.386+0000 7f11e37fe640 1 -- 172.21.15.45:0/3781896143 learned_addr learned my addr 172.21.15.45:0/3781896143 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:48.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.386+0000 7f11e2ffd640 1 --2- 172.21.15.45:0/3781896143 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f11e40b3cb0 0x7f11e40b8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:48.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.386+0000 7f11e3fff640 1 --2- 172.21.15.45:0/3781896143 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f11e40cfed0 0x7f11e415dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:48.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.386+0000 7f11e37fe640 1 -- 172.21.15.45:0/3781896143 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f11e40b3cb0 msgr2=0x7f11e40b8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:48.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.386+0000 7f11e37fe640 1 --2- 172.21.15.45:0/3781896143 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f11e40b3cb0 0x7f11e40b8340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:48.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.386+0000 7f11e37fe640 1 -- 172.21.15.45:0/3781896143 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f11e40cfed0 msgr2=0x7f11e415dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:48.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.386+0000 7f11e37fe640 1 --2- 172.21.15.45:0/3781896143 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f11e40cfed0 0x7f11e415dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:48.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.386+0000 7f11e37fe640 1 -- 172.21.15.45:0/3781896143 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11d80094d0 con 0x7f11e40b35f0 2023-11-28T18:37:48.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.386+0000 7f11e37fe640 1 --2- 172.21.15.45:0/3781896143 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11e40b35f0 0x7f11e40c8c90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f11d400c500 tx=0x7f11d400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:48.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.386+0000 7f11cbfff640 1 -- 172.21.15.45:0/3781896143 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d4005220 con 0x7f11e40b35f0 2023-11-28T18:37:48.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.386+0000 7f11cbfff640 1 -- 172.21.15.45:0/3781896143 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11d4005380 con 0x7f11e40b35f0 2023-11-28T18:37:48.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.386+0000 7f11cbfff640 1 -- 172.21.15.45:0/3781896143 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d4007270 con 0x7f11e40b35f0 2023-11-28T18:37:48.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.386+0000 7f11e9dd8640 1 -- 172.21.15.45:0/3781896143 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11e40b57c0 con 0x7f11e40b35f0 2023-11-28T18:37:48.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.386+0000 7f11e9dd8640 1 -- 172.21.15.45:0/3781896143 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11e415a480 con 0x7f11e40b35f0 2023-11-28T18:37:48.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.390+0000 7f11e9dd8640 1 -- 172.21.15.45:0/3781896143 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11e4069480 con 0x7f11e40b35f0 2023-11-28T18:37:48.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.390+0000 7f11cbfff640 1 -- 172.21.15.45:0/3781896143 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f11d40073d0 con 0x7f11e40b35f0 2023-11-28T18:37:48.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.390+0000 7f11cbfff640 1 --2- 172.21.15.45:0/3781896143 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f11d00668d0 0x7f11d0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:48.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.390+0000 7f11cbfff640 1 -- 172.21.15.45:0/3781896143 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f11d4083bf0 con 0x7f11e40b35f0 2023-11-28T18:37:48.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.390+0000 7f11e2ffd640 1 --2- 172.21.15.45:0/3781896143 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f11d00668d0 0x7f11d0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:48.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.390+0000 7f11e2ffd640 1 --2- 172.21.15.45:0/3781896143 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f11d00668d0 0x7f11d0068d90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f11d80ae000 tx=0x7f11d80b5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:48.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.394+0000 7f11cbfff640 1 -- 172.21.15.45:0/3781896143 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f11d4050ef0 con 0x7f11e40b35f0 2023-11-28T18:37:48.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.554+0000 7f11e9dd8640 1 -- 172.21.15.45:0/3781896143 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f11e40b8bc0 con 0x7f11e40b35f0 2023-11-28T18:37:48.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.554+0000 7f11cbfff640 1 -- 172.21.15.45:0/3781896143 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16469 (secure 0 0 0) 0x7f11d4054510 con 0x7f11e40b35f0 2023-11-28T18:37:48.562 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:37:48.562 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":20,"fsid":"d10f5cd6-1d00-4019-99b6-6fa435498a15","created":"2023-11-28T18:37:08.189030+0000","modified":"2023-11-28T18:37:33.971141+0000","last_up_change":"2023-11-28T18:37:20.196124+0000","last_in_change":"2023-11-28T18:37:10.742043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T18:37:21.293917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T18:37:31.384760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T18:37:31.834769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"84465384-103c-4f2c-a45a-96f5bb9c835f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6809","nonce":555237322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6811","nonce":555237322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6815","nonce":555237322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6813","nonce":555237322}]},"public_addr":"172.21.15.45:6809/555237322","cluster_addr":"172.21.15.45:6811/555237322","heartbeat_back_addr":"172.21.15.45:6815/555237322","heartbeat_front_addr":"172.21.15.45:6813/555237322","state":["exists","up"]},{"osd":1,"uuid":"7d9eed24-a58f-42c7-a787-ac06be8553fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6801","nonce":2857063763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6803","nonce":2857063763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6807","nonce":2857063763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6805","nonce":2857063763}]},"public_addr":"172.21.15.45:6801/2857063763","cluster_addr":"172.21.15.45:6803/2857063763","heartbeat_back_addr":"172.21.15.45:6807/2857063763","heartbeat_front_addr":"172.21.15.45:6805/2857063763","state":["exists","up"]},{"osd":2,"uuid":"575eeccc-4abf-45b4-9caf-f3e797859588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6817","nonce":193884539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6819","nonce":193884539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6823","nonce":193884539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6821","nonce":193884539}]},"public_addr":"172.21.15.45:6817/193884539","cluster_addr":"172.21.15.45:6819/193884539","heartbeat_back_addr":"172.21.15.45:6823/193884539","heartbeat_front_addr":"172.21.15.45:6821/193884539","state":["exists","up"]},{"osd":3,"uuid":"9b0290d6-9a52-4bc8-b2a1-7622c5dc8e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6825","nonce":78541084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6827","nonce":78541084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6831","nonce":78541084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6829","nonce":78541084}]},"public_addr":"172.21.15.45:6825/78541084","cluster_addr":"172.21.15.45:6827/78541084","heartbeat_back_addr":"172.21.15.45:6831/78541084","heartbeat_front_addr":"172.21.15.45:6829/78541084","state":["exists","up"]},{"osd":4,"uuid":"ce632829-f027-4fbf-a627-02c571aa9d53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6809","nonce":1537591987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6811","nonce":1537591987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6815","nonce":1537591987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6813","nonce":1537591987}]},"public_addr":"172.21.15.190:6809/1537591987","cluster_addr":"172.21.15.190:6811/1537591987","heartbeat_back_addr":"172.21.15.190:6815/1537591987","heartbeat_front_addr":"172.21.15.190:6813/1537591987","state":["exists","up"]},{"osd":5,"uuid":"8700b609-27be-40bd-a251-4c0ae0a29ead","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6801","nonce":3296698407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6803","nonce":3296698407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6807","nonce":3296698407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6805","nonce":3296698407}]},"public_addr":"172.21.15.190:6801/3296698407","cluster_addr":"172.21.15.190:6803/3296698407","heartbeat_back_addr":"172.21.15.190:6807/3296698407","heartbeat_front_addr":"172.21.15.190:6805/3296698407","state":["exists","up"]},{"osd":6,"uuid":"44ce4a40-e6ff-4f4d-8e8a-7341e5c91f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6817","nonce":2317686718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6819","nonce":2317686718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6823","nonce":2317686718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6821","nonce":2317686718}]},"public_addr":"172.21.15.190:6817/2317686718","cluster_addr":"172.21.15.190:6819/2317686718","heartbeat_back_addr":"172.21.15.190:6823/2317686718","heartbeat_front_addr":"172.21.15.190:6821/2317686718","state":["exists","up"]},{"osd":7,"uuid":"192238c9-1423-4b7e-ac8f-84ba32113ddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6825","nonce":2493232051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6827","nonce":2493232051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6831","nonce":2493232051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6829","nonce":2493232051}]},"public_addr":"172.21.15.190:6825/2493232051","cluster_addr":"172.21.15.190:6827/2493232051","heartbeat_back_addr":"172.21.15.190:6831/2493232051","heartbeat_front_addr":"172.21.15.190:6829/2493232051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.393552+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.385453+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.361421+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.366408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.363226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.276007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.414605+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.445885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T18:37:48.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.558+0000 7f11e9dd8640 1 -- 172.21.15.45:0/3781896143 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f11d00668d0 msgr2=0x7f11d0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:48.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.558+0000 7f11e9dd8640 1 --2- 172.21.15.45:0/3781896143 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f11d00668d0 0x7f11d0068d90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f11d80ae000 tx=0x7f11d80b5040 comp rx=0 tx=0).stop 2023-11-28T18:37:48.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.558+0000 7f11e9dd8640 1 -- 172.21.15.45:0/3781896143 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11e40b35f0 msgr2=0x7f11e40c8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:48.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.558+0000 7f11e9dd8640 1 --2- 172.21.15.45:0/3781896143 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11e40b35f0 0x7f11e40c8c90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f11d400c500 tx=0x7f11d400c9c0 comp rx=0 tx=0).stop 2023-11-28T18:37:48.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.558+0000 7f11e9dd8640 1 -- 172.21.15.45:0/3781896143 shutdown_connections 2023-11-28T18:37:48.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.558+0000 7f11e9dd8640 1 --2- 172.21.15.45:0/3781896143 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f11d00668d0 0x7f11d0068d90 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:48.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.558+0000 7f11e9dd8640 1 --2- 172.21.15.45:0/3781896143 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f11e40cfed0 0x7f11e415dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:48.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.558+0000 7f11e9dd8640 1 --2- 172.21.15.45:0/3781896143 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f11e40b3cb0 0x7f11e40b8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:48.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.558+0000 7f11e9dd8640 1 --2- 172.21.15.45:0/3781896143 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11e40b35f0 0x7f11e40c8c90 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:48.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.558+0000 7f11e9dd8640 1 -- 172.21.15.45:0/3781896143 >> 172.21.15.45:0/3781896143 conn(0x7f11e409c4f0 msgr2=0x7f11e40d31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:48.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.558+0000 7f11e9dd8640 1 -- 172.21.15.45:0/3781896143 shutdown_connections 2023-11-28T18:37:48.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.558+0000 7f11e9dd8640 1 -- 172.21.15.45:0/3781896143 wait complete. 2023-11-28T18:37:48.584 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T18:37:48.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.722+0000 7feea33b8640 1 Processor -- start 2023-11-28T18:37:48.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.722+0000 7feea33b8640 1 -- start start 2023-11-28T18:37:48.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.722+0000 7feea33b8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fee9c15d240 0x7fee9c0d2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:48.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.722+0000 7feea33b8640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fee9c0d15e0 0x7fee9c0b61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:48.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.722+0000 7feea33b8640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee9c0b2a30 con 0x7fee9c0d11a0 2023-11-28T18:37:48.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.722+0000 7feea33b8640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee9c0d1b40 con 0x7fee9c0d15e0 2023-11-28T18:37:48.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.722+0000 7feea33b8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee9c0d1e20 con 0x7fee9c15d240 2023-11-28T18:37:48.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.722+0000 7feea1154640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fee9c15d240 0x7fee9c0d2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:48.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.722+0000 7feea1955640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fee9c0d15e0 0x7fee9c0b61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:48.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.722+0000 7feea1154640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fee9c15d240 0x7fee9c0d2be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.45:37336/0 (socket says 172.21.15.45:37336) 2023-11-28T18:37:48.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.722+0000 7feea1154640 1 -- 172.21.15.45:0/3633046944 learned_addr learned my addr 172.21.15.45:0/3633046944 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:48.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.722+0000 7feea1154640 1 -- 172.21.15.45:0/3633046944 >> v2:172.21.15.190:3300/0 conn(0x7fee9c0d15e0 msgr2=0x7fee9c0b61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:48.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.722+0000 7feea1154640 1 --2- 172.21.15.45:0/3633046944 >> v2:172.21.15.190:3300/0 conn(0x7fee9c0d15e0 0x7fee9c0b61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:48.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.722+0000 7feea1154640 1 -- 172.21.15.45:0/3633046944 >> v1:172.21.15.190:6789/0 conn(0x7fee9c0d11a0 legacy=0x7fee9c0cde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:48.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.722+0000 7feea1154640 1 -- 172.21.15.45:0/3633046944 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee9c0d2100 con 0x7fee9c15d240 2023-11-28T18:37:48.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.726+0000 7feea1154640 1 --2- 172.21.15.45:0/3633046944 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fee9c15d240 0x7fee9c0d2be0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fee98009870 tx=0x7fee9801ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54dc3aafb9b26485 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:48.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.726+0000 7fee93fff640 1 -- 172.21.15.45:0/3633046944 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee980a8a30 con 0x7fee9c15d240 2023-11-28T18:37:48.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.726+0000 7fee93fff640 1 -- 172.21.15.45:0/3633046944 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee980a8b90 con 0x7fee9c15d240 2023-11-28T18:37:48.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.726+0000 7fee93fff640 1 -- 172.21.15.45:0/3633046944 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee980b0440 con 0x7fee9c15d240 2023-11-28T18:37:48.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.726+0000 7feea33b8640 1 -- 172.21.15.45:0/3633046944 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fee9c15d240 msgr2=0x7fee9c0d2be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:48.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.726+0000 7feea33b8640 1 --2- 172.21.15.45:0/3633046944 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fee9c15d240 0x7fee9c0d2be0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fee98009870 tx=0x7fee9801ed30 comp rx=0 tx=0).stop 2023-11-28T18:37:48.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.726+0000 7feea33b8640 1 -- 172.21.15.45:0/3633046944 shutdown_connections 2023-11-28T18:37:48.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.726+0000 7feea33b8640 1 --2- 172.21.15.45:0/3633046944 >> v2:172.21.15.190:3300/0 conn(0x7fee9c0d15e0 0x7fee9c0b61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:48.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.726+0000 7feea33b8640 1 --2- 172.21.15.45:0/3633046944 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fee9c15d240 0x7fee9c0d2be0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:48.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.726+0000 7feea33b8640 1 -- 172.21.15.45:0/3633046944 >> 172.21.15.45:0/3633046944 conn(0x7fee9c0722a0 msgr2=0x7fee9c0cfbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:48.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.726+0000 7feea33b8640 1 -- 172.21.15.45:0/3633046944 shutdown_connections 2023-11-28T18:37:48.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.726+0000 7feea33b8640 1 -- 172.21.15.45:0/3633046944 wait complete. 2023-11-28T18:37:48.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.730+0000 7feea33b8640 1 Processor -- start 2023-11-28T18:37:48.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.730+0000 7feea33b8640 1 -- start start 2023-11-28T18:37:48.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.730+0000 7feea33b8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fee9c0d11a0 0x7fee9c153460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:48.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.730+0000 7feea33b8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fee9c0d15e0 0x7fee9c1f3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:48.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.730+0000 7feea33b8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee9c15d240 0x7fee9c1eff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:48.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.730+0000 7feea33b8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee9c1546c0 con 0x7fee9c15d240 2023-11-28T18:37:48.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.730+0000 7feea33b8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee9c1f3ab0 con 0x7fee9c0d15e0 2023-11-28T18:37:48.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.730+0000 7feea33b8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee9c153a40 con 0x7fee9c0d11a0 2023-11-28T18:37:48.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.730+0000 7feea1955640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee9c15d240 0x7fee9c1eff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:48.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.730+0000 7feea1154640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fee9c0d11a0 0x7fee9c153460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:48.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.730+0000 7feea1955640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee9c15d240 0x7fee9c1eff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38910/0 (socket says 172.21.15.45:38910) 2023-11-28T18:37:48.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.730+0000 7feea1955640 1 -- 172.21.15.45:0/819401564 learned_addr learned my addr 172.21.15.45:0/819401564 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:48.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.730+0000 7feea0953640 1 --2- 172.21.15.45:0/819401564 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fee9c0d15e0 0x7fee9c1f3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:48.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.730+0000 7feea1955640 1 -- 172.21.15.45:0/819401564 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fee9c0d11a0 msgr2=0x7fee9c153460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:48.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.730+0000 7feea1955640 1 --2- 172.21.15.45:0/819401564 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fee9c0d11a0 0x7fee9c153460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:48.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.730+0000 7feea1955640 1 -- 172.21.15.45:0/819401564 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fee9c0d15e0 msgr2=0x7fee9c1f3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:48.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.730+0000 7feea1955640 1 --2- 172.21.15.45:0/819401564 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fee9c0d15e0 0x7fee9c1f3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:48.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.730+0000 7feea1955640 1 -- 172.21.15.45:0/819401564 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee980094d0 con 0x7fee9c15d240 2023-11-28T18:37:48.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.730+0000 7feea1955640 1 --2- 172.21.15.45:0/819401564 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee9c15d240 0x7fee9c1eff40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fee9400efc0 tx=0x7fee9400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:48.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.730+0000 7fee91ffb640 1 -- 172.21.15.45:0/819401564 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee94009ca0 con 0x7fee9c15d240 2023-11-28T18:37:48.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.730+0000 7fee91ffb640 1 -- 172.21.15.45:0/819401564 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee9400f040 con 0x7fee9c15d240 2023-11-28T18:37:48.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.730+0000 7fee91ffb640 1 -- 172.21.15.45:0/819401564 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee940146c0 con 0x7fee9c15d240 2023-11-28T18:37:48.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.730+0000 7feea33b8640 1 -- 172.21.15.45:0/819401564 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee9c153d20 con 0x7fee9c15d240 2023-11-28T18:37:48.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.730+0000 7feea33b8640 1 -- 172.21.15.45:0/819401564 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee9c1542e0 con 0x7fee9c15d240 2023-11-28T18:37:48.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.734+0000 7feea33b8640 1 -- 172.21.15.45:0/819401564 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee9c069480 con 0x7fee9c15d240 2023-11-28T18:37:48.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.734+0000 7fee91ffb640 1 -- 172.21.15.45:0/819401564 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fee94014820 con 0x7fee9c15d240 2023-11-28T18:37:48.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.734+0000 7fee91ffb640 1 --2- 172.21.15.45:0/819401564 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fee80066900 0x7fee80068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:48.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.734+0000 7fee91ffb640 1 -- 172.21.15.45:0/819401564 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fee940851f0 con 0x7fee9c15d240 2023-11-28T18:37:48.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.734+0000 7feea1154640 1 --2- 172.21.15.45:0/819401564 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fee80066900 0x7fee80068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:48.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.734+0000 7feea1154640 1 --2- 172.21.15.45:0/819401564 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fee80066900 0x7fee80068dc0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fee980b2000 tx=0x7fee98009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:48.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.738+0000 7fee91ffb640 1 -- 172.21.15.45:0/819401564 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fee940524d0 con 0x7fee9c15d240 2023-11-28T18:37:48.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.930+0000 7feea33b8640 1 -- 172.21.15.45:0/819401564 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fee9c0b8700 con 0x7fee9c15d240 2023-11-28T18:37:48.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.930+0000 7fee91ffb640 1 -- 172.21.15.45:0/819401564 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4910 (secure 0 0 0) 0x7fee94055af0 con 0x7fee9c15d240 2023-11-28T18:37:48.935 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:37:48.935 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/972230763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":972230763},{"type":"v1","addr":"172.21.15.45:6835","nonce":972230763}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/4274475693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":4274475693},{"type":"v1","addr":"172.21.15.190:6837","nonce":4274475693}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/3154556740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":3154556740},{"type":"v1","addr":"172.21.15.190:6836","nonce":3154556740}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T18:37:32.842966+0000","modified":"2023-11-28T18:37:35.841966+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6834/1657221272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1657221272},{"type":"v1","addr":"172.21.15.45:6834","nonce":1657221272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T18:37:48.936 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 8 2023-11-28T18:37:48.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.930+0000 7feea33b8640 1 -- 172.21.15.45:0/819401564 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fee80066900 msgr2=0x7fee80068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:48.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.930+0000 7feea33b8640 1 --2- 172.21.15.45:0/819401564 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fee80066900 0x7fee80068dc0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fee980b2000 tx=0x7fee98009040 comp rx=0 tx=0).stop 2023-11-28T18:37:48.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.930+0000 7feea33b8640 1 -- 172.21.15.45:0/819401564 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee9c15d240 msgr2=0x7fee9c1eff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:48.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.930+0000 7feea33b8640 1 --2- 172.21.15.45:0/819401564 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee9c15d240 0x7fee9c1eff40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fee9400efc0 tx=0x7fee9400c490 comp rx=0 tx=0).stop 2023-11-28T18:37:48.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.930+0000 7feea33b8640 1 -- 172.21.15.45:0/819401564 shutdown_connections 2023-11-28T18:37:48.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.930+0000 7feea33b8640 1 --2- 172.21.15.45:0/819401564 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fee80066900 0x7fee80068dc0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:48.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.930+0000 7feea33b8640 1 --2- 172.21.15.45:0/819401564 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee9c15d240 0x7fee9c1eff40 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:48.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.930+0000 7feea33b8640 1 --2- 172.21.15.45:0/819401564 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fee9c0d15e0 0x7fee9c1f3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:48.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.930+0000 7feea33b8640 1 --2- 172.21.15.45:0/819401564 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fee9c0d11a0 0x7fee9c153460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:48.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.930+0000 7feea33b8640 1 -- 172.21.15.45:0/819401564 >> 172.21.15.45:0/819401564 conn(0x7fee9c0722a0 msgr2=0x7fee9c0b66b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:48.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.930+0000 7feea33b8640 1 -- 172.21.15.45:0/819401564 shutdown_connections 2023-11-28T18:37:48.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:48.930+0000 7feea33b8640 1 -- 172.21.15.45:0/819401564 wait complete. 2023-11-28T18:37:49.359 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-28T18:37:32.842966+0000', 'modified': '2023-11-28T18:37:35.841966+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4281}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4281': {'gid': 4281, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.45:6834/1657221272', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.45:6832', 'nonce': 1657221272}, {'type': 'v1', 'addr': '172.21.15.45:6834', 'nonce': 1657221272}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-28T18:37:49.359 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-28T18:37:49.359 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-28T18:37:49.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.498+0000 7f7700b55640 1 Processor -- start 2023-11-28T18:37:49.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.498+0000 7f7700b55640 1 -- start start 2023-11-28T18:37:49.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.502+0000 7f7700b55640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f76fc0b47a0 0x7f76fc0d10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:49.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.502+0000 7f7700b55640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f76fc0b4b80 0x7f76fc0d1620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:49.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.502+0000 7f7700b55640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f76fc142c40 0x7f76fc143090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:49.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.502+0000 7f7700b55640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76fc15d800 con 0x7f76fc0b4b80 2023-11-28T18:37:49.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.502+0000 7f7700b55640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76fc140970 con 0x7f76fc0b47a0 2023-11-28T18:37:49.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.502+0000 7f7700b55640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76fc15da50 con 0x7f76fc142c40 2023-11-28T18:37:49.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.502+0000 7f76f3fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f76fc0b4b80 0x7f76fc0d1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:49.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.502+0000 7f76f3fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f76fc0b4b80 0x7f76fc0d1620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38912/0 (socket says 172.21.15.45:38912) 2023-11-28T18:37:49.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.502+0000 7f76f3fff640 1 -- 172.21.15.45:0/2695169870 learned_addr learned my addr 172.21.15.45:0/2695169870 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:49.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.502+0000 7f76fad9d640 1 --2- 172.21.15.45:0/2695169870 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f76fc142c40 0x7f76fc143090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:49.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.502+0000 7f76fa59c640 1 --2- 172.21.15.45:0/2695169870 >> v2:172.21.15.190:3300/0 conn(0x7f76fc0b47a0 0x7f76fc0d10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:49.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.502+0000 7f76f3fff640 1 -- 172.21.15.45:0/2695169870 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f76fc142c40 msgr2=0x7f76fc143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:49.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.502+0000 7f76f3fff640 1 --2- 172.21.15.45:0/2695169870 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f76fc142c40 0x7f76fc143090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:49.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.502+0000 7f76f3fff640 1 -- 172.21.15.45:0/2695169870 >> v2:172.21.15.190:3300/0 conn(0x7f76fc0b47a0 msgr2=0x7f76fc0d10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:49.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.502+0000 7f76f3fff640 1 --2- 172.21.15.45:0/2695169870 >> v2:172.21.15.190:3300/0 conn(0x7f76fc0b47a0 0x7f76fc0d10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:49.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.502+0000 7f76f3fff640 1 -- 172.21.15.45:0/2695169870 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76fc15dd30 con 0x7f76fc0b4b80 2023-11-28T18:37:49.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.506+0000 7f76f3fff640 1 --2- 172.21.15.45:0/2695169870 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76fc0b4b80 0x7f76fc0d1620 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f76fc0b3d70 tx=0x7f76e401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=541ce82f9b2cc91b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:49.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.506+0000 7f76f9d9b640 1 -- 172.21.15.45:0/2695169870 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e40ab600 con 0x7f76fc0b4b80 2023-11-28T18:37:49.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.506+0000 7f76f9d9b640 1 -- 172.21.15.45:0/2695169870 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76e40a7050 con 0x7f76fc0b4b80 2023-11-28T18:37:49.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.506+0000 7f76f9d9b640 1 -- 172.21.15.45:0/2695169870 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e40ab980 con 0x7f76fc0b4b80 2023-11-28T18:37:49.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.506+0000 7f7700b55640 1 -- 172.21.15.45:0/2695169870 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76fc0b4b80 msgr2=0x7f76fc0d1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:49.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.506+0000 7f7700b55640 1 --2- 172.21.15.45:0/2695169870 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76fc0b4b80 0x7f76fc0d1620 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f76fc0b3d70 tx=0x7f76e401c500 comp rx=0 tx=0).stop 2023-11-28T18:37:49.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.506+0000 7f7700b55640 1 -- 172.21.15.45:0/2695169870 shutdown_connections 2023-11-28T18:37:49.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.506+0000 7f7700b55640 1 --2- 172.21.15.45:0/2695169870 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f76fc142c40 0x7f76fc143090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:49.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.506+0000 7f7700b55640 1 --2- 172.21.15.45:0/2695169870 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76fc0b4b80 0x7f76fc0d1620 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:49.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.506+0000 7f7700b55640 1 --2- 172.21.15.45:0/2695169870 >> v2:172.21.15.190:3300/0 conn(0x7f76fc0b47a0 0x7f76fc0d10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:49.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.506+0000 7f7700b55640 1 -- 172.21.15.45:0/2695169870 >> 172.21.15.45:0/2695169870 conn(0x7f76fc06a570 msgr2=0x7f76fc06a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:49.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.506+0000 7f7700b55640 1 -- 172.21.15.45:0/2695169870 shutdown_connections 2023-11-28T18:37:49.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.506+0000 7f7700b55640 1 -- 172.21.15.45:0/2695169870 wait complete. 2023-11-28T18:37:49.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.506+0000 7f7700b55640 1 Processor -- start 2023-11-28T18:37:49.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.506+0000 7f7700b55640 1 -- start start 2023-11-28T18:37:49.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.510+0000 7f7700b55640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f76fc0b47a0 0x7f76fc13c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:49.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.510+0000 7f7700b55640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f76fc0b4b80 0x7f76fc150070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:49.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.510+0000 7f7700b55640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76fc142c40 0x7f76fc1505b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:49.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.510+0000 7f7700b55640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76fc15f3b0 con 0x7f76fc142c40 2023-11-28T18:37:49.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.510+0000 7f7700b55640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76fc13cdd0 con 0x7f76fc0b47a0 2023-11-28T18:37:49.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.510+0000 7f7700b55640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76fc15f600 con 0x7f76fc0b4b80 2023-11-28T18:37:49.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.510+0000 7f76fad9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76fc142c40 0x7f76fc1505b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:49.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.510+0000 7f76fad9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76fc142c40 0x7f76fc1505b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38928/0 (socket says 172.21.15.45:38928) 2023-11-28T18:37:49.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.510+0000 7f76fad9d640 1 -- 172.21.15.45:0/1508518278 learned_addr learned my addr 172.21.15.45:0/1508518278 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:49.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.510+0000 7f76fa59c640 1 --2- 172.21.15.45:0/1508518278 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f76fc0b47a0 0x7f76fc13c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:49.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.510+0000 7f76f3fff640 1 --2- 172.21.15.45:0/1508518278 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f76fc0b4b80 0x7f76fc150070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:49.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.510+0000 7f76fad9d640 1 -- 172.21.15.45:0/1508518278 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f76fc0b4b80 msgr2=0x7f76fc150070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:49.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.510+0000 7f76fad9d640 1 --2- 172.21.15.45:0/1508518278 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f76fc0b4b80 0x7f76fc150070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:49.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.510+0000 7f76fad9d640 1 -- 172.21.15.45:0/1508518278 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f76fc0b47a0 msgr2=0x7f76fc13c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:49.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.510+0000 7f76fad9d640 1 --2- 172.21.15.45:0/1508518278 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f76fc0b47a0 0x7f76fc13c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:49.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.510+0000 7f76fad9d640 1 -- 172.21.15.45:0/1508518278 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e40094d0 con 0x7f76fc142c40 2023-11-28T18:37:49.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.510+0000 7f76fad9d640 1 --2- 172.21.15.45:0/1508518278 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76fc142c40 0x7f76fc1505b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f76f4007e60 tx=0x7f76f400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:49.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.510+0000 7f76f2ffd640 1 -- 172.21.15.45:0/1508518278 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f4014420 con 0x7f76fc142c40 2023-11-28T18:37:49.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.510+0000 7f76f2ffd640 1 -- 172.21.15.45:0/1508518278 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f40145a0 con 0x7f76fc142c40 2023-11-28T18:37:49.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.510+0000 7f76f2ffd640 1 -- 172.21.15.45:0/1508518278 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f4014950 con 0x7f76fc142c40 2023-11-28T18:37:49.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.510+0000 7f7700b55640 1 -- 172.21.15.45:0/1508518278 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76fc15f8e0 con 0x7f76fc142c40 2023-11-28T18:37:49.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.510+0000 7f7700b55640 1 -- 172.21.15.45:0/1508518278 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76fc15fea0 con 0x7f76fc142c40 2023-11-28T18:37:49.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.510+0000 7f76f2ffd640 1 -- 172.21.15.45:0/1508518278 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f76f4014ab0 con 0x7f76fc142c40 2023-11-28T18:37:49.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.514+0000 7f76f2ffd640 1 --2- 172.21.15.45:0/1508518278 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f76dc0668d0 0x7f76dc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:49.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.514+0000 7f76f2ffd640 1 -- 172.21.15.45:0/1508518278 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f76f4084b30 con 0x7f76fc142c40 2023-11-28T18:37:49.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.514+0000 7f76fa59c640 1 --2- 172.21.15.45:0/1508518278 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f76dc0668d0 0x7f76dc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:49.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.514+0000 7f7703eba000 1 Processor -- start 2023-11-28T18:37:49.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.514+0000 7f7703eba000 1 -- start start 2023-11-28T18:37:49.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.514+0000 7f76fa59c640 1 --2- 172.21.15.45:0/1508518278 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f76dc0668d0 0x7f76dc068d90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f76ec007a60 tx=0x7f76ec008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:49.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.514+0000 7f7703eba000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a5ba7edd30 0x55a5ba7ee110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:49.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.514+0000 7f7703eba000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a5ba7ee650 0x55a5ba7a0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:49.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.514+0000 7f7703eba000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a5ba7a1500 0x55a5ba7a18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:49.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.514+0000 7f7703eba000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5ba66a110 con 0x55a5ba7a1500 2023-11-28T18:37:49.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.514+0000 7f7703eba000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5ba5fa9a0 con 0x55a5ba7edd30 2023-11-28T18:37:49.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.514+0000 7f7703eba000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a5ba5f7ed0 con 0x55a5ba7ee650 2023-11-28T18:37:49.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.514+0000 7f76fad9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a5ba7a1500 0x55a5ba7a18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:49.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.514+0000 7f76fad9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a5ba7a1500 0x55a5ba7a18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38934/0 (socket says 172.21.15.45:38934) 2023-11-28T18:37:49.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.514+0000 7f76fad9d640 1 -- 172.21.15.45:0/2622567407 learned_addr learned my addr 172.21.15.45:0/2622567407 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:49.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.514+0000 7f76f3fff640 1 --2- 172.21.15.45:0/2622567407 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a5ba7ee650 0x55a5ba7a0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:49.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.514+0000 7f76fa59c640 1 --2- 172.21.15.45:0/2622567407 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a5ba7edd30 0x55a5ba7ee110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:49.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.514+0000 7f76fad9d640 1 -- 172.21.15.45:0/2622567407 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a5ba7ee650 msgr2=0x55a5ba7a0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:49.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.514+0000 7f76fad9d640 1 --2- 172.21.15.45:0/2622567407 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a5ba7ee650 0x55a5ba7a0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:49.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.514+0000 7f76fad9d640 1 -- 172.21.15.45:0/2622567407 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a5ba7edd30 msgr2=0x55a5ba7ee110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:49.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.514+0000 7f76fad9d640 1 --2- 172.21.15.45:0/2622567407 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a5ba7edd30 0x55a5ba7ee110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:49.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.514+0000 7f76fad9d640 1 -- 172.21.15.45:0/2622567407 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a5ba2eb890 con 0x55a5ba7a1500 2023-11-28T18:37:49.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.514+0000 7f76f3fff640 1 --2- 172.21.15.45:0/2622567407 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a5ba7ee650 0x55a5ba7a0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:37:49.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.514+0000 7f76fa59c640 1 --2- 172.21.15.45:0/2622567407 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a5ba7edd30 0x55a5ba7ee110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:37:49.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.514+0000 7f76fad9d640 1 --2- 172.21.15.45:0/2622567407 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a5ba7a1500 0x55a5ba7a18e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f76f405d890 tx=0x7f76f4059c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d0bc7e08cb059e6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:49.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.514+0000 7f76dbfff640 1 -- 172.21.15.45:0/2622567407 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f4053f10 con 0x55a5ba7a1500 2023-11-28T18:37:49.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.514+0000 7f76dbfff640 1 -- 172.21.15.45:0/2622567407 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f4052280 con 0x55a5ba7a1500 2023-11-28T18:37:49.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.514+0000 7f76dbfff640 1 -- 172.21.15.45:0/2622567407 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f406d3c0 con 0x55a5ba7a1500 2023-11-28T18:37:49.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.518+0000 7f7703eba000 1 -- 172.21.15.45:0/2622567407 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a5ba7a1500 msgr2=0x55a5ba7a18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:49.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.518+0000 7f7703eba000 1 --2- 172.21.15.45:0/2622567407 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a5ba7a1500 0x55a5ba7a18e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f76f405d890 tx=0x7f76f4059c10 comp rx=0 tx=0).stop 2023-11-28T18:37:49.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.518+0000 7f7703eba000 1 -- 172.21.15.45:0/2622567407 shutdown_connections 2023-11-28T18:37:49.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.518+0000 7f7703eba000 1 --2- 172.21.15.45:0/2622567407 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a5ba7a1500 0x55a5ba7a18e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:49.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.518+0000 7f7703eba000 1 --2- 172.21.15.45:0/2622567407 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a5ba7ee650 0x55a5ba7a0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:49.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.518+0000 7f7703eba000 1 --2- 172.21.15.45:0/2622567407 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a5ba7edd30 0x55a5ba7ee110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:49.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.518+0000 7f7703eba000 1 -- 172.21.15.45:0/2622567407 >> 172.21.15.45:0/2622567407 conn(0x55a5ba7ce8c0 msgr2=0x55a5ba7d0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:49.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.518+0000 7f7703eba000 1 -- 172.21.15.45:0/2622567407 shutdown_connections 2023-11-28T18:37:49.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.518+0000 7f7703eba000 1 -- 172.21.15.45:0/2622567407 wait complete. 2023-11-28T18:37:49.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.518+0000 7f7703eba000 1 -- start start 2023-11-28T18:37:49.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.518+0000 7f7703eba000 1 Processor -- start 2023-11-28T18:37:49.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.518+0000 7f7703eba000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a5ba7a1500 0x55a5ba7a74e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:49.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.518+0000 7f7703eba000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a5ba7edd30 0x55a5ba7a7a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:49.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.518+0000 7f7703eba000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a5ba7ee650 0x55a5ba7a7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:49.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.518+0000 7f7703eba000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5ba5f37c0 con 0x55a5ba7a1500 2023-11-28T18:37:49.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.518+0000 7f7703eba000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5ba5abbf0 con 0x55a5ba7edd30 2023-11-28T18:37:49.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.518+0000 7f7703eba000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a5ba5b1a90 con 0x55a5ba7ee650 2023-11-28T18:37:49.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.518+0000 7f7703eba000 10 client.0 _ll_register_callbacks cb 0x55a5ba78ee20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T18:37:49.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.518+0000 7f76fa59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a5ba7a1500 0x55a5ba7a74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:49.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.518+0000 7f76fa59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a5ba7a1500 0x55a5ba7a74e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38944/0 (socket says 172.21.15.45:38944) 2023-11-28T18:37:49.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.518+0000 7f76f3fff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a5ba7edd30 0x55a5ba7a7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:49.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.518+0000 7f76fa59c640 1 -- 172.21.15.45:0/548017606 learned_addr learned my addr 172.21.15.45:0/548017606 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:49.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.518+0000 7f76fad9d640 1 --2- 172.21.15.45:0/548017606 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a5ba7ee650 0x55a5ba7a7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:49.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.518+0000 7f76fa59c640 1 -- 172.21.15.45:0/548017606 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a5ba7ee650 msgr2=0x55a5ba7a7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:49.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.518+0000 7f76fa59c640 1 --2- 172.21.15.45:0/548017606 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a5ba7ee650 0x55a5ba7a7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:49.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.518+0000 7f76fa59c640 1 -- 172.21.15.45:0/548017606 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a5ba7edd30 msgr2=0x55a5ba7a7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:49.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.518+0000 7f76fa59c640 1 --2- 172.21.15.45:0/548017606 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a5ba7edd30 0x55a5ba7a7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:49.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.518+0000 7f76fa59c640 1 -- 172.21.15.45:0/548017606 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76fc15fea0 con 0x55a5ba7a1500 2023-11-28T18:37:49.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.518+0000 7f76fa59c640 1 --2- 172.21.15.45:0/548017606 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a5ba7a1500 0x55a5ba7a74e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f76ec016a00 tx=0x7f76ec004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a041d6fc0413f20 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:49.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.518+0000 7f76d97fa640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-11-28T18:37:49.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.522+0000 7f76d97fa640 1 -- 172.21.15.45:0/548017606 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ec026070 con 0x55a5ba7a1500 2023-11-28T18:37:49.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.522+0000 7f7703eba000 1 -- 172.21.15.45:0/548017606 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a5ba5b5470 con 0x55a5ba7a1500 2023-11-28T18:37:49.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.522+0000 7f76d97fa640 1 -- 172.21.15.45:0/548017606 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f76ec010e60 con 0x55a5ba7a1500 2023-11-28T18:37:49.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.522+0000 7f76d97fa640 1 -- 172.21.15.45:0/548017606 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f76ec014bc0 con 0x55a5ba7a1500 2023-11-28T18:37:49.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.522+0000 7f7703eba000 10 client.4671 fetch_fsmap learned FSMap version 8 2023-11-28T18:37:49.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.522+0000 7f7703eba000 1 -- 172.21.15.45:0/548017606 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55a5ba5b4190 con 0x55a5ba7a1500 2023-11-28T18:37:49.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.522+0000 7f76d97fa640 1 -- 172.21.15.45:0/548017606 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a5ba5b5470 con 0x55a5ba7a1500 2023-11-28T18:37:49.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.522+0000 7f76d97fa640 1 -- 172.21.15.45:0/548017606 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f76ec029020 con 0x55a5ba7a1500 2023-11-28T18:37:49.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.522+0000 7f7703eba000 10 client.4671 fetch_fsmap finished waiting for FSMap version 8 2023-11-28T18:37:49.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.522+0000 7f7703eba000 10 client.4671 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-28T18:37:49.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.522+0000 7f7703eba000 20 client.4671 populate_metadata read hostname 'smithi045' 2023-11-28T18:37:49.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.522+0000 7f7703eba000 1 --2- 172.21.15.45:0/548017606 >> [v2:172.21.15.45:6832/1657221272,v1:172.21.15.45:6834/1657221272] conn(0x55a5ba7a8970 0x55a5ba7ffff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:49.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.522+0000 7f7703eba000 4 client.4671 mds_command: new command op to 4281 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-28T18:37:49.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.522+0000 7f7703eba000 1 -- 172.21.15.45:0/548017606 --> [v2:172.21.15.45:6832/1657221272,v1:172.21.15.45:6834/1657221272] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a5ba5b8b50 con 0x55a5ba7a8970 2023-11-28T18:37:49.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.522+0000 7f76f3fff640 1 --2- 172.21.15.45:0/548017606 >> [v2:172.21.15.45:6832/1657221272,v1:172.21.15.45:6834/1657221272] conn(0x55a5ba7a8970 0x55a5ba7ffff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:49.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.522+0000 7f76f3fff640 1 --2- 172.21.15.45:0/548017606 >> [v2:172.21.15.45:6832/1657221272,v1:172.21.15.45:6834/1657221272] conn(0x55a5ba7a8970 0x55a5ba7ffff0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7030f8757d74a86 server_cookie=1a9253dc8f367025 in_seq=0 out_seq=0 2023-11-28T18:37:49.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.522+0000 7f76d97fa640 10 client.4671 ms_handle_connect on v2:172.21.15.45:6832/1657221272 2023-11-28T18:37:49.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.522+0000 7f76d97fa640 1 -- 172.21.15.45:0/548017606 <== mds.0 v2:172.21.15.45:6832/1657221272 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a5ba5b8b50 con 0x55a5ba7a8970 2023-11-28T18:37:49.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.522+0000 7f76d97fa640 10 client.4671 handle_command_reply: tid=0 2023-11-28T18:37:49.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.522+0000 7f7703eba000 1 client.4671 shutdown 2023-11-28T18:37:49.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.522+0000 7f7703eba000 1 -- 172.21.15.45:0/548017606 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a5ba7a1500 msgr2=0x55a5ba7a74e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:49.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.522+0000 7f7703eba000 1 --2- 172.21.15.45:0/548017606 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a5ba7a1500 0x55a5ba7a74e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f76ec016a00 tx=0x7f76ec004740 comp rx=0 tx=0).stop 2023-11-28T18:37:49.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.522+0000 7f7703eba000 1 -- 172.21.15.45:0/548017606 shutdown_connections 2023-11-28T18:37:49.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.522+0000 7f7703eba000 1 --2- 172.21.15.45:0/548017606 >> [v2:172.21.15.45:6832/1657221272,v1:172.21.15.45:6834/1657221272] conn(0x55a5ba7a8970 0x55a5ba7ffff0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:49.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.522+0000 7f7703eba000 1 --2- 172.21.15.45:0/548017606 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a5ba7ee650 0x55a5ba7a7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:49.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.522+0000 7f7703eba000 1 --2- 172.21.15.45:0/548017606 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a5ba7edd30 0x55a5ba7a7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:49.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.522+0000 7f76d97fa640 0 client.4671 ms_handle_reset on v2:172.21.15.45:6832/1657221272 2023-11-28T18:37:49.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.522+0000 7f7703eba000 1 --2- 172.21.15.45:0/548017606 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a5ba7a1500 0x55a5ba7a74e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:49.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.522+0000 7f7703eba000 1 -- 172.21.15.45:0/548017606 >> 172.21.15.45:0/548017606 conn(0x55a5ba7ce8c0 msgr2=0x55a5ba7a06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:49.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.522+0000 7f7703eba000 1 -- 172.21.15.45:0/548017606 shutdown_connections 2023-11-28T18:37:49.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.522+0000 7f7703eba000 1 -- 172.21.15.45:0/548017606 wait complete. 2023-11-28T18:37:49.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.522+0000 7f7703eba000 20 client.4671 trim_cache size 0 max 16384 2023-11-28T18:37:49.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.538+0000 7f7703eba000 1 Processor -- start 2023-11-28T18:37:49.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.538+0000 7f7703eba000 1 -- start start 2023-11-28T18:37:49.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.538+0000 7f7703eba000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a5ba7a1500 0x55a5ba7cd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:49.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.538+0000 7f7703eba000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a5ba7edd30 0x55a5ba7cd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:49.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.538+0000 7f7703eba000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a5ba7ee650 0x55a5ba7ffff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:49.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.538+0000 7f7703eba000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5ba2ac940 con 0x55a5ba7ee650 2023-11-28T18:37:49.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.538+0000 7f7703eba000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5ba7a4dd0 con 0x55a5ba7a1500 2023-11-28T18:37:49.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.538+0000 7f7703eba000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a5ba5c8b70 con 0x55a5ba7edd30 2023-11-28T18:37:49.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.542+0000 7f76fad9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a5ba7ee650 0x55a5ba7ffff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:49.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.542+0000 7f76fad9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a5ba7ee650 0x55a5ba7ffff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38960/0 (socket says 172.21.15.45:38960) 2023-11-28T18:37:49.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.542+0000 7f76fad9d640 1 -- 172.21.15.45:0/1007348876 learned_addr learned my addr 172.21.15.45:0/1007348876 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:49.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.542+0000 7f76fa59c640 1 --2- 172.21.15.45:0/1007348876 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a5ba7a1500 0x55a5ba7cd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:49.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.542+0000 7f76f3fff640 1 --2- 172.21.15.45:0/1007348876 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a5ba7edd30 0x55a5ba7cd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:49.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.542+0000 7f76fad9d640 1 -- 172.21.15.45:0/1007348876 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a5ba7edd30 msgr2=0x55a5ba7cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:49.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.542+0000 7f76fad9d640 1 --2- 172.21.15.45:0/1007348876 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a5ba7edd30 0x55a5ba7cd8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:49.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.542+0000 7f76fad9d640 1 -- 172.21.15.45:0/1007348876 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a5ba7a1500 msgr2=0x55a5ba7cd3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:49.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.542+0000 7f76fad9d640 1 --2- 172.21.15.45:0/1007348876 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a5ba7a1500 0x55a5ba7cd3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:49.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.542+0000 7f76fad9d640 1 -- 172.21.15.45:0/1007348876 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a5ba59a490 con 0x55a5ba7ee650 2023-11-28T18:37:49.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.542+0000 7f76fad9d640 1 --2- 172.21.15.45:0/1007348876 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a5ba7ee650 0x55a5ba7ffff0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f76f405df80 tx=0x7f76f4059000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6db5cecfbfcb4a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:49.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.542+0000 7f76f0ff9640 1 -- 172.21.15.45:0/1007348876 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f4053f10 con 0x55a5ba7ee650 2023-11-28T18:37:49.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.542+0000 7f76f0ff9640 1 -- 172.21.15.45:0/1007348876 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f40830c0 con 0x55a5ba7ee650 2023-11-28T18:37:49.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.542+0000 7f76f0ff9640 1 -- 172.21.15.45:0/1007348876 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f406d1c0 con 0x55a5ba7ee650 2023-11-28T18:37:49.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.542+0000 7f7703eba000 1 -- 172.21.15.45:0/1007348876 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a5ba7ee650 msgr2=0x55a5ba7ffff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:49.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.542+0000 7f7703eba000 1 --2- 172.21.15.45:0/1007348876 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a5ba7ee650 0x55a5ba7ffff0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f76f405df80 tx=0x7f76f4059000 comp rx=0 tx=0).stop 2023-11-28T18:37:49.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.542+0000 7f7703eba000 1 -- 172.21.15.45:0/1007348876 shutdown_connections 2023-11-28T18:37:49.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.542+0000 7f7703eba000 1 --2- 172.21.15.45:0/1007348876 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a5ba7ee650 0x55a5ba7ffff0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:49.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.542+0000 7f7703eba000 1 --2- 172.21.15.45:0/1007348876 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a5ba7edd30 0x55a5ba7cd8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:49.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.542+0000 7f7703eba000 1 --2- 172.21.15.45:0/1007348876 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a5ba7a1500 0x55a5ba7cd3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:49.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.542+0000 7f7703eba000 1 -- 172.21.15.45:0/1007348876 >> 172.21.15.45:0/1007348876 conn(0x55a5ba7ce8c0 msgr2=0x55a5ba79f720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:49.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.542+0000 7f7703eba000 1 -- 172.21.15.45:0/1007348876 shutdown_connections 2023-11-28T18:37:49.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.542+0000 7f7703eba000 1 -- 172.21.15.45:0/1007348876 wait complete. 2023-11-28T18:37:49.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.542+0000 7f7703eba000 1 -- start start 2023-11-28T18:37:49.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.542+0000 7f7703eba000 1 Processor -- start 2023-11-28T18:37:49.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.542+0000 7f7703eba000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a5ba7a1500 0x55a5ba84e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:49.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.542+0000 7f7703eba000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a5ba7edd30 0x55a5ba84ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:49.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.542+0000 7f7703eba000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a5ba7ee650 0x55a5ba809a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:49.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.542+0000 7f7703eba000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5ba58e8a0 con 0x55a5ba7a1500 2023-11-28T18:37:49.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.542+0000 7f7703eba000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5ba5bc910 con 0x55a5ba7ee650 2023-11-28T18:37:49.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.542+0000 7f7703eba000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a5ba689440 con 0x55a5ba7edd30 2023-11-28T18:37:49.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.542+0000 7f7703eba000 10 client.0 _ll_register_callbacks cb 0x55a5ba66a060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T18:37:49.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.542+0000 7f76fa59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a5ba7a1500 0x55a5ba84e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:49.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.546+0000 7f76fa59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a5ba7a1500 0x55a5ba84e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38974/0 (socket says 172.21.15.45:38974) 2023-11-28T18:37:49.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.546+0000 7f76fa59c640 1 -- 172.21.15.45:0/552288244 learned_addr learned my addr 172.21.15.45:0/552288244 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:49.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.546+0000 7f76fad9d640 1 --2- 172.21.15.45:0/552288244 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a5ba7ee650 0x55a5ba809a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:49.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.546+0000 7f76f3fff640 1 --2- 172.21.15.45:0/552288244 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a5ba7edd30 0x55a5ba84ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:49.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.546+0000 7f76fa59c640 1 -- 172.21.15.45:0/552288244 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a5ba7edd30 msgr2=0x55a5ba84ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:49.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.546+0000 7f76fa59c640 1 --2- 172.21.15.45:0/552288244 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a5ba7edd30 0x55a5ba84ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:49.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.546+0000 7f76fa59c640 1 -- 172.21.15.45:0/552288244 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a5ba7ee650 msgr2=0x55a5ba809a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:49.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.546+0000 7f76fa59c640 1 --2- 172.21.15.45:0/552288244 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a5ba7ee650 0x55a5ba809a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:49.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.546+0000 7f76fa59c640 1 -- 172.21.15.45:0/552288244 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a5ba2eb890 con 0x55a5ba7a1500 2023-11-28T18:37:49.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.546+0000 7f76fa59c640 1 --2- 172.21.15.45:0/552288244 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a5ba7a1500 0x55a5ba84e810 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f76ec006b20 tx=0x7f76ec015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59cf73099dd6c19d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:49.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.546+0000 7f76d97fa640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-11-28T18:37:49.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.546+0000 7f76d97fa640 1 -- 172.21.15.45:0/552288244 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ec026040 con 0x55a5ba7a1500 2023-11-28T18:37:49.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.546+0000 7f7703eba000 1 -- 172.21.15.45:0/552288244 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a5ba5f2110 con 0x55a5ba7a1500 2023-11-28T18:37:49.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.546+0000 7f76d97fa640 1 -- 172.21.15.45:0/552288244 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f76ec004510 con 0x55a5ba7a1500 2023-11-28T18:37:49.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.546+0000 7f76d97fa640 1 -- 172.21.15.45:0/552288244 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f76ec014800 con 0x55a5ba7a1500 2023-11-28T18:37:49.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.546+0000 7f7703eba000 10 client.4677 fetch_fsmap learned FSMap version 8 2023-11-28T18:37:49.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.546+0000 7f7703eba000 1 -- 172.21.15.45:0/552288244 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55a5ba2ebcc0 con 0x55a5ba7a1500 2023-11-28T18:37:49.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.546+0000 7f76d97fa640 1 -- 172.21.15.45:0/552288244 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76ec041070 con 0x55a5ba7a1500 2023-11-28T18:37:49.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.546+0000 7f76d97fa640 1 -- 172.21.15.45:0/552288244 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f76ec029070 con 0x55a5ba7a1500 2023-11-28T18:37:49.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.546+0000 7f7703eba000 10 client.4677 fetch_fsmap finished waiting for FSMap version 8 2023-11-28T18:37:49.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.546+0000 7f7703eba000 10 client.4677 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-28T18:37:49.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.546+0000 7f7703eba000 20 client.4677 populate_metadata read hostname 'smithi045' 2023-11-28T18:37:49.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.546+0000 7f7703eba000 1 --2- 172.21.15.45:0/552288244 >> [v2:172.21.15.45:6832/1657221272,v1:172.21.15.45:6834/1657221272] conn(0x55a5ba855670 0x55a5ba857a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:49.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.546+0000 7f7703eba000 4 client.4677 mds_command: new command op to 4281 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-28T18:37:49.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.546+0000 7f7703eba000 1 -- 172.21.15.45:0/552288244 --> [v2:172.21.15.45:6832/1657221272,v1:172.21.15.45:6834/1657221272] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a5ba620650 con 0x55a5ba855670 2023-11-28T18:37:49.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.546+0000 7f76f3fff640 1 --2- 172.21.15.45:0/552288244 >> [v2:172.21.15.45:6832/1657221272,v1:172.21.15.45:6834/1657221272] conn(0x55a5ba855670 0x55a5ba857a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:49.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.546+0000 7f76f3fff640 1 --2- 172.21.15.45:0/552288244 >> [v2:172.21.15.45:6832/1657221272,v1:172.21.15.45:6834/1657221272] conn(0x55a5ba855670 0x55a5ba857a60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f650b2c47ed20918 server_cookie=7d70724ccd003a2c in_seq=0 out_seq=0 2023-11-28T18:37:49.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.546+0000 7f76d97fa640 10 client.4677 ms_handle_connect on v2:172.21.15.45:6832/1657221272 2023-11-28T18:37:49.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.546+0000 7f76d97fa640 1 -- 172.21.15.45:0/552288244 <== mds.0 v2:172.21.15.45:6832/1657221272 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55a5ba620650 con 0x55a5ba855670 2023-11-28T18:37:49.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.546+0000 7f76d97fa640 10 client.4677 handle_command_reply: tid=0 2023-11-28T18:37:49.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.546+0000 7f7703eba000 1 client.4677 shutdown 2023-11-28T18:37:49.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.546+0000 7f7703eba000 1 -- 172.21.15.45:0/552288244 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a5ba7a1500 msgr2=0x55a5ba84e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:49.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.546+0000 7f7703eba000 1 --2- 172.21.15.45:0/552288244 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a5ba7a1500 0x55a5ba84e810 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f76ec006b20 tx=0x7f76ec015000 comp rx=0 tx=0).stop 2023-11-28T18:37:49.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.546+0000 7f7703eba000 1 -- 172.21.15.45:0/552288244 shutdown_connections 2023-11-28T18:37:49.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.546+0000 7f7703eba000 1 --2- 172.21.15.45:0/552288244 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a5ba7ee650 0x55a5ba809a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:49.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.546+0000 7f7703eba000 1 --2- 172.21.15.45:0/552288244 >> [v2:172.21.15.45:6832/1657221272,v1:172.21.15.45:6834/1657221272] conn(0x55a5ba855670 0x55a5ba857a60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:49.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.546+0000 7f7703eba000 1 --2- 172.21.15.45:0/552288244 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a5ba7edd30 0x55a5ba84ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:49.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.546+0000 7f7703eba000 1 --2- 172.21.15.45:0/552288244 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a5ba7a1500 0x55a5ba84e810 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:49.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.546+0000 7f7703eba000 1 -- 172.21.15.45:0/552288244 >> 172.21.15.45:0/552288244 conn(0x55a5ba7ce8c0 msgr2=0x55a5ba79ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:49.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.546+0000 7f76d97fa640 0 client.4677 ms_handle_reset on v2:172.21.15.45:6832/1657221272 2023-11-28T18:37:49.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.546+0000 7f7703eba000 1 -- 172.21.15.45:0/552288244 shutdown_connections 2023-11-28T18:37:49.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.546+0000 7f7703eba000 1 -- 172.21.15.45:0/552288244 wait complete. 2023-11-28T18:37:49.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.546+0000 7f7703eba000 20 client.4677 trim_cache size 0 max 16384 2023-11-28T18:37:49.559 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-11-28T18:37:49.559 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_fsid": "d10f5cd6-1d00-4019-99b6-6fa435498a15", 2023-11-28T18:37:49.560 INFO:teuthology.orchestra.run.smithi045.stdout: "whoami": 0, 2023-11-28T18:37:49.560 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 4281, 2023-11-28T18:37:49.560 INFO:teuthology.orchestra.run.smithi045.stdout: "want_state": "up:active", 2023-11-28T18:37:49.560 INFO:teuthology.orchestra.run.smithi045.stdout: "state": "up:active", 2023-11-28T18:37:49.560 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs", 2023-11-28T18:37:49.561 INFO:teuthology.orchestra.run.smithi045.stdout: "rank_uptime": 16.109293476000001, 2023-11-28T18:37:49.561 INFO:teuthology.orchestra.run.smithi045.stdout: "mdsmap_epoch": 8, 2023-11-28T18:37:49.561 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch": 20, 2023-11-28T18:37:49.561 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch_barrier": 20, 2023-11-28T18:37:49.561 INFO:teuthology.orchestra.run.smithi045.stdout: "uptime": 22.933386938999998 2023-11-28T18:37:49.561 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-11-28T18:37:49.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.550+0000 7f7700b55640 1 -- 172.21.15.45:0/1508518278 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f76dc0668d0 msgr2=0x7f76dc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:49.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.550+0000 7f7700b55640 1 --2- 172.21.15.45:0/1508518278 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f76dc0668d0 0x7f76dc068d90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f76ec007a60 tx=0x7f76ec008040 comp rx=0 tx=0).stop 2023-11-28T18:37:49.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.550+0000 7f7700b55640 1 -- 172.21.15.45:0/1508518278 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76fc142c40 msgr2=0x7f76fc1505b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:49.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.550+0000 7f7700b55640 1 --2- 172.21.15.45:0/1508518278 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76fc142c40 0x7f76fc1505b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f76f4007e60 tx=0x7f76f400e4b0 comp rx=0 tx=0).stop 2023-11-28T18:37:49.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.550+0000 7f7700b55640 1 -- 172.21.15.45:0/1508518278 shutdown_connections 2023-11-28T18:37:49.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.550+0000 7f7700b55640 1 --2- 172.21.15.45:0/1508518278 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f76dc0668d0 0x7f76dc068d90 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:49.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.550+0000 7f7700b55640 1 --2- 172.21.15.45:0/1508518278 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76fc142c40 0x7f76fc1505b0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:49.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.550+0000 7f7700b55640 1 --2- 172.21.15.45:0/1508518278 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f76fc0b4b80 0x7f76fc150070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:49.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.550+0000 7f7700b55640 1 --2- 172.21.15.45:0/1508518278 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f76fc0b47a0 0x7f76fc13c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:49.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.550+0000 7f7700b55640 1 -- 172.21.15.45:0/1508518278 >> 172.21.15.45:0/1508518278 conn(0x7f76fc06a570 msgr2=0x7f76fc141510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:49.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.550+0000 7f7700b55640 1 -- 172.21.15.45:0/1508518278 shutdown_connections 2023-11-28T18:37:49.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.550+0000 7f7700b55640 1 -- 172.21.15.45:0/1508518278 wait complete. 2023-11-28T18:37:49.573 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-11-28T18:37:49.597 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-11-28T18:37:49.597 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-11-28T18:37:49.597 INFO:tasks.ceph_fuse:client.0 config is {} 2023-11-28T18:37:49.598 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-28T18:37:49.598 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-28T18:37:49.598 INFO:tasks.ceph_fuse:client.2 config is {} 2023-11-28T18:37:49.598 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-28T18:37:49.598 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-28T18:37:49.598 INFO:tasks.ceph_fuse:client.1 config is {} 2023-11-28T18:37:49.598 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-28T18:37:49.598 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-28T18:37:49.598 INFO:tasks.ceph_fuse:client.3 config is {} 2023-11-28T18:37:49.599 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-28T18:37:49.599 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-28T18:37:49.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:37:49.599 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-11-28T18:37:49.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:37:49.609 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link delete ceph-brx 2023-11-28T18:37:49.674 INFO:teuthology.orchestra.run.smithi045.stderr:Cannot find device "ceph-brx" 2023-11-28T18:37:49.675 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T18:37:49.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:37:49.676 DEBUG:teuthology.orchestra.run.smithi190:> ip netns list 2023-11-28T18:37:49.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:37:49.687 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip link delete ceph-brx 2023-11-28T18:37:49.755 INFO:teuthology.orchestra.run.smithi190.stderr:Cannot find device "ceph-brx" 2023-11-28T18:37:49.757 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T18:37:49.757 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-11-28T18:37:49.758 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T18:37:49.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.894+0000 7f27bad80640 1 Processor -- start 2023-11-28T18:37:49.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.894+0000 7f27bad80640 1 -- start start 2023-11-28T18:37:49.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.894+0000 7f27bad80640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f27b4144880 0x7f27b406c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:49.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.894+0000 7f27bad80640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f27b40721c0 0x7f27b406c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:49.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.894+0000 7f27bad80640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27b4071120 con 0x7f27b40704a0 2023-11-28T18:37:49.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.894+0000 7f27bad80640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27b415f050 con 0x7f27b40721c0 2023-11-28T18:37:49.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.894+0000 7f27bad80640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27b4071400 con 0x7f27b4144880 2023-11-28T18:37:49.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.898+0000 7f27b3fff640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f27b40721c0 0x7f27b406c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:49.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.898+0000 7f27b8b1c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f27b4144880 0x7f27b406c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:49.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.898+0000 7f27b3fff640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f27b40721c0 0x7f27b406c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.45:43030/0 (socket says 172.21.15.45:43030) 2023-11-28T18:37:49.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.898+0000 7f27b3fff640 1 -- 172.21.15.45:0/3466672758 learned_addr learned my addr 172.21.15.45:0/3466672758 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:49.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.898+0000 7f27b3fff640 1 -- 172.21.15.45:0/3466672758 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f27b4144880 msgr2=0x7f27b406c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:49.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.898+0000 7f27b3fff640 1 --2- 172.21.15.45:0/3466672758 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f27b4144880 0x7f27b406c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:49.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.898+0000 7f27b3fff640 1 -- 172.21.15.45:0/3466672758 >> v1:172.21.15.190:6789/0 conn(0x7f27b40704a0 legacy=0x7f27b4070920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:49.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.898+0000 7f27b3fff640 1 -- 172.21.15.45:0/3466672758 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27b40716e0 con 0x7f27b40721c0 2023-11-28T18:37:49.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.898+0000 7f27b8b1c640 1 --2- 172.21.15.45:0/3466672758 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f27b4144880 0x7f27b406c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:37:49.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.898+0000 7f27b3fff640 1 --2- 172.21.15.45:0/3466672758 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f27b40721c0 0x7f27b406c840 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f27a0009870 tx=0x7f27a001c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4837b2016031899c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:49.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.902+0000 7f27b37fe640 1 -- 172.21.15.45:0/3466672758 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27a00aa670 con 0x7f27b40721c0 2023-11-28T18:37:49.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.902+0000 7f27b37fe640 1 -- 172.21.15.45:0/3466672758 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27a00aa7d0 con 0x7f27b40721c0 2023-11-28T18:37:49.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.902+0000 7f27b37fe640 1 -- 172.21.15.45:0/3466672758 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27a00aab60 con 0x7f27b40721c0 2023-11-28T18:37:49.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.902+0000 7f27bad80640 1 -- 172.21.15.45:0/3466672758 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f27b40721c0 msgr2=0x7f27b406c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:49.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.902+0000 7f27bad80640 1 --2- 172.21.15.45:0/3466672758 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f27b40721c0 0x7f27b406c840 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f27a0009870 tx=0x7f27a001c510 comp rx=0 tx=0).stop 2023-11-28T18:37:49.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.902+0000 7f27bad80640 1 -- 172.21.15.45:0/3466672758 shutdown_connections 2023-11-28T18:37:49.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.902+0000 7f27bad80640 1 --2- 172.21.15.45:0/3466672758 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f27b40721c0 0x7f27b406c840 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:49.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.902+0000 7f27bad80640 1 --2- 172.21.15.45:0/3466672758 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f27b4144880 0x7f27b406c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:49.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.902+0000 7f27bad80640 1 -- 172.21.15.45:0/3466672758 >> 172.21.15.45:0/3466672758 conn(0x7f27b406a570 msgr2=0x7f27b406a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:49.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.902+0000 7f27bad80640 1 -- 172.21.15.45:0/3466672758 shutdown_connections 2023-11-28T18:37:49.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.902+0000 7f27bad80640 1 -- 172.21.15.45:0/3466672758 wait complete. 2023-11-28T18:37:49.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.902+0000 7f27bad80640 1 Processor -- start 2023-11-28T18:37:49.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.902+0000 7f27bad80640 1 -- start start 2023-11-28T18:37:49.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.902+0000 7f27bad80640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f27b40704a0 0x7f27b40b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:49.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.902+0000 7f27bad80640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f27b40721c0 0x7f27b415a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:49.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.902+0000 7f27bad80640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f27b4144880 0x7f27b41f98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:49.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.902+0000 7f27bad80640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27b415acb0 con 0x7f27b4144880 2023-11-28T18:37:49.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.902+0000 7f27bad80640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27b4142cc0 con 0x7f27b40721c0 2023-11-28T18:37:49.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.902+0000 7f27bad80640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27b41f9e20 con 0x7f27b40704a0 2023-11-28T18:37:49.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.906+0000 7f27b931d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f27b4144880 0x7f27b41f98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:49.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.906+0000 7f27b931d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f27b4144880 0x7f27b41f98e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38990/0 (socket says 172.21.15.45:38990) 2023-11-28T18:37:49.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.906+0000 7f27b3fff640 1 --2- 172.21.15.45:0/2118532324 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f27b40721c0 0x7f27b415a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:49.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.906+0000 7f27b931d640 1 -- 172.21.15.45:0/2118532324 learned_addr learned my addr 172.21.15.45:0/2118532324 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:49.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.906+0000 7f27b8b1c640 1 --2- 172.21.15.45:0/2118532324 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f27b40704a0 0x7f27b40b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:49.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.906+0000 7f27b931d640 1 -- 172.21.15.45:0/2118532324 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f27b40704a0 msgr2=0x7f27b40b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:49.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.906+0000 7f27b931d640 1 --2- 172.21.15.45:0/2118532324 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f27b40704a0 0x7f27b40b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:49.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.906+0000 7f27b931d640 1 -- 172.21.15.45:0/2118532324 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f27b40721c0 msgr2=0x7f27b415a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:49.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.906+0000 7f27b931d640 1 --2- 172.21.15.45:0/2118532324 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f27b40721c0 0x7f27b415a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:49.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.906+0000 7f27b931d640 1 -- 172.21.15.45:0/2118532324 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27a8009420 con 0x7f27b4144880 2023-11-28T18:37:49.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.906+0000 7f27b931d640 1 --2- 172.21.15.45:0/2118532324 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f27b4144880 0x7f27b41f98e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f27ac00c710 tx=0x7f27ac00cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:49.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.906+0000 7f27b17fa640 1 -- 172.21.15.45:0/2118532324 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ac006d60 con 0x7f27b4144880 2023-11-28T18:37:49.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.906+0000 7f27b17fa640 1 -- 172.21.15.45:0/2118532324 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27ac00ce20 con 0x7f27b4144880 2023-11-28T18:37:49.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.906+0000 7f27b17fa640 1 -- 172.21.15.45:0/2118532324 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ac003bc0 con 0x7f27b4144880 2023-11-28T18:37:49.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.906+0000 7f27bad80640 1 -- 172.21.15.45:0/2118532324 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27a00094d0 con 0x7f27b4144880 2023-11-28T18:37:49.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.906+0000 7f27bad80640 1 -- 172.21.15.45:0/2118532324 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27b40b29a0 con 0x7f27b4144880 2023-11-28T18:37:49.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.906+0000 7f27bad80640 1 -- 172.21.15.45:0/2118532324 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27b4142e30 con 0x7f27b4144880 2023-11-28T18:37:49.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.906+0000 7f27b17fa640 1 -- 172.21.15.45:0/2118532324 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f27ac003d20 con 0x7f27b4144880 2023-11-28T18:37:49.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.910+0000 7f27b17fa640 1 --2- 172.21.15.45:0/2118532324 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f27980668d0 0x7f2798068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:49.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.910+0000 7f27b17fa640 1 -- 172.21.15.45:0/2118532324 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f27ac083f40 con 0x7f27b4144880 2023-11-28T18:37:49.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.910+0000 7f27b8b1c640 1 --2- 172.21.15.45:0/2118532324 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f27980668d0 0x7f2798068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:49.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.910+0000 7f27b8b1c640 1 --2- 172.21.15.45:0/2118532324 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f27980668d0 0x7f2798068d90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f27a8009c50 tx=0x7f27a8009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:49.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:49.910+0000 7f27b17fa640 1 -- 172.21.15.45:0/2118532324 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f27ac054c30 con 0x7f27b4144880 2023-11-28T18:37:50.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:50.170+0000 7f27bad80640 1 -- 172.21.15.45:0/2118532324 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f27b4069480 con 0x7f27b4144880 2023-11-28T18:37:50.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:50.170+0000 7f27b17fa640 1 -- 172.21.15.45:0/2118532324 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f27ac0547c0 con 0x7f27b4144880 2023-11-28T18:37:50.177 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T18:37:50.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:50.174+0000 7f27bad80640 1 -- 172.21.15.45:0/2118532324 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f27980668d0 msgr2=0x7f2798068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:50.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:50.174+0000 7f27bad80640 1 --2- 172.21.15.45:0/2118532324 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f27980668d0 0x7f2798068d90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f27a8009c50 tx=0x7f27a8009190 comp rx=0 tx=0).stop 2023-11-28T18:37:50.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:50.174+0000 7f27bad80640 1 -- 172.21.15.45:0/2118532324 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f27b4144880 msgr2=0x7f27b41f98e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:50.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:50.174+0000 7f27bad80640 1 --2- 172.21.15.45:0/2118532324 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f27b4144880 0x7f27b41f98e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f27ac00c710 tx=0x7f27ac00cbd0 comp rx=0 tx=0).stop 2023-11-28T18:37:50.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:50.174+0000 7f27bad80640 1 -- 172.21.15.45:0/2118532324 shutdown_connections 2023-11-28T18:37:50.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:50.174+0000 7f27bad80640 1 --2- 172.21.15.45:0/2118532324 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f27980668d0 0x7f2798068d90 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:50.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:50.174+0000 7f27bad80640 1 --2- 172.21.15.45:0/2118532324 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f27b4144880 0x7f27b41f98e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:50.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:50.174+0000 7f27bad80640 1 --2- 172.21.15.45:0/2118532324 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f27b40721c0 0x7f27b415a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:50.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:50.174+0000 7f27bad80640 1 --2- 172.21.15.45:0/2118532324 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f27b40704a0 0x7f27b40b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:50.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:50.174+0000 7f27bad80640 1 -- 172.21.15.45:0/2118532324 >> 172.21.15.45:0/2118532324 conn(0x7f27b406a570 msgr2=0x7f27b415dc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:50.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:50.174+0000 7f27bad80640 1 -- 172.21.15.45:0/2118532324 shutdown_connections 2023-11-28T18:37:50.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:50.174+0000 7f27bad80640 1 -- 172.21.15.45:0/2118532324 wait complete. 2023-11-28T18:37:50.199 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-28T18:37:50.199 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T18:37:50.199 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi045.front.sepia.ceph.com 2023-11-28T18:37:50.199 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-28T18:37:50.200 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-28T18:37:50.200 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-28T18:37:50.200 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-28T18:37:50.200 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T18:37:50.200 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T18:37:50.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:37:50.201 DEBUG:teuthology.orchestra.run.smithi045:> ip addr 2023-11-28T18:37:50.211 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T18:37:50.212 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T18:37:50.212 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T18:37:50.212 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:37:50.212 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2023-11-28T18:37:50.212 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:37:50.212 INFO:teuthology.orchestra.run.smithi045.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T18:37:50.213 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a6 brd ff:ff:ff:ff:ff:ff 2023-11-28T18:37:50.213 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f0 2023-11-28T18:37:50.213 INFO:teuthology.orchestra.run.smithi045.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T18:37:50.213 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a7 brd ff:ff:ff:ff:ff:ff 2023-11-28T18:37:50.213 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f1 2023-11-28T18:37:50.213 INFO:teuthology.orchestra.run.smithi045.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T18:37:50.213 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:be brd ff:ff:ff:ff:ff:ff 2023-11-28T18:37:50.213 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f0 2023-11-28T18:37:50.214 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.21.15.45/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-11-28T18:37:50.214 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft 42388sec preferred_lft 42388sec 2023-11-28T18:37:50.214 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec4:7aff:febd:12be/64 scope link 2023-11-28T18:37:50.214 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:37:50.214 INFO:teuthology.orchestra.run.smithi045.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T18:37:50.214 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:bf brd ff:ff:ff:ff:ff:ff 2023-11-28T18:37:50.214 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f1 2023-11-28T18:37:50.214 INFO:teuthology.orchestra.run.smithi045.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T18:37:50.214 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 02:42:ab:69:35:3d brd ff:ff:ff:ff:ff:ff 2023-11-28T18:37:50.214 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T18:37:50.214 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:37:50.215 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-28T18:37:50.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:37:50.216 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-11-28T18:37:50.216 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-11-28T18:37:50.216 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link add name ceph-brx type bridge 2023-11-28T18:37:50.216 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip addr flush dev ceph-brx 2023-11-28T18:37:50.216 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set ceph-brx up 2023-11-28T18:37:50.216 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-28T18:37:50.216 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-11-28T18:37:50.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:37:50.336 DEBUG:teuthology.orchestra.run.smithi045:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T18:37:50.356 INFO:teuthology.orchestra.run.smithi045.stdout:1 2023-11-28T18:37:50.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:37:50.358 DEBUG:teuthology.orchestra.run.smithi045:> route 2023-11-28T18:37:50.430 INFO:teuthology.orchestra.run.smithi045.stdout:Kernel IP routing table 2023-11-28T18:37:50.430 INFO:teuthology.orchestra.run.smithi045.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T18:37:50.430 INFO:teuthology.orchestra.run.smithi045.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-11-28T18:37:50.430 INFO:teuthology.orchestra.run.smithi045.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T18:37:50.430 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-11-28T18:37:50.430 INFO:teuthology.orchestra.run.smithi045.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T18:37:50.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:37:50.431 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-11-28T18:37:50.431 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-11-28T18:37:50.431 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-28T18:37:50.431 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-28T18:37:50.432 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-28T18:37:50.432 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-11-28T18:37:50.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:37:50.531 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-11-28T18:37:50.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:37:50.542 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list-id 2023-11-28T18:37:50.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:37:50.591 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-11-28T18:37:50.591 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-11-28T18:37:50.591 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T18:37:50.591 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-11-28T18:37:50.591 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-11-28T18:37:50.676 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-11-28T18:37:50.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:37:50.676 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-11-28T18:37:50.676 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-11-28T18:37:50.676 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-11-28T18:37:50.677 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-28T18:37:50.677 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-11-28T18:37:50.677 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-11-28T18:37:50.677 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-11-28T18:37:50.677 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-11-28T18:37:50.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:37:50.844 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-11-28T18:37:50.844 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-11-28T18:37:50.844 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set brx.0 up 2023-11-28T18:37:50.844 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set dev brx.0 master ceph-brx 2023-11-28T18:37:50.844 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-11-28T18:37:50.887 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-28T18:37:50.887 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T18:37:50.887 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-28T18:37:50.943 INFO:teuthology.orchestra.run.smithi045.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-28T18:37:50.943 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T18:37:50.943 DEBUG:teuthology.orchestra.run.smithi045:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-28T18:37:50.994 DEBUG:teuthology.orchestra.run.smithi045:> sudo modprobe fuse 2023-11-28T18:37:51.060 DEBUG:teuthology.orchestra.run.smithi045:> cat /proc/self/mounts | awk '{print $2}' 2023-11-28T18:37:51.112 INFO:teuthology.orchestra.run.smithi045.stdout:/sys 2023-11-28T18:37:51.132 INFO:teuthology.orchestra.run.smithi045.stdout:/proc 2023-11-28T18:37:51.133 INFO:teuthology.orchestra.run.smithi045.stdout:/dev 2023-11-28T18:37:51.133 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/pts 2023-11-28T18:37:51.133 INFO:teuthology.orchestra.run.smithi045.stdout:/run 2023-11-28T18:37:51.133 INFO:teuthology.orchestra.run.smithi045.stdout:/ 2023-11-28T18:37:51.133 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/security 2023-11-28T18:37:51.133 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/shm 2023-11-28T18:37:51.133 INFO:teuthology.orchestra.run.smithi045.stdout:/run/lock 2023-11-28T18:37:51.133 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/cgroup 2023-11-28T18:37:51.133 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/pstore 2023-11-28T18:37:51.133 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/bpf 2023-11-28T18:37:51.133 INFO:teuthology.orchestra.run.smithi045.stdout:/proc/sys/fs/binfmt_misc 2023-11-28T18:37:51.134 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/hugepages 2023-11-28T18:37:51.134 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/mqueue 2023-11-28T18:37:51.134 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/debug 2023-11-28T18:37:51.134 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/tracing 2023-11-28T18:37:51.134 INFO:teuthology.orchestra.run.smithi045.stdout:/proc/fs/nfsd 2023-11-28T18:37:51.134 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/fuse/connections 2023-11-28T18:37:51.134 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/config 2023-11-28T18:37:51.134 INFO:teuthology.orchestra.run.smithi045.stdout:/run/credentials/systemd-sysusers.service 2023-11-28T18:37:51.134 INFO:teuthology.orchestra.run.smithi045.stdout:/run/rpc_pipefs 2023-11-28T18:37:51.134 INFO:teuthology.orchestra.run.smithi045.stdout:/run/user/1000 2023-11-28T18:37:51.134 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph 2023-11-28T18:37:51.134 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-0 2023-11-28T18:37:51.134 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-1 2023-11-28T18:37:51.135 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-2 2023-11-28T18:37:51.135 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-3 2023-11-28T18:37:51.135 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns 2023-11-28T18:37:51.135 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T18:37:51.135 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T18:37:51.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:37:51.136 DEBUG:teuthology.orchestra.run.smithi045:> ls /sys/fs/fuse/connections 2023-11-28T18:37:51.187 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-28T18:37:51.187 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-28T18:37:51.233 DEBUG:teuthology.orchestra.run.smithi045:> sudo modprobe fuse 2023-11-28T18:37:51.256 DEBUG:teuthology.orchestra.run.smithi045:> cat /proc/self/mounts | awk '{print $2}' 2023-11-28T18:37:51.312 INFO:teuthology.orchestra.run.smithi045.stdout:/sys 2023-11-28T18:37:51.312 INFO:teuthology.orchestra.run.smithi045.stdout:/proc 2023-11-28T18:37:51.312 INFO:teuthology.orchestra.run.smithi045.stdout:/dev 2023-11-28T18:37:51.312 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/pts 2023-11-28T18:37:51.312 INFO:teuthology.orchestra.run.smithi045.stdout:/run 2023-11-28T18:37:51.313 INFO:teuthology.orchestra.run.smithi045.stdout:/ 2023-11-28T18:37:51.313 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/security 2023-11-28T18:37:51.313 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/shm 2023-11-28T18:37:51.313 INFO:teuthology.orchestra.run.smithi045.stdout:/run/lock 2023-11-28T18:37:51.313 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/cgroup 2023-11-28T18:37:51.313 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/pstore 2023-11-28T18:37:51.313 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/bpf 2023-11-28T18:37:51.313 INFO:teuthology.orchestra.run.smithi045.stdout:/proc/sys/fs/binfmt_misc 2023-11-28T18:37:51.313 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/hugepages 2023-11-28T18:37:51.313 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/mqueue 2023-11-28T18:37:51.313 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/debug 2023-11-28T18:37:51.314 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/tracing 2023-11-28T18:37:51.314 INFO:teuthology.orchestra.run.smithi045.stdout:/proc/fs/nfsd 2023-11-28T18:37:51.315 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/fuse/connections 2023-11-28T18:37:51.315 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/config 2023-11-28T18:37:51.315 INFO:teuthology.orchestra.run.smithi045.stdout:/run/credentials/systemd-sysusers.service 2023-11-28T18:37:51.315 INFO:teuthology.orchestra.run.smithi045.stdout:/run/rpc_pipefs 2023-11-28T18:37:51.315 INFO:teuthology.orchestra.run.smithi045.stdout:/run/user/1000 2023-11-28T18:37:51.315 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph 2023-11-28T18:37:51.315 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-0 2023-11-28T18:37:51.315 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-1 2023-11-28T18:37:51.316 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-2 2023-11-28T18:37:51.316 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-3 2023-11-28T18:37:51.316 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns 2023-11-28T18:37:51.316 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T18:37:51.316 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T18:37:51.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:37:51.317 DEBUG:teuthology.orchestra.run.smithi045:> ls /sys/fs/fuse/connections 2023-11-28T18:37:51.339 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:2023-11-28T18:37:51.334+0000 7f400d4dc580 -1 init, newargv = 0x55cce09ee230 newargc=15 2023-11-28T18:37:51.340 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:ceph-fuse[44382]: starting ceph client 2023-11-28T18:37:51.347 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:ceph-fuse[44382]: starting fuse 2023-11-28T18:37:51.349 INFO:teuthology.orchestra.run.smithi045.stdout:43 2023-11-28T18:37:51.349 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-11-28T18:37:51.349 DEBUG:teuthology.orchestra.run.smithi045:> sudo stdin-killer -- python3 -c ' 2023-11-28T18:37:51.349 DEBUG:teuthology.orchestra.run.smithi045:> import glob 2023-11-28T18:37:51.349 DEBUG:teuthology.orchestra.run.smithi045:> import re 2023-11-28T18:37:51.350 DEBUG:teuthology.orchestra.run.smithi045:> import os 2023-11-28T18:37:51.350 DEBUG:teuthology.orchestra.run.smithi045:> import subprocess 2023-11-28T18:37:51.350 DEBUG:teuthology.orchestra.run.smithi045:> 2023-11-28T18:37:51.350 DEBUG:teuthology.orchestra.run.smithi045:> def _find_admin_socket(client_name): 2023-11-28T18:37:51.350 DEBUG:teuthology.orchestra.run.smithi045:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-28T18:37:51.350 DEBUG:teuthology.orchestra.run.smithi045:> files = glob.glob(asok_path) 2023-11-28T18:37:51.350 DEBUG:teuthology.orchestra.run.smithi045:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-28T18:37:51.350 DEBUG:teuthology.orchestra.run.smithi045:> 2023-11-28T18:37:51.350 DEBUG:teuthology.orchestra.run.smithi045:> # Given a non-glob path, it better be there 2023-11-28T18:37:51.350 DEBUG:teuthology.orchestra.run.smithi045:> if "*" not in asok_path: 2023-11-28T18:37:51.350 DEBUG:teuthology.orchestra.run.smithi045:> assert(len(files) == 1) 2023-11-28T18:37:51.350 DEBUG:teuthology.orchestra.run.smithi045:> return files[0] 2023-11-28T18:37:51.351 DEBUG:teuthology.orchestra.run.smithi045:> 2023-11-28T18:37:51.351 DEBUG:teuthology.orchestra.run.smithi045:> for f in files: 2023-11-28T18:37:51.351 DEBUG:teuthology.orchestra.run.smithi045:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-28T18:37:51.351 DEBUG:teuthology.orchestra.run.smithi045:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-28T18:37:51.351 DEBUG:teuthology.orchestra.run.smithi045:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-28T18:37:51.351 DEBUG:teuthology.orchestra.run.smithi045:> contents = proc_f.read() 2023-11-28T18:37:51.351 DEBUG:teuthology.orchestra.run.smithi045:> if mountpoint in contents: 2023-11-28T18:37:51.351 DEBUG:teuthology.orchestra.run.smithi045:> return f 2023-11-28T18:37:51.351 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-28T18:37:51.351 DEBUG:teuthology.orchestra.run.smithi045:> 2023-11-28T18:37:51.351 DEBUG:teuthology.orchestra.run.smithi045:> print(_find_admin_socket("client.0")) 2023-11-28T18:37:51.351 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-11-28T18:37:51.477 INFO:teuthology.orchestra.run.smithi045.stdout:/var/run/ceph/ceph-client.0.44382.asok 2023-11-28T18:37:51.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-28T18:37:51.489 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.44382.asok 2023-11-28T18:37:51.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:37:51.490 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.44382.asok status 2023-11-28T18:37:51.663 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-11-28T18:37:51.663 INFO:teuthology.orchestra.run.smithi045.stdout: "metadata": { 2023-11-28T18:37:51.663 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_sha1": "47c1c547372ed5bff7984647dc200bac0e019caf", 2023-11-28T18:37:51.664 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_version": "ceph version 18.0.0-7531-g47c1c547 (47c1c547372ed5bff7984647dc200bac0e019caf) reef (dev)", 2023-11-28T18:37:51.664 INFO:teuthology.orchestra.run.smithi045.stdout: "entity_id": "0", 2023-11-28T18:37:51.664 INFO:teuthology.orchestra.run.smithi045.stdout: "hostname": "smithi045", 2023-11-28T18:37:51.664 INFO:teuthology.orchestra.run.smithi045.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-28T18:37:51.664 INFO:teuthology.orchestra.run.smithi045.stdout: "pid": "44382", 2023-11-28T18:37:51.664 INFO:teuthology.orchestra.run.smithi045.stdout: "root": "/" 2023-11-28T18:37:51.664 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:37:51.664 INFO:teuthology.orchestra.run.smithi045.stdout: "dentry_count": 0, 2023-11-28T18:37:51.664 INFO:teuthology.orchestra.run.smithi045.stdout: "dentry_pinned_count": 0, 2023-11-28T18:37:51.664 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 4686, 2023-11-28T18:37:51.664 INFO:teuthology.orchestra.run.smithi045.stdout: "inst": { 2023-11-28T18:37:51.664 INFO:teuthology.orchestra.run.smithi045.stdout: "name": { 2023-11-28T18:37:51.665 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "client", 2023-11-28T18:37:51.665 INFO:teuthology.orchestra.run.smithi045.stdout: "num": 4686 2023-11-28T18:37:51.665 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:37:51.665 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": { 2023-11-28T18:37:51.665 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-11-28T18:37:51.665 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "192.168.0.1:0", 2023-11-28T18:37:51.665 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1836277033 2023-11-28T18:37:51.665 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:37:51.665 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:37:51.665 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": { 2023-11-28T18:37:51.665 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-11-28T18:37:51.666 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "192.168.0.1:0", 2023-11-28T18:37:51.666 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1836277033 2023-11-28T18:37:51.666 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:37:51.667 INFO:teuthology.orchestra.run.smithi045.stdout: "inst_str": "client.4686 192.168.0.1:0/1836277033", 2023-11-28T18:37:51.667 INFO:teuthology.orchestra.run.smithi045.stdout: "addr_str": "192.168.0.1:0/1836277033", 2023-11-28T18:37:51.667 INFO:teuthology.orchestra.run.smithi045.stdout: "inode_count": 1, 2023-11-28T18:37:51.667 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_epoch": 8, 2023-11-28T18:37:51.667 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_epoch": 20, 2023-11-28T18:37:51.667 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_epoch_barrier": 0, 2023-11-28T18:37:51.668 INFO:teuthology.orchestra.run.smithi045.stdout: "blocklisted": false, 2023-11-28T18:37:51.668 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs" 2023-11-28T18:37:51.668 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-11-28T18:37:51.678 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T18:37:51.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.814+0000 7f1af9617640 1 Processor -- start 2023-11-28T18:37:51.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.814+0000 7f1af9617640 1 -- start start 2023-11-28T18:37:51.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.818+0000 7f1af9617640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1af41608b0 0x7f1af40d2b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:51.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.818+0000 7f1af9617640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f1af40cdb60 0x7f1af40b6270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:51.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.818+0000 7f1af9617640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1af40d0db0 con 0x7f1af40b51e0 2023-11-28T18:37:51.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.818+0000 7f1af9617640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1af4160c90 con 0x7f1af40cdb60 2023-11-28T18:37:51.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.818+0000 7f1af9617640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1af40ce320 con 0x7f1af41608b0 2023-11-28T18:37:51.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.818+0000 7f1af37fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f1af40b51e0 0x7f1af40d1800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51088/0 (socket says 172.21.15.45:51088) 2023-11-28T18:37:51.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.818+0000 7f1af37fe640 1 -- 172.21.15.45:0/1311868967 learned_addr learned my addr 172.21.15.45:0/1311868967 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:37:51.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.818+0000 7f1af2ffd640 1 --2- 172.21.15.45:0/1311868967 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1af41608b0 0x7f1af40d2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:51.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.818+0000 7f1af27fc640 1 -- 172.21.15.45:0/1311868967 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2046567730 0 0) 0x7f1af40d0db0 con 0x7f1af40b51e0 2023-11-28T18:37:51.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.818+0000 7f1af27fc640 1 -- 172.21.15.45:0/1311868967 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ae0003530 con 0x7f1af40b51e0 2023-11-28T18:37:51.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.818+0000 7f1aebfff640 1 --2- 172.21.15.45:0/1311868967 >> v2:172.21.15.190:3300/0 conn(0x7f1af40cdb60 0x7f1af40b6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:51.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.818+0000 7f1af27fc640 1 -- 172.21.15.45:0/1311868967 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4141643661 0 0) 0x7f1ae0003530 con 0x7f1af40b51e0 2023-11-28T18:37:51.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.818+0000 7f1af27fc640 1 -- 172.21.15.45:0/1311868967 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1af41608b0 msgr2=0x7f1af40d2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:51.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.818+0000 7f1af27fc640 1 --2- 172.21.15.45:0/1311868967 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1af41608b0 0x7f1af40d2b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:51.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.818+0000 7f1af27fc640 1 -- 172.21.15.45:0/1311868967 >> v2:172.21.15.190:3300/0 conn(0x7f1af40cdb60 msgr2=0x7f1af40b6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:51.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.818+0000 7f1af27fc640 1 --2- 172.21.15.45:0/1311868967 >> v2:172.21.15.190:3300/0 conn(0x7f1af40cdb60 0x7f1af40b6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:51.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.818+0000 7f1af27fc640 1 -- 172.21.15.45:0/1311868967 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1af40ce600 con 0x7f1af40b51e0 2023-11-28T18:37:51.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.818+0000 7f1af27fc640 1 -- 172.21.15.45:0/1311868967 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4084481567 0 0) 0x7f1aec001a00 con 0x7f1af40b51e0 2023-11-28T18:37:51.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.818+0000 7f1af27fc640 1 -- 172.21.15.45:0/1311868967 >> v1:172.21.15.45:6789/0 conn(0x7f1af40b51e0 legacy=0x7f1af40d1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:51.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.818+0000 7f1af27fc640 1 --2- 172.21.15.45:0/1311868967 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1ae0003980 0x7f1ae0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:51.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.818+0000 7f1af27fc640 1 --2- 172.21.15.45:0/1311868967 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ae00047d0 0x7f1ae0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:51.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.818+0000 7f1af27fc640 1 --2- 172.21.15.45:0/1311868967 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1af41608b0 0x7f1ae0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:51.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.818+0000 7f1af27fc640 1 -- 172.21.15.45:0/1311868967 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1af4160c90 con 0x7f1ae00047d0 2023-11-28T18:37:51.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.818+0000 7f1af27fc640 1 -- 172.21.15.45:0/1311868967 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1af40ce320 con 0x7f1ae0003980 2023-11-28T18:37:51.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.818+0000 7f1af27fc640 1 -- 172.21.15.45:0/1311868967 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae000b990 con 0x7f1af41608b0 2023-11-28T18:37:51.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.818+0000 7f1aebfff640 1 --2- 172.21.15.45:0/1311868967 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ae00047d0 0x7f1ae0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:51.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.818+0000 7f1af37fe640 1 --2- 172.21.15.45:0/1311868967 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1af41608b0 0x7f1ae0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:51.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.818+0000 7f1af2ffd640 1 --2- 172.21.15.45:0/1311868967 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1ae0003980 0x7f1ae0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:51.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.818+0000 7f1aebfff640 1 -- 172.21.15.45:0/1311868967 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1af41608b0 msgr2=0x7f1ae0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:51.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.818+0000 7f1aebfff640 1 --2- 172.21.15.45:0/1311868967 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1af41608b0 0x7f1ae0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:51.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.818+0000 7f1aebfff640 1 -- 172.21.15.45:0/1311868967 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1ae0003980 msgr2=0x7f1ae0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:51.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.818+0000 7f1aebfff640 1 --2- 172.21.15.45:0/1311868967 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1ae0003980 0x7f1ae0003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:51.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.818+0000 7f1aebfff640 1 -- 172.21.15.45:0/1311868967 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ae0003530 con 0x7f1ae00047d0 2023-11-28T18:37:51.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.822+0000 7f1aebfff640 1 --2- 172.21.15.45:0/1311868967 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ae00047d0 0x7f1ae0004c50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1adc009ae0 tx=0x7f1adc01ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f08b3e0d4904a147 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:51.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.822+0000 7f1af27fc640 1 -- 172.21.15.45:0/1311868967 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1adc0a55a0 con 0x7f1ae00047d0 2023-11-28T18:37:51.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.822+0000 7f1af27fc640 1 -- 172.21.15.45:0/1311868967 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1adc0a5700 con 0x7f1ae00047d0 2023-11-28T18:37:51.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.822+0000 7f1af27fc640 1 -- 172.21.15.45:0/1311868967 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1adc0a5ab0 con 0x7f1ae00047d0 2023-11-28T18:37:51.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.822+0000 7f1af9617640 1 -- 172.21.15.45:0/1311868967 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ae00047d0 msgr2=0x7f1ae0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:51.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.822+0000 7f1af9617640 1 --2- 172.21.15.45:0/1311868967 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ae00047d0 0x7f1ae0004c50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1adc009ae0 tx=0x7f1adc01ca90 comp rx=0 tx=0).stop 2023-11-28T18:37:51.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.822+0000 7f1af37fe640 1 -- 172.21.15.45:0/1311868967 reap_dead start 2023-11-28T18:37:51.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.822+0000 7f1af9617640 1 -- 172.21.15.45:0/1311868967 shutdown_connections 2023-11-28T18:37:51.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.822+0000 7f1af9617640 1 -- 172.21.15.45:0/1311868967 >> 172.21.15.45:0/1311868967 conn(0x7f1af40720a0 msgr2=0x7f1af40724b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:51.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.822+0000 7f1af9617640 1 -- 172.21.15.45:0/1311868967 shutdown_connections 2023-11-28T18:37:51.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.822+0000 7f1af9617640 1 -- 172.21.15.45:0/1311868967 wait complete. 2023-11-28T18:37:51.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.822+0000 7f1af9617640 1 Processor -- start 2023-11-28T18:37:51.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.826+0000 7f1af9617640 1 -- start start 2023-11-28T18:37:51.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.826+0000 7f1af9617640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1ae00047d0 0x7f1af41540c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:51.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.826+0000 7f1af9617640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1af414e270 0x7f1af4156a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:51.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.826+0000 7f1af9617640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1af414d9a0 0x7f1af40c6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:51.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.826+0000 7f1af9617640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1af40c7e40 con 0x7f1af414d9a0 2023-11-28T18:37:51.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.826+0000 7f1af9617640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1af40c9700 con 0x7f1ae00047d0 2023-11-28T18:37:51.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.826+0000 7f1af9617640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1af40c99e0 con 0x7f1af414e270 2023-11-28T18:37:51.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.826+0000 7f1af37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1af414d9a0 0x7f1af40c6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:51.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.826+0000 7f1af37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1af414d9a0 0x7f1af40c6ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39000/0 (socket says 172.21.15.45:39000) 2023-11-28T18:37:51.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.826+0000 7f1af37fe640 1 -- 172.21.15.45:0/2096995819 learned_addr learned my addr 172.21.15.45:0/2096995819 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:51.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.826+0000 7f1af2ffd640 1 --2- 172.21.15.45:0/2096995819 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1ae00047d0 0x7f1af41540c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:51.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.826+0000 7f1aebfff640 1 --2- 172.21.15.45:0/2096995819 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1af414e270 0x7f1af4156a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:51.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.826+0000 7f1af37fe640 1 -- 172.21.15.45:0/2096995819 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1af414e270 msgr2=0x7f1af4156a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:51.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.826+0000 7f1af37fe640 1 --2- 172.21.15.45:0/2096995819 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1af414e270 0x7f1af4156a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:51.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.826+0000 7f1af37fe640 1 -- 172.21.15.45:0/2096995819 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1ae00047d0 msgr2=0x7f1af41540c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:51.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.826+0000 7f1af37fe640 1 --2- 172.21.15.45:0/2096995819 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1ae00047d0 0x7f1af41540c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:51.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.826+0000 7f1af37fe640 1 -- 172.21.15.45:0/2096995819 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1af40c7a60 con 0x7f1af414d9a0 2023-11-28T18:37:51.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.826+0000 7f1af37fe640 1 --2- 172.21.15.45:0/2096995819 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1af414d9a0 0x7f1af40c6ce0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1aec000f90 tx=0x7f1aec012860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:51.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.826+0000 7f1aeb7fe640 1 -- 172.21.15.45:0/2096995819 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aec01b070 con 0x7f1af414d9a0 2023-11-28T18:37:51.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.826+0000 7f1aeb7fe640 1 -- 172.21.15.45:0/2096995819 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aec001260 con 0x7f1af414d9a0 2023-11-28T18:37:51.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.826+0000 7f1aeb7fe640 1 -- 172.21.15.45:0/2096995819 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aec007b20 con 0x7f1af414d9a0 2023-11-28T18:37:51.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.826+0000 7f1af9617640 1 -- 172.21.15.45:0/2096995819 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1af414de20 con 0x7f1af414d9a0 2023-11-28T18:37:51.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.826+0000 7f1af9617640 1 -- 172.21.15.45:0/2096995819 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1af40c73f0 con 0x7f1af414d9a0 2023-11-28T18:37:51.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.826+0000 7f1af9617640 1 -- 172.21.15.45:0/2096995819 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1af40c7f80 con 0x7f1af414d9a0 2023-11-28T18:37:51.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.830+0000 7f1aeb7fe640 1 -- 172.21.15.45:0/2096995819 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f1aec0166a0 con 0x7f1af414d9a0 2023-11-28T18:37:51.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.830+0000 7f1aeb7fe640 1 --2- 172.21.15.45:0/2096995819 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1ad40668d0 0x7f1ad4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:51.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.830+0000 7f1aeb7fe640 1 -- 172.21.15.45:0/2096995819 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1aec087e30 con 0x7f1af414d9a0 2023-11-28T18:37:51.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.830+0000 7f1af2ffd640 1 --2- 172.21.15.45:0/2096995819 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1ad40668d0 0x7f1ad4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:51.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.830+0000 7f1af2ffd640 1 --2- 172.21.15.45:0/2096995819 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1ad40668d0 0x7f1ad4068d90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1ae4009a80 tx=0x7f1ae4009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:51.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:51.834+0000 7f1aeb7fe640 1 -- 172.21.15.45:0/2096995819 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1af40c7f80 con 0x7f1af414d9a0 2023-11-28T18:37:52.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:52.030+0000 7f1af9617640 1 -- 172.21.15.45:0/2096995819 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1af40c7f80 con 0x7f1af414d9a0 2023-11-28T18:37:52.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:52.030+0000 7f1aeb7fe640 1 -- 172.21.15.45:0/2096995819 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1af40c7f80 con 0x7f1af414d9a0 2023-11-28T18:37:52.035 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T18:37:52.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:52.030+0000 7f1af9617640 1 -- 172.21.15.45:0/2096995819 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1ad40668d0 msgr2=0x7f1ad4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:52.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:52.030+0000 7f1af9617640 1 --2- 172.21.15.45:0/2096995819 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1ad40668d0 0x7f1ad4068d90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1ae4009a80 tx=0x7f1ae4009190 comp rx=0 tx=0).stop 2023-11-28T18:37:52.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:52.030+0000 7f1af9617640 1 -- 172.21.15.45:0/2096995819 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1af414d9a0 msgr2=0x7f1af40c6ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:52.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:52.030+0000 7f1af9617640 1 --2- 172.21.15.45:0/2096995819 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1af414d9a0 0x7f1af40c6ce0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1aec000f90 tx=0x7f1aec012860 comp rx=0 tx=0).stop 2023-11-28T18:37:52.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:52.030+0000 7f1af9617640 1 -- 172.21.15.45:0/2096995819 shutdown_connections 2023-11-28T18:37:52.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:52.030+0000 7f1af9617640 1 --2- 172.21.15.45:0/2096995819 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1ad40668d0 0x7f1ad4068d90 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:52.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:52.030+0000 7f1af9617640 1 --2- 172.21.15.45:0/2096995819 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1af414d9a0 0x7f1af40c6ce0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:52.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:52.030+0000 7f1af9617640 1 --2- 172.21.15.45:0/2096995819 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1af414e270 0x7f1af4156a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:52.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:52.030+0000 7f1af9617640 1 --2- 172.21.15.45:0/2096995819 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1ae00047d0 0x7f1af41540c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:52.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:52.030+0000 7f1af9617640 1 -- 172.21.15.45:0/2096995819 >> 172.21.15.45:0/2096995819 conn(0x7f1af40720a0 msgr2=0x7f1af40b3860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:52.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:52.030+0000 7f1af9617640 1 -- 172.21.15.45:0/2096995819 shutdown_connections 2023-11-28T18:37:52.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:52.030+0000 7f1af9617640 1 -- 172.21.15.45:0/2096995819 wait complete. 2023-11-28T18:37:52.057 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-28T18:37:52.059 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T18:37:52.059 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi045.front.sepia.ceph.com 2023-11-28T18:37:52.060 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-11-28T18:37:52.060 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-28T18:37:52.061 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-28T18:37:52.061 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-28T18:37:52.061 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T18:37:52.062 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-11-28T18:37:52.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:37:52.062 DEBUG:teuthology.orchestra.run.smithi045:> ip addr 2023-11-28T18:37:52.072 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T18:37:52.072 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T18:37:52.072 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T18:37:52.073 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:37:52.073 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2023-11-28T18:37:52.073 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:37:52.073 INFO:teuthology.orchestra.run.smithi045.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T18:37:52.073 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a6 brd ff:ff:ff:ff:ff:ff 2023-11-28T18:37:52.073 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f0 2023-11-28T18:37:52.073 INFO:teuthology.orchestra.run.smithi045.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T18:37:52.073 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a7 brd ff:ff:ff:ff:ff:ff 2023-11-28T18:37:52.074 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f1 2023-11-28T18:37:52.074 INFO:teuthology.orchestra.run.smithi045.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T18:37:52.074 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:be brd ff:ff:ff:ff:ff:ff 2023-11-28T18:37:52.074 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f0 2023-11-28T18:37:52.074 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.21.15.45/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-11-28T18:37:52.074 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft 42386sec preferred_lft 42386sec 2023-11-28T18:37:52.074 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec4:7aff:febd:12be/64 scope link 2023-11-28T18:37:52.075 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:37:52.075 INFO:teuthology.orchestra.run.smithi045.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T18:37:52.075 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:bf brd ff:ff:ff:ff:ff:ff 2023-11-28T18:37:52.075 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f1 2023-11-28T18:37:52.075 INFO:teuthology.orchestra.run.smithi045.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T18:37:52.075 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 02:42:ab:69:35:3d brd ff:ff:ff:ff:ff:ff 2023-11-28T18:37:52.075 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T18:37:52.075 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:37:52.076 INFO:teuthology.orchestra.run.smithi045.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T18:37:52.076 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-28T18:37:52.076 INFO:teuthology.orchestra.run.smithi045.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-28T18:37:52.076 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:37:52.076 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link tentative 2023-11-28T18:37:52.076 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:37:52.076 INFO:teuthology.orchestra.run.smithi045.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T18:37:52.076 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T18:37:52.077 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link tentative 2023-11-28T18:37:52.077 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:37:52.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:37:52.077 DEBUG:teuthology.orchestra.run.smithi045:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T18:37:52.137 INFO:teuthology.orchestra.run.smithi045.stdout:1 2023-11-28T18:37:52.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:37:52.139 DEBUG:teuthology.orchestra.run.smithi045:> route 2023-11-28T18:37:52.196 INFO:teuthology.orchestra.run.smithi045.stdout:Kernel IP routing table 2023-11-28T18:37:52.197 INFO:teuthology.orchestra.run.smithi045.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T18:37:52.197 INFO:teuthology.orchestra.run.smithi045.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-11-28T18:37:52.197 INFO:teuthology.orchestra.run.smithi045.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T18:37:52.197 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-11-28T18:37:52.198 INFO:teuthology.orchestra.run.smithi045.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T18:37:52.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:37:52.199 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-11-28T18:37:52.199 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-11-28T18:37:52.200 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-28T18:37:52.200 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-28T18:37:52.200 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-28T18:37:52.200 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-11-28T18:37:52.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:37:52.295 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-11-28T18:37:52.305 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-28T18:37:52.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:37:52.305 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list-id 2023-11-28T18:37:52.359 INFO:teuthology.orchestra.run.smithi045.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-11-28T18:37:52.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:37:52.360 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-11-28T18:37:52.360 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-11-28T18:37:52.360 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T18:37:52.360 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-11-28T18:37:52.360 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-11-28T18:37:52.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:37:52.444 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-28T18:37:52.512 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T18:37:52.512 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T18:37:52.512 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T18:37:52.512 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:37:52.512 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2023-11-28T18:37:52.512 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:37:52.512 INFO:teuthology.orchestra.run.smithi045.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T18:37:52.512 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 5a:b8:de:85:e8:58 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-28T18:37:52.512 INFO:teuthology.orchestra.run.smithi045.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-28T18:37:52.512 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:37:52.513 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::58b8:deff:fe85:e858/64 scope link tentative 2023-11-28T18:37:52.513 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:37:52.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:37:52.514 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-28T18:37:52.584 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T18:37:52.584 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T18:37:52.584 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T18:37:52.584 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:37:52.585 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2023-11-28T18:37:52.585 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:37:52.585 INFO:teuthology.orchestra.run.smithi045.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T18:37:52.585 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 5a:b8:de:85:e8:58 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-28T18:37:52.585 INFO:teuthology.orchestra.run.smithi045.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-28T18:37:52.586 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:37:52.586 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::58b8:deff:fe85:e858/64 scope link tentative 2023-11-28T18:37:52.589 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:37:52.591 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-11-28T18:37:52.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:37:52.591 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-11-28T18:37:52.591 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-11-28T18:37:52.591 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-11-28T18:37:52.591 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-28T18:37:52.592 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-11-28T18:37:52.592 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-11-28T18:37:52.592 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-11-28T18:37:52.592 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-11-28T18:37:52.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:37:52.735 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-11-28T18:37:52.735 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-11-28T18:37:52.735 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set brx.1 up 2023-11-28T18:37:52.735 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set dev brx.1 master ceph-brx 2023-11-28T18:37:52.735 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-11-28T18:37:52.776 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-11-28T18:37:52.776 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T18:37:52.776 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-11-28T18:37:52.831 INFO:teuthology.orchestra.run.smithi045.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-11-28T18:37:52.831 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T18:37:52.831 DEBUG:teuthology.orchestra.run.smithi045:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-11-28T18:37:52.882 DEBUG:teuthology.orchestra.run.smithi045:> sudo modprobe fuse 2023-11-28T18:37:52.948 DEBUG:teuthology.orchestra.run.smithi045:> cat /proc/self/mounts | awk '{print $2}' 2023-11-28T18:37:53.002 INFO:teuthology.orchestra.run.smithi045.stdout:/sys 2023-11-28T18:37:53.002 INFO:teuthology.orchestra.run.smithi045.stdout:/proc 2023-11-28T18:37:53.002 INFO:teuthology.orchestra.run.smithi045.stdout:/dev 2023-11-28T18:37:53.002 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/pts 2023-11-28T18:37:53.002 INFO:teuthology.orchestra.run.smithi045.stdout:/run 2023-11-28T18:37:53.002 INFO:teuthology.orchestra.run.smithi045.stdout:/ 2023-11-28T18:37:53.002 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/security 2023-11-28T18:37:53.003 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/shm 2023-11-28T18:37:53.003 INFO:teuthology.orchestra.run.smithi045.stdout:/run/lock 2023-11-28T18:37:53.003 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/cgroup 2023-11-28T18:37:53.003 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/pstore 2023-11-28T18:37:53.003 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/bpf 2023-11-28T18:37:53.003 INFO:teuthology.orchestra.run.smithi045.stdout:/proc/sys/fs/binfmt_misc 2023-11-28T18:37:53.003 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/hugepages 2023-11-28T18:37:53.003 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/mqueue 2023-11-28T18:37:53.003 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/debug 2023-11-28T18:37:53.003 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/tracing 2023-11-28T18:37:53.004 INFO:teuthology.orchestra.run.smithi045.stdout:/proc/fs/nfsd 2023-11-28T18:37:53.004 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/fuse/connections 2023-11-28T18:37:53.004 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/config 2023-11-28T18:37:53.004 INFO:teuthology.orchestra.run.smithi045.stdout:/run/credentials/systemd-sysusers.service 2023-11-28T18:37:53.004 INFO:teuthology.orchestra.run.smithi045.stdout:/run/rpc_pipefs 2023-11-28T18:37:53.004 INFO:teuthology.orchestra.run.smithi045.stdout:/run/user/1000 2023-11-28T18:37:53.004 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph 2023-11-28T18:37:53.004 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-0 2023-11-28T18:37:53.005 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-1 2023-11-28T18:37:53.005 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-2 2023-11-28T18:37:53.005 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-3 2023-11-28T18:37:53.005 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns 2023-11-28T18:37:53.005 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T18:37:53.005 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T18:37:53.005 INFO:teuthology.orchestra.run.smithi045.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-28T18:37:53.005 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T18:37:53.005 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T18:37:53.006 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:37:53.006 DEBUG:teuthology.orchestra.run.smithi045:> ls /sys/fs/fuse/connections 2023-11-28T18:37:53.056 INFO:teuthology.orchestra.run.smithi045.stdout:43 2023-11-28T18:37:53.056 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [43] 2023-11-28T18:37:53.056 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2023-11-28T18:37:53.101 DEBUG:teuthology.orchestra.run.smithi045:> sudo modprobe fuse 2023-11-28T18:37:53.123 DEBUG:teuthology.orchestra.run.smithi045:> cat /proc/self/mounts | awk '{print $2}' 2023-11-28T18:37:53.127 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:37:53.175 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:37:53.180 INFO:teuthology.orchestra.run.smithi045.stdout:/sys 2023-11-28T18:37:53.180 INFO:teuthology.orchestra.run.smithi045.stdout:/proc 2023-11-28T18:37:53.180 INFO:teuthology.orchestra.run.smithi045.stdout:/dev 2023-11-28T18:37:53.180 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/pts 2023-11-28T18:37:53.181 INFO:teuthology.orchestra.run.smithi045.stdout:/run 2023-11-28T18:37:53.181 INFO:teuthology.orchestra.run.smithi045.stdout:/ 2023-11-28T18:37:53.181 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/security 2023-11-28T18:37:53.181 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/shm 2023-11-28T18:37:53.181 INFO:teuthology.orchestra.run.smithi045.stdout:/run/lock 2023-11-28T18:37:53.182 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/cgroup 2023-11-28T18:37:53.182 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/pstore 2023-11-28T18:37:53.182 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/bpf 2023-11-28T18:37:53.182 INFO:teuthology.orchestra.run.smithi045.stdout:/proc/sys/fs/binfmt_misc 2023-11-28T18:37:53.183 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/hugepages 2023-11-28T18:37:53.183 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/mqueue 2023-11-28T18:37:53.183 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/debug 2023-11-28T18:37:53.183 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/tracing 2023-11-28T18:37:53.183 INFO:teuthology.orchestra.run.smithi045.stdout:/proc/fs/nfsd 2023-11-28T18:37:53.184 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/fuse/connections 2023-11-28T18:37:53.184 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/config 2023-11-28T18:37:53.184 INFO:teuthology.orchestra.run.smithi045.stdout:/run/credentials/systemd-sysusers.service 2023-11-28T18:37:53.184 INFO:teuthology.orchestra.run.smithi045.stdout:/run/rpc_pipefs 2023-11-28T18:37:53.184 INFO:teuthology.orchestra.run.smithi045.stdout:/run/user/1000 2023-11-28T18:37:53.185 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph 2023-11-28T18:37:53.185 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-0 2023-11-28T18:37:53.185 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-1 2023-11-28T18:37:53.185 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-2 2023-11-28T18:37:53.185 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-3 2023-11-28T18:37:53.185 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns 2023-11-28T18:37:53.185 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T18:37:53.185 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T18:37:53.186 INFO:teuthology.orchestra.run.smithi045.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-28T18:37:53.186 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T18:37:53.186 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T18:37:53.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:37:53.187 DEBUG:teuthology.orchestra.run.smithi045:> ls /sys/fs/fuse/connections 2023-11-28T18:37:53.199 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi045.stderr:2023-11-28T18:37:53.194+0000 7fba31911580 -1 init, newargv = 0x5593405890d0 newargc=15 2023-11-28T18:37:53.200 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi045.stderr:ceph-fuse[44517]: starting ceph client 2023-11-28T18:37:53.207 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi045.stderr:ceph-fuse[44517]: starting fuse 2023-11-28T18:37:53.209 INFO:teuthology.orchestra.run.smithi045.stdout:43 2023-11-28T18:37:53.209 INFO:teuthology.orchestra.run.smithi045.stdout:44 2023-11-28T18:37:53.209 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43, 44] 2023-11-28T18:37:53.209 DEBUG:teuthology.orchestra.run.smithi045:> sudo stdin-killer -- python3 -c ' 2023-11-28T18:37:53.209 DEBUG:teuthology.orchestra.run.smithi045:> import glob 2023-11-28T18:37:53.209 DEBUG:teuthology.orchestra.run.smithi045:> import re 2023-11-28T18:37:53.210 DEBUG:teuthology.orchestra.run.smithi045:> import os 2023-11-28T18:37:53.210 DEBUG:teuthology.orchestra.run.smithi045:> import subprocess 2023-11-28T18:37:53.210 DEBUG:teuthology.orchestra.run.smithi045:> 2023-11-28T18:37:53.210 DEBUG:teuthology.orchestra.run.smithi045:> def _find_admin_socket(client_name): 2023-11-28T18:37:53.210 DEBUG:teuthology.orchestra.run.smithi045:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-11-28T18:37:53.210 DEBUG:teuthology.orchestra.run.smithi045:> files = glob.glob(asok_path) 2023-11-28T18:37:53.210 DEBUG:teuthology.orchestra.run.smithi045:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-11-28T18:37:53.210 DEBUG:teuthology.orchestra.run.smithi045:> 2023-11-28T18:37:53.210 DEBUG:teuthology.orchestra.run.smithi045:> # Given a non-glob path, it better be there 2023-11-28T18:37:53.210 DEBUG:teuthology.orchestra.run.smithi045:> if "*" not in asok_path: 2023-11-28T18:37:53.210 DEBUG:teuthology.orchestra.run.smithi045:> assert(len(files) == 1) 2023-11-28T18:37:53.210 DEBUG:teuthology.orchestra.run.smithi045:> return files[0] 2023-11-28T18:37:53.211 DEBUG:teuthology.orchestra.run.smithi045:> 2023-11-28T18:37:53.211 DEBUG:teuthology.orchestra.run.smithi045:> for f in files: 2023-11-28T18:37:53.211 DEBUG:teuthology.orchestra.run.smithi045:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-28T18:37:53.211 DEBUG:teuthology.orchestra.run.smithi045:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-28T18:37:53.211 DEBUG:teuthology.orchestra.run.smithi045:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-28T18:37:53.211 DEBUG:teuthology.orchestra.run.smithi045:> contents = proc_f.read() 2023-11-28T18:37:53.211 DEBUG:teuthology.orchestra.run.smithi045:> if mountpoint in contents: 2023-11-28T18:37:53.211 DEBUG:teuthology.orchestra.run.smithi045:> return f 2023-11-28T18:37:53.211 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-28T18:37:53.211 DEBUG:teuthology.orchestra.run.smithi045:> 2023-11-28T18:37:53.211 DEBUG:teuthology.orchestra.run.smithi045:> print(_find_admin_socket("client.2")) 2023-11-28T18:37:53.211 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-11-28T18:37:53.341 INFO:teuthology.orchestra.run.smithi045.stdout:/var/run/ceph/ceph-client.2.44517.asok 2023-11-28T18:37:53.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-28T18:37:53.352 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.44517.asok 2023-11-28T18:37:53.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:37:53.352 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.44517.asok status 2023-11-28T18:37:53.532 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-11-28T18:37:53.532 INFO:teuthology.orchestra.run.smithi045.stdout: "metadata": { 2023-11-28T18:37:53.532 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_sha1": "47c1c547372ed5bff7984647dc200bac0e019caf", 2023-11-28T18:37:53.532 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_version": "ceph version 18.0.0-7531-g47c1c547 (47c1c547372ed5bff7984647dc200bac0e019caf) reef (dev)", 2023-11-28T18:37:53.532 INFO:teuthology.orchestra.run.smithi045.stdout: "entity_id": "2", 2023-11-28T18:37:53.532 INFO:teuthology.orchestra.run.smithi045.stdout: "hostname": "smithi045", 2023-11-28T18:37:53.532 INFO:teuthology.orchestra.run.smithi045.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-11-28T18:37:53.533 INFO:teuthology.orchestra.run.smithi045.stdout: "pid": "44517", 2023-11-28T18:37:53.533 INFO:teuthology.orchestra.run.smithi045.stdout: "root": "/" 2023-11-28T18:37:53.533 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:37:53.533 INFO:teuthology.orchestra.run.smithi045.stdout: "dentry_count": 0, 2023-11-28T18:37:53.533 INFO:teuthology.orchestra.run.smithi045.stdout: "dentry_pinned_count": 0, 2023-11-28T18:37:53.533 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 4701, 2023-11-28T18:37:53.533 INFO:teuthology.orchestra.run.smithi045.stdout: "inst": { 2023-11-28T18:37:53.533 INFO:teuthology.orchestra.run.smithi045.stdout: "name": { 2023-11-28T18:37:53.533 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "client", 2023-11-28T18:37:53.534 INFO:teuthology.orchestra.run.smithi045.stdout: "num": 4701 2023-11-28T18:37:53.534 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:37:53.534 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": { 2023-11-28T18:37:53.534 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-11-28T18:37:53.534 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "192.168.0.2:0", 2023-11-28T18:37:53.534 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 77812184 2023-11-28T18:37:53.534 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:37:53.534 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:37:53.534 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": { 2023-11-28T18:37:53.534 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-11-28T18:37:53.535 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "192.168.0.2:0", 2023-11-28T18:37:53.535 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 77812184 2023-11-28T18:37:53.535 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:37:53.535 INFO:teuthology.orchestra.run.smithi045.stdout: "inst_str": "client.4701 192.168.0.2:0/77812184", 2023-11-28T18:37:53.535 INFO:teuthology.orchestra.run.smithi045.stdout: "addr_str": "192.168.0.2:0/77812184", 2023-11-28T18:37:53.535 INFO:teuthology.orchestra.run.smithi045.stdout: "inode_count": 1, 2023-11-28T18:37:53.535 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_epoch": 8, 2023-11-28T18:37:53.535 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_epoch": 20, 2023-11-28T18:37:53.535 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_epoch_barrier": 0, 2023-11-28T18:37:53.535 INFO:teuthology.orchestra.run.smithi045.stdout: "blocklisted": false, 2023-11-28T18:37:53.535 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs" 2023-11-28T18:37:53.535 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-11-28T18:37:53.547 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T18:37:53.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.686+0000 7f2a462bb640 1 Processor -- start 2023-11-28T18:37:53.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.686+0000 7f2a462bb640 1 -- start start 2023-11-28T18:37:53.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.686+0000 7f2a462bb640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f2a400cf950 0x7f2a400cfd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:53.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.686+0000 7f2a462bb640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2a400d0270 0x7f2a400d0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:53.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.686+0000 7f2a462bb640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a400c7000 con 0x7f2a400d06d0 2023-11-28T18:37:53.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.686+0000 7f2a462bb640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a400cf0a0 con 0x7f2a400cf950 2023-11-28T18:37:53.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.686+0000 7f2a462bb640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a400ceae0 con 0x7f2a400d0270 2023-11-28T18:37:53.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.686+0000 7f2a45aba640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f2a400d06d0 0x7f2a400d12c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51098/0 (socket says 172.21.15.45:51098) 2023-11-28T18:37:53.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.686+0000 7f2a45aba640 1 -- 172.21.15.45:0/297391979 learned_addr learned my addr 172.21.15.45:0/297391979 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:37:53.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.686+0000 7f2a44ab8640 1 --2- 172.21.15.45:0/297391979 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2a400d0270 0x7f2a400d0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:53.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.686+0000 7f2a452b9640 1 --2- 172.21.15.45:0/297391979 >> v2:172.21.15.190:3300/0 conn(0x7f2a400cf950 0x7f2a400cfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:53.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.686+0000 7f2a37fff640 1 -- 172.21.15.45:0/297391979 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2466217317 0 0) 0x7f2a400c7000 con 0x7f2a400d06d0 2023-11-28T18:37:53.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.686+0000 7f2a37fff640 1 -- 172.21.15.45:0/297391979 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a2c003530 con 0x7f2a400d06d0 2023-11-28T18:37:53.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.686+0000 7f2a37fff640 1 -- 172.21.15.45:0/297391979 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 410763447 0 0) 0x7f2a2c003530 con 0x7f2a400d06d0 2023-11-28T18:37:53.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.686+0000 7f2a44ab8640 1 -- 172.21.15.45:0/297391979 >> v2:172.21.15.190:3300/0 conn(0x7f2a400cf950 msgr2=0x7f2a400cfd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:53.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.686+0000 7f2a44ab8640 1 --2- 172.21.15.45:0/297391979 >> v2:172.21.15.190:3300/0 conn(0x7f2a400cf950 0x7f2a400cfd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:53.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.686+0000 7f2a44ab8640 1 -- 172.21.15.45:0/297391979 >> v1:172.21.15.45:6789/0 conn(0x7f2a400d06d0 legacy=0x7f2a400d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:53.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.686+0000 7f2a44ab8640 1 -- 172.21.15.45:0/297391979 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a400cedc0 con 0x7f2a400d0270 2023-11-28T18:37:53.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.686+0000 7f2a452b9640 1 --2- 172.21.15.45:0/297391979 >> v2:172.21.15.190:3300/0 conn(0x7f2a400cf950 0x7f2a400cfd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:37:53.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.690+0000 7f2a44ab8640 1 --2- 172.21.15.45:0/297391979 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2a400d0270 0x7f2a400d0d80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2a300097c0 tx=0x7f2a3001c2e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b19ff95e34f69e0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:53.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.690+0000 7f2a37fff640 1 -- 172.21.15.45:0/297391979 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a38001a00 con 0x7f2a400d0270 2023-11-28T18:37:53.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.690+0000 7f2a37fff640 1 -- 172.21.15.45:0/297391979 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a300a7050 con 0x7f2a400d0270 2023-11-28T18:37:53.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.690+0000 7f2a37fff640 1 -- 172.21.15.45:0/297391979 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a300ab620 con 0x7f2a400d0270 2023-11-28T18:37:53.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.690+0000 7f2a462bb640 1 -- 172.21.15.45:0/297391979 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2a400d0270 msgr2=0x7f2a400d0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:53.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.690+0000 7f2a462bb640 1 --2- 172.21.15.45:0/297391979 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2a400d0270 0x7f2a400d0d80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2a300097c0 tx=0x7f2a3001c2e0 comp rx=0 tx=0).stop 2023-11-28T18:37:53.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.690+0000 7f2a462bb640 1 -- 172.21.15.45:0/297391979 shutdown_connections 2023-11-28T18:37:53.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.690+0000 7f2a462bb640 1 --2- 172.21.15.45:0/297391979 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2a400d0270 0x7f2a400d0d80 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:53.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.690+0000 7f2a462bb640 1 --2- 172.21.15.45:0/297391979 >> v2:172.21.15.190:3300/0 conn(0x7f2a400cf950 0x7f2a400cfd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:53.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.690+0000 7f2a462bb640 1 -- 172.21.15.45:0/297391979 >> 172.21.15.45:0/297391979 conn(0x7f2a400d2fa0 msgr2=0x7f2a400d3380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:53.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.690+0000 7f2a462bb640 1 -- 172.21.15.45:0/297391979 shutdown_connections 2023-11-28T18:37:53.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.690+0000 7f2a462bb640 1 -- 172.21.15.45:0/297391979 wait complete. 2023-11-28T18:37:53.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.694+0000 7f2a462bb640 1 Processor -- start 2023-11-28T18:37:53.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.694+0000 7f2a462bb640 1 -- start start 2023-11-28T18:37:53.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.694+0000 7f2a462bb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2a400cf950 0x7f2a4009dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:53.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.694+0000 7f2a462bb640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2a400d0270 0x7f2a40158030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:53.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.694+0000 7f2a462bb640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2a400d06d0 0x7f2a400c8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:53.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.694+0000 7f2a462bb640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4009f740 con 0x7f2a400cf950 2023-11-28T18:37:53.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.694+0000 7f2a462bb640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4009eb30 con 0x7f2a400d06d0 2023-11-28T18:37:53.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.694+0000 7f2a462bb640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4009ee10 con 0x7f2a400d0270 2023-11-28T18:37:53.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.694+0000 7f2a452b9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2a400cf950 0x7f2a4009dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:53.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.694+0000 7f2a452b9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2a400cf950 0x7f2a4009dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39002/0 (socket says 172.21.15.45:39002) 2023-11-28T18:37:53.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.694+0000 7f2a452b9640 1 -- 172.21.15.45:0/2909643284 learned_addr learned my addr 172.21.15.45:0/2909643284 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:53.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.694+0000 7f2a44ab8640 1 --2- 172.21.15.45:0/2909643284 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2a400d0270 0x7f2a40158030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:53.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.694+0000 7f2a45aba640 1 --2- 172.21.15.45:0/2909643284 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2a400d06d0 0x7f2a400c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:53.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.694+0000 7f2a452b9640 1 -- 172.21.15.45:0/2909643284 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2a400d0270 msgr2=0x7f2a40158030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:53.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.694+0000 7f2a452b9640 1 --2- 172.21.15.45:0/2909643284 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2a400d0270 0x7f2a40158030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:53.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.694+0000 7f2a452b9640 1 -- 172.21.15.45:0/2909643284 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2a400d06d0 msgr2=0x7f2a400c8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:53.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.694+0000 7f2a452b9640 1 --2- 172.21.15.45:0/2909643284 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2a400d06d0 0x7f2a400c8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:53.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.694+0000 7f2a452b9640 1 -- 172.21.15.45:0/2909643284 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a3c009420 con 0x7f2a400cf950 2023-11-28T18:37:53.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.694+0000 7f2a452b9640 1 --2- 172.21.15.45:0/2909643284 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2a400cf950 0x7f2a4009dc60 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c00ebe0 tx=0x7f2a3c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:53.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.694+0000 7f2a35ffb640 1 -- 172.21.15.45:0/2909643284 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3c00eee0 con 0x7f2a400cf950 2023-11-28T18:37:53.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.694+0000 7f2a35ffb640 1 -- 172.21.15.45:0/2909643284 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a3c00cc30 con 0x7f2a400cf950 2023-11-28T18:37:53.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.694+0000 7f2a35ffb640 1 -- 172.21.15.45:0/2909643284 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3c013470 con 0x7f2a400cf950 2023-11-28T18:37:53.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.694+0000 7f2a462bb640 1 -- 172.21.15.45:0/2909643284 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a30009420 con 0x7f2a400cf950 2023-11-28T18:37:53.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.694+0000 7f2a462bb640 1 -- 172.21.15.45:0/2909643284 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a4009f3d0 con 0x7f2a400cf950 2023-11-28T18:37:53.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.694+0000 7f2a462bb640 1 -- 172.21.15.45:0/2909643284 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a400a0f70 con 0x7f2a400cf950 2023-11-28T18:37:53.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.698+0000 7f2a35ffb640 1 -- 172.21.15.45:0/2909643284 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f2a3c0135d0 con 0x7f2a400cf950 2023-11-28T18:37:53.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.698+0000 7f2a35ffb640 1 --2- 172.21.15.45:0/2909643284 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f2a240668d0 0x7f2a24068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:53.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.698+0000 7f2a35ffb640 1 -- 172.21.15.45:0/2909643284 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2a3c0847c0 con 0x7f2a400cf950 2023-11-28T18:37:53.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.698+0000 7f2a44ab8640 1 --2- 172.21.15.45:0/2909643284 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f2a240668d0 0x7f2a24068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:53.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.698+0000 7f2a44ab8640 1 --2- 172.21.15.45:0/2909643284 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f2a240668d0 0x7f2a24068d90 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2a300ad000 tx=0x7f2a30008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:53.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.702+0000 7f2a35ffb640 1 -- 172.21.15.45:0/2909643284 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2a3c051980 con 0x7f2a400cf950 2023-11-28T18:37:53.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.890+0000 7f2a462bb640 1 -- 172.21.15.45:0/2909643284 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2a4004e970 con 0x7f2a400cf950 2023-11-28T18:37:53.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.894+0000 7f2a35ffb640 1 -- 172.21.15.45:0/2909643284 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2a3c017060 con 0x7f2a400cf950 2023-11-28T18:37:53.899 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T18:37:53.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.894+0000 7f2a462bb640 1 -- 172.21.15.45:0/2909643284 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f2a240668d0 msgr2=0x7f2a24068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:53.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.894+0000 7f2a462bb640 1 --2- 172.21.15.45:0/2909643284 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f2a240668d0 0x7f2a24068d90 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2a300ad000 tx=0x7f2a30008040 comp rx=0 tx=0).stop 2023-11-28T18:37:53.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.894+0000 7f2a462bb640 1 -- 172.21.15.45:0/2909643284 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2a400cf950 msgr2=0x7f2a4009dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:53.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.894+0000 7f2a462bb640 1 --2- 172.21.15.45:0/2909643284 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2a400cf950 0x7f2a4009dc60 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c00ebe0 tx=0x7f2a3c00c520 comp rx=0 tx=0).stop 2023-11-28T18:37:53.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.894+0000 7f2a462bb640 1 -- 172.21.15.45:0/2909643284 shutdown_connections 2023-11-28T18:37:53.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.894+0000 7f2a462bb640 1 --2- 172.21.15.45:0/2909643284 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f2a240668d0 0x7f2a24068d90 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:53.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.894+0000 7f2a462bb640 1 --2- 172.21.15.45:0/2909643284 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2a400d06d0 0x7f2a400c8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:53.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.894+0000 7f2a462bb640 1 --2- 172.21.15.45:0/2909643284 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2a400d0270 0x7f2a40158030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:53.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.894+0000 7f2a462bb640 1 --2- 172.21.15.45:0/2909643284 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2a400cf950 0x7f2a4009dc60 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:53.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.894+0000 7f2a462bb640 1 -- 172.21.15.45:0/2909643284 >> 172.21.15.45:0/2909643284 conn(0x7f2a400d2fa0 msgr2=0x7f2a4006c400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:53.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.894+0000 7f2a462bb640 1 -- 172.21.15.45:0/2909643284 shutdown_connections 2023-11-28T18:37:53.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:53.894+0000 7f2a462bb640 1 -- 172.21.15.45:0/2909643284 wait complete. 2023-11-28T18:37:53.919 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-28T18:37:53.920 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T18:37:53.920 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi190.front.sepia.ceph.com 2023-11-28T18:37:53.920 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-28T18:37:53.920 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-28T18:37:53.920 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-28T18:37:53.920 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-28T18:37:53.920 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T18:37:53.920 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-28T18:37:53.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:37:53.921 DEBUG:teuthology.orchestra.run.smithi190:> ip addr 2023-11-28T18:37:53.931 INFO:teuthology.orchestra.run.smithi190.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T18:37:53.931 INFO:teuthology.orchestra.run.smithi190.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T18:37:53.931 INFO:teuthology.orchestra.run.smithi190.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T18:37:53.931 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:37:53.932 INFO:teuthology.orchestra.run.smithi190.stdout: inet6 ::1/128 scope host 2023-11-28T18:37:53.932 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:37:53.932 INFO:teuthology.orchestra.run.smithi190.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T18:37:53.932 INFO:teuthology.orchestra.run.smithi190.stdout: link/ether 0c:c4:7a:d9:36:d0 brd ff:ff:ff:ff:ff:ff 2023-11-28T18:37:53.932 INFO:teuthology.orchestra.run.smithi190.stdout: altname enp7s0f0 2023-11-28T18:37:53.932 INFO:teuthology.orchestra.run.smithi190.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T18:37:53.932 INFO:teuthology.orchestra.run.smithi190.stdout: link/ether 0c:c4:7a:d9:36:d1 brd ff:ff:ff:ff:ff:ff 2023-11-28T18:37:53.932 INFO:teuthology.orchestra.run.smithi190.stdout: altname enp7s0f1 2023-11-28T18:37:53.932 INFO:teuthology.orchestra.run.smithi190.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T18:37:53.933 INFO:teuthology.orchestra.run.smithi190.stdout: link/ether 0c:c4:7a:88:77:62 brd ff:ff:ff:ff:ff:ff 2023-11-28T18:37:53.933 INFO:teuthology.orchestra.run.smithi190.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T18:37:53.933 INFO:teuthology.orchestra.run.smithi190.stdout: link/ether 0c:c4:7a:88:77:63 brd ff:ff:ff:ff:ff:ff 2023-11-28T18:37:53.933 INFO:teuthology.orchestra.run.smithi190.stdout: inet 172.21.15.190/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-28T18:37:53.933 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft 42366sec preferred_lft 42366sec 2023-11-28T18:37:53.933 INFO:teuthology.orchestra.run.smithi190.stdout: inet6 fe80::ec4:7aff:fe88:7763/64 scope link 2023-11-28T18:37:53.933 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:37:53.933 INFO:teuthology.orchestra.run.smithi190.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T18:37:53.933 INFO:teuthology.orchestra.run.smithi190.stdout: link/ether 02:42:02:d7:0b:9b brd ff:ff:ff:ff:ff:ff 2023-11-28T18:37:53.933 INFO:teuthology.orchestra.run.smithi190.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T18:37:53.933 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:37:53.934 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-28T18:37:53.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:37:53.934 DEBUG:teuthology.orchestra.run.smithi190:> (cd / && exec bash -c ' 2023-11-28T18:37:53.934 DEBUG:teuthology.orchestra.run.smithi190:> set -e 2023-11-28T18:37:53.934 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip link add name ceph-brx type bridge 2023-11-28T18:37:53.934 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip addr flush dev ceph-brx 2023-11-28T18:37:53.934 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip link set ceph-brx up 2023-11-28T18:37:53.934 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-28T18:37:53.934 DEBUG:teuthology.orchestra.run.smithi190:> ') 2023-11-28T18:37:54.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:37:54.048 DEBUG:teuthology.orchestra.run.smithi190:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T18:37:54.070 INFO:teuthology.orchestra.run.smithi190.stdout:1 2023-11-28T18:37:54.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:37:54.072 DEBUG:teuthology.orchestra.run.smithi190:> route 2023-11-28T18:37:54.141 INFO:teuthology.orchestra.run.smithi190.stdout:Kernel IP routing table 2023-11-28T18:37:54.142 INFO:teuthology.orchestra.run.smithi190.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T18:37:54.142 INFO:teuthology.orchestra.run.smithi190.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-28T18:37:54.142 INFO:teuthology.orchestra.run.smithi190.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-28T18:37:54.142 INFO:teuthology.orchestra.run.smithi190.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T18:37:54.142 INFO:teuthology.orchestra.run.smithi190.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-28T18:37:54.142 INFO:teuthology.orchestra.run.smithi190.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T18:37:54.143 INFO:teuthology.orchestra.run.smithi190.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T18:37:54.143 INFO:teuthology.orchestra.run.smithi190.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T18:37:54.143 INFO:teuthology.orchestra.run.smithi190.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T18:37:54.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:37:54.143 DEBUG:teuthology.orchestra.run.smithi190:> (cd / && exec bash -c ' 2023-11-28T18:37:54.143 DEBUG:teuthology.orchestra.run.smithi190:> set -e 2023-11-28T18:37:54.143 DEBUG:teuthology.orchestra.run.smithi190:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-28T18:37:54.143 DEBUG:teuthology.orchestra.run.smithi190:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-28T18:37:54.143 DEBUG:teuthology.orchestra.run.smithi190:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-28T18:37:54.143 DEBUG:teuthology.orchestra.run.smithi190:> ') 2023-11-28T18:37:54.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:37:54.236 DEBUG:teuthology.orchestra.run.smithi190:> ip netns list 2023-11-28T18:37:54.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:37:54.247 DEBUG:teuthology.orchestra.run.smithi190:> ip netns list-id 2023-11-28T18:37:54.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:37:54.302 DEBUG:teuthology.orchestra.run.smithi190:> (cd / && exec bash -c ' 2023-11-28T18:37:54.302 DEBUG:teuthology.orchestra.run.smithi190:> set -e 2023-11-28T18:37:54.302 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-28T18:37:54.302 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-11-28T18:37:54.302 DEBUG:teuthology.orchestra.run.smithi190:> ') 2023-11-28T18:37:54.389 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-11-28T18:37:54.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:37:54.390 DEBUG:teuthology.orchestra.run.smithi190:> (cd / && exec bash -c ' 2023-11-28T18:37:54.390 DEBUG:teuthology.orchestra.run.smithi190:> set -e 2023-11-28T18:37:54.390 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-11-28T18:37:54.390 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-28T18:37:54.390 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-11-28T18:37:54.390 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-11-28T18:37:54.391 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-11-28T18:37:54.391 DEBUG:teuthology.orchestra.run.smithi190:> ') 2023-11-28T18:37:54.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:37:54.559 DEBUG:teuthology.orchestra.run.smithi190:> (cd / && exec bash -c ' 2023-11-28T18:37:54.559 DEBUG:teuthology.orchestra.run.smithi190:> set -e 2023-11-28T18:37:54.559 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip link set brx.0 up 2023-11-28T18:37:54.559 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip link set dev brx.0 master ceph-brx 2023-11-28T18:37:54.560 DEBUG:teuthology.orchestra.run.smithi190:> ') 2023-11-28T18:37:54.600 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-11-28T18:37:54.600 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T18:37:54.600 DEBUG:teuthology.orchestra.run.smithi190:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-28T18:37:54.654 INFO:teuthology.orchestra.run.smithi190.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-28T18:37:54.654 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T18:37:54.654 DEBUG:teuthology.orchestra.run.smithi190:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-28T18:37:54.705 DEBUG:teuthology.orchestra.run.smithi190:> sudo modprobe fuse 2023-11-28T18:37:54.770 DEBUG:teuthology.orchestra.run.smithi190:> cat /proc/self/mounts | awk '{print $2}' 2023-11-28T18:37:54.823 INFO:teuthology.orchestra.run.smithi190.stdout:/sys 2023-11-28T18:37:54.823 INFO:teuthology.orchestra.run.smithi190.stdout:/proc 2023-11-28T18:37:54.823 INFO:teuthology.orchestra.run.smithi190.stdout:/dev 2023-11-28T18:37:54.823 INFO:teuthology.orchestra.run.smithi190.stdout:/dev/pts 2023-11-28T18:37:54.823 INFO:teuthology.orchestra.run.smithi190.stdout:/run 2023-11-28T18:37:54.823 INFO:teuthology.orchestra.run.smithi190.stdout:/ 2023-11-28T18:37:54.823 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/kernel/security 2023-11-28T18:37:54.824 INFO:teuthology.orchestra.run.smithi190.stdout:/dev/shm 2023-11-28T18:37:54.824 INFO:teuthology.orchestra.run.smithi190.stdout:/run/lock 2023-11-28T18:37:54.824 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/fs/cgroup 2023-11-28T18:37:54.824 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/fs/pstore 2023-11-28T18:37:54.824 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/fs/bpf 2023-11-28T18:37:54.824 INFO:teuthology.orchestra.run.smithi190.stdout:/proc/sys/fs/binfmt_misc 2023-11-28T18:37:54.824 INFO:teuthology.orchestra.run.smithi190.stdout:/dev/hugepages 2023-11-28T18:37:54.824 INFO:teuthology.orchestra.run.smithi190.stdout:/dev/mqueue 2023-11-28T18:37:54.824 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/kernel/debug 2023-11-28T18:37:54.824 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/kernel/tracing 2023-11-28T18:37:54.824 INFO:teuthology.orchestra.run.smithi190.stdout:/proc/fs/nfsd 2023-11-28T18:37:54.824 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/fs/fuse/connections 2023-11-28T18:37:54.825 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/kernel/config 2023-11-28T18:37:54.825 INFO:teuthology.orchestra.run.smithi190.stdout:/run/credentials/systemd-sysusers.service 2023-11-28T18:37:54.825 INFO:teuthology.orchestra.run.smithi190.stdout:/run/rpc_pipefs 2023-11-28T18:37:54.825 INFO:teuthology.orchestra.run.smithi190.stdout:/run/user/1000 2023-11-28T18:37:54.825 INFO:teuthology.orchestra.run.smithi190.stdout:/var/lib/ceph 2023-11-28T18:37:54.825 INFO:teuthology.orchestra.run.smithi190.stdout:/var/lib/ceph/osd/ceph-4 2023-11-28T18:37:54.825 INFO:teuthology.orchestra.run.smithi190.stdout:/var/lib/ceph/osd/ceph-5 2023-11-28T18:37:54.825 INFO:teuthology.orchestra.run.smithi190.stdout:/var/lib/ceph/osd/ceph-6 2023-11-28T18:37:54.825 INFO:teuthology.orchestra.run.smithi190.stdout:/var/lib/ceph/osd/ceph-7 2023-11-28T18:37:54.825 INFO:teuthology.orchestra.run.smithi190.stdout:/run/netns 2023-11-28T18:37:54.825 INFO:teuthology.orchestra.run.smithi190.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-28T18:37:54.826 INFO:teuthology.orchestra.run.smithi190.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-28T18:37:54.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:37:54.827 DEBUG:teuthology.orchestra.run.smithi190:> ls /sys/fs/fuse/connections 2023-11-28T18:37:54.877 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-28T18:37:54.877 DEBUG:teuthology.orchestra.run.smithi190:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-11-28T18:37:54.924 DEBUG:teuthology.orchestra.run.smithi190:> sudo modprobe fuse 2023-11-28T18:37:54.945 DEBUG:teuthology.orchestra.run.smithi190:> cat /proc/self/mounts | awk '{print $2}' 2023-11-28T18:37:54.999 INFO:teuthology.orchestra.run.smithi190.stdout:/sys 2023-11-28T18:37:54.999 INFO:teuthology.orchestra.run.smithi190.stdout:/proc 2023-11-28T18:37:54.999 INFO:teuthology.orchestra.run.smithi190.stdout:/dev 2023-11-28T18:37:54.999 INFO:teuthology.orchestra.run.smithi190.stdout:/dev/pts 2023-11-28T18:37:55.000 INFO:teuthology.orchestra.run.smithi190.stdout:/run 2023-11-28T18:37:55.000 INFO:teuthology.orchestra.run.smithi190.stdout:/ 2023-11-28T18:37:55.000 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/kernel/security 2023-11-28T18:37:55.000 INFO:teuthology.orchestra.run.smithi190.stdout:/dev/shm 2023-11-28T18:37:55.000 INFO:teuthology.orchestra.run.smithi190.stdout:/run/lock 2023-11-28T18:37:55.000 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/fs/cgroup 2023-11-28T18:37:55.000 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/fs/pstore 2023-11-28T18:37:55.000 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/fs/bpf 2023-11-28T18:37:55.001 INFO:teuthology.orchestra.run.smithi190.stdout:/proc/sys/fs/binfmt_misc 2023-11-28T18:37:55.001 INFO:teuthology.orchestra.run.smithi190.stdout:/dev/hugepages 2023-11-28T18:37:55.001 INFO:teuthology.orchestra.run.smithi190.stdout:/dev/mqueue 2023-11-28T18:37:55.001 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/kernel/debug 2023-11-28T18:37:55.001 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/kernel/tracing 2023-11-28T18:37:55.001 INFO:teuthology.orchestra.run.smithi190.stdout:/proc/fs/nfsd 2023-11-28T18:37:55.001 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/fs/fuse/connections 2023-11-28T18:37:55.001 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/kernel/config 2023-11-28T18:37:55.001 INFO:teuthology.orchestra.run.smithi190.stdout:/run/credentials/systemd-sysusers.service 2023-11-28T18:37:55.001 INFO:teuthology.orchestra.run.smithi190.stdout:/run/rpc_pipefs 2023-11-28T18:37:55.001 INFO:teuthology.orchestra.run.smithi190.stdout:/run/user/1000 2023-11-28T18:37:55.001 INFO:teuthology.orchestra.run.smithi190.stdout:/var/lib/ceph 2023-11-28T18:37:55.001 INFO:teuthology.orchestra.run.smithi190.stdout:/var/lib/ceph/osd/ceph-4 2023-11-28T18:37:55.002 INFO:teuthology.orchestra.run.smithi190.stdout:/var/lib/ceph/osd/ceph-5 2023-11-28T18:37:55.002 INFO:teuthology.orchestra.run.smithi190.stdout:/var/lib/ceph/osd/ceph-6 2023-11-28T18:37:55.002 INFO:teuthology.orchestra.run.smithi190.stdout:/var/lib/ceph/osd/ceph-7 2023-11-28T18:37:55.002 INFO:teuthology.orchestra.run.smithi190.stdout:/run/netns 2023-11-28T18:37:55.002 INFO:teuthology.orchestra.run.smithi190.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-28T18:37:55.002 INFO:teuthology.orchestra.run.smithi190.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-28T18:37:55.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:37:55.003 DEBUG:teuthology.orchestra.run.smithi190:> ls /sys/fs/fuse/connections 2023-11-28T18:37:55.049 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi190.stderr:2023-11-28T18:37:55.043+0000 7f32f87e8580 -1 init, newargv = 0x561353a4e110 newargc=15 2023-11-28T18:37:55.050 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi190.stderr:ceph-fuse[43720]: starting ceph client 2023-11-28T18:37:55.055 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi190.stderr:ceph-fuse[43720]: starting fuse 2023-11-28T18:37:55.057 INFO:teuthology.orchestra.run.smithi190.stdout:43 2023-11-28T18:37:55.058 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-11-28T18:37:55.058 DEBUG:teuthology.orchestra.run.smithi190:> sudo stdin-killer -- python3 -c ' 2023-11-28T18:37:55.058 DEBUG:teuthology.orchestra.run.smithi190:> import glob 2023-11-28T18:37:55.058 DEBUG:teuthology.orchestra.run.smithi190:> import re 2023-11-28T18:37:55.058 DEBUG:teuthology.orchestra.run.smithi190:> import os 2023-11-28T18:37:55.058 DEBUG:teuthology.orchestra.run.smithi190:> import subprocess 2023-11-28T18:37:55.058 DEBUG:teuthology.orchestra.run.smithi190:> 2023-11-28T18:37:55.058 DEBUG:teuthology.orchestra.run.smithi190:> def _find_admin_socket(client_name): 2023-11-28T18:37:55.059 DEBUG:teuthology.orchestra.run.smithi190:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-11-28T18:37:55.059 DEBUG:teuthology.orchestra.run.smithi190:> files = glob.glob(asok_path) 2023-11-28T18:37:55.059 DEBUG:teuthology.orchestra.run.smithi190:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-11-28T18:37:55.059 DEBUG:teuthology.orchestra.run.smithi190:> 2023-11-28T18:37:55.059 DEBUG:teuthology.orchestra.run.smithi190:> # Given a non-glob path, it better be there 2023-11-28T18:37:55.059 DEBUG:teuthology.orchestra.run.smithi190:> if "*" not in asok_path: 2023-11-28T18:37:55.059 DEBUG:teuthology.orchestra.run.smithi190:> assert(len(files) == 1) 2023-11-28T18:37:55.059 DEBUG:teuthology.orchestra.run.smithi190:> return files[0] 2023-11-28T18:37:55.059 DEBUG:teuthology.orchestra.run.smithi190:> 2023-11-28T18:37:55.059 DEBUG:teuthology.orchestra.run.smithi190:> for f in files: 2023-11-28T18:37:55.059 DEBUG:teuthology.orchestra.run.smithi190:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-28T18:37:55.060 DEBUG:teuthology.orchestra.run.smithi190:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-28T18:37:55.060 DEBUG:teuthology.orchestra.run.smithi190:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-28T18:37:55.060 DEBUG:teuthology.orchestra.run.smithi190:> contents = proc_f.read() 2023-11-28T18:37:55.060 DEBUG:teuthology.orchestra.run.smithi190:> if mountpoint in contents: 2023-11-28T18:37:55.060 DEBUG:teuthology.orchestra.run.smithi190:> return f 2023-11-28T18:37:55.060 DEBUG:teuthology.orchestra.run.smithi190:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-28T18:37:55.060 DEBUG:teuthology.orchestra.run.smithi190:> 2023-11-28T18:37:55.060 DEBUG:teuthology.orchestra.run.smithi190:> print(_find_admin_socket("client.1")) 2023-11-28T18:37:55.060 DEBUG:teuthology.orchestra.run.smithi190:> ' 2023-11-28T18:37:55.185 INFO:teuthology.orchestra.run.smithi190.stdout:/var/run/ceph/ceph-client.1.43720.asok 2023-11-28T18:37:55.189 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-28T18:37:55.197 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.43720.asok 2023-11-28T18:37:55.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:37:55.197 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.43720.asok status 2023-11-28T18:37:55.374 INFO:teuthology.orchestra.run.smithi190.stdout:{ 2023-11-28T18:37:55.374 INFO:teuthology.orchestra.run.smithi190.stdout: "metadata": { 2023-11-28T18:37:55.374 INFO:teuthology.orchestra.run.smithi190.stdout: "ceph_sha1": "47c1c547372ed5bff7984647dc200bac0e019caf", 2023-11-28T18:37:55.374 INFO:teuthology.orchestra.run.smithi190.stdout: "ceph_version": "ceph version 18.0.0-7531-g47c1c547 (47c1c547372ed5bff7984647dc200bac0e019caf) reef (dev)", 2023-11-28T18:37:55.374 INFO:teuthology.orchestra.run.smithi190.stdout: "entity_id": "1", 2023-11-28T18:37:55.374 INFO:teuthology.orchestra.run.smithi190.stdout: "hostname": "smithi190", 2023-11-28T18:37:55.374 INFO:teuthology.orchestra.run.smithi190.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-11-28T18:37:55.374 INFO:teuthology.orchestra.run.smithi190.stdout: "pid": "43720", 2023-11-28T18:37:55.374 INFO:teuthology.orchestra.run.smithi190.stdout: "root": "/" 2023-11-28T18:37:55.375 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-11-28T18:37:55.375 INFO:teuthology.orchestra.run.smithi190.stdout: "dentry_count": 0, 2023-11-28T18:37:55.375 INFO:teuthology.orchestra.run.smithi190.stdout: "dentry_pinned_count": 0, 2023-11-28T18:37:55.375 INFO:teuthology.orchestra.run.smithi190.stdout: "id": 4610, 2023-11-28T18:37:55.375 INFO:teuthology.orchestra.run.smithi190.stdout: "inst": { 2023-11-28T18:37:55.375 INFO:teuthology.orchestra.run.smithi190.stdout: "name": { 2023-11-28T18:37:55.375 INFO:teuthology.orchestra.run.smithi190.stdout: "type": "client", 2023-11-28T18:37:55.375 INFO:teuthology.orchestra.run.smithi190.stdout: "num": 4610 2023-11-28T18:37:55.375 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-11-28T18:37:55.375 INFO:teuthology.orchestra.run.smithi190.stdout: "addr": { 2023-11-28T18:37:55.375 INFO:teuthology.orchestra.run.smithi190.stdout: "type": "v1", 2023-11-28T18:37:55.376 INFO:teuthology.orchestra.run.smithi190.stdout: "addr": "192.168.0.1:0", 2023-11-28T18:37:55.376 INFO:teuthology.orchestra.run.smithi190.stdout: "nonce": 227295550 2023-11-28T18:37:55.376 INFO:teuthology.orchestra.run.smithi190.stdout: } 2023-11-28T18:37:55.376 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-11-28T18:37:55.376 INFO:teuthology.orchestra.run.smithi190.stdout: "addr": { 2023-11-28T18:37:55.376 INFO:teuthology.orchestra.run.smithi190.stdout: "type": "v1", 2023-11-28T18:37:55.376 INFO:teuthology.orchestra.run.smithi190.stdout: "addr": "192.168.0.1:0", 2023-11-28T18:37:55.376 INFO:teuthology.orchestra.run.smithi190.stdout: "nonce": 227295550 2023-11-28T18:37:55.376 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-11-28T18:37:55.376 INFO:teuthology.orchestra.run.smithi190.stdout: "inst_str": "client.4610 192.168.0.1:0/227295550", 2023-11-28T18:37:55.376 INFO:teuthology.orchestra.run.smithi190.stdout: "addr_str": "192.168.0.1:0/227295550", 2023-11-28T18:37:55.376 INFO:teuthology.orchestra.run.smithi190.stdout: "inode_count": 1, 2023-11-28T18:37:55.376 INFO:teuthology.orchestra.run.smithi190.stdout: "mds_epoch": 8, 2023-11-28T18:37:55.377 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_epoch": 20, 2023-11-28T18:37:55.377 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_epoch_barrier": 0, 2023-11-28T18:37:55.377 INFO:teuthology.orchestra.run.smithi190.stdout: "blocklisted": false, 2023-11-28T18:37:55.377 INFO:teuthology.orchestra.run.smithi190.stdout: "fs_name": "cephfs" 2023-11-28T18:37:55.377 INFO:teuthology.orchestra.run.smithi190.stdout:} 2023-11-28T18:37:55.389 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T18:37:55.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:55.538+0000 7f37c0ddf640 1 Processor -- start 2023-11-28T18:37:55.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:55.538+0000 7f37c0ddf640 1 -- start start 2023-11-28T18:37:55.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:55.542+0000 7f37c0ddf640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f37bc06d1d0 0x7f37bc15a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:55.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:55.542+0000 7f37c0ddf640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37bc0704a0 con 0x7f37bc1509a0 2023-11-28T18:37:55.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:55.542+0000 7f37c0ddf640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37bc15ab60 con 0x7f37bc06cdf0 2023-11-28T18:37:55.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:55.542+0000 7f37c0ddf640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37bc0706d0 con 0x7f37bc06d1d0 2023-11-28T18:37:55.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:55.542+0000 7f37b3fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f37bc1509a0 0x7f37bc159de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51102/0 (socket says 172.21.15.45:51102) 2023-11-28T18:37:55.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:55.542+0000 7f37b3fff640 1 -- 172.21.15.45:0/1795119041 learned_addr learned my addr 172.21.15.45:0/1795119041 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:37:55.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:55.542+0000 7f37bad9d640 1 --2- 172.21.15.45:0/1795119041 >> v2:172.21.15.45:3300/0 conn(0x7f37bc06d1d0 0x7f37bc15a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:55.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:55.542+0000 7f37b9d9b640 1 -- 172.21.15.45:0/1795119041 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3382592079 0 0) 0x7f37bc0704a0 con 0x7f37bc1509a0 2023-11-28T18:37:55.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:55.542+0000 7f37b9d9b640 1 -- 172.21.15.45:0/1795119041 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37a8003530 con 0x7f37bc1509a0 2023-11-28T18:37:55.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:55.542+0000 7f37bad9d640 1 -- 172.21.15.45:0/1795119041 >> v1:172.21.15.190:6789/0 conn(0x7f37bc06cdf0 legacy=0x7f37bc150290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:55.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:55.542+0000 7f37bad9d640 1 -- 172.21.15.45:0/1795119041 >> v1:172.21.15.45:6789/0 conn(0x7f37bc1509a0 legacy=0x7f37bc159de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:55.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:55.542+0000 7f37bad9d640 1 -- 172.21.15.45:0/1795119041 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37bc0709b0 con 0x7f37bc06d1d0 2023-11-28T18:37:55.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:55.546+0000 7f37bad9d640 1 --2- 172.21.15.45:0/1795119041 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37bc06d1d0 0x7f37bc15a4f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f37b4009d90 tx=0x7f37b401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbfda68ee390c47b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:55.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:55.546+0000 7f37b9d9b640 1 -- 172.21.15.45:0/1795119041 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b40a5790 con 0x7f37bc06d1d0 2023-11-28T18:37:55.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:55.546+0000 7f37b9d9b640 1 -- 172.21.15.45:0/1795119041 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37b40a58f0 con 0x7f37bc06d1d0 2023-11-28T18:37:55.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:55.546+0000 7f37b9d9b640 1 -- 172.21.15.45:0/1795119041 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b40a5c80 con 0x7f37bc06d1d0 2023-11-28T18:37:55.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:55.546+0000 7f37c0ddf640 1 -- 172.21.15.45:0/1795119041 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37bc06d1d0 msgr2=0x7f37bc15a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:55.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:55.546+0000 7f37c0ddf640 1 --2- 172.21.15.45:0/1795119041 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37bc06d1d0 0x7f37bc15a4f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f37b4009d90 tx=0x7f37b401c950 comp rx=0 tx=0).stop 2023-11-28T18:37:55.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:55.546+0000 7f37c0ddf640 1 -- 172.21.15.45:0/1795119041 shutdown_connections 2023-11-28T18:37:55.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:55.546+0000 7f37c0ddf640 1 --2- 172.21.15.45:0/1795119041 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37bc06d1d0 0x7f37bc15a4f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:55.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:55.546+0000 7f37c0ddf640 1 -- 172.21.15.45:0/1795119041 >> 172.21.15.45:0/1795119041 conn(0x7f37bc06a570 msgr2=0x7f37bc06a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:55.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:55.546+0000 7f37c0ddf640 1 -- 172.21.15.45:0/1795119041 shutdown_connections 2023-11-28T18:37:55.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:55.546+0000 7f37c0ddf640 1 -- 172.21.15.45:0/1795119041 wait complete. 2023-11-28T18:37:55.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:55.546+0000 7f37c0ddf640 1 Processor -- start 2023-11-28T18:37:55.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:55.546+0000 7f37c0ddf640 1 -- start start 2023-11-28T18:37:55.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:55.546+0000 7f37c0ddf640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f37bc06cdf0 0x7f37bc13d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:55.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:55.546+0000 7f37c0ddf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37bc06d1d0 0x7f37bc13e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:55.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:55.546+0000 7f37c0ddf640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f37bc1509a0 0x7f37bc13e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:55.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:55.546+0000 7f37c0ddf640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37bc1484a0 con 0x7f37bc06d1d0 2023-11-28T18:37:55.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:55.546+0000 7f37c0ddf640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37bc13f4b0 con 0x7f37bc1509a0 2023-11-28T18:37:55.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:55.546+0000 7f37c0ddf640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37bc15c4f0 con 0x7f37bc06cdf0 2023-11-28T18:37:55.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:55.550+0000 7f37b3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37bc06d1d0 0x7f37bc13e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:55.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:55.550+0000 7f37b3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37bc06d1d0 0x7f37bc13e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39026/0 (socket says 172.21.15.45:39026) 2023-11-28T18:37:55.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:55.550+0000 7f37b3fff640 1 -- 172.21.15.45:0/1760103658 learned_addr learned my addr 172.21.15.45:0/1760103658 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:55.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:55.550+0000 7f37ba59c640 1 --2- 172.21.15.45:0/1760103658 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f37bc06cdf0 0x7f37bc13d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:55.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:55.550+0000 7f37bad9d640 1 --2- 172.21.15.45:0/1760103658 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f37bc1509a0 0x7f37bc13e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:55.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:55.550+0000 7f37b3fff640 1 -- 172.21.15.45:0/1760103658 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f37bc06cdf0 msgr2=0x7f37bc13d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:55.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:55.550+0000 7f37b3fff640 1 --2- 172.21.15.45:0/1760103658 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f37bc06cdf0 0x7f37bc13d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:55.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:55.550+0000 7f37b3fff640 1 -- 172.21.15.45:0/1760103658 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f37bc1509a0 msgr2=0x7f37bc13e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:55.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:55.550+0000 7f37b3fff640 1 --2- 172.21.15.45:0/1760103658 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f37bc1509a0 0x7f37bc13e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:55.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:55.550+0000 7f37b3fff640 1 -- 172.21.15.45:0/1760103658 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b4009a70 con 0x7f37bc06d1d0 2023-11-28T18:37:55.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:55.550+0000 7f37bad9d640 1 --2- 172.21.15.45:0/1760103658 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f37bc1509a0 0x7f37bc13e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:37:55.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:55.550+0000 7f37b3fff640 1 --2- 172.21.15.45:0/1760103658 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37bc06d1d0 0x7f37bc13e0f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f37a400c420 tx=0x7f37a400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:55.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:55.550+0000 7f37b2ffd640 1 -- 172.21.15.45:0/1760103658 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a4005cf0 con 0x7f37bc06d1d0 2023-11-28T18:37:55.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:55.550+0000 7f37b2ffd640 1 -- 172.21.15.45:0/1760103658 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37a4005e50 con 0x7f37bc06d1d0 2023-11-28T18:37:55.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:55.550+0000 7f37b2ffd640 1 -- 172.21.15.45:0/1760103658 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a40072d0 con 0x7f37bc06d1d0 2023-11-28T18:37:55.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:55.550+0000 7f37c0ddf640 1 -- 172.21.15.45:0/1760103658 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37bc13dec0 con 0x7f37bc06d1d0 2023-11-28T18:37:55.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:55.550+0000 7f37c0ddf640 1 -- 172.21.15.45:0/1760103658 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37bc148960 con 0x7f37bc06d1d0 2023-11-28T18:37:55.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:55.550+0000 7f37c0ddf640 1 -- 172.21.15.45:0/1760103658 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37bc069480 con 0x7f37bc06d1d0 2023-11-28T18:37:55.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:55.550+0000 7f37b2ffd640 1 -- 172.21.15.45:0/1760103658 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f37a4007430 con 0x7f37bc06d1d0 2023-11-28T18:37:55.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:55.554+0000 7f37b2ffd640 1 --2- 172.21.15.45:0/1760103658 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f379c066900 0x7f379c068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:55.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:55.554+0000 7f37b2ffd640 1 -- 172.21.15.45:0/1760103658 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f37a4083620 con 0x7f37bc06d1d0 2023-11-28T18:37:55.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:55.554+0000 7f37ba59c640 1 --2- 172.21.15.45:0/1760103658 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f379c066900 0x7f379c068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:55.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:55.554+0000 7f37ba59c640 1 --2- 172.21.15.45:0/1760103658 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f379c066900 0x7f379c068dc0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f37ac000f70 tx=0x7f37ac009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:55.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:55.558+0000 7f37b2ffd640 1 -- 172.21.15.45:0/1760103658 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f37a40543c0 con 0x7f37bc06d1d0 2023-11-28T18:37:55.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:55.750+0000 7f37c0ddf640 1 -- 172.21.15.45:0/1760103658 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f37bc165550 con 0x7f37bc06d1d0 2023-11-28T18:37:55.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:55.750+0000 7f37b2ffd640 1 -- 172.21.15.45:0/1760103658 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f37a4053f50 con 0x7f37bc06d1d0 2023-11-28T18:37:55.756 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T18:37:55.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:55.750+0000 7f37c0ddf640 1 -- 172.21.15.45:0/1760103658 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f379c066900 msgr2=0x7f379c068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:55.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:55.750+0000 7f37c0ddf640 1 --2- 172.21.15.45:0/1760103658 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f379c066900 0x7f379c068dc0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f37ac000f70 tx=0x7f37ac009040 comp rx=0 tx=0).stop 2023-11-28T18:37:55.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:55.750+0000 7f37c0ddf640 1 -- 172.21.15.45:0/1760103658 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37bc06d1d0 msgr2=0x7f37bc13e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:55.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:55.750+0000 7f37c0ddf640 1 --2- 172.21.15.45:0/1760103658 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37bc06d1d0 0x7f37bc13e0f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f37a400c420 tx=0x7f37a400c8e0 comp rx=0 tx=0).stop 2023-11-28T18:37:55.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:55.750+0000 7f37c0ddf640 1 -- 172.21.15.45:0/1760103658 shutdown_connections 2023-11-28T18:37:55.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:55.750+0000 7f37c0ddf640 1 --2- 172.21.15.45:0/1760103658 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f379c066900 0x7f379c068dc0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:55.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:55.750+0000 7f37c0ddf640 1 --2- 172.21.15.45:0/1760103658 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f37bc1509a0 0x7f37bc13e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:55.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:55.750+0000 7f37c0ddf640 1 --2- 172.21.15.45:0/1760103658 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37bc06d1d0 0x7f37bc13e0f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:55.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:55.750+0000 7f37c0ddf640 1 --2- 172.21.15.45:0/1760103658 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f37bc06cdf0 0x7f37bc13d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:55.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:55.750+0000 7f37c0ddf640 1 -- 172.21.15.45:0/1760103658 >> 172.21.15.45:0/1760103658 conn(0x7f37bc06a570 msgr2=0x7f37bc15dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:55.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:55.750+0000 7f37c0ddf640 1 -- 172.21.15.45:0/1760103658 shutdown_connections 2023-11-28T18:37:55.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:55.750+0000 7f37c0ddf640 1 -- 172.21.15.45:0/1760103658 wait complete. 2023-11-28T18:37:55.777 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-28T18:37:55.777 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T18:37:55.777 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi190.front.sepia.ceph.com 2023-11-28T18:37:55.777 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-11-28T18:37:55.777 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-28T18:37:55.778 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-28T18:37:55.778 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-28T18:37:55.778 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T18:37:55.778 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-11-28T18:37:55.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:37:55.779 DEBUG:teuthology.orchestra.run.smithi190:> ip addr 2023-11-28T18:37:55.788 INFO:teuthology.orchestra.run.smithi190.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T18:37:55.788 INFO:teuthology.orchestra.run.smithi190.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T18:37:55.788 INFO:teuthology.orchestra.run.smithi190.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T18:37:55.789 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:37:55.789 INFO:teuthology.orchestra.run.smithi190.stdout: inet6 ::1/128 scope host 2023-11-28T18:37:55.789 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:37:55.789 INFO:teuthology.orchestra.run.smithi190.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T18:37:55.789 INFO:teuthology.orchestra.run.smithi190.stdout: link/ether 0c:c4:7a:d9:36:d0 brd ff:ff:ff:ff:ff:ff 2023-11-28T18:37:55.790 INFO:teuthology.orchestra.run.smithi190.stdout: altname enp7s0f0 2023-11-28T18:37:55.790 INFO:teuthology.orchestra.run.smithi190.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T18:37:55.790 INFO:teuthology.orchestra.run.smithi190.stdout: link/ether 0c:c4:7a:d9:36:d1 brd ff:ff:ff:ff:ff:ff 2023-11-28T18:37:55.790 INFO:teuthology.orchestra.run.smithi190.stdout: altname enp7s0f1 2023-11-28T18:37:55.790 INFO:teuthology.orchestra.run.smithi190.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T18:37:55.790 INFO:teuthology.orchestra.run.smithi190.stdout: link/ether 0c:c4:7a:88:77:62 brd ff:ff:ff:ff:ff:ff 2023-11-28T18:37:55.790 INFO:teuthology.orchestra.run.smithi190.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T18:37:55.791 INFO:teuthology.orchestra.run.smithi190.stdout: link/ether 0c:c4:7a:88:77:63 brd ff:ff:ff:ff:ff:ff 2023-11-28T18:37:55.791 INFO:teuthology.orchestra.run.smithi190.stdout: inet 172.21.15.190/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-28T18:37:55.791 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft 42364sec preferred_lft 42364sec 2023-11-28T18:37:55.791 INFO:teuthology.orchestra.run.smithi190.stdout: inet6 fe80::ec4:7aff:fe88:7763/64 scope link 2023-11-28T18:37:55.791 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:37:55.791 INFO:teuthology.orchestra.run.smithi190.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T18:37:55.792 INFO:teuthology.orchestra.run.smithi190.stdout: link/ether 02:42:02:d7:0b:9b brd ff:ff:ff:ff:ff:ff 2023-11-28T18:37:55.792 INFO:teuthology.orchestra.run.smithi190.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T18:37:55.792 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:37:55.792 INFO:teuthology.orchestra.run.smithi190.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T18:37:55.792 INFO:teuthology.orchestra.run.smithi190.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-28T18:37:55.792 INFO:teuthology.orchestra.run.smithi190.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-28T18:37:55.792 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:37:55.793 INFO:teuthology.orchestra.run.smithi190.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link tentative 2023-11-28T18:37:55.793 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:37:55.793 INFO:teuthology.orchestra.run.smithi190.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T18:37:55.793 INFO:teuthology.orchestra.run.smithi190.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-28T18:37:55.793 INFO:teuthology.orchestra.run.smithi190.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link tentative 2023-11-28T18:37:55.793 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:37:55.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:37:55.795 DEBUG:teuthology.orchestra.run.smithi190:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T18:37:55.855 INFO:teuthology.orchestra.run.smithi190.stdout:1 2023-11-28T18:37:55.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:37:55.858 DEBUG:teuthology.orchestra.run.smithi190:> route 2023-11-28T18:37:55.911 INFO:teuthology.orchestra.run.smithi190.stdout:Kernel IP routing table 2023-11-28T18:37:55.912 INFO:teuthology.orchestra.run.smithi190.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T18:37:55.912 INFO:teuthology.orchestra.run.smithi190.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-28T18:37:55.912 INFO:teuthology.orchestra.run.smithi190.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-28T18:37:55.912 INFO:teuthology.orchestra.run.smithi190.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T18:37:55.912 INFO:teuthology.orchestra.run.smithi190.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-28T18:37:55.912 INFO:teuthology.orchestra.run.smithi190.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T18:37:55.912 INFO:teuthology.orchestra.run.smithi190.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T18:37:55.912 INFO:teuthology.orchestra.run.smithi190.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T18:37:55.912 INFO:teuthology.orchestra.run.smithi190.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T18:37:55.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:37:55.913 DEBUG:teuthology.orchestra.run.smithi190:> (cd / && exec bash -c ' 2023-11-28T18:37:55.913 DEBUG:teuthology.orchestra.run.smithi190:> set -e 2023-11-28T18:37:55.913 DEBUG:teuthology.orchestra.run.smithi190:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-28T18:37:55.913 DEBUG:teuthology.orchestra.run.smithi190:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-28T18:37:55.913 DEBUG:teuthology.orchestra.run.smithi190:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-28T18:37:55.913 DEBUG:teuthology.orchestra.run.smithi190:> ') 2023-11-28T18:37:56.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:37:56.003 DEBUG:teuthology.orchestra.run.smithi190:> ip netns list 2023-11-28T18:37:56.012 INFO:teuthology.orchestra.run.smithi190.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-28T18:37:56.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:37:56.014 DEBUG:teuthology.orchestra.run.smithi190:> ip netns list-id 2023-11-28T18:37:56.065 INFO:teuthology.orchestra.run.smithi190.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-11-28T18:37:56.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:37:56.066 DEBUG:teuthology.orchestra.run.smithi190:> (cd / && exec bash -c ' 2023-11-28T18:37:56.066 DEBUG:teuthology.orchestra.run.smithi190:> set -e 2023-11-28T18:37:56.066 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-28T18:37:56.067 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-11-28T18:37:56.067 DEBUG:teuthology.orchestra.run.smithi190:> ') 2023-11-28T18:37:56.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:37:56.154 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-28T18:37:56.222 INFO:teuthology.orchestra.run.smithi190.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T18:37:56.222 INFO:teuthology.orchestra.run.smithi190.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T18:37:56.222 INFO:teuthology.orchestra.run.smithi190.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T18:37:56.222 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:37:56.222 INFO:teuthology.orchestra.run.smithi190.stdout: inet6 ::1/128 scope host 2023-11-28T18:37:56.222 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:37:56.222 INFO:teuthology.orchestra.run.smithi190.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T18:37:56.222 INFO:teuthology.orchestra.run.smithi190.stdout: link/ether 66:de:76:1f:f6:88 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-28T18:37:56.223 INFO:teuthology.orchestra.run.smithi190.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-28T18:37:56.223 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:37:56.223 INFO:teuthology.orchestra.run.smithi190.stdout: inet6 fe80::64de:76ff:fe1f:f688/64 scope link 2023-11-28T18:37:56.223 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:37:56.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:37:56.224 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-28T18:37:56.286 INFO:teuthology.orchestra.run.smithi190.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T18:37:56.286 INFO:teuthology.orchestra.run.smithi190.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T18:37:56.286 INFO:teuthology.orchestra.run.smithi190.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T18:37:56.286 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:37:56.286 INFO:teuthology.orchestra.run.smithi190.stdout: inet6 ::1/128 scope host 2023-11-28T18:37:56.286 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:37:56.286 INFO:teuthology.orchestra.run.smithi190.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T18:37:56.287 INFO:teuthology.orchestra.run.smithi190.stdout: link/ether 66:de:76:1f:f6:88 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-28T18:37:56.287 INFO:teuthology.orchestra.run.smithi190.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-28T18:37:56.287 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:37:56.287 INFO:teuthology.orchestra.run.smithi190.stdout: inet6 fe80::64de:76ff:fe1f:f688/64 scope link 2023-11-28T18:37:56.287 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:37:56.288 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-11-28T18:37:56.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:37:56.288 DEBUG:teuthology.orchestra.run.smithi190:> (cd / && exec bash -c ' 2023-11-28T18:37:56.288 DEBUG:teuthology.orchestra.run.smithi190:> set -e 2023-11-28T18:37:56.288 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-11-28T18:37:56.288 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-28T18:37:56.288 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-11-28T18:37:56.289 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-11-28T18:37:56.289 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-11-28T18:37:56.289 DEBUG:teuthology.orchestra.run.smithi190:> ') 2023-11-28T18:37:56.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:37:56.426 DEBUG:teuthology.orchestra.run.smithi190:> (cd / && exec bash -c ' 2023-11-28T18:37:56.426 DEBUG:teuthology.orchestra.run.smithi190:> set -e 2023-11-28T18:37:56.426 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip link set brx.1 up 2023-11-28T18:37:56.426 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip link set dev brx.1 master ceph-brx 2023-11-28T18:37:56.426 DEBUG:teuthology.orchestra.run.smithi190:> ') 2023-11-28T18:37:56.467 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2023-11-28T18:37:56.467 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T18:37:56.467 DEBUG:teuthology.orchestra.run.smithi190:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-11-28T18:37:56.521 INFO:teuthology.orchestra.run.smithi190.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-11-28T18:37:56.522 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T18:37:56.522 DEBUG:teuthology.orchestra.run.smithi190:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-11-28T18:37:56.576 DEBUG:teuthology.orchestra.run.smithi190:> sudo modprobe fuse 2023-11-28T18:37:56.641 DEBUG:teuthology.orchestra.run.smithi190:> cat /proc/self/mounts | awk '{print $2}' 2023-11-28T18:37:56.695 INFO:teuthology.orchestra.run.smithi190.stdout:/sys 2023-11-28T18:37:56.695 INFO:teuthology.orchestra.run.smithi190.stdout:/proc 2023-11-28T18:37:56.695 INFO:teuthology.orchestra.run.smithi190.stdout:/dev 2023-11-28T18:37:56.695 INFO:teuthology.orchestra.run.smithi190.stdout:/dev/pts 2023-11-28T18:37:56.695 INFO:teuthology.orchestra.run.smithi190.stdout:/run 2023-11-28T18:37:56.697 INFO:teuthology.orchestra.run.smithi190.stdout:/ 2023-11-28T18:37:56.697 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/kernel/security 2023-11-28T18:37:56.697 INFO:teuthology.orchestra.run.smithi190.stdout:/dev/shm 2023-11-28T18:37:56.697 INFO:teuthology.orchestra.run.smithi190.stdout:/run/lock 2023-11-28T18:37:56.697 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/fs/cgroup 2023-11-28T18:37:56.697 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/fs/pstore 2023-11-28T18:37:56.698 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/fs/bpf 2023-11-28T18:37:56.698 INFO:teuthology.orchestra.run.smithi190.stdout:/proc/sys/fs/binfmt_misc 2023-11-28T18:37:56.698 INFO:teuthology.orchestra.run.smithi190.stdout:/dev/hugepages 2023-11-28T18:37:56.698 INFO:teuthology.orchestra.run.smithi190.stdout:/dev/mqueue 2023-11-28T18:37:56.698 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/kernel/debug 2023-11-28T18:37:56.698 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/kernel/tracing 2023-11-28T18:37:56.698 INFO:teuthology.orchestra.run.smithi190.stdout:/proc/fs/nfsd 2023-11-28T18:37:56.698 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/fs/fuse/connections 2023-11-28T18:37:56.698 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/kernel/config 2023-11-28T18:37:56.698 INFO:teuthology.orchestra.run.smithi190.stdout:/run/credentials/systemd-sysusers.service 2023-11-28T18:37:56.698 INFO:teuthology.orchestra.run.smithi190.stdout:/run/rpc_pipefs 2023-11-28T18:37:56.698 INFO:teuthology.orchestra.run.smithi190.stdout:/run/user/1000 2023-11-28T18:37:56.699 INFO:teuthology.orchestra.run.smithi190.stdout:/var/lib/ceph 2023-11-28T18:37:56.699 INFO:teuthology.orchestra.run.smithi190.stdout:/var/lib/ceph/osd/ceph-4 2023-11-28T18:37:56.699 INFO:teuthology.orchestra.run.smithi190.stdout:/var/lib/ceph/osd/ceph-5 2023-11-28T18:37:56.699 INFO:teuthology.orchestra.run.smithi190.stdout:/var/lib/ceph/osd/ceph-6 2023-11-28T18:37:56.699 INFO:teuthology.orchestra.run.smithi190.stdout:/var/lib/ceph/osd/ceph-7 2023-11-28T18:37:56.699 INFO:teuthology.orchestra.run.smithi190.stdout:/run/netns 2023-11-28T18:37:56.699 INFO:teuthology.orchestra.run.smithi190.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-28T18:37:56.699 INFO:teuthology.orchestra.run.smithi190.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-28T18:37:56.700 INFO:teuthology.orchestra.run.smithi190.stdout:/home/ubuntu/cephtest/mnt.1 2023-11-28T18:37:56.700 INFO:teuthology.orchestra.run.smithi190.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-28T18:37:56.700 INFO:teuthology.orchestra.run.smithi190.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-28T18:37:56.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:37:56.701 DEBUG:teuthology.orchestra.run.smithi190:> ls /sys/fs/fuse/connections 2023-11-28T18:37:56.753 INFO:teuthology.orchestra.run.smithi190.stdout:43 2023-11-28T18:37:56.753 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [43] 2023-11-28T18:37:56.753 DEBUG:teuthology.orchestra.run.smithi190:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2023-11-28T18:37:56.804 DEBUG:teuthology.orchestra.run.smithi190:> sudo modprobe fuse 2023-11-28T18:37:56.826 DEBUG:teuthology.orchestra.run.smithi190:> cat /proc/self/mounts | awk '{print $2}' 2023-11-28T18:37:56.879 INFO:teuthology.orchestra.run.smithi190.stdout:/sys 2023-11-28T18:37:56.879 INFO:teuthology.orchestra.run.smithi190.stdout:/proc 2023-11-28T18:37:56.879 INFO:teuthology.orchestra.run.smithi190.stdout:/dev 2023-11-28T18:37:56.879 INFO:teuthology.orchestra.run.smithi190.stdout:/dev/pts 2023-11-28T18:37:56.879 INFO:teuthology.orchestra.run.smithi190.stdout:/run 2023-11-28T18:37:56.879 INFO:teuthology.orchestra.run.smithi190.stdout:/ 2023-11-28T18:37:56.879 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/kernel/security 2023-11-28T18:37:56.879 INFO:teuthology.orchestra.run.smithi190.stdout:/dev/shm 2023-11-28T18:37:56.879 INFO:teuthology.orchestra.run.smithi190.stdout:/run/lock 2023-11-28T18:37:56.880 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/fs/cgroup 2023-11-28T18:37:56.880 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/fs/pstore 2023-11-28T18:37:56.881 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/fs/bpf 2023-11-28T18:37:56.881 INFO:teuthology.orchestra.run.smithi190.stdout:/proc/sys/fs/binfmt_misc 2023-11-28T18:37:56.881 INFO:teuthology.orchestra.run.smithi190.stdout:/dev/hugepages 2023-11-28T18:37:56.882 INFO:teuthology.orchestra.run.smithi190.stdout:/dev/mqueue 2023-11-28T18:37:56.882 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/kernel/debug 2023-11-28T18:37:56.882 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/kernel/tracing 2023-11-28T18:37:56.882 INFO:teuthology.orchestra.run.smithi190.stdout:/proc/fs/nfsd 2023-11-28T18:37:56.882 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/fs/fuse/connections 2023-11-28T18:37:56.882 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/kernel/config 2023-11-28T18:37:56.882 INFO:teuthology.orchestra.run.smithi190.stdout:/run/credentials/systemd-sysusers.service 2023-11-28T18:37:56.882 INFO:teuthology.orchestra.run.smithi190.stdout:/run/rpc_pipefs 2023-11-28T18:37:56.883 INFO:teuthology.orchestra.run.smithi190.stdout:/run/user/1000 2023-11-28T18:37:56.883 INFO:teuthology.orchestra.run.smithi190.stdout:/var/lib/ceph 2023-11-28T18:37:56.883 INFO:teuthology.orchestra.run.smithi190.stdout:/var/lib/ceph/osd/ceph-4 2023-11-28T18:37:56.883 INFO:teuthology.orchestra.run.smithi190.stdout:/var/lib/ceph/osd/ceph-5 2023-11-28T18:37:56.883 INFO:teuthology.orchestra.run.smithi190.stdout:/var/lib/ceph/osd/ceph-6 2023-11-28T18:37:56.883 INFO:teuthology.orchestra.run.smithi190.stdout:/var/lib/ceph/osd/ceph-7 2023-11-28T18:37:56.883 INFO:teuthology.orchestra.run.smithi190.stdout:/run/netns 2023-11-28T18:37:56.883 INFO:teuthology.orchestra.run.smithi190.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-28T18:37:56.883 INFO:teuthology.orchestra.run.smithi190.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-28T18:37:56.883 INFO:teuthology.orchestra.run.smithi190.stdout:/home/ubuntu/cephtest/mnt.1 2023-11-28T18:37:56.884 INFO:teuthology.orchestra.run.smithi190.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-28T18:37:56.884 INFO:teuthology.orchestra.run.smithi190.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-28T18:37:56.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:37:56.885 DEBUG:teuthology.orchestra.run.smithi190:> ls /sys/fs/fuse/connections 2023-11-28T18:37:56.899 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi190.stderr:2023-11-28T18:37:56.895+0000 7f1df0845580 -1 init, newargv = 0x562daef151b0 newargc=15 2023-11-28T18:37:56.899 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi190.stderr:ceph-fuse[43826]: starting ceph client 2023-11-28T18:37:56.907 INFO:teuthology.orchestra.run.smithi190.stdout:43 2023-11-28T18:37:56.908 INFO:teuthology.orchestra.run.smithi190.stdout:44 2023-11-28T18:37:56.908 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi190.stderr:ceph-fuse[43826]: starting fuse 2023-11-28T18:37:56.909 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43, 44] 2023-11-28T18:37:56.909 DEBUG:teuthology.orchestra.run.smithi190:> sudo stdin-killer -- python3 -c ' 2023-11-28T18:37:56.909 DEBUG:teuthology.orchestra.run.smithi190:> import glob 2023-11-28T18:37:56.909 DEBUG:teuthology.orchestra.run.smithi190:> import re 2023-11-28T18:37:56.909 DEBUG:teuthology.orchestra.run.smithi190:> import os 2023-11-28T18:37:56.910 DEBUG:teuthology.orchestra.run.smithi190:> import subprocess 2023-11-28T18:37:56.910 DEBUG:teuthology.orchestra.run.smithi190:> 2023-11-28T18:37:56.910 DEBUG:teuthology.orchestra.run.smithi190:> def _find_admin_socket(client_name): 2023-11-28T18:37:56.910 DEBUG:teuthology.orchestra.run.smithi190:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2023-11-28T18:37:56.910 DEBUG:teuthology.orchestra.run.smithi190:> files = glob.glob(asok_path) 2023-11-28T18:37:56.910 DEBUG:teuthology.orchestra.run.smithi190:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2023-11-28T18:37:56.910 DEBUG:teuthology.orchestra.run.smithi190:> 2023-11-28T18:37:56.910 DEBUG:teuthology.orchestra.run.smithi190:> # Given a non-glob path, it better be there 2023-11-28T18:37:56.911 DEBUG:teuthology.orchestra.run.smithi190:> if "*" not in asok_path: 2023-11-28T18:37:56.911 DEBUG:teuthology.orchestra.run.smithi190:> assert(len(files) == 1) 2023-11-28T18:37:56.911 DEBUG:teuthology.orchestra.run.smithi190:> return files[0] 2023-11-28T18:37:56.911 DEBUG:teuthology.orchestra.run.smithi190:> 2023-11-28T18:37:56.911 DEBUG:teuthology.orchestra.run.smithi190:> for f in files: 2023-11-28T18:37:56.911 DEBUG:teuthology.orchestra.run.smithi190:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-28T18:37:56.911 DEBUG:teuthology.orchestra.run.smithi190:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-28T18:37:56.911 DEBUG:teuthology.orchestra.run.smithi190:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-28T18:37:56.911 DEBUG:teuthology.orchestra.run.smithi190:> contents = proc_f.read() 2023-11-28T18:37:56.911 DEBUG:teuthology.orchestra.run.smithi190:> if mountpoint in contents: 2023-11-28T18:37:56.912 DEBUG:teuthology.orchestra.run.smithi190:> return f 2023-11-28T18:37:56.912 DEBUG:teuthology.orchestra.run.smithi190:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-28T18:37:56.912 DEBUG:teuthology.orchestra.run.smithi190:> 2023-11-28T18:37:56.912 DEBUG:teuthology.orchestra.run.smithi190:> print(_find_admin_socket("client.3")) 2023-11-28T18:37:56.912 DEBUG:teuthology.orchestra.run.smithi190:> ' 2023-11-28T18:37:57.041 INFO:teuthology.orchestra.run.smithi190.stdout:/var/run/ceph/ceph-client.3.43826.asok 2023-11-28T18:37:57.044 INFO:teuthology.orchestra.run.smithi190.stderr:2023-11-28T18:37:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-28T18:37:57.052 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.43826.asok 2023-11-28T18:37:57.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:37:57.052 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.43826.asok status 2023-11-28T18:37:57.221 INFO:teuthology.orchestra.run.smithi190.stdout:{ 2023-11-28T18:37:57.221 INFO:teuthology.orchestra.run.smithi190.stdout: "metadata": { 2023-11-28T18:37:57.221 INFO:teuthology.orchestra.run.smithi190.stdout: "ceph_sha1": "47c1c547372ed5bff7984647dc200bac0e019caf", 2023-11-28T18:37:57.221 INFO:teuthology.orchestra.run.smithi190.stdout: "ceph_version": "ceph version 18.0.0-7531-g47c1c547 (47c1c547372ed5bff7984647dc200bac0e019caf) reef (dev)", 2023-11-28T18:37:57.221 INFO:teuthology.orchestra.run.smithi190.stdout: "entity_id": "3", 2023-11-28T18:37:57.221 INFO:teuthology.orchestra.run.smithi190.stdout: "hostname": "smithi190", 2023-11-28T18:37:57.221 INFO:teuthology.orchestra.run.smithi190.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2023-11-28T18:37:57.222 INFO:teuthology.orchestra.run.smithi190.stdout: "pid": "43826", 2023-11-28T18:37:57.222 INFO:teuthology.orchestra.run.smithi190.stdout: "root": "/" 2023-11-28T18:37:57.222 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-11-28T18:37:57.222 INFO:teuthology.orchestra.run.smithi190.stdout: "dentry_count": 0, 2023-11-28T18:37:57.222 INFO:teuthology.orchestra.run.smithi190.stdout: "dentry_pinned_count": 0, 2023-11-28T18:37:57.222 INFO:teuthology.orchestra.run.smithi190.stdout: "id": 4616, 2023-11-28T18:37:57.222 INFO:teuthology.orchestra.run.smithi190.stdout: "inst": { 2023-11-28T18:37:57.222 INFO:teuthology.orchestra.run.smithi190.stdout: "name": { 2023-11-28T18:37:57.222 INFO:teuthology.orchestra.run.smithi190.stdout: "type": "client", 2023-11-28T18:37:57.222 INFO:teuthology.orchestra.run.smithi190.stdout: "num": 4616 2023-11-28T18:37:57.222 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-11-28T18:37:57.222 INFO:teuthology.orchestra.run.smithi190.stdout: "addr": { 2023-11-28T18:37:57.223 INFO:teuthology.orchestra.run.smithi190.stdout: "type": "v1", 2023-11-28T18:37:57.223 INFO:teuthology.orchestra.run.smithi190.stdout: "addr": "192.168.0.2:0", 2023-11-28T18:37:57.223 INFO:teuthology.orchestra.run.smithi190.stdout: "nonce": 2977784113 2023-11-28T18:37:57.223 INFO:teuthology.orchestra.run.smithi190.stdout: } 2023-11-28T18:37:57.223 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-11-28T18:37:57.223 INFO:teuthology.orchestra.run.smithi190.stdout: "addr": { 2023-11-28T18:37:57.223 INFO:teuthology.orchestra.run.smithi190.stdout: "type": "v1", 2023-11-28T18:37:57.223 INFO:teuthology.orchestra.run.smithi190.stdout: "addr": "192.168.0.2:0", 2023-11-28T18:37:57.223 INFO:teuthology.orchestra.run.smithi190.stdout: "nonce": 2977784113 2023-11-28T18:37:57.223 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2023-11-28T18:37:57.223 INFO:teuthology.orchestra.run.smithi190.stdout: "inst_str": "client.4616 192.168.0.2:0/2977784113", 2023-11-28T18:37:57.223 INFO:teuthology.orchestra.run.smithi190.stdout: "addr_str": "192.168.0.2:0/2977784113", 2023-11-28T18:37:57.224 INFO:teuthology.orchestra.run.smithi190.stdout: "inode_count": 1, 2023-11-28T18:37:57.224 INFO:teuthology.orchestra.run.smithi190.stdout: "mds_epoch": 8, 2023-11-28T18:37:57.224 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_epoch": 20, 2023-11-28T18:37:57.224 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_epoch_barrier": 0, 2023-11-28T18:37:57.224 INFO:teuthology.orchestra.run.smithi190.stdout: "blocklisted": false, 2023-11-28T18:37:57.224 INFO:teuthology.orchestra.run.smithi190.stdout: "fs_name": "cephfs" 2023-11-28T18:37:57.224 INFO:teuthology.orchestra.run.smithi190.stdout:} 2023-11-28T18:37:57.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:37:57.236 DEBUG:teuthology.orchestra.run.smithi045:> stat --file-system '--printf=%T 2023-11-28T18:37:57.236 DEBUG:teuthology.orchestra.run.smithi045:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-28T18:37:57.248 INFO:teuthology.orchestra.run.smithi045.stdout:fuseblk 2023-11-28T18:37:57.248 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-28T18:37:57.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:37:57.249 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-28T18:37:57.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:37:57.321 DEBUG:teuthology.orchestra.run.smithi045:> stat --file-system '--printf=%T 2023-11-28T18:37:57.321 DEBUG:teuthology.orchestra.run.smithi045:> ' -- /home/ubuntu/cephtest/mnt.2 2023-11-28T18:37:57.372 INFO:teuthology.orchestra.run.smithi045.stdout:fuseblk 2023-11-28T18:37:57.372 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-11-28T18:37:57.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:37:57.372 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-11-28T18:37:57.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:37:57.441 DEBUG:teuthology.orchestra.run.smithi190:> stat --file-system '--printf=%T 2023-11-28T18:37:57.441 DEBUG:teuthology.orchestra.run.smithi190:> ' -- /home/ubuntu/cephtest/mnt.1 2023-11-28T18:37:57.450 INFO:teuthology.orchestra.run.smithi190.stdout:fuseblk 2023-11-28T18:37:57.451 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-11-28T18:37:57.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:37:57.451 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-28T18:37:57.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:37:57.513 DEBUG:teuthology.orchestra.run.smithi190:> stat --file-system '--printf=%T 2023-11-28T18:37:57.513 DEBUG:teuthology.orchestra.run.smithi190:> ' -- /home/ubuntu/cephtest/mnt.3 2023-11-28T18:37:57.569 INFO:teuthology.orchestra.run.smithi190.stdout:fuseblk 2023-11-28T18:37:57.570 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2023-11-28T18:37:57.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:37:57.570 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-11-28T18:37:57.632 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-11-28T18:37:57.649 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T18:37:57.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.794+0000 7f1faa5f5640 1 Processor -- start 2023-11-28T18:37:57.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.798+0000 7f1faa5f5640 1 -- start start 2023-11-28T18:37:57.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.798+0000 7f1faa5f5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1fa413cf70 0x7f1fa406c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:57.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.798+0000 7f1faa5f5640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f1fa415ad80 0x7f1fa40cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:57.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.798+0000 7f1faa5f5640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fa415b1b0 con 0x7f1fa406c840 2023-11-28T18:37:57.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.798+0000 7f1faa5f5640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fa413d350 con 0x7f1fa413cf70 2023-11-28T18:37:57.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.798+0000 7f1faa5f5640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fa4140520 con 0x7f1fa415ad80 2023-11-28T18:37:57.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.798+0000 7f1fa3fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1fa413cf70 0x7f1fa406c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:57.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.798+0000 7f1fa3fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1fa413cf70 0x7f1fa406c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39034/0 (socket says 172.21.15.45:39034) 2023-11-28T18:37:57.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.798+0000 7f1fa3fff640 1 -- 172.21.15.45:0/2291853064 learned_addr learned my addr 172.21.15.45:0/2291853064 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:57.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.798+0000 7f1fa37fe640 1 --1- 172.21.15.45:0/2291853064 >> v1:172.21.15.45:6789/0 conn(0x7f1fa406c840 0x7f1fa415a670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51110/0 (socket says 172.21.15.45:51110) 2023-11-28T18:37:57.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.798+0000 7f1fa8b92640 1 --2- 172.21.15.45:0/2291853064 >> v2:172.21.15.190:3300/0 conn(0x7f1fa415ad80 0x7f1fa40cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:57.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.798+0000 7f1fa3fff640 1 -- 172.21.15.45:0/2291853064 >> v2:172.21.15.190:3300/0 conn(0x7f1fa415ad80 msgr2=0x7f1fa40cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:57.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.798+0000 7f1fa3fff640 1 --2- 172.21.15.45:0/2291853064 >> v2:172.21.15.190:3300/0 conn(0x7f1fa415ad80 0x7f1fa40cd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:57.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.798+0000 7f1fa3fff640 1 -- 172.21.15.45:0/2291853064 >> v1:172.21.15.45:6789/0 conn(0x7f1fa406c840 legacy=0x7f1fa415a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:57.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.798+0000 7f1fa3fff640 1 -- 172.21.15.45:0/2291853064 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa415b3e0 con 0x7f1fa413cf70 2023-11-28T18:37:57.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.798+0000 7f1fa2ffd640 1 -- 172.21.15.45:0/2291853064 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1577049 0 0) 0x7f1fa415b1b0 con 0x7f1fa406c840 2023-11-28T18:37:57.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.802+0000 7f1fa3fff640 1 --2- 172.21.15.45:0/2291853064 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fa413cf70 0x7f1fa406c300 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1fa406e990 tx=0x7f1f9401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a64d80f9bb6af4b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:57.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.802+0000 7f1fa2ffd640 1 -- 172.21.15.45:0/2291853064 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f940ad660 con 0x7f1fa413cf70 2023-11-28T18:37:57.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.802+0000 7f1fa2ffd640 1 -- 172.21.15.45:0/2291853064 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f940ad7c0 con 0x7f1fa413cf70 2023-11-28T18:37:57.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.802+0000 7f1fa2ffd640 1 -- 172.21.15.45:0/2291853064 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f940adb50 con 0x7f1fa413cf70 2023-11-28T18:37:57.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.802+0000 7f1faa5f5640 1 -- 172.21.15.45:0/2291853064 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fa413cf70 msgr2=0x7f1fa406c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:57.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.802+0000 7f1faa5f5640 1 --2- 172.21.15.45:0/2291853064 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fa413cf70 0x7f1fa406c300 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1fa406e990 tx=0x7f1f9401c470 comp rx=0 tx=0).stop 2023-11-28T18:37:57.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.802+0000 7f1faa5f5640 1 -- 172.21.15.45:0/2291853064 shutdown_connections 2023-11-28T18:37:57.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.802+0000 7f1faa5f5640 1 --2- 172.21.15.45:0/2291853064 >> v2:172.21.15.190:3300/0 conn(0x7f1fa415ad80 0x7f1fa40cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:57.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.802+0000 7f1faa5f5640 1 --2- 172.21.15.45:0/2291853064 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fa413cf70 0x7f1fa406c300 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:57.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.802+0000 7f1faa5f5640 1 -- 172.21.15.45:0/2291853064 >> 172.21.15.45:0/2291853064 conn(0x7f1fa406a570 msgr2=0x7f1fa406a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:57.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.802+0000 7f1faa5f5640 1 -- 172.21.15.45:0/2291853064 shutdown_connections 2023-11-28T18:37:57.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.802+0000 7f1faa5f5640 1 -- 172.21.15.45:0/2291853064 wait complete. 2023-11-28T18:37:57.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.802+0000 7f1faa5f5640 1 Processor -- start 2023-11-28T18:37:57.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.802+0000 7f1faa5f5640 1 -- start start 2023-11-28T18:37:57.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.806+0000 7f1faa5f5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fa406c840 0x7f1fa415b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:57.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.806+0000 7f1faa5f5640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1fa413cf70 0x7f1fa414f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:57.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.806+0000 7f1faa5f5640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1fa415ad80 0x7f1fa414f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:57.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.806+0000 7f1faa5f5640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa415cbd0 con 0x7f1fa406c840 2023-11-28T18:37:57.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.806+0000 7f1faa5f5640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa415cff0 con 0x7f1fa415ad80 2023-11-28T18:37:57.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.806+0000 7f1faa5f5640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa415bf50 con 0x7f1fa413cf70 2023-11-28T18:37:57.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.806+0000 7f1fa3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fa406c840 0x7f1fa415b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:57.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.806+0000 7f1fa3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fa406c840 0x7f1fa415b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39046/0 (socket says 172.21.15.45:39046) 2023-11-28T18:37:57.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.806+0000 7f1fa3fff640 1 -- 172.21.15.45:0/721948494 learned_addr learned my addr 172.21.15.45:0/721948494 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:57.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.806+0000 7f1fa37fe640 1 --2- 172.21.15.45:0/721948494 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1fa413cf70 0x7f1fa414f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:57.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.806+0000 7f1fa3fff640 1 -- 172.21.15.45:0/721948494 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1fa413cf70 msgr2=0x7f1fa414f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:57.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.806+0000 7f1fa3fff640 1 --2- 172.21.15.45:0/721948494 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1fa413cf70 0x7f1fa414f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:57.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.806+0000 7f1fa8b92640 1 --2- 172.21.15.45:0/721948494 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1fa415ad80 0x7f1fa414f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:57.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.806+0000 7f1fa3fff640 1 -- 172.21.15.45:0/721948494 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1fa415ad80 msgr2=0x7f1fa414f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:57.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.806+0000 7f1fa3fff640 1 --2- 172.21.15.45:0/721948494 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1fa415ad80 0x7f1fa414f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:57.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.806+0000 7f1fa3fff640 1 -- 172.21.15.45:0/721948494 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f940094d0 con 0x7f1fa406c840 2023-11-28T18:37:57.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.806+0000 7f1fa37fe640 1 --2- 172.21.15.45:0/721948494 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1fa413cf70 0x7f1fa414f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:37:57.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.806+0000 7f1fa8b92640 1 --2- 172.21.15.45:0/721948494 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1fa415ad80 0x7f1fa414f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:37:57.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.806+0000 7f1fa3fff640 1 --2- 172.21.15.45:0/721948494 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fa406c840 0x7f1fa415b5e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1f94019080 tx=0x7f1f94019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:57.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.806+0000 7f1fa0ff9640 1 -- 172.21.15.45:0/721948494 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f940b6640 con 0x7f1fa406c840 2023-11-28T18:37:57.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.806+0000 7f1fa0ff9640 1 -- 172.21.15.45:0/721948494 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f940b67a0 con 0x7f1fa406c840 2023-11-28T18:37:57.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.806+0000 7f1fa0ff9640 1 -- 172.21.15.45:0/721948494 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f940b6b50 con 0x7f1fa406c840 2023-11-28T18:37:57.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.806+0000 7f1faa5f5640 1 -- 172.21.15.45:0/721948494 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fa415c230 con 0x7f1fa406c840 2023-11-28T18:37:57.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.806+0000 7f1faa5f5640 1 -- 172.21.15.45:0/721948494 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fa415c7f0 con 0x7f1fa406c840 2023-11-28T18:37:57.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.806+0000 7f1faa5f5640 1 -- 172.21.15.45:0/721948494 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fa415cd10 con 0x7f1fa406c840 2023-11-28T18:37:57.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.810+0000 7f1fa0ff9640 1 -- 172.21.15.45:0/721948494 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f1f940b4070 con 0x7f1fa406c840 2023-11-28T18:37:57.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.810+0000 7f1fa0ff9640 1 --2- 172.21.15.45:0/721948494 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1f900668d0 0x7f1f90068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:57.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.810+0000 7f1fa0ff9640 1 -- 172.21.15.45:0/721948494 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1f9411e6f0 con 0x7f1fa406c840 2023-11-28T18:37:57.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.810+0000 7f1fa37fe640 1 --2- 172.21.15.45:0/721948494 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1f900668d0 0x7f1f90068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:57.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.810+0000 7f1fa37fe640 1 --2- 172.21.15.45:0/721948494 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1f900668d0 0x7f1f90068d90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1fa41503f0 tx=0x7f1f98009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:57.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.814+0000 7f1fa0ff9640 1 -- 172.21.15.45:0/721948494 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1fa415cd10 con 0x7f1fa406c840 2023-11-28T18:37:57.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.970+0000 7f1faa5f5640 1 -- 172.21.15.45:0/721948494 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1fa415cd10 con 0x7f1fa406c840 2023-11-28T18:37:57.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.970+0000 7f1fa0ff9640 1 -- 172.21.15.45:0/721948494 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16469 (secure 0 0 0) 0x7f1fa415cd10 con 0x7f1fa406c840 2023-11-28T18:37:57.978 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:37:57.978 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":20,"fsid":"d10f5cd6-1d00-4019-99b6-6fa435498a15","created":"2023-11-28T18:37:08.189030+0000","modified":"2023-11-28T18:37:33.971141+0000","last_up_change":"2023-11-28T18:37:20.196124+0000","last_in_change":"2023-11-28T18:37:10.742043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T18:37:21.293917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T18:37:31.384760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T18:37:31.834769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"84465384-103c-4f2c-a45a-96f5bb9c835f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6809","nonce":555237322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6811","nonce":555237322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6815","nonce":555237322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6813","nonce":555237322}]},"public_addr":"172.21.15.45:6809/555237322","cluster_addr":"172.21.15.45:6811/555237322","heartbeat_back_addr":"172.21.15.45:6815/555237322","heartbeat_front_addr":"172.21.15.45:6813/555237322","state":["exists","up"]},{"osd":1,"uuid":"7d9eed24-a58f-42c7-a787-ac06be8553fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6801","nonce":2857063763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6803","nonce":2857063763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6807","nonce":2857063763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6805","nonce":2857063763}]},"public_addr":"172.21.15.45:6801/2857063763","cluster_addr":"172.21.15.45:6803/2857063763","heartbeat_back_addr":"172.21.15.45:6807/2857063763","heartbeat_front_addr":"172.21.15.45:6805/2857063763","state":["exists","up"]},{"osd":2,"uuid":"575eeccc-4abf-45b4-9caf-f3e797859588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6817","nonce":193884539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6819","nonce":193884539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6823","nonce":193884539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6821","nonce":193884539}]},"public_addr":"172.21.15.45:6817/193884539","cluster_addr":"172.21.15.45:6819/193884539","heartbeat_back_addr":"172.21.15.45:6823/193884539","heartbeat_front_addr":"172.21.15.45:6821/193884539","state":["exists","up"]},{"osd":3,"uuid":"9b0290d6-9a52-4bc8-b2a1-7622c5dc8e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6825","nonce":78541084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6827","nonce":78541084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6831","nonce":78541084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6829","nonce":78541084}]},"public_addr":"172.21.15.45:6825/78541084","cluster_addr":"172.21.15.45:6827/78541084","heartbeat_back_addr":"172.21.15.45:6831/78541084","heartbeat_front_addr":"172.21.15.45:6829/78541084","state":["exists","up"]},{"osd":4,"uuid":"ce632829-f027-4fbf-a627-02c571aa9d53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6809","nonce":1537591987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6811","nonce":1537591987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6815","nonce":1537591987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6813","nonce":1537591987}]},"public_addr":"172.21.15.190:6809/1537591987","cluster_addr":"172.21.15.190:6811/1537591987","heartbeat_back_addr":"172.21.15.190:6815/1537591987","heartbeat_front_addr":"172.21.15.190:6813/1537591987","state":["exists","up"]},{"osd":5,"uuid":"8700b609-27be-40bd-a251-4c0ae0a29ead","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6801","nonce":3296698407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6803","nonce":3296698407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6807","nonce":3296698407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6805","nonce":3296698407}]},"public_addr":"172.21.15.190:6801/3296698407","cluster_addr":"172.21.15.190:6803/3296698407","heartbeat_back_addr":"172.21.15.190:6807/3296698407","heartbeat_front_addr":"172.21.15.190:6805/3296698407","state":["exists","up"]},{"osd":6,"uuid":"44ce4a40-e6ff-4f4d-8e8a-7341e5c91f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6817","nonce":2317686718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6819","nonce":2317686718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6823","nonce":2317686718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6821","nonce":2317686718}]},"public_addr":"172.21.15.190:6817/2317686718","cluster_addr":"172.21.15.190:6819/2317686718","heartbeat_back_addr":"172.21.15.190:6823/2317686718","heartbeat_front_addr":"172.21.15.190:6821/2317686718","state":["exists","up"]},{"osd":7,"uuid":"192238c9-1423-4b7e-ac8f-84ba32113ddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6825","nonce":2493232051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6827","nonce":2493232051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6831","nonce":2493232051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6829","nonce":2493232051}]},"public_addr":"172.21.15.190:6825/2493232051","cluster_addr":"172.21.15.190:6827/2493232051","heartbeat_back_addr":"172.21.15.190:6831/2493232051","heartbeat_front_addr":"172.21.15.190:6829/2493232051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.393552+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.385453+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.361421+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.366408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.363226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.276007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.414605+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.445885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T18:37:57.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.974+0000 7f1faa5f5640 1 -- 172.21.15.45:0/721948494 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1f900668d0 msgr2=0x7f1f90068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:57.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.974+0000 7f1faa5f5640 1 --2- 172.21.15.45:0/721948494 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1f900668d0 0x7f1f90068d90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1fa41503f0 tx=0x7f1f98009040 comp rx=0 tx=0).stop 2023-11-28T18:37:57.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.974+0000 7f1faa5f5640 1 -- 172.21.15.45:0/721948494 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fa406c840 msgr2=0x7f1fa415b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:57.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.974+0000 7f1faa5f5640 1 --2- 172.21.15.45:0/721948494 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fa406c840 0x7f1fa415b5e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1f94019080 tx=0x7f1f94019210 comp rx=0 tx=0).stop 2023-11-28T18:37:57.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.974+0000 7f1faa5f5640 1 -- 172.21.15.45:0/721948494 shutdown_connections 2023-11-28T18:37:57.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.974+0000 7f1faa5f5640 1 --2- 172.21.15.45:0/721948494 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1f900668d0 0x7f1f90068d90 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:57.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.974+0000 7f1faa5f5640 1 --2- 172.21.15.45:0/721948494 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1fa415ad80 0x7f1fa414f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:57.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.974+0000 7f1faa5f5640 1 --2- 172.21.15.45:0/721948494 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1fa413cf70 0x7f1fa414f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:57.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.974+0000 7f1faa5f5640 1 --2- 172.21.15.45:0/721948494 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fa406c840 0x7f1fa415b5e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:57.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.974+0000 7f1faa5f5640 1 -- 172.21.15.45:0/721948494 >> 172.21.15.45:0/721948494 conn(0x7f1fa406a570 msgr2=0x7f1fa4071700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:57.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.974+0000 7f1faa5f5640 1 -- 172.21.15.45:0/721948494 shutdown_connections 2023-11-28T18:37:57.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:57.974+0000 7f1faa5f5640 1 -- 172.21.15.45:0/721948494 wait complete. 2023-11-28T18:37:58.000 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T18:37:21.293917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T18:37:31.384760+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T18:37:31.834769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T18:37:58.000 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T18:37:58.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.142+0000 7ff5eaf9d640 1 Processor -- start 2023-11-28T18:37:58.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.142+0000 7ff5eaf9d640 1 -- start start 2023-11-28T18:37:58.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.142+0000 7ff5eaf9d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff5e40d1540 0x7ff5e4141080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:58.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.142+0000 7ff5eaf9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff5e40ce160 0x7ff5e415ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:58.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.142+0000 7ff5eaf9d640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5e41415c0 con 0x7ff5e40b41c0 2023-11-28T18:37:58.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.142+0000 7ff5eaf9d640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5e415c500 con 0x7ff5e40ce160 2023-11-28T18:37:58.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.142+0000 7ff5eaf9d640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5e415b5c0 con 0x7ff5e40d1540 2023-11-28T18:37:58.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.142+0000 7ff5e953a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff5e40ce160 0x7ff5e415ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:58.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.142+0000 7ff5e3fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff5e40b41c0 0x7ff5e40cda50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33632/0 (socket says 172.21.15.45:33632) 2023-11-28T18:37:58.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.142+0000 7ff5e953a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff5e40ce160 0x7ff5e415ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53136/0 (socket says 172.21.15.45:53136) 2023-11-28T18:37:58.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.142+0000 7ff5e3fff640 1 -- 172.21.15.45:0/1163932726 learned_addr learned my addr 172.21.15.45:0/1163932726 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:37:58.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.142+0000 7ff5e8d39640 1 --2- 172.21.15.45:0/1163932726 >> v2:172.21.15.190:3300/0 conn(0x7ff5e40d1540 0x7ff5e4141080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:58.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.142+0000 7ff5e953a640 1 -- 172.21.15.45:0/1163932726 >> v2:172.21.15.190:3300/0 conn(0x7ff5e40d1540 msgr2=0x7ff5e4141080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:58.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.142+0000 7ff5e953a640 1 --2- 172.21.15.45:0/1163932726 >> v2:172.21.15.190:3300/0 conn(0x7ff5e40d1540 0x7ff5e4141080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:58.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.142+0000 7ff5e953a640 1 -- 172.21.15.45:0/1163932726 >> v1:172.21.15.45:6789/0 conn(0x7ff5e40b41c0 legacy=0x7ff5e40cda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:58.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.142+0000 7ff5e953a640 1 -- 172.21.15.45:0/1163932726 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e415b880 con 0x7ff5e40ce160 2023-11-28T18:37:58.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.142+0000 7ff5e37fe640 1 -- 172.21.15.45:0/1163932726 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 746075524 0 0) 0x7ff5e41415c0 con 0x7ff5e40b41c0 2023-11-28T18:37:58.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.146+0000 7ff5e953a640 1 --2- 172.21.15.45:0/1163932726 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5e40ce160 0x7ff5e415ed60 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff5e4070710 tx=0x7ff5dc01c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb11f46c4346f9f1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:58.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.146+0000 7ff5e37fe640 1 -- 172.21.15.45:0/1163932726 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5dc0a5710 con 0x7ff5e40ce160 2023-11-28T18:37:58.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.146+0000 7ff5e37fe640 1 -- 172.21.15.45:0/1163932726 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5dc0a5870 con 0x7ff5e40ce160 2023-11-28T18:37:58.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.146+0000 7ff5e37fe640 1 -- 172.21.15.45:0/1163932726 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5dc0a5c00 con 0x7ff5e40ce160 2023-11-28T18:37:58.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.146+0000 7ff5eaf9d640 1 -- 172.21.15.45:0/1163932726 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5e40ce160 msgr2=0x7ff5e415ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:58.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.146+0000 7ff5eaf9d640 1 --2- 172.21.15.45:0/1163932726 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5e40ce160 0x7ff5e415ed60 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff5e4070710 tx=0x7ff5dc01c850 comp rx=0 tx=0).stop 2023-11-28T18:37:58.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.146+0000 7ff5eaf9d640 1 -- 172.21.15.45:0/1163932726 shutdown_connections 2023-11-28T18:37:58.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.146+0000 7ff5eaf9d640 1 --2- 172.21.15.45:0/1163932726 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5e40ce160 0x7ff5e415ed60 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:58.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.146+0000 7ff5eaf9d640 1 --2- 172.21.15.45:0/1163932726 >> v2:172.21.15.190:3300/0 conn(0x7ff5e40d1540 0x7ff5e4141080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:58.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.146+0000 7ff5eaf9d640 1 -- 172.21.15.45:0/1163932726 >> 172.21.15.45:0/1163932726 conn(0x7ff5e4070b80 msgr2=0x7ff5e4066360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:58.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.146+0000 7ff5eaf9d640 1 -- 172.21.15.45:0/1163932726 shutdown_connections 2023-11-28T18:37:58.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.146+0000 7ff5eaf9d640 1 -- 172.21.15.45:0/1163932726 wait complete. 2023-11-28T18:37:58.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.150+0000 7ff5eaf9d640 1 Processor -- start 2023-11-28T18:37:58.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.150+0000 7ff5eaf9d640 1 -- start start 2023-11-28T18:37:58.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.150+0000 7ff5eaf9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5e40b41c0 0x7ff5e4151760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:58.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.150+0000 7ff5eaf9d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff5e40ce160 0x7ff5e4153f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:58.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.150+0000 7ff5eaf9d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff5e40d1540 0x7ff5e413b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:58.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.150+0000 7ff5eaf9d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e4151ca0 con 0x7ff5e40b41c0 2023-11-28T18:37:58.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.150+0000 7ff5eaf9d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e41531a0 con 0x7ff5e40ce160 2023-11-28T18:37:58.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.150+0000 7ff5eaf9d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e4153480 con 0x7ff5e40d1540 2023-11-28T18:37:58.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.150+0000 7ff5e8d39640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5e40b41c0 0x7ff5e4151760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:58.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.150+0000 7ff5e8d39640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5e40b41c0 0x7ff5e4151760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53150/0 (socket says 172.21.15.45:53150) 2023-11-28T18:37:58.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.150+0000 7ff5e8d39640 1 -- 172.21.15.45:0/1903787437 learned_addr learned my addr 172.21.15.45:0/1903787437 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:58.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.150+0000 7ff5e3fff640 1 --2- 172.21.15.45:0/1903787437 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff5e40ce160 0x7ff5e4153f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:58.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.150+0000 7ff5e953a640 1 --2- 172.21.15.45:0/1903787437 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff5e40d1540 0x7ff5e413b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:58.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.150+0000 7ff5e8d39640 1 -- 172.21.15.45:0/1903787437 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff5e40d1540 msgr2=0x7ff5e413b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:58.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.150+0000 7ff5e8d39640 1 --2- 172.21.15.45:0/1903787437 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff5e40d1540 0x7ff5e413b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:58.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.150+0000 7ff5e8d39640 1 -- 172.21.15.45:0/1903787437 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff5e40ce160 msgr2=0x7ff5e4153f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:58.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.150+0000 7ff5e8d39640 1 --2- 172.21.15.45:0/1903787437 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff5e40ce160 0x7ff5e4153f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:58.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.150+0000 7ff5e8d39640 1 -- 172.21.15.45:0/1903787437 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5dc009a70 con 0x7ff5e40b41c0 2023-11-28T18:37:58.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.150+0000 7ff5e3fff640 1 --2- 172.21.15.45:0/1903787437 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff5e40ce160 0x7ff5e4153f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:37:58.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.150+0000 7ff5e8d39640 1 --2- 172.21.15.45:0/1903787437 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5e40b41c0 0x7ff5e4151760 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff5d800e930 tx=0x7ff5d800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:58.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.150+0000 7ff5e17fa640 1 -- 172.21.15.45:0/1903787437 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d8009690 con 0x7ff5e40b41c0 2023-11-28T18:37:58.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.150+0000 7ff5e17fa640 1 -- 172.21.15.45:0/1903787437 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5d800ca00 con 0x7ff5e40b41c0 2023-11-28T18:37:58.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.150+0000 7ff5e17fa640 1 -- 172.21.15.45:0/1903787437 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d800cd70 con 0x7ff5e40b41c0 2023-11-28T18:37:58.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.150+0000 7ff5eaf9d640 1 -- 172.21.15.45:0/1903787437 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5e40d1aa0 con 0x7ff5e40b41c0 2023-11-28T18:37:58.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.150+0000 7ff5eaf9d640 1 -- 172.21.15.45:0/1903787437 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5e4153a40 con 0x7ff5e40b41c0 2023-11-28T18:37:58.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.154+0000 7ff5eaf9d640 1 -- 172.21.15.45:0/1903787437 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5e4153c00 con 0x7ff5e40b41c0 2023-11-28T18:37:58.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.154+0000 7ff5e17fa640 1 -- 172.21.15.45:0/1903787437 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ff5d8013470 con 0x7ff5e40b41c0 2023-11-28T18:37:58.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.154+0000 7ff5e17fa640 1 --2- 172.21.15.45:0/1903787437 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff5c80668d0 0x7ff5c8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:58.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.154+0000 7ff5e17fa640 1 -- 172.21.15.45:0/1903787437 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff5d8084710 con 0x7ff5e40b41c0 2023-11-28T18:37:58.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.154+0000 7ff5e3fff640 1 --2- 172.21.15.45:0/1903787437 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff5c80668d0 0x7ff5c8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:58.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.154+0000 7ff5e3fff640 1 --2- 172.21.15.45:0/1903787437 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff5c80668d0 0x7ff5c8068d90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff5e40b2d60 tx=0x7ff5d0007cb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:58.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.158+0000 7ff5e17fa640 1 -- 172.21.15.45:0/1903787437 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff5d8051970 con 0x7ff5e40b41c0 2023-11-28T18:37:58.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.318+0000 7ff5eaf9d640 1 -- 172.21.15.45:0/1903787437 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff5e4069410 con 0x7ff5e40b41c0 2023-11-28T18:37:58.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.318+0000 7ff5e17fa640 1 -- 172.21.15.45:0/1903787437 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff5d8054f90 con 0x7ff5e40b41c0 2023-11-28T18:37:58.325 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-11-28T18:37:58.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.322+0000 7ff5eaf9d640 1 -- 172.21.15.45:0/1903787437 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff5c80668d0 msgr2=0x7ff5c8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:58.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.322+0000 7ff5eaf9d640 1 --2- 172.21.15.45:0/1903787437 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff5c80668d0 0x7ff5c8068d90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff5e40b2d60 tx=0x7ff5d0007cb0 comp rx=0 tx=0).stop 2023-11-28T18:37:58.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.322+0000 7ff5eaf9d640 1 -- 172.21.15.45:0/1903787437 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5e40b41c0 msgr2=0x7ff5e4151760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:58.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.322+0000 7ff5eaf9d640 1 --2- 172.21.15.45:0/1903787437 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5e40b41c0 0x7ff5e4151760 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff5d800e930 tx=0x7ff5d800edf0 comp rx=0 tx=0).stop 2023-11-28T18:37:58.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.322+0000 7ff5eaf9d640 1 -- 172.21.15.45:0/1903787437 shutdown_connections 2023-11-28T18:37:58.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.322+0000 7ff5eaf9d640 1 --2- 172.21.15.45:0/1903787437 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff5c80668d0 0x7ff5c8068d90 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:58.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.322+0000 7ff5eaf9d640 1 --2- 172.21.15.45:0/1903787437 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff5e40d1540 0x7ff5e413b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:58.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.322+0000 7ff5eaf9d640 1 --2- 172.21.15.45:0/1903787437 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff5e40ce160 0x7ff5e4153f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:58.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.322+0000 7ff5eaf9d640 1 --2- 172.21.15.45:0/1903787437 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5e40b41c0 0x7ff5e4151760 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:58.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.322+0000 7ff5eaf9d640 1 -- 172.21.15.45:0/1903787437 >> 172.21.15.45:0/1903787437 conn(0x7ff5e4070b80 msgr2=0x7ff5e40b4680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:58.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.322+0000 7ff5eaf9d640 1 -- 172.21.15.45:0/1903787437 shutdown_connections 2023-11-28T18:37:58.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.322+0000 7ff5eaf9d640 1 -- 172.21.15.45:0/1903787437 wait complete. 2023-11-28T18:37:58.349 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T18:37:58.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.490+0000 7fd949e32640 1 Processor -- start 2023-11-28T18:37:58.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.490+0000 7fd949e32640 1 -- start start 2023-11-28T18:37:58.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.490+0000 7fd949e32640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd9440ce9a0 0x7fd9440ae0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:58.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.490+0000 7fd949e32640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9440af1c0 con 0x7fd94406bc90 2023-11-28T18:37:58.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.490+0000 7fd949e32640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9440ae920 con 0x7fd9440ced80 2023-11-28T18:37:58.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.490+0000 7fd949e32640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9440aec00 con 0x7fd9440ce9a0 2023-11-28T18:37:58.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.490+0000 7fd943fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd94406bc90 0x7fd9440b2d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33634/0 (socket says 172.21.15.45:33634) 2023-11-28T18:37:58.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.490+0000 7fd943fff640 1 -- 172.21.15.45:0/3088191748 learned_addr learned my addr 172.21.15.45:0/3088191748 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:37:58.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.490+0000 7fd9437fe640 1 --2- 172.21.15.45:0/3088191748 >> v2:172.21.15.190:3300/0 conn(0x7fd9440ce9a0 0x7fd9440ae0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:58.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.490+0000 7fd9427fc640 1 -- 172.21.15.45:0/3088191748 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 294389839 0 0) 0x7fd9440af1c0 con 0x7fd94406bc90 2023-11-28T18:37:58.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.490+0000 7fd9427fc640 1 -- 172.21.15.45:0/3088191748 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd92c003530 con 0x7fd94406bc90 2023-11-28T18:37:58.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.490+0000 7fd9427fc640 1 -- 172.21.15.45:0/3088191748 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2735387480 0 0) 0x7fd9440ae920 con 0x7fd9440ced80 2023-11-28T18:37:58.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.490+0000 7fd9427fc640 1 -- 172.21.15.45:0/3088191748 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9440af1c0 con 0x7fd9440ced80 2023-11-28T18:37:58.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.490+0000 7fd9427fc640 1 -- 172.21.15.45:0/3088191748 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3097395367 0 0) 0x7fd92c003530 con 0x7fd94406bc90 2023-11-28T18:37:58.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.490+0000 7fd9437fe640 1 -- 172.21.15.45:0/3088191748 >> v1:172.21.15.190:6789/0 conn(0x7fd9440ced80 legacy=0x7fd94406b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:58.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.490+0000 7fd9437fe640 1 -- 172.21.15.45:0/3088191748 >> v1:172.21.15.45:6789/0 conn(0x7fd94406bc90 legacy=0x7fd9440b2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:58.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.490+0000 7fd9437fe640 1 -- 172.21.15.45:0/3088191748 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9440aeee0 con 0x7fd9440ce9a0 2023-11-28T18:37:58.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.494+0000 7fd9437fe640 1 --2- 172.21.15.45:0/3088191748 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd9440ce9a0 0x7fd9440ae0a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd9340097c0 tx=0x7fd93401c250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd6a32cdb8b53b18 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:58.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.494+0000 7fd9427fc640 1 -- 172.21.15.45:0/3088191748 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd93c001a00 con 0x7fd9440ce9a0 2023-11-28T18:37:58.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.494+0000 7fd9427fc640 1 -- 172.21.15.45:0/3088191748 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9340a7050 con 0x7fd9440ce9a0 2023-11-28T18:37:58.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.494+0000 7fd9427fc640 1 -- 172.21.15.45:0/3088191748 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9340ab620 con 0x7fd9440ce9a0 2023-11-28T18:37:58.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.494+0000 7fd949e32640 1 -- 172.21.15.45:0/3088191748 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd9440ce9a0 msgr2=0x7fd9440ae0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:58.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.494+0000 7fd949e32640 1 --2- 172.21.15.45:0/3088191748 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd9440ce9a0 0x7fd9440ae0a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd9340097c0 tx=0x7fd93401c250 comp rx=0 tx=0).stop 2023-11-28T18:37:58.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.494+0000 7fd949e32640 1 -- 172.21.15.45:0/3088191748 shutdown_connections 2023-11-28T18:37:58.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.494+0000 7fd949e32640 1 --2- 172.21.15.45:0/3088191748 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd9440ce9a0 0x7fd9440ae0a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:58.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.494+0000 7fd949e32640 1 -- 172.21.15.45:0/3088191748 >> 172.21.15.45:0/3088191748 conn(0x7fd9440b1b70 msgr2=0x7fd944070cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:58.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.494+0000 7fd949e32640 1 -- 172.21.15.45:0/3088191748 shutdown_connections 2023-11-28T18:37:58.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.494+0000 7fd949e32640 1 -- 172.21.15.45:0/3088191748 wait complete. 2023-11-28T18:37:58.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.498+0000 7fd949e32640 1 Processor -- start 2023-11-28T18:37:58.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.498+0000 7fd949e32640 1 -- start start 2023-11-28T18:37:58.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.498+0000 7fd949e32640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd94406bc90 0x7fd94413be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:58.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.498+0000 7fd949e32640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9440ce9a0 0x7fd9441f6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:58.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.498+0000 7fd949e32640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd9440ced80 0x7fd9440afb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:58.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.498+0000 7fd949e32640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd944156850 con 0x7fd9440ce9a0 2023-11-28T18:37:58.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.498+0000 7fd949e32640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd944155c40 con 0x7fd9440ced80 2023-11-28T18:37:58.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.498+0000 7fd949e32640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd944155f20 con 0x7fd94406bc90 2023-11-28T18:37:58.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.498+0000 7fd942ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9440ce9a0 0x7fd9441f6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:58.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.498+0000 7fd942ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9440ce9a0 0x7fd9441f6390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53166/0 (socket says 172.21.15.45:53166) 2023-11-28T18:37:58.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.498+0000 7fd942ffd640 1 -- 172.21.15.45:0/3698560709 learned_addr learned my addr 172.21.15.45:0/3698560709 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:58.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.498+0000 7fd9437fe640 1 --2- 172.21.15.45:0/3698560709 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd94406bc90 0x7fd94413be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:58.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.498+0000 7fd943fff640 1 --2- 172.21.15.45:0/3698560709 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd9440ced80 0x7fd9440afb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:58.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.498+0000 7fd942ffd640 1 -- 172.21.15.45:0/3698560709 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd94406bc90 msgr2=0x7fd94413be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:58.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.498+0000 7fd942ffd640 1 --2- 172.21.15.45:0/3698560709 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd94406bc90 0x7fd94413be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:58.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.498+0000 7fd942ffd640 1 -- 172.21.15.45:0/3698560709 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd9440ced80 msgr2=0x7fd9440afb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:58.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.498+0000 7fd942ffd640 1 --2- 172.21.15.45:0/3698560709 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd9440ced80 0x7fd9440afb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:58.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.498+0000 7fd942ffd640 1 -- 172.21.15.45:0/3698560709 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd934009420 con 0x7fd9440ce9a0 2023-11-28T18:37:58.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.498+0000 7fd943fff640 1 --2- 172.21.15.45:0/3698560709 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd9440ced80 0x7fd9440afb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:37:58.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.498+0000 7fd942ffd640 1 --2- 172.21.15.45:0/3698560709 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9440ce9a0 0x7fd9441f6390 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd93800c490 tx=0x7fd93800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:58.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.498+0000 7fd92bfff640 1 -- 172.21.15.45:0/3698560709 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9380052d0 con 0x7fd9440ce9a0 2023-11-28T18:37:58.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.498+0000 7fd92bfff640 1 -- 172.21.15.45:0/3698560709 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd938005430 con 0x7fd9440ce9a0 2023-11-28T18:37:58.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.498+0000 7fd92bfff640 1 -- 172.21.15.45:0/3698560709 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd938012870 con 0x7fd9440ce9a0 2023-11-28T18:37:58.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.498+0000 7fd949e32640 1 -- 172.21.15.45:0/3698560709 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd944156200 con 0x7fd9440ce9a0 2023-11-28T18:37:58.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.498+0000 7fd949e32640 1 -- 172.21.15.45:0/3698560709 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd94413c3d0 con 0x7fd9440ce9a0 2023-11-28T18:37:58.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.502+0000 7fd949e32640 1 -- 172.21.15.45:0/3698560709 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9441569c0 con 0x7fd9440ce9a0 2023-11-28T18:37:58.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.502+0000 7fd92bfff640 1 -- 172.21.15.45:0/3698560709 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fd9380129d0 con 0x7fd9440ce9a0 2023-11-28T18:37:58.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.502+0000 7fd92bfff640 1 --2- 172.21.15.45:0/3698560709 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fd9300668d0 0x7fd930068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:58.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.502+0000 7fd92bfff640 1 -- 172.21.15.45:0/3698560709 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd938083f20 con 0x7fd9440ce9a0 2023-11-28T18:37:58.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.502+0000 7fd9437fe640 1 --2- 172.21.15.45:0/3698560709 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fd9300668d0 0x7fd930068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:58.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.502+0000 7fd9437fe640 1 --2- 172.21.15.45:0/3698560709 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fd9300668d0 0x7fd930068d90 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd9340ad000 tx=0x7fd9340a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:58.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.506+0000 7fd92bfff640 1 -- 172.21.15.45:0/3698560709 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd938051170 con 0x7fd9440ce9a0 2023-11-28T18:37:58.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.666+0000 7fd949e32640 1 -- 172.21.15.45:0/3698560709 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd944069410 con 0x7fd9440ce9a0 2023-11-28T18:37:58.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.666+0000 7fd92bfff640 1 -- 172.21.15.45:0/3698560709 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd938054790 con 0x7fd9440ce9a0 2023-11-28T18:37:58.672 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-11-28T18:37:58.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.666+0000 7fd949e32640 1 -- 172.21.15.45:0/3698560709 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fd9300668d0 msgr2=0x7fd930068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:58.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.666+0000 7fd949e32640 1 --2- 172.21.15.45:0/3698560709 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fd9300668d0 0x7fd930068d90 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd9340ad000 tx=0x7fd9340a6000 comp rx=0 tx=0).stop 2023-11-28T18:37:58.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.666+0000 7fd949e32640 1 -- 172.21.15.45:0/3698560709 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9440ce9a0 msgr2=0x7fd9441f6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:58.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.666+0000 7fd949e32640 1 --2- 172.21.15.45:0/3698560709 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9440ce9a0 0x7fd9441f6390 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd93800c490 tx=0x7fd93800c950 comp rx=0 tx=0).stop 2023-11-28T18:37:58.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.670+0000 7fd949e32640 1 -- 172.21.15.45:0/3698560709 shutdown_connections 2023-11-28T18:37:58.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.670+0000 7fd949e32640 1 --2- 172.21.15.45:0/3698560709 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fd9300668d0 0x7fd930068d90 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:58.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.670+0000 7fd949e32640 1 --2- 172.21.15.45:0/3698560709 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd9440ced80 0x7fd9440afb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:58.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.670+0000 7fd949e32640 1 --2- 172.21.15.45:0/3698560709 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9440ce9a0 0x7fd9441f6390 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:58.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.670+0000 7fd949e32640 1 --2- 172.21.15.45:0/3698560709 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd94406bc90 0x7fd94413be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:58.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.670+0000 7fd949e32640 1 -- 172.21.15.45:0/3698560709 >> 172.21.15.45:0/3698560709 conn(0x7fd9440b1b70 msgr2=0x7fd94414fe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:58.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.670+0000 7fd949e32640 1 -- 172.21.15.45:0/3698560709 shutdown_connections 2023-11-28T18:37:58.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.670+0000 7fd949e32640 1 -- 172.21.15.45:0/3698560709 wait complete. 2023-11-28T18:37:58.693 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T18:37:58.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.830+0000 7fd00626b640 1 Processor -- start 2023-11-28T18:37:58.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.834+0000 7fd00626b640 1 -- start start 2023-11-28T18:37:58.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.834+0000 7fd00626b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd0001469a0 0x7fd00006cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:58.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.834+0000 7fd00626b640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd00015fde0 0x7fd0000b44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:58.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.834+0000 7fd00626b640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0000b4a10 con 0x7fd0000b4070 2023-11-28T18:37:58.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.834+0000 7fd00626b640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd00015e940 con 0x7fd00015fde0 2023-11-28T18:37:58.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.834+0000 7fd00626b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd00015dd30 con 0x7fd0001469a0 2023-11-28T18:37:58.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.834+0000 7fcfff7fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd0000b4070 0x7fd00006e8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33648/0 (socket says 172.21.15.45:33648) 2023-11-28T18:37:58.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.834+0000 7fcfff7fe640 1 -- 172.21.15.45:0/2005093568 learned_addr learned my addr 172.21.15.45:0/2005093568 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:37:58.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.834+0000 7fd004808640 1 --2- 172.21.15.45:0/2005093568 >> v2:172.21.15.190:3300/0 conn(0x7fd00015fde0 0x7fd0000b44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:58.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.834+0000 7fcffffff640 1 --2- 172.21.15.45:0/2005093568 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd0001469a0 0x7fd00006cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:58.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.834+0000 7fcffeffd640 1 -- 172.21.15.45:0/2005093568 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1337290079 0 0) 0x7fd0000b4a10 con 0x7fd0000b4070 2023-11-28T18:37:58.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.834+0000 7fcffeffd640 1 -- 172.21.15.45:0/2005093568 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfe8003530 con 0x7fd0000b4070 2023-11-28T18:37:58.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.834+0000 7fd004808640 1 -- 172.21.15.45:0/2005093568 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd0001469a0 msgr2=0x7fd00006cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:58.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.834+0000 7fd004808640 1 --2- 172.21.15.45:0/2005093568 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd0001469a0 0x7fd00006cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:58.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.834+0000 7fd004808640 1 -- 172.21.15.45:0/2005093568 >> v1:172.21.15.45:6789/0 conn(0x7fd0000b4070 legacy=0x7fd00006e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:58.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.834+0000 7fd004808640 1 -- 172.21.15.45:0/2005093568 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd00015e010 con 0x7fd00015fde0 2023-11-28T18:37:58.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.834+0000 7fcffffff640 1 --2- 172.21.15.45:0/2005093568 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd0001469a0 0x7fd00006cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:37:58.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.838+0000 7fd004808640 1 --2- 172.21.15.45:0/2005093568 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd00015fde0 0x7fd0000b44d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fcff8009d90 tx=0x7fcff801c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35dd9e0d79f152f4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:58.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.838+0000 7fcffeffd640 1 -- 172.21.15.45:0/2005093568 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff80a5820 con 0x7fd00015fde0 2023-11-28T18:37:58.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.838+0000 7fcffeffd640 1 -- 172.21.15.45:0/2005093568 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcff80a5980 con 0x7fd00015fde0 2023-11-28T18:37:58.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.838+0000 7fcffeffd640 1 -- 172.21.15.45:0/2005093568 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff80a5cf0 con 0x7fd00015fde0 2023-11-28T18:37:58.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.838+0000 7fd00626b640 1 -- 172.21.15.45:0/2005093568 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd00015fde0 msgr2=0x7fd0000b44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:58.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.838+0000 7fd00626b640 1 --2- 172.21.15.45:0/2005093568 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd00015fde0 0x7fd0000b44d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fcff8009d90 tx=0x7fcff801c950 comp rx=0 tx=0).stop 2023-11-28T18:37:58.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.838+0000 7fd00626b640 1 -- 172.21.15.45:0/2005093568 shutdown_connections 2023-11-28T18:37:58.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.838+0000 7fd00626b640 1 --2- 172.21.15.45:0/2005093568 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd00015fde0 0x7fd0000b44d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:58.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.838+0000 7fd00626b640 1 --2- 172.21.15.45:0/2005093568 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd0001469a0 0x7fd00006cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:58.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.838+0000 7fd00626b640 1 -- 172.21.15.45:0/2005093568 >> 172.21.15.45:0/2005093568 conn(0x7fd000070b80 msgr2=0x7fd000066360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:58.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.838+0000 7fd00626b640 1 -- 172.21.15.45:0/2005093568 shutdown_connections 2023-11-28T18:37:58.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.838+0000 7fd00626b640 1 -- 172.21.15.45:0/2005093568 wait complete. 2023-11-28T18:37:58.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.842+0000 7fd00626b640 1 Processor -- start 2023-11-28T18:37:58.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.842+0000 7fd00626b640 1 -- start start 2023-11-28T18:37:58.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.842+0000 7fd00626b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd0000b4070 0x7fd000166750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:58.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.842+0000 7fd00626b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0001469a0 0x7fd00015c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:58.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.842+0000 7fd00626b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd00015fde0 0x7fd000145020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:58.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.842+0000 7fd00626b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd00015d170 con 0x7fd0001469a0 2023-11-28T18:37:58.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.842+0000 7fd00626b640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd000166fc0 con 0x7fd00015fde0 2023-11-28T18:37:58.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.842+0000 7fd00626b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd000161e50 con 0x7fd0000b4070 2023-11-28T18:37:58.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.842+0000 7fcfff7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0001469a0 0x7fd00015c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:58.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.842+0000 7fcfff7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0001469a0 0x7fd00015c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53170/0 (socket says 172.21.15.45:53170) 2023-11-28T18:37:58.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.842+0000 7fcfff7fe640 1 -- 172.21.15.45:0/2556775805 learned_addr learned my addr 172.21.15.45:0/2556775805 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:58.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.842+0000 7fd004808640 1 --2- 172.21.15.45:0/2556775805 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd00015fde0 0x7fd000145020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:58.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.842+0000 7fcffffff640 1 --2- 172.21.15.45:0/2556775805 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd0000b4070 0x7fd000166750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:58.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.842+0000 7fcfff7fe640 1 -- 172.21.15.45:0/2556775805 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd0000b4070 msgr2=0x7fd000166750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:58.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.842+0000 7fcfff7fe640 1 --2- 172.21.15.45:0/2556775805 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd0000b4070 0x7fd000166750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:58.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.842+0000 7fcfff7fe640 1 -- 172.21.15.45:0/2556775805 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd00015fde0 msgr2=0x7fd000145020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:58.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.842+0000 7fcfff7fe640 1 --2- 172.21.15.45:0/2556775805 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd00015fde0 0x7fd000145020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:58.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.842+0000 7fcfff7fe640 1 -- 172.21.15.45:0/2556775805 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcff0009420 con 0x7fd0001469a0 2023-11-28T18:37:58.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.842+0000 7fcfff7fe640 1 --2- 172.21.15.45:0/2556775805 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0001469a0 0x7fd00015c090 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fcff400c450 tx=0x7fcff400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:58.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.842+0000 7fcffcff9640 1 -- 172.21.15.45:0/2556775805 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff4005cf0 con 0x7fd0001469a0 2023-11-28T18:37:58.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.842+0000 7fcffcff9640 1 -- 172.21.15.45:0/2556775805 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcff4005e50 con 0x7fd0001469a0 2023-11-28T18:37:58.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.842+0000 7fcffcff9640 1 -- 172.21.15.45:0/2556775805 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff4007290 con 0x7fd0001469a0 2023-11-28T18:37:58.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.842+0000 7fd00626b640 1 -- 172.21.15.45:0/2556775805 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcff8009a70 con 0x7fd0001469a0 2023-11-28T18:37:58.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.842+0000 7fd00626b640 1 -- 172.21.15.45:0/2556775805 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd000162410 con 0x7fd0001469a0 2023-11-28T18:37:58.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.842+0000 7fd00626b640 1 -- 172.21.15.45:0/2556775805 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd000069410 con 0x7fd0001469a0 2023-11-28T18:37:58.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.846+0000 7fcffcff9640 1 -- 172.21.15.45:0/2556775805 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fcff40073f0 con 0x7fd0001469a0 2023-11-28T18:37:58.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.846+0000 7fcffcff9640 1 --2- 172.21.15.45:0/2556775805 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fcfec0668d0 0x7fcfec068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:58.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.846+0000 7fcffcff9640 1 -- 172.21.15.45:0/2556775805 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcff4083a50 con 0x7fd0001469a0 2023-11-28T18:37:58.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.846+0000 7fcffffff640 1 --2- 172.21.15.45:0/2556775805 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fcfec0668d0 0x7fcfec068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:58.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.846+0000 7fcffffff640 1 --2- 172.21.15.45:0/2556775805 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fcfec0668d0 0x7fcfec068d90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd0001fd370 tx=0x7fcff0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:58.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:58.850+0000 7fcffcff9640 1 -- 172.21.15.45:0/2556775805 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcff4050c00 con 0x7fd0001469a0 2023-11-28T18:37:59.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.006+0000 7fd00626b640 1 -- 172.21.15.45:0/2556775805 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd000167440 con 0x7fd0001469a0 2023-11-28T18:37:59.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.006+0000 7fcffcff9640 1 -- 172.21.15.45:0/2556775805 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcff4017020 con 0x7fd0001469a0 2023-11-28T18:37:59.014 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-11-28T18:37:59.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.010+0000 7fd00626b640 1 -- 172.21.15.45:0/2556775805 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fcfec0668d0 msgr2=0x7fcfec068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:59.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.010+0000 7fd00626b640 1 --2- 172.21.15.45:0/2556775805 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fcfec0668d0 0x7fcfec068d90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd0001fd370 tx=0x7fcff0008040 comp rx=0 tx=0).stop 2023-11-28T18:37:59.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.010+0000 7fd00626b640 1 -- 172.21.15.45:0/2556775805 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0001469a0 msgr2=0x7fd00015c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:59.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.010+0000 7fd00626b640 1 --2- 172.21.15.45:0/2556775805 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0001469a0 0x7fd00015c090 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fcff400c450 tx=0x7fcff400c910 comp rx=0 tx=0).stop 2023-11-28T18:37:59.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.010+0000 7fd00626b640 1 -- 172.21.15.45:0/2556775805 shutdown_connections 2023-11-28T18:37:59.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.010+0000 7fd00626b640 1 --2- 172.21.15.45:0/2556775805 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fcfec0668d0 0x7fcfec068d90 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:59.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.010+0000 7fd00626b640 1 --2- 172.21.15.45:0/2556775805 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd00015fde0 0x7fd000145020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:59.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.010+0000 7fd00626b640 1 --2- 172.21.15.45:0/2556775805 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0001469a0 0x7fd00015c090 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:59.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.010+0000 7fd00626b640 1 --2- 172.21.15.45:0/2556775805 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd0000b4070 0x7fd000166750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:59.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.010+0000 7fd00626b640 1 -- 172.21.15.45:0/2556775805 >> 172.21.15.45:0/2556775805 conn(0x7fd000070b80 msgr2=0x7fd000066360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:59.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.010+0000 7fd00626b640 1 -- 172.21.15.45:0/2556775805 shutdown_connections 2023-11-28T18:37:59.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.010+0000 7fd00626b640 1 -- 172.21.15.45:0/2556775805 wait complete. 2023-11-28T18:37:59.035 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T18:37:59.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.174+0000 7efe47209640 1 Processor -- start 2023-11-28T18:37:59.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.174+0000 7efe47209640 1 -- start start 2023-11-28T18:37:59.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.174+0000 7efe47209640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7efe4015d4d0 0x7efe400b62d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:59.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.174+0000 7efe47209640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe400d2230 con 0x7efe400d1500 2023-11-28T18:37:59.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.174+0000 7efe47209640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe400d2780 con 0x7efe400b5220 2023-11-28T18:37:59.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.174+0000 7efe47209640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe400d3120 con 0x7efe4015d4d0 2023-11-28T18:37:59.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.174+0000 7efe457a6640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7efe400d1500 0x7efe400d1950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33650/0 (socket says 172.21.15.45:33650) 2023-11-28T18:37:59.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.174+0000 7efe457a6640 1 -- 172.21.15.45:0/3043851058 learned_addr learned my addr 172.21.15.45:0/3043851058 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:37:59.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.174+0000 7efe3ffff640 1 --2- 172.21.15.45:0/3043851058 >> v2:172.21.15.190:3300/0 conn(0x7efe4015d4d0 0x7efe400b62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:59.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.174+0000 7efe3f7fe640 1 -- 172.21.15.45:0/3043851058 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2712989663 0 0) 0x7efe400d2230 con 0x7efe400d1500 2023-11-28T18:37:59.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.174+0000 7efe3f7fe640 1 -- 172.21.15.45:0/3043851058 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe30003530 con 0x7efe400d1500 2023-11-28T18:37:59.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.174+0000 7efe3ffff640 1 -- 172.21.15.45:0/3043851058 >> v1:172.21.15.190:6789/0 conn(0x7efe400b5220 legacy=0x7efe400b5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:59.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.174+0000 7efe3ffff640 1 -- 172.21.15.45:0/3043851058 >> v1:172.21.15.45:6789/0 conn(0x7efe400d1500 legacy=0x7efe400d1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:59.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.174+0000 7efe3ffff640 1 -- 172.21.15.45:0/3043851058 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe400d2a60 con 0x7efe4015d4d0 2023-11-28T18:37:59.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.178+0000 7efe3ffff640 1 --2- 172.21.15.45:0/3043851058 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efe4015d4d0 0x7efe400b62d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7efe2c0097c0 tx=0x7efe2c01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93fe0429c391157d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:59.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.178+0000 7efe3f7fe640 1 -- 172.21.15.45:0/3043851058 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2c0a8050 con 0x7efe4015d4d0 2023-11-28T18:37:59.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.178+0000 7efe3f7fe640 1 -- 172.21.15.45:0/3043851058 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe2c0ac5f0 con 0x7efe4015d4d0 2023-11-28T18:37:59.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.178+0000 7efe3f7fe640 1 -- 172.21.15.45:0/3043851058 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2c0ac980 con 0x7efe4015d4d0 2023-11-28T18:37:59.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.178+0000 7efe47209640 1 -- 172.21.15.45:0/3043851058 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efe4015d4d0 msgr2=0x7efe400b62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:59.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.178+0000 7efe47209640 1 --2- 172.21.15.45:0/3043851058 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efe4015d4d0 0x7efe400b62d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7efe2c0097c0 tx=0x7efe2c01c480 comp rx=0 tx=0).stop 2023-11-28T18:37:59.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.178+0000 7efe47209640 1 -- 172.21.15.45:0/3043851058 shutdown_connections 2023-11-28T18:37:59.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.178+0000 7efe47209640 1 --2- 172.21.15.45:0/3043851058 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efe4015d4d0 0x7efe400b62d0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:59.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.178+0000 7efe47209640 1 -- 172.21.15.45:0/3043851058 >> 172.21.15.45:0/3043851058 conn(0x7efe400720a0 msgr2=0x7efe400724b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:59.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.178+0000 7efe47209640 1 -- 172.21.15.45:0/3043851058 shutdown_connections 2023-11-28T18:37:59.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.178+0000 7efe47209640 1 -- 172.21.15.45:0/3043851058 wait complete. 2023-11-28T18:37:59.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.182+0000 7efe47209640 1 Processor -- start 2023-11-28T18:37:59.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.182+0000 7efe47209640 1 -- start start 2023-11-28T18:37:59.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.182+0000 7efe47209640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efe400b5220 0x7efe4015f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:59.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.182+0000 7efe47209640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe400d1500 0x7efe4015fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:59.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.182+0000 7efe47209640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efe4015d4d0 0x7efe400c70e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:59.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.182+0000 7efe47209640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe4015f940 con 0x7efe400d1500 2023-11-28T18:37:59.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.182+0000 7efe47209640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe400c69e0 con 0x7efe400b5220 2023-11-28T18:37:59.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.182+0000 7efe47209640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe401597d0 con 0x7efe4015d4d0 2023-11-28T18:37:59.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.182+0000 7efe3ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe400d1500 0x7efe4015fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:59.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.182+0000 7efe44fa5640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efe400b5220 0x7efe4015f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:59.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.182+0000 7efe3ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe400d1500 0x7efe4015fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53176/0 (socket says 172.21.15.45:53176) 2023-11-28T18:37:59.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.182+0000 7efe3ffff640 1 -- 172.21.15.45:0/224509795 learned_addr learned my addr 172.21.15.45:0/224509795 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:59.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.182+0000 7efe457a6640 1 --2- 172.21.15.45:0/224509795 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efe4015d4d0 0x7efe400c70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:59.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.182+0000 7efe3ffff640 1 -- 172.21.15.45:0/224509795 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efe4015d4d0 msgr2=0x7efe400c70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:59.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.182+0000 7efe3ffff640 1 --2- 172.21.15.45:0/224509795 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efe4015d4d0 0x7efe400c70e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:59.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.182+0000 7efe3ffff640 1 -- 172.21.15.45:0/224509795 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efe400b5220 msgr2=0x7efe4015f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:59.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.182+0000 7efe3ffff640 1 --2- 172.21.15.45:0/224509795 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efe400b5220 0x7efe4015f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:59.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.182+0000 7efe3ffff640 1 -- 172.21.15.45:0/224509795 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe2c009420 con 0x7efe400d1500 2023-11-28T18:37:59.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.182+0000 7efe44fa5640 1 --2- 172.21.15.45:0/224509795 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efe400b5220 0x7efe4015f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:37:59.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.182+0000 7efe3ffff640 1 --2- 172.21.15.45:0/224509795 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe400d1500 0x7efe4015fe80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7efe2c01ab30 tx=0x7efe2c019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:59.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.182+0000 7efe3d7fa640 1 -- 172.21.15.45:0/224509795 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2c006e20 con 0x7efe400d1500 2023-11-28T18:37:59.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.182+0000 7efe3d7fa640 1 -- 172.21.15.45:0/224509795 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe2c0b5610 con 0x7efe400d1500 2023-11-28T18:37:59.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.182+0000 7efe3d7fa640 1 -- 172.21.15.45:0/224509795 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2c0b59e0 con 0x7efe400d1500 2023-11-28T18:37:59.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.182+0000 7efe47209640 1 -- 172.21.15.45:0/224509795 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe40159ab0 con 0x7efe400d1500 2023-11-28T18:37:59.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.182+0000 7efe47209640 1 -- 172.21.15.45:0/224509795 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe4015a070 con 0x7efe400d1500 2023-11-28T18:37:59.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.186+0000 7efe47209640 1 -- 172.21.15.45:0/224509795 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe40069480 con 0x7efe400d1500 2023-11-28T18:37:59.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.186+0000 7efe3d7fa640 1 -- 172.21.15.45:0/224509795 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7efe2c0b3040 con 0x7efe400d1500 2023-11-28T18:37:59.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.186+0000 7efe3d7fa640 1 --2- 172.21.15.45:0/224509795 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7efe240668d0 0x7efe24068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:59.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.186+0000 7efe3d7fa640 1 -- 172.21.15.45:0/224509795 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efe2c11dff0 con 0x7efe400d1500 2023-11-28T18:37:59.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.186+0000 7efe44fa5640 1 --2- 172.21.15.45:0/224509795 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7efe240668d0 0x7efe24068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:59.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.186+0000 7efe44fa5640 1 --2- 172.21.15.45:0/224509795 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7efe240668d0 0x7efe24068d90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7efe34007fd0 tx=0x7efe34009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:59.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.190+0000 7efe3d7fa640 1 -- 172.21.15.45:0/224509795 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efe2c0eb310 con 0x7efe400d1500 2023-11-28T18:37:59.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.350+0000 7efe47209640 1 -- 172.21.15.45:0/224509795 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efe400b6a20 con 0x7efe400d1500 2023-11-28T18:37:59.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.350+0000 7efe3d7fa640 1 -- 172.21.15.45:0/224509795 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16469 (secure 0 0 0) 0x7efe400b6a20 con 0x7efe400d1500 2023-11-28T18:37:59.356 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:37:59.356 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":20,"fsid":"d10f5cd6-1d00-4019-99b6-6fa435498a15","created":"2023-11-28T18:37:08.189030+0000","modified":"2023-11-28T18:37:33.971141+0000","last_up_change":"2023-11-28T18:37:20.196124+0000","last_in_change":"2023-11-28T18:37:10.742043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T18:37:21.293917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T18:37:31.384760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T18:37:31.834769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"84465384-103c-4f2c-a45a-96f5bb9c835f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6809","nonce":555237322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6811","nonce":555237322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6815","nonce":555237322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6813","nonce":555237322}]},"public_addr":"172.21.15.45:6809/555237322","cluster_addr":"172.21.15.45:6811/555237322","heartbeat_back_addr":"172.21.15.45:6815/555237322","heartbeat_front_addr":"172.21.15.45:6813/555237322","state":["exists","up"]},{"osd":1,"uuid":"7d9eed24-a58f-42c7-a787-ac06be8553fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6801","nonce":2857063763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6803","nonce":2857063763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6807","nonce":2857063763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6805","nonce":2857063763}]},"public_addr":"172.21.15.45:6801/2857063763","cluster_addr":"172.21.15.45:6803/2857063763","heartbeat_back_addr":"172.21.15.45:6807/2857063763","heartbeat_front_addr":"172.21.15.45:6805/2857063763","state":["exists","up"]},{"osd":2,"uuid":"575eeccc-4abf-45b4-9caf-f3e797859588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6817","nonce":193884539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6819","nonce":193884539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6823","nonce":193884539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6821","nonce":193884539}]},"public_addr":"172.21.15.45:6817/193884539","cluster_addr":"172.21.15.45:6819/193884539","heartbeat_back_addr":"172.21.15.45:6823/193884539","heartbeat_front_addr":"172.21.15.45:6821/193884539","state":["exists","up"]},{"osd":3,"uuid":"9b0290d6-9a52-4bc8-b2a1-7622c5dc8e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6825","nonce":78541084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6827","nonce":78541084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6831","nonce":78541084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6829","nonce":78541084}]},"public_addr":"172.21.15.45:6825/78541084","cluster_addr":"172.21.15.45:6827/78541084","heartbeat_back_addr":"172.21.15.45:6831/78541084","heartbeat_front_addr":"172.21.15.45:6829/78541084","state":["exists","up"]},{"osd":4,"uuid":"ce632829-f027-4fbf-a627-02c571aa9d53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6809","nonce":1537591987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6811","nonce":1537591987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6815","nonce":1537591987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6813","nonce":1537591987}]},"public_addr":"172.21.15.190:6809/1537591987","cluster_addr":"172.21.15.190:6811/1537591987","heartbeat_back_addr":"172.21.15.190:6815/1537591987","heartbeat_front_addr":"172.21.15.190:6813/1537591987","state":["exists","up"]},{"osd":5,"uuid":"8700b609-27be-40bd-a251-4c0ae0a29ead","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6801","nonce":3296698407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6803","nonce":3296698407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6807","nonce":3296698407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6805","nonce":3296698407}]},"public_addr":"172.21.15.190:6801/3296698407","cluster_addr":"172.21.15.190:6803/3296698407","heartbeat_back_addr":"172.21.15.190:6807/3296698407","heartbeat_front_addr":"172.21.15.190:6805/3296698407","state":["exists","up"]},{"osd":6,"uuid":"44ce4a40-e6ff-4f4d-8e8a-7341e5c91f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6817","nonce":2317686718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6819","nonce":2317686718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6823","nonce":2317686718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6821","nonce":2317686718}]},"public_addr":"172.21.15.190:6817/2317686718","cluster_addr":"172.21.15.190:6819/2317686718","heartbeat_back_addr":"172.21.15.190:6823/2317686718","heartbeat_front_addr":"172.21.15.190:6821/2317686718","state":["exists","up"]},{"osd":7,"uuid":"192238c9-1423-4b7e-ac8f-84ba32113ddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6825","nonce":2493232051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6827","nonce":2493232051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6831","nonce":2493232051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6829","nonce":2493232051}]},"public_addr":"172.21.15.190:6825/2493232051","cluster_addr":"172.21.15.190:6827/2493232051","heartbeat_back_addr":"172.21.15.190:6831/2493232051","heartbeat_front_addr":"172.21.15.190:6829/2493232051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.393552+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.385453+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.361421+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.366408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.363226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.276007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.414605+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.445885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T18:37:59.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.350+0000 7efe47209640 1 -- 172.21.15.45:0/224509795 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7efe240668d0 msgr2=0x7efe24068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:59.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.350+0000 7efe47209640 1 --2- 172.21.15.45:0/224509795 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7efe240668d0 0x7efe24068d90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7efe34007fd0 tx=0x7efe34009040 comp rx=0 tx=0).stop 2023-11-28T18:37:59.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.350+0000 7efe47209640 1 -- 172.21.15.45:0/224509795 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe400d1500 msgr2=0x7efe4015fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:59.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.350+0000 7efe47209640 1 --2- 172.21.15.45:0/224509795 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe400d1500 0x7efe4015fe80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7efe2c01ab30 tx=0x7efe2c019220 comp rx=0 tx=0).stop 2023-11-28T18:37:59.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.350+0000 7efe47209640 1 -- 172.21.15.45:0/224509795 shutdown_connections 2023-11-28T18:37:59.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.350+0000 7efe47209640 1 --2- 172.21.15.45:0/224509795 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7efe240668d0 0x7efe24068d90 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:59.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.350+0000 7efe47209640 1 --2- 172.21.15.45:0/224509795 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efe4015d4d0 0x7efe400c70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:59.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.350+0000 7efe47209640 1 --2- 172.21.15.45:0/224509795 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe400d1500 0x7efe4015fe80 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:59.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.350+0000 7efe47209640 1 --2- 172.21.15.45:0/224509795 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efe400b5220 0x7efe4015f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:59.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.350+0000 7efe47209640 1 -- 172.21.15.45:0/224509795 >> 172.21.15.45:0/224509795 conn(0x7efe400720a0 msgr2=0x7efe40154bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:59.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.350+0000 7efe47209640 1 -- 172.21.15.45:0/224509795 shutdown_connections 2023-11-28T18:37:59.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.354+0000 7efe47209640 1 -- 172.21.15.45:0/224509795 wait complete. 2023-11-28T18:37:59.378 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T18:37:21.293917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T18:37:31.384760+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T18:37:31.834769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T18:37:59.378 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T18:37:59.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.518+0000 7f285b9b8640 1 Processor -- start 2023-11-28T18:37:59.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.518+0000 7f285b9b8640 1 -- start start 2023-11-28T18:37:59.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.518+0000 7f285b9b8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2854158ce0 0x7f285415eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:59.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.518+0000 7f285b9b8640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f28540cba50 0x7f285415be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:59.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.518+0000 7f285b9b8640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f285415b6b0 con 0x7f28540b4310 2023-11-28T18:37:59.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.518+0000 7f285b9b8640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f285415f450 con 0x7f28540cba50 2023-11-28T18:37:59.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.518+0000 7f285b9b8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f285415f730 con 0x7f2854158ce0 2023-11-28T18:37:59.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.518+0000 7f2859f55640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f28540b4310 0x7f2854070430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33656/0 (socket says 172.21.15.45:33656) 2023-11-28T18:37:59.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.518+0000 7f2859f55640 1 -- 172.21.15.45:0/2178473985 learned_addr learned my addr 172.21.15.45:0/2178473985 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:37:59.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.518+0000 7f2858f53640 1 --2- 172.21.15.45:0/2178473985 >> v2:172.21.15.190:3300/0 conn(0x7f28540cba50 0x7f285415be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:59.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.518+0000 7f2859754640 1 --2- 172.21.15.45:0/2178473985 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2854158ce0 0x7f285415eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:59.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.522+0000 7f284bfff640 1 -- 172.21.15.45:0/2178473985 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1431750284 0 0) 0x7f285415b6b0 con 0x7f28540b4310 2023-11-28T18:37:59.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.522+0000 7f284bfff640 1 -- 172.21.15.45:0/2178473985 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2840003530 con 0x7f28540b4310 2023-11-28T18:37:59.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.522+0000 7f2859754640 1 -- 172.21.15.45:0/2178473985 >> v2:172.21.15.190:3300/0 conn(0x7f28540cba50 msgr2=0x7f285415be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:37:59.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.522+0000 7f2859754640 1 --2- 172.21.15.45:0/2178473985 >> v2:172.21.15.190:3300/0 conn(0x7f28540cba50 0x7f285415be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:59.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.522+0000 7f2859754640 1 -- 172.21.15.45:0/2178473985 >> v1:172.21.15.45:6789/0 conn(0x7f28540b4310 legacy=0x7f2854070430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:59.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.522+0000 7f284bfff640 1 -- 172.21.15.45:0/2178473985 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2230576738 0 0) 0x7f2840003530 con 0x7f28540b4310 2023-11-28T18:37:59.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.522+0000 7f2859754640 1 -- 172.21.15.45:0/2178473985 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f285415b920 con 0x7f2854158ce0 2023-11-28T18:37:59.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.522+0000 7f2858f53640 1 --2- 172.21.15.45:0/2178473985 >> v2:172.21.15.190:3300/0 conn(0x7f28540cba50 0x7f285415be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:37:59.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.522+0000 7f2859754640 1 --2- 172.21.15.45:0/2178473985 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2854158ce0 0x7f285415eb90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f28500097c0 tx=0x7f285001c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=554db84dedc88ea5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:59.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.522+0000 7f284bfff640 1 -- 172.21.15.45:0/2178473985 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284c001a00 con 0x7f2854158ce0 2023-11-28T18:37:59.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.522+0000 7f284bfff640 1 -- 172.21.15.45:0/2178473985 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28500a7050 con 0x7f2854158ce0 2023-11-28T18:37:59.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.522+0000 7f284bfff640 1 -- 172.21.15.45:0/2178473985 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28500ab620 con 0x7f2854158ce0 2023-11-28T18:37:59.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.526+0000 7f285b9b8640 1 -- 172.21.15.45:0/2178473985 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2854158ce0 msgr2=0x7f285415eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:59.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.526+0000 7f285b9b8640 1 --2- 172.21.15.45:0/2178473985 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2854158ce0 0x7f285415eb90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f28500097c0 tx=0x7f285001c3a0 comp rx=0 tx=0).stop 2023-11-28T18:37:59.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.526+0000 7f285b9b8640 1 -- 172.21.15.45:0/2178473985 shutdown_connections 2023-11-28T18:37:59.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.526+0000 7f285b9b8640 1 --2- 172.21.15.45:0/2178473985 >> v2:172.21.15.190:3300/0 conn(0x7f28540cba50 0x7f285415be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:59.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.526+0000 7f285b9b8640 1 --2- 172.21.15.45:0/2178473985 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2854158ce0 0x7f285415eb90 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:59.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.526+0000 7f285b9b8640 1 -- 172.21.15.45:0/2178473985 >> 172.21.15.45:0/2178473985 conn(0x7f28540b0d00 msgr2=0x7f28540b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:59.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.526+0000 7f285b9b8640 1 -- 172.21.15.45:0/2178473985 shutdown_connections 2023-11-28T18:37:59.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.526+0000 7f285b9b8640 1 -- 172.21.15.45:0/2178473985 wait complete. 2023-11-28T18:37:59.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.526+0000 7f285b9b8640 1 Processor -- start 2023-11-28T18:37:59.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.526+0000 7f285b9b8640 1 -- start start 2023-11-28T18:37:59.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.526+0000 7f285b9b8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f28540b4310 0x7f2854157990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:59.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.526+0000 7f285b9b8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28540cba50 0x7f2854152da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:59.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.526+0000 7f285b9b8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2854158ce0 0x7f28540a8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:59.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.526+0000 7f285b9b8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2854151d90 con 0x7f28540cba50 2023-11-28T18:37:59.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.526+0000 7f285b9b8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2854152910 con 0x7f2854158ce0 2023-11-28T18:37:59.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.526+0000 7f285b9b8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2854151fe0 con 0x7f28540b4310 2023-11-28T18:37:59.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.526+0000 7f2858f53640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28540cba50 0x7f2854152da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:59.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.526+0000 7f2858f53640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28540cba50 0x7f2854152da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53192/0 (socket says 172.21.15.45:53192) 2023-11-28T18:37:59.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.526+0000 7f2858f53640 1 -- 172.21.15.45:0/934277792 learned_addr learned my addr 172.21.15.45:0/934277792 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:59.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.526+0000 7f2859f55640 1 --2- 172.21.15.45:0/934277792 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2854158ce0 0x7f28540a8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:59.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.526+0000 7f2859754640 1 --2- 172.21.15.45:0/934277792 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f28540b4310 0x7f2854157990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:59.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.526+0000 7f2858f53640 1 -- 172.21.15.45:0/934277792 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f28540b4310 msgr2=0x7f2854157990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:59.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.526+0000 7f2858f53640 1 --2- 172.21.15.45:0/934277792 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f28540b4310 0x7f2854157990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:59.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.526+0000 7f2858f53640 1 -- 172.21.15.45:0/934277792 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2854158ce0 msgr2=0x7f28540a8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:59.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.526+0000 7f2858f53640 1 --2- 172.21.15.45:0/934277792 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2854158ce0 0x7f28540a8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:59.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.526+0000 7f2858f53640 1 -- 172.21.15.45:0/934277792 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2844009420 con 0x7f28540cba50 2023-11-28T18:37:59.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.526+0000 7f2859f55640 1 --2- 172.21.15.45:0/934277792 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2854158ce0 0x7f28540a8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:37:59.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.526+0000 7f2859754640 1 --2- 172.21.15.45:0/934277792 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f28540b4310 0x7f2854157990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:37:59.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.530+0000 7f2858f53640 1 --2- 172.21.15.45:0/934277792 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28540cba50 0x7f2854152da0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f284400e9d0 tx=0x7f284400ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:59.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.530+0000 7f2849ffb640 1 -- 172.21.15.45:0/934277792 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284400ca60 con 0x7f28540cba50 2023-11-28T18:37:59.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.530+0000 7f2849ffb640 1 -- 172.21.15.45:0/934277792 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f284400cbc0 con 0x7f28540cba50 2023-11-28T18:37:59.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.530+0000 7f285b9b8640 1 -- 172.21.15.45:0/934277792 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2850009420 con 0x7f28540cba50 2023-11-28T18:37:59.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.530+0000 7f2849ffb640 1 -- 172.21.15.45:0/934277792 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2844013470 con 0x7f28540cba50 2023-11-28T18:37:59.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.530+0000 7f285b9b8640 1 -- 172.21.15.45:0/934277792 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28541525a0 con 0x7f28540cba50 2023-11-28T18:37:59.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.530+0000 7f285b9b8640 1 -- 172.21.15.45:0/934277792 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2854152a80 con 0x7f28540cba50 2023-11-28T18:37:59.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.530+0000 7f2849ffb640 1 -- 172.21.15.45:0/934277792 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f28440135d0 con 0x7f28540cba50 2023-11-28T18:37:59.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.530+0000 7f2849ffb640 1 --2- 172.21.15.45:0/934277792 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f28380668d0 0x7f2838068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:59.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.534+0000 7f2849ffb640 1 -- 172.21.15.45:0/934277792 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f28440842c0 con 0x7f28540cba50 2023-11-28T18:37:59.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.534+0000 7f2859754640 1 --2- 172.21.15.45:0/934277792 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f28380668d0 0x7f2838068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:59.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.534+0000 7f2859754640 1 --2- 172.21.15.45:0/934277792 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f28380668d0 0x7f2838068d90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f28500ad000 tx=0x7f28500a4f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:59.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.538+0000 7f2849ffb640 1 -- 172.21.15.45:0/934277792 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2844051590 con 0x7f28540cba50 2023-11-28T18:37:59.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.694+0000 7f285b9b8640 1 -- 172.21.15.45:0/934277792 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2854069410 con 0x7f28540cba50 2023-11-28T18:37:59.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.698+0000 7f2849ffb640 1 -- 172.21.15.45:0/934277792 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2844054bb0 con 0x7f28540cba50 2023-11-28T18:37:59.703 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-11-28T18:37:59.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.698+0000 7f285b9b8640 1 -- 172.21.15.45:0/934277792 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f28380668d0 msgr2=0x7f2838068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:59.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.698+0000 7f285b9b8640 1 --2- 172.21.15.45:0/934277792 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f28380668d0 0x7f2838068d90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f28500ad000 tx=0x7f28500a4f90 comp rx=0 tx=0).stop 2023-11-28T18:37:59.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.698+0000 7f285b9b8640 1 -- 172.21.15.45:0/934277792 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28540cba50 msgr2=0x7f2854152da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:59.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.698+0000 7f285b9b8640 1 --2- 172.21.15.45:0/934277792 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28540cba50 0x7f2854152da0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f284400e9d0 tx=0x7f284400ee90 comp rx=0 tx=0).stop 2023-11-28T18:37:59.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.698+0000 7f285b9b8640 1 -- 172.21.15.45:0/934277792 shutdown_connections 2023-11-28T18:37:59.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.698+0000 7f285b9b8640 1 --2- 172.21.15.45:0/934277792 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f28380668d0 0x7f2838068d90 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:59.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.698+0000 7f285b9b8640 1 --2- 172.21.15.45:0/934277792 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2854158ce0 0x7f28540a8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:59.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.698+0000 7f285b9b8640 1 --2- 172.21.15.45:0/934277792 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28540cba50 0x7f2854152da0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:59.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.698+0000 7f285b9b8640 1 --2- 172.21.15.45:0/934277792 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f28540b4310 0x7f2854157990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:59.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.698+0000 7f285b9b8640 1 -- 172.21.15.45:0/934277792 >> 172.21.15.45:0/934277792 conn(0x7f28540b0d00 msgr2=0x7f2854071d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:59.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.698+0000 7f285b9b8640 1 -- 172.21.15.45:0/934277792 shutdown_connections 2023-11-28T18:37:59.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.698+0000 7f285b9b8640 1 -- 172.21.15.45:0/934277792 wait complete. 2023-11-28T18:37:59.724 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T18:37:59.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.862+0000 7f4867bd1640 1 Processor -- start 2023-11-28T18:37:59.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.862+0000 7f4867bd1640 1 -- start start 2023-11-28T18:37:59.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.862+0000 7f4867bd1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f486014b220 0x7f48600b3e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:59.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.862+0000 7f4867bd1640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48600b2000 con 0x7f486014ac20 2023-11-28T18:37:59.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.866+0000 7f4867bd1640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48600b22a0 con 0x7f48600b4390 2023-11-28T18:37:59.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.866+0000 7f4867bd1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48600b4820 con 0x7f486014b220 2023-11-28T18:37:59.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.866+0000 7f486596d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f486014ac20 0x7f4860165a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33662/0 (socket says 172.21.15.45:33662) 2023-11-28T18:37:59.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.866+0000 7f486596d640 1 -- 172.21.15.45:0/1481433068 learned_addr learned my addr 172.21.15.45:0/1481433068 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:37:59.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.866+0000 7f486516c640 1 --2- 172.21.15.45:0/1481433068 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f486014b220 0x7f48600b3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:59.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.866+0000 7f486496b640 1 -- 172.21.15.45:0/1481433068 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2148177221 0 0) 0x7f48600b2000 con 0x7f486014ac20 2023-11-28T18:37:59.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.866+0000 7f486496b640 1 -- 172.21.15.45:0/1481433068 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f484c003530 con 0x7f486014ac20 2023-11-28T18:37:59.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.866+0000 7f486496b640 1 -- 172.21.15.45:0/1481433068 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2598444663 0 0) 0x7f48600b22a0 con 0x7f48600b4390 2023-11-28T18:37:59.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.866+0000 7f486496b640 1 -- 172.21.15.45:0/1481433068 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48600b2000 con 0x7f48600b4390 2023-11-28T18:37:59.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.866+0000 7f486516c640 1 -- 172.21.15.45:0/1481433068 >> v1:172.21.15.190:6789/0 conn(0x7f48600b4390 legacy=0x7f4860070430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:59.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.866+0000 7f486516c640 1 -- 172.21.15.45:0/1481433068 >> v1:172.21.15.45:6789/0 conn(0x7f486014ac20 legacy=0x7f4860165a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:59.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.866+0000 7f486516c640 1 -- 172.21.15.45:0/1481433068 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48600b2580 con 0x7f486014b220 2023-11-28T18:37:59.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.866+0000 7f486516c640 1 --2- 172.21.15.45:0/1481433068 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f486014b220 0x7f48600b3e50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f48500097f0 tx=0x7f485001c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63361ea1df532d31 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:59.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.870+0000 7f486496b640 1 -- 172.21.15.45:0/1481433068 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48500ac410 con 0x7f486014b220 2023-11-28T18:37:59.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.870+0000 7f486496b640 1 -- 172.21.15.45:0/1481433068 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48500ac570 con 0x7f486014b220 2023-11-28T18:37:59.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.870+0000 7f486496b640 1 -- 172.21.15.45:0/1481433068 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48500ac900 con 0x7f486014b220 2023-11-28T18:37:59.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.870+0000 7f4867bd1640 1 -- 172.21.15.45:0/1481433068 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f486014b220 msgr2=0x7f48600b3e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:59.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.870+0000 7f4867bd1640 1 --2- 172.21.15.45:0/1481433068 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f486014b220 0x7f48600b3e50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f48500097f0 tx=0x7f485001c4c0 comp rx=0 tx=0).stop 2023-11-28T18:37:59.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.870+0000 7f4867bd1640 1 -- 172.21.15.45:0/1481433068 shutdown_connections 2023-11-28T18:37:59.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.870+0000 7f4867bd1640 1 --2- 172.21.15.45:0/1481433068 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f486014b220 0x7f48600b3e50 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:59.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.870+0000 7f4867bd1640 1 -- 172.21.15.45:0/1481433068 >> 172.21.15.45:0/1481433068 conn(0x7f48600b0d00 msgr2=0x7f48600b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:37:59.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.870+0000 7f4867bd1640 1 -- 172.21.15.45:0/1481433068 shutdown_connections 2023-11-28T18:37:59.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.870+0000 7f4867bd1640 1 -- 172.21.15.45:0/1481433068 wait complete. 2023-11-28T18:37:59.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.870+0000 7f4867bd1640 1 Processor -- start 2023-11-28T18:37:59.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.870+0000 7f4867bd1640 1 -- start start 2023-11-28T18:37:59.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.870+0000 7f4867bd1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f48600b4390 0x7f48601fa400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:59.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.870+0000 7f4867bd1640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f486014ac20 0x7f48600ade50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:59.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.870+0000 7f4867bd1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48601444d0 0x7f48601fbb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:59.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.870+0000 7f4867bd1640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48601fb690 con 0x7f48601444d0 2023-11-28T18:37:59.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.870+0000 7f4867bd1640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48601faa80 con 0x7f486014ac20 2023-11-28T18:37:59.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.870+0000 7f4867bd1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48601fad60 con 0x7f48600b4390 2023-11-28T18:37:59.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.874+0000 7f486616e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48601444d0 0x7f48601fbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:59.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.874+0000 7f486616e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48601444d0 0x7f48601fbb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53204/0 (socket says 172.21.15.45:53204) 2023-11-28T18:37:59.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.874+0000 7f486616e640 1 -- 172.21.15.45:0/788726319 learned_addr learned my addr 172.21.15.45:0/788726319 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:37:59.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.874+0000 7f486516c640 1 --2- 172.21.15.45:0/788726319 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f486014ac20 0x7f48600ade50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:59.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.874+0000 7f486596d640 1 --2- 172.21.15.45:0/788726319 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f48600b4390 0x7f48601fa400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:59.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.874+0000 7f486616e640 1 -- 172.21.15.45:0/788726319 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f48600b4390 msgr2=0x7f48601fa400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:59.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.874+0000 7f486616e640 1 --2- 172.21.15.45:0/788726319 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f48600b4390 0x7f48601fa400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:59.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.874+0000 7f486616e640 1 -- 172.21.15.45:0/788726319 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f486014ac20 msgr2=0x7f48600ade50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:37:59.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.874+0000 7f486616e640 1 --2- 172.21.15.45:0/788726319 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f486014ac20 0x7f48600ade50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:37:59.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.874+0000 7f486616e640 1 -- 172.21.15.45:0/788726319 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4850009420 con 0x7f48601444d0 2023-11-28T18:37:59.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.874+0000 7f486616e640 1 --2- 172.21.15.45:0/788726319 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48601444d0 0x7f48601fbb20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f485800c790 tx=0x7f485800cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:59.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.874+0000 7f48567fc640 1 -- 172.21.15.45:0/788726319 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485800cea0 con 0x7f48601444d0 2023-11-28T18:37:59.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.874+0000 7f48567fc640 1 -- 172.21.15.45:0/788726319 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4858003b80 con 0x7f48601444d0 2023-11-28T18:37:59.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.874+0000 7f48567fc640 1 -- 172.21.15.45:0/788726319 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485800a850 con 0x7f48601444d0 2023-11-28T18:37:59.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.874+0000 7f4867bd1640 1 -- 172.21.15.45:0/788726319 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48601fb040 con 0x7f48601444d0 2023-11-28T18:37:59.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.874+0000 7f4867bd1640 1 -- 172.21.15.45:0/788726319 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48600ae390 con 0x7f48601444d0 2023-11-28T18:37:59.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.874+0000 7f4867bd1640 1 -- 172.21.15.45:0/788726319 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4860069410 con 0x7f48601444d0 2023-11-28T18:37:59.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.874+0000 7f48567fc640 1 -- 172.21.15.45:0/788726319 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f485800a9b0 con 0x7f48601444d0 2023-11-28T18:37:59.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.878+0000 7f48567fc640 1 --2- 172.21.15.45:0/788726319 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f48440668d0 0x7f4844068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:37:59.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.878+0000 7f48567fc640 1 -- 172.21.15.45:0/788726319 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f48580843b0 con 0x7f48601444d0 2023-11-28T18:37:59.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.878+0000 7f486596d640 1 --2- 172.21.15.45:0/788726319 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f48440668d0 0x7f4844068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:37:59.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.878+0000 7f486596d640 1 --2- 172.21.15.45:0/788726319 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f48440668d0 0x7f4844068d90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f485c0011f0 tx=0x7f485c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:37:59.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:37:59.882+0000 7f48567fc640 1 -- 172.21.15.45:0/788726319 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4858051550 con 0x7f48601444d0 2023-11-28T18:38:00.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.038+0000 7f4867bd1640 1 -- 172.21.15.45:0/788726319 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f48601fb7d0 con 0x7f48601444d0 2023-11-28T18:38:00.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.038+0000 7f48567fc640 1 -- 172.21.15.45:0/788726319 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4858054b70 con 0x7f48601444d0 2023-11-28T18:38:00.044 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-11-28T18:38:00.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.038+0000 7f4867bd1640 1 -- 172.21.15.45:0/788726319 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f48440668d0 msgr2=0x7f4844068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:00.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.038+0000 7f4867bd1640 1 --2- 172.21.15.45:0/788726319 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f48440668d0 0x7f4844068d90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f485c0011f0 tx=0x7f485c009040 comp rx=0 tx=0).stop 2023-11-28T18:38:00.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.038+0000 7f4867bd1640 1 -- 172.21.15.45:0/788726319 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48601444d0 msgr2=0x7f48601fbb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:00.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.038+0000 7f4867bd1640 1 --2- 172.21.15.45:0/788726319 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48601444d0 0x7f48601fbb20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f485800c790 tx=0x7f485800cc50 comp rx=0 tx=0).stop 2023-11-28T18:38:00.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.038+0000 7f4867bd1640 1 -- 172.21.15.45:0/788726319 shutdown_connections 2023-11-28T18:38:00.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.038+0000 7f4867bd1640 1 --2- 172.21.15.45:0/788726319 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f48440668d0 0x7f4844068d90 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:00.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.038+0000 7f4867bd1640 1 --2- 172.21.15.45:0/788726319 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48601444d0 0x7f48601fbb20 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:00.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.038+0000 7f4867bd1640 1 --2- 172.21.15.45:0/788726319 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f486014ac20 0x7f48600ade50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:00.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.038+0000 7f4867bd1640 1 --2- 172.21.15.45:0/788726319 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f48600b4390 0x7f48601fa400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:00.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.038+0000 7f4867bd1640 1 -- 172.21.15.45:0/788726319 >> 172.21.15.45:0/788726319 conn(0x7f48600b0d00 msgr2=0x7f48600aefe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:00.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.038+0000 7f4867bd1640 1 -- 172.21.15.45:0/788726319 shutdown_connections 2023-11-28T18:38:00.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.038+0000 7f4867bd1640 1 -- 172.21.15.45:0/788726319 wait complete. 2023-11-28T18:38:00.065 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T18:38:00.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.206+0000 7f9ec7046640 1 Processor -- start 2023-11-28T18:38:00.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.206+0000 7f9ec7046640 1 -- start start 2023-11-28T18:38:00.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.206+0000 7f9ec7046640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ec01469a0 0x7f9ec006cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:00.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.206+0000 7f9ec7046640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ec015e940 con 0x7f9ec00b4070 2023-11-28T18:38:00.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.206+0000 7f9ec7046640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ec006f700 con 0x7f9ec015fde0 2023-11-28T18:38:00.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.206+0000 7f9ec7046640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec015dd30 con 0x7f9ec01469a0 2023-11-28T18:38:00.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.206+0000 7f9ebffff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f9ec00b4070 0x7f9ec006e8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33678/0 (socket says 172.21.15.45:33678) 2023-11-28T18:38:00.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.206+0000 7f9ebffff640 1 -- 172.21.15.45:0/1649198229 learned_addr learned my addr 172.21.15.45:0/1649198229 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:38:00.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.206+0000 7f9ec4de2640 1 --2- 172.21.15.45:0/1649198229 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ec01469a0 0x7f9ec006cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:00.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.206+0000 7f9ebf7fe640 1 -- 172.21.15.45:0/1649198229 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2153869302 0 0) 0x7f9ec015e940 con 0x7f9ec00b4070 2023-11-28T18:38:00.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.206+0000 7f9ebf7fe640 1 -- 172.21.15.45:0/1649198229 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9eb0003530 con 0x7f9ec00b4070 2023-11-28T18:38:00.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.206+0000 7f9ec4de2640 1 -- 172.21.15.45:0/1649198229 >> v1:172.21.15.190:6789/0 conn(0x7f9ec015fde0 legacy=0x7f9ec006eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:00.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.206+0000 7f9ec4de2640 1 -- 172.21.15.45:0/1649198229 >> v1:172.21.15.45:6789/0 conn(0x7f9ec00b4070 legacy=0x7f9ec006e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:00.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.206+0000 7f9ec4de2640 1 -- 172.21.15.45:0/1649198229 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec015e010 con 0x7f9ec01469a0 2023-11-28T18:38:00.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.210+0000 7f9ec4de2640 1 --2- 172.21.15.45:0/1649198229 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ec01469a0 0x7f9ec006cab0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9eb40097f0 tx=0x7f9eb401c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a815f227d14d65f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:00.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.210+0000 7f9ebf7fe640 1 -- 172.21.15.45:0/1649198229 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb40ac410 con 0x7f9ec01469a0 2023-11-28T18:38:00.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.210+0000 7f9ebf7fe640 1 -- 172.21.15.45:0/1649198229 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eb40ac570 con 0x7f9ec01469a0 2023-11-28T18:38:00.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.210+0000 7f9ebf7fe640 1 -- 172.21.15.45:0/1649198229 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb40ac900 con 0x7f9ec01469a0 2023-11-28T18:38:00.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.210+0000 7f9ec7046640 1 -- 172.21.15.45:0/1649198229 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ec01469a0 msgr2=0x7f9ec006cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:00.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.210+0000 7f9ec7046640 1 --2- 172.21.15.45:0/1649198229 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ec01469a0 0x7f9ec006cab0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9eb40097f0 tx=0x7f9eb401c4c0 comp rx=0 tx=0).stop 2023-11-28T18:38:00.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.210+0000 7f9ec7046640 1 -- 172.21.15.45:0/1649198229 shutdown_connections 2023-11-28T18:38:00.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.210+0000 7f9ec7046640 1 --2- 172.21.15.45:0/1649198229 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ec01469a0 0x7f9ec006cab0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:00.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.210+0000 7f9ec7046640 1 -- 172.21.15.45:0/1649198229 >> 172.21.15.45:0/1649198229 conn(0x7f9ec0070b80 msgr2=0x7f9ec0066360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:00.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.210+0000 7f9ec7046640 1 -- 172.21.15.45:0/1649198229 shutdown_connections 2023-11-28T18:38:00.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.210+0000 7f9ec7046640 1 -- 172.21.15.45:0/1649198229 wait complete. 2023-11-28T18:38:00.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.214+0000 7f9ec7046640 1 Processor -- start 2023-11-28T18:38:00.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.214+0000 7f9ec7046640 1 -- start start 2023-11-28T18:38:00.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.214+0000 7f9ec7046640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ec00b4070 0x7f9ec0144570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:00.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.214+0000 7f9ec7046640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ec01469a0 0x7f9ec015a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:00.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.214+0000 7f9ec7046640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ec015fde0 0x7f9ec0159be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:00.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.214+0000 7f9ec7046640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec0144b50 con 0x7f9ec015fde0 2023-11-28T18:38:00.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.214+0000 7f9ec7046640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec015a950 con 0x7f9ec01469a0 2023-11-28T18:38:00.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.214+0000 7f9ec7046640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec0138510 con 0x7f9ec00b4070 2023-11-28T18:38:00.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.214+0000 7f9ec55e3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ec015fde0 0x7f9ec0159be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:00.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.214+0000 7f9ec4de2640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ec00b4070 0x7f9ec0144570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:00.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.214+0000 7f9ebffff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ec01469a0 0x7f9ec015a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:00.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.214+0000 7f9ec4de2640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ec00b4070 0x7f9ec0144570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.45:41140/0 (socket says 172.21.15.45:41140) 2023-11-28T18:38:00.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.214+0000 7f9ec4de2640 1 -- 172.21.15.45:0/1976129977 learned_addr learned my addr 172.21.15.45:0/1976129977 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:00.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.214+0000 7f9ec4de2640 1 -- 172.21.15.45:0/1976129977 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ec01469a0 msgr2=0x7f9ec015a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:00.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.214+0000 7f9ec4de2640 1 --2- 172.21.15.45:0/1976129977 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ec01469a0 0x7f9ec015a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:00.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.214+0000 7f9ec4de2640 1 -- 172.21.15.45:0/1976129977 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ec015fde0 msgr2=0x7f9ec0159be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:00.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.214+0000 7f9ec4de2640 1 --2- 172.21.15.45:0/1976129977 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ec015fde0 0x7f9ec0159be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:00.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.214+0000 7f9ec4de2640 1 -- 172.21.15.45:0/1976129977 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb4009420 con 0x7f9ec00b4070 2023-11-28T18:38:00.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.214+0000 7f9ec55e3640 1 --2- 172.21.15.45:0/1976129977 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ec015fde0 0x7f9ec0159be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:38:00.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.214+0000 7f9ec4de2640 1 --2- 172.21.15.45:0/1976129977 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ec00b4070 0x7f9ec0144570 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9eb40190d0 tx=0x7f9eb4019260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:00.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.214+0000 7f9ebd7fa640 1 -- 172.21.15.45:0/1976129977 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb40ac410 con 0x7f9ec00b4070 2023-11-28T18:38:00.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.214+0000 7f9ebd7fa640 1 -- 172.21.15.45:0/1976129977 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eb40ace90 con 0x7f9ec00b4070 2023-11-28T18:38:00.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.214+0000 7f9ebd7fa640 1 -- 172.21.15.45:0/1976129977 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb4004220 con 0x7f9ec00b4070 2023-11-28T18:38:00.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.214+0000 7f9ec7046640 1 -- 172.21.15.45:0/1976129977 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ec01387f0 con 0x7f9ec00b4070 2023-11-28T18:38:00.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.214+0000 7f9ec7046640 1 -- 172.21.15.45:0/1976129977 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ec0138db0 con 0x7f9ec00b4070 2023-11-28T18:38:00.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.218+0000 7f9ec7046640 1 -- 172.21.15.45:0/1976129977 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ec0138fa0 con 0x7f9ec00b4070 2023-11-28T18:38:00.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.218+0000 7f9ebd7fa640 1 -- 172.21.15.45:0/1976129977 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f9eb40b3040 con 0x7f9ec00b4070 2023-11-28T18:38:00.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.218+0000 7f9ebd7fa640 1 --2- 172.21.15.45:0/1976129977 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9ea40668d0 0x7f9ea4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:00.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.218+0000 7f9ebd7fa640 1 -- 172.21.15.45:0/1976129977 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9eb411e2a0 con 0x7f9ec00b4070 2023-11-28T18:38:00.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.218+0000 7f9ebffff640 1 --2- 172.21.15.45:0/1976129977 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9ea40668d0 0x7f9ea4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:00.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.218+0000 7f9ebffff640 1 --2- 172.21.15.45:0/1976129977 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9ea40668d0 0x7f9ea4068d90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9ec0141eb0 tx=0x7f9eac007d40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:00.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.230+0000 7f9ebd7fa640 1 -- 172.21.15.45:0/1976129977 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9eb40eb720 con 0x7f9ec00b4070 2023-11-28T18:38:00.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.386+0000 7f9ec7046640 1 -- 172.21.15.45:0/1976129977 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9ec0138650 con 0x7f9ec00b4070 2023-11-28T18:38:00.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.386+0000 7f9ebd7fa640 1 -- 172.21.15.45:0/1976129977 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9ec0138650 con 0x7f9ec00b4070 2023-11-28T18:38:00.394 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-11-28T18:38:00.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.386+0000 7f9ec7046640 1 -- 172.21.15.45:0/1976129977 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9ea40668d0 msgr2=0x7f9ea4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:00.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.386+0000 7f9ec7046640 1 --2- 172.21.15.45:0/1976129977 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9ea40668d0 0x7f9ea4068d90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9ec0141eb0 tx=0x7f9eac007d40 comp rx=0 tx=0).stop 2023-11-28T18:38:00.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.386+0000 7f9ec7046640 1 -- 172.21.15.45:0/1976129977 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ec00b4070 msgr2=0x7f9ec0144570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:00.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.386+0000 7f9ec7046640 1 --2- 172.21.15.45:0/1976129977 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ec00b4070 0x7f9ec0144570 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9eb40190d0 tx=0x7f9eb4019260 comp rx=0 tx=0).stop 2023-11-28T18:38:00.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.386+0000 7f9ec7046640 1 -- 172.21.15.45:0/1976129977 shutdown_connections 2023-11-28T18:38:00.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.386+0000 7f9ec7046640 1 --2- 172.21.15.45:0/1976129977 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9ea40668d0 0x7f9ea4068d90 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:00.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.386+0000 7f9ec7046640 1 --2- 172.21.15.45:0/1976129977 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ec015fde0 0x7f9ec0159be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:00.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.386+0000 7f9ec7046640 1 --2- 172.21.15.45:0/1976129977 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ec01469a0 0x7f9ec015a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:00.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.386+0000 7f9ec7046640 1 --2- 172.21.15.45:0/1976129977 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ec00b4070 0x7f9ec0144570 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:00.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.386+0000 7f9ec7046640 1 -- 172.21.15.45:0/1976129977 >> 172.21.15.45:0/1976129977 conn(0x7f9ec0070b80 msgr2=0x7f9ec006e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:00.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.386+0000 7f9ec7046640 1 -- 172.21.15.45:0/1976129977 shutdown_connections 2023-11-28T18:38:00.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.386+0000 7f9ec7046640 1 -- 172.21.15.45:0/1976129977 wait complete. 2023-11-28T18:38:00.413 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T18:38:00.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.550+0000 7f7fe1fe6640 1 Processor -- start 2023-11-28T18:38:00.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.550+0000 7f7fe1fe6640 1 -- start start 2023-11-28T18:38:00.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.554+0000 7f7fe1fe6640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7fdc06ca10 0x7f7fdc15a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:00.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.554+0000 7f7fe1fe6640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f7fdc15abb0 0x7f7fdc0cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:00.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.554+0000 7f7fe1fe6640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fdc15b3e0 con 0x7f7fdc13cf70 2023-11-28T18:38:00.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.554+0000 7f7fe1fe6640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fdc13d350 con 0x7f7fdc06ca10 2023-11-28T18:38:00.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.554+0000 7f7fe1fe6640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fdc140520 con 0x7f7fdc15abb0 2023-11-28T18:38:00.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.554+0000 7f7fdb7fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f7fdc13cf70 0x7f7fdc06c300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33690/0 (socket says 172.21.15.45:33690) 2023-11-28T18:38:00.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.554+0000 7f7fdb7fe640 1 -- 172.21.15.45:0/3776001206 learned_addr learned my addr 172.21.15.45:0/3776001206 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:38:00.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.554+0000 7f7fdaffd640 1 --2- 172.21.15.45:0/3776001206 >> v2:172.21.15.45:3300/0 conn(0x7f7fdc06ca10 0x7f7fdc15a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:00.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.554+0000 7f7fdbfff640 1 --2- 172.21.15.45:0/3776001206 >> v2:172.21.15.190:3300/0 conn(0x7f7fdc15abb0 0x7f7fdc0cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:00.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.554+0000 7f7fdaffd640 1 -- 172.21.15.45:0/3776001206 >> v2:172.21.15.190:3300/0 conn(0x7f7fdc15abb0 msgr2=0x7f7fdc0cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:00.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.554+0000 7f7fdaffd640 1 --2- 172.21.15.45:0/3776001206 >> v2:172.21.15.190:3300/0 conn(0x7f7fdc15abb0 0x7f7fdc0cd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:00.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.554+0000 7f7fdaffd640 1 -- 172.21.15.45:0/3776001206 >> v1:172.21.15.45:6789/0 conn(0x7f7fdc13cf70 legacy=0x7f7fdc06c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:00.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.554+0000 7f7fdaffd640 1 -- 172.21.15.45:0/3776001206 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fdc13f760 con 0x7f7fdc06ca10 2023-11-28T18:38:00.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.554+0000 7f7fdbfff640 1 --2- 172.21.15.45:0/3776001206 >> v2:172.21.15.190:3300/0 conn(0x7f7fdc15abb0 0x7f7fdc0cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:38:00.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.554+0000 7f7fda7fc640 1 -- 172.21.15.45:0/3776001206 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 831478283 0 0) 0x7f7fdc15b3e0 con 0x7f7fdc13cf70 2023-11-28T18:38:00.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.558+0000 7f7fdaffd640 1 --2- 172.21.15.45:0/3776001206 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7fdc06ca10 0x7f7fdc15a670 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc0725c0 tx=0x7f7fd001c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daf4bee8887399ca server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:00.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.558+0000 7f7fda7fc640 1 -- 172.21.15.45:0/3776001206 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd00ad680 con 0x7f7fdc06ca10 2023-11-28T18:38:00.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.558+0000 7f7fda7fc640 1 -- 172.21.15.45:0/3776001206 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fd00ad7e0 con 0x7f7fdc06ca10 2023-11-28T18:38:00.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.558+0000 7f7fda7fc640 1 -- 172.21.15.45:0/3776001206 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd00adb70 con 0x7f7fdc06ca10 2023-11-28T18:38:00.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.558+0000 7f7fe1fe6640 1 -- 172.21.15.45:0/3776001206 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7fdc06ca10 msgr2=0x7f7fdc15a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:00.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.558+0000 7f7fe1fe6640 1 --2- 172.21.15.45:0/3776001206 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7fdc06ca10 0x7f7fdc15a670 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc0725c0 tx=0x7f7fd001c380 comp rx=0 tx=0).stop 2023-11-28T18:38:00.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.558+0000 7f7fe1fe6640 1 -- 172.21.15.45:0/3776001206 shutdown_connections 2023-11-28T18:38:00.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.558+0000 7f7fe1fe6640 1 --2- 172.21.15.45:0/3776001206 >> v2:172.21.15.190:3300/0 conn(0x7f7fdc15abb0 0x7f7fdc0cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:00.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.558+0000 7f7fe1fe6640 1 --2- 172.21.15.45:0/3776001206 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7fdc06ca10 0x7f7fdc15a670 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:00.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.558+0000 7f7fe1fe6640 1 -- 172.21.15.45:0/3776001206 >> 172.21.15.45:0/3776001206 conn(0x7f7fdc06a570 msgr2=0x7f7fdc06a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:00.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.558+0000 7f7fe1fe6640 1 -- 172.21.15.45:0/3776001206 shutdown_connections 2023-11-28T18:38:00.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.558+0000 7f7fe1fe6640 1 -- 172.21.15.45:0/3776001206 wait complete. 2023-11-28T18:38:00.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.558+0000 7f7fe1fe6640 1 Processor -- start 2023-11-28T18:38:00.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.558+0000 7f7fe1fe6640 1 -- start start 2023-11-28T18:38:00.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.562+0000 7f7fe1fe6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7fdc06ca10 0x7f7fdc13d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:00.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.562+0000 7f7fe1fe6640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7fdc13cf70 0x7f7fdc13e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:00.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.562+0000 7f7fe1fe6640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7fdc15abb0 0x7f7fdc13e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:00.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.562+0000 7f7fe1fe6640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fdc13f030 con 0x7f7fdc06ca10 2023-11-28T18:38:00.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.562+0000 7f7fe1fe6640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fdc150450 con 0x7f7fdc13cf70 2023-11-28T18:38:00.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.562+0000 7f7fe1fe6640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fdc150730 con 0x7f7fdc15abb0 2023-11-28T18:38:00.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.562+0000 7f7fdb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7fdc06ca10 0x7f7fdc13d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:00.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.562+0000 7f7fdb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7fdc06ca10 0x7f7fdc13d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53228/0 (socket says 172.21.15.45:53228) 2023-11-28T18:38:00.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.562+0000 7f7fdb7fe640 1 -- 172.21.15.45:0/1147581337 learned_addr learned my addr 172.21.15.45:0/1147581337 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:00.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.562+0000 7f7fdaffd640 1 --2- 172.21.15.45:0/1147581337 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7fdc13cf70 0x7f7fdc13e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:00.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.562+0000 7f7fdbfff640 1 --2- 172.21.15.45:0/1147581337 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7fdc15abb0 0x7f7fdc13e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:00.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.562+0000 7f7fdb7fe640 1 -- 172.21.15.45:0/1147581337 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7fdc15abb0 msgr2=0x7f7fdc13e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:00.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.562+0000 7f7fdb7fe640 1 --2- 172.21.15.45:0/1147581337 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7fdc15abb0 0x7f7fdc13e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:00.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.562+0000 7f7fdb7fe640 1 -- 172.21.15.45:0/1147581337 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7fdc13cf70 msgr2=0x7f7fdc13e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:00.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.562+0000 7f7fdb7fe640 1 --2- 172.21.15.45:0/1147581337 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7fdc13cf70 0x7f7fdc13e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:00.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.562+0000 7f7fdb7fe640 1 -- 172.21.15.45:0/1147581337 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fd0009420 con 0x7f7fdc06ca10 2023-11-28T18:38:00.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.562+0000 7f7fdbfff640 1 --2- 172.21.15.45:0/1147581337 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7fdc15abb0 0x7f7fdc13e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:38:00.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.562+0000 7f7fdb7fe640 1 --2- 172.21.15.45:0/1147581337 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7fdc06ca10 0x7f7fdc13d4a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc0011f0 tx=0x7f7fcc00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:00.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.562+0000 7f7fc3fff640 1 -- 172.21.15.45:0/1147581337 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fcc0074e0 con 0x7f7fdc06ca10 2023-11-28T18:38:00.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.562+0000 7f7fc3fff640 1 -- 172.21.15.45:0/1147581337 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fcc007640 con 0x7f7fdc06ca10 2023-11-28T18:38:00.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.562+0000 7f7fc3fff640 1 -- 172.21.15.45:0/1147581337 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fcc004a10 con 0x7f7fdc06ca10 2023-11-28T18:38:00.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.562+0000 7f7fe1fe6640 1 -- 172.21.15.45:0/1147581337 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fdc150a10 con 0x7f7fdc06ca10 2023-11-28T18:38:00.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.562+0000 7f7fe1fe6640 1 -- 172.21.15.45:0/1147581337 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fdc14f210 con 0x7f7fdc06ca10 2023-11-28T18:38:00.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.562+0000 7f7fe1fe6640 1 -- 172.21.15.45:0/1147581337 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fdc13a940 con 0x7f7fdc06ca10 2023-11-28T18:38:00.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.562+0000 7f7fc3fff640 1 -- 172.21.15.45:0/1147581337 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f7fcc004b70 con 0x7f7fdc06ca10 2023-11-28T18:38:00.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.566+0000 7f7fc3fff640 1 --2- 172.21.15.45:0/1147581337 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f7fc80668d0 0x7f7fc8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:00.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.566+0000 7f7fc3fff640 1 -- 172.21.15.45:0/1147581337 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7fcc083670 con 0x7f7fdc06ca10 2023-11-28T18:38:00.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.566+0000 7f7fdaffd640 1 --2- 172.21.15.45:0/1147581337 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f7fc80668d0 0x7f7fc8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:00.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.566+0000 7f7fdaffd640 1 --2- 172.21.15.45:0/1147581337 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f7fc80668d0 0x7f7fc8068d90 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7fd00af000 tx=0x7f7fd00a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:00.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.574+0000 7f7fc3fff640 1 -- 172.21.15.45:0/1147581337 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7fcc050960 con 0x7f7fdc06ca10 2023-11-28T18:38:00.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.726+0000 7f7fe1fe6640 1 -- 172.21.15.45:0/1147581337 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7fdc069480 con 0x7f7fdc06ca10 2023-11-28T18:38:00.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.726+0000 7f7fc3fff640 1 -- 172.21.15.45:0/1147581337 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16469 (secure 0 0 0) 0x7f7fcc018090 con 0x7f7fdc06ca10 2023-11-28T18:38:00.734 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:38:00.734 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":20,"fsid":"d10f5cd6-1d00-4019-99b6-6fa435498a15","created":"2023-11-28T18:37:08.189030+0000","modified":"2023-11-28T18:37:33.971141+0000","last_up_change":"2023-11-28T18:37:20.196124+0000","last_in_change":"2023-11-28T18:37:10.742043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T18:37:21.293917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T18:37:31.384760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T18:37:31.834769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"84465384-103c-4f2c-a45a-96f5bb9c835f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6809","nonce":555237322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6811","nonce":555237322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6815","nonce":555237322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6813","nonce":555237322}]},"public_addr":"172.21.15.45:6809/555237322","cluster_addr":"172.21.15.45:6811/555237322","heartbeat_back_addr":"172.21.15.45:6815/555237322","heartbeat_front_addr":"172.21.15.45:6813/555237322","state":["exists","up"]},{"osd":1,"uuid":"7d9eed24-a58f-42c7-a787-ac06be8553fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6801","nonce":2857063763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6803","nonce":2857063763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6807","nonce":2857063763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6805","nonce":2857063763}]},"public_addr":"172.21.15.45:6801/2857063763","cluster_addr":"172.21.15.45:6803/2857063763","heartbeat_back_addr":"172.21.15.45:6807/2857063763","heartbeat_front_addr":"172.21.15.45:6805/2857063763","state":["exists","up"]},{"osd":2,"uuid":"575eeccc-4abf-45b4-9caf-f3e797859588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6817","nonce":193884539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6819","nonce":193884539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6823","nonce":193884539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6821","nonce":193884539}]},"public_addr":"172.21.15.45:6817/193884539","cluster_addr":"172.21.15.45:6819/193884539","heartbeat_back_addr":"172.21.15.45:6823/193884539","heartbeat_front_addr":"172.21.15.45:6821/193884539","state":["exists","up"]},{"osd":3,"uuid":"9b0290d6-9a52-4bc8-b2a1-7622c5dc8e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6825","nonce":78541084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6827","nonce":78541084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6831","nonce":78541084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6829","nonce":78541084}]},"public_addr":"172.21.15.45:6825/78541084","cluster_addr":"172.21.15.45:6827/78541084","heartbeat_back_addr":"172.21.15.45:6831/78541084","heartbeat_front_addr":"172.21.15.45:6829/78541084","state":["exists","up"]},{"osd":4,"uuid":"ce632829-f027-4fbf-a627-02c571aa9d53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6809","nonce":1537591987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6811","nonce":1537591987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6815","nonce":1537591987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6813","nonce":1537591987}]},"public_addr":"172.21.15.190:6809/1537591987","cluster_addr":"172.21.15.190:6811/1537591987","heartbeat_back_addr":"172.21.15.190:6815/1537591987","heartbeat_front_addr":"172.21.15.190:6813/1537591987","state":["exists","up"]},{"osd":5,"uuid":"8700b609-27be-40bd-a251-4c0ae0a29ead","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6801","nonce":3296698407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6803","nonce":3296698407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6807","nonce":3296698407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6805","nonce":3296698407}]},"public_addr":"172.21.15.190:6801/3296698407","cluster_addr":"172.21.15.190:6803/3296698407","heartbeat_back_addr":"172.21.15.190:6807/3296698407","heartbeat_front_addr":"172.21.15.190:6805/3296698407","state":["exists","up"]},{"osd":6,"uuid":"44ce4a40-e6ff-4f4d-8e8a-7341e5c91f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6817","nonce":2317686718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6819","nonce":2317686718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6823","nonce":2317686718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6821","nonce":2317686718}]},"public_addr":"172.21.15.190:6817/2317686718","cluster_addr":"172.21.15.190:6819/2317686718","heartbeat_back_addr":"172.21.15.190:6823/2317686718","heartbeat_front_addr":"172.21.15.190:6821/2317686718","state":["exists","up"]},{"osd":7,"uuid":"192238c9-1423-4b7e-ac8f-84ba32113ddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6825","nonce":2493232051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6827","nonce":2493232051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6831","nonce":2493232051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6829","nonce":2493232051}]},"public_addr":"172.21.15.190:6825/2493232051","cluster_addr":"172.21.15.190:6827/2493232051","heartbeat_back_addr":"172.21.15.190:6831/2493232051","heartbeat_front_addr":"172.21.15.190:6829/2493232051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.393552+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.385453+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.361421+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.366408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.363226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.276007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.414605+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.445885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T18:38:00.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.730+0000 7f7fe1fe6640 1 -- 172.21.15.45:0/1147581337 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f7fc80668d0 msgr2=0x7f7fc8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:00.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.730+0000 7f7fe1fe6640 1 --2- 172.21.15.45:0/1147581337 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f7fc80668d0 0x7f7fc8068d90 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7fd00af000 tx=0x7f7fd00a7000 comp rx=0 tx=0).stop 2023-11-28T18:38:00.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.730+0000 7f7fe1fe6640 1 -- 172.21.15.45:0/1147581337 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7fdc06ca10 msgr2=0x7f7fdc13d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:00.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.730+0000 7f7fe1fe6640 1 --2- 172.21.15.45:0/1147581337 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7fdc06ca10 0x7f7fdc13d4a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc0011f0 tx=0x7f7fcc00c9b0 comp rx=0 tx=0).stop 2023-11-28T18:38:00.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.730+0000 7f7fe1fe6640 1 -- 172.21.15.45:0/1147581337 shutdown_connections 2023-11-28T18:38:00.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.730+0000 7f7fe1fe6640 1 --2- 172.21.15.45:0/1147581337 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f7fc80668d0 0x7f7fc8068d90 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:00.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.730+0000 7f7fe1fe6640 1 --2- 172.21.15.45:0/1147581337 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7fdc15abb0 0x7f7fdc13e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:00.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.730+0000 7f7fe1fe6640 1 --2- 172.21.15.45:0/1147581337 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7fdc13cf70 0x7f7fdc13e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:00.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.730+0000 7f7fe1fe6640 1 --2- 172.21.15.45:0/1147581337 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7fdc06ca10 0x7f7fdc13d4a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:00.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.730+0000 7f7fe1fe6640 1 -- 172.21.15.45:0/1147581337 >> 172.21.15.45:0/1147581337 conn(0x7f7fdc06a570 msgr2=0x7f7fdc15a340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:00.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.730+0000 7f7fe1fe6640 1 -- 172.21.15.45:0/1147581337 shutdown_connections 2023-11-28T18:38:00.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.730+0000 7f7fe1fe6640 1 -- 172.21.15.45:0/1147581337 wait complete. 2023-11-28T18:38:00.756 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T18:37:21.293917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T18:37:31.384760+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T18:37:31.834769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T18:38:00.756 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T18:38:00.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.902+0000 7fc59371d640 1 Processor -- start 2023-11-28T18:38:00.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.902+0000 7fc59371d640 1 -- start start 2023-11-28T18:38:00.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.902+0000 7fc59371d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc58c15adf0 0x7fc58c13d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:00.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.902+0000 7fc59371d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc58c13f630 0x7fc58c0ce240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:00.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.902+0000 7fc59371d640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc58c13d2f0 con 0x7fc58c071dd0 2023-11-28T18:38:00.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.902+0000 7fc59371d640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc58c140560 con 0x7fc58c15adf0 2023-11-28T18:38:00.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.902+0000 7fc59371d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc58c0cd830 con 0x7fc58c13f630 2023-11-28T18:38:00.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.902+0000 7fc590cb8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc58c15adf0 0x7fc58c13d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:00.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.902+0000 7fc5914b9640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fc58c071dd0 0x7fc58c0721b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33706/0 (socket says 172.21.15.45:33706) 2023-11-28T18:38:00.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.902+0000 7fc590cb8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc58c15adf0 0x7fc58c13d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53244/0 (socket says 172.21.15.45:53244) 2023-11-28T18:38:00.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.902+0000 7fc5914b9640 1 -- 172.21.15.45:0/3478974775 learned_addr learned my addr 172.21.15.45:0/3478974775 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:38:00.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.902+0000 7fc591cba640 1 --2- 172.21.15.45:0/3478974775 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc58c13f630 0x7fc58c0ce240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:00.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.902+0000 7fc590cb8640 1 -- 172.21.15.45:0/3478974775 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc58c13f630 msgr2=0x7fc58c0ce240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:00.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.902+0000 7fc590cb8640 1 --2- 172.21.15.45:0/3478974775 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc58c13f630 0x7fc58c0ce240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:00.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.902+0000 7fc590cb8640 1 -- 172.21.15.45:0/3478974775 >> v1:172.21.15.45:6789/0 conn(0x7fc58c071dd0 legacy=0x7fc58c0721b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:00.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.902+0000 7fc590cb8640 1 -- 172.21.15.45:0/3478974775 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc58c0cddb0 con 0x7fc58c15adf0 2023-11-28T18:38:00.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.902+0000 7fc583fff640 1 -- 172.21.15.45:0/3478974775 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2162622063 0 0) 0x7fc58c13d2f0 con 0x7fc58c071dd0 2023-11-28T18:38:00.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.906+0000 7fc590cb8640 1 --2- 172.21.15.45:0/3478974775 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc58c15adf0 0x7fc58c13d5a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc57c0097c0 tx=0x7fc57c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1216ad3b5533d9e8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:00.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.906+0000 7fc583fff640 1 -- 172.21.15.45:0/3478974775 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57c004230 con 0x7fc58c15adf0 2023-11-28T18:38:00.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.906+0000 7fc583fff640 1 -- 172.21.15.45:0/3478974775 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc57c0a7050 con 0x7fc58c15adf0 2023-11-28T18:38:00.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.906+0000 7fc583fff640 1 -- 172.21.15.45:0/3478974775 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57c003620 con 0x7fc58c15adf0 2023-11-28T18:38:00.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.906+0000 7fc59371d640 1 -- 172.21.15.45:0/3478974775 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc58c15adf0 msgr2=0x7fc58c13d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:00.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.906+0000 7fc59371d640 1 --2- 172.21.15.45:0/3478974775 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc58c15adf0 0x7fc58c13d5a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc57c0097c0 tx=0x7fc57c01c450 comp rx=0 tx=0).stop 2023-11-28T18:38:00.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.906+0000 7fc59371d640 1 -- 172.21.15.45:0/3478974775 shutdown_connections 2023-11-28T18:38:00.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.906+0000 7fc59371d640 1 --2- 172.21.15.45:0/3478974775 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc58c13f630 0x7fc58c0ce240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:00.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.906+0000 7fc59371d640 1 --2- 172.21.15.45:0/3478974775 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc58c15adf0 0x7fc58c13d5a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:00.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.906+0000 7fc59371d640 1 -- 172.21.15.45:0/3478974775 >> 172.21.15.45:0/3478974775 conn(0x7fc58c0b0d00 msgr2=0x7fc58c0b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:00.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.906+0000 7fc59371d640 1 -- 172.21.15.45:0/3478974775 shutdown_connections 2023-11-28T18:38:00.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.906+0000 7fc59371d640 1 -- 172.21.15.45:0/3478974775 wait complete. 2023-11-28T18:38:00.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.910+0000 7fc59371d640 1 Processor -- start 2023-11-28T18:38:00.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.910+0000 7fc59371d640 1 -- start start 2023-11-28T18:38:00.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.910+0000 7fc59371d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc58c071dd0 0x7fc58c153fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:00.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.910+0000 7fc59371d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc58c13f630 0x7fc58c0b4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:00.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.910+0000 7fc59371d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc58c15adf0 0x7fc58c1f6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:00.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.910+0000 7fc59371d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58c1f7930 con 0x7fc58c071dd0 2023-11-28T18:38:00.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.910+0000 7fc59371d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58c1f7370 con 0x7fc58c15adf0 2023-11-28T18:38:00.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.910+0000 7fc59371d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc58c1f7650 con 0x7fc58c13f630 2023-11-28T18:38:00.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.910+0000 7fc5914b9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc58c071dd0 0x7fc58c153fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:00.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.910+0000 7fc5914b9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc58c071dd0 0x7fc58c153fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53248/0 (socket says 172.21.15.45:53248) 2023-11-28T18:38:00.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.910+0000 7fc5914b9640 1 -- 172.21.15.45:0/512467554 learned_addr learned my addr 172.21.15.45:0/512467554 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:00.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.910+0000 7fc590cb8640 1 --2- 172.21.15.45:0/512467554 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc58c13f630 0x7fc58c0b4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:00.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.910+0000 7fc5914b9640 1 -- 172.21.15.45:0/512467554 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc58c13f630 msgr2=0x7fc58c0b4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:00.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.910+0000 7fc591cba640 1 --2- 172.21.15.45:0/512467554 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc58c15adf0 0x7fc58c1f6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:00.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.910+0000 7fc5914b9640 1 --2- 172.21.15.45:0/512467554 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc58c13f630 0x7fc58c0b4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:00.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.910+0000 7fc5914b9640 1 -- 172.21.15.45:0/512467554 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc58c15adf0 msgr2=0x7fc58c1f6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:00.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.910+0000 7fc5914b9640 1 --2- 172.21.15.45:0/512467554 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc58c15adf0 0x7fc58c1f6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:00.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.910+0000 7fc5914b9640 1 -- 172.21.15.45:0/512467554 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc57c009420 con 0x7fc58c071dd0 2023-11-28T18:38:00.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.910+0000 7fc590cb8640 1 --2- 172.21.15.45:0/512467554 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc58c13f630 0x7fc58c0b4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:38:00.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.910+0000 7fc591cba640 1 --2- 172.21.15.45:0/512467554 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc58c15adf0 0x7fc58c1f6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:38:00.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.910+0000 7fc5914b9640 1 --2- 172.21.15.45:0/512467554 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc58c071dd0 0x7fc58c153fc0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc5880011f0 tx=0x7fc58800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:00.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.910+0000 7fc581ffb640 1 -- 172.21.15.45:0/512467554 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5880074e0 con 0x7fc58c071dd0 2023-11-28T18:38:00.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.910+0000 7fc581ffb640 1 -- 172.21.15.45:0/512467554 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc588007640 con 0x7fc58c071dd0 2023-11-28T18:38:00.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.910+0000 7fc581ffb640 1 -- 172.21.15.45:0/512467554 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc588004a10 con 0x7fc58c071dd0 2023-11-28T18:38:00.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.910+0000 7fc59371d640 1 -- 172.21.15.45:0/512467554 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc58c1537c0 con 0x7fc58c071dd0 2023-11-28T18:38:00.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.910+0000 7fc59371d640 1 -- 172.21.15.45:0/512467554 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc58c1fa080 con 0x7fc58c071dd0 2023-11-28T18:38:00.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.910+0000 7fc59371d640 1 -- 172.21.15.45:0/512467554 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc58c153620 con 0x7fc58c071dd0 2023-11-28T18:38:00.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.914+0000 7fc581ffb640 1 -- 172.21.15.45:0/512467554 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fc588004b70 con 0x7fc58c071dd0 2023-11-28T18:38:00.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.914+0000 7fc581ffb640 1 --2- 172.21.15.45:0/512467554 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fc570066900 0x7fc570068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:00.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.914+0000 7fc581ffb640 1 -- 172.21.15.45:0/512467554 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc5880835f0 con 0x7fc58c071dd0 2023-11-28T18:38:00.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.914+0000 7fc590cb8640 1 --2- 172.21.15.45:0/512467554 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fc570066900 0x7fc570068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:00.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.914+0000 7fc590cb8640 1 --2- 172.21.15.45:0/512467554 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fc570066900 0x7fc570068dc0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc57c0ad000 tx=0x7fc57c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:00.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:00.918+0000 7fc581ffb640 1 -- 172.21.15.45:0/512467554 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc58c153620 con 0x7fc58c071dd0 2023-11-28T18:38:01.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.078+0000 7fc59371d640 1 -- 172.21.15.45:0/512467554 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc58c153620 con 0x7fc58c071dd0 2023-11-28T18:38:01.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.078+0000 7fc581ffb640 1 -- 172.21.15.45:0/512467554 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc588018020 con 0x7fc58c071dd0 2023-11-28T18:38:01.081 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-11-28T18:38:01.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.082+0000 7fc59371d640 1 -- 172.21.15.45:0/512467554 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fc570066900 msgr2=0x7fc570068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:01.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.082+0000 7fc59371d640 1 --2- 172.21.15.45:0/512467554 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fc570066900 0x7fc570068dc0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc57c0ad000 tx=0x7fc57c0a6000 comp rx=0 tx=0).stop 2023-11-28T18:38:01.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.082+0000 7fc59371d640 1 -- 172.21.15.45:0/512467554 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc58c071dd0 msgr2=0x7fc58c153fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:01.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.082+0000 7fc59371d640 1 --2- 172.21.15.45:0/512467554 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc58c071dd0 0x7fc58c153fc0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc5880011f0 tx=0x7fc58800c9b0 comp rx=0 tx=0).stop 2023-11-28T18:38:01.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.082+0000 7fc59371d640 1 -- 172.21.15.45:0/512467554 shutdown_connections 2023-11-28T18:38:01.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.082+0000 7fc59371d640 1 --2- 172.21.15.45:0/512467554 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fc570066900 0x7fc570068dc0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:01.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.082+0000 7fc59371d640 1 --2- 172.21.15.45:0/512467554 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc58c15adf0 0x7fc58c1f6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:01.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.082+0000 7fc59371d640 1 --2- 172.21.15.45:0/512467554 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc58c13f630 0x7fc58c0b4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:01.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.082+0000 7fc59371d640 1 --2- 172.21.15.45:0/512467554 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc58c071dd0 0x7fc58c153fc0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:01.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.082+0000 7fc59371d640 1 -- 172.21.15.45:0/512467554 >> 172.21.15.45:0/512467554 conn(0x7fc58c0b0d00 msgr2=0x7fc58c13dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:01.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.082+0000 7fc59371d640 1 -- 172.21.15.45:0/512467554 shutdown_connections 2023-11-28T18:38:01.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.082+0000 7fc59371d640 1 -- 172.21.15.45:0/512467554 wait complete. 2023-11-28T18:38:01.104 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T18:38:01.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.250+0000 7f058ef2a640 1 Processor -- start 2023-11-28T18:38:01.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.250+0000 7f058ef2a640 1 -- start start 2023-11-28T18:38:01.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.250+0000 7f058ef2a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0588143a50 0x7f058806f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:01.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.250+0000 7f058ef2a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f05881467a0 0x7f058806a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:01.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.250+0000 7f058ef2a640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f058806f980 con 0x7f058806aab0 2023-11-28T18:38:01.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.250+0000 7f058ef2a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0588161a10 con 0x7f05881467a0 2023-11-28T18:38:01.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.250+0000 7f058ef2a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05881470a0 con 0x7f0588143a50 2023-11-28T18:38:01.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.250+0000 7f0587fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f05881467a0 0x7f058806a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:01.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.250+0000 7f058d4c7640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f058806aab0 0x7f0588071540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33722/0 (socket says 172.21.15.45:33722) 2023-11-28T18:38:01.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.250+0000 7f058d4c7640 1 -- 172.21.15.45:0/327511671 learned_addr learned my addr 172.21.15.45:0/327511671 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:38:01.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.250+0000 7f058ccc6640 1 --2- 172.21.15.45:0/327511671 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0588143a50 0x7f058806f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:01.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.250+0000 7f0587fff640 1 -- 172.21.15.45:0/327511671 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0588143a50 msgr2=0x7f058806f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:01.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.250+0000 7f0587fff640 1 --2- 172.21.15.45:0/327511671 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0588143a50 0x7f058806f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:01.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.250+0000 7f0587fff640 1 -- 172.21.15.45:0/327511671 >> v1:172.21.15.45:6789/0 conn(0x7f058806aab0 legacy=0x7f0588071540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:01.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.250+0000 7f0587fff640 1 -- 172.21.15.45:0/327511671 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0588161070 con 0x7f05881467a0 2023-11-28T18:38:01.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.254+0000 7f0587fff640 1 --2- 172.21.15.45:0/327511671 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05881467a0 0x7f058806a570 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f05740097c0 tx=0x7f057401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fed3e2ae165c4e5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:01.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.254+0000 7f05877fe640 1 -- 172.21.15.45:0/327511671 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05740ab600 con 0x7f05881467a0 2023-11-28T18:38:01.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.254+0000 7f05877fe640 1 -- 172.21.15.45:0/327511671 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05740a7050 con 0x7f05881467a0 2023-11-28T18:38:01.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.254+0000 7f05877fe640 1 -- 172.21.15.45:0/327511671 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05740ab980 con 0x7f05881467a0 2023-11-28T18:38:01.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.254+0000 7f058ef2a640 1 -- 172.21.15.45:0/327511671 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05881467a0 msgr2=0x7f058806a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:01.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.254+0000 7f058ef2a640 1 --2- 172.21.15.45:0/327511671 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05881467a0 0x7f058806a570 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f05740097c0 tx=0x7f057401c3f0 comp rx=0 tx=0).stop 2023-11-28T18:38:01.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.254+0000 7f058ef2a640 1 -- 172.21.15.45:0/327511671 shutdown_connections 2023-11-28T18:38:01.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.254+0000 7f058ef2a640 1 --2- 172.21.15.45:0/327511671 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05881467a0 0x7f058806a570 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:01.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.254+0000 7f058ef2a640 1 --2- 172.21.15.45:0/327511671 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0588143a50 0x7f058806f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:01.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.254+0000 7f058ef2a640 1 -- 172.21.15.45:0/327511671 >> 172.21.15.45:0/327511671 conn(0x7f05880b1df0 msgr2=0x7f05880b2200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:01.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.254+0000 7f058ef2a640 1 -- 172.21.15.45:0/327511671 shutdown_connections 2023-11-28T18:38:01.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.254+0000 7f058ef2a640 1 -- 172.21.15.45:0/327511671 wait complete. 2023-11-28T18:38:01.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.254+0000 7f058ef2a640 1 Processor -- start 2023-11-28T18:38:01.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.254+0000 7f058ef2a640 1 -- start start 2023-11-28T18:38:01.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.258+0000 7f058ef2a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f058806aab0 0x7f058813f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:01.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.258+0000 7f058ef2a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0588143a50 0x7f05880af6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:01.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.258+0000 7f058ef2a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f05881467a0 0x7f058815fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:01.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.258+0000 7f058ef2a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05880b1380 con 0x7f058806aab0 2023-11-28T18:38:01.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.258+0000 7f058ef2a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058813e650 con 0x7f05881467a0 2023-11-28T18:38:01.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.258+0000 7f058ef2a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f058813e8f0 con 0x7f0588143a50 2023-11-28T18:38:01.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.258+0000 7f058ccc6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f058806aab0 0x7f058813f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:01.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.258+0000 7f058ccc6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f058806aab0 0x7f058813f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53264/0 (socket says 172.21.15.45:53264) 2023-11-28T18:38:01.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.258+0000 7f058ccc6640 1 -- 172.21.15.45:0/236468477 learned_addr learned my addr 172.21.15.45:0/236468477 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:01.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.258+0000 7f0587fff640 1 --2- 172.21.15.45:0/236468477 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0588143a50 0x7f05880af6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:01.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.258+0000 7f058d4c7640 1 --2- 172.21.15.45:0/236468477 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f05881467a0 0x7f058815fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:01.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.258+0000 7f058ccc6640 1 -- 172.21.15.45:0/236468477 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0588143a50 msgr2=0x7f05880af6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:01.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.258+0000 7f058ccc6640 1 --2- 172.21.15.45:0/236468477 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0588143a50 0x7f05880af6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:01.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.258+0000 7f058ccc6640 1 -- 172.21.15.45:0/236468477 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f05881467a0 msgr2=0x7f058815fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:01.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.258+0000 7f058ccc6640 1 --2- 172.21.15.45:0/236468477 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f05881467a0 0x7f058815fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:01.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.258+0000 7f058ccc6640 1 -- 172.21.15.45:0/236468477 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0574009420 con 0x7f058806aab0 2023-11-28T18:38:01.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.258+0000 7f058ccc6640 1 --2- 172.21.15.45:0/236468477 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f058806aab0 0x7f058813f990 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f057c00d800 tx=0x7f057c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:01.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.258+0000 7f05857fa640 1 -- 172.21.15.45:0/236468477 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057c00b6c0 con 0x7f058806aab0 2023-11-28T18:38:01.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.258+0000 7f05857fa640 1 -- 172.21.15.45:0/236468477 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f057c00b820 con 0x7f058806aab0 2023-11-28T18:38:01.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.258+0000 7f058ef2a640 1 -- 172.21.15.45:0/236468477 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f058813ebd0 con 0x7f058806aab0 2023-11-28T18:38:01.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.258+0000 7f05857fa640 1 -- 172.21.15.45:0/236468477 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057c00bb90 con 0x7f058806aab0 2023-11-28T18:38:01.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.258+0000 7f058ef2a640 1 -- 172.21.15.45:0/236468477 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0588140000 con 0x7f058806aab0 2023-11-28T18:38:01.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.258+0000 7f058ef2a640 1 -- 172.21.15.45:0/236468477 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0588069410 con 0x7f058806aab0 2023-11-28T18:38:01.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.262+0000 7f05857fa640 1 -- 172.21.15.45:0/236468477 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f057c00bcf0 con 0x7f058806aab0 2023-11-28T18:38:01.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.262+0000 7f05857fa640 1 --2- 172.21.15.45:0/236468477 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f056c0668d0 0x7f056c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:01.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.262+0000 7f05857fa640 1 -- 172.21.15.45:0/236468477 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f057c0849c0 con 0x7f058806aab0 2023-11-28T18:38:01.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.262+0000 7f0587fff640 1 --2- 172.21.15.45:0/236468477 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f056c0668d0 0x7f056c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:01.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.262+0000 7f0587fff640 1 --2- 172.21.15.45:0/236468477 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f056c0668d0 0x7f056c068d90 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f05740ad000 tx=0x7f05740a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:01.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.266+0000 7f05857fa640 1 -- 172.21.15.45:0/236468477 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f057c051bf0 con 0x7f058806aab0 2023-11-28T18:38:01.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.422+0000 7f058ef2a640 1 -- 172.21.15.45:0/236468477 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0588146e80 con 0x7f058806aab0 2023-11-28T18:38:01.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.422+0000 7f05857fa640 1 -- 172.21.15.45:0/236468477 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f057c055210 con 0x7f058806aab0 2023-11-28T18:38:01.424 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-11-28T18:38:01.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.422+0000 7f058ef2a640 1 -- 172.21.15.45:0/236468477 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f056c0668d0 msgr2=0x7f056c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:01.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.422+0000 7f058ef2a640 1 --2- 172.21.15.45:0/236468477 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f056c0668d0 0x7f056c068d90 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f05740ad000 tx=0x7f05740a6000 comp rx=0 tx=0).stop 2023-11-28T18:38:01.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.422+0000 7f058ef2a640 1 -- 172.21.15.45:0/236468477 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f058806aab0 msgr2=0x7f058813f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:01.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.422+0000 7f058ef2a640 1 --2- 172.21.15.45:0/236468477 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f058806aab0 0x7f058813f990 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f057c00d800 tx=0x7f057c00dcc0 comp rx=0 tx=0).stop 2023-11-28T18:38:01.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.422+0000 7f058ef2a640 1 -- 172.21.15.45:0/236468477 shutdown_connections 2023-11-28T18:38:01.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.422+0000 7f058ef2a640 1 --2- 172.21.15.45:0/236468477 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f056c0668d0 0x7f056c068d90 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:01.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.422+0000 7f058ef2a640 1 --2- 172.21.15.45:0/236468477 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f05881467a0 0x7f058815fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:01.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.422+0000 7f058ef2a640 1 --2- 172.21.15.45:0/236468477 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0588143a50 0x7f05880af6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:01.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.422+0000 7f058ef2a640 1 --2- 172.21.15.45:0/236468477 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f058806aab0 0x7f058813f990 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:01.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.422+0000 7f058ef2a640 1 -- 172.21.15.45:0/236468477 >> 172.21.15.45:0/236468477 conn(0x7f05880b1df0 msgr2=0x7f0588145ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:01.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.426+0000 7f058ef2a640 1 -- 172.21.15.45:0/236468477 shutdown_connections 2023-11-28T18:38:01.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.426+0000 7f058ef2a640 1 -- 172.21.15.45:0/236468477 wait complete. 2023-11-28T18:38:01.446 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T18:38:01.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.590+0000 7fc1d525f640 1 Processor -- start 2023-11-28T18:38:01.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.590+0000 7fc1d525f640 1 -- start start 2023-11-28T18:38:01.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.590+0000 7fc1d525f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc1d0071dd0 0x7fc1d00721b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:01.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.590+0000 7fc1d525f640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fc1d015adf0 0x7fc1d013d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:01.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.590+0000 7fc1d525f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc1d013f630 0x7fc1d00ce240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:01.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.590+0000 7fc1d525f640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1d0140560 con 0x7fc1d0071dd0 2023-11-28T18:38:01.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.590+0000 7fc1d525f640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1d00cd830 con 0x7fc1d015adf0 2023-11-28T18:38:01.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.590+0000 7fc1d525f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d013d2f0 con 0x7fc1d013f630 2023-11-28T18:38:01.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.590+0000 7fc1ced9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc1d0071dd0 0x7fc1d00721b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:01.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.590+0000 7fc1ced9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc1d0071dd0 0x7fc1d00721b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53280/0 (socket says 172.21.15.45:53280) 2023-11-28T18:38:01.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.590+0000 7fc1ced9d640 1 -- 172.21.15.45:0/3154670220 learned_addr learned my addr 172.21.15.45:0/3154670220 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:01.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.590+0000 7fc1ced9d640 1 -- 172.21.15.45:0/3154670220 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc1d013f630 msgr2=0x7fc1d00ce240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:01.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.590+0000 7fc1ced9d640 1 --2- 172.21.15.45:0/3154670220 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc1d013f630 0x7fc1d00ce240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:01.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.590+0000 7fc1ced9d640 1 -- 172.21.15.45:0/3154670220 >> v2:172.21.15.190:3300/0 conn(0x7fc1d015adf0 msgr2=0x7fc1d013d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:01.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.590+0000 7fc1ced9d640 1 --2- 172.21.15.45:0/3154670220 >> v2:172.21.15.190:3300/0 conn(0x7fc1d015adf0 0x7fc1d013d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:01.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.590+0000 7fc1ced9d640 1 -- 172.21.15.45:0/3154670220 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d00cddb0 con 0x7fc1d0071dd0 2023-11-28T18:38:01.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.594+0000 7fc1ced9d640 1 --2- 172.21.15.45:0/3154670220 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc1d0071dd0 0x7fc1d00721b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0074510 tx=0x7fc1c001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efe042e79913959b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:01.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.594+0000 7fc1ce59c640 1 -- 172.21.15.45:0/3154670220 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c00aa620 con 0x7fc1d0071dd0 2023-11-28T18:38:01.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.594+0000 7fc1ce59c640 1 -- 172.21.15.45:0/3154670220 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1c00aa780 con 0x7fc1d0071dd0 2023-11-28T18:38:01.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.594+0000 7fc1ce59c640 1 -- 172.21.15.45:0/3154670220 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c00aab10 con 0x7fc1d0071dd0 2023-11-28T18:38:01.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.594+0000 7fc1d525f640 1 -- 172.21.15.45:0/3154670220 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc1d0071dd0 msgr2=0x7fc1d00721b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:01.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.594+0000 7fc1d525f640 1 --2- 172.21.15.45:0/3154670220 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc1d0071dd0 0x7fc1d00721b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0074510 tx=0x7fc1c001c500 comp rx=0 tx=0).stop 2023-11-28T18:38:01.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.594+0000 7fc1d525f640 1 -- 172.21.15.45:0/3154670220 shutdown_connections 2023-11-28T18:38:01.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.594+0000 7fc1d525f640 1 --2- 172.21.15.45:0/3154670220 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc1d013f630 0x7fc1d00ce240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:01.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.594+0000 7fc1d525f640 1 --2- 172.21.15.45:0/3154670220 >> v2:172.21.15.190:3300/0 conn(0x7fc1d015adf0 0x7fc1d013d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:01.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.594+0000 7fc1d525f640 1 --2- 172.21.15.45:0/3154670220 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc1d0071dd0 0x7fc1d00721b0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:01.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.594+0000 7fc1d525f640 1 -- 172.21.15.45:0/3154670220 >> 172.21.15.45:0/3154670220 conn(0x7fc1d00b0d00 msgr2=0x7fc1d00b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:01.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.594+0000 7fc1d525f640 1 -- 172.21.15.45:0/3154670220 shutdown_connections 2023-11-28T18:38:01.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.594+0000 7fc1d525f640 1 -- 172.21.15.45:0/3154670220 wait complete. 2023-11-28T18:38:01.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.598+0000 7fc1d525f640 1 Processor -- start 2023-11-28T18:38:01.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.598+0000 7fc1d525f640 1 -- start start 2023-11-28T18:38:01.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.598+0000 7fc1d525f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc1d0071dd0 0x7fc1d01f9500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:01.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.598+0000 7fc1d525f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc1d013f630 0x7fc1d0158f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:01.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.598+0000 7fc1d525f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc1d015adf0 0x7fc1d01594c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:01.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.598+0000 7fc1d525f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d0140b80 con 0x7fc1d015adf0 2023-11-28T18:38:01.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.598+0000 7fc1d525f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d01f9a40 con 0x7fc1d013f630 2023-11-28T18:38:01.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.598+0000 7fc1d525f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d0136aa0 con 0x7fc1d0071dd0 2023-11-28T18:38:01.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.598+0000 7fc1cf59e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc1d015adf0 0x7fc1d01594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:01.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.598+0000 7fc1ced9d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc1d0071dd0 0x7fc1d01f9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:01.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.598+0000 7fc1cf59e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc1d015adf0 0x7fc1d01594c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53290/0 (socket says 172.21.15.45:53290) 2023-11-28T18:38:01.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.598+0000 7fc1ced9d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc1d0071dd0 0x7fc1d01f9500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.45:41206/0 (socket says 172.21.15.45:41206) 2023-11-28T18:38:01.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.598+0000 7fc1cf59e640 1 -- 172.21.15.45:0/4155192940 learned_addr learned my addr 172.21.15.45:0/4155192940 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:01.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.598+0000 7fc1c7fff640 1 --2- 172.21.15.45:0/4155192940 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc1d013f630 0x7fc1d0158f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:01.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.598+0000 7fc1cf59e640 1 -- 172.21.15.45:0/4155192940 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc1d0071dd0 msgr2=0x7fc1d01f9500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:01.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.598+0000 7fc1cf59e640 1 --2- 172.21.15.45:0/4155192940 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc1d0071dd0 0x7fc1d01f9500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:01.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.598+0000 7fc1cf59e640 1 -- 172.21.15.45:0/4155192940 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc1d013f630 msgr2=0x7fc1d0158f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:01.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.598+0000 7fc1cf59e640 1 --2- 172.21.15.45:0/4155192940 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc1d013f630 0x7fc1d0158f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:01.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.598+0000 7fc1cf59e640 1 -- 172.21.15.45:0/4155192940 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1c00094d0 con 0x7fc1d015adf0 2023-11-28T18:38:01.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.598+0000 7fc1ced9d640 1 --2- 172.21.15.45:0/4155192940 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc1d0071dd0 0x7fc1d01f9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:38:01.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.598+0000 7fc1cf59e640 1 --2- 172.21.15.45:0/4155192940 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc1d015adf0 0x7fc1d01594c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc1c800b970 tx=0x7fc1c800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:01.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.598+0000 7fc1c77fe640 1 -- 172.21.15.45:0/4155192940 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c800cb40 con 0x7fc1d015adf0 2023-11-28T18:38:01.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.598+0000 7fc1c77fe640 1 -- 172.21.15.45:0/4155192940 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1c800ccc0 con 0x7fc1d015adf0 2023-11-28T18:38:01.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.598+0000 7fc1c77fe640 1 -- 172.21.15.45:0/4155192940 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c8014680 con 0x7fc1d015adf0 2023-11-28T18:38:01.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.598+0000 7fc1d525f640 1 -- 172.21.15.45:0/4155192940 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1d0140850 con 0x7fc1d015adf0 2023-11-28T18:38:01.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.598+0000 7fc1d525f640 1 -- 172.21.15.45:0/4155192940 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1d01367c0 con 0x7fc1d015adf0 2023-11-28T18:38:01.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.602+0000 7fc1d525f640 1 -- 172.21.15.45:0/4155192940 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1d015b230 con 0x7fc1d015adf0 2023-11-28T18:38:01.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.602+0000 7fc1c77fe640 1 -- 172.21.15.45:0/4155192940 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fc1c801d3b0 con 0x7fc1d015adf0 2023-11-28T18:38:01.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.602+0000 7fc1c77fe640 1 --2- 172.21.15.45:0/4155192940 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fc1b0066900 0x7fc1b0068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:01.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.602+0000 7fc1c77fe640 1 -- 172.21.15.45:0/4155192940 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc1c8084350 con 0x7fc1d015adf0 2023-11-28T18:38:01.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.602+0000 7fc1ced9d640 1 --2- 172.21.15.45:0/4155192940 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fc1b0066900 0x7fc1b0068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:01.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.602+0000 7fc1ced9d640 1 --2- 172.21.15.45:0/4155192940 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fc1b0066900 0x7fc1b0068dc0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc1c00ae000 tx=0x7fc1c00b5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:01.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.606+0000 7fc1c77fe640 1 -- 172.21.15.45:0/4155192940 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc1d015b230 con 0x7fc1d015adf0 2023-11-28T18:38:01.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.766+0000 7fc1d525f640 1 -- 172.21.15.45:0/4155192940 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc1d015b230 con 0x7fc1d015adf0 2023-11-28T18:38:01.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.766+0000 7fc1c77fe640 1 -- 172.21.15.45:0/4155192940 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc1c8019020 con 0x7fc1d015adf0 2023-11-28T18:38:01.772 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-11-28T18:38:01.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.770+0000 7fc1d525f640 1 -- 172.21.15.45:0/4155192940 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fc1b0066900 msgr2=0x7fc1b0068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:01.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.770+0000 7fc1d525f640 1 --2- 172.21.15.45:0/4155192940 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fc1b0066900 0x7fc1b0068dc0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc1c00ae000 tx=0x7fc1c00b5040 comp rx=0 tx=0).stop 2023-11-28T18:38:01.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.770+0000 7fc1d525f640 1 -- 172.21.15.45:0/4155192940 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc1d015adf0 msgr2=0x7fc1d01594c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:01.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.770+0000 7fc1d525f640 1 --2- 172.21.15.45:0/4155192940 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc1d015adf0 0x7fc1d01594c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc1c800b970 tx=0x7fc1c800be30 comp rx=0 tx=0).stop 2023-11-28T18:38:01.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.770+0000 7fc1d525f640 1 -- 172.21.15.45:0/4155192940 shutdown_connections 2023-11-28T18:38:01.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.770+0000 7fc1d525f640 1 --2- 172.21.15.45:0/4155192940 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fc1b0066900 0x7fc1b0068dc0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:01.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.770+0000 7fc1d525f640 1 --2- 172.21.15.45:0/4155192940 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc1d015adf0 0x7fc1d01594c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:01.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.770+0000 7fc1d525f640 1 --2- 172.21.15.45:0/4155192940 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc1d013f630 0x7fc1d0158f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:01.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.770+0000 7fc1d525f640 1 --2- 172.21.15.45:0/4155192940 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc1d0071dd0 0x7fc1d01f9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:01.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.770+0000 7fc1d525f640 1 -- 172.21.15.45:0/4155192940 >> 172.21.15.45:0/4155192940 conn(0x7fc1d00b0d00 msgr2=0x7fc1d015bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:01.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.770+0000 7fc1d525f640 1 -- 172.21.15.45:0/4155192940 shutdown_connections 2023-11-28T18:38:01.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.770+0000 7fc1d525f640 1 -- 172.21.15.45:0/4155192940 wait complete. 2023-11-28T18:38:01.791 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T18:38:01.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.930+0000 7fca60ddf640 1 Processor -- start 2023-11-28T18:38:01.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.934+0000 7fca60ddf640 1 -- start start 2023-11-28T18:38:01.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.934+0000 7fca60ddf640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fca5c13cf70 0x7fca5c06c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:01.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.934+0000 7fca60ddf640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fca5c15ad80 0x7fca5c0cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:01.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.934+0000 7fca60ddf640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca5c15b3e0 con 0x7fca5c06c840 2023-11-28T18:38:01.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.934+0000 7fca60ddf640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca5c13d350 con 0x7fca5c15ad80 2023-11-28T18:38:01.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.934+0000 7fca60ddf640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca5c15b1f0 con 0x7fca5c13cf70 2023-11-28T18:38:01.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.934+0000 7fca5ad9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fca5c15ad80 0x7fca5c0cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:01.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.934+0000 7fca53fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fca5c06c840 0x7fca5c15a670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33728/0 (socket says 172.21.15.45:33728) 2023-11-28T18:38:01.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.934+0000 7fca5ad9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fca5c15ad80 0x7fca5c0cd8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53304/0 (socket says 172.21.15.45:53304) 2023-11-28T18:38:01.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.934+0000 7fca53fff640 1 -- 172.21.15.45:0/2834164375 learned_addr learned my addr 172.21.15.45:0/2834164375 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:38:01.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.934+0000 7fca5a59c640 1 --2- 172.21.15.45:0/2834164375 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fca5c13cf70 0x7fca5c06c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:01.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.934+0000 7fca5ad9d640 1 -- 172.21.15.45:0/2834164375 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fca5c13cf70 msgr2=0x7fca5c06c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:01.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.934+0000 7fca5ad9d640 1 --2- 172.21.15.45:0/2834164375 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fca5c13cf70 0x7fca5c06c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:01.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.934+0000 7fca59d9b640 1 -- 172.21.15.45:0/2834164375 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2569653048 0 0) 0x7fca5c15b3e0 con 0x7fca5c06c840 2023-11-28T18:38:01.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.934+0000 7fca5ad9d640 1 -- 172.21.15.45:0/2834164375 >> v1:172.21.15.45:6789/0 conn(0x7fca5c06c840 legacy=0x7fca5c15a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:01.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.934+0000 7fca5ad9d640 1 -- 172.21.15.45:0/2834164375 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca5c06cc80 con 0x7fca5c15ad80 2023-11-28T18:38:01.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.938+0000 7fca5ad9d640 1 --2- 172.21.15.45:0/2834164375 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca5c15ad80 0x7fca5c0cd8c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fca54009d90 tx=0x7fca5401c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c4e80ff3ab51b94 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:01.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.938+0000 7fca59d9b640 1 -- 172.21.15.45:0/2834164375 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca540a5870 con 0x7fca5c15ad80 2023-11-28T18:38:01.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.938+0000 7fca59d9b640 1 -- 172.21.15.45:0/2834164375 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca540a59d0 con 0x7fca5c15ad80 2023-11-28T18:38:01.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.938+0000 7fca59d9b640 1 -- 172.21.15.45:0/2834164375 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca540a5d60 con 0x7fca5c15ad80 2023-11-28T18:38:01.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.938+0000 7fca60ddf640 1 -- 172.21.15.45:0/2834164375 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca5c15ad80 msgr2=0x7fca5c0cd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:01.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.938+0000 7fca60ddf640 1 --2- 172.21.15.45:0/2834164375 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca5c15ad80 0x7fca5c0cd8c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fca54009d90 tx=0x7fca5401c8c0 comp rx=0 tx=0).stop 2023-11-28T18:38:01.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.938+0000 7fca60ddf640 1 -- 172.21.15.45:0/2834164375 shutdown_connections 2023-11-28T18:38:01.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.938+0000 7fca60ddf640 1 --2- 172.21.15.45:0/2834164375 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca5c15ad80 0x7fca5c0cd8c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:01.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.938+0000 7fca60ddf640 1 --2- 172.21.15.45:0/2834164375 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fca5c13cf70 0x7fca5c06c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:01.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.938+0000 7fca60ddf640 1 -- 172.21.15.45:0/2834164375 >> 172.21.15.45:0/2834164375 conn(0x7fca5c06a570 msgr2=0x7fca5c06a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:01.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.938+0000 7fca60ddf640 1 -- 172.21.15.45:0/2834164375 shutdown_connections 2023-11-28T18:38:01.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.938+0000 7fca60ddf640 1 -- 172.21.15.45:0/2834164375 wait complete. 2023-11-28T18:38:01.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.938+0000 7fca60ddf640 1 Processor -- start 2023-11-28T18:38:01.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.938+0000 7fca60ddf640 1 -- start start 2023-11-28T18:38:01.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.942+0000 7fca60ddf640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fca5c06c840 0x7fca5c1393a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:01.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.942+0000 7fca60ddf640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fca5c13cf70 0x7fca5c158b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:01.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.942+0000 7fca60ddf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca5c15ad80 0x7fca5c14f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:01.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.942+0000 7fca60ddf640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca5c0b39e0 con 0x7fca5c15ad80 2023-11-28T18:38:01.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.942+0000 7fca60ddf640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca5c154ed0 con 0x7fca5c06c840 2023-11-28T18:38:01.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.942+0000 7fca60ddf640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca5c1551b0 con 0x7fca5c13cf70 2023-11-28T18:38:01.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.942+0000 7fca5ad9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca5c15ad80 0x7fca5c14f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:01.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.942+0000 7fca5ad9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca5c15ad80 0x7fca5c14f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53316/0 (socket says 172.21.15.45:53316) 2023-11-28T18:38:01.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.942+0000 7fca5ad9d640 1 -- 172.21.15.45:0/3132628913 learned_addr learned my addr 172.21.15.45:0/3132628913 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:01.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.942+0000 7fca53fff640 1 --2- 172.21.15.45:0/3132628913 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fca5c13cf70 0x7fca5c158b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:01.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.942+0000 7fca5a59c640 1 --2- 172.21.15.45:0/3132628913 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fca5c06c840 0x7fca5c1393a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:01.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.942+0000 7fca5ad9d640 1 -- 172.21.15.45:0/3132628913 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fca5c13cf70 msgr2=0x7fca5c158b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:01.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.942+0000 7fca5ad9d640 1 --2- 172.21.15.45:0/3132628913 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fca5c13cf70 0x7fca5c158b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:01.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.942+0000 7fca5ad9d640 1 -- 172.21.15.45:0/3132628913 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fca5c06c840 msgr2=0x7fca5c1393a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:01.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.942+0000 7fca5ad9d640 1 --2- 172.21.15.45:0/3132628913 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fca5c06c840 0x7fca5c1393a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:01.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.942+0000 7fca5ad9d640 1 -- 172.21.15.45:0/3132628913 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca54009a70 con 0x7fca5c15ad80 2023-11-28T18:38:01.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.942+0000 7fca5ad9d640 1 --2- 172.21.15.45:0/3132628913 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca5c15ad80 0x7fca5c14f950 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fca540b0040 tx=0x7fca54019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:01.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.942+0000 7fca52ffd640 1 -- 172.21.15.45:0/3132628913 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca540b9650 con 0x7fca5c15ad80 2023-11-28T18:38:01.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.942+0000 7fca52ffd640 1 -- 172.21.15.45:0/3132628913 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca540b97b0 con 0x7fca5c15ad80 2023-11-28T18:38:01.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.942+0000 7fca52ffd640 1 -- 172.21.15.45:0/3132628913 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca540b9b40 con 0x7fca5c15ad80 2023-11-28T18:38:01.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.942+0000 7fca60ddf640 1 -- 172.21.15.45:0/3132628913 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca5c155490 con 0x7fca5c15ad80 2023-11-28T18:38:01.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.942+0000 7fca60ddf640 1 -- 172.21.15.45:0/3132628913 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca5c155a50 con 0x7fca5c15ad80 2023-11-28T18:38:01.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.942+0000 7fca60ddf640 1 -- 172.21.15.45:0/3132628913 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca5c069480 con 0x7fca5c15ad80 2023-11-28T18:38:01.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.946+0000 7fca52ffd640 1 -- 172.21.15.45:0/3132628913 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fca540b9ca0 con 0x7fca5c15ad80 2023-11-28T18:38:01.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.946+0000 7fca52ffd640 1 --2- 172.21.15.45:0/3132628913 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fca3c0668d0 0x7fca3c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:01.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.946+0000 7fca52ffd640 1 -- 172.21.15.45:0/3132628913 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fca5411f700 con 0x7fca5c15ad80 2023-11-28T18:38:01.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.946+0000 7fca5a59c640 1 --2- 172.21.15.45:0/3132628913 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fca3c0668d0 0x7fca3c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:01.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.946+0000 7fca5a59c640 1 --2- 172.21.15.45:0/3132628913 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fca3c0668d0 0x7fca3c068d90 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fca4c009af0 tx=0x7fca4c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:01.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:01.950+0000 7fca52ffd640 1 -- 172.21.15.45:0/3132628913 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fca540ec930 con 0x7fca5c15ad80 2023-11-28T18:38:02.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.106+0000 7fca60ddf640 1 -- 172.21.15.45:0/3132628913 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fca5c06d220 con 0x7fca5c15ad80 2023-11-28T18:38:02.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.110+0000 7fca52ffd640 1 -- 172.21.15.45:0/3132628913 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16469 (secure 0 0 0) 0x7fca540eff50 con 0x7fca5c15ad80 2023-11-28T18:38:02.111 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:38:02.111 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":20,"fsid":"d10f5cd6-1d00-4019-99b6-6fa435498a15","created":"2023-11-28T18:37:08.189030+0000","modified":"2023-11-28T18:37:33.971141+0000","last_up_change":"2023-11-28T18:37:20.196124+0000","last_in_change":"2023-11-28T18:37:10.742043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T18:37:21.293917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T18:37:31.384760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T18:37:31.834769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"84465384-103c-4f2c-a45a-96f5bb9c835f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6809","nonce":555237322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6811","nonce":555237322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6815","nonce":555237322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6813","nonce":555237322}]},"public_addr":"172.21.15.45:6809/555237322","cluster_addr":"172.21.15.45:6811/555237322","heartbeat_back_addr":"172.21.15.45:6815/555237322","heartbeat_front_addr":"172.21.15.45:6813/555237322","state":["exists","up"]},{"osd":1,"uuid":"7d9eed24-a58f-42c7-a787-ac06be8553fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6801","nonce":2857063763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6803","nonce":2857063763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6807","nonce":2857063763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6805","nonce":2857063763}]},"public_addr":"172.21.15.45:6801/2857063763","cluster_addr":"172.21.15.45:6803/2857063763","heartbeat_back_addr":"172.21.15.45:6807/2857063763","heartbeat_front_addr":"172.21.15.45:6805/2857063763","state":["exists","up"]},{"osd":2,"uuid":"575eeccc-4abf-45b4-9caf-f3e797859588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6817","nonce":193884539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6819","nonce":193884539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6823","nonce":193884539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6821","nonce":193884539}]},"public_addr":"172.21.15.45:6817/193884539","cluster_addr":"172.21.15.45:6819/193884539","heartbeat_back_addr":"172.21.15.45:6823/193884539","heartbeat_front_addr":"172.21.15.45:6821/193884539","state":["exists","up"]},{"osd":3,"uuid":"9b0290d6-9a52-4bc8-b2a1-7622c5dc8e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6825","nonce":78541084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6827","nonce":78541084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6831","nonce":78541084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6829","nonce":78541084}]},"public_addr":"172.21.15.45:6825/78541084","cluster_addr":"172.21.15.45:6827/78541084","heartbeat_back_addr":"172.21.15.45:6831/78541084","heartbeat_front_addr":"172.21.15.45:6829/78541084","state":["exists","up"]},{"osd":4,"uuid":"ce632829-f027-4fbf-a627-02c571aa9d53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6809","nonce":1537591987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6811","nonce":1537591987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6815","nonce":1537591987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6813","nonce":1537591987}]},"public_addr":"172.21.15.190:6809/1537591987","cluster_addr":"172.21.15.190:6811/1537591987","heartbeat_back_addr":"172.21.15.190:6815/1537591987","heartbeat_front_addr":"172.21.15.190:6813/1537591987","state":["exists","up"]},{"osd":5,"uuid":"8700b609-27be-40bd-a251-4c0ae0a29ead","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6801","nonce":3296698407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6803","nonce":3296698407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6807","nonce":3296698407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6805","nonce":3296698407}]},"public_addr":"172.21.15.190:6801/3296698407","cluster_addr":"172.21.15.190:6803/3296698407","heartbeat_back_addr":"172.21.15.190:6807/3296698407","heartbeat_front_addr":"172.21.15.190:6805/3296698407","state":["exists","up"]},{"osd":6,"uuid":"44ce4a40-e6ff-4f4d-8e8a-7341e5c91f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6817","nonce":2317686718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6819","nonce":2317686718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6823","nonce":2317686718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6821","nonce":2317686718}]},"public_addr":"172.21.15.190:6817/2317686718","cluster_addr":"172.21.15.190:6819/2317686718","heartbeat_back_addr":"172.21.15.190:6823/2317686718","heartbeat_front_addr":"172.21.15.190:6821/2317686718","state":["exists","up"]},{"osd":7,"uuid":"192238c9-1423-4b7e-ac8f-84ba32113ddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6825","nonce":2493232051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6827","nonce":2493232051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6831","nonce":2493232051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6829","nonce":2493232051}]},"public_addr":"172.21.15.190:6825/2493232051","cluster_addr":"172.21.15.190:6827/2493232051","heartbeat_back_addr":"172.21.15.190:6831/2493232051","heartbeat_front_addr":"172.21.15.190:6829/2493232051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.393552+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.385453+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.361421+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.366408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.363226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.276007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.414605+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.445885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T18:38:02.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.110+0000 7fca60ddf640 1 -- 172.21.15.45:0/3132628913 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fca3c0668d0 msgr2=0x7fca3c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:02.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.110+0000 7fca60ddf640 1 --2- 172.21.15.45:0/3132628913 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fca3c0668d0 0x7fca3c068d90 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fca4c009af0 tx=0x7fca4c008040 comp rx=0 tx=0).stop 2023-11-28T18:38:02.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.110+0000 7fca60ddf640 1 -- 172.21.15.45:0/3132628913 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca5c15ad80 msgr2=0x7fca5c14f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:02.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.110+0000 7fca60ddf640 1 --2- 172.21.15.45:0/3132628913 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca5c15ad80 0x7fca5c14f950 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fca540b0040 tx=0x7fca54019660 comp rx=0 tx=0).stop 2023-11-28T18:38:02.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.110+0000 7fca60ddf640 1 -- 172.21.15.45:0/3132628913 shutdown_connections 2023-11-28T18:38:02.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.110+0000 7fca60ddf640 1 --2- 172.21.15.45:0/3132628913 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fca3c0668d0 0x7fca3c068d90 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:02.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.110+0000 7fca60ddf640 1 --2- 172.21.15.45:0/3132628913 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca5c15ad80 0x7fca5c14f950 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:02.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.110+0000 7fca60ddf640 1 --2- 172.21.15.45:0/3132628913 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fca5c13cf70 0x7fca5c158b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:02.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.110+0000 7fca60ddf640 1 --2- 172.21.15.45:0/3132628913 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fca5c06c840 0x7fca5c1393a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:02.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.110+0000 7fca60ddf640 1 -- 172.21.15.45:0/3132628913 >> 172.21.15.45:0/3132628913 conn(0x7fca5c06a570 msgr2=0x7fca5c15c330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:02.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.110+0000 7fca60ddf640 1 -- 172.21.15.45:0/3132628913 shutdown_connections 2023-11-28T18:38:02.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.110+0000 7fca60ddf640 1 -- 172.21.15.45:0/3132628913 wait complete. 2023-11-28T18:38:02.132 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T18:37:21.293917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T18:37:31.384760+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T18:37:31.834769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T18:38:02.133 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T18:38:02.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.278+0000 7fdfac3aa640 1 Processor -- start 2023-11-28T18:38:02.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.278+0000 7fdfac3aa640 1 -- start start 2023-11-28T18:38:02.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.278+0000 7fdfac3aa640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fdfa40b4780 0x7fdfa406cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:02.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.278+0000 7fdfac3aa640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfa415e940 con 0x7fdfa415edd0 2023-11-28T18:38:02.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.278+0000 7fdfac3aa640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfa415dd30 con 0x7fdfa41469a0 2023-11-28T18:38:02.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.278+0000 7fdfac3aa640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfa415e010 con 0x7fdfa40b4780 2023-11-28T18:38:02.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.278+0000 7fdfaa947640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fdfa415edd0 0x7fdfa415f260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33742/0 (socket says 172.21.15.45:33742) 2023-11-28T18:38:02.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.278+0000 7fdfaa947640 1 -- 172.21.15.45:0/1180046426 learned_addr learned my addr 172.21.15.45:0/1180046426 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:38:02.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.278+0000 7fdfa9945640 1 --2- 172.21.15.45:0/1180046426 >> v2:172.21.15.190:3300/0 conn(0x7fdfa40b4780 0x7fdfa406cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:02.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.278+0000 7fdfa9144640 1 -- 172.21.15.45:0/1180046426 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3676878074 0 0) 0x7fdfa415e940 con 0x7fdfa415edd0 2023-11-28T18:38:02.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.278+0000 7fdfa9144640 1 -- 172.21.15.45:0/1180046426 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf90003530 con 0x7fdfa415edd0 2023-11-28T18:38:02.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.278+0000 7fdfa9144640 1 -- 172.21.15.45:0/1180046426 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3848480888 0 0) 0x7fdf90003530 con 0x7fdfa415edd0 2023-11-28T18:38:02.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.278+0000 7fdfa9945640 1 -- 172.21.15.45:0/1180046426 >> v1:172.21.15.190:6789/0 conn(0x7fdfa41469a0 legacy=0x7fdfa40b4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:02.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.278+0000 7fdfa9945640 1 -- 172.21.15.45:0/1180046426 >> v1:172.21.15.45:6789/0 conn(0x7fdfa415edd0 legacy=0x7fdfa415f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:02.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.278+0000 7fdfa9945640 1 -- 172.21.15.45:0/1180046426 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfa415e2f0 con 0x7fdfa40b4780 2023-11-28T18:38:02.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.282+0000 7fdfa9945640 1 --2- 172.21.15.45:0/1180046426 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdfa40b4780 0x7fdfa406cab0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fdf940097c0 tx=0x7fdf9401c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64798f59bf7febad server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:02.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.282+0000 7fdfa9144640 1 -- 172.21.15.45:0/1180046426 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf9c001a00 con 0x7fdfa40b4780 2023-11-28T18:38:02.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.282+0000 7fdfa9144640 1 -- 172.21.15.45:0/1180046426 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf940a7050 con 0x7fdfa40b4780 2023-11-28T18:38:02.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.282+0000 7fdfa9144640 1 -- 172.21.15.45:0/1180046426 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf940ab600 con 0x7fdfa40b4780 2023-11-28T18:38:02.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.282+0000 7fdfac3aa640 1 -- 172.21.15.45:0/1180046426 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdfa40b4780 msgr2=0x7fdfa406cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:02.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.282+0000 7fdfac3aa640 1 --2- 172.21.15.45:0/1180046426 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdfa40b4780 0x7fdfa406cab0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fdf940097c0 tx=0x7fdf9401c3a0 comp rx=0 tx=0).stop 2023-11-28T18:38:02.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.282+0000 7fdfac3aa640 1 -- 172.21.15.45:0/1180046426 shutdown_connections 2023-11-28T18:38:02.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.282+0000 7fdfac3aa640 1 --2- 172.21.15.45:0/1180046426 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdfa40b4780 0x7fdfa406cab0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:02.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.282+0000 7fdfac3aa640 1 -- 172.21.15.45:0/1180046426 >> 172.21.15.45:0/1180046426 conn(0x7fdfa4070b80 msgr2=0x7fdfa4066360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:02.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.282+0000 7fdfac3aa640 1 -- 172.21.15.45:0/1180046426 shutdown_connections 2023-11-28T18:38:02.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.282+0000 7fdfac3aa640 1 -- 172.21.15.45:0/1180046426 wait complete. 2023-11-28T18:38:02.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.286+0000 7fdfac3aa640 1 Processor -- start 2023-11-28T18:38:02.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.286+0000 7fdfac3aa640 1 -- start start 2023-11-28T18:38:02.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.286+0000 7fdfac3aa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfa40b4780 0x7fdfa41405c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:02.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.286+0000 7fdfac3aa640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdfa41469a0 0x7fdfa415a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:02.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.286+0000 7fdfac3aa640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdfa415edd0 0x7fdfa413d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:02.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.286+0000 7fdfac3aa640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa4159c70 con 0x7fdfa40b4780 2023-11-28T18:38:02.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.286+0000 7fdfac3aa640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa415a100 con 0x7fdfa41469a0 2023-11-28T18:38:02.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.286+0000 7fdfac3aa640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa40ca730 con 0x7fdfa415edd0 2023-11-28T18:38:02.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.286+0000 7fdfaa146640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfa40b4780 0x7fdfa41405c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:02.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.286+0000 7fdfaa146640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfa40b4780 0x7fdfa41405c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53324/0 (socket says 172.21.15.45:53324) 2023-11-28T18:38:02.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.286+0000 7fdfaa146640 1 -- 172.21.15.45:0/3724354247 learned_addr learned my addr 172.21.15.45:0/3724354247 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:02.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.286+0000 7fdfa9945640 1 --2- 172.21.15.45:0/3724354247 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdfa41469a0 0x7fdfa415a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:02.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.286+0000 7fdfaa947640 1 --2- 172.21.15.45:0/3724354247 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdfa415edd0 0x7fdfa413d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:02.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.286+0000 7fdfaa146640 1 -- 172.21.15.45:0/3724354247 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdfa415edd0 msgr2=0x7fdfa413d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:02.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.286+0000 7fdfaa146640 1 --2- 172.21.15.45:0/3724354247 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdfa415edd0 0x7fdfa413d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:02.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.286+0000 7fdfaa146640 1 -- 172.21.15.45:0/3724354247 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdfa41469a0 msgr2=0x7fdfa415a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:02.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.286+0000 7fdfaa146640 1 --2- 172.21.15.45:0/3724354247 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdfa41469a0 0x7fdfa415a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:02.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.286+0000 7fdfaa146640 1 -- 172.21.15.45:0/3724354247 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf94009420 con 0x7fdfa40b4780 2023-11-28T18:38:02.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.286+0000 7fdfa9945640 1 --2- 172.21.15.45:0/3724354247 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdfa41469a0 0x7fdfa415a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:38:02.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.286+0000 7fdfaa146640 1 --2- 172.21.15.45:0/3724354247 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfa40b4780 0x7fdfa41405c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fdfa000c500 tx=0x7fdfa000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:02.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.286+0000 7fdf9affd640 1 -- 172.21.15.45:0/3724354247 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa0005220 con 0x7fdfa40b4780 2023-11-28T18:38:02.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.286+0000 7fdf9affd640 1 -- 172.21.15.45:0/3724354247 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfa0005380 con 0x7fdfa40b4780 2023-11-28T18:38:02.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.286+0000 7fdf9affd640 1 -- 172.21.15.45:0/3724354247 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa0007270 con 0x7fdfa40b4780 2023-11-28T18:38:02.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.286+0000 7fdfac3aa640 1 -- 172.21.15.45:0/3724354247 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfa4159060 con 0x7fdfa40b4780 2023-11-28T18:38:02.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.286+0000 7fdfac3aa640 1 -- 172.21.15.45:0/3724354247 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfa4159620 con 0x7fdfa40b4780 2023-11-28T18:38:02.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.290+0000 7fdfac3aa640 1 -- 172.21.15.45:0/3724354247 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfa4069410 con 0x7fdfa40b4780 2023-11-28T18:38:02.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.290+0000 7fdf9affd640 1 -- 172.21.15.45:0/3724354247 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fdfa00073d0 con 0x7fdfa40b4780 2023-11-28T18:38:02.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.290+0000 7fdf9affd640 1 --2- 172.21.15.45:0/3724354247 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fdf880668d0 0x7fdf88068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:02.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.290+0000 7fdf9affd640 1 -- 172.21.15.45:0/3724354247 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdfa0083d20 con 0x7fdfa40b4780 2023-11-28T18:38:02.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.290+0000 7fdfa9945640 1 --2- 172.21.15.45:0/3724354247 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fdf880668d0 0x7fdf88068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:02.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.290+0000 7fdfa9945640 1 --2- 172.21.15.45:0/3724354247 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fdf880668d0 0x7fdf88068d90 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fdf940ad000 tx=0x7fdf940a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:02.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.294+0000 7fdf9affd640 1 -- 172.21.15.45:0/3724354247 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdfa0050f70 con 0x7fdfa40b4780 2023-11-28T18:38:02.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.454+0000 7fdfac3aa640 1 -- 172.21.15.45:0/3724354247 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdfa406c920 con 0x7fdfa40b4780 2023-11-28T18:38:02.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.454+0000 7fdf9affd640 1 -- 172.21.15.45:0/3724354247 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdfa0054590 con 0x7fdfa40b4780 2023-11-28T18:38:02.455 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-11-28T18:38:02.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.454+0000 7fdfac3aa640 1 -- 172.21.15.45:0/3724354247 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fdf880668d0 msgr2=0x7fdf88068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:02.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.454+0000 7fdfac3aa640 1 --2- 172.21.15.45:0/3724354247 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fdf880668d0 0x7fdf88068d90 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fdf940ad000 tx=0x7fdf940a6000 comp rx=0 tx=0).stop 2023-11-28T18:38:02.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.454+0000 7fdfac3aa640 1 -- 172.21.15.45:0/3724354247 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfa40b4780 msgr2=0x7fdfa41405c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:02.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.454+0000 7fdfac3aa640 1 --2- 172.21.15.45:0/3724354247 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfa40b4780 0x7fdfa41405c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fdfa000c500 tx=0x7fdfa000c9c0 comp rx=0 tx=0).stop 2023-11-28T18:38:02.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.454+0000 7fdfac3aa640 1 -- 172.21.15.45:0/3724354247 shutdown_connections 2023-11-28T18:38:02.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.454+0000 7fdfac3aa640 1 --2- 172.21.15.45:0/3724354247 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fdf880668d0 0x7fdf88068d90 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:02.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.454+0000 7fdfac3aa640 1 --2- 172.21.15.45:0/3724354247 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdfa415edd0 0x7fdfa413d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:02.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.454+0000 7fdfac3aa640 1 --2- 172.21.15.45:0/3724354247 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdfa41469a0 0x7fdfa415a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:02.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.454+0000 7fdfac3aa640 1 --2- 172.21.15.45:0/3724354247 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfa40b4780 0x7fdfa41405c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:02.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.454+0000 7fdfac3aa640 1 -- 172.21.15.45:0/3724354247 >> 172.21.15.45:0/3724354247 conn(0x7fdfa4070b80 msgr2=0x7fdfa4141540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:02.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.454+0000 7fdfac3aa640 1 -- 172.21.15.45:0/3724354247 shutdown_connections 2023-11-28T18:38:02.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.454+0000 7fdfac3aa640 1 -- 172.21.15.45:0/3724354247 wait complete. 2023-11-28T18:38:02.476 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T18:38:02.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.618+0000 7f9aed809640 1 Processor -- start 2023-11-28T18:38:02.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.618+0000 7f9aed809640 1 -- start start 2023-11-28T18:38:02.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.622+0000 7f9aed809640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f9ae80cba50 0x7f9ae815be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:02.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.622+0000 7f9aed809640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ae815b6b0 con 0x7f9ae80b4310 2023-11-28T18:38:02.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.622+0000 7f9aed809640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ae815f450 con 0x7f9ae8158ce0 2023-11-28T18:38:02.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.622+0000 7f9aed809640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ae815f730 con 0x7f9ae80cba50 2023-11-28T18:38:02.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.622+0000 7f9ae77fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f9ae80b4310 0x7f9ae8070430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33746/0 (socket says 172.21.15.45:33746) 2023-11-28T18:38:02.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.622+0000 7f9ae77fe640 1 -- 172.21.15.45:0/3759515437 learned_addr learned my addr 172.21.15.45:0/3759515437 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:38:02.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.622+0000 7f9ae67fc640 1 --2- 172.21.15.45:0/3759515437 >> v2:172.21.15.190:3300/0 conn(0x7f9ae80cba50 0x7f9ae815be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:02.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.622+0000 7f9ae5ffb640 1 -- 172.21.15.45:0/3759515437 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1436277203 0 0) 0x7f9ae815b6b0 con 0x7f9ae80b4310 2023-11-28T18:38:02.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.622+0000 7f9ae5ffb640 1 -- 172.21.15.45:0/3759515437 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ad0003530 con 0x7f9ae80b4310 2023-11-28T18:38:02.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.622+0000 7f9ae5ffb640 1 -- 172.21.15.45:0/3759515437 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 754491836 0 0) 0x7f9ad0003530 con 0x7f9ae80b4310 2023-11-28T18:38:02.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.622+0000 7f9ae5ffb640 1 -- 172.21.15.45:0/3759515437 >> v2:172.21.15.190:3300/0 conn(0x7f9ae80cba50 msgr2=0x7f9ae815be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:02.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.622+0000 7f9ae5ffb640 1 --2- 172.21.15.45:0/3759515437 >> v2:172.21.15.190:3300/0 conn(0x7f9ae80cba50 0x7f9ae815be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:02.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.622+0000 7f9ae5ffb640 1 -- 172.21.15.45:0/3759515437 >> v1:172.21.15.190:6789/0 conn(0x7f9ae8158ce0 legacy=0x7f9ae815eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:02.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.622+0000 7f9ae5ffb640 1 -- 172.21.15.45:0/3759515437 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ae815b920 con 0x7f9ae80b4310 2023-11-28T18:38:02.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.622+0000 7f9ae5ffb640 1 -- 172.21.15.45:0/3759515437 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4084481567 0 0) 0x7f9ae0001a00 con 0x7f9ae80b4310 2023-11-28T18:38:02.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.622+0000 7f9ae5ffb640 1 -- 172.21.15.45:0/3759515437 >> v1:172.21.15.45:6789/0 conn(0x7f9ae80b4310 legacy=0x7f9ae8070430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:02.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.622+0000 7f9ae5ffb640 1 --2- 172.21.15.45:0/3759515437 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ad00039d0 0x7f9ad0003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:02.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.622+0000 7f9ae5ffb640 1 --2- 172.21.15.45:0/3759515437 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ad00047d0 0x7f9ad0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:02.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.622+0000 7f9ae5ffb640 1 --2- 172.21.15.45:0/3759515437 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ad0005190 0x7f9ad000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:02.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.622+0000 7f9ae5ffb640 1 -- 172.21.15.45:0/3759515437 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae815f730 con 0x7f9ad00047d0 2023-11-28T18:38:02.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.622+0000 7f9ae5ffb640 1 -- 172.21.15.45:0/3759515437 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad000c090 con 0x7f9ad0005190 2023-11-28T18:38:02.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.622+0000 7f9ae5ffb640 1 -- 172.21.15.45:0/3759515437 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad000c250 con 0x7f9ad00039d0 2023-11-28T18:38:02.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.622+0000 7f9ae67fc640 1 --2- 172.21.15.45:0/3759515437 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ad00047d0 0x7f9ad0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:02.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.622+0000 7f9ae6ffd640 1 --2- 172.21.15.45:0/3759515437 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ad00039d0 0x7f9ad0003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:02.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.622+0000 7f9ae77fe640 1 --2- 172.21.15.45:0/3759515437 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ad0005190 0x7f9ad000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:02.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.622+0000 7f9ae67fc640 1 -- 172.21.15.45:0/3759515437 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ad00039d0 msgr2=0x7f9ad0003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:02.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.622+0000 7f9ae67fc640 1 --2- 172.21.15.45:0/3759515437 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ad00039d0 0x7f9ad0003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:02.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.622+0000 7f9ae67fc640 1 -- 172.21.15.45:0/3759515437 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ad0005190 msgr2=0x7f9ad000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:02.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.622+0000 7f9ae67fc640 1 --2- 172.21.15.45:0/3759515437 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ad0005190 0x7f9ad000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:02.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.622+0000 7f9ae77fe640 1 -- 172.21.15.45:0/3759515437 reap_dead start 2023-11-28T18:38:02.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.622+0000 7f9ae67fc640 1 -- 172.21.15.45:0/3759515437 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad0003530 con 0x7f9ad00047d0 2023-11-28T18:38:02.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.626+0000 7f9ae67fc640 1 --2- 172.21.15.45:0/3759515437 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ad00047d0 0x7f9ad0004c50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9adc009ab0 tx=0x7f9adc01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e8fd26dee428564 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:02.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.626+0000 7f9ae5ffb640 1 -- 172.21.15.45:0/3759515437 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9adc0a5510 con 0x7f9ad00047d0 2023-11-28T18:38:02.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.626+0000 7f9ae5ffb640 1 -- 172.21.15.45:0/3759515437 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9adc0a5670 con 0x7f9ad00047d0 2023-11-28T18:38:02.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.626+0000 7f9ae5ffb640 1 -- 172.21.15.45:0/3759515437 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9adc0a5a20 con 0x7f9ad00047d0 2023-11-28T18:38:02.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.626+0000 7f9aed809640 1 -- 172.21.15.45:0/3759515437 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ad00047d0 msgr2=0x7f9ad0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:02.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.626+0000 7f9aed809640 1 --2- 172.21.15.45:0/3759515437 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ad00047d0 0x7f9ad0004c50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9adc009ab0 tx=0x7f9adc01ca30 comp rx=0 tx=0).stop 2023-11-28T18:38:02.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.626+0000 7f9aed809640 1 -- 172.21.15.45:0/3759515437 shutdown_connections 2023-11-28T18:38:02.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.626+0000 7f9aed809640 1 --2- 172.21.15.45:0/3759515437 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ad00047d0 0x7f9ad0004c50 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:02.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.626+0000 7f9aed809640 1 -- 172.21.15.45:0/3759515437 >> 172.21.15.45:0/3759515437 conn(0x7f9ae80b0d00 msgr2=0x7f9ae80b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:02.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.626+0000 7f9aed809640 1 -- 172.21.15.45:0/3759515437 shutdown_connections 2023-11-28T18:38:02.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.626+0000 7f9aed809640 1 -- 172.21.15.45:0/3759515437 wait complete. 2023-11-28T18:38:02.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.630+0000 7f9aed809640 1 Processor -- start 2023-11-28T18:38:02.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.630+0000 7f9aed809640 1 -- start start 2023-11-28T18:38:02.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.630+0000 7f9aed809640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ad00047d0 0x7f9ae8156a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:02.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.630+0000 7f9aed809640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ae80adab0 0x7f9ae8153f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:02.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.630+0000 7f9aed809640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ae81f1110 0x7f9ae81f1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:02.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.630+0000 7f9aed809640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae814f580 con 0x7f9ae80adab0 2023-11-28T18:38:02.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.630+0000 7f9aed809640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae81570e0 con 0x7f9ad00047d0 2023-11-28T18:38:02.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.630+0000 7f9aed809640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae81573c0 con 0x7f9ae81f1110 2023-11-28T18:38:02.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.630+0000 7f9ae67fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ae80adab0 0x7f9ae8153f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:02.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.630+0000 7f9ae67fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ae80adab0 0x7f9ae8153f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53338/0 (socket says 172.21.15.45:53338) 2023-11-28T18:38:02.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.630+0000 7f9ae67fc640 1 -- 172.21.15.45:0/2204915026 learned_addr learned my addr 172.21.15.45:0/2204915026 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:02.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.630+0000 7f9ae6ffd640 1 --2- 172.21.15.45:0/2204915026 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ad00047d0 0x7f9ae8156a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:02.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.630+0000 7f9ae77fe640 1 --2- 172.21.15.45:0/2204915026 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ae81f1110 0x7f9ae81f1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:02.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.630+0000 7f9ae67fc640 1 -- 172.21.15.45:0/2204915026 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ae81f1110 msgr2=0x7f9ae81f1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:02.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.630+0000 7f9ae67fc640 1 --2- 172.21.15.45:0/2204915026 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ae81f1110 0x7f9ae81f1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:02.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.630+0000 7f9ae67fc640 1 -- 172.21.15.45:0/2204915026 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ad00047d0 msgr2=0x7f9ae8156a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:02.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.630+0000 7f9ae67fc640 1 --2- 172.21.15.45:0/2204915026 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ad00047d0 0x7f9ae8156a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:02.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.630+0000 7f9ae67fc640 1 -- 172.21.15.45:0/2204915026 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ae814f210 con 0x7f9ae80adab0 2023-11-28T18:38:02.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.630+0000 7f9ae67fc640 1 --2- 172.21.15.45:0/2204915026 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ae80adab0 0x7f9ae8153f40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9adc01c860 tx=0x7f9adc0197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:02.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.630+0000 7f9acffff640 1 -- 172.21.15.45:0/2204915026 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9adc0bd070 con 0x7f9ae80adab0 2023-11-28T18:38:02.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.630+0000 7f9acffff640 1 -- 172.21.15.45:0/2204915026 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9adc004020 con 0x7f9ae80adab0 2023-11-28T18:38:02.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.630+0000 7f9acffff640 1 -- 172.21.15.45:0/2204915026 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9adc0043d0 con 0x7f9ae80adab0 2023-11-28T18:38:02.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.630+0000 7f9aed809640 1 -- 172.21.15.45:0/2204915026 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ae80adf10 con 0x7f9ae80adab0 2023-11-28T18:38:02.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.630+0000 7f9aed809640 1 -- 172.21.15.45:0/2204915026 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ae8154480 con 0x7f9ae80adab0 2023-11-28T18:38:02.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.634+0000 7f9aed809640 1 -- 172.21.15.45:0/2204915026 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ae8154670 con 0x7f9ae80adab0 2023-11-28T18:38:02.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.634+0000 7f9acffff640 1 -- 172.21.15.45:0/2204915026 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f9adc0b4070 con 0x7f9ae80adab0 2023-11-28T18:38:02.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.634+0000 7f9acffff640 1 --2- 172.21.15.45:0/2204915026 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9ad4066900 0x7f9ad4068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:02.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.634+0000 7f9acffff640 1 -- 172.21.15.45:0/2204915026 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9adc11e450 con 0x7f9ae80adab0 2023-11-28T18:38:02.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.634+0000 7f9ae6ffd640 1 --2- 172.21.15.45:0/2204915026 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9ad4066900 0x7f9ad4068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:02.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.634+0000 7f9ae6ffd640 1 --2- 172.21.15.45:0/2204915026 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9ad4066900 0x7f9ad4068dc0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9ae80501d0 tx=0x7f9ad8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:02.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.638+0000 7f9acffff640 1 -- 172.21.15.45:0/2204915026 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9adc0eb850 con 0x7f9ae80adab0 2023-11-28T18:38:02.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.794+0000 7f9aed809640 1 -- 172.21.15.45:0/2204915026 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9ae8069410 con 0x7f9ae80adab0 2023-11-28T18:38:02.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.798+0000 7f9acffff640 1 -- 172.21.15.45:0/2204915026 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9adc0eee70 con 0x7f9ae80adab0 2023-11-28T18:38:02.799 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-11-28T18:38:02.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.798+0000 7f9aed809640 1 -- 172.21.15.45:0/2204915026 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9ad4066900 msgr2=0x7f9ad4068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:02.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.798+0000 7f9aed809640 1 --2- 172.21.15.45:0/2204915026 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9ad4066900 0x7f9ad4068dc0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9ae80501d0 tx=0x7f9ad8009040 comp rx=0 tx=0).stop 2023-11-28T18:38:02.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.798+0000 7f9aed809640 1 -- 172.21.15.45:0/2204915026 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ae80adab0 msgr2=0x7f9ae8153f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:02.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.798+0000 7f9aed809640 1 --2- 172.21.15.45:0/2204915026 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ae80adab0 0x7f9ae8153f40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9adc01c860 tx=0x7f9adc0197d0 comp rx=0 tx=0).stop 2023-11-28T18:38:02.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.798+0000 7f9aed809640 1 -- 172.21.15.45:0/2204915026 shutdown_connections 2023-11-28T18:38:02.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.798+0000 7f9aed809640 1 --2- 172.21.15.45:0/2204915026 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9ad4066900 0x7f9ad4068dc0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:02.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.798+0000 7f9aed809640 1 --2- 172.21.15.45:0/2204915026 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ae81f1110 0x7f9ae81f1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:02.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.798+0000 7f9aed809640 1 --2- 172.21.15.45:0/2204915026 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ae80adab0 0x7f9ae8153f40 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:02.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.798+0000 7f9aed809640 1 --2- 172.21.15.45:0/2204915026 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ad00047d0 0x7f9ae8156a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:02.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.798+0000 7f9aed809640 1 -- 172.21.15.45:0/2204915026 >> 172.21.15.45:0/2204915026 conn(0x7f9ae80b0d00 msgr2=0x7f9ae8070330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:02.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.798+0000 7f9aed809640 1 -- 172.21.15.45:0/2204915026 shutdown_connections 2023-11-28T18:38:02.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.798+0000 7f9aed809640 1 -- 172.21.15.45:0/2204915026 wait complete. 2023-11-28T18:38:02.820 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T18:38:02.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.962+0000 7fcfacad6640 1 Processor -- start 2023-11-28T18:38:02.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.962+0000 7fcfacad6640 1 -- start start 2023-11-28T18:38:02.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.966+0000 7fcfacad6640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcfa80cba50 0x7fcfa815be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:02.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.966+0000 7fcfacad6640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfa815b6b0 con 0x7fcfa8158ce0 2023-11-28T18:38:02.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.966+0000 7fcfacad6640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfa815f450 con 0x7fcfa80b4310 2023-11-28T18:38:02.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.966+0000 7fcfacad6640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa815f730 con 0x7fcfa80cba50 2023-11-28T18:38:02.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.966+0000 7fcfa659c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fcfa8158ce0 0x7fcfa815eb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33760/0 (socket says 172.21.15.45:33760) 2023-11-28T18:38:02.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.966+0000 7fcfa659c640 1 -- 172.21.15.45:0/3349449717 learned_addr learned my addr 172.21.15.45:0/3349449717 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:38:02.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.966+0000 7fcf9ffff640 1 --2- 172.21.15.45:0/3349449717 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcfa80cba50 0x7fcfa815be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:02.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.966+0000 7fcfa5d9b640 1 -- 172.21.15.45:0/3349449717 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 171986312 0 0) 0x7fcfa815b6b0 con 0x7fcfa8158ce0 2023-11-28T18:38:02.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.966+0000 7fcfa5d9b640 1 -- 172.21.15.45:0/3349449717 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf94003530 con 0x7fcfa8158ce0 2023-11-28T18:38:02.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.966+0000 7fcfa5d9b640 1 -- 172.21.15.45:0/3349449717 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 502172609 0 0) 0x7fcfa815f450 con 0x7fcfa80b4310 2023-11-28T18:38:02.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.966+0000 7fcfa5d9b640 1 -- 172.21.15.45:0/3349449717 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfa815b6b0 con 0x7fcfa80b4310 2023-11-28T18:38:02.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.966+0000 7fcf9ffff640 1 -- 172.21.15.45:0/3349449717 >> v1:172.21.15.190:6789/0 conn(0x7fcfa80b4310 legacy=0x7fcfa8070430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:02.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.966+0000 7fcf9ffff640 1 -- 172.21.15.45:0/3349449717 >> v1:172.21.15.45:6789/0 conn(0x7fcfa8158ce0 legacy=0x7fcfa815eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:02.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.966+0000 7fcf9ffff640 1 -- 172.21.15.45:0/3349449717 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa815b920 con 0x7fcfa80cba50 2023-11-28T18:38:02.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.970+0000 7fcf9ffff640 1 --2- 172.21.15.45:0/3349449717 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcfa80cba50 0x7fcfa815be40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcf900097f0 tx=0x7fcf9001c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13f2fba11b0075a7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:02.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.970+0000 7fcfa5d9b640 1 -- 172.21.15.45:0/3349449717 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf900ac630 con 0x7fcfa80cba50 2023-11-28T18:38:02.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.970+0000 7fcfa5d9b640 1 -- 172.21.15.45:0/3349449717 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf900ac790 con 0x7fcfa80cba50 2023-11-28T18:38:02.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.970+0000 7fcfa5d9b640 1 -- 172.21.15.45:0/3349449717 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf900acb20 con 0x7fcfa80cba50 2023-11-28T18:38:02.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.970+0000 7fcfacad6640 1 -- 172.21.15.45:0/3349449717 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcfa80cba50 msgr2=0x7fcfa815be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:02.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.970+0000 7fcfacad6640 1 --2- 172.21.15.45:0/3349449717 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcfa80cba50 0x7fcfa815be40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcf900097f0 tx=0x7fcf9001c4c0 comp rx=0 tx=0).stop 2023-11-28T18:38:02.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.970+0000 7fcfacad6640 1 -- 172.21.15.45:0/3349449717 shutdown_connections 2023-11-28T18:38:02.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.970+0000 7fcfacad6640 1 --2- 172.21.15.45:0/3349449717 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcfa80cba50 0x7fcfa815be40 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:02.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.970+0000 7fcfacad6640 1 -- 172.21.15.45:0/3349449717 >> 172.21.15.45:0/3349449717 conn(0x7fcfa80b0d00 msgr2=0x7fcfa80b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:02.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.970+0000 7fcfacad6640 1 -- 172.21.15.45:0/3349449717 shutdown_connections 2023-11-28T18:38:02.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.970+0000 7fcfacad6640 1 -- 172.21.15.45:0/3349449717 wait complete. 2023-11-28T18:38:02.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.970+0000 7fcfacad6640 1 Processor -- start 2023-11-28T18:38:02.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.970+0000 7fcfacad6640 1 -- start start 2023-11-28T18:38:02.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.974+0000 7fcfacad6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfa80b4310 0x7fcfa814ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:02.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.974+0000 7fcfacad6640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcfa80cba50 0x7fcfa8150540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:02.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.974+0000 7fcfacad6640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcfa8158ce0 0x7fcfa814c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:02.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.974+0000 7fcfacad6640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa8151930 con 0x7fcfa80b4310 2023-11-28T18:38:02.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.974+0000 7fcfacad6640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa8154db0 con 0x7fcfa80cba50 2023-11-28T18:38:02.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.974+0000 7fcfacad6640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa8150a80 con 0x7fcfa8158ce0 2023-11-28T18:38:02.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.974+0000 7fcfa659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfa80b4310 0x7fcfa814ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:02.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.974+0000 7fcfa659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfa80b4310 0x7fcfa814ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53348/0 (socket says 172.21.15.45:53348) 2023-11-28T18:38:02.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.974+0000 7fcfa659c640 1 -- 172.21.15.45:0/2841189373 learned_addr learned my addr 172.21.15.45:0/2841189373 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:02.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.974+0000 7fcfa6d9d640 1 --2- 172.21.15.45:0/2841189373 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcfa8158ce0 0x7fcfa814c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:02.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.974+0000 7fcf9ffff640 1 --2- 172.21.15.45:0/2841189373 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcfa80cba50 0x7fcfa8150540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:02.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.974+0000 7fcfa659c640 1 -- 172.21.15.45:0/2841189373 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcfa8158ce0 msgr2=0x7fcfa814c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:02.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.974+0000 7fcfa659c640 1 --2- 172.21.15.45:0/2841189373 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcfa8158ce0 0x7fcfa814c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:02.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.974+0000 7fcfa659c640 1 -- 172.21.15.45:0/2841189373 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcfa80cba50 msgr2=0x7fcfa8150540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:02.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.974+0000 7fcfa659c640 1 --2- 172.21.15.45:0/2841189373 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcfa80cba50 0x7fcfa8150540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:02.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.974+0000 7fcfa659c640 1 -- 172.21.15.45:0/2841189373 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf90009420 con 0x7fcfa80b4310 2023-11-28T18:38:02.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.974+0000 7fcfa6d9d640 1 --2- 172.21.15.45:0/2841189373 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcfa8158ce0 0x7fcfa814c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:38:02.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.974+0000 7fcfa659c640 1 --2- 172.21.15.45:0/2841189373 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfa80b4310 0x7fcfa814ec80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fcf9800c450 tx=0x7fcf9800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:02.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.974+0000 7fcf9effd640 1 -- 172.21.15.45:0/2841189373 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf98005cf0 con 0x7fcfa80b4310 2023-11-28T18:38:02.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.974+0000 7fcf9effd640 1 -- 172.21.15.45:0/2841189373 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf98005e50 con 0x7fcfa80b4310 2023-11-28T18:38:02.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.974+0000 7fcf9effd640 1 -- 172.21.15.45:0/2841189373 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf980072b0 con 0x7fcfa80b4310 2023-11-28T18:38:02.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.974+0000 7fcfacad6640 1 -- 172.21.15.45:0/2841189373 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfa8150cb0 con 0x7fcfa80b4310 2023-11-28T18:38:02.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.974+0000 7fcfacad6640 1 -- 172.21.15.45:0/2841189373 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfa8151270 con 0x7fcfa80b4310 2023-11-28T18:38:02.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.974+0000 7fcfacad6640 1 -- 172.21.15.45:0/2841189373 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfa8069410 con 0x7fcfa80b4310 2023-11-28T18:38:02.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.978+0000 7fcf9effd640 1 -- 172.21.15.45:0/2841189373 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fcf98007410 con 0x7fcfa80b4310 2023-11-28T18:38:02.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.978+0000 7fcf9effd640 1 --2- 172.21.15.45:0/2841189373 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fcf880668d0 0x7fcf88068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:02.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.978+0000 7fcf9effd640 1 -- 172.21.15.45:0/2841189373 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcf98083950 con 0x7fcfa80b4310 2023-11-28T18:38:02.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.978+0000 7fcf9ffff640 1 --2- 172.21.15.45:0/2841189373 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fcf880668d0 0x7fcf88068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:02.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.978+0000 7fcf9ffff640 1 --2- 172.21.15.45:0/2841189373 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fcf880668d0 0x7fcf88068d90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fcf900ae000 tx=0x7fcf90008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:02.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:02.982+0000 7fcf9effd640 1 -- 172.21.15.45:0/2841189373 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcf98050bb0 con 0x7fcfa80b4310 2023-11-28T18:38:03.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.142+0000 7fcfacad6640 1 -- 172.21.15.45:0/2841189373 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcfa80719e0 con 0x7fcfa80b4310 2023-11-28T18:38:03.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.142+0000 7fcf9effd640 1 -- 172.21.15.45:0/2841189373 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcf980170a0 con 0x7fcfa80b4310 2023-11-28T18:38:03.144 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-11-28T18:38:03.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.142+0000 7fcfacad6640 1 -- 172.21.15.45:0/2841189373 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fcf880668d0 msgr2=0x7fcf88068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:03.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.142+0000 7fcfacad6640 1 --2- 172.21.15.45:0/2841189373 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fcf880668d0 0x7fcf88068d90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fcf900ae000 tx=0x7fcf90008040 comp rx=0 tx=0).stop 2023-11-28T18:38:03.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.142+0000 7fcfacad6640 1 -- 172.21.15.45:0/2841189373 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfa80b4310 msgr2=0x7fcfa814ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:03.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.142+0000 7fcfacad6640 1 --2- 172.21.15.45:0/2841189373 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfa80b4310 0x7fcfa814ec80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fcf9800c450 tx=0x7fcf9800c910 comp rx=0 tx=0).stop 2023-11-28T18:38:03.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.142+0000 7fcfacad6640 1 -- 172.21.15.45:0/2841189373 shutdown_connections 2023-11-28T18:38:03.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.142+0000 7fcfacad6640 1 --2- 172.21.15.45:0/2841189373 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fcf880668d0 0x7fcf88068d90 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:03.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.142+0000 7fcfacad6640 1 --2- 172.21.15.45:0/2841189373 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcfa8158ce0 0x7fcfa814c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:03.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.142+0000 7fcfacad6640 1 --2- 172.21.15.45:0/2841189373 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcfa80cba50 0x7fcfa8150540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:03.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.142+0000 7fcfacad6640 1 --2- 172.21.15.45:0/2841189373 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfa80b4310 0x7fcfa814ec80 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:03.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.142+0000 7fcfacad6640 1 -- 172.21.15.45:0/2841189373 >> 172.21.15.45:0/2841189373 conn(0x7fcfa80b0d00 msgr2=0x7fcfa80b10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:03.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.142+0000 7fcfacad6640 1 -- 172.21.15.45:0/2841189373 shutdown_connections 2023-11-28T18:38:03.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.142+0000 7fcfacad6640 1 -- 172.21.15.45:0/2841189373 wait complete. 2023-11-28T18:38:03.177 INFO:tasks.cephfs_test_runner:Starting test: test_inject_to_empty (tasks.cephfs.test_journal_repair.TestJournalRepair) That when some dentries in the journal but nothing is in 2023-11-28T18:38:03.178 INFO:tasks.cephfs_test_runner:test_inject_to_empty (tasks.cephfs.test_journal_repair.TestJournalRepair) 2023-11-28T18:38:03.178 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T18:38:03.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.318+0000 7fbba43d1640 1 Processor -- start 2023-11-28T18:38:03.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.318+0000 7fbba43d1640 1 -- start start 2023-11-28T18:38:03.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.322+0000 7fbba43d1640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbb9c06ca10 0x7fbb9c0704a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:03.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.322+0000 7fbba43d1640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb9c071120 con 0x7fbb9c144880 2023-11-28T18:38:03.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.322+0000 7fbba43d1640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb9c071400 con 0x7fbb9c0721c0 2023-11-28T18:38:03.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.322+0000 7fbba43d1640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb9c15f050 con 0x7fbb9c06ca10 2023-11-28T18:38:03.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.322+0000 7fbba216d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fbb9c144880 0x7fbb9c06c300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33774/0 (socket says 172.21.15.45:33774) 2023-11-28T18:38:03.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.322+0000 7fbba216d640 1 -- 172.21.15.45:0/2508686095 learned_addr learned my addr 172.21.15.45:0/2508686095 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:38:03.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.322+0000 7fbba196c640 1 --2- 172.21.15.45:0/2508686095 >> v2:172.21.15.45:3300/0 conn(0x7fbb9c06ca10 0x7fbb9c0704a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:03.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.322+0000 7fbba116b640 1 -- 172.21.15.45:0/2508686095 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 623476103 0 0) 0x7fbb9c071120 con 0x7fbb9c144880 2023-11-28T18:38:03.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.322+0000 7fbba196c640 1 -- 172.21.15.45:0/2508686095 >> v1:172.21.15.190:6789/0 conn(0x7fbb9c0721c0 legacy=0x7fbb9c15b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:03.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.322+0000 7fbba196c640 1 -- 172.21.15.45:0/2508686095 >> v1:172.21.15.45:6789/0 conn(0x7fbb9c144880 legacy=0x7fbb9c06c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:03.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.322+0000 7fbba196c640 1 -- 172.21.15.45:0/2508686095 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb9c0716e0 con 0x7fbb9c06ca10 2023-11-28T18:38:03.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.322+0000 7fbba196c640 1 --2- 172.21.15.45:0/2508686095 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb9c06ca10 0x7fbb9c0704a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c0097c0 tx=0x7fbb8c01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fb57fbccad56848 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:03.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.326+0000 7fbba116b640 1 -- 172.21.15.45:0/2508686095 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb8c0ab610 con 0x7fbb9c06ca10 2023-11-28T18:38:03.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.326+0000 7fbba116b640 1 -- 172.21.15.45:0/2508686095 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb8c0ab770 con 0x7fbb9c06ca10 2023-11-28T18:38:03.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.326+0000 7fbba116b640 1 -- 172.21.15.45:0/2508686095 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb8c0abb00 con 0x7fbb9c06ca10 2023-11-28T18:38:03.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.326+0000 7fbba43d1640 1 -- 172.21.15.45:0/2508686095 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb9c06ca10 msgr2=0x7fbb9c0704a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:03.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.326+0000 7fbba43d1640 1 --2- 172.21.15.45:0/2508686095 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb9c06ca10 0x7fbb9c0704a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c0097c0 tx=0x7fbb8c01c410 comp rx=0 tx=0).stop 2023-11-28T18:38:03.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.326+0000 7fbba43d1640 1 -- 172.21.15.45:0/2508686095 shutdown_connections 2023-11-28T18:38:03.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.326+0000 7fbba43d1640 1 --2- 172.21.15.45:0/2508686095 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb9c06ca10 0x7fbb9c0704a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:03.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.326+0000 7fbba43d1640 1 -- 172.21.15.45:0/2508686095 >> 172.21.15.45:0/2508686095 conn(0x7fbb9c06a570 msgr2=0x7fbb9c06a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:03.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.326+0000 7fbba43d1640 1 -- 172.21.15.45:0/2508686095 shutdown_connections 2023-11-28T18:38:03.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.326+0000 7fbba43d1640 1 -- 172.21.15.45:0/2508686095 wait complete. 2023-11-28T18:38:03.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.326+0000 7fbba43d1640 1 Processor -- start 2023-11-28T18:38:03.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.326+0000 7fbba43d1640 1 -- start start 2023-11-28T18:38:03.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.326+0000 7fbba43d1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbb9c06ca10 0x7fbb9c1662e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:03.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.326+0000 7fbba43d1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb9c0721c0 0x7fbb9c13b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:03.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.326+0000 7fbba43d1640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbb9c144880 0x7fbb9c142c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:03.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.326+0000 7fbba43d1640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9c13bf30 con 0x7fbb9c0721c0 2023-11-28T18:38:03.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.326+0000 7fbba43d1640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9c142230 con 0x7fbb9c144880 2023-11-28T18:38:03.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.326+0000 7fbba43d1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9c165370 con 0x7fbb9c06ca10 2023-11-28T18:38:03.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.326+0000 7fbba196c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb9c0721c0 0x7fbb9c13b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:03.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.326+0000 7fbba196c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb9c0721c0 0x7fbb9c13b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53376/0 (socket says 172.21.15.45:53376) 2023-11-28T18:38:03.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.326+0000 7fbba196c640 1 -- 172.21.15.45:0/3517797358 learned_addr learned my addr 172.21.15.45:0/3517797358 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:03.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.330+0000 7fbba216d640 1 --2- 172.21.15.45:0/3517797358 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbb9c06ca10 0x7fbb9c1662e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:03.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.330+0000 7fbba296e640 1 --2- 172.21.15.45:0/3517797358 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbb9c144880 0x7fbb9c142c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:03.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.330+0000 7fbba196c640 1 -- 172.21.15.45:0/3517797358 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbb9c06ca10 msgr2=0x7fbb9c1662e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:03.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.330+0000 7fbba196c640 1 --2- 172.21.15.45:0/3517797358 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbb9c06ca10 0x7fbb9c1662e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:03.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.330+0000 7fbba196c640 1 -- 172.21.15.45:0/3517797358 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbb9c144880 msgr2=0x7fbb9c142c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:03.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.330+0000 7fbba196c640 1 --2- 172.21.15.45:0/3517797358 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbb9c144880 0x7fbb9c142c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:03.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.330+0000 7fbba196c640 1 -- 172.21.15.45:0/3517797358 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb8c009420 con 0x7fbb9c0721c0 2023-11-28T18:38:03.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.330+0000 7fbba196c640 1 --2- 172.21.15.45:0/3517797358 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb9c0721c0 0x7fbb9c13b9f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c0ad040 tx=0x7fbb8c01ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:03.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.330+0000 7fbb92ffd640 1 -- 172.21.15.45:0/3517797358 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb8c0b5810 con 0x7fbb9c0721c0 2023-11-28T18:38:03.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.330+0000 7fbb92ffd640 1 -- 172.21.15.45:0/3517797358 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb8c0b5990 con 0x7fbb9c0721c0 2023-11-28T18:38:03.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.330+0000 7fbb92ffd640 1 -- 172.21.15.45:0/3517797358 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb8c0b5d40 con 0x7fbb9c0721c0 2023-11-28T18:38:03.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.330+0000 7fbba43d1640 1 -- 172.21.15.45:0/3517797358 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb9c165650 con 0x7fbb9c0721c0 2023-11-28T18:38:03.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.330+0000 7fbba43d1640 1 -- 172.21.15.45:0/3517797358 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb9c142760 con 0x7fbb9c0721c0 2023-11-28T18:38:03.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.330+0000 7fbba43d1640 1 -- 172.21.15.45:0/3517797358 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb9c142950 con 0x7fbb9c0721c0 2023-11-28T18:38:03.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.330+0000 7fbb92ffd640 1 -- 172.21.15.45:0/3517797358 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fbb8c0bf410 con 0x7fbb9c0721c0 2023-11-28T18:38:03.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.330+0000 7fbb92ffd640 1 --2- 172.21.15.45:0/3517797358 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbb800668d0 0x7fbb80068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:03.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.334+0000 7fbb92ffd640 1 -- 172.21.15.45:0/3517797358 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbb8c11ee30 con 0x7fbb9c0721c0 2023-11-28T18:38:03.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.334+0000 7fbba216d640 1 --2- 172.21.15.45:0/3517797358 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbb800668d0 0x7fbb80068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:03.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.334+0000 7fbba216d640 1 --2- 172.21.15.45:0/3517797358 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbb800668d0 0x7fbb80068d90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fbb98000f70 tx=0x7fbb98007df0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:03.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.338+0000 7fbb92ffd640 1 -- 172.21.15.45:0/3517797358 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbb8c0ec110 con 0x7fbb9c0721c0 2023-11-28T18:38:03.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.494+0000 7fbba43d1640 1 -- 172.21.15.45:0/3517797358 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbb9c15c570 con 0x7fbb9c0721c0 2023-11-28T18:38:03.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.494+0000 7fbb92ffd640 1 -- 172.21.15.45:0/3517797358 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16469 (secure 0 0 0) 0x7fbb9c15c570 con 0x7fbb9c0721c0 2023-11-28T18:38:03.498 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:38:03.498 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":20,"fsid":"d10f5cd6-1d00-4019-99b6-6fa435498a15","created":"2023-11-28T18:37:08.189030+0000","modified":"2023-11-28T18:37:33.971141+0000","last_up_change":"2023-11-28T18:37:20.196124+0000","last_in_change":"2023-11-28T18:37:10.742043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T18:37:21.293917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T18:37:31.384760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T18:37:31.834769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"84465384-103c-4f2c-a45a-96f5bb9c835f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6809","nonce":555237322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6811","nonce":555237322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6815","nonce":555237322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6813","nonce":555237322}]},"public_addr":"172.21.15.45:6809/555237322","cluster_addr":"172.21.15.45:6811/555237322","heartbeat_back_addr":"172.21.15.45:6815/555237322","heartbeat_front_addr":"172.21.15.45:6813/555237322","state":["exists","up"]},{"osd":1,"uuid":"7d9eed24-a58f-42c7-a787-ac06be8553fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6801","nonce":2857063763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6803","nonce":2857063763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6807","nonce":2857063763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6805","nonce":2857063763}]},"public_addr":"172.21.15.45:6801/2857063763","cluster_addr":"172.21.15.45:6803/2857063763","heartbeat_back_addr":"172.21.15.45:6807/2857063763","heartbeat_front_addr":"172.21.15.45:6805/2857063763","state":["exists","up"]},{"osd":2,"uuid":"575eeccc-4abf-45b4-9caf-f3e797859588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6817","nonce":193884539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6819","nonce":193884539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6823","nonce":193884539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6821","nonce":193884539}]},"public_addr":"172.21.15.45:6817/193884539","cluster_addr":"172.21.15.45:6819/193884539","heartbeat_back_addr":"172.21.15.45:6823/193884539","heartbeat_front_addr":"172.21.15.45:6821/193884539","state":["exists","up"]},{"osd":3,"uuid":"9b0290d6-9a52-4bc8-b2a1-7622c5dc8e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6825","nonce":78541084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6827","nonce":78541084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6831","nonce":78541084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6829","nonce":78541084}]},"public_addr":"172.21.15.45:6825/78541084","cluster_addr":"172.21.15.45:6827/78541084","heartbeat_back_addr":"172.21.15.45:6831/78541084","heartbeat_front_addr":"172.21.15.45:6829/78541084","state":["exists","up"]},{"osd":4,"uuid":"ce632829-f027-4fbf-a627-02c571aa9d53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6809","nonce":1537591987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6811","nonce":1537591987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6815","nonce":1537591987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6813","nonce":1537591987}]},"public_addr":"172.21.15.190:6809/1537591987","cluster_addr":"172.21.15.190:6811/1537591987","heartbeat_back_addr":"172.21.15.190:6815/1537591987","heartbeat_front_addr":"172.21.15.190:6813/1537591987","state":["exists","up"]},{"osd":5,"uuid":"8700b609-27be-40bd-a251-4c0ae0a29ead","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6801","nonce":3296698407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6803","nonce":3296698407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6807","nonce":3296698407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6805","nonce":3296698407}]},"public_addr":"172.21.15.190:6801/3296698407","cluster_addr":"172.21.15.190:6803/3296698407","heartbeat_back_addr":"172.21.15.190:6807/3296698407","heartbeat_front_addr":"172.21.15.190:6805/3296698407","state":["exists","up"]},{"osd":6,"uuid":"44ce4a40-e6ff-4f4d-8e8a-7341e5c91f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6817","nonce":2317686718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6819","nonce":2317686718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6823","nonce":2317686718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6821","nonce":2317686718}]},"public_addr":"172.21.15.190:6817/2317686718","cluster_addr":"172.21.15.190:6819/2317686718","heartbeat_back_addr":"172.21.15.190:6823/2317686718","heartbeat_front_addr":"172.21.15.190:6821/2317686718","state":["exists","up"]},{"osd":7,"uuid":"192238c9-1423-4b7e-ac8f-84ba32113ddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6825","nonce":2493232051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6827","nonce":2493232051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6831","nonce":2493232051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6829","nonce":2493232051}]},"public_addr":"172.21.15.190:6825/2493232051","cluster_addr":"172.21.15.190:6827/2493232051","heartbeat_back_addr":"172.21.15.190:6831/2493232051","heartbeat_front_addr":"172.21.15.190:6829/2493232051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.393552+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.385453+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.361421+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.366408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.363226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.276007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.414605+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.445885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T18:38:03.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.498+0000 7fbba43d1640 1 -- 172.21.15.45:0/3517797358 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbb800668d0 msgr2=0x7fbb80068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:03.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.498+0000 7fbba43d1640 1 --2- 172.21.15.45:0/3517797358 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbb800668d0 0x7fbb80068d90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fbb98000f70 tx=0x7fbb98007df0 comp rx=0 tx=0).stop 2023-11-28T18:38:03.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.498+0000 7fbba43d1640 1 -- 172.21.15.45:0/3517797358 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb9c0721c0 msgr2=0x7fbb9c13b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:03.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.498+0000 7fbba43d1640 1 --2- 172.21.15.45:0/3517797358 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb9c0721c0 0x7fbb9c13b9f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c0ad040 tx=0x7fbb8c01ac50 comp rx=0 tx=0).stop 2023-11-28T18:38:03.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.498+0000 7fbba43d1640 1 -- 172.21.15.45:0/3517797358 shutdown_connections 2023-11-28T18:38:03.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.498+0000 7fbba43d1640 1 --2- 172.21.15.45:0/3517797358 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbb800668d0 0x7fbb80068d90 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:03.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.498+0000 7fbba43d1640 1 --2- 172.21.15.45:0/3517797358 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbb9c144880 0x7fbb9c142c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:03.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.498+0000 7fbba43d1640 1 --2- 172.21.15.45:0/3517797358 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb9c0721c0 0x7fbb9c13b9f0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:03.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.498+0000 7fbba43d1640 1 --2- 172.21.15.45:0/3517797358 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbb9c06ca10 0x7fbb9c1662e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:03.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.498+0000 7fbba43d1640 1 -- 172.21.15.45:0/3517797358 >> 172.21.15.45:0/3517797358 conn(0x7fbb9c06a570 msgr2=0x7fbb9c15d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:03.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.498+0000 7fbba43d1640 1 -- 172.21.15.45:0/3517797358 shutdown_connections 2023-11-28T18:38:03.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.498+0000 7fbba43d1640 1 -- 172.21.15.45:0/3517797358 wait complete. 2023-11-28T18:38:03.519 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T18:37:21.293917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T18:37:31.384760+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T18:37:31.834769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T18:38:03.520 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T18:38:03.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.662+0000 7f3933ee3640 1 Processor -- start 2023-11-28T18:38:03.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.662+0000 7f3933ee3640 1 -- start start 2023-11-28T18:38:03.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.662+0000 7f3933ee3640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f392c158ce0 0x7f392c15eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:03.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.662+0000 7f3933ee3640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f392c15b6b0 con 0x7f392c0cba50 2023-11-28T18:38:03.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.662+0000 7f3933ee3640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f392c15c550 con 0x7f392c0b4310 2023-11-28T18:38:03.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.662+0000 7f3933ee3640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f392c15f450 con 0x7f392c158ce0 2023-11-28T18:38:03.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.666+0000 7f393147e640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f392c0cba50 0x7f392c15be40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33778/0 (socket says 172.21.15.45:33778) 2023-11-28T18:38:03.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.666+0000 7f393147e640 1 -- 172.21.15.45:0/281519283 learned_addr learned my addr 172.21.15.45:0/281519283 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:38:03.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.666+0000 7f3931c7f640 1 --2- 172.21.15.45:0/281519283 >> v2:172.21.15.190:3300/0 conn(0x7f392c158ce0 0x7f392c15eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:03.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.666+0000 7f3930c7d640 1 -- 172.21.15.45:0/281519283 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2719819988 0 0) 0x7f392c15b6b0 con 0x7f392c0cba50 2023-11-28T18:38:03.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.666+0000 7f3930c7d640 1 -- 172.21.15.45:0/281519283 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3918003530 con 0x7f392c0cba50 2023-11-28T18:38:03.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.666+0000 7f3930c7d640 1 -- 172.21.15.45:0/281519283 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1233126604 0 0) 0x7f3918003530 con 0x7f392c0cba50 2023-11-28T18:38:03.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.666+0000 7f3930c7d640 1 -- 172.21.15.45:0/281519283 >> v2:172.21.15.190:3300/0 conn(0x7f392c158ce0 msgr2=0x7f392c15eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:03.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.666+0000 7f3930c7d640 1 --2- 172.21.15.45:0/281519283 >> v2:172.21.15.190:3300/0 conn(0x7f392c158ce0 0x7f392c15eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:03.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.666+0000 7f3930c7d640 1 -- 172.21.15.45:0/281519283 >> v1:172.21.15.190:6789/0 conn(0x7f392c0b4310 legacy=0x7f392c070430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:03.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.666+0000 7f3930c7d640 1 -- 172.21.15.45:0/281519283 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f392c15f730 con 0x7f392c0cba50 2023-11-28T18:38:03.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.666+0000 7f3930c7d640 1 -- 172.21.15.45:0/281519283 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4084481567 0 0) 0x7f391c001680 con 0x7f392c0cba50 2023-11-28T18:38:03.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.666+0000 7f3930c7d640 1 -- 172.21.15.45:0/281519283 >> v1:172.21.15.45:6789/0 conn(0x7f392c0cba50 legacy=0x7f392c15be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:03.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.666+0000 7f3930c7d640 1 --2- 172.21.15.45:0/281519283 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f39180039d0 0x7f3918003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:03.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.666+0000 7f3930c7d640 1 --2- 172.21.15.45:0/281519283 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f39180047d0 0x7f3918004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:03.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.666+0000 7f3930c7d640 1 --2- 172.21.15.45:0/281519283 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3918005190 0x7f391800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:03.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.666+0000 7f3930c7d640 1 -- 172.21.15.45:0/281519283 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f392c15f450 con 0x7f3918005190 2023-11-28T18:38:03.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.666+0000 7f3930c7d640 1 -- 172.21.15.45:0/281519283 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f391800c090 con 0x7f39180039d0 2023-11-28T18:38:03.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.666+0000 7f3930c7d640 1 -- 172.21.15.45:0/281519283 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f391800c250 con 0x7f39180047d0 2023-11-28T18:38:03.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.666+0000 7f3931c7f640 1 --2- 172.21.15.45:0/281519283 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f39180039d0 0x7f3918003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:03.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.666+0000 7f3932480640 1 --2- 172.21.15.45:0/281519283 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3918005190 0x7f391800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:03.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.666+0000 7f393147e640 1 --2- 172.21.15.45:0/281519283 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f39180047d0 0x7f3918004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:03.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.666+0000 7f3932480640 1 -- 172.21.15.45:0/281519283 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f39180047d0 msgr2=0x7f3918004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:03.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.666+0000 7f3932480640 1 --2- 172.21.15.45:0/281519283 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f39180047d0 0x7f3918004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:03.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.666+0000 7f3932480640 1 -- 172.21.15.45:0/281519283 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f39180039d0 msgr2=0x7f3918003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:03.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.666+0000 7f3932480640 1 --2- 172.21.15.45:0/281519283 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f39180039d0 0x7f3918003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:03.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.666+0000 7f3932480640 1 -- 172.21.15.45:0/281519283 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3918003530 con 0x7f3918005190 2023-11-28T18:38:03.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.666+0000 7f3931c7f640 1 --2- 172.21.15.45:0/281519283 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f39180039d0 0x7f3918003df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:38:03.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.670+0000 7f3932480640 1 -- 172.21.15.45:0/281519283 reap_dead start 2023-11-28T18:38:03.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.670+0000 7f3932480640 1 --2- 172.21.15.45:0/281519283 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3918005190 0x7f391800b990 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3924001e70 tx=0x7f392401c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9d56134886f5632 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:03.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.670+0000 7f3930c7d640 1 -- 172.21.15.45:0/281519283 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3924003b80 con 0x7f3918005190 2023-11-28T18:38:03.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.670+0000 7f3930c7d640 1 -- 172.21.15.45:0/281519283 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3924003d20 con 0x7f3918005190 2023-11-28T18:38:03.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.670+0000 7f3930c7d640 1 -- 172.21.15.45:0/281519283 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3924005260 con 0x7f3918005190 2023-11-28T18:38:03.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.670+0000 7f3933ee3640 1 -- 172.21.15.45:0/281519283 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3918005190 msgr2=0x7f391800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:03.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.670+0000 7f3933ee3640 1 --2- 172.21.15.45:0/281519283 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3918005190 0x7f391800b990 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3924001e70 tx=0x7f392401c760 comp rx=0 tx=0).stop 2023-11-28T18:38:03.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.670+0000 7f3933ee3640 1 -- 172.21.15.45:0/281519283 shutdown_connections 2023-11-28T18:38:03.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.670+0000 7f3933ee3640 1 --2- 172.21.15.45:0/281519283 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3918005190 0x7f391800b990 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:03.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.670+0000 7f3933ee3640 1 -- 172.21.15.45:0/281519283 >> 172.21.15.45:0/281519283 conn(0x7f392c0b0d00 msgr2=0x7f392c0b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:03.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.670+0000 7f3933ee3640 1 -- 172.21.15.45:0/281519283 shutdown_connections 2023-11-28T18:38:03.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.670+0000 7f3933ee3640 1 -- 172.21.15.45:0/281519283 wait complete. 2023-11-28T18:38:03.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.670+0000 7f3933ee3640 1 Processor -- start 2023-11-28T18:38:03.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.670+0000 7f3933ee3640 1 -- start start 2023-11-28T18:38:03.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.674+0000 7f3933ee3640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3918005190 0x7f392c0ad6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:03.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.674+0000 7f3933ee3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f392c14a260 0x7f392c14a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:03.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.674+0000 7f3933ee3640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f392c1e6490 0x7f392c1e6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:03.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.674+0000 7f3933ee3640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f392c1443f0 con 0x7f392c14a260 2023-11-28T18:38:03.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.674+0000 7f3933ee3640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f392c14ac00 con 0x7f392c1e6490 2023-11-28T18:38:03.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.674+0000 7f3933ee3640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f392c1e71f0 con 0x7f3918005190 2023-11-28T18:38:03.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.674+0000 7f393147e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f392c14a260 0x7f392c14a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:03.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.674+0000 7f393147e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f392c14a260 0x7f392c14a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53396/0 (socket says 172.21.15.45:53396) 2023-11-28T18:38:03.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.674+0000 7f393147e640 1 -- 172.21.15.45:0/4202314608 learned_addr learned my addr 172.21.15.45:0/4202314608 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:03.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.674+0000 7f3932480640 1 --2- 172.21.15.45:0/4202314608 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f392c1e6490 0x7f392c1e6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:03.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.674+0000 7f393147e640 1 -- 172.21.15.45:0/4202314608 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3918005190 msgr2=0x7f392c0ad6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:03.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.674+0000 7f3931c7f640 1 --2- 172.21.15.45:0/4202314608 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3918005190 0x7f392c0ad6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:03.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.674+0000 7f393147e640 1 --2- 172.21.15.45:0/4202314608 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3918005190 0x7f392c0ad6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:03.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.674+0000 7f393147e640 1 -- 172.21.15.45:0/4202314608 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f392c1e6490 msgr2=0x7f392c1e6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:03.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.674+0000 7f393147e640 1 --2- 172.21.15.45:0/4202314608 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f392c1e6490 0x7f392c1e6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:03.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.674+0000 7f393147e640 1 -- 172.21.15.45:0/4202314608 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f392c144720 con 0x7f392c14a260 2023-11-28T18:38:03.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.674+0000 7f3932480640 1 --2- 172.21.15.45:0/4202314608 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f392c1e6490 0x7f392c1e6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:38:03.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.674+0000 7f3931c7f640 1 --2- 172.21.15.45:0/4202314608 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3918005190 0x7f392c0ad6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:38:03.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.674+0000 7f393147e640 1 --2- 172.21.15.45:0/4202314608 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f392c14a260 0x7f392c14a6c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f391c000c10 tx=0x7f391c007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:03.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.674+0000 7f39227fc640 1 -- 172.21.15.45:0/4202314608 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391c0015f0 con 0x7f392c14a260 2023-11-28T18:38:03.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.674+0000 7f39227fc640 1 -- 172.21.15.45:0/4202314608 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f391c00f9c0 con 0x7f392c14a260 2023-11-28T18:38:03.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.674+0000 7f39227fc640 1 -- 172.21.15.45:0/4202314608 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391c00fd70 con 0x7f392c14a260 2023-11-28T18:38:03.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.674+0000 7f3933ee3640 1 -- 172.21.15.45:0/4202314608 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f392c144a00 con 0x7f392c14a260 2023-11-28T18:38:03.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.674+0000 7f3933ee3640 1 -- 172.21.15.45:0/4202314608 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f392c144fc0 con 0x7f392c14a260 2023-11-28T18:38:03.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.674+0000 7f3933ee3640 1 -- 172.21.15.45:0/4202314608 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f392c069410 con 0x7f392c14a260 2023-11-28T18:38:03.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.674+0000 7f39227fc640 1 -- 172.21.15.45:0/4202314608 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f391c01d460 con 0x7f392c14a260 2023-11-28T18:38:03.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.678+0000 7f39227fc640 1 --2- 172.21.15.45:0/4202314608 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f3910066900 0x7f3910068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:03.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.678+0000 7f39227fc640 1 -- 172.21.15.45:0/4202314608 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f391c084690 con 0x7f392c14a260 2023-11-28T18:38:03.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.678+0000 7f3931c7f640 1 --2- 172.21.15.45:0/4202314608 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f3910066900 0x7f3910068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:03.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.678+0000 7f3931c7f640 1 --2- 172.21.15.45:0/4202314608 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f3910066900 0x7f3910068dc0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3928009c00 tx=0x7f3928008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:03.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.682+0000 7f39227fc640 1 -- 172.21.15.45:0/4202314608 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f391c0517a0 con 0x7f392c14a260 2023-11-28T18:38:03.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.838+0000 7f3933ee3640 1 -- 172.21.15.45:0/4202314608 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f392c0716f0 con 0x7f392c14a260 2023-11-28T18:38:03.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.838+0000 7f39227fc640 1 -- 172.21.15.45:0/4202314608 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f391c054dc0 con 0x7f392c14a260 2023-11-28T18:38:03.840 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-11-28T18:38:03.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.838+0000 7f3933ee3640 1 -- 172.21.15.45:0/4202314608 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f3910066900 msgr2=0x7f3910068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:03.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.838+0000 7f3933ee3640 1 --2- 172.21.15.45:0/4202314608 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f3910066900 0x7f3910068dc0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3928009c00 tx=0x7f3928008040 comp rx=0 tx=0).stop 2023-11-28T18:38:03.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.838+0000 7f3933ee3640 1 -- 172.21.15.45:0/4202314608 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f392c14a260 msgr2=0x7f392c14a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:03.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.838+0000 7f3933ee3640 1 --2- 172.21.15.45:0/4202314608 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f392c14a260 0x7f392c14a6c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f391c000c10 tx=0x7f391c007720 comp rx=0 tx=0).stop 2023-11-28T18:38:03.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.838+0000 7f3933ee3640 1 -- 172.21.15.45:0/4202314608 shutdown_connections 2023-11-28T18:38:03.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.838+0000 7f3933ee3640 1 --2- 172.21.15.45:0/4202314608 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f3910066900 0x7f3910068dc0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:03.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.838+0000 7f3933ee3640 1 --2- 172.21.15.45:0/4202314608 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f392c1e6490 0x7f392c1e6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:03.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.838+0000 7f3933ee3640 1 --2- 172.21.15.45:0/4202314608 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f392c14a260 0x7f392c14a6c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:03.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.838+0000 7f3933ee3640 1 --2- 172.21.15.45:0/4202314608 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3918005190 0x7f392c0ad6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:03.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.838+0000 7f3933ee3640 1 -- 172.21.15.45:0/4202314608 >> 172.21.15.45:0/4202314608 conn(0x7f392c0b0d00 msgr2=0x7f392c0af740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:03.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.838+0000 7f3933ee3640 1 -- 172.21.15.45:0/4202314608 shutdown_connections 2023-11-28T18:38:03.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:03.838+0000 7f3933ee3640 1 -- 172.21.15.45:0/4202314608 wait complete. 2023-11-28T18:38:03.861 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T18:38:04.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.006+0000 7fbed32f5640 1 Processor -- start 2023-11-28T18:38:04.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.006+0000 7fbed32f5640 1 -- start start 2023-11-28T18:38:04.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.006+0000 7fbed32f5640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbecc0cfb20 0x7fbecc0b3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:04.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.006+0000 7fbed32f5640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fbecc0b42b0 0x7fbecc0d0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:04.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.006+0000 7fbed32f5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbecc0cff00 0x7fbecc0d10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:04.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.006+0000 7fbed32f5640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbecc0b3d40 con 0x7fbecc0cff00 2023-11-28T18:38:04.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.006+0000 7fbed32f5640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbecc0d0490 con 0x7fbecc0b42b0 2023-11-28T18:38:04.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.006+0000 7fbed32f5640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbecc0d0770 con 0x7fbecc0cfb20 2023-11-28T18:38:04.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.006+0000 7fbed2af4640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbecc0cff00 0x7fbecc0d10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:04.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.006+0000 7fbed2af4640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbecc0cff00 0x7fbecc0d10e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53406/0 (socket says 172.21.15.45:53406) 2023-11-28T18:38:04.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.006+0000 7fbed2af4640 1 -- 172.21.15.45:0/1710254461 learned_addr learned my addr 172.21.15.45:0/1710254461 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:04.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.006+0000 7fbed22f3640 1 --2- 172.21.15.45:0/1710254461 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbecc0cfb20 0x7fbecc0b3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:04.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.006+0000 7fbed1af2640 1 --2- 172.21.15.45:0/1710254461 >> v2:172.21.15.190:3300/0 conn(0x7fbecc0b42b0 0x7fbecc0d0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:04.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.006+0000 7fbed2af4640 1 -- 172.21.15.45:0/1710254461 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbecc0cfb20 msgr2=0x7fbecc0b3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:04.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.006+0000 7fbed2af4640 1 --2- 172.21.15.45:0/1710254461 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbecc0cfb20 0x7fbecc0b3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:04.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.006+0000 7fbed2af4640 1 -- 172.21.15.45:0/1710254461 >> v2:172.21.15.190:3300/0 conn(0x7fbecc0b42b0 msgr2=0x7fbecc0d0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:04.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.006+0000 7fbed2af4640 1 --2- 172.21.15.45:0/1710254461 >> v2:172.21.15.190:3300/0 conn(0x7fbecc0b42b0 0x7fbecc0d0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:04.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.006+0000 7fbed2af4640 1 -- 172.21.15.45:0/1710254461 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbecc0b3240 con 0x7fbecc0cff00 2023-11-28T18:38:04.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.010+0000 7fbed2af4640 1 --2- 172.21.15.45:0/1710254461 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbecc0cff00 0x7fbecc0d10e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fbecc08bc10 tx=0x7fbec401c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bd34f32ac9d6288 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:04.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.010+0000 7fbed12f1640 1 -- 172.21.15.45:0/1710254461 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec40a5750 con 0x7fbecc0cff00 2023-11-28T18:38:04.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.010+0000 7fbed12f1640 1 -- 172.21.15.45:0/1710254461 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbec40a58b0 con 0x7fbecc0cff00 2023-11-28T18:38:04.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.010+0000 7fbed12f1640 1 -- 172.21.15.45:0/1710254461 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec40a5c40 con 0x7fbecc0cff00 2023-11-28T18:38:04.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.010+0000 7fbed32f5640 1 -- 172.21.15.45:0/1710254461 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbecc0cff00 msgr2=0x7fbecc0d10e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:04.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.010+0000 7fbed32f5640 1 --2- 172.21.15.45:0/1710254461 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbecc0cff00 0x7fbecc0d10e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fbecc08bc10 tx=0x7fbec401c8b0 comp rx=0 tx=0).stop 2023-11-28T18:38:04.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.010+0000 7fbed32f5640 1 -- 172.21.15.45:0/1710254461 shutdown_connections 2023-11-28T18:38:04.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.010+0000 7fbed32f5640 1 --2- 172.21.15.45:0/1710254461 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbecc0cff00 0x7fbecc0d10e0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:04.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.010+0000 7fbed32f5640 1 --2- 172.21.15.45:0/1710254461 >> v2:172.21.15.190:3300/0 conn(0x7fbecc0b42b0 0x7fbecc0d0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:04.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.010+0000 7fbed32f5640 1 --2- 172.21.15.45:0/1710254461 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbecc0cfb20 0x7fbecc0b3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:04.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.010+0000 7fbed32f5640 1 -- 172.21.15.45:0/1710254461 >> 172.21.15.45:0/1710254461 conn(0x7fbecc0d2fd0 msgr2=0x7fbecc0d33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:04.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.010+0000 7fbed32f5640 1 -- 172.21.15.45:0/1710254461 shutdown_connections 2023-11-28T18:38:04.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.010+0000 7fbed32f5640 1 -- 172.21.15.45:0/1710254461 wait complete. 2023-11-28T18:38:04.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.014+0000 7fbed32f5640 1 Processor -- start 2023-11-28T18:38:04.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.014+0000 7fbed32f5640 1 -- start start 2023-11-28T18:38:04.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.014+0000 7fbed32f5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbecc0b42b0 0x7fbecc150210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:04.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.014+0000 7fbed32f5640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbecc0cfb20 0x7fbecc155970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:04.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.014+0000 7fbed32f5640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbecc0cff00 0x7fbecc0ca0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:04.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.014+0000 7fbed32f5640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbecc0b1bf0 con 0x7fbecc0b42b0 2023-11-28T18:38:04.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.014+0000 7fbed32f5640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbecc150010 con 0x7fbecc0cfb20 2023-11-28T18:38:04.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.014+0000 7fbed32f5640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbecc156330 con 0x7fbecc0cff00 2023-11-28T18:38:04.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.014+0000 7fbed22f3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbecc0b42b0 0x7fbecc150210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:04.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.014+0000 7fbed22f3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbecc0b42b0 0x7fbecc150210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53408/0 (socket says 172.21.15.45:53408) 2023-11-28T18:38:04.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.014+0000 7fbed22f3640 1 -- 172.21.15.45:0/1659107059 learned_addr learned my addr 172.21.15.45:0/1659107059 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:04.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.014+0000 7fbed1af2640 1 --2- 172.21.15.45:0/1659107059 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbecc0cfb20 0x7fbecc155970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:04.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.014+0000 7fbed2af4640 1 --2- 172.21.15.45:0/1659107059 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbecc0cff00 0x7fbecc0ca0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:04.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.014+0000 7fbed22f3640 1 -- 172.21.15.45:0/1659107059 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbecc0cff00 msgr2=0x7fbecc0ca0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:04.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.014+0000 7fbed22f3640 1 --2- 172.21.15.45:0/1659107059 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbecc0cff00 0x7fbecc0ca0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:04.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.014+0000 7fbed22f3640 1 -- 172.21.15.45:0/1659107059 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbecc0cfb20 msgr2=0x7fbecc155970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:04.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.014+0000 7fbed22f3640 1 --2- 172.21.15.45:0/1659107059 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbecc0cfb20 0x7fbecc155970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:04.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.014+0000 7fbed22f3640 1 -- 172.21.15.45:0/1659107059 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbec4009b30 con 0x7fbecc0b42b0 2023-11-28T18:38:04.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.014+0000 7fbed2af4640 1 --2- 172.21.15.45:0/1659107059 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbecc0cff00 0x7fbecc0ca0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:38:04.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.014+0000 7fbed22f3640 1 --2- 172.21.15.45:0/1659107059 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbecc0b42b0 0x7fbecc150210 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fbebc00d5f0 tx=0x7fbebc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:04.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.014+0000 7fbec2ffd640 1 -- 172.21.15.45:0/1659107059 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbebc0125f0 con 0x7fbecc0b42b0 2023-11-28T18:38:04.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.014+0000 7fbec2ffd640 1 -- 172.21.15.45:0/1659107059 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbebc012750 con 0x7fbecc0b42b0 2023-11-28T18:38:04.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.014+0000 7fbed32f5640 1 -- 172.21.15.45:0/1659107059 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbecc156050 con 0x7fbecc0b42b0 2023-11-28T18:38:04.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.014+0000 7fbec2ffd640 1 -- 172.21.15.45:0/1659107059 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbebc012ae0 con 0x7fbecc0b42b0 2023-11-28T18:38:04.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.014+0000 7fbed32f5640 1 -- 172.21.15.45:0/1659107059 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbecc0b1810 con 0x7fbecc0b42b0 2023-11-28T18:38:04.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.014+0000 7fbed32f5640 1 -- 172.21.15.45:0/1659107059 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbecc0b1e60 con 0x7fbecc0b42b0 2023-11-28T18:38:04.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.018+0000 7fbec2ffd640 1 -- 172.21.15.45:0/1659107059 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fbebc012c40 con 0x7fbecc0b42b0 2023-11-28T18:38:04.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.018+0000 7fbec2ffd640 1 --2- 172.21.15.45:0/1659107059 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbeb00668d0 0x7fbeb0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:04.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.018+0000 7fbec2ffd640 1 -- 172.21.15.45:0/1659107059 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbebc084910 con 0x7fbecc0b42b0 2023-11-28T18:38:04.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.018+0000 7fbed1af2640 1 --2- 172.21.15.45:0/1659107059 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbeb00668d0 0x7fbeb0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:04.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.018+0000 7fbed1af2640 1 --2- 172.21.15.45:0/1659107059 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbeb00668d0 0x7fbeb0068d90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbecc153e00 tx=0x7fbec8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:04.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.022+0000 7fbec2ffd640 1 -- 172.21.15.45:0/1659107059 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbebc051ab0 con 0x7fbecc0b42b0 2023-11-28T18:38:04.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.178+0000 7fbed32f5640 1 -- 172.21.15.45:0/1659107059 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbecc067a30 con 0x7fbecc0b42b0 2023-11-28T18:38:04.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.178+0000 7fbec2ffd640 1 -- 172.21.15.45:0/1659107059 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbebc0550d0 con 0x7fbecc0b42b0 2023-11-28T18:38:04.181 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-11-28T18:38:04.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.182+0000 7fbed32f5640 1 -- 172.21.15.45:0/1659107059 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbeb00668d0 msgr2=0x7fbeb0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:04.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.182+0000 7fbed32f5640 1 --2- 172.21.15.45:0/1659107059 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbeb00668d0 0x7fbeb0068d90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbecc153e00 tx=0x7fbec8008040 comp rx=0 tx=0).stop 2023-11-28T18:38:04.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.182+0000 7fbed32f5640 1 -- 172.21.15.45:0/1659107059 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbecc0b42b0 msgr2=0x7fbecc150210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:04.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.182+0000 7fbed32f5640 1 --2- 172.21.15.45:0/1659107059 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbecc0b42b0 0x7fbecc150210 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fbebc00d5f0 tx=0x7fbebc00dab0 comp rx=0 tx=0).stop 2023-11-28T18:38:04.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.182+0000 7fbed32f5640 1 -- 172.21.15.45:0/1659107059 shutdown_connections 2023-11-28T18:38:04.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.182+0000 7fbed32f5640 1 --2- 172.21.15.45:0/1659107059 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbeb00668d0 0x7fbeb0068d90 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:04.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.182+0000 7fbed32f5640 1 --2- 172.21.15.45:0/1659107059 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbecc0cff00 0x7fbecc0ca0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:04.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.182+0000 7fbed32f5640 1 --2- 172.21.15.45:0/1659107059 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbecc0cfb20 0x7fbecc155970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:04.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.182+0000 7fbed32f5640 1 --2- 172.21.15.45:0/1659107059 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbecc0b42b0 0x7fbecc150210 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:04.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.182+0000 7fbed32f5640 1 -- 172.21.15.45:0/1659107059 >> 172.21.15.45:0/1659107059 conn(0x7fbecc0d2fd0 msgr2=0x7fbecc0c69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:04.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.182+0000 7fbed32f5640 1 -- 172.21.15.45:0/1659107059 shutdown_connections 2023-11-28T18:38:04.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.182+0000 7fbed32f5640 1 -- 172.21.15.45:0/1659107059 wait complete. 2023-11-28T18:38:04.203 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T18:38:04.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.346+0000 7f5923e17640 1 Processor -- start 2023-11-28T18:38:04.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.346+0000 7f5923e17640 1 -- start start 2023-11-28T18:38:04.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.346+0000 7f5923e17640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f591c071dd0 0x7f591c0721b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:04.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.346+0000 7f5923e17640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f591c13d2f0 con 0x7f591c15adf0 2023-11-28T18:38:04.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.346+0000 7f5923e17640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f591c0cddb0 con 0x7f591c13f630 2023-11-28T18:38:04.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.346+0000 7f5923e17640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f591c140560 con 0x7f591c071dd0 2023-11-28T18:38:04.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.346+0000 7f5921bb3640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f591c071dd0 0x7f591c0721b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:04.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.346+0000 7f59213b2640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f591c15adf0 0x7f591c13d5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33790/0 (socket says 172.21.15.45:33790) 2023-11-28T18:38:04.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.346+0000 7f59213b2640 1 -- 172.21.15.45:0/408154798 learned_addr learned my addr 172.21.15.45:0/408154798 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:38:04.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.346+0000 7f5921bb3640 1 -- 172.21.15.45:0/408154798 >> v1:172.21.15.190:6789/0 conn(0x7f591c13f630 legacy=0x7f591c0ce240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:04.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.346+0000 7f5921bb3640 1 -- 172.21.15.45:0/408154798 >> v1:172.21.15.45:6789/0 conn(0x7f591c15adf0 legacy=0x7f591c13d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:04.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.350+0000 7f5921bb3640 1 -- 172.21.15.45:0/408154798 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f591c0726f0 con 0x7f591c071dd0 2023-11-28T18:38:04.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.346+0000 7f5920bb1640 1 -- 172.21.15.45:0/408154798 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3927799398 0 0) 0x7f591c13d2f0 con 0x7f591c15adf0 2023-11-28T18:38:04.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.350+0000 7f5921bb3640 1 --2- 172.21.15.45:0/408154798 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f591c071dd0 0x7f591c0721b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f59180097c0 tx=0x7f591801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c47429da3b07a55 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:04.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.350+0000 7f5920bb1640 1 -- 172.21.15.45:0/408154798 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59180ab600 con 0x7f591c071dd0 2023-11-28T18:38:04.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.350+0000 7f5920bb1640 1 -- 172.21.15.45:0/408154798 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59180a7050 con 0x7f591c071dd0 2023-11-28T18:38:04.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.350+0000 7f5920bb1640 1 -- 172.21.15.45:0/408154798 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59180ab980 con 0x7f591c071dd0 2023-11-28T18:38:04.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.350+0000 7f5923e17640 1 -- 172.21.15.45:0/408154798 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f591c071dd0 msgr2=0x7f591c0721b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:04.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.350+0000 7f5923e17640 1 --2- 172.21.15.45:0/408154798 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f591c071dd0 0x7f591c0721b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f59180097c0 tx=0x7f591801c480 comp rx=0 tx=0).stop 2023-11-28T18:38:04.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.350+0000 7f5923e17640 1 -- 172.21.15.45:0/408154798 shutdown_connections 2023-11-28T18:38:04.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.350+0000 7f5923e17640 1 --2- 172.21.15.45:0/408154798 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f591c071dd0 0x7f591c0721b0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:04.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.350+0000 7f5923e17640 1 -- 172.21.15.45:0/408154798 >> 172.21.15.45:0/408154798 conn(0x7f591c0b0d00 msgr2=0x7f591c0b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:04.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.350+0000 7f5923e17640 1 -- 172.21.15.45:0/408154798 shutdown_connections 2023-11-28T18:38:04.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.350+0000 7f5923e17640 1 -- 172.21.15.45:0/408154798 wait complete. 2023-11-28T18:38:04.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.354+0000 7f5923e17640 1 Processor -- start 2023-11-28T18:38:04.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.354+0000 7f5923e17640 1 -- start start 2023-11-28T18:38:04.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.354+0000 7f5923e17640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f591c071dd0 0x7f591c0c4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:04.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.354+0000 7f5923e17640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f591c13f630 0x7f591c070f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:04.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.354+0000 7f5923e17640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f591c15adf0 0x7f591c0c6f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:04.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.354+0000 7f5923e17640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f591c0c67a0 con 0x7f591c071dd0 2023-11-28T18:38:04.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.354+0000 7f5923e17640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f591c0c5700 con 0x7f591c15adf0 2023-11-28T18:38:04.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.354+0000 7f5923e17640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f591c0c59e0 con 0x7f591c13f630 2023-11-28T18:38:04.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.354+0000 7f5921bb3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f591c071dd0 0x7f591c0c4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:04.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.354+0000 7f5921bb3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f591c071dd0 0x7f591c0c4e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53422/0 (socket says 172.21.15.45:53422) 2023-11-28T18:38:04.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.354+0000 7f5921bb3640 1 -- 172.21.15.45:0/3509449422 learned_addr learned my addr 172.21.15.45:0/3509449422 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:04.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.354+0000 7f59213b2640 1 --2- 172.21.15.45:0/3509449422 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f591c13f630 0x7f591c070f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:04.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.354+0000 7f59223b4640 1 --2- 172.21.15.45:0/3509449422 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f591c15adf0 0x7f591c0c6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:04.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.354+0000 7f5921bb3640 1 -- 172.21.15.45:0/3509449422 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f591c13f630 msgr2=0x7f591c070f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:04.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.354+0000 7f5921bb3640 1 --2- 172.21.15.45:0/3509449422 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f591c13f630 0x7f591c070f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:04.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.354+0000 7f5921bb3640 1 -- 172.21.15.45:0/3509449422 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f591c15adf0 msgr2=0x7f591c0c6f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:04.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.354+0000 7f5921bb3640 1 --2- 172.21.15.45:0/3509449422 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f591c15adf0 0x7f591c0c6f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:04.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.354+0000 7f5921bb3640 1 -- 172.21.15.45:0/3509449422 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5918009420 con 0x7f591c071dd0 2023-11-28T18:38:04.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.354+0000 7f5921bb3640 1 --2- 172.21.15.45:0/3509449422 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f591c071dd0 0x7f591c0c4e90 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f591801a0b0 tx=0x7f591801acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:04.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.354+0000 7f59127fc640 1 -- 172.21.15.45:0/3509449422 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5918004020 con 0x7f591c071dd0 2023-11-28T18:38:04.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.354+0000 7f59127fc640 1 -- 172.21.15.45:0/3509449422 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5918004180 con 0x7f591c071dd0 2023-11-28T18:38:04.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.354+0000 7f59127fc640 1 -- 172.21.15.45:0/3509449422 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59180044f0 con 0x7f591c071dd0 2023-11-28T18:38:04.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.354+0000 7f5923e17640 1 -- 172.21.15.45:0/3509449422 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f591c0c5cc0 con 0x7f591c071dd0 2023-11-28T18:38:04.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.358+0000 7f5923e17640 1 -- 172.21.15.45:0/3509449422 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f591c0c6280 con 0x7f591c071dd0 2023-11-28T18:38:04.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.358+0000 7f5923e17640 1 -- 172.21.15.45:0/3509449422 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f591c069410 con 0x7f591c071dd0 2023-11-28T18:38:04.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.358+0000 7f59127fc640 1 -- 172.21.15.45:0/3509449422 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f5918003620 con 0x7f591c071dd0 2023-11-28T18:38:04.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.358+0000 7f59127fc640 1 --2- 172.21.15.45:0/3509449422 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f59000668d0 0x7f5900068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:04.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.358+0000 7f59127fc640 1 -- 172.21.15.45:0/3509449422 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f591811ea40 con 0x7f591c071dd0 2023-11-28T18:38:04.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.358+0000 7f59213b2640 1 --2- 172.21.15.45:0/3509449422 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f59000668d0 0x7f5900068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:04.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.358+0000 7f59213b2640 1 --2- 172.21.15.45:0/3509449422 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f59000668d0 0x7f5900068d90 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f591c13e370 tx=0x7f590c007240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:04.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.362+0000 7f59127fc640 1 -- 172.21.15.45:0/3509449422 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f59180ebc90 con 0x7f591c071dd0 2023-11-28T18:38:04.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.518+0000 7f5923e17640 1 -- 172.21.15.45:0/3509449422 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f591c06e750 con 0x7f591c071dd0 2023-11-28T18:38:04.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.522+0000 7f59127fc640 1 -- 172.21.15.45:0/3509449422 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f59180b00a0 con 0x7f591c071dd0 2023-11-28T18:38:04.523 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-11-28T18:38:04.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.522+0000 7f5923e17640 1 -- 172.21.15.45:0/3509449422 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f59000668d0 msgr2=0x7f5900068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:04.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.522+0000 7f5923e17640 1 --2- 172.21.15.45:0/3509449422 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f59000668d0 0x7f5900068d90 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f591c13e370 tx=0x7f590c007240 comp rx=0 tx=0).stop 2023-11-28T18:38:04.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.522+0000 7f5923e17640 1 -- 172.21.15.45:0/3509449422 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f591c071dd0 msgr2=0x7f591c0c4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:04.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.522+0000 7f5923e17640 1 --2- 172.21.15.45:0/3509449422 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f591c071dd0 0x7f591c0c4e90 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f591801a0b0 tx=0x7f591801acc0 comp rx=0 tx=0).stop 2023-11-28T18:38:04.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.522+0000 7f5923e17640 1 -- 172.21.15.45:0/3509449422 shutdown_connections 2023-11-28T18:38:04.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.522+0000 7f5923e17640 1 --2- 172.21.15.45:0/3509449422 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f59000668d0 0x7f5900068d90 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:04.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.522+0000 7f5923e17640 1 --2- 172.21.15.45:0/3509449422 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f591c15adf0 0x7f591c0c6f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:04.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.522+0000 7f5923e17640 1 --2- 172.21.15.45:0/3509449422 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f591c13f630 0x7f591c070f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:04.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.522+0000 7f5923e17640 1 --2- 172.21.15.45:0/3509449422 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f591c071dd0 0x7f591c0c4e90 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:04.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.522+0000 7f5923e17640 1 -- 172.21.15.45:0/3509449422 >> 172.21.15.45:0/3509449422 conn(0x7f591c0b0d00 msgr2=0x7f591c150b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:04.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.522+0000 7f5923e17640 1 -- 172.21.15.45:0/3509449422 shutdown_connections 2023-11-28T18:38:04.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.522+0000 7f5923e17640 1 -- 172.21.15.45:0/3509449422 wait complete. 2023-11-28T18:38:04.544 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_journal_repair.TestJournalRepair.test_inject_to_empty' 2023-11-28T18:38:04.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.686+0000 7f156aafe640 1 Processor -- start 2023-11-28T18:38:04.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.686+0000 7f156aafe640 1 -- start start 2023-11-28T18:38:04.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.686+0000 7f156aafe640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f156406cdc0 0x7f15640aeed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:04.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.686+0000 7f156aafe640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15640ade30 con 0x7f156406b580 2023-11-28T18:38:04.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.686+0000 7f156aafe640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15640ae110 con 0x7f156415d1a0 2023-11-28T18:38:04.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.686+0000 7f156aafe640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f156406e050 con 0x7f156406cdc0 2023-11-28T18:38:04.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.686+0000 7f156909b640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f156406b580 0x7f156406b990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33804/0 (socket says 172.21.15.45:33804) 2023-11-28T18:38:04.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.686+0000 7f156909b640 1 -- 172.21.15.45:0/2061472319 learned_addr learned my addr 172.21.15.45:0/2061472319 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:38:04.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.686+0000 7f1563fff640 1 --2- 172.21.15.45:0/2061472319 >> v2:172.21.15.190:3300/0 conn(0x7f156406cdc0 0x7f15640aeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:04.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.686+0000 7f15637fe640 1 -- 172.21.15.45:0/2061472319 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3716034183 0 0) 0x7f15640ade30 con 0x7f156406b580 2023-11-28T18:38:04.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.686+0000 7f15637fe640 1 -- 172.21.15.45:0/2061472319 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1554003530 con 0x7f156406b580 2023-11-28T18:38:04.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.686+0000 7f15637fe640 1 -- 172.21.15.45:0/2061472319 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2720329654 0 0) 0x7f15640ae110 con 0x7f156415d1a0 2023-11-28T18:38:04.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.686+0000 7f15637fe640 1 -- 172.21.15.45:0/2061472319 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15640ade30 con 0x7f156415d1a0 2023-11-28T18:38:04.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.686+0000 7f1563fff640 1 -- 172.21.15.45:0/2061472319 >> v1:172.21.15.190:6789/0 conn(0x7f156415d1a0 legacy=0x7f15640ad5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:04.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.686+0000 7f1563fff640 1 -- 172.21.15.45:0/2061472319 >> v1:172.21.15.45:6789/0 conn(0x7f156406b580 legacy=0x7f156406b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:04.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.686+0000 7f15637fe640 1 -- 172.21.15.45:0/2061472319 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1515220082 0 0) 0x7f1554003530 con 0x7f156406b580 2023-11-28T18:38:04.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.686+0000 7f1563fff640 1 -- 172.21.15.45:0/2061472319 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15640ae3f0 con 0x7f156406cdc0 2023-11-28T18:38:04.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.690+0000 7f1563fff640 1 --2- 172.21.15.45:0/2061472319 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f156406cdc0 0x7f15640aeed0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f15500097c0 tx=0x7f155001c310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3a712a82cdac627 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:04.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.690+0000 7f15637fe640 1 -- 172.21.15.45:0/2061472319 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155c001a00 con 0x7f156406cdc0 2023-11-28T18:38:04.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.690+0000 7f15637fe640 1 -- 172.21.15.45:0/2061472319 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15500a7050 con 0x7f156406cdc0 2023-11-28T18:38:04.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.690+0000 7f15637fe640 1 -- 172.21.15.45:0/2061472319 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15500ab620 con 0x7f156406cdc0 2023-11-28T18:38:04.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.690+0000 7f156aafe640 1 -- 172.21.15.45:0/2061472319 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f156406cdc0 msgr2=0x7f15640aeed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:04.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.690+0000 7f156aafe640 1 --2- 172.21.15.45:0/2061472319 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f156406cdc0 0x7f15640aeed0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f15500097c0 tx=0x7f155001c310 comp rx=0 tx=0).stop 2023-11-28T18:38:04.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.690+0000 7f156aafe640 1 -- 172.21.15.45:0/2061472319 shutdown_connections 2023-11-28T18:38:04.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.690+0000 7f156aafe640 1 --2- 172.21.15.45:0/2061472319 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f156406cdc0 0x7f15640aeed0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:04.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.690+0000 7f156aafe640 1 -- 172.21.15.45:0/2061472319 >> 172.21.15.45:0/2061472319 conn(0x7f15640b1b30 msgr2=0x7f1564070d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:04.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.690+0000 7f156aafe640 1 -- 172.21.15.45:0/2061472319 shutdown_connections 2023-11-28T18:38:04.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.690+0000 7f156aafe640 1 -- 172.21.15.45:0/2061472319 wait complete. 2023-11-28T18:38:04.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.694+0000 7f156aafe640 1 Processor -- start 2023-11-28T18:38:04.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.694+0000 7f156aafe640 1 -- start start 2023-11-28T18:38:04.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.694+0000 7f156aafe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f156406b580 0x7f1564145c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:04.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.694+0000 7f156aafe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f156406cdc0 0x7f156414b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:04.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.694+0000 7f156aafe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f156415d1a0 0x7f1564153aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:04.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.694+0000 7f156aafe640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15640aeab0 con 0x7f156406b580 2023-11-28T18:38:04.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.694+0000 7f156aafe640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15641461b0 con 0x7f156415d1a0 2023-11-28T18:38:04.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.694+0000 7f156aafe640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15641562b0 con 0x7f156406cdc0 2023-11-28T18:38:04.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.694+0000 7f156889a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f156406b580 0x7f1564145c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:04.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.694+0000 7f156889a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f156406b580 0x7f1564145c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53430/0 (socket says 172.21.15.45:53430) 2023-11-28T18:38:04.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.694+0000 7f156889a640 1 -- 172.21.15.45:0/1084264628 learned_addr learned my addr 172.21.15.45:0/1084264628 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:04.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.694+0000 7f156909b640 1 --2- 172.21.15.45:0/1084264628 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f156415d1a0 0x7f1564153aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:04.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.694+0000 7f1563fff640 1 --2- 172.21.15.45:0/1084264628 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f156406cdc0 0x7f156414b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:04.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.694+0000 7f156889a640 1 -- 172.21.15.45:0/1084264628 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f156406cdc0 msgr2=0x7f156414b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:04.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.694+0000 7f156889a640 1 --2- 172.21.15.45:0/1084264628 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f156406cdc0 0x7f156414b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:04.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.694+0000 7f156889a640 1 -- 172.21.15.45:0/1084264628 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f156415d1a0 msgr2=0x7f1564153aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:04.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.694+0000 7f156889a640 1 --2- 172.21.15.45:0/1084264628 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f156415d1a0 0x7f1564153aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:04.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.694+0000 7f156889a640 1 -- 172.21.15.45:0/1084264628 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1550009420 con 0x7f156406b580 2023-11-28T18:38:04.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.694+0000 7f1563fff640 1 --2- 172.21.15.45:0/1084264628 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f156406cdc0 0x7f156414b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:38:04.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.694+0000 7f156909b640 1 --2- 172.21.15.45:0/1084264628 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f156415d1a0 0x7f1564153aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:38:04.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.694+0000 7f156889a640 1 --2- 172.21.15.45:0/1084264628 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f156406b580 0x7f1564145c70 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f155800c490 tx=0x7f155800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:04.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.694+0000 7f15617fa640 1 -- 172.21.15.45:0/1084264628 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15580052d0 con 0x7f156406b580 2023-11-28T18:38:04.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.694+0000 7f15617fa640 1 -- 172.21.15.45:0/1084264628 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1558005430 con 0x7f156406b580 2023-11-28T18:38:04.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.694+0000 7f15617fa640 1 -- 172.21.15.45:0/1084264628 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1558012870 con 0x7f156406b580 2023-11-28T18:38:04.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.694+0000 7f156aafe640 1 -- 172.21.15.45:0/1084264628 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1564160150 con 0x7f156406b580 2023-11-28T18:38:04.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.694+0000 7f156aafe640 1 -- 172.21.15.45:0/1084264628 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f156415fe70 con 0x7f156406b580 2023-11-28T18:38:04.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.694+0000 7f156aafe640 1 -- 172.21.15.45:0/1084264628 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1564069480 con 0x7f156406b580 2023-11-28T18:38:04.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.698+0000 7f15617fa640 1 -- 172.21.15.45:0/1084264628 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f15580129d0 con 0x7f156406b580 2023-11-28T18:38:04.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.698+0000 7f15617fa640 1 --2- 172.21.15.45:0/1084264628 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f15480668d0 0x7f1548068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:04.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.698+0000 7f15617fa640 1 -- 172.21.15.45:0/1084264628 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1558083f80 con 0x7f156406b580 2023-11-28T18:38:04.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.698+0000 7f1563fff640 1 --2- 172.21.15.45:0/1084264628 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f15480668d0 0x7f1548068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:04.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.698+0000 7f1563fff640 1 --2- 172.21.15.45:0/1084264628 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f15480668d0 0x7f1548068d90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f15500ad000 tx=0x7f1550008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:04.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.702+0000 7f15617fa640 1 -- 172.21.15.45:0/1084264628 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f15580b5280 con 0x7f156406b580 2023-11-28T18:38:04.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:04.910+0000 7f156aafe640 1 -- 172.21.15.45:0/1084264628 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_journal_repair.TestJournalRepair.test_inject_to_empty"]} v 0) v1 -- 0x7f1564071c50 con 0x7f156406b580 2023-11-28T18:38:05.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.106+0000 7f15617fa640 1 -- 172.21.15.45:0/1084264628 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_journal_repair.TestJournalRepair.test_inject_to_empty"]}]=0 v54) v1 ==== 153+0+0 (secure 0 0 0) 0x7f1558054ce0 con 0x7f156406b580 2023-11-28T18:38:05.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.110+0000 7f156aafe640 1 -- 172.21.15.45:0/1084264628 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f15480668d0 msgr2=0x7f1548068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:05.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.110+0000 7f156aafe640 1 --2- 172.21.15.45:0/1084264628 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f15480668d0 0x7f1548068d90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f15500ad000 tx=0x7f1550008040 comp rx=0 tx=0).stop 2023-11-28T18:38:05.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.110+0000 7f156aafe640 1 -- 172.21.15.45:0/1084264628 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f156406b580 msgr2=0x7f1564145c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:05.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.110+0000 7f156aafe640 1 --2- 172.21.15.45:0/1084264628 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f156406b580 0x7f1564145c70 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f155800c490 tx=0x7f155800c950 comp rx=0 tx=0).stop 2023-11-28T18:38:05.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.110+0000 7f156aafe640 1 -- 172.21.15.45:0/1084264628 shutdown_connections 2023-11-28T18:38:05.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.110+0000 7f156aafe640 1 --2- 172.21.15.45:0/1084264628 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f15480668d0 0x7f1548068d90 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:05.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.110+0000 7f156aafe640 1 --2- 172.21.15.45:0/1084264628 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f156415d1a0 0x7f1564153aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:05.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.110+0000 7f156aafe640 1 --2- 172.21.15.45:0/1084264628 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f156406cdc0 0x7f156414b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:05.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.110+0000 7f156aafe640 1 --2- 172.21.15.45:0/1084264628 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f156406b580 0x7f1564145c70 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:05.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.110+0000 7f156aafe640 1 -- 172.21.15.45:0/1084264628 >> 172.21.15.45:0/1084264628 conn(0x7f15640b1b30 msgr2=0x7f15640b0900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:05.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.110+0000 7f156aafe640 1 -- 172.21.15.45:0/1084264628 shutdown_connections 2023-11-28T18:38:05.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.110+0000 7f156aafe640 1 -- 172.21.15.45:0/1084264628 wait complete. 2023-11-28T18:38:05.131 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-28T18:38:05.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.274+0000 7fc0e9f55640 1 Processor -- start 2023-11-28T18:38:05.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.274+0000 7fc0e9f55640 1 -- start start 2023-11-28T18:38:05.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.278+0000 7fc0e9f55640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc0e415d2f0 0x7fc0e40d17f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:05.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.278+0000 7fc0e9f55640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fc0e40d1d30 0x7fc0e40cfc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:05.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.278+0000 7fc0e9f55640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0e40aff70 con 0x7fc0e415d6d0 2023-11-28T18:38:05.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.278+0000 7fc0e9f55640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0e40b0210 con 0x7fc0e40d1d30 2023-11-28T18:38:05.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.278+0000 7fc0e9f55640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e40b04f0 con 0x7fc0e415d2f0 2023-11-28T18:38:05.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.278+0000 7fc0e2ffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fc0e40d1d30 0x7fc0e40cfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:05.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.278+0000 7fc0e37fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc0e415d2f0 0x7fc0e40d17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:05.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.278+0000 7fc0e2ffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fc0e40d1d30 0x7fc0e40cfc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.45:50348/0 (socket says 172.21.15.45:50348) 2023-11-28T18:38:05.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.278+0000 7fc0e2ffd640 1 -- 172.21.15.45:0/1285180217 learned_addr learned my addr 172.21.15.45:0/1285180217 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:05.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.278+0000 7fc0e3fff640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fc0e415d6d0 0x7fc0e40cddb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.45:43270/0 (socket says 172.21.15.45:43270) 2023-11-28T18:38:05.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.278+0000 7fc0e37fe640 1 -- 172.21.15.45:0/1285180217 >> v2:172.21.15.190:3300/0 conn(0x7fc0e40d1d30 msgr2=0x7fc0e40cfc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:05.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.278+0000 7fc0e37fe640 1 --2- 172.21.15.45:0/1285180217 >> v2:172.21.15.190:3300/0 conn(0x7fc0e40d1d30 0x7fc0e40cfc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:05.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.278+0000 7fc0e37fe640 1 -- 172.21.15.45:0/1285180217 >> v1:172.21.15.190:6789/0 conn(0x7fc0e415d6d0 legacy=0x7fc0e40cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:05.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.278+0000 7fc0e37fe640 1 -- 172.21.15.45:0/1285180217 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0e40b07d0 con 0x7fc0e415d2f0 2023-11-28T18:38:05.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.282+0000 7fc0e37fe640 1 --2- 172.21.15.45:0/1285180217 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc0e415d2f0 0x7fc0e40d17f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc0d40097c0 tx=0x7fc0d401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd6cf8c4a4cfd981 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:05.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.282+0000 7fc0e27fc640 1 -- 172.21.15.45:0/1285180217 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d40ab620 con 0x7fc0e415d2f0 2023-11-28T18:38:05.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.282+0000 7fc0e27fc640 1 -- 172.21.15.45:0/1285180217 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0d40ab780 con 0x7fc0e415d2f0 2023-11-28T18:38:05.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.282+0000 7fc0e27fc640 1 -- 172.21.15.45:0/1285180217 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d40abb10 con 0x7fc0e415d2f0 2023-11-28T18:38:05.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.282+0000 7fc0e9f55640 1 -- 172.21.15.45:0/1285180217 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc0e415d2f0 msgr2=0x7fc0e40d17f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:05.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.282+0000 7fc0e9f55640 1 --2- 172.21.15.45:0/1285180217 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc0e415d2f0 0x7fc0e40d17f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc0d40097c0 tx=0x7fc0d401c480 comp rx=0 tx=0).stop 2023-11-28T18:38:05.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.282+0000 7fc0e9f55640 1 -- 172.21.15.45:0/1285180217 shutdown_connections 2023-11-28T18:38:05.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.282+0000 7fc0e9f55640 1 --2- 172.21.15.45:0/1285180217 >> v2:172.21.15.190:3300/0 conn(0x7fc0e40d1d30 0x7fc0e40cfc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:05.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.282+0000 7fc0e9f55640 1 --2- 172.21.15.45:0/1285180217 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc0e415d2f0 0x7fc0e40d17f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:05.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.282+0000 7fc0e9f55640 1 -- 172.21.15.45:0/1285180217 >> 172.21.15.45:0/1285180217 conn(0x7fc0e409c550 msgr2=0x7fc0e40d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:05.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.282+0000 7fc0e9f55640 1 -- 172.21.15.45:0/1285180217 shutdown_connections 2023-11-28T18:38:05.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.282+0000 7fc0e9f55640 1 -- 172.21.15.45:0/1285180217 wait complete. 2023-11-28T18:38:05.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.282+0000 7fc0e9f55640 1 Processor -- start 2023-11-28T18:38:05.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.282+0000 7fc0e9f55640 1 -- start start 2023-11-28T18:38:05.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.286+0000 7fc0e9f55640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0e40d1d30 0x7fc0e4153780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:05.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.286+0000 7fc0e9f55640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc0e415d2f0 0x7fc0e4158080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:05.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.286+0000 7fc0e9f55640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc0e415d6d0 0x7fc0e415be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:05.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.286+0000 7fc0e9f55640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e4153cc0 con 0x7fc0e40d1d30 2023-11-28T18:38:05.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.286+0000 7fc0e9f55640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e41585c0 con 0x7fc0e415d6d0 2023-11-28T18:38:05.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.286+0000 7fc0e9f55640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e4158840 con 0x7fc0e415d2f0 2023-11-28T18:38:05.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.286+0000 7fc0e37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0e40d1d30 0x7fc0e4153780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:05.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.286+0000 7fc0e37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0e40d1d30 0x7fc0e4153780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53438/0 (socket says 172.21.15.45:53438) 2023-11-28T18:38:05.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.286+0000 7fc0e37fe640 1 -- 172.21.15.45:0/406652652 learned_addr learned my addr 172.21.15.45:0/406652652 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:05.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.286+0000 7fc0e3fff640 1 --2- 172.21.15.45:0/406652652 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc0e415d6d0 0x7fc0e415be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:05.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.286+0000 7fc0e2ffd640 1 --2- 172.21.15.45:0/406652652 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc0e415d2f0 0x7fc0e4158080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:05.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.286+0000 7fc0e37fe640 1 -- 172.21.15.45:0/406652652 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc0e415d2f0 msgr2=0x7fc0e4158080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:05.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.286+0000 7fc0e37fe640 1 --2- 172.21.15.45:0/406652652 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc0e415d2f0 0x7fc0e4158080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:05.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.286+0000 7fc0e37fe640 1 -- 172.21.15.45:0/406652652 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc0e415d6d0 msgr2=0x7fc0e415be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:05.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.286+0000 7fc0e37fe640 1 --2- 172.21.15.45:0/406652652 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc0e415d6d0 0x7fc0e415be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:05.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.286+0000 7fc0e37fe640 1 -- 172.21.15.45:0/406652652 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0d4009420 con 0x7fc0e40d1d30 2023-11-28T18:38:05.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.286+0000 7fc0e3fff640 1 --2- 172.21.15.45:0/406652652 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc0e415d6d0 0x7fc0e415be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:38:05.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.286+0000 7fc0e37fe640 1 --2- 172.21.15.45:0/406652652 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0e40d1d30 0x7fc0e4153780 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc0d40ad040 tx=0x7fc0d401acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:05.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.286+0000 7fc0cbfff640 1 -- 172.21.15.45:0/406652652 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d40abe40 con 0x7fc0e40d1d30 2023-11-28T18:38:05.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.286+0000 7fc0cbfff640 1 -- 172.21.15.45:0/406652652 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0d40bf410 con 0x7fc0e40d1d30 2023-11-28T18:38:05.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.286+0000 7fc0cbfff640 1 -- 172.21.15.45:0/406652652 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d40bf7c0 con 0x7fc0e40d1d30 2023-11-28T18:38:05.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.286+0000 7fc0e9f55640 1 -- 172.21.15.45:0/406652652 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0e4158b20 con 0x7fc0e40d1d30 2023-11-28T18:38:05.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.286+0000 7fc0e9f55640 1 -- 172.21.15.45:0/406652652 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0e41590e0 con 0x7fc0e40d1d30 2023-11-28T18:38:05.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.286+0000 7fc0e9f55640 1 -- 172.21.15.45:0/406652652 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0e4067a30 con 0x7fc0e40d1d30 2023-11-28T18:38:05.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.286+0000 7fc0cbfff640 1 -- 172.21.15.45:0/406652652 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fc0d40b5400 con 0x7fc0e40d1d30 2023-11-28T18:38:05.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.290+0000 7fc0cbfff640 1 --2- 172.21.15.45:0/406652652 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fc0d0066920 0x7fc0d0068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:05.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.290+0000 7fc0cbfff640 1 -- 172.21.15.45:0/406652652 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc0d411ef80 con 0x7fc0e40d1d30 2023-11-28T18:38:05.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.290+0000 7fc0e2ffd640 1 --2- 172.21.15.45:0/406652652 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fc0d0066920 0x7fc0d0068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:05.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.290+0000 7fc0e2ffd640 1 --2- 172.21.15.45:0/406652652 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fc0d0066920 0x7fc0d0068de0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc0e4160730 tx=0x7fc0d8009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:05.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.294+0000 7fc0cbfff640 1 -- 172.21.15.45:0/406652652 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc0d40ec400 con 0x7fc0e40d1d30 2023-11-28T18:38:05.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.454+0000 7fc0e9f55640 1 -- 172.21.15.45:0/406652652 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fc0e4069410 con 0x7fc0e40d1d30 2023-11-28T18:38:05.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.458+0000 7fc0cbfff640 1 -- 172.21.15.45:0/406652652 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc0d40efa20 con 0x7fc0e40d1d30 2023-11-28T18:38:05.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.462+0000 7fc0e9f55640 1 -- 172.21.15.45:0/406652652 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fc0d0066920 msgr2=0x7fc0d0068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:05.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.462+0000 7fc0e9f55640 1 --2- 172.21.15.45:0/406652652 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fc0d0066920 0x7fc0d0068de0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc0e4160730 tx=0x7fc0d8009240 comp rx=0 tx=0).stop 2023-11-28T18:38:05.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.462+0000 7fc0e9f55640 1 -- 172.21.15.45:0/406652652 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0e40d1d30 msgr2=0x7fc0e4153780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:05.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.462+0000 7fc0e9f55640 1 --2- 172.21.15.45:0/406652652 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0e40d1d30 0x7fc0e4153780 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc0d40ad040 tx=0x7fc0d401acc0 comp rx=0 tx=0).stop 2023-11-28T18:38:05.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.462+0000 7fc0e9f55640 1 -- 172.21.15.45:0/406652652 shutdown_connections 2023-11-28T18:38:05.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.462+0000 7fc0e9f55640 1 --2- 172.21.15.45:0/406652652 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fc0d0066920 0x7fc0d0068de0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:05.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.462+0000 7fc0e9f55640 1 --2- 172.21.15.45:0/406652652 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc0e415d6d0 0x7fc0e415be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:05.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.462+0000 7fc0e9f55640 1 --2- 172.21.15.45:0/406652652 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc0e415d2f0 0x7fc0e4158080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:05.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.462+0000 7fc0e9f55640 1 --2- 172.21.15.45:0/406652652 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0e40d1d30 0x7fc0e4153780 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:05.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.462+0000 7fc0e9f55640 1 -- 172.21.15.45:0/406652652 >> 172.21.15.45:0/406652652 conn(0x7fc0e409c550 msgr2=0x7fc0e4159a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:05.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.462+0000 7fc0e9f55640 1 -- 172.21.15.45:0/406652652 shutdown_connections 2023-11-28T18:38:05.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.462+0000 7fc0e9f55640 1 -- 172.21.15.45:0/406652652 wait complete. 2023-11-28T18:38:05.482 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-28T18:38:05.482 DEBUG:teuthology.orchestra.run.smithi045:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T18:38:05.585 DEBUG:teuthology.orchestra.run.smithi190:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T18:38:05.672 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-28T18:38:05.672 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T18:38:05.672 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T18:38:05.682 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T18:38:05.682 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T18:38:05.739 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T18:38:05.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.930+0000 7f1673c79640 1 Processor -- start 2023-11-28T18:38:05.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.930+0000 7f1673c79640 1 -- start start 2023-11-28T18:38:05.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.930+0000 7f1673c79640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f166c0d2b50 0x7f166c0b6270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:05.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.930+0000 7f1673c79640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f166c0d0db0 con 0x7f166c1608b0 2023-11-28T18:38:05.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.930+0000 7f1673c79640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f166c0d2f90 con 0x7f166c0b51e0 2023-11-28T18:38:05.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.930+0000 7f1673c79640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f166c160c90 con 0x7f166c0d2b50 2023-11-28T18:38:05.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.930+0000 7f1671a15640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f166c1608b0 0x7f166c0cdb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33816/0 (socket says 172.21.15.45:33816) 2023-11-28T18:38:05.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.930+0000 7f1671a15640 1 -- 172.21.15.45:0/1865128161 learned_addr learned my addr 172.21.15.45:0/1865128161 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:38:05.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.930+0000 7f1671214640 1 --2- 172.21.15.45:0/1865128161 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f166c0d2b50 0x7f166c0b6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:05.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.930+0000 7f1670a13640 1 -- 172.21.15.45:0/1865128161 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 10345649 0 0) 0x7f166c0d0db0 con 0x7f166c1608b0 2023-11-28T18:38:05.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.930+0000 7f1670a13640 1 -- 172.21.15.45:0/1865128161 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1658003530 con 0x7f166c1608b0 2023-11-28T18:38:05.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.930+0000 7f1670a13640 1 -- 172.21.15.45:0/1865128161 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3901178777 0 0) 0x7f166c0d2f90 con 0x7f166c0b51e0 2023-11-28T18:38:05.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.930+0000 7f1670a13640 1 -- 172.21.15.45:0/1865128161 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f166c0d0db0 con 0x7f166c0b51e0 2023-11-28T18:38:05.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.930+0000 7f1671214640 1 -- 172.21.15.45:0/1865128161 >> v1:172.21.15.190:6789/0 conn(0x7f166c0b51e0 legacy=0x7f166c0d1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:05.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.930+0000 7f1671214640 1 -- 172.21.15.45:0/1865128161 >> v1:172.21.15.45:6789/0 conn(0x7f166c1608b0 legacy=0x7f166c0cdb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:05.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.930+0000 7f1670a13640 1 -- 172.21.15.45:0/1865128161 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3451196093 0 0) 0x7f1658003530 con 0x7f166c1608b0 2023-11-28T18:38:05.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.930+0000 7f1671214640 1 -- 172.21.15.45:0/1865128161 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f166c0ce320 con 0x7f166c0d2b50 2023-11-28T18:38:05.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.934+0000 7f1671214640 1 --2- 172.21.15.45:0/1865128161 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f166c0d2b50 0x7f166c0b6270 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f165c0097f0 tx=0x7f165c01c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ba1ceb4a98e7872 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:05.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.934+0000 7f1670a13640 1 -- 172.21.15.45:0/1865128161 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1668001680 con 0x7f166c0d2b50 2023-11-28T18:38:05.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.934+0000 7f1670a13640 1 -- 172.21.15.45:0/1865128161 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f165c0a7050 con 0x7f166c0d2b50 2023-11-28T18:38:05.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.934+0000 7f1670a13640 1 -- 172.21.15.45:0/1865128161 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f165c0ab620 con 0x7f166c0d2b50 2023-11-28T18:38:05.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.934+0000 7f1673c79640 1 -- 172.21.15.45:0/1865128161 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f166c0d2b50 msgr2=0x7f166c0b6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:05.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.934+0000 7f1673c79640 1 --2- 172.21.15.45:0/1865128161 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f166c0d2b50 0x7f166c0b6270 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f165c0097f0 tx=0x7f165c01c3e0 comp rx=0 tx=0).stop 2023-11-28T18:38:05.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.934+0000 7f1673c79640 1 -- 172.21.15.45:0/1865128161 shutdown_connections 2023-11-28T18:38:05.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.934+0000 7f1673c79640 1 --2- 172.21.15.45:0/1865128161 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f166c0d2b50 0x7f166c0b6270 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:05.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.934+0000 7f1673c79640 1 -- 172.21.15.45:0/1865128161 >> 172.21.15.45:0/1865128161 conn(0x7f166c0720a0 msgr2=0x7f166c0724b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:05.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.934+0000 7f1673c79640 1 -- 172.21.15.45:0/1865128161 shutdown_connections 2023-11-28T18:38:05.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.934+0000 7f1673c79640 1 -- 172.21.15.45:0/1865128161 wait complete. 2023-11-28T18:38:05.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.938+0000 7f1673c79640 1 Processor -- start 2023-11-28T18:38:05.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.938+0000 7f1673c79640 1 -- start start 2023-11-28T18:38:05.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.938+0000 7f1673c79640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f166c0b51e0 0x7f166c0c99f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:05.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.938+0000 7f1673c79640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f166c0d2b50 0x7f166c0c6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:05.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.938+0000 7f1673c79640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f166c1608b0 0x7f166c0cc480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:05.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.938+0000 7f1673c79640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f166c14caa0 con 0x7f166c0b51e0 2023-11-28T18:38:05.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.938+0000 7f1673c79640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f166c14e7c0 con 0x7f166c1608b0 2023-11-28T18:38:05.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.938+0000 7f1673c79640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f166c14eaa0 con 0x7f166c0d2b50 2023-11-28T18:38:05.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.938+0000 7f1671a15640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f166c0b51e0 0x7f166c0c99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:05.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.938+0000 7f1671a15640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f166c0b51e0 0x7f166c0c99f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53452/0 (socket says 172.21.15.45:53452) 2023-11-28T18:38:05.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.938+0000 7f1671a15640 1 -- 172.21.15.45:0/3780900171 learned_addr learned my addr 172.21.15.45:0/3780900171 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:05.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.938+0000 7f1672216640 1 --2- 172.21.15.45:0/3780900171 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f166c1608b0 0x7f166c0cc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:05.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.938+0000 7f1671214640 1 --2- 172.21.15.45:0/3780900171 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f166c0d2b50 0x7f166c0c6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:05.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.938+0000 7f1671a15640 1 -- 172.21.15.45:0/3780900171 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f166c0d2b50 msgr2=0x7f166c0c6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:05.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.938+0000 7f1671a15640 1 --2- 172.21.15.45:0/3780900171 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f166c0d2b50 0x7f166c0c6520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:05.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.938+0000 7f1671a15640 1 -- 172.21.15.45:0/3780900171 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f166c1608b0 msgr2=0x7f166c0cc480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:05.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.938+0000 7f1671a15640 1 --2- 172.21.15.45:0/3780900171 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f166c1608b0 0x7f166c0cc480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:05.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.938+0000 7f1671a15640 1 -- 172.21.15.45:0/3780900171 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f165c009420 con 0x7f166c0b51e0 2023-11-28T18:38:05.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.938+0000 7f1671214640 1 --2- 172.21.15.45:0/3780900171 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f166c0d2b50 0x7f166c0c6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:38:05.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.938+0000 7f1672216640 1 --2- 172.21.15.45:0/3780900171 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f166c1608b0 0x7f166c0cc480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:38:05.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.938+0000 7f1671a15640 1 --2- 172.21.15.45:0/3780900171 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f166c0b51e0 0x7f166c0c99f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f166800c780 tx=0x7f166800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:05.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.938+0000 7f16627fc640 1 -- 172.21.15.45:0/3780900171 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1668005ae0 con 0x7f166c0b51e0 2023-11-28T18:38:05.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.938+0000 7f16627fc640 1 -- 172.21.15.45:0/3780900171 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1668005c40 con 0x7f166c0b51e0 2023-11-28T18:38:05.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.938+0000 7f16627fc640 1 -- 172.21.15.45:0/3780900171 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1668007070 con 0x7f166c0b51e0 2023-11-28T18:38:05.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.938+0000 7f1673c79640 1 -- 172.21.15.45:0/3780900171 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f166c0b5b80 con 0x7f166c0b51e0 2023-11-28T18:38:05.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.938+0000 7f1673c79640 1 -- 172.21.15.45:0/3780900171 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f166c14f060 con 0x7f166c0b51e0 2023-11-28T18:38:05.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.942+0000 7f1673c79640 1 -- 172.21.15.45:0/3780900171 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f166c069480 con 0x7f166c0b51e0 2023-11-28T18:38:05.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.942+0000 7f16627fc640 1 -- 172.21.15.45:0/3780900171 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f16680071f0 con 0x7f166c0b51e0 2023-11-28T18:38:05.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.942+0000 7f16627fc640 1 --2- 172.21.15.45:0/3780900171 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1650066900 0x7f1650068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:05.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.942+0000 7f16627fc640 1 -- 172.21.15.45:0/3780900171 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1668083be0 con 0x7f166c0b51e0 2023-11-28T18:38:05.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.942+0000 7f1671214640 1 --2- 172.21.15.45:0/3780900171 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1650066900 0x7f1650068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:05.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.942+0000 7f1671214640 1 --2- 172.21.15.45:0/3780900171 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1650066900 0x7f1650068dc0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f165c0ad000 tx=0x7f165c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:05.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:05.946+0000 7f16627fc640 1 -- 172.21.15.45:0/3780900171 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1668054810 con 0x7f166c0b51e0 2023-11-28T18:38:06.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.102+0000 7f1673c79640 1 -- 172.21.15.45:0/3780900171 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f166c0728e0 con 0x7f166c0b51e0 2023-11-28T18:38:06.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.106+0000 7f16627fc640 1 -- 172.21.15.45:0/3780900171 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16469 (secure 0 0 0) 0x7f1668017020 con 0x7f166c0b51e0 2023-11-28T18:38:06.107 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:38:06.107 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":20,"fsid":"d10f5cd6-1d00-4019-99b6-6fa435498a15","created":"2023-11-28T18:37:08.189030+0000","modified":"2023-11-28T18:37:33.971141+0000","last_up_change":"2023-11-28T18:37:20.196124+0000","last_in_change":"2023-11-28T18:37:10.742043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T18:37:21.293917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T18:37:31.384760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T18:37:31.834769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"84465384-103c-4f2c-a45a-96f5bb9c835f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6809","nonce":555237322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6811","nonce":555237322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6815","nonce":555237322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6813","nonce":555237322}]},"public_addr":"172.21.15.45:6809/555237322","cluster_addr":"172.21.15.45:6811/555237322","heartbeat_back_addr":"172.21.15.45:6815/555237322","heartbeat_front_addr":"172.21.15.45:6813/555237322","state":["exists","up"]},{"osd":1,"uuid":"7d9eed24-a58f-42c7-a787-ac06be8553fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6801","nonce":2857063763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6803","nonce":2857063763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6807","nonce":2857063763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6805","nonce":2857063763}]},"public_addr":"172.21.15.45:6801/2857063763","cluster_addr":"172.21.15.45:6803/2857063763","heartbeat_back_addr":"172.21.15.45:6807/2857063763","heartbeat_front_addr":"172.21.15.45:6805/2857063763","state":["exists","up"]},{"osd":2,"uuid":"575eeccc-4abf-45b4-9caf-f3e797859588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6817","nonce":193884539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6819","nonce":193884539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6823","nonce":193884539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6821","nonce":193884539}]},"public_addr":"172.21.15.45:6817/193884539","cluster_addr":"172.21.15.45:6819/193884539","heartbeat_back_addr":"172.21.15.45:6823/193884539","heartbeat_front_addr":"172.21.15.45:6821/193884539","state":["exists","up"]},{"osd":3,"uuid":"9b0290d6-9a52-4bc8-b2a1-7622c5dc8e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6825","nonce":78541084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6827","nonce":78541084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6831","nonce":78541084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6829","nonce":78541084}]},"public_addr":"172.21.15.45:6825/78541084","cluster_addr":"172.21.15.45:6827/78541084","heartbeat_back_addr":"172.21.15.45:6831/78541084","heartbeat_front_addr":"172.21.15.45:6829/78541084","state":["exists","up"]},{"osd":4,"uuid":"ce632829-f027-4fbf-a627-02c571aa9d53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6809","nonce":1537591987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6811","nonce":1537591987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6815","nonce":1537591987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6813","nonce":1537591987}]},"public_addr":"172.21.15.190:6809/1537591987","cluster_addr":"172.21.15.190:6811/1537591987","heartbeat_back_addr":"172.21.15.190:6815/1537591987","heartbeat_front_addr":"172.21.15.190:6813/1537591987","state":["exists","up"]},{"osd":5,"uuid":"8700b609-27be-40bd-a251-4c0ae0a29ead","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6801","nonce":3296698407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6803","nonce":3296698407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6807","nonce":3296698407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6805","nonce":3296698407}]},"public_addr":"172.21.15.190:6801/3296698407","cluster_addr":"172.21.15.190:6803/3296698407","heartbeat_back_addr":"172.21.15.190:6807/3296698407","heartbeat_front_addr":"172.21.15.190:6805/3296698407","state":["exists","up"]},{"osd":6,"uuid":"44ce4a40-e6ff-4f4d-8e8a-7341e5c91f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6817","nonce":2317686718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6819","nonce":2317686718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6823","nonce":2317686718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6821","nonce":2317686718}]},"public_addr":"172.21.15.190:6817/2317686718","cluster_addr":"172.21.15.190:6819/2317686718","heartbeat_back_addr":"172.21.15.190:6823/2317686718","heartbeat_front_addr":"172.21.15.190:6821/2317686718","state":["exists","up"]},{"osd":7,"uuid":"192238c9-1423-4b7e-ac8f-84ba32113ddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6825","nonce":2493232051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6827","nonce":2493232051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6831","nonce":2493232051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6829","nonce":2493232051}]},"public_addr":"172.21.15.190:6825/2493232051","cluster_addr":"172.21.15.190:6827/2493232051","heartbeat_back_addr":"172.21.15.190:6831/2493232051","heartbeat_front_addr":"172.21.15.190:6829/2493232051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.393552+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.385453+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.361421+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.366408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.363226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.276007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.414605+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.445885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T18:38:06.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.106+0000 7f1673c79640 1 -- 172.21.15.45:0/3780900171 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1650066900 msgr2=0x7f1650068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:06.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.106+0000 7f1673c79640 1 --2- 172.21.15.45:0/3780900171 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1650066900 0x7f1650068dc0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f165c0ad000 tx=0x7f165c0a6000 comp rx=0 tx=0).stop 2023-11-28T18:38:06.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.106+0000 7f1673c79640 1 -- 172.21.15.45:0/3780900171 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f166c0b51e0 msgr2=0x7f166c0c99f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:06.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.106+0000 7f1673c79640 1 --2- 172.21.15.45:0/3780900171 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f166c0b51e0 0x7f166c0c99f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f166800c780 tx=0x7f166800cc40 comp rx=0 tx=0).stop 2023-11-28T18:38:06.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.106+0000 7f1673c79640 1 -- 172.21.15.45:0/3780900171 shutdown_connections 2023-11-28T18:38:06.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.106+0000 7f1673c79640 1 --2- 172.21.15.45:0/3780900171 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1650066900 0x7f1650068dc0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:06.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.106+0000 7f1673c79640 1 --2- 172.21.15.45:0/3780900171 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f166c1608b0 0x7f166c0cc480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:06.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.106+0000 7f1673c79640 1 --2- 172.21.15.45:0/3780900171 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f166c0d2b50 0x7f166c0c6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:06.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.106+0000 7f1673c79640 1 --2- 172.21.15.45:0/3780900171 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f166c0b51e0 0x7f166c0c99f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:06.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.106+0000 7f1673c79640 1 -- 172.21.15.45:0/3780900171 >> 172.21.15.45:0/3780900171 conn(0x7f166c0720a0 msgr2=0x7f166c14d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:06.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.106+0000 7f1673c79640 1 -- 172.21.15.45:0/3780900171 shutdown_connections 2023-11-28T18:38:06.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.106+0000 7f1673c79640 1 -- 172.21.15.45:0/3780900171 wait complete. 2023-11-28T18:38:06.130 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T18:37:21.293917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T18:37:31.384760+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T18:37:31.834769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T18:38:06.131 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T18:38:06.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.274+0000 7fb3ece17640 1 Processor -- start 2023-11-28T18:38:06.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.274+0000 7fb3ece17640 1 -- start start 2023-11-28T18:38:06.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.278+0000 7fb3ece17640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb3e80b1dc0 0x7fb3e80cfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:06.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.278+0000 7fb3ece17640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fb3e80d0100 0x7fb3e8161030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:06.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.278+0000 7fb3ece17640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3e80cf450 con 0x7fb3e815e780 2023-11-28T18:38:06.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.278+0000 7fb3ece17640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3e80cf7a0 con 0x7fb3e80d0100 2023-11-28T18:38:06.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.278+0000 7fb3ece17640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e80ce8b0 con 0x7fb3e80b1dc0 2023-11-28T18:38:06.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.278+0000 7fb3e7fff640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fb3e80d0100 0x7fb3e8161030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:06.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.278+0000 7fb3e6ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb3e80b1dc0 0x7fb3e80cfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:06.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.278+0000 7fb3e7fff640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fb3e80d0100 0x7fb3e8161030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.45:50364/0 (socket says 172.21.15.45:50364) 2023-11-28T18:38:06.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.278+0000 7fb3e7fff640 1 -- 172.21.15.45:0/65247115 learned_addr learned my addr 172.21.15.45:0/65247115 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:06.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.278+0000 7fb3e7fff640 1 -- 172.21.15.45:0/65247115 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb3e80b1dc0 msgr2=0x7fb3e80cfbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:06.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.278+0000 7fb3e7fff640 1 --2- 172.21.15.45:0/65247115 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb3e80b1dc0 0x7fb3e80cfbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:06.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.278+0000 7fb3e7fff640 1 -- 172.21.15.45:0/65247115 >> v1:172.21.15.190:6789/0 conn(0x7fb3e815e780 legacy=0x7fb3e815ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:06.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.278+0000 7fb3e7fff640 1 -- 172.21.15.45:0/65247115 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3e80ceb90 con 0x7fb3e80d0100 2023-11-28T18:38:06.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.278+0000 7fb3e6ffd640 1 --2- 172.21.15.45:0/65247115 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb3e80b1dc0 0x7fb3e80cfbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:38:06.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.282+0000 7fb3e7fff640 1 --2- 172.21.15.45:0/65247115 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb3e80d0100 0x7fb3e8161030 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb3e0009e50 tx=0x7fb3e001c980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0e802a9dc7085cb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:06.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.282+0000 7fb3e67fc640 1 -- 172.21.15.45:0/65247115 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e00a5820 con 0x7fb3e80d0100 2023-11-28T18:38:06.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.282+0000 7fb3e67fc640 1 -- 172.21.15.45:0/65247115 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3e00a5980 con 0x7fb3e80d0100 2023-11-28T18:38:06.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.282+0000 7fb3e67fc640 1 -- 172.21.15.45:0/65247115 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e00a5d10 con 0x7fb3e80d0100 2023-11-28T18:38:06.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.282+0000 7fb3ece17640 1 -- 172.21.15.45:0/65247115 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb3e80d0100 msgr2=0x7fb3e8161030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:06.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.282+0000 7fb3ece17640 1 --2- 172.21.15.45:0/65247115 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb3e80d0100 0x7fb3e8161030 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb3e0009e50 tx=0x7fb3e001c980 comp rx=0 tx=0).stop 2023-11-28T18:38:06.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.282+0000 7fb3ece17640 1 -- 172.21.15.45:0/65247115 shutdown_connections 2023-11-28T18:38:06.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.282+0000 7fb3ece17640 1 --2- 172.21.15.45:0/65247115 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb3e80d0100 0x7fb3e8161030 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:06.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.282+0000 7fb3ece17640 1 --2- 172.21.15.45:0/65247115 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb3e80b1dc0 0x7fb3e80cfbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:06.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.282+0000 7fb3ece17640 1 -- 172.21.15.45:0/65247115 >> 172.21.15.45:0/65247115 conn(0x7fb3e80d2fb0 msgr2=0x7fb3e80d33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:06.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.282+0000 7fb3ece17640 1 -- 172.21.15.45:0/65247115 shutdown_connections 2023-11-28T18:38:06.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.282+0000 7fb3ece17640 1 -- 172.21.15.45:0/65247115 wait complete. 2023-11-28T18:38:06.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.282+0000 7fb3ece17640 1 Processor -- start 2023-11-28T18:38:06.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.282+0000 7fb3ece17640 1 -- start start 2023-11-28T18:38:06.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.286+0000 7fb3ece17640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3e80b1dc0 0x7fb3e8158a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:06.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.286+0000 7fb3ece17640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb3e80d0100 0x7fb3e80cc090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:06.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.286+0000 7fb3ece17640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb3e815e780 0x7fb3e80cc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:06.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.286+0000 7fb3ece17640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e80c7520 con 0x7fb3e80b1dc0 2023-11-28T18:38:06.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.286+0000 7fb3ece17640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e80b8d80 con 0x7fb3e815e780 2023-11-28T18:38:06.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.286+0000 7fb3ece17640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e80c6b80 con 0x7fb3e80d0100 2023-11-28T18:38:06.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.286+0000 7fb3e77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3e80b1dc0 0x7fb3e8158a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:06.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.286+0000 7fb3e77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3e80b1dc0 0x7fb3e8158a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53464/0 (socket says 172.21.15.45:53464) 2023-11-28T18:38:06.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.286+0000 7fb3e77fe640 1 -- 172.21.15.45:0/3808340799 learned_addr learned my addr 172.21.15.45:0/3808340799 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:06.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.286+0000 7fb3e7fff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb3e815e780 0x7fb3e80cc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:06.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.286+0000 7fb3e6ffd640 1 --2- 172.21.15.45:0/3808340799 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb3e80d0100 0x7fb3e80cc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:06.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.286+0000 7fb3e77fe640 1 -- 172.21.15.45:0/3808340799 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb3e80d0100 msgr2=0x7fb3e80cc090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:06.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.286+0000 7fb3e77fe640 1 --2- 172.21.15.45:0/3808340799 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb3e80d0100 0x7fb3e80cc090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:06.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.286+0000 7fb3e77fe640 1 -- 172.21.15.45:0/3808340799 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb3e815e780 msgr2=0x7fb3e80cc5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:06.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.286+0000 7fb3e77fe640 1 --2- 172.21.15.45:0/3808340799 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb3e815e780 0x7fb3e80cc5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:06.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.286+0000 7fb3e77fe640 1 -- 172.21.15.45:0/3808340799 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3dc009420 con 0x7fb3e80b1dc0 2023-11-28T18:38:06.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.286+0000 7fb3e77fe640 1 --2- 172.21.15.45:0/3808340799 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3e80b1dc0 0x7fb3e8158a60 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb3d800c3c0 tx=0x7fb3d800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:06.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.286+0000 7fb3cffff640 1 -- 172.21.15.45:0/3808340799 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d80052d0 con 0x7fb3e80b1dc0 2023-11-28T18:38:06.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.286+0000 7fb3cffff640 1 -- 172.21.15.45:0/3808340799 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3d8005430 con 0x7fb3e80b1dc0 2023-11-28T18:38:06.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.286+0000 7fb3cffff640 1 -- 172.21.15.45:0/3808340799 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d8003840 con 0x7fb3e80b1dc0 2023-11-28T18:38:06.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.286+0000 7fb3ece17640 1 -- 172.21.15.45:0/3808340799 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3e0009b30 con 0x7fb3e80b1dc0 2023-11-28T18:38:06.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.286+0000 7fb3ece17640 1 -- 172.21.15.45:0/3808340799 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3e80c7140 con 0x7fb3e80b1dc0 2023-11-28T18:38:06.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.286+0000 7fb3ece17640 1 -- 172.21.15.45:0/3808340799 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3e804e970 con 0x7fb3e80b1dc0 2023-11-28T18:38:06.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.290+0000 7fb3cffff640 1 -- 172.21.15.45:0/3808340799 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fb3d80039a0 con 0x7fb3e80b1dc0 2023-11-28T18:38:06.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.290+0000 7fb3cffff640 1 --2- 172.21.15.45:0/3808340799 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fb3d40668d0 0x7fb3d4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:06.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.290+0000 7fb3cffff640 1 -- 172.21.15.45:0/3808340799 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb3d8083980 con 0x7fb3e80b1dc0 2023-11-28T18:38:06.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.290+0000 7fb3e6ffd640 1 --2- 172.21.15.45:0/3808340799 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fb3d40668d0 0x7fb3d4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:06.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.290+0000 7fb3e6ffd640 1 --2- 172.21.15.45:0/3808340799 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fb3d40668d0 0x7fb3d4068d90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb3e80c9f40 tx=0x7fb3dc009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:06.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.294+0000 7fb3cffff640 1 -- 172.21.15.45:0/3808340799 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb3d8050bd0 con 0x7fb3e80b1dc0 2023-11-28T18:38:06.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.450+0000 7fb3ece17640 1 -- 172.21.15.45:0/3808340799 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb3e808ca90 con 0x7fb3e80b1dc0 2023-11-28T18:38:06.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.450+0000 7fb3cffff640 1 -- 172.21.15.45:0/3808340799 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb3d80170a0 con 0x7fb3e80b1dc0 2023-11-28T18:38:06.454 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-11-28T18:38:06.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.454+0000 7fb3ece17640 1 -- 172.21.15.45:0/3808340799 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fb3d40668d0 msgr2=0x7fb3d4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:06.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.454+0000 7fb3ece17640 1 --2- 172.21.15.45:0/3808340799 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fb3d40668d0 0x7fb3d4068d90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb3e80c9f40 tx=0x7fb3dc009190 comp rx=0 tx=0).stop 2023-11-28T18:38:06.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.454+0000 7fb3ece17640 1 -- 172.21.15.45:0/3808340799 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3e80b1dc0 msgr2=0x7fb3e8158a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:06.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.454+0000 7fb3ece17640 1 --2- 172.21.15.45:0/3808340799 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3e80b1dc0 0x7fb3e8158a60 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb3d800c3c0 tx=0x7fb3d800c880 comp rx=0 tx=0).stop 2023-11-28T18:38:06.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.454+0000 7fb3ece17640 1 -- 172.21.15.45:0/3808340799 shutdown_connections 2023-11-28T18:38:06.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.454+0000 7fb3ece17640 1 --2- 172.21.15.45:0/3808340799 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fb3d40668d0 0x7fb3d4068d90 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:06.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.454+0000 7fb3ece17640 1 --2- 172.21.15.45:0/3808340799 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb3e815e780 0x7fb3e80cc5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:06.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.454+0000 7fb3ece17640 1 --2- 172.21.15.45:0/3808340799 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb3e80d0100 0x7fb3e80cc090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:06.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.454+0000 7fb3ece17640 1 --2- 172.21.15.45:0/3808340799 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3e80b1dc0 0x7fb3e8158a60 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:06.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.454+0000 7fb3ece17640 1 -- 172.21.15.45:0/3808340799 >> 172.21.15.45:0/3808340799 conn(0x7fb3e80d2fb0 msgr2=0x7fb3e80cdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:06.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.454+0000 7fb3ece17640 1 -- 172.21.15.45:0/3808340799 shutdown_connections 2023-11-28T18:38:06.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.454+0000 7fb3ece17640 1 -- 172.21.15.45:0/3808340799 wait complete. 2023-11-28T18:38:06.475 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T18:38:06.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.618+0000 7ff0beb72640 1 Processor -- start 2023-11-28T18:38:06.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.618+0000 7ff0beb72640 1 -- start start 2023-11-28T18:38:06.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.618+0000 7ff0beb72640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff0b8161530 0x7ff0b80b4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:06.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.618+0000 7ff0beb72640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0b80b23d0 con 0x7ff0b80ac880 2023-11-28T18:38:06.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.618+0000 7ff0beb72640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0b8146550 con 0x7ff0b8145ee0 2023-11-28T18:38:06.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.618+0000 7ff0beb72640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0b80b20a0 con 0x7ff0b8161530 2023-11-28T18:38:06.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.622+0000 7ff0bd10f640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff0b80ac880 0x7ff0b8070e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33826/0 (socket says 172.21.15.45:33826) 2023-11-28T18:38:06.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.622+0000 7ff0bd10f640 1 -- 172.21.15.45:0/2398727296 learned_addr learned my addr 172.21.15.45:0/2398727296 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:38:06.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.622+0000 7ff0b7fff640 1 --2- 172.21.15.45:0/2398727296 >> v2:172.21.15.190:3300/0 conn(0x7ff0b8161530 0x7ff0b80b4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:06.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.622+0000 7ff0b77fe640 1 -- 172.21.15.45:0/2398727296 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 960872635 0 0) 0x7ff0b80b23d0 con 0x7ff0b80ac880 2023-11-28T18:38:06.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.622+0000 7ff0b77fe640 1 -- 172.21.15.45:0/2398727296 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0a8003530 con 0x7ff0b80ac880 2023-11-28T18:38:06.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.622+0000 7ff0b7fff640 1 -- 172.21.15.45:0/2398727296 >> v1:172.21.15.190:6789/0 conn(0x7ff0b8145ee0 legacy=0x7ff0b8160e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:06.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.622+0000 7ff0b77fe640 1 -- 172.21.15.45:0/2398727296 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3143108268 0 0) 0x7ff0b8146550 con 0x7ff0b8145ee0 2023-11-28T18:38:06.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.622+0000 7ff0b7fff640 1 -- 172.21.15.45:0/2398727296 >> v1:172.21.15.45:6789/0 conn(0x7ff0b80ac880 legacy=0x7ff0b8070e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:06.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.622+0000 7ff0b7fff640 1 -- 172.21.15.45:0/2398727296 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0b81467f0 con 0x7ff0b8161530 2023-11-28T18:38:06.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.622+0000 7ff0b7fff640 1 --2- 172.21.15.45:0/2398727296 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff0b8161530 0x7ff0b80b4cd0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff0a40097c0 tx=0x7ff0a401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ce59ba79906b854 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:06.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.626+0000 7ff0b77fe640 1 -- 172.21.15.45:0/2398727296 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a40a8050 con 0x7ff0b8161530 2023-11-28T18:38:06.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.626+0000 7ff0b77fe640 1 -- 172.21.15.45:0/2398727296 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0a40ac5f0 con 0x7ff0b8161530 2023-11-28T18:38:06.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.626+0000 7ff0b77fe640 1 -- 172.21.15.45:0/2398727296 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a40ac980 con 0x7ff0b8161530 2023-11-28T18:38:06.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.626+0000 7ff0beb72640 1 -- 172.21.15.45:0/2398727296 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff0b8161530 msgr2=0x7ff0b80b4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:06.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.626+0000 7ff0beb72640 1 --2- 172.21.15.45:0/2398727296 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff0b8161530 0x7ff0b80b4cd0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff0a40097c0 tx=0x7ff0a401c480 comp rx=0 tx=0).stop 2023-11-28T18:38:06.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.626+0000 7ff0beb72640 1 -- 172.21.15.45:0/2398727296 shutdown_connections 2023-11-28T18:38:06.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.626+0000 7ff0beb72640 1 --2- 172.21.15.45:0/2398727296 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff0b8161530 0x7ff0b80b4cd0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:06.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.626+0000 7ff0beb72640 1 -- 172.21.15.45:0/2398727296 >> 172.21.15.45:0/2398727296 conn(0x7ff0b80b0d00 msgr2=0x7ff0b80b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:06.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.626+0000 7ff0beb72640 1 -- 172.21.15.45:0/2398727296 shutdown_connections 2023-11-28T18:38:06.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.626+0000 7ff0beb72640 1 -- 172.21.15.45:0/2398727296 wait complete. 2023-11-28T18:38:06.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.626+0000 7ff0beb72640 1 Processor -- start 2023-11-28T18:38:06.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.626+0000 7ff0beb72640 1 -- start start 2023-11-28T18:38:06.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.626+0000 7ff0beb72640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff0b80ac880 0x7ff0b8162030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:06.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.630+0000 7ff0beb72640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff0b8145ee0 0x7ff0b815ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:06.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.630+0000 7ff0beb72640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0b8161530 0x7ff0b815c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:06.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.630+0000 7ff0beb72640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b815fee0 con 0x7ff0b8161530 2023-11-28T18:38:06.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.630+0000 7ff0beb72640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b815f2d0 con 0x7ff0b80ac880 2023-11-28T18:38:06.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.630+0000 7ff0beb72640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b815f5b0 con 0x7ff0b8145ee0 2023-11-28T18:38:06.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.630+0000 7ff0bd10f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0b8161530 0x7ff0b815c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:06.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.630+0000 7ff0bc90e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff0b80ac880 0x7ff0b8162030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:06.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.630+0000 7ff0b7fff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff0b8145ee0 0x7ff0b815ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:06.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.630+0000 7ff0bd10f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0b8161530 0x7ff0b815c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53466/0 (socket says 172.21.15.45:53466) 2023-11-28T18:38:06.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.630+0000 7ff0bd10f640 1 -- 172.21.15.45:0/1709499240 learned_addr learned my addr 172.21.15.45:0/1709499240 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:06.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.630+0000 7ff0bc90e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff0b80ac880 0x7ff0b8162030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.45:50388/0 (socket says 172.21.15.45:50388) 2023-11-28T18:38:06.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.630+0000 7ff0bd10f640 1 -- 172.21.15.45:0/1709499240 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff0b8145ee0 msgr2=0x7ff0b815ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:06.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.630+0000 7ff0bd10f640 1 --2- 172.21.15.45:0/1709499240 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff0b8145ee0 0x7ff0b815ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:06.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.630+0000 7ff0bd10f640 1 -- 172.21.15.45:0/1709499240 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff0b80ac880 msgr2=0x7ff0b8162030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:06.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.630+0000 7ff0bd10f640 1 --2- 172.21.15.45:0/1709499240 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff0b80ac880 0x7ff0b8162030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:06.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.630+0000 7ff0bd10f640 1 -- 172.21.15.45:0/1709499240 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0a4009420 con 0x7ff0b8161530 2023-11-28T18:38:06.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.630+0000 7ff0bc90e640 1 --2- 172.21.15.45:0/1709499240 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff0b80ac880 0x7ff0b8162030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:38:06.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.630+0000 7ff0b7fff640 1 --2- 172.21.15.45:0/1709499240 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff0b8145ee0 0x7ff0b815ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:38:06.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.630+0000 7ff0bd10f640 1 --2- 172.21.15.45:0/1709499240 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0b8161530 0x7ff0b815c990 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff0b000caa0 tx=0x7ff0b000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:06.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.630+0000 7ff0b57fa640 1 -- 172.21.15.45:0/1709499240 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b000ac00 con 0x7ff0b8161530 2023-11-28T18:38:06.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.630+0000 7ff0b57fa640 1 -- 172.21.15.45:0/1709499240 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0b000ad60 con 0x7ff0b8161530 2023-11-28T18:38:06.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.630+0000 7ff0b57fa640 1 -- 172.21.15.45:0/1709499240 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b0012620 con 0x7ff0b8161530 2023-11-28T18:38:06.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.630+0000 7ff0beb72640 1 -- 172.21.15.45:0/1709499240 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0b815f890 con 0x7ff0b8161530 2023-11-28T18:38:06.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.630+0000 7ff0beb72640 1 -- 172.21.15.45:0/1709499240 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0b815ced0 con 0x7ff0b8161530 2023-11-28T18:38:06.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.630+0000 7ff0beb72640 1 -- 172.21.15.45:0/1709499240 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0b8160050 con 0x7ff0b8161530 2023-11-28T18:38:06.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.630+0000 7ff0b57fa640 1 -- 172.21.15.45:0/1709499240 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ff0b0007070 con 0x7ff0b8161530 2023-11-28T18:38:06.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.634+0000 7ff0b57fa640 1 --2- 172.21.15.45:0/1709499240 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff09c066900 0x7ff09c068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:06.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.634+0000 7ff0b57fa640 1 -- 172.21.15.45:0/1709499240 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff0b00843b0 con 0x7ff0b8161530 2023-11-28T18:38:06.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.634+0000 7ff0bc90e640 1 --2- 172.21.15.45:0/1709499240 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff09c066900 0x7ff09c068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:06.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.634+0000 7ff0bc90e640 1 --2- 172.21.15.45:0/1709499240 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff09c066900 0x7ff09c068dc0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac007fd0 tx=0x7ff0ac009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:06.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.638+0000 7ff0b57fa640 1 -- 172.21.15.45:0/1709499240 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff0b0051600 con 0x7ff0b8161530 2023-11-28T18:38:06.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.794+0000 7ff0beb72640 1 -- 172.21.15.45:0/1709499240 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff0b8069410 con 0x7ff0b8161530 2023-11-28T18:38:06.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.794+0000 7ff0b57fa640 1 -- 172.21.15.45:0/1709499240 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff0b0054c20 con 0x7ff0b8161530 2023-11-28T18:38:06.797 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-11-28T18:38:06.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.798+0000 7ff0beb72640 1 -- 172.21.15.45:0/1709499240 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff09c066900 msgr2=0x7ff09c068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:06.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.798+0000 7ff0beb72640 1 --2- 172.21.15.45:0/1709499240 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff09c066900 0x7ff09c068dc0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac007fd0 tx=0x7ff0ac009040 comp rx=0 tx=0).stop 2023-11-28T18:38:06.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.798+0000 7ff0beb72640 1 -- 172.21.15.45:0/1709499240 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0b8161530 msgr2=0x7ff0b815c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:06.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.798+0000 7ff0beb72640 1 --2- 172.21.15.45:0/1709499240 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0b8161530 0x7ff0b815c990 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff0b000caa0 tx=0x7ff0b000cf60 comp rx=0 tx=0).stop 2023-11-28T18:38:06.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.798+0000 7ff0beb72640 1 -- 172.21.15.45:0/1709499240 shutdown_connections 2023-11-28T18:38:06.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.798+0000 7ff0beb72640 1 --2- 172.21.15.45:0/1709499240 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff09c066900 0x7ff09c068dc0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:06.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.798+0000 7ff0beb72640 1 --2- 172.21.15.45:0/1709499240 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0b8161530 0x7ff0b815c990 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:06.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.798+0000 7ff0beb72640 1 --2- 172.21.15.45:0/1709499240 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff0b8145ee0 0x7ff0b815ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:06.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.798+0000 7ff0beb72640 1 --2- 172.21.15.45:0/1709499240 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff0b80ac880 0x7ff0b8162030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:06.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.798+0000 7ff0beb72640 1 -- 172.21.15.45:0/1709499240 >> 172.21.15.45:0/1709499240 conn(0x7ff0b80b0d00 msgr2=0x7ff0b80b3c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:06.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.798+0000 7ff0beb72640 1 -- 172.21.15.45:0/1709499240 shutdown_connections 2023-11-28T18:38:06.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.798+0000 7ff0beb72640 1 -- 172.21.15.45:0/1709499240 wait complete. 2023-11-28T18:38:06.820 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T18:38:06.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.962+0000 7fbf8e9d1640 1 Processor -- start 2023-11-28T18:38:06.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.962+0000 7fbf8e9d1640 1 -- start start 2023-11-28T18:38:06.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.966+0000 7fbf8e9d1640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fbf881409a0 0x7fbf88140e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:06.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.966+0000 7fbf8e9d1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbf880ae920 0x7fbf880aed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:06.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.966+0000 7fbf8e9d1640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf880ad5e0 con 0x7fbf881401f0 2023-11-28T18:38:06.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.966+0000 7fbf8e9d1640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf880ad880 con 0x7fbf881409a0 2023-11-28T18:38:06.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.966+0000 7fbf8e9d1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf880adb60 con 0x7fbf880ae920 2023-11-28T18:38:06.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.966+0000 7fbf87fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fbf881401f0 0x7fbf88161730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33834/0 (socket says 172.21.15.45:33834) 2023-11-28T18:38:06.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.966+0000 7fbf87fff640 1 -- 172.21.15.45:0/781644963 learned_addr learned my addr 172.21.15.45:0/781644963 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:38:06.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.966+0000 7fbf8cf6e640 1 --2- 172.21.15.45:0/781644963 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbf880ae920 0x7fbf880aed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:06.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.966+0000 7fbf877fe640 1 --2- 172.21.15.45:0/781644963 >> v2:172.21.15.190:3300/0 conn(0x7fbf881409a0 0x7fbf88140e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:06.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.966+0000 7fbf86ffd640 1 -- 172.21.15.45:0/781644963 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1173761190 0 0) 0x7fbf880ad5e0 con 0x7fbf881401f0 2023-11-28T18:38:06.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.966+0000 7fbf86ffd640 1 -- 172.21.15.45:0/781644963 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf70003530 con 0x7fbf881401f0 2023-11-28T18:38:06.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.966+0000 7fbf86ffd640 1 -- 172.21.15.45:0/781644963 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1620110923 0 0) 0x7fbf70003530 con 0x7fbf881401f0 2023-11-28T18:38:06.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.966+0000 7fbf86ffd640 1 -- 172.21.15.45:0/781644963 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbf880ae920 msgr2=0x7fbf880aed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:06.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.966+0000 7fbf86ffd640 1 --2- 172.21.15.45:0/781644963 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbf880ae920 0x7fbf880aed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:06.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.966+0000 7fbf86ffd640 1 -- 172.21.15.45:0/781644963 >> v2:172.21.15.190:3300/0 conn(0x7fbf881409a0 msgr2=0x7fbf88140e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:06.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.966+0000 7fbf86ffd640 1 --2- 172.21.15.45:0/781644963 >> v2:172.21.15.190:3300/0 conn(0x7fbf881409a0 0x7fbf88140e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:06.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.966+0000 7fbf86ffd640 1 -- 172.21.15.45:0/781644963 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf880ade40 con 0x7fbf881401f0 2023-11-28T18:38:06.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.966+0000 7fbf86ffd640 1 -- 172.21.15.45:0/781644963 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4084481567 0 0) 0x7fbf78001680 con 0x7fbf881401f0 2023-11-28T18:38:06.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.966+0000 7fbf86ffd640 1 -- 172.21.15.45:0/781644963 >> v1:172.21.15.45:6789/0 conn(0x7fbf881401f0 legacy=0x7fbf88161730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:06.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.966+0000 7fbf86ffd640 1 --2- 172.21.15.45:0/781644963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf70003980 0x7fbf70003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:06.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.966+0000 7fbf86ffd640 1 --2- 172.21.15.45:0/781644963 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbf880ae920 0x7fbf700047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:06.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.966+0000 7fbf86ffd640 1 --2- 172.21.15.45:0/781644963 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbf70004d10 0x7fbf70005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:06.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.966+0000 7fbf86ffd640 1 -- 172.21.15.45:0/781644963 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf880ad880 con 0x7fbf70003980 2023-11-28T18:38:06.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.966+0000 7fbf86ffd640 1 -- 172.21.15.45:0/781644963 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf880adb60 con 0x7fbf70004d10 2023-11-28T18:38:06.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.966+0000 7fbf86ffd640 1 -- 172.21.15.45:0/781644963 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf7000b990 con 0x7fbf880ae920 2023-11-28T18:38:06.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.966+0000 7fbf87fff640 1 --2- 172.21.15.45:0/781644963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf70003980 0x7fbf70003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:06.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.966+0000 7fbf8cf6e640 1 --2- 172.21.15.45:0/781644963 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbf70004d10 0x7fbf70005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:06.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.966+0000 7fbf877fe640 1 --2- 172.21.15.45:0/781644963 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbf880ae920 0x7fbf700047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:06.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.966+0000 7fbf87fff640 1 -- 172.21.15.45:0/781644963 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbf880ae920 msgr2=0x7fbf700047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:06.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.966+0000 7fbf87fff640 1 --2- 172.21.15.45:0/781644963 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbf880ae920 0x7fbf700047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:06.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.966+0000 7fbf87fff640 1 -- 172.21.15.45:0/781644963 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbf70004d10 msgr2=0x7fbf70005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:06.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.966+0000 7fbf87fff640 1 --2- 172.21.15.45:0/781644963 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbf70004d10 0x7fbf70005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:06.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.966+0000 7fbf87fff640 1 -- 172.21.15.45:0/781644963 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf70003530 con 0x7fbf70003980 2023-11-28T18:38:06.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.966+0000 7fbf877fe640 1 --2- 172.21.15.45:0/781644963 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbf880ae920 0x7fbf700047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:38:06.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.970+0000 7fbf87fff640 1 --2- 172.21.15.45:0/781644963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf70003980 0x7fbf70003da0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fbf7800c240 tx=0x7fbf7801cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c2e46b4b3912902 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:06.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.970+0000 7fbf86ffd640 1 -- 172.21.15.45:0/781644963 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf780058e0 con 0x7fbf70003980 2023-11-28T18:38:06.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.970+0000 7fbf86ffd640 1 -- 172.21.15.45:0/781644963 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf78005a40 con 0x7fbf70003980 2023-11-28T18:38:06.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.970+0000 7fbf86ffd640 1 -- 172.21.15.45:0/781644963 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf78005e10 con 0x7fbf70003980 2023-11-28T18:38:06.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.970+0000 7fbf8e9d1640 1 -- 172.21.15.45:0/781644963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf70003980 msgr2=0x7fbf70003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:06.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.970+0000 7fbf8e9d1640 1 --2- 172.21.15.45:0/781644963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf70003980 0x7fbf70003da0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fbf7800c240 tx=0x7fbf7801cc60 comp rx=0 tx=0).stop 2023-11-28T18:38:06.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.970+0000 7fbf8cf6e640 1 -- 172.21.15.45:0/781644963 reap_dead start 2023-11-28T18:38:06.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.970+0000 7fbf8e9d1640 1 -- 172.21.15.45:0/781644963 shutdown_connections 2023-11-28T18:38:06.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.970+0000 7fbf8e9d1640 1 -- 172.21.15.45:0/781644963 >> 172.21.15.45:0/781644963 conn(0x7fbf880b1b70 msgr2=0x7fbf88070cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:06.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.970+0000 7fbf8e9d1640 1 -- 172.21.15.45:0/781644963 shutdown_connections 2023-11-28T18:38:06.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.970+0000 7fbf8e9d1640 1 -- 172.21.15.45:0/781644963 wait complete. 2023-11-28T18:38:06.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.970+0000 7fbf8e9d1640 1 Processor -- start 2023-11-28T18:38:06.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.974+0000 7fbf8e9d1640 1 -- start start 2023-11-28T18:38:06.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.974+0000 7fbf8e9d1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbf70003980 0x7fbf8813eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:06.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.974+0000 7fbf8e9d1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf88164660 0x7fbf8815fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:06.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.974+0000 7fbf8e9d1640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbf88164ae0 0x7fbf8815ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:06.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.974+0000 7fbf8e9d1640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf88165cd0 con 0x7fbf88164660 2023-11-28T18:38:06.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.974+0000 7fbf8e9d1640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8813f420 con 0x7fbf88164ae0 2023-11-28T18:38:06.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.974+0000 7fbf8e9d1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf88165050 con 0x7fbf70003980 2023-11-28T18:38:06.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.974+0000 7fbf877fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf88164660 0x7fbf8815fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:06.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.974+0000 7fbf877fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf88164660 0x7fbf8815fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53484/0 (socket says 172.21.15.45:53484) 2023-11-28T18:38:06.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.974+0000 7fbf877fe640 1 -- 172.21.15.45:0/3681232831 learned_addr learned my addr 172.21.15.45:0/3681232831 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:06.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.974+0000 7fbf8cf6e640 1 --2- 172.21.15.45:0/3681232831 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbf88164ae0 0x7fbf8815ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:06.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.974+0000 7fbf87fff640 1 --2- 172.21.15.45:0/3681232831 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbf70003980 0x7fbf8813eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:06.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.974+0000 7fbf877fe640 1 -- 172.21.15.45:0/3681232831 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbf70003980 msgr2=0x7fbf8813eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:06.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.974+0000 7fbf877fe640 1 --2- 172.21.15.45:0/3681232831 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbf70003980 0x7fbf8813eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:06.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.974+0000 7fbf877fe640 1 -- 172.21.15.45:0/3681232831 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbf88164ae0 msgr2=0x7fbf8815ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:06.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.974+0000 7fbf877fe640 1 --2- 172.21.15.45:0/3681232831 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbf88164ae0 0x7fbf8815ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:06.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.974+0000 7fbf877fe640 1 -- 172.21.15.45:0/3681232831 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf88165330 con 0x7fbf88164660 2023-11-28T18:38:06.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.974+0000 7fbf8cf6e640 1 --2- 172.21.15.45:0/3681232831 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbf88164ae0 0x7fbf8815ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:38:06.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.974+0000 7fbf87fff640 1 --2- 172.21.15.45:0/3681232831 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbf70003980 0x7fbf8813eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:38:06.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.974+0000 7fbf877fe640 1 --2- 172.21.15.45:0/3681232831 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf88164660 0x7fbf8815fa40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c0115f0 tx=0x7fbf7c011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:06.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.974+0000 7fbf84ff9640 1 -- 172.21.15.45:0/3681232831 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7c004220 con 0x7fbf88164660 2023-11-28T18:38:06.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.974+0000 7fbf84ff9640 1 -- 172.21.15.45:0/3681232831 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf7c004380 con 0x7fbf88164660 2023-11-28T18:38:06.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.974+0000 7fbf84ff9640 1 -- 172.21.15.45:0/3681232831 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7c00f910 con 0x7fbf88164660 2023-11-28T18:38:06.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.974+0000 7fbf8e9d1640 1 -- 172.21.15.45:0/3681232831 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf88165610 con 0x7fbf88164660 2023-11-28T18:38:06.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.974+0000 7fbf8e9d1640 1 -- 172.21.15.45:0/3681232831 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf88157ed0 con 0x7fbf88164660 2023-11-28T18:38:06.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.974+0000 7fbf8e9d1640 1 -- 172.21.15.45:0/3681232831 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf88069410 con 0x7fbf88164660 2023-11-28T18:38:06.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.978+0000 7fbf84ff9640 1 -- 172.21.15.45:0/3681232831 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fbf7c00fa70 con 0x7fbf88164660 2023-11-28T18:38:06.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.978+0000 7fbf84ff9640 1 --2- 172.21.15.45:0/3681232831 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbf74066900 0x7fbf74068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:06.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.978+0000 7fbf84ff9640 1 -- 172.21.15.45:0/3681232831 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbf7c084910 con 0x7fbf88164660 2023-11-28T18:38:06.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.978+0000 7fbf87fff640 1 --2- 172.21.15.45:0/3681232831 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbf74066900 0x7fbf74068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:06.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.978+0000 7fbf87fff640 1 --2- 172.21.15.45:0/3681232831 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbf74066900 0x7fbf74068dc0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbf780aa000 tx=0x7fbf78001a80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:06.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:06.982+0000 7fbf84ff9640 1 -- 172.21.15.45:0/3681232831 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbf7c051b40 con 0x7fbf88164660 2023-11-28T18:38:07.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.138+0000 7fbf8e9d1640 1 -- 172.21.15.45:0/3681232831 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbf8815cd00 con 0x7fbf88164660 2023-11-28T18:38:07.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.142+0000 7fbf84ff9640 1 -- 172.21.15.45:0/3681232831 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbf7c022020 con 0x7fbf88164660 2023-11-28T18:38:07.143 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-11-28T18:38:07.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.142+0000 7fbf8e9d1640 1 -- 172.21.15.45:0/3681232831 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbf74066900 msgr2=0x7fbf74068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:07.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.142+0000 7fbf8e9d1640 1 --2- 172.21.15.45:0/3681232831 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbf74066900 0x7fbf74068dc0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbf780aa000 tx=0x7fbf78001a80 comp rx=0 tx=0).stop 2023-11-28T18:38:07.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.142+0000 7fbf8e9d1640 1 -- 172.21.15.45:0/3681232831 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf88164660 msgr2=0x7fbf8815fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:07.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.142+0000 7fbf8e9d1640 1 --2- 172.21.15.45:0/3681232831 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf88164660 0x7fbf8815fa40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c0115f0 tx=0x7fbf7c011ab0 comp rx=0 tx=0).stop 2023-11-28T18:38:07.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.142+0000 7fbf8e9d1640 1 -- 172.21.15.45:0/3681232831 shutdown_connections 2023-11-28T18:38:07.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.142+0000 7fbf8e9d1640 1 --2- 172.21.15.45:0/3681232831 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbf74066900 0x7fbf74068dc0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:07.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.142+0000 7fbf8e9d1640 1 --2- 172.21.15.45:0/3681232831 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbf88164ae0 0x7fbf8815ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:07.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.142+0000 7fbf8e9d1640 1 --2- 172.21.15.45:0/3681232831 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf88164660 0x7fbf8815fa40 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:07.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.142+0000 7fbf8e9d1640 1 --2- 172.21.15.45:0/3681232831 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbf70003980 0x7fbf8813eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:07.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.142+0000 7fbf8e9d1640 1 -- 172.21.15.45:0/3681232831 >> 172.21.15.45:0/3681232831 conn(0x7fbf880b1b70 msgr2=0x7fbf8806e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:07.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.142+0000 7fbf8e9d1640 1 -- 172.21.15.45:0/3681232831 shutdown_connections 2023-11-28T18:38:07.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.142+0000 7fbf8e9d1640 1 -- 172.21.15.45:0/3681232831 wait complete. 2023-11-28T18:38:07.165 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T18:38:07.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.306+0000 7f4d0005f640 1 Processor -- start 2023-11-28T18:38:07.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.310+0000 7f4d0005f640 1 -- start start 2023-11-28T18:38:07.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.310+0000 7f4d0005f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4cf8146c00 0x7f4cf815e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:07.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.310+0000 7f4d0005f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4cf80b32c0 0x7f4cf806ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:07.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.310+0000 7f4d0005f640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cf8146fe0 con 0x7f4cf806e8f0 2023-11-28T18:38:07.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.310+0000 7f4d0005f640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cf815e970 con 0x7f4cf8146c00 2023-11-28T18:38:07.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.310+0000 7f4d0005f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf806f390 con 0x7f4cf80b32c0 2023-11-28T18:38:07.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.310+0000 7f4cfddfb640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4cf8146c00 0x7f4cf815e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:07.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.310+0000 7f4cfd5fa640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f4cf806e8f0 0x7f4cf80b2bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33846/0 (socket says 172.21.15.45:33846) 2023-11-28T18:38:07.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.310+0000 7f4cfd5fa640 1 -- 172.21.15.45:0/4011427781 learned_addr learned my addr 172.21.15.45:0/4011427781 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:38:07.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.310+0000 7f4cfe5fc640 1 --2- 172.21.15.45:0/4011427781 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4cf80b32c0 0x7f4cf806ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:07.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.310+0000 7f4cfddfb640 1 -- 172.21.15.45:0/4011427781 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4cf80b32c0 msgr2=0x7f4cf806ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:07.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.310+0000 7f4cfddfb640 1 --2- 172.21.15.45:0/4011427781 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4cf80b32c0 0x7f4cf806ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:07.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.310+0000 7f4cfddfb640 1 -- 172.21.15.45:0/4011427781 >> v1:172.21.15.45:6789/0 conn(0x7f4cf806e8f0 legacy=0x7f4cf80b2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:07.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.310+0000 7f4cfddfb640 1 -- 172.21.15.45:0/4011427781 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf806f670 con 0x7f4cf8146c00 2023-11-28T18:38:07.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.310+0000 7f4cfcdf9640 1 -- 172.21.15.45:0/4011427781 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2460441617 0 0) 0x7f4cf8146fe0 con 0x7f4cf806e8f0 2023-11-28T18:38:07.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.314+0000 7f4cfddfb640 1 --2- 172.21.15.45:0/4011427781 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cf8146c00 0x7f4cf815e430 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4cf40097c0 tx=0x7f4cf401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e19f4147b68728c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:07.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.314+0000 7f4cfcdf9640 1 -- 172.21.15.45:0/4011427781 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf40ab650 con 0x7f4cf8146c00 2023-11-28T18:38:07.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.314+0000 7f4cfcdf9640 1 -- 172.21.15.45:0/4011427781 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cf40ab7b0 con 0x7f4cf8146c00 2023-11-28T18:38:07.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.314+0000 7f4cfcdf9640 1 -- 172.21.15.45:0/4011427781 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf40abb40 con 0x7f4cf8146c00 2023-11-28T18:38:07.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.314+0000 7f4d0005f640 1 -- 172.21.15.45:0/4011427781 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cf8146c00 msgr2=0x7f4cf815e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:07.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.314+0000 7f4d0005f640 1 --2- 172.21.15.45:0/4011427781 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cf8146c00 0x7f4cf815e430 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4cf40097c0 tx=0x7f4cf401c450 comp rx=0 tx=0).stop 2023-11-28T18:38:07.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.314+0000 7f4d0005f640 1 -- 172.21.15.45:0/4011427781 shutdown_connections 2023-11-28T18:38:07.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.314+0000 7f4d0005f640 1 --2- 172.21.15.45:0/4011427781 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4cf80b32c0 0x7f4cf806ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:07.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.314+0000 7f4d0005f640 1 --2- 172.21.15.45:0/4011427781 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cf8146c00 0x7f4cf815e430 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:07.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.314+0000 7f4d0005f640 1 -- 172.21.15.45:0/4011427781 >> 172.21.15.45:0/4011427781 conn(0x7f4cf806a570 msgr2=0x7f4cf806a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:07.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.314+0000 7f4d0005f640 1 -- 172.21.15.45:0/4011427781 shutdown_connections 2023-11-28T18:38:07.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.314+0000 7f4d0005f640 1 -- 172.21.15.45:0/4011427781 wait complete. 2023-11-28T18:38:07.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.314+0000 7f4d0005f640 1 Processor -- start 2023-11-28T18:38:07.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.318+0000 7f4d0005f640 1 -- start start 2023-11-28T18:38:07.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.318+0000 7f4d0005f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4cf806e8f0 0x7f4cf813e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:07.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.318+0000 7f4d0005f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cf80b32c0 0x7f4cf813f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:07.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.318+0000 7f4d0005f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4cf8146c00 0x7f4cf8145a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:07.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.318+0000 7f4d0005f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf8140280 con 0x7f4cf80b32c0 2023-11-28T18:38:07.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.318+0000 7f4d0005f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf813fcc0 con 0x7f4cf806e8f0 2023-11-28T18:38:07.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.318+0000 7f4d0005f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf813ffa0 con 0x7f4cf8146c00 2023-11-28T18:38:07.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.318+0000 7f4cfd5fa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cf80b32c0 0x7f4cf813f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:07.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.318+0000 7f4cfd5fa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cf80b32c0 0x7f4cf813f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53502/0 (socket says 172.21.15.45:53502) 2023-11-28T18:38:07.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.318+0000 7f4cfd5fa640 1 -- 172.21.15.45:0/4084923860 learned_addr learned my addr 172.21.15.45:0/4084923860 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:07.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.318+0000 7f4cfddfb640 1 --2- 172.21.15.45:0/4084923860 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4cf806e8f0 0x7f4cf813e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:07.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.318+0000 7f4cfe5fc640 1 --2- 172.21.15.45:0/4084923860 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4cf8146c00 0x7f4cf8145a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:07.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.318+0000 7f4cfd5fa640 1 -- 172.21.15.45:0/4084923860 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4cf8146c00 msgr2=0x7f4cf8145a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:07.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.318+0000 7f4cfd5fa640 1 --2- 172.21.15.45:0/4084923860 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4cf8146c00 0x7f4cf8145a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:07.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.318+0000 7f4cfd5fa640 1 -- 172.21.15.45:0/4084923860 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4cf806e8f0 msgr2=0x7f4cf813e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:07.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.318+0000 7f4cfd5fa640 1 --2- 172.21.15.45:0/4084923860 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4cf806e8f0 0x7f4cf813e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:07.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.318+0000 7f4cfd5fa640 1 -- 172.21.15.45:0/4084923860 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf4009420 con 0x7f4cf80b32c0 2023-11-28T18:38:07.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.318+0000 7f4cfd5fa640 1 --2- 172.21.15.45:0/4084923860 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cf80b32c0 0x7f4cf813f200 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4ce80011f0 tx=0x7f4ce800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:07.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.318+0000 7f4cee7fc640 1 -- 172.21.15.45:0/4084923860 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce80074e0 con 0x7f4cf80b32c0 2023-11-28T18:38:07.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.318+0000 7f4cee7fc640 1 -- 172.21.15.45:0/4084923860 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ce8007640 con 0x7f4cf80b32c0 2023-11-28T18:38:07.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.318+0000 7f4cee7fc640 1 -- 172.21.15.45:0/4084923860 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce8004a10 con 0x7f4cf80b32c0 2023-11-28T18:38:07.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.318+0000 7f4d0005f640 1 -- 172.21.15.45:0/4084923860 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cf81405b0 con 0x7f4cf80b32c0 2023-11-28T18:38:07.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.318+0000 7f4d0005f640 1 -- 172.21.15.45:0/4084923860 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cf80b3ec0 con 0x7f4cf80b32c0 2023-11-28T18:38:07.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.318+0000 7f4d0005f640 1 -- 172.21.15.45:0/4084923860 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cf80b7000 con 0x7f4cf80b32c0 2023-11-28T18:38:07.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.322+0000 7f4cee7fc640 1 -- 172.21.15.45:0/4084923860 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f4ce8004b70 con 0x7f4cf80b32c0 2023-11-28T18:38:07.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.322+0000 7f4cee7fc640 1 --2- 172.21.15.45:0/4084923860 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4cdc0668d0 0x7f4cdc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:07.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.322+0000 7f4cee7fc640 1 -- 172.21.15.45:0/4084923860 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4ce80836a0 con 0x7f4cf80b32c0 2023-11-28T18:38:07.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.322+0000 7f4cfddfb640 1 --2- 172.21.15.45:0/4084923860 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4cdc0668d0 0x7f4cdc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:07.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.322+0000 7f4cfddfb640 1 --2- 172.21.15.45:0/4084923860 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4cdc0668d0 0x7f4cdc068d90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4cf40af000 tx=0x7f4cf40a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:07.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.326+0000 7f4cee7fc640 1 -- 172.21.15.45:0/4084923860 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4ce8050980 con 0x7f4cf80b32c0 2023-11-28T18:38:07.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.494+0000 7f4d0005f640 1 -- 172.21.15.45:0/4084923860 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f4cf80cacd0 con 0x7f4cf80b32c0 2023-11-28T18:38:07.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.494+0000 7f4cee7fc640 1 -- 172.21.15.45:0/4084923860 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f4ce8018080 con 0x7f4cf80b32c0 2023-11-28T18:38:07.497 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-11-28T18:38:07.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.498+0000 7f4d0005f640 1 -- 172.21.15.45:0/4084923860 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4cdc0668d0 msgr2=0x7f4cdc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:07.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.498+0000 7f4d0005f640 1 --2- 172.21.15.45:0/4084923860 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4cdc0668d0 0x7f4cdc068d90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4cf40af000 tx=0x7f4cf40a7000 comp rx=0 tx=0).stop 2023-11-28T18:38:07.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.498+0000 7f4d0005f640 1 -- 172.21.15.45:0/4084923860 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cf80b32c0 msgr2=0x7f4cf813f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:07.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.498+0000 7f4d0005f640 1 --2- 172.21.15.45:0/4084923860 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cf80b32c0 0x7f4cf813f200 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4ce80011f0 tx=0x7f4ce800c9b0 comp rx=0 tx=0).stop 2023-11-28T18:38:07.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.498+0000 7f4d0005f640 1 -- 172.21.15.45:0/4084923860 shutdown_connections 2023-11-28T18:38:07.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.498+0000 7f4d0005f640 1 --2- 172.21.15.45:0/4084923860 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4cdc0668d0 0x7f4cdc068d90 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:07.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.498+0000 7f4d0005f640 1 --2- 172.21.15.45:0/4084923860 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4cf8146c00 0x7f4cf8145a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:07.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.498+0000 7f4d0005f640 1 --2- 172.21.15.45:0/4084923860 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cf80b32c0 0x7f4cf813f200 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:07.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.498+0000 7f4d0005f640 1 --2- 172.21.15.45:0/4084923860 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4cf806e8f0 0x7f4cf813e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:07.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.498+0000 7f4d0005f640 1 -- 172.21.15.45:0/4084923860 >> 172.21.15.45:0/4084923860 conn(0x7f4cf806a570 msgr2=0x7f4cf80d0d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:07.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.498+0000 7f4d0005f640 1 -- 172.21.15.45:0/4084923860 shutdown_connections 2023-11-28T18:38:07.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.498+0000 7f4d0005f640 1 -- 172.21.15.45:0/4084923860 wait complete. 2023-11-28T18:38:07.518 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T18:38:07.518 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T18:38:07.528 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T18:38:07.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.714+0000 7f601d2d6640 1 Processor -- start 2023-11-28T18:38:07.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.714+0000 7f601d2d6640 1 -- start start 2023-11-28T18:38:07.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.714+0000 7f601d2d6640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f60181401c0 0x7f6018071f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:07.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.714+0000 7f601d2d6640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f601806c300 0x7f601806c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:07.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.714+0000 7f601d2d6640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6018140900 con 0x7f60180704a0 2023-11-28T18:38:07.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.714+0000 7f601d2d6640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f601806ccf0 con 0x7f60181401c0 2023-11-28T18:38:07.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.714+0000 7f601d2d6640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f601815dbc0 con 0x7f601806c300 2023-11-28T18:38:07.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.714+0000 7f6016ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f60181401c0 0x7f6018071f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:07.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.714+0000 7f60177fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f60180704a0 0x7f6018070910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33858/0 (socket says 172.21.15.45:33858) 2023-11-28T18:38:07.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.714+0000 7f60177fe640 1 -- 172.21.15.45:0/1464000809 learned_addr learned my addr 172.21.15.45:0/1464000809 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:38:07.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.714+0000 7f600ffff640 1 --2- 172.21.15.45:0/1464000809 >> v2:172.21.15.190:3300/0 conn(0x7f601806c300 0x7f601806c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:07.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.714+0000 7f6016ffd640 1 -- 172.21.15.45:0/1464000809 >> v2:172.21.15.190:3300/0 conn(0x7f601806c300 msgr2=0x7f601806c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:07.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.714+0000 7f6016ffd640 1 --2- 172.21.15.45:0/1464000809 >> v2:172.21.15.190:3300/0 conn(0x7f601806c300 0x7f601806c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:07.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.714+0000 7f6016ffd640 1 -- 172.21.15.45:0/1464000809 >> v1:172.21.15.45:6789/0 conn(0x7f60180704a0 legacy=0x7f6018070910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:07.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.718+0000 7f6016ffd640 1 -- 172.21.15.45:0/1464000809 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f601815dea0 con 0x7f60181401c0 2023-11-28T18:38:07.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.714+0000 7f60167fc640 1 -- 172.21.15.45:0/1464000809 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2347342469 0 0) 0x7f6018140900 con 0x7f60180704a0 2023-11-28T18:38:07.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.718+0000 7f6016ffd640 1 --2- 172.21.15.45:0/1464000809 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60181401c0 0x7f6018071f60 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6018143a30 tx=0x7f600801c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c7c1d71def289e2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:07.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.718+0000 7f60167fc640 1 -- 172.21.15.45:0/1464000809 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60080ac600 con 0x7f60181401c0 2023-11-28T18:38:07.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.718+0000 7f60167fc640 1 -- 172.21.15.45:0/1464000809 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60080a8050 con 0x7f60181401c0 2023-11-28T18:38:07.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.718+0000 7f60167fc640 1 -- 172.21.15.45:0/1464000809 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60080ac980 con 0x7f60181401c0 2023-11-28T18:38:07.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.718+0000 7f601d2d6640 1 -- 172.21.15.45:0/1464000809 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60181401c0 msgr2=0x7f6018071f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:07.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.718+0000 7f601d2d6640 1 --2- 172.21.15.45:0/1464000809 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60181401c0 0x7f6018071f60 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6018143a30 tx=0x7f600801c3a0 comp rx=0 tx=0).stop 2023-11-28T18:38:07.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.718+0000 7f601d2d6640 1 -- 172.21.15.45:0/1464000809 shutdown_connections 2023-11-28T18:38:07.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.718+0000 7f601d2d6640 1 --2- 172.21.15.45:0/1464000809 >> v2:172.21.15.190:3300/0 conn(0x7f601806c300 0x7f601806c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:07.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.718+0000 7f601d2d6640 1 --2- 172.21.15.45:0/1464000809 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60181401c0 0x7f6018071f60 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:07.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.718+0000 7f601d2d6640 1 -- 172.21.15.45:0/1464000809 >> 172.21.15.45:0/1464000809 conn(0x7f601806a570 msgr2=0x7f601806a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:07.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.718+0000 7f601d2d6640 1 -- 172.21.15.45:0/1464000809 shutdown_connections 2023-11-28T18:38:07.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.718+0000 7f601d2d6640 1 -- 172.21.15.45:0/1464000809 wait complete. 2023-11-28T18:38:07.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.722+0000 7f601d2d6640 1 Processor -- start 2023-11-28T18:38:07.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.722+0000 7f601d2d6640 1 -- start start 2023-11-28T18:38:07.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.722+0000 7f601d2d6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f601806c300 0x7f6018136e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:07.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.722+0000 7f601d2d6640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f60180704a0 0x7f601813f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:07.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.722+0000 7f601d2d6640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f60181401c0 0x7f601815ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:07.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.722+0000 7f601d2d6640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60181556d0 con 0x7f601806c300 2023-11-28T18:38:07.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.722+0000 7f601d2d6640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6018155990 con 0x7f60181401c0 2023-11-28T18:38:07.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.722+0000 7f601d2d6640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6018155c70 con 0x7f60180704a0 2023-11-28T18:38:07.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.722+0000 7f6016ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f601806c300 0x7f6018136e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:07.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.722+0000 7f6016ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f601806c300 0x7f6018136e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53526/0 (socket says 172.21.15.45:53526) 2023-11-28T18:38:07.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.722+0000 7f6016ffd640 1 -- 172.21.15.45:0/3692965777 learned_addr learned my addr 172.21.15.45:0/3692965777 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:07.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.722+0000 7f60177fe640 1 --2- 172.21.15.45:0/3692965777 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f60181401c0 0x7f601815ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:07.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.722+0000 7f600ffff640 1 --2- 172.21.15.45:0/3692965777 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f60180704a0 0x7f601813f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:07.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.722+0000 7f6016ffd640 1 -- 172.21.15.45:0/3692965777 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f60180704a0 msgr2=0x7f601813f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:07.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.722+0000 7f6016ffd640 1 --2- 172.21.15.45:0/3692965777 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f60180704a0 0x7f601813f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:07.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.722+0000 7f6016ffd640 1 -- 172.21.15.45:0/3692965777 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f60181401c0 msgr2=0x7f601815ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:07.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.722+0000 7f6016ffd640 1 --2- 172.21.15.45:0/3692965777 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f60181401c0 0x7f601815ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:07.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.722+0000 7f6016ffd640 1 -- 172.21.15.45:0/3692965777 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6008009420 con 0x7f601806c300 2023-11-28T18:38:07.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.722+0000 7f60177fe640 1 --2- 172.21.15.45:0/3692965777 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f60181401c0 0x7f601815ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:38:07.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.722+0000 7f600ffff640 1 --2- 172.21.15.45:0/3692965777 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f60180704a0 0x7f601813f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:38:07.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.722+0000 7f6016ffd640 1 --2- 172.21.15.45:0/3692965777 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f601806c300 0x7f6018136e60 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6008018fb0 tx=0x7f600801abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:07.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.722+0000 7f600f7fe640 1 -- 172.21.15.45:0/3692965777 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60080b7620 con 0x7f601806c300 2023-11-28T18:38:07.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.722+0000 7f600f7fe640 1 -- 172.21.15.45:0/3692965777 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60080b7780 con 0x7f601806c300 2023-11-28T18:38:07.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.722+0000 7f600f7fe640 1 -- 172.21.15.45:0/3692965777 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60080b7af0 con 0x7f601806c300 2023-11-28T18:38:07.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.726+0000 7f601d2d6640 1 -- 172.21.15.45:0/3692965777 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6018155f50 con 0x7f601806c300 2023-11-28T18:38:07.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.726+0000 7f601d2d6640 1 -- 172.21.15.45:0/3692965777 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60181572d0 con 0x7f601806c300 2023-11-28T18:38:07.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.726+0000 7f601d2d6640 1 -- 172.21.15.45:0/3692965777 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6018069480 con 0x7f601806c300 2023-11-28T18:38:07.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.726+0000 7f600f7fe640 1 -- 172.21.15.45:0/3692965777 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f60080b3040 con 0x7f601806c300 2023-11-28T18:38:07.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.726+0000 7f600f7fe640 1 --2- 172.21.15.45:0/3692965777 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f5ff80668d0 0x7f5ff8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:07.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.726+0000 7f600f7fe640 1 -- 172.21.15.45:0/3692965777 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f600811ea20 con 0x7f601806c300 2023-11-28T18:38:07.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.726+0000 7f600ffff640 1 --2- 172.21.15.45:0/3692965777 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f5ff80668d0 0x7f5ff8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:07.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.726+0000 7f600ffff640 1 --2- 172.21.15.45:0/3692965777 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f5ff80668d0 0x7f5ff8068d90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f60181373a0 tx=0x7f6000008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:07.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.730+0000 7f600f7fe640 1 -- 172.21.15.45:0/3692965777 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f60080ebbc0 con 0x7f601806c300 2023-11-28T18:38:07.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.886+0000 7f601d2d6640 1 -- 172.21.15.45:0/3692965777 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6018141a70 con 0x7f601806c300 2023-11-28T18:38:07.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.890+0000 7f600f7fe640 1 -- 172.21.15.45:0/3692965777 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16469 (secure 0 0 0) 0x7f60080ef1e0 con 0x7f601806c300 2023-11-28T18:38:07.891 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:38:07.891 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":20,"fsid":"d10f5cd6-1d00-4019-99b6-6fa435498a15","created":"2023-11-28T18:37:08.189030+0000","modified":"2023-11-28T18:37:33.971141+0000","last_up_change":"2023-11-28T18:37:20.196124+0000","last_in_change":"2023-11-28T18:37:10.742043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T18:37:21.293917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T18:37:31.384760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T18:37:31.834769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"84465384-103c-4f2c-a45a-96f5bb9c835f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6809","nonce":555237322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6811","nonce":555237322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6815","nonce":555237322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6813","nonce":555237322}]},"public_addr":"172.21.15.45:6809/555237322","cluster_addr":"172.21.15.45:6811/555237322","heartbeat_back_addr":"172.21.15.45:6815/555237322","heartbeat_front_addr":"172.21.15.45:6813/555237322","state":["exists","up"]},{"osd":1,"uuid":"7d9eed24-a58f-42c7-a787-ac06be8553fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6801","nonce":2857063763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6803","nonce":2857063763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6807","nonce":2857063763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6805","nonce":2857063763}]},"public_addr":"172.21.15.45:6801/2857063763","cluster_addr":"172.21.15.45:6803/2857063763","heartbeat_back_addr":"172.21.15.45:6807/2857063763","heartbeat_front_addr":"172.21.15.45:6805/2857063763","state":["exists","up"]},{"osd":2,"uuid":"575eeccc-4abf-45b4-9caf-f3e797859588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6817","nonce":193884539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6819","nonce":193884539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6823","nonce":193884539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6821","nonce":193884539}]},"public_addr":"172.21.15.45:6817/193884539","cluster_addr":"172.21.15.45:6819/193884539","heartbeat_back_addr":"172.21.15.45:6823/193884539","heartbeat_front_addr":"172.21.15.45:6821/193884539","state":["exists","up"]},{"osd":3,"uuid":"9b0290d6-9a52-4bc8-b2a1-7622c5dc8e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6825","nonce":78541084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6827","nonce":78541084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6831","nonce":78541084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6829","nonce":78541084}]},"public_addr":"172.21.15.45:6825/78541084","cluster_addr":"172.21.15.45:6827/78541084","heartbeat_back_addr":"172.21.15.45:6831/78541084","heartbeat_front_addr":"172.21.15.45:6829/78541084","state":["exists","up"]},{"osd":4,"uuid":"ce632829-f027-4fbf-a627-02c571aa9d53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6809","nonce":1537591987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6811","nonce":1537591987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6815","nonce":1537591987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6813","nonce":1537591987}]},"public_addr":"172.21.15.190:6809/1537591987","cluster_addr":"172.21.15.190:6811/1537591987","heartbeat_back_addr":"172.21.15.190:6815/1537591987","heartbeat_front_addr":"172.21.15.190:6813/1537591987","state":["exists","up"]},{"osd":5,"uuid":"8700b609-27be-40bd-a251-4c0ae0a29ead","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6801","nonce":3296698407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6803","nonce":3296698407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6807","nonce":3296698407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6805","nonce":3296698407}]},"public_addr":"172.21.15.190:6801/3296698407","cluster_addr":"172.21.15.190:6803/3296698407","heartbeat_back_addr":"172.21.15.190:6807/3296698407","heartbeat_front_addr":"172.21.15.190:6805/3296698407","state":["exists","up"]},{"osd":6,"uuid":"44ce4a40-e6ff-4f4d-8e8a-7341e5c91f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6817","nonce":2317686718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6819","nonce":2317686718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6823","nonce":2317686718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6821","nonce":2317686718}]},"public_addr":"172.21.15.190:6817/2317686718","cluster_addr":"172.21.15.190:6819/2317686718","heartbeat_back_addr":"172.21.15.190:6823/2317686718","heartbeat_front_addr":"172.21.15.190:6821/2317686718","state":["exists","up"]},{"osd":7,"uuid":"192238c9-1423-4b7e-ac8f-84ba32113ddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6825","nonce":2493232051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6827","nonce":2493232051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6831","nonce":2493232051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6829","nonce":2493232051}]},"public_addr":"172.21.15.190:6825/2493232051","cluster_addr":"172.21.15.190:6827/2493232051","heartbeat_back_addr":"172.21.15.190:6831/2493232051","heartbeat_front_addr":"172.21.15.190:6829/2493232051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.393552+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.385453+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.361421+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.366408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.363226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.276007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.414605+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.445885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T18:38:07.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.890+0000 7f601d2d6640 1 -- 172.21.15.45:0/3692965777 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f5ff80668d0 msgr2=0x7f5ff8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:07.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.890+0000 7f601d2d6640 1 --2- 172.21.15.45:0/3692965777 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f5ff80668d0 0x7f5ff8068d90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f60181373a0 tx=0x7f6000008040 comp rx=0 tx=0).stop 2023-11-28T18:38:07.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.890+0000 7f601d2d6640 1 -- 172.21.15.45:0/3692965777 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f601806c300 msgr2=0x7f6018136e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:07.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.890+0000 7f601d2d6640 1 --2- 172.21.15.45:0/3692965777 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f601806c300 0x7f6018136e60 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6008018fb0 tx=0x7f600801abe0 comp rx=0 tx=0).stop 2023-11-28T18:38:07.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.890+0000 7f601d2d6640 1 -- 172.21.15.45:0/3692965777 shutdown_connections 2023-11-28T18:38:07.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.890+0000 7f601d2d6640 1 --2- 172.21.15.45:0/3692965777 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f5ff80668d0 0x7f5ff8068d90 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:07.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.890+0000 7f601d2d6640 1 --2- 172.21.15.45:0/3692965777 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f60181401c0 0x7f601815ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:07.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.890+0000 7f601d2d6640 1 --2- 172.21.15.45:0/3692965777 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f60180704a0 0x7f601813f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:07.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.890+0000 7f601d2d6640 1 --2- 172.21.15.45:0/3692965777 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f601806c300 0x7f6018136e60 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:07.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.890+0000 7f601d2d6640 1 -- 172.21.15.45:0/3692965777 >> 172.21.15.45:0/3692965777 conn(0x7f601806a570 msgr2=0x7f6018141360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:07.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.890+0000 7f601d2d6640 1 -- 172.21.15.45:0/3692965777 shutdown_connections 2023-11-28T18:38:07.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:07.890+0000 7f601d2d6640 1 -- 172.21.15.45:0/3692965777 wait complete. 2023-11-28T18:38:07.913 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T18:37:21.293917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T18:37:31.384760+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T18:37:31.834769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T18:38:07.913 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T18:38:08.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.058+0000 7f60014fe640 1 Processor -- start 2023-11-28T18:38:08.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.058+0000 7f60014fe640 1 -- start start 2023-11-28T18:38:08.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.058+0000 7f60014fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ffc0ae870 0x7f5ffc15d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:08.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.058+0000 7f60014fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5ffc15d750 0x7f5ffc0cd030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:08.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.058+0000 7f60014fe640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ffc1575f0 con 0x7f5ffc157210 2023-11-28T18:38:08.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.058+0000 7f60014fe640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ffc15dbe0 con 0x7f5ffc15d750 2023-11-28T18:38:08.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.058+0000 7f60014fe640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ffc0713d0 con 0x7f5ffc0ae870 2023-11-28T18:38:08.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.058+0000 7f5ffb7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5ffc15d750 0x7f5ffc0cd030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:08.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.058+0000 7f5ffb7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5ffc15d750 0x7f5ffc0cd030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53942/0 (socket says 172.21.15.45:53942) 2023-11-28T18:38:08.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.058+0000 7f5ffb7fe640 1 -- 172.21.15.45:0/1154590151 learned_addr learned my addr 172.21.15.45:0/1154590151 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:08.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.058+0000 7f5ff3fff640 1 --2- 172.21.15.45:0/1154590151 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ffc0ae870 0x7f5ffc15d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:08.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.058+0000 7f5ffb7fe640 1 -- 172.21.15.45:0/1154590151 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ffc0ae870 msgr2=0x7f5ffc15d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:08.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.058+0000 7f5ffb7fe640 1 --2- 172.21.15.45:0/1154590151 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ffc0ae870 0x7f5ffc15d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:08.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.058+0000 7f5ffb7fe640 1 -- 172.21.15.45:0/1154590151 >> v1:172.21.15.190:6789/0 conn(0x7f5ffc157210 legacy=0x7f5ffc070cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:08.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.058+0000 7f5ffb7fe640 1 -- 172.21.15.45:0/1154590151 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ffc071640 con 0x7f5ffc15d750 2023-11-28T18:38:08.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.062+0000 7f5ffb7fe640 1 --2- 172.21.15.45:0/1154590151 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ffc15d750 0x7f5ffc0cd030 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5ff400d150 tx=0x7f5ff401ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d2b7936ed98f0f1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:08.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.062+0000 7f5ffa7fc640 1 -- 172.21.15.45:0/1154590151 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff400b2d0 con 0x7f5ffc15d750 2023-11-28T18:38:08.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.062+0000 7f5ffa7fc640 1 -- 172.21.15.45:0/1154590151 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ff400b430 con 0x7f5ffc15d750 2023-11-28T18:38:08.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.062+0000 7f5ffa7fc640 1 -- 172.21.15.45:0/1154590151 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff40a7c80 con 0x7f5ffc15d750 2023-11-28T18:38:08.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.062+0000 7f60014fe640 1 -- 172.21.15.45:0/1154590151 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ffc15d750 msgr2=0x7f5ffc0cd030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:08.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.062+0000 7f60014fe640 1 --2- 172.21.15.45:0/1154590151 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ffc15d750 0x7f5ffc0cd030 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5ff400d150 tx=0x7f5ff401ec10 comp rx=0 tx=0).stop 2023-11-28T18:38:08.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.062+0000 7f60014fe640 1 -- 172.21.15.45:0/1154590151 shutdown_connections 2023-11-28T18:38:08.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.062+0000 7f60014fe640 1 --2- 172.21.15.45:0/1154590151 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ffc15d750 0x7f5ffc0cd030 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:08.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.062+0000 7f60014fe640 1 --2- 172.21.15.45:0/1154590151 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ffc0ae870 0x7f5ffc15d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:08.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.062+0000 7f60014fe640 1 -- 172.21.15.45:0/1154590151 >> 172.21.15.45:0/1154590151 conn(0x7f5ffc0b0d00 msgr2=0x7f5ffc0b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:08.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.062+0000 7f60014fe640 1 -- 172.21.15.45:0/1154590151 shutdown_connections 2023-11-28T18:38:08.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.062+0000 7f60014fe640 1 -- 172.21.15.45:0/1154590151 wait complete. 2023-11-28T18:38:08.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.066+0000 7f60014fe640 1 Processor -- start 2023-11-28T18:38:08.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.066+0000 7f60014fe640 1 -- start start 2023-11-28T18:38:08.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.066+0000 7f60014fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5ffc0ae870 0x7f5ffc0b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:08.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.066+0000 7f60014fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ffc157210 0x7f5ffc0b3560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:08.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.066+0000 7f60014fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ffc15d750 0x7f5ffc150f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:08.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.066+0000 7f60014fe640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ffc0b4300 con 0x7f5ffc15d750 2023-11-28T18:38:08.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.066+0000 7f60014fe640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ffc0b3190 con 0x7f5ffc0ae870 2023-11-28T18:38:08.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.066+0000 7f60014fe640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ffc0b3aa0 con 0x7f5ffc157210 2023-11-28T18:38:08.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.066+0000 7f5ffb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ffc15d750 0x7f5ffc150f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:08.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.066+0000 7f5ff3fff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ffc157210 0x7f5ffc0b3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:08.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.066+0000 7f5ffaffd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5ffc0ae870 0x7f5ffc0b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:08.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.066+0000 7f5ffb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ffc15d750 0x7f5ffc150f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53948/0 (socket says 172.21.15.45:53948) 2023-11-28T18:38:08.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.066+0000 7f5ffb7fe640 1 -- 172.21.15.45:0/3255445913 learned_addr learned my addr 172.21.15.45:0/3255445913 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:08.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.066+0000 7f5ffb7fe640 1 -- 172.21.15.45:0/3255445913 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ffc157210 msgr2=0x7f5ffc0b3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:08.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.066+0000 7f5ffb7fe640 1 --2- 172.21.15.45:0/3255445913 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ffc157210 0x7f5ffc0b3560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:08.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.066+0000 7f5ffb7fe640 1 -- 172.21.15.45:0/3255445913 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5ffc0ae870 msgr2=0x7f5ffc0b2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:08.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.066+0000 7f5ffb7fe640 1 --2- 172.21.15.45:0/3255445913 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5ffc0ae870 0x7f5ffc0b2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:08.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.066+0000 7f5ffb7fe640 1 -- 172.21.15.45:0/3255445913 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff400bd40 con 0x7f5ffc15d750 2023-11-28T18:38:08.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.066+0000 7f5ffb7fe640 1 --2- 172.21.15.45:0/3255445913 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ffc15d750 0x7f5ffc150f90 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5ff40b1040 tx=0x7f5ff401b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:08.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.066+0000 7f5ff37fe640 1 -- 172.21.15.45:0/3255445913 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff4009800 con 0x7f5ffc15d750 2023-11-28T18:38:08.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.066+0000 7f5ff37fe640 1 -- 172.21.15.45:0/3255445913 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ff40099a0 con 0x7f5ffc15d750 2023-11-28T18:38:08.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.066+0000 7f5ff37fe640 1 -- 172.21.15.45:0/3255445913 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff4009d50 con 0x7f5ffc15d750 2023-11-28T18:38:08.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.066+0000 7f60014fe640 1 -- 172.21.15.45:0/3255445913 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ffc0b3d40 con 0x7f5ffc15d750 2023-11-28T18:38:08.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.066+0000 7f60014fe640 1 -- 172.21.15.45:0/3255445913 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ffc0b2450 con 0x7f5ffc15d750 2023-11-28T18:38:08.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.070+0000 7f60014fe640 1 -- 172.21.15.45:0/3255445913 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ffc069410 con 0x7f5ffc15d750 2023-11-28T18:38:08.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.070+0000 7f5ff37fe640 1 -- 172.21.15.45:0/3255445913 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f5ff40c3460 con 0x7f5ffc15d750 2023-11-28T18:38:08.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.070+0000 7f5ff37fe640 1 --2- 172.21.15.45:0/3255445913 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f5fdc0668d0 0x7f5fdc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:08.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.070+0000 7f5ff37fe640 1 -- 172.21.15.45:0/3255445913 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5ff411f940 con 0x7f5ffc15d750 2023-11-28T18:38:08.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.070+0000 7f5ffaffd640 1 --2- 172.21.15.45:0/3255445913 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f5fdc0668d0 0x7f5fdc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:08.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.070+0000 7f5ffaffd640 1 --2- 172.21.15.45:0/3255445913 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f5fdc0668d0 0x7f5fdc068d90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc153700 tx=0x7f5fec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:08.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.074+0000 7f5ff37fe640 1 -- 172.21.15.45:0/3255445913 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5ff40ecc10 con 0x7f5ffc15d750 2023-11-28T18:38:08.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.234+0000 7f60014fe640 1 -- 172.21.15.45:0/3255445913 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5ffc0b2230 con 0x7f5ffc15d750 2023-11-28T18:38:08.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.234+0000 7f5ff37fe640 1 -- 172.21.15.45:0/3255445913 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5ff40f0230 con 0x7f5ffc15d750 2023-11-28T18:38:08.236 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-11-28T18:38:08.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.234+0000 7f60014fe640 1 -- 172.21.15.45:0/3255445913 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f5fdc0668d0 msgr2=0x7f5fdc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:08.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.234+0000 7f60014fe640 1 --2- 172.21.15.45:0/3255445913 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f5fdc0668d0 0x7f5fdc068d90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc153700 tx=0x7f5fec009040 comp rx=0 tx=0).stop 2023-11-28T18:38:08.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.234+0000 7f60014fe640 1 -- 172.21.15.45:0/3255445913 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ffc15d750 msgr2=0x7f5ffc150f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:08.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.234+0000 7f60014fe640 1 --2- 172.21.15.45:0/3255445913 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ffc15d750 0x7f5ffc150f90 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5ff40b1040 tx=0x7f5ff401b9b0 comp rx=0 tx=0).stop 2023-11-28T18:38:08.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.234+0000 7f60014fe640 1 -- 172.21.15.45:0/3255445913 shutdown_connections 2023-11-28T18:38:08.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.234+0000 7f60014fe640 1 --2- 172.21.15.45:0/3255445913 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f5fdc0668d0 0x7f5fdc068d90 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:08.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.234+0000 7f60014fe640 1 --2- 172.21.15.45:0/3255445913 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ffc15d750 0x7f5ffc150f90 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:08.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.234+0000 7f60014fe640 1 --2- 172.21.15.45:0/3255445913 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ffc157210 0x7f5ffc0b3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:08.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.234+0000 7f60014fe640 1 --2- 172.21.15.45:0/3255445913 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5ffc0ae870 0x7f5ffc0b2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:08.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.234+0000 7f60014fe640 1 -- 172.21.15.45:0/3255445913 >> 172.21.15.45:0/3255445913 conn(0x7f5ffc0b0d00 msgr2=0x7f5ffc0b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:08.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.234+0000 7f60014fe640 1 -- 172.21.15.45:0/3255445913 shutdown_connections 2023-11-28T18:38:08.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.234+0000 7f60014fe640 1 -- 172.21.15.45:0/3255445913 wait complete. 2023-11-28T18:38:08.257 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T18:38:08.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.402+0000 7f80e205f640 1 Processor -- start 2023-11-28T18:38:08.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.402+0000 7f80e205f640 1 -- start start 2023-11-28T18:38:08.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.402+0000 7f80e205f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f80dc0cba50 0x7f80dc15be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:08.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.402+0000 7f80e205f640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80dc15b6b0 con 0x7f80dc158ce0 2023-11-28T18:38:08.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.402+0000 7f80e205f640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80dc15f450 con 0x7f80dc0b4310 2023-11-28T18:38:08.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.402+0000 7f80e205f640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80dc15f730 con 0x7f80dc0cba50 2023-11-28T18:38:08.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.402+0000 7f80daffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f80dc0cba50 0x7f80dc15be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:08.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.402+0000 7f80daffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f80dc0cba50 0x7f80dc15be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53952/0 (socket says 172.21.15.45:53952) 2023-11-28T18:38:08.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.402+0000 7f80daffd640 1 -- 172.21.15.45:0/281908277 learned_addr learned my addr 172.21.15.45:0/281908277 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:08.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.402+0000 7f80db7fe640 1 --1- 172.21.15.45:0/281908277 >> v1:172.21.15.45:6789/0 conn(0x7f80dc158ce0 0x7f80dc15eb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45730/0 (socket says 172.21.15.45:45730) 2023-11-28T18:38:08.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.402+0000 7f80daffd640 1 -- 172.21.15.45:0/281908277 >> v1:172.21.15.190:6789/0 conn(0x7f80dc0b4310 legacy=0x7f80dc070430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:08.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.402+0000 7f80daffd640 1 -- 172.21.15.45:0/281908277 >> v1:172.21.15.45:6789/0 conn(0x7f80dc158ce0 legacy=0x7f80dc15eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:08.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.402+0000 7f80daffd640 1 -- 172.21.15.45:0/281908277 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80dc15b920 con 0x7f80dc0cba50 2023-11-28T18:38:08.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.406+0000 7f80daffd640 1 --2- 172.21.15.45:0/281908277 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80dc0cba50 0x7f80dc15be40 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f80d0009870 tx=0x7f80d001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c334dfaefbc28e4f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:08.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.406+0000 7f80da7fc640 1 -- 172.21.15.45:0/281908277 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d00ab610 con 0x7f80dc0cba50 2023-11-28T18:38:08.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.406+0000 7f80da7fc640 1 -- 172.21.15.45:0/281908277 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80d00ab770 con 0x7f80dc0cba50 2023-11-28T18:38:08.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.406+0000 7f80da7fc640 1 -- 172.21.15.45:0/281908277 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d00abb00 con 0x7f80dc0cba50 2023-11-28T18:38:08.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.406+0000 7f80e205f640 1 -- 172.21.15.45:0/281908277 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80dc0cba50 msgr2=0x7f80dc15be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:08.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.406+0000 7f80e205f640 1 --2- 172.21.15.45:0/281908277 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80dc0cba50 0x7f80dc15be40 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f80d0009870 tx=0x7f80d001c500 comp rx=0 tx=0).stop 2023-11-28T18:38:08.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.406+0000 7f80e205f640 1 -- 172.21.15.45:0/281908277 shutdown_connections 2023-11-28T18:38:08.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.406+0000 7f80e205f640 1 --2- 172.21.15.45:0/281908277 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80dc0cba50 0x7f80dc15be40 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:08.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.406+0000 7f80e205f640 1 -- 172.21.15.45:0/281908277 >> 172.21.15.45:0/281908277 conn(0x7f80dc0b0d00 msgr2=0x7f80dc0b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:08.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.406+0000 7f80e205f640 1 -- 172.21.15.45:0/281908277 shutdown_connections 2023-11-28T18:38:08.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.406+0000 7f80e205f640 1 -- 172.21.15.45:0/281908277 wait complete. 2023-11-28T18:38:08.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.410+0000 7f80e205f640 1 Processor -- start 2023-11-28T18:38:08.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.410+0000 7f80e205f640 1 -- start start 2023-11-28T18:38:08.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.410+0000 7f80e205f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f80dc0b4310 0x7f80dc14c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:08.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.410+0000 7f80e205f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80dc0cba50 0x7f80dc150ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:08.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.410+0000 7f80e205f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f80dc158ce0 0x7f80dc151b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:08.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.410+0000 7f80e205f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80dc14c9f0 con 0x7f80dc0cba50 2023-11-28T18:38:08.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.410+0000 7f80e205f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80dc0ae520 con 0x7f80dc0b4310 2023-11-28T18:38:08.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.410+0000 7f80e205f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80dc150a50 con 0x7f80dc158ce0 2023-11-28T18:38:08.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.410+0000 7f80daffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80dc0cba50 0x7f80dc150ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:08.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.410+0000 7f80daffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80dc0cba50 0x7f80dc150ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53954/0 (socket says 172.21.15.45:53954) 2023-11-28T18:38:08.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.410+0000 7f80daffd640 1 -- 172.21.15.45:0/1967048759 learned_addr learned my addr 172.21.15.45:0/1967048759 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:08.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.410+0000 7f80db7fe640 1 --2- 172.21.15.45:0/1967048759 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f80dc0b4310 0x7f80dc14c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:08.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.410+0000 7f80dbfff640 1 --2- 172.21.15.45:0/1967048759 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f80dc158ce0 0x7f80dc151b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:08.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.410+0000 7f80daffd640 1 -- 172.21.15.45:0/1967048759 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f80dc158ce0 msgr2=0x7f80dc151b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:08.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.410+0000 7f80daffd640 1 --2- 172.21.15.45:0/1967048759 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f80dc158ce0 0x7f80dc151b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:08.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.410+0000 7f80daffd640 1 -- 172.21.15.45:0/1967048759 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f80dc0b4310 msgr2=0x7f80dc14c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:08.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.410+0000 7f80daffd640 1 --2- 172.21.15.45:0/1967048759 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f80dc0b4310 0x7f80dc14c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:08.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.410+0000 7f80daffd640 1 -- 172.21.15.45:0/1967048759 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d00094d0 con 0x7f80dc0cba50 2023-11-28T18:38:08.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.410+0000 7f80daffd640 1 --2- 172.21.15.45:0/1967048759 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80dc0cba50 0x7f80dc150ee0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f80d00ad040 tx=0x7f80d001ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:08.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.410+0000 7f80c3fff640 1 -- 172.21.15.45:0/1967048759 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d00b4800 con 0x7f80dc0cba50 2023-11-28T18:38:08.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.410+0000 7f80c3fff640 1 -- 172.21.15.45:0/1967048759 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80d00b4960 con 0x7f80dc0cba50 2023-11-28T18:38:08.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.410+0000 7f80c3fff640 1 -- 172.21.15.45:0/1967048759 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d00b4d10 con 0x7f80dc0cba50 2023-11-28T18:38:08.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.410+0000 7f80e205f640 1 -- 172.21.15.45:0/1967048759 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80dc1546d0 con 0x7f80dc0cba50 2023-11-28T18:38:08.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.410+0000 7f80e205f640 1 -- 172.21.15.45:0/1967048759 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80dc1506e0 con 0x7f80dc0cba50 2023-11-28T18:38:08.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.414+0000 7f80e205f640 1 -- 172.21.15.45:0/1967048759 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80dc150540 con 0x7f80dc0cba50 2023-11-28T18:38:08.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.414+0000 7f80c3fff640 1 -- 172.21.15.45:0/1967048759 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f80d00c83a0 con 0x7f80dc0cba50 2023-11-28T18:38:08.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.414+0000 7f80c3fff640 1 --2- 172.21.15.45:0/1967048759 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f80c80668d0 0x7f80c8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:08.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.414+0000 7f80c3fff640 1 -- 172.21.15.45:0/1967048759 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f80d011ee80 con 0x7f80dc0cba50 2023-11-28T18:38:08.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.414+0000 7f80db7fe640 1 --2- 172.21.15.45:0/1967048759 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f80c80668d0 0x7f80c8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:08.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.414+0000 7f80db7fe640 1 --2- 172.21.15.45:0/1967048759 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f80c80668d0 0x7f80c8068d90 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f80cc000f70 tx=0x7f80cc007cb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:08.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.418+0000 7f80c3fff640 1 -- 172.21.15.45:0/1967048759 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f80dc150540 con 0x7f80dc0cba50 2023-11-28T18:38:08.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.574+0000 7f80e205f640 1 -- 172.21.15.45:0/1967048759 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f80dc150540 con 0x7f80dc0cba50 2023-11-28T18:38:08.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.574+0000 7f80c3fff640 1 -- 172.21.15.45:0/1967048759 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f80dc150540 con 0x7f80dc0cba50 2023-11-28T18:38:08.578 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-11-28T18:38:08.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.578+0000 7f80e205f640 1 -- 172.21.15.45:0/1967048759 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f80c80668d0 msgr2=0x7f80c8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:08.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.578+0000 7f80e205f640 1 --2- 172.21.15.45:0/1967048759 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f80c80668d0 0x7f80c8068d90 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f80cc000f70 tx=0x7f80cc007cb0 comp rx=0 tx=0).stop 2023-11-28T18:38:08.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.578+0000 7f80e205f640 1 -- 172.21.15.45:0/1967048759 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80dc0cba50 msgr2=0x7f80dc150ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:08.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.578+0000 7f80e205f640 1 --2- 172.21.15.45:0/1967048759 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80dc0cba50 0x7f80dc150ee0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f80d00ad040 tx=0x7f80d001ad40 comp rx=0 tx=0).stop 2023-11-28T18:38:08.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.578+0000 7f80e205f640 1 -- 172.21.15.45:0/1967048759 shutdown_connections 2023-11-28T18:38:08.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.578+0000 7f80e205f640 1 --2- 172.21.15.45:0/1967048759 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f80c80668d0 0x7f80c8068d90 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:08.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.578+0000 7f80e205f640 1 --2- 172.21.15.45:0/1967048759 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f80dc158ce0 0x7f80dc151b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:08.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.578+0000 7f80e205f640 1 --2- 172.21.15.45:0/1967048759 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80dc0cba50 0x7f80dc150ee0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:08.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.578+0000 7f80e205f640 1 --2- 172.21.15.45:0/1967048759 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f80dc0b4310 0x7f80dc14c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:08.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.578+0000 7f80e205f640 1 -- 172.21.15.45:0/1967048759 >> 172.21.15.45:0/1967048759 conn(0x7f80dc0b0d00 msgr2=0x7f80dc0b10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:08.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.578+0000 7f80e205f640 1 -- 172.21.15.45:0/1967048759 shutdown_connections 2023-11-28T18:38:08.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.578+0000 7f80e205f640 1 -- 172.21.15.45:0/1967048759 wait complete. 2023-11-28T18:38:08.599 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T18:38:08.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.742+0000 7f4113b96640 1 Processor -- start 2023-11-28T18:38:08.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.742+0000 7f4113b96640 1 -- start start 2023-11-28T18:38:08.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.746+0000 7f4113b96640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f410c15d2f0 0x7f410c0d17f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:08.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.746+0000 7f4113b96640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f410c0d1d30 0x7f410c0cfc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:08.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.746+0000 7f4113b96640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f410c0aff70 con 0x7f410c15d6d0 2023-11-28T18:38:08.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.746+0000 7f4113b96640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f410c0b0210 con 0x7f410c15d2f0 2023-11-28T18:38:08.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.746+0000 7f4113b96640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f410c0b04f0 con 0x7f410c0d1d30 2023-11-28T18:38:08.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.746+0000 7f4111932640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f410c15d2f0 0x7f410c0d17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:08.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.746+0000 7f4112133640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f410c15d6d0 0x7f410c0cddb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45742/0 (socket says 172.21.15.45:45742) 2023-11-28T18:38:08.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.746+0000 7f4112133640 1 -- 172.21.15.45:0/1391543752 learned_addr learned my addr 172.21.15.45:0/1391543752 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:38:08.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.746+0000 7f4111131640 1 --2- 172.21.15.45:0/1391543752 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f410c0d1d30 0x7f410c0cfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:08.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.746+0000 7f4111932640 1 -- 172.21.15.45:0/1391543752 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f410c0d1d30 msgr2=0x7f410c0cfc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:08.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.746+0000 7f4111932640 1 --2- 172.21.15.45:0/1391543752 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f410c0d1d30 0x7f410c0cfc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:08.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.746+0000 7f4111932640 1 -- 172.21.15.45:0/1391543752 >> v1:172.21.15.45:6789/0 conn(0x7f410c15d6d0 legacy=0x7f410c0cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:08.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.746+0000 7f4111932640 1 -- 172.21.15.45:0/1391543752 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f410c0b07d0 con 0x7f410c15d2f0 2023-11-28T18:38:08.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.750+0000 7f4111932640 1 --2- 172.21.15.45:0/1391543752 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f410c15d2f0 0x7f410c0d17f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f41080097c0 tx=0x7f410801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c10fd930eabbf00a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:08.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.750+0000 7f4110930640 1 -- 172.21.15.45:0/1391543752 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41080ab620 con 0x7f410c15d2f0 2023-11-28T18:38:08.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.750+0000 7f4110930640 1 -- 172.21.15.45:0/1391543752 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41080ab780 con 0x7f410c15d2f0 2023-11-28T18:38:08.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.750+0000 7f4110930640 1 -- 172.21.15.45:0/1391543752 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41080abb10 con 0x7f410c15d2f0 2023-11-28T18:38:08.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.750+0000 7f4113b96640 1 -- 172.21.15.45:0/1391543752 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f410c15d2f0 msgr2=0x7f410c0d17f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:08.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.750+0000 7f4113b96640 1 --2- 172.21.15.45:0/1391543752 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f410c15d2f0 0x7f410c0d17f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f41080097c0 tx=0x7f410801c480 comp rx=0 tx=0).stop 2023-11-28T18:38:08.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.750+0000 7f4113b96640 1 -- 172.21.15.45:0/1391543752 shutdown_connections 2023-11-28T18:38:08.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.750+0000 7f4113b96640 1 --2- 172.21.15.45:0/1391543752 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f410c0d1d30 0x7f410c0cfc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:08.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.750+0000 7f4113b96640 1 --2- 172.21.15.45:0/1391543752 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f410c15d2f0 0x7f410c0d17f0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:08.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.750+0000 7f4113b96640 1 -- 172.21.15.45:0/1391543752 >> 172.21.15.45:0/1391543752 conn(0x7f410c09c550 msgr2=0x7f410c0d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:08.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.750+0000 7f4113b96640 1 -- 172.21.15.45:0/1391543752 shutdown_connections 2023-11-28T18:38:08.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.750+0000 7f4113b96640 1 -- 172.21.15.45:0/1391543752 wait complete. 2023-11-28T18:38:08.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.750+0000 7f4113b96640 1 Processor -- start 2023-11-28T18:38:08.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.750+0000 7f4113b96640 1 -- start start 2023-11-28T18:38:08.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.754+0000 7f4113b96640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f410c0d1d30 0x7f410c15dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:08.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.754+0000 7f4113b96640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f410c15d2f0 0x7f410c15e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:08.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.754+0000 7f4113b96640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f410c15d6d0 0x7f410c154a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:08.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.754+0000 7f4113b96640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f410c15bb90 con 0x7f410c15d6d0 2023-11-28T18:38:08.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.754+0000 7f4113b96640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f410c15be70 con 0x7f410c0d1d30 2023-11-28T18:38:08.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.754+0000 7f4113b96640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f410c15c150 con 0x7f410c15d2f0 2023-11-28T18:38:08.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.754+0000 7f4112133640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f410c15d6d0 0x7f410c154a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:08.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.754+0000 7f4112133640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f410c15d6d0 0x7f410c154a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53976/0 (socket says 172.21.15.45:53976) 2023-11-28T18:38:08.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.754+0000 7f4112133640 1 -- 172.21.15.45:0/1169978040 learned_addr learned my addr 172.21.15.45:0/1169978040 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:08.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.754+0000 7f4111131640 1 --2- 172.21.15.45:0/1169978040 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f410c15d2f0 0x7f410c15e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:08.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.754+0000 7f4111932640 1 --2- 172.21.15.45:0/1169978040 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f410c0d1d30 0x7f410c15dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:08.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.754+0000 7f4112133640 1 -- 172.21.15.45:0/1169978040 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f410c15d2f0 msgr2=0x7f410c15e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:08.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.754+0000 7f4112133640 1 --2- 172.21.15.45:0/1169978040 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f410c15d2f0 0x7f410c15e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:08.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.754+0000 7f4112133640 1 -- 172.21.15.45:0/1169978040 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f410c0d1d30 msgr2=0x7f410c15dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:08.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.754+0000 7f4112133640 1 --2- 172.21.15.45:0/1169978040 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f410c0d1d30 0x7f410c15dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:08.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.754+0000 7f4112133640 1 -- 172.21.15.45:0/1169978040 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4108009420 con 0x7f410c15d6d0 2023-11-28T18:38:08.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.754+0000 7f4112133640 1 --2- 172.21.15.45:0/1169978040 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f410c15d6d0 0x7f410c154a40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f410400ca80 tx=0x7f410400cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:08.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.754+0000 7f41027fc640 1 -- 172.21.15.45:0/1169978040 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f410400ac30 con 0x7f410c15d6d0 2023-11-28T18:38:08.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.754+0000 7f41027fc640 1 -- 172.21.15.45:0/1169978040 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f410400ad90 con 0x7f410c15d6d0 2023-11-28T18:38:08.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.754+0000 7f41027fc640 1 -- 172.21.15.45:0/1169978040 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4104012600 con 0x7f410c15d6d0 2023-11-28T18:38:08.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.754+0000 7f4113b96640 1 -- 172.21.15.45:0/1169978040 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f410c15c430 con 0x7f410c15d6d0 2023-11-28T18:38:08.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.754+0000 7f4113b96640 1 -- 172.21.15.45:0/1169978040 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f410c15b840 con 0x7f410c15d6d0 2023-11-28T18:38:08.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.754+0000 7f4113b96640 1 -- 172.21.15.45:0/1169978040 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f410c067a30 con 0x7f410c15d6d0 2023-11-28T18:38:08.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.754+0000 7f41027fc640 1 -- 172.21.15.45:0/1169978040 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f4104007070 con 0x7f410c15d6d0 2023-11-28T18:38:08.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.758+0000 7f41027fc640 1 --2- 172.21.15.45:0/1169978040 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f40f00668d0 0x7f40f0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:08.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.758+0000 7f41027fc640 1 -- 172.21.15.45:0/1169978040 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4104084200 con 0x7f410c15d6d0 2023-11-28T18:38:08.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.758+0000 7f4111932640 1 --2- 172.21.15.45:0/1169978040 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f40f00668d0 0x7f40f0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:08.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.758+0000 7f4111932640 1 --2- 172.21.15.45:0/1169978040 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f40f00668d0 0x7f40f0068d90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f41080af000 tx=0x7f41080a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:08.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.762+0000 7f41027fc640 1 -- 172.21.15.45:0/1169978040 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f41040514e0 con 0x7f410c15d6d0 2023-11-28T18:38:08.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.918+0000 7f4113b96640 1 -- 172.21.15.45:0/1169978040 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f410c154760 con 0x7f410c15d6d0 2023-11-28T18:38:08.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.918+0000 7f41027fc640 1 -- 172.21.15.45:0/1169978040 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f410c154760 con 0x7f410c15d6d0 2023-11-28T18:38:08.922 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-11-28T18:38:08.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.922+0000 7f4113b96640 1 -- 172.21.15.45:0/1169978040 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f40f00668d0 msgr2=0x7f40f0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:08.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.922+0000 7f4113b96640 1 --2- 172.21.15.45:0/1169978040 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f40f00668d0 0x7f40f0068d90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f41080af000 tx=0x7f41080a7000 comp rx=0 tx=0).stop 2023-11-28T18:38:08.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.922+0000 7f4113b96640 1 -- 172.21.15.45:0/1169978040 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f410c15d6d0 msgr2=0x7f410c154a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:08.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.922+0000 7f4113b96640 1 --2- 172.21.15.45:0/1169978040 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f410c15d6d0 0x7f410c154a40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f410400ca80 tx=0x7f410400cf40 comp rx=0 tx=0).stop 2023-11-28T18:38:08.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.922+0000 7f4113b96640 1 -- 172.21.15.45:0/1169978040 shutdown_connections 2023-11-28T18:38:08.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.922+0000 7f4113b96640 1 --2- 172.21.15.45:0/1169978040 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f40f00668d0 0x7f40f0068d90 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:08.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.922+0000 7f4113b96640 1 --2- 172.21.15.45:0/1169978040 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f410c15d6d0 0x7f410c154a40 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:08.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.922+0000 7f4113b96640 1 --2- 172.21.15.45:0/1169978040 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f410c15d2f0 0x7f410c15e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:08.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.922+0000 7f4113b96640 1 --2- 172.21.15.45:0/1169978040 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f410c0d1d30 0x7f410c15dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:08.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.922+0000 7f4113b96640 1 -- 172.21.15.45:0/1169978040 >> 172.21.15.45:0/1169978040 conn(0x7f410c09c550 msgr2=0x7f410c0d0750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:08.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.922+0000 7f4113b96640 1 -- 172.21.15.45:0/1169978040 shutdown_connections 2023-11-28T18:38:08.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:08.922+0000 7f4113b96640 1 -- 172.21.15.45:0/1169978040 wait complete. 2023-11-28T18:38:08.944 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T18:38:09.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.086+0000 7ff561f1d640 1 Processor -- start 2023-11-28T18:38:09.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.086+0000 7ff561f1d640 1 -- start start 2023-11-28T18:38:09.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.090+0000 7ff561f1d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff55c0b35f0 0x7ff55c0d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:09.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.090+0000 7ff561f1d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff55c0b3cb0 0x7ff55c15f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:09.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.090+0000 7ff561f1d640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff55c0d38c0 con 0x7ff55c0cf7c0 2023-11-28T18:38:09.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.090+0000 7ff561f1d640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff55c0d40d0 con 0x7ff55c0b3cb0 2023-11-28T18:38:09.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.090+0000 7ff561f1d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff55c0cdcc0 con 0x7ff55c0b35f0 2023-11-28T18:38:09.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.090+0000 7ff55affd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff55c0b3cb0 0x7ff55c15f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:09.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.090+0000 7ff55b7fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff55c0b35f0 0x7ff55c0d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:09.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.090+0000 7ff55b7fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff55c0b35f0 0x7ff55c0d0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.45:60070/0 (socket says 172.21.15.45:60070) 2023-11-28T18:38:09.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.090+0000 7ff55affd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff55c0b3cb0 0x7ff55c15f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.45:41174/0 (socket says 172.21.15.45:41174) 2023-11-28T18:38:09.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.090+0000 7ff55b7fe640 1 -- 172.21.15.45:0/3853670820 learned_addr learned my addr 172.21.15.45:0/3853670820 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:09.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.090+0000 7ff55b7fe640 1 -- 172.21.15.45:0/3853670820 >> v2:172.21.15.190:3300/0 conn(0x7ff55c0b3cb0 msgr2=0x7ff55c15f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:09.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.090+0000 7ff55b7fe640 1 --2- 172.21.15.45:0/3853670820 >> v2:172.21.15.190:3300/0 conn(0x7ff55c0b3cb0 0x7ff55c15f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:09.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.090+0000 7ff55b7fe640 1 -- 172.21.15.45:0/3853670820 >> v1:172.21.15.190:6789/0 conn(0x7ff55c0cf7c0 legacy=0x7ff55c0ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:09.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.090+0000 7ff55b7fe640 1 -- 172.21.15.45:0/3853670820 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff55c0d3b10 con 0x7ff55c0b35f0 2023-11-28T18:38:09.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.094+0000 7ff55b7fe640 1 --2- 172.21.15.45:0/3853670820 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff55c0b35f0 0x7ff55c0d0f90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff54c009870 tx=0x7ff54c01c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17d9052bf2615cd5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:09.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.094+0000 7ff55a7fc640 1 -- 172.21.15.45:0/3853670820 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff54c0a9400 con 0x7ff55c0b35f0 2023-11-28T18:38:09.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.094+0000 7ff55a7fc640 1 -- 172.21.15.45:0/3853670820 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff54c0a9560 con 0x7ff55c0b35f0 2023-11-28T18:38:09.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.094+0000 7ff55a7fc640 1 -- 172.21.15.45:0/3853670820 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff54c0a98f0 con 0x7ff55c0b35f0 2023-11-28T18:38:09.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.094+0000 7ff561f1d640 1 -- 172.21.15.45:0/3853670820 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff55c0b35f0 msgr2=0x7ff55c0d0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:09.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.094+0000 7ff561f1d640 1 --2- 172.21.15.45:0/3853670820 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff55c0b35f0 0x7ff55c0d0f90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff54c009870 tx=0x7ff54c01c540 comp rx=0 tx=0).stop 2023-11-28T18:38:09.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.094+0000 7ff561f1d640 1 -- 172.21.15.45:0/3853670820 shutdown_connections 2023-11-28T18:38:09.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.094+0000 7ff561f1d640 1 --2- 172.21.15.45:0/3853670820 >> v2:172.21.15.190:3300/0 conn(0x7ff55c0b3cb0 0x7ff55c15f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:09.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.094+0000 7ff561f1d640 1 --2- 172.21.15.45:0/3853670820 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff55c0b35f0 0x7ff55c0d0f90 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:09.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.094+0000 7ff561f1d640 1 -- 172.21.15.45:0/3853670820 >> 172.21.15.45:0/3853670820 conn(0x7ff55c09c4f0 msgr2=0x7ff55c0d31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:09.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.094+0000 7ff561f1d640 1 -- 172.21.15.45:0/3853670820 shutdown_connections 2023-11-28T18:38:09.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.094+0000 7ff561f1d640 1 -- 172.21.15.45:0/3853670820 wait complete. 2023-11-28T18:38:09.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.094+0000 7ff561f1d640 1 Processor -- start 2023-11-28T18:38:09.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.094+0000 7ff561f1d640 1 -- start start 2023-11-28T18:38:09.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.098+0000 7ff561f1d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff55c0b35f0 0x7ff55c159020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:09.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.098+0000 7ff561f1d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff55c0b3cb0 0x7ff55c0ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:09.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.098+0000 7ff561f1d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff55c0cf7c0 0x7ff55c09e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:09.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.098+0000 7ff561f1d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff55c0712d0 con 0x7ff55c0cf7c0 2023-11-28T18:38:09.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.098+0000 7ff561f1d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff55c0a06a0 con 0x7ff55c0b3cb0 2023-11-28T18:38:09.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.098+0000 7ff561f1d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff55c159560 con 0x7ff55c0b35f0 2023-11-28T18:38:09.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.098+0000 7ff55bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff55c0cf7c0 0x7ff55c09e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:09.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.098+0000 7ff55bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff55c0cf7c0 0x7ff55c09e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53978/0 (socket says 172.21.15.45:53978) 2023-11-28T18:38:09.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.098+0000 7ff55bfff640 1 -- 172.21.15.45:0/2819392483 learned_addr learned my addr 172.21.15.45:0/2819392483 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:09.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.098+0000 7ff55affd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff55c0b3cb0 0x7ff55c0ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:09.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.098+0000 7ff55b7fe640 1 --2- 172.21.15.45:0/2819392483 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff55c0b35f0 0x7ff55c159020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:09.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.098+0000 7ff55bfff640 1 -- 172.21.15.45:0/2819392483 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff55c0b35f0 msgr2=0x7ff55c159020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:09.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.098+0000 7ff55bfff640 1 --2- 172.21.15.45:0/2819392483 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff55c0b35f0 0x7ff55c159020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:09.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.098+0000 7ff55bfff640 1 -- 172.21.15.45:0/2819392483 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff55c0b3cb0 msgr2=0x7ff55c0ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:09.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.098+0000 7ff55bfff640 1 --2- 172.21.15.45:0/2819392483 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff55c0b3cb0 0x7ff55c0ccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:09.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.098+0000 7ff55bfff640 1 -- 172.21.15.45:0/2819392483 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff54c0094d0 con 0x7ff55c0cf7c0 2023-11-28T18:38:09.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.098+0000 7ff55bfff640 1 --2- 172.21.15.45:0/2819392483 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff55c0cf7c0 0x7ff55c09e650 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff55400c730 tx=0x7ff55400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:09.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.098+0000 7ff543fff640 1 -- 172.21.15.45:0/2819392483 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff554003b80 con 0x7ff55c0cf7c0 2023-11-28T18:38:09.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.098+0000 7ff543fff640 1 -- 172.21.15.45:0/2819392483 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff554003ce0 con 0x7ff55c0cf7c0 2023-11-28T18:38:09.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.098+0000 7ff543fff640 1 -- 172.21.15.45:0/2819392483 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff554005310 con 0x7ff55c0cf7c0 2023-11-28T18:38:09.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.098+0000 7ff561f1d640 1 -- 172.21.15.45:0/2819392483 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff55c0d0160 con 0x7ff55c0cf7c0 2023-11-28T18:38:09.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.098+0000 7ff561f1d640 1 -- 172.21.15.45:0/2819392483 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff55c0a08d0 con 0x7ff55c0cf7c0 2023-11-28T18:38:09.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.098+0000 7ff561f1d640 1 -- 172.21.15.45:0/2819392483 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff55c069480 con 0x7ff55c0cf7c0 2023-11-28T18:38:09.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.102+0000 7ff543fff640 1 -- 172.21.15.45:0/2819392483 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ff554005680 con 0x7ff55c0cf7c0 2023-11-28T18:38:09.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.102+0000 7ff543fff640 1 --2- 172.21.15.45:0/2819392483 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff5480668d0 0x7ff548068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:09.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.102+0000 7ff543fff640 1 -- 172.21.15.45:0/2819392483 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff554084220 con 0x7ff55c0cf7c0 2023-11-28T18:38:09.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.102+0000 7ff55b7fe640 1 --2- 172.21.15.45:0/2819392483 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff5480668d0 0x7ff548068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:09.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.102+0000 7ff55b7fe640 1 --2- 172.21.15.45:0/2819392483 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff5480668d0 0x7ff548068d90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff54c0ae000 tx=0x7ff54c0b3040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:09.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.106+0000 7ff543fff640 1 -- 172.21.15.45:0/2819392483 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff5540514f0 con 0x7ff55c0cf7c0 2023-11-28T18:38:09.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.286+0000 7ff561f1d640 1 -- 172.21.15.45:0/2819392483 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff55c1683b0 con 0x7ff55c0cf7c0 2023-11-28T18:38:09.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.286+0000 7ff543fff640 1 -- 172.21.15.45:0/2819392483 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff554054b10 con 0x7ff55c0cf7c0 2023-11-28T18:38:09.290 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-11-28T18:38:09.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.290+0000 7ff561f1d640 1 -- 172.21.15.45:0/2819392483 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff5480668d0 msgr2=0x7ff548068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:09.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.290+0000 7ff561f1d640 1 --2- 172.21.15.45:0/2819392483 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff5480668d0 0x7ff548068d90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff54c0ae000 tx=0x7ff54c0b3040 comp rx=0 tx=0).stop 2023-11-28T18:38:09.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.290+0000 7ff561f1d640 1 -- 172.21.15.45:0/2819392483 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff55c0cf7c0 msgr2=0x7ff55c09e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:09.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.290+0000 7ff561f1d640 1 --2- 172.21.15.45:0/2819392483 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff55c0cf7c0 0x7ff55c09e650 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff55400c730 tx=0x7ff55400cbf0 comp rx=0 tx=0).stop 2023-11-28T18:38:09.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.290+0000 7ff561f1d640 1 -- 172.21.15.45:0/2819392483 shutdown_connections 2023-11-28T18:38:09.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.290+0000 7ff561f1d640 1 --2- 172.21.15.45:0/2819392483 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff5480668d0 0x7ff548068d90 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:09.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.290+0000 7ff561f1d640 1 --2- 172.21.15.45:0/2819392483 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff55c0cf7c0 0x7ff55c09e650 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:09.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.290+0000 7ff561f1d640 1 --2- 172.21.15.45:0/2819392483 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff55c0b3cb0 0x7ff55c0ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:09.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.290+0000 7ff561f1d640 1 --2- 172.21.15.45:0/2819392483 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff55c0b35f0 0x7ff55c159020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:09.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.290+0000 7ff561f1d640 1 -- 172.21.15.45:0/2819392483 >> 172.21.15.45:0/2819392483 conn(0x7ff55c09c4f0 msgr2=0x7ff55c0b07d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:09.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.290+0000 7ff561f1d640 1 -- 172.21.15.45:0/2819392483 shutdown_connections 2023-11-28T18:38:09.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.290+0000 7ff561f1d640 1 -- 172.21.15.45:0/2819392483 wait complete. 2023-11-28T18:38:09.311 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi045.front.sepia.ceph.com... 2023-11-28T18:38:09.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:38:09.311 DEBUG:teuthology.orchestra.run.smithi045:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-28T18:38:09.347 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T18:38:09.347 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi045.front.sepia.ceph.com 2023-11-28T18:38:09.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:38:09.347 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-28T18:38:09.402 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-28T18:38:09.403 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T18:38:09.412 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-28T18:38:09.413 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T18:38:09.462 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T18:38:09.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.602+0000 7fbbd72e3640 1 Processor -- start 2023-11-28T18:38:09.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.602+0000 7fbbd72e3640 1 -- start start 2023-11-28T18:38:09.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.602+0000 7fbbd72e3640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbbd013cf70 0x7fbbd006c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:09.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.606+0000 7fbbd72e3640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fbbd006c840 0x7fbbd015a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:09.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.606+0000 7fbbd72e3640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbd015b3e0 con 0x7fbbd015abb0 2023-11-28T18:38:09.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.606+0000 7fbbd72e3640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbd013d350 con 0x7fbbd013cf70 2023-11-28T18:38:09.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.606+0000 7fbbd72e3640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbd0140520 con 0x7fbbd006c840 2023-11-28T18:38:09.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.606+0000 7fbbd507f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbbd013cf70 0x7fbbd006c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:09.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.606+0000 7fbbd507f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbbd013cf70 0x7fbbd006c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53990/0 (socket says 172.21.15.45:53990) 2023-11-28T18:38:09.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.606+0000 7fbbd507f640 1 -- 172.21.15.45:0/3610014022 learned_addr learned my addr 172.21.15.45:0/3610014022 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:09.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.606+0000 7fbbd487e640 1 --2- 172.21.15.45:0/3610014022 >> v2:172.21.15.190:3300/0 conn(0x7fbbd006c840 0x7fbbd015a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:09.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.606+0000 7fbbd507f640 1 -- 172.21.15.45:0/3610014022 >> v2:172.21.15.190:3300/0 conn(0x7fbbd006c840 msgr2=0x7fbbd015a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:09.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.606+0000 7fbbd507f640 1 --2- 172.21.15.45:0/3610014022 >> v2:172.21.15.190:3300/0 conn(0x7fbbd006c840 0x7fbbd015a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:09.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.606+0000 7fbbd507f640 1 -- 172.21.15.45:0/3610014022 >> v1:172.21.15.45:6789/0 conn(0x7fbbd015abb0 legacy=0x7fbbd00715b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:09.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.606+0000 7fbbd507f640 1 -- 172.21.15.45:0/3610014022 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd013f760 con 0x7fbbd013cf70 2023-11-28T18:38:09.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.606+0000 7fbbd507f640 1 --2- 172.21.15.45:0/3610014022 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbd013cf70 0x7fbbd006c300 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fbbd00cc7d0 tx=0x7fbbcc01eb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aed21293083d5801 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:09.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.606+0000 7fbbc7fff640 1 -- 172.21.15.45:0/3610014022 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbcc0a7b00 con 0x7fbbd013cf70 2023-11-28T18:38:09.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.606+0000 7fbbc7fff640 1 -- 172.21.15.45:0/3610014022 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbcc0a7c60 con 0x7fbbd013cf70 2023-11-28T18:38:09.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.606+0000 7fbbc7fff640 1 -- 172.21.15.45:0/3610014022 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbcc0af440 con 0x7fbbd013cf70 2023-11-28T18:38:09.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.610+0000 7fbbd72e3640 1 -- 172.21.15.45:0/3610014022 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbd013cf70 msgr2=0x7fbbd006c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:09.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.610+0000 7fbbd72e3640 1 --2- 172.21.15.45:0/3610014022 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbd013cf70 0x7fbbd006c300 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fbbd00cc7d0 tx=0x7fbbcc01eb40 comp rx=0 tx=0).stop 2023-11-28T18:38:09.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.610+0000 7fbbd72e3640 1 -- 172.21.15.45:0/3610014022 shutdown_connections 2023-11-28T18:38:09.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.610+0000 7fbbd72e3640 1 --2- 172.21.15.45:0/3610014022 >> v2:172.21.15.190:3300/0 conn(0x7fbbd006c840 0x7fbbd015a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:09.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.610+0000 7fbbd72e3640 1 --2- 172.21.15.45:0/3610014022 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbd013cf70 0x7fbbd006c300 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:09.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.610+0000 7fbbd72e3640 1 -- 172.21.15.45:0/3610014022 >> 172.21.15.45:0/3610014022 conn(0x7fbbd006a570 msgr2=0x7fbbd006a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:09.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.610+0000 7fbbd72e3640 1 -- 172.21.15.45:0/3610014022 shutdown_connections 2023-11-28T18:38:09.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.610+0000 7fbbd72e3640 1 -- 172.21.15.45:0/3610014022 wait complete. 2023-11-28T18:38:09.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.610+0000 7fbbd72e3640 1 Processor -- start 2023-11-28T18:38:09.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.610+0000 7fbbd72e3640 1 -- start start 2023-11-28T18:38:09.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.610+0000 7fbbd72e3640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbbd006c840 0x7fbbd013b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:09.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.610+0000 7fbbd72e3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbd013cf70 0x7fbbd0150000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:09.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.610+0000 7fbbd72e3640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbbd015abb0 0x7fbbd0154ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:09.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.610+0000 7fbbd72e3640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd013bcc0 con 0x7fbbd013cf70 2023-11-28T18:38:09.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.610+0000 7fbbd72e3640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd014ef60 con 0x7fbbd006c840 2023-11-28T18:38:09.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.610+0000 7fbbd72e3640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd014f240 con 0x7fbbd015abb0 2023-11-28T18:38:09.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.610+0000 7fbbd487e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbd013cf70 0x7fbbd0150000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:09.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.610+0000 7fbbd487e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbd013cf70 0x7fbbd0150000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53994/0 (socket says 172.21.15.45:53994) 2023-11-28T18:38:09.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.610+0000 7fbbd487e640 1 -- 172.21.15.45:0/4102207500 learned_addr learned my addr 172.21.15.45:0/4102207500 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:09.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.610+0000 7fbbd507f640 1 --2- 172.21.15.45:0/4102207500 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbbd006c840 0x7fbbd013b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:09.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.610+0000 7fbbd5880640 1 --2- 172.21.15.45:0/4102207500 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbbd015abb0 0x7fbbd0154ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:09.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.614+0000 7fbbd487e640 1 -- 172.21.15.45:0/4102207500 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbbd015abb0 msgr2=0x7fbbd0154ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:09.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.614+0000 7fbbd487e640 1 --2- 172.21.15.45:0/4102207500 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbbd015abb0 0x7fbbd0154ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:09.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.614+0000 7fbbd487e640 1 -- 172.21.15.45:0/4102207500 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbbd006c840 msgr2=0x7fbbd013b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:09.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.614+0000 7fbbd487e640 1 --2- 172.21.15.45:0/4102207500 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbbd006c840 0x7fbbd013b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:09.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.614+0000 7fbbd487e640 1 -- 172.21.15.45:0/4102207500 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbcc00b770 con 0x7fbbd013cf70 2023-11-28T18:38:09.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.614+0000 7fbbd487e640 1 --2- 172.21.15.45:0/4102207500 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbd013cf70 0x7fbbd0150000 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fbbc000c7f0 tx=0x7fbbc000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:09.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.614+0000 7fbbc5ffb640 1 -- 172.21.15.45:0/4102207500 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc0007820 con 0x7fbbd013cf70 2023-11-28T18:38:09.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.614+0000 7fbbc5ffb640 1 -- 172.21.15.45:0/4102207500 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbc0007980 con 0x7fbbd013cf70 2023-11-28T18:38:09.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.614+0000 7fbbc5ffb640 1 -- 172.21.15.45:0/4102207500 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc0007d30 con 0x7fbbd013cf70 2023-11-28T18:38:09.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.614+0000 7fbbd72e3640 1 -- 172.21.15.45:0/4102207500 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbd014f520 con 0x7fbbd013cf70 2023-11-28T18:38:09.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.614+0000 7fbbd72e3640 1 -- 172.21.15.45:0/4102207500 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbd014fae0 con 0x7fbbd013cf70 2023-11-28T18:38:09.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.614+0000 7fbbd72e3640 1 -- 172.21.15.45:0/4102207500 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbd014fd00 con 0x7fbbd013cf70 2023-11-28T18:38:09.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.614+0000 7fbbc5ffb640 1 -- 172.21.15.45:0/4102207500 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fbbc00113f0 con 0x7fbbd013cf70 2023-11-28T18:38:09.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.614+0000 7fbbc5ffb640 1 --2- 172.21.15.45:0/4102207500 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbbb40668d0 0x7fbbb4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:09.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.618+0000 7fbbc5ffb640 1 -- 172.21.15.45:0/4102207500 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbbc0084610 con 0x7fbbd013cf70 2023-11-28T18:38:09.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.618+0000 7fbbd507f640 1 --2- 172.21.15.45:0/4102207500 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbbb40668d0 0x7fbbb4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:09.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.618+0000 7fbbd507f640 1 --2- 172.21.15.45:0/4102207500 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbbb40668d0 0x7fbbb4068d90 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc0b1000 tx=0x7fbbcc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:09.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.618+0000 7fbbc5ffb640 1 -- 172.21.15.45:0/4102207500 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbbc00518f0 con 0x7fbbd013cf70 2023-11-28T18:38:09.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.778+0000 7fbbd72e3640 1 -- 172.21.15.45:0/4102207500 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbbd0069480 con 0x7fbbd013cf70 2023-11-28T18:38:09.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.778+0000 7fbbc5ffb640 1 -- 172.21.15.45:0/4102207500 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16469 (secure 0 0 0) 0x7fbbc0054f10 con 0x7fbbd013cf70 2023-11-28T18:38:09.781 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:38:09.781 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":20,"fsid":"d10f5cd6-1d00-4019-99b6-6fa435498a15","created":"2023-11-28T18:37:08.189030+0000","modified":"2023-11-28T18:37:33.971141+0000","last_up_change":"2023-11-28T18:37:20.196124+0000","last_in_change":"2023-11-28T18:37:10.742043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T18:37:21.293917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T18:37:31.384760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T18:37:31.834769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"84465384-103c-4f2c-a45a-96f5bb9c835f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6809","nonce":555237322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6811","nonce":555237322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6815","nonce":555237322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6813","nonce":555237322}]},"public_addr":"172.21.15.45:6809/555237322","cluster_addr":"172.21.15.45:6811/555237322","heartbeat_back_addr":"172.21.15.45:6815/555237322","heartbeat_front_addr":"172.21.15.45:6813/555237322","state":["exists","up"]},{"osd":1,"uuid":"7d9eed24-a58f-42c7-a787-ac06be8553fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6801","nonce":2857063763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6803","nonce":2857063763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6807","nonce":2857063763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6805","nonce":2857063763}]},"public_addr":"172.21.15.45:6801/2857063763","cluster_addr":"172.21.15.45:6803/2857063763","heartbeat_back_addr":"172.21.15.45:6807/2857063763","heartbeat_front_addr":"172.21.15.45:6805/2857063763","state":["exists","up"]},{"osd":2,"uuid":"575eeccc-4abf-45b4-9caf-f3e797859588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6817","nonce":193884539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6819","nonce":193884539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6823","nonce":193884539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6821","nonce":193884539}]},"public_addr":"172.21.15.45:6817/193884539","cluster_addr":"172.21.15.45:6819/193884539","heartbeat_back_addr":"172.21.15.45:6823/193884539","heartbeat_front_addr":"172.21.15.45:6821/193884539","state":["exists","up"]},{"osd":3,"uuid":"9b0290d6-9a52-4bc8-b2a1-7622c5dc8e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6825","nonce":78541084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6827","nonce":78541084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6831","nonce":78541084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6829","nonce":78541084}]},"public_addr":"172.21.15.45:6825/78541084","cluster_addr":"172.21.15.45:6827/78541084","heartbeat_back_addr":"172.21.15.45:6831/78541084","heartbeat_front_addr":"172.21.15.45:6829/78541084","state":["exists","up"]},{"osd":4,"uuid":"ce632829-f027-4fbf-a627-02c571aa9d53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6809","nonce":1537591987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6811","nonce":1537591987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6815","nonce":1537591987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6813","nonce":1537591987}]},"public_addr":"172.21.15.190:6809/1537591987","cluster_addr":"172.21.15.190:6811/1537591987","heartbeat_back_addr":"172.21.15.190:6815/1537591987","heartbeat_front_addr":"172.21.15.190:6813/1537591987","state":["exists","up"]},{"osd":5,"uuid":"8700b609-27be-40bd-a251-4c0ae0a29ead","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6801","nonce":3296698407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6803","nonce":3296698407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6807","nonce":3296698407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6805","nonce":3296698407}]},"public_addr":"172.21.15.190:6801/3296698407","cluster_addr":"172.21.15.190:6803/3296698407","heartbeat_back_addr":"172.21.15.190:6807/3296698407","heartbeat_front_addr":"172.21.15.190:6805/3296698407","state":["exists","up"]},{"osd":6,"uuid":"44ce4a40-e6ff-4f4d-8e8a-7341e5c91f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6817","nonce":2317686718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6819","nonce":2317686718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6823","nonce":2317686718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6821","nonce":2317686718}]},"public_addr":"172.21.15.190:6817/2317686718","cluster_addr":"172.21.15.190:6819/2317686718","heartbeat_back_addr":"172.21.15.190:6823/2317686718","heartbeat_front_addr":"172.21.15.190:6821/2317686718","state":["exists","up"]},{"osd":7,"uuid":"192238c9-1423-4b7e-ac8f-84ba32113ddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6825","nonce":2493232051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6827","nonce":2493232051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6831","nonce":2493232051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6829","nonce":2493232051}]},"public_addr":"172.21.15.190:6825/2493232051","cluster_addr":"172.21.15.190:6827/2493232051","heartbeat_back_addr":"172.21.15.190:6831/2493232051","heartbeat_front_addr":"172.21.15.190:6829/2493232051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.393552+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.385453+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.361421+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.366408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.363226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.276007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.414605+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.445885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T18:38:09.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.782+0000 7fbbd72e3640 1 -- 172.21.15.45:0/4102207500 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbbb40668d0 msgr2=0x7fbbb4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:09.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.782+0000 7fbbd72e3640 1 --2- 172.21.15.45:0/4102207500 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbbb40668d0 0x7fbbb4068d90 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc0b1000 tx=0x7fbbcc008040 comp rx=0 tx=0).stop 2023-11-28T18:38:09.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.782+0000 7fbbd72e3640 1 -- 172.21.15.45:0/4102207500 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbd013cf70 msgr2=0x7fbbd0150000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:09.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.782+0000 7fbbd72e3640 1 --2- 172.21.15.45:0/4102207500 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbd013cf70 0x7fbbd0150000 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fbbc000c7f0 tx=0x7fbbc000ccb0 comp rx=0 tx=0).stop 2023-11-28T18:38:09.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.782+0000 7fbbd72e3640 1 -- 172.21.15.45:0/4102207500 shutdown_connections 2023-11-28T18:38:09.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.782+0000 7fbbd72e3640 1 --2- 172.21.15.45:0/4102207500 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbbb40668d0 0x7fbbb4068d90 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:09.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.782+0000 7fbbd72e3640 1 --2- 172.21.15.45:0/4102207500 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbbd015abb0 0x7fbbd0154ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:09.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.782+0000 7fbbd72e3640 1 --2- 172.21.15.45:0/4102207500 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbd013cf70 0x7fbbd0150000 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:09.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.782+0000 7fbbd72e3640 1 --2- 172.21.15.45:0/4102207500 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbbd006c840 0x7fbbd013b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:09.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.782+0000 7fbbd72e3640 1 -- 172.21.15.45:0/4102207500 >> 172.21.15.45:0/4102207500 conn(0x7fbbd006a570 msgr2=0x7fbbd00addc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:09.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.782+0000 7fbbd72e3640 1 -- 172.21.15.45:0/4102207500 shutdown_connections 2023-11-28T18:38:09.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.782+0000 7fbbd72e3640 1 -- 172.21.15.45:0/4102207500 wait complete. 2023-11-28T18:38:09.802 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T18:37:21.293917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T18:37:31.384760+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T18:37:31.834769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T18:38:09.803 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T18:38:09.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.946+0000 7fcd681f5640 1 Processor -- start 2023-11-28T18:38:09.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.946+0000 7fcd681f5640 1 -- start start 2023-11-28T18:38:09.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.946+0000 7fcd681f5640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fcd6014ac20 0x7fcd60165a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:09.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.946+0000 7fcd681f5640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcd6014b220 0x7fcd600b3e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:09.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.946+0000 7fcd681f5640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd600b2000 con 0x7fcd600b4390 2023-11-28T18:38:09.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.946+0000 7fcd681f5640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd600b4820 con 0x7fcd6014ac20 2023-11-28T18:38:09.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.946+0000 7fcd681f5640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd600b22a0 con 0x7fcd6014b220 2023-11-28T18:38:09.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.950+0000 7fcd65f91640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fcd6014ac20 0x7fcd60165a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:09.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.950+0000 7fcd65790640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcd6014b220 0x7fcd600b3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:09.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.950+0000 7fcd65790640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcd6014b220 0x7fcd600b3e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.45:60100/0 (socket says 172.21.15.45:60100) 2023-11-28T18:38:09.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.950+0000 7fcd65790640 1 -- 172.21.15.45:0/1599374266 learned_addr learned my addr 172.21.15.45:0/1599374266 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:09.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.950+0000 7fcd65f91640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fcd6014ac20 0x7fcd60165a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.45:41210/0 (socket says 172.21.15.45:41210) 2023-11-28T18:38:09.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.950+0000 7fcd66792640 1 --1- 172.21.15.45:0/1599374266 >> v1:172.21.15.190:6789/0 conn(0x7fcd600b4390 0x7fcd60161b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.45:47692/0 (socket says 172.21.15.45:47692) 2023-11-28T18:38:09.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.950+0000 7fcd65790640 1 -- 172.21.15.45:0/1599374266 >> v2:172.21.15.190:3300/0 conn(0x7fcd6014ac20 msgr2=0x7fcd60165a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:09.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.950+0000 7fcd65790640 1 --2- 172.21.15.45:0/1599374266 >> v2:172.21.15.190:3300/0 conn(0x7fcd6014ac20 0x7fcd60165a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:09.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.950+0000 7fcd65790640 1 -- 172.21.15.45:0/1599374266 >> v1:172.21.15.190:6789/0 conn(0x7fcd600b4390 legacy=0x7fcd60161b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:09.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.950+0000 7fcd65790640 1 -- 172.21.15.45:0/1599374266 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd600b2580 con 0x7fcd6014b220 2023-11-28T18:38:09.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.950+0000 7fcd65790640 1 --2- 172.21.15.45:0/1599374266 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcd6014b220 0x7fcd600b3e50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcd50009870 tx=0x7fcd5001c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5af2415641778a64 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:09.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.950+0000 7fcd64f8f640 1 -- 172.21.15.45:0/1599374266 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd500aa670 con 0x7fcd6014b220 2023-11-28T18:38:09.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.950+0000 7fcd64f8f640 1 -- 172.21.15.45:0/1599374266 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd500aa7d0 con 0x7fcd6014b220 2023-11-28T18:38:09.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.950+0000 7fcd64f8f640 1 -- 172.21.15.45:0/1599374266 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd500aab60 con 0x7fcd6014b220 2023-11-28T18:38:09.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.954+0000 7fcd681f5640 1 -- 172.21.15.45:0/1599374266 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcd6014b220 msgr2=0x7fcd600b3e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:09.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.954+0000 7fcd681f5640 1 --2- 172.21.15.45:0/1599374266 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcd6014b220 0x7fcd600b3e50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcd50009870 tx=0x7fcd5001c510 comp rx=0 tx=0).stop 2023-11-28T18:38:09.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.954+0000 7fcd681f5640 1 -- 172.21.15.45:0/1599374266 shutdown_connections 2023-11-28T18:38:09.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.954+0000 7fcd681f5640 1 --2- 172.21.15.45:0/1599374266 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcd6014b220 0x7fcd600b3e50 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:09.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.954+0000 7fcd681f5640 1 --2- 172.21.15.45:0/1599374266 >> v2:172.21.15.190:3300/0 conn(0x7fcd6014ac20 0x7fcd60165a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:09.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.954+0000 7fcd681f5640 1 -- 172.21.15.45:0/1599374266 >> 172.21.15.45:0/1599374266 conn(0x7fcd600b0d00 msgr2=0x7fcd600b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:09.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.954+0000 7fcd681f5640 1 -- 172.21.15.45:0/1599374266 shutdown_connections 2023-11-28T18:38:09.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.954+0000 7fcd681f5640 1 -- 172.21.15.45:0/1599374266 wait complete. 2023-11-28T18:38:09.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.954+0000 7fcd681f5640 1 Processor -- start 2023-11-28T18:38:09.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.954+0000 7fcd681f5640 1 -- start start 2023-11-28T18:38:09.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.954+0000 7fcd681f5640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcd600b4390 0x7fcd6015f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:09.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.954+0000 7fcd681f5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd6014ac20 0x7fcd601662f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:09.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.954+0000 7fcd681f5640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcd60161370 0x7fcd601606f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:09.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.954+0000 7fcd681f5640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd6016a830 con 0x7fcd6014ac20 2023-11-28T18:38:09.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.954+0000 7fcd681f5640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd6016aad0 con 0x7fcd60161370 2023-11-28T18:38:09.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.954+0000 7fcd681f5640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd6016adb0 con 0x7fcd600b4390 2023-11-28T18:38:09.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.954+0000 7fcd65790640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd6014ac20 0x7fcd601662f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:09.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.954+0000 7fcd65790640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd6014ac20 0x7fcd601662f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54004/0 (socket says 172.21.15.45:54004) 2023-11-28T18:38:09.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.954+0000 7fcd65790640 1 -- 172.21.15.45:0/1333801451 learned_addr learned my addr 172.21.15.45:0/1333801451 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:09.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.954+0000 7fcd65f91640 1 --2- 172.21.15.45:0/1333801451 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcd600b4390 0x7fcd6015f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:09.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.954+0000 7fcd66792640 1 --2- 172.21.15.45:0/1333801451 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcd60161370 0x7fcd601606f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:09.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.958+0000 7fcd65790640 1 -- 172.21.15.45:0/1333801451 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcd600b4390 msgr2=0x7fcd6015f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:09.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.958+0000 7fcd65790640 1 --2- 172.21.15.45:0/1333801451 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcd600b4390 0x7fcd6015f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:09.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.958+0000 7fcd65790640 1 -- 172.21.15.45:0/1333801451 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcd60161370 msgr2=0x7fcd601606f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:09.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.958+0000 7fcd65790640 1 --2- 172.21.15.45:0/1333801451 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcd60161370 0x7fcd601606f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:09.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.958+0000 7fcd65790640 1 -- 172.21.15.45:0/1333801451 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd500094d0 con 0x7fcd6014ac20 2023-11-28T18:38:09.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.958+0000 7fcd65790640 1 --2- 172.21.15.45:0/1333801451 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd6014ac20 0x7fcd601662f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fcd500ac040 tx=0x7fcd5001ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:09.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.958+0000 7fcd567fc640 1 -- 172.21.15.45:0/1333801451 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd500b3800 con 0x7fcd6014ac20 2023-11-28T18:38:09.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.958+0000 7fcd567fc640 1 -- 172.21.15.45:0/1333801451 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd500b3980 con 0x7fcd6014ac20 2023-11-28T18:38:09.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.958+0000 7fcd567fc640 1 -- 172.21.15.45:0/1333801451 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd500b3d30 con 0x7fcd6014ac20 2023-11-28T18:38:09.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.958+0000 7fcd681f5640 1 -- 172.21.15.45:0/1333801451 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd6016b090 con 0x7fcd6014ac20 2023-11-28T18:38:09.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.958+0000 7fcd681f5640 1 -- 172.21.15.45:0/1333801451 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd6015fa80 con 0x7fcd6014ac20 2023-11-28T18:38:09.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.958+0000 7fcd681f5640 1 -- 172.21.15.45:0/1333801451 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd60069410 con 0x7fcd6014ac20 2023-11-28T18:38:09.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.958+0000 7fcd567fc640 1 -- 172.21.15.45:0/1333801451 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fcd500b2380 con 0x7fcd6014ac20 2023-11-28T18:38:09.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.958+0000 7fcd567fc640 1 --2- 172.21.15.45:0/1333801451 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fcd440668d0 0x7fcd44068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:09.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.958+0000 7fcd567fc640 1 -- 172.21.15.45:0/1333801451 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcd60162ab0 con 0x7fcd6014ac20 2023-11-28T18:38:09.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.962+0000 7fcd65f91640 1 --2- 172.21.15.45:0/1333801451 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fcd440668d0 0x7fcd44068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:09.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.962+0000 7fcd65f91640 1 --2- 172.21.15.45:0/1333801451 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fcd440668d0 0x7fcd44068d90 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c009b60 tx=0x7fcd5c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:09.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:09.962+0000 7fcd567fc640 1 -- 172.21.15.45:0/1333801451 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcd500ebe30 con 0x7fcd6014ac20 2023-11-28T18:38:10.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.126+0000 7fcd681f5640 1 -- 172.21.15.45:0/1333801451 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcd6006e750 con 0x7fcd6014ac20 2023-11-28T18:38:10.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.126+0000 7fcd567fc640 1 -- 172.21.15.45:0/1333801451 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcd500c30a0 con 0x7fcd6014ac20 2023-11-28T18:38:10.130 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-11-28T18:38:10.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.130+0000 7fcd681f5640 1 -- 172.21.15.45:0/1333801451 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fcd440668d0 msgr2=0x7fcd44068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:10.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.130+0000 7fcd681f5640 1 --2- 172.21.15.45:0/1333801451 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fcd440668d0 0x7fcd44068d90 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c009b60 tx=0x7fcd5c009190 comp rx=0 tx=0).stop 2023-11-28T18:38:10.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.130+0000 7fcd681f5640 1 -- 172.21.15.45:0/1333801451 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd6014ac20 msgr2=0x7fcd601662f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:10.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.130+0000 7fcd681f5640 1 --2- 172.21.15.45:0/1333801451 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd6014ac20 0x7fcd601662f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fcd500ac040 tx=0x7fcd5001ad50 comp rx=0 tx=0).stop 2023-11-28T18:38:10.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.130+0000 7fcd681f5640 1 -- 172.21.15.45:0/1333801451 shutdown_connections 2023-11-28T18:38:10.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.130+0000 7fcd681f5640 1 --2- 172.21.15.45:0/1333801451 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fcd440668d0 0x7fcd44068d90 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:10.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.130+0000 7fcd681f5640 1 --2- 172.21.15.45:0/1333801451 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcd60161370 0x7fcd601606f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:10.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.130+0000 7fcd681f5640 1 --2- 172.21.15.45:0/1333801451 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd6014ac20 0x7fcd601662f0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:10.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.130+0000 7fcd681f5640 1 --2- 172.21.15.45:0/1333801451 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcd600b4390 0x7fcd6015f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:10.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.130+0000 7fcd681f5640 1 -- 172.21.15.45:0/1333801451 >> 172.21.15.45:0/1333801451 conn(0x7fcd600b0d00 msgr2=0x7fcd601645d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:10.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.130+0000 7fcd681f5640 1 -- 172.21.15.45:0/1333801451 shutdown_connections 2023-11-28T18:38:10.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.130+0000 7fcd681f5640 1 -- 172.21.15.45:0/1333801451 wait complete. 2023-11-28T18:38:10.152 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T18:38:10.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.294+0000 7fa8dfb1d640 1 Processor -- start 2023-11-28T18:38:10.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.298+0000 7fa8dfb1d640 1 -- start start 2023-11-28T18:38:10.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.298+0000 7fa8dfb1d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa8d8158ce0 0x7fa8d815eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:10.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.298+0000 7fa8dfb1d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa8d80b4310 0x7fa8d80b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:10.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.298+0000 7fa8dfb1d640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8d80b4c80 con 0x7fa8d80cba50 2023-11-28T18:38:10.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.298+0000 7fa8dfb1d640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8d815b6b0 con 0x7fa8d80b4310 2023-11-28T18:38:10.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.298+0000 7fa8dfb1d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d815c550 con 0x7fa8d8158ce0 2023-11-28T18:38:10.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.298+0000 7fa8dd0b8640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fa8d80cba50 0x7fa8d815be40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45764/0 (socket says 172.21.15.45:45764) 2023-11-28T18:38:10.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.298+0000 7fa8dd0b8640 1 -- 172.21.15.45:0/1264070781 learned_addr learned my addr 172.21.15.45:0/1264070781 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:38:10.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.298+0000 7fa8de0ba640 1 --2- 172.21.15.45:0/1264070781 >> v2:172.21.15.190:3300/0 conn(0x7fa8d80b4310 0x7fa8d80b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:10.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.298+0000 7fa8dd8b9640 1 --2- 172.21.15.45:0/1264070781 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa8d8158ce0 0x7fa8d815eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:10.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.298+0000 7fa8dc8b7640 1 -- 172.21.15.45:0/1264070781 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1569324801 0 0) 0x7fa8d80b4c80 con 0x7fa8d80cba50 2023-11-28T18:38:10.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.298+0000 7fa8dc8b7640 1 -- 172.21.15.45:0/1264070781 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8c4003530 con 0x7fa8d80cba50 2023-11-28T18:38:10.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.298+0000 7fa8dd8b9640 1 -- 172.21.15.45:0/1264070781 >> v2:172.21.15.190:3300/0 conn(0x7fa8d80b4310 msgr2=0x7fa8d80b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:10.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.298+0000 7fa8dd8b9640 1 --2- 172.21.15.45:0/1264070781 >> v2:172.21.15.190:3300/0 conn(0x7fa8d80b4310 0x7fa8d80b4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:10.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.298+0000 7fa8dd8b9640 1 -- 172.21.15.45:0/1264070781 >> v1:172.21.15.45:6789/0 conn(0x7fa8d80cba50 legacy=0x7fa8d815be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:10.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.298+0000 7fa8dd8b9640 1 -- 172.21.15.45:0/1264070781 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d815f450 con 0x7fa8d8158ce0 2023-11-28T18:38:10.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.298+0000 7fa8de0ba640 1 --2- 172.21.15.45:0/1264070781 >> v2:172.21.15.190:3300/0 conn(0x7fa8d80b4310 0x7fa8d80b4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:38:10.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.302+0000 7fa8dd8b9640 1 --2- 172.21.15.45:0/1264070781 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa8d8158ce0 0x7fa8d815eb90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa8d40097c0 tx=0x7fa8d401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a9f57ddfc07c632 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:10.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.302+0000 7fa8dc8b7640 1 -- 172.21.15.45:0/1264070781 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d40ab650 con 0x7fa8d8158ce0 2023-11-28T18:38:10.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.302+0000 7fa8dc8b7640 1 -- 172.21.15.45:0/1264070781 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8d40ab7b0 con 0x7fa8d8158ce0 2023-11-28T18:38:10.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.302+0000 7fa8dc8b7640 1 -- 172.21.15.45:0/1264070781 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d40abb40 con 0x7fa8d8158ce0 2023-11-28T18:38:10.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.302+0000 7fa8dfb1d640 1 -- 172.21.15.45:0/1264070781 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa8d8158ce0 msgr2=0x7fa8d815eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:10.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.302+0000 7fa8dfb1d640 1 --2- 172.21.15.45:0/1264070781 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa8d8158ce0 0x7fa8d815eb90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa8d40097c0 tx=0x7fa8d401c450 comp rx=0 tx=0).stop 2023-11-28T18:38:10.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.302+0000 7fa8dfb1d640 1 -- 172.21.15.45:0/1264070781 shutdown_connections 2023-11-28T18:38:10.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.302+0000 7fa8dfb1d640 1 --2- 172.21.15.45:0/1264070781 >> v2:172.21.15.190:3300/0 conn(0x7fa8d80b4310 0x7fa8d80b4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:10.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.302+0000 7fa8dfb1d640 1 --2- 172.21.15.45:0/1264070781 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa8d8158ce0 0x7fa8d815eb90 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:10.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.302+0000 7fa8dfb1d640 1 -- 172.21.15.45:0/1264070781 >> 172.21.15.45:0/1264070781 conn(0x7fa8d80b0d00 msgr2=0x7fa8d80b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:10.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.302+0000 7fa8dfb1d640 1 -- 172.21.15.45:0/1264070781 shutdown_connections 2023-11-28T18:38:10.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.302+0000 7fa8dfb1d640 1 -- 172.21.15.45:0/1264070781 wait complete. 2023-11-28T18:38:10.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.306+0000 7fa8dfb1d640 1 Processor -- start 2023-11-28T18:38:10.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.306+0000 7fa8dfb1d640 1 -- start start 2023-11-28T18:38:10.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.306+0000 7fa8dfb1d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8d80b4310 0x7fa8d80adb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:10.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.306+0000 7fa8dfb1d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa8d80cba50 0x7fa8d80a8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:10.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.306+0000 7fa8dfb1d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa8d8158ce0 0x7fa8d80a89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:10.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.306+0000 7fa8dfb1d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d8155b10 con 0x7fa8d80b4310 2023-11-28T18:38:10.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.306+0000 7fa8dfb1d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d8155df0 con 0x7fa8d8158ce0 2023-11-28T18:38:10.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.306+0000 7fa8dfb1d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d81560d0 con 0x7fa8d80cba50 2023-11-28T18:38:10.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.306+0000 7fa8dd8b9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8d80b4310 0x7fa8d80adb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:10.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.306+0000 7fa8dd8b9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8d80b4310 0x7fa8d80adb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54006/0 (socket says 172.21.15.45:54006) 2023-11-28T18:38:10.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.306+0000 7fa8dd8b9640 1 -- 172.21.15.45:0/2526209091 learned_addr learned my addr 172.21.15.45:0/2526209091 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:10.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.306+0000 7fa8de0ba640 1 --2- 172.21.15.45:0/2526209091 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa8d8158ce0 0x7fa8d80a89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:10.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.306+0000 7fa8dd0b8640 1 --2- 172.21.15.45:0/2526209091 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa8d80cba50 0x7fa8d80a8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:10.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.306+0000 7fa8dd8b9640 1 -- 172.21.15.45:0/2526209091 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa8d80cba50 msgr2=0x7fa8d80a8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:10.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.306+0000 7fa8dd8b9640 1 --2- 172.21.15.45:0/2526209091 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa8d80cba50 0x7fa8d80a8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:10.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.306+0000 7fa8dd8b9640 1 -- 172.21.15.45:0/2526209091 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa8d8158ce0 msgr2=0x7fa8d80a89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:10.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.306+0000 7fa8dd8b9640 1 --2- 172.21.15.45:0/2526209091 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa8d8158ce0 0x7fa8d80a89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:10.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.306+0000 7fa8dd8b9640 1 -- 172.21.15.45:0/2526209091 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d0009a70 con 0x7fa8d80b4310 2023-11-28T18:38:10.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.306+0000 7fa8dd8b9640 1 --2- 172.21.15.45:0/2526209091 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8d80b4310 0x7fa8d80adb50 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa8d40ad040 tx=0x7fa8d401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:10.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.306+0000 7fa8ce7fc640 1 -- 172.21.15.45:0/2526209091 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d40bf610 con 0x7fa8d80b4310 2023-11-28T18:38:10.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.306+0000 7fa8ce7fc640 1 -- 172.21.15.45:0/2526209091 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8d40bf7b0 con 0x7fa8d80b4310 2023-11-28T18:38:10.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.306+0000 7fa8ce7fc640 1 -- 172.21.15.45:0/2526209091 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d40bfb60 con 0x7fa8d80b4310 2023-11-28T18:38:10.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.306+0000 7fa8dfb1d640 1 -- 172.21.15.45:0/2526209091 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8d4009420 con 0x7fa8d80b4310 2023-11-28T18:38:10.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.306+0000 7fa8dfb1d640 1 -- 172.21.15.45:0/2526209091 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8d8156690 con 0x7fa8d80b4310 2023-11-28T18:38:10.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.306+0000 7fa8dfb1d640 1 -- 172.21.15.45:0/2526209091 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8d8069410 con 0x7fa8d80b4310 2023-11-28T18:38:10.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.310+0000 7fa8ce7fc640 1 -- 172.21.15.45:0/2526209091 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa8d40b5400 con 0x7fa8d80b4310 2023-11-28T18:38:10.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.310+0000 7fa8ce7fc640 1 --2- 172.21.15.45:0/2526209091 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa8bc0668d0 0x7fa8bc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:10.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.310+0000 7fa8ce7fc640 1 -- 172.21.15.45:0/2526209091 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa8d411ecf0 con 0x7fa8d80b4310 2023-11-28T18:38:10.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.310+0000 7fa8dd0b8640 1 --2- 172.21.15.45:0/2526209091 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa8bc0668d0 0x7fa8bc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:10.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.310+0000 7fa8dd0b8640 1 --2- 172.21.15.45:0/2526209091 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa8bc0668d0 0x7fa8bc068d90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa8d815eae0 tx=0x7fa8c8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:10.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.314+0000 7fa8ce7fc640 1 -- 172.21.15.45:0/2526209091 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa8d40ebf40 con 0x7fa8d80b4310 2023-11-28T18:38:10.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.470+0000 7fa8dfb1d640 1 -- 172.21.15.45:0/2526209091 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa8d80b19d0 con 0x7fa8d80b4310 2023-11-28T18:38:10.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.470+0000 7fa8ce7fc640 1 -- 172.21.15.45:0/2526209091 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa8d40ef560 con 0x7fa8d80b4310 2023-11-28T18:38:10.473 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-11-28T18:38:10.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.474+0000 7fa8dfb1d640 1 -- 172.21.15.45:0/2526209091 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa8bc0668d0 msgr2=0x7fa8bc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:10.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.474+0000 7fa8dfb1d640 1 --2- 172.21.15.45:0/2526209091 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa8bc0668d0 0x7fa8bc068d90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa8d815eae0 tx=0x7fa8c8009040 comp rx=0 tx=0).stop 2023-11-28T18:38:10.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.474+0000 7fa8dfb1d640 1 -- 172.21.15.45:0/2526209091 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8d80b4310 msgr2=0x7fa8d80adb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:10.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.474+0000 7fa8dfb1d640 1 --2- 172.21.15.45:0/2526209091 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8d80b4310 0x7fa8d80adb50 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa8d40ad040 tx=0x7fa8d401ac90 comp rx=0 tx=0).stop 2023-11-28T18:38:10.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.474+0000 7fa8dfb1d640 1 -- 172.21.15.45:0/2526209091 shutdown_connections 2023-11-28T18:38:10.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.474+0000 7fa8dfb1d640 1 --2- 172.21.15.45:0/2526209091 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa8bc0668d0 0x7fa8bc068d90 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:10.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.474+0000 7fa8dfb1d640 1 --2- 172.21.15.45:0/2526209091 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa8d8158ce0 0x7fa8d80a89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:10.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.474+0000 7fa8dfb1d640 1 --2- 172.21.15.45:0/2526209091 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa8d80cba50 0x7fa8d80a8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:10.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.474+0000 7fa8dfb1d640 1 --2- 172.21.15.45:0/2526209091 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8d80b4310 0x7fa8d80adb50 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:10.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.474+0000 7fa8dfb1d640 1 -- 172.21.15.45:0/2526209091 >> 172.21.15.45:0/2526209091 conn(0x7fa8d80b0d00 msgr2=0x7fa8d80aef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:10.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.474+0000 7fa8dfb1d640 1 -- 172.21.15.45:0/2526209091 shutdown_connections 2023-11-28T18:38:10.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.474+0000 7fa8dfb1d640 1 -- 172.21.15.45:0/2526209091 wait complete. 2023-11-28T18:38:10.494 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T18:38:10.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.638+0000 7f92c7f96640 1 Processor -- start 2023-11-28T18:38:10.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.638+0000 7f92c7f96640 1 -- start start 2023-11-28T18:38:10.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.638+0000 7f92c7f96640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f92c014ac20 0x7f92c0165a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:10.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.638+0000 7f92c7f96640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f92c014b220 0x7f92c00b3e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:10.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.638+0000 7f92c7f96640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92c00b2000 con 0x7f92c00b4390 2023-11-28T18:38:10.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.638+0000 7f92c7f96640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92c00b4820 con 0x7f92c014ac20 2023-11-28T18:38:10.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.638+0000 7f92c7f96640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92c00b22a0 con 0x7f92c014b220 2023-11-28T18:38:10.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.638+0000 7f92c5d32640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f92c014ac20 0x7f92c0165a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:10.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.638+0000 7f92c5d32640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f92c014ac20 0x7f92c0165a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54018/0 (socket says 172.21.15.45:54018) 2023-11-28T18:38:10.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.638+0000 7f92c5d32640 1 -- 172.21.15.45:0/571925846 learned_addr learned my addr 172.21.15.45:0/571925846 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:10.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.638+0000 7f92c5531640 1 --2- 172.21.15.45:0/571925846 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f92c014b220 0x7f92c00b3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:10.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.638+0000 7f92c5d32640 1 -- 172.21.15.45:0/571925846 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f92c014b220 msgr2=0x7f92c00b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:10.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.638+0000 7f92c5d32640 1 --2- 172.21.15.45:0/571925846 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f92c014b220 0x7f92c00b3e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:10.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.638+0000 7f92c5d32640 1 -- 172.21.15.45:0/571925846 >> v1:172.21.15.190:6789/0 conn(0x7f92c00b4390 legacy=0x7f92c0161b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:10.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.638+0000 7f92c5d32640 1 -- 172.21.15.45:0/571925846 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c00b2580 con 0x7f92c014ac20 2023-11-28T18:38:10.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.642+0000 7f92c5d32640 1 --2- 172.21.15.45:0/571925846 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92c014ac20 0x7f92c0165a60 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f92bc009870 tx=0x7f92bc01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8df9b995d46584a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:10.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.642+0000 7f92c4d30640 1 -- 172.21.15.45:0/571925846 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92bc0aa5f0 con 0x7f92c014ac20 2023-11-28T18:38:10.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.642+0000 7f92c4d30640 1 -- 172.21.15.45:0/571925846 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92bc0aa750 con 0x7f92c014ac20 2023-11-28T18:38:10.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.642+0000 7f92c4d30640 1 -- 172.21.15.45:0/571925846 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92bc0aaae0 con 0x7f92c014ac20 2023-11-28T18:38:10.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.642+0000 7f92c7f96640 1 -- 172.21.15.45:0/571925846 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92c014ac20 msgr2=0x7f92c0165a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:10.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.642+0000 7f92c7f96640 1 --2- 172.21.15.45:0/571925846 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92c014ac20 0x7f92c0165a60 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f92bc009870 tx=0x7f92bc01c4d0 comp rx=0 tx=0).stop 2023-11-28T18:38:10.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.642+0000 7f92c7f96640 1 -- 172.21.15.45:0/571925846 shutdown_connections 2023-11-28T18:38:10.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.642+0000 7f92c7f96640 1 --2- 172.21.15.45:0/571925846 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f92c014b220 0x7f92c00b3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:10.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.642+0000 7f92c7f96640 1 --2- 172.21.15.45:0/571925846 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92c014ac20 0x7f92c0165a60 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:10.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.642+0000 7f92c7f96640 1 -- 172.21.15.45:0/571925846 >> 172.21.15.45:0/571925846 conn(0x7f92c00b0d00 msgr2=0x7f92c00b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:10.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.642+0000 7f92c7f96640 1 -- 172.21.15.45:0/571925846 shutdown_connections 2023-11-28T18:38:10.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.642+0000 7f92c7f96640 1 -- 172.21.15.45:0/571925846 wait complete. 2023-11-28T18:38:10.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.646+0000 7f92c7f96640 1 Processor -- start 2023-11-28T18:38:10.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.646+0000 7f92c7f96640 1 -- start start 2023-11-28T18:38:10.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.646+0000 7f92c7f96640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f92c00b4390 0x7f92c0160b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:10.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.646+0000 7f92c7f96640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f92c014ac20 0x7f92c0143080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:10.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.646+0000 7f92c7f96640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92c01662f0 0x7f92c0166780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:10.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.646+0000 7f92c7f96640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c01606b0 con 0x7f92c01662f0 2023-11-28T18:38:10.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.646+0000 7f92c7f96640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c014a130 con 0x7f92c014ac20 2023-11-28T18:38:10.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.646+0000 7f92c7f96640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92c014a410 con 0x7f92c00b4390 2023-11-28T18:38:10.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.646+0000 7f92c6533640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92c01662f0 0x7f92c0166780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:10.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.646+0000 7f92c6533640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92c01662f0 0x7f92c0166780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54034/0 (socket says 172.21.15.45:54034) 2023-11-28T18:38:10.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.646+0000 7f92c5531640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f92c014ac20 0x7f92c0143080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:10.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.646+0000 7f92c6533640 1 -- 172.21.15.45:0/822253534 learned_addr learned my addr 172.21.15.45:0/822253534 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:10.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.646+0000 7f92c5d32640 1 --2- 172.21.15.45:0/822253534 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f92c00b4390 0x7f92c0160b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:10.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.646+0000 7f92c6533640 1 -- 172.21.15.45:0/822253534 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f92c00b4390 msgr2=0x7f92c0160b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:10.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.646+0000 7f92c6533640 1 --2- 172.21.15.45:0/822253534 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f92c00b4390 0x7f92c0160b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:10.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.646+0000 7f92c6533640 1 -- 172.21.15.45:0/822253534 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f92c014ac20 msgr2=0x7f92c0143080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:10.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.646+0000 7f92c6533640 1 --2- 172.21.15.45:0/822253534 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f92c014ac20 0x7f92c0143080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:10.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.646+0000 7f92c6533640 1 -- 172.21.15.45:0/822253534 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92bc0094d0 con 0x7f92c01662f0 2023-11-28T18:38:10.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.646+0000 7f92c6533640 1 --2- 172.21.15.45:0/822253534 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92c01662f0 0x7f92c0166780 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f92b800c780 tx=0x7f92b800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:10.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.646+0000 7f92b67fc640 1 -- 172.21.15.45:0/822253534 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b8004b70 con 0x7f92c01662f0 2023-11-28T18:38:10.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.646+0000 7f92b67fc640 1 -- 172.21.15.45:0/822253534 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b800ce90 con 0x7f92c01662f0 2023-11-28T18:38:10.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.646+0000 7f92c7f96640 1 -- 172.21.15.45:0/822253534 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92c0160340 con 0x7f92c01662f0 2023-11-28T18:38:10.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.646+0000 7f92b67fc640 1 -- 172.21.15.45:0/822253534 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b800a850 con 0x7f92c01662f0 2023-11-28T18:38:10.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.646+0000 7f92c7f96640 1 -- 172.21.15.45:0/822253534 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92c01435c0 con 0x7f92c01662f0 2023-11-28T18:38:10.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.650+0000 7f92c7f96640 1 -- 172.21.15.45:0/822253534 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92c0160860 con 0x7f92c01662f0 2023-11-28T18:38:10.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.650+0000 7f92b67fc640 1 -- 172.21.15.45:0/822253534 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f92b800a9b0 con 0x7f92c01662f0 2023-11-28T18:38:10.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.650+0000 7f92b67fc640 1 --2- 172.21.15.45:0/822253534 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f92a4066900 0x7f92a4068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:10.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.650+0000 7f92b67fc640 1 -- 172.21.15.45:0/822253534 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f92b8084480 con 0x7f92c01662f0 2023-11-28T18:38:10.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.650+0000 7f92c5d32640 1 --2- 172.21.15.45:0/822253534 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f92a4066900 0x7f92a4068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:10.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.650+0000 7f92c5d32640 1 --2- 172.21.15.45:0/822253534 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f92a4066900 0x7f92a4068dc0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f92bc0ae000 tx=0x7f92bc0b5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:10.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.654+0000 7f92b67fc640 1 -- 172.21.15.45:0/822253534 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f92c0160860 con 0x7f92c01662f0 2023-11-28T18:38:10.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.810+0000 7f92c7f96640 1 -- 172.21.15.45:0/822253534 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f92c0069410 con 0x7f92c01662f0 2023-11-28T18:38:10.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.810+0000 7f92b67fc640 1 -- 172.21.15.45:0/822253534 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f92b80551f0 con 0x7f92c01662f0 2023-11-28T18:38:10.812 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-11-28T18:38:10.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.810+0000 7f92c7f96640 1 -- 172.21.15.45:0/822253534 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f92a4066900 msgr2=0x7f92a4068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:10.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.810+0000 7f92c7f96640 1 --2- 172.21.15.45:0/822253534 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f92a4066900 0x7f92a4068dc0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f92bc0ae000 tx=0x7f92bc0b5040 comp rx=0 tx=0).stop 2023-11-28T18:38:10.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.810+0000 7f92c7f96640 1 -- 172.21.15.45:0/822253534 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92c01662f0 msgr2=0x7f92c0166780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:10.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.810+0000 7f92c7f96640 1 --2- 172.21.15.45:0/822253534 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92c01662f0 0x7f92c0166780 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f92b800c780 tx=0x7f92b800cc40 comp rx=0 tx=0).stop 2023-11-28T18:38:10.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.810+0000 7f92c7f96640 1 -- 172.21.15.45:0/822253534 shutdown_connections 2023-11-28T18:38:10.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.810+0000 7f92c7f96640 1 --2- 172.21.15.45:0/822253534 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f92a4066900 0x7f92a4068dc0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:10.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.810+0000 7f92c7f96640 1 --2- 172.21.15.45:0/822253534 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92c01662f0 0x7f92c0166780 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:10.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.810+0000 7f92c7f96640 1 --2- 172.21.15.45:0/822253534 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f92c014ac20 0x7f92c0143080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:10.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.810+0000 7f92c7f96640 1 --2- 172.21.15.45:0/822253534 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f92c00b4390 0x7f92c0160b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:10.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.810+0000 7f92c7f96640 1 -- 172.21.15.45:0/822253534 >> 172.21.15.45:0/822253534 conn(0x7f92c00b0d00 msgr2=0x7f92c0143890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:10.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.810+0000 7f92c7f96640 1 -- 172.21.15.45:0/822253534 shutdown_connections 2023-11-28T18:38:10.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.810+0000 7f92c7f96640 1 -- 172.21.15.45:0/822253534 wait complete. 2023-11-28T18:38:10.833 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T18:38:10.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.974+0000 7fd390032640 1 Processor -- start 2023-11-28T18:38:10.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.974+0000 7fd390032640 1 -- start start 2023-11-28T18:38:10.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.974+0000 7fd390032640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd38806ca10 0x7fd388145290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:10.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.974+0000 7fd390032640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd38815c0b0 0x7fd3881457d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:10.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.974+0000 7fd390032640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd388146000 con 0x7fd38815bcd0 2023-11-28T18:38:10.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.974+0000 7fd390032640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3881462e0 con 0x7fd38806ca10 2023-11-28T18:38:10.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.974+0000 7fd390032640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3881465c0 con 0x7fd38815c0b0 2023-11-28T18:38:10.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.978+0000 7fd38d5cd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd38806ca10 0x7fd388145290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:10.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.978+0000 7fd38d5cd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd38806ca10 0x7fd388145290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54038/0 (socket says 172.21.15.45:54038) 2023-11-28T18:38:10.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.978+0000 7fd38d5cd640 1 -- 172.21.15.45:0/1883644481 learned_addr learned my addr 172.21.15.45:0/1883644481 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:10.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.978+0000 7fd38e5cf640 1 --2- 172.21.15.45:0/1883644481 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd38815c0b0 0x7fd3881457d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:10.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.978+0000 7fd38d5cd640 1 -- 172.21.15.45:0/1883644481 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd38815c0b0 msgr2=0x7fd3881457d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:10.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.978+0000 7fd38d5cd640 1 --2- 172.21.15.45:0/1883644481 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd38815c0b0 0x7fd3881457d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:10.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.978+0000 7fd38d5cd640 1 -- 172.21.15.45:0/1883644481 >> v1:172.21.15.190:6789/0 conn(0x7fd38815bcd0 legacy=0x7fd38806c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:10.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.978+0000 7fd38d5cd640 1 -- 172.21.15.45:0/1883644481 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3881468a0 con 0x7fd38806ca10 2023-11-28T18:38:10.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.978+0000 7fd38d5cd640 1 --2- 172.21.15.45:0/1883644481 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd38806ca10 0x7fd388145290 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd3780098a0 tx=0x7fd37801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acd70b950119568d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:10.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.978+0000 7fd38cdcc640 1 -- 172.21.15.45:0/1883644481 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3780ab640 con 0x7fd38806ca10 2023-11-28T18:38:10.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.982+0000 7fd38cdcc640 1 -- 172.21.15.45:0/1883644481 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3780a7070 con 0x7fd38806ca10 2023-11-28T18:38:10.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.982+0000 7fd38cdcc640 1 -- 172.21.15.45:0/1883644481 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3780ab9c0 con 0x7fd38806ca10 2023-11-28T18:38:10.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.982+0000 7fd390032640 1 -- 172.21.15.45:0/1883644481 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd38806ca10 msgr2=0x7fd388145290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:10.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.982+0000 7fd390032640 1 --2- 172.21.15.45:0/1883644481 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd38806ca10 0x7fd388145290 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd3780098a0 tx=0x7fd37801c460 comp rx=0 tx=0).stop 2023-11-28T18:38:10.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.982+0000 7fd390032640 1 -- 172.21.15.45:0/1883644481 shutdown_connections 2023-11-28T18:38:10.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.982+0000 7fd390032640 1 --2- 172.21.15.45:0/1883644481 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd38815c0b0 0x7fd3881457d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:10.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.982+0000 7fd390032640 1 --2- 172.21.15.45:0/1883644481 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd38806ca10 0x7fd388145290 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:10.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.982+0000 7fd390032640 1 -- 172.21.15.45:0/1883644481 >> 172.21.15.45:0/1883644481 conn(0x7fd38806a570 msgr2=0x7fd38806a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:10.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.982+0000 7fd390032640 1 -- 172.21.15.45:0/1883644481 shutdown_connections 2023-11-28T18:38:10.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.982+0000 7fd390032640 1 -- 172.21.15.45:0/1883644481 wait complete. 2023-11-28T18:38:10.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.982+0000 7fd390032640 1 Processor -- start 2023-11-28T18:38:10.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.982+0000 7fd390032640 1 -- start start 2023-11-28T18:38:10.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.982+0000 7fd390032640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd38806ca10 0x7fd388159aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:10.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.982+0000 7fd390032640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd38815bcd0 0x7fd38815e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:10.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.982+0000 7fd390032640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd38815c0b0 0x7fd3881603f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:10.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.982+0000 7fd390032640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd388159fe0 con 0x7fd38815c0b0 2023-11-28T18:38:10.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.982+0000 7fd390032640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd388162500 con 0x7fd38815bcd0 2023-11-28T18:38:10.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.982+0000 7fd390032640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd388161ef0 con 0x7fd38806ca10 2023-11-28T18:38:10.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.982+0000 7fd38e5cf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd38815c0b0 0x7fd3881603f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:10.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.982+0000 7fd38e5cf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd38815c0b0 0x7fd3881603f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54048/0 (socket says 172.21.15.45:54048) 2023-11-28T18:38:10.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.982+0000 7fd38e5cf640 1 -- 172.21.15.45:0/834139846 learned_addr learned my addr 172.21.15.45:0/834139846 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:10.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.982+0000 7fd38ddce640 1 --2- 172.21.15.45:0/834139846 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd38806ca10 0x7fd388159aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:10.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.982+0000 7fd38d5cd640 1 --2- 172.21.15.45:0/834139846 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd38815bcd0 0x7fd38815e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:10.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.986+0000 7fd38e5cf640 1 -- 172.21.15.45:0/834139846 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd38806ca10 msgr2=0x7fd388159aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:10.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.986+0000 7fd38e5cf640 1 --2- 172.21.15.45:0/834139846 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd38806ca10 0x7fd388159aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:10.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.986+0000 7fd38e5cf640 1 -- 172.21.15.45:0/834139846 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd38815bcd0 msgr2=0x7fd38815e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:10.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.986+0000 7fd38e5cf640 1 --2- 172.21.15.45:0/834139846 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd38815bcd0 0x7fd38815e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:10.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.986+0000 7fd38e5cf640 1 -- 172.21.15.45:0/834139846 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3780094d0 con 0x7fd38815c0b0 2023-11-28T18:38:10.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.986+0000 7fd38d5cd640 1 --2- 172.21.15.45:0/834139846 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd38815bcd0 0x7fd38815e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:38:10.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.986+0000 7fd38e5cf640 1 --2- 172.21.15.45:0/834139846 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd38815c0b0 0x7fd3881603f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd38000efc0 tx=0x7fd38000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:10.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.986+0000 7fd37e7fc640 1 -- 172.21.15.45:0/834139846 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd380009b20 con 0x7fd38815c0b0 2023-11-28T18:38:10.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.986+0000 7fd37e7fc640 1 -- 172.21.15.45:0/834139846 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd38000f040 con 0x7fd38815c0b0 2023-11-28T18:38:10.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.986+0000 7fd390032640 1 -- 172.21.15.45:0/834139846 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd38815eb70 con 0x7fd38815c0b0 2023-11-28T18:38:10.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.986+0000 7fd37e7fc640 1 -- 172.21.15.45:0/834139846 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3800146c0 con 0x7fd38815c0b0 2023-11-28T18:38:10.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.986+0000 7fd390032640 1 -- 172.21.15.45:0/834139846 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd38815ee50 con 0x7fd38815c0b0 2023-11-28T18:38:10.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.986+0000 7fd390032640 1 -- 172.21.15.45:0/834139846 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd388162670 con 0x7fd38815c0b0 2023-11-28T18:38:10.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.986+0000 7fd37e7fc640 1 -- 172.21.15.45:0/834139846 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fd380014820 con 0x7fd38815c0b0 2023-11-28T18:38:10.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.986+0000 7fd37e7fc640 1 --2- 172.21.15.45:0/834139846 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fd36c0668d0 0x7fd36c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:10.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.986+0000 7fd37e7fc640 1 -- 172.21.15.45:0/834139846 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd3800852d0 con 0x7fd38815c0b0 2023-11-28T18:38:10.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.990+0000 7fd38ddce640 1 --2- 172.21.15.45:0/834139846 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fd36c0668d0 0x7fd36c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:10.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.990+0000 7fd38ddce640 1 --2- 172.21.15.45:0/834139846 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fd36c0668d0 0x7fd36c068d90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd388145120 tx=0x7fd384009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:10.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:10.990+0000 7fd37e7fc640 1 -- 172.21.15.45:0/834139846 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd380052470 con 0x7fd38815c0b0 2023-11-28T18:38:11.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.162+0000 7fd390032640 1 -- 172.21.15.45:0/834139846 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd388069480 con 0x7fd38815c0b0 2023-11-28T18:38:11.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.162+0000 7fd37e7fc640 1 -- 172.21.15.45:0/834139846 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd380009e60 con 0x7fd38815c0b0 2023-11-28T18:38:11.164 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-11-28T18:38:11.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.162+0000 7fd390032640 1 -- 172.21.15.45:0/834139846 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fd36c0668d0 msgr2=0x7fd36c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:11.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.162+0000 7fd390032640 1 --2- 172.21.15.45:0/834139846 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fd36c0668d0 0x7fd36c068d90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd388145120 tx=0x7fd384009040 comp rx=0 tx=0).stop 2023-11-28T18:38:11.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.162+0000 7fd390032640 1 -- 172.21.15.45:0/834139846 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd38815c0b0 msgr2=0x7fd3881603f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:11.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.162+0000 7fd390032640 1 --2- 172.21.15.45:0/834139846 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd38815c0b0 0x7fd3881603f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd38000efc0 tx=0x7fd38000c490 comp rx=0 tx=0).stop 2023-11-28T18:38:11.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.162+0000 7fd390032640 1 -- 172.21.15.45:0/834139846 shutdown_connections 2023-11-28T18:38:11.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.162+0000 7fd390032640 1 --2- 172.21.15.45:0/834139846 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fd36c0668d0 0x7fd36c068d90 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:11.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.162+0000 7fd390032640 1 --2- 172.21.15.45:0/834139846 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd38815c0b0 0x7fd3881603f0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:11.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.162+0000 7fd390032640 1 --2- 172.21.15.45:0/834139846 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd38815bcd0 0x7fd38815e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:11.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.162+0000 7fd390032640 1 --2- 172.21.15.45:0/834139846 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd38806ca10 0x7fd388159aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:11.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.162+0000 7fd390032640 1 -- 172.21.15.45:0/834139846 >> 172.21.15.45:0/834139846 conn(0x7fd38806a570 msgr2=0x7fd3880aec70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:11.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.166+0000 7fd390032640 1 -- 172.21.15.45:0/834139846 shutdown_connections 2023-11-28T18:38:11.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.166+0000 7fd390032640 1 -- 172.21.15.45:0/834139846 wait complete. 2023-11-28T18:38:11.186 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-28T18:38:11.186 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T18:38:11.196 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T18:38:11.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.338+0000 7f1a4df80640 1 Processor -- start 2023-11-28T18:38:11.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.338+0000 7f1a4df80640 1 -- start start 2023-11-28T18:38:11.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.338+0000 7f1a4df80640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f1a480cfed0 0x7f1a480d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:11.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.338+0000 7f1a4df80640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1a480b3cb0 0x7f1a4815f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:11.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.338+0000 7f1a4df80640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a480d38c0 con 0x7f1a480b35f0 2023-11-28T18:38:11.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.338+0000 7f1a4df80640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a480d40d0 con 0x7f1a480cfed0 2023-11-28T18:38:11.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.338+0000 7f1a4df80640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a480cdcc0 con 0x7f1a480b3cb0 2023-11-28T18:38:11.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.338+0000 7f1a46ffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f1a480cfed0 0x7f1a480d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:11.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.338+0000 7f1a47fff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1a480b3cb0 0x7f1a4815f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:11.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.338+0000 7f1a46ffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f1a480cfed0 0x7f1a480d0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.45:41262/0 (socket says 172.21.15.45:41262) 2023-11-28T18:38:11.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.338+0000 7f1a46ffd640 1 -- 172.21.15.45:0/17916030 learned_addr learned my addr 172.21.15.45:0/17916030 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:11.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.338+0000 7f1a46ffd640 1 -- 172.21.15.45:0/17916030 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1a480b3cb0 msgr2=0x7f1a4815f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:11.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.338+0000 7f1a46ffd640 1 --2- 172.21.15.45:0/17916030 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1a480b3cb0 0x7f1a4815f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:11.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.338+0000 7f1a46ffd640 1 -- 172.21.15.45:0/17916030 >> v1:172.21.15.190:6789/0 conn(0x7f1a480b35f0 legacy=0x7f1a480cf7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:11.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.338+0000 7f1a46ffd640 1 -- 172.21.15.45:0/17916030 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a480d3b10 con 0x7f1a480cfed0 2023-11-28T18:38:11.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.338+0000 7f1a467fc640 1 -- 172.21.15.45:0/17916030 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 91044620 0 0) 0x7f1a480d38c0 con 0x7f1a480b35f0 2023-11-28T18:38:11.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.342+0000 7f1a46ffd640 1 --2- 172.21.15.45:0/17916030 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1a480cfed0 0x7f1a480d0f90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c009870 tx=0x7f1a3c01c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e34e332d38ce8d4d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:11.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.342+0000 7f1a467fc640 1 -- 172.21.15.45:0/17916030 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c0a9400 con 0x7f1a480cfed0 2023-11-28T18:38:11.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.342+0000 7f1a467fc640 1 -- 172.21.15.45:0/17916030 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a3c0a9560 con 0x7f1a480cfed0 2023-11-28T18:38:11.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.342+0000 7f1a467fc640 1 -- 172.21.15.45:0/17916030 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c0a98f0 con 0x7f1a480cfed0 2023-11-28T18:38:11.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.342+0000 7f1a4df80640 1 -- 172.21.15.45:0/17916030 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1a480cfed0 msgr2=0x7f1a480d0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:11.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.342+0000 7f1a4df80640 1 --2- 172.21.15.45:0/17916030 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1a480cfed0 0x7f1a480d0f90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c009870 tx=0x7f1a3c01c540 comp rx=0 tx=0).stop 2023-11-28T18:38:11.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.342+0000 7f1a4df80640 1 -- 172.21.15.45:0/17916030 shutdown_connections 2023-11-28T18:38:11.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.342+0000 7f1a4df80640 1 --2- 172.21.15.45:0/17916030 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1a480b3cb0 0x7f1a4815f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:11.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.342+0000 7f1a4df80640 1 --2- 172.21.15.45:0/17916030 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1a480cfed0 0x7f1a480d0f90 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:11.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.342+0000 7f1a4df80640 1 -- 172.21.15.45:0/17916030 >> 172.21.15.45:0/17916030 conn(0x7f1a4809c4f0 msgr2=0x7f1a480d31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:11.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.342+0000 7f1a4df80640 1 -- 172.21.15.45:0/17916030 shutdown_connections 2023-11-28T18:38:11.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.342+0000 7f1a4df80640 1 -- 172.21.15.45:0/17916030 wait complete. 2023-11-28T18:38:11.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.346+0000 7f1a4df80640 1 Processor -- start 2023-11-28T18:38:11.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.346+0000 7f1a4df80640 1 -- start start 2023-11-28T18:38:11.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.346+0000 7f1a4df80640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1a480b35f0 0x7f1a4814c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:11.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.346+0000 7f1a4df80640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1a480b3cb0 0x7f1a4809f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:11.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.346+0000 7f1a4df80640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a480cfed0 0x7f1a480cc450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:11.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.346+0000 7f1a4df80640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a480a0050 con 0x7f1a480cfed0 2023-11-28T18:38:11.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.346+0000 7f1a4df80640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a480a0330 con 0x7f1a480b35f0 2023-11-28T18:38:11.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.346+0000 7f1a4df80640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a480a0610 con 0x7f1a480b3cb0 2023-11-28T18:38:11.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.346+0000 7f1a47fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a480cfed0 0x7f1a480cc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:11.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.346+0000 7f1a47fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a480cfed0 0x7f1a480cc450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54056/0 (socket says 172.21.15.45:54056) 2023-11-28T18:38:11.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.346+0000 7f1a47fff640 1 -- 172.21.15.45:0/234924484 learned_addr learned my addr 172.21.15.45:0/234924484 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:11.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.346+0000 7f1a46ffd640 1 --2- 172.21.15.45:0/234924484 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1a480b3cb0 0x7f1a4809f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:11.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.346+0000 7f1a477fe640 1 --2- 172.21.15.45:0/234924484 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1a480b35f0 0x7f1a4814c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:11.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.346+0000 7f1a47fff640 1 -- 172.21.15.45:0/234924484 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1a480b3cb0 msgr2=0x7f1a4809f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:11.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.346+0000 7f1a47fff640 1 --2- 172.21.15.45:0/234924484 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1a480b3cb0 0x7f1a4809f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:11.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.346+0000 7f1a47fff640 1 -- 172.21.15.45:0/234924484 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1a480b35f0 msgr2=0x7f1a4814c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:11.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.346+0000 7f1a47fff640 1 --2- 172.21.15.45:0/234924484 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1a480b35f0 0x7f1a4814c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:11.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.346+0000 7f1a47fff640 1 -- 172.21.15.45:0/234924484 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a3c0094d0 con 0x7f1a480cfed0 2023-11-28T18:38:11.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.346+0000 7f1a47fff640 1 --2- 172.21.15.45:0/234924484 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a480cfed0 0x7f1a480cc450 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1a4000efc0 tx=0x7f1a4000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:11.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.346+0000 7f1a2ffff640 1 -- 172.21.15.45:0/234924484 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a40009b10 con 0x7f1a480cfed0 2023-11-28T18:38:11.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.346+0000 7f1a2ffff640 1 -- 172.21.15.45:0/234924484 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a4000f040 con 0x7f1a480cfed0 2023-11-28T18:38:11.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.346+0000 7f1a4df80640 1 -- 172.21.15.45:0/234924484 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a480b5ed0 con 0x7f1a480cfed0 2023-11-28T18:38:11.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.346+0000 7f1a2ffff640 1 -- 172.21.15.45:0/234924484 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a400146c0 con 0x7f1a480cfed0 2023-11-28T18:38:11.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.346+0000 7f1a4df80640 1 -- 172.21.15.45:0/234924484 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a4814c950 con 0x7f1a480cfed0 2023-11-28T18:38:11.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.350+0000 7f1a4df80640 1 -- 172.21.15.45:0/234924484 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a48069480 con 0x7f1a480cfed0 2023-11-28T18:38:11.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.350+0000 7f1a2ffff640 1 -- 172.21.15.45:0/234924484 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f1a40014820 con 0x7f1a480cfed0 2023-11-28T18:38:11.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.350+0000 7f1a2ffff640 1 --2- 172.21.15.45:0/234924484 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1a340668d0 0x7f1a34068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:11.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.350+0000 7f1a2ffff640 1 -- 172.21.15.45:0/234924484 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1a40085080 con 0x7f1a480cfed0 2023-11-28T18:38:11.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.350+0000 7f1a477fe640 1 --2- 172.21.15.45:0/234924484 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1a340668d0 0x7f1a34068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:11.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.350+0000 7f1a477fe640 1 --2- 172.21.15.45:0/234924484 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1a340668d0 0x7f1a34068d90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1a38000f70 tx=0x7f1a38009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:11.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.354+0000 7f1a2ffff640 1 -- 172.21.15.45:0/234924484 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1a400b6280 con 0x7f1a480cfed0 2023-11-28T18:38:11.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.510+0000 7f1a4df80640 1 -- 172.21.15.45:0/234924484 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1a480b6380 con 0x7f1a480cfed0 2023-11-28T18:38:11.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.510+0000 7f1a2ffff640 1 -- 172.21.15.45:0/234924484 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16469 (secure 0 0 0) 0x7f1a40018070 con 0x7f1a480cfed0 2023-11-28T18:38:11.514 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:38:11.514 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":20,"fsid":"d10f5cd6-1d00-4019-99b6-6fa435498a15","created":"2023-11-28T18:37:08.189030+0000","modified":"2023-11-28T18:37:33.971141+0000","last_up_change":"2023-11-28T18:37:20.196124+0000","last_in_change":"2023-11-28T18:37:10.742043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T18:37:21.293917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T18:37:31.384760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T18:37:31.834769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"84465384-103c-4f2c-a45a-96f5bb9c835f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6809","nonce":555237322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6811","nonce":555237322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6815","nonce":555237322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6813","nonce":555237322}]},"public_addr":"172.21.15.45:6809/555237322","cluster_addr":"172.21.15.45:6811/555237322","heartbeat_back_addr":"172.21.15.45:6815/555237322","heartbeat_front_addr":"172.21.15.45:6813/555237322","state":["exists","up"]},{"osd":1,"uuid":"7d9eed24-a58f-42c7-a787-ac06be8553fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6801","nonce":2857063763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6803","nonce":2857063763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6807","nonce":2857063763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6805","nonce":2857063763}]},"public_addr":"172.21.15.45:6801/2857063763","cluster_addr":"172.21.15.45:6803/2857063763","heartbeat_back_addr":"172.21.15.45:6807/2857063763","heartbeat_front_addr":"172.21.15.45:6805/2857063763","state":["exists","up"]},{"osd":2,"uuid":"575eeccc-4abf-45b4-9caf-f3e797859588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6817","nonce":193884539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6819","nonce":193884539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6823","nonce":193884539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6821","nonce":193884539}]},"public_addr":"172.21.15.45:6817/193884539","cluster_addr":"172.21.15.45:6819/193884539","heartbeat_back_addr":"172.21.15.45:6823/193884539","heartbeat_front_addr":"172.21.15.45:6821/193884539","state":["exists","up"]},{"osd":3,"uuid":"9b0290d6-9a52-4bc8-b2a1-7622c5dc8e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6825","nonce":78541084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6827","nonce":78541084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6831","nonce":78541084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6829","nonce":78541084}]},"public_addr":"172.21.15.45:6825/78541084","cluster_addr":"172.21.15.45:6827/78541084","heartbeat_back_addr":"172.21.15.45:6831/78541084","heartbeat_front_addr":"172.21.15.45:6829/78541084","state":["exists","up"]},{"osd":4,"uuid":"ce632829-f027-4fbf-a627-02c571aa9d53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6809","nonce":1537591987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6811","nonce":1537591987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6815","nonce":1537591987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6813","nonce":1537591987}]},"public_addr":"172.21.15.190:6809/1537591987","cluster_addr":"172.21.15.190:6811/1537591987","heartbeat_back_addr":"172.21.15.190:6815/1537591987","heartbeat_front_addr":"172.21.15.190:6813/1537591987","state":["exists","up"]},{"osd":5,"uuid":"8700b609-27be-40bd-a251-4c0ae0a29ead","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6801","nonce":3296698407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6803","nonce":3296698407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6807","nonce":3296698407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6805","nonce":3296698407}]},"public_addr":"172.21.15.190:6801/3296698407","cluster_addr":"172.21.15.190:6803/3296698407","heartbeat_back_addr":"172.21.15.190:6807/3296698407","heartbeat_front_addr":"172.21.15.190:6805/3296698407","state":["exists","up"]},{"osd":6,"uuid":"44ce4a40-e6ff-4f4d-8e8a-7341e5c91f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6817","nonce":2317686718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6819","nonce":2317686718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6823","nonce":2317686718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6821","nonce":2317686718}]},"public_addr":"172.21.15.190:6817/2317686718","cluster_addr":"172.21.15.190:6819/2317686718","heartbeat_back_addr":"172.21.15.190:6823/2317686718","heartbeat_front_addr":"172.21.15.190:6821/2317686718","state":["exists","up"]},{"osd":7,"uuid":"192238c9-1423-4b7e-ac8f-84ba32113ddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6825","nonce":2493232051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6827","nonce":2493232051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6831","nonce":2493232051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6829","nonce":2493232051}]},"public_addr":"172.21.15.190:6825/2493232051","cluster_addr":"172.21.15.190:6827/2493232051","heartbeat_back_addr":"172.21.15.190:6831/2493232051","heartbeat_front_addr":"172.21.15.190:6829/2493232051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.393552+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.385453+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.361421+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.366408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.363226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.276007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.414605+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.445885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T18:38:11.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.514+0000 7f1a4df80640 1 -- 172.21.15.45:0/234924484 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1a340668d0 msgr2=0x7f1a34068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:11.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.514+0000 7f1a4df80640 1 --2- 172.21.15.45:0/234924484 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1a340668d0 0x7f1a34068d90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1a38000f70 tx=0x7f1a38009040 comp rx=0 tx=0).stop 2023-11-28T18:38:11.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.514+0000 7f1a4df80640 1 -- 172.21.15.45:0/234924484 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a480cfed0 msgr2=0x7f1a480cc450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:11.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.514+0000 7f1a4df80640 1 --2- 172.21.15.45:0/234924484 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a480cfed0 0x7f1a480cc450 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1a4000efc0 tx=0x7f1a4000c490 comp rx=0 tx=0).stop 2023-11-28T18:38:11.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.514+0000 7f1a4df80640 1 -- 172.21.15.45:0/234924484 shutdown_connections 2023-11-28T18:38:11.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.514+0000 7f1a4df80640 1 --2- 172.21.15.45:0/234924484 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1a340668d0 0x7f1a34068d90 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:11.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.514+0000 7f1a4df80640 1 --2- 172.21.15.45:0/234924484 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a480cfed0 0x7f1a480cc450 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:11.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.514+0000 7f1a4df80640 1 --2- 172.21.15.45:0/234924484 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1a480b3cb0 0x7f1a4809f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:11.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.514+0000 7f1a4df80640 1 --2- 172.21.15.45:0/234924484 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1a480b35f0 0x7f1a4814c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:11.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.514+0000 7f1a4df80640 1 -- 172.21.15.45:0/234924484 >> 172.21.15.45:0/234924484 conn(0x7f1a4809c4f0 msgr2=0x7f1a480b0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:11.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.514+0000 7f1a4df80640 1 -- 172.21.15.45:0/234924484 shutdown_connections 2023-11-28T18:38:11.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.514+0000 7f1a4df80640 1 -- 172.21.15.45:0/234924484 wait complete. 2023-11-28T18:38:11.536 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T18:37:21.293917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T18:37:31.384760+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T18:37:31.834769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T18:38:11.536 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T18:38:11.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.678+0000 7fc2b050f640 1 Processor -- start 2023-11-28T18:38:11.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.678+0000 7fc2b050f640 1 -- start start 2023-11-28T18:38:11.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.682+0000 7fc2b050f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2a81409a0 0x7fc2a8140e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:11.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.682+0000 7fc2b050f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc2a80ae920 0x7fc2a80aed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:11.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.682+0000 7fc2b050f640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2a80ad5e0 con 0x7fc2a81401f0 2023-11-28T18:38:11.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.682+0000 7fc2b050f640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2a80ad880 con 0x7fc2a80ae920 2023-11-28T18:38:11.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.682+0000 7fc2b050f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a80adb60 con 0x7fc2a81409a0 2023-11-28T18:38:11.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.682+0000 7fc2ae2ab640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fc2a81401f0 0x7fc2a8161730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45768/0 (socket says 172.21.15.45:45768) 2023-11-28T18:38:11.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.682+0000 7fc2ae2ab640 1 -- 172.21.15.45:0/2449807215 learned_addr learned my addr 172.21.15.45:0/2449807215 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:38:11.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.682+0000 7fc2aeaac640 1 --2- 172.21.15.45:0/2449807215 >> v2:172.21.15.45:3300/0 conn(0x7fc2a80ae920 0x7fc2a80aed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:11.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.682+0000 7fc2adaaa640 1 --2- 172.21.15.45:0/2449807215 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2a81409a0 0x7fc2a8140e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:11.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.682+0000 7fc2aeaac640 1 -- 172.21.15.45:0/2449807215 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2a81409a0 msgr2=0x7fc2a8140e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:11.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.682+0000 7fc2aeaac640 1 --2- 172.21.15.45:0/2449807215 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2a81409a0 0x7fc2a8140e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:11.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.682+0000 7fc2aeaac640 1 -- 172.21.15.45:0/2449807215 >> v1:172.21.15.45:6789/0 conn(0x7fc2a81401f0 legacy=0x7fc2a8161730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:11.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.682+0000 7fc2aeaac640 1 -- 172.21.15.45:0/2449807215 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a80ade40 con 0x7fc2a80ae920 2023-11-28T18:38:11.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.682+0000 7fc2ad2a9640 1 -- 172.21.15.45:0/2449807215 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3104733801 0 0) 0x7fc2a80ad5e0 con 0x7fc2a81401f0 2023-11-28T18:38:11.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.682+0000 7fc2adaaa640 1 --2- 172.21.15.45:0/2449807215 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2a81409a0 0x7fc2a8140e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:38:11.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.686+0000 7fc2aeaac640 1 --2- 172.21.15.45:0/2449807215 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2a80ae920 0x7fc2a80aed90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc2a0009d90 tx=0x7fc2a001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c18a2dcda77e202 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:11.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.686+0000 7fc2ad2a9640 1 -- 172.21.15.45:0/2449807215 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a00a5900 con 0x7fc2a80ae920 2023-11-28T18:38:11.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.686+0000 7fc2ad2a9640 1 -- 172.21.15.45:0/2449807215 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2a00a5a60 con 0x7fc2a80ae920 2023-11-28T18:38:11.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.686+0000 7fc2ad2a9640 1 -- 172.21.15.45:0/2449807215 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a00a5df0 con 0x7fc2a80ae920 2023-11-28T18:38:11.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.686+0000 7fc2b050f640 1 -- 172.21.15.45:0/2449807215 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2a80ae920 msgr2=0x7fc2a80aed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:11.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.686+0000 7fc2b050f640 1 --2- 172.21.15.45:0/2449807215 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2a80ae920 0x7fc2a80aed90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc2a0009d90 tx=0x7fc2a001c950 comp rx=0 tx=0).stop 2023-11-28T18:38:11.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.686+0000 7fc2b050f640 1 -- 172.21.15.45:0/2449807215 shutdown_connections 2023-11-28T18:38:11.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.686+0000 7fc2b050f640 1 --2- 172.21.15.45:0/2449807215 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2a80ae920 0x7fc2a80aed90 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:11.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.686+0000 7fc2b050f640 1 --2- 172.21.15.45:0/2449807215 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2a81409a0 0x7fc2a8140e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:11.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.686+0000 7fc2b050f640 1 -- 172.21.15.45:0/2449807215 >> 172.21.15.45:0/2449807215 conn(0x7fc2a80b1b70 msgr2=0x7fc2a8070cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:11.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.686+0000 7fc2b050f640 1 -- 172.21.15.45:0/2449807215 shutdown_connections 2023-11-28T18:38:11.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.686+0000 7fc2b050f640 1 -- 172.21.15.45:0/2449807215 wait complete. 2023-11-28T18:38:11.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.686+0000 7fc2b050f640 1 Processor -- start 2023-11-28T18:38:11.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.686+0000 7fc2b050f640 1 -- start start 2023-11-28T18:38:11.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.686+0000 7fc2b050f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2a80ae920 0x7fc2a813e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:11.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.686+0000 7fc2b050f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2a81401f0 0x7fc2a813ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:11.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.686+0000 7fc2b050f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2a81409a0 0x7fc2a8139b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:11.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.686+0000 7fc2b050f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a813c370 con 0x7fc2a80ae920 2023-11-28T18:38:11.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.686+0000 7fc2b050f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a815da10 con 0x7fc2a81409a0 2023-11-28T18:38:11.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.686+0000 7fc2b050f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a815dcf0 con 0x7fc2a81401f0 2023-11-28T18:38:11.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.690+0000 7fc2ae2ab640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2a80ae920 0x7fc2a813e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:11.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.690+0000 7fc2ae2ab640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2a80ae920 0x7fc2a813e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54066/0 (socket says 172.21.15.45:54066) 2023-11-28T18:38:11.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.690+0000 7fc2ae2ab640 1 -- 172.21.15.45:0/1538789683 learned_addr learned my addr 172.21.15.45:0/1538789683 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:11.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.690+0000 7fc2ae2ab640 1 -- 172.21.15.45:0/1538789683 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2a81401f0 msgr2=0x7fc2a813ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:11.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.690+0000 7fc2ae2ab640 1 --2- 172.21.15.45:0/1538789683 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2a81401f0 0x7fc2a813ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:11.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.690+0000 7fc2ae2ab640 1 -- 172.21.15.45:0/1538789683 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2a81409a0 msgr2=0x7fc2a8139b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:11.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.690+0000 7fc2ae2ab640 1 --2- 172.21.15.45:0/1538789683 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2a81409a0 0x7fc2a8139b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:11.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.690+0000 7fc2ae2ab640 1 -- 172.21.15.45:0/1538789683 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a0009a70 con 0x7fc2a80ae920 2023-11-28T18:38:11.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.690+0000 7fc2ae2ab640 1 --2- 172.21.15.45:0/1538789683 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2a80ae920 0x7fc2a813e840 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc2a40011f0 tx=0x7fc2a400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:11.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.690+0000 7fc29effd640 1 -- 172.21.15.45:0/1538789683 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a40074e0 con 0x7fc2a80ae920 2023-11-28T18:38:11.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.690+0000 7fc29effd640 1 -- 172.21.15.45:0/1538789683 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2a4007640 con 0x7fc2a80ae920 2023-11-28T18:38:11.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.690+0000 7fc29effd640 1 -- 172.21.15.45:0/1538789683 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a4004a10 con 0x7fc2a80ae920 2023-11-28T18:38:11.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.690+0000 7fc2b050f640 1 -- 172.21.15.45:0/1538789683 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2a815dfd0 con 0x7fc2a80ae920 2023-11-28T18:38:11.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.690+0000 7fc2b050f640 1 -- 172.21.15.45:0/1538789683 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2a815e590 con 0x7fc2a80ae920 2023-11-28T18:38:11.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.690+0000 7fc2b050f640 1 -- 172.21.15.45:0/1538789683 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2a815e780 con 0x7fc2a80ae920 2023-11-28T18:38:11.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.690+0000 7fc29effd640 1 -- 172.21.15.45:0/1538789683 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fc2a4004b70 con 0x7fc2a80ae920 2023-11-28T18:38:11.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.694+0000 7fc29effd640 1 --2- 172.21.15.45:0/1538789683 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fc28c066900 0x7fc28c068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:11.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.694+0000 7fc29effd640 1 -- 172.21.15.45:0/1538789683 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc2a4083740 con 0x7fc2a80ae920 2023-11-28T18:38:11.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.694+0000 7fc2adaaa640 1 --2- 172.21.15.45:0/1538789683 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fc28c066900 0x7fc28c068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:11.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.694+0000 7fc2adaaa640 1 --2- 172.21.15.45:0/1538789683 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fc28c066900 0x7fc28c068dc0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc2a813be90 tx=0x7fc298008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:11.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.694+0000 7fc29effd640 1 -- 172.21.15.45:0/1538789683 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc2a4050850 con 0x7fc2a80ae920 2023-11-28T18:38:11.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.854+0000 7fc2b050f640 1 -- 172.21.15.45:0/1538789683 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc2a8069410 con 0x7fc2a80ae920 2023-11-28T18:38:11.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.854+0000 7fc29effd640 1 -- 172.21.15.45:0/1538789683 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc2a40180a0 con 0x7fc2a80ae920 2023-11-28T18:38:11.856 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-11-28T18:38:11.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.854+0000 7fc2b050f640 1 -- 172.21.15.45:0/1538789683 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fc28c066900 msgr2=0x7fc28c068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:11.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.854+0000 7fc2b050f640 1 --2- 172.21.15.45:0/1538789683 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fc28c066900 0x7fc28c068dc0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc2a813be90 tx=0x7fc298008040 comp rx=0 tx=0).stop 2023-11-28T18:38:11.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.854+0000 7fc2b050f640 1 -- 172.21.15.45:0/1538789683 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2a80ae920 msgr2=0x7fc2a813e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:11.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.854+0000 7fc2b050f640 1 --2- 172.21.15.45:0/1538789683 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2a80ae920 0x7fc2a813e840 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc2a40011f0 tx=0x7fc2a400c9b0 comp rx=0 tx=0).stop 2023-11-28T18:38:11.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.854+0000 7fc2b050f640 1 -- 172.21.15.45:0/1538789683 shutdown_connections 2023-11-28T18:38:11.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.854+0000 7fc2b050f640 1 --2- 172.21.15.45:0/1538789683 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fc28c066900 0x7fc28c068dc0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:11.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.854+0000 7fc2b050f640 1 --2- 172.21.15.45:0/1538789683 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2a81409a0 0x7fc2a8139b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:11.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.854+0000 7fc2b050f640 1 --2- 172.21.15.45:0/1538789683 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2a81401f0 0x7fc2a813ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:11.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.854+0000 7fc2b050f640 1 --2- 172.21.15.45:0/1538789683 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2a80ae920 0x7fc2a813e840 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:11.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.854+0000 7fc2b050f640 1 -- 172.21.15.45:0/1538789683 >> 172.21.15.45:0/1538789683 conn(0x7fc2a80b1b70 msgr2=0x7fc2a80b3a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:11.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.854+0000 7fc2b050f640 1 -- 172.21.15.45:0/1538789683 shutdown_connections 2023-11-28T18:38:11.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:11.854+0000 7fc2b050f640 1 -- 172.21.15.45:0/1538789683 wait complete. 2023-11-28T18:38:11.877 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T18:38:12.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.022+0000 7f1b5385a640 1 Processor -- start 2023-11-28T18:38:12.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.022+0000 7f1b5385a640 1 -- start start 2023-11-28T18:38:12.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.022+0000 7f1b5385a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b4c161530 0x7f1b4c0b4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:12.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.022+0000 7f1b5385a640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f1b4c0ac880 0x7f1b4c070e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:12.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.022+0000 7f1b5385a640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b4c0b23d0 con 0x7f1b4c145ee0 2023-11-28T18:38:12.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.022+0000 7f1b5385a640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b4c146550 con 0x7f1b4c0ac880 2023-11-28T18:38:12.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.022+0000 7f1b5385a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4c0b20a0 con 0x7f1b4c161530 2023-11-28T18:38:12.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.022+0000 7f1b515f6640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f1b4c145ee0 0x7f1b4c160e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45780/0 (socket says 172.21.15.45:45780) 2023-11-28T18:38:12.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.022+0000 7f1b515f6640 1 -- 172.21.15.45:0/799098778 learned_addr learned my addr 172.21.15.45:0/799098778 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:38:12.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.022+0000 7f1b51df7640 1 --2- 172.21.15.45:0/799098778 >> v2:172.21.15.190:3300/0 conn(0x7f1b4c0ac880 0x7f1b4c070e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:12.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.022+0000 7f1b50df5640 1 --2- 172.21.15.45:0/799098778 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b4c161530 0x7f1b4c0b4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:12.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.022+0000 7f1b43fff640 1 -- 172.21.15.45:0/799098778 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2008149484 0 0) 0x7f1b4c0b23d0 con 0x7f1b4c145ee0 2023-11-28T18:38:12.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.022+0000 7f1b43fff640 1 -- 172.21.15.45:0/799098778 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b38003530 con 0x7f1b4c145ee0 2023-11-28T18:38:12.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.022+0000 7f1b51df7640 1 -- 172.21.15.45:0/799098778 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b4c161530 msgr2=0x7f1b4c0b4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:12.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.022+0000 7f1b51df7640 1 --2- 172.21.15.45:0/799098778 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b4c161530 0x7f1b4c0b4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:12.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.022+0000 7f1b51df7640 1 -- 172.21.15.45:0/799098778 >> v1:172.21.15.45:6789/0 conn(0x7f1b4c145ee0 legacy=0x7f1b4c160e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:12.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.022+0000 7f1b43fff640 1 -- 172.21.15.45:0/799098778 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1184724279 0 0) 0x7f1b38003530 con 0x7f1b4c145ee0 2023-11-28T18:38:12.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.022+0000 7f1b51df7640 1 -- 172.21.15.45:0/799098778 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b4c1467f0 con 0x7f1b4c0ac880 2023-11-28T18:38:12.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.026+0000 7f1b51df7640 1 --2- 172.21.15.45:0/799098778 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b4c0ac880 0x7f1b4c070e40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1b44009d90 tx=0x7f1b4401c870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3dec3af9c8ab8a2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:12.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.026+0000 7f1b43fff640 1 -- 172.21.15.45:0/799098778 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b48001680 con 0x7f1b4c0ac880 2023-11-28T18:38:12.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.026+0000 7f1b43fff640 1 -- 172.21.15.45:0/799098778 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b440a5580 con 0x7f1b4c0ac880 2023-11-28T18:38:12.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.026+0000 7f1b43fff640 1 -- 172.21.15.45:0/799098778 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b440a5910 con 0x7f1b4c0ac880 2023-11-28T18:38:12.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.026+0000 7f1b5385a640 1 -- 172.21.15.45:0/799098778 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b4c0ac880 msgr2=0x7f1b4c070e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:12.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.026+0000 7f1b5385a640 1 --2- 172.21.15.45:0/799098778 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b4c0ac880 0x7f1b4c070e40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1b44009d90 tx=0x7f1b4401c870 comp rx=0 tx=0).stop 2023-11-28T18:38:12.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.026+0000 7f1b5385a640 1 -- 172.21.15.45:0/799098778 shutdown_connections 2023-11-28T18:38:12.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.026+0000 7f1b5385a640 1 --2- 172.21.15.45:0/799098778 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b4c0ac880 0x7f1b4c070e40 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:12.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.026+0000 7f1b5385a640 1 --2- 172.21.15.45:0/799098778 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b4c161530 0x7f1b4c0b4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:12.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.026+0000 7f1b5385a640 1 -- 172.21.15.45:0/799098778 >> 172.21.15.45:0/799098778 conn(0x7f1b4c0b0d00 msgr2=0x7f1b4c0b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:12.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.026+0000 7f1b5385a640 1 -- 172.21.15.45:0/799098778 shutdown_connections 2023-11-28T18:38:12.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.030+0000 7f1b5385a640 1 -- 172.21.15.45:0/799098778 wait complete. 2023-11-28T18:38:12.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.030+0000 7f1b5385a640 1 Processor -- start 2023-11-28T18:38:12.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.030+0000 7f1b5385a640 1 -- start start 2023-11-28T18:38:12.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.030+0000 7f1b5385a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b4c0ac880 0x7f1b4c15d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:12.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.030+0000 7f1b5385a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b4c145ee0 0x7f1b4c15f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:12.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.030+0000 7f1b5385a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b4c161530 0x7f1b4c13f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:12.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.030+0000 7f1b5385a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4c15da20 con 0x7f1b4c145ee0 2023-11-28T18:38:12.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.030+0000 7f1b5385a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4c15dd00 con 0x7f1b4c161530 2023-11-28T18:38:12.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.030+0000 7f1b5385a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4c15dfe0 con 0x7f1b4c0ac880 2023-11-28T18:38:12.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.030+0000 7f1b50df5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b4c145ee0 0x7f1b4c15f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:12.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.030+0000 7f1b50df5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b4c145ee0 0x7f1b4c15f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54070/0 (socket says 172.21.15.45:54070) 2023-11-28T18:38:12.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.030+0000 7f1b50df5640 1 -- 172.21.15.45:0/129480612 learned_addr learned my addr 172.21.15.45:0/129480612 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:12.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.030+0000 7f1b51df7640 1 --2- 172.21.15.45:0/129480612 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b4c161530 0x7f1b4c13f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:12.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.030+0000 7f1b515f6640 1 --2- 172.21.15.45:0/129480612 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b4c0ac880 0x7f1b4c15d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:12.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.030+0000 7f1b50df5640 1 -- 172.21.15.45:0/129480612 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b4c0ac880 msgr2=0x7f1b4c15d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:12.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.030+0000 7f1b50df5640 1 --2- 172.21.15.45:0/129480612 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b4c0ac880 0x7f1b4c15d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:12.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.030+0000 7f1b50df5640 1 -- 172.21.15.45:0/129480612 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b4c161530 msgr2=0x7f1b4c13f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:12.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.030+0000 7f1b50df5640 1 --2- 172.21.15.45:0/129480612 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b4c161530 0x7f1b4c13f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:12.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.030+0000 7f1b50df5640 1 -- 172.21.15.45:0/129480612 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b44009a70 con 0x7f1b4c145ee0 2023-11-28T18:38:12.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.030+0000 7f1b515f6640 1 --2- 172.21.15.45:0/129480612 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b4c0ac880 0x7f1b4c15d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:38:12.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.030+0000 7f1b50df5640 1 --2- 172.21.15.45:0/129480612 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b4c145ee0 0x7f1b4c15f970 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c00e930 tx=0x7f1b3c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:12.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.030+0000 7f1b41ffb640 1 -- 172.21.15.45:0/129480612 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3c009690 con 0x7f1b4c145ee0 2023-11-28T18:38:12.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.030+0000 7f1b41ffb640 1 -- 172.21.15.45:0/129480612 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b3c00ca00 con 0x7f1b4c145ee0 2023-11-28T18:38:12.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.030+0000 7f1b41ffb640 1 -- 172.21.15.45:0/129480612 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3c00cd70 con 0x7f1b4c145ee0 2023-11-28T18:38:12.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.030+0000 7f1b5385a640 1 -- 172.21.15.45:0/129480612 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b4c15e2c0 con 0x7f1b4c145ee0 2023-11-28T18:38:12.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.034+0000 7f1b5385a640 1 -- 172.21.15.45:0/129480612 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b4c15c800 con 0x7f1b4c145ee0 2023-11-28T18:38:12.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.034+0000 7f1b5385a640 1 -- 172.21.15.45:0/129480612 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b4c069410 con 0x7f1b4c145ee0 2023-11-28T18:38:12.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.034+0000 7f1b41ffb640 1 -- 172.21.15.45:0/129480612 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f1b3c013470 con 0x7f1b4c145ee0 2023-11-28T18:38:12.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.034+0000 7f1b41ffb640 1 --2- 172.21.15.45:0/129480612 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1b30066900 0x7f1b30068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:12.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.034+0000 7f1b41ffb640 1 -- 172.21.15.45:0/129480612 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1b3c084600 con 0x7f1b4c145ee0 2023-11-28T18:38:12.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.038+0000 7f1b515f6640 1 --2- 172.21.15.45:0/129480612 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1b30066900 0x7f1b30068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:12.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.038+0000 7f1b515f6640 1 --2- 172.21.15.45:0/129480612 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1b30066900 0x7f1b30068dc0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1b48005890 tx=0x7f1b48009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:12.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.038+0000 7f1b41ffb640 1 -- 172.21.15.45:0/129480612 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1b3c051910 con 0x7f1b4c145ee0 2023-11-28T18:38:12.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.194+0000 7f1b5385a640 1 -- 172.21.15.45:0/129480612 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1b4c167f90 con 0x7f1b4c145ee0 2023-11-28T18:38:12.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.194+0000 7f1b41ffb640 1 -- 172.21.15.45:0/129480612 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1b3c054f30 con 0x7f1b4c145ee0 2023-11-28T18:38:12.198 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-11-28T18:38:12.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.198+0000 7f1b5385a640 1 -- 172.21.15.45:0/129480612 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1b30066900 msgr2=0x7f1b30068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:12.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.198+0000 7f1b5385a640 1 --2- 172.21.15.45:0/129480612 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1b30066900 0x7f1b30068dc0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1b48005890 tx=0x7f1b48009040 comp rx=0 tx=0).stop 2023-11-28T18:38:12.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.198+0000 7f1b5385a640 1 -- 172.21.15.45:0/129480612 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b4c145ee0 msgr2=0x7f1b4c15f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:12.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.198+0000 7f1b5385a640 1 --2- 172.21.15.45:0/129480612 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b4c145ee0 0x7f1b4c15f970 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c00e930 tx=0x7f1b3c00edf0 comp rx=0 tx=0).stop 2023-11-28T18:38:12.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.198+0000 7f1b5385a640 1 -- 172.21.15.45:0/129480612 shutdown_connections 2023-11-28T18:38:12.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.198+0000 7f1b5385a640 1 --2- 172.21.15.45:0/129480612 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1b30066900 0x7f1b30068dc0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:12.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.198+0000 7f1b5385a640 1 --2- 172.21.15.45:0/129480612 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b4c161530 0x7f1b4c13f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:12.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.198+0000 7f1b5385a640 1 --2- 172.21.15.45:0/129480612 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b4c145ee0 0x7f1b4c15f970 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:12.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.198+0000 7f1b5385a640 1 --2- 172.21.15.45:0/129480612 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b4c0ac880 0x7f1b4c15d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:12.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.198+0000 7f1b5385a640 1 -- 172.21.15.45:0/129480612 >> 172.21.15.45:0/129480612 conn(0x7f1b4c0b0d00 msgr2=0x7f1b4c0b03e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:12.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.198+0000 7f1b5385a640 1 -- 172.21.15.45:0/129480612 shutdown_connections 2023-11-28T18:38:12.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.198+0000 7f1b5385a640 1 -- 172.21.15.45:0/129480612 wait complete. 2023-11-28T18:38:12.219 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T18:38:12.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.362+0000 7f36de6dd640 1 Processor -- start 2023-11-28T18:38:12.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.366+0000 7f36de6dd640 1 -- start start 2023-11-28T18:38:12.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.366+0000 7f36de6dd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f36d80ced80 0x7f36d806b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:12.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.366+0000 7f36de6dd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f36d815e4d0 0x7f36d806bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:12.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.366+0000 7f36de6dd640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36d80af1c0 con 0x7f36d80ce9a0 2023-11-28T18:38:12.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.366+0000 7f36de6dd640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36d80ae920 con 0x7f36d815e4d0 2023-11-28T18:38:12.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.366+0000 7f36de6dd640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36d80aec00 con 0x7f36d80ced80 2023-11-28T18:38:12.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.366+0000 7f36d7fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f36d80ce9a0 0x7f36d80ae0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45796/0 (socket says 172.21.15.45:45796) 2023-11-28T18:38:12.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.366+0000 7f36d7fff640 1 -- 172.21.15.45:0/717901750 learned_addr learned my addr 172.21.15.45:0/717901750 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:38:12.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.366+0000 7f36dcc7a640 1 --2- 172.21.15.45:0/717901750 >> v2:172.21.15.45:3300/0 conn(0x7f36d815e4d0 0x7f36d806bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:12.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.366+0000 7f36dcc7a640 1 -- 172.21.15.45:0/717901750 >> v2:172.21.15.190:3300/0 conn(0x7f36d80ced80 msgr2=0x7f36d806b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:12.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.366+0000 7f36d77fe640 1 --2- 172.21.15.45:0/717901750 >> v2:172.21.15.190:3300/0 conn(0x7f36d80ced80 0x7f36d806b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:12.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.366+0000 7f36d6ffd640 1 -- 172.21.15.45:0/717901750 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3798312965 0 0) 0x7f36d80af1c0 con 0x7f36d80ce9a0 2023-11-28T18:38:12.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.366+0000 7f36dcc7a640 1 --2- 172.21.15.45:0/717901750 >> v2:172.21.15.190:3300/0 conn(0x7f36d80ced80 0x7f36d806b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:12.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.366+0000 7f36dcc7a640 1 -- 172.21.15.45:0/717901750 >> v1:172.21.15.45:6789/0 conn(0x7f36d80ce9a0 legacy=0x7f36d80ae0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:12.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.366+0000 7f36dcc7a640 1 -- 172.21.15.45:0/717901750 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36d80aeee0 con 0x7f36d815e4d0 2023-11-28T18:38:12.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.366+0000 7f36d77fe640 1 --2- 172.21.15.45:0/717901750 >> v2:172.21.15.190:3300/0 conn(0x7f36d80ced80 0x7f36d806b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:38:12.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.370+0000 7f36dcc7a640 1 --2- 172.21.15.45:0/717901750 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36d815e4d0 0x7f36d806bac0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f36d806ed80 tx=0x7f36d001c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d208c1153158f700 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:12.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.370+0000 7f36d6ffd640 1 -- 172.21.15.45:0/717901750 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d00a58a0 con 0x7f36d815e4d0 2023-11-28T18:38:12.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.370+0000 7f36d6ffd640 1 -- 172.21.15.45:0/717901750 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36d00a5a00 con 0x7f36d815e4d0 2023-11-28T18:38:12.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.370+0000 7f36d6ffd640 1 -- 172.21.15.45:0/717901750 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d00a5d90 con 0x7f36d815e4d0 2023-11-28T18:38:12.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.370+0000 7f36de6dd640 1 -- 172.21.15.45:0/717901750 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36d815e4d0 msgr2=0x7f36d806bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:12.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.370+0000 7f36de6dd640 1 --2- 172.21.15.45:0/717901750 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36d815e4d0 0x7f36d806bac0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f36d806ed80 tx=0x7f36d001c7c0 comp rx=0 tx=0).stop 2023-11-28T18:38:12.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.370+0000 7f36de6dd640 1 -- 172.21.15.45:0/717901750 shutdown_connections 2023-11-28T18:38:12.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.370+0000 7f36de6dd640 1 --2- 172.21.15.45:0/717901750 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36d815e4d0 0x7f36d806bac0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:12.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.370+0000 7f36de6dd640 1 --2- 172.21.15.45:0/717901750 >> v2:172.21.15.190:3300/0 conn(0x7f36d80ced80 0x7f36d806b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:12.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.370+0000 7f36de6dd640 1 -- 172.21.15.45:0/717901750 >> 172.21.15.45:0/717901750 conn(0x7f36d80b1b70 msgr2=0x7f36d8070cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:12.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.370+0000 7f36de6dd640 1 -- 172.21.15.45:0/717901750 shutdown_connections 2023-11-28T18:38:12.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.370+0000 7f36de6dd640 1 -- 172.21.15.45:0/717901750 wait complete. 2023-11-28T18:38:12.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.370+0000 7f36de6dd640 1 Processor -- start 2023-11-28T18:38:12.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.374+0000 7f36de6dd640 1 -- start start 2023-11-28T18:38:12.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.374+0000 7f36de6dd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f36d80ce9a0 0x7f36d814fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:12.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.374+0000 7f36de6dd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36d80ced80 0x7f36d814a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:12.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.374+0000 7f36de6dd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36d815e4d0 0x7f36d8157440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:12.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.374+0000 7f36de6dd640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d814a960 con 0x7f36d815e4d0 2023-11-28T18:38:12.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.374+0000 7f36de6dd640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d81522c0 con 0x7f36d80ced80 2023-11-28T18:38:12.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.374+0000 7f36de6dd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36d814eb10 con 0x7f36d80ce9a0 2023-11-28T18:38:12.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.374+0000 7f36dcc7a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36d815e4d0 0x7f36d8157440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:12.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.374+0000 7f36dcc7a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36d815e4d0 0x7f36d8157440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54080/0 (socket says 172.21.15.45:54080) 2023-11-28T18:38:12.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.374+0000 7f36dcc7a640 1 -- 172.21.15.45:0/623326483 learned_addr learned my addr 172.21.15.45:0/623326483 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:12.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.374+0000 7f36dcc7a640 1 -- 172.21.15.45:0/623326483 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f36d80ce9a0 msgr2=0x7f36d814fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:12.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.374+0000 7f36dcc7a640 1 --2- 172.21.15.45:0/623326483 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f36d80ce9a0 0x7f36d814fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:12.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.374+0000 7f36dcc7a640 1 -- 172.21.15.45:0/623326483 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36d80ced80 msgr2=0x7f36d814a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:12.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.374+0000 7f36dcc7a640 1 --2- 172.21.15.45:0/623326483 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36d80ced80 0x7f36d814a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:12.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.374+0000 7f36dcc7a640 1 -- 172.21.15.45:0/623326483 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36d0009a70 con 0x7f36d815e4d0 2023-11-28T18:38:12.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.374+0000 7f36dcc7a640 1 --2- 172.21.15.45:0/623326483 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36d815e4d0 0x7f36d8157440 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f36d00b0040 tx=0x7f36d0019560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:12.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.374+0000 7f36d4ff9640 1 -- 172.21.15.45:0/623326483 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d00ad950 con 0x7f36d815e4d0 2023-11-28T18:38:12.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.374+0000 7f36d4ff9640 1 -- 172.21.15.45:0/623326483 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36d00adab0 con 0x7f36d815e4d0 2023-11-28T18:38:12.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.374+0000 7f36d4ff9640 1 -- 172.21.15.45:0/623326483 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d00ade40 con 0x7f36d815e4d0 2023-11-28T18:38:12.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.374+0000 7f36de6dd640 1 -- 172.21.15.45:0/623326483 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36d814edf0 con 0x7f36d815e4d0 2023-11-28T18:38:12.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.374+0000 7f36de6dd640 1 -- 172.21.15.45:0/623326483 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36d814f3b0 con 0x7f36d815e4d0 2023-11-28T18:38:12.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.374+0000 7f36de6dd640 1 -- 172.21.15.45:0/623326483 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36d8069410 con 0x7f36d815e4d0 2023-11-28T18:38:12.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.378+0000 7f36d4ff9640 1 -- 172.21.15.45:0/623326483 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f36d00b9450 con 0x7f36d815e4d0 2023-11-28T18:38:12.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.378+0000 7f36d4ff9640 1 --2- 172.21.15.45:0/623326483 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f36c40668d0 0x7f36c4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:12.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.378+0000 7f36d4ff9640 1 -- 172.21.15.45:0/623326483 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f36d011fb60 con 0x7f36d815e4d0 2023-11-28T18:38:12.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.378+0000 7f36d7fff640 1 --2- 172.21.15.45:0/623326483 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f36c40668d0 0x7f36c4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:12.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.378+0000 7f36d7fff640 1 --2- 172.21.15.45:0/623326483 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f36c40668d0 0x7f36c4068d90 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f36c80011f0 tx=0x7f36c8007930 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:12.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.382+0000 7f36d4ff9640 1 -- 172.21.15.45:0/623326483 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f36d00ecd00 con 0x7f36d815e4d0 2023-11-28T18:38:12.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.542+0000 7f36de6dd640 1 -- 172.21.15.45:0/623326483 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f36d8071fa0 con 0x7f36d815e4d0 2023-11-28T18:38:12.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.542+0000 7f36d4ff9640 1 -- 172.21.15.45:0/623326483 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f36d00bd020 con 0x7f36d815e4d0 2023-11-28T18:38:12.544 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-11-28T18:38:12.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.542+0000 7f36de6dd640 1 -- 172.21.15.45:0/623326483 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f36c40668d0 msgr2=0x7f36c4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:12.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.542+0000 7f36de6dd640 1 --2- 172.21.15.45:0/623326483 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f36c40668d0 0x7f36c4068d90 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f36c80011f0 tx=0x7f36c8007930 comp rx=0 tx=0).stop 2023-11-28T18:38:12.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.542+0000 7f36de6dd640 1 -- 172.21.15.45:0/623326483 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36d815e4d0 msgr2=0x7f36d8157440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:12.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.542+0000 7f36de6dd640 1 --2- 172.21.15.45:0/623326483 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36d815e4d0 0x7f36d8157440 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f36d00b0040 tx=0x7f36d0019560 comp rx=0 tx=0).stop 2023-11-28T18:38:12.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.542+0000 7f36de6dd640 1 -- 172.21.15.45:0/623326483 shutdown_connections 2023-11-28T18:38:12.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.542+0000 7f36de6dd640 1 --2- 172.21.15.45:0/623326483 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f36c40668d0 0x7f36c4068d90 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:12.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.542+0000 7f36de6dd640 1 --2- 172.21.15.45:0/623326483 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36d815e4d0 0x7f36d8157440 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:12.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.542+0000 7f36de6dd640 1 --2- 172.21.15.45:0/623326483 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36d80ced80 0x7f36d814a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:12.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.542+0000 7f36de6dd640 1 --2- 172.21.15.45:0/623326483 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f36d80ce9a0 0x7f36d814fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:12.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.542+0000 7f36de6dd640 1 -- 172.21.15.45:0/623326483 >> 172.21.15.45:0/623326483 conn(0x7f36d80b1b70 msgr2=0x7f36d80af370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:12.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.542+0000 7f36de6dd640 1 -- 172.21.15.45:0/623326483 shutdown_connections 2023-11-28T18:38:12.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.542+0000 7f36de6dd640 1 -- 172.21.15.45:0/623326483 wait complete. 2023-11-28T18:38:12.565 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T18:38:12.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.710+0000 7f9bad1f5640 1 Processor -- start 2023-11-28T18:38:12.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.710+0000 7f9bad1f5640 1 -- start start 2023-11-28T18:38:12.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.710+0000 7f9bad1f5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9ba813cf70 0x7f9ba806c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:12.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.710+0000 7f9bad1f5640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ba806c840 0x7f9ba815a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:12.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.710+0000 7f9bad1f5640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ba815b3e0 con 0x7f9ba815abb0 2023-11-28T18:38:12.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.710+0000 7f9bad1f5640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ba813d350 con 0x7f9ba813cf70 2023-11-28T18:38:12.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.710+0000 7f9bad1f5640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba8140520 con 0x7f9ba806c840 2023-11-28T18:38:12.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.710+0000 7f9ba6d9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9ba813cf70 0x7f9ba806c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:12.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.710+0000 7f9ba759e640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f9ba815abb0 0x7f9ba80715b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45810/0 (socket says 172.21.15.45:45810) 2023-11-28T18:38:12.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.710+0000 7f9ba759e640 1 -- 172.21.15.45:0/2596091801 learned_addr learned my addr 172.21.15.45:0/2596091801 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:38:12.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.710+0000 7f9b9ffff640 1 --2- 172.21.15.45:0/2596091801 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ba806c840 0x7f9ba815a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:12.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.710+0000 7f9ba6d9d640 1 -- 172.21.15.45:0/2596091801 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ba806c840 msgr2=0x7f9ba815a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:12.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.710+0000 7f9ba6d9d640 1 --2- 172.21.15.45:0/2596091801 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ba806c840 0x7f9ba815a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:12.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.710+0000 7f9ba659c640 1 -- 172.21.15.45:0/2596091801 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3707617242 0 0) 0x7f9ba815b3e0 con 0x7f9ba815abb0 2023-11-28T18:38:12.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.710+0000 7f9ba6d9d640 1 -- 172.21.15.45:0/2596091801 >> v1:172.21.15.45:6789/0 conn(0x7f9ba815abb0 legacy=0x7f9ba80715b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:12.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.710+0000 7f9ba6d9d640 1 -- 172.21.15.45:0/2596091801 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ba806cc80 con 0x7f9ba813cf70 2023-11-28T18:38:12.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.710+0000 7f9b9ffff640 1 --2- 172.21.15.45:0/2596091801 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ba806c840 0x7f9ba815a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:38:12.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.714+0000 7f9ba6d9d640 1 --2- 172.21.15.45:0/2596091801 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ba813cf70 0x7f9ba806c300 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9b980097f0 tx=0x7f9b9801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24bf05535ef1abfb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:12.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.714+0000 7f9ba659c640 1 -- 172.21.15.45:0/2596091801 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b980ac620 con 0x7f9ba813cf70 2023-11-28T18:38:12.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.714+0000 7f9ba659c640 1 -- 172.21.15.45:0/2596091801 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b980ac780 con 0x7f9ba813cf70 2023-11-28T18:38:12.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.714+0000 7f9ba659c640 1 -- 172.21.15.45:0/2596091801 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b980acb10 con 0x7f9ba813cf70 2023-11-28T18:38:12.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.714+0000 7f9bad1f5640 1 -- 172.21.15.45:0/2596091801 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ba813cf70 msgr2=0x7f9ba806c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:12.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.714+0000 7f9bad1f5640 1 --2- 172.21.15.45:0/2596091801 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ba813cf70 0x7f9ba806c300 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9b980097f0 tx=0x7f9b9801c3c0 comp rx=0 tx=0).stop 2023-11-28T18:38:12.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.714+0000 7f9bad1f5640 1 -- 172.21.15.45:0/2596091801 shutdown_connections 2023-11-28T18:38:12.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.714+0000 7f9bad1f5640 1 --2- 172.21.15.45:0/2596091801 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ba806c840 0x7f9ba815a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:12.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.714+0000 7f9bad1f5640 1 --2- 172.21.15.45:0/2596091801 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ba813cf70 0x7f9ba806c300 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:12.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.714+0000 7f9bad1f5640 1 -- 172.21.15.45:0/2596091801 >> 172.21.15.45:0/2596091801 conn(0x7f9ba806a570 msgr2=0x7f9ba806a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:12.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.714+0000 7f9bad1f5640 1 -- 172.21.15.45:0/2596091801 shutdown_connections 2023-11-28T18:38:12.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.714+0000 7f9bad1f5640 1 -- 172.21.15.45:0/2596091801 wait complete. 2023-11-28T18:38:12.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.714+0000 7f9bad1f5640 1 Processor -- start 2023-11-28T18:38:12.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.718+0000 7f9bad1f5640 1 -- start start 2023-11-28T18:38:12.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.718+0000 7f9bad1f5640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ba806c840 0x7f9ba8155bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:12.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.718+0000 7f9bad1f5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ba813cf70 0x7f9ba80aec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:12.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.718+0000 7f9bad1f5640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ba815abb0 0x7f9ba80af680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:12.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.718+0000 7f9bad1f5640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba80afe40 con 0x7f9ba813cf70 2023-11-28T18:38:12.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.718+0000 7f9bad1f5640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba80b1b30 con 0x7f9ba806c840 2023-11-28T18:38:12.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.718+0000 7f9bad1f5640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba80b12f0 con 0x7f9ba815abb0 2023-11-28T18:38:12.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.718+0000 7f9b9ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ba813cf70 0x7f9ba80aec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:12.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.718+0000 7f9b9ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ba813cf70 0x7f9ba80aec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54088/0 (socket says 172.21.15.45:54088) 2023-11-28T18:38:12.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.718+0000 7f9b9ffff640 1 -- 172.21.15.45:0/3067490665 learned_addr learned my addr 172.21.15.45:0/3067490665 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:12.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.718+0000 7f9ba759e640 1 --2- 172.21.15.45:0/3067490665 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ba815abb0 0x7f9ba80af680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:12.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.718+0000 7f9ba6d9d640 1 --2- 172.21.15.45:0/3067490665 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ba806c840 0x7f9ba8155bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:12.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.718+0000 7f9b9ffff640 1 -- 172.21.15.45:0/3067490665 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ba815abb0 msgr2=0x7f9ba80af680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:12.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.718+0000 7f9b9ffff640 1 --2- 172.21.15.45:0/3067490665 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ba815abb0 0x7f9ba80af680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:12.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.718+0000 7f9b9ffff640 1 -- 172.21.15.45:0/3067490665 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ba806c840 msgr2=0x7f9ba8155bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:12.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.718+0000 7f9b9ffff640 1 --2- 172.21.15.45:0/3067490665 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ba806c840 0x7f9ba8155bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:12.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.718+0000 7f9b9ffff640 1 -- 172.21.15.45:0/3067490665 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b98009420 con 0x7f9ba813cf70 2023-11-28T18:38:12.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.718+0000 7f9b9ffff640 1 --2- 172.21.15.45:0/3067490665 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ba813cf70 0x7f9ba80aec70 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9b9000c7f0 tx=0x7f9b9000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:12.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.718+0000 7f9b9f7fe640 1 -- 172.21.15.45:0/3067490665 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b90007820 con 0x7f9ba813cf70 2023-11-28T18:38:12.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.718+0000 7f9b9f7fe640 1 -- 172.21.15.45:0/3067490665 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b90007980 con 0x7f9ba813cf70 2023-11-28T18:38:12.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.718+0000 7f9b9f7fe640 1 -- 172.21.15.45:0/3067490665 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b90007d30 con 0x7f9ba813cf70 2023-11-28T18:38:12.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.718+0000 7f9bad1f5640 1 -- 172.21.15.45:0/3067490665 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ba80afbc0 con 0x7f9ba813cf70 2023-11-28T18:38:12.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.718+0000 7f9bad1f5640 1 -- 172.21.15.45:0/3067490665 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ba80b1850 con 0x7f9ba813cf70 2023-11-28T18:38:12.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.718+0000 7f9bad1f5640 1 -- 172.21.15.45:0/3067490665 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ba8069480 con 0x7f9ba813cf70 2023-11-28T18:38:12.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.722+0000 7f9b9f7fe640 1 -- 172.21.15.45:0/3067490665 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f9b900113f0 con 0x7f9ba813cf70 2023-11-28T18:38:12.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.722+0000 7f9b9f7fe640 1 --2- 172.21.15.45:0/3067490665 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9b880668d0 0x7f9b88068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:12.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.722+0000 7f9b9f7fe640 1 -- 172.21.15.45:0/3067490665 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9b90084740 con 0x7f9ba813cf70 2023-11-28T18:38:12.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.722+0000 7f9ba6d9d640 1 --2- 172.21.15.45:0/3067490665 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9b880668d0 0x7f9b88068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:12.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.722+0000 7f9ba6d9d640 1 --2- 172.21.15.45:0/3067490665 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9b880668d0 0x7f9b88068d90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9b980ae000 tx=0x7f9b980a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:12.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.726+0000 7f9b9f7fe640 1 -- 172.21.15.45:0/3067490665 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9b90051980 con 0x7f9ba813cf70 2023-11-28T18:38:12.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.894+0000 7f9bad1f5640 1 -- 172.21.15.45:0/3067490665 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9ba80cc340 con 0x7f9ba813cf70 2023-11-28T18:38:12.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.894+0000 7f9b9f7fe640 1 -- 172.21.15.45:0/3067490665 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9b90054fa0 con 0x7f9ba813cf70 2023-11-28T18:38:12.896 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-11-28T18:38:12.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.894+0000 7f9bad1f5640 1 -- 172.21.15.45:0/3067490665 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9b880668d0 msgr2=0x7f9b88068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:12.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.894+0000 7f9bad1f5640 1 --2- 172.21.15.45:0/3067490665 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9b880668d0 0x7f9b88068d90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9b980ae000 tx=0x7f9b980a7000 comp rx=0 tx=0).stop 2023-11-28T18:38:12.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.894+0000 7f9bad1f5640 1 -- 172.21.15.45:0/3067490665 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ba813cf70 msgr2=0x7f9ba80aec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:12.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.894+0000 7f9bad1f5640 1 --2- 172.21.15.45:0/3067490665 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ba813cf70 0x7f9ba80aec70 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9b9000c7f0 tx=0x7f9b9000ccb0 comp rx=0 tx=0).stop 2023-11-28T18:38:12.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.894+0000 7f9bad1f5640 1 -- 172.21.15.45:0/3067490665 shutdown_connections 2023-11-28T18:38:12.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.894+0000 7f9bad1f5640 1 --2- 172.21.15.45:0/3067490665 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9b880668d0 0x7f9b88068d90 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:12.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.894+0000 7f9bad1f5640 1 --2- 172.21.15.45:0/3067490665 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ba815abb0 0x7f9ba80af680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:12.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.894+0000 7f9bad1f5640 1 --2- 172.21.15.45:0/3067490665 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ba813cf70 0x7f9ba80aec70 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:12.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.894+0000 7f9bad1f5640 1 --2- 172.21.15.45:0/3067490665 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ba806c840 0x7f9ba8155bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:12.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.894+0000 7f9bad1f5640 1 -- 172.21.15.45:0/3067490665 >> 172.21.15.45:0/3067490665 conn(0x7f9ba806a570 msgr2=0x7f9ba815b650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:12.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.898+0000 7f9bad1f5640 1 -- 172.21.15.45:0/3067490665 shutdown_connections 2023-11-28T18:38:12.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:12.898+0000 7f9bad1f5640 1 -- 172.21.15.45:0/3067490665 wait complete. 2023-11-28T18:38:12.918 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi190.front.sepia.ceph.com... 2023-11-28T18:38:12.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:38:12.918 DEBUG:teuthology.orchestra.run.smithi190:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-11-28T18:38:12.957 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T18:38:12.958 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi190.front.sepia.ceph.com 2023-11-28T18:38:12.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:38:12.958 DEBUG:teuthology.orchestra.run.smithi190:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-28T18:38:13.015 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T18:38:13.015 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T18:38:13.025 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T18:38:13.025 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T18:38:13.075 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T18:38:13.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.262+0000 7f45f509c640 1 Processor -- start 2023-11-28T18:38:13.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.262+0000 7f45f509c640 1 -- start start 2023-11-28T18:38:13.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.262+0000 7f45f509c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f45f015ad80 0x7f45f0164e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:13.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.262+0000 7f45f509c640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45f015b3e0 con 0x7f45f006ca10 2023-11-28T18:38:13.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.262+0000 7f45f509c640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45f013f760 con 0x7f45f013cf70 2023-11-28T18:38:13.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.262+0000 7f45f509c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45f013d350 con 0x7f45f015ad80 2023-11-28T18:38:13.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.262+0000 7f45e7fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f45f006ca10 0x7f45f015a670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45816/0 (socket says 172.21.15.45:45816) 2023-11-28T18:38:13.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.262+0000 7f45e7fff640 1 -- 172.21.15.45:0/1374806778 learned_addr learned my addr 172.21.15.45:0/1374806778 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:38:13.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.262+0000 7f45ef59e640 1 --2- 172.21.15.45:0/1374806778 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f45f015ad80 0x7f45f0164e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:13.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.262+0000 7f45ee59c640 1 -- 172.21.15.45:0/1374806778 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2001602570 0 0) 0x7f45f013f760 con 0x7f45f013cf70 2023-11-28T18:38:13.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.262+0000 7f45ee59c640 1 -- 172.21.15.45:0/1374806778 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45dc005740 con 0x7f45f013cf70 2023-11-28T18:38:13.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.262+0000 7f45ee59c640 1 -- 172.21.15.45:0/1374806778 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3189686735 0 0) 0x7f45f015b3e0 con 0x7f45f006ca10 2023-11-28T18:38:13.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.262+0000 7f45ee59c640 1 -- 172.21.15.45:0/1374806778 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45f013f760 con 0x7f45f006ca10 2023-11-28T18:38:13.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.262+0000 7f45ef59e640 1 -- 172.21.15.45:0/1374806778 >> v1:172.21.15.190:6789/0 conn(0x7f45f013cf70 legacy=0x7f45f006c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:13.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.262+0000 7f45ef59e640 1 -- 172.21.15.45:0/1374806778 >> v1:172.21.15.45:6789/0 conn(0x7f45f006ca10 legacy=0x7f45f015a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:13.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.262+0000 7f45ef59e640 1 -- 172.21.15.45:0/1374806778 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f013fa40 con 0x7f45f015ad80 2023-11-28T18:38:13.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.266+0000 7f45ef59e640 1 --2- 172.21.15.45:0/1374806778 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f45f015ad80 0x7f45f0164e30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f45e8009dc0 tx=0x7f45e801c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5daaf1098cc53ed server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:13.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.266+0000 7f45ee59c640 1 -- 172.21.15.45:0/1374806778 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e80a66b0 con 0x7f45f015ad80 2023-11-28T18:38:13.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.266+0000 7f45ee59c640 1 -- 172.21.15.45:0/1374806778 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e80a6810 con 0x7f45f015ad80 2023-11-28T18:38:13.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.266+0000 7f45ee59c640 1 -- 172.21.15.45:0/1374806778 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e80a6ba0 con 0x7f45f015ad80 2023-11-28T18:38:13.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.266+0000 7f45f509c640 1 -- 172.21.15.45:0/1374806778 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f45f015ad80 msgr2=0x7f45f0164e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:13.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.266+0000 7f45f509c640 1 --2- 172.21.15.45:0/1374806778 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f45f015ad80 0x7f45f0164e30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f45e8009dc0 tx=0x7f45e801c8e0 comp rx=0 tx=0).stop 2023-11-28T18:38:13.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.266+0000 7f45f509c640 1 -- 172.21.15.45:0/1374806778 shutdown_connections 2023-11-28T18:38:13.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.266+0000 7f45f509c640 1 --2- 172.21.15.45:0/1374806778 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f45f015ad80 0x7f45f0164e30 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:13.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.266+0000 7f45f509c640 1 -- 172.21.15.45:0/1374806778 >> 172.21.15.45:0/1374806778 conn(0x7f45f006a570 msgr2=0x7f45f006a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:13.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.266+0000 7f45f509c640 1 -- 172.21.15.45:0/1374806778 shutdown_connections 2023-11-28T18:38:13.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.266+0000 7f45f509c640 1 -- 172.21.15.45:0/1374806778 wait complete. 2023-11-28T18:38:13.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.270+0000 7f45f509c640 1 Processor -- start 2023-11-28T18:38:13.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.270+0000 7f45f509c640 1 -- start start 2023-11-28T18:38:13.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.270+0000 7f45f509c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45f006ca10 0x7f45f0150cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:13.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.270+0000 7f45f509c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f45f013cf70 0x7f45f0154b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:13.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.270+0000 7f45f509c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f45f015ad80 0x7f45f01550b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:13.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.270+0000 7f45f509c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f0155ca0 con 0x7f45f006ca10 2023-11-28T18:38:13.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.270+0000 7f45f509c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f0156c70 con 0x7f45f015ad80 2023-11-28T18:38:13.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.270+0000 7f45f509c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45f015c7a0 con 0x7f45f013cf70 2023-11-28T18:38:13.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.270+0000 7f45eed9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45f006ca10 0x7f45f0150cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:13.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.270+0000 7f45eed9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45f006ca10 0x7f45f0150cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54096/0 (socket says 172.21.15.45:54096) 2023-11-28T18:38:13.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.270+0000 7f45eed9d640 1 -- 172.21.15.45:0/2485429430 learned_addr learned my addr 172.21.15.45:0/2485429430 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:13.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.270+0000 7f45e7fff640 1 --2- 172.21.15.45:0/2485429430 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f45f013cf70 0x7f45f0154b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:13.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.270+0000 7f45ef59e640 1 --2- 172.21.15.45:0/2485429430 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f45f015ad80 0x7f45f01550b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:13.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.270+0000 7f45eed9d640 1 -- 172.21.15.45:0/2485429430 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f45f013cf70 msgr2=0x7f45f0154b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:13.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.270+0000 7f45eed9d640 1 --2- 172.21.15.45:0/2485429430 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f45f013cf70 0x7f45f0154b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:13.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.270+0000 7f45eed9d640 1 -- 172.21.15.45:0/2485429430 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f45f015ad80 msgr2=0x7f45f01550b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:13.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.270+0000 7f45eed9d640 1 --2- 172.21.15.45:0/2485429430 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f45f015ad80 0x7f45f01550b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:13.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.270+0000 7f45eed9d640 1 -- 172.21.15.45:0/2485429430 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e8009a70 con 0x7f45f006ca10 2023-11-28T18:38:13.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.270+0000 7f45eed9d640 1 --2- 172.21.15.45:0/2485429430 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45f006ca10 0x7f45f0150cb0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f45e00010f0 tx=0x7f45e000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:13.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.270+0000 7f45e77fe640 1 -- 172.21.15.45:0/2485429430 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e00052d0 con 0x7f45f006ca10 2023-11-28T18:38:13.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.270+0000 7f45e77fe640 1 -- 172.21.15.45:0/2485429430 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e0005430 con 0x7f45f006ca10 2023-11-28T18:38:13.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.270+0000 7f45e77fe640 1 -- 172.21.15.45:0/2485429430 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e0012830 con 0x7f45f006ca10 2023-11-28T18:38:13.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.270+0000 7f45f509c640 1 -- 172.21.15.45:0/2485429430 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45f01f6bd0 con 0x7f45f006ca10 2023-11-28T18:38:13.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.270+0000 7f45f509c640 1 -- 172.21.15.45:0/2485429430 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45f01559c0 con 0x7f45f006ca10 2023-11-28T18:38:13.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.274+0000 7f45f509c640 1 -- 172.21.15.45:0/2485429430 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45f00ac880 con 0x7f45f006ca10 2023-11-28T18:38:13.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.274+0000 7f45e77fe640 1 -- 172.21.15.45:0/2485429430 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f45e0003600 con 0x7f45f006ca10 2023-11-28T18:38:13.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.274+0000 7f45e77fe640 1 --2- 172.21.15.45:0/2485429430 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f45d00668d0 0x7f45d0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:13.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.274+0000 7f45e77fe640 1 -- 172.21.15.45:0/2485429430 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f45e0083970 con 0x7f45f006ca10 2023-11-28T18:38:13.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.274+0000 7f45e7fff640 1 --2- 172.21.15.45:0/2485429430 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f45d00668d0 0x7f45d0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:13.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.274+0000 7f45e7fff640 1 --2- 172.21.15.45:0/2485429430 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f45d00668d0 0x7f45d0068d90 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f45f015a070 tx=0x7f45d8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:13.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.278+0000 7f45e77fe640 1 -- 172.21.15.45:0/2485429430 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f45f00ac880 con 0x7f45f006ca10 2023-11-28T18:38:13.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.438+0000 7f45f509c640 1 -- 172.21.15.45:0/2485429430 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f45f00ac880 con 0x7f45f006ca10 2023-11-28T18:38:13.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.442+0000 7f45e77fe640 1 -- 172.21.15.45:0/2485429430 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16469 (secure 0 0 0) 0x7f45f00ac880 con 0x7f45f006ca10 2023-11-28T18:38:13.443 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:38:13.443 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":20,"fsid":"d10f5cd6-1d00-4019-99b6-6fa435498a15","created":"2023-11-28T18:37:08.189030+0000","modified":"2023-11-28T18:37:33.971141+0000","last_up_change":"2023-11-28T18:37:20.196124+0000","last_in_change":"2023-11-28T18:37:10.742043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T18:37:21.293917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T18:37:31.384760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T18:37:31.834769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"84465384-103c-4f2c-a45a-96f5bb9c835f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6809","nonce":555237322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6811","nonce":555237322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6815","nonce":555237322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6813","nonce":555237322}]},"public_addr":"172.21.15.45:6809/555237322","cluster_addr":"172.21.15.45:6811/555237322","heartbeat_back_addr":"172.21.15.45:6815/555237322","heartbeat_front_addr":"172.21.15.45:6813/555237322","state":["exists","up"]},{"osd":1,"uuid":"7d9eed24-a58f-42c7-a787-ac06be8553fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6801","nonce":2857063763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6803","nonce":2857063763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6807","nonce":2857063763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6805","nonce":2857063763}]},"public_addr":"172.21.15.45:6801/2857063763","cluster_addr":"172.21.15.45:6803/2857063763","heartbeat_back_addr":"172.21.15.45:6807/2857063763","heartbeat_front_addr":"172.21.15.45:6805/2857063763","state":["exists","up"]},{"osd":2,"uuid":"575eeccc-4abf-45b4-9caf-f3e797859588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6817","nonce":193884539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6819","nonce":193884539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6823","nonce":193884539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6821","nonce":193884539}]},"public_addr":"172.21.15.45:6817/193884539","cluster_addr":"172.21.15.45:6819/193884539","heartbeat_back_addr":"172.21.15.45:6823/193884539","heartbeat_front_addr":"172.21.15.45:6821/193884539","state":["exists","up"]},{"osd":3,"uuid":"9b0290d6-9a52-4bc8-b2a1-7622c5dc8e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6825","nonce":78541084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6827","nonce":78541084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6831","nonce":78541084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6829","nonce":78541084}]},"public_addr":"172.21.15.45:6825/78541084","cluster_addr":"172.21.15.45:6827/78541084","heartbeat_back_addr":"172.21.15.45:6831/78541084","heartbeat_front_addr":"172.21.15.45:6829/78541084","state":["exists","up"]},{"osd":4,"uuid":"ce632829-f027-4fbf-a627-02c571aa9d53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6809","nonce":1537591987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6811","nonce":1537591987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6815","nonce":1537591987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6813","nonce":1537591987}]},"public_addr":"172.21.15.190:6809/1537591987","cluster_addr":"172.21.15.190:6811/1537591987","heartbeat_back_addr":"172.21.15.190:6815/1537591987","heartbeat_front_addr":"172.21.15.190:6813/1537591987","state":["exists","up"]},{"osd":5,"uuid":"8700b609-27be-40bd-a251-4c0ae0a29ead","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6801","nonce":3296698407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6803","nonce":3296698407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6807","nonce":3296698407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6805","nonce":3296698407}]},"public_addr":"172.21.15.190:6801/3296698407","cluster_addr":"172.21.15.190:6803/3296698407","heartbeat_back_addr":"172.21.15.190:6807/3296698407","heartbeat_front_addr":"172.21.15.190:6805/3296698407","state":["exists","up"]},{"osd":6,"uuid":"44ce4a40-e6ff-4f4d-8e8a-7341e5c91f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6817","nonce":2317686718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6819","nonce":2317686718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6823","nonce":2317686718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6821","nonce":2317686718}]},"public_addr":"172.21.15.190:6817/2317686718","cluster_addr":"172.21.15.190:6819/2317686718","heartbeat_back_addr":"172.21.15.190:6823/2317686718","heartbeat_front_addr":"172.21.15.190:6821/2317686718","state":["exists","up"]},{"osd":7,"uuid":"192238c9-1423-4b7e-ac8f-84ba32113ddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6825","nonce":2493232051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6827","nonce":2493232051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6831","nonce":2493232051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6829","nonce":2493232051}]},"public_addr":"172.21.15.190:6825/2493232051","cluster_addr":"172.21.15.190:6827/2493232051","heartbeat_back_addr":"172.21.15.190:6831/2493232051","heartbeat_front_addr":"172.21.15.190:6829/2493232051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.393552+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.385453+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.361421+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.366408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.363226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.276007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.414605+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.445885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T18:38:13.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.442+0000 7f45f509c640 1 -- 172.21.15.45:0/2485429430 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f45d00668d0 msgr2=0x7f45d0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:13.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.442+0000 7f45f509c640 1 --2- 172.21.15.45:0/2485429430 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f45d00668d0 0x7f45d0068d90 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f45f015a070 tx=0x7f45d8009040 comp rx=0 tx=0).stop 2023-11-28T18:38:13.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.442+0000 7f45f509c640 1 -- 172.21.15.45:0/2485429430 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45f006ca10 msgr2=0x7f45f0150cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:13.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.442+0000 7f45f509c640 1 --2- 172.21.15.45:0/2485429430 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45f006ca10 0x7f45f0150cb0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f45e00010f0 tx=0x7f45e000c960 comp rx=0 tx=0).stop 2023-11-28T18:38:13.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.442+0000 7f45f509c640 1 -- 172.21.15.45:0/2485429430 shutdown_connections 2023-11-28T18:38:13.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.442+0000 7f45f509c640 1 --2- 172.21.15.45:0/2485429430 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f45d00668d0 0x7f45d0068d90 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:13.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.442+0000 7f45f509c640 1 --2- 172.21.15.45:0/2485429430 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f45f015ad80 0x7f45f01550b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:13.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.442+0000 7f45f509c640 1 --2- 172.21.15.45:0/2485429430 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f45f013cf70 0x7f45f0154b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:13.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.442+0000 7f45f509c640 1 --2- 172.21.15.45:0/2485429430 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45f006ca10 0x7f45f0150cb0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:13.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.442+0000 7f45f509c640 1 -- 172.21.15.45:0/2485429430 >> 172.21.15.45:0/2485429430 conn(0x7f45f006a570 msgr2=0x7f45f013ddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:13.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.442+0000 7f45f509c640 1 -- 172.21.15.45:0/2485429430 shutdown_connections 2023-11-28T18:38:13.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.442+0000 7f45f509c640 1 -- 172.21.15.45:0/2485429430 wait complete. 2023-11-28T18:38:13.464 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T18:37:21.293917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T18:37:31.384760+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T18:37:31.834769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T18:38:13.465 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T18:38:13.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.606+0000 7f910572a640 1 Processor -- start 2023-11-28T18:38:13.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.606+0000 7f910572a640 1 -- start start 2023-11-28T18:38:13.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.610+0000 7f910572a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f91000ad8c0 0x7f91000adca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:13.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.610+0000 7f910572a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f910006ddb0 0x7f910006e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:13.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.610+0000 7f910572a640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f910015b4e0 0x7f910015b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:13.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.610+0000 7f910572a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91000ae1e0 con 0x7f910006ddb0 2023-11-28T18:38:13.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.610+0000 7f910572a640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f910006ca30 con 0x7f910015b4e0 2023-11-28T18:38:13.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.610+0000 7f910572a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f910006cd10 con 0x7f91000ad8c0 2023-11-28T18:38:13.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.610+0000 7f90f7fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f910006ddb0 0x7f910006e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:13.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.610+0000 7f90f7fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f910006ddb0 0x7f910006e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54106/0 (socket says 172.21.15.45:54106) 2023-11-28T18:38:13.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.610+0000 7f90f7fff640 1 -- 172.21.15.45:0/3200766166 learned_addr learned my addr 172.21.15.45:0/3200766166 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:13.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.610+0000 7f90ff7fe640 1 --2- 172.21.15.45:0/3200766166 >> v2:172.21.15.190:3300/0 conn(0x7f910015b4e0 0x7f910015b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:13.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.610+0000 7f90feffd640 1 --2- 172.21.15.45:0/3200766166 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f91000ad8c0 0x7f91000adca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:13.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.610+0000 7f90f7fff640 1 -- 172.21.15.45:0/3200766166 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f91000ad8c0 msgr2=0x7f91000adca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:13.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.610+0000 7f90f7fff640 1 --2- 172.21.15.45:0/3200766166 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f91000ad8c0 0x7f91000adca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:13.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.610+0000 7f90f7fff640 1 -- 172.21.15.45:0/3200766166 >> v2:172.21.15.190:3300/0 conn(0x7f910015b4e0 msgr2=0x7f910015b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:13.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.610+0000 7f90f7fff640 1 --2- 172.21.15.45:0/3200766166 >> v2:172.21.15.190:3300/0 conn(0x7f910015b4e0 0x7f910015b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:13.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.610+0000 7f90f7fff640 1 -- 172.21.15.45:0/3200766166 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f910006cff0 con 0x7f910006ddb0 2023-11-28T18:38:13.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.614+0000 7f90f7fff640 1 --2- 172.21.15.45:0/3200766166 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f910006ddb0 0x7f910006e230 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f91000b1630 tx=0x7f90e801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ff71c18d0d0a552 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:13.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.614+0000 7f90fe7fc640 1 -- 172.21.15.45:0/3200766166 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e80aa5f0 con 0x7f910006ddb0 2023-11-28T18:38:13.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.614+0000 7f90fe7fc640 1 -- 172.21.15.45:0/3200766166 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90e80aa750 con 0x7f910006ddb0 2023-11-28T18:38:13.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.614+0000 7f90fe7fc640 1 -- 172.21.15.45:0/3200766166 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e80aaae0 con 0x7f910006ddb0 2023-11-28T18:38:13.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.614+0000 7f910572a640 1 -- 172.21.15.45:0/3200766166 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f910006ddb0 msgr2=0x7f910006e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:13.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.614+0000 7f910572a640 1 --2- 172.21.15.45:0/3200766166 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f910006ddb0 0x7f910006e230 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f91000b1630 tx=0x7f90e801c4d0 comp rx=0 tx=0).stop 2023-11-28T18:38:13.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.614+0000 7f910572a640 1 -- 172.21.15.45:0/3200766166 shutdown_connections 2023-11-28T18:38:13.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.614+0000 7f910572a640 1 --2- 172.21.15.45:0/3200766166 >> v2:172.21.15.190:3300/0 conn(0x7f910015b4e0 0x7f910015b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:13.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.614+0000 7f910572a640 1 --2- 172.21.15.45:0/3200766166 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f910006ddb0 0x7f910006e230 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:13.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.614+0000 7f910572a640 1 --2- 172.21.15.45:0/3200766166 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f91000ad8c0 0x7f91000adca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:13.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.614+0000 7f910572a640 1 -- 172.21.15.45:0/3200766166 >> 172.21.15.45:0/3200766166 conn(0x7f91000b0960 msgr2=0x7f91000b0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:13.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.614+0000 7f910572a640 1 -- 172.21.15.45:0/3200766166 shutdown_connections 2023-11-28T18:38:13.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.614+0000 7f910572a640 1 -- 172.21.15.45:0/3200766166 wait complete. 2023-11-28T18:38:13.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.614+0000 7f910572a640 1 Processor -- start 2023-11-28T18:38:13.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.614+0000 7f910572a640 1 -- start start 2023-11-28T18:38:13.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.618+0000 7f910572a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f910006ddb0 0x7f910009ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:13.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.618+0000 7f910572a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91000ad8c0 0x7f910015a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:13.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.618+0000 7f910572a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f910015b4e0 0x7f910009bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:13.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.618+0000 7f910572a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9100099d60 con 0x7f910006ddb0 2023-11-28T18:38:13.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.618+0000 7f910572a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f910009a040 con 0x7f91000ad8c0 2023-11-28T18:38:13.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.618+0000 7f910572a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f910009a320 con 0x7f910015b4e0 2023-11-28T18:38:13.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.618+0000 7f90feffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f910006ddb0 0x7f910009ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:13.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.618+0000 7f90feffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f910006ddb0 0x7f910009ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54110/0 (socket says 172.21.15.45:54110) 2023-11-28T18:38:13.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.618+0000 7f90feffd640 1 -- 172.21.15.45:0/1712213151 learned_addr learned my addr 172.21.15.45:0/1712213151 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:13.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.618+0000 7f90f7fff640 1 --2- 172.21.15.45:0/1712213151 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91000ad8c0 0x7f910015a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:13.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.618+0000 7f90ff7fe640 1 --2- 172.21.15.45:0/1712213151 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f910015b4e0 0x7f910009bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:13.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.618+0000 7f90feffd640 1 -- 172.21.15.45:0/1712213151 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f910015b4e0 msgr2=0x7f910009bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:13.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.618+0000 7f90feffd640 1 --2- 172.21.15.45:0/1712213151 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f910015b4e0 0x7f910009bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:13.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.618+0000 7f90feffd640 1 -- 172.21.15.45:0/1712213151 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91000ad8c0 msgr2=0x7f910015a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:13.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.618+0000 7f90feffd640 1 --2- 172.21.15.45:0/1712213151 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91000ad8c0 0x7f910015a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:13.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.618+0000 7f90feffd640 1 -- 172.21.15.45:0/1712213151 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e8009480 con 0x7f910006ddb0 2023-11-28T18:38:13.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.618+0000 7f90feffd640 1 --2- 172.21.15.45:0/1712213151 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f910006ddb0 0x7f910009ae00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f90f000e8b0 tx=0x7f90f000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:13.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.618+0000 7f90f77fe640 1 -- 172.21.15.45:0/1712213151 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f000c940 con 0x7f910006ddb0 2023-11-28T18:38:13.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.618+0000 7f90f77fe640 1 -- 172.21.15.45:0/1712213151 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90f000caa0 con 0x7f910006ddb0 2023-11-28T18:38:13.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.618+0000 7f90f77fe640 1 -- 172.21.15.45:0/1712213151 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f000ce30 con 0x7f910006ddb0 2023-11-28T18:38:13.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.618+0000 7f910572a640 1 -- 172.21.15.45:0/1712213151 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f910009a600 con 0x7f910006ddb0 2023-11-28T18:38:13.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.618+0000 7f910572a640 1 -- 172.21.15.45:0/1712213151 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9100099a10 con 0x7f910006ddb0 2023-11-28T18:38:13.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.618+0000 7f910572a640 1 -- 172.21.15.45:0/1712213151 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f910009d0c0 con 0x7f910006ddb0 2023-11-28T18:38:13.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.618+0000 7f90f77fe640 1 -- 172.21.15.45:0/1712213151 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f90f0013470 con 0x7f910006ddb0 2023-11-28T18:38:13.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.622+0000 7f90f77fe640 1 --2- 172.21.15.45:0/1712213151 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f90e00668d0 0x7f90e0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:13.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.622+0000 7f90f77fe640 1 -- 172.21.15.45:0/1712213151 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f90f0084750 con 0x7f910006ddb0 2023-11-28T18:38:13.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.622+0000 7f90f7fff640 1 --2- 172.21.15.45:0/1712213151 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f90e00668d0 0x7f90e0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:13.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.622+0000 7f90f7fff640 1 --2- 172.21.15.45:0/1712213151 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f90e00668d0 0x7f90e0068d90 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f90e80ae000 tx=0x7f90e80a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:13.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.626+0000 7f90f77fe640 1 -- 172.21.15.45:0/1712213151 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f90f0051860 con 0x7f910006ddb0 2023-11-28T18:38:13.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.782+0000 7f910572a640 1 -- 172.21.15.45:0/1712213151 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f910004e970 con 0x7f910006ddb0 2023-11-28T18:38:13.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.782+0000 7f90f77fe640 1 -- 172.21.15.45:0/1712213151 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f90f0054e80 con 0x7f910006ddb0 2023-11-28T18:38:13.786 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-11-28T18:38:13.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.786+0000 7f910572a640 1 -- 172.21.15.45:0/1712213151 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f90e00668d0 msgr2=0x7f90e0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:13.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.786+0000 7f910572a640 1 --2- 172.21.15.45:0/1712213151 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f90e00668d0 0x7f90e0068d90 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f90e80ae000 tx=0x7f90e80a7000 comp rx=0 tx=0).stop 2023-11-28T18:38:13.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.786+0000 7f910572a640 1 -- 172.21.15.45:0/1712213151 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f910006ddb0 msgr2=0x7f910009ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:13.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.786+0000 7f910572a640 1 --2- 172.21.15.45:0/1712213151 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f910006ddb0 0x7f910009ae00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f90f000e8b0 tx=0x7f90f000ed70 comp rx=0 tx=0).stop 2023-11-28T18:38:13.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.786+0000 7f910572a640 1 -- 172.21.15.45:0/1712213151 shutdown_connections 2023-11-28T18:38:13.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.786+0000 7f910572a640 1 --2- 172.21.15.45:0/1712213151 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f90e00668d0 0x7f90e0068d90 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:13.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.786+0000 7f910572a640 1 --2- 172.21.15.45:0/1712213151 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f910015b4e0 0x7f910009bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:13.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.786+0000 7f910572a640 1 --2- 172.21.15.45:0/1712213151 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91000ad8c0 0x7f910015a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:13.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.786+0000 7f910572a640 1 --2- 172.21.15.45:0/1712213151 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f910006ddb0 0x7f910009ae00 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:13.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.786+0000 7f910572a640 1 -- 172.21.15.45:0/1712213151 >> 172.21.15.45:0/1712213151 conn(0x7f91000b0960 msgr2=0x7f910006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:13.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.786+0000 7f910572a640 1 -- 172.21.15.45:0/1712213151 shutdown_connections 2023-11-28T18:38:13.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.786+0000 7f910572a640 1 -- 172.21.15.45:0/1712213151 wait complete. 2023-11-28T18:38:13.807 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T18:38:13.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.950+0000 7eff6805f640 1 Processor -- start 2023-11-28T18:38:13.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.950+0000 7eff6805f640 1 -- start start 2023-11-28T18:38:13.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.950+0000 7eff6805f640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7eff600cba50 0x7eff6015be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:13.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.950+0000 7eff6805f640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff6015b6b0 con 0x7eff600b4310 2023-11-28T18:38:13.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.950+0000 7eff6805f640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff6015f450 con 0x7eff60158ce0 2023-11-28T18:38:13.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.950+0000 7eff6805f640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff6015f730 con 0x7eff600cba50 2023-11-28T18:38:13.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.950+0000 7eff665fc640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7eff600b4310 0x7eff60070430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45824/0 (socket says 172.21.15.45:45824) 2023-11-28T18:38:13.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.950+0000 7eff665fc640 1 -- 172.21.15.45:0/314513078 learned_addr learned my addr 172.21.15.45:0/314513078 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:38:13.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.950+0000 7eff65dfb640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7eff60158ce0 0x7eff6015eb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.45:47722/0 (socket says 172.21.15.45:47722) 2023-11-28T18:38:13.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.950+0000 7eff655fa640 1 --2- 172.21.15.45:0/314513078 >> v2:172.21.15.190:3300/0 conn(0x7eff600cba50 0x7eff6015be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:13.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.950+0000 7eff64df9640 1 -- 172.21.15.45:0/314513078 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2977912059 0 0) 0x7eff6015b6b0 con 0x7eff600b4310 2023-11-28T18:38:13.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.950+0000 7eff64df9640 1 -- 172.21.15.45:0/314513078 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff4c003530 con 0x7eff600b4310 2023-11-28T18:38:13.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.950+0000 7eff655fa640 1 -- 172.21.15.45:0/314513078 >> v1:172.21.15.190:6789/0 conn(0x7eff60158ce0 legacy=0x7eff6015eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:13.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.950+0000 7eff64df9640 1 -- 172.21.15.45:0/314513078 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3435736034 0 0) 0x7eff6015f450 con 0x7eff60158ce0 2023-11-28T18:38:13.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.950+0000 7eff655fa640 1 -- 172.21.15.45:0/314513078 >> v1:172.21.15.45:6789/0 conn(0x7eff600b4310 legacy=0x7eff60070430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:13.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.950+0000 7eff655fa640 1 -- 172.21.15.45:0/314513078 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff6015b920 con 0x7eff600cba50 2023-11-28T18:38:13.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.954+0000 7eff655fa640 1 --2- 172.21.15.45:0/314513078 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7eff600cba50 0x7eff6015be40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7eff500097c0 tx=0x7eff5001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45aa7a60dfe80f73 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:13.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.954+0000 7eff64df9640 1 -- 172.21.15.45:0/314513078 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff500a8050 con 0x7eff600cba50 2023-11-28T18:38:13.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.954+0000 7eff64df9640 1 -- 172.21.15.45:0/314513078 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff500ac5f0 con 0x7eff600cba50 2023-11-28T18:38:13.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.954+0000 7eff64df9640 1 -- 172.21.15.45:0/314513078 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff500ac980 con 0x7eff600cba50 2023-11-28T18:38:13.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.954+0000 7eff6805f640 1 -- 172.21.15.45:0/314513078 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7eff600cba50 msgr2=0x7eff6015be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:13.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.954+0000 7eff6805f640 1 --2- 172.21.15.45:0/314513078 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7eff600cba50 0x7eff6015be40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7eff500097c0 tx=0x7eff5001c480 comp rx=0 tx=0).stop 2023-11-28T18:38:13.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.954+0000 7eff6805f640 1 -- 172.21.15.45:0/314513078 shutdown_connections 2023-11-28T18:38:13.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.954+0000 7eff6805f640 1 --2- 172.21.15.45:0/314513078 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7eff600cba50 0x7eff6015be40 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:13.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.954+0000 7eff6805f640 1 -- 172.21.15.45:0/314513078 >> 172.21.15.45:0/314513078 conn(0x7eff600b0d00 msgr2=0x7eff600b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:13.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.954+0000 7eff6805f640 1 -- 172.21.15.45:0/314513078 shutdown_connections 2023-11-28T18:38:13.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.954+0000 7eff6805f640 1 -- 172.21.15.45:0/314513078 wait complete. 2023-11-28T18:38:13.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.958+0000 7eff6805f640 1 Processor -- start 2023-11-28T18:38:13.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.958+0000 7eff6805f640 1 -- start start 2023-11-28T18:38:13.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.958+0000 7eff6805f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff600b4310 0x7eff601558b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:13.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.958+0000 7eff6805f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff600cba50 0x7eff600c8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:13.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.958+0000 7eff6805f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7eff60158ce0 0x7eff6014f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:13.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.958+0000 7eff6805f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff60155e90 con 0x7eff600b4310 2023-11-28T18:38:13.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.958+0000 7eff6805f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff6014f8e0 con 0x7eff60158ce0 2023-11-28T18:38:13.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.958+0000 7eff6805f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff60153930 con 0x7eff600cba50 2023-11-28T18:38:13.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.958+0000 7eff65dfb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff600b4310 0x7eff601558b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:13.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.958+0000 7eff65dfb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff600b4310 0x7eff601558b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54118/0 (socket says 172.21.15.45:54118) 2023-11-28T18:38:13.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.958+0000 7eff65dfb640 1 -- 172.21.15.45:0/2893743594 learned_addr learned my addr 172.21.15.45:0/2893743594 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:13.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.958+0000 7eff655fa640 1 --2- 172.21.15.45:0/2893743594 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff600cba50 0x7eff600c8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:13.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.958+0000 7eff665fc640 1 --2- 172.21.15.45:0/2893743594 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7eff60158ce0 0x7eff6014f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:13.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.958+0000 7eff65dfb640 1 -- 172.21.15.45:0/2893743594 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff600cba50 msgr2=0x7eff600c8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:13.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.958+0000 7eff65dfb640 1 --2- 172.21.15.45:0/2893743594 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff600cba50 0x7eff600c8380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:13.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.958+0000 7eff65dfb640 1 -- 172.21.15.45:0/2893743594 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7eff60158ce0 msgr2=0x7eff6014f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:13.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.958+0000 7eff65dfb640 1 --2- 172.21.15.45:0/2893743594 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7eff60158ce0 0x7eff6014f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:13.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.958+0000 7eff65dfb640 1 -- 172.21.15.45:0/2893743594 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff50009420 con 0x7eff600b4310 2023-11-28T18:38:13.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.958+0000 7eff65dfb640 1 --2- 172.21.15.45:0/2893743594 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff600b4310 0x7eff601558b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7eff5c00c480 tx=0x7eff5c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:13.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.958+0000 7eff567fc640 1 -- 172.21.15.45:0/2893743594 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5c0074e0 con 0x7eff600b4310 2023-11-28T18:38:13.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.958+0000 7eff567fc640 1 -- 172.21.15.45:0/2893743594 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff5c007660 con 0x7eff600b4310 2023-11-28T18:38:13.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.958+0000 7eff567fc640 1 -- 172.21.15.45:0/2893743594 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5c004a30 con 0x7eff600b4310 2023-11-28T18:38:13.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.958+0000 7eff6805f640 1 -- 172.21.15.45:0/2893743594 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff6014fd20 con 0x7eff600b4310 2023-11-28T18:38:13.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.958+0000 7eff6805f640 1 -- 172.21.15.45:0/2893743594 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff60153eb0 con 0x7eff600b4310 2023-11-28T18:38:13.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.962+0000 7eff6805f640 1 -- 172.21.15.45:0/2893743594 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff60069410 con 0x7eff600b4310 2023-11-28T18:38:13.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.962+0000 7eff567fc640 1 -- 172.21.15.45:0/2893743594 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7eff5c004b90 con 0x7eff600b4310 2023-11-28T18:38:13.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.962+0000 7eff567fc640 1 --2- 172.21.15.45:0/2893743594 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7eff440668d0 0x7eff44068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:13.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.962+0000 7eff567fc640 1 -- 172.21.15.45:0/2893743594 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7eff5c083530 con 0x7eff600b4310 2023-11-28T18:38:13.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.962+0000 7eff655fa640 1 --2- 172.21.15.45:0/2893743594 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7eff440668d0 0x7eff44068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:13.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.962+0000 7eff655fa640 1 --2- 172.21.15.45:0/2893743594 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7eff440668d0 0x7eff44068d90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7eff500ae000 tx=0x7eff50008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:13.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:13.966+0000 7eff567fc640 1 -- 172.21.15.45:0/2893743594 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7eff5c050810 con 0x7eff600b4310 2023-11-28T18:38:14.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.126+0000 7eff6805f640 1 -- 172.21.15.45:0/2893743594 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7eff600b19d0 con 0x7eff600b4310 2023-11-28T18:38:14.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.126+0000 7eff567fc640 1 -- 172.21.15.45:0/2893743594 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7eff5c053e30 con 0x7eff600b4310 2023-11-28T18:38:14.128 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-11-28T18:38:14.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.126+0000 7eff6805f640 1 -- 172.21.15.45:0/2893743594 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7eff440668d0 msgr2=0x7eff44068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:14.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.126+0000 7eff6805f640 1 --2- 172.21.15.45:0/2893743594 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7eff440668d0 0x7eff44068d90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7eff500ae000 tx=0x7eff50008040 comp rx=0 tx=0).stop 2023-11-28T18:38:14.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.126+0000 7eff6805f640 1 -- 172.21.15.45:0/2893743594 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff600b4310 msgr2=0x7eff601558b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:14.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.126+0000 7eff6805f640 1 --2- 172.21.15.45:0/2893743594 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff600b4310 0x7eff601558b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7eff5c00c480 tx=0x7eff5c00c940 comp rx=0 tx=0).stop 2023-11-28T18:38:14.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.126+0000 7eff6805f640 1 -- 172.21.15.45:0/2893743594 shutdown_connections 2023-11-28T18:38:14.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.126+0000 7eff6805f640 1 --2- 172.21.15.45:0/2893743594 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7eff440668d0 0x7eff44068d90 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:14.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.126+0000 7eff6805f640 1 --2- 172.21.15.45:0/2893743594 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7eff60158ce0 0x7eff6014f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:14.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.126+0000 7eff6805f640 1 --2- 172.21.15.45:0/2893743594 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff600cba50 0x7eff600c8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:14.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.126+0000 7eff6805f640 1 --2- 172.21.15.45:0/2893743594 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff600b4310 0x7eff601558b0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:14.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.126+0000 7eff6805f640 1 -- 172.21.15.45:0/2893743594 >> 172.21.15.45:0/2893743594 conn(0x7eff600b0d00 msgr2=0x7eff60070fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:14.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.126+0000 7eff6805f640 1 -- 172.21.15.45:0/2893743594 shutdown_connections 2023-11-28T18:38:14.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.126+0000 7eff6805f640 1 -- 172.21.15.45:0/2893743594 wait complete. 2023-11-28T18:38:14.150 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T18:38:14.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.294+0000 7f1fc6396640 1 Processor -- start 2023-11-28T18:38:14.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.294+0000 7f1fc6396640 1 -- start start 2023-11-28T18:38:14.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.298+0000 7f1fc6396640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1fc01469a0 0x7f1fc006cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:14.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.298+0000 7f1fc6396640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fc015e940 con 0x7f1fc00b4070 2023-11-28T18:38:14.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.298+0000 7f1fc6396640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fc006f700 con 0x7f1fc015fde0 2023-11-28T18:38:14.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.298+0000 7f1fc6396640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fc015dd30 con 0x7f1fc01469a0 2023-11-28T18:38:14.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.298+0000 7f1fbffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1fc01469a0 0x7f1fc006cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:14.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.298+0000 7f1fbffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1fc01469a0 0x7f1fc006cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54126/0 (socket says 172.21.15.45:54126) 2023-11-28T18:38:14.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.298+0000 7f1fbffff640 1 -- 172.21.15.45:0/536795293 learned_addr learned my addr 172.21.15.45:0/536795293 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:14.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.298+0000 7f1fbffff640 1 -- 172.21.15.45:0/536795293 >> v1:172.21.15.190:6789/0 conn(0x7f1fc015fde0 legacy=0x7f1fc006eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:14.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.298+0000 7f1fbffff640 1 -- 172.21.15.45:0/536795293 >> v1:172.21.15.45:6789/0 conn(0x7f1fc00b4070 legacy=0x7f1fc006e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:14.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.298+0000 7f1fbffff640 1 -- 172.21.15.45:0/536795293 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc015e010 con 0x7f1fc01469a0 2023-11-28T18:38:14.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.302+0000 7f1fbffff640 1 --2- 172.21.15.45:0/536795293 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fc01469a0 0x7f1fc006cab0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1fb0009870 tx=0x7f1fb001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4f57f826f396a08 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:14.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.302+0000 7f1fbeffd640 1 -- 172.21.15.45:0/536795293 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb00a7070 con 0x7f1fc01469a0 2023-11-28T18:38:14.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.302+0000 7f1fbeffd640 1 -- 172.21.15.45:0/536795293 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fb00ab430 con 0x7f1fc01469a0 2023-11-28T18:38:14.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.302+0000 7f1fbeffd640 1 -- 172.21.15.45:0/536795293 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb00ab7c0 con 0x7f1fc01469a0 2023-11-28T18:38:14.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.302+0000 7f1fc6396640 1 -- 172.21.15.45:0/536795293 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fc01469a0 msgr2=0x7f1fc006cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:14.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.302+0000 7f1fc6396640 1 --2- 172.21.15.45:0/536795293 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fc01469a0 0x7f1fc006cab0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1fb0009870 tx=0x7f1fb001c540 comp rx=0 tx=0).stop 2023-11-28T18:38:14.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.302+0000 7f1fc6396640 1 -- 172.21.15.45:0/536795293 shutdown_connections 2023-11-28T18:38:14.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.302+0000 7f1fc6396640 1 --2- 172.21.15.45:0/536795293 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fc01469a0 0x7f1fc006cab0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:14.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.302+0000 7f1fc6396640 1 -- 172.21.15.45:0/536795293 >> 172.21.15.45:0/536795293 conn(0x7f1fc0070b80 msgr2=0x7f1fc0066360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:14.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.302+0000 7f1fc6396640 1 -- 172.21.15.45:0/536795293 shutdown_connections 2023-11-28T18:38:14.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.302+0000 7f1fc6396640 1 -- 172.21.15.45:0/536795293 wait complete. 2023-11-28T18:38:14.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.302+0000 7f1fc6396640 1 Processor -- start 2023-11-28T18:38:14.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.302+0000 7f1fc6396640 1 -- start start 2023-11-28T18:38:14.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.306+0000 7f1fc6396640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1fc00b4070 0x7f1fc0134120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:14.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.306+0000 7f1fc6396640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fc01469a0 0x7f1fc0144720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:14.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.306+0000 7f1fc6396640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1fc015fde0 0x7f1fc0142f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:14.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.306+0000 7f1fc6396640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc0143450 con 0x7f1fc01469a0 2023-11-28T18:38:14.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.306+0000 7f1fc6396640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc0144290 con 0x7f1fc015fde0 2023-11-28T18:38:14.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.306+0000 7f1fc6396640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc0143680 con 0x7f1fc00b4070 2023-11-28T18:38:14.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.306+0000 7f1fbf7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fc01469a0 0x7f1fc0144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:14.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.306+0000 7f1fbf7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fc01469a0 0x7f1fc0144720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54142/0 (socket says 172.21.15.45:54142) 2023-11-28T18:38:14.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.306+0000 7f1fbf7fe640 1 -- 172.21.15.45:0/1640653989 learned_addr learned my addr 172.21.15.45:0/1640653989 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:14.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.306+0000 7f1fbffff640 1 --2- 172.21.15.45:0/1640653989 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1fc00b4070 0x7f1fc0134120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:14.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.306+0000 7f1fc4933640 1 --2- 172.21.15.45:0/1640653989 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1fc015fde0 0x7f1fc0142f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:14.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.306+0000 7f1fbf7fe640 1 -- 172.21.15.45:0/1640653989 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1fc00b4070 msgr2=0x7f1fc0134120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:14.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.306+0000 7f1fbf7fe640 1 --2- 172.21.15.45:0/1640653989 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1fc00b4070 0x7f1fc0134120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:14.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.306+0000 7f1fbf7fe640 1 -- 172.21.15.45:0/1640653989 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1fc015fde0 msgr2=0x7f1fc0142f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:14.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.306+0000 7f1fbf7fe640 1 --2- 172.21.15.45:0/1640653989 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1fc015fde0 0x7f1fc0142f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:14.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.306+0000 7f1fbf7fe640 1 -- 172.21.15.45:0/1640653989 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fb00094d0 con 0x7f1fc01469a0 2023-11-28T18:38:14.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.306+0000 7f1fbffff640 1 --2- 172.21.15.45:0/1640653989 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1fc00b4070 0x7f1fc0134120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:38:14.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.306+0000 7f1fbf7fe640 1 --2- 172.21.15.45:0/1640653989 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fc01469a0 0x7f1fc0144720 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f1fb400c500 tx=0x7f1fb400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:14.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.306+0000 7f1fbcff9640 1 -- 172.21.15.45:0/1640653989 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb4005220 con 0x7f1fc01469a0 2023-11-28T18:38:14.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.306+0000 7f1fbcff9640 1 -- 172.21.15.45:0/1640653989 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fb4005380 con 0x7f1fc01469a0 2023-11-28T18:38:14.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.306+0000 7f1fbcff9640 1 -- 172.21.15.45:0/1640653989 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb4007270 con 0x7f1fc01469a0 2023-11-28T18:38:14.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.306+0000 7f1fc6396640 1 -- 172.21.15.45:0/1640653989 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fc0143960 con 0x7f1fc01469a0 2023-11-28T18:38:14.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.306+0000 7f1fc6396640 1 -- 172.21.15.45:0/1640653989 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fc0143f20 con 0x7f1fc01469a0 2023-11-28T18:38:14.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.306+0000 7f1fc6396640 1 -- 172.21.15.45:0/1640653989 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fc0144400 con 0x7f1fc01469a0 2023-11-28T18:38:14.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.306+0000 7f1fbcff9640 1 -- 172.21.15.45:0/1640653989 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f1fb40073d0 con 0x7f1fc01469a0 2023-11-28T18:38:14.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.310+0000 7f1fbcff9640 1 --2- 172.21.15.45:0/1640653989 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1fac0668d0 0x7f1fac068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:14.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.310+0000 7f1fbcff9640 1 -- 172.21.15.45:0/1640653989 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5804+0+0 (secure 0 0 0) 0x7f1fb4083e50 con 0x7f1fc01469a0 2023-11-28T18:38:14.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.310+0000 7f1fbffff640 1 --2- 172.21.15.45:0/1640653989 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1fac0668d0 0x7f1fac068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:14.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.310+0000 7f1fbffff640 1 --2- 172.21.15.45:0/1640653989 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1fac0668d0 0x7f1fac068d90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1fb00af000 tx=0x7f1fb00a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:14.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.314+0000 7f1fbcff9640 1 -- 172.21.15.45:0/1640653989 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1fb4050fa0 con 0x7f1fc01469a0 2023-11-28T18:38:14.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.470+0000 7f1fc6396640 1 -- 172.21.15.45:0/1640653989 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1fc0069410 con 0x7f1fc01469a0 2023-11-28T18:38:14.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.470+0000 7f1fbcff9640 1 -- 172.21.15.45:0/1640653989 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1fb40545c0 con 0x7f1fc01469a0 2023-11-28T18:38:14.473 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-11-28T18:38:14.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.470+0000 7f1fc6396640 1 -- 172.21.15.45:0/1640653989 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1fac0668d0 msgr2=0x7f1fac068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:14.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.470+0000 7f1fc6396640 1 --2- 172.21.15.45:0/1640653989 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1fac0668d0 0x7f1fac068d90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1fb00af000 tx=0x7f1fb00a7000 comp rx=0 tx=0).stop 2023-11-28T18:38:14.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.474+0000 7f1fc6396640 1 -- 172.21.15.45:0/1640653989 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fc01469a0 msgr2=0x7f1fc0144720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:14.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.474+0000 7f1fc6396640 1 --2- 172.21.15.45:0/1640653989 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fc01469a0 0x7f1fc0144720 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f1fb400c500 tx=0x7f1fb400c9c0 comp rx=0 tx=0).stop 2023-11-28T18:38:14.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.474+0000 7f1fc6396640 1 -- 172.21.15.45:0/1640653989 shutdown_connections 2023-11-28T18:38:14.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.474+0000 7f1fc6396640 1 --2- 172.21.15.45:0/1640653989 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1fac0668d0 0x7f1fac068d90 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:14.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.474+0000 7f1fc6396640 1 --2- 172.21.15.45:0/1640653989 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1fc015fde0 0x7f1fc0142f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:14.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.474+0000 7f1fc6396640 1 --2- 172.21.15.45:0/1640653989 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fc01469a0 0x7f1fc0144720 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:14.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.474+0000 7f1fc6396640 1 --2- 172.21.15.45:0/1640653989 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1fc00b4070 0x7f1fc0134120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:14.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.474+0000 7f1fc6396640 1 -- 172.21.15.45:0/1640653989 >> 172.21.15.45:0/1640653989 conn(0x7f1fc0070b80 msgr2=0x7f1fc0066360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:14.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.474+0000 7f1fc6396640 1 -- 172.21.15.45:0/1640653989 shutdown_connections 2023-11-28T18:38:14.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.474+0000 7f1fc6396640 1 -- 172.21.15.45:0/1640653989 wait complete. 2023-11-28T18:38:14.494 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T18:38:14.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.634+0000 7f02c7a9a640 1 Processor -- start 2023-11-28T18:38:14.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.638+0000 7f02c7a9a640 1 -- start start 2023-11-28T18:38:14.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.638+0000 7f02c7a9a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f02c006ca10 0x7f02c00704a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:14.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.638+0000 7f02c7a9a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f02c00721c0 0x7f02c00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:14.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.638+0000 7f02c7a9a640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02c0071120 con 0x7f02c0144880 2023-11-28T18:38:14.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.638+0000 7f02c7a9a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02c015f050 con 0x7f02c00721c0 2023-11-28T18:38:14.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.638+0000 7f02c7a9a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02c0070f20 con 0x7f02c006ca10 2023-11-28T18:38:14.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.638+0000 7f02c6037640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f02c00721c0 0x7f02c00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:14.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.638+0000 7f02c5836640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f02c0144880 0x7f02c006c300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45856/0 (socket says 172.21.15.45:45856) 2023-11-28T18:38:14.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.638+0000 7f02c5836640 1 -- 172.21.15.45:0/3103416442 learned_addr learned my addr 172.21.15.45:0/3103416442 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:38:14.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.638+0000 7f02c5035640 1 --2- 172.21.15.45:0/3103416442 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f02c006ca10 0x7f02c00704a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:14.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.638+0000 7f02c6037640 1 -- 172.21.15.45:0/3103416442 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f02c006ca10 msgr2=0x7f02c00704a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:14.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.638+0000 7f02c6037640 1 --2- 172.21.15.45:0/3103416442 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f02c006ca10 0x7f02c00704a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:14.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.638+0000 7f02c6037640 1 -- 172.21.15.45:0/3103416442 >> v1:172.21.15.45:6789/0 conn(0x7f02c0144880 legacy=0x7f02c006c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:14.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.638+0000 7f02c6037640 1 -- 172.21.15.45:0/3103416442 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02c0071400 con 0x7f02c00721c0 2023-11-28T18:38:14.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.638+0000 7f02c4834640 1 -- 172.21.15.45:0/3103416442 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 71890610 0 0) 0x7f02c0071120 con 0x7f02c0144880 2023-11-28T18:38:14.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.642+0000 7f02c6037640 1 --2- 172.21.15.45:0/3103416442 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02c00721c0 0x7f02c00709e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f02b8009d90 tx=0x7f02b801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27e7c317a1d41786 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:14.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.642+0000 7f02c4834640 1 -- 172.21.15.45:0/3103416442 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b80a59e0 con 0x7f02c00721c0 2023-11-28T18:38:14.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.642+0000 7f02c4834640 1 -- 172.21.15.45:0/3103416442 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02b80a5b40 con 0x7f02c00721c0 2023-11-28T18:38:14.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.642+0000 7f02c4834640 1 -- 172.21.15.45:0/3103416442 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b80ad440 con 0x7f02c00721c0 2023-11-28T18:38:14.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.642+0000 7f02c7a9a640 1 -- 172.21.15.45:0/3103416442 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02c00721c0 msgr2=0x7f02c00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:14.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.642+0000 7f02c7a9a640 1 --2- 172.21.15.45:0/3103416442 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02c00721c0 0x7f02c00709e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f02b8009d90 tx=0x7f02b801c920 comp rx=0 tx=0).stop 2023-11-28T18:38:14.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.642+0000 7f02c7a9a640 1 -- 172.21.15.45:0/3103416442 shutdown_connections 2023-11-28T18:38:14.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.642+0000 7f02c7a9a640 1 --2- 172.21.15.45:0/3103416442 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02c00721c0 0x7f02c00709e0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:14.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.642+0000 7f02c7a9a640 1 --2- 172.21.15.45:0/3103416442 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f02c006ca10 0x7f02c00704a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:14.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.642+0000 7f02c7a9a640 1 -- 172.21.15.45:0/3103416442 >> 172.21.15.45:0/3103416442 conn(0x7f02c006a570 msgr2=0x7f02c006a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:14.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.642+0000 7f02c7a9a640 1 -- 172.21.15.45:0/3103416442 shutdown_connections 2023-11-28T18:38:14.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.642+0000 7f02c7a9a640 1 -- 172.21.15.45:0/3103416442 wait complete. 2023-11-28T18:38:14.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.642+0000 7f02c7a9a640 1 Processor -- start 2023-11-28T18:38:14.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.642+0000 7f02c7a9a640 1 -- start start 2023-11-28T18:38:14.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.646+0000 7f02c7a9a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f02c006ca10 0x7f02c015a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:14.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.646+0000 7f02c7a9a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f02c00721c0 0x7f02c01f63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:14.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.646+0000 7f02c7a9a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02c0144880 0x7f02c01f8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:14.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.646+0000 7f02c7a9a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c01f59d0 con 0x7f02c0144880 2023-11-28T18:38:14.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.646+0000 7f02c7a9a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c015ad50 con 0x7f02c00721c0 2023-11-28T18:38:14.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.646+0000 7f02c7a9a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02c01f5bf0 con 0x7f02c006ca10 2023-11-28T18:38:14.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.646+0000 7f02c6037640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02c0144880 0x7f02c01f8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:14.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.646+0000 7f02c6037640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02c0144880 0x7f02c01f8ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54156/0 (socket says 172.21.15.45:54156) 2023-11-28T18:38:14.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.646+0000 7f02c6037640 1 -- 172.21.15.45:0/635564295 learned_addr learned my addr 172.21.15.45:0/635564295 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:14.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.646+0000 7f02c5035640 1 --2- 172.21.15.45:0/635564295 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f02c00721c0 0x7f02c01f63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:14.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.646+0000 7f02c5836640 1 --2- 172.21.15.45:0/635564295 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f02c006ca10 0x7f02c015a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:14.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.646+0000 7f02c6037640 1 -- 172.21.15.45:0/635564295 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f02c006ca10 msgr2=0x7f02c015a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:14.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.646+0000 7f02c6037640 1 --2- 172.21.15.45:0/635564295 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f02c006ca10 0x7f02c015a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:14.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.646+0000 7f02c6037640 1 -- 172.21.15.45:0/635564295 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f02c00721c0 msgr2=0x7f02c01f63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:14.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.646+0000 7f02c6037640 1 --2- 172.21.15.45:0/635564295 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f02c00721c0 0x7f02c01f63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:14.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.646+0000 7f02c6037640 1 -- 172.21.15.45:0/635564295 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02b8009a70 con 0x7f02c0144880 2023-11-28T18:38:14.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.646+0000 7f02c6037640 1 --2- 172.21.15.45:0/635564295 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02c0144880 0x7f02c01f8ff0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f02b801a550 tx=0x7f02b80196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:14.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.646+0000 7f02b67fc640 1 -- 172.21.15.45:0/635564295 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b80aed80 con 0x7f02c0144880 2023-11-28T18:38:14.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.646+0000 7f02b67fc640 1 -- 172.21.15.45:0/635564295 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02b8009450 con 0x7f02c0144880 2023-11-28T18:38:14.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.646+0000 7f02b67fc640 1 -- 172.21.15.45:0/635564295 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b80b7610 con 0x7f02c0144880 2023-11-28T18:38:14.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.646+0000 7f02c7a9a640 1 -- 172.21.15.45:0/635564295 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02c01f99d0 con 0x7f02c0144880 2023-11-28T18:38:14.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.646+0000 7f02c7a9a640 1 -- 172.21.15.45:0/635564295 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02c01f5eb0 con 0x7f02c0144880 2023-11-28T18:38:14.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.646+0000 7f02c7a9a640 1 -- 172.21.15.45:0/635564295 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02c01f9ef0 con 0x7f02c0144880 2023-11-28T18:38:14.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.650+0000 7f02b67fc640 1 -- 172.21.15.45:0/635564295 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f02b80b4050 con 0x7f02c0144880 2023-11-28T18:38:14.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.650+0000 7f02b67fc640 1 --2- 172.21.15.45:0/635564295 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f02a40668d0 0x7f02a4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:14.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.650+0000 7f02b67fc640 1 -- 172.21.15.45:0/635564295 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5804+0+0 (secure 0 0 0) 0x7f02b811f9f0 con 0x7f02c0144880 2023-11-28T18:38:14.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.650+0000 7f02c5836640 1 --2- 172.21.15.45:0/635564295 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f02a40668d0 0x7f02a4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:14.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.650+0000 7f02c5836640 1 --2- 172.21.15.45:0/635564295 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f02a40668d0 0x7f02a4068d90 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f02bc000f70 tx=0x7f02bc007c10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:14.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.654+0000 7f02b67fc640 1 -- 172.21.15.45:0/635564295 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f02b80ecce0 con 0x7f02c0144880 2023-11-28T18:38:14.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.822+0000 7f02c7a9a640 1 -- 172.21.15.45:0/635564295 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f02c01f60a0 con 0x7f02c0144880 2023-11-28T18:38:14.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.822+0000 7f02b67fc640 1 -- 172.21.15.45:0/635564295 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7f02b80c6080 con 0x7f02c0144880 2023-11-28T18:38:14.824 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-11-28T18:38:14.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.822+0000 7f02c7a9a640 1 -- 172.21.15.45:0/635564295 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f02a40668d0 msgr2=0x7f02a4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:14.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.822+0000 7f02c7a9a640 1 --2- 172.21.15.45:0/635564295 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f02a40668d0 0x7f02a4068d90 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f02bc000f70 tx=0x7f02bc007c10 comp rx=0 tx=0).stop 2023-11-28T18:38:14.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.822+0000 7f02c7a9a640 1 -- 172.21.15.45:0/635564295 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02c0144880 msgr2=0x7f02c01f8ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:14.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.822+0000 7f02c7a9a640 1 --2- 172.21.15.45:0/635564295 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02c0144880 0x7f02c01f8ff0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f02b801a550 tx=0x7f02b80196c0 comp rx=0 tx=0).stop 2023-11-28T18:38:14.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.822+0000 7f02c7a9a640 1 -- 172.21.15.45:0/635564295 shutdown_connections 2023-11-28T18:38:14.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.822+0000 7f02c7a9a640 1 --2- 172.21.15.45:0/635564295 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f02a40668d0 0x7f02a4068d90 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:14.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.822+0000 7f02c7a9a640 1 --2- 172.21.15.45:0/635564295 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02c0144880 0x7f02c01f8ff0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:14.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.822+0000 7f02c7a9a640 1 --2- 172.21.15.45:0/635564295 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f02c00721c0 0x7f02c01f63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:14.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.822+0000 7f02c7a9a640 1 --2- 172.21.15.45:0/635564295 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f02c006ca10 0x7f02c015a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:14.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.822+0000 7f02c7a9a640 1 -- 172.21.15.45:0/635564295 >> 172.21.15.45:0/635564295 conn(0x7f02c006a570 msgr2=0x7f02c00704a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:14.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.822+0000 7f02c7a9a640 1 -- 172.21.15.45:0/635564295 shutdown_connections 2023-11-28T18:38:14.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:14.822+0000 7f02c7a9a640 1 -- 172.21.15.45:0/635564295 wait complete. 2023-11-28T18:38:14.846 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T18:38:14.846 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T18:38:14.856 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T18:38:15.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.038+0000 7f6ca59d1640 1 Processor -- start 2023-11-28T18:38:15.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.038+0000 7f6ca59d1640 1 -- start start 2023-11-28T18:38:15.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.038+0000 7f6ca59d1640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6ca015d240 0x7f6ca00d2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:15.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.038+0000 7f6ca59d1640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ca00b2a30 con 0x7f6ca00d11a0 2023-11-28T18:38:15.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.038+0000 7f6ca59d1640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ca00d1b40 con 0x7f6ca00d15e0 2023-11-28T18:38:15.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.038+0000 7f6ca59d1640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ca00d1e20 con 0x7f6ca015d240 2023-11-28T18:38:15.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.038+0000 7f6c9effd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6ca015d240 0x7f6ca00d2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:15.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.038+0000 7f6c97fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f6ca00d11a0 0x7f6ca00cde30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45870/0 (socket says 172.21.15.45:45870) 2023-11-28T18:38:15.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.038+0000 7f6c97fff640 1 -- 172.21.15.45:0/1076122919 learned_addr learned my addr 172.21.15.45:0/1076122919 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:38:15.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.038+0000 7f6c9effd640 1 -- 172.21.15.45:0/1076122919 >> v1:172.21.15.190:6789/0 conn(0x7f6ca00d15e0 legacy=0x7f6ca00b61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:15.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.038+0000 7f6c9effd640 1 -- 172.21.15.45:0/1076122919 >> v1:172.21.15.45:6789/0 conn(0x7f6ca00d11a0 legacy=0x7f6ca00cde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:15.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.038+0000 7f6c9effd640 1 -- 172.21.15.45:0/1076122919 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca00d2100 con 0x7f6ca015d240 2023-11-28T18:38:15.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.038+0000 7f6c9e7fc640 1 -- 172.21.15.45:0/1076122919 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3180657660 0 0) 0x7f6ca00b2a30 con 0x7f6ca00d11a0 2023-11-28T18:38:15.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.042+0000 7f6c9effd640 1 --2- 172.21.15.45:0/1076122919 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ca015d240 0x7f6ca00d2be0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6c900097c0 tx=0x7f6c9001ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d351ab306038b6c5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:15.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.042+0000 7f6c9e7fc640 1 -- 172.21.15.45:0/1076122919 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c900a8930 con 0x7f6ca015d240 2023-11-28T18:38:15.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.042+0000 7f6c9e7fc640 1 -- 172.21.15.45:0/1076122919 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c900a8a90 con 0x7f6ca015d240 2023-11-28T18:38:15.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.042+0000 7f6c9e7fc640 1 -- 172.21.15.45:0/1076122919 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c900a8e20 con 0x7f6ca015d240 2023-11-28T18:38:15.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.042+0000 7f6ca59d1640 1 -- 172.21.15.45:0/1076122919 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ca015d240 msgr2=0x7f6ca00d2be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:15.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.042+0000 7f6ca59d1640 1 --2- 172.21.15.45:0/1076122919 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ca015d240 0x7f6ca00d2be0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6c900097c0 tx=0x7f6c9001ec30 comp rx=0 tx=0).stop 2023-11-28T18:38:15.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.042+0000 7f6ca59d1640 1 -- 172.21.15.45:0/1076122919 shutdown_connections 2023-11-28T18:38:15.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.042+0000 7f6ca59d1640 1 --2- 172.21.15.45:0/1076122919 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ca015d240 0x7f6ca00d2be0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:15.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.042+0000 7f6ca59d1640 1 -- 172.21.15.45:0/1076122919 >> 172.21.15.45:0/1076122919 conn(0x7f6ca00722a0 msgr2=0x7f6ca00cfbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:15.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.042+0000 7f6ca59d1640 1 -- 172.21.15.45:0/1076122919 shutdown_connections 2023-11-28T18:38:15.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.042+0000 7f6ca59d1640 1 -- 172.21.15.45:0/1076122919 wait complete. 2023-11-28T18:38:15.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.046+0000 7f6ca59d1640 1 Processor -- start 2023-11-28T18:38:15.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.046+0000 7f6ca59d1640 1 -- start start 2023-11-28T18:38:15.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.046+0000 7f6ca59d1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ca00d11a0 0x7f6ca015fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:15.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.046+0000 7f6ca59d1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ca00d15e0 0x7f6ca00cc710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:15.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.046+0000 7f6ca59d1640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ca015d240 0x7f6ca00ccc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:15.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.046+0000 7f6ca59d1640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca01601f0 con 0x7f6ca00d11a0 2023-11-28T18:38:15.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.046+0000 7f6ca59d1640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca00c7c10 con 0x7f6ca015d240 2023-11-28T18:38:15.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.046+0000 7f6ca59d1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca00cd190 con 0x7f6ca00d15e0 2023-11-28T18:38:15.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.046+0000 7f6c9effd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ca00d11a0 0x7f6ca015fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:15.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.046+0000 7f6c9effd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ca00d11a0 0x7f6ca015fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54172/0 (socket says 172.21.15.45:54172) 2023-11-28T18:38:15.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.046+0000 7f6c9effd640 1 -- 172.21.15.45:0/3052098250 learned_addr learned my addr 172.21.15.45:0/3052098250 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:15.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.046+0000 7f6c97fff640 1 --2- 172.21.15.45:0/3052098250 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ca00d15e0 0x7f6ca00cc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:15.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.046+0000 7f6c9f7fe640 1 --2- 172.21.15.45:0/3052098250 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ca015d240 0x7f6ca00ccc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:15.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.046+0000 7f6c9effd640 1 -- 172.21.15.45:0/3052098250 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ca00d15e0 msgr2=0x7f6ca00cc710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:15.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.046+0000 7f6c9effd640 1 --2- 172.21.15.45:0/3052098250 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ca00d15e0 0x7f6ca00cc710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:15.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.046+0000 7f6c9effd640 1 -- 172.21.15.45:0/3052098250 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ca015d240 msgr2=0x7f6ca00ccc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:15.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.046+0000 7f6c9effd640 1 --2- 172.21.15.45:0/3052098250 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ca015d240 0x7f6ca00ccc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:15.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.046+0000 7f6c9effd640 1 -- 172.21.15.45:0/3052098250 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c90009420 con 0x7f6ca00d11a0 2023-11-28T18:38:15.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.046+0000 7f6c9effd640 1 --2- 172.21.15.45:0/3052098250 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ca00d11a0 0x7f6ca015fcb0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6c900097c0 tx=0x7f6c9001b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:15.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.046+0000 7f6c9cff9640 1 -- 172.21.15.45:0/3052098250 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c900b0ea0 con 0x7f6ca00d11a0 2023-11-28T18:38:15.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.046+0000 7f6c9cff9640 1 -- 172.21.15.45:0/3052098250 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c90004030 con 0x7f6ca00d11a0 2023-11-28T18:38:15.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.046+0000 7f6ca59d1640 1 -- 172.21.15.45:0/3052098250 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ca00cb1a0 con 0x7f6ca00d11a0 2023-11-28T18:38:15.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.046+0000 7f6c9cff9640 1 -- 172.21.15.45:0/3052098250 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c900043a0 con 0x7f6ca00d11a0 2023-11-28T18:38:15.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.046+0000 7f6ca59d1640 1 -- 172.21.15.45:0/3052098250 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ca0160680 con 0x7f6ca00d11a0 2023-11-28T18:38:15.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.046+0000 7f6ca59d1640 1 -- 172.21.15.45:0/3052098250 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ca0069480 con 0x7f6ca00d11a0 2023-11-28T18:38:15.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.050+0000 7f6c9cff9640 1 -- 172.21.15.45:0/3052098250 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f6c900b7040 con 0x7f6ca00d11a0 2023-11-28T18:38:15.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.050+0000 7f6c9cff9640 1 --2- 172.21.15.45:0/3052098250 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6c800668d0 0x7f6c80068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:15.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.050+0000 7f6c9cff9640 1 -- 172.21.15.45:0/3052098250 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5804+0+0 (secure 0 0 0) 0x7f6c901220f0 con 0x7f6ca00d11a0 2023-11-28T18:38:15.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.050+0000 7f6c97fff640 1 --2- 172.21.15.45:0/3052098250 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6c800668d0 0x7f6c80068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:15.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.050+0000 7f6c97fff640 1 --2- 172.21.15.45:0/3052098250 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6c800668d0 0x7f6c80068d90 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6ca00ca8c0 tx=0x7f6c88007b60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:15.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.054+0000 7f6c9cff9640 1 -- 172.21.15.45:0/3052098250 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6c900ef2c0 con 0x7f6ca00d11a0 2023-11-28T18:38:15.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.214+0000 7f6ca59d1640 1 -- 172.21.15.45:0/3052098250 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6ca00ce7b0 con 0x7f6ca00d11a0 2023-11-28T18:38:15.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.214+0000 7f6c9cff9640 1 -- 172.21.15.45:0/3052098250 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16689 (secure 0 0 0) 0x7f6c900b5090 con 0x7f6ca00d11a0 2023-11-28T18:38:15.217 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:38:15.218 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":22,"fsid":"d10f5cd6-1d00-4019-99b6-6fa435498a15","created":"2023-11-28T18:37:08.189030+0000","modified":"2023-11-28T18:38:15.148068+0000","last_up_change":"2023-11-28T18:37:20.196124+0000","last_in_change":"2023-11-28T18:37:10.742043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T18:37:21.293917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T18:37:31.384760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T18:37:31.834769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"84465384-103c-4f2c-a45a-96f5bb9c835f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6809","nonce":555237322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6811","nonce":555237322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6815","nonce":555237322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6813","nonce":555237322}]},"public_addr":"172.21.15.45:6809/555237322","cluster_addr":"172.21.15.45:6811/555237322","heartbeat_back_addr":"172.21.15.45:6815/555237322","heartbeat_front_addr":"172.21.15.45:6813/555237322","state":["exists","up"]},{"osd":1,"uuid":"7d9eed24-a58f-42c7-a787-ac06be8553fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6801","nonce":2857063763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6803","nonce":2857063763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6807","nonce":2857063763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6805","nonce":2857063763}]},"public_addr":"172.21.15.45:6801/2857063763","cluster_addr":"172.21.15.45:6803/2857063763","heartbeat_back_addr":"172.21.15.45:6807/2857063763","heartbeat_front_addr":"172.21.15.45:6805/2857063763","state":["exists","up"]},{"osd":2,"uuid":"575eeccc-4abf-45b4-9caf-f3e797859588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6817","nonce":193884539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6819","nonce":193884539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6823","nonce":193884539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6821","nonce":193884539}]},"public_addr":"172.21.15.45:6817/193884539","cluster_addr":"172.21.15.45:6819/193884539","heartbeat_back_addr":"172.21.15.45:6823/193884539","heartbeat_front_addr":"172.21.15.45:6821/193884539","state":["exists","up"]},{"osd":3,"uuid":"9b0290d6-9a52-4bc8-b2a1-7622c5dc8e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6825","nonce":78541084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6827","nonce":78541084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6831","nonce":78541084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6829","nonce":78541084}]},"public_addr":"172.21.15.45:6825/78541084","cluster_addr":"172.21.15.45:6827/78541084","heartbeat_back_addr":"172.21.15.45:6831/78541084","heartbeat_front_addr":"172.21.15.45:6829/78541084","state":["exists","up"]},{"osd":4,"uuid":"ce632829-f027-4fbf-a627-02c571aa9d53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6809","nonce":1537591987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6811","nonce":1537591987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6815","nonce":1537591987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6813","nonce":1537591987}]},"public_addr":"172.21.15.190:6809/1537591987","cluster_addr":"172.21.15.190:6811/1537591987","heartbeat_back_addr":"172.21.15.190:6815/1537591987","heartbeat_front_addr":"172.21.15.190:6813/1537591987","state":["exists","up"]},{"osd":5,"uuid":"8700b609-27be-40bd-a251-4c0ae0a29ead","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6801","nonce":3296698407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6803","nonce":3296698407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6807","nonce":3296698407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6805","nonce":3296698407}]},"public_addr":"172.21.15.190:6801/3296698407","cluster_addr":"172.21.15.190:6803/3296698407","heartbeat_back_addr":"172.21.15.190:6807/3296698407","heartbeat_front_addr":"172.21.15.190:6805/3296698407","state":["exists","up"]},{"osd":6,"uuid":"44ce4a40-e6ff-4f4d-8e8a-7341e5c91f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6817","nonce":2317686718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6819","nonce":2317686718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6823","nonce":2317686718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6821","nonce":2317686718}]},"public_addr":"172.21.15.190:6817/2317686718","cluster_addr":"172.21.15.190:6819/2317686718","heartbeat_back_addr":"172.21.15.190:6823/2317686718","heartbeat_front_addr":"172.21.15.190:6821/2317686718","state":["exists","up"]},{"osd":7,"uuid":"192238c9-1423-4b7e-ac8f-84ba32113ddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6825","nonce":2493232051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6827","nonce":2493232051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6831","nonce":2493232051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6829","nonce":2493232051}]},"public_addr":"172.21.15.190:6825/2493232051","cluster_addr":"172.21.15.190:6827/2493232051","heartbeat_back_addr":"172.21.15.190:6831/2493232051","heartbeat_front_addr":"172.21.15.190:6829/2493232051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.393552+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.385453+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.361421+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.366408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.363226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.276007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.414605+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.445885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2},{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T18:38:15.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.218+0000 7f6ca59d1640 1 -- 172.21.15.45:0/3052098250 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6c800668d0 msgr2=0x7f6c80068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:15.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.218+0000 7f6ca59d1640 1 --2- 172.21.15.45:0/3052098250 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6c800668d0 0x7f6c80068d90 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6ca00ca8c0 tx=0x7f6c88007b60 comp rx=0 tx=0).stop 2023-11-28T18:38:15.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.218+0000 7f6ca59d1640 1 -- 172.21.15.45:0/3052098250 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ca00d11a0 msgr2=0x7f6ca015fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:15.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.218+0000 7f6ca59d1640 1 --2- 172.21.15.45:0/3052098250 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ca00d11a0 0x7f6ca015fcb0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6c900097c0 tx=0x7f6c9001b9d0 comp rx=0 tx=0).stop 2023-11-28T18:38:15.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.218+0000 7f6ca59d1640 1 -- 172.21.15.45:0/3052098250 shutdown_connections 2023-11-28T18:38:15.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.218+0000 7f6ca59d1640 1 --2- 172.21.15.45:0/3052098250 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6c800668d0 0x7f6c80068d90 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:15.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.218+0000 7f6ca59d1640 1 --2- 172.21.15.45:0/3052098250 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ca015d240 0x7f6ca00ccc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:15.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.218+0000 7f6ca59d1640 1 --2- 172.21.15.45:0/3052098250 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ca00d15e0 0x7f6ca00cc710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:15.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.218+0000 7f6ca59d1640 1 --2- 172.21.15.45:0/3052098250 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ca00d11a0 0x7f6ca015fcb0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:15.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.218+0000 7f6ca59d1640 1 -- 172.21.15.45:0/3052098250 >> 172.21.15.45:0/3052098250 conn(0x7f6ca00722a0 msgr2=0x7f6ca00b7870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:15.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.218+0000 7f6ca59d1640 1 -- 172.21.15.45:0/3052098250 shutdown_connections 2023-11-28T18:38:15.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.218+0000 7f6ca59d1640 1 -- 172.21.15.45:0/3052098250 wait complete. 2023-11-28T18:38:15.239 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T18:37:21.293917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T18:37:31.384760+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T18:37:31.834769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T18:38:15.239 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T18:38:15.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.382+0000 7f329549c640 1 Processor -- start 2023-11-28T18:38:15.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.382+0000 7f329549c640 1 -- start start 2023-11-28T18:38:15.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.382+0000 7f329549c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3290160a40 0x7f32900d3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:15.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.382+0000 7f329549c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f32900d1cf0 0x7f32900ce0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:15.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.382+0000 7f329549c640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32900b39f0 con 0x7f32900d0070 2023-11-28T18:38:15.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.382+0000 7f329549c640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32900d0e80 con 0x7f3290160a40 2023-11-28T18:38:15.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.382+0000 7f329549c640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32900b3c90 con 0x7f32900d1cf0 2023-11-28T18:38:15.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.386+0000 7f328ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3290160a40 0x7f32900d3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:15.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.386+0000 7f328ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3290160a40 0x7f32900d3b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54188/0 (socket says 172.21.15.45:54188) 2023-11-28T18:38:15.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.386+0000 7f328ffff640 1 -- 172.21.15.45:0/3789852461 learned_addr learned my addr 172.21.15.45:0/3789852461 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:15.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.386+0000 7f3294c9b640 1 --2- 172.21.15.45:0/3789852461 >> v2:172.21.15.190:3300/0 conn(0x7f32900d1cf0 0x7f32900ce0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:15.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.386+0000 7f328ffff640 1 -- 172.21.15.45:0/3789852461 >> v2:172.21.15.190:3300/0 conn(0x7f32900d1cf0 msgr2=0x7f32900ce0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:15.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.386+0000 7f328ffff640 1 --2- 172.21.15.45:0/3789852461 >> v2:172.21.15.190:3300/0 conn(0x7f32900d1cf0 0x7f32900ce0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:15.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.386+0000 7f328ffff640 1 -- 172.21.15.45:0/3789852461 >> v1:172.21.15.190:6789/0 conn(0x7f32900d0070 legacy=0x7f32900d15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:15.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.386+0000 7f328ffff640 1 -- 172.21.15.45:0/3789852461 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3290160e20 con 0x7f3290160a40 2023-11-28T18:38:15.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.386+0000 7f328ffff640 1 --2- 172.21.15.45:0/3789852461 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3290160a40 0x7f32900d3b20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f32900c6ad0 tx=0x7f328001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95982fd21e78adb1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:15.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.386+0000 7f328effd640 1 -- 172.21.15.45:0/3789852461 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32800aa680 con 0x7f3290160a40 2023-11-28T18:38:15.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.386+0000 7f328effd640 1 -- 172.21.15.45:0/3789852461 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32800aa7e0 con 0x7f3290160a40 2023-11-28T18:38:15.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.386+0000 7f328effd640 1 -- 172.21.15.45:0/3789852461 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32800aab70 con 0x7f3290160a40 2023-11-28T18:38:15.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.390+0000 7f329549c640 1 -- 172.21.15.45:0/3789852461 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3290160a40 msgr2=0x7f32900d3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:15.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.390+0000 7f329549c640 1 --2- 172.21.15.45:0/3789852461 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3290160a40 0x7f32900d3b20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f32900c6ad0 tx=0x7f328001c500 comp rx=0 tx=0).stop 2023-11-28T18:38:15.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.390+0000 7f329549c640 1 -- 172.21.15.45:0/3789852461 shutdown_connections 2023-11-28T18:38:15.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.390+0000 7f329549c640 1 --2- 172.21.15.45:0/3789852461 >> v2:172.21.15.190:3300/0 conn(0x7f32900d1cf0 0x7f32900ce0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:15.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.390+0000 7f329549c640 1 --2- 172.21.15.45:0/3789852461 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3290160a40 0x7f32900d3b20 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:15.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.390+0000 7f329549c640 1 -- 172.21.15.45:0/3789852461 >> 172.21.15.45:0/3789852461 conn(0x7f32900d3000 msgr2=0x7f32900d3410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:15.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.390+0000 7f329549c640 1 -- 172.21.15.45:0/3789852461 shutdown_connections 2023-11-28T18:38:15.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.390+0000 7f329549c640 1 -- 172.21.15.45:0/3789852461 wait complete. 2023-11-28T18:38:15.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.390+0000 7f329549c640 1 Processor -- start 2023-11-28T18:38:15.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.390+0000 7f329549c640 1 -- start start 2023-11-28T18:38:15.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.390+0000 7f329549c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32900d0070 0x7f32900ccb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:15.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.390+0000 7f329549c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f32900d1cf0 0x7f32900b7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:15.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.390+0000 7f329549c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3290160a40 0x7f32900b7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:15.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.390+0000 7f329549c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32900cd0c0 con 0x7f32900d0070 2023-11-28T18:38:15.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.390+0000 7f329549c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32900b7bc0 con 0x7f32900d1cf0 2023-11-28T18:38:15.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.390+0000 7f329549c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32900b7ea0 con 0x7f3290160a40 2023-11-28T18:38:15.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.390+0000 7f328ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32900d0070 0x7f32900ccb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:15.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.390+0000 7f328ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32900d0070 0x7f32900ccb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54192/0 (socket says 172.21.15.45:54192) 2023-11-28T18:38:15.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.390+0000 7f328ffff640 1 -- 172.21.15.45:0/1237610601 learned_addr learned my addr 172.21.15.45:0/1237610601 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:15.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.390+0000 7f328f7fe640 1 --2- 172.21.15.45:0/1237610601 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f32900d1cf0 0x7f32900b7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:15.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.394+0000 7f328ffff640 1 -- 172.21.15.45:0/1237610601 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3290160a40 msgr2=0x7f32900b7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:15.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.394+0000 7f328ffff640 1 --2- 172.21.15.45:0/1237610601 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3290160a40 0x7f32900b7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:15.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.394+0000 7f328ffff640 1 -- 172.21.15.45:0/1237610601 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f32900d1cf0 msgr2=0x7f32900b7000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:15.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.394+0000 7f328ffff640 1 --2- 172.21.15.45:0/1237610601 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f32900d1cf0 0x7f32900b7000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:15.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.394+0000 7f328ffff640 1 -- 172.21.15.45:0/1237610601 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32800094d0 con 0x7f32900d0070 2023-11-28T18:38:15.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.394+0000 7f328ffff640 1 --2- 172.21.15.45:0/1237610601 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32900d0070 0x7f32900ccb80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f32800ac040 tx=0x7f328001ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:15.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.394+0000 7f328cff9640 1 -- 172.21.15.45:0/1237610601 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32800aa680 con 0x7f32900d0070 2023-11-28T18:38:15.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.394+0000 7f328cff9640 1 -- 172.21.15.45:0/1237610601 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32800b3820 con 0x7f32900d0070 2023-11-28T18:38:15.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.394+0000 7f328cff9640 1 -- 172.21.15.45:0/1237610601 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32800b3bd0 con 0x7f32900d0070 2023-11-28T18:38:15.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.394+0000 7f329549c640 1 -- 172.21.15.45:0/1237610601 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32900b8180 con 0x7f32900d0070 2023-11-28T18:38:15.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.394+0000 7f329549c640 1 -- 172.21.15.45:0/1237610601 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32900cc2d0 con 0x7f32900d0070 2023-11-28T18:38:15.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.394+0000 7f329549c640 1 -- 172.21.15.45:0/1237610601 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3290067a30 con 0x7f32900d0070 2023-11-28T18:38:15.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.394+0000 7f328cff9640 1 -- 172.21.15.45:0/1237610601 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f32800b3d30 con 0x7f32900d0070 2023-11-28T18:38:15.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.394+0000 7f328cff9640 1 --2- 172.21.15.45:0/1237610601 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f327c0668d0 0x7f327c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:15.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.394+0000 7f328cff9640 1 -- 172.21.15.45:0/1237610601 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5804+0+0 (secure 0 0 0) 0x7f328011ed30 con 0x7f32900d0070 2023-11-28T18:38:15.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.398+0000 7f328f7fe640 1 --2- 172.21.15.45:0/1237610601 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f327c0668d0 0x7f327c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:15.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.398+0000 7f328f7fe640 1 --2- 172.21.15.45:0/1237610601 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f327c0668d0 0x7f327c068d90 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f32901f9780 tx=0x7f3284009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:15.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.398+0000 7f328cff9640 1 -- 172.21.15.45:0/1237610601 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f32800ebf20 con 0x7f32900d0070 2023-11-28T18:38:15.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.558+0000 7f329549c640 1 -- 172.21.15.45:0/1237610601 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f32900a0ee0 con 0x7f32900d0070 2023-11-28T18:38:15.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.558+0000 7f328cff9640 1 -- 172.21.15.45:0/1237610601 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f32800c3020 con 0x7f32900d0070 2023-11-28T18:38:15.562 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-11-28T18:38:15.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.562+0000 7f329549c640 1 -- 172.21.15.45:0/1237610601 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f327c0668d0 msgr2=0x7f327c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:15.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.562+0000 7f329549c640 1 --2- 172.21.15.45:0/1237610601 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f327c0668d0 0x7f327c068d90 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f32901f9780 tx=0x7f3284009040 comp rx=0 tx=0).stop 2023-11-28T18:38:15.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.562+0000 7f329549c640 1 -- 172.21.15.45:0/1237610601 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32900d0070 msgr2=0x7f32900ccb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:15.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.562+0000 7f329549c640 1 --2- 172.21.15.45:0/1237610601 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32900d0070 0x7f32900ccb80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f32800ac040 tx=0x7f328001ad40 comp rx=0 tx=0).stop 2023-11-28T18:38:15.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.562+0000 7f329549c640 1 -- 172.21.15.45:0/1237610601 shutdown_connections 2023-11-28T18:38:15.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.562+0000 7f329549c640 1 --2- 172.21.15.45:0/1237610601 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f327c0668d0 0x7f327c068d90 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:15.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.562+0000 7f329549c640 1 --2- 172.21.15.45:0/1237610601 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3290160a40 0x7f32900b7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:15.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.562+0000 7f329549c640 1 --2- 172.21.15.45:0/1237610601 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f32900d1cf0 0x7f32900b7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:15.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.562+0000 7f329549c640 1 --2- 172.21.15.45:0/1237610601 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32900d0070 0x7f32900ccb80 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:15.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.562+0000 7f329549c640 1 -- 172.21.15.45:0/1237610601 >> 172.21.15.45:0/1237610601 conn(0x7f32900d3000 msgr2=0x7f329006b040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:15.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.562+0000 7f329549c640 1 -- 172.21.15.45:0/1237610601 shutdown_connections 2023-11-28T18:38:15.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.562+0000 7f329549c640 1 -- 172.21.15.45:0/1237610601 wait complete. 2023-11-28T18:38:15.582 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T18:38:15.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.726+0000 7f20e952a640 1 Processor -- start 2023-11-28T18:38:15.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.726+0000 7f20e952a640 1 -- start start 2023-11-28T18:38:15.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.730+0000 7f20e952a640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f20e4157210 0x7f20e4070cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:15.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.730+0000 7f20e952a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f20e415d920 0x7f20e40cd030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:15.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.730+0000 7f20e952a640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20e41575f0 con 0x7f20e40ae870 2023-11-28T18:38:15.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.730+0000 7f20e952a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20e4071640 con 0x7f20e415d920 2023-11-28T18:38:15.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.730+0000 7f20e952a640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20e4071920 con 0x7f20e4157210 2023-11-28T18:38:15.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.730+0000 7f20e37fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f20e415d920 0x7f20e40cd030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:15.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.730+0000 7f20e37fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f20e415d920 0x7f20e40cd030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54204/0 (socket says 172.21.15.45:54204) 2023-11-28T18:38:15.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.730+0000 7f20e37fe640 1 -- 172.21.15.45:0/495370299 learned_addr learned my addr 172.21.15.45:0/495370299 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:15.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.730+0000 7f20e2ffd640 1 --2- 172.21.15.45:0/495370299 >> v2:172.21.15.190:3300/0 conn(0x7f20e4157210 0x7f20e4070cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:15.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.730+0000 7f20e37fe640 1 -- 172.21.15.45:0/495370299 >> v2:172.21.15.190:3300/0 conn(0x7f20e4157210 msgr2=0x7f20e4070cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:15.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.730+0000 7f20e37fe640 1 --2- 172.21.15.45:0/495370299 >> v2:172.21.15.190:3300/0 conn(0x7f20e4157210 0x7f20e4070cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:15.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.730+0000 7f20e37fe640 1 -- 172.21.15.45:0/495370299 >> v1:172.21.15.190:6789/0 conn(0x7f20e40ae870 legacy=0x7f20e415d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:15.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.730+0000 7f20e37fe640 1 -- 172.21.15.45:0/495370299 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e4071c00 con 0x7f20e415d920 2023-11-28T18:38:15.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.734+0000 7f20e37fe640 1 --2- 172.21.15.45:0/495370299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20e415d920 0x7f20e40cd030 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f20e406bfd0 tx=0x7f20dc01c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c649af3585f861d9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:15.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.734+0000 7f20e27fc640 1 -- 172.21.15.45:0/495370299 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20dc0a5670 con 0x7f20e415d920 2023-11-28T18:38:15.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.734+0000 7f20e27fc640 1 -- 172.21.15.45:0/495370299 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20dc0a57d0 con 0x7f20e415d920 2023-11-28T18:38:15.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.734+0000 7f20e27fc640 1 -- 172.21.15.45:0/495370299 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20dc0a5b60 con 0x7f20e415d920 2023-11-28T18:38:15.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.734+0000 7f20e952a640 1 -- 172.21.15.45:0/495370299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20e415d920 msgr2=0x7f20e40cd030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:15.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.734+0000 7f20e952a640 1 --2- 172.21.15.45:0/495370299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20e415d920 0x7f20e40cd030 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f20e406bfd0 tx=0x7f20dc01c940 comp rx=0 tx=0).stop 2023-11-28T18:38:15.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.734+0000 7f20e952a640 1 -- 172.21.15.45:0/495370299 shutdown_connections 2023-11-28T18:38:15.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.734+0000 7f20e952a640 1 --2- 172.21.15.45:0/495370299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20e415d920 0x7f20e40cd030 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:15.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.734+0000 7f20e952a640 1 --2- 172.21.15.45:0/495370299 >> v2:172.21.15.190:3300/0 conn(0x7f20e4157210 0x7f20e4070cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:15.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.734+0000 7f20e952a640 1 -- 172.21.15.45:0/495370299 >> 172.21.15.45:0/495370299 conn(0x7f20e40b0d00 msgr2=0x7f20e40b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:15.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.734+0000 7f20e952a640 1 -- 172.21.15.45:0/495370299 shutdown_connections 2023-11-28T18:38:15.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.734+0000 7f20e952a640 1 -- 172.21.15.45:0/495370299 wait complete. 2023-11-28T18:38:15.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.734+0000 7f20e952a640 1 Processor -- start 2023-11-28T18:38:15.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.734+0000 7f20e952a640 1 -- start start 2023-11-28T18:38:15.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.734+0000 7f20e952a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20e40ae870 0x7f20e414d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:15.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.734+0000 7f20e952a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f20e4157210 0x7f20e40afd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:15.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.738+0000 7f20e952a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f20e415d920 0x7f20e40b02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:15.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.738+0000 7f20e952a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e41f3de0 con 0x7f20e40ae870 2023-11-28T18:38:15.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.738+0000 7f20e952a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e41f4080 con 0x7f20e415d920 2023-11-28T18:38:15.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.738+0000 7f20e952a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20e41f4360 con 0x7f20e4157210 2023-11-28T18:38:15.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.738+0000 7f20e2ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20e40ae870 0x7f20e414d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:15.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.738+0000 7f20e2ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20e40ae870 0x7f20e414d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54214/0 (socket says 172.21.15.45:54214) 2023-11-28T18:38:15.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.738+0000 7f20e2ffd640 1 -- 172.21.15.45:0/4016941828 learned_addr learned my addr 172.21.15.45:0/4016941828 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:15.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.738+0000 7f20e37fe640 1 --2- 172.21.15.45:0/4016941828 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f20e415d920 0x7f20e40b02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:15.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.738+0000 7f20dbfff640 1 --2- 172.21.15.45:0/4016941828 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f20e4157210 0x7f20e40afd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:15.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.738+0000 7f20e2ffd640 1 -- 172.21.15.45:0/4016941828 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f20e4157210 msgr2=0x7f20e40afd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:15.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.738+0000 7f20e2ffd640 1 --2- 172.21.15.45:0/4016941828 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f20e4157210 0x7f20e40afd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:15.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.738+0000 7f20e2ffd640 1 -- 172.21.15.45:0/4016941828 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f20e415d920 msgr2=0x7f20e40b02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:15.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.738+0000 7f20e2ffd640 1 --2- 172.21.15.45:0/4016941828 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f20e415d920 0x7f20e40b02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:15.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.738+0000 7f20e2ffd640 1 -- 172.21.15.45:0/4016941828 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20dc009b30 con 0x7f20e40ae870 2023-11-28T18:38:15.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.738+0000 7f20dbfff640 1 --2- 172.21.15.45:0/4016941828 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f20e4157210 0x7f20e40afd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:38:15.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.738+0000 7f20e2ffd640 1 --2- 172.21.15.45:0/4016941828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20e40ae870 0x7f20e414d5e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f20d400e930 tx=0x7f20d400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:15.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.738+0000 7f20db7fe640 1 -- 172.21.15.45:0/4016941828 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d4009690 con 0x7f20e40ae870 2023-11-28T18:38:15.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.738+0000 7f20db7fe640 1 -- 172.21.15.45:0/4016941828 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20d400ca00 con 0x7f20e40ae870 2023-11-28T18:38:15.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.738+0000 7f20db7fe640 1 -- 172.21.15.45:0/4016941828 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d400cd70 con 0x7f20e40ae870 2023-11-28T18:38:15.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.738+0000 7f20e952a640 1 -- 172.21.15.45:0/4016941828 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20e41f4640 con 0x7f20e40ae870 2023-11-28T18:38:15.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.738+0000 7f20e952a640 1 -- 172.21.15.45:0/4016941828 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20e414db20 con 0x7f20e40ae870 2023-11-28T18:38:15.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.738+0000 7f20e952a640 1 -- 172.21.15.45:0/4016941828 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20e4069410 con 0x7f20e40ae870 2023-11-28T18:38:15.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.738+0000 7f20db7fe640 1 -- 172.21.15.45:0/4016941828 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f20d4013470 con 0x7f20e40ae870 2023-11-28T18:38:15.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.742+0000 7f20db7fe640 1 --2- 172.21.15.45:0/4016941828 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f20c40668d0 0x7f20c4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:15.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.742+0000 7f20db7fe640 1 -- 172.21.15.45:0/4016941828 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5804+0+0 (secure 0 0 0) 0x7f20d4084760 con 0x7f20e40ae870 2023-11-28T18:38:15.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.742+0000 7f20dbfff640 1 --2- 172.21.15.45:0/4016941828 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f20c40668d0 0x7f20c4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:15.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.742+0000 7f20dbfff640 1 --2- 172.21.15.45:0/4016941828 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f20c40668d0 0x7f20c4068d90 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f20e4151480 tx=0x7f20cc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:15.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.746+0000 7f20db7fe640 1 -- 172.21.15.45:0/4016941828 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f20d4051a10 con 0x7f20e40ae870 2023-11-28T18:38:15.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.902+0000 7f20e952a640 1 -- 172.21.15.45:0/4016941828 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f20e406e520 con 0x7f20e40ae870 2023-11-28T18:38:15.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.902+0000 7f20db7fe640 1 -- 172.21.15.45:0/4016941828 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f20d4055030 con 0x7f20e40ae870 2023-11-28T18:38:15.904 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-11-28T18:38:15.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.902+0000 7f20e952a640 1 -- 172.21.15.45:0/4016941828 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f20c40668d0 msgr2=0x7f20c4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:15.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.902+0000 7f20e952a640 1 --2- 172.21.15.45:0/4016941828 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f20c40668d0 0x7f20c4068d90 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f20e4151480 tx=0x7f20cc009040 comp rx=0 tx=0).stop 2023-11-28T18:38:15.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.902+0000 7f20e952a640 1 -- 172.21.15.45:0/4016941828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20e40ae870 msgr2=0x7f20e414d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:15.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.902+0000 7f20e952a640 1 --2- 172.21.15.45:0/4016941828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20e40ae870 0x7f20e414d5e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f20d400e930 tx=0x7f20d400edf0 comp rx=0 tx=0).stop 2023-11-28T18:38:15.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.902+0000 7f20e952a640 1 -- 172.21.15.45:0/4016941828 shutdown_connections 2023-11-28T18:38:15.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.902+0000 7f20e952a640 1 --2- 172.21.15.45:0/4016941828 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f20c40668d0 0x7f20c4068d90 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:15.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.902+0000 7f20e952a640 1 --2- 172.21.15.45:0/4016941828 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f20e415d920 0x7f20e40b02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:15.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.902+0000 7f20e952a640 1 --2- 172.21.15.45:0/4016941828 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f20e4157210 0x7f20e40afd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:15.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.902+0000 7f20e952a640 1 --2- 172.21.15.45:0/4016941828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20e40ae870 0x7f20e414d5e0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:15.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.902+0000 7f20e952a640 1 -- 172.21.15.45:0/4016941828 >> 172.21.15.45:0/4016941828 conn(0x7f20e40b0d00 msgr2=0x7f20e40cdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:15.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.902+0000 7f20e952a640 1 -- 172.21.15.45:0/4016941828 shutdown_connections 2023-11-28T18:38:15.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:15.902+0000 7f20e952a640 1 -- 172.21.15.45:0/4016941828 wait complete. 2023-11-28T18:38:15.926 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T18:38:16.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.070+0000 7f193112a640 1 Processor -- start 2023-11-28T18:38:16.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.070+0000 7f193112a640 1 -- start start 2023-11-28T18:38:16.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.070+0000 7f193112a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f192c15d410 0x7f192c0d3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:16.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.070+0000 7f193112a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f192c0d1680 0x7f192c0ce890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:16.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.070+0000 7f193112a640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f192c0d3ad0 con 0x7f192c0d3670 2023-11-28T18:38:16.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.070+0000 7f193112a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f192c0d1b10 con 0x7f192c0d1680 2023-11-28T18:38:16.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.070+0000 7f193112a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f192c0ce400 con 0x7f192c15d410 2023-11-28T18:38:16.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.070+0000 7f1923fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f192c0d3670 0x7f192c0d0f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45882/0 (socket says 172.21.15.45:45882) 2023-11-28T18:38:16.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.070+0000 7f1923fff640 1 -- 172.21.15.45:0/2995264711 learned_addr learned my addr 172.21.15.45:0/2995264711 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:38:16.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.070+0000 7f192b59e640 1 --2- 172.21.15.45:0/2995264711 >> v2:172.21.15.45:3300/0 conn(0x7f192c0d1680 0x7f192c0ce890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:16.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.070+0000 7f192ad9d640 1 --2- 172.21.15.45:0/2995264711 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f192c15d410 0x7f192c0d3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:16.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.070+0000 7f192a59c640 1 -- 172.21.15.45:0/2995264711 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2097230214 0 0) 0x7f192c0d3ad0 con 0x7f192c0d3670 2023-11-28T18:38:16.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.070+0000 7f192a59c640 1 -- 172.21.15.45:0/2995264711 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1918003530 con 0x7f192c0d3670 2023-11-28T18:38:16.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.070+0000 7f192b59e640 1 -- 172.21.15.45:0/2995264711 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f192c15d410 msgr2=0x7f192c0d3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:16.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.070+0000 7f192b59e640 1 --2- 172.21.15.45:0/2995264711 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f192c15d410 0x7f192c0d3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:16.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.070+0000 7f192b59e640 1 -- 172.21.15.45:0/2995264711 >> v1:172.21.15.45:6789/0 conn(0x7f192c0d3670 legacy=0x7f192c0d0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:16.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.070+0000 7f192b59e640 1 -- 172.21.15.45:0/2995264711 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f192c0d1d10 con 0x7f192c0d1680 2023-11-28T18:38:16.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.074+0000 7f192b59e640 1 --2- 172.21.15.45:0/2995264711 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f192c0d1680 0x7f192c0ce890 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1924009d90 tx=0x7f192401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49d86b471775a9de server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:16.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.074+0000 7f192a59c640 1 -- 172.21.15.45:0/2995264711 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19240a5a10 con 0x7f192c0d1680 2023-11-28T18:38:16.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.074+0000 7f192a59c640 1 -- 172.21.15.45:0/2995264711 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19240a5b70 con 0x7f192c0d1680 2023-11-28T18:38:16.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.074+0000 7f192a59c640 1 -- 172.21.15.45:0/2995264711 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19240ad440 con 0x7f192c0d1680 2023-11-28T18:38:16.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.074+0000 7f193112a640 1 -- 172.21.15.45:0/2995264711 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f192c0d1680 msgr2=0x7f192c0ce890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:16.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.074+0000 7f193112a640 1 --2- 172.21.15.45:0/2995264711 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f192c0d1680 0x7f192c0ce890 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1924009d90 tx=0x7f192401c950 comp rx=0 tx=0).stop 2023-11-28T18:38:16.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.074+0000 7f193112a640 1 -- 172.21.15.45:0/2995264711 shutdown_connections 2023-11-28T18:38:16.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.074+0000 7f193112a640 1 --2- 172.21.15.45:0/2995264711 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f192c0d1680 0x7f192c0ce890 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:16.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.074+0000 7f193112a640 1 --2- 172.21.15.45:0/2995264711 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f192c15d410 0x7f192c0d3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:16.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.074+0000 7f193112a640 1 -- 172.21.15.45:0/2995264711 >> 172.21.15.45:0/2995264711 conn(0x7f192c08cbc0 msgr2=0x7f192c09c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:16.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.074+0000 7f193112a640 1 -- 172.21.15.45:0/2995264711 shutdown_connections 2023-11-28T18:38:16.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.074+0000 7f193112a640 1 -- 172.21.15.45:0/2995264711 wait complete. 2023-11-28T18:38:16.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.078+0000 7f193112a640 1 Processor -- start 2023-11-28T18:38:16.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.078+0000 7f193112a640 1 -- start start 2023-11-28T18:38:16.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.078+0000 7f193112a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f192c0d1680 0x7f192c14e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:16.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.078+0000 7f193112a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f192c0d3670 0x7f192c14fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:16.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.078+0000 7f193112a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f192c15d410 0x7f192c160570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:16.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.078+0000 7f193112a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f192c14f730 con 0x7f192c15d410 2023-11-28T18:38:16.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.078+0000 7f193112a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f192c15ef30 con 0x7f192c0d3670 2023-11-28T18:38:16.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.078+0000 7f193112a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f192c14ee00 con 0x7f192c0d1680 2023-11-28T18:38:16.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.078+0000 7f192b59e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f192c15d410 0x7f192c160570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:16.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.078+0000 7f192b59e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f192c15d410 0x7f192c160570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54238/0 (socket says 172.21.15.45:54238) 2023-11-28T18:38:16.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.078+0000 7f192b59e640 1 -- 172.21.15.45:0/3132136828 learned_addr learned my addr 172.21.15.45:0/3132136828 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:16.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.078+0000 7f192ad9d640 1 --2- 172.21.15.45:0/3132136828 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f192c0d1680 0x7f192c14e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:16.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.078+0000 7f1923fff640 1 --2- 172.21.15.45:0/3132136828 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f192c0d3670 0x7f192c14fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:16.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.078+0000 7f192b59e640 1 -- 172.21.15.45:0/3132136828 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f192c0d1680 msgr2=0x7f192c14e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:16.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.078+0000 7f192b59e640 1 --2- 172.21.15.45:0/3132136828 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f192c0d1680 0x7f192c14e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:16.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.078+0000 7f192b59e640 1 -- 172.21.15.45:0/3132136828 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f192c0d3670 msgr2=0x7f192c14fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:16.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.078+0000 7f192b59e640 1 --2- 172.21.15.45:0/3132136828 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f192c0d3670 0x7f192c14fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:16.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.078+0000 7f192b59e640 1 -- 172.21.15.45:0/3132136828 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1924009a70 con 0x7f192c15d410 2023-11-28T18:38:16.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.078+0000 7f192b59e640 1 --2- 172.21.15.45:0/3132136828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f192c15d410 0x7f192c160570 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f19240b0040 tx=0x7f19240196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:16.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.078+0000 7f19237fe640 1 -- 172.21.15.45:0/3132136828 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19240adce0 con 0x7f192c15d410 2023-11-28T18:38:16.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.078+0000 7f19237fe640 1 -- 172.21.15.45:0/3132136828 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19240ade40 con 0x7f192c15d410 2023-11-28T18:38:16.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.078+0000 7f19237fe640 1 -- 172.21.15.45:0/3132136828 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19240b9690 con 0x7f192c15d410 2023-11-28T18:38:16.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.078+0000 7f193112a640 1 -- 172.21.15.45:0/3132136828 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f192c14f0e0 con 0x7f192c15d410 2023-11-28T18:38:16.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.078+0000 7f193112a640 1 -- 172.21.15.45:0/3132136828 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f192c15e7c0 con 0x7f192c15d410 2023-11-28T18:38:16.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.082+0000 7f193112a640 1 -- 172.21.15.45:0/3132136828 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f192c067a30 con 0x7f192c15d410 2023-11-28T18:38:16.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.082+0000 7f19237fe640 1 -- 172.21.15.45:0/3132136828 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f19240b97f0 con 0x7f192c15d410 2023-11-28T18:38:16.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.082+0000 7f19237fe640 1 --2- 172.21.15.45:0/3132136828 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f190c0668d0 0x7f190c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:16.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.082+0000 7f19237fe640 1 -- 172.21.15.45:0/3132136828 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5804+0+0 (secure 0 0 0) 0x7f192411fa80 con 0x7f192c15d410 2023-11-28T18:38:16.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.082+0000 7f192ad9d640 1 --2- 172.21.15.45:0/3132136828 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f190c0668d0 0x7f190c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:16.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.082+0000 7f192ad9d640 1 --2- 172.21.15.45:0/3132136828 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f190c0668d0 0x7f190c068d90 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f191c009ac0 tx=0x7f191c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:16.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.086+0000 7f19237fe640 1 -- 172.21.15.45:0/3132136828 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f19240ecc50 con 0x7f192c15d410 2023-11-28T18:38:16.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.246+0000 7f193112a640 1 -- 172.21.15.45:0/3132136828 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f192c069410 con 0x7f192c15d410 2023-11-28T18:38:16.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.246+0000 7f19237fe640 1 -- 172.21.15.45:0/3132136828 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1924009450 con 0x7f192c15d410 2023-11-28T18:38:16.249 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-11-28T18:38:16.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.250+0000 7f193112a640 1 -- 172.21.15.45:0/3132136828 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f190c0668d0 msgr2=0x7f190c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:16.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.250+0000 7f193112a640 1 --2- 172.21.15.45:0/3132136828 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f190c0668d0 0x7f190c068d90 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f191c009ac0 tx=0x7f191c009190 comp rx=0 tx=0).stop 2023-11-28T18:38:16.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.250+0000 7f193112a640 1 -- 172.21.15.45:0/3132136828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f192c15d410 msgr2=0x7f192c160570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:16.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.250+0000 7f193112a640 1 --2- 172.21.15.45:0/3132136828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f192c15d410 0x7f192c160570 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f19240b0040 tx=0x7f19240196f0 comp rx=0 tx=0).stop 2023-11-28T18:38:16.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.250+0000 7f193112a640 1 -- 172.21.15.45:0/3132136828 shutdown_connections 2023-11-28T18:38:16.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.250+0000 7f193112a640 1 --2- 172.21.15.45:0/3132136828 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f190c0668d0 0x7f190c068d90 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:16.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.250+0000 7f193112a640 1 --2- 172.21.15.45:0/3132136828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f192c15d410 0x7f192c160570 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:16.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.250+0000 7f193112a640 1 --2- 172.21.15.45:0/3132136828 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f192c0d3670 0x7f192c14fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:16.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.250+0000 7f193112a640 1 --2- 172.21.15.45:0/3132136828 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f192c0d1680 0x7f192c14e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:16.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.250+0000 7f193112a640 1 -- 172.21.15.45:0/3132136828 >> 172.21.15.45:0/3132136828 conn(0x7f192c08cbc0 msgr2=0x7f192c15a060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:16.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.250+0000 7f193112a640 1 -- 172.21.15.45:0/3132136828 shutdown_connections 2023-11-28T18:38:16.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.250+0000 7f193112a640 1 -- 172.21.15.45:0/3132136828 wait complete. 2023-11-28T18:38:16.271 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T18:38:16.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.414+0000 7f53dcd96640 1 Processor -- start 2023-11-28T18:38:16.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.414+0000 7f53dcd96640 1 -- start start 2023-11-28T18:38:16.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.414+0000 7f53dcd96640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f53d80b46d0 0x7f53d80c6b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:16.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.414+0000 7f53dcd96640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f53d80b4180 0x7f53d80c70a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:16.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.414+0000 7f53dcd96640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53d80b3f10 con 0x7f53d80cf9a0 2023-11-28T18:38:16.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.414+0000 7f53dcd96640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53d80b3c30 con 0x7f53d80b4180 2023-11-28T18:38:16.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.414+0000 7f53dcd96640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53d80d3bd0 con 0x7f53d80b46d0 2023-11-28T18:38:16.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.414+0000 7f53d77fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f53d80cf9a0 0x7f53d81605c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45894/0 (socket says 172.21.15.45:45894) 2023-11-28T18:38:16.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.414+0000 7f53d77fe640 1 -- 172.21.15.45:0/1079996295 learned_addr learned my addr 172.21.15.45:0/1079996295 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:38:16.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.414+0000 7f53d7fff640 1 --2- 172.21.15.45:0/1079996295 >> v2:172.21.15.45:3300/0 conn(0x7f53d80b4180 0x7f53d80c70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:16.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.414+0000 7f53d6ffd640 1 --2- 172.21.15.45:0/1079996295 >> v2:172.21.15.190:3300/0 conn(0x7f53d80b46d0 0x7f53d80c6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:16.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.414+0000 7f53d67fc640 1 -- 172.21.15.45:0/1079996295 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2428967953 0 0) 0x7f53d80b3f10 con 0x7f53d80cf9a0 2023-11-28T18:38:16.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.414+0000 7f53d67fc640 1 -- 172.21.15.45:0/1079996295 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53c0003530 con 0x7f53d80cf9a0 2023-11-28T18:38:16.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.414+0000 7f53d7fff640 1 -- 172.21.15.45:0/1079996295 >> v2:172.21.15.190:3300/0 conn(0x7f53d80b46d0 msgr2=0x7f53d80c6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:16.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.414+0000 7f53d7fff640 1 --2- 172.21.15.45:0/1079996295 >> v2:172.21.15.190:3300/0 conn(0x7f53d80b46d0 0x7f53d80c6b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:16.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.414+0000 7f53d7fff640 1 -- 172.21.15.45:0/1079996295 >> v1:172.21.15.45:6789/0 conn(0x7f53d80cf9a0 legacy=0x7f53d81605c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:16.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.414+0000 7f53d7fff640 1 -- 172.21.15.45:0/1079996295 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d80ce7d0 con 0x7f53d80b4180 2023-11-28T18:38:16.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.414+0000 7f53d6ffd640 1 --2- 172.21.15.45:0/1079996295 >> v2:172.21.15.190:3300/0 conn(0x7f53d80b46d0 0x7f53d80c6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:38:16.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.418+0000 7f53d7fff640 1 --2- 172.21.15.45:0/1079996295 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53d80b4180 0x7f53d80c70a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f53d808c170 tx=0x7f53d001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5374f0ca7706963d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:16.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.418+0000 7f53d67fc640 1 -- 172.21.15.45:0/1079996295 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d00a5970 con 0x7f53d80b4180 2023-11-28T18:38:16.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.418+0000 7f53d67fc640 1 -- 172.21.15.45:0/1079996295 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53d00a5ad0 con 0x7f53d80b4180 2023-11-28T18:38:16.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.418+0000 7f53d67fc640 1 -- 172.21.15.45:0/1079996295 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d00a5e60 con 0x7f53d80b4180 2023-11-28T18:38:16.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.418+0000 7f53dcd96640 1 -- 172.21.15.45:0/1079996295 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53d80b4180 msgr2=0x7f53d80c70a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:16.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.418+0000 7f53dcd96640 1 --2- 172.21.15.45:0/1079996295 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53d80b4180 0x7f53d80c70a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f53d808c170 tx=0x7f53d001c910 comp rx=0 tx=0).stop 2023-11-28T18:38:16.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.418+0000 7f53dcd96640 1 -- 172.21.15.45:0/1079996295 shutdown_connections 2023-11-28T18:38:16.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.418+0000 7f53dcd96640 1 --2- 172.21.15.45:0/1079996295 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53d80b4180 0x7f53d80c70a0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:16.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.418+0000 7f53dcd96640 1 --2- 172.21.15.45:0/1079996295 >> v2:172.21.15.190:3300/0 conn(0x7f53d80b46d0 0x7f53d80c6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:16.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.418+0000 7f53dcd96640 1 -- 172.21.15.45:0/1079996295 >> 172.21.15.45:0/1079996295 conn(0x7f53d80d3010 msgr2=0x7f53d80d3420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:16.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.418+0000 7f53dcd96640 1 -- 172.21.15.45:0/1079996295 shutdown_connections 2023-11-28T18:38:16.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.418+0000 7f53dcd96640 1 -- 172.21.15.45:0/1079996295 wait complete. 2023-11-28T18:38:16.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.422+0000 7f53dcd96640 1 Processor -- start 2023-11-28T18:38:16.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.422+0000 7f53dcd96640 1 -- start start 2023-11-28T18:38:16.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.422+0000 7f53dcd96640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53d80b4180 0x7f53d8157090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:16.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.422+0000 7f53dcd96640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f53d80b46d0 0x7f53d80b7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:16.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.422+0000 7f53dcd96640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f53d80cf9a0 0x7f53d80b1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:16.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.422+0000 7f53dcd96640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d81fa590 con 0x7f53d80b4180 2023-11-28T18:38:16.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.422+0000 7f53dcd96640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d80b7f80 con 0x7f53d80cf9a0 2023-11-28T18:38:16.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.422+0000 7f53dcd96640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53d80b1b60 con 0x7f53d80b46d0 2023-11-28T18:38:16.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.422+0000 7f53d77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53d80b4180 0x7f53d8157090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:16.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.422+0000 7f53d77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53d80b4180 0x7f53d8157090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54252/0 (socket says 172.21.15.45:54252) 2023-11-28T18:38:16.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.422+0000 7f53d77fe640 1 -- 172.21.15.45:0/1926000631 learned_addr learned my addr 172.21.15.45:0/1926000631 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:16.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.422+0000 7f53d77fe640 1 -- 172.21.15.45:0/1926000631 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f53d80b46d0 msgr2=0x7f53d80b7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:16.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.422+0000 7f53d77fe640 1 --2- 172.21.15.45:0/1926000631 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f53d80b46d0 0x7f53d80b7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:16.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.422+0000 7f53d77fe640 1 -- 172.21.15.45:0/1926000631 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f53d80cf9a0 msgr2=0x7f53d80b1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:16.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.422+0000 7f53d77fe640 1 --2- 172.21.15.45:0/1926000631 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f53d80cf9a0 0x7f53d80b1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:16.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.422+0000 7f53d77fe640 1 -- 172.21.15.45:0/1926000631 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d0009a70 con 0x7f53d80b4180 2023-11-28T18:38:16.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.422+0000 7f53d77fe640 1 --2- 172.21.15.45:0/1926000631 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53d80b4180 0x7f53d8157090 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f53c800c450 tx=0x7f53c800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:16.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.422+0000 7f53bffff640 1 -- 172.21.15.45:0/1926000631 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c8005cf0 con 0x7f53d80b4180 2023-11-28T18:38:16.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.422+0000 7f53bffff640 1 -- 172.21.15.45:0/1926000631 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c8005e50 con 0x7f53d80b4180 2023-11-28T18:38:16.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.422+0000 7f53bffff640 1 -- 172.21.15.45:0/1926000631 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c8007270 con 0x7f53d80b4180 2023-11-28T18:38:16.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.422+0000 7f53dcd96640 1 -- 172.21.15.45:0/1926000631 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53d80b6c80 con 0x7f53d80b4180 2023-11-28T18:38:16.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.422+0000 7f53dcd96640 1 -- 172.21.15.45:0/1926000631 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53d80b7240 con 0x7f53d80b4180 2023-11-28T18:38:16.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.426+0000 7f53dcd96640 1 -- 172.21.15.45:0/1926000631 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53d80a0fc0 con 0x7f53d80b4180 2023-11-28T18:38:16.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.426+0000 7f53bffff640 1 -- 172.21.15.45:0/1926000631 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f53c80073d0 con 0x7f53d80b4180 2023-11-28T18:38:16.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.426+0000 7f53bffff640 1 --2- 172.21.15.45:0/1926000631 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f53c40668d0 0x7f53c4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:16.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.426+0000 7f53bffff640 1 -- 172.21.15.45:0/1926000631 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5804+0+0 (secure 0 0 0) 0x7f53c80839c0 con 0x7f53d80b4180 2023-11-28T18:38:16.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.426+0000 7f53d6ffd640 1 --2- 172.21.15.45:0/1926000631 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f53c40668d0 0x7f53c4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:16.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.426+0000 7f53d6ffd640 1 --2- 172.21.15.45:0/1926000631 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f53c40668d0 0x7f53c4068d90 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f53cc006f10 tx=0x7f53cc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:16.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.430+0000 7f53bffff640 1 -- 172.21.15.45:0/1926000631 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f53c8050bb0 con 0x7f53d80b4180 2023-11-28T18:38:16.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.598+0000 7f53dcd96640 1 -- 172.21.15.45:0/1926000631 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f53d804e970 con 0x7f53d80b4180 2023-11-28T18:38:16.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.598+0000 7f53bffff640 1 -- 172.21.15.45:0/1926000631 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f53c8017020 con 0x7f53d80b4180 2023-11-28T18:38:16.602 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-11-28T18:38:16.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.602+0000 7f53dcd96640 1 -- 172.21.15.45:0/1926000631 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f53c40668d0 msgr2=0x7f53c4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:16.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.602+0000 7f53dcd96640 1 --2- 172.21.15.45:0/1926000631 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f53c40668d0 0x7f53c4068d90 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f53cc006f10 tx=0x7f53cc008040 comp rx=0 tx=0).stop 2023-11-28T18:38:16.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.602+0000 7f53dcd96640 1 -- 172.21.15.45:0/1926000631 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53d80b4180 msgr2=0x7f53d8157090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:16.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.602+0000 7f53dcd96640 1 --2- 172.21.15.45:0/1926000631 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53d80b4180 0x7f53d8157090 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f53c800c450 tx=0x7f53c800c910 comp rx=0 tx=0).stop 2023-11-28T18:38:16.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.602+0000 7f53dcd96640 1 -- 172.21.15.45:0/1926000631 shutdown_connections 2023-11-28T18:38:16.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.602+0000 7f53dcd96640 1 --2- 172.21.15.45:0/1926000631 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f53c40668d0 0x7f53c4068d90 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:16.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.602+0000 7f53dcd96640 1 --2- 172.21.15.45:0/1926000631 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f53d80cf9a0 0x7f53d80b1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:16.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.602+0000 7f53dcd96640 1 --2- 172.21.15.45:0/1926000631 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f53d80b46d0 0x7f53d80b7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:16.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.602+0000 7f53dcd96640 1 --2- 172.21.15.45:0/1926000631 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53d80b4180 0x7f53d8157090 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:16.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.602+0000 7f53dcd96640 1 -- 172.21.15.45:0/1926000631 >> 172.21.15.45:0/1926000631 conn(0x7f53d80d3010 msgr2=0x7f53d81605a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:16.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.602+0000 7f53dcd96640 1 -- 172.21.15.45:0/1926000631 shutdown_connections 2023-11-28T18:38:16.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.602+0000 7f53dcd96640 1 -- 172.21.15.45:0/1926000631 wait complete. 2023-11-28T18:38:16.623 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi045.front.sepia.ceph.com... 2023-11-28T18:38:16.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:38:16.624 DEBUG:teuthology.orchestra.run.smithi045:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2023-11-28T18:38:16.646 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T18:38:16.646 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi045.front.sepia.ceph.com 2023-11-28T18:38:16.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:38:16.646 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-28T18:38:16.704 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-28T18:38:16.704 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T18:38:16.716 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-28T18:38:16.717 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T18:38:16.767 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T18:38:16.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.906+0000 7fb7f833e640 1 Processor -- start 2023-11-28T18:38:16.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.906+0000 7fb7f833e640 1 -- start start 2023-11-28T18:38:16.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.910+0000 7fb7f833e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fb7f0144880 0x7fb7f006c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:16.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.910+0000 7fb7f833e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb7f00721c0 0x7fb7f006c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:16.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.910+0000 7fb7f833e640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7f0071120 con 0x7fb7f00704a0 2023-11-28T18:38:16.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.910+0000 7fb7f833e640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7f015f050 con 0x7fb7f0144880 2023-11-28T18:38:16.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.910+0000 7fb7f833e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f0071400 con 0x7fb7f00721c0 2023-11-28T18:38:16.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.910+0000 7fb7f58d9640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb7f00721c0 0x7fb7f006c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:16.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.910+0000 7fb7f60da640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fb7f0144880 0x7fb7f006c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:16.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.910+0000 7fb7f58d9640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb7f00721c0 0x7fb7f006c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.45:60374/0 (socket says 172.21.15.45:60374) 2023-11-28T18:38:16.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.910+0000 7fb7f58d9640 1 -- 172.21.15.45:0/623247871 learned_addr learned my addr 172.21.15.45:0/623247871 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:16.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.910+0000 7fb7f60da640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fb7f0144880 0x7fb7f006c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.45:41476/0 (socket says 172.21.15.45:41476) 2023-11-28T18:38:16.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.910+0000 7fb7f58d9640 1 -- 172.21.15.45:0/623247871 >> v2:172.21.15.190:3300/0 conn(0x7fb7f0144880 msgr2=0x7fb7f006c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:16.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.910+0000 7fb7f58d9640 1 --2- 172.21.15.45:0/623247871 >> v2:172.21.15.190:3300/0 conn(0x7fb7f0144880 0x7fb7f006c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:16.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.910+0000 7fb7f58d9640 1 -- 172.21.15.45:0/623247871 >> v1:172.21.15.190:6789/0 conn(0x7fb7f00704a0 legacy=0x7fb7f0070920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:16.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.910+0000 7fb7f58d9640 1 -- 172.21.15.45:0/623247871 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f00716e0 con 0x7fb7f00721c0 2023-11-28T18:38:16.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.910+0000 7fb7f60da640 1 --2- 172.21.15.45:0/623247871 >> v2:172.21.15.190:3300/0 conn(0x7fb7f0144880 0x7fb7f006c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:38:16.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.914+0000 7fb7f58d9640 1 --2- 172.21.15.45:0/623247871 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb7f00721c0 0x7fb7f006c840 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb7e0009870 tx=0x7fb7e001c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a41ad7f6ac484646 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:16.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.914+0000 7fb7f50d8640 1 -- 172.21.15.45:0/623247871 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e00aa670 con 0x7fb7f00721c0 2023-11-28T18:38:16.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.914+0000 7fb7f50d8640 1 -- 172.21.15.45:0/623247871 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7e00aa7d0 con 0x7fb7f00721c0 2023-11-28T18:38:16.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.914+0000 7fb7f50d8640 1 -- 172.21.15.45:0/623247871 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e00aab60 con 0x7fb7f00721c0 2023-11-28T18:38:16.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.914+0000 7fb7f833e640 1 -- 172.21.15.45:0/623247871 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb7f00721c0 msgr2=0x7fb7f006c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:16.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.914+0000 7fb7f833e640 1 --2- 172.21.15.45:0/623247871 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb7f00721c0 0x7fb7f006c840 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb7e0009870 tx=0x7fb7e001c510 comp rx=0 tx=0).stop 2023-11-28T18:38:16.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.914+0000 7fb7f833e640 1 -- 172.21.15.45:0/623247871 shutdown_connections 2023-11-28T18:38:16.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.914+0000 7fb7f833e640 1 --2- 172.21.15.45:0/623247871 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb7f00721c0 0x7fb7f006c840 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:16.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.914+0000 7fb7f833e640 1 --2- 172.21.15.45:0/623247871 >> v2:172.21.15.190:3300/0 conn(0x7fb7f0144880 0x7fb7f006c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:16.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.914+0000 7fb7f833e640 1 -- 172.21.15.45:0/623247871 >> 172.21.15.45:0/623247871 conn(0x7fb7f006a570 msgr2=0x7fb7f006a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:16.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.914+0000 7fb7f833e640 1 -- 172.21.15.45:0/623247871 shutdown_connections 2023-11-28T18:38:16.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.914+0000 7fb7f833e640 1 -- 172.21.15.45:0/623247871 wait complete. 2023-11-28T18:38:16.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.914+0000 7fb7f833e640 1 Processor -- start 2023-11-28T18:38:16.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.914+0000 7fb7f833e640 1 -- start start 2023-11-28T18:38:16.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.918+0000 7fb7f833e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb7f00704a0 0x7fb7f00cc400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:16.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.918+0000 7fb7f833e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb7f00721c0 0x7fb7f015a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:16.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.918+0000 7fb7f833e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7f0144880 0x7fb7f015a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:16.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.918+0000 7fb7f833e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f00b31c0 con 0x7fb7f0144880 2023-11-28T18:38:16.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.918+0000 7fb7f833e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f01382e0 con 0x7fb7f00721c0 2023-11-28T18:38:16.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.918+0000 7fb7f833e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f0141550 con 0x7fb7f00704a0 2023-11-28T18:38:16.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.918+0000 7fb7f68db640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7f0144880 0x7fb7f015a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:16.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.918+0000 7fb7f68db640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7f0144880 0x7fb7f015a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54260/0 (socket says 172.21.15.45:54260) 2023-11-28T18:38:16.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.918+0000 7fb7f68db640 1 -- 172.21.15.45:0/4001004418 learned_addr learned my addr 172.21.15.45:0/4001004418 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:16.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.918+0000 7fb7f60da640 1 --2- 172.21.15.45:0/4001004418 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb7f00704a0 0x7fb7f00cc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:16.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.918+0000 7fb7f58d9640 1 --2- 172.21.15.45:0/4001004418 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb7f00721c0 0x7fb7f015a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:16.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.918+0000 7fb7f68db640 1 -- 172.21.15.45:0/4001004418 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb7f00704a0 msgr2=0x7fb7f00cc400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:16.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.918+0000 7fb7f68db640 1 --2- 172.21.15.45:0/4001004418 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb7f00704a0 0x7fb7f00cc400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:16.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.918+0000 7fb7f68db640 1 -- 172.21.15.45:0/4001004418 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb7f00721c0 msgr2=0x7fb7f015a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:16.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.918+0000 7fb7f68db640 1 --2- 172.21.15.45:0/4001004418 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb7f00721c0 0x7fb7f015a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:16.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.918+0000 7fb7f68db640 1 -- 172.21.15.45:0/4001004418 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7ec009420 con 0x7fb7f0144880 2023-11-28T18:38:16.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.918+0000 7fb7f68db640 1 --2- 172.21.15.45:0/4001004418 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7f0144880 0x7fb7f015a990 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb7e800c7d0 tx=0x7fb7e800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:16.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.918+0000 7fb7e6ffd640 1 -- 172.21.15.45:0/4001004418 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e8003b80 con 0x7fb7f0144880 2023-11-28T18:38:16.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.918+0000 7fb7e6ffd640 1 -- 172.21.15.45:0/4001004418 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7e8003ce0 con 0x7fb7f0144880 2023-11-28T18:38:16.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.918+0000 7fb7f833e640 1 -- 172.21.15.45:0/4001004418 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7e00094d0 con 0x7fb7f0144880 2023-11-28T18:38:16.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.918+0000 7fb7e6ffd640 1 -- 172.21.15.45:0/4001004418 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e800aa30 con 0x7fb7f0144880 2023-11-28T18:38:16.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.918+0000 7fb7f833e640 1 -- 172.21.15.45:0/4001004418 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7f00b36f0 con 0x7fb7f0144880 2023-11-28T18:38:16.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.918+0000 7fb7f833e640 1 -- 172.21.15.45:0/4001004418 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7f0069480 con 0x7fb7f0144880 2023-11-28T18:38:16.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.918+0000 7fb7e6ffd640 1 -- 172.21.15.45:0/4001004418 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fb7e800ab90 con 0x7fb7f0144880 2023-11-28T18:38:16.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.922+0000 7fb7e6ffd640 1 --2- 172.21.15.45:0/4001004418 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fb7d4066900 0x7fb7d4068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:16.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.922+0000 7fb7e6ffd640 1 -- 172.21.15.45:0/4001004418 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5804+0+0 (secure 0 0 0) 0x7fb7e8084230 con 0x7fb7f0144880 2023-11-28T18:38:16.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.922+0000 7fb7f60da640 1 --2- 172.21.15.45:0/4001004418 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fb7d4066900 0x7fb7d4068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:16.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.922+0000 7fb7f60da640 1 --2- 172.21.15.45:0/4001004418 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fb7d4066900 0x7fb7d4068dc0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec009c50 tx=0x7fb7ec009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:16.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:16.926+0000 7fb7e6ffd640 1 -- 172.21.15.45:0/4001004418 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb7e8051420 con 0x7fb7f0144880 2023-11-28T18:38:17.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.082+0000 7fb7f833e640 1 -- 172.21.15.45:0/4001004418 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb7f015f1a0 con 0x7fb7f0144880 2023-11-28T18:38:17.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.082+0000 7fb7e6ffd640 1 -- 172.21.15.45:0/4001004418 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16689 (secure 0 0 0) 0x7fb7e8054a40 con 0x7fb7f0144880 2023-11-28T18:38:17.085 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:38:17.085 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":22,"fsid":"d10f5cd6-1d00-4019-99b6-6fa435498a15","created":"2023-11-28T18:37:08.189030+0000","modified":"2023-11-28T18:38:15.148068+0000","last_up_change":"2023-11-28T18:37:20.196124+0000","last_in_change":"2023-11-28T18:37:10.742043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T18:37:21.293917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T18:37:31.384760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T18:37:31.834769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"84465384-103c-4f2c-a45a-96f5bb9c835f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6809","nonce":555237322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6811","nonce":555237322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6815","nonce":555237322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6813","nonce":555237322}]},"public_addr":"172.21.15.45:6809/555237322","cluster_addr":"172.21.15.45:6811/555237322","heartbeat_back_addr":"172.21.15.45:6815/555237322","heartbeat_front_addr":"172.21.15.45:6813/555237322","state":["exists","up"]},{"osd":1,"uuid":"7d9eed24-a58f-42c7-a787-ac06be8553fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6801","nonce":2857063763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6803","nonce":2857063763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6807","nonce":2857063763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6805","nonce":2857063763}]},"public_addr":"172.21.15.45:6801/2857063763","cluster_addr":"172.21.15.45:6803/2857063763","heartbeat_back_addr":"172.21.15.45:6807/2857063763","heartbeat_front_addr":"172.21.15.45:6805/2857063763","state":["exists","up"]},{"osd":2,"uuid":"575eeccc-4abf-45b4-9caf-f3e797859588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6817","nonce":193884539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6819","nonce":193884539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6823","nonce":193884539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6821","nonce":193884539}]},"public_addr":"172.21.15.45:6817/193884539","cluster_addr":"172.21.15.45:6819/193884539","heartbeat_back_addr":"172.21.15.45:6823/193884539","heartbeat_front_addr":"172.21.15.45:6821/193884539","state":["exists","up"]},{"osd":3,"uuid":"9b0290d6-9a52-4bc8-b2a1-7622c5dc8e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6825","nonce":78541084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6827","nonce":78541084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6831","nonce":78541084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6829","nonce":78541084}]},"public_addr":"172.21.15.45:6825/78541084","cluster_addr":"172.21.15.45:6827/78541084","heartbeat_back_addr":"172.21.15.45:6831/78541084","heartbeat_front_addr":"172.21.15.45:6829/78541084","state":["exists","up"]},{"osd":4,"uuid":"ce632829-f027-4fbf-a627-02c571aa9d53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6809","nonce":1537591987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6811","nonce":1537591987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6815","nonce":1537591987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6813","nonce":1537591987}]},"public_addr":"172.21.15.190:6809/1537591987","cluster_addr":"172.21.15.190:6811/1537591987","heartbeat_back_addr":"172.21.15.190:6815/1537591987","heartbeat_front_addr":"172.21.15.190:6813/1537591987","state":["exists","up"]},{"osd":5,"uuid":"8700b609-27be-40bd-a251-4c0ae0a29ead","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6801","nonce":3296698407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6803","nonce":3296698407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6807","nonce":3296698407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6805","nonce":3296698407}]},"public_addr":"172.21.15.190:6801/3296698407","cluster_addr":"172.21.15.190:6803/3296698407","heartbeat_back_addr":"172.21.15.190:6807/3296698407","heartbeat_front_addr":"172.21.15.190:6805/3296698407","state":["exists","up"]},{"osd":6,"uuid":"44ce4a40-e6ff-4f4d-8e8a-7341e5c91f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6817","nonce":2317686718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6819","nonce":2317686718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6823","nonce":2317686718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6821","nonce":2317686718}]},"public_addr":"172.21.15.190:6817/2317686718","cluster_addr":"172.21.15.190:6819/2317686718","heartbeat_back_addr":"172.21.15.190:6823/2317686718","heartbeat_front_addr":"172.21.15.190:6821/2317686718","state":["exists","up"]},{"osd":7,"uuid":"192238c9-1423-4b7e-ac8f-84ba32113ddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6825","nonce":2493232051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6827","nonce":2493232051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6831","nonce":2493232051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6829","nonce":2493232051}]},"public_addr":"172.21.15.190:6825/2493232051","cluster_addr":"172.21.15.190:6827/2493232051","heartbeat_back_addr":"172.21.15.190:6831/2493232051","heartbeat_front_addr":"172.21.15.190:6829/2493232051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.393552+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.385453+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.361421+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.366408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.363226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.276007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.414605+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.445885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2},{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T18:38:17.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.086+0000 7fb7f833e640 1 -- 172.21.15.45:0/4001004418 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fb7d4066900 msgr2=0x7fb7d4068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:17.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.086+0000 7fb7f833e640 1 --2- 172.21.15.45:0/4001004418 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fb7d4066900 0x7fb7d4068dc0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec009c50 tx=0x7fb7ec009190 comp rx=0 tx=0).stop 2023-11-28T18:38:17.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.086+0000 7fb7f833e640 1 -- 172.21.15.45:0/4001004418 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7f0144880 msgr2=0x7fb7f015a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:17.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.086+0000 7fb7f833e640 1 --2- 172.21.15.45:0/4001004418 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7f0144880 0x7fb7f015a990 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb7e800c7d0 tx=0x7fb7e800cc90 comp rx=0 tx=0).stop 2023-11-28T18:38:17.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.086+0000 7fb7f833e640 1 -- 172.21.15.45:0/4001004418 shutdown_connections 2023-11-28T18:38:17.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.086+0000 7fb7f833e640 1 --2- 172.21.15.45:0/4001004418 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fb7d4066900 0x7fb7d4068dc0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:17.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.086+0000 7fb7f833e640 1 --2- 172.21.15.45:0/4001004418 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7f0144880 0x7fb7f015a990 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:17.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.086+0000 7fb7f833e640 1 --2- 172.21.15.45:0/4001004418 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb7f00721c0 0x7fb7f015a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:17.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.086+0000 7fb7f833e640 1 --2- 172.21.15.45:0/4001004418 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb7f00704a0 0x7fb7f00cc400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:17.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.086+0000 7fb7f833e640 1 -- 172.21.15.45:0/4001004418 >> 172.21.15.45:0/4001004418 conn(0x7fb7f006a570 msgr2=0x7fb7f006c300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:17.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.086+0000 7fb7f833e640 1 -- 172.21.15.45:0/4001004418 shutdown_connections 2023-11-28T18:38:17.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.086+0000 7fb7f833e640 1 -- 172.21.15.45:0/4001004418 wait complete. 2023-11-28T18:38:17.107 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T18:37:21.293917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T18:37:31.384760+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T18:37:31.834769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T18:38:17.107 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T18:38:17.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.250+0000 7fe528e17640 1 Processor -- start 2023-11-28T18:38:17.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.250+0000 7fe528e17640 1 -- start start 2023-11-28T18:38:17.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.254+0000 7fe528e17640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe524158ce0 0x7fe52415eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:17.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.254+0000 7fe528e17640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe5240cba50 0x7fe52415be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:17.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.254+0000 7fe528e17640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe52415b6b0 con 0x7fe5240b4310 2023-11-28T18:38:17.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.254+0000 7fe528e17640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe52415f450 con 0x7fe524158ce0 2023-11-28T18:38:17.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.254+0000 7fe528e17640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe52415f730 con 0x7fe5240cba50 2023-11-28T18:38:17.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.254+0000 7fe52259c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe524158ce0 0x7fe52415eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:17.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.254+0000 7fe51bfff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe5240cba50 0x7fe52415be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:17.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.254+0000 7fe51bfff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe5240cba50 0x7fe52415be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.45:60390/0 (socket says 172.21.15.45:60390) 2023-11-28T18:38:17.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.254+0000 7fe51bfff640 1 -- 172.21.15.45:0/3983315560 learned_addr learned my addr 172.21.15.45:0/3983315560 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:17.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.254+0000 7fe52259c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe524158ce0 0x7fe52415eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.45:41488/0 (socket says 172.21.15.45:41488) 2023-11-28T18:38:17.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.254+0000 7fe52259c640 1 -- 172.21.15.45:0/3983315560 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe5240cba50 msgr2=0x7fe52415be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:17.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.254+0000 7fe52259c640 1 --2- 172.21.15.45:0/3983315560 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe5240cba50 0x7fe52415be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:17.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.254+0000 7fe52259c640 1 -- 172.21.15.45:0/3983315560 >> v1:172.21.15.190:6789/0 conn(0x7fe5240b4310 legacy=0x7fe524070430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:17.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.254+0000 7fe52259c640 1 -- 172.21.15.45:0/3983315560 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe52415b920 con 0x7fe524158ce0 2023-11-28T18:38:17.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.254+0000 7fe51bfff640 1 --2- 172.21.15.45:0/3983315560 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe5240cba50 0x7fe52415be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:38:17.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.258+0000 7fe52259c640 1 --2- 172.21.15.45:0/3983315560 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe524158ce0 0x7fe52415eb90 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe5140097c0 tx=0x7fe51401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6bc50626f9510ba server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:17.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.258+0000 7fe521d9b640 1 -- 172.21.15.45:0/3983315560 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5140a6040 con 0x7fe524158ce0 2023-11-28T18:38:17.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.258+0000 7fe521d9b640 1 -- 172.21.15.45:0/3983315560 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5140aa600 con 0x7fe524158ce0 2023-11-28T18:38:17.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.258+0000 7fe521d9b640 1 -- 172.21.15.45:0/3983315560 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5140aa990 con 0x7fe524158ce0 2023-11-28T18:38:17.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.258+0000 7fe528e17640 1 -- 172.21.15.45:0/3983315560 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe524158ce0 msgr2=0x7fe52415eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:17.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.258+0000 7fe528e17640 1 --2- 172.21.15.45:0/3983315560 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe524158ce0 0x7fe52415eb90 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe5140097c0 tx=0x7fe51401c480 comp rx=0 tx=0).stop 2023-11-28T18:38:17.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.258+0000 7fe528e17640 1 -- 172.21.15.45:0/3983315560 shutdown_connections 2023-11-28T18:38:17.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.258+0000 7fe528e17640 1 --2- 172.21.15.45:0/3983315560 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe5240cba50 0x7fe52415be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:17.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.258+0000 7fe528e17640 1 --2- 172.21.15.45:0/3983315560 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe524158ce0 0x7fe52415eb90 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:17.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.258+0000 7fe528e17640 1 -- 172.21.15.45:0/3983315560 >> 172.21.15.45:0/3983315560 conn(0x7fe5240b0d00 msgr2=0x7fe5240b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:17.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.258+0000 7fe528e17640 1 -- 172.21.15.45:0/3983315560 shutdown_connections 2023-11-28T18:38:17.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.258+0000 7fe528e17640 1 -- 172.21.15.45:0/3983315560 wait complete. 2023-11-28T18:38:17.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.258+0000 7fe528e17640 1 Processor -- start 2023-11-28T18:38:17.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.258+0000 7fe528e17640 1 -- start start 2023-11-28T18:38:17.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.262+0000 7fe528e17640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe5240b4310 0x7fe52414d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:17.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.262+0000 7fe528e17640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5240cba50 0x7fe524152990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:17.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.262+0000 7fe528e17640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe524158ce0 0x7fe524157850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:17.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.262+0000 7fe528e17640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5241560b0 con 0x7fe5240cba50 2023-11-28T18:38:17.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.262+0000 7fe528e17640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe52415d8e0 con 0x7fe524158ce0 2023-11-28T18:38:17.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.262+0000 7fe528e17640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe524155dd0 con 0x7fe5240b4310 2023-11-28T18:38:17.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.262+0000 7fe51bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5240cba50 0x7fe524152990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:17.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.262+0000 7fe51bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5240cba50 0x7fe524152990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54262/0 (socket says 172.21.15.45:54262) 2023-11-28T18:38:17.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.262+0000 7fe51bfff640 1 -- 172.21.15.45:0/3244931202 learned_addr learned my addr 172.21.15.45:0/3244931202 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:17.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.262+0000 7fe52259c640 1 --2- 172.21.15.45:0/3244931202 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe5240b4310 0x7fe52414d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:17.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.262+0000 7fe522d9d640 1 --2- 172.21.15.45:0/3244931202 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe524158ce0 0x7fe524157850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:17.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.262+0000 7fe51bfff640 1 -- 172.21.15.45:0/3244931202 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe5240b4310 msgr2=0x7fe52414d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:17.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.262+0000 7fe51bfff640 1 --2- 172.21.15.45:0/3244931202 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe5240b4310 0x7fe52414d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:17.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.262+0000 7fe51bfff640 1 -- 172.21.15.45:0/3244931202 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe524158ce0 msgr2=0x7fe524157850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:17.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.262+0000 7fe51bfff640 1 --2- 172.21.15.45:0/3244931202 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe524158ce0 0x7fe524157850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:17.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.262+0000 7fe51bfff640 1 -- 172.21.15.45:0/3244931202 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe50c0094d0 con 0x7fe5240cba50 2023-11-28T18:38:17.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.262+0000 7fe51bfff640 1 --2- 172.21.15.45:0/3244931202 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5240cba50 0x7fe524152990 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe50c00e9a0 tx=0x7fe50c00ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:17.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.262+0000 7fe51affd640 1 -- 172.21.15.45:0/3244931202 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe50c00ca00 con 0x7fe5240cba50 2023-11-28T18:38:17.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.262+0000 7fe51affd640 1 -- 172.21.15.45:0/3244931202 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe50c00cb60 con 0x7fe5240cba50 2023-11-28T18:38:17.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.262+0000 7fe51affd640 1 -- 172.21.15.45:0/3244931202 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe50c013470 con 0x7fe5240cba50 2023-11-28T18:38:17.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.262+0000 7fe528e17640 1 -- 172.21.15.45:0/3244931202 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe514009420 con 0x7fe5240cba50 2023-11-28T18:38:17.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.262+0000 7fe528e17640 1 -- 172.21.15.45:0/3244931202 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe52415de80 con 0x7fe5240cba50 2023-11-28T18:38:17.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.262+0000 7fe528e17640 1 -- 172.21.15.45:0/3244931202 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe524073ce0 con 0x7fe5240cba50 2023-11-28T18:38:17.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.262+0000 7fe51affd640 1 -- 172.21.15.45:0/3244931202 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe50c0135d0 con 0x7fe5240cba50 2023-11-28T18:38:17.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.266+0000 7fe51affd640 1 --2- 172.21.15.45:0/3244931202 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe5040668d0 0x7fe504068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:17.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.266+0000 7fe51affd640 1 -- 172.21.15.45:0/3244931202 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5804+0+0 (secure 0 0 0) 0x7fe50c0847a0 con 0x7fe5240cba50 2023-11-28T18:38:17.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.266+0000 7fe52259c640 1 --2- 172.21.15.45:0/3244931202 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe5040668d0 0x7fe504068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:17.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.266+0000 7fe52259c640 1 --2- 172.21.15.45:0/3244931202 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe5040668d0 0x7fe504068d90 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe5140ae000 tx=0x7fe5140b5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:17.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.270+0000 7fe51affd640 1 -- 172.21.15.45:0/3244931202 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe524073ce0 con 0x7fe5240cba50 2023-11-28T18:38:17.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.426+0000 7fe528e17640 1 -- 172.21.15.45:0/3244931202 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe524073ce0 con 0x7fe5240cba50 2023-11-28T18:38:17.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.426+0000 7fe51affd640 1 -- 172.21.15.45:0/3244931202 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe524073ce0 con 0x7fe5240cba50 2023-11-28T18:38:17.429 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-11-28T18:38:17.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.430+0000 7fe528e17640 1 -- 172.21.15.45:0/3244931202 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe5040668d0 msgr2=0x7fe504068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:17.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.430+0000 7fe528e17640 1 --2- 172.21.15.45:0/3244931202 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe5040668d0 0x7fe504068d90 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe5140ae000 tx=0x7fe5140b5040 comp rx=0 tx=0).stop 2023-11-28T18:38:17.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.430+0000 7fe528e17640 1 -- 172.21.15.45:0/3244931202 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5240cba50 msgr2=0x7fe524152990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:17.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.430+0000 7fe528e17640 1 --2- 172.21.15.45:0/3244931202 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5240cba50 0x7fe524152990 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe50c00e9a0 tx=0x7fe50c00ee60 comp rx=0 tx=0).stop 2023-11-28T18:38:17.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.430+0000 7fe528e17640 1 -- 172.21.15.45:0/3244931202 shutdown_connections 2023-11-28T18:38:17.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.430+0000 7fe528e17640 1 --2- 172.21.15.45:0/3244931202 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe5040668d0 0x7fe504068d90 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:17.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.430+0000 7fe528e17640 1 --2- 172.21.15.45:0/3244931202 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe524158ce0 0x7fe524157850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:17.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.430+0000 7fe528e17640 1 --2- 172.21.15.45:0/3244931202 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5240cba50 0x7fe524152990 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:17.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.430+0000 7fe528e17640 1 --2- 172.21.15.45:0/3244931202 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe5240b4310 0x7fe52414d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:17.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.430+0000 7fe528e17640 1 -- 172.21.15.45:0/3244931202 >> 172.21.15.45:0/3244931202 conn(0x7fe5240b0d00 msgr2=0x7fe52415a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:17.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.430+0000 7fe528e17640 1 -- 172.21.15.45:0/3244931202 shutdown_connections 2023-11-28T18:38:17.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.430+0000 7fe528e17640 1 -- 172.21.15.45:0/3244931202 wait complete. 2023-11-28T18:38:17.450 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T18:38:17.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.594+0000 7f0a3029a640 1 Processor -- start 2023-11-28T18:38:17.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.594+0000 7f0a3029a640 1 -- start start 2023-11-28T18:38:17.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.598+0000 7f0a3029a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0a2806ac80 0x7f0a2806f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:17.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.598+0000 7f0a3029a640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f0a281467a0 0x7f0a280b30f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:17.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.598+0000 7f0a3029a640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a2806f980 con 0x7f0a28143a50 2023-11-28T18:38:17.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.598+0000 7f0a3029a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a28161a10 con 0x7f0a2806ac80 2023-11-28T18:38:17.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.598+0000 7f0a3029a640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a281470a0 con 0x7f0a281467a0 2023-11-28T18:38:17.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.598+0000 7f0a2d835640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0a2806ac80 0x7f0a2806f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:17.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.598+0000 7f0a2e036640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f0a28143a50 0x7f0a2806a570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45896/0 (socket says 172.21.15.45:45896) 2023-11-28T18:38:17.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.598+0000 7f0a2e036640 1 -- 172.21.15.45:0/3658830182 learned_addr learned my addr 172.21.15.45:0/3658830182 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:38:17.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.598+0000 7f0a2e837640 1 --2- 172.21.15.45:0/3658830182 >> v2:172.21.15.190:3300/0 conn(0x7f0a281467a0 0x7f0a280b30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:17.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.598+0000 7f0a2d835640 1 -- 172.21.15.45:0/3658830182 >> v2:172.21.15.190:3300/0 conn(0x7f0a281467a0 msgr2=0x7f0a280b30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:17.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.598+0000 7f0a2d835640 1 --2- 172.21.15.45:0/3658830182 >> v2:172.21.15.190:3300/0 conn(0x7f0a281467a0 0x7f0a280b30f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:17.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.598+0000 7f0a2d835640 1 -- 172.21.15.45:0/3658830182 >> v1:172.21.15.45:6789/0 conn(0x7f0a28143a50 legacy=0x7f0a2806a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:17.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.598+0000 7f0a2d835640 1 -- 172.21.15.45:0/3658830182 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a28161070 con 0x7f0a2806ac80 2023-11-28T18:38:17.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.598+0000 7f0a2d034640 1 -- 172.21.15.45:0/3658830182 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3632758504 0 0) 0x7f0a2806f980 con 0x7f0a28143a50 2023-11-28T18:38:17.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.598+0000 7f0a2e837640 1 --2- 172.21.15.45:0/3658830182 >> v2:172.21.15.190:3300/0 conn(0x7f0a281467a0 0x7f0a280b30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:38:17.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.598+0000 7f0a2d835640 1 --2- 172.21.15.45:0/3658830182 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a2806ac80 0x7f0a2806f2a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f0a2806c500 tx=0x7f0a1801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b503c745c213331a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:17.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.602+0000 7f0a2d034640 1 -- 172.21.15.45:0/3658830182 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a180ac630 con 0x7f0a2806ac80 2023-11-28T18:38:17.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.602+0000 7f0a2d034640 1 -- 172.21.15.45:0/3658830182 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a180ac790 con 0x7f0a2806ac80 2023-11-28T18:38:17.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.602+0000 7f0a2d034640 1 -- 172.21.15.45:0/3658830182 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a180acb20 con 0x7f0a2806ac80 2023-11-28T18:38:17.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.602+0000 7f0a3029a640 1 -- 172.21.15.45:0/3658830182 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a2806ac80 msgr2=0x7f0a2806f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:17.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.602+0000 7f0a3029a640 1 --2- 172.21.15.45:0/3658830182 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a2806ac80 0x7f0a2806f2a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f0a2806c500 tx=0x7f0a1801c3d0 comp rx=0 tx=0).stop 2023-11-28T18:38:17.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.602+0000 7f0a3029a640 1 -- 172.21.15.45:0/3658830182 shutdown_connections 2023-11-28T18:38:17.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.602+0000 7f0a3029a640 1 --2- 172.21.15.45:0/3658830182 >> v2:172.21.15.190:3300/0 conn(0x7f0a281467a0 0x7f0a280b30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:17.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.602+0000 7f0a3029a640 1 --2- 172.21.15.45:0/3658830182 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a2806ac80 0x7f0a2806f2a0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:17.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.602+0000 7f0a3029a640 1 -- 172.21.15.45:0/3658830182 >> 172.21.15.45:0/3658830182 conn(0x7f0a280b1df0 msgr2=0x7f0a280b2200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:17.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.602+0000 7f0a3029a640 1 -- 172.21.15.45:0/3658830182 shutdown_connections 2023-11-28T18:38:17.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.602+0000 7f0a3029a640 1 -- 172.21.15.45:0/3658830182 wait complete. 2023-11-28T18:38:17.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.602+0000 7f0a3029a640 1 Processor -- start 2023-11-28T18:38:17.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.602+0000 7f0a3029a640 1 -- start start 2023-11-28T18:38:17.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.602+0000 7f0a3029a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0a2806ac80 0x7f0a28167b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:17.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.602+0000 7f0a3029a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0a28143a50 0x7f0a28141d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:17.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.602+0000 7f0a3029a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a281467a0 0x7f0a2815bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:17.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.602+0000 7f0a3029a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2815e6d0 con 0x7f0a281467a0 2023-11-28T18:38:17.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.602+0000 7f0a3029a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2815e9b0 con 0x7f0a2806ac80 2023-11-28T18:38:17.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.602+0000 7f0a3029a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2815ec90 con 0x7f0a28143a50 2023-11-28T18:38:17.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.602+0000 7f0a2e837640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a281467a0 0x7f0a2815bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:17.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.602+0000 7f0a2e837640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a281467a0 0x7f0a2815bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54280/0 (socket says 172.21.15.45:54280) 2023-11-28T18:38:17.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.602+0000 7f0a2e837640 1 -- 172.21.15.45:0/4184474017 learned_addr learned my addr 172.21.15.45:0/4184474017 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:17.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.602+0000 7f0a2e036640 1 --2- 172.21.15.45:0/4184474017 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0a2806ac80 0x7f0a28167b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:17.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.602+0000 7f0a2d835640 1 --2- 172.21.15.45:0/4184474017 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0a28143a50 0x7f0a28141d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:17.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.606+0000 7f0a2e837640 1 -- 172.21.15.45:0/4184474017 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0a28143a50 msgr2=0x7f0a28141d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:17.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.606+0000 7f0a2e837640 1 --2- 172.21.15.45:0/4184474017 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0a28143a50 0x7f0a28141d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:17.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.606+0000 7f0a2e837640 1 -- 172.21.15.45:0/4184474017 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0a2806ac80 msgr2=0x7f0a28167b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:17.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.606+0000 7f0a2e837640 1 --2- 172.21.15.45:0/4184474017 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0a2806ac80 0x7f0a28167b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:17.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.606+0000 7f0a2e837640 1 -- 172.21.15.45:0/4184474017 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a18009420 con 0x7f0a281467a0 2023-11-28T18:38:17.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.606+0000 7f0a2d835640 1 --2- 172.21.15.45:0/4184474017 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0a28143a50 0x7f0a28141d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:38:17.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.606+0000 7f0a2e036640 1 --2- 172.21.15.45:0/4184474017 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0a2806ac80 0x7f0a28167b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:38:17.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.606+0000 7f0a2e837640 1 --2- 172.21.15.45:0/4184474017 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a281467a0 0x7f0a2815bbe0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0a2000cd50 tx=0x7f0a2000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:17.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.606+0000 7f0a1effd640 1 -- 172.21.15.45:0/4184474017 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2000f680 con 0x7f0a281467a0 2023-11-28T18:38:17.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.606+0000 7f0a1effd640 1 -- 172.21.15.45:0/4184474017 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a2000f800 con 0x7f0a281467a0 2023-11-28T18:38:17.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.606+0000 7f0a1effd640 1 -- 172.21.15.45:0/4184474017 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2000fbb0 con 0x7f0a281467a0 2023-11-28T18:38:17.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.606+0000 7f0a3029a640 1 -- 172.21.15.45:0/4184474017 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a2815ef70 con 0x7f0a281467a0 2023-11-28T18:38:17.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.606+0000 7f0a3029a640 1 -- 172.21.15.45:0/4184474017 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a281680b0 con 0x7f0a281467a0 2023-11-28T18:38:17.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.606+0000 7f0a3029a640 1 -- 172.21.15.45:0/4184474017 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a28069410 con 0x7f0a281467a0 2023-11-28T18:38:17.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.606+0000 7f0a1effd640 1 -- 172.21.15.45:0/4184474017 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f0a2000b040 con 0x7f0a281467a0 2023-11-28T18:38:17.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.606+0000 7f0a1effd640 1 --2- 172.21.15.45:0/4184474017 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f0a0c066900 0x7f0a0c068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:17.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.606+0000 7f0a1effd640 1 -- 172.21.15.45:0/4184474017 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5804+0+0 (secure 0 0 0) 0x7f0a20084ef0 con 0x7f0a281467a0 2023-11-28T18:38:17.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.610+0000 7f0a2e036640 1 --2- 172.21.15.45:0/4184474017 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f0a0c066900 0x7f0a0c068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:17.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.610+0000 7f0a2e036640 1 --2- 172.21.15.45:0/4184474017 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f0a0c066900 0x7f0a0c068dc0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0a24007fd0 tx=0x7f0a24007c20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:17.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.610+0000 7f0a1effd640 1 -- 172.21.15.45:0/4184474017 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0a20052030 con 0x7f0a281467a0 2023-11-28T18:38:17.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.770+0000 7f0a3029a640 1 -- 172.21.15.45:0/4184474017 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0a28146e80 con 0x7f0a281467a0 2023-11-28T18:38:17.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.770+0000 7f0a1effd640 1 -- 172.21.15.45:0/4184474017 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0a2001d020 con 0x7f0a281467a0 2023-11-28T18:38:17.771 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-11-28T18:38:17.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.770+0000 7f0a3029a640 1 -- 172.21.15.45:0/4184474017 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f0a0c066900 msgr2=0x7f0a0c068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:17.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.770+0000 7f0a3029a640 1 --2- 172.21.15.45:0/4184474017 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f0a0c066900 0x7f0a0c068dc0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0a24007fd0 tx=0x7f0a24007c20 comp rx=0 tx=0).stop 2023-11-28T18:38:17.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.770+0000 7f0a3029a640 1 -- 172.21.15.45:0/4184474017 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a281467a0 msgr2=0x7f0a2815bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:17.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.770+0000 7f0a3029a640 1 --2- 172.21.15.45:0/4184474017 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a281467a0 0x7f0a2815bbe0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0a2000cd50 tx=0x7f0a2000a650 comp rx=0 tx=0).stop 2023-11-28T18:38:17.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.770+0000 7f0a3029a640 1 -- 172.21.15.45:0/4184474017 shutdown_connections 2023-11-28T18:38:17.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.770+0000 7f0a3029a640 1 --2- 172.21.15.45:0/4184474017 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f0a0c066900 0x7f0a0c068dc0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:17.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.770+0000 7f0a3029a640 1 --2- 172.21.15.45:0/4184474017 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a281467a0 0x7f0a2815bbe0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:17.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.770+0000 7f0a3029a640 1 --2- 172.21.15.45:0/4184474017 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0a28143a50 0x7f0a28141d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:17.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.770+0000 7f0a3029a640 1 --2- 172.21.15.45:0/4184474017 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0a2806ac80 0x7f0a28167b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:17.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.770+0000 7f0a3029a640 1 -- 172.21.15.45:0/4184474017 >> 172.21.15.45:0/4184474017 conn(0x7f0a280b1df0 msgr2=0x7f0a2813f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:17.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.770+0000 7f0a3029a640 1 -- 172.21.15.45:0/4184474017 shutdown_connections 2023-11-28T18:38:17.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.770+0000 7f0a3029a640 1 -- 172.21.15.45:0/4184474017 wait complete. 2023-11-28T18:38:17.792 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T18:38:17.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.934+0000 7efc12e9a640 1 Processor -- start 2023-11-28T18:38:17.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.934+0000 7efc12e9a640 1 -- start start 2023-11-28T18:38:17.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.938+0000 7efc12e9a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efc0c071dd0 0x7efc0c0721b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:17.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.938+0000 7efc12e9a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7efc0c15adf0 0x7efc0c13d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:17.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.938+0000 7efc12e9a640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc0c13d2f0 con 0x7efc0c13f630 2023-11-28T18:38:17.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.938+0000 7efc12e9a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc0c140560 con 0x7efc0c15adf0 2023-11-28T18:38:17.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.938+0000 7efc12e9a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc0c0cd830 con 0x7efc0c071dd0 2023-11-28T18:38:17.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.938+0000 7efc0bfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7efc0c15adf0 0x7efc0c13d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:17.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.938+0000 7efc11437640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7efc0c13f630 0x7efc0c0ce240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59694/0 (socket says 172.21.15.45:59694) 2023-11-28T18:38:17.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.938+0000 7efc11437640 1 -- 172.21.15.45:0/1181357281 learned_addr learned my addr 172.21.15.45:0/1181357281 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:38:17.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.938+0000 7efc10c36640 1 --2- 172.21.15.45:0/1181357281 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efc0c071dd0 0x7efc0c0721b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:17.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.938+0000 7efc0bfff640 1 -- 172.21.15.45:0/1181357281 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efc0c071dd0 msgr2=0x7efc0c0721b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:17.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.938+0000 7efc0bfff640 1 --2- 172.21.15.45:0/1181357281 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efc0c071dd0 0x7efc0c0721b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:17.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.938+0000 7efc0bfff640 1 -- 172.21.15.45:0/1181357281 >> v1:172.21.15.45:6789/0 conn(0x7efc0c13f630 legacy=0x7efc0c0ce240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:17.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.938+0000 7efc0bfff640 1 -- 172.21.15.45:0/1181357281 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc0c0cddb0 con 0x7efc0c15adf0 2023-11-28T18:38:17.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.942+0000 7efc0bfff640 1 --2- 172.21.15.45:0/1181357281 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc0c15adf0 0x7efc0c13d5a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7efbf80097c0 tx=0x7efbf801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f17a90668555faf6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:17.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.942+0000 7efc0b7fe640 1 -- 172.21.15.45:0/1181357281 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf80ab680 con 0x7efc0c15adf0 2023-11-28T18:38:17.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.942+0000 7efc0b7fe640 1 -- 172.21.15.45:0/1181357281 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbf80ab7e0 con 0x7efc0c15adf0 2023-11-28T18:38:17.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.942+0000 7efc0b7fe640 1 -- 172.21.15.45:0/1181357281 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf80abb70 con 0x7efc0c15adf0 2023-11-28T18:38:17.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.942+0000 7efc12e9a640 1 -- 172.21.15.45:0/1181357281 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc0c15adf0 msgr2=0x7efc0c13d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:17.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.942+0000 7efc12e9a640 1 --2- 172.21.15.45:0/1181357281 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc0c15adf0 0x7efc0c13d5a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7efbf80097c0 tx=0x7efbf801c480 comp rx=0 tx=0).stop 2023-11-28T18:38:17.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.942+0000 7efc12e9a640 1 -- 172.21.15.45:0/1181357281 shutdown_connections 2023-11-28T18:38:17.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.942+0000 7efc12e9a640 1 --2- 172.21.15.45:0/1181357281 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc0c15adf0 0x7efc0c13d5a0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:17.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.942+0000 7efc12e9a640 1 --2- 172.21.15.45:0/1181357281 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efc0c071dd0 0x7efc0c0721b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:17.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.942+0000 7efc12e9a640 1 -- 172.21.15.45:0/1181357281 >> 172.21.15.45:0/1181357281 conn(0x7efc0c0b0d00 msgr2=0x7efc0c0b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:17.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.942+0000 7efc12e9a640 1 -- 172.21.15.45:0/1181357281 shutdown_connections 2023-11-28T18:38:17.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.942+0000 7efc12e9a640 1 -- 172.21.15.45:0/1181357281 wait complete. 2023-11-28T18:38:17.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.942+0000 7efc12e9a640 1 Processor -- start 2023-11-28T18:38:17.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.942+0000 7efc12e9a640 1 -- start start 2023-11-28T18:38:17.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.942+0000 7efc12e9a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc0c071dd0 0x7efc0c141360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:17.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.946+0000 7efc12e9a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efc0c13f630 0x7efc0c1418a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:17.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.946+0000 7efc12e9a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efc0c15adf0 0x7efc0c13b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:17.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.946+0000 7efc12e9a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc0c0b21e0 con 0x7efc0c071dd0 2023-11-28T18:38:17.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.946+0000 7efc12e9a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc0c0b1e40 con 0x7efc0c15adf0 2023-11-28T18:38:17.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.946+0000 7efc12e9a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc0c141de0 con 0x7efc0c13f630 2023-11-28T18:38:17.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.946+0000 7efc10c36640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc0c071dd0 0x7efc0c141360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:17.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.946+0000 7efc10c36640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc0c071dd0 0x7efc0c141360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56130/0 (socket says 172.21.15.45:56130) 2023-11-28T18:38:17.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.946+0000 7efc10c36640 1 -- 172.21.15.45:0/2393551380 learned_addr learned my addr 172.21.15.45:0/2393551380 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:17.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.946+0000 7efc0bfff640 1 --2- 172.21.15.45:0/2393551380 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efc0c13f630 0x7efc0c1418a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:17.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.946+0000 7efc11437640 1 --2- 172.21.15.45:0/2393551380 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efc0c15adf0 0x7efc0c13b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:17.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.946+0000 7efc10c36640 1 -- 172.21.15.45:0/2393551380 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efc0c13f630 msgr2=0x7efc0c1418a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:17.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.946+0000 7efc10c36640 1 --2- 172.21.15.45:0/2393551380 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efc0c13f630 0x7efc0c1418a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:17.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.946+0000 7efc10c36640 1 -- 172.21.15.45:0/2393551380 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efc0c15adf0 msgr2=0x7efc0c13b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:17.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.946+0000 7efc10c36640 1 --2- 172.21.15.45:0/2393551380 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efc0c15adf0 0x7efc0c13b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:17.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.946+0000 7efc10c36640 1 -- 172.21.15.45:0/2393551380 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbf8009420 con 0x7efc0c071dd0 2023-11-28T18:38:17.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.946+0000 7efc10c36640 1 --2- 172.21.15.45:0/2393551380 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc0c071dd0 0x7efc0c141360 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7efc0000d800 tx=0x7efc0000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:17.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.946+0000 7efc097fa640 1 -- 172.21.15.45:0/2393551380 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0000b6c0 con 0x7efc0c071dd0 2023-11-28T18:38:17.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.946+0000 7efc097fa640 1 -- 172.21.15.45:0/2393551380 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc0000b820 con 0x7efc0c071dd0 2023-11-28T18:38:17.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.946+0000 7efc12e9a640 1 -- 172.21.15.45:0/2393551380 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc0c142090 con 0x7efc0c071dd0 2023-11-28T18:38:17.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.946+0000 7efc097fa640 1 -- 172.21.15.45:0/2393551380 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0000bb90 con 0x7efc0c071dd0 2023-11-28T18:38:17.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.946+0000 7efc12e9a640 1 -- 172.21.15.45:0/2393551380 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc0c13b5c0 con 0x7efc0c071dd0 2023-11-28T18:38:17.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.946+0000 7efc12e9a640 1 -- 172.21.15.45:0/2393551380 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc0c0b2450 con 0x7efc0c071dd0 2023-11-28T18:38:17.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.946+0000 7efc097fa640 1 -- 172.21.15.45:0/2393551380 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7efc0000bcf0 con 0x7efc0c071dd0 2023-11-28T18:38:17.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.950+0000 7efc097fa640 1 --2- 172.21.15.45:0/2393551380 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7efbf00668d0 0x7efbf0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:17.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.950+0000 7efc097fa640 1 -- 172.21.15.45:0/2393551380 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5804+0+0 (secure 0 0 0) 0x7efc000849a0 con 0x7efc0c071dd0 2023-11-28T18:38:17.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.950+0000 7efc0bfff640 1 --2- 172.21.15.45:0/2393551380 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7efbf00668d0 0x7efbf0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:17.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.950+0000 7efc0bfff640 1 --2- 172.21.15.45:0/2393551380 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7efbf00668d0 0x7efbf0068d90 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7efbf80af000 tx=0x7efbf80a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:17.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:17.950+0000 7efc097fa640 1 -- 172.21.15.45:0/2393551380 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efc00051c10 con 0x7efc0c071dd0 2023-11-28T18:38:18.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.110+0000 7efc12e9a640 1 -- 172.21.15.45:0/2393551380 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efc0c069410 con 0x7efc0c071dd0 2023-11-28T18:38:18.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.110+0000 7efc097fa640 1 -- 172.21.15.45:0/2393551380 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7efc00011340 con 0x7efc0c071dd0 2023-11-28T18:38:18.114 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-11-28T18:38:18.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.114+0000 7efc12e9a640 1 -- 172.21.15.45:0/2393551380 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7efbf00668d0 msgr2=0x7efbf0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:18.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.114+0000 7efc12e9a640 1 --2- 172.21.15.45:0/2393551380 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7efbf00668d0 0x7efbf0068d90 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7efbf80af000 tx=0x7efbf80a7000 comp rx=0 tx=0).stop 2023-11-28T18:38:18.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.114+0000 7efc12e9a640 1 -- 172.21.15.45:0/2393551380 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc0c071dd0 msgr2=0x7efc0c141360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:18.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.114+0000 7efc12e9a640 1 --2- 172.21.15.45:0/2393551380 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc0c071dd0 0x7efc0c141360 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7efc0000d800 tx=0x7efc0000dcc0 comp rx=0 tx=0).stop 2023-11-28T18:38:18.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.114+0000 7efc12e9a640 1 -- 172.21.15.45:0/2393551380 shutdown_connections 2023-11-28T18:38:18.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.114+0000 7efc12e9a640 1 --2- 172.21.15.45:0/2393551380 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7efbf00668d0 0x7efbf0068d90 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:18.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.114+0000 7efc12e9a640 1 --2- 172.21.15.45:0/2393551380 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efc0c15adf0 0x7efc0c13b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:18.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.114+0000 7efc12e9a640 1 --2- 172.21.15.45:0/2393551380 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efc0c13f630 0x7efc0c1418a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:18.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.114+0000 7efc12e9a640 1 --2- 172.21.15.45:0/2393551380 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc0c071dd0 0x7efc0c141360 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:18.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.114+0000 7efc12e9a640 1 -- 172.21.15.45:0/2393551380 >> 172.21.15.45:0/2393551380 conn(0x7efc0c0b0d00 msgr2=0x7efc0c159a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:18.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.114+0000 7efc12e9a640 1 -- 172.21.15.45:0/2393551380 shutdown_connections 2023-11-28T18:38:18.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.114+0000 7efc12e9a640 1 -- 172.21.15.45:0/2393551380 wait complete. 2023-11-28T18:38:18.136 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T18:38:18.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.282+0000 7f1e5be09640 1 Processor -- start 2023-11-28T18:38:18.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.282+0000 7f1e5be09640 1 -- start start 2023-11-28T18:38:18.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.282+0000 7f1e5be09640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f1e540d17f0 0x7f1e54142c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:18.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.282+0000 7f1e5be09640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1e540b4b80 0x7f1e54143180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:18.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.282+0000 7f1e5be09640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e5415d800 con 0x7f1e540b47a0 2023-11-28T18:38:18.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.282+0000 7f1e5be09640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e54161e00 con 0x7f1e540d17f0 2023-11-28T18:38:18.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.282+0000 7f1e5be09640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e54140970 con 0x7f1e540b4b80 2023-11-28T18:38:18.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.286+0000 7f1e59ba5640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f1e540b47a0 0x7f1e540d10e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.45:37320/0 (socket says 172.21.15.45:37320) 2023-11-28T18:38:18.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.286+0000 7f1e59ba5640 1 -- 172.21.15.45:0/46217145 learned_addr learned my addr 172.21.15.45:0/46217145 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:38:18.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.286+0000 7f1e593a4640 1 --2- 172.21.15.45:0/46217145 >> v2:172.21.15.190:3300/0 conn(0x7f1e540d17f0 0x7f1e54142c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:18.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.286+0000 7f1e5a3a6640 1 --2- 172.21.15.45:0/46217145 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1e540b4b80 0x7f1e54143180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:18.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.286+0000 7f1e58ba3640 1 -- 172.21.15.45:0/46217145 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4080815967 0 0) 0x7f1e5415d800 con 0x7f1e540b47a0 2023-11-28T18:38:18.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.286+0000 7f1e58ba3640 1 -- 172.21.15.45:0/46217145 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e40003530 con 0x7f1e540b47a0 2023-11-28T18:38:18.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.286+0000 7f1e593a4640 1 -- 172.21.15.45:0/46217145 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1e540b4b80 msgr2=0x7f1e54143180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:18.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.286+0000 7f1e593a4640 1 --2- 172.21.15.45:0/46217145 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1e540b4b80 0x7f1e54143180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:18.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.286+0000 7f1e593a4640 1 -- 172.21.15.45:0/46217145 >> v1:172.21.15.190:6789/0 conn(0x7f1e540b47a0 legacy=0x7f1e540d10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:18.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.286+0000 7f1e593a4640 1 -- 172.21.15.45:0/46217145 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e5415da50 con 0x7f1e540d17f0 2023-11-28T18:38:18.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.286+0000 7f1e5a3a6640 1 --2- 172.21.15.45:0/46217145 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1e540b4b80 0x7f1e54143180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:38:18.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.286+0000 7f1e593a4640 1 --2- 172.21.15.45:0/46217145 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1e540d17f0 0x7f1e54142c40 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1e440097f0 tx=0x7f1e4401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e581717b9490a40 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:18.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.290+0000 7f1e58ba3640 1 -- 172.21.15.45:0/46217145 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e440ab600 con 0x7f1e540d17f0 2023-11-28T18:38:18.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.290+0000 7f1e58ba3640 1 -- 172.21.15.45:0/46217145 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e440a7050 con 0x7f1e540d17f0 2023-11-28T18:38:18.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.290+0000 7f1e58ba3640 1 -- 172.21.15.45:0/46217145 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e440ab980 con 0x7f1e540d17f0 2023-11-28T18:38:18.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.290+0000 7f1e5be09640 1 -- 172.21.15.45:0/46217145 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1e540d17f0 msgr2=0x7f1e54142c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:18.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.290+0000 7f1e5be09640 1 --2- 172.21.15.45:0/46217145 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1e540d17f0 0x7f1e54142c40 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1e440097f0 tx=0x7f1e4401c480 comp rx=0 tx=0).stop 2023-11-28T18:38:18.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.290+0000 7f1e5be09640 1 -- 172.21.15.45:0/46217145 shutdown_connections 2023-11-28T18:38:18.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.290+0000 7f1e5be09640 1 --2- 172.21.15.45:0/46217145 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1e540b4b80 0x7f1e54143180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:18.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.290+0000 7f1e5be09640 1 --2- 172.21.15.45:0/46217145 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1e540d17f0 0x7f1e54142c40 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:18.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.290+0000 7f1e5be09640 1 -- 172.21.15.45:0/46217145 >> 172.21.15.45:0/46217145 conn(0x7f1e5406a570 msgr2=0x7f1e5406a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:18.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.290+0000 7f1e5be09640 1 -- 172.21.15.45:0/46217145 shutdown_connections 2023-11-28T18:38:18.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.290+0000 7f1e5be09640 1 -- 172.21.15.45:0/46217145 wait complete. 2023-11-28T18:38:18.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.290+0000 7f1e5be09640 1 Processor -- start 2023-11-28T18:38:18.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.290+0000 7f1e5be09640 1 -- start start 2023-11-28T18:38:18.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.290+0000 7f1e5be09640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1e540b47a0 0x7f1e54138c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:18.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.290+0000 7f1e5be09640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e540b4b80 0x7f1e54154ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:18.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.290+0000 7f1e5be09640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1e540d17f0 0x7f1e5413acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:18.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.290+0000 7f1e5be09640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e54139190 con 0x7f1e540b4b80 2023-11-28T18:38:18.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.290+0000 7f1e5be09640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e541394e0 con 0x7f1e540b47a0 2023-11-28T18:38:18.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.290+0000 7f1e5be09640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e541397c0 con 0x7f1e540d17f0 2023-11-28T18:38:18.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.290+0000 7f1e593a4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e540b4b80 0x7f1e54154ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:18.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.294+0000 7f1e593a4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e540b4b80 0x7f1e54154ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56146/0 (socket says 172.21.15.45:56146) 2023-11-28T18:38:18.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.294+0000 7f1e593a4640 1 -- 172.21.15.45:0/1966644876 learned_addr learned my addr 172.21.15.45:0/1966644876 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:18.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.294+0000 7f1e59ba5640 1 --2- 172.21.15.45:0/1966644876 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1e540b47a0 0x7f1e54138c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:18.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.294+0000 7f1e5a3a6640 1 --2- 172.21.15.45:0/1966644876 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1e540d17f0 0x7f1e5413acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:18.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.294+0000 7f1e593a4640 1 -- 172.21.15.45:0/1966644876 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1e540d17f0 msgr2=0x7f1e5413acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:18.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.294+0000 7f1e593a4640 1 --2- 172.21.15.45:0/1966644876 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1e540d17f0 0x7f1e5413acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:18.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.294+0000 7f1e593a4640 1 -- 172.21.15.45:0/1966644876 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1e540b47a0 msgr2=0x7f1e54138c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:18.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.294+0000 7f1e593a4640 1 --2- 172.21.15.45:0/1966644876 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1e540b47a0 0x7f1e54138c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:18.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.294+0000 7f1e593a4640 1 -- 172.21.15.45:0/1966644876 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e4c009a70 con 0x7f1e540b4b80 2023-11-28T18:38:18.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.294+0000 7f1e593a4640 1 --2- 172.21.15.45:0/1966644876 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e540b4b80 0x7f1e54154ab0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1e4401ab30 tx=0x7f1e44019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:18.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.294+0000 7f1e4a7fc640 1 -- 172.21.15.45:0/1966644876 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e440b4400 con 0x7f1e540b4b80 2023-11-28T18:38:18.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.294+0000 7f1e4a7fc640 1 -- 172.21.15.45:0/1966644876 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e440b4580 con 0x7f1e540b4b80 2023-11-28T18:38:18.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.294+0000 7f1e4a7fc640 1 -- 172.21.15.45:0/1966644876 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e440b4930 con 0x7f1e540b4b80 2023-11-28T18:38:18.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.294+0000 7f1e5be09640 1 -- 172.21.15.45:0/1966644876 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e44009420 con 0x7f1e540b4b80 2023-11-28T18:38:18.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.294+0000 7f1e5be09640 1 -- 172.21.15.45:0/1966644876 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e54139d80 con 0x7f1e540b4b80 2023-11-28T18:38:18.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.294+0000 7f1e5be09640 1 -- 172.21.15.45:0/1966644876 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e54069480 con 0x7f1e540b4b80 2023-11-28T18:38:18.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.294+0000 7f1e4a7fc640 1 -- 172.21.15.45:0/1966644876 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f1e440b2040 con 0x7f1e540b4b80 2023-11-28T18:38:18.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.298+0000 7f1e4a7fc640 1 --2- 172.21.15.45:0/1966644876 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1e380668d0 0x7f1e38068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:18.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.298+0000 7f1e4a7fc640 1 -- 172.21.15.45:0/1966644876 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5804+0+0 (secure 0 0 0) 0x7f1e4411e2a0 con 0x7f1e540b4b80 2023-11-28T18:38:18.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.298+0000 7f1e59ba5640 1 --2- 172.21.15.45:0/1966644876 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1e380668d0 0x7f1e38068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:18.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.298+0000 7f1e59ba5640 1 --2- 172.21.15.45:0/1966644876 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1e380668d0 0x7f1e38068d90 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1e500011f0 tx=0x7f1e50007d40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:18.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.302+0000 7f1e4a7fc640 1 -- 172.21.15.45:0/1966644876 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1e440eb520 con 0x7f1e540b4b80 2023-11-28T18:38:18.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.470+0000 7f1e5be09640 1 -- 172.21.15.45:0/1966644876 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f1e540b3af0 con 0x7f1e540b4b80 2023-11-28T18:38:18.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.470+0000 7f1e4a7fc640 1 -- 172.21.15.45:0/1966644876 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1e440eeb40 con 0x7f1e540b4b80 2023-11-28T18:38:18.473 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-11-28T18:38:18.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.470+0000 7f1e5be09640 1 -- 172.21.15.45:0/1966644876 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1e380668d0 msgr2=0x7f1e38068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:18.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.470+0000 7f1e5be09640 1 --2- 172.21.15.45:0/1966644876 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1e380668d0 0x7f1e38068d90 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1e500011f0 tx=0x7f1e50007d40 comp rx=0 tx=0).stop 2023-11-28T18:38:18.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.470+0000 7f1e5be09640 1 -- 172.21.15.45:0/1966644876 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e540b4b80 msgr2=0x7f1e54154ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:18.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.470+0000 7f1e5be09640 1 --2- 172.21.15.45:0/1966644876 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e540b4b80 0x7f1e54154ab0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1e4401ab30 tx=0x7f1e44019220 comp rx=0 tx=0).stop 2023-11-28T18:38:18.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.470+0000 7f1e5be09640 1 -- 172.21.15.45:0/1966644876 shutdown_connections 2023-11-28T18:38:18.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.470+0000 7f1e5be09640 1 --2- 172.21.15.45:0/1966644876 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1e380668d0 0x7f1e38068d90 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:18.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.470+0000 7f1e5be09640 1 --2- 172.21.15.45:0/1966644876 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1e540d17f0 0x7f1e5413acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:18.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.470+0000 7f1e5be09640 1 --2- 172.21.15.45:0/1966644876 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e540b4b80 0x7f1e54154ab0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:18.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.470+0000 7f1e5be09640 1 --2- 172.21.15.45:0/1966644876 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1e540b47a0 0x7f1e54138c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:18.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.470+0000 7f1e5be09640 1 -- 172.21.15.45:0/1966644876 >> 172.21.15.45:0/1966644876 conn(0x7f1e5406a570 msgr2=0x7f1e5406c030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:18.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.474+0000 7f1e5be09640 1 -- 172.21.15.45:0/1966644876 shutdown_connections 2023-11-28T18:38:18.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.474+0000 7f1e5be09640 1 -- 172.21.15.45:0/1966644876 wait complete. 2023-11-28T18:38:18.494 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-28T18:38:18.494 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T18:38:18.504 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T18:38:18.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.646+0000 7f06cf7aa640 1 Processor -- start 2023-11-28T18:38:18.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.646+0000 7f06cf7aa640 1 -- start start 2023-11-28T18:38:18.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.646+0000 7f06cf7aa640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f06c806ca10 0x7f06c8145290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:18.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.646+0000 7f06cf7aa640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f06c815c0b0 0x7f06c81457d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:18.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.646+0000 7f06cf7aa640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06c8146000 con 0x7f06c815bcd0 2023-11-28T18:38:18.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.646+0000 7f06cf7aa640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06c81462e0 con 0x7f06c815c0b0 2023-11-28T18:38:18.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.646+0000 7f06cf7aa640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06c81465c0 con 0x7f06c806ca10 2023-11-28T18:38:18.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.646+0000 7f06cdd47640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f06c815c0b0 0x7f06c81457d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:18.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.646+0000 7f06cdd47640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f06c815c0b0 0x7f06c81457d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56162/0 (socket says 172.21.15.45:56162) 2023-11-28T18:38:18.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.646+0000 7f06cdd47640 1 -- 172.21.15.45:0/1396005218 learned_addr learned my addr 172.21.15.45:0/1396005218 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:18.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.646+0000 7f06ccd45640 1 --2- 172.21.15.45:0/1396005218 >> v2:172.21.15.190:3300/0 conn(0x7f06c806ca10 0x7f06c8145290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:18.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.646+0000 7f06cdd47640 1 -- 172.21.15.45:0/1396005218 >> v2:172.21.15.190:3300/0 conn(0x7f06c806ca10 msgr2=0x7f06c8145290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:18.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.646+0000 7f06cdd47640 1 --2- 172.21.15.45:0/1396005218 >> v2:172.21.15.190:3300/0 conn(0x7f06c806ca10 0x7f06c8145290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:18.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.646+0000 7f06cdd47640 1 -- 172.21.15.45:0/1396005218 >> v1:172.21.15.190:6789/0 conn(0x7f06c815bcd0 legacy=0x7f06c806c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:18.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.646+0000 7f06cdd47640 1 -- 172.21.15.45:0/1396005218 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c81468a0 con 0x7f06c815c0b0 2023-11-28T18:38:18.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.650+0000 7f06cdd47640 1 --2- 172.21.15.45:0/1396005218 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06c815c0b0 0x7f06c81457d0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f06c0009e50 tx=0x7f06c001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f489a1471d5cba3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:18.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.650+0000 7f06bffff640 1 -- 172.21.15.45:0/1396005218 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c00a57b0 con 0x7f06c815c0b0 2023-11-28T18:38:18.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.650+0000 7f06bffff640 1 -- 172.21.15.45:0/1396005218 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06c00a5910 con 0x7f06c815c0b0 2023-11-28T18:38:18.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.650+0000 7f06bffff640 1 -- 172.21.15.45:0/1396005218 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c00a5ca0 con 0x7f06c815c0b0 2023-11-28T18:38:18.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.650+0000 7f06cf7aa640 1 -- 172.21.15.45:0/1396005218 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06c815c0b0 msgr2=0x7f06c81457d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:18.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.650+0000 7f06cf7aa640 1 --2- 172.21.15.45:0/1396005218 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06c815c0b0 0x7f06c81457d0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f06c0009e50 tx=0x7f06c001c910 comp rx=0 tx=0).stop 2023-11-28T18:38:18.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.650+0000 7f06cf7aa640 1 -- 172.21.15.45:0/1396005218 shutdown_connections 2023-11-28T18:38:18.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.650+0000 7f06cf7aa640 1 --2- 172.21.15.45:0/1396005218 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06c815c0b0 0x7f06c81457d0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:18.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.650+0000 7f06cf7aa640 1 --2- 172.21.15.45:0/1396005218 >> v2:172.21.15.190:3300/0 conn(0x7f06c806ca10 0x7f06c8145290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:18.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.650+0000 7f06cf7aa640 1 -- 172.21.15.45:0/1396005218 >> 172.21.15.45:0/1396005218 conn(0x7f06c806a570 msgr2=0x7f06c806a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:18.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.650+0000 7f06cf7aa640 1 -- 172.21.15.45:0/1396005218 shutdown_connections 2023-11-28T18:38:18.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.650+0000 7f06cf7aa640 1 -- 172.21.15.45:0/1396005218 wait complete. 2023-11-28T18:38:18.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.654+0000 7f06cf7aa640 1 Processor -- start 2023-11-28T18:38:18.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.654+0000 7f06cf7aa640 1 -- start start 2023-11-28T18:38:18.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.654+0000 7f06cf7aa640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f06c806ca10 0x7f06c8140ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:18.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.654+0000 7f06cf7aa640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f06c815bcd0 0x7f06c81561c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:18.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.654+0000 7f06cf7aa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06c815c0b0 0x7f06c813ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:18.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.654+0000 7f06cf7aa640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c8140690 con 0x7f06c815c0b0 2023-11-28T18:38:18.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.654+0000 7f06cf7aa640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c8142920 con 0x7f06c806ca10 2023-11-28T18:38:18.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.654+0000 7f06cf7aa640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06c813fcf0 con 0x7f06c815bcd0 2023-11-28T18:38:18.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.654+0000 7f06cdd47640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06c815c0b0 0x7f06c813ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:18.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.654+0000 7f06cdd47640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06c815c0b0 0x7f06c813ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56166/0 (socket says 172.21.15.45:56166) 2023-11-28T18:38:18.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.654+0000 7f06cdd47640 1 -- 172.21.15.45:0/46443537 learned_addr learned my addr 172.21.15.45:0/46443537 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:18.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.654+0000 7f06cd546640 1 --2- 172.21.15.45:0/46443537 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f06c806ca10 0x7f06c8140ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:18.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.654+0000 7f06ccd45640 1 --2- 172.21.15.45:0/46443537 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f06c815bcd0 0x7f06c81561c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:18.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.654+0000 7f06cdd47640 1 -- 172.21.15.45:0/46443537 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f06c815bcd0 msgr2=0x7f06c81561c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:18.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.654+0000 7f06cdd47640 1 --2- 172.21.15.45:0/46443537 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f06c815bcd0 0x7f06c81561c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:18.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.654+0000 7f06cdd47640 1 -- 172.21.15.45:0/46443537 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f06c806ca10 msgr2=0x7f06c8140ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:18.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.654+0000 7f06cdd47640 1 --2- 172.21.15.45:0/46443537 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f06c806ca10 0x7f06c8140ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:18.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.654+0000 7f06cdd47640 1 -- 172.21.15.45:0/46443537 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c0009b30 con 0x7f06c815c0b0 2023-11-28T18:38:18.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.654+0000 7f06cdd47640 1 --2- 172.21.15.45:0/46443537 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06c815c0b0 0x7f06c813ef50 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f06c00af040 tx=0x7f06c00196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:18.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.654+0000 7f06bdffb640 1 -- 172.21.15.45:0/46443537 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c00b8670 con 0x7f06c815c0b0 2023-11-28T18:38:18.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.654+0000 7f06bdffb640 1 -- 172.21.15.45:0/46443537 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06c00b87d0 con 0x7f06c815c0b0 2023-11-28T18:38:18.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.654+0000 7f06bdffb640 1 -- 172.21.15.45:0/46443537 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c00b8b60 con 0x7f06c815c0b0 2023-11-28T18:38:18.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.654+0000 7f06cf7aa640 1 -- 172.21.15.45:0/46443537 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06c813ffd0 con 0x7f06c815c0b0 2023-11-28T18:38:18.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.654+0000 7f06cf7aa640 1 -- 172.21.15.45:0/46443537 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06c81424f0 con 0x7f06c815c0b0 2023-11-28T18:38:18.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.658+0000 7f06cf7aa640 1 -- 172.21.15.45:0/46443537 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06c81426e0 con 0x7f06c815c0b0 2023-11-28T18:38:18.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.658+0000 7f06bdffb640 1 -- 172.21.15.45:0/46443537 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f06c00b8cc0 con 0x7f06c815c0b0 2023-11-28T18:38:18.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.658+0000 7f06bdffb640 1 --2- 172.21.15.45:0/46443537 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f06ac0668d0 0x7f06ac068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:18.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.658+0000 7f06bdffb640 1 -- 172.21.15.45:0/46443537 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5804+0+0 (secure 0 0 0) 0x7f06c011f9c0 con 0x7f06c815c0b0 2023-11-28T18:38:18.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.658+0000 7f06cd546640 1 --2- 172.21.15.45:0/46443537 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f06ac0668d0 0x7f06ac068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:18.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.658+0000 7f06cd546640 1 --2- 172.21.15.45:0/46443537 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f06ac0668d0 0x7f06ac068d90 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f06c4007fd0 tx=0x7f06c4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:18.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.662+0000 7f06bdffb640 1 -- 172.21.15.45:0/46443537 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f06c81426e0 con 0x7f06c815c0b0 2023-11-28T18:38:18.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.822+0000 7f06cf7aa640 1 -- 172.21.15.45:0/46443537 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f06c81426e0 con 0x7f06c815c0b0 2023-11-28T18:38:18.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.822+0000 7f06bdffb640 1 -- 172.21.15.45:0/46443537 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16689 (secure 0 0 0) 0x7f06c81426e0 con 0x7f06c815c0b0 2023-11-28T18:38:18.827 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:38:18.827 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":22,"fsid":"d10f5cd6-1d00-4019-99b6-6fa435498a15","created":"2023-11-28T18:37:08.189030+0000","modified":"2023-11-28T18:38:15.148068+0000","last_up_change":"2023-11-28T18:37:20.196124+0000","last_in_change":"2023-11-28T18:37:10.742043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T18:37:21.293917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T18:37:31.384760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T18:37:31.834769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"84465384-103c-4f2c-a45a-96f5bb9c835f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6809","nonce":555237322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6811","nonce":555237322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6815","nonce":555237322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6813","nonce":555237322}]},"public_addr":"172.21.15.45:6809/555237322","cluster_addr":"172.21.15.45:6811/555237322","heartbeat_back_addr":"172.21.15.45:6815/555237322","heartbeat_front_addr":"172.21.15.45:6813/555237322","state":["exists","up"]},{"osd":1,"uuid":"7d9eed24-a58f-42c7-a787-ac06be8553fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6801","nonce":2857063763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6803","nonce":2857063763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6807","nonce":2857063763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6805","nonce":2857063763}]},"public_addr":"172.21.15.45:6801/2857063763","cluster_addr":"172.21.15.45:6803/2857063763","heartbeat_back_addr":"172.21.15.45:6807/2857063763","heartbeat_front_addr":"172.21.15.45:6805/2857063763","state":["exists","up"]},{"osd":2,"uuid":"575eeccc-4abf-45b4-9caf-f3e797859588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6817","nonce":193884539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6819","nonce":193884539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6823","nonce":193884539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6821","nonce":193884539}]},"public_addr":"172.21.15.45:6817/193884539","cluster_addr":"172.21.15.45:6819/193884539","heartbeat_back_addr":"172.21.15.45:6823/193884539","heartbeat_front_addr":"172.21.15.45:6821/193884539","state":["exists","up"]},{"osd":3,"uuid":"9b0290d6-9a52-4bc8-b2a1-7622c5dc8e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6825","nonce":78541084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6827","nonce":78541084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6831","nonce":78541084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6829","nonce":78541084}]},"public_addr":"172.21.15.45:6825/78541084","cluster_addr":"172.21.15.45:6827/78541084","heartbeat_back_addr":"172.21.15.45:6831/78541084","heartbeat_front_addr":"172.21.15.45:6829/78541084","state":["exists","up"]},{"osd":4,"uuid":"ce632829-f027-4fbf-a627-02c571aa9d53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6809","nonce":1537591987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6811","nonce":1537591987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6815","nonce":1537591987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6813","nonce":1537591987}]},"public_addr":"172.21.15.190:6809/1537591987","cluster_addr":"172.21.15.190:6811/1537591987","heartbeat_back_addr":"172.21.15.190:6815/1537591987","heartbeat_front_addr":"172.21.15.190:6813/1537591987","state":["exists","up"]},{"osd":5,"uuid":"8700b609-27be-40bd-a251-4c0ae0a29ead","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6801","nonce":3296698407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6803","nonce":3296698407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6807","nonce":3296698407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6805","nonce":3296698407}]},"public_addr":"172.21.15.190:6801/3296698407","cluster_addr":"172.21.15.190:6803/3296698407","heartbeat_back_addr":"172.21.15.190:6807/3296698407","heartbeat_front_addr":"172.21.15.190:6805/3296698407","state":["exists","up"]},{"osd":6,"uuid":"44ce4a40-e6ff-4f4d-8e8a-7341e5c91f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6817","nonce":2317686718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6819","nonce":2317686718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6823","nonce":2317686718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6821","nonce":2317686718}]},"public_addr":"172.21.15.190:6817/2317686718","cluster_addr":"172.21.15.190:6819/2317686718","heartbeat_back_addr":"172.21.15.190:6823/2317686718","heartbeat_front_addr":"172.21.15.190:6821/2317686718","state":["exists","up"]},{"osd":7,"uuid":"192238c9-1423-4b7e-ac8f-84ba32113ddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6825","nonce":2493232051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6827","nonce":2493232051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6831","nonce":2493232051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6829","nonce":2493232051}]},"public_addr":"172.21.15.190:6825/2493232051","cluster_addr":"172.21.15.190:6827/2493232051","heartbeat_back_addr":"172.21.15.190:6831/2493232051","heartbeat_front_addr":"172.21.15.190:6829/2493232051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.393552+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.385453+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.361421+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.366408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.363226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.276007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.414605+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.445885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2},{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T18:38:18.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.826+0000 7f06cf7aa640 1 -- 172.21.15.45:0/46443537 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f06ac0668d0 msgr2=0x7f06ac068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:18.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.826+0000 7f06cf7aa640 1 --2- 172.21.15.45:0/46443537 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f06ac0668d0 0x7f06ac068d90 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f06c4007fd0 tx=0x7f06c4009040 comp rx=0 tx=0).stop 2023-11-28T18:38:18.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.826+0000 7f06cf7aa640 1 -- 172.21.15.45:0/46443537 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06c815c0b0 msgr2=0x7f06c813ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:18.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.826+0000 7f06cf7aa640 1 --2- 172.21.15.45:0/46443537 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06c815c0b0 0x7f06c813ef50 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f06c00af040 tx=0x7f06c00196b0 comp rx=0 tx=0).stop 2023-11-28T18:38:18.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.826+0000 7f06cf7aa640 1 -- 172.21.15.45:0/46443537 shutdown_connections 2023-11-28T18:38:18.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.826+0000 7f06cf7aa640 1 --2- 172.21.15.45:0/46443537 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f06ac0668d0 0x7f06ac068d90 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:18.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.826+0000 7f06cf7aa640 1 --2- 172.21.15.45:0/46443537 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06c815c0b0 0x7f06c813ef50 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:18.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.826+0000 7f06cf7aa640 1 --2- 172.21.15.45:0/46443537 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f06c815bcd0 0x7f06c81561c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:18.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.826+0000 7f06cf7aa640 1 --2- 172.21.15.45:0/46443537 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f06c806ca10 0x7f06c8140ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:18.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.826+0000 7f06cf7aa640 1 -- 172.21.15.45:0/46443537 >> 172.21.15.45:0/46443537 conn(0x7f06c806a570 msgr2=0x7f06c81450d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:18.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.826+0000 7f06cf7aa640 1 -- 172.21.15.45:0/46443537 shutdown_connections 2023-11-28T18:38:18.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.826+0000 7f06cf7aa640 1 -- 172.21.15.45:0/46443537 wait complete. 2023-11-28T18:38:18.846 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T18:37:21.293917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T18:37:31.384760+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T18:37:31.834769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T18:38:18.847 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T18:38:18.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.990+0000 7f2afa617640 1 Processor -- start 2023-11-28T18:38:18.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.990+0000 7f2afa617640 1 -- start start 2023-11-28T18:38:18.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.990+0000 7f2afa617640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2af4071dd0 0x7f2af40721b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:18.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.990+0000 7f2afa617640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2af413f630 0x7f2af40ce240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:18.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.990+0000 7f2afa617640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2af413d2f0 con 0x7f2af415adf0 2023-11-28T18:38:18.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.990+0000 7f2afa617640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2af4140560 con 0x7f2af4071dd0 2023-11-28T18:38:18.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.990+0000 7f2afa617640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2af40cd830 con 0x7f2af413f630 2023-11-28T18:38:18.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.990+0000 7f2af3fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2af4071dd0 0x7f2af40721b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:18.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.990+0000 7f2af3fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2af4071dd0 0x7f2af40721b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56176/0 (socket says 172.21.15.45:56176) 2023-11-28T18:38:18.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.990+0000 7f2af3fff640 1 -- 172.21.15.45:0/1253062313 learned_addr learned my addr 172.21.15.45:0/1253062313 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:18.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.994+0000 7f2af3fff640 1 -- 172.21.15.45:0/1253062313 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2af413f630 msgr2=0x7f2af40ce240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:18.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.994+0000 7f2af8bb4640 1 --2- 172.21.15.45:0/1253062313 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2af413f630 0x7f2af40ce240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:18.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.994+0000 7f2af3fff640 1 --2- 172.21.15.45:0/1253062313 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2af413f630 0x7f2af40ce240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:18.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.994+0000 7f2af3fff640 1 -- 172.21.15.45:0/1253062313 >> v1:172.21.15.190:6789/0 conn(0x7f2af415adf0 legacy=0x7f2af413d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:18.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.994+0000 7f2af3fff640 1 -- 172.21.15.45:0/1253062313 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2af40cddb0 con 0x7f2af4071dd0 2023-11-28T18:38:18.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.994+0000 7f2af8bb4640 1 --2- 172.21.15.45:0/1253062313 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2af413f630 0x7f2af40ce240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:38:18.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.994+0000 7f2af3fff640 1 --2- 172.21.15.45:0/1253062313 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2af4071dd0 0x7f2af40721b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2ae4009870 tx=0x7f2ae401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3574bbe32fe47465 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:18.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.994+0000 7f2af2ffd640 1 -- 172.21.15.45:0/1253062313 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae40aa620 con 0x7f2af4071dd0 2023-11-28T18:38:18.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.994+0000 7f2af2ffd640 1 -- 172.21.15.45:0/1253062313 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ae40aa780 con 0x7f2af4071dd0 2023-11-28T18:38:18.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.994+0000 7f2af2ffd640 1 -- 172.21.15.45:0/1253062313 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae40aab10 con 0x7f2af4071dd0 2023-11-28T18:38:18.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.994+0000 7f2afa617640 1 -- 172.21.15.45:0/1253062313 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2af4071dd0 msgr2=0x7f2af40721b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:18.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.994+0000 7f2afa617640 1 --2- 172.21.15.45:0/1253062313 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2af4071dd0 0x7f2af40721b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2ae4009870 tx=0x7f2ae401c500 comp rx=0 tx=0).stop 2023-11-28T18:38:18.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.994+0000 7f2afa617640 1 -- 172.21.15.45:0/1253062313 shutdown_connections 2023-11-28T18:38:18.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.998+0000 7f2afa617640 1 --2- 172.21.15.45:0/1253062313 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2af413f630 0x7f2af40ce240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:18.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.998+0000 7f2afa617640 1 --2- 172.21.15.45:0/1253062313 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2af4071dd0 0x7f2af40721b0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:18.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.998+0000 7f2afa617640 1 -- 172.21.15.45:0/1253062313 >> 172.21.15.45:0/1253062313 conn(0x7f2af40b0d00 msgr2=0x7f2af40b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:18.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.998+0000 7f2afa617640 1 -- 172.21.15.45:0/1253062313 shutdown_connections 2023-11-28T18:38:18.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.998+0000 7f2afa617640 1 -- 172.21.15.45:0/1253062313 wait complete. 2023-11-28T18:38:19.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.998+0000 7f2afa617640 1 Processor -- start 2023-11-28T18:38:19.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.998+0000 7f2afa617640 1 -- start start 2023-11-28T18:38:19.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.998+0000 7f2afa617640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2af4071dd0 0x7f2af4137770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:19.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.998+0000 7f2afa617640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2af413f630 0x7f2af4137cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:19.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.998+0000 7f2afa617640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2af415adf0 0x7f2af4133d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:19.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.998+0000 7f2afa617640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2af40ad240 con 0x7f2af4071dd0 2023-11-28T18:38:19.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.998+0000 7f2afa617640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2af40ad9f0 con 0x7f2af415adf0 2023-11-28T18:38:19.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.998+0000 7f2afa617640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2af40ad430 con 0x7f2af413f630 2023-11-28T18:38:19.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.998+0000 7f2af3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2af4071dd0 0x7f2af4137770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:19.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.998+0000 7f2af3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2af4071dd0 0x7f2af4137770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56192/0 (socket says 172.21.15.45:56192) 2023-11-28T18:38:19.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.998+0000 7f2af3fff640 1 -- 172.21.15.45:0/4223653582 learned_addr learned my addr 172.21.15.45:0/4223653582 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:19.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.998+0000 7f2af37fe640 1 --2- 172.21.15.45:0/4223653582 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2af413f630 0x7f2af4137cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:19.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.998+0000 7f2af8bb4640 1 --2- 172.21.15.45:0/4223653582 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2af415adf0 0x7f2af4133d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:19.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.998+0000 7f2af3fff640 1 -- 172.21.15.45:0/4223653582 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2af413f630 msgr2=0x7f2af4137cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:19.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.998+0000 7f2af3fff640 1 --2- 172.21.15.45:0/4223653582 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2af413f630 0x7f2af4137cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:19.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.998+0000 7f2af3fff640 1 -- 172.21.15.45:0/4223653582 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2af415adf0 msgr2=0x7f2af4133d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:19.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.998+0000 7f2af3fff640 1 --2- 172.21.15.45:0/4223653582 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2af415adf0 0x7f2af4133d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:19.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.998+0000 7f2af3fff640 1 -- 172.21.15.45:0/4223653582 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ae40094d0 con 0x7f2af4071dd0 2023-11-28T18:38:19.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:18.998+0000 7f2af3fff640 1 --2- 172.21.15.45:0/4223653582 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2af4071dd0 0x7f2af4137770 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f2ae40ac040 tx=0x7f2ae401ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:19.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.002+0000 7f2af0ff9640 1 -- 172.21.15.45:0/4223653582 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae40b3800 con 0x7f2af4071dd0 2023-11-28T18:38:19.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.002+0000 7f2af0ff9640 1 -- 172.21.15.45:0/4223653582 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ae40b3980 con 0x7f2af4071dd0 2023-11-28T18:38:19.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.002+0000 7f2afa617640 1 -- 172.21.15.45:0/4223653582 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2af40ad710 con 0x7f2af4071dd0 2023-11-28T18:38:19.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.002+0000 7f2af0ff9640 1 -- 172.21.15.45:0/4223653582 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae40b3d30 con 0x7f2af4071dd0 2023-11-28T18:38:19.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.002+0000 7f2afa617640 1 -- 172.21.15.45:0/4223653582 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2af40adef0 con 0x7f2af4071dd0 2023-11-28T18:38:19.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.002+0000 7f2afa617640 1 -- 172.21.15.45:0/4223653582 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2af415b250 con 0x7f2af4071dd0 2023-11-28T18:38:19.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.002+0000 7f2af0ff9640 1 -- 172.21.15.45:0/4223653582 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f2ae40b2380 con 0x7f2af4071dd0 2023-11-28T18:38:19.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.002+0000 7f2af0ff9640 1 --2- 172.21.15.45:0/4223653582 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f2ae00668d0 0x7f2ae0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:19.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.002+0000 7f2af0ff9640 1 -- 172.21.15.45:0/4223653582 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5804+0+0 (secure 0 0 0) 0x7f2ae411eb60 con 0x7f2af4071dd0 2023-11-28T18:38:19.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.006+0000 7f2af37fe640 1 --2- 172.21.15.45:0/4223653582 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f2ae00668d0 0x7f2ae0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:19.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.006+0000 7f2af37fe640 1 --2- 172.21.15.45:0/4223653582 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f2ae00668d0 0x7f2ae0068d90 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2af4159a60 tx=0x7f2ae8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:19.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.006+0000 7f2af0ff9640 1 -- 172.21.15.45:0/4223653582 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2af415b250 con 0x7f2af4071dd0 2023-11-28T18:38:19.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.166+0000 7f2afa617640 1 -- 172.21.15.45:0/4223653582 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2af415b250 con 0x7f2af4071dd0 2023-11-28T18:38:19.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.166+0000 7f2af0ff9640 1 -- 172.21.15.45:0/4223653582 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2af415b250 con 0x7f2af4071dd0 2023-11-28T18:38:19.169 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-11-28T18:38:19.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.170+0000 7f2afa617640 1 -- 172.21.15.45:0/4223653582 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f2ae00668d0 msgr2=0x7f2ae0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:19.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.170+0000 7f2afa617640 1 --2- 172.21.15.45:0/4223653582 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f2ae00668d0 0x7f2ae0068d90 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2af4159a60 tx=0x7f2ae8008040 comp rx=0 tx=0).stop 2023-11-28T18:38:19.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.170+0000 7f2afa617640 1 -- 172.21.15.45:0/4223653582 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2af4071dd0 msgr2=0x7f2af4137770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:19.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.170+0000 7f2afa617640 1 --2- 172.21.15.45:0/4223653582 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2af4071dd0 0x7f2af4137770 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f2ae40ac040 tx=0x7f2ae401ad40 comp rx=0 tx=0).stop 2023-11-28T18:38:19.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.170+0000 7f2afa617640 1 -- 172.21.15.45:0/4223653582 shutdown_connections 2023-11-28T18:38:19.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.170+0000 7f2afa617640 1 --2- 172.21.15.45:0/4223653582 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f2ae00668d0 0x7f2ae0068d90 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:19.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.170+0000 7f2afa617640 1 --2- 172.21.15.45:0/4223653582 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2af415adf0 0x7f2af4133d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:19.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.170+0000 7f2afa617640 1 --2- 172.21.15.45:0/4223653582 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2af413f630 0x7f2af4137cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:19.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.170+0000 7f2afa617640 1 --2- 172.21.15.45:0/4223653582 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2af4071dd0 0x7f2af4137770 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:19.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.170+0000 7f2afa617640 1 -- 172.21.15.45:0/4223653582 >> 172.21.15.45:0/4223653582 conn(0x7f2af40b0d00 msgr2=0x7f2af40afee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:19.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.170+0000 7f2afa617640 1 -- 172.21.15.45:0/4223653582 shutdown_connections 2023-11-28T18:38:19.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.170+0000 7f2afa617640 1 -- 172.21.15.45:0/4223653582 wait complete. 2023-11-28T18:38:19.191 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T18:38:19.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.334+0000 7fcb60e6b640 1 Processor -- start 2023-11-28T18:38:19.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.334+0000 7fcb60e6b640 1 -- start start 2023-11-28T18:38:19.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.338+0000 7fcb60e6b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcb5c158ce0 0x7fcb5c15eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:19.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.338+0000 7fcb60e6b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcb5c0cba50 0x7fcb5c15be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:19.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.338+0000 7fcb60e6b640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb5c15b6b0 con 0x7fcb5c0b4310 2023-11-28T18:38:19.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.338+0000 7fcb60e6b640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb5c15f450 con 0x7fcb5c158ce0 2023-11-28T18:38:19.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.338+0000 7fcb60e6b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5c15f730 con 0x7fcb5c0cba50 2023-11-28T18:38:19.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.338+0000 7fcb5a59c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcb5c158ce0 0x7fcb5c15eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:19.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.338+0000 7fcb5a59c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcb5c158ce0 0x7fcb5c15eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56196/0 (socket says 172.21.15.45:56196) 2023-11-28T18:38:19.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.338+0000 7fcb5a59c640 1 -- 172.21.15.45:0/3319271122 learned_addr learned my addr 172.21.15.45:0/3319271122 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:19.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.338+0000 7fcb53fff640 1 --2- 172.21.15.45:0/3319271122 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcb5c0cba50 0x7fcb5c15be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:19.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.338+0000 7fcb5a59c640 1 -- 172.21.15.45:0/3319271122 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcb5c0cba50 msgr2=0x7fcb5c15be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:19.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.338+0000 7fcb5a59c640 1 --2- 172.21.15.45:0/3319271122 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcb5c0cba50 0x7fcb5c15be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:19.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.338+0000 7fcb5a59c640 1 -- 172.21.15.45:0/3319271122 >> v1:172.21.15.190:6789/0 conn(0x7fcb5c0b4310 legacy=0x7fcb5c070430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:19.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.338+0000 7fcb5a59c640 1 -- 172.21.15.45:0/3319271122 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb5c15b920 con 0x7fcb5c158ce0 2023-11-28T18:38:19.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.342+0000 7fcb5a59c640 1 --2- 172.21.15.45:0/3319271122 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb5c158ce0 0x7fcb5c15eb90 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c009870 tx=0x7fcb4c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2e30c4ac4ee614e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:19.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.342+0000 7fcb59d9b640 1 -- 172.21.15.45:0/3319271122 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4c0aa640 con 0x7fcb5c158ce0 2023-11-28T18:38:19.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.342+0000 7fcb59d9b640 1 -- 172.21.15.45:0/3319271122 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb4c0aa7a0 con 0x7fcb5c158ce0 2023-11-28T18:38:19.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.342+0000 7fcb59d9b640 1 -- 172.21.15.45:0/3319271122 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4c0aab30 con 0x7fcb5c158ce0 2023-11-28T18:38:19.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.342+0000 7fcb60e6b640 1 -- 172.21.15.45:0/3319271122 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb5c158ce0 msgr2=0x7fcb5c15eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:19.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.342+0000 7fcb60e6b640 1 --2- 172.21.15.45:0/3319271122 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb5c158ce0 0x7fcb5c15eb90 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c009870 tx=0x7fcb4c01c500 comp rx=0 tx=0).stop 2023-11-28T18:38:19.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.342+0000 7fcb60e6b640 1 -- 172.21.15.45:0/3319271122 shutdown_connections 2023-11-28T18:38:19.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.342+0000 7fcb60e6b640 1 --2- 172.21.15.45:0/3319271122 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcb5c0cba50 0x7fcb5c15be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:19.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.342+0000 7fcb60e6b640 1 --2- 172.21.15.45:0/3319271122 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb5c158ce0 0x7fcb5c15eb90 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:19.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.342+0000 7fcb60e6b640 1 -- 172.21.15.45:0/3319271122 >> 172.21.15.45:0/3319271122 conn(0x7fcb5c0b0d00 msgr2=0x7fcb5c0b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:19.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.342+0000 7fcb60e6b640 1 -- 172.21.15.45:0/3319271122 shutdown_connections 2023-11-28T18:38:19.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.342+0000 7fcb60e6b640 1 -- 172.21.15.45:0/3319271122 wait complete. 2023-11-28T18:38:19.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.342+0000 7fcb60e6b640 1 Processor -- start 2023-11-28T18:38:19.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.342+0000 7fcb60e6b640 1 -- start start 2023-11-28T18:38:19.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.346+0000 7fcb60e6b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcb5c0b4310 0x7fcb5c151510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:19.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.346+0000 7fcb60e6b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb5c0cba50 0x7fcb5c15d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:19.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.346+0000 7fcb60e6b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcb5c158ce0 0x7fcb5c149c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:19.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.346+0000 7fcb60e6b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5c1510f0 con 0x7fcb5c0cba50 2023-11-28T18:38:19.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.346+0000 7fcb60e6b640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5c15cd70 con 0x7fcb5c158ce0 2023-11-28T18:38:19.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.346+0000 7fcb60e6b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5c15c7b0 con 0x7fcb5c0b4310 2023-11-28T18:38:19.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.346+0000 7fcb53fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb5c0cba50 0x7fcb5c15d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:19.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.346+0000 7fcb53fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb5c0cba50 0x7fcb5c15d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56202/0 (socket says 172.21.15.45:56202) 2023-11-28T18:38:19.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.346+0000 7fcb53fff640 1 -- 172.21.15.45:0/2748394454 learned_addr learned my addr 172.21.15.45:0/2748394454 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:19.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.346+0000 7fcb5a59c640 1 --2- 172.21.15.45:0/2748394454 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcb5c0b4310 0x7fcb5c151510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:19.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.346+0000 7fcb5ad9d640 1 --2- 172.21.15.45:0/2748394454 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcb5c158ce0 0x7fcb5c149c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:19.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.346+0000 7fcb53fff640 1 -- 172.21.15.45:0/2748394454 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcb5c0b4310 msgr2=0x7fcb5c151510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:19.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.346+0000 7fcb53fff640 1 --2- 172.21.15.45:0/2748394454 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcb5c0b4310 0x7fcb5c151510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:19.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.346+0000 7fcb53fff640 1 -- 172.21.15.45:0/2748394454 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcb5c158ce0 msgr2=0x7fcb5c149c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:19.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.346+0000 7fcb53fff640 1 --2- 172.21.15.45:0/2748394454 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcb5c158ce0 0x7fcb5c149c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:19.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.346+0000 7fcb53fff640 1 -- 172.21.15.45:0/2748394454 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb4c0094d0 con 0x7fcb5c0cba50 2023-11-28T18:38:19.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.346+0000 7fcb5a59c640 1 --2- 172.21.15.45:0/2748394454 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcb5c0b4310 0x7fcb5c151510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:38:19.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.346+0000 7fcb53fff640 1 --2- 172.21.15.45:0/2748394454 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb5c0cba50 0x7fcb5c15d310 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fcb4400d800 tx=0x7fcb4400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:19.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.346+0000 7fcb52ffd640 1 -- 172.21.15.45:0/2748394454 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4400b6c0 con 0x7fcb5c0cba50 2023-11-28T18:38:19.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.346+0000 7fcb52ffd640 1 -- 172.21.15.45:0/2748394454 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb4400b820 con 0x7fcb5c0cba50 2023-11-28T18:38:19.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.346+0000 7fcb52ffd640 1 -- 172.21.15.45:0/2748394454 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4400bbd0 con 0x7fcb5c0cba50 2023-11-28T18:38:19.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.346+0000 7fcb60e6b640 1 -- 172.21.15.45:0/2748394454 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb5c15ca90 con 0x7fcb5c0cba50 2023-11-28T18:38:19.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.346+0000 7fcb60e6b640 1 -- 172.21.15.45:0/2748394454 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb5c151a50 con 0x7fcb5c0cba50 2023-11-28T18:38:19.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.346+0000 7fcb60e6b640 1 -- 172.21.15.45:0/2748394454 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb5c151230 con 0x7fcb5c0cba50 2023-11-28T18:38:19.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.350+0000 7fcb52ffd640 1 -- 172.21.15.45:0/2748394454 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fcb4400bd30 con 0x7fcb5c0cba50 2023-11-28T18:38:19.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.350+0000 7fcb52ffd640 1 --2- 172.21.15.45:0/2748394454 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fcb3c0668d0 0x7fcb3c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:19.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.350+0000 7fcb52ffd640 1 -- 172.21.15.45:0/2748394454 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5804+0+0 (secure 0 0 0) 0x7fcb440849a0 con 0x7fcb5c0cba50 2023-11-28T18:38:19.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.350+0000 7fcb5a59c640 1 --2- 172.21.15.45:0/2748394454 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fcb3c0668d0 0x7fcb3c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:19.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.350+0000 7fcb5a59c640 1 --2- 172.21.15.45:0/2748394454 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fcb3c0668d0 0x7fcb3c068d90 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c0ae000 tx=0x7fcb4c0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:19.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.354+0000 7fcb52ffd640 1 -- 172.21.15.45:0/2748394454 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcb5c151230 con 0x7fcb5c0cba50 2023-11-28T18:38:19.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.510+0000 7fcb60e6b640 1 -- 172.21.15.45:0/2748394454 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcb5c151230 con 0x7fcb5c0cba50 2023-11-28T18:38:19.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.510+0000 7fcb52ffd640 1 -- 172.21.15.45:0/2748394454 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcb5c151230 con 0x7fcb5c0cba50 2023-11-28T18:38:19.513 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-11-28T18:38:19.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.514+0000 7fcb60e6b640 1 -- 172.21.15.45:0/2748394454 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fcb3c0668d0 msgr2=0x7fcb3c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:19.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.514+0000 7fcb60e6b640 1 --2- 172.21.15.45:0/2748394454 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fcb3c0668d0 0x7fcb3c068d90 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c0ae000 tx=0x7fcb4c0a7000 comp rx=0 tx=0).stop 2023-11-28T18:38:19.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.514+0000 7fcb60e6b640 1 -- 172.21.15.45:0/2748394454 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb5c0cba50 msgr2=0x7fcb5c15d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:19.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.514+0000 7fcb60e6b640 1 --2- 172.21.15.45:0/2748394454 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb5c0cba50 0x7fcb5c15d310 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fcb4400d800 tx=0x7fcb4400dcc0 comp rx=0 tx=0).stop 2023-11-28T18:38:19.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.514+0000 7fcb60e6b640 1 -- 172.21.15.45:0/2748394454 shutdown_connections 2023-11-28T18:38:19.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.514+0000 7fcb60e6b640 1 --2- 172.21.15.45:0/2748394454 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fcb3c0668d0 0x7fcb3c068d90 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:19.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.514+0000 7fcb60e6b640 1 --2- 172.21.15.45:0/2748394454 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcb5c158ce0 0x7fcb5c149c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:19.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.514+0000 7fcb60e6b640 1 --2- 172.21.15.45:0/2748394454 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb5c0cba50 0x7fcb5c15d310 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:19.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.514+0000 7fcb60e6b640 1 --2- 172.21.15.45:0/2748394454 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcb5c0b4310 0x7fcb5c151510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:19.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.514+0000 7fcb60e6b640 1 -- 172.21.15.45:0/2748394454 >> 172.21.15.45:0/2748394454 conn(0x7fcb5c0b0d00 msgr2=0x7fcb5c0734a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:19.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.514+0000 7fcb60e6b640 1 -- 172.21.15.45:0/2748394454 shutdown_connections 2023-11-28T18:38:19.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.514+0000 7fcb60e6b640 1 -- 172.21.15.45:0/2748394454 wait complete. 2023-11-28T18:38:19.534 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T18:38:19.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.678+0000 7f08ba879640 1 Processor -- start 2023-11-28T18:38:19.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.678+0000 7f08ba879640 1 -- start start 2023-11-28T18:38:19.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.678+0000 7f08ba879640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f08b4158ce0 0x7f08b415eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:19.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.678+0000 7f08ba879640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f08b40cba50 0x7f08b415be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:19.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.678+0000 7f08ba879640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08b415b6b0 con 0x7f08b40b4310 2023-11-28T18:38:19.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.678+0000 7f08ba879640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08b415f450 con 0x7f08b4158ce0 2023-11-28T18:38:19.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.678+0000 7f08ba879640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08b415f730 con 0x7f08b40cba50 2023-11-28T18:38:19.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.678+0000 7f08b3fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f08b4158ce0 0x7f08b415eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:19.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.678+0000 7f08b8e16640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f08b40b4310 0x7f08b4070430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59704/0 (socket says 172.21.15.45:59704) 2023-11-28T18:38:19.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.682+0000 7f08b8e16640 1 -- 172.21.15.45:0/2374385444 learned_addr learned my addr 172.21.15.45:0/2374385444 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:38:19.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.682+0000 7f08b37fe640 1 --2- 172.21.15.45:0/2374385444 >> v2:172.21.15.190:3300/0 conn(0x7f08b40cba50 0x7f08b415be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:19.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.682+0000 7f08b3fff640 1 -- 172.21.15.45:0/2374385444 >> v2:172.21.15.190:3300/0 conn(0x7f08b40cba50 msgr2=0x7f08b415be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:19.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.682+0000 7f08b3fff640 1 --2- 172.21.15.45:0/2374385444 >> v2:172.21.15.190:3300/0 conn(0x7f08b40cba50 0x7f08b415be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:19.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.682+0000 7f08b3fff640 1 -- 172.21.15.45:0/2374385444 >> v1:172.21.15.45:6789/0 conn(0x7f08b40b4310 legacy=0x7f08b4070430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:19.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.682+0000 7f08b3fff640 1 -- 172.21.15.45:0/2374385444 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b415b920 con 0x7f08b4158ce0 2023-11-28T18:38:19.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.682+0000 7f08b2ffd640 1 -- 172.21.15.45:0/2374385444 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1677425233 0 0) 0x7f08b415b6b0 con 0x7f08b40b4310 2023-11-28T18:38:19.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.682+0000 7f08b3fff640 1 --2- 172.21.15.45:0/2374385444 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08b4158ce0 0x7f08b415eb90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f08b40cef00 tx=0x7f08a401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=397d80dc5738d382 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:19.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.682+0000 7f08b2ffd640 1 -- 172.21.15.45:0/2374385444 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a40ab680 con 0x7f08b4158ce0 2023-11-28T18:38:19.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.682+0000 7f08b2ffd640 1 -- 172.21.15.45:0/2374385444 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08a40ab7e0 con 0x7f08b4158ce0 2023-11-28T18:38:19.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.682+0000 7f08b2ffd640 1 -- 172.21.15.45:0/2374385444 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a40abb70 con 0x7f08b4158ce0 2023-11-28T18:38:19.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.686+0000 7f08ba879640 1 -- 172.21.15.45:0/2374385444 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08b4158ce0 msgr2=0x7f08b415eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:19.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.686+0000 7f08ba879640 1 --2- 172.21.15.45:0/2374385444 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08b4158ce0 0x7f08b415eb90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f08b40cef00 tx=0x7f08a401c460 comp rx=0 tx=0).stop 2023-11-28T18:38:19.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.686+0000 7f08ba879640 1 -- 172.21.15.45:0/2374385444 shutdown_connections 2023-11-28T18:38:19.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.686+0000 7f08ba879640 1 --2- 172.21.15.45:0/2374385444 >> v2:172.21.15.190:3300/0 conn(0x7f08b40cba50 0x7f08b415be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:19.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.686+0000 7f08ba879640 1 --2- 172.21.15.45:0/2374385444 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08b4158ce0 0x7f08b415eb90 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:19.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.686+0000 7f08ba879640 1 -- 172.21.15.45:0/2374385444 >> 172.21.15.45:0/2374385444 conn(0x7f08b40b0d00 msgr2=0x7f08b40b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:19.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.686+0000 7f08ba879640 1 -- 172.21.15.45:0/2374385444 shutdown_connections 2023-11-28T18:38:19.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.686+0000 7f08ba879640 1 -- 172.21.15.45:0/2374385444 wait complete. 2023-11-28T18:38:19.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.686+0000 7f08ba879640 1 Processor -- start 2023-11-28T18:38:19.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.686+0000 7f08ba879640 1 -- start start 2023-11-28T18:38:19.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.686+0000 7f08ba879640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08b40b4310 0x7f08b415ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:19.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.686+0000 7f08ba879640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f08b40cba50 0x7f08b40aa8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:19.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.686+0000 7f08ba879640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f08b4158ce0 0x7f08b41538e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:19.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.686+0000 7f08ba879640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b415ef50 con 0x7f08b40b4310 2023-11-28T18:38:19.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.686+0000 7f08ba879640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b41563f0 con 0x7f08b40cba50 2023-11-28T18:38:19.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.686+0000 7f08ba879640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08b4155b20 con 0x7f08b4158ce0 2023-11-28T18:38:19.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.686+0000 7f08b3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08b40b4310 0x7f08b415ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:19.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.686+0000 7f08b3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08b40b4310 0x7f08b415ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56218/0 (socket says 172.21.15.45:56218) 2023-11-28T18:38:19.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.686+0000 7f08b3fff640 1 -- 172.21.15.45:0/4118028344 learned_addr learned my addr 172.21.15.45:0/4118028344 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:19.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.686+0000 7f08b37fe640 1 --2- 172.21.15.45:0/4118028344 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f08b40cba50 0x7f08b40aa8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:19.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.686+0000 7f08b8e16640 1 --2- 172.21.15.45:0/4118028344 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f08b4158ce0 0x7f08b41538e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:19.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.686+0000 7f08b3fff640 1 -- 172.21.15.45:0/4118028344 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f08b4158ce0 msgr2=0x7f08b41538e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:19.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.686+0000 7f08b3fff640 1 --2- 172.21.15.45:0/4118028344 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f08b4158ce0 0x7f08b41538e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:19.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.686+0000 7f08b3fff640 1 -- 172.21.15.45:0/4118028344 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f08b40cba50 msgr2=0x7f08b40aa8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:19.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.686+0000 7f08b3fff640 1 --2- 172.21.15.45:0/4118028344 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f08b40cba50 0x7f08b40aa8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:19.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.686+0000 7f08b3fff640 1 -- 172.21.15.45:0/4118028344 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08a4009420 con 0x7f08b40b4310 2023-11-28T18:38:19.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.690+0000 7f08b3fff640 1 --2- 172.21.15.45:0/4118028344 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08b40b4310 0x7f08b415ea10 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f08a401ab10 tx=0x7f08a401aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:19.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.690+0000 7f08b0ff9640 1 -- 172.21.15.45:0/4118028344 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a4004230 con 0x7f08b40b4310 2023-11-28T18:38:19.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.690+0000 7f08b0ff9640 1 -- 172.21.15.45:0/4118028344 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08a40b9070 con 0x7f08b40b4310 2023-11-28T18:38:19.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.690+0000 7f08b0ff9640 1 -- 172.21.15.45:0/4118028344 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a4003620 con 0x7f08b40b4310 2023-11-28T18:38:19.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.690+0000 7f08ba879640 1 -- 172.21.15.45:0/4118028344 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08b40aae00 con 0x7f08b40b4310 2023-11-28T18:38:19.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.690+0000 7f08ba879640 1 -- 172.21.15.45:0/4118028344 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08b4155da0 con 0x7f08b40b4310 2023-11-28T18:38:19.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.690+0000 7f08ba879640 1 -- 172.21.15.45:0/4118028344 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08b4069410 con 0x7f08b40b4310 2023-11-28T18:38:19.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.690+0000 7f08b0ff9640 1 -- 172.21.15.45:0/4118028344 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f08a4003780 con 0x7f08b40b4310 2023-11-28T18:38:19.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.690+0000 7f08b0ff9640 1 --2- 172.21.15.45:0/4118028344 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f08a0066900 0x7f08a0068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:19.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.690+0000 7f08b0ff9640 1 -- 172.21.15.45:0/4118028344 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5804+0+0 (secure 0 0 0) 0x7f08a40bb070 con 0x7f08b40b4310 2023-11-28T18:38:19.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.690+0000 7f08b37fe640 1 --2- 172.21.15.45:0/4118028344 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f08a0066900 0x7f08a0068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:19.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.694+0000 7f08b37fe640 1 --2- 172.21.15.45:0/4118028344 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f08a0066900 0x7f08a0068dc0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f08b4165980 tx=0x7f08a8009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:19.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.694+0000 7f08b0ff9640 1 -- 172.21.15.45:0/4118028344 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f08a40ebde0 con 0x7f08b40b4310 2023-11-28T18:38:19.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.850+0000 7f08ba879640 1 -- 172.21.15.45:0/4118028344 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f08b40b19d0 con 0x7f08b40b4310 2023-11-28T18:38:19.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.854+0000 7f08b0ff9640 1 -- 172.21.15.45:0/4118028344 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f08a40ef400 con 0x7f08b40b4310 2023-11-28T18:38:19.855 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-11-28T18:38:19.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.854+0000 7f08ba879640 1 -- 172.21.15.45:0/4118028344 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f08a0066900 msgr2=0x7f08a0068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:19.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.854+0000 7f08ba879640 1 --2- 172.21.15.45:0/4118028344 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f08a0066900 0x7f08a0068dc0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f08b4165980 tx=0x7f08a8009190 comp rx=0 tx=0).stop 2023-11-28T18:38:19.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.854+0000 7f08ba879640 1 -- 172.21.15.45:0/4118028344 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08b40b4310 msgr2=0x7f08b415ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:19.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.854+0000 7f08ba879640 1 --2- 172.21.15.45:0/4118028344 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08b40b4310 0x7f08b415ea10 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f08a401ab10 tx=0x7f08a401aca0 comp rx=0 tx=0).stop 2023-11-28T18:38:19.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.854+0000 7f08ba879640 1 -- 172.21.15.45:0/4118028344 shutdown_connections 2023-11-28T18:38:19.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.854+0000 7f08ba879640 1 --2- 172.21.15.45:0/4118028344 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f08a0066900 0x7f08a0068dc0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:19.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.854+0000 7f08ba879640 1 --2- 172.21.15.45:0/4118028344 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f08b4158ce0 0x7f08b41538e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:19.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.854+0000 7f08ba879640 1 --2- 172.21.15.45:0/4118028344 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f08b40cba50 0x7f08b40aa8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:19.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.854+0000 7f08ba879640 1 --2- 172.21.15.45:0/4118028344 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08b40b4310 0x7f08b415ea10 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:19.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.854+0000 7f08ba879640 1 -- 172.21.15.45:0/4118028344 >> 172.21.15.45:0/4118028344 conn(0x7f08b40b0d00 msgr2=0x7f08b40b0290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:19.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.854+0000 7f08ba879640 1 -- 172.21.15.45:0/4118028344 shutdown_connections 2023-11-28T18:38:19.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:19.854+0000 7f08ba879640 1 -- 172.21.15.45:0/4118028344 wait complete. 2023-11-28T18:38:19.876 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T18:38:20.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.018+0000 7f1680ec9640 1 Processor -- start 2023-11-28T18:38:20.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.018+0000 7f1680ec9640 1 -- start start 2023-11-28T18:38:20.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.022+0000 7f1680ec9640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f167c146c00 0x7f167c15e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:20.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.022+0000 7f1680ec9640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f167c0b32c0 0x7f167c06ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:20.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.022+0000 7f1680ec9640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f167c146fe0 con 0x7f167c06e8f0 2023-11-28T18:38:20.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.022+0000 7f1680ec9640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f167c15e970 con 0x7f167c146c00 2023-11-28T18:38:20.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.022+0000 7f1680ec9640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f167c06f390 con 0x7f167c0b32c0 2023-11-28T18:38:20.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.022+0000 7f167a59c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f167c146c00 0x7f167c15e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:20.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.022+0000 7f167ad9d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f167c0b32c0 0x7f167c06ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:20.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.022+0000 7f167a59c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f167c146c00 0x7f167c15e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.45:56540/0 (socket says 172.21.15.45:56540) 2023-11-28T18:38:20.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.022+0000 7f167a59c640 1 -- 172.21.15.45:0/4054829344 learned_addr learned my addr 172.21.15.45:0/4054829344 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:20.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.022+0000 7f167ad9d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f167c0b32c0 0x7f167c06ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.45:52404/0 (socket says 172.21.15.45:52404) 2023-11-28T18:38:20.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.022+0000 7f167a59c640 1 -- 172.21.15.45:0/4054829344 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f167c0b32c0 msgr2=0x7f167c06ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:20.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.022+0000 7f167a59c640 1 --2- 172.21.15.45:0/4054829344 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f167c0b32c0 0x7f167c06ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:20.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.022+0000 7f167a59c640 1 -- 172.21.15.45:0/4054829344 >> v1:172.21.15.190:6789/0 conn(0x7f167c06e8f0 legacy=0x7f167c0b2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:20.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.022+0000 7f167a59c640 1 -- 172.21.15.45:0/4054829344 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f167c06f670 con 0x7f167c146c00 2023-11-28T18:38:20.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.026+0000 7f167a59c640 1 --2- 172.21.15.45:0/4054829344 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f167c146c00 0x7f167c15e430 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f166c009870 tx=0x7f166c01c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91a21bdc0d200285 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:20.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.026+0000 7f1679d9b640 1 -- 172.21.15.45:0/4054829344 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f166c0aa670 con 0x7f167c146c00 2023-11-28T18:38:20.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.026+0000 7f1679d9b640 1 -- 172.21.15.45:0/4054829344 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f166c0aa7d0 con 0x7f167c146c00 2023-11-28T18:38:20.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.026+0000 7f1679d9b640 1 -- 172.21.15.45:0/4054829344 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f166c0aab60 con 0x7f167c146c00 2023-11-28T18:38:20.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.026+0000 7f1680ec9640 1 -- 172.21.15.45:0/4054829344 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f167c146c00 msgr2=0x7f167c15e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:20.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.026+0000 7f1680ec9640 1 --2- 172.21.15.45:0/4054829344 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f167c146c00 0x7f167c15e430 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f166c009870 tx=0x7f166c01c510 comp rx=0 tx=0).stop 2023-11-28T18:38:20.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.026+0000 7f1680ec9640 1 -- 172.21.15.45:0/4054829344 shutdown_connections 2023-11-28T18:38:20.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.026+0000 7f1680ec9640 1 --2- 172.21.15.45:0/4054829344 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f167c0b32c0 0x7f167c06ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:20.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.026+0000 7f1680ec9640 1 --2- 172.21.15.45:0/4054829344 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f167c146c00 0x7f167c15e430 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:20.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.026+0000 7f1680ec9640 1 -- 172.21.15.45:0/4054829344 >> 172.21.15.45:0/4054829344 conn(0x7f167c06a570 msgr2=0x7f167c06a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:20.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.026+0000 7f1680ec9640 1 -- 172.21.15.45:0/4054829344 shutdown_connections 2023-11-28T18:38:20.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.026+0000 7f1680ec9640 1 -- 172.21.15.45:0/4054829344 wait complete. 2023-11-28T18:38:20.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.026+0000 7f1680ec9640 1 Processor -- start 2023-11-28T18:38:20.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.026+0000 7f1680ec9640 1 -- start start 2023-11-28T18:38:20.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.030+0000 7f1680ec9640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f167c06e8f0 0x7f167c0b4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:20.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.030+0000 7f1680ec9640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f167c0b32c0 0x7f167c1f9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:20.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.030+0000 7f1680ec9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f167c146c00 0x7f167c1f9d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:20.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.030+0000 7f1680ec9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f167c0b5d10 con 0x7f167c146c00 2023-11-28T18:38:20.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.030+0000 7f1680ec9640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f167c0b5100 con 0x7f167c06e8f0 2023-11-28T18:38:20.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.030+0000 7f1680ec9640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f167c0b53e0 con 0x7f167c0b32c0 2023-11-28T18:38:20.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.030+0000 7f167ad9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f167c146c00 0x7f167c1f9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:20.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.030+0000 7f167ad9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f167c146c00 0x7f167c1f9d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56220/0 (socket says 172.21.15.45:56220) 2023-11-28T18:38:20.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.030+0000 7f167ad9d640 1 -- 172.21.15.45:0/1976197718 learned_addr learned my addr 172.21.15.45:0/1976197718 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:20.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.030+0000 7f167a59c640 1 --2- 172.21.15.45:0/1976197718 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f167c06e8f0 0x7f167c0b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:20.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.030+0000 7f1673fff640 1 --2- 172.21.15.45:0/1976197718 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f167c0b32c0 0x7f167c1f9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:20.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.030+0000 7f167ad9d640 1 -- 172.21.15.45:0/1976197718 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f167c0b32c0 msgr2=0x7f167c1f9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:20.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.030+0000 7f167ad9d640 1 --2- 172.21.15.45:0/1976197718 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f167c0b32c0 0x7f167c1f9800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:20.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.030+0000 7f167ad9d640 1 -- 172.21.15.45:0/1976197718 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f167c06e8f0 msgr2=0x7f167c0b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:20.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.030+0000 7f167ad9d640 1 --2- 172.21.15.45:0/1976197718 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f167c06e8f0 0x7f167c0b4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:20.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.030+0000 7f167ad9d640 1 -- 172.21.15.45:0/1976197718 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f166c0094d0 con 0x7f167c146c00 2023-11-28T18:38:20.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.030+0000 7f167ad9d640 1 --2- 172.21.15.45:0/1976197718 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f167c146c00 0x7f167c1f9d40 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f167400efc0 tx=0x7f167400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:20.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.030+0000 7f1672ffd640 1 -- 172.21.15.45:0/1976197718 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1674009ca0 con 0x7f167c146c00 2023-11-28T18:38:20.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.030+0000 7f1672ffd640 1 -- 172.21.15.45:0/1976197718 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f167400f040 con 0x7f167c146c00 2023-11-28T18:38:20.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.030+0000 7f1672ffd640 1 -- 172.21.15.45:0/1976197718 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16740146c0 con 0x7f167c146c00 2023-11-28T18:38:20.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.030+0000 7f1680ec9640 1 -- 172.21.15.45:0/1976197718 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f167c0b56c0 con 0x7f167c146c00 2023-11-28T18:38:20.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.030+0000 7f1680ec9640 1 -- 172.21.15.45:0/1976197718 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f167c1fa280 con 0x7f167c146c00 2023-11-28T18:38:20.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.030+0000 7f1680ec9640 1 -- 172.21.15.45:0/1976197718 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f167c0cad00 con 0x7f167c146c00 2023-11-28T18:38:20.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.034+0000 7f1672ffd640 1 -- 172.21.15.45:0/1976197718 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f1674014820 con 0x7f167c146c00 2023-11-28T18:38:20.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.034+0000 7f1672ffd640 1 --2- 172.21.15.45:0/1976197718 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f165c0668d0 0x7f165c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:20.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.034+0000 7f1672ffd640 1 -- 172.21.15.45:0/1976197718 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5804+0+0 (secure 0 0 0) 0x7f16740852c0 con 0x7f167c146c00 2023-11-28T18:38:20.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.034+0000 7f167a59c640 1 --2- 172.21.15.45:0/1976197718 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f165c0668d0 0x7f165c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:20.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.034+0000 7f167a59c640 1 --2- 172.21.15.45:0/1976197718 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f165c0668d0 0x7f165c068d90 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f166c0ae000 tx=0x7f166c0b5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:20.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.038+0000 7f1672ffd640 1 -- 172.21.15.45:0/1976197718 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1674052540 con 0x7f167c146c00 2023-11-28T18:38:20.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.206+0000 7f1680ec9640 1 -- 172.21.15.45:0/1976197718 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f167c069480 con 0x7f167c146c00 2023-11-28T18:38:20.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.206+0000 7f1672ffd640 1 -- 172.21.15.45:0/1976197718 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1674055b60 con 0x7f167c146c00 2023-11-28T18:38:20.211 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-11-28T18:38:20.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.210+0000 7f1680ec9640 1 -- 172.21.15.45:0/1976197718 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f165c0668d0 msgr2=0x7f165c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:20.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.210+0000 7f1680ec9640 1 --2- 172.21.15.45:0/1976197718 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f165c0668d0 0x7f165c068d90 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f166c0ae000 tx=0x7f166c0b5040 comp rx=0 tx=0).stop 2023-11-28T18:38:20.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.210+0000 7f1680ec9640 1 -- 172.21.15.45:0/1976197718 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f167c146c00 msgr2=0x7f167c1f9d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:20.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.210+0000 7f1680ec9640 1 --2- 172.21.15.45:0/1976197718 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f167c146c00 0x7f167c1f9d40 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f167400efc0 tx=0x7f167400c490 comp rx=0 tx=0).stop 2023-11-28T18:38:20.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.210+0000 7f1680ec9640 1 -- 172.21.15.45:0/1976197718 shutdown_connections 2023-11-28T18:38:20.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.210+0000 7f1680ec9640 1 --2- 172.21.15.45:0/1976197718 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f165c0668d0 0x7f165c068d90 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:20.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.210+0000 7f1680ec9640 1 --2- 172.21.15.45:0/1976197718 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f167c146c00 0x7f167c1f9d40 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:20.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.210+0000 7f1680ec9640 1 --2- 172.21.15.45:0/1976197718 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f167c0b32c0 0x7f167c1f9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:20.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.210+0000 7f1680ec9640 1 --2- 172.21.15.45:0/1976197718 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f167c06e8f0 0x7f167c0b4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:20.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.210+0000 7f1680ec9640 1 -- 172.21.15.45:0/1976197718 >> 172.21.15.45:0/1976197718 conn(0x7f167c06a570 msgr2=0x7f167c06be50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:20.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.210+0000 7f1680ec9640 1 -- 172.21.15.45:0/1976197718 shutdown_connections 2023-11-28T18:38:20.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.210+0000 7f1680ec9640 1 -- 172.21.15.45:0/1976197718 wait complete. 2023-11-28T18:38:20.232 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi190.front.sepia.ceph.com... 2023-11-28T18:38:20.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:38:20.232 DEBUG:teuthology.orchestra.run.smithi190:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2023-11-28T18:38:20.258 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T18:38:20.258 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi190.front.sepia.ceph.com 2023-11-28T18:38:20.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:38:20.258 DEBUG:teuthology.orchestra.run.smithi190:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-28T18:38:20.311 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-28T18:38:20.312 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T18:38:20.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.454+0000 7f3ad5617640 1 Processor -- start 2023-11-28T18:38:20.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.454+0000 7f3ad5617640 1 -- start start 2023-11-28T18:38:20.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.454+0000 7f3ad5617640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3ad00b51e0 0x7f3ad00b55f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:20.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.454+0000 7f3ad5617640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ad00d2fc0 con 0x7f3ad01608b0 2023-11-28T18:38:20.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.454+0000 7f3ad5617640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ad00d0db0 con 0x7f3ad00d2b50 2023-11-28T18:38:20.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.454+0000 7f3ad5617640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ad0160c90 con 0x7f3ad00b51e0 2023-11-28T18:38:20.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.454+0000 7f3acf7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3ad00b51e0 0x7f3ad00b55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:20.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.454+0000 7f3aceffd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f3ad01608b0 0x7f3ad00cdb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59712/0 (socket says 172.21.15.45:59712) 2023-11-28T18:38:20.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.454+0000 7f3aceffd640 1 -- 172.21.15.45:0/3918555450 learned_addr learned my addr 172.21.15.45:0/3918555450 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:38:20.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.454+0000 7f3acf7fe640 1 -- 172.21.15.45:0/3918555450 >> v1:172.21.15.190:6789/0 conn(0x7f3ad00d2b50 legacy=0x7f3ad00b6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:20.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.454+0000 7f3acf7fe640 1 -- 172.21.15.45:0/3918555450 >> v1:172.21.15.45:6789/0 conn(0x7f3ad01608b0 legacy=0x7f3ad00cdb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:20.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.454+0000 7f3acdffb640 1 -- 172.21.15.45:0/3918555450 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1800200099 0 0) 0x7f3ad00d2fc0 con 0x7f3ad01608b0 2023-11-28T18:38:20.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.454+0000 7f3acf7fe640 1 -- 172.21.15.45:0/3918555450 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ad00b6980 con 0x7f3ad00b51e0 2023-11-28T18:38:20.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.458+0000 7f3acf7fe640 1 --2- 172.21.15.45:0/3918555450 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ad00b51e0 0x7f3ad00b55f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f3ac8009d90 tx=0x7f3ac801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee0f2b4e938f7684 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:20.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.458+0000 7f3acdffb640 1 -- 172.21.15.45:0/3918555450 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac80a57d0 con 0x7f3ad00b51e0 2023-11-28T18:38:20.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.458+0000 7f3acdffb640 1 -- 172.21.15.45:0/3918555450 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ac80a5930 con 0x7f3ad00b51e0 2023-11-28T18:38:20.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.458+0000 7f3acdffb640 1 -- 172.21.15.45:0/3918555450 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac80a5cc0 con 0x7f3ad00b51e0 2023-11-28T18:38:20.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.458+0000 7f3ad5617640 1 -- 172.21.15.45:0/3918555450 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ad00b51e0 msgr2=0x7f3ad00b55f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:20.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.458+0000 7f3ad5617640 1 --2- 172.21.15.45:0/3918555450 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ad00b51e0 0x7f3ad00b55f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f3ac8009d90 tx=0x7f3ac801c910 comp rx=0 tx=0).stop 2023-11-28T18:38:20.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.458+0000 7f3ad5617640 1 -- 172.21.15.45:0/3918555450 shutdown_connections 2023-11-28T18:38:20.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.458+0000 7f3ad5617640 1 --2- 172.21.15.45:0/3918555450 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ad00b51e0 0x7f3ad00b55f0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:20.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.458+0000 7f3ad5617640 1 -- 172.21.15.45:0/3918555450 >> 172.21.15.45:0/3918555450 conn(0x7f3ad00720a0 msgr2=0x7f3ad00724b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:20.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.458+0000 7f3ad5617640 1 -- 172.21.15.45:0/3918555450 shutdown_connections 2023-11-28T18:38:20.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.458+0000 7f3ad5617640 1 -- 172.21.15.45:0/3918555450 wait complete. 2023-11-28T18:38:20.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.458+0000 7f3ad5617640 1 Processor -- start 2023-11-28T18:38:20.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.462+0000 7f3ad5617640 1 -- start start 2023-11-28T18:38:20.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.462+0000 7f3ad5617640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3ad00b51e0 0x7f3ad014d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:20.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.462+0000 7f3ad5617640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3ad00d2b50 0x7f3ad00c8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:20.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.462+0000 7f3ad5617640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ad01608b0 0x7f3ad00cac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:20.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.462+0000 7f3ad5617640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad00c93f0 con 0x7f3ad01608b0 2023-11-28T18:38:20.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.462+0000 7f3ad5617640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad00c80f0 con 0x7f3ad00d2b50 2023-11-28T18:38:20.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.462+0000 7f3ad5617640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad00c83d0 con 0x7f3ad00b51e0 2023-11-28T18:38:20.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.462+0000 7f3acf7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ad01608b0 0x7f3ad00cac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:20.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.462+0000 7f3acf7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ad01608b0 0x7f3ad00cac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56246/0 (socket says 172.21.15.45:56246) 2023-11-28T18:38:20.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.462+0000 7f3acf7fe640 1 -- 172.21.15.45:0/2296814184 learned_addr learned my addr 172.21.15.45:0/2296814184 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:20.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.462+0000 7f3aceffd640 1 --2- 172.21.15.45:0/2296814184 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3ad00b51e0 0x7f3ad014d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:20.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.462+0000 7f3ace7fc640 1 --2- 172.21.15.45:0/2296814184 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3ad00d2b50 0x7f3ad00c8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:20.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.462+0000 7f3acf7fe640 1 -- 172.21.15.45:0/2296814184 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3ad00b51e0 msgr2=0x7f3ad014d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:20.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.462+0000 7f3acf7fe640 1 --2- 172.21.15.45:0/2296814184 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3ad00b51e0 0x7f3ad014d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:20.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.462+0000 7f3acf7fe640 1 -- 172.21.15.45:0/2296814184 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3ad00d2b50 msgr2=0x7f3ad00c8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:20.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.462+0000 7f3acf7fe640 1 --2- 172.21.15.45:0/2296814184 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3ad00d2b50 0x7f3ad00c8eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:20.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.462+0000 7f3acf7fe640 1 -- 172.21.15.45:0/2296814184 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ac8009a70 con 0x7f3ad01608b0 2023-11-28T18:38:20.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.462+0000 7f3acf7fe640 1 --2- 172.21.15.45:0/2296814184 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ad01608b0 0x7f3ad00cac90 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3ac80b0040 tx=0x7f3ac80196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:20.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.462+0000 7f3ab77fe640 1 -- 172.21.15.45:0/2296814184 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac80ad850 con 0x7f3ad01608b0 2023-11-28T18:38:20.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.462+0000 7f3ab77fe640 1 -- 172.21.15.45:0/2296814184 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ac80ad9b0 con 0x7f3ad01608b0 2023-11-28T18:38:20.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.462+0000 7f3ab77fe640 1 -- 172.21.15.45:0/2296814184 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac80adda0 con 0x7f3ad01608b0 2023-11-28T18:38:20.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.462+0000 7f3ad5617640 1 -- 172.21.15.45:0/2296814184 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ad00c86b0 con 0x7f3ad01608b0 2023-11-28T18:38:20.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.462+0000 7f3ad5617640 1 -- 172.21.15.45:0/2296814184 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ad00c7da0 con 0x7f3ad01608b0 2023-11-28T18:38:20.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.462+0000 7f3ad5617640 1 -- 172.21.15.45:0/2296814184 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ad0069480 con 0x7f3ad01608b0 2023-11-28T18:38:20.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.466+0000 7f3ab77fe640 1 -- 172.21.15.45:0/2296814184 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f3ac80b4050 con 0x7f3ad01608b0 2023-11-28T18:38:20.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.466+0000 7f3ab77fe640 1 --2- 172.21.15.45:0/2296814184 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f3abc066900 0x7f3abc068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:20.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.466+0000 7f3ab77fe640 1 -- 172.21.15.45:0/2296814184 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5804+0+0 (secure 0 0 0) 0x7f3ac811ebf0 con 0x7f3ad01608b0 2023-11-28T18:38:20.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.466+0000 7f3aceffd640 1 --2- 172.21.15.45:0/2296814184 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f3abc066900 0x7f3abc068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:20.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.466+0000 7f3aceffd640 1 --2- 172.21.15.45:0/2296814184 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f3abc066900 0x7f3abc068dc0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3ac0000f70 tx=0x7f3ac0007df0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:20.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.470+0000 7f3ab77fe640 1 -- 172.21.15.45:0/2296814184 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3ac80ebde0 con 0x7f3ad01608b0 2023-11-28T18:38:20.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.658+0000 7f3ad5617640 1 -- 172.21.15.45:0/2296814184 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3ad00c8b60 con 0x7f3ad01608b0 2023-11-28T18:38:20.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.662+0000 7f3ab77fe640 1 -- 172.21.15.45:0/2296814184 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4910 (secure 0 0 0) 0x7f3ac80b2090 con 0x7f3ad01608b0 2023-11-28T18:38:20.663 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:38:20.663 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/972230763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":972230763},{"type":"v1","addr":"172.21.15.45:6835","nonce":972230763}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/4274475693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":4274475693},{"type":"v1","addr":"172.21.15.190:6837","nonce":4274475693}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/3154556740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":3154556740},{"type":"v1","addr":"172.21.15.190:6836","nonce":3154556740}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T18:37:32.842966+0000","modified":"2023-11-28T18:37:35.841966+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6834/1657221272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1657221272},{"type":"v1","addr":"172.21.15.45:6834","nonce":1657221272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T18:38:20.663 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 8 2023-11-28T18:38:20.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.662+0000 7f3ad5617640 1 -- 172.21.15.45:0/2296814184 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f3abc066900 msgr2=0x7f3abc068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:20.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.662+0000 7f3ad5617640 1 --2- 172.21.15.45:0/2296814184 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f3abc066900 0x7f3abc068dc0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3ac0000f70 tx=0x7f3ac0007df0 comp rx=0 tx=0).stop 2023-11-28T18:38:20.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.662+0000 7f3ad5617640 1 -- 172.21.15.45:0/2296814184 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ad01608b0 msgr2=0x7f3ad00cac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:20.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.662+0000 7f3ad5617640 1 --2- 172.21.15.45:0/2296814184 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ad01608b0 0x7f3ad00cac90 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3ac80b0040 tx=0x7f3ac80196b0 comp rx=0 tx=0).stop 2023-11-28T18:38:20.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.662+0000 7f3ad5617640 1 -- 172.21.15.45:0/2296814184 shutdown_connections 2023-11-28T18:38:20.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.662+0000 7f3ad5617640 1 --2- 172.21.15.45:0/2296814184 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f3abc066900 0x7f3abc068dc0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:20.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.662+0000 7f3ad5617640 1 --2- 172.21.15.45:0/2296814184 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ad01608b0 0x7f3ad00cac90 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:20.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.662+0000 7f3ad5617640 1 --2- 172.21.15.45:0/2296814184 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3ad00d2b50 0x7f3ad00c8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:20.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.662+0000 7f3ad5617640 1 --2- 172.21.15.45:0/2296814184 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3ad00b51e0 0x7f3ad014d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:20.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.662+0000 7f3ad5617640 1 -- 172.21.15.45:0/2296814184 >> 172.21.15.45:0/2296814184 conn(0x7f3ad00720a0 msgr2=0x7f3ad015f1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:20.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.662+0000 7f3ad5617640 1 -- 172.21.15.45:0/2296814184 shutdown_connections 2023-11-28T18:38:20.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.662+0000 7f3ad5617640 1 -- 172.21.15.45:0/2296814184 wait complete. 2023-11-28T18:38:20.684 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T18:38:20.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.826+0000 7fda8189a640 1 Processor -- start 2023-11-28T18:38:20.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.826+0000 7fda8189a640 1 -- start start 2023-11-28T18:38:20.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.826+0000 7fda8189a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda7c0d2b50 0x7fda7c0b6270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:20.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.826+0000 7fda8189a640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda7c0d0db0 con 0x7fda7c1608b0 2023-11-28T18:38:20.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.826+0000 7fda8189a640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda7c0d2f90 con 0x7fda7c0b51e0 2023-11-28T18:38:20.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.826+0000 7fda8189a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda7c160c90 con 0x7fda7c0d2b50 2023-11-28T18:38:20.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.826+0000 7fda7affd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fda7c1608b0 0x7fda7c0cdb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59728/0 (socket says 172.21.15.45:59728) 2023-11-28T18:38:20.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.826+0000 7fda7affd640 1 -- 172.21.15.45:0/2706481094 learned_addr learned my addr 172.21.15.45:0/2706481094 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:38:20.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.826+0000 7fda7a7fc640 1 -- 172.21.15.45:0/2706481094 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1158811739 0 0) 0x7fda7c0d0db0 con 0x7fda7c1608b0 2023-11-28T18:38:20.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.826+0000 7fda7a7fc640 1 -- 172.21.15.45:0/2706481094 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda68003530 con 0x7fda7c1608b0 2023-11-28T18:38:20.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.826+0000 7fda73fff640 1 --2- 172.21.15.45:0/2706481094 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda7c0d2b50 0x7fda7c0b6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:20.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.826+0000 7fda7a7fc640 1 -- 172.21.15.45:0/2706481094 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3282774693 0 0) 0x7fda68003530 con 0x7fda7c1608b0 2023-11-28T18:38:20.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.826+0000 7fda7a7fc640 1 -- 172.21.15.45:0/2706481094 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda7c0d2b50 msgr2=0x7fda7c0b6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:20.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.826+0000 7fda7a7fc640 1 --2- 172.21.15.45:0/2706481094 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda7c0d2b50 0x7fda7c0b6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:20.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.826+0000 7fda7a7fc640 1 -- 172.21.15.45:0/2706481094 >> v1:172.21.15.190:6789/0 conn(0x7fda7c0b51e0 legacy=0x7fda7c0d1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:20.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.826+0000 7fda7a7fc640 1 -- 172.21.15.45:0/2706481094 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda7c0ce320 con 0x7fda7c1608b0 2023-11-28T18:38:20.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.826+0000 7fda7a7fc640 1 -- 172.21.15.45:0/2706481094 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4084481567 0 0) 0x7fda6c001680 con 0x7fda7c1608b0 2023-11-28T18:38:20.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.826+0000 7fda7a7fc640 1 -- 172.21.15.45:0/2706481094 >> v1:172.21.15.45:6789/0 conn(0x7fda7c1608b0 legacy=0x7fda7c0cdb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:20.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.826+0000 7fda7a7fc640 1 --2- 172.21.15.45:0/2706481094 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda680039b0 0x7fda68003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:20.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.826+0000 7fda7a7fc640 1 --2- 172.21.15.45:0/2706481094 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda7c0d2b50 0x7fda680047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:20.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.826+0000 7fda7a7fc640 1 --2- 172.21.15.45:0/2706481094 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda68004d10 0x7fda68005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:20.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.826+0000 7fda7a7fc640 1 -- 172.21.15.45:0/2706481094 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda7c160c90 con 0x7fda68004d10 2023-11-28T18:38:20.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.826+0000 7fda7a7fc640 1 -- 172.21.15.45:0/2706481094 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda6800baa0 con 0x7fda680039b0 2023-11-28T18:38:20.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.826+0000 7fda7a7fc640 1 -- 172.21.15.45:0/2706481094 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda6800bc60 con 0x7fda7c0d2b50 2023-11-28T18:38:20.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.826+0000 7fda7b7fe640 1 --2- 172.21.15.45:0/2706481094 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda68004d10 0x7fda68005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:20.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.826+0000 7fda7affd640 1 --2- 172.21.15.45:0/2706481094 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda680039b0 0x7fda68003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:20.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.826+0000 7fda73fff640 1 --2- 172.21.15.45:0/2706481094 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda7c0d2b50 0x7fda680047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:20.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.830+0000 7fda7b7fe640 1 -- 172.21.15.45:0/2706481094 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda7c0d2b50 msgr2=0x7fda680047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:20.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.830+0000 7fda7b7fe640 1 --2- 172.21.15.45:0/2706481094 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda7c0d2b50 0x7fda680047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:20.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.830+0000 7fda7b7fe640 1 -- 172.21.15.45:0/2706481094 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda680039b0 msgr2=0x7fda68003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:20.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.830+0000 7fda7b7fe640 1 --2- 172.21.15.45:0/2706481094 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda680039b0 0x7fda68003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:20.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.830+0000 7fda7b7fe640 1 -- 172.21.15.45:0/2706481094 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda68003530 con 0x7fda68004d10 2023-11-28T18:38:20.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.830+0000 7fda7affd640 1 --2- 172.21.15.45:0/2706481094 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda680039b0 0x7fda68003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:38:20.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.830+0000 7fda73fff640 1 --2- 172.21.15.45:0/2706481094 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda7c0d2b50 0x7fda680047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:38:20.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.830+0000 7fda7b7fe640 1 --2- 172.21.15.45:0/2706481094 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda68004d10 0x7fda68005190 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fda74001e40 tx=0x7fda7401c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f6f25859655e3a3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:20.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.830+0000 7fda7a7fc640 1 -- 172.21.15.45:0/2706481094 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda74003b80 con 0x7fda68004d10 2023-11-28T18:38:20.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.830+0000 7fda7a7fc640 1 -- 172.21.15.45:0/2706481094 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda74003ce0 con 0x7fda68004d10 2023-11-28T18:38:20.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.830+0000 7fda7a7fc640 1 -- 172.21.15.45:0/2706481094 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda740052c0 con 0x7fda68004d10 2023-11-28T18:38:20.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.830+0000 7fda8189a640 1 -- 172.21.15.45:0/2706481094 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda68004d10 msgr2=0x7fda68005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:20.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.830+0000 7fda8189a640 1 --2- 172.21.15.45:0/2706481094 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda68004d10 0x7fda68005190 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fda74001e40 tx=0x7fda7401c740 comp rx=0 tx=0).stop 2023-11-28T18:38:20.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.830+0000 7fda7b7fe640 1 -- 172.21.15.45:0/2706481094 reap_dead start 2023-11-28T18:38:20.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.830+0000 7fda8189a640 1 -- 172.21.15.45:0/2706481094 shutdown_connections 2023-11-28T18:38:20.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.830+0000 7fda8189a640 1 -- 172.21.15.45:0/2706481094 >> 172.21.15.45:0/2706481094 conn(0x7fda7c0720a0 msgr2=0x7fda7c0724b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:20.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.830+0000 7fda8189a640 1 -- 172.21.15.45:0/2706481094 shutdown_connections 2023-11-28T18:38:20.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.830+0000 7fda8189a640 1 -- 172.21.15.45:0/2706481094 wait complete. 2023-11-28T18:38:20.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.834+0000 7fda8189a640 1 Processor -- start 2023-11-28T18:38:20.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.834+0000 7fda8189a640 1 -- start start 2023-11-28T18:38:20.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.834+0000 7fda8189a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda68004d10 0x7fda7c154fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:20.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.834+0000 7fda8189a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda7c155520 0x7fda7c15a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:20.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.834+0000 7fda8189a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda7c15a9c0 0x7fda7c159770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:20.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.834+0000 7fda8189a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda7c15ae40 con 0x7fda7c15a9c0 2023-11-28T18:38:20.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.834+0000 7fda8189a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda7c1583c0 con 0x7fda68004d10 2023-11-28T18:38:20.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.834+0000 7fda8189a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda7c158610 con 0x7fda7c155520 2023-11-28T18:38:20.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.834+0000 7fda7b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda7c15a9c0 0x7fda7c159770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:20.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.834+0000 7fda7b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda7c15a9c0 0x7fda7c159770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56268/0 (socket says 172.21.15.45:56268) 2023-11-28T18:38:20.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.834+0000 7fda7b7fe640 1 -- 172.21.15.45:0/1149817232 learned_addr learned my addr 172.21.15.45:0/1149817232 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:20.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.834+0000 7fda7affd640 1 --2- 172.21.15.45:0/1149817232 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda68004d10 0x7fda7c154fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:20.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.834+0000 7fda73fff640 1 --2- 172.21.15.45:0/1149817232 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda7c155520 0x7fda7c15a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:20.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.834+0000 7fda7b7fe640 1 -- 172.21.15.45:0/1149817232 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda7c155520 msgr2=0x7fda7c15a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:20.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.834+0000 7fda7b7fe640 1 --2- 172.21.15.45:0/1149817232 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda7c155520 0x7fda7c15a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:20.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.834+0000 7fda7b7fe640 1 -- 172.21.15.45:0/1149817232 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda68004d10 msgr2=0x7fda7c154fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:20.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.834+0000 7fda7b7fe640 1 --2- 172.21.15.45:0/1149817232 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda68004d10 0x7fda7c154fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:20.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.834+0000 7fda7b7fe640 1 -- 172.21.15.45:0/1149817232 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda7c1588f0 con 0x7fda7c15a9c0 2023-11-28T18:38:20.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.834+0000 7fda73fff640 1 --2- 172.21.15.45:0/1149817232 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda7c155520 0x7fda7c15a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:38:20.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.834+0000 7fda7affd640 1 --2- 172.21.15.45:0/1149817232 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda68004d10 0x7fda7c154fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:38:20.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.834+0000 7fda7b7fe640 1 --2- 172.21.15.45:0/1149817232 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda7c15a9c0 0x7fda7c159770 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fda7401c570 tx=0x7fda68005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:20.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.834+0000 7fda78ff9640 1 -- 172.21.15.45:0/1149817232 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda740012e0 con 0x7fda7c15a9c0 2023-11-28T18:38:20.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.838+0000 7fda78ff9640 1 -- 172.21.15.45:0/1149817232 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda74005030 con 0x7fda7c15a9c0 2023-11-28T18:38:20.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.838+0000 7fda78ff9640 1 -- 172.21.15.45:0/1149817232 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda740053e0 con 0x7fda7c15a9c0 2023-11-28T18:38:20.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.838+0000 7fda8189a640 1 -- 172.21.15.45:0/1149817232 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda7c158bd0 con 0x7fda7c15a9c0 2023-11-28T18:38:20.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.838+0000 7fda8189a640 1 -- 172.21.15.45:0/1149817232 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda7c159190 con 0x7fda7c15a9c0 2023-11-28T18:38:20.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.838+0000 7fda8189a640 1 -- 172.21.15.45:0/1149817232 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda7c069480 con 0x7fda7c15a9c0 2023-11-28T18:38:20.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.838+0000 7fda78ff9640 1 -- 172.21.15.45:0/1149817232 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fda74005540 con 0x7fda7c15a9c0 2023-11-28T18:38:20.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.838+0000 7fda78ff9640 1 --2- 172.21.15.45:0/1149817232 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fda5c0668d0 0x7fda5c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:20.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.838+0000 7fda78ff9640 1 -- 172.21.15.45:0/1149817232 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5804+0+0 (secure 0 0 0) 0x7fda7411d7a0 con 0x7fda7c15a9c0 2023-11-28T18:38:20.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.838+0000 7fda7affd640 1 --2- 172.21.15.45:0/1149817232 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fda5c0668d0 0x7fda5c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:20.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.842+0000 7fda7affd640 1 --2- 172.21.15.45:0/1149817232 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fda5c0668d0 0x7fda5c068d90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fda6c000c10 tx=0x7fda6c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:20.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:20.842+0000 7fda78ff9640 1 -- 172.21.15.45:0/1149817232 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fda740ea860 con 0x7fda7c15a9c0 2023-11-28T18:38:21.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.002+0000 7fda8189a640 1 -- 172.21.15.45:0/1149817232 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fda7c0d03b0 con 0x7fda7c15a9c0 2023-11-28T18:38:21.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.002+0000 7fda78ff9640 1 -- 172.21.15.45:0/1149817232 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16689 (secure 0 0 0) 0x7fda740ba090 con 0x7fda7c15a9c0 2023-11-28T18:38:21.006 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:38:21.006 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":22,"fsid":"d10f5cd6-1d00-4019-99b6-6fa435498a15","created":"2023-11-28T18:37:08.189030+0000","modified":"2023-11-28T18:38:15.148068+0000","last_up_change":"2023-11-28T18:37:20.196124+0000","last_in_change":"2023-11-28T18:37:10.742043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T18:37:21.293917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T18:37:31.384760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T18:37:31.834769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"84465384-103c-4f2c-a45a-96f5bb9c835f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6809","nonce":555237322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6811","nonce":555237322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6815","nonce":555237322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6813","nonce":555237322}]},"public_addr":"172.21.15.45:6809/555237322","cluster_addr":"172.21.15.45:6811/555237322","heartbeat_back_addr":"172.21.15.45:6815/555237322","heartbeat_front_addr":"172.21.15.45:6813/555237322","state":["exists","up"]},{"osd":1,"uuid":"7d9eed24-a58f-42c7-a787-ac06be8553fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6801","nonce":2857063763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6803","nonce":2857063763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6807","nonce":2857063763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6805","nonce":2857063763}]},"public_addr":"172.21.15.45:6801/2857063763","cluster_addr":"172.21.15.45:6803/2857063763","heartbeat_back_addr":"172.21.15.45:6807/2857063763","heartbeat_front_addr":"172.21.15.45:6805/2857063763","state":["exists","up"]},{"osd":2,"uuid":"575eeccc-4abf-45b4-9caf-f3e797859588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6817","nonce":193884539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6819","nonce":193884539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6823","nonce":193884539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6821","nonce":193884539}]},"public_addr":"172.21.15.45:6817/193884539","cluster_addr":"172.21.15.45:6819/193884539","heartbeat_back_addr":"172.21.15.45:6823/193884539","heartbeat_front_addr":"172.21.15.45:6821/193884539","state":["exists","up"]},{"osd":3,"uuid":"9b0290d6-9a52-4bc8-b2a1-7622c5dc8e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6825","nonce":78541084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6827","nonce":78541084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6831","nonce":78541084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6829","nonce":78541084}]},"public_addr":"172.21.15.45:6825/78541084","cluster_addr":"172.21.15.45:6827/78541084","heartbeat_back_addr":"172.21.15.45:6831/78541084","heartbeat_front_addr":"172.21.15.45:6829/78541084","state":["exists","up"]},{"osd":4,"uuid":"ce632829-f027-4fbf-a627-02c571aa9d53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6809","nonce":1537591987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6811","nonce":1537591987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6815","nonce":1537591987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6813","nonce":1537591987}]},"public_addr":"172.21.15.190:6809/1537591987","cluster_addr":"172.21.15.190:6811/1537591987","heartbeat_back_addr":"172.21.15.190:6815/1537591987","heartbeat_front_addr":"172.21.15.190:6813/1537591987","state":["exists","up"]},{"osd":5,"uuid":"8700b609-27be-40bd-a251-4c0ae0a29ead","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6801","nonce":3296698407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6803","nonce":3296698407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6807","nonce":3296698407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6805","nonce":3296698407}]},"public_addr":"172.21.15.190:6801/3296698407","cluster_addr":"172.21.15.190:6803/3296698407","heartbeat_back_addr":"172.21.15.190:6807/3296698407","heartbeat_front_addr":"172.21.15.190:6805/3296698407","state":["exists","up"]},{"osd":6,"uuid":"44ce4a40-e6ff-4f4d-8e8a-7341e5c91f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6817","nonce":2317686718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6819","nonce":2317686718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6823","nonce":2317686718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6821","nonce":2317686718}]},"public_addr":"172.21.15.190:6817/2317686718","cluster_addr":"172.21.15.190:6819/2317686718","heartbeat_back_addr":"172.21.15.190:6823/2317686718","heartbeat_front_addr":"172.21.15.190:6821/2317686718","state":["exists","up"]},{"osd":7,"uuid":"192238c9-1423-4b7e-ac8f-84ba32113ddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6825","nonce":2493232051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6827","nonce":2493232051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6831","nonce":2493232051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6829","nonce":2493232051}]},"public_addr":"172.21.15.190:6825/2493232051","cluster_addr":"172.21.15.190:6827/2493232051","heartbeat_back_addr":"172.21.15.190:6831/2493232051","heartbeat_front_addr":"172.21.15.190:6829/2493232051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.393552+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.385453+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.361421+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.366408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.363226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.276007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.414605+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.445885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2},{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T18:38:21.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.006+0000 7fda8189a640 1 -- 172.21.15.45:0/1149817232 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fda5c0668d0 msgr2=0x7fda5c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:21.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.006+0000 7fda8189a640 1 --2- 172.21.15.45:0/1149817232 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fda5c0668d0 0x7fda5c068d90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fda6c000c10 tx=0x7fda6c009040 comp rx=0 tx=0).stop 2023-11-28T18:38:21.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.006+0000 7fda8189a640 1 -- 172.21.15.45:0/1149817232 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda7c15a9c0 msgr2=0x7fda7c159770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:21.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.006+0000 7fda8189a640 1 --2- 172.21.15.45:0/1149817232 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda7c15a9c0 0x7fda7c159770 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fda7401c570 tx=0x7fda68005800 comp rx=0 tx=0).stop 2023-11-28T18:38:21.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.006+0000 7fda8189a640 1 -- 172.21.15.45:0/1149817232 shutdown_connections 2023-11-28T18:38:21.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.006+0000 7fda8189a640 1 --2- 172.21.15.45:0/1149817232 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fda5c0668d0 0x7fda5c068d90 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:21.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.006+0000 7fda8189a640 1 --2- 172.21.15.45:0/1149817232 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda7c15a9c0 0x7fda7c159770 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:21.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.006+0000 7fda8189a640 1 --2- 172.21.15.45:0/1149817232 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda7c155520 0x7fda7c15a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:21.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.006+0000 7fda8189a640 1 --2- 172.21.15.45:0/1149817232 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda68004d10 0x7fda7c154fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:21.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.006+0000 7fda8189a640 1 -- 172.21.15.45:0/1149817232 >> 172.21.15.45:0/1149817232 conn(0x7fda7c0720a0 msgr2=0x7fda7c0c8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:21.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.006+0000 7fda8189a640 1 -- 172.21.15.45:0/1149817232 shutdown_connections 2023-11-28T18:38:21.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.006+0000 7fda8189a640 1 -- 172.21.15.45:0/1149817232 wait complete. 2023-11-28T18:38:21.027 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T18:37:21.293917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T18:37:31.384760+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T18:37:31.834769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T18:38:21.028 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T18:38:21.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.170+0000 7fcbfdf2a640 1 Processor -- start 2023-11-28T18:38:21.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.170+0000 7fcbfdf2a640 1 -- start start 2023-11-28T18:38:21.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.174+0000 7fcbfdf2a640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fcbf8071dd0 0x7fcbf80721b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:21.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.174+0000 7fcbfdf2a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcbf813f630 0x7fcbf80ce240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:21.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.174+0000 7fcbfdf2a640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbf813d2f0 con 0x7fcbf815adf0 2023-11-28T18:38:21.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.174+0000 7fcbfdf2a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbf8140560 con 0x7fcbf813f630 2023-11-28T18:38:21.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.174+0000 7fcbfdf2a640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbf80cd830 con 0x7fcbf8071dd0 2023-11-28T18:38:21.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.174+0000 7fcbf7fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcbf813f630 0x7fcbf80ce240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:21.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.174+0000 7fcbf7fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcbf813f630 0x7fcbf80ce240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56274/0 (socket says 172.21.15.45:56274) 2023-11-28T18:38:21.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.174+0000 7fcbf7fff640 1 -- 172.21.15.45:0/598439702 learned_addr learned my addr 172.21.15.45:0/598439702 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:21.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.174+0000 7fcbf77fe640 1 --2- 172.21.15.45:0/598439702 >> v2:172.21.15.190:3300/0 conn(0x7fcbf8071dd0 0x7fcbf80721b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:21.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.174+0000 7fcbf7fff640 1 -- 172.21.15.45:0/598439702 >> v2:172.21.15.190:3300/0 conn(0x7fcbf8071dd0 msgr2=0x7fcbf80721b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:21.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.174+0000 7fcbf7fff640 1 --2- 172.21.15.45:0/598439702 >> v2:172.21.15.190:3300/0 conn(0x7fcbf8071dd0 0x7fcbf80721b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:21.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.174+0000 7fcbf7fff640 1 -- 172.21.15.45:0/598439702 >> v1:172.21.15.190:6789/0 conn(0x7fcbf815adf0 legacy=0x7fcbf813d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:21.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.174+0000 7fcbf7fff640 1 -- 172.21.15.45:0/598439702 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbf80cddb0 con 0x7fcbf813f630 2023-11-28T18:38:21.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.178+0000 7fcbf7fff640 1 --2- 172.21.15.45:0/598439702 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcbf813f630 0x7fcbf80ce240 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fcbf80b1dc0 tx=0x7fcbf001c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f82ec7992dad0f95 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:21.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.178+0000 7fcbf67fc640 1 -- 172.21.15.45:0/598439702 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf00a5890 con 0x7fcbf813f630 2023-11-28T18:38:21.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.178+0000 7fcbf67fc640 1 -- 172.21.15.45:0/598439702 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbf00a59f0 con 0x7fcbf813f630 2023-11-28T18:38:21.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.178+0000 7fcbf67fc640 1 -- 172.21.15.45:0/598439702 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf00a5d80 con 0x7fcbf813f630 2023-11-28T18:38:21.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.178+0000 7fcbfdf2a640 1 -- 172.21.15.45:0/598439702 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcbf813f630 msgr2=0x7fcbf80ce240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:21.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.178+0000 7fcbfdf2a640 1 --2- 172.21.15.45:0/598439702 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcbf813f630 0x7fcbf80ce240 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fcbf80b1dc0 tx=0x7fcbf001c9d0 comp rx=0 tx=0).stop 2023-11-28T18:38:21.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.178+0000 7fcbfdf2a640 1 -- 172.21.15.45:0/598439702 shutdown_connections 2023-11-28T18:38:21.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.178+0000 7fcbfdf2a640 1 --2- 172.21.15.45:0/598439702 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcbf813f630 0x7fcbf80ce240 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:21.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.178+0000 7fcbfdf2a640 1 --2- 172.21.15.45:0/598439702 >> v2:172.21.15.190:3300/0 conn(0x7fcbf8071dd0 0x7fcbf80721b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:21.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.178+0000 7fcbfdf2a640 1 -- 172.21.15.45:0/598439702 >> 172.21.15.45:0/598439702 conn(0x7fcbf80b0d00 msgr2=0x7fcbf80b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:21.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.178+0000 7fcbfdf2a640 1 -- 172.21.15.45:0/598439702 shutdown_connections 2023-11-28T18:38:21.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.178+0000 7fcbfdf2a640 1 -- 172.21.15.45:0/598439702 wait complete. 2023-11-28T18:38:21.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.178+0000 7fcbfdf2a640 1 Processor -- start 2023-11-28T18:38:21.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.178+0000 7fcbfdf2a640 1 -- start start 2023-11-28T18:38:21.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.182+0000 7fcbfdf2a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcbf8071dd0 0x7fcbf80a8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:21.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.182+0000 7fcbfdf2a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcbf813f630 0x7fcbf8150570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:21.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.182+0000 7fcbfdf2a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcbf815adf0 0x7fcbf81f6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:21.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.182+0000 7fcbfdf2a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf80a89b0 con 0x7fcbf815adf0 2023-11-28T18:38:21.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.182+0000 7fcbfdf2a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf8140c70 con 0x7fcbf813f630 2023-11-28T18:38:21.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.182+0000 7fcbfdf2a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf8140f50 con 0x7fcbf8071dd0 2023-11-28T18:38:21.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.182+0000 7fcbf7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcbf815adf0 0x7fcbf81f6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:21.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.182+0000 7fcbf7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcbf815adf0 0x7fcbf81f6940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56276/0 (socket says 172.21.15.45:56276) 2023-11-28T18:38:21.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.182+0000 7fcbf7fff640 1 -- 172.21.15.45:0/1095066000 learned_addr learned my addr 172.21.15.45:0/1095066000 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:21.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.182+0000 7fcbf77fe640 1 --2- 172.21.15.45:0/1095066000 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcbf8071dd0 0x7fcbf80a8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:21.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.182+0000 7fcbf6ffd640 1 --2- 172.21.15.45:0/1095066000 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcbf813f630 0x7fcbf8150570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:21.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.182+0000 7fcbf7fff640 1 -- 172.21.15.45:0/1095066000 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcbf8071dd0 msgr2=0x7fcbf80a8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:21.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.182+0000 7fcbf7fff640 1 --2- 172.21.15.45:0/1095066000 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcbf8071dd0 0x7fcbf80a8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:21.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.182+0000 7fcbf7fff640 1 -- 172.21.15.45:0/1095066000 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcbf813f630 msgr2=0x7fcbf8150570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:21.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.182+0000 7fcbf7fff640 1 --2- 172.21.15.45:0/1095066000 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcbf813f630 0x7fcbf8150570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:21.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.182+0000 7fcbf7fff640 1 -- 172.21.15.45:0/1095066000 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbf0009b30 con 0x7fcbf815adf0 2023-11-28T18:38:21.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.182+0000 7fcbf7fff640 1 --2- 172.21.15.45:0/1095066000 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcbf815adf0 0x7fcbf81f6940 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fcbf00195e0 tx=0x7fcbf0019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:21.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.182+0000 7fcbdffff640 1 -- 172.21.15.45:0/1095066000 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf00b8880 con 0x7fcbf815adf0 2023-11-28T18:38:21.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.182+0000 7fcbdffff640 1 -- 172.21.15.45:0/1095066000 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbf00b89e0 con 0x7fcbf815adf0 2023-11-28T18:38:21.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.182+0000 7fcbdffff640 1 -- 172.21.15.45:0/1095066000 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf00b8dd0 con 0x7fcbf815adf0 2023-11-28T18:38:21.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.182+0000 7fcbfdf2a640 1 -- 172.21.15.45:0/1095066000 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbf8141230 con 0x7fcbf815adf0 2023-11-28T18:38:21.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.182+0000 7fcbfdf2a640 1 -- 172.21.15.45:0/1095066000 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbf81417f0 con 0x7fcbf815adf0 2023-11-28T18:38:21.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.182+0000 7fcbfdf2a640 1 -- 172.21.15.45:0/1095066000 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbf81419e0 con 0x7fcbf815adf0 2023-11-28T18:38:21.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.186+0000 7fcbdffff640 1 -- 172.21.15.45:0/1095066000 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fcbf00c3460 con 0x7fcbf815adf0 2023-11-28T18:38:21.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.186+0000 7fcbdffff640 1 --2- 172.21.15.45:0/1095066000 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fcbe40668d0 0x7fcbe4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:21.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.186+0000 7fcbdffff640 1 -- 172.21.15.45:0/1095066000 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5804+0+0 (secure 0 0 0) 0x7fcbf011fc70 con 0x7fcbf815adf0 2023-11-28T18:38:21.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.186+0000 7fcbf77fe640 1 --2- 172.21.15.45:0/1095066000 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fcbe40668d0 0x7fcbe4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:21.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.186+0000 7fcbf77fe640 1 --2- 172.21.15.45:0/1095066000 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fcbe40668d0 0x7fcbe4068d90 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fcbe8009ac0 tx=0x7fcbe8009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:21.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.190+0000 7fcbdffff640 1 -- 172.21.15.45:0/1095066000 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcbf00ecf90 con 0x7fcbf815adf0 2023-11-28T18:38:21.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.350+0000 7fcbfdf2a640 1 -- 172.21.15.45:0/1095066000 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcbf8069410 con 0x7fcbf815adf0 2023-11-28T18:38:21.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.350+0000 7fcbdffff640 1 -- 172.21.15.45:0/1095066000 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcbf00f05b0 con 0x7fcbf815adf0 2023-11-28T18:38:21.353 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-11-28T18:38:21.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.354+0000 7fcbfdf2a640 1 -- 172.21.15.45:0/1095066000 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fcbe40668d0 msgr2=0x7fcbe4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:21.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.354+0000 7fcbfdf2a640 1 --2- 172.21.15.45:0/1095066000 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fcbe40668d0 0x7fcbe4068d90 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fcbe8009ac0 tx=0x7fcbe8009190 comp rx=0 tx=0).stop 2023-11-28T18:38:21.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.354+0000 7fcbfdf2a640 1 -- 172.21.15.45:0/1095066000 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcbf815adf0 msgr2=0x7fcbf81f6940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:21.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.354+0000 7fcbfdf2a640 1 --2- 172.21.15.45:0/1095066000 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcbf815adf0 0x7fcbf81f6940 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fcbf00195e0 tx=0x7fcbf0019770 comp rx=0 tx=0).stop 2023-11-28T18:38:21.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.354+0000 7fcbfdf2a640 1 -- 172.21.15.45:0/1095066000 shutdown_connections 2023-11-28T18:38:21.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.354+0000 7fcbfdf2a640 1 --2- 172.21.15.45:0/1095066000 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fcbe40668d0 0x7fcbe4068d90 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:21.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.354+0000 7fcbfdf2a640 1 --2- 172.21.15.45:0/1095066000 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcbf815adf0 0x7fcbf81f6940 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:21.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.354+0000 7fcbfdf2a640 1 --2- 172.21.15.45:0/1095066000 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcbf813f630 0x7fcbf8150570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:21.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.354+0000 7fcbfdf2a640 1 --2- 172.21.15.45:0/1095066000 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcbf8071dd0 0x7fcbf80a8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:21.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.354+0000 7fcbfdf2a640 1 -- 172.21.15.45:0/1095066000 >> 172.21.15.45:0/1095066000 conn(0x7fcbf80b0d00 msgr2=0x7fcbf815cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:21.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.354+0000 7fcbfdf2a640 1 -- 172.21.15.45:0/1095066000 shutdown_connections 2023-11-28T18:38:21.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.354+0000 7fcbfdf2a640 1 -- 172.21.15.45:0/1095066000 wait complete. 2023-11-28T18:38:21.375 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T18:38:21.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.518+0000 7fb9c2d2a640 1 Processor -- start 2023-11-28T18:38:21.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.518+0000 7fb9c2d2a640 1 -- start start 2023-11-28T18:38:21.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.522+0000 7fb9c2d2a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb9bc15adf0 0x7fb9bc13d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:21.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.522+0000 7fb9c2d2a640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fb9bc13f630 0x7fb9bc0ce240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:21.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.522+0000 7fb9c2d2a640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9bc13d2f0 con 0x7fb9bc071dd0 2023-11-28T18:38:21.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.522+0000 7fb9c2d2a640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9bc140560 con 0x7fb9bc13f630 2023-11-28T18:38:21.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.522+0000 7fb9c2d2a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9bc0cd830 con 0x7fb9bc15adf0 2023-11-28T18:38:21.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.522+0000 7fb9c0ac6640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fb9bc071dd0 0x7fb9bc0721b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59744/0 (socket says 172.21.15.45:59744) 2023-11-28T18:38:21.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.522+0000 7fb9c0ac6640 1 -- 172.21.15.45:0/4181485318 learned_addr learned my addr 172.21.15.45:0/4181485318 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:38:21.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.522+0000 7fb9bbfff640 1 --2- 172.21.15.45:0/4181485318 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb9bc15adf0 0x7fb9bc13d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:21.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.522+0000 7fb9c12c7640 1 --2- 172.21.15.45:0/4181485318 >> v2:172.21.15.190:3300/0 conn(0x7fb9bc13f630 0x7fb9bc0ce240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:21.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.522+0000 7fb9bb7fe640 1 -- 172.21.15.45:0/4181485318 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 66348068 0 0) 0x7fb9bc13d2f0 con 0x7fb9bc071dd0 2023-11-28T18:38:21.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.522+0000 7fb9bb7fe640 1 -- 172.21.15.45:0/4181485318 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9ac003530 con 0x7fb9bc071dd0 2023-11-28T18:38:21.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.522+0000 7fb9bbfff640 1 -- 172.21.15.45:0/4181485318 >> v2:172.21.15.190:3300/0 conn(0x7fb9bc13f630 msgr2=0x7fb9bc0ce240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:21.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.522+0000 7fb9bbfff640 1 --2- 172.21.15.45:0/4181485318 >> v2:172.21.15.190:3300/0 conn(0x7fb9bc13f630 0x7fb9bc0ce240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:21.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.522+0000 7fb9bbfff640 1 -- 172.21.15.45:0/4181485318 >> v1:172.21.15.45:6789/0 conn(0x7fb9bc071dd0 legacy=0x7fb9bc0721b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:21.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.522+0000 7fb9bbfff640 1 -- 172.21.15.45:0/4181485318 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9bc0cddb0 con 0x7fb9bc15adf0 2023-11-28T18:38:21.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.526+0000 7fb9bbfff640 1 --2- 172.21.15.45:0/4181485318 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb9bc15adf0 0x7fb9bc13d5a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb9a80097c0 tx=0x7fb9a801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63e59b62dee400af server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:21.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.526+0000 7fb9bb7fe640 1 -- 172.21.15.45:0/4181485318 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a80ab650 con 0x7fb9bc15adf0 2023-11-28T18:38:21.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.526+0000 7fb9bb7fe640 1 -- 172.21.15.45:0/4181485318 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9a80ab7b0 con 0x7fb9bc15adf0 2023-11-28T18:38:21.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.526+0000 7fb9bb7fe640 1 -- 172.21.15.45:0/4181485318 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a80abb40 con 0x7fb9bc15adf0 2023-11-28T18:38:21.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.526+0000 7fb9c2d2a640 1 -- 172.21.15.45:0/4181485318 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb9bc15adf0 msgr2=0x7fb9bc13d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:21.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.526+0000 7fb9c2d2a640 1 --2- 172.21.15.45:0/4181485318 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb9bc15adf0 0x7fb9bc13d5a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb9a80097c0 tx=0x7fb9a801c450 comp rx=0 tx=0).stop 2023-11-28T18:38:21.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.526+0000 7fb9c2d2a640 1 -- 172.21.15.45:0/4181485318 shutdown_connections 2023-11-28T18:38:21.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.526+0000 7fb9c2d2a640 1 --2- 172.21.15.45:0/4181485318 >> v2:172.21.15.190:3300/0 conn(0x7fb9bc13f630 0x7fb9bc0ce240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:21.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.526+0000 7fb9c2d2a640 1 --2- 172.21.15.45:0/4181485318 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb9bc15adf0 0x7fb9bc13d5a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:21.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.526+0000 7fb9c2d2a640 1 -- 172.21.15.45:0/4181485318 >> 172.21.15.45:0/4181485318 conn(0x7fb9bc0b0d00 msgr2=0x7fb9bc0b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:21.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.526+0000 7fb9c2d2a640 1 -- 172.21.15.45:0/4181485318 shutdown_connections 2023-11-28T18:38:21.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.526+0000 7fb9c2d2a640 1 -- 172.21.15.45:0/4181485318 wait complete. 2023-11-28T18:38:21.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.526+0000 7fb9c2d2a640 1 Processor -- start 2023-11-28T18:38:21.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.526+0000 7fb9c2d2a640 1 -- start start 2023-11-28T18:38:21.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.530+0000 7fb9c2d2a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb9bc071dd0 0x7fb9bc0b4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:21.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.530+0000 7fb9c2d2a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb9bc13f630 0x7fb9bc142020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:21.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.530+0000 7fb9c2d2a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb9bc15adf0 0x7fb9bc1591a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:21.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.530+0000 7fb9c2d2a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9bc142720 con 0x7fb9bc13f630 2023-11-28T18:38:21.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.530+0000 7fb9c2d2a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9bc13cde0 con 0x7fb9bc15adf0 2023-11-28T18:38:21.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.530+0000 7fb9c2d2a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9bc13c040 con 0x7fb9bc071dd0 2023-11-28T18:38:21.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.530+0000 7fb9bbfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb9bc13f630 0x7fb9bc142020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:21.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.530+0000 7fb9bbfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb9bc13f630 0x7fb9bc142020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56282/0 (socket says 172.21.15.45:56282) 2023-11-28T18:38:21.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.530+0000 7fb9bbfff640 1 -- 172.21.15.45:0/2015992553 learned_addr learned my addr 172.21.15.45:0/2015992553 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:21.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.530+0000 7fb9c0ac6640 1 --2- 172.21.15.45:0/2015992553 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb9bc071dd0 0x7fb9bc0b4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:21.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.530+0000 7fb9c12c7640 1 --2- 172.21.15.45:0/2015992553 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb9bc15adf0 0x7fb9bc1591a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:21.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.530+0000 7fb9bbfff640 1 -- 172.21.15.45:0/2015992553 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb9bc071dd0 msgr2=0x7fb9bc0b4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:21.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.530+0000 7fb9bbfff640 1 --2- 172.21.15.45:0/2015992553 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb9bc071dd0 0x7fb9bc0b4810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:21.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.530+0000 7fb9bbfff640 1 -- 172.21.15.45:0/2015992553 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb9bc15adf0 msgr2=0x7fb9bc1591a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:21.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.530+0000 7fb9bbfff640 1 --2- 172.21.15.45:0/2015992553 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb9bc15adf0 0x7fb9bc1591a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:21.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.530+0000 7fb9bbfff640 1 -- 172.21.15.45:0/2015992553 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9a8009420 con 0x7fb9bc13f630 2023-11-28T18:38:21.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.530+0000 7fb9bbfff640 1 --2- 172.21.15.45:0/2015992553 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb9bc13f630 0x7fb9bc142020 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb9a80ad040 tx=0x7fb9a801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:21.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.530+0000 7fb9b97fa640 1 -- 172.21.15.45:0/2015992553 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a80bf610 con 0x7fb9bc13f630 2023-11-28T18:38:21.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.530+0000 7fb9b97fa640 1 -- 172.21.15.45:0/2015992553 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9a80bf7b0 con 0x7fb9bc13f630 2023-11-28T18:38:21.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.530+0000 7fb9c2d2a640 1 -- 172.21.15.45:0/2015992553 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9bc13c320 con 0x7fb9bc13f630 2023-11-28T18:38:21.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.530+0000 7fb9b97fa640 1 -- 172.21.15.45:0/2015992553 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a80bfb60 con 0x7fb9bc13f630 2023-11-28T18:38:21.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.530+0000 7fb9c2d2a640 1 -- 172.21.15.45:0/2015992553 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9bc13c8e0 con 0x7fb9bc13f630 2023-11-28T18:38:21.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.530+0000 7fb9c2d2a640 1 -- 172.21.15.45:0/2015992553 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9bc069410 con 0x7fb9bc13f630 2023-11-28T18:38:21.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.530+0000 7fb9b97fa640 1 -- 172.21.15.45:0/2015992553 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fb9a80b5400 con 0x7fb9bc13f630 2023-11-28T18:38:21.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.534+0000 7fb9b97fa640 1 --2- 172.21.15.45:0/2015992553 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fb9a00668d0 0x7fb9a0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:21.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.534+0000 7fb9b97fa640 1 -- 172.21.15.45:0/2015992553 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5804+0+0 (secure 0 0 0) 0x7fb9a811f310 con 0x7fb9bc13f630 2023-11-28T18:38:21.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.534+0000 7fb9c0ac6640 1 --2- 172.21.15.45:0/2015992553 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fb9a00668d0 0x7fb9a0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:21.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.534+0000 7fb9c0ac6640 1 --2- 172.21.15.45:0/2015992553 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fb9a00668d0 0x7fb9a0068d90 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb9b00011f0 tx=0x7fb9b0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:21.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.538+0000 7fb9b97fa640 1 -- 172.21.15.45:0/2015992553 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb9a80ec600 con 0x7fb9bc13f630 2023-11-28T18:38:21.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.694+0000 7fb9c2d2a640 1 -- 172.21.15.45:0/2015992553 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb9bc15ba40 con 0x7fb9bc13f630 2023-11-28T18:38:21.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.694+0000 7fb9b97fa640 1 -- 172.21.15.45:0/2015992553 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb9a80efc20 con 0x7fb9bc13f630 2023-11-28T18:38:21.696 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-11-28T18:38:21.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.694+0000 7fb9c2d2a640 1 -- 172.21.15.45:0/2015992553 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fb9a00668d0 msgr2=0x7fb9a0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:21.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.694+0000 7fb9c2d2a640 1 --2- 172.21.15.45:0/2015992553 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fb9a00668d0 0x7fb9a0068d90 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb9b00011f0 tx=0x7fb9b0009040 comp rx=0 tx=0).stop 2023-11-28T18:38:21.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.694+0000 7fb9c2d2a640 1 -- 172.21.15.45:0/2015992553 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb9bc13f630 msgr2=0x7fb9bc142020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:21.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.694+0000 7fb9c2d2a640 1 --2- 172.21.15.45:0/2015992553 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb9bc13f630 0x7fb9bc142020 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb9a80ad040 tx=0x7fb9a801ac90 comp rx=0 tx=0).stop 2023-11-28T18:38:21.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.694+0000 7fb9c2d2a640 1 -- 172.21.15.45:0/2015992553 shutdown_connections 2023-11-28T18:38:21.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.694+0000 7fb9c2d2a640 1 --2- 172.21.15.45:0/2015992553 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fb9a00668d0 0x7fb9a0068d90 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:21.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.694+0000 7fb9c2d2a640 1 --2- 172.21.15.45:0/2015992553 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb9bc15adf0 0x7fb9bc1591a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:21.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.694+0000 7fb9c2d2a640 1 --2- 172.21.15.45:0/2015992553 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb9bc13f630 0x7fb9bc142020 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:21.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.694+0000 7fb9c2d2a640 1 --2- 172.21.15.45:0/2015992553 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb9bc071dd0 0x7fb9bc0b4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:21.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.694+0000 7fb9c2d2a640 1 -- 172.21.15.45:0/2015992553 >> 172.21.15.45:0/2015992553 conn(0x7fb9bc0b0d00 msgr2=0x7fb9bc15bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:21.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.694+0000 7fb9c2d2a640 1 -- 172.21.15.45:0/2015992553 shutdown_connections 2023-11-28T18:38:21.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.694+0000 7fb9c2d2a640 1 -- 172.21.15.45:0/2015992553 wait complete. 2023-11-28T18:38:21.718 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T18:38:21.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.862+0000 7f1e39b57640 1 Processor -- start 2023-11-28T18:38:21.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.862+0000 7f1e39b57640 1 -- start start 2023-11-28T18:38:21.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.862+0000 7f1e39b57640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1e34071dd0 0x7f1e340721b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:21.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.862+0000 7f1e39b57640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f1e3413f630 0x7f1e340ce240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:21.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.862+0000 7f1e39b57640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e3413d2f0 con 0x7f1e3415adf0 2023-11-28T18:38:21.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.862+0000 7f1e39b57640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e34140560 con 0x7f1e34071dd0 2023-11-28T18:38:21.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.862+0000 7f1e39b57640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e340cd830 con 0x7f1e3413f630 2023-11-28T18:38:21.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.862+0000 7f1e337fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1e34071dd0 0x7f1e340721b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:21.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.862+0000 7f1e32ffd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f1e3415adf0 0x7f1e3413d5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59746/0 (socket says 172.21.15.45:59746) 2023-11-28T18:38:21.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.862+0000 7f1e32ffd640 1 -- 172.21.15.45:0/3687090769 learned_addr learned my addr 172.21.15.45:0/3687090769 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:38:21.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.862+0000 7f1e33fff640 1 --2- 172.21.15.45:0/3687090769 >> v2:172.21.15.190:3300/0 conn(0x7f1e3413f630 0x7f1e340ce240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:21.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.862+0000 7f1e337fe640 1 -- 172.21.15.45:0/3687090769 >> v2:172.21.15.190:3300/0 conn(0x7f1e3413f630 msgr2=0x7f1e340ce240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:21.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.862+0000 7f1e337fe640 1 --2- 172.21.15.45:0/3687090769 >> v2:172.21.15.190:3300/0 conn(0x7f1e3413f630 0x7f1e340ce240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:21.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.862+0000 7f1e337fe640 1 -- 172.21.15.45:0/3687090769 >> v1:172.21.15.45:6789/0 conn(0x7f1e3415adf0 legacy=0x7f1e3413d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:21.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.862+0000 7f1e337fe640 1 -- 172.21.15.45:0/3687090769 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e340cddb0 con 0x7f1e34071dd0 2023-11-28T18:38:21.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.862+0000 7f1e327fc640 1 -- 172.21.15.45:0/3687090769 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1934889038 0 0) 0x7f1e3413d2f0 con 0x7f1e3415adf0 2023-11-28T18:38:21.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.866+0000 7f1e337fe640 1 --2- 172.21.15.45:0/3687090769 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e34071dd0 0x7f1e340721b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f1e3406d600 tx=0x7f1e2401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78f5a389a9b2a836 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:21.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.866+0000 7f1e327fc640 1 -- 172.21.15.45:0/3687090769 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e240ab660 con 0x7f1e34071dd0 2023-11-28T18:38:21.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.866+0000 7f1e327fc640 1 -- 172.21.15.45:0/3687090769 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e240ab7c0 con 0x7f1e34071dd0 2023-11-28T18:38:21.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.866+0000 7f1e327fc640 1 -- 172.21.15.45:0/3687090769 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e240abb50 con 0x7f1e34071dd0 2023-11-28T18:38:21.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.866+0000 7f1e39b57640 1 -- 172.21.15.45:0/3687090769 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e34071dd0 msgr2=0x7f1e340721b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:21.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.866+0000 7f1e39b57640 1 --2- 172.21.15.45:0/3687090769 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e34071dd0 0x7f1e340721b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f1e3406d600 tx=0x7f1e2401c460 comp rx=0 tx=0).stop 2023-11-28T18:38:21.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.866+0000 7f1e39b57640 1 -- 172.21.15.45:0/3687090769 shutdown_connections 2023-11-28T18:38:21.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.866+0000 7f1e39b57640 1 --2- 172.21.15.45:0/3687090769 >> v2:172.21.15.190:3300/0 conn(0x7f1e3413f630 0x7f1e340ce240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:21.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.866+0000 7f1e39b57640 1 --2- 172.21.15.45:0/3687090769 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e34071dd0 0x7f1e340721b0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:21.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.866+0000 7f1e39b57640 1 -- 172.21.15.45:0/3687090769 >> 172.21.15.45:0/3687090769 conn(0x7f1e340b0d00 msgr2=0x7f1e340b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:21.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.866+0000 7f1e39b57640 1 -- 172.21.15.45:0/3687090769 shutdown_connections 2023-11-28T18:38:21.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.866+0000 7f1e39b57640 1 -- 172.21.15.45:0/3687090769 wait complete. 2023-11-28T18:38:21.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.870+0000 7f1e39b57640 1 Processor -- start 2023-11-28T18:38:21.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.870+0000 7f1e39b57640 1 -- start start 2023-11-28T18:38:21.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.870+0000 7f1e39b57640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1e34071dd0 0x7f1e3413c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:21.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.870+0000 7f1e39b57640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e3413f630 0x7f1e340ab6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:21.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.870+0000 7f1e39b57640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1e3415adf0 0x7f1e3415b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:21.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.870+0000 7f1e39b57640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e34142180 con 0x7f1e3413f630 2023-11-28T18:38:21.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.870+0000 7f1e39b57640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e340ac070 con 0x7f1e3415adf0 2023-11-28T18:38:21.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.870+0000 7f1e39b57640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e34141b30 con 0x7f1e34071dd0 2023-11-28T18:38:21.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.870+0000 7f1e32ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e3413f630 0x7f1e340ab6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:21.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.870+0000 7f1e32ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e3413f630 0x7f1e340ab6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56306/0 (socket says 172.21.15.45:56306) 2023-11-28T18:38:21.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.870+0000 7f1e32ffd640 1 -- 172.21.15.45:0/297422188 learned_addr learned my addr 172.21.15.45:0/297422188 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:21.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.870+0000 7f1e337fe640 1 --2- 172.21.15.45:0/297422188 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1e34071dd0 0x7f1e3413c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:21.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.870+0000 7f1e33fff640 1 --2- 172.21.15.45:0/297422188 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1e3415adf0 0x7f1e3415b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:21.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.870+0000 7f1e32ffd640 1 -- 172.21.15.45:0/297422188 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1e34071dd0 msgr2=0x7f1e3413c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:21.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.870+0000 7f1e32ffd640 1 --2- 172.21.15.45:0/297422188 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1e34071dd0 0x7f1e3413c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:21.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.870+0000 7f1e32ffd640 1 -- 172.21.15.45:0/297422188 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1e3415adf0 msgr2=0x7f1e3415b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:21.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.870+0000 7f1e32ffd640 1 --2- 172.21.15.45:0/297422188 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1e3415adf0 0x7f1e3415b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:21.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.870+0000 7f1e32ffd640 1 -- 172.21.15.45:0/297422188 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e24009420 con 0x7f1e3413f630 2023-11-28T18:38:21.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.870+0000 7f1e32ffd640 1 --2- 172.21.15.45:0/297422188 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e3413f630 0x7f1e340ab6f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f1e2800c480 tx=0x7f1e2800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:21.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.870+0000 7f1e1bfff640 1 -- 172.21.15.45:0/297422188 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e280074e0 con 0x7f1e3413f630 2023-11-28T18:38:21.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.870+0000 7f1e1bfff640 1 -- 172.21.15.45:0/297422188 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e28007660 con 0x7f1e3413f630 2023-11-28T18:38:21.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.870+0000 7f1e1bfff640 1 -- 172.21.15.45:0/297422188 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e28004a30 con 0x7f1e3413f630 2023-11-28T18:38:21.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.870+0000 7f1e39b57640 1 -- 172.21.15.45:0/297422188 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e34141e10 con 0x7f1e3413f630 2023-11-28T18:38:21.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.870+0000 7f1e39b57640 1 -- 172.21.15.45:0/297422188 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e340abc30 con 0x7f1e3413f630 2023-11-28T18:38:21.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.874+0000 7f1e39b57640 1 -- 172.21.15.45:0/297422188 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e34141990 con 0x7f1e3413f630 2023-11-28T18:38:21.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.874+0000 7f1e1bfff640 1 -- 172.21.15.45:0/297422188 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f1e28004b90 con 0x7f1e3413f630 2023-11-28T18:38:21.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.874+0000 7f1e1bfff640 1 --2- 172.21.15.45:0/297422188 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1e200668d0 0x7f1e20068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:21.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.874+0000 7f1e1bfff640 1 -- 172.21.15.45:0/297422188 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5804+0+0 (secure 0 0 0) 0x7f1e28083620 con 0x7f1e3413f630 2023-11-28T18:38:21.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.874+0000 7f1e337fe640 1 --2- 172.21.15.45:0/297422188 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1e200668d0 0x7f1e20068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:21.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.874+0000 7f1e337fe640 1 --2- 172.21.15.45:0/297422188 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1e200668d0 0x7f1e20068d90 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1e240af000 tx=0x7f1e240a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:21.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:21.878+0000 7f1e1bfff640 1 -- 172.21.15.45:0/297422188 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1e34141990 con 0x7f1e3413f630 2023-11-28T18:38:22.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.034+0000 7f1e39b57640 1 -- 172.21.15.45:0/297422188 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1e34141990 con 0x7f1e3413f630 2023-11-28T18:38:22.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.034+0000 7f1e1bfff640 1 -- 172.21.15.45:0/297422188 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1e34141990 con 0x7f1e3413f630 2023-11-28T18:38:22.039 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-11-28T18:38:22.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.038+0000 7f1e39b57640 1 -- 172.21.15.45:0/297422188 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1e200668d0 msgr2=0x7f1e20068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:22.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.038+0000 7f1e39b57640 1 --2- 172.21.15.45:0/297422188 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1e200668d0 0x7f1e20068d90 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1e240af000 tx=0x7f1e240a7000 comp rx=0 tx=0).stop 2023-11-28T18:38:22.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.038+0000 7f1e39b57640 1 -- 172.21.15.45:0/297422188 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e3413f630 msgr2=0x7f1e340ab6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:22.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.038+0000 7f1e39b57640 1 --2- 172.21.15.45:0/297422188 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e3413f630 0x7f1e340ab6f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f1e2800c480 tx=0x7f1e2800c940 comp rx=0 tx=0).stop 2023-11-28T18:38:22.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.038+0000 7f1e39b57640 1 -- 172.21.15.45:0/297422188 shutdown_connections 2023-11-28T18:38:22.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.038+0000 7f1e39b57640 1 --2- 172.21.15.45:0/297422188 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1e200668d0 0x7f1e20068d90 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:22.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.038+0000 7f1e39b57640 1 --2- 172.21.15.45:0/297422188 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1e3415adf0 0x7f1e3415b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:22.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.038+0000 7f1e39b57640 1 --2- 172.21.15.45:0/297422188 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e3413f630 0x7f1e340ab6f0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:22.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.038+0000 7f1e39b57640 1 --2- 172.21.15.45:0/297422188 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1e34071dd0 0x7f1e3413c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:22.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.038+0000 7f1e39b57640 1 -- 172.21.15.45:0/297422188 >> 172.21.15.45:0/297422188 conn(0x7f1e340b0d00 msgr2=0x7f1e340aec70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:22.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.038+0000 7f1e39b57640 1 -- 172.21.15.45:0/297422188 shutdown_connections 2023-11-28T18:38:22.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.038+0000 7f1e39b57640 1 -- 172.21.15.45:0/297422188 wait complete. 2023-11-28T18:38:22.061 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T18:38:22.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.202+0000 7f47ee4ea640 1 Processor -- start 2023-11-28T18:38:22.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.202+0000 7f47ee4ea640 1 -- start start 2023-11-28T18:38:22.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.202+0000 7f47ee4ea640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f47e813cf70 0x7f47e806c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:22.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.202+0000 7f47ee4ea640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47e815b1b0 con 0x7f47e806c840 2023-11-28T18:38:22.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.202+0000 7f47ee4ea640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47e815b3e0 con 0x7f47e815ad80 2023-11-28T18:38:22.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.202+0000 7f47ee4ea640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47e813d350 con 0x7f47e813cf70 2023-11-28T18:38:22.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.202+0000 7f47e7fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f47e813cf70 0x7f47e806c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:22.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.202+0000 7f47e7fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f47e813cf70 0x7f47e806c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56322/0 (socket says 172.21.15.45:56322) 2023-11-28T18:38:22.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.202+0000 7f47e7fff640 1 -- 172.21.15.45:0/532039786 learned_addr learned my addr 172.21.15.45:0/532039786 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:22.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.202+0000 7f47e7fff640 1 -- 172.21.15.45:0/532039786 >> v1:172.21.15.190:6789/0 conn(0x7f47e815ad80 legacy=0x7f47e80cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:22.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.202+0000 7f47e7fff640 1 -- 172.21.15.45:0/532039786 >> v1:172.21.15.45:6789/0 conn(0x7f47e806c840 legacy=0x7f47e815a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:22.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.202+0000 7f47e7fff640 1 -- 172.21.15.45:0/532039786 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e813f760 con 0x7f47e813cf70 2023-11-28T18:38:22.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.206+0000 7f47e7fff640 1 --2- 172.21.15.45:0/532039786 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47e813cf70 0x7f47e806c300 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f47d800bb10 tx=0x7f47d801eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89edc6140b19d6ce server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:22.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.206+0000 7f47e6ffd640 1 -- 172.21.15.45:0/532039786 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d80a7a50 con 0x7f47e813cf70 2023-11-28T18:38:22.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.206+0000 7f47e6ffd640 1 -- 172.21.15.45:0/532039786 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d80a7bb0 con 0x7f47e813cf70 2023-11-28T18:38:22.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.206+0000 7f47e6ffd640 1 -- 172.21.15.45:0/532039786 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d80af440 con 0x7f47e813cf70 2023-11-28T18:38:22.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.206+0000 7f47ee4ea640 1 -- 172.21.15.45:0/532039786 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47e813cf70 msgr2=0x7f47e806c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:22.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.206+0000 7f47ee4ea640 1 --2- 172.21.15.45:0/532039786 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47e813cf70 0x7f47e806c300 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f47d800bb10 tx=0x7f47d801eb80 comp rx=0 tx=0).stop 2023-11-28T18:38:22.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.206+0000 7f47ee4ea640 1 -- 172.21.15.45:0/532039786 shutdown_connections 2023-11-28T18:38:22.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.206+0000 7f47ee4ea640 1 --2- 172.21.15.45:0/532039786 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47e813cf70 0x7f47e806c300 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:22.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.206+0000 7f47ee4ea640 1 -- 172.21.15.45:0/532039786 >> 172.21.15.45:0/532039786 conn(0x7f47e806a570 msgr2=0x7f47e806a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:22.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.206+0000 7f47ee4ea640 1 -- 172.21.15.45:0/532039786 shutdown_connections 2023-11-28T18:38:22.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.206+0000 7f47ee4ea640 1 -- 172.21.15.45:0/532039786 wait complete. 2023-11-28T18:38:22.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.210+0000 7f47ee4ea640 1 Processor -- start 2023-11-28T18:38:22.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.210+0000 7f47ee4ea640 1 -- start start 2023-11-28T18:38:22.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.210+0000 7f47ee4ea640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f47e806c840 0x7f47e8155ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:22.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.210+0000 7f47ee4ea640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f47e813cf70 0x7f47e8159840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:22.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.210+0000 7f47ee4ea640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47e815ad80 0x7f47e8155050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:22.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.210+0000 7f47ee4ea640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e813c440 con 0x7f47e815ad80 2023-11-28T18:38:22.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.210+0000 7f47ee4ea640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e8159eb0 con 0x7f47e806c840 2023-11-28T18:38:22.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.210+0000 7f47ee4ea640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47e8154290 con 0x7f47e813cf70 2023-11-28T18:38:22.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.210+0000 7f47eca87640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47e815ad80 0x7f47e8155050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:22.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.210+0000 7f47eca87640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47e815ad80 0x7f47e8155050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56336/0 (socket says 172.21.15.45:56336) 2023-11-28T18:38:22.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.210+0000 7f47eca87640 1 -- 172.21.15.45:0/2979579016 learned_addr learned my addr 172.21.15.45:0/2979579016 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:22.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.210+0000 7f47e77fe640 1 --2- 172.21.15.45:0/2979579016 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f47e813cf70 0x7f47e8159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:22.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.210+0000 7f47e7fff640 1 --2- 172.21.15.45:0/2979579016 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f47e806c840 0x7f47e8155ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:22.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.210+0000 7f47eca87640 1 -- 172.21.15.45:0/2979579016 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f47e813cf70 msgr2=0x7f47e8159840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:22.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.210+0000 7f47eca87640 1 --2- 172.21.15.45:0/2979579016 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f47e813cf70 0x7f47e8159840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:22.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.210+0000 7f47eca87640 1 -- 172.21.15.45:0/2979579016 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f47e806c840 msgr2=0x7f47e8155ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:22.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.210+0000 7f47eca87640 1 --2- 172.21.15.45:0/2979579016 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f47e806c840 0x7f47e8155ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:22.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.210+0000 7f47eca87640 1 -- 172.21.15.45:0/2979579016 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47d800b770 con 0x7f47e815ad80 2023-11-28T18:38:22.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.210+0000 7f47eca87640 1 --2- 172.21.15.45:0/2979579016 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47e815ad80 0x7f47e8155050 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f47e000c760 tx=0x7f47e000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:22.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.210+0000 7f47e4ff9640 1 -- 172.21.15.45:0/2979579016 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e0003b80 con 0x7f47e815ad80 2023-11-28T18:38:22.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.210+0000 7f47e4ff9640 1 -- 172.21.15.45:0/2979579016 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47e0003ce0 con 0x7f47e815ad80 2023-11-28T18:38:22.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.210+0000 7f47e4ff9640 1 -- 172.21.15.45:0/2979579016 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e000aa30 con 0x7f47e815ad80 2023-11-28T18:38:22.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.210+0000 7f47ee4ea640 1 -- 172.21.15.45:0/2979579016 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47e8154570 con 0x7f47e815ad80 2023-11-28T18:38:22.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.210+0000 7f47ee4ea640 1 -- 172.21.15.45:0/2979579016 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47e8154b30 con 0x7f47e815ad80 2023-11-28T18:38:22.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.210+0000 7f47ee4ea640 1 -- 172.21.15.45:0/2979579016 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47e8069480 con 0x7f47e815ad80 2023-11-28T18:38:22.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.214+0000 7f47e4ff9640 1 -- 172.21.15.45:0/2979579016 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f47e000ab90 con 0x7f47e815ad80 2023-11-28T18:38:22.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.214+0000 7f47e4ff9640 1 --2- 172.21.15.45:0/2979579016 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f47d40668d0 0x7f47d4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:22.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.214+0000 7f47e4ff9640 1 -- 172.21.15.45:0/2979579016 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5804+0+0 (secure 0 0 0) 0x7f47e0084100 con 0x7f47e815ad80 2023-11-28T18:38:22.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.214+0000 7f47e7fff640 1 --2- 172.21.15.45:0/2979579016 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f47d40668d0 0x7f47d4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:22.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.214+0000 7f47e7fff640 1 --2- 172.21.15.45:0/2979579016 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f47d40668d0 0x7f47d4068d90 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f47d80b1000 tx=0x7f47d8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:22.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.218+0000 7f47e4ff9640 1 -- 172.21.15.45:0/2979579016 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f47e0051380 con 0x7f47e815ad80 2023-11-28T18:38:22.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.406+0000 7f47ee4ea640 1 -- 172.21.15.45:0/2979579016 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f47e815a290 con 0x7f47e815ad80 2023-11-28T18:38:22.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.410+0000 7f47e4ff9640 1 -- 172.21.15.45:0/2979579016 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4910 (secure 0 0 0) 0x7f47e00549a0 con 0x7f47e815ad80 2023-11-28T18:38:22.411 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:38:22.411 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/972230763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":972230763},{"type":"v1","addr":"172.21.15.45:6835","nonce":972230763}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/4274475693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":4274475693},{"type":"v1","addr":"172.21.15.190:6837","nonce":4274475693}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/3154556740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":3154556740},{"type":"v1","addr":"172.21.15.190:6836","nonce":3154556740}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T18:37:32.842966+0000","modified":"2023-11-28T18:37:35.841966+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6834/1657221272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1657221272},{"type":"v1","addr":"172.21.15.45:6834","nonce":1657221272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T18:38:22.411 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 8 2023-11-28T18:38:22.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.410+0000 7f47ee4ea640 1 -- 172.21.15.45:0/2979579016 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f47d40668d0 msgr2=0x7f47d4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:22.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.410+0000 7f47ee4ea640 1 --2- 172.21.15.45:0/2979579016 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f47d40668d0 0x7f47d4068d90 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f47d80b1000 tx=0x7f47d8008040 comp rx=0 tx=0).stop 2023-11-28T18:38:22.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.410+0000 7f47ee4ea640 1 -- 172.21.15.45:0/2979579016 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47e815ad80 msgr2=0x7f47e8155050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:22.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.410+0000 7f47ee4ea640 1 --2- 172.21.15.45:0/2979579016 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47e815ad80 0x7f47e8155050 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f47e000c760 tx=0x7f47e000cc20 comp rx=0 tx=0).stop 2023-11-28T18:38:22.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.410+0000 7f47ee4ea640 1 -- 172.21.15.45:0/2979579016 shutdown_connections 2023-11-28T18:38:22.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.410+0000 7f47ee4ea640 1 --2- 172.21.15.45:0/2979579016 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f47d40668d0 0x7f47d4068d90 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:22.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.410+0000 7f47ee4ea640 1 --2- 172.21.15.45:0/2979579016 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47e815ad80 0x7f47e8155050 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:22.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.410+0000 7f47ee4ea640 1 --2- 172.21.15.45:0/2979579016 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f47e813cf70 0x7f47e8159840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:22.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.410+0000 7f47ee4ea640 1 --2- 172.21.15.45:0/2979579016 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f47e806c840 0x7f47e8155ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:22.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.410+0000 7f47ee4ea640 1 -- 172.21.15.45:0/2979579016 >> 172.21.15.45:0/2979579016 conn(0x7f47e806a570 msgr2=0x7f47e815c340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:22.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.410+0000 7f47ee4ea640 1 -- 172.21.15.45:0/2979579016 shutdown_connections 2023-11-28T18:38:22.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.410+0000 7f47ee4ea640 1 -- 172.21.15.45:0/2979579016 wait complete. 2023-11-28T18:38:22.432 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T18:38:22.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.574+0000 7f0243232640 1 Processor -- start 2023-11-28T18:38:22.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.574+0000 7f0243232640 1 -- start start 2023-11-28T18:38:22.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.574+0000 7f0243232640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f023c0cdc60 0x7f023c15b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:22.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.574+0000 7f0243232640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f023c0ce040 0x7f023c15f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:22.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.574+0000 7f0243232640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f023c13e3c0 con 0x7f023c15f920 2023-11-28T18:38:22.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.574+0000 7f0243232640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f023c15be90 con 0x7f023c0ce040 2023-11-28T18:38:22.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.574+0000 7f0243232640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f023c15c170 con 0x7f023c0cdc60 2023-11-28T18:38:22.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.574+0000 7f02417cf640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f023c15f920 0x7f023c155090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59760/0 (socket says 172.21.15.45:59760) 2023-11-28T18:38:22.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.574+0000 7f02417cf640 1 -- 172.21.15.45:0/2210321580 learned_addr learned my addr 172.21.15.45:0/2210321580 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:38:22.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.574+0000 7f0240fce640 1 --2- 172.21.15.45:0/2210321580 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f023c0cdc60 0x7f023c15b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:22.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.574+0000 7f023bfff640 1 --2- 172.21.15.45:0/2210321580 >> v2:172.21.15.190:3300/0 conn(0x7f023c0ce040 0x7f023c15f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:22.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.574+0000 7f023b7fe640 1 -- 172.21.15.45:0/2210321580 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1797846734 0 0) 0x7f02340014a0 con 0x7f023c15f920 2023-11-28T18:38:22.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.574+0000 7f023b7fe640 1 -- 172.21.15.45:0/2210321580 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f022c003530 con 0x7f023c15f920 2023-11-28T18:38:22.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.574+0000 7f023b7fe640 1 -- 172.21.15.45:0/2210321580 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2092936244 0 0) 0x7f022c003530 con 0x7f023c15f920 2023-11-28T18:38:22.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.574+0000 7f023b7fe640 1 -- 172.21.15.45:0/2210321580 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f023c0cdc60 msgr2=0x7f023c15b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:22.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.574+0000 7f023b7fe640 1 --2- 172.21.15.45:0/2210321580 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f023c0cdc60 0x7f023c15b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:22.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.574+0000 7f023b7fe640 1 -- 172.21.15.45:0/2210321580 >> v2:172.21.15.190:3300/0 conn(0x7f023c0ce040 msgr2=0x7f023c15f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:22.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.574+0000 7f023b7fe640 1 --2- 172.21.15.45:0/2210321580 >> v2:172.21.15.190:3300/0 conn(0x7f023c0ce040 0x7f023c15f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:22.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.574+0000 7f023b7fe640 1 -- 172.21.15.45:0/2210321580 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f023c15c450 con 0x7f023c15f920 2023-11-28T18:38:22.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.574+0000 7f023b7fe640 1 -- 172.21.15.45:0/2210321580 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4084481567 0 0) 0x7f0234001bb0 con 0x7f023c15f920 2023-11-28T18:38:22.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.574+0000 7f023bfff640 1 --2- 172.21.15.45:0/2210321580 >> v2:172.21.15.190:3300/0 conn(0x7f023c0ce040 0x7f023c15f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:38:22.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.574+0000 7f023b7fe640 1 -- 172.21.15.45:0/2210321580 >> v1:172.21.15.45:6789/0 conn(0x7f023c15f920 legacy=0x7f023c155090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:22.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.574+0000 7f023b7fe640 1 --2- 172.21.15.45:0/2210321580 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f022c003980 0x7f022c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:22.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.574+0000 7f023b7fe640 1 --2- 172.21.15.45:0/2210321580 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f022c0047d0 0x7f022c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:22.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.574+0000 7f023b7fe640 1 --2- 172.21.15.45:0/2210321580 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f023c0cdc60 0x7f022c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:22.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.574+0000 7f023b7fe640 1 -- 172.21.15.45:0/2210321580 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f023c15be90 con 0x7f022c0047d0 2023-11-28T18:38:22.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.574+0000 7f023b7fe640 1 -- 172.21.15.45:0/2210321580 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f023c15c170 con 0x7f022c003980 2023-11-28T18:38:22.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.574+0000 7f023b7fe640 1 -- 172.21.15.45:0/2210321580 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f022c00b990 con 0x7f023c0cdc60 2023-11-28T18:38:22.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.574+0000 7f023bfff640 1 --2- 172.21.15.45:0/2210321580 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f022c0047d0 0x7f022c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:22.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.578+0000 7f02417cf640 1 --2- 172.21.15.45:0/2210321580 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f023c0cdc60 0x7f022c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:22.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.578+0000 7f0240fce640 1 --2- 172.21.15.45:0/2210321580 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f022c003980 0x7f022c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:22.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.578+0000 7f023bfff640 1 -- 172.21.15.45:0/2210321580 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f023c0cdc60 msgr2=0x7f022c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:22.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.578+0000 7f023bfff640 1 --2- 172.21.15.45:0/2210321580 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f023c0cdc60 0x7f022c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:22.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.578+0000 7f023bfff640 1 -- 172.21.15.45:0/2210321580 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f022c003980 msgr2=0x7f022c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:22.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.578+0000 7f023bfff640 1 --2- 172.21.15.45:0/2210321580 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f022c003980 0x7f022c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:22.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.578+0000 7f023bfff640 1 -- 172.21.15.45:0/2210321580 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f022c003530 con 0x7f022c0047d0 2023-11-28T18:38:22.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.578+0000 7f0240fce640 1 --2- 172.21.15.45:0/2210321580 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f022c003980 0x7f022c003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:38:22.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.578+0000 7f02417cf640 1 --2- 172.21.15.45:0/2210321580 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f023c0cdc60 0x7f022c005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:38:22.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.578+0000 7f023bfff640 1 --2- 172.21.15.45:0/2210321580 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f022c0047d0 0x7f022c004c50 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f0228009cb0 tx=0x7f022801cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c79120b8f3b57dac server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:22.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.578+0000 7f023b7fe640 1 -- 172.21.15.45:0/2210321580 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02280a5850 con 0x7f022c0047d0 2023-11-28T18:38:22.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.578+0000 7f023b7fe640 1 -- 172.21.15.45:0/2210321580 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02280a59b0 con 0x7f022c0047d0 2023-11-28T18:38:22.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.578+0000 7f023b7fe640 1 -- 172.21.15.45:0/2210321580 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02280a5d60 con 0x7f022c0047d0 2023-11-28T18:38:22.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.578+0000 7f0243232640 1 -- 172.21.15.45:0/2210321580 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f022c0047d0 msgr2=0x7f022c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:22.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.578+0000 7f0243232640 1 --2- 172.21.15.45:0/2210321580 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f022c0047d0 0x7f022c004c50 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f0228009cb0 tx=0x7f022801cc70 comp rx=0 tx=0).stop 2023-11-28T18:38:22.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.582+0000 7f02417cf640 1 -- 172.21.15.45:0/2210321580 reap_dead start 2023-11-28T18:38:22.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.582+0000 7f0243232640 1 -- 172.21.15.45:0/2210321580 shutdown_connections 2023-11-28T18:38:22.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.582+0000 7f0243232640 1 -- 172.21.15.45:0/2210321580 >> 172.21.15.45:0/2210321580 conn(0x7f023c06a570 msgr2=0x7f023c06a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:22.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.582+0000 7f0243232640 1 -- 172.21.15.45:0/2210321580 shutdown_connections 2023-11-28T18:38:22.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.582+0000 7f0243232640 1 -- 172.21.15.45:0/2210321580 wait complete. 2023-11-28T18:38:22.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.582+0000 7f0243232640 1 Processor -- start 2023-11-28T18:38:22.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.582+0000 7f0243232640 1 -- start start 2023-11-28T18:38:22.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.582+0000 7f0243232640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f022c0047d0 0x7f023c157e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:22.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.582+0000 7f0243232640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f023c0b2150 0x7f023c1ee9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:22.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.582+0000 7f0243232640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f023c156410 0x7f023c1568c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:22.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.582+0000 7f0243232640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f023c0b3960 con 0x7f023c156410 2023-11-28T18:38:22.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.582+0000 7f0243232640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f023c158370 con 0x7f022c0047d0 2023-11-28T18:38:22.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.582+0000 7f0243232640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f023c155c50 con 0x7f023c0b2150 2023-11-28T18:38:22.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.582+0000 7f02417cf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f023c156410 0x7f023c1568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:22.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.582+0000 7f02417cf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f023c156410 0x7f023c1568c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56354/0 (socket says 172.21.15.45:56354) 2023-11-28T18:38:22.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.582+0000 7f02417cf640 1 -- 172.21.15.45:0/2216332834 learned_addr learned my addr 172.21.15.45:0/2216332834 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:22.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.582+0000 7f0240fce640 1 --2- 172.21.15.45:0/2216332834 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f022c0047d0 0x7f023c157e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:22.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.582+0000 7f023bfff640 1 --2- 172.21.15.45:0/2216332834 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f023c0b2150 0x7f023c1ee9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:22.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.582+0000 7f02417cf640 1 -- 172.21.15.45:0/2216332834 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f023c0b2150 msgr2=0x7f023c1ee9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:22.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.582+0000 7f02417cf640 1 --2- 172.21.15.45:0/2216332834 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f023c0b2150 0x7f023c1ee9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:22.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.582+0000 7f02417cf640 1 -- 172.21.15.45:0/2216332834 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f022c0047d0 msgr2=0x7f023c157e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:22.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.582+0000 7f02417cf640 1 --2- 172.21.15.45:0/2216332834 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f022c0047d0 0x7f023c157e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:22.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.582+0000 7f02417cf640 1 -- 172.21.15.45:0/2216332834 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f023c1ef240 con 0x7f023c156410 2023-11-28T18:38:22.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.582+0000 7f023bfff640 1 --2- 172.21.15.45:0/2216332834 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f023c0b2150 0x7f023c1ee9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:38:22.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.586+0000 7f02417cf640 1 --2- 172.21.15.45:0/2216332834 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f023c156410 0x7f023c1568c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f023c15fd00 tx=0x7f023400ff10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:22.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.586+0000 7f02397fa640 1 -- 172.21.15.45:0/2216332834 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0234014590 con 0x7f023c156410 2023-11-28T18:38:22.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.586+0000 7f02397fa640 1 -- 172.21.15.45:0/2216332834 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0234014710 con 0x7f023c156410 2023-11-28T18:38:22.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.586+0000 7f02397fa640 1 -- 172.21.15.45:0/2216332834 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0234014ac0 con 0x7f023c156410 2023-11-28T18:38:22.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.586+0000 7f0243232640 1 -- 172.21.15.45:0/2216332834 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f023c1ef520 con 0x7f023c156410 2023-11-28T18:38:22.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.586+0000 7f0243232640 1 -- 172.21.15.45:0/2216332834 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f023c155ef0 con 0x7f023c156410 2023-11-28T18:38:22.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.586+0000 7f0243232640 1 -- 172.21.15.45:0/2216332834 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f023c156110 con 0x7f023c156410 2023-11-28T18:38:22.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.586+0000 7f02397fa640 1 -- 172.21.15.45:0/2216332834 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f0234014c20 con 0x7f023c156410 2023-11-28T18:38:22.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.586+0000 7f02397fa640 1 --2- 172.21.15.45:0/2216332834 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f0220066900 0x7f0220068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:22.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.586+0000 7f02397fa640 1 -- 172.21.15.45:0/2216332834 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5804+0+0 (secure 0 0 0) 0x7f023408a8c0 con 0x7f023c156410 2023-11-28T18:38:22.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.586+0000 7f0240fce640 1 --2- 172.21.15.45:0/2216332834 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f0220066900 0x7f0220068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:22.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.590+0000 7f0240fce640 1 --2- 172.21.15.45:0/2216332834 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f0220066900 0x7f0220068dc0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0230009a80 tx=0x7f0230008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:22.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.590+0000 7f02397fa640 1 -- 172.21.15.45:0/2216332834 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0234057a00 con 0x7f023c156410 2023-11-28T18:38:22.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.750+0000 7f0243232640 1 -- 172.21.15.45:0/2216332834 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f023c13e3c0 con 0x7f023c156410 2023-11-28T18:38:22.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.750+0000 7f02397fa640 1 -- 172.21.15.45:0/2216332834 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16689 (secure 0 0 0) 0x7f023c13e3c0 con 0x7f023c156410 2023-11-28T18:38:22.753 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:38:22.753 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":22,"fsid":"d10f5cd6-1d00-4019-99b6-6fa435498a15","created":"2023-11-28T18:37:08.189030+0000","modified":"2023-11-28T18:38:15.148068+0000","last_up_change":"2023-11-28T18:37:20.196124+0000","last_in_change":"2023-11-28T18:37:10.742043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T18:37:21.293917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T18:37:31.384760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T18:37:31.834769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"84465384-103c-4f2c-a45a-96f5bb9c835f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6809","nonce":555237322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6811","nonce":555237322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6815","nonce":555237322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6813","nonce":555237322}]},"public_addr":"172.21.15.45:6809/555237322","cluster_addr":"172.21.15.45:6811/555237322","heartbeat_back_addr":"172.21.15.45:6815/555237322","heartbeat_front_addr":"172.21.15.45:6813/555237322","state":["exists","up"]},{"osd":1,"uuid":"7d9eed24-a58f-42c7-a787-ac06be8553fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6801","nonce":2857063763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6803","nonce":2857063763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6807","nonce":2857063763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6805","nonce":2857063763}]},"public_addr":"172.21.15.45:6801/2857063763","cluster_addr":"172.21.15.45:6803/2857063763","heartbeat_back_addr":"172.21.15.45:6807/2857063763","heartbeat_front_addr":"172.21.15.45:6805/2857063763","state":["exists","up"]},{"osd":2,"uuid":"575eeccc-4abf-45b4-9caf-f3e797859588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6817","nonce":193884539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6819","nonce":193884539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6823","nonce":193884539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6821","nonce":193884539}]},"public_addr":"172.21.15.45:6817/193884539","cluster_addr":"172.21.15.45:6819/193884539","heartbeat_back_addr":"172.21.15.45:6823/193884539","heartbeat_front_addr":"172.21.15.45:6821/193884539","state":["exists","up"]},{"osd":3,"uuid":"9b0290d6-9a52-4bc8-b2a1-7622c5dc8e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6825","nonce":78541084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6827","nonce":78541084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6831","nonce":78541084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6829","nonce":78541084}]},"public_addr":"172.21.15.45:6825/78541084","cluster_addr":"172.21.15.45:6827/78541084","heartbeat_back_addr":"172.21.15.45:6831/78541084","heartbeat_front_addr":"172.21.15.45:6829/78541084","state":["exists","up"]},{"osd":4,"uuid":"ce632829-f027-4fbf-a627-02c571aa9d53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6809","nonce":1537591987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6811","nonce":1537591987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6815","nonce":1537591987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6813","nonce":1537591987}]},"public_addr":"172.21.15.190:6809/1537591987","cluster_addr":"172.21.15.190:6811/1537591987","heartbeat_back_addr":"172.21.15.190:6815/1537591987","heartbeat_front_addr":"172.21.15.190:6813/1537591987","state":["exists","up"]},{"osd":5,"uuid":"8700b609-27be-40bd-a251-4c0ae0a29ead","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6801","nonce":3296698407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6803","nonce":3296698407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6807","nonce":3296698407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6805","nonce":3296698407}]},"public_addr":"172.21.15.190:6801/3296698407","cluster_addr":"172.21.15.190:6803/3296698407","heartbeat_back_addr":"172.21.15.190:6807/3296698407","heartbeat_front_addr":"172.21.15.190:6805/3296698407","state":["exists","up"]},{"osd":6,"uuid":"44ce4a40-e6ff-4f4d-8e8a-7341e5c91f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6817","nonce":2317686718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6819","nonce":2317686718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6823","nonce":2317686718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6821","nonce":2317686718}]},"public_addr":"172.21.15.190:6817/2317686718","cluster_addr":"172.21.15.190:6819/2317686718","heartbeat_back_addr":"172.21.15.190:6823/2317686718","heartbeat_front_addr":"172.21.15.190:6821/2317686718","state":["exists","up"]},{"osd":7,"uuid":"192238c9-1423-4b7e-ac8f-84ba32113ddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6825","nonce":2493232051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6827","nonce":2493232051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6831","nonce":2493232051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6829","nonce":2493232051}]},"public_addr":"172.21.15.190:6825/2493232051","cluster_addr":"172.21.15.190:6827/2493232051","heartbeat_back_addr":"172.21.15.190:6831/2493232051","heartbeat_front_addr":"172.21.15.190:6829/2493232051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.393552+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.385453+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.361421+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.366408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.363226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.276007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.414605+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.445885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2},{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T18:38:22.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.754+0000 7f0243232640 1 -- 172.21.15.45:0/2216332834 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f0220066900 msgr2=0x7f0220068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:22.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.754+0000 7f0243232640 1 --2- 172.21.15.45:0/2216332834 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f0220066900 0x7f0220068dc0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0230009a80 tx=0x7f0230008040 comp rx=0 tx=0).stop 2023-11-28T18:38:22.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.754+0000 7f0243232640 1 -- 172.21.15.45:0/2216332834 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f023c156410 msgr2=0x7f023c1568c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:22.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.754+0000 7f0243232640 1 --2- 172.21.15.45:0/2216332834 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f023c156410 0x7f023c1568c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f023c15fd00 tx=0x7f023400ff10 comp rx=0 tx=0).stop 2023-11-28T18:38:22.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.754+0000 7f0243232640 1 -- 172.21.15.45:0/2216332834 shutdown_connections 2023-11-28T18:38:22.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.754+0000 7f0243232640 1 --2- 172.21.15.45:0/2216332834 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f0220066900 0x7f0220068dc0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:22.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.754+0000 7f0243232640 1 --2- 172.21.15.45:0/2216332834 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f023c156410 0x7f023c1568c0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:22.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.754+0000 7f0243232640 1 --2- 172.21.15.45:0/2216332834 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f023c0b2150 0x7f023c1ee9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:22.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.754+0000 7f0243232640 1 --2- 172.21.15.45:0/2216332834 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f022c0047d0 0x7f023c157e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:22.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.754+0000 7f0243232640 1 -- 172.21.15.45:0/2216332834 >> 172.21.15.45:0/2216332834 conn(0x7f023c06a570 msgr2=0x7f023c06cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:22.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.754+0000 7f0243232640 1 -- 172.21.15.45:0/2216332834 shutdown_connections 2023-11-28T18:38:22.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.754+0000 7f0243232640 1 -- 172.21.15.45:0/2216332834 wait complete. 2023-11-28T18:38:22.775 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-28T18:38:22.775 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T18:38:22.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.914+0000 7fbe21daa640 1 Processor -- start 2023-11-28T18:38:22.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.914+0000 7fbe21daa640 1 -- start start 2023-11-28T18:38:22.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.918+0000 7fbe21daa640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbe1c15ad80 0x7fbe1c164e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:22.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.918+0000 7fbe21daa640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe1c15b3e0 con 0x7fbe1c06ca10 2023-11-28T18:38:22.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.918+0000 7fbe21daa640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe1c13f760 con 0x7fbe1c13cf70 2023-11-28T18:38:22.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.918+0000 7fbe21daa640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe1c13d350 con 0x7fbe1c15ad80 2023-11-28T18:38:22.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.918+0000 7fbe1affd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fbe1c06ca10 0x7fbe1c15a670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59762/0 (socket says 172.21.15.45:59762) 2023-11-28T18:38:22.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.918+0000 7fbe1affd640 1 -- 172.21.15.45:0/751483084 learned_addr learned my addr 172.21.15.45:0/751483084 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:38:22.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.918+0000 7fbe1bfff640 1 --2- 172.21.15.45:0/751483084 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbe1c15ad80 0x7fbe1c164e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:22.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.918+0000 7fbe1a7fc640 1 -- 172.21.15.45:0/751483084 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1203259119 0 0) 0x7fbe1c15b3e0 con 0x7fbe1c06ca10 2023-11-28T18:38:22.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.918+0000 7fbe1a7fc640 1 -- 172.21.15.45:0/751483084 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe04005740 con 0x7fbe1c06ca10 2023-11-28T18:38:22.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.918+0000 7fbe1a7fc640 1 -- 172.21.15.45:0/751483084 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 122887313 0 0) 0x7fbe1c13f760 con 0x7fbe1c13cf70 2023-11-28T18:38:22.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.918+0000 7fbe1a7fc640 1 -- 172.21.15.45:0/751483084 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe1c15b3e0 con 0x7fbe1c13cf70 2023-11-28T18:38:22.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.918+0000 7fbe1a7fc640 1 -- 172.21.15.45:0/751483084 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2182207239 0 0) 0x7fbe04005740 con 0x7fbe1c06ca10 2023-11-28T18:38:22.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.918+0000 7fbe1bfff640 1 -- 172.21.15.45:0/751483084 >> v1:172.21.15.190:6789/0 conn(0x7fbe1c13cf70 legacy=0x7fbe1c06c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:22.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.918+0000 7fbe1bfff640 1 -- 172.21.15.45:0/751483084 >> v1:172.21.15.45:6789/0 conn(0x7fbe1c06ca10 legacy=0x7fbe1c15a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:22.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.918+0000 7fbe1bfff640 1 -- 172.21.15.45:0/751483084 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe1c13fa40 con 0x7fbe1c15ad80 2023-11-28T18:38:22.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.922+0000 7fbe1bfff640 1 --2- 172.21.15.45:0/751483084 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbe1c15ad80 0x7fbe1c164e30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbe14009dc0 tx=0x7fbe1401c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d57db8748bbe5aa7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:22.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.922+0000 7fbe1a7fc640 1 -- 172.21.15.45:0/751483084 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe10001680 con 0x7fbe1c15ad80 2023-11-28T18:38:22.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.922+0000 7fbe1a7fc640 1 -- 172.21.15.45:0/751483084 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe140a9450 con 0x7fbe1c15ad80 2023-11-28T18:38:22.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.922+0000 7fbe1a7fc640 1 -- 172.21.15.45:0/751483084 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe140a97e0 con 0x7fbe1c15ad80 2023-11-28T18:38:22.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.922+0000 7fbe21daa640 1 -- 172.21.15.45:0/751483084 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbe1c15ad80 msgr2=0x7fbe1c164e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:22.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.922+0000 7fbe21daa640 1 --2- 172.21.15.45:0/751483084 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbe1c15ad80 0x7fbe1c164e30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbe14009dc0 tx=0x7fbe1401c800 comp rx=0 tx=0).stop 2023-11-28T18:38:22.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.922+0000 7fbe21daa640 1 -- 172.21.15.45:0/751483084 shutdown_connections 2023-11-28T18:38:22.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.922+0000 7fbe21daa640 1 --2- 172.21.15.45:0/751483084 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbe1c15ad80 0x7fbe1c164e30 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:22.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.922+0000 7fbe21daa640 1 -- 172.21.15.45:0/751483084 >> 172.21.15.45:0/751483084 conn(0x7fbe1c06a570 msgr2=0x7fbe1c06a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:22.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.922+0000 7fbe21daa640 1 -- 172.21.15.45:0/751483084 shutdown_connections 2023-11-28T18:38:22.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.922+0000 7fbe21daa640 1 -- 172.21.15.45:0/751483084 wait complete. 2023-11-28T18:38:22.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.922+0000 7fbe21daa640 1 Processor -- start 2023-11-28T18:38:22.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.922+0000 7fbe21daa640 1 -- start start 2023-11-28T18:38:22.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.926+0000 7fbe21daa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbe1c06ca10 0x7fbe1c133320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:22.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.926+0000 7fbe21daa640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbe1c13cf70 0x7fbe1c1563c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:22.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.926+0000 7fbe21daa640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbe1c15ad80 0x7fbe1c159ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:22.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.926+0000 7fbe21daa640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe1c157720 con 0x7fbe1c06ca10 2023-11-28T18:38:22.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.926+0000 7fbe21daa640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe1c156aa0 con 0x7fbe1c13cf70 2023-11-28T18:38:22.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.926+0000 7fbe21daa640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe1c156d80 con 0x7fbe1c15ad80 2023-11-28T18:38:22.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.926+0000 7fbe1b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbe1c06ca10 0x7fbe1c133320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:22.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.926+0000 7fbe1b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbe1c06ca10 0x7fbe1c133320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56368/0 (socket says 172.21.15.45:56368) 2023-11-28T18:38:22.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.926+0000 7fbe1b7fe640 1 -- 172.21.15.45:0/2139303331 learned_addr learned my addr 172.21.15.45:0/2139303331 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:22.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.926+0000 7fbe1affd640 1 --2- 172.21.15.45:0/2139303331 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbe1c13cf70 0x7fbe1c1563c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:22.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.926+0000 7fbe1bfff640 1 --2- 172.21.15.45:0/2139303331 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbe1c15ad80 0x7fbe1c159ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:22.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.926+0000 7fbe1b7fe640 1 -- 172.21.15.45:0/2139303331 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbe1c15ad80 msgr2=0x7fbe1c159ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:22.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.926+0000 7fbe1b7fe640 1 --2- 172.21.15.45:0/2139303331 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbe1c15ad80 0x7fbe1c159ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:22.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.926+0000 7fbe1b7fe640 1 -- 172.21.15.45:0/2139303331 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbe1c13cf70 msgr2=0x7fbe1c1563c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:22.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.926+0000 7fbe1b7fe640 1 --2- 172.21.15.45:0/2139303331 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbe1c13cf70 0x7fbe1c1563c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:22.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.926+0000 7fbe1b7fe640 1 -- 172.21.15.45:0/2139303331 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe14009a70 con 0x7fbe1c06ca10 2023-11-28T18:38:22.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.926+0000 7fbe1b7fe640 1 --2- 172.21.15.45:0/2139303331 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbe1c06ca10 0x7fbe1c133320 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c00c490 tx=0x7fbe0c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:22.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.926+0000 7fbe03fff640 1 -- 172.21.15.45:0/2139303331 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c0052d0 con 0x7fbe1c06ca10 2023-11-28T18:38:22.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.926+0000 7fbe03fff640 1 -- 172.21.15.45:0/2139303331 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe0c005430 con 0x7fbe1c06ca10 2023-11-28T18:38:22.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.926+0000 7fbe03fff640 1 -- 172.21.15.45:0/2139303331 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c012870 con 0x7fbe1c06ca10 2023-11-28T18:38:22.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.926+0000 7fbe21daa640 1 -- 172.21.15.45:0/2139303331 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe1c157060 con 0x7fbe1c06ca10 2023-11-28T18:38:22.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.926+0000 7fbe21daa640 1 -- 172.21.15.45:0/2139303331 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe1c15a000 con 0x7fbe1c06ca10 2023-11-28T18:38:22.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.926+0000 7fbe21daa640 1 -- 172.21.15.45:0/2139303331 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe1c069480 con 0x7fbe1c06ca10 2023-11-28T18:38:22.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.930+0000 7fbe03fff640 1 -- 172.21.15.45:0/2139303331 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fbe0c0129d0 con 0x7fbe1c06ca10 2023-11-28T18:38:22.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.930+0000 7fbe03fff640 1 --2- 172.21.15.45:0/2139303331 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbe080668d0 0x7fbe08068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:22.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.930+0000 7fbe03fff640 1 -- 172.21.15.45:0/2139303331 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5804+0+0 (secure 0 0 0) 0x7fbe0c084120 con 0x7fbe1c06ca10 2023-11-28T18:38:22.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.930+0000 7fbe1affd640 1 --2- 172.21.15.45:0/2139303331 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbe080668d0 0x7fbe08068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:22.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.930+0000 7fbe1affd640 1 --2- 172.21.15.45:0/2139303331 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbe080668d0 0x7fbe08068d90 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c0cc440 tx=0x7fbe10009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:22.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:22.934+0000 7fbe03fff640 1 -- 172.21.15.45:0/2139303331 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbe0c0512f0 con 0x7fbe1c06ca10 2023-11-28T18:38:23.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.126+0000 7fbe21daa640 1 -- 172.21.15.45:0/2139303331 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbe1c06d220 con 0x7fbe1c06ca10 2023-11-28T18:38:23.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.126+0000 7fbe03fff640 1 -- 172.21.15.45:0/2139303331 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4910 (secure 0 0 0) 0x7fbe0c054910 con 0x7fbe1c06ca10 2023-11-28T18:38:23.128 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:38:23.128 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/972230763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":972230763},{"type":"v1","addr":"172.21.15.45:6835","nonce":972230763}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/4274475693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":4274475693},{"type":"v1","addr":"172.21.15.190:6837","nonce":4274475693}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/3154556740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":3154556740},{"type":"v1","addr":"172.21.15.190:6836","nonce":3154556740}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T18:37:32.842966+0000","modified":"2023-11-28T18:37:35.841966+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6834/1657221272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1657221272},{"type":"v1","addr":"172.21.15.45:6834","nonce":1657221272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T18:38:23.129 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 8 2023-11-28T18:38:23.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.126+0000 7fbe21daa640 1 -- 172.21.15.45:0/2139303331 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbe080668d0 msgr2=0x7fbe08068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:23.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.126+0000 7fbe21daa640 1 --2- 172.21.15.45:0/2139303331 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbe080668d0 0x7fbe08068d90 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c0cc440 tx=0x7fbe10009040 comp rx=0 tx=0).stop 2023-11-28T18:38:23.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.126+0000 7fbe21daa640 1 -- 172.21.15.45:0/2139303331 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbe1c06ca10 msgr2=0x7fbe1c133320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:23.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.126+0000 7fbe21daa640 1 --2- 172.21.15.45:0/2139303331 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbe1c06ca10 0x7fbe1c133320 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c00c490 tx=0x7fbe0c00c950 comp rx=0 tx=0).stop 2023-11-28T18:38:23.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.126+0000 7fbe21daa640 1 -- 172.21.15.45:0/2139303331 shutdown_connections 2023-11-28T18:38:23.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.126+0000 7fbe21daa640 1 --2- 172.21.15.45:0/2139303331 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbe080668d0 0x7fbe08068d90 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:23.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.126+0000 7fbe21daa640 1 --2- 172.21.15.45:0/2139303331 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbe1c15ad80 0x7fbe1c159ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:23.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.126+0000 7fbe21daa640 1 --2- 172.21.15.45:0/2139303331 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbe1c13cf70 0x7fbe1c1563c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:23.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.126+0000 7fbe21daa640 1 --2- 172.21.15.45:0/2139303331 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbe1c06ca10 0x7fbe1c133320 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:23.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.126+0000 7fbe21daa640 1 -- 172.21.15.45:0/2139303331 >> 172.21.15.45:0/2139303331 conn(0x7fbe1c06a570 msgr2=0x7fbe1c13db80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:23.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.126+0000 7fbe21daa640 1 -- 172.21.15.45:0/2139303331 shutdown_connections 2023-11-28T18:38:23.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.130+0000 7fbe21daa640 1 -- 172.21.15.45:0/2139303331 wait complete. 2023-11-28T18:38:23.150 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T18:38:23.256 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:38:23.262 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:38:23.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.294+0000 7f0c959aa640 1 Processor -- start 2023-11-28T18:38:23.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.294+0000 7f0c959aa640 1 -- start start 2023-11-28T18:38:23.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.294+0000 7f0c959aa640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0c900b35f0 0x7f0c900d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:23.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.294+0000 7f0c959aa640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f0c900cfed0 0x7f0c9015f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:23.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.294+0000 7f0c959aa640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c900d38c0 con 0x7f0c900b3cb0 2023-11-28T18:38:23.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.294+0000 7f0c959aa640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c900d40d0 con 0x7f0c900cfed0 2023-11-28T18:38:23.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.294+0000 7f0c959aa640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c900cdcc0 con 0x7f0c900b35f0 2023-11-28T18:38:23.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.294+0000 7f0c87fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f0c900b3cb0 0x7f0c900cf7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59768/0 (socket says 172.21.15.45:59768) 2023-11-28T18:38:23.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.294+0000 7f0c87fff640 1 -- 172.21.15.45:0/4260533147 learned_addr learned my addr 172.21.15.45:0/4260533147 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:38:23.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.294+0000 7f0c8f7fe640 1 --2- 172.21.15.45:0/4260533147 >> v2:172.21.15.190:3300/0 conn(0x7f0c900cfed0 0x7f0c9015f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:23.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.294+0000 7f0c8effd640 1 --2- 172.21.15.45:0/4260533147 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0c900b35f0 0x7f0c900d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:23.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.294+0000 7f0c8e7fc640 1 -- 172.21.15.45:0/4260533147 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2171973371 0 0) 0x7f0c900d38c0 con 0x7f0c900b3cb0 2023-11-28T18:38:23.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.294+0000 7f0c8e7fc640 1 -- 172.21.15.45:0/4260533147 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c7c003530 con 0x7f0c900b3cb0 2023-11-28T18:38:23.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.294+0000 7f0c8e7fc640 1 -- 172.21.15.45:0/4260533147 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3575369523 0 0) 0x7f0c7c003530 con 0x7f0c900b3cb0 2023-11-28T18:38:23.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.294+0000 7f0c8e7fc640 1 -- 172.21.15.45:0/4260533147 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0c900b35f0 msgr2=0x7f0c900d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:23.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.294+0000 7f0c8e7fc640 1 --2- 172.21.15.45:0/4260533147 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0c900b35f0 0x7f0c900d0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:23.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.294+0000 7f0c8e7fc640 1 -- 172.21.15.45:0/4260533147 >> v2:172.21.15.190:3300/0 conn(0x7f0c900cfed0 msgr2=0x7f0c9015f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:23.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.294+0000 7f0c8e7fc640 1 --2- 172.21.15.45:0/4260533147 >> v2:172.21.15.190:3300/0 conn(0x7f0c900cfed0 0x7f0c9015f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:23.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.294+0000 7f0c8e7fc640 1 -- 172.21.15.45:0/4260533147 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c900d3b10 con 0x7f0c900b3cb0 2023-11-28T18:38:23.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.294+0000 7f0c8e7fc640 1 -- 172.21.15.45:0/4260533147 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4084481567 0 0) 0x7f0c78001680 con 0x7f0c900b3cb0 2023-11-28T18:38:23.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.294+0000 7f0c8e7fc640 1 -- 172.21.15.45:0/4260533147 >> v1:172.21.15.45:6789/0 conn(0x7f0c900b3cb0 legacy=0x7f0c900cf7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:23.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.294+0000 7f0c8e7fc640 1 --2- 172.21.15.45:0/4260533147 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c7c003980 0x7f0c7c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:23.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.298+0000 7f0c8e7fc640 1 --2- 172.21.15.45:0/4260533147 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0c7c0047d0 0x7f0c7c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:23.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.298+0000 7f0c8e7fc640 1 --2- 172.21.15.45:0/4260533147 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0c900b35f0 0x7f0c7c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:23.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.298+0000 7f0c8e7fc640 1 -- 172.21.15.45:0/4260533147 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c900d40d0 con 0x7f0c7c003980 2023-11-28T18:38:23.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.298+0000 7f0c8e7fc640 1 -- 172.21.15.45:0/4260533147 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c900cdcc0 con 0x7f0c7c0047d0 2023-11-28T18:38:23.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.298+0000 7f0c8e7fc640 1 -- 172.21.15.45:0/4260533147 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7c00b990 con 0x7f0c900b35f0 2023-11-28T18:38:23.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.298+0000 7f0c8effd640 1 --2- 172.21.15.45:0/4260533147 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c7c003980 0x7f0c7c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:23.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.298+0000 7f0c87fff640 1 --2- 172.21.15.45:0/4260533147 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0c7c0047d0 0x7f0c7c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:23.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.298+0000 7f0c8f7fe640 1 --2- 172.21.15.45:0/4260533147 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0c900b35f0 0x7f0c7c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:23.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.298+0000 7f0c8effd640 1 -- 172.21.15.45:0/4260533147 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0c900b35f0 msgr2=0x7f0c7c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:23.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.298+0000 7f0c8effd640 1 --2- 172.21.15.45:0/4260533147 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0c900b35f0 0x7f0c7c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:23.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.298+0000 7f0c8effd640 1 -- 172.21.15.45:0/4260533147 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0c7c0047d0 msgr2=0x7f0c7c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:23.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.298+0000 7f0c8effd640 1 --2- 172.21.15.45:0/4260533147 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0c7c0047d0 0x7f0c7c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:23.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.298+0000 7f0c8effd640 1 -- 172.21.15.45:0/4260533147 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c7c003530 con 0x7f0c7c003980 2023-11-28T18:38:23.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.298+0000 7f0c87fff640 1 --2- 172.21.15.45:0/4260533147 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0c7c0047d0 0x7f0c7c004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:38:23.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.298+0000 7f0c8effd640 1 --2- 172.21.15.45:0/4260533147 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c7c003980 0x7f0c7c003da0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f0c80009ae0 tx=0x7f0c8001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e63edce8393a515f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:23.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.298+0000 7f0c8e7fc640 1 -- 172.21.15.45:0/4260533147 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c800a6460 con 0x7f0c7c003980 2023-11-28T18:38:23.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.298+0000 7f0c8e7fc640 1 -- 172.21.15.45:0/4260533147 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c800a65c0 con 0x7f0c7c003980 2023-11-28T18:38:23.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.298+0000 7f0c8e7fc640 1 -- 172.21.15.45:0/4260533147 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c800a6970 con 0x7f0c7c003980 2023-11-28T18:38:23.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.302+0000 7f0c959aa640 1 -- 172.21.15.45:0/4260533147 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c7c003980 msgr2=0x7f0c7c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:23.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.302+0000 7f0c959aa640 1 --2- 172.21.15.45:0/4260533147 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c7c003980 0x7f0c7c003da0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f0c80009ae0 tx=0x7f0c8001ca50 comp rx=0 tx=0).stop 2023-11-28T18:38:23.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.302+0000 7f0c8f7fe640 1 -- 172.21.15.45:0/4260533147 reap_dead start 2023-11-28T18:38:23.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.302+0000 7f0c959aa640 1 -- 172.21.15.45:0/4260533147 shutdown_connections 2023-11-28T18:38:23.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.302+0000 7f0c959aa640 1 -- 172.21.15.45:0/4260533147 >> 172.21.15.45:0/4260533147 conn(0x7f0c9009c4f0 msgr2=0x7f0c900d31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:23.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.302+0000 7f0c959aa640 1 -- 172.21.15.45:0/4260533147 shutdown_connections 2023-11-28T18:38:23.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.302+0000 7f0c959aa640 1 -- 172.21.15.45:0/4260533147 wait complete. 2023-11-28T18:38:23.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.302+0000 7f0c959aa640 1 Processor -- start 2023-11-28T18:38:23.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.302+0000 7f0c959aa640 1 -- start start 2023-11-28T18:38:23.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.302+0000 7f0c959aa640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0c7c003980 0x7f0c90154630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:23.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.302+0000 7f0c959aa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c900b1a90 0x7f0c900b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:23.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.302+0000 7f0c959aa640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0c900cbc80 0x7f0c900cc100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:23.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.302+0000 7f0c959aa640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c901fa8f0 con 0x7f0c900b1a90 2023-11-28T18:38:23.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.302+0000 7f0c959aa640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c900b2430 con 0x7f0c900cbc80 2023-11-28T18:38:23.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.302+0000 7f0c959aa640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c900cc640 con 0x7f0c7c003980 2023-11-28T18:38:23.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.302+0000 7f0c87fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c900b1a90 0x7f0c900b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:23.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.302+0000 7f0c8effd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0c7c003980 0x7f0c90154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:23.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.302+0000 7f0c87fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c900b1a90 0x7f0c900b1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56380/0 (socket says 172.21.15.45:56380) 2023-11-28T18:38:23.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.302+0000 7f0c87fff640 1 -- 172.21.15.45:0/4235517674 learned_addr learned my addr 172.21.15.45:0/4235517674 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:23.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.302+0000 7f0c8f7fe640 1 --2- 172.21.15.45:0/4235517674 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0c900cbc80 0x7f0c900cc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:23.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.306+0000 7f0c87fff640 1 -- 172.21.15.45:0/4235517674 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0c7c003980 msgr2=0x7f0c90154630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:23.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.306+0000 7f0c87fff640 1 --2- 172.21.15.45:0/4235517674 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0c7c003980 0x7f0c90154630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:23.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.306+0000 7f0c87fff640 1 -- 172.21.15.45:0/4235517674 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0c900cbc80 msgr2=0x7f0c900cc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:23.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.306+0000 7f0c87fff640 1 --2- 172.21.15.45:0/4235517674 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0c900cbc80 0x7f0c900cc100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:23.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.306+0000 7f0c87fff640 1 -- 172.21.15.45:0/4235517674 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c901f9ce0 con 0x7f0c900b1a90 2023-11-28T18:38:23.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.306+0000 7f0c8effd640 1 --2- 172.21.15.45:0/4235517674 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0c7c003980 0x7f0c90154630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:38:23.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.306+0000 7f0c87fff640 1 --2- 172.21.15.45:0/4235517674 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c900b1a90 0x7f0c900b1ef0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f0c78001000 tx=0x7f0c7800eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:23.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.306+0000 7f0c8cff9640 1 -- 172.21.15.45:0/4235517674 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7800c690 con 0x7f0c900b1a90 2023-11-28T18:38:23.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.306+0000 7f0c8cff9640 1 -- 172.21.15.45:0/4235517674 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c7800c7f0 con 0x7f0c900b1a90 2023-11-28T18:38:23.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.306+0000 7f0c8cff9640 1 -- 172.21.15.45:0/4235517674 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7800cb60 con 0x7f0c900b1a90 2023-11-28T18:38:23.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.306+0000 7f0c959aa640 1 -- 172.21.15.45:0/4235517674 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c901f9fc0 con 0x7f0c900b1a90 2023-11-28T18:38:23.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.306+0000 7f0c959aa640 1 -- 172.21.15.45:0/4235517674 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c901fa580 con 0x7f0c900b1a90 2023-11-28T18:38:23.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.306+0000 7f0c959aa640 1 -- 172.21.15.45:0/4235517674 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c901fa740 con 0x7f0c900b1a90 2023-11-28T18:38:23.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.306+0000 7f0c8cff9640 1 -- 172.21.15.45:0/4235517674 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f0c7800ccc0 con 0x7f0c900b1a90 2023-11-28T18:38:23.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.306+0000 7f0c8cff9640 1 --2- 172.21.15.45:0/4235517674 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f0c70066900 0x7f0c70068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:23.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.306+0000 7f0c8cff9640 1 -- 172.21.15.45:0/4235517674 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5804+0+0 (secure 0 0 0) 0x7f0c78083fa0 con 0x7f0c900b1a90 2023-11-28T18:38:23.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.310+0000 7f0c8effd640 1 --2- 172.21.15.45:0/4235517674 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f0c70066900 0x7f0c70068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:23.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.310+0000 7f0c8effd640 1 --2- 172.21.15.45:0/4235517674 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f0c70066900 0x7f0c70068dc0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0c800ad000 tx=0x7f0c800b3040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:23.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.310+0000 7f0c8cff9640 1 -- 172.21.15.45:0/4235517674 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0c78051190 con 0x7f0c900b1a90 2023-11-28T18:38:23.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.502+0000 7f0c959aa640 1 -- 172.21.15.45:0/4235517674 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0c90069480 con 0x7f0c900b1a90 2023-11-28T18:38:23.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.502+0000 7f0c8cff9640 1 -- 172.21.15.45:0/4235517674 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4910 (secure 0 0 0) 0x7f0c780547b0 con 0x7f0c900b1a90 2023-11-28T18:38:23.504 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:38:23.504 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/972230763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":972230763},{"type":"v1","addr":"172.21.15.45:6835","nonce":972230763}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/4274475693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":4274475693},{"type":"v1","addr":"172.21.15.190:6837","nonce":4274475693}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/3154556740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":3154556740},{"type":"v1","addr":"172.21.15.190:6836","nonce":3154556740}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T18:37:32.842966+0000","modified":"2023-11-28T18:37:35.841966+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6834/1657221272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1657221272},{"type":"v1","addr":"172.21.15.45:6834","nonce":1657221272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T18:38:23.505 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 8 2023-11-28T18:38:23.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.502+0000 7f0c959aa640 1 -- 172.21.15.45:0/4235517674 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f0c70066900 msgr2=0x7f0c70068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:23.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.502+0000 7f0c959aa640 1 --2- 172.21.15.45:0/4235517674 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f0c70066900 0x7f0c70068dc0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0c800ad000 tx=0x7f0c800b3040 comp rx=0 tx=0).stop 2023-11-28T18:38:23.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.502+0000 7f0c959aa640 1 -- 172.21.15.45:0/4235517674 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c900b1a90 msgr2=0x7f0c900b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:23.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.502+0000 7f0c959aa640 1 --2- 172.21.15.45:0/4235517674 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c900b1a90 0x7f0c900b1ef0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f0c78001000 tx=0x7f0c7800eba0 comp rx=0 tx=0).stop 2023-11-28T18:38:23.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.502+0000 7f0c959aa640 1 -- 172.21.15.45:0/4235517674 shutdown_connections 2023-11-28T18:38:23.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.502+0000 7f0c959aa640 1 --2- 172.21.15.45:0/4235517674 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f0c70066900 0x7f0c70068dc0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:23.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.502+0000 7f0c959aa640 1 --2- 172.21.15.45:0/4235517674 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0c900cbc80 0x7f0c900cc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:23.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.502+0000 7f0c959aa640 1 --2- 172.21.15.45:0/4235517674 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c900b1a90 0x7f0c900b1ef0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:23.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.502+0000 7f0c959aa640 1 --2- 172.21.15.45:0/4235517674 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0c7c003980 0x7f0c90154630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:23.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.502+0000 7f0c959aa640 1 -- 172.21.15.45:0/4235517674 >> 172.21.15.45:0/4235517674 conn(0x7f0c9009c4f0 msgr2=0x7f0c9015f700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:23.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.502+0000 7f0c959aa640 1 -- 172.21.15.45:0/4235517674 shutdown_connections 2023-11-28T18:38:23.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.502+0000 7f0c959aa640 1 -- 172.21.15.45:0/4235517674 wait complete. 2023-11-28T18:38:23.525 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T18:38:23.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.666+0000 7f0490772640 1 Processor -- start 2023-11-28T18:38:23.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.666+0000 7f0490772640 1 -- start start 2023-11-28T18:38:23.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.666+0000 7f0490772640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f048813cf70 0x7f048806c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:23.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.666+0000 7f0490772640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f048815b1b0 con 0x7f048815ad80 2023-11-28T18:38:23.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.666+0000 7f0490772640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f048815b3e0 con 0x7f048806c840 2023-11-28T18:38:23.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.666+0000 7f0490772640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f048813d350 con 0x7f048813cf70 2023-11-28T18:38:23.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.666+0000 7f048ed0f640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f048815ad80 0x7f04880cd8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59774/0 (socket says 172.21.15.45:59774) 2023-11-28T18:38:23.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.666+0000 7f048ed0f640 1 -- 172.21.15.45:0/3184633465 learned_addr learned my addr 172.21.15.45:0/3184633465 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:38:23.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.666+0000 7f048e50e640 1 --2- 172.21.15.45:0/3184633465 >> v2:172.21.15.190:3300/0 conn(0x7f048813cf70 0x7f048806c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:23.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.666+0000 7f048d50c640 1 -- 172.21.15.45:0/3184633465 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1422279471 0 0) 0x7f048815b1b0 con 0x7f048815ad80 2023-11-28T18:38:23.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.666+0000 7f048d50c640 1 -- 172.21.15.45:0/3184633465 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0474003530 con 0x7f048815ad80 2023-11-28T18:38:23.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.670+0000 7f048d50c640 1 -- 172.21.15.45:0/3184633465 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3793430842 0 0) 0x7f0474003530 con 0x7f048815ad80 2023-11-28T18:38:23.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.670+0000 7f048e50e640 1 -- 172.21.15.45:0/3184633465 >> v1:172.21.15.190:6789/0 conn(0x7f048806c840 legacy=0x7f048815a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:23.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.670+0000 7f048e50e640 1 -- 172.21.15.45:0/3184633465 >> v1:172.21.15.45:6789/0 conn(0x7f048815ad80 legacy=0x7f04880cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:23.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.670+0000 7f048e50e640 1 -- 172.21.15.45:0/3184633465 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f048813f760 con 0x7f048813cf70 2023-11-28T18:38:23.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.670+0000 7f048e50e640 1 --2- 172.21.15.45:0/3184633465 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f048813cf70 0x7f048806c300 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f04840097c0 tx=0x7f048401c310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d70eea4fcc3a1836 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:23.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.670+0000 7f048d50c640 1 -- 172.21.15.45:0/3184633465 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0480001a00 con 0x7f048813cf70 2023-11-28T18:38:23.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.670+0000 7f048d50c640 1 -- 172.21.15.45:0/3184633465 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04840a7050 con 0x7f048813cf70 2023-11-28T18:38:23.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.670+0000 7f048d50c640 1 -- 172.21.15.45:0/3184633465 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04840ab600 con 0x7f048813cf70 2023-11-28T18:38:23.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.670+0000 7f0490772640 1 -- 172.21.15.45:0/3184633465 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f048813cf70 msgr2=0x7f048806c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:23.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.670+0000 7f0490772640 1 --2- 172.21.15.45:0/3184633465 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f048813cf70 0x7f048806c300 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f04840097c0 tx=0x7f048401c310 comp rx=0 tx=0).stop 2023-11-28T18:38:23.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.674+0000 7f0490772640 1 -- 172.21.15.45:0/3184633465 shutdown_connections 2023-11-28T18:38:23.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.674+0000 7f0490772640 1 --2- 172.21.15.45:0/3184633465 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f048813cf70 0x7f048806c300 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:23.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.674+0000 7f0490772640 1 -- 172.21.15.45:0/3184633465 >> 172.21.15.45:0/3184633465 conn(0x7f048806a570 msgr2=0x7f048806a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:23.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.674+0000 7f0490772640 1 -- 172.21.15.45:0/3184633465 shutdown_connections 2023-11-28T18:38:23.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.674+0000 7f0490772640 1 -- 172.21.15.45:0/3184633465 wait complete. 2023-11-28T18:38:23.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.674+0000 7f0490772640 1 Processor -- start 2023-11-28T18:38:23.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.674+0000 7f0490772640 1 -- start start 2023-11-28T18:38:23.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.674+0000 7f0490772640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f048806c840 0x7f048814ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:23.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.674+0000 7f0490772640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f048813cf70 0x7f0488158040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:23.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.674+0000 7f0490772640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f048815ad80 0x7f0488158580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:23.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.674+0000 7f0490772640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0488156c10 con 0x7f048813cf70 2023-11-28T18:38:23.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.674+0000 7f0490772640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0488157990 con 0x7f048815ad80 2023-11-28T18:38:23.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.674+0000 7f0490772640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0488155ee0 con 0x7f048806c840 2023-11-28T18:38:23.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.674+0000 7f048dd0d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f048813cf70 0x7f0488158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:23.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.674+0000 7f048dd0d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f048813cf70 0x7f0488158040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56392/0 (socket says 172.21.15.45:56392) 2023-11-28T18:38:23.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.674+0000 7f048dd0d640 1 -- 172.21.15.45:0/1896656342 learned_addr learned my addr 172.21.15.45:0/1896656342 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:23.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.674+0000 7f048ed0f640 1 --2- 172.21.15.45:0/1896656342 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f048815ad80 0x7f0488158580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:23.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.674+0000 7f048e50e640 1 --2- 172.21.15.45:0/1896656342 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f048806c840 0x7f048814ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:23.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.674+0000 7f048dd0d640 1 -- 172.21.15.45:0/1896656342 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f048806c840 msgr2=0x7f048814ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:23.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.674+0000 7f048dd0d640 1 --2- 172.21.15.45:0/1896656342 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f048806c840 0x7f048814ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:23.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.674+0000 7f048dd0d640 1 -- 172.21.15.45:0/1896656342 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f048815ad80 msgr2=0x7f0488158580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:23.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.674+0000 7f048dd0d640 1 --2- 172.21.15.45:0/1896656342 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f048815ad80 0x7f0488158580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:23.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.674+0000 7f048dd0d640 1 -- 172.21.15.45:0/1896656342 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0484009420 con 0x7f048813cf70 2023-11-28T18:38:23.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.674+0000 7f048dd0d640 1 --2- 172.21.15.45:0/1896656342 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f048813cf70 0x7f0488158040 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f047800c370 tx=0x7f047800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:23.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.678+0000 7f047effd640 1 -- 172.21.15.45:0/1896656342 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04780052d0 con 0x7f048813cf70 2023-11-28T18:38:23.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.678+0000 7f047effd640 1 -- 172.21.15.45:0/1896656342 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0478005430 con 0x7f048813cf70 2023-11-28T18:38:23.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.678+0000 7f047effd640 1 -- 172.21.15.45:0/1896656342 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0478007260 con 0x7f048813cf70 2023-11-28T18:38:23.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.678+0000 7f0490772640 1 -- 172.21.15.45:0/1896656342 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0488156eb0 con 0x7f048813cf70 2023-11-28T18:38:23.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.678+0000 7f0490772640 1 -- 172.21.15.45:0/1896656342 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0488157470 con 0x7f048813cf70 2023-11-28T18:38:23.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.678+0000 7f0490772640 1 -- 172.21.15.45:0/1896656342 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0488069480 con 0x7f048813cf70 2023-11-28T18:38:23.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.678+0000 7f047effd640 1 -- 172.21.15.45:0/1896656342 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f04780073c0 con 0x7f048813cf70 2023-11-28T18:38:23.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.678+0000 7f047effd640 1 --2- 172.21.15.45:0/1896656342 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f046c066900 0x7f046c068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:23.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.678+0000 7f047effd640 1 -- 172.21.15.45:0/1896656342 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5804+0+0 (secure 0 0 0) 0x7f04780836f0 con 0x7f048813cf70 2023-11-28T18:38:23.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.678+0000 7f048e50e640 1 --2- 172.21.15.45:0/1896656342 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f046c066900 0x7f046c068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:23.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.682+0000 7f048e50e640 1 --2- 172.21.15.45:0/1896656342 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f046c066900 0x7f046c068dc0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f04840ad000 tx=0x7f0484008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:23.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.682+0000 7f047effd640 1 -- 172.21.15.45:0/1896656342 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f04780509f0 con 0x7f048813cf70 2023-11-28T18:38:23.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.846+0000 7f0490772640 1 -- 172.21.15.45:0/1896656342 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0488138690 con 0x7f048813cf70 2023-11-28T18:38:23.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.846+0000 7f047effd640 1 -- 172.21.15.45:0/1896656342 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16689 (secure 0 0 0) 0x7f0478054010 con 0x7f048813cf70 2023-11-28T18:38:23.851 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:38:23.851 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":22,"fsid":"d10f5cd6-1d00-4019-99b6-6fa435498a15","created":"2023-11-28T18:37:08.189030+0000","modified":"2023-11-28T18:38:15.148068+0000","last_up_change":"2023-11-28T18:37:20.196124+0000","last_in_change":"2023-11-28T18:37:10.742043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T18:37:21.293917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T18:37:31.384760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T18:37:31.834769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"84465384-103c-4f2c-a45a-96f5bb9c835f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6809","nonce":555237322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6811","nonce":555237322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6815","nonce":555237322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6813","nonce":555237322}]},"public_addr":"172.21.15.45:6809/555237322","cluster_addr":"172.21.15.45:6811/555237322","heartbeat_back_addr":"172.21.15.45:6815/555237322","heartbeat_front_addr":"172.21.15.45:6813/555237322","state":["exists","up"]},{"osd":1,"uuid":"7d9eed24-a58f-42c7-a787-ac06be8553fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6801","nonce":2857063763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6803","nonce":2857063763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6807","nonce":2857063763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6805","nonce":2857063763}]},"public_addr":"172.21.15.45:6801/2857063763","cluster_addr":"172.21.15.45:6803/2857063763","heartbeat_back_addr":"172.21.15.45:6807/2857063763","heartbeat_front_addr":"172.21.15.45:6805/2857063763","state":["exists","up"]},{"osd":2,"uuid":"575eeccc-4abf-45b4-9caf-f3e797859588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6817","nonce":193884539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6819","nonce":193884539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6823","nonce":193884539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6821","nonce":193884539}]},"public_addr":"172.21.15.45:6817/193884539","cluster_addr":"172.21.15.45:6819/193884539","heartbeat_back_addr":"172.21.15.45:6823/193884539","heartbeat_front_addr":"172.21.15.45:6821/193884539","state":["exists","up"]},{"osd":3,"uuid":"9b0290d6-9a52-4bc8-b2a1-7622c5dc8e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6825","nonce":78541084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6827","nonce":78541084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6831","nonce":78541084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6829","nonce":78541084}]},"public_addr":"172.21.15.45:6825/78541084","cluster_addr":"172.21.15.45:6827/78541084","heartbeat_back_addr":"172.21.15.45:6831/78541084","heartbeat_front_addr":"172.21.15.45:6829/78541084","state":["exists","up"]},{"osd":4,"uuid":"ce632829-f027-4fbf-a627-02c571aa9d53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6809","nonce":1537591987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6811","nonce":1537591987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6815","nonce":1537591987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6813","nonce":1537591987}]},"public_addr":"172.21.15.190:6809/1537591987","cluster_addr":"172.21.15.190:6811/1537591987","heartbeat_back_addr":"172.21.15.190:6815/1537591987","heartbeat_front_addr":"172.21.15.190:6813/1537591987","state":["exists","up"]},{"osd":5,"uuid":"8700b609-27be-40bd-a251-4c0ae0a29ead","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6801","nonce":3296698407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6803","nonce":3296698407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6807","nonce":3296698407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6805","nonce":3296698407}]},"public_addr":"172.21.15.190:6801/3296698407","cluster_addr":"172.21.15.190:6803/3296698407","heartbeat_back_addr":"172.21.15.190:6807/3296698407","heartbeat_front_addr":"172.21.15.190:6805/3296698407","state":["exists","up"]},{"osd":6,"uuid":"44ce4a40-e6ff-4f4d-8e8a-7341e5c91f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6817","nonce":2317686718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6819","nonce":2317686718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6823","nonce":2317686718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6821","nonce":2317686718}]},"public_addr":"172.21.15.190:6817/2317686718","cluster_addr":"172.21.15.190:6819/2317686718","heartbeat_back_addr":"172.21.15.190:6823/2317686718","heartbeat_front_addr":"172.21.15.190:6821/2317686718","state":["exists","up"]},{"osd":7,"uuid":"192238c9-1423-4b7e-ac8f-84ba32113ddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6825","nonce":2493232051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6827","nonce":2493232051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6831","nonce":2493232051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6829","nonce":2493232051}]},"public_addr":"172.21.15.190:6825/2493232051","cluster_addr":"172.21.15.190:6827/2493232051","heartbeat_back_addr":"172.21.15.190:6831/2493232051","heartbeat_front_addr":"172.21.15.190:6829/2493232051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.393552+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.385453+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.361421+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.366408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.363226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.276007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.414605+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.445885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2},{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T18:38:23.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.850+0000 7f0490772640 1 -- 172.21.15.45:0/1896656342 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f046c066900 msgr2=0x7f046c068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:23.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.850+0000 7f0490772640 1 --2- 172.21.15.45:0/1896656342 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f046c066900 0x7f046c068dc0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f04840ad000 tx=0x7f0484008040 comp rx=0 tx=0).stop 2023-11-28T18:38:23.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.850+0000 7f0490772640 1 -- 172.21.15.45:0/1896656342 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f048813cf70 msgr2=0x7f0488158040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:23.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.850+0000 7f0490772640 1 --2- 172.21.15.45:0/1896656342 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f048813cf70 0x7f0488158040 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f047800c370 tx=0x7f047800c830 comp rx=0 tx=0).stop 2023-11-28T18:38:23.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.850+0000 7f0490772640 1 -- 172.21.15.45:0/1896656342 shutdown_connections 2023-11-28T18:38:23.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.850+0000 7f0490772640 1 --2- 172.21.15.45:0/1896656342 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f046c066900 0x7f046c068dc0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:23.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.850+0000 7f0490772640 1 --2- 172.21.15.45:0/1896656342 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f048815ad80 0x7f0488158580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:23.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.850+0000 7f0490772640 1 --2- 172.21.15.45:0/1896656342 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f048813cf70 0x7f0488158040 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:23.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.850+0000 7f0490772640 1 --2- 172.21.15.45:0/1896656342 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f048806c840 0x7f048814ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:23.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.850+0000 7f0490772640 1 -- 172.21.15.45:0/1896656342 >> 172.21.15.45:0/1896656342 conn(0x7f048806a570 msgr2=0x7f048815c1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:23.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.850+0000 7f0490772640 1 -- 172.21.15.45:0/1896656342 shutdown_connections 2023-11-28T18:38:23.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:23.850+0000 7f0490772640 1 -- 172.21.15.45:0/1896656342 wait complete. 2023-11-28T18:38:23.872 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-28T18:38:24.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.014+0000 7fc0848fe640 1 Processor -- start 2023-11-28T18:38:24.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.014+0000 7fc0848fe640 1 -- start start 2023-11-28T18:38:24.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.014+0000 7fc0848fe640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fc08015d1a0 0x7fc0800aeed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:24.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.014+0000 7fc0848fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc08006cdc0 0x7fc0800ad5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:24.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.014+0000 7fc0848fe640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0800ade30 con 0x7fc08006b580 2023-11-28T18:38:24.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.014+0000 7fc0848fe640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc08006e050 con 0x7fc08015d1a0 2023-11-28T18:38:24.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.014+0000 7fc0848fe640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0800aeab0 con 0x7fc08006cdc0 2023-11-28T18:38:24.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.014+0000 7fc07e59c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fc08015d1a0 0x7fc0800aeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:24.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.014+0000 7fc077fff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc08006cdc0 0x7fc0800ad5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:24.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.014+0000 7fc07ed9d640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fc08006b580 0x7fc0800b2830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.45:37410/0 (socket says 172.21.15.45:37410) 2023-11-28T18:38:24.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.014+0000 7fc07ed9d640 1 -- 172.21.15.45:0/3343236953 learned_addr learned my addr 172.21.15.45:0/3343236953 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:38:24.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.014+0000 7fc07dd9b640 1 -- 172.21.15.45:0/3343236953 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1012125343 0 0) 0x7fc0800ade30 con 0x7fc08006b580 2023-11-28T18:38:24.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.014+0000 7fc07dd9b640 1 -- 172.21.15.45:0/3343236953 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc06c003530 con 0x7fc08006b580 2023-11-28T18:38:24.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.014+0000 7fc07e59c640 1 -- 172.21.15.45:0/3343236953 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc08006cdc0 msgr2=0x7fc0800ad5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:24.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.014+0000 7fc07e59c640 1 --2- 172.21.15.45:0/3343236953 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc08006cdc0 0x7fc0800ad5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:24.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.014+0000 7fc07e59c640 1 -- 172.21.15.45:0/3343236953 >> v1:172.21.15.190:6789/0 conn(0x7fc08006b580 legacy=0x7fc0800b2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:24.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.014+0000 7fc07e59c640 1 -- 172.21.15.45:0/3343236953 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0800ae110 con 0x7fc08015d1a0 2023-11-28T18:38:24.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.018+0000 7fc07e59c640 1 --2- 172.21.15.45:0/3343236953 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc08015d1a0 0x7fc0800aeed0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc0700097c0 tx=0x7fc07001c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68be91a3cb9e7772 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:24.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.018+0000 7fc07dd9b640 1 -- 172.21.15.45:0/3343236953 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0700ab600 con 0x7fc08015d1a0 2023-11-28T18:38:24.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.018+0000 7fc07dd9b640 1 -- 172.21.15.45:0/3343236953 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0700a7050 con 0x7fc08015d1a0 2023-11-28T18:38:24.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.018+0000 7fc07dd9b640 1 -- 172.21.15.45:0/3343236953 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0700ab980 con 0x7fc08015d1a0 2023-11-28T18:38:24.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.018+0000 7fc0848fe640 1 -- 172.21.15.45:0/3343236953 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc08015d1a0 msgr2=0x7fc0800aeed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:24.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.018+0000 7fc0848fe640 1 --2- 172.21.15.45:0/3343236953 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc08015d1a0 0x7fc0800aeed0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc0700097c0 tx=0x7fc07001c3f0 comp rx=0 tx=0).stop 2023-11-28T18:38:24.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.018+0000 7fc0848fe640 1 -- 172.21.15.45:0/3343236953 shutdown_connections 2023-11-28T18:38:24.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.018+0000 7fc0848fe640 1 --2- 172.21.15.45:0/3343236953 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc08006cdc0 0x7fc0800ad5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:24.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.018+0000 7fc0848fe640 1 --2- 172.21.15.45:0/3343236953 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc08015d1a0 0x7fc0800aeed0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:24.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.018+0000 7fc0848fe640 1 -- 172.21.15.45:0/3343236953 >> 172.21.15.45:0/3343236953 conn(0x7fc0800b1b30 msgr2=0x7fc080070d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:24.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.018+0000 7fc0848fe640 1 -- 172.21.15.45:0/3343236953 shutdown_connections 2023-11-28T18:38:24.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.018+0000 7fc0848fe640 1 -- 172.21.15.45:0/3343236953 wait complete. 2023-11-28T18:38:24.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.022+0000 7fc0848fe640 1 Processor -- start 2023-11-28T18:38:24.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.022+0000 7fc0848fe640 1 -- start start 2023-11-28T18:38:24.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.022+0000 7fc0848fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc08006b580 0x7fc080156240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:24.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.022+0000 7fc0848fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc08006cdc0 0x7fc0801578a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:24.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.022+0000 7fc0848fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc08015d1a0 0x7fc08015bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:24.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.022+0000 7fc0848fe640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc080155830 con 0x7fc08015d1a0 2023-11-28T18:38:24.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.022+0000 7fc0848fe640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc080155db0 con 0x7fc08006b580 2023-11-28T18:38:24.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.022+0000 7fc0848fe640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0801581f0 con 0x7fc08006cdc0 2023-11-28T18:38:24.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.022+0000 7fc07ed9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc08015d1a0 0x7fc08015bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:24.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.022+0000 7fc07ed9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc08015d1a0 0x7fc08015bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56394/0 (socket says 172.21.15.45:56394) 2023-11-28T18:38:24.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.022+0000 7fc07ed9d640 1 -- 172.21.15.45:0/3676119048 learned_addr learned my addr 172.21.15.45:0/3676119048 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:24.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.022+0000 7fc07e59c640 1 --2- 172.21.15.45:0/3676119048 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc08006b580 0x7fc080156240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:24.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.022+0000 7fc077fff640 1 --2- 172.21.15.45:0/3676119048 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc08006cdc0 0x7fc0801578a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:24.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.022+0000 7fc07ed9d640 1 -- 172.21.15.45:0/3676119048 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc08006cdc0 msgr2=0x7fc0801578a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:24.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.022+0000 7fc07ed9d640 1 --2- 172.21.15.45:0/3676119048 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc08006cdc0 0x7fc0801578a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:24.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.022+0000 7fc07ed9d640 1 -- 172.21.15.45:0/3676119048 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc08006b580 msgr2=0x7fc080156240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:24.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.022+0000 7fc07ed9d640 1 --2- 172.21.15.45:0/3676119048 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc08006b580 0x7fc080156240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:24.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.022+0000 7fc07ed9d640 1 -- 172.21.15.45:0/3676119048 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc070009420 con 0x7fc08015d1a0 2023-11-28T18:38:24.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.022+0000 7fc07ed9d640 1 --2- 172.21.15.45:0/3676119048 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc08015d1a0 0x7fc08015bef0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc07800caa0 tx=0x7fc07800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:24.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.022+0000 7fc076ffd640 1 -- 172.21.15.45:0/3676119048 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07800ac00 con 0x7fc08015d1a0 2023-11-28T18:38:24.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.022+0000 7fc076ffd640 1 -- 172.21.15.45:0/3676119048 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc07800ad60 con 0x7fc08015d1a0 2023-11-28T18:38:24.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.022+0000 7fc076ffd640 1 -- 172.21.15.45:0/3676119048 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc078012620 con 0x7fc08015d1a0 2023-11-28T18:38:24.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.022+0000 7fc0848fe640 1 -- 172.21.15.45:0/3676119048 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc08006bf20 con 0x7fc08015d1a0 2023-11-28T18:38:24.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.022+0000 7fc0848fe640 1 -- 172.21.15.45:0/3676119048 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc080155a40 con 0x7fc08015d1a0 2023-11-28T18:38:24.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.026+0000 7fc0848fe640 1 -- 172.21.15.45:0/3676119048 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc080155f60 con 0x7fc08015d1a0 2023-11-28T18:38:24.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.026+0000 7fc076ffd640 1 -- 172.21.15.45:0/3676119048 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fc078007070 con 0x7fc08015d1a0 2023-11-28T18:38:24.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.026+0000 7fc076ffd640 1 --2- 172.21.15.45:0/3676119048 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fc060066900 0x7fc060068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:24.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.026+0000 7fc076ffd640 1 -- 172.21.15.45:0/3676119048 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5804+0+0 (secure 0 0 0) 0x7fc078084340 con 0x7fc08015d1a0 2023-11-28T18:38:24.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.026+0000 7fc07e59c640 1 --2- 172.21.15.45:0/3676119048 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fc060066900 0x7fc060068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:24.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.026+0000 7fc07e59c640 1 --2- 172.21.15.45:0/3676119048 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fc060066900 0x7fc060068dc0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc0700ad000 tx=0x7fc070008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:24.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.030+0000 7fc076ffd640 1 -- 172.21.15.45:0/3676119048 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc080155f60 con 0x7fc08015d1a0 2023-11-28T18:38:24.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.222+0000 7fc0848fe640 1 -- 172.21.15.45:0/3676119048 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fc080155f20 con 0x7fc08015d1a0 2023-11-28T18:38:24.223 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-11-28T18:38:24.222+0000 7f5668eb3640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-28T18:38:24.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.222+0000 7fc076ffd640 1 -- 172.21.15.45:0/3676119048 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7fc0780515c0 con 0x7fc08015d1a0 2023-11-28T18:38:24.226 INFO:teuthology.orchestra.run.smithi045.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-28T18:38:24.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.226+0000 7fc0848fe640 1 -- 172.21.15.45:0/3676119048 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fc060066900 msgr2=0x7fc060068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:24.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.226+0000 7fc0848fe640 1 --2- 172.21.15.45:0/3676119048 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fc060066900 0x7fc060068dc0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc0700ad000 tx=0x7fc070008040 comp rx=0 tx=0).stop 2023-11-28T18:38:24.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.226+0000 7fc0848fe640 1 -- 172.21.15.45:0/3676119048 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc08015d1a0 msgr2=0x7fc08015bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:24.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.226+0000 7fc0848fe640 1 --2- 172.21.15.45:0/3676119048 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc08015d1a0 0x7fc08015bef0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc07800caa0 tx=0x7fc07800cf60 comp rx=0 tx=0).stop 2023-11-28T18:38:24.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.226+0000 7fc0848fe640 1 -- 172.21.15.45:0/3676119048 shutdown_connections 2023-11-28T18:38:24.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.226+0000 7fc0848fe640 1 --2- 172.21.15.45:0/3676119048 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fc060066900 0x7fc060068dc0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:24.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.226+0000 7fc0848fe640 1 --2- 172.21.15.45:0/3676119048 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc08015d1a0 0x7fc08015bef0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:24.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.226+0000 7fc0848fe640 1 --2- 172.21.15.45:0/3676119048 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc08006cdc0 0x7fc0801578a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:24.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.226+0000 7fc0848fe640 1 --2- 172.21.15.45:0/3676119048 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc08006b580 0x7fc080156240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:24.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.226+0000 7fc0848fe640 1 -- 172.21.15.45:0/3676119048 >> 172.21.15.45:0/3676119048 conn(0x7fc0800b1b30 msgr2=0x7fc080161730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:24.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.226+0000 7fc0848fe640 1 -- 172.21.15.45:0/3676119048 shutdown_connections 2023-11-28T18:38:24.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.226+0000 7fc0848fe640 1 -- 172.21.15.45:0/3676119048 wait complete. 2023-11-28T18:38:24.235 INFO:tasks.ceph.mds.c.smithi045.stderr: -2839> 2023-11-28T18:37:36.631+0000 7f21a298a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T18:38:24.250 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-28T18:38:24.284 INFO:tasks.ceph.mds.c.smithi045.stdout:starting mds.c at 2023-11-28T18:38:24.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.394+0000 7f3420c17640 1 Processor -- start 2023-11-28T18:38:24.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.394+0000 7f3420c17640 1 -- start start 2023-11-28T18:38:24.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.394+0000 7f3420c17640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f341c15e5d0 0x7f341c0ce5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:24.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.394+0000 7f3420c17640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f341c0b3b00 0x7f341c0ad940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:24.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.394+0000 7f3420c17640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f341c0ce370 con 0x7f341c0ade80 2023-11-28T18:38:24.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.394+0000 7f3420c17640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f341c06d030 con 0x7f341c15e5d0 2023-11-28T18:38:24.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.394+0000 7f3420c17640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f341c15e9b0 con 0x7f341c0b3b00 2023-11-28T18:38:24.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.398+0000 7f341b7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f341c15e5d0 0x7f341c0ce5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:24.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.398+0000 7f341b7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f341c15e5d0 0x7f341c0ce5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56424/0 (socket says 172.21.15.45:56424) 2023-11-28T18:38:24.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.398+0000 7f341b7fe640 1 -- 172.21.15.45:0/4145717594 learned_addr learned my addr 172.21.15.45:0/4145717594 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:24.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.398+0000 7f3413fff640 1 --2- 172.21.15.45:0/4145717594 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f341c0b3b00 0x7f341c0ad940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:24.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.398+0000 7f341b7fe640 1 -- 172.21.15.45:0/4145717594 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f341c0b3b00 msgr2=0x7f341c0ad940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:24.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.398+0000 7f341b7fe640 1 --2- 172.21.15.45:0/4145717594 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f341c0b3b00 0x7f341c0ad940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:24.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.398+0000 7f341b7fe640 1 -- 172.21.15.45:0/4145717594 >> v1:172.21.15.45:6789/0 conn(0x7f341c0ade80 legacy=0x7f341c15ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:24.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.398+0000 7f341b7fe640 1 -- 172.21.15.45:0/4145717594 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f341c0b2ce0 con 0x7f341c15e5d0 2023-11-28T18:38:24.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.398+0000 7f341affd640 1 -- 172.21.15.45:0/4145717594 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3601188366 0 0) 0x7f341c0ce370 con 0x7f341c0ade80 2023-11-28T18:38:24.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.398+0000 7f341b7fe640 1 --2- 172.21.15.45:0/4145717594 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f341c15e5d0 0x7f341c0ce5e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f340c009870 tx=0x7f340c01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4069fde1db8f105a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:24.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.398+0000 7f341affd640 1 -- 172.21.15.45:0/4145717594 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340c0ab600 con 0x7f341c15e5d0 2023-11-28T18:38:24.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.398+0000 7f341affd640 1 -- 172.21.15.45:0/4145717594 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f340c0a7050 con 0x7f341c15e5d0 2023-11-28T18:38:24.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.398+0000 7f341affd640 1 -- 172.21.15.45:0/4145717594 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340c0ab980 con 0x7f341c15e5d0 2023-11-28T18:38:24.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.402+0000 7f3420c17640 1 -- 172.21.15.45:0/4145717594 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f341c15e5d0 msgr2=0x7f341c0ce5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:24.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.402+0000 7f3420c17640 1 --2- 172.21.15.45:0/4145717594 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f341c15e5d0 0x7f341c0ce5e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f340c009870 tx=0x7f340c01c4b0 comp rx=0 tx=0).stop 2023-11-28T18:38:24.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.402+0000 7f3420c17640 1 -- 172.21.15.45:0/4145717594 shutdown_connections 2023-11-28T18:38:24.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.402+0000 7f3420c17640 1 --2- 172.21.15.45:0/4145717594 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f341c0b3b00 0x7f341c0ad940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:24.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.402+0000 7f3420c17640 1 --2- 172.21.15.45:0/4145717594 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f341c15e5d0 0x7f341c0ce5e0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:24.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.402+0000 7f3420c17640 1 -- 172.21.15.45:0/4145717594 >> 172.21.15.45:0/4145717594 conn(0x7f341c0b0960 msgr2=0x7f341c0b0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:24.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.402+0000 7f3420c17640 1 -- 172.21.15.45:0/4145717594 shutdown_connections 2023-11-28T18:38:24.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.402+0000 7f3420c17640 1 -- 172.21.15.45:0/4145717594 wait complete. 2023-11-28T18:38:24.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.402+0000 7f3420c17640 1 Processor -- start 2023-11-28T18:38:24.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.402+0000 7f3420c17640 1 -- start start 2023-11-28T18:38:24.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.402+0000 7f3420c17640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f341c0ade80 0x7f341c14c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:24.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.402+0000 7f3420c17640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f341c0b3b00 0x7f341c09bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:24.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.402+0000 7f3420c17640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f341c15e5d0 0x7f341c13e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:24.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.402+0000 7f3420c17640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f341c14d9c0 con 0x7f341c15e5d0 2023-11-28T18:38:24.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.402+0000 7f3420c17640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f341c09c070 con 0x7f341c0ade80 2023-11-28T18:38:24.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.402+0000 7f3420c17640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f341c14cd40 con 0x7f341c0b3b00 2023-11-28T18:38:24.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.402+0000 7f341bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f341c15e5d0 0x7f341c13e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:24.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.406+0000 7f341bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f341c15e5d0 0x7f341c13e3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56432/0 (socket says 172.21.15.45:56432) 2023-11-28T18:38:24.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.406+0000 7f341bfff640 1 -- 172.21.15.45:0/594260457 learned_addr learned my addr 172.21.15.45:0/594260457 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:24.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.406+0000 7f341b7fe640 1 --2- 172.21.15.45:0/594260457 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f341c0ade80 0x7f341c14c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:24.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.406+0000 7f3413fff640 1 --2- 172.21.15.45:0/594260457 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f341c0b3b00 0x7f341c09bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:24.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.406+0000 7f341bfff640 1 -- 172.21.15.45:0/594260457 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f341c0b3b00 msgr2=0x7f341c09bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:24.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.406+0000 7f341bfff640 1 --2- 172.21.15.45:0/594260457 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f341c0b3b00 0x7f341c09bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:24.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.406+0000 7f341bfff640 1 -- 172.21.15.45:0/594260457 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f341c0ade80 msgr2=0x7f341c14c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:24.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.406+0000 7f341bfff640 1 --2- 172.21.15.45:0/594260457 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f341c0ade80 0x7f341c14c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:24.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.406+0000 7f341bfff640 1 -- 172.21.15.45:0/594260457 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f340c0094d0 con 0x7f341c15e5d0 2023-11-28T18:38:24.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.406+0000 7f341bfff640 1 --2- 172.21.15.45:0/594260457 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f341c15e5d0 0x7f341c13e3d0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f341400c780 tx=0x7f341400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:24.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.406+0000 7f3418ff9640 1 -- 172.21.15.45:0/594260457 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3414003db0 con 0x7f341c15e5d0 2023-11-28T18:38:24.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.406+0000 7f3418ff9640 1 -- 172.21.15.45:0/594260457 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f341400ce90 con 0x7f341c15e5d0 2023-11-28T18:38:24.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.406+0000 7f3418ff9640 1 -- 172.21.15.45:0/594260457 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34140052b0 con 0x7f341c15e5d0 2023-11-28T18:38:24.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.406+0000 7f3420c17640 1 -- 172.21.15.45:0/594260457 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f341c14d020 con 0x7f341c15e5d0 2023-11-28T18:38:24.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.406+0000 7f3420c17640 1 -- 172.21.15.45:0/594260457 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f341c14d5e0 con 0x7f341c15e5d0 2023-11-28T18:38:24.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.406+0000 7f3420c17640 1 -- 172.21.15.45:0/594260457 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f341c09d0c0 con 0x7f341c15e5d0 2023-11-28T18:38:24.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.406+0000 7f3418ff9640 1 -- 172.21.15.45:0/594260457 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f3414005410 con 0x7f341c15e5d0 2023-11-28T18:38:24.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.406+0000 7f3418ff9640 1 --2- 172.21.15.45:0/594260457 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f33fc0668d0 0x7f33fc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:24.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.406+0000 7f3418ff9640 1 -- 172.21.15.45:0/594260457 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5890+0+0 (secure 0 0 0) 0x7f34140841b0 con 0x7f341c15e5d0 2023-11-28T18:38:24.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.410+0000 7f341b7fe640 1 --2- 172.21.15.45:0/594260457 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f33fc0668d0 0x7f33fc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:24.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.410+0000 7f341b7fe640 1 --2- 172.21.15.45:0/594260457 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f33fc0668d0 0x7f33fc068d90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f340c0ad000 tx=0x7f340c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:24.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.410+0000 7f3418ff9640 1 -- 172.21.15.45:0/594260457 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3414051470 con 0x7f341c15e5d0 2023-11-28T18:38:24.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:24.605+0000 7f3420c17640 1 -- 172.21.15.45:0/594260457 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f341c04e970 con 0x7f341c15e5d0 2023-11-28T18:38:25.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.225+0000 7f3418ff9640 1 -- 172.21.15.45:0/594260457 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3414054a90 con 0x7f341c15e5d0 2023-11-28T18:38:25.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.229+0000 7f3420c17640 1 -- 172.21.15.45:0/594260457 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f33fc0668d0 msgr2=0x7f33fc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:25.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.229+0000 7f3420c17640 1 --2- 172.21.15.45:0/594260457 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f33fc0668d0 0x7f33fc068d90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f340c0ad000 tx=0x7f340c0a6000 comp rx=0 tx=0).stop 2023-11-28T18:38:25.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.229+0000 7f3420c17640 1 -- 172.21.15.45:0/594260457 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f341c15e5d0 msgr2=0x7f341c13e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:25.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.229+0000 7f3420c17640 1 --2- 172.21.15.45:0/594260457 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f341c15e5d0 0x7f341c13e3d0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f341400c780 tx=0x7f341400cc40 comp rx=0 tx=0).stop 2023-11-28T18:38:25.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.229+0000 7f3420c17640 1 -- 172.21.15.45:0/594260457 shutdown_connections 2023-11-28T18:38:25.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.229+0000 7f3420c17640 1 --2- 172.21.15.45:0/594260457 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f33fc0668d0 0x7f33fc068d90 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:25.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.229+0000 7f3420c17640 1 --2- 172.21.15.45:0/594260457 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f341c15e5d0 0x7f341c13e3d0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:25.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.229+0000 7f3420c17640 1 --2- 172.21.15.45:0/594260457 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f341c0b3b00 0x7f341c09bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:25.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.229+0000 7f3420c17640 1 --2- 172.21.15.45:0/594260457 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f341c0ade80 0x7f341c14c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:25.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.229+0000 7f3420c17640 1 -- 172.21.15.45:0/594260457 >> 172.21.15.45:0/594260457 conn(0x7f341c0b0960 msgr2=0x7f341c0afb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:25.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.229+0000 7f3420c17640 1 -- 172.21.15.45:0/594260457 shutdown_connections 2023-11-28T18:38:25.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.229+0000 7f3420c17640 1 -- 172.21.15.45:0/594260457 wait complete. 2023-11-28T18:38:25.255 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-28T18:38:25.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.445+0000 7f9f9ee9a640 1 Processor -- start 2023-11-28T18:38:25.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.445+0000 7f9f9ee9a640 1 -- start start 2023-11-28T18:38:25.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.449+0000 7f9f9ee9a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9f9815b280 0x7f9f98071c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:25.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.449+0000 7f9f9ee9a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f980b19c0 0x7f9f98072180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:25.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.449+0000 7f9f9ee9a640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f9f980726c0 0x7f9f980ae450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:25.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.449+0000 7f9f9ee9a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f98067e90 con 0x7f9f9815b280 2023-11-28T18:38:25.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.449+0000 7f9f9ee9a640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f9815b660 con 0x7f9f980726c0 2023-11-28T18:38:25.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.449+0000 7f9f9ee9a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f980cb6a0 con 0x7f9f980b19c0 2023-11-28T18:38:25.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.449+0000 7f9f9cc36640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9f9815b280 0x7f9f98071c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:25.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.449+0000 7f9f9cc36640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9f9815b280 0x7f9f98071c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56434/0 (socket says 172.21.15.45:56434) 2023-11-28T18:38:25.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.449+0000 7f9f9cc36640 1 -- 172.21.15.45:0/1854575849 learned_addr learned my addr 172.21.15.45:0/1854575849 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:25.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.449+0000 7f9f9cc36640 1 -- 172.21.15.45:0/1854575849 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f980b19c0 msgr2=0x7f9f98072180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:25.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.449+0000 7f9f97fff640 1 --2- 172.21.15.45:0/1854575849 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f980b19c0 0x7f9f98072180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:25.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.449+0000 7f9f9d437640 1 --2- 172.21.15.45:0/1854575849 >> v2:172.21.15.190:3300/0 conn(0x7f9f980726c0 0x7f9f980ae450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:25.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.449+0000 7f9f9cc36640 1 --2- 172.21.15.45:0/1854575849 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f980b19c0 0x7f9f98072180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:25.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.449+0000 7f9f9cc36640 1 -- 172.21.15.45:0/1854575849 >> v2:172.21.15.190:3300/0 conn(0x7f9f980726c0 msgr2=0x7f9f980ae450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:25.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.449+0000 7f9f9cc36640 1 --2- 172.21.15.45:0/1854575849 >> v2:172.21.15.190:3300/0 conn(0x7f9f980726c0 0x7f9f980ae450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:25.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.449+0000 7f9f9cc36640 1 -- 172.21.15.45:0/1854575849 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f980adfc0 con 0x7f9f9815b280 2023-11-28T18:38:25.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.449+0000 7f9f97fff640 1 --2- 172.21.15.45:0/1854575849 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f980b19c0 0x7f9f98072180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:38:25.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.449+0000 7f9f9d437640 1 --2- 172.21.15.45:0/1854575849 >> v2:172.21.15.190:3300/0 conn(0x7f9f980726c0 0x7f9f980ae450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:38:25.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.453+0000 7f9f9cc36640 1 --2- 172.21.15.45:0/1854575849 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f9815b280 0x7f9f98071c40 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f9f98071630 tx=0x7f9f8c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=915a4c94b94c8110 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:25.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.453+0000 7f9f977fe640 1 -- 172.21.15.45:0/1854575849 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c0a7070 con 0x7f9f9815b280 2023-11-28T18:38:25.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.453+0000 7f9f977fe640 1 -- 172.21.15.45:0/1854575849 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f8c0ab430 con 0x7f9f9815b280 2023-11-28T18:38:25.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.453+0000 7f9f977fe640 1 -- 172.21.15.45:0/1854575849 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c0ab7c0 con 0x7f9f9815b280 2023-11-28T18:38:25.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.453+0000 7f9f9ee9a640 1 -- 172.21.15.45:0/1854575849 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f9815b280 msgr2=0x7f9f98071c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:25.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.453+0000 7f9f9ee9a640 1 --2- 172.21.15.45:0/1854575849 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f9815b280 0x7f9f98071c40 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f9f98071630 tx=0x7f9f8c01c470 comp rx=0 tx=0).stop 2023-11-28T18:38:25.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.453+0000 7f9f9ee9a640 1 -- 172.21.15.45:0/1854575849 shutdown_connections 2023-11-28T18:38:25.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.453+0000 7f9f9ee9a640 1 --2- 172.21.15.45:0/1854575849 >> v2:172.21.15.190:3300/0 conn(0x7f9f980726c0 0x7f9f980ae450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:25.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.453+0000 7f9f9ee9a640 1 --2- 172.21.15.45:0/1854575849 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f980b19c0 0x7f9f98072180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:25.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.453+0000 7f9f9ee9a640 1 --2- 172.21.15.45:0/1854575849 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f9815b280 0x7f9f98071c40 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:25.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.453+0000 7f9f9ee9a640 1 -- 172.21.15.45:0/1854575849 >> 172.21.15.45:0/1854575849 conn(0x7f9f980b0ea0 msgr2=0x7f9f980b12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:25.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.453+0000 7f9f9ee9a640 1 -- 172.21.15.45:0/1854575849 shutdown_connections 2023-11-28T18:38:25.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.453+0000 7f9f9ee9a640 1 -- 172.21.15.45:0/1854575849 wait complete. 2023-11-28T18:38:25.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.453+0000 7f9f9ee9a640 1 Processor -- start 2023-11-28T18:38:25.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.453+0000 7f9f9ee9a640 1 -- start start 2023-11-28T18:38:25.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.457+0000 7f9f9ee9a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9f980726c0 0x7f9f980989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:25.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.457+0000 7f9f9ee9a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f980b19c0 0x7f9f9815c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:25.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.457+0000 7f9f9ee9a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f9815b280 0x7f9f980cdc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:25.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.457+0000 7f9f9ee9a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f98098f00 con 0x7f9f980b19c0 2023-11-28T18:38:25.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.457+0000 7f9f9ee9a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9815d590 con 0x7f9f980726c0 2023-11-28T18:38:25.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.457+0000 7f9f9ee9a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9815c720 con 0x7f9f9815b280 2023-11-28T18:38:25.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.457+0000 7f9f97fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f980b19c0 0x7f9f9815c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:25.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.457+0000 7f9f97fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f980b19c0 0x7f9f9815c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56436/0 (socket says 172.21.15.45:56436) 2023-11-28T18:38:25.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.457+0000 7f9f97fff640 1 -- 172.21.15.45:0/205950354 learned_addr learned my addr 172.21.15.45:0/205950354 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:25.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.457+0000 7f9f9cc36640 1 --2- 172.21.15.45:0/205950354 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9f980726c0 0x7f9f980989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:25.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.457+0000 7f9f9d437640 1 --2- 172.21.15.45:0/205950354 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f9815b280 0x7f9f980cdc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:25.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.457+0000 7f9f97fff640 1 -- 172.21.15.45:0/205950354 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f9815b280 msgr2=0x7f9f980cdc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:25.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.457+0000 7f9f97fff640 1 --2- 172.21.15.45:0/205950354 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f9815b280 0x7f9f980cdc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:25.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.457+0000 7f9f97fff640 1 -- 172.21.15.45:0/205950354 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9f980726c0 msgr2=0x7f9f980989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:25.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.457+0000 7f9f97fff640 1 --2- 172.21.15.45:0/205950354 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9f980726c0 0x7f9f980989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:25.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.457+0000 7f9f97fff640 1 -- 172.21.15.45:0/205950354 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f8c0094d0 con 0x7f9f980b19c0 2023-11-28T18:38:25.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.457+0000 7f9f97fff640 1 --2- 172.21.15.45:0/205950354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f980b19c0 0x7f9f9815c1e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9f8400c7c0 tx=0x7f9f8400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:25.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.457+0000 7f9f957fa640 1 -- 172.21.15.45:0/205950354 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f84007a30 con 0x7f9f980b19c0 2023-11-28T18:38:25.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.457+0000 7f9f957fa640 1 -- 172.21.15.45:0/205950354 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f84007b90 con 0x7f9f980b19c0 2023-11-28T18:38:25.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.457+0000 7f9f957fa640 1 -- 172.21.15.45:0/205950354 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8400ce70 con 0x7f9f980b19c0 2023-11-28T18:38:25.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.457+0000 7f9f9ee9a640 1 -- 172.21.15.45:0/205950354 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f9815c980 con 0x7f9f980b19c0 2023-11-28T18:38:25.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.457+0000 7f9f9ee9a640 1 -- 172.21.15.45:0/205950354 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f9815cf40 con 0x7f9f980b19c0 2023-11-28T18:38:25.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.457+0000 7f9f9ee9a640 1 -- 172.21.15.45:0/205950354 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f9815d740 con 0x7f9f980b19c0 2023-11-28T18:38:25.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.461+0000 7f9f957fa640 1 -- 172.21.15.45:0/205950354 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f9f840113f0 con 0x7f9f980b19c0 2023-11-28T18:38:25.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.461+0000 7f9f957fa640 1 --2- 172.21.15.45:0/205950354 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9f7c0668d0 0x7f9f7c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:25.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.461+0000 7f9f957fa640 1 -- 172.21.15.45:0/205950354 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5890+0+0 (secure 0 0 0) 0x7f9f840848f0 con 0x7f9f980b19c0 2023-11-28T18:38:25.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.461+0000 7f9f9cc36640 1 --2- 172.21.15.45:0/205950354 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9f7c0668d0 0x7f9f7c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:25.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.461+0000 7f9f9cc36640 1 --2- 172.21.15.45:0/205950354 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9f7c0668d0 0x7f9f7c068d90 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c0af000 tx=0x7f9f8c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:25.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.465+0000 7f9f957fa640 1 -- 172.21.15.45:0/205950354 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9f9815d740 con 0x7f9f980b19c0 2023-11-28T18:38:25.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:25.621+0000 7f9f9ee9a640 1 -- 172.21.15.45:0/205950354 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9f9815d700 con 0x7f9f980b19c0 2023-11-28T18:38:26.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:26.229+0000 7f9f957fa640 1 -- 172.21.15.45:0/205950354 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) v1 ==== 181+0+0 (secure 0 0 0) 0x7f9f840555a0 con 0x7f9f980b19c0 2023-11-28T18:38:26.235 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' removed 2023-11-28T18:38:26.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:26.233+0000 7f9f9ee9a640 1 -- 172.21.15.45:0/205950354 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9f7c0668d0 msgr2=0x7f9f7c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:26.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:26.233+0000 7f9f9ee9a640 1 --2- 172.21.15.45:0/205950354 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9f7c0668d0 0x7f9f7c068d90 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c0af000 tx=0x7f9f8c008040 comp rx=0 tx=0).stop 2023-11-28T18:38:26.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:26.233+0000 7f9f9ee9a640 1 -- 172.21.15.45:0/205950354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f980b19c0 msgr2=0x7f9f9815c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:26.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:26.233+0000 7f9f9ee9a640 1 --2- 172.21.15.45:0/205950354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f980b19c0 0x7f9f9815c1e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9f8400c7c0 tx=0x7f9f8400cc80 comp rx=0 tx=0).stop 2023-11-28T18:38:26.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:26.233+0000 7f9f9ee9a640 1 -- 172.21.15.45:0/205950354 shutdown_connections 2023-11-28T18:38:26.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:26.233+0000 7f9f9ee9a640 1 --2- 172.21.15.45:0/205950354 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9f7c0668d0 0x7f9f7c068d90 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:26.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:26.233+0000 7f9f9ee9a640 1 --2- 172.21.15.45:0/205950354 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f9815b280 0x7f9f980cdc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:26.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:26.233+0000 7f9f9ee9a640 1 --2- 172.21.15.45:0/205950354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f980b19c0 0x7f9f9815c1e0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:26.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:26.233+0000 7f9f9ee9a640 1 --2- 172.21.15.45:0/205950354 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9f980726c0 0x7f9f980989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:26.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:26.233+0000 7f9f9ee9a640 1 -- 172.21.15.45:0/205950354 >> 172.21.15.45:0/205950354 conn(0x7f9f980b0ea0 msgr2=0x7f9f98156740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:26.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:26.233+0000 7f9f9ee9a640 1 -- 172.21.15.45:0/205950354 shutdown_connections 2023-11-28T18:38:26.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:26.233+0000 7f9f9ee9a640 1 -- 172.21.15.45:0/205950354 wait complete. 2023-11-28T18:38:26.264 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-28T18:38:26.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:26.417+0000 7f2ef832a640 1 Processor -- start 2023-11-28T18:38:26.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:26.417+0000 7f2ef832a640 1 -- start start 2023-11-28T18:38:26.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:26.417+0000 7f2ef832a640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f2ef015a4c0 0x7f2ef00ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:26.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:26.417+0000 7f2ef832a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2ef006d730 0x7f2ef006dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:26.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:26.417+0000 7f2ef832a640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ef00ce3b0 con 0x7f2ef00ae660 2023-11-28T18:38:26.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:26.417+0000 7f2ef832a640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ef00cd5b0 con 0x7f2ef015a4c0 2023-11-28T18:38:26.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:26.417+0000 7f2ef832a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef006e0e0 con 0x7f2ef006d730 2023-11-28T18:38:26.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:26.417+0000 7f2ef68c7640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2ef006d730 0x7f2ef006dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:26.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:26.417+0000 7f2ef60c6640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f2ef015a4c0 0x7f2ef00ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:26.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:26.417+0000 7f2ef68c7640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2ef006d730 0x7f2ef006dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.45:52572/0 (socket says 172.21.15.45:52572) 2023-11-28T18:38:26.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:26.417+0000 7f2ef58c5640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f2ef00ae660 0x7f2ef00ccea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.45:37432/0 (socket says 172.21.15.45:37432) 2023-11-28T18:38:26.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:26.417+0000 7f2ef68c7640 1 -- 172.21.15.45:0/3520090772 learned_addr learned my addr 172.21.15.45:0/3520090772 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:26.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:26.417+0000 7f2ef68c7640 1 -- 172.21.15.45:0/3520090772 >> v2:172.21.15.190:3300/0 conn(0x7f2ef015a4c0 msgr2=0x7f2ef00ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:26.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:26.417+0000 7f2ef68c7640 1 --2- 172.21.15.45:0/3520090772 >> v2:172.21.15.190:3300/0 conn(0x7f2ef015a4c0 0x7f2ef00ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:26.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:26.417+0000 7f2ef68c7640 1 -- 172.21.15.45:0/3520090772 >> v1:172.21.15.190:6789/0 conn(0x7f2ef00ae660 legacy=0x7f2ef00ccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:26.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:26.417+0000 7f2ef68c7640 1 -- 172.21.15.45:0/3520090772 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ef00cd7a0 con 0x7f2ef006d730 2023-11-28T18:38:26.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:26.417+0000 7f2ef60c6640 1 --2- 172.21.15.45:0/3520090772 >> v2:172.21.15.190:3300/0 conn(0x7f2ef015a4c0 0x7f2ef00ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:38:26.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:26.421+0000 7f2ef68c7640 1 --2- 172.21.15.45:0/3520090772 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2ef006d730 0x7f2ef006dba0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2ee8009e50 tx=0x7f2ee801ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a540c2dfe87369cd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:26.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:26.421+0000 7f2ef50c4640 1 -- 172.21.15.45:0/3520090772 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee80a58e0 con 0x7f2ef006d730 2023-11-28T18:38:26.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:26.421+0000 7f2ef50c4640 1 -- 172.21.15.45:0/3520090772 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ee80a5a40 con 0x7f2ef006d730 2023-11-28T18:38:26.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:26.421+0000 7f2ef50c4640 1 -- 172.21.15.45:0/3520090772 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee80a5dd0 con 0x7f2ef006d730 2023-11-28T18:38:26.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:26.421+0000 7f2ef832a640 1 -- 172.21.15.45:0/3520090772 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2ef006d730 msgr2=0x7f2ef006dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:26.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:26.421+0000 7f2ef832a640 1 --2- 172.21.15.45:0/3520090772 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2ef006d730 0x7f2ef006dba0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2ee8009e50 tx=0x7f2ee801ca10 comp rx=0 tx=0).stop 2023-11-28T18:38:26.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:26.421+0000 7f2ef832a640 1 -- 172.21.15.45:0/3520090772 shutdown_connections 2023-11-28T18:38:26.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:26.421+0000 7f2ef832a640 1 --2- 172.21.15.45:0/3520090772 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2ef006d730 0x7f2ef006dba0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:26.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:26.421+0000 7f2ef832a640 1 --2- 172.21.15.45:0/3520090772 >> v2:172.21.15.190:3300/0 conn(0x7f2ef015a4c0 0x7f2ef00ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:26.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:26.421+0000 7f2ef832a640 1 -- 172.21.15.45:0/3520090772 >> 172.21.15.45:0/3520090772 conn(0x7f2ef00b0c90 msgr2=0x7f2ef00b10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:26.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:26.421+0000 7f2ef832a640 1 -- 172.21.15.45:0/3520090772 shutdown_connections 2023-11-28T18:38:26.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:26.421+0000 7f2ef832a640 1 -- 172.21.15.45:0/3520090772 wait complete. 2023-11-28T18:38:26.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:26.425+0000 7f2ef832a640 1 Processor -- start 2023-11-28T18:38:26.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:26.425+0000 7f2ef832a640 1 -- start start 2023-11-28T18:38:26.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:26.425+0000 7f2ef832a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2ef006d730 0x7f2ef009ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:26.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:26.425+0000 7f2ef832a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2ef00ae660 0x7f2ef014e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:26.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:26.425+0000 7f2ef832a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ef015a4c0 0x7f2ef00aff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:26.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:26.425+0000 7f2ef832a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef015a8a0 con 0x7f2ef015a4c0 2023-11-28T18:38:26.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:26.425+0000 7f2ef832a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef015b140 con 0x7f2ef006d730 2023-11-28T18:38:26.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:26.425+0000 7f2ef832a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef014e690 con 0x7f2ef00ae660 2023-11-28T18:38:26.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:26.425+0000 7f2ef68c7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ef015a4c0 0x7f2ef00aff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:26.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:26.425+0000 7f2ef68c7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ef015a4c0 0x7f2ef00aff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56442/0 (socket says 172.21.15.45:56442) 2023-11-28T18:38:26.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:26.425+0000 7f2ef68c7640 1 -- 172.21.15.45:0/1333941055 learned_addr learned my addr 172.21.15.45:0/1333941055 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:26.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:26.425+0000 7f2ef60c6640 1 --2- 172.21.15.45:0/1333941055 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2ef006d730 0x7f2ef009ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:26.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:26.425+0000 7f2ef58c5640 1 --2- 172.21.15.45:0/1333941055 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2ef00ae660 0x7f2ef014e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:26.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:26.425+0000 7f2ef68c7640 1 -- 172.21.15.45:0/1333941055 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2ef00ae660 msgr2=0x7f2ef014e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:26.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:26.425+0000 7f2ef68c7640 1 --2- 172.21.15.45:0/1333941055 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2ef00ae660 0x7f2ef014e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:26.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:26.425+0000 7f2ef68c7640 1 -- 172.21.15.45:0/1333941055 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2ef006d730 msgr2=0x7f2ef009ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:26.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:26.425+0000 7f2ef68c7640 1 --2- 172.21.15.45:0/1333941055 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2ef006d730 0x7f2ef009ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:26.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:26.425+0000 7f2ef68c7640 1 -- 172.21.15.45:0/1333941055 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eec00b6c0 con 0x7f2ef015a4c0 2023-11-28T18:38:26.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:26.425+0000 7f2ef68c7640 1 --2- 172.21.15.45:0/1333941055 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ef015a4c0 0x7f2ef00aff80 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f2ee801a640 tx=0x7f2ee80197b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:26.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:26.425+0000 7f2ee6ffd640 1 -- 172.21.15.45:0/1333941055 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee80b8670 con 0x7f2ef015a4c0 2023-11-28T18:38:26.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:26.425+0000 7f2ee6ffd640 1 -- 172.21.15.45:0/1333941055 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ee80b87d0 con 0x7f2ef015a4c0 2023-11-28T18:38:26.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:26.425+0000 7f2ee6ffd640 1 -- 172.21.15.45:0/1333941055 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee80b8b80 con 0x7f2ef015a4c0 2023-11-28T18:38:26.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:26.425+0000 7f2ef832a640 1 -- 172.21.15.45:0/1333941055 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ee8009b30 con 0x7f2ef015a4c0 2023-11-28T18:38:26.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:26.425+0000 7f2ef832a640 1 -- 172.21.15.45:0/1333941055 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ef015aaf0 con 0x7f2ef015a4c0 2023-11-28T18:38:26.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:26.429+0000 7f2ef832a640 1 -- 172.21.15.45:0/1333941055 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ef004e890 con 0x7f2ef015a4c0 2023-11-28T18:38:26.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:26.429+0000 7f2ee6ffd640 1 -- 172.21.15.45:0/1333941055 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f2ee80b8ce0 con 0x7f2ef015a4c0 2023-11-28T18:38:26.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:26.429+0000 7f2ee6ffd640 1 --2- 172.21.15.45:0/1333941055 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f2ed40668d0 0x7f2ed4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:26.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:26.429+0000 7f2ee6ffd640 1 -- 172.21.15.45:0/1333941055 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5452+0+0 (secure 0 0 0) 0x7f2ee811f720 con 0x7f2ef015a4c0 2023-11-28T18:38:26.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:26.429+0000 7f2ef60c6640 1 --2- 172.21.15.45:0/1333941055 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f2ed40668d0 0x7f2ed4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:26.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:26.429+0000 7f2ef60c6640 1 --2- 172.21.15.45:0/1333941055 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f2ed40668d0 0x7f2ed4068d90 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2ef014f2d0 tx=0x7f2eec00b3a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:26.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:26.433+0000 7f2ee6ffd640 1 -- 172.21.15.45:0/1333941055 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2ee80ecb10 con 0x7f2ef015a4c0 2023-11-28T18:38:26.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:26.589+0000 7f2ef832a640 1 -- 172.21.15.45:0/1333941055 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2ef0069410 con 0x7f2ef015a4c0 2023-11-28T18:38:27.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.233+0000 7f2ee6ffd640 1 -- 172.21.15.45:0/1333941055 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) v1 ==== 169+0+0 (secure 0 0 0) 0x7f2ee811f020 con 0x7f2ef015a4c0 2023-11-28T18:38:27.236 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' removed 2023-11-28T18:38:27.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.233+0000 7f2ef832a640 1 -- 172.21.15.45:0/1333941055 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f2ed40668d0 msgr2=0x7f2ed4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:27.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.233+0000 7f2ef832a640 1 --2- 172.21.15.45:0/1333941055 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f2ed40668d0 0x7f2ed4068d90 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2ef014f2d0 tx=0x7f2eec00b3a0 comp rx=0 tx=0).stop 2023-11-28T18:38:27.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.233+0000 7f2ef832a640 1 -- 172.21.15.45:0/1333941055 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ef015a4c0 msgr2=0x7f2ef00aff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:27.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.233+0000 7f2ef832a640 1 --2- 172.21.15.45:0/1333941055 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ef015a4c0 0x7f2ef00aff80 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f2ee801a640 tx=0x7f2ee80197b0 comp rx=0 tx=0).stop 2023-11-28T18:38:27.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.237+0000 7f2ef832a640 1 -- 172.21.15.45:0/1333941055 shutdown_connections 2023-11-28T18:38:27.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.237+0000 7f2ef832a640 1 --2- 172.21.15.45:0/1333941055 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f2ed40668d0 0x7f2ed4068d90 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:27.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.237+0000 7f2ef832a640 1 --2- 172.21.15.45:0/1333941055 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ef015a4c0 0x7f2ef00aff80 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:27.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.237+0000 7f2ef832a640 1 --2- 172.21.15.45:0/1333941055 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2ef00ae660 0x7f2ef014e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:27.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.237+0000 7f2ef832a640 1 --2- 172.21.15.45:0/1333941055 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2ef006d730 0x7f2ef009ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:27.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.237+0000 7f2ef832a640 1 -- 172.21.15.45:0/1333941055 >> 172.21.15.45:0/1333941055 conn(0x7f2ef00b0c90 msgr2=0x7f2ef00cb8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:27.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.237+0000 7f2ef832a640 1 -- 172.21.15.45:0/1333941055 shutdown_connections 2023-11-28T18:38:27.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.237+0000 7f2ef832a640 1 -- 172.21.15.45:0/1333941055 wait complete. 2023-11-28T18:38:27.271 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-28T18:38:27.271 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-28T18:38:27.271 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-28T18:38:27.272 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T18:38:27.272 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-28T18:38:27.272 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-28T18:38:27.272 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-28T18:38:27.272 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T18:38:27.272 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-28T18:38:27.272 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-28T18:38:27.273 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-28T18:38:27.273 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T18:38:27.273 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-28T18:38:27.273 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-28T18:38:27.273 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-28T18:38:27.273 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T18:38:27.288 INFO:tasks.ceph.mds.c:Stopped 2023-11-28T18:38:27.288 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-28T18:38:27.289 INFO:tasks.ceph.mds.a:Stopped 2023-11-28T18:38:27.289 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-28T18:38:27.293 INFO:tasks.ceph.mds.b:Stopped 2023-11-28T18:38:27.293 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-28T18:38:27.295 INFO:tasks.ceph.mds.d:Stopped 2023-11-28T18:38:27.295 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-28T18:38:27.337 INFO:tasks.ceph.mds.c:Started 2023-11-28T18:38:27.338 DEBUG:teuthology.parallel:result is None 2023-11-28T18:38:27.340 INFO:tasks.ceph.mds.b:Started 2023-11-28T18:38:27.340 INFO:tasks.ceph.mds.a:Started 2023-11-28T18:38:27.340 DEBUG:teuthology.parallel:result is None 2023-11-28T18:38:27.340 DEBUG:teuthology.parallel:result is None 2023-11-28T18:38:27.342 INFO:tasks.ceph.mds.d:Started 2023-11-28T18:38:27.343 DEBUG:teuthology.parallel:result is None 2023-11-28T18:38:27.343 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-28T18:38:27.428 INFO:tasks.ceph.mds.b.smithi190.stdout:starting mds.b at 2023-11-28T18:38:27.428 INFO:tasks.ceph.mds.d.smithi190.stdout:starting mds.d at 2023-11-28T18:38:27.429 INFO:tasks.ceph.mds.a.smithi045.stdout:starting mds.a at 2023-11-28T18:38:27.429 INFO:tasks.ceph.mds.c.smithi045.stdout:starting mds.c at 2023-11-28T18:38:27.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.489+0000 7f16fb12a640 1 Processor -- start 2023-11-28T18:38:27.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.489+0000 7f16fb12a640 1 -- start start 2023-11-28T18:38:27.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.493+0000 7f16fb12a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f16f4072010 0x7f16f40af1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:27.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.493+0000 7f16fb12a640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f16f40af720 0x7f16f40b3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:27.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.493+0000 7f16fb12a640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16f40afb60 con 0x7f16f415d3f0 2023-11-28T18:38:27.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.493+0000 7f16fb12a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16f40aeb70 con 0x7f16f4072010 2023-11-28T18:38:27.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.493+0000 7f16fb12a640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16f40addf0 con 0x7f16f40af720 2023-11-28T18:38:27.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.493+0000 7f16f3fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f16f4072010 0x7f16f40af1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:27.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.493+0000 7f16f3fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f16f4072010 0x7f16f40af1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56464/0 (socket says 172.21.15.45:56464) 2023-11-28T18:38:27.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.493+0000 7f16f3fff640 1 -- 172.21.15.45:0/4193837095 learned_addr learned my addr 172.21.15.45:0/4193837095 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:27.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.493+0000 7f16f96c7640 1 --2- 172.21.15.45:0/4193837095 >> v2:172.21.15.190:3300/0 conn(0x7f16f40af720 0x7f16f40b3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:27.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.493+0000 7f16f3fff640 1 -- 172.21.15.45:0/4193837095 >> v2:172.21.15.190:3300/0 conn(0x7f16f40af720 msgr2=0x7f16f40b3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:27.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.493+0000 7f16f3fff640 1 --2- 172.21.15.45:0/4193837095 >> v2:172.21.15.190:3300/0 conn(0x7f16f40af720 0x7f16f40b3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:27.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.493+0000 7f16f3fff640 1 -- 172.21.15.45:0/4193837095 >> v1:172.21.15.190:6789/0 conn(0x7f16f415d3f0 legacy=0x7f16f40ad6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:27.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.493+0000 7f16f37fe640 1 -- 172.21.15.45:0/4193837095 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1528663862 0 0) 0x7f16f40afb60 con 0x7f16f415d3f0 2023-11-28T18:38:27.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.493+0000 7f16f3fff640 1 -- 172.21.15.45:0/4193837095 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16f40adff0 con 0x7f16f4072010 2023-11-28T18:38:27.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.493+0000 7f16f96c7640 1 --2- 172.21.15.45:0/4193837095 >> v2:172.21.15.190:3300/0 conn(0x7f16f40af720 0x7f16f40b3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:38:27.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.497+0000 7f16f3fff640 1 --2- 172.21.15.45:0/4193837095 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16f4072010 0x7f16f40af1e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f16f406c4d0 tx=0x7f16e001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0a187b07723f103 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:27.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.497+0000 7f16f37fe640 1 -- 172.21.15.45:0/4193837095 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e00a89f0 con 0x7f16f4072010 2023-11-28T18:38:27.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.497+0000 7f16f37fe640 1 -- 172.21.15.45:0/4193837095 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16e00a8b50 con 0x7f16f4072010 2023-11-28T18:38:27.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.497+0000 7f16f37fe640 1 -- 172.21.15.45:0/4193837095 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e00b0440 con 0x7f16f4072010 2023-11-28T18:38:27.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.497+0000 7f16fb12a640 1 -- 172.21.15.45:0/4193837095 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16f4072010 msgr2=0x7f16f40af1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:27.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.497+0000 7f16fb12a640 1 --2- 172.21.15.45:0/4193837095 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16f4072010 0x7f16f40af1e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f16f406c4d0 tx=0x7f16e001ecf0 comp rx=0 tx=0).stop 2023-11-28T18:38:27.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.497+0000 7f16fb12a640 1 -- 172.21.15.45:0/4193837095 shutdown_connections 2023-11-28T18:38:27.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.497+0000 7f16fb12a640 1 --2- 172.21.15.45:0/4193837095 >> v2:172.21.15.190:3300/0 conn(0x7f16f40af720 0x7f16f40b3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:27.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.497+0000 7f16fb12a640 1 --2- 172.21.15.45:0/4193837095 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16f4072010 0x7f16f40af1e0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:27.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.497+0000 7f16fb12a640 1 -- 172.21.15.45:0/4193837095 >> 172.21.15.45:0/4193837095 conn(0x7f16f406b680 msgr2=0x7f16f406ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:27.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.497+0000 7f16fb12a640 1 -- 172.21.15.45:0/4193837095 shutdown_connections 2023-11-28T18:38:27.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.497+0000 7f16fb12a640 1 -- 172.21.15.45:0/4193837095 wait complete. 2023-11-28T18:38:27.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.497+0000 7f16fb12a640 1 Processor -- start 2023-11-28T18:38:27.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.497+0000 7f16fb12a640 1 -- start start 2023-11-28T18:38:27.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.501+0000 7f16fb12a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16f4072010 0x7f16f4152070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:27.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.501+0000 7f16fb12a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16f40af720 0x7f16f41f2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:27.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.501+0000 7f16fb12a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16f415d3f0 0x7f16f41f2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:27.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.501+0000 7f16fb12a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f4153750 con 0x7f16f4072010 2023-11-28T18:38:27.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.501+0000 7f16fb12a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f40b0de0 con 0x7f16f40af720 2023-11-28T18:38:27.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.501+0000 7f16fb12a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16f415fc00 con 0x7f16f415d3f0 2023-11-28T18:38:27.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.501+0000 7f16f8ec6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16f4072010 0x7f16f4152070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:27.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.501+0000 7f16f8ec6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16f4072010 0x7f16f4152070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56472/0 (socket says 172.21.15.45:56472) 2023-11-28T18:38:27.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.501+0000 7f16f3fff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16f40af720 0x7f16f41f2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:27.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.501+0000 7f16f96c7640 1 --2- 172.21.15.45:0/2960383270 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16f415d3f0 0x7f16f41f2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:27.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.501+0000 7f16f8ec6640 1 -- 172.21.15.45:0/2960383270 learned_addr learned my addr 172.21.15.45:0/2960383270 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:27.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.501+0000 7f16f3fff640 1 -- 172.21.15.45:0/2960383270 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16f415d3f0 msgr2=0x7f16f41f2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:27.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.501+0000 7f16f3fff640 1 --2- 172.21.15.45:0/2960383270 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16f415d3f0 0x7f16f41f2d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:27.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.501+0000 7f16f3fff640 1 -- 172.21.15.45:0/2960383270 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16f4072010 msgr2=0x7f16f4152070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:27.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.501+0000 7f16f3fff640 1 --2- 172.21.15.45:0/2960383270 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16f4072010 0x7f16f4152070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:27.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.501+0000 7f16f3fff640 1 -- 172.21.15.45:0/2960383270 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16ec009a70 con 0x7f16f40af720 2023-11-28T18:38:27.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.501+0000 7f16f8ec6640 1 --2- 172.21.15.45:0/2960383270 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16f4072010 0x7f16f4152070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:38:27.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.501+0000 7f16f3fff640 1 --2- 172.21.15.45:0/2960383270 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16f40af720 0x7f16f41f2840 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f16e00af000 tx=0x7f16e001ba90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:27.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.501+0000 7f16f17fa640 1 -- 172.21.15.45:0/2960383270 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e00ba600 con 0x7f16f40af720 2023-11-28T18:38:27.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.501+0000 7f16f17fa640 1 -- 172.21.15.45:0/2960383270 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16e00ba7a0 con 0x7f16f40af720 2023-11-28T18:38:27.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.501+0000 7f16f17fa640 1 -- 172.21.15.45:0/2960383270 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e00bab50 con 0x7f16f40af720 2023-11-28T18:38:27.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.501+0000 7f16fb12a640 1 -- 172.21.15.45:0/2960383270 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16e00094d0 con 0x7f16f40af720 2023-11-28T18:38:27.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.501+0000 7f16fb12a640 1 -- 172.21.15.45:0/2960383270 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16f415f640 con 0x7f16f40af720 2023-11-28T18:38:27.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.501+0000 7f16fb12a640 1 -- 172.21.15.45:0/2960383270 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16f4069460 con 0x7f16f40af720 2023-11-28T18:38:27.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.501+0000 7f16f17fa640 1 -- 172.21.15.45:0/2960383270 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f16e00bacb0 con 0x7f16f40af720 2023-11-28T18:38:27.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.505+0000 7f16f17fa640 1 --2- 172.21.15.45:0/2960383270 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f16d80668d0 0x7f16d8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:27.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.505+0000 7f16f17fa640 1 -- 172.21.15.45:0/2960383270 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f16e0122430 con 0x7f16f40af720 2023-11-28T18:38:27.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.505+0000 7f16f8ec6640 1 --2- 172.21.15.45:0/2960383270 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f16d80668d0 0x7f16d8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:27.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.505+0000 7f16f8ec6640 1 --2- 172.21.15.45:0/2960383270 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f16d80668d0 0x7f16d8068d90 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f16e8007fd0 tx=0x7f16e8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:27.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.509+0000 7f16f17fa640 1 -- 172.21.15.45:0/2960383270 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f16e00ef960 con 0x7f16f40af720 2023-11-28T18:38:27.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:27.677+0000 7f16fb12a640 1 -- 172.21.15.45:0/2960383270 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f16f415c6f0 con 0x7f16f40af720 2023-11-28T18:38:29.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.025+0000 7f16f17fa640 1 -- 172.21.15.45:0/2960383270 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v30) v1 ==== 97+0+0 (secure 0 0 0) 0x7f16e00f2f80 con 0x7f16f40af720 2023-11-28T18:38:29.030 INFO:teuthology.orchestra.run.smithi045.stderr: removed all blocklist entries 2023-11-28T18:38:29.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.029+0000 7f16fb12a640 1 -- 172.21.15.45:0/2960383270 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f16d80668d0 msgr2=0x7f16d8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:29.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.029+0000 7f16fb12a640 1 --2- 172.21.15.45:0/2960383270 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f16d80668d0 0x7f16d8068d90 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f16e8007fd0 tx=0x7f16e8009040 comp rx=0 tx=0).stop 2023-11-28T18:38:29.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.029+0000 7f16fb12a640 1 -- 172.21.15.45:0/2960383270 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16f40af720 msgr2=0x7f16f41f2840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:29.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.029+0000 7f16fb12a640 1 --2- 172.21.15.45:0/2960383270 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16f40af720 0x7f16f41f2840 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f16e00af000 tx=0x7f16e001ba90 comp rx=0 tx=0).stop 2023-11-28T18:38:29.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.029+0000 7f16fb12a640 1 -- 172.21.15.45:0/2960383270 shutdown_connections 2023-11-28T18:38:29.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.029+0000 7f16fb12a640 1 --2- 172.21.15.45:0/2960383270 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f16d80668d0 0x7f16d8068d90 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:29.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.029+0000 7f16fb12a640 1 --2- 172.21.15.45:0/2960383270 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16f415d3f0 0x7f16f41f2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:29.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.029+0000 7f16fb12a640 1 --2- 172.21.15.45:0/2960383270 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16f40af720 0x7f16f41f2840 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:29.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.029+0000 7f16fb12a640 1 --2- 172.21.15.45:0/2960383270 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16f4072010 0x7f16f4152070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:29.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.029+0000 7f16fb12a640 1 -- 172.21.15.45:0/2960383270 >> 172.21.15.45:0/2960383270 conn(0x7f16f406b680 msgr2=0x7f16f40aecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:29.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.029+0000 7f16fb12a640 1 -- 172.21.15.45:0/2960383270 shutdown_connections 2023-11-28T18:38:29.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.029+0000 7f16fb12a640 1 -- 172.21.15.45:0/2960383270 wait complete. 2023-11-28T18:38:29.056 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-28T18:38:29.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.201+0000 7f15ba365640 1 Processor -- start 2023-11-28T18:38:29.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.201+0000 7f15ba365640 1 -- start start 2023-11-28T18:38:29.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.201+0000 7f15ba365640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f15b4144880 0x7f15b406c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:29.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.201+0000 7f15ba365640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f15b40721c0 0x7f15b406c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:29.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.201+0000 7f15ba365640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f15b40704a0 0x7f15b4070920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:29.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.201+0000 7f15ba365640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15b415f050 con 0x7f15b4144880 2023-11-28T18:38:29.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.201+0000 7f15ba365640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15b4070e60 con 0x7f15b40704a0 2023-11-28T18:38:29.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.201+0000 7f15ba365640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15b4071120 con 0x7f15b40721c0 2023-11-28T18:38:29.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.201+0000 7f15b3fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f15b4144880 0x7f15b406c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:29.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.201+0000 7f15b3fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f15b4144880 0x7f15b406c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60038/0 (socket says 172.21.15.45:60038) 2023-11-28T18:38:29.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.201+0000 7f15b3fff640 1 -- 172.21.15.45:0/3270249859 learned_addr learned my addr 172.21.15.45:0/3270249859 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:29.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.201+0000 7f15b8902640 1 --2- 172.21.15.45:0/3270249859 >> v2:172.21.15.190:3300/0 conn(0x7f15b40704a0 0x7f15b4070920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:29.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.201+0000 7f15b37fe640 1 --2- 172.21.15.45:0/3270249859 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f15b40721c0 0x7f15b406c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:29.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.201+0000 7f15b3fff640 1 -- 172.21.15.45:0/3270249859 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f15b40721c0 msgr2=0x7f15b406c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:29.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.201+0000 7f15b3fff640 1 --2- 172.21.15.45:0/3270249859 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f15b40721c0 0x7f15b406c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:29.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.201+0000 7f15b3fff640 1 -- 172.21.15.45:0/3270249859 >> v2:172.21.15.190:3300/0 conn(0x7f15b40704a0 msgr2=0x7f15b4070920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:29.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.201+0000 7f15b3fff640 1 --2- 172.21.15.45:0/3270249859 >> v2:172.21.15.190:3300/0 conn(0x7f15b40704a0 0x7f15b4070920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:29.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.201+0000 7f15b3fff640 1 -- 172.21.15.45:0/3270249859 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b4071400 con 0x7f15b4144880 2023-11-28T18:38:29.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.205+0000 7f15b3fff640 1 --2- 172.21.15.45:0/3270249859 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15b4144880 0x7f15b406c300 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f15b415fdb0 tx=0x7f15a401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2052050d5083255 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:29.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.205+0000 7f15b2ffd640 1 -- 172.21.15.45:0/3270249859 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a40aa5f0 con 0x7f15b4144880 2023-11-28T18:38:29.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.205+0000 7f15b2ffd640 1 -- 172.21.15.45:0/3270249859 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15a40aa750 con 0x7f15b4144880 2023-11-28T18:38:29.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.205+0000 7f15b2ffd640 1 -- 172.21.15.45:0/3270249859 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a40aaae0 con 0x7f15b4144880 2023-11-28T18:38:29.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.205+0000 7f15ba365640 1 -- 172.21.15.45:0/3270249859 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15b4144880 msgr2=0x7f15b406c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:29.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.205+0000 7f15ba365640 1 --2- 172.21.15.45:0/3270249859 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15b4144880 0x7f15b406c300 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f15b415fdb0 tx=0x7f15a401c4d0 comp rx=0 tx=0).stop 2023-11-28T18:38:29.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.205+0000 7f15ba365640 1 -- 172.21.15.45:0/3270249859 shutdown_connections 2023-11-28T18:38:29.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.205+0000 7f15ba365640 1 --2- 172.21.15.45:0/3270249859 >> v2:172.21.15.190:3300/0 conn(0x7f15b40704a0 0x7f15b4070920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:29.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.205+0000 7f15ba365640 1 --2- 172.21.15.45:0/3270249859 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f15b40721c0 0x7f15b406c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:29.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.205+0000 7f15ba365640 1 --2- 172.21.15.45:0/3270249859 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15b4144880 0x7f15b406c300 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:29.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.205+0000 7f15ba365640 1 -- 172.21.15.45:0/3270249859 >> 172.21.15.45:0/3270249859 conn(0x7f15b406a570 msgr2=0x7f15b406a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:29.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.205+0000 7f15ba365640 1 -- 172.21.15.45:0/3270249859 shutdown_connections 2023-11-28T18:38:29.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.205+0000 7f15ba365640 1 -- 172.21.15.45:0/3270249859 wait complete. 2023-11-28T18:38:29.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.209+0000 7f15ba365640 1 Processor -- start 2023-11-28T18:38:29.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.209+0000 7f15ba365640 1 -- start start 2023-11-28T18:38:29.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.209+0000 7f15ba365640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f15b40704a0 0x7f15b41f96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:29.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.209+0000 7f15ba365640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f15b40721c0 0x7f15b413d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:29.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.209+0000 7f15ba365640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15b4144880 0x7f15b40b2860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:29.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.209+0000 7f15ba365640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15b41572c0 con 0x7f15b4144880 2023-11-28T18:38:29.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.209+0000 7f15ba365640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15b41f9bf0 con 0x7f15b40721c0 2023-11-28T18:38:29.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.209+0000 7f15ba365640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15b4158000 con 0x7f15b40704a0 2023-11-28T18:38:29.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.209+0000 7f15b8902640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15b4144880 0x7f15b40b2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:29.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.209+0000 7f15b8902640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15b4144880 0x7f15b40b2860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60040/0 (socket says 172.21.15.45:60040) 2023-11-28T18:38:29.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.209+0000 7f15b8902640 1 -- 172.21.15.45:0/2220234284 learned_addr learned my addr 172.21.15.45:0/2220234284 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:29.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.209+0000 7f15b3fff640 1 --2- 172.21.15.45:0/2220234284 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f15b40704a0 0x7f15b41f96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:29.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.209+0000 7f15b37fe640 1 --2- 172.21.15.45:0/2220234284 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f15b40721c0 0x7f15b413d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:29.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.209+0000 7f15b8902640 1 -- 172.21.15.45:0/2220234284 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f15b40704a0 msgr2=0x7f15b41f96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:29.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.209+0000 7f15b8902640 1 --2- 172.21.15.45:0/2220234284 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f15b40704a0 0x7f15b41f96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:29.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.209+0000 7f15b8902640 1 -- 172.21.15.45:0/2220234284 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f15b40721c0 msgr2=0x7f15b413d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:29.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.209+0000 7f15b8902640 1 --2- 172.21.15.45:0/2220234284 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f15b40721c0 0x7f15b413d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:29.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.209+0000 7f15b8902640 1 -- 172.21.15.45:0/2220234284 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a40094d0 con 0x7f15b4144880 2023-11-28T18:38:29.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.209+0000 7f15b8902640 1 --2- 172.21.15.45:0/2220234284 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15b4144880 0x7f15b40b2860 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f15ac007e30 tx=0x7f15ac00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:29.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.209+0000 7f15b0ff9640 1 -- 172.21.15.45:0/2220234284 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15ac014620 con 0x7f15b4144880 2023-11-28T18:38:29.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.209+0000 7f15b0ff9640 1 -- 172.21.15.45:0/2220234284 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15ac00ee90 con 0x7f15b4144880 2023-11-28T18:38:29.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.209+0000 7f15ba365640 1 -- 172.21.15.45:0/2220234284 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15b41582e0 con 0x7f15b4144880 2023-11-28T18:38:29.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.209+0000 7f15b0ff9640 1 -- 172.21.15.45:0/2220234284 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15ac0149c0 con 0x7f15b4144880 2023-11-28T18:38:29.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.209+0000 7f15ba365640 1 -- 172.21.15.45:0/2220234284 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15b41588a0 con 0x7f15b4144880 2023-11-28T18:38:29.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.213+0000 7f15ba365640 1 -- 172.21.15.45:0/2220234284 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15b4069480 con 0x7f15b4144880 2023-11-28T18:38:29.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.213+0000 7f15b0ff9640 1 -- 172.21.15.45:0/2220234284 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f15ac014b20 con 0x7f15b4144880 2023-11-28T18:38:29.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.213+0000 7f15b0ff9640 1 --2- 172.21.15.45:0/2220234284 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f15a00668d0 0x7f15a0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:29.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.213+0000 7f15b0ff9640 1 -- 172.21.15.45:0/2220234284 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f15ac084930 con 0x7f15b4144880 2023-11-28T18:38:29.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.213+0000 7f15b3fff640 1 --2- 172.21.15.45:0/2220234284 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f15a00668d0 0x7f15a0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:29.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.217+0000 7f15b3fff640 1 --2- 172.21.15.45:0/2220234284 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f15a00668d0 0x7f15a0068d90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f15a40ae000 tx=0x7f15a40b5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:29.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.217+0000 7f15b0ff9640 1 -- 172.21.15.45:0/2220234284 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f15ac051f60 con 0x7f15b4144880 2023-11-28T18:38:29.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.429+0000 7f15ba365640 1 -- 172.21.15.45:0/2220234284 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f15b406d1b0 con 0x7f15b4144880 2023-11-28T18:38:29.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.429+0000 7f15b0ff9640 1 -- 172.21.15.45:0/2220234284 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f15ac055580 con 0x7f15b4144880 2023-11-28T18:38:29.434 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:38:29.434 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-11-28T18:38:29.434 INFO:teuthology.orchestra.run.smithi045.stdout: "auth_dump": [ 2023-11-28T18:38:29.434 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T18:38:29.434 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.a", 2023-11-28T18:38:29.434 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQApM2ZlwyjdFxAAPGPzbFeQHiSnfmd6fx12HA==", 2023-11-28T18:38:29.434 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T18:38:29.434 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-11-28T18:38:29.434 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-11-28T18:38:29.434 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-11-28T18:38:29.435 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T18:38:29.435 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:38:29.435 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:38:29.435 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T18:38:29.435 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.b", 2023-11-28T18:38:29.435 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQApM2ZlrJe9JBAAV2uXCF1nOYAUZf9Vm6BIWQ==", 2023-11-28T18:38:29.435 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T18:38:29.435 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-11-28T18:38:29.435 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-11-28T18:38:29.435 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-11-28T18:38:29.435 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T18:38:29.436 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:38:29.436 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:38:29.436 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T18:38:29.436 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.c", 2023-11-28T18:38:29.436 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQApM2Zl7guBHxAA42VxKvKwW30qtt+nyQZ4Aw==", 2023-11-28T18:38:29.436 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T18:38:29.436 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-11-28T18:38:29.436 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-11-28T18:38:29.436 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-11-28T18:38:29.436 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T18:38:29.436 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:38:29.436 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:38:29.436 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T18:38:29.437 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.d", 2023-11-28T18:38:29.437 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQApM2Zl1xU7LBAAHQ+Co90EW5qv+8793OyE/A==", 2023-11-28T18:38:29.437 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T18:38:29.437 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-11-28T18:38:29.437 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-11-28T18:38:29.437 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-11-28T18:38:29.437 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T18:38:29.437 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:38:29.437 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:38:29.437 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T18:38:29.437 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.0", 2023-11-28T18:38:29.437 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQArM2ZluGYOEhAAOKSw2u1izQOjdoRctC8s7g==", 2023-11-28T18:38:29.438 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T18:38:29.438 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-11-28T18:38:29.438 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-11-28T18:38:29.438 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T18:38:29.438 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:38:29.438 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:38:29.438 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T18:38:29.438 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.1", 2023-11-28T18:38:29.438 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAuM2ZlIFuuGRAAK+YCnRUy8yKlojp9gukUYw==", 2023-11-28T18:38:29.438 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T18:38:29.438 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-11-28T18:38:29.438 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-11-28T18:38:29.438 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T18:38:29.439 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:38:29.439 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:38:29.439 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T18:38:29.439 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.2", 2023-11-28T18:38:29.439 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAxM2ZlOytnHxAAxXh2AsKCqrG5iYdmnF9+Qg==", 2023-11-28T18:38:29.439 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T18:38:29.439 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-11-28T18:38:29.439 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-11-28T18:38:29.439 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T18:38:29.439 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:38:29.439 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:38:29.439 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T18:38:29.440 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.3", 2023-11-28T18:38:29.440 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQA0M2Zl2fnBJxAAv68KZJFnQWwyUupB+whAEg==", 2023-11-28T18:38:29.440 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T18:38:29.440 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-11-28T18:38:29.440 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-11-28T18:38:29.440 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T18:38:29.440 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:38:29.440 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:38:29.440 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T18:38:29.440 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.4", 2023-11-28T18:38:29.440 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQA6M2ZllZg1MBAAzvMRW0IZnwwqfzhJ7wWjjQ==", 2023-11-28T18:38:29.440 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T18:38:29.440 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-11-28T18:38:29.441 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-11-28T18:38:29.441 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T18:38:29.441 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:38:29.441 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:38:29.441 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T18:38:29.441 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.5", 2023-11-28T18:38:29.441 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQA9M2Zlq0KjNxAAXOkL+JS09zzWRoPlgPGx+A==", 2023-11-28T18:38:29.441 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T18:38:29.441 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-11-28T18:38:29.441 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-11-28T18:38:29.441 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T18:38:29.441 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:38:29.442 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:38:29.442 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T18:38:29.442 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.6", 2023-11-28T18:38:29.442 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBBM2ZlVUVPAhAAurFCH6ubc+fXb8cUcg2nIg==", 2023-11-28T18:38:29.442 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T18:38:29.442 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-11-28T18:38:29.442 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-11-28T18:38:29.442 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T18:38:29.442 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:38:29.442 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:38:29.442 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T18:38:29.442 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.7", 2023-11-28T18:38:29.442 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBEM2ZlD846CRAA7GWGdOzRdv8vN7YbQyU4NQ==", 2023-11-28T18:38:29.443 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T18:38:29.443 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-11-28T18:38:29.443 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-11-28T18:38:29.443 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T18:38:29.443 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:38:29.443 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:38:29.443 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T18:38:29.443 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.0", 2023-11-28T18:38:29.443 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQApM2ZlTJxNMBAAwJAMWm1Y180iNJmgHnWFnw==", 2023-11-28T18:38:29.443 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T18:38:29.443 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-11-28T18:38:29.443 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-11-28T18:38:29.444 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-11-28T18:38:29.444 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-11-28T18:38:29.444 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:38:29.444 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:38:29.444 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T18:38:29.444 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.1", 2023-11-28T18:38:29.444 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQApM2Zl7yM7OhAA+Nu2Ay/zIVuRsCk90QGWbg==", 2023-11-28T18:38:29.444 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T18:38:29.444 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-11-28T18:38:29.444 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-11-28T18:38:29.444 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-11-28T18:38:29.444 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-11-28T18:38:29.444 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:38:29.445 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:38:29.445 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T18:38:29.445 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.2", 2023-11-28T18:38:29.445 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQApM2ZlhvR6NhAAbs7Rqb1gatb4fymZ2IHy5w==", 2023-11-28T18:38:29.445 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T18:38:29.445 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-11-28T18:38:29.445 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-11-28T18:38:29.445 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-11-28T18:38:29.445 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-11-28T18:38:29.445 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:38:29.445 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:38:29.445 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T18:38:29.446 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.3", 2023-11-28T18:38:29.446 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqM2ZlsarFBBAA1avYCNMV4t4UGM00iN6XiQ==", 2023-11-28T18:38:29.446 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T18:38:29.446 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-11-28T18:38:29.446 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-11-28T18:38:29.446 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-11-28T18:38:29.446 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-11-28T18:38:29.446 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:38:29.446 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:38:29.446 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T18:38:29.446 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.admin", 2023-11-28T18:38:29.446 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAoM2Zlhs1lNhAAsjadFkCQjkeqhuBhlHrHfQ==", 2023-11-28T18:38:29.447 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T18:38:29.447 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-11-28T18:38:29.447 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-11-28T18:38:29.447 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-11-28T18:38:29.447 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T18:38:29.447 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:38:29.447 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:38:29.447 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T18:38:29.447 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.bootstrap-mds", 2023-11-28T18:38:29.447 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBUM2Zl9jFOCxAA+jxv17lDUkU6FKqo6AVsSg==", 2023-11-28T18:38:29.447 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T18:38:29.447 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile bootstrap-mds" 2023-11-28T18:38:29.447 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:38:29.448 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:38:29.448 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T18:38:29.448 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.bootstrap-mgr", 2023-11-28T18:38:29.448 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBUM2ZlIj9OCxAA2ofCqA2JlxSLBUFHdBL9yQ==", 2023-11-28T18:38:29.448 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T18:38:29.448 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile bootstrap-mgr" 2023-11-28T18:38:29.448 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:38:29.448 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:38:29.448 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T18:38:29.449 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.bootstrap-osd", 2023-11-28T18:38:29.449 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBUM2ZlKEhOCxAAzBUvlue8zK/KdPKEOKrlzw==", 2023-11-28T18:38:29.449 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T18:38:29.449 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile bootstrap-osd" 2023-11-28T18:38:29.449 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:38:29.449 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:38:29.449 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T18:38:29.449 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.bootstrap-rbd", 2023-11-28T18:38:29.449 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBUM2ZlF1FOCxAAksZkxqmTXGXCqnrtnVPUdw==", 2023-11-28T18:38:29.449 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T18:38:29.449 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile bootstrap-rbd" 2023-11-28T18:38:29.449 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:38:29.450 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:38:29.450 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T18:38:29.450 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-11-28T18:38:29.450 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBUM2ZlR1pOCxAAW26qJYYyUIFC2avSdOc+/g==", 2023-11-28T18:38:29.450 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T18:38:29.450 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-11-28T18:38:29.450 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:38:29.450 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:38:29.450 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T18:38:29.450 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.bootstrap-rgw", 2023-11-28T18:38:29.450 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBUM2ZlCmROCxAA0Ay0psKvNil3Co240rBPoA==", 2023-11-28T18:38:29.450 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T18:38:29.451 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile bootstrap-rgw" 2023-11-28T18:38:29.451 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:38:29.451 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:38:29.451 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T18:38:29.451 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mgr.x", 2023-11-28T18:38:29.451 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQApM2ZlVReeExAAlYEJ4EwbGHtSUIkimoiJ2Q==", 2023-11-28T18:38:29.451 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T18:38:29.451 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-11-28T18:38:29.451 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile mgr", 2023-11-28T18:38:29.451 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T18:38:29.451 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:38:29.451 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:38:29.452 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T18:38:29.452 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mgr.y", 2023-11-28T18:38:29.452 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQApM2ZlnK1sDxAAfGqLMBH8IHZdQ7he/TVa6w==", 2023-11-28T18:38:29.452 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T18:38:29.452 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-11-28T18:38:29.452 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile mgr", 2023-11-28T18:38:29.452 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T18:38:29.452 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:38:29.452 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:38:29.452 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-11-28T18:38:29.452 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-11-28T18:38:29.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.433+0000 7f15ba365640 1 -- 172.21.15.45:0/2220234284 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f15a00668d0 msgr2=0x7f15a0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:29.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.433+0000 7f15ba365640 1 --2- 172.21.15.45:0/2220234284 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f15a00668d0 0x7f15a0068d90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f15a40ae000 tx=0x7f15a40b5040 comp rx=0 tx=0).stop 2023-11-28T18:38:29.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.433+0000 7f15ba365640 1 -- 172.21.15.45:0/2220234284 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15b4144880 msgr2=0x7f15b40b2860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:29.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.433+0000 7f15ba365640 1 --2- 172.21.15.45:0/2220234284 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15b4144880 0x7f15b40b2860 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f15ac007e30 tx=0x7f15ac00e4b0 comp rx=0 tx=0).stop 2023-11-28T18:38:29.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.433+0000 7f15ba365640 1 -- 172.21.15.45:0/2220234284 shutdown_connections 2023-11-28T18:38:29.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.433+0000 7f15ba365640 1 --2- 172.21.15.45:0/2220234284 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f15a00668d0 0x7f15a0068d90 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:29.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.433+0000 7f15ba365640 1 --2- 172.21.15.45:0/2220234284 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15b4144880 0x7f15b40b2860 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:29.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.433+0000 7f15ba365640 1 --2- 172.21.15.45:0/2220234284 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f15b40721c0 0x7f15b413d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:29.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.433+0000 7f15ba365640 1 --2- 172.21.15.45:0/2220234284 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f15b40704a0 0x7f15b41f96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:29.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.433+0000 7f15ba365640 1 -- 172.21.15.45:0/2220234284 >> 172.21.15.45:0/2220234284 conn(0x7f15b406a570 msgr2=0x7f15b406a950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:29.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.433+0000 7f15ba365640 1 -- 172.21.15.45:0/2220234284 shutdown_connections 2023-11-28T18:38:29.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.433+0000 7f15ba365640 1 -- 172.21.15.45:0/2220234284 wait complete. 2023-11-28T18:38:29.455 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-11-28T18:38:29.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.597+0000 7f640b66b640 1 Processor -- start 2023-11-28T18:38:29.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.597+0000 7f640b66b640 1 -- start start 2023-11-28T18:38:29.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.597+0000 7f640b66b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f640406cdc0 0x7f64040aeed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:29.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.597+0000 7f640b66b640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64040ade30 con 0x7f640406b580 2023-11-28T18:38:29.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.597+0000 7f640b66b640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64040ae110 con 0x7f640415d1a0 2023-11-28T18:38:29.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.597+0000 7f640b66b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f640406e050 con 0x7f640406cdc0 2023-11-28T18:38:29.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.597+0000 7f6409c08640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f640406b580 0x7f64040b2830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47812/0 (socket says 172.21.15.45:47812) 2023-11-28T18:38:29.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.597+0000 7f6409c08640 1 -- 172.21.15.45:0/271663234 learned_addr learned my addr 172.21.15.45:0/271663234 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:38:29.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.597+0000 7f6408c06640 1 --2- 172.21.15.45:0/271663234 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f640406cdc0 0x7f64040aeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:29.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.597+0000 7f63fbfff640 1 -- 172.21.15.45:0/271663234 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4041811409 0 0) 0x7f64040ade30 con 0x7f640406b580 2023-11-28T18:38:29.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.597+0000 7f63fbfff640 1 -- 172.21.15.45:0/271663234 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63f0003530 con 0x7f640406b580 2023-11-28T18:38:29.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.597+0000 7f63fbfff640 1 -- 172.21.15.45:0/271663234 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3918952403 0 0) 0x7f64040ae110 con 0x7f640415d1a0 2023-11-28T18:38:29.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.597+0000 7f63fbfff640 1 -- 172.21.15.45:0/271663234 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64040ade30 con 0x7f640415d1a0 2023-11-28T18:38:29.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.597+0000 7f63fbfff640 1 -- 172.21.15.45:0/271663234 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 576185662 0 0) 0x7f63f0003530 con 0x7f640406b580 2023-11-28T18:38:29.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.597+0000 7f6408c06640 1 -- 172.21.15.45:0/271663234 >> v1:172.21.15.190:6789/0 conn(0x7f640415d1a0 legacy=0x7f64040ad5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:29.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.597+0000 7f6408c06640 1 -- 172.21.15.45:0/271663234 >> v1:172.21.15.45:6789/0 conn(0x7f640406b580 legacy=0x7f64040b2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:29.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.597+0000 7f6408c06640 1 -- 172.21.15.45:0/271663234 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64040ae3f0 con 0x7f640406cdc0 2023-11-28T18:38:29.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.601+0000 7f6408c06640 1 --2- 172.21.15.45:0/271663234 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f640406cdc0 0x7f64040aeed0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f63f40097f0 tx=0x7f63f401c350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb818f557fd00355 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:29.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.601+0000 7f63fbfff640 1 -- 172.21.15.45:0/271663234 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63fc001a00 con 0x7f640406cdc0 2023-11-28T18:38:29.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.601+0000 7f63fbfff640 1 -- 172.21.15.45:0/271663234 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63f40a7050 con 0x7f640406cdc0 2023-11-28T18:38:29.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.601+0000 7f63fbfff640 1 -- 172.21.15.45:0/271663234 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f40ab620 con 0x7f640406cdc0 2023-11-28T18:38:29.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.601+0000 7f640b66b640 1 -- 172.21.15.45:0/271663234 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f640406cdc0 msgr2=0x7f64040aeed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:29.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.601+0000 7f640b66b640 1 --2- 172.21.15.45:0/271663234 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f640406cdc0 0x7f64040aeed0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f63f40097f0 tx=0x7f63f401c350 comp rx=0 tx=0).stop 2023-11-28T18:38:29.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.601+0000 7f640b66b640 1 -- 172.21.15.45:0/271663234 shutdown_connections 2023-11-28T18:38:29.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.601+0000 7f640b66b640 1 --2- 172.21.15.45:0/271663234 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f640406cdc0 0x7f64040aeed0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:29.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.601+0000 7f640b66b640 1 -- 172.21.15.45:0/271663234 >> 172.21.15.45:0/271663234 conn(0x7f64040b1b30 msgr2=0x7f6404070d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:29.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.601+0000 7f640b66b640 1 -- 172.21.15.45:0/271663234 shutdown_connections 2023-11-28T18:38:29.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.601+0000 7f640b66b640 1 -- 172.21.15.45:0/271663234 wait complete. 2023-11-28T18:38:29.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.605+0000 7f640b66b640 1 Processor -- start 2023-11-28T18:38:29.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.605+0000 7f640b66b640 1 -- start start 2023-11-28T18:38:29.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.605+0000 7f640b66b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f640406b580 0x7f640414f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:29.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.605+0000 7f640b66b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f640406cdc0 0x7f64041521e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:29.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.605+0000 7f640b66b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f640415d1a0 0x7f6404154180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:29.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.605+0000 7f640b66b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64040aeab0 con 0x7f640415d1a0 2023-11-28T18:38:29.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.605+0000 7f640b66b640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6404149210 con 0x7f640406b580 2023-11-28T18:38:29.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.605+0000 7f640b66b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64041494f0 con 0x7f640406cdc0 2023-11-28T18:38:29.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.605+0000 7f6409c08640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f640415d1a0 0x7f6404154180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:29.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.605+0000 7f6409c08640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f640415d1a0 0x7f6404154180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60044/0 (socket says 172.21.15.45:60044) 2023-11-28T18:38:29.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.605+0000 7f6409c08640 1 -- 172.21.15.45:0/1405886270 learned_addr learned my addr 172.21.15.45:0/1405886270 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:29.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.605+0000 7f6408c06640 1 --2- 172.21.15.45:0/1405886270 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f640406cdc0 0x7f64041521e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:29.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.605+0000 7f6409407640 1 --2- 172.21.15.45:0/1405886270 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f640406b580 0x7f640414f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:29.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.605+0000 7f6409c08640 1 -- 172.21.15.45:0/1405886270 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f640406cdc0 msgr2=0x7f64041521e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:29.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.605+0000 7f6409c08640 1 --2- 172.21.15.45:0/1405886270 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f640406cdc0 0x7f64041521e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:29.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.605+0000 7f6409c08640 1 -- 172.21.15.45:0/1405886270 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f640406b580 msgr2=0x7f640414f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:29.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.605+0000 7f6409c08640 1 --2- 172.21.15.45:0/1405886270 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f640406b580 0x7f640414f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:29.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.605+0000 7f6409c08640 1 -- 172.21.15.45:0/1405886270 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63f4009420 con 0x7f640415d1a0 2023-11-28T18:38:29.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.605+0000 7f6409c08640 1 --2- 172.21.15.45:0/1405886270 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f640415d1a0 0x7f6404154180 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f63fc00cc60 tx=0x7f63fc00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:29.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.605+0000 7f63f9ffb640 1 -- 172.21.15.45:0/1405886270 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63fc00ce70 con 0x7f640415d1a0 2023-11-28T18:38:29.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.605+0000 7f63f9ffb640 1 -- 172.21.15.45:0/1405886270 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63fc012400 con 0x7f640415d1a0 2023-11-28T18:38:29.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.605+0000 7f63f9ffb640 1 -- 172.21.15.45:0/1405886270 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63fc0127b0 con 0x7f640415d1a0 2023-11-28T18:38:29.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.605+0000 7f640b66b640 1 -- 172.21.15.45:0/1405886270 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64041497d0 con 0x7f640415d1a0 2023-11-28T18:38:29.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.605+0000 7f640b66b640 1 -- 172.21.15.45:0/1405886270 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6404149d90 con 0x7f640415d1a0 2023-11-28T18:38:29.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.609+0000 7f640b66b640 1 -- 172.21.15.45:0/1405886270 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6404069480 con 0x7f640415d1a0 2023-11-28T18:38:29.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.609+0000 7f63f9ffb640 1 -- 172.21.15.45:0/1405886270 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f63fc012910 con 0x7f640415d1a0 2023-11-28T18:38:29.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.609+0000 7f63f9ffb640 1 --2- 172.21.15.45:0/1405886270 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f63e8066900 0x7f63e8068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:29.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.609+0000 7f63f9ffb640 1 -- 172.21.15.45:0/1405886270 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f63fc084680 con 0x7f640415d1a0 2023-11-28T18:38:29.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.609+0000 7f6409407640 1 --2- 172.21.15.45:0/1405886270 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f63e8066900 0x7f63e8068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:29.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.609+0000 7f6409407640 1 --2- 172.21.15.45:0/1405886270 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f63e8066900 0x7f63e8068dc0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f64000011f0 tx=0x7f6400009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:29.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.613+0000 7f63f9ffb640 1 -- 172.21.15.45:0/1405886270 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f63fc051cb0 con 0x7f640415d1a0 2023-11-28T18:38:29.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.825+0000 7f640b66b640 1 -- 172.21.15.45:0/1405886270 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f6404149f80 con 0x7f640415d1a0 2023-11-28T18:38:29.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.829+0000 7f63f9ffb640 1 -- 172.21.15.45:0/1405886270 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f63fc0552d0 con 0x7f640415d1a0 2023-11-28T18:38:29.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.829+0000 7f640b66b640 1 -- 172.21.15.45:0/1405886270 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f63e8066900 msgr2=0x7f63e8068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:29.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.829+0000 7f640b66b640 1 --2- 172.21.15.45:0/1405886270 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f63e8066900 0x7f63e8068dc0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f64000011f0 tx=0x7f6400009040 comp rx=0 tx=0).stop 2023-11-28T18:38:29.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.829+0000 7f640b66b640 1 -- 172.21.15.45:0/1405886270 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f640415d1a0 msgr2=0x7f6404154180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:29.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.829+0000 7f640b66b640 1 --2- 172.21.15.45:0/1405886270 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f640415d1a0 0x7f6404154180 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f63fc00cc60 tx=0x7f63fc00a430 comp rx=0 tx=0).stop 2023-11-28T18:38:29.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.829+0000 7f640b66b640 1 -- 172.21.15.45:0/1405886270 shutdown_connections 2023-11-28T18:38:29.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.829+0000 7f640b66b640 1 --2- 172.21.15.45:0/1405886270 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f63e8066900 0x7f63e8068dc0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:29.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.829+0000 7f640b66b640 1 --2- 172.21.15.45:0/1405886270 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f640415d1a0 0x7f6404154180 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:29.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.829+0000 7f640b66b640 1 --2- 172.21.15.45:0/1405886270 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f640406cdc0 0x7f64041521e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:29.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.829+0000 7f640b66b640 1 --2- 172.21.15.45:0/1405886270 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f640406b580 0x7f640414f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:29.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.829+0000 7f640b66b640 1 -- 172.21.15.45:0/1405886270 >> 172.21.15.45:0/1405886270 conn(0x7f64040b1b30 msgr2=0x7f6404158b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:29.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.829+0000 7f640b66b640 1 -- 172.21.15.45:0/1405886270 shutdown_connections 2023-11-28T18:38:29.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.829+0000 7f640b66b640 1 -- 172.21.15.45:0/1405886270 wait complete. 2023-11-28T18:38:29.853 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-11-28T18:38:29.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.993+0000 7f7e7a101640 1 Processor -- start 2023-11-28T18:38:29.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.993+0000 7f7e7a101640 1 -- start start 2023-11-28T18:38:29.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.997+0000 7f7e7a101640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7e7415d3c0 0x7f7e740c9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:29.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.997+0000 7f7e7a101640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f7e740cfaf0 0x7f7e740cc240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:29.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.997+0000 7f7e7a101640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e740afe40 con 0x7f7e740cc780 2023-11-28T18:38:29.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.997+0000 7f7e7a101640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e740af880 con 0x7f7e740cfaf0 2023-11-28T18:38:29.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.997+0000 7f7e7a101640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e740afb60 con 0x7f7e7415d3c0 2023-11-28T18:38:29.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.997+0000 7f7e73fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f7e740cc780 0x7f7e740c84b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47816/0 (socket says 172.21.15.45:47816) 2023-11-28T18:38:29.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.997+0000 7f7e73fff640 1 -- 172.21.15.45:0/688912687 learned_addr learned my addr 172.21.15.45:0/688912687 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:38:29.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.997+0000 7f7e737fe640 1 --2- 172.21.15.45:0/688912687 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7e7415d3c0 0x7f7e740c9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:30.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.997+0000 7f7e72ffd640 1 --2- 172.21.15.45:0/688912687 >> v2:172.21.15.190:3300/0 conn(0x7f7e740cfaf0 0x7f7e740cc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:30.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.997+0000 7f7e727fc640 1 -- 172.21.15.45:0/688912687 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3559210948 0 0) 0x7f7e740afe40 con 0x7f7e740cc780 2023-11-28T18:38:30.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.997+0000 7f7e727fc640 1 -- 172.21.15.45:0/688912687 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e5c003530 con 0x7f7e740cc780 2023-11-28T18:38:30.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.997+0000 7f7e737fe640 1 -- 172.21.15.45:0/688912687 >> v2:172.21.15.190:3300/0 conn(0x7f7e740cfaf0 msgr2=0x7f7e740cc240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:30.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.997+0000 7f7e737fe640 1 --2- 172.21.15.45:0/688912687 >> v2:172.21.15.190:3300/0 conn(0x7f7e740cfaf0 0x7f7e740cc240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:30.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.997+0000 7f7e737fe640 1 -- 172.21.15.45:0/688912687 >> v1:172.21.15.45:6789/0 conn(0x7f7e740cc780 legacy=0x7f7e740c84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:30.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:29.997+0000 7f7e737fe640 1 -- 172.21.15.45:0/688912687 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e740cbd20 con 0x7f7e7415d3c0 2023-11-28T18:38:30.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.001+0000 7f7e737fe640 1 --2- 172.21.15.45:0/688912687 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7e7415d3c0 0x7f7e740c9090 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7e640097c0 tx=0x7f7e6401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9e142a7c03cac8b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:30.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.001+0000 7f7e727fc640 1 -- 172.21.15.45:0/688912687 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e640a6040 con 0x7f7e7415d3c0 2023-11-28T18:38:30.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.001+0000 7f7e727fc640 1 -- 172.21.15.45:0/688912687 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e640aa600 con 0x7f7e7415d3c0 2023-11-28T18:38:30.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.001+0000 7f7e727fc640 1 -- 172.21.15.45:0/688912687 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e640aa990 con 0x7f7e7415d3c0 2023-11-28T18:38:30.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.001+0000 7f7e7a101640 1 -- 172.21.15.45:0/688912687 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7e7415d3c0 msgr2=0x7f7e740c9090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:30.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.001+0000 7f7e7a101640 1 --2- 172.21.15.45:0/688912687 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7e7415d3c0 0x7f7e740c9090 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7e640097c0 tx=0x7f7e6401c480 comp rx=0 tx=0).stop 2023-11-28T18:38:30.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.001+0000 7f7e7a101640 1 -- 172.21.15.45:0/688912687 shutdown_connections 2023-11-28T18:38:30.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.001+0000 7f7e7a101640 1 --2- 172.21.15.45:0/688912687 >> v2:172.21.15.190:3300/0 conn(0x7f7e740cfaf0 0x7f7e740cc240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:30.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.001+0000 7f7e7a101640 1 --2- 172.21.15.45:0/688912687 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7e7415d3c0 0x7f7e740c9090 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:30.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.001+0000 7f7e7a101640 1 -- 172.21.15.45:0/688912687 >> 172.21.15.45:0/688912687 conn(0x7f7e74071c90 msgr2=0x7f7e74072070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:30.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.001+0000 7f7e7a101640 1 -- 172.21.15.45:0/688912687 shutdown_connections 2023-11-28T18:38:30.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.001+0000 7f7e7a101640 1 -- 172.21.15.45:0/688912687 wait complete. 2023-11-28T18:38:30.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.001+0000 7f7e7a101640 1 Processor -- start 2023-11-28T18:38:30.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.001+0000 7f7e7a101640 1 -- start start 2023-11-28T18:38:30.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.005+0000 7f7e7a101640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7e740cc780 0x7f7e740b3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:30.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.005+0000 7f7e7a101640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7e740cfaf0 0x7f7e7414ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:30.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.005+0000 7f7e7a101640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e7415d3c0 0x7f7e74160170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:30.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.005+0000 7f7e7a101640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7415fd50 con 0x7f7e7415d3c0 2023-11-28T18:38:30.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.005+0000 7f7e7a101640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e741504e0 con 0x7f7e740cc780 2023-11-28T18:38:30.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.005+0000 7f7e7a101640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7415f0d0 con 0x7f7e740cfaf0 2023-11-28T18:38:30.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.005+0000 7f7e73fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e7415d3c0 0x7f7e74160170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:30.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.005+0000 7f7e73fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e7415d3c0 0x7f7e74160170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60046/0 (socket says 172.21.15.45:60046) 2023-11-28T18:38:30.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.005+0000 7f7e73fff640 1 -- 172.21.15.45:0/625452791 learned_addr learned my addr 172.21.15.45:0/625452791 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:30.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.005+0000 7f7e72ffd640 1 --2- 172.21.15.45:0/625452791 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7e740cfaf0 0x7f7e7414ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:30.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.005+0000 7f7e737fe640 1 --2- 172.21.15.45:0/625452791 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7e740cc780 0x7f7e740b3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:30.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.005+0000 7f7e73fff640 1 -- 172.21.15.45:0/625452791 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7e740cfaf0 msgr2=0x7f7e7414ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:30.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.005+0000 7f7e73fff640 1 --2- 172.21.15.45:0/625452791 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7e740cfaf0 0x7f7e7414ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:30.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.005+0000 7f7e73fff640 1 -- 172.21.15.45:0/625452791 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7e740cc780 msgr2=0x7f7e740b3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:30.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.005+0000 7f7e73fff640 1 --2- 172.21.15.45:0/625452791 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7e740cc780 0x7f7e740b3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:30.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.005+0000 7f7e73fff640 1 -- 172.21.15.45:0/625452791 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e64009420 con 0x7f7e7415d3c0 2023-11-28T18:38:30.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.005+0000 7f7e73fff640 1 --2- 172.21.15.45:0/625452791 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e7415d3c0 0x7f7e74160170 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c00cb40 tx=0x7f7e6c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:30.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.005+0000 7f7e5bfff640 1 -- 172.21.15.45:0/625452791 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c00aca0 con 0x7f7e7415d3c0 2023-11-28T18:38:30.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.005+0000 7f7e5bfff640 1 -- 172.21.15.45:0/625452791 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e6c00ae00 con 0x7f7e7415d3c0 2023-11-28T18:38:30.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.005+0000 7f7e7a101640 1 -- 172.21.15.45:0/625452791 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e7415f3b0 con 0x7f7e7415d3c0 2023-11-28T18:38:30.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.005+0000 7f7e5bfff640 1 -- 172.21.15.45:0/625452791 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c012620 con 0x7f7e7415d3c0 2023-11-28T18:38:30.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.005+0000 7f7e7a101640 1 -- 172.21.15.45:0/625452791 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e7415f970 con 0x7f7e7415d3c0 2023-11-28T18:38:30.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.005+0000 7f7e7a101640 1 -- 172.21.15.45:0/625452791 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e7415fe90 con 0x7f7e7415d3c0 2023-11-28T18:38:30.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.005+0000 7f7e5bfff640 1 -- 172.21.15.45:0/625452791 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f7e6c007070 con 0x7f7e7415d3c0 2023-11-28T18:38:30.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.009+0000 7f7e5bfff640 1 --2- 172.21.15.45:0/625452791 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f7e600668d0 0x7f7e60068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:30.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.009+0000 7f7e5bfff640 1 -- 172.21.15.45:0/625452791 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7e6c084110 con 0x7f7e7415d3c0 2023-11-28T18:38:30.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.009+0000 7f7e737fe640 1 --2- 172.21.15.45:0/625452791 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f7e600668d0 0x7f7e60068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:30.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.009+0000 7f7e737fe640 1 --2- 172.21.15.45:0/625452791 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f7e600668d0 0x7f7e60068d90 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7e640ae000 tx=0x7f7e640b5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:30.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.013+0000 7f7e5bfff640 1 -- 172.21.15.45:0/625452791 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7e7415fe90 con 0x7f7e7415d3c0 2023-11-28T18:38:30.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.225+0000 7f7e7a101640 1 -- 172.21.15.45:0/625452791 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f7e7415fe90 con 0x7f7e7415d3c0 2023-11-28T18:38:30.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.229+0000 7f7e5bfff640 1 -- 172.21.15.45:0/625452791 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f7e7415fe90 con 0x7f7e7415d3c0 2023-11-28T18:38:30.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.233+0000 7f7e7a101640 1 -- 172.21.15.45:0/625452791 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f7e600668d0 msgr2=0x7f7e60068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:30.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.233+0000 7f7e7a101640 1 --2- 172.21.15.45:0/625452791 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f7e600668d0 0x7f7e60068d90 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7e640ae000 tx=0x7f7e640b5040 comp rx=0 tx=0).stop 2023-11-28T18:38:30.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.233+0000 7f7e7a101640 1 -- 172.21.15.45:0/625452791 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e7415d3c0 msgr2=0x7f7e74160170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:30.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.233+0000 7f7e7a101640 1 --2- 172.21.15.45:0/625452791 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e7415d3c0 0x7f7e74160170 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c00cb40 tx=0x7f7e6c00a060 comp rx=0 tx=0).stop 2023-11-28T18:38:30.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.233+0000 7f7e7a101640 1 -- 172.21.15.45:0/625452791 shutdown_connections 2023-11-28T18:38:30.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.233+0000 7f7e7a101640 1 --2- 172.21.15.45:0/625452791 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f7e600668d0 0x7f7e60068d90 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:30.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.233+0000 7f7e7a101640 1 --2- 172.21.15.45:0/625452791 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e7415d3c0 0x7f7e74160170 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:30.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.233+0000 7f7e7a101640 1 --2- 172.21.15.45:0/625452791 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7e740cfaf0 0x7f7e7414ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:30.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.233+0000 7f7e7a101640 1 --2- 172.21.15.45:0/625452791 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7e740cc780 0x7f7e740b3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:30.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.233+0000 7f7e7a101640 1 -- 172.21.15.45:0/625452791 >> 172.21.15.45:0/625452791 conn(0x7f7e74071c90 msgr2=0x7f7e740c9bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:30.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.233+0000 7f7e7a101640 1 -- 172.21.15.45:0/625452791 shutdown_connections 2023-11-28T18:38:30.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.233+0000 7f7e7a101640 1 -- 172.21.15.45:0/625452791 wait complete. 2023-11-28T18:38:30.255 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-11-28T18:38:30.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.397+0000 7f093cc54640 1 Processor -- start 2023-11-28T18:38:30.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.397+0000 7f093cc54640 1 -- start start 2023-11-28T18:38:30.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.397+0000 7f093cc54640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f093806ca10 0x7f09380704a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:30.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.397+0000 7f093cc54640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0938071120 con 0x7f0938144880 2023-11-28T18:38:30.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.397+0000 7f093cc54640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0938071400 con 0x7f09380721c0 2023-11-28T18:38:30.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.397+0000 7f093cc54640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f093815f050 con 0x7f093806ca10 2023-11-28T18:38:30.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.397+0000 7f093659c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f0938144880 0x7f093806c300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47828/0 (socket says 172.21.15.45:47828) 2023-11-28T18:38:30.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.397+0000 7f093659c640 1 -- 172.21.15.45:0/1533913098 learned_addr learned my addr 172.21.15.45:0/1533913098 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:38:30.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.397+0000 7f092ffff640 1 --2- 172.21.15.45:0/1533913098 >> v2:172.21.15.45:3300/0 conn(0x7f093806ca10 0x7f09380704a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:30.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.397+0000 7f092ffff640 1 -- 172.21.15.45:0/1533913098 >> v1:172.21.15.190:6789/0 conn(0x7f09380721c0 legacy=0x7f093815b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:30.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.397+0000 7f092ffff640 1 -- 172.21.15.45:0/1533913098 >> v1:172.21.15.45:6789/0 conn(0x7f0938144880 legacy=0x7f093806c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:30.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.397+0000 7f092ffff640 1 -- 172.21.15.45:0/1533913098 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09380716e0 con 0x7f093806ca10 2023-11-28T18:38:30.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.401+0000 7f092ffff640 1 --2- 172.21.15.45:0/1533913098 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f093806ca10 0x7f09380704a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f09200097c0 tx=0x7f092001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5658544228a7c1e4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:30.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.401+0000 7f0935d9b640 1 -- 172.21.15.45:0/1533913098 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09200ab610 con 0x7f093806ca10 2023-11-28T18:38:30.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.401+0000 7f0935d9b640 1 -- 172.21.15.45:0/1533913098 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09200ab770 con 0x7f093806ca10 2023-11-28T18:38:30.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.401+0000 7f0935d9b640 1 -- 172.21.15.45:0/1533913098 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09200abb00 con 0x7f093806ca10 2023-11-28T18:38:30.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.401+0000 7f093cc54640 1 -- 172.21.15.45:0/1533913098 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f093806ca10 msgr2=0x7f09380704a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:30.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.401+0000 7f093cc54640 1 --2- 172.21.15.45:0/1533913098 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f093806ca10 0x7f09380704a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f09200097c0 tx=0x7f092001c410 comp rx=0 tx=0).stop 2023-11-28T18:38:30.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.401+0000 7f093cc54640 1 -- 172.21.15.45:0/1533913098 shutdown_connections 2023-11-28T18:38:30.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.401+0000 7f093cc54640 1 --2- 172.21.15.45:0/1533913098 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f093806ca10 0x7f09380704a0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:30.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.401+0000 7f093cc54640 1 -- 172.21.15.45:0/1533913098 >> 172.21.15.45:0/1533913098 conn(0x7f093806a570 msgr2=0x7f093806a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:30.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.401+0000 7f093cc54640 1 -- 172.21.15.45:0/1533913098 shutdown_connections 2023-11-28T18:38:30.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.401+0000 7f093cc54640 1 -- 172.21.15.45:0/1533913098 wait complete. 2023-11-28T18:38:30.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.405+0000 7f093cc54640 1 Processor -- start 2023-11-28T18:38:30.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.405+0000 7f093cc54640 1 -- start start 2023-11-28T18:38:30.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.405+0000 7f093cc54640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f093806ca10 0x7f0938159c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:30.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.405+0000 7f093cc54640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f09380721c0 0x7f093813e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:30.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.405+0000 7f093cc54640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0938144880 0x7f093815a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:30.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.405+0000 7f093cc54640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f093813db00 con 0x7f093806ca10 2023-11-28T18:38:30.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.405+0000 7f093cc54640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f093813f670 con 0x7f0938144880 2023-11-28T18:38:30.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.405+0000 7f093cc54640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f093813f950 con 0x7f09380721c0 2023-11-28T18:38:30.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.405+0000 7f093659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f093806ca10 0x7f0938159c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:30.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.405+0000 7f093659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f093806ca10 0x7f0938159c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60062/0 (socket says 172.21.15.45:60062) 2023-11-28T18:38:30.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.405+0000 7f093659c640 1 -- 172.21.15.45:0/2410037005 learned_addr learned my addr 172.21.15.45:0/2410037005 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:30.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.405+0000 7f092ffff640 1 --2- 172.21.15.45:0/2410037005 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f09380721c0 0x7f093813e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:30.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.405+0000 7f0936d9d640 1 --2- 172.21.15.45:0/2410037005 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0938144880 0x7f093815a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:30.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.405+0000 7f093659c640 1 -- 172.21.15.45:0/2410037005 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f09380721c0 msgr2=0x7f093813e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:30.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.405+0000 7f093659c640 1 --2- 172.21.15.45:0/2410037005 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f09380721c0 0x7f093813e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:30.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.405+0000 7f093659c640 1 -- 172.21.15.45:0/2410037005 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0938144880 msgr2=0x7f093815a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:30.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.405+0000 7f093659c640 1 --2- 172.21.15.45:0/2410037005 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0938144880 0x7f093815a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:30.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.405+0000 7f093659c640 1 -- 172.21.15.45:0/2410037005 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0920009420 con 0x7f093806ca10 2023-11-28T18:38:30.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.405+0000 7f093659c640 1 --2- 172.21.15.45:0/2410037005 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f093806ca10 0x7f0938159c80 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f092800c400 tx=0x7f092800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:30.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.405+0000 7f092effd640 1 -- 172.21.15.45:0/2410037005 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0928005cf0 con 0x7f093806ca10 2023-11-28T18:38:30.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.405+0000 7f092effd640 1 -- 172.21.15.45:0/2410037005 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0928005e50 con 0x7f093806ca10 2023-11-28T18:38:30.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.405+0000 7f092effd640 1 -- 172.21.15.45:0/2410037005 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09280072d0 con 0x7f093806ca10 2023-11-28T18:38:30.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.405+0000 7f093cc54640 1 -- 172.21.15.45:0/2410037005 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f093813dda0 con 0x7f093806ca10 2023-11-28T18:38:30.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.405+0000 7f093cc54640 1 -- 172.21.15.45:0/2410037005 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f093813fc30 con 0x7f093806ca10 2023-11-28T18:38:30.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.405+0000 7f093cc54640 1 -- 172.21.15.45:0/2410037005 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f093813dfe0 con 0x7f093806ca10 2023-11-28T18:38:30.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.409+0000 7f092effd640 1 -- 172.21.15.45:0/2410037005 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f0928007430 con 0x7f093806ca10 2023-11-28T18:38:30.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.409+0000 7f092effd640 1 --2- 172.21.15.45:0/2410037005 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f09180668d0 0x7f0918068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:30.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.409+0000 7f092effd640 1 -- 172.21.15.45:0/2410037005 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f09280835c0 con 0x7f093806ca10 2023-11-28T18:38:30.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.409+0000 7f092ffff640 1 --2- 172.21.15.45:0/2410037005 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f09180668d0 0x7f0918068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:30.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.409+0000 7f092ffff640 1 --2- 172.21.15.45:0/2410037005 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f09180668d0 0x7f0918068d90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f09200af000 tx=0x7f09200a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:30.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.413+0000 7f092effd640 1 -- 172.21.15.45:0/2410037005 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f093813dfe0 con 0x7f093806ca10 2023-11-28T18:38:30.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.625+0000 7f093cc54640 1 -- 172.21.15.45:0/2410037005 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f093813df90 con 0x7f093806ca10 2023-11-28T18:38:30.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.625+0000 7f092effd640 1 -- 172.21.15.45:0/2410037005 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f0928050bf0 con 0x7f093806ca10 2023-11-28T18:38:30.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.629+0000 7f093cc54640 1 -- 172.21.15.45:0/2410037005 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f09180668d0 msgr2=0x7f0918068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:30.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.629+0000 7f093cc54640 1 --2- 172.21.15.45:0/2410037005 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f09180668d0 0x7f0918068d90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f09200af000 tx=0x7f09200a7000 comp rx=0 tx=0).stop 2023-11-28T18:38:30.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.629+0000 7f093cc54640 1 -- 172.21.15.45:0/2410037005 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f093806ca10 msgr2=0x7f0938159c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:30.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.629+0000 7f093cc54640 1 --2- 172.21.15.45:0/2410037005 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f093806ca10 0x7f0938159c80 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f092800c400 tx=0x7f092800c8c0 comp rx=0 tx=0).stop 2023-11-28T18:38:30.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.629+0000 7f093cc54640 1 -- 172.21.15.45:0/2410037005 shutdown_connections 2023-11-28T18:38:30.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.629+0000 7f093cc54640 1 --2- 172.21.15.45:0/2410037005 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f09180668d0 0x7f0918068d90 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:30.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.629+0000 7f093cc54640 1 --2- 172.21.15.45:0/2410037005 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0938144880 0x7f093815a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:30.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.629+0000 7f093cc54640 1 --2- 172.21.15.45:0/2410037005 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f09380721c0 0x7f093813e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:30.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.629+0000 7f093cc54640 1 --2- 172.21.15.45:0/2410037005 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f093806ca10 0x7f0938159c80 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:30.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.629+0000 7f093cc54640 1 -- 172.21.15.45:0/2410037005 >> 172.21.15.45:0/2410037005 conn(0x7f093806a570 msgr2=0x7f0938143550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:30.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.629+0000 7f093cc54640 1 -- 172.21.15.45:0/2410037005 shutdown_connections 2023-11-28T18:38:30.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.629+0000 7f093cc54640 1 -- 172.21.15.45:0/2410037005 wait complete. 2023-11-28T18:38:30.652 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-11-28T18:38:30.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.793+0000 7ff0fa3fd640 1 Processor -- start 2023-11-28T18:38:30.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.793+0000 7ff0fa3fd640 1 -- start start 2023-11-28T18:38:30.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.793+0000 7ff0fa3fd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff0f40cf950 0x7ff0f40cfd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:30.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.793+0000 7ff0fa3fd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff0f40d0270 0x7ff0f40d0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:30.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.793+0000 7ff0fa3fd640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0f40c7000 con 0x7ff0f40d06d0 2023-11-28T18:38:30.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.793+0000 7ff0fa3fd640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0f40cf0a0 con 0x7ff0f40d0270 2023-11-28T18:38:30.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.793+0000 7ff0fa3fd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f40ceae0 con 0x7ff0f40cf950 2023-11-28T18:38:30.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.793+0000 7ff0f9bfc640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff0f40d06d0 0x7ff0f40d12c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47844/0 (socket says 172.21.15.45:47844) 2023-11-28T18:38:30.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.793+0000 7ff0f9bfc640 1 -- 172.21.15.45:0/3460859670 learned_addr learned my addr 172.21.15.45:0/3460859670 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:38:30.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.797+0000 7ff0f8bfa640 1 --2- 172.21.15.45:0/3460859670 >> v2:172.21.15.190:3300/0 conn(0x7ff0f40d0270 0x7ff0f40d0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:30.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.797+0000 7ff0f93fb640 1 --2- 172.21.15.45:0/3460859670 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff0f40cf950 0x7ff0f40cfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:30.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.797+0000 7ff0ebfff640 1 -- 172.21.15.45:0/3460859670 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 458665747 0 0) 0x7ff0f40c7000 con 0x7ff0f40d06d0 2023-11-28T18:38:30.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.797+0000 7ff0ebfff640 1 -- 172.21.15.45:0/3460859670 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0e0003530 con 0x7ff0f40d06d0 2023-11-28T18:38:30.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.797+0000 7ff0ebfff640 1 -- 172.21.15.45:0/3460859670 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2352184893 0 0) 0x7ff0e0003530 con 0x7ff0f40d06d0 2023-11-28T18:38:30.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.797+0000 7ff0ebfff640 1 -- 172.21.15.45:0/3460859670 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff0f40cf950 msgr2=0x7ff0f40cfd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:30.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.797+0000 7ff0ebfff640 1 --2- 172.21.15.45:0/3460859670 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff0f40cf950 0x7ff0f40cfd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:30.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.797+0000 7ff0ebfff640 1 -- 172.21.15.45:0/3460859670 >> v2:172.21.15.190:3300/0 conn(0x7ff0f40d0270 msgr2=0x7ff0f40d0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:30.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.797+0000 7ff0ebfff640 1 --2- 172.21.15.45:0/3460859670 >> v2:172.21.15.190:3300/0 conn(0x7ff0f40d0270 0x7ff0f40d0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:30.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.797+0000 7ff0ebfff640 1 -- 172.21.15.45:0/3460859670 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0f40cedc0 con 0x7ff0f40d06d0 2023-11-28T18:38:30.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.797+0000 7ff0ebfff640 1 -- 172.21.15.45:0/3460859670 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4084481567 0 0) 0x7ff0ec001a00 con 0x7ff0f40d06d0 2023-11-28T18:38:30.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.797+0000 7ff0f8bfa640 1 --2- 172.21.15.45:0/3460859670 >> v2:172.21.15.190:3300/0 conn(0x7ff0f40d0270 0x7ff0f40d0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:38:30.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.797+0000 7ff0ebfff640 1 -- 172.21.15.45:0/3460859670 >> v1:172.21.15.45:6789/0 conn(0x7ff0f40d06d0 legacy=0x7ff0f40d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:30.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.797+0000 7ff0ebfff640 1 --2- 172.21.15.45:0/3460859670 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0e0003980 0x7ff0e0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:30.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.797+0000 7ff0ebfff640 1 --2- 172.21.15.45:0/3460859670 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff0e00047d0 0x7ff0e0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:30.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.797+0000 7ff0ebfff640 1 --2- 172.21.15.45:0/3460859670 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff0f40cf950 0x7ff0e0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:30.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.797+0000 7ff0ebfff640 1 -- 172.21.15.45:0/3460859670 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f40cf0a0 con 0x7ff0e0003980 2023-11-28T18:38:30.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.797+0000 7ff0ebfff640 1 -- 172.21.15.45:0/3460859670 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f40ceae0 con 0x7ff0e00047d0 2023-11-28T18:38:30.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.797+0000 7ff0ebfff640 1 -- 172.21.15.45:0/3460859670 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e000b9e0 con 0x7ff0f40cf950 2023-11-28T18:38:30.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.797+0000 7ff0f93fb640 1 --2- 172.21.15.45:0/3460859670 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0e0003980 0x7ff0e0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:30.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.797+0000 7ff0f8bfa640 1 --2- 172.21.15.45:0/3460859670 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff0e00047d0 0x7ff0e0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:30.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.797+0000 7ff0f9bfc640 1 --2- 172.21.15.45:0/3460859670 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff0f40cf950 0x7ff0e0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:30.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.797+0000 7ff0f93fb640 1 -- 172.21.15.45:0/3460859670 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff0f40cf950 msgr2=0x7ff0e0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:30.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.797+0000 7ff0f93fb640 1 --2- 172.21.15.45:0/3460859670 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff0f40cf950 0x7ff0e0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:30.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.797+0000 7ff0f93fb640 1 -- 172.21.15.45:0/3460859670 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff0e00047d0 msgr2=0x7ff0e0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:30.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.797+0000 7ff0f93fb640 1 --2- 172.21.15.45:0/3460859670 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff0e00047d0 0x7ff0e0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:30.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.797+0000 7ff0f93fb640 1 -- 172.21.15.45:0/3460859670 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e0003530 con 0x7ff0e0003980 2023-11-28T18:38:30.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.797+0000 7ff0f8bfa640 1 --2- 172.21.15.45:0/3460859670 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff0e00047d0 0x7ff0e0004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:38:30.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.797+0000 7ff0f9bfc640 1 --2- 172.21.15.45:0/3460859670 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff0f40cf950 0x7ff0e0005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:38:30.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.801+0000 7ff0f93fb640 1 --2- 172.21.15.45:0/3460859670 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0e0003980 0x7ff0e0003da0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff0f0009b10 tx=0x7ff0f001ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3c6f710c7f3e383 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:30.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.801+0000 7ff0ebfff640 1 -- 172.21.15.45:0/3460859670 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f00a6430 con 0x7ff0e0003980 2023-11-28T18:38:30.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.801+0000 7ff0ebfff640 1 -- 172.21.15.45:0/3460859670 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0f00a6590 con 0x7ff0e0003980 2023-11-28T18:38:30.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.801+0000 7ff0ebfff640 1 -- 172.21.15.45:0/3460859670 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f00a6940 con 0x7ff0e0003980 2023-11-28T18:38:30.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.801+0000 7ff0fa3fd640 1 -- 172.21.15.45:0/3460859670 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0e0003980 msgr2=0x7ff0e0003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:30.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.801+0000 7ff0fa3fd640 1 --2- 172.21.15.45:0/3460859670 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0e0003980 0x7ff0e0003da0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff0f0009b10 tx=0x7ff0f001ca20 comp rx=0 tx=0).stop 2023-11-28T18:38:30.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.801+0000 7ff0f9bfc640 1 -- 172.21.15.45:0/3460859670 reap_dead start 2023-11-28T18:38:30.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.801+0000 7ff0fa3fd640 1 -- 172.21.15.45:0/3460859670 shutdown_connections 2023-11-28T18:38:30.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.801+0000 7ff0fa3fd640 1 -- 172.21.15.45:0/3460859670 >> 172.21.15.45:0/3460859670 conn(0x7ff0f40d2fa0 msgr2=0x7ff0f40d3380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:30.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.801+0000 7ff0fa3fd640 1 -- 172.21.15.45:0/3460859670 shutdown_connections 2023-11-28T18:38:30.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.801+0000 7ff0fa3fd640 1 -- 172.21.15.45:0/3460859670 wait complete. 2023-11-28T18:38:30.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.801+0000 7ff0fa3fd640 1 Processor -- start 2023-11-28T18:38:30.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.801+0000 7ff0fa3fd640 1 -- start start 2023-11-28T18:38:30.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.805+0000 7ff0fa3fd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff0e0003980 0x7ff0f409d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:30.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.805+0000 7ff0fa3fd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0f406b5a0 0x7ff0f406ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:30.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.805+0000 7ff0fa3fd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff0f406bf60 0x7ff0f409ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:30.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.805+0000 7ff0fa3fd640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f409e7d0 con 0x7ff0f406b5a0 2023-11-28T18:38:30.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.805+0000 7ff0fa3fd640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f409dc90 con 0x7ff0e0003980 2023-11-28T18:38:30.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.805+0000 7ff0fa3fd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f406c930 con 0x7ff0f406bf60 2023-11-28T18:38:30.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.805+0000 7ff0f8bfa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0f406b5a0 0x7ff0f406ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:30.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.805+0000 7ff0f8bfa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0f406b5a0 0x7ff0f406ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60078/0 (socket says 172.21.15.45:60078) 2023-11-28T18:38:30.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.805+0000 7ff0f8bfa640 1 -- 172.21.15.45:0/1477611651 learned_addr learned my addr 172.21.15.45:0/1477611651 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:30.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.805+0000 7ff0f9bfc640 1 --2- 172.21.15.45:0/1477611651 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff0f406bf60 0x7ff0f409ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:30.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.805+0000 7ff0f93fb640 1 --2- 172.21.15.45:0/1477611651 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff0e0003980 0x7ff0f409d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:30.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.805+0000 7ff0f8bfa640 1 -- 172.21.15.45:0/1477611651 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff0f406bf60 msgr2=0x7ff0f409ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:30.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.805+0000 7ff0f8bfa640 1 --2- 172.21.15.45:0/1477611651 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff0f406bf60 0x7ff0f409ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:30.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.805+0000 7ff0f8bfa640 1 -- 172.21.15.45:0/1477611651 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff0e0003980 msgr2=0x7ff0f409d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:30.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.805+0000 7ff0f8bfa640 1 --2- 172.21.15.45:0/1477611651 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff0e0003980 0x7ff0f409d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:30.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.805+0000 7ff0f8bfa640 1 -- 172.21.15.45:0/1477611651 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0f406cc10 con 0x7ff0f406b5a0 2023-11-28T18:38:30.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.805+0000 7ff0f93fb640 1 --2- 172.21.15.45:0/1477611651 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff0e0003980 0x7ff0f409d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:38:30.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.805+0000 7ff0f9bfc640 1 --2- 172.21.15.45:0/1477611651 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff0f406bf60 0x7ff0f409ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:38:30.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.805+0000 7ff0f8bfa640 1 --2- 172.21.15.45:0/1477611651 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0f406b5a0 0x7ff0f406ba20 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7ff0e4011880 tx=0x7ff0e4011d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:30.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.805+0000 7ff0e9ffb640 1 -- 172.21.15.45:0/1477611651 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e400fbd0 con 0x7ff0f406b5a0 2023-11-28T18:38:30.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.805+0000 7ff0e9ffb640 1 -- 172.21.15.45:0/1477611651 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e400fd30 con 0x7ff0f406b5a0 2023-11-28T18:38:30.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.805+0000 7ff0e9ffb640 1 -- 172.21.15.45:0/1477611651 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e4015660 con 0x7ff0f406b5a0 2023-11-28T18:38:30.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.805+0000 7ff0fa3fd640 1 -- 172.21.15.45:0/1477611651 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0f409e180 con 0x7ff0f406b5a0 2023-11-28T18:38:30.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.805+0000 7ff0fa3fd640 1 -- 172.21.15.45:0/1477611651 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0f406c3e0 con 0x7ff0f406b5a0 2023-11-28T18:38:30.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.805+0000 7ff0fa3fd640 1 -- 172.21.15.45:0/1477611651 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0f406c6c0 con 0x7ff0f406b5a0 2023-11-28T18:38:30.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.805+0000 7ff0e9ffb640 1 -- 172.21.15.45:0/1477611651 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ff0e40157c0 con 0x7ff0f406b5a0 2023-11-28T18:38:30.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.809+0000 7ff0e9ffb640 1 --2- 172.21.15.45:0/1477611651 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff0d8066900 0x7ff0d8068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:30.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.809+0000 7ff0e9ffb640 1 -- 172.21.15.45:0/1477611651 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff0e4084ba0 con 0x7ff0f406b5a0 2023-11-28T18:38:30.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.809+0000 7ff0f93fb640 1 --2- 172.21.15.45:0/1477611651 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff0d8066900 0x7ff0d8068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:30.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.809+0000 7ff0f93fb640 1 --2- 172.21.15.45:0/1477611651 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff0d8066900 0x7ff0d8068dc0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff0f00ad000 tx=0x7ff0f00b2040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:30.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:30.813+0000 7ff0e9ffb640 1 -- 172.21.15.45:0/1477611651 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff0e4052090 con 0x7ff0f406b5a0 2023-11-28T18:38:31.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.025+0000 7ff0fa3fd640 1 -- 172.21.15.45:0/1477611651 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7ff0f404e970 con 0x7ff0f406b5a0 2023-11-28T18:38:31.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.029+0000 7ff0e9ffb640 1 -- 172.21.15.45:0/1477611651 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7ff0e400fea0 con 0x7ff0f406b5a0 2023-11-28T18:38:31.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.033+0000 7ff0fa3fd640 1 -- 172.21.15.45:0/1477611651 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff0d8066900 msgr2=0x7ff0d8068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:31.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.033+0000 7ff0fa3fd640 1 --2- 172.21.15.45:0/1477611651 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff0d8066900 0x7ff0d8068dc0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff0f00ad000 tx=0x7ff0f00b2040 comp rx=0 tx=0).stop 2023-11-28T18:38:31.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.033+0000 7ff0fa3fd640 1 -- 172.21.15.45:0/1477611651 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0f406b5a0 msgr2=0x7ff0f406ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:31.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.033+0000 7ff0fa3fd640 1 --2- 172.21.15.45:0/1477611651 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0f406b5a0 0x7ff0f406ba20 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7ff0e4011880 tx=0x7ff0e4011d40 comp rx=0 tx=0).stop 2023-11-28T18:38:31.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.033+0000 7ff0fa3fd640 1 -- 172.21.15.45:0/1477611651 shutdown_connections 2023-11-28T18:38:31.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.033+0000 7ff0fa3fd640 1 --2- 172.21.15.45:0/1477611651 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff0d8066900 0x7ff0d8068dc0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:31.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.033+0000 7ff0fa3fd640 1 --2- 172.21.15.45:0/1477611651 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff0f406bf60 0x7ff0f409ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:31.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.033+0000 7ff0fa3fd640 1 --2- 172.21.15.45:0/1477611651 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0f406b5a0 0x7ff0f406ba20 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:31.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.033+0000 7ff0fa3fd640 1 --2- 172.21.15.45:0/1477611651 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff0e0003980 0x7ff0f409d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:31.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.033+0000 7ff0fa3fd640 1 -- 172.21.15.45:0/1477611651 >> 172.21.15.45:0/1477611651 conn(0x7ff0f40d2fa0 msgr2=0x7ff0f4161560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:31.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.033+0000 7ff0fa3fd640 1 -- 172.21.15.45:0/1477611651 shutdown_connections 2023-11-28T18:38:31.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.033+0000 7ff0fa3fd640 1 -- 172.21.15.45:0/1477611651 wait complete. 2023-11-28T18:38:31.055 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-11-28T18:38:31.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.197+0000 7fdaf17c4640 1 Processor -- start 2023-11-28T18:38:31.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.197+0000 7fdaf17c4640 1 -- start start 2023-11-28T18:38:31.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.197+0000 7fdaf17c4640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fdaec1509a0 0x7fdaec159de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:31.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.197+0000 7fdaf17c4640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaec0704a0 con 0x7fdaec06d1d0 2023-11-28T18:38:31.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.197+0000 7fdaf17c4640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaec15ab60 con 0x7fdaec06cdf0 2023-11-28T18:38:31.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.197+0000 7fdaf17c4640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaec0706d0 con 0x7fdaec1509a0 2023-11-28T18:38:31.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.197+0000 7fdaeb7fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fdaec06d1d0 0x7fdaec15a320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47854/0 (socket says 172.21.15.45:47854) 2023-11-28T18:38:31.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.197+0000 7fdaeb7fe640 1 -- 172.21.15.45:0/2629509093 learned_addr learned my addr 172.21.15.45:0/2629509093 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:38:31.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.197+0000 7fdae3fff640 1 --2- 172.21.15.45:0/2629509093 >> v2:172.21.15.190:3300/0 conn(0x7fdaec1509a0 0x7fdaec159de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:31.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.197+0000 7fdaea7fc640 1 -- 172.21.15.45:0/2629509093 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2590295635 0 0) 0x7fdaec0704a0 con 0x7fdaec06d1d0 2023-11-28T18:38:31.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.197+0000 7fdaea7fc640 1 -- 172.21.15.45:0/2629509093 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdad8003530 con 0x7fdaec06d1d0 2023-11-28T18:38:31.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.197+0000 7fdae3fff640 1 -- 172.21.15.45:0/2629509093 >> v1:172.21.15.190:6789/0 conn(0x7fdaec06cdf0 legacy=0x7fdaec150290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:31.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.197+0000 7fdae3fff640 1 -- 172.21.15.45:0/2629509093 >> v1:172.21.15.45:6789/0 conn(0x7fdaec06d1d0 legacy=0x7fdaec15a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:31.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.197+0000 7fdae3fff640 1 -- 172.21.15.45:0/2629509093 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaec0709b0 con 0x7fdaec1509a0 2023-11-28T18:38:31.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.201+0000 7fdae3fff640 1 --2- 172.21.15.45:0/2629509093 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdaec1509a0 0x7fdaec159de0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fdad400a960 tx=0x7fdad401d850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ba6d47c5cf68619 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:31.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.201+0000 7fdaea7fc640 1 -- 172.21.15.45:0/2629509093 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad40a76b0 con 0x7fdaec1509a0 2023-11-28T18:38:31.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.201+0000 7fdaea7fc640 1 -- 172.21.15.45:0/2629509093 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdad40a7810 con 0x7fdaec1509a0 2023-11-28T18:38:31.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.201+0000 7fdaea7fc640 1 -- 172.21.15.45:0/2629509093 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad40a7b80 con 0x7fdaec1509a0 2023-11-28T18:38:31.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.201+0000 7fdaf17c4640 1 -- 172.21.15.45:0/2629509093 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdaec1509a0 msgr2=0x7fdaec159de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:31.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.201+0000 7fdaf17c4640 1 --2- 172.21.15.45:0/2629509093 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdaec1509a0 0x7fdaec159de0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fdad400a960 tx=0x7fdad401d850 comp rx=0 tx=0).stop 2023-11-28T18:38:31.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.201+0000 7fdaf17c4640 1 -- 172.21.15.45:0/2629509093 shutdown_connections 2023-11-28T18:38:31.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.201+0000 7fdaf17c4640 1 --2- 172.21.15.45:0/2629509093 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdaec1509a0 0x7fdaec159de0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:31.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.201+0000 7fdaf17c4640 1 -- 172.21.15.45:0/2629509093 >> 172.21.15.45:0/2629509093 conn(0x7fdaec06a570 msgr2=0x7fdaec06a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:31.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.201+0000 7fdaf17c4640 1 -- 172.21.15.45:0/2629509093 shutdown_connections 2023-11-28T18:38:31.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.201+0000 7fdaf17c4640 1 -- 172.21.15.45:0/2629509093 wait complete. 2023-11-28T18:38:31.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.205+0000 7fdaf17c4640 1 Processor -- start 2023-11-28T18:38:31.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.205+0000 7fdaf17c4640 1 -- start start 2023-11-28T18:38:31.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.205+0000 7fdaf17c4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdaec06cdf0 0x7fdaec0afe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:31.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.205+0000 7fdaf17c4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdaec06d1d0 0x7fdaec0b0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:31.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.205+0000 7fdaf17c4640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdaec1509a0 0x7fdaec0aee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:31.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.205+0000 7fdaf17c4640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaec0b0390 con 0x7fdaec06d1d0 2023-11-28T18:38:31.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.205+0000 7fdaf17c4640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaec0b1220 con 0x7fdaec1509a0 2023-11-28T18:38:31.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.205+0000 7fdaf17c4640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaec14d940 con 0x7fdaec06cdf0 2023-11-28T18:38:31.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.205+0000 7fdae3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdaec06d1d0 0x7fdaec0b0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:31.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.205+0000 7fdae3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdaec06d1d0 0x7fdaec0b0ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60090/0 (socket says 172.21.15.45:60090) 2023-11-28T18:38:31.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.205+0000 7fdae3fff640 1 -- 172.21.15.45:0/4074641186 learned_addr learned my addr 172.21.15.45:0/4074641186 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:31.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.205+0000 7fdaeaffd640 1 --2- 172.21.15.45:0/4074641186 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdaec06cdf0 0x7fdaec0afe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:31.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.205+0000 7fdaeb7fe640 1 --2- 172.21.15.45:0/4074641186 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdaec1509a0 0x7fdaec0aee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:31.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.205+0000 7fdae3fff640 1 -- 172.21.15.45:0/4074641186 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdaec06cdf0 msgr2=0x7fdaec0afe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:31.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.205+0000 7fdae3fff640 1 --2- 172.21.15.45:0/4074641186 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdaec06cdf0 0x7fdaec0afe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:31.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.205+0000 7fdae3fff640 1 -- 172.21.15.45:0/4074641186 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdaec1509a0 msgr2=0x7fdaec0aee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:31.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.205+0000 7fdae3fff640 1 --2- 172.21.15.45:0/4074641186 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdaec1509a0 0x7fdaec0aee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:31.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.205+0000 7fdae3fff640 1 -- 172.21.15.45:0/4074641186 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdad400a5c0 con 0x7fdaec06d1d0 2023-11-28T18:38:31.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.205+0000 7fdae3fff640 1 --2- 172.21.15.45:0/4074641186 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdaec06d1d0 0x7fdaec0b0ce0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fdad400a960 tx=0x7fdad401c090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:31.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.205+0000 7fdae37fe640 1 -- 172.21.15.45:0/4074641186 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad40a7e50 con 0x7fdaec06d1d0 2023-11-28T18:38:31.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.205+0000 7fdae37fe640 1 -- 172.21.15.45:0/4074641186 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdad4004030 con 0x7fdaec06d1d0 2023-11-28T18:38:31.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.205+0000 7fdae37fe640 1 -- 172.21.15.45:0/4074641186 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad40043e0 con 0x7fdaec06d1d0 2023-11-28T18:38:31.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.205+0000 7fdaf17c4640 1 -- 172.21.15.45:0/4074641186 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaec14dc20 con 0x7fdaec06d1d0 2023-11-28T18:38:31.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.205+0000 7fdaf17c4640 1 -- 172.21.15.45:0/4074641186 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaec14e1e0 con 0x7fdaec06d1d0 2023-11-28T18:38:31.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.209+0000 7fdaf17c4640 1 -- 172.21.15.45:0/4074641186 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaec069480 con 0x7fdaec06d1d0 2023-11-28T18:38:31.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.209+0000 7fdae37fe640 1 -- 172.21.15.45:0/4074641186 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fdad4003620 con 0x7fdaec06d1d0 2023-11-28T18:38:31.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.209+0000 7fdae37fe640 1 --2- 172.21.15.45:0/4074641186 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fdacc0668d0 0x7fdacc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:31.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.209+0000 7fdae37fe640 1 -- 172.21.15.45:0/4074641186 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fdad40ab070 con 0x7fdaec06d1d0 2023-11-28T18:38:31.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.209+0000 7fdaeaffd640 1 --2- 172.21.15.45:0/4074641186 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fdacc0668d0 0x7fdacc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:31.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.209+0000 7fdaeaffd640 1 --2- 172.21.15.45:0/4074641186 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fdacc0668d0 0x7fdacc068d90 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fdadc001650 tx=0x7fdadc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:31.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.213+0000 7fdae37fe640 1 -- 172.21.15.45:0/4074641186 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdad40eb610 con 0x7fdaec06d1d0 2023-11-28T18:38:31.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.429+0000 7fdaf17c4640 1 -- 172.21.15.45:0/4074641186 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fdaec0713c0 con 0x7fdaec06d1d0 2023-11-28T18:38:31.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.433+0000 7fdae37fe640 1 -- 172.21.15.45:0/4074641186 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7fdaec0713c0 con 0x7fdaec06d1d0 2023-11-28T18:38:31.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.433+0000 7fdaf17c4640 1 -- 172.21.15.45:0/4074641186 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fdacc0668d0 msgr2=0x7fdacc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:31.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.433+0000 7fdaf17c4640 1 --2- 172.21.15.45:0/4074641186 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fdacc0668d0 0x7fdacc068d90 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fdadc001650 tx=0x7fdadc009040 comp rx=0 tx=0).stop 2023-11-28T18:38:31.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.433+0000 7fdaf17c4640 1 -- 172.21.15.45:0/4074641186 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdaec06d1d0 msgr2=0x7fdaec0b0ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:31.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.433+0000 7fdaf17c4640 1 --2- 172.21.15.45:0/4074641186 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdaec06d1d0 0x7fdaec0b0ce0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fdad400a960 tx=0x7fdad401c090 comp rx=0 tx=0).stop 2023-11-28T18:38:31.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.433+0000 7fdaf17c4640 1 -- 172.21.15.45:0/4074641186 shutdown_connections 2023-11-28T18:38:31.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.433+0000 7fdaf17c4640 1 --2- 172.21.15.45:0/4074641186 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fdacc0668d0 0x7fdacc068d90 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:31.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.433+0000 7fdaf17c4640 1 --2- 172.21.15.45:0/4074641186 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdaec1509a0 0x7fdaec0aee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:31.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.433+0000 7fdaf17c4640 1 --2- 172.21.15.45:0/4074641186 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdaec06d1d0 0x7fdaec0b0ce0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:31.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.433+0000 7fdaf17c4640 1 --2- 172.21.15.45:0/4074641186 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdaec06cdf0 0x7fdaec0afe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:31.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.433+0000 7fdaf17c4640 1 -- 172.21.15.45:0/4074641186 >> 172.21.15.45:0/4074641186 conn(0x7fdaec06a570 msgr2=0x7fdaec15dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:31.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.433+0000 7fdaf17c4640 1 -- 172.21.15.45:0/4074641186 shutdown_connections 2023-11-28T18:38:31.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.433+0000 7fdaf17c4640 1 -- 172.21.15.45:0/4074641186 wait complete. 2023-11-28T18:38:31.457 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-11-28T18:38:31.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.597+0000 7fe021654640 1 Processor -- start 2023-11-28T18:38:31.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.597+0000 7fe021654640 1 -- start start 2023-11-28T18:38:31.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.601+0000 7fe021654640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe01c144880 0x7fe01c06c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:31.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.601+0000 7fe021654640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe01c0721c0 0x7fe01c06c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:31.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.601+0000 7fe021654640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe01c071120 con 0x7fe01c0704a0 2023-11-28T18:38:31.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.601+0000 7fe021654640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe01c15f050 con 0x7fe01c0721c0 2023-11-28T18:38:31.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.601+0000 7fe021654640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe01c071400 con 0x7fe01c144880 2023-11-28T18:38:31.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.601+0000 7fe013fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe01c0721c0 0x7fe01c06c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:31.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.601+0000 7fe013fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe01c0721c0 0x7fe01c06c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60096/0 (socket says 172.21.15.45:60096) 2023-11-28T18:38:31.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.601+0000 7fe013fff640 1 -- 172.21.15.45:0/2305444720 learned_addr learned my addr 172.21.15.45:0/2305444720 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:31.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.601+0000 7fe01affd640 1 --2- 172.21.15.45:0/2305444720 >> v2:172.21.15.190:3300/0 conn(0x7fe01c144880 0x7fe01c06c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:31.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.601+0000 7fe013fff640 1 -- 172.21.15.45:0/2305444720 >> v2:172.21.15.190:3300/0 conn(0x7fe01c144880 msgr2=0x7fe01c06c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:31.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.601+0000 7fe013fff640 1 --2- 172.21.15.45:0/2305444720 >> v2:172.21.15.190:3300/0 conn(0x7fe01c144880 0x7fe01c06c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:31.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.601+0000 7fe013fff640 1 -- 172.21.15.45:0/2305444720 >> v1:172.21.15.190:6789/0 conn(0x7fe01c0704a0 legacy=0x7fe01c070950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:31.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.601+0000 7fe013fff640 1 -- 172.21.15.45:0/2305444720 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe01c0716e0 con 0x7fe01c0721c0 2023-11-28T18:38:31.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.605+0000 7fe013fff640 1 --2- 172.21.15.45:0/2305444720 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe01c0721c0 0x7fe01c06c840 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fe01c068060 tx=0x7fe00401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d53c4273796fbb1a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:31.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.605+0000 7fe01a7fc640 1 -- 172.21.15.45:0/2305444720 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0040aa430 con 0x7fe01c0721c0 2023-11-28T18:38:31.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.605+0000 7fe01a7fc640 1 -- 172.21.15.45:0/2305444720 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0040aa590 con 0x7fe01c0721c0 2023-11-28T18:38:31.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.605+0000 7fe01a7fc640 1 -- 172.21.15.45:0/2305444720 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0040aa920 con 0x7fe01c0721c0 2023-11-28T18:38:31.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.605+0000 7fe021654640 1 -- 172.21.15.45:0/2305444720 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe01c0721c0 msgr2=0x7fe01c06c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:31.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.605+0000 7fe021654640 1 --2- 172.21.15.45:0/2305444720 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe01c0721c0 0x7fe01c06c840 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fe01c068060 tx=0x7fe00401c4d0 comp rx=0 tx=0).stop 2023-11-28T18:38:31.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.605+0000 7fe021654640 1 -- 172.21.15.45:0/2305444720 shutdown_connections 2023-11-28T18:38:31.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.605+0000 7fe021654640 1 --2- 172.21.15.45:0/2305444720 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe01c0721c0 0x7fe01c06c840 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:31.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.605+0000 7fe021654640 1 --2- 172.21.15.45:0/2305444720 >> v2:172.21.15.190:3300/0 conn(0x7fe01c144880 0x7fe01c06c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:31.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.605+0000 7fe021654640 1 -- 172.21.15.45:0/2305444720 >> 172.21.15.45:0/2305444720 conn(0x7fe01c06a570 msgr2=0x7fe01c06a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:31.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.605+0000 7fe021654640 1 -- 172.21.15.45:0/2305444720 shutdown_connections 2023-11-28T18:38:31.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.605+0000 7fe021654640 1 -- 172.21.15.45:0/2305444720 wait complete. 2023-11-28T18:38:31.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.605+0000 7fe021654640 1 Processor -- start 2023-11-28T18:38:31.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.605+0000 7fe021654640 1 -- start start 2023-11-28T18:38:31.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.605+0000 7fe021654640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe01c0704a0 0x7fe01c147cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:31.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.605+0000 7fe021654640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe01c0721c0 0x7fe01c159210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:31.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.605+0000 7fe021654640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe01c144880 0x7fe01c13c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:31.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.609+0000 7fe021654640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe01c159750 con 0x7fe01c0721c0 2023-11-28T18:38:31.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.609+0000 7fe021654640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe01c15a500 con 0x7fe01c0704a0 2023-11-28T18:38:31.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.609+0000 7fe021654640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe01c159980 con 0x7fe01c144880 2023-11-28T18:38:31.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.609+0000 7fe013fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe01c0721c0 0x7fe01c159210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:31.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.609+0000 7fe013fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe01c0721c0 0x7fe01c159210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60098/0 (socket says 172.21.15.45:60098) 2023-11-28T18:38:31.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.609+0000 7fe013fff640 1 -- 172.21.15.45:0/411505541 learned_addr learned my addr 172.21.15.45:0/411505541 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:31.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.609+0000 7fe01affd640 1 --2- 172.21.15.45:0/411505541 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe01c0704a0 0x7fe01c147cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:31.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.609+0000 7fe01b7fe640 1 --2- 172.21.15.45:0/411505541 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe01c144880 0x7fe01c13c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:31.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.609+0000 7fe013fff640 1 -- 172.21.15.45:0/411505541 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe01c144880 msgr2=0x7fe01c13c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:31.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.609+0000 7fe013fff640 1 --2- 172.21.15.45:0/411505541 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe01c144880 0x7fe01c13c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:31.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.609+0000 7fe013fff640 1 -- 172.21.15.45:0/411505541 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe01c0704a0 msgr2=0x7fe01c147cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:31.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.609+0000 7fe013fff640 1 --2- 172.21.15.45:0/411505541 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe01c0704a0 0x7fe01c147cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:31.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.609+0000 7fe013fff640 1 -- 172.21.15.45:0/411505541 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0040094d0 con 0x7fe01c0721c0 2023-11-28T18:38:31.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.609+0000 7fe013fff640 1 --2- 172.21.15.45:0/411505541 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe01c0721c0 0x7fe01c159210 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fe0040190e0 tx=0x7fe00401ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:31.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.609+0000 7fe0137fe640 1 -- 172.21.15.45:0/411505541 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0040aa430 con 0x7fe01c0721c0 2023-11-28T18:38:31.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.609+0000 7fe0137fe640 1 -- 172.21.15.45:0/411505541 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0040b3820 con 0x7fe01c0721c0 2023-11-28T18:38:31.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.609+0000 7fe0137fe640 1 -- 172.21.15.45:0/411505541 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0040b3bd0 con 0x7fe01c0721c0 2023-11-28T18:38:31.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.609+0000 7fe021654640 1 -- 172.21.15.45:0/411505541 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe01c159c60 con 0x7fe01c0721c0 2023-11-28T18:38:31.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.609+0000 7fe021654640 1 -- 172.21.15.45:0/411505541 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe01c15a220 con 0x7fe01c0721c0 2023-11-28T18:38:31.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.609+0000 7fe021654640 1 -- 172.21.15.45:0/411505541 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe01c069480 con 0x7fe01c0721c0 2023-11-28T18:38:31.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.609+0000 7fe0137fe640 1 -- 172.21.15.45:0/411505541 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe0040b3d30 con 0x7fe01c0721c0 2023-11-28T18:38:31.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.613+0000 7fe0137fe640 1 --2- 172.21.15.45:0/411505541 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fdffc0668d0 0x7fdffc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:31.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.613+0000 7fe0137fe640 1 -- 172.21.15.45:0/411505541 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe00411e1e0 con 0x7fe01c0721c0 2023-11-28T18:38:31.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.613+0000 7fe01affd640 1 --2- 172.21.15.45:0/411505541 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fdffc0668d0 0x7fdffc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:31.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.613+0000 7fe01affd640 1 --2- 172.21.15.45:0/411505541 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fdffc0668d0 0x7fdffc068d90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe00c0079c0 tx=0x7fe00c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:31.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.617+0000 7fe0137fe640 1 -- 172.21.15.45:0/411505541 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe0040eb780 con 0x7fe01c0721c0 2023-11-28T18:38:31.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.833+0000 7fe021654640 1 -- 172.21.15.45:0/411505541 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fe01c06d1b0 con 0x7fe01c0721c0 2023-11-28T18:38:31.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.837+0000 7fe0137fe640 1 -- 172.21.15.45:0/411505541 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7fe0040eeda0 con 0x7fe01c0721c0 2023-11-28T18:38:31.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.837+0000 7fe021654640 1 -- 172.21.15.45:0/411505541 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fdffc0668d0 msgr2=0x7fdffc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:31.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.837+0000 7fe021654640 1 --2- 172.21.15.45:0/411505541 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fdffc0668d0 0x7fdffc068d90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe00c0079c0 tx=0x7fe00c008040 comp rx=0 tx=0).stop 2023-11-28T18:38:31.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.837+0000 7fe021654640 1 -- 172.21.15.45:0/411505541 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe01c0721c0 msgr2=0x7fe01c159210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:31.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.837+0000 7fe021654640 1 --2- 172.21.15.45:0/411505541 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe01c0721c0 0x7fe01c159210 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fe0040190e0 tx=0x7fe00401ad10 comp rx=0 tx=0).stop 2023-11-28T18:38:31.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.837+0000 7fe021654640 1 -- 172.21.15.45:0/411505541 shutdown_connections 2023-11-28T18:38:31.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.837+0000 7fe021654640 1 --2- 172.21.15.45:0/411505541 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fdffc0668d0 0x7fdffc068d90 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:31.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.837+0000 7fe021654640 1 --2- 172.21.15.45:0/411505541 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe01c144880 0x7fe01c13c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:31.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.837+0000 7fe021654640 1 --2- 172.21.15.45:0/411505541 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe01c0721c0 0x7fe01c159210 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:31.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.837+0000 7fe021654640 1 --2- 172.21.15.45:0/411505541 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe01c0704a0 0x7fe01c147cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:31.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.837+0000 7fe021654640 1 -- 172.21.15.45:0/411505541 >> 172.21.15.45:0/411505541 conn(0x7fe01c06a570 msgr2=0x7fe01c0cd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:31.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.837+0000 7fe021654640 1 -- 172.21.15.45:0/411505541 shutdown_connections 2023-11-28T18:38:31.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:31.837+0000 7fe021654640 1 -- 172.21.15.45:0/411505541 wait complete. 2023-11-28T18:38:31.862 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T18:38:32.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.001+0000 7f99b18d6640 1 Processor -- start 2023-11-28T18:38:32.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.001+0000 7f99b18d6640 1 -- start start 2023-11-28T18:38:32.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.005+0000 7f99b18d6640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f99ac0d2be0 0x7f99ac0cde30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:32.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.005+0000 7f99b18d6640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99ac0b2a30 con 0x7f99ac15d240 2023-11-28T18:38:32.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.005+0000 7f99b18d6640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99ac0d18b0 con 0x7f99ac0ce370 2023-11-28T18:38:32.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.005+0000 7f99b18d6640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99ac0d3020 con 0x7f99ac0d2be0 2023-11-28T18:38:32.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.005+0000 7f99a3fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f99ac0d2be0 0x7f99ac0cde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:32.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.005+0000 7f99aaffd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f99ac15d240 0x7f99ac0d11a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47860/0 (socket says 172.21.15.45:47860) 2023-11-28T18:38:32.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.005+0000 7f99a3fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f99ac0d2be0 0x7f99ac0cde30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60110/0 (socket says 172.21.15.45:60110) 2023-11-28T18:38:32.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.005+0000 7f99aaffd640 1 -- 172.21.15.45:0/4117255012 learned_addr learned my addr 172.21.15.45:0/4117255012 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:38:32.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.005+0000 7f99a3fff640 1 -- 172.21.15.45:0/4117255012 >> v1:172.21.15.190:6789/0 conn(0x7f99ac0ce370 legacy=0x7f99ac0b61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:32.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.005+0000 7f99a3fff640 1 -- 172.21.15.45:0/4117255012 >> v1:172.21.15.45:6789/0 conn(0x7f99ac15d240 legacy=0x7f99ac0d11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:32.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.005+0000 7f99a3fff640 1 -- 172.21.15.45:0/4117255012 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99ac0ce7e0 con 0x7f99ac0d2be0 2023-11-28T18:38:32.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.005+0000 7f99a3fff640 1 --2- 172.21.15.45:0/4117255012 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99ac0d2be0 0x7f99ac0cde30 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f99940097c0 tx=0x7f999401c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6144a9b840ef200 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:32.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.009+0000 7f99aa7fc640 1 -- 172.21.15.45:0/4117255012 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99940ab600 con 0x7f99ac0d2be0 2023-11-28T18:38:32.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.009+0000 7f99aa7fc640 1 -- 172.21.15.45:0/4117255012 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99940a7050 con 0x7f99ac0d2be0 2023-11-28T18:38:32.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.009+0000 7f99aa7fc640 1 -- 172.21.15.45:0/4117255012 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99940ab980 con 0x7f99ac0d2be0 2023-11-28T18:38:32.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.009+0000 7f99b18d6640 1 -- 172.21.15.45:0/4117255012 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99ac0d2be0 msgr2=0x7f99ac0cde30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:32.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.009+0000 7f99b18d6640 1 --2- 172.21.15.45:0/4117255012 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99ac0d2be0 0x7f99ac0cde30 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f99940097c0 tx=0x7f999401c360 comp rx=0 tx=0).stop 2023-11-28T18:38:32.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.009+0000 7f99b18d6640 1 -- 172.21.15.45:0/4117255012 shutdown_connections 2023-11-28T18:38:32.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.009+0000 7f99b18d6640 1 --2- 172.21.15.45:0/4117255012 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99ac0d2be0 0x7f99ac0cde30 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:32.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.009+0000 7f99b18d6640 1 -- 172.21.15.45:0/4117255012 >> 172.21.15.45:0/4117255012 conn(0x7f99ac0722a0 msgr2=0x7f99ac0cfbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:32.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.009+0000 7f99b18d6640 1 -- 172.21.15.45:0/4117255012 shutdown_connections 2023-11-28T18:38:32.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.009+0000 7f99b18d6640 1 -- 172.21.15.45:0/4117255012 wait complete. 2023-11-28T18:38:32.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.009+0000 7f99b18d6640 1 Processor -- start 2023-11-28T18:38:32.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.009+0000 7f99b18d6640 1 -- start start 2023-11-28T18:38:32.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.009+0000 7f99b18d6640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f99ac0ce370 0x7f99ac14a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:32.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.009+0000 7f99b18d6640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f99ac0d2be0 0x7f99ac0ca230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:32.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.009+0000 7f99b18d6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99ac15d240 0x7f99ac15f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:32.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.009+0000 7f99b18d6640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99ac0cbc40 con 0x7f99ac15d240 2023-11-28T18:38:32.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.009+0000 7f99b18d6640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99ac0caba0 con 0x7f99ac0ce370 2023-11-28T18:38:32.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.009+0000 7f99b18d6640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99ac0cae80 con 0x7f99ac0d2be0 2023-11-28T18:38:32.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.009+0000 7f99ab7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99ac15d240 0x7f99ac15f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:32.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.009+0000 7f99ab7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99ac15d240 0x7f99ac15f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60112/0 (socket says 172.21.15.45:60112) 2023-11-28T18:38:32.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.009+0000 7f99ab7fe640 1 -- 172.21.15.45:0/1016058426 learned_addr learned my addr 172.21.15.45:0/1016058426 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:32.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.009+0000 7f99a3fff640 1 --2- 172.21.15.45:0/1016058426 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f99ac0d2be0 0x7f99ac0ca230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:32.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.009+0000 7f99aaffd640 1 --2- 172.21.15.45:0/1016058426 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f99ac0ce370 0x7f99ac14a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:32.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.013+0000 7f99ab7fe640 1 -- 172.21.15.45:0/1016058426 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f99ac0d2be0 msgr2=0x7f99ac0ca230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:32.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.013+0000 7f99ab7fe640 1 --2- 172.21.15.45:0/1016058426 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f99ac0d2be0 0x7f99ac0ca230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:32.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.013+0000 7f99ab7fe640 1 -- 172.21.15.45:0/1016058426 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f99ac0ce370 msgr2=0x7f99ac14a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:32.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.013+0000 7f99ab7fe640 1 --2- 172.21.15.45:0/1016058426 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f99ac0ce370 0x7f99ac14a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:32.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.013+0000 7f99ab7fe640 1 -- 172.21.15.45:0/1016058426 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9994009420 con 0x7f99ac15d240 2023-11-28T18:38:32.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.013+0000 7f99ab7fe640 1 --2- 172.21.15.45:0/1016058426 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99ac15d240 0x7f99ac15f520 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f99a400c780 tx=0x7f99a400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:32.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.013+0000 7f99a8ff9640 1 -- 172.21.15.45:0/1016058426 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a4004b70 con 0x7f99ac15d240 2023-11-28T18:38:32.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.013+0000 7f99a8ff9640 1 -- 172.21.15.45:0/1016058426 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99a400ce90 con 0x7f99ac15d240 2023-11-28T18:38:32.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.013+0000 7f99a8ff9640 1 -- 172.21.15.45:0/1016058426 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a400a850 con 0x7f99ac15d240 2023-11-28T18:38:32.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.013+0000 7f99b18d6640 1 -- 172.21.15.45:0/1016058426 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99ac0cb160 con 0x7f99ac15d240 2023-11-28T18:38:32.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.013+0000 7f99b18d6640 1 -- 172.21.15.45:0/1016058426 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99ac0cb720 con 0x7f99ac15d240 2023-11-28T18:38:32.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.013+0000 7f99b18d6640 1 -- 172.21.15.45:0/1016058426 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99ac0cb910 con 0x7f99ac15d240 2023-11-28T18:38:32.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.013+0000 7f99a8ff9640 1 -- 172.21.15.45:0/1016058426 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f99a400a9b0 con 0x7f99ac15d240 2023-11-28T18:38:32.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.013+0000 7f99a8ff9640 1 --2- 172.21.15.45:0/1016058426 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f998c0668d0 0x7f998c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:32.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.013+0000 7f99a8ff9640 1 -- 172.21.15.45:0/1016058426 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f99a4084360 con 0x7f99ac15d240 2023-11-28T18:38:32.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.017+0000 7f99aaffd640 1 --2- 172.21.15.45:0/1016058426 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f998c0668d0 0x7f998c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:32.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.017+0000 7f99aaffd640 1 --2- 172.21.15.45:0/1016058426 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f998c0668d0 0x7f998c068d90 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f999c009fd0 tx=0x7f999c00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:32.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.017+0000 7f99a8ff9640 1 -- 172.21.15.45:0/1016058426 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f99a4051850 con 0x7f99ac15d240 2023-11-28T18:38:32.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.173+0000 7f99b18d6640 1 -- 172.21.15.45:0/1016058426 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f99ac069480 con 0x7f99ac15d240 2023-11-28T18:38:32.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.177+0000 7f99a8ff9640 1 -- 172.21.15.45:0/1016058426 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+12821 (secure 0 0 0) 0x7f99a4054e70 con 0x7f99ac15d240 2023-11-28T18:38:32.180 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:38:32.180 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":30,"fsid":"d10f5cd6-1d00-4019-99b6-6fa435498a15","created":"2023-11-28T18:37:08.189030+0000","modified":"2023-11-28T18:38:29.023736+0000","last_up_change":"2023-11-28T18:37:20.196124+0000","last_in_change":"2023-11-28T18:37:10.742043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T18:37:21.293917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"84465384-103c-4f2c-a45a-96f5bb9c835f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6809","nonce":555237322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6811","nonce":555237322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6815","nonce":555237322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6813","nonce":555237322}]},"public_addr":"172.21.15.45:6809/555237322","cluster_addr":"172.21.15.45:6811/555237322","heartbeat_back_addr":"172.21.15.45:6815/555237322","heartbeat_front_addr":"172.21.15.45:6813/555237322","state":["exists","up"]},{"osd":1,"uuid":"7d9eed24-a58f-42c7-a787-ac06be8553fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6801","nonce":2857063763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6803","nonce":2857063763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6807","nonce":2857063763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6805","nonce":2857063763}]},"public_addr":"172.21.15.45:6801/2857063763","cluster_addr":"172.21.15.45:6803/2857063763","heartbeat_back_addr":"172.21.15.45:6807/2857063763","heartbeat_front_addr":"172.21.15.45:6805/2857063763","state":["exists","up"]},{"osd":2,"uuid":"575eeccc-4abf-45b4-9caf-f3e797859588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6817","nonce":193884539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6819","nonce":193884539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6823","nonce":193884539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6821","nonce":193884539}]},"public_addr":"172.21.15.45:6817/193884539","cluster_addr":"172.21.15.45:6819/193884539","heartbeat_back_addr":"172.21.15.45:6823/193884539","heartbeat_front_addr":"172.21.15.45:6821/193884539","state":["exists","up"]},{"osd":3,"uuid":"9b0290d6-9a52-4bc8-b2a1-7622c5dc8e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6825","nonce":78541084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6827","nonce":78541084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6831","nonce":78541084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6829","nonce":78541084}]},"public_addr":"172.21.15.45:6825/78541084","cluster_addr":"172.21.15.45:6827/78541084","heartbeat_back_addr":"172.21.15.45:6831/78541084","heartbeat_front_addr":"172.21.15.45:6829/78541084","state":["exists","up"]},{"osd":4,"uuid":"ce632829-f027-4fbf-a627-02c571aa9d53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6809","nonce":1537591987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6811","nonce":1537591987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6815","nonce":1537591987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6813","nonce":1537591987}]},"public_addr":"172.21.15.190:6809/1537591987","cluster_addr":"172.21.15.190:6811/1537591987","heartbeat_back_addr":"172.21.15.190:6815/1537591987","heartbeat_front_addr":"172.21.15.190:6813/1537591987","state":["exists","up"]},{"osd":5,"uuid":"8700b609-27be-40bd-a251-4c0ae0a29ead","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6801","nonce":3296698407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6803","nonce":3296698407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6807","nonce":3296698407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6805","nonce":3296698407}]},"public_addr":"172.21.15.190:6801/3296698407","cluster_addr":"172.21.15.190:6803/3296698407","heartbeat_back_addr":"172.21.15.190:6807/3296698407","heartbeat_front_addr":"172.21.15.190:6805/3296698407","state":["exists","up"]},{"osd":6,"uuid":"44ce4a40-e6ff-4f4d-8e8a-7341e5c91f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6817","nonce":2317686718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6819","nonce":2317686718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6823","nonce":2317686718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6821","nonce":2317686718}]},"public_addr":"172.21.15.190:6817/2317686718","cluster_addr":"172.21.15.190:6819/2317686718","heartbeat_back_addr":"172.21.15.190:6823/2317686718","heartbeat_front_addr":"172.21.15.190:6821/2317686718","state":["exists","up"]},{"osd":7,"uuid":"192238c9-1423-4b7e-ac8f-84ba32113ddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6825","nonce":2493232051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6827","nonce":2493232051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6831","nonce":2493232051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6829","nonce":2493232051}]},"public_addr":"172.21.15.190:6825/2493232051","cluster_addr":"172.21.15.190:6827/2493232051","heartbeat_back_addr":"172.21.15.190:6831/2493232051","heartbeat_front_addr":"172.21.15.190:6829/2493232051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.393552+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.385453+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.361421+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.366408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.363226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.276007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.414605+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.445885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T18:38:32.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.177+0000 7f99b18d6640 1 -- 172.21.15.45:0/1016058426 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f998c0668d0 msgr2=0x7f998c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:32.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.177+0000 7f99b18d6640 1 --2- 172.21.15.45:0/1016058426 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f998c0668d0 0x7f998c068d90 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f999c009fd0 tx=0x7f999c00b040 comp rx=0 tx=0).stop 2023-11-28T18:38:32.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.177+0000 7f99b18d6640 1 -- 172.21.15.45:0/1016058426 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99ac15d240 msgr2=0x7f99ac15f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:32.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.177+0000 7f99b18d6640 1 --2- 172.21.15.45:0/1016058426 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99ac15d240 0x7f99ac15f520 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f99a400c780 tx=0x7f99a400cc40 comp rx=0 tx=0).stop 2023-11-28T18:38:32.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.177+0000 7f99b18d6640 1 -- 172.21.15.45:0/1016058426 shutdown_connections 2023-11-28T18:38:32.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.177+0000 7f99b18d6640 1 --2- 172.21.15.45:0/1016058426 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f998c0668d0 0x7f998c068d90 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:32.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.177+0000 7f99b18d6640 1 --2- 172.21.15.45:0/1016058426 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99ac15d240 0x7f99ac15f520 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:32.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.177+0000 7f99b18d6640 1 --2- 172.21.15.45:0/1016058426 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f99ac0d2be0 0x7f99ac0ca230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:32.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.177+0000 7f99b18d6640 1 --2- 172.21.15.45:0/1016058426 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f99ac0ce370 0x7f99ac14a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:32.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.177+0000 7f99b18d6640 1 -- 172.21.15.45:0/1016058426 >> 172.21.15.45:0/1016058426 conn(0x7f99ac0722a0 msgr2=0x7f99ac06b570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:32.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.177+0000 7f99b18d6640 1 -- 172.21.15.45:0/1016058426 shutdown_connections 2023-11-28T18:38:32.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.177+0000 7f99b18d6640 1 -- 172.21.15.45:0/1016058426 wait complete. 2023-11-28T18:38:32.202 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T18:37:21.293917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T18:38:32.203 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T18:38:32.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.345+0000 7f3d7d5aa640 1 Processor -- start 2023-11-28T18:38:32.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.345+0000 7f3d7d5aa640 1 -- start start 2023-11-28T18:38:32.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.349+0000 7f3d7d5aa640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3d7806e130 0x7f3d78159b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:32.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.349+0000 7f3d7d5aa640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f3d78070540 0x7f3d780709f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:32.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.349+0000 7f3d7d5aa640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d7806dca0 con 0x7f3d780b3c90 2023-11-28T18:38:32.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.349+0000 7f3d7d5aa640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d78070f30 con 0x7f3d7806e130 2023-11-28T18:38:32.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.349+0000 7f3d7d5aa640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d7806d090 con 0x7f3d78070540 2023-11-28T18:38:32.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.349+0000 7f3d767fc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3d7806e130 0x7f3d78159b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:32.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.349+0000 7f3d76ffd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f3d780b3c90 0x7f3d7806c8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47870/0 (socket says 172.21.15.45:47870) 2023-11-28T18:38:32.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.349+0000 7f3d76ffd640 1 -- 172.21.15.45:0/2629143266 learned_addr learned my addr 172.21.15.45:0/2629143266 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:38:32.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.349+0000 7f3d777fe640 1 --2- 172.21.15.45:0/2629143266 >> v2:172.21.15.190:3300/0 conn(0x7f3d78070540 0x7f3d780709f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:32.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.349+0000 7f3d767fc640 1 -- 172.21.15.45:0/2629143266 >> v2:172.21.15.190:3300/0 conn(0x7f3d78070540 msgr2=0x7f3d780709f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:32.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.349+0000 7f3d767fc640 1 --2- 172.21.15.45:0/2629143266 >> v2:172.21.15.190:3300/0 conn(0x7f3d78070540 0x7f3d780709f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:32.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.349+0000 7f3d767fc640 1 -- 172.21.15.45:0/2629143266 >> v1:172.21.15.45:6789/0 conn(0x7f3d780b3c90 legacy=0x7f3d7806c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:32.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.349+0000 7f3d767fc640 1 -- 172.21.15.45:0/2629143266 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d7806d370 con 0x7f3d7806e130 2023-11-28T18:38:32.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.349+0000 7f3d777fe640 1 --2- 172.21.15.45:0/2629143266 >> v2:172.21.15.190:3300/0 conn(0x7f3d78070540 0x7f3d780709f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:38:32.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.353+0000 7f3d767fc640 1 --2- 172.21.15.45:0/2629143266 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d7806e130 0x7f3d78159b30 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f3d78157700 tx=0x7f3d6c01c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6af187b2827b2e7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:32.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.353+0000 7f3d75ffb640 1 -- 172.21.15.45:0/2629143266 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d6c0ab600 con 0x7f3d7806e130 2023-11-28T18:38:32.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.353+0000 7f3d75ffb640 1 -- 172.21.15.45:0/2629143266 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d6c0a7050 con 0x7f3d7806e130 2023-11-28T18:38:32.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.353+0000 7f3d75ffb640 1 -- 172.21.15.45:0/2629143266 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d6c0ab980 con 0x7f3d7806e130 2023-11-28T18:38:32.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.353+0000 7f3d7d5aa640 1 -- 172.21.15.45:0/2629143266 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d7806e130 msgr2=0x7f3d78159b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:32.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.353+0000 7f3d7d5aa640 1 --2- 172.21.15.45:0/2629143266 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d7806e130 0x7f3d78159b30 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f3d78157700 tx=0x7f3d6c01c380 comp rx=0 tx=0).stop 2023-11-28T18:38:32.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.353+0000 7f3d7d5aa640 1 -- 172.21.15.45:0/2629143266 shutdown_connections 2023-11-28T18:38:32.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.353+0000 7f3d7d5aa640 1 --2- 172.21.15.45:0/2629143266 >> v2:172.21.15.190:3300/0 conn(0x7f3d78070540 0x7f3d780709f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:32.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.353+0000 7f3d7d5aa640 1 --2- 172.21.15.45:0/2629143266 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d7806e130 0x7f3d78159b30 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:32.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.353+0000 7f3d7d5aa640 1 -- 172.21.15.45:0/2629143266 >> 172.21.15.45:0/2629143266 conn(0x7f3d780b0960 msgr2=0x7f3d780b0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:32.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.353+0000 7f3d7d5aa640 1 -- 172.21.15.45:0/2629143266 shutdown_connections 2023-11-28T18:38:32.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.353+0000 7f3d7d5aa640 1 -- 172.21.15.45:0/2629143266 wait complete. 2023-11-28T18:38:32.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.353+0000 7f3d7d5aa640 1 Processor -- start 2023-11-28T18:38:32.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.353+0000 7f3d7d5aa640 1 -- start start 2023-11-28T18:38:32.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.357+0000 7f3d7d5aa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d7806e130 0x7f3d780abe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:32.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.357+0000 7f3d7d5aa640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d78070540 0x7f3d78139de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:32.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.357+0000 7f3d7d5aa640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d780b3c90 0x7f3d78148600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:32.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.357+0000 7f3d7d5aa640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d7809be30 con 0x7f3d7806e130 2023-11-28T18:38:32.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.357+0000 7f3d7d5aa640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d781490c0 con 0x7f3d78070540 2023-11-28T18:38:32.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.357+0000 7f3d7d5aa640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d781493a0 con 0x7f3d780b3c90 2023-11-28T18:38:32.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.357+0000 7f3d76ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d7806e130 0x7f3d780abe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:32.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.357+0000 7f3d76ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d7806e130 0x7f3d780abe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60128/0 (socket says 172.21.15.45:60128) 2023-11-28T18:38:32.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.357+0000 7f3d76ffd640 1 -- 172.21.15.45:0/52307208 learned_addr learned my addr 172.21.15.45:0/52307208 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:32.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.357+0000 7f3d777fe640 1 --2- 172.21.15.45:0/52307208 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d780b3c90 0x7f3d78148600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:32.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.357+0000 7f3d767fc640 1 --2- 172.21.15.45:0/52307208 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d78070540 0x7f3d78139de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:32.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.357+0000 7f3d76ffd640 1 -- 172.21.15.45:0/52307208 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d780b3c90 msgr2=0x7f3d78148600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:32.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.357+0000 7f3d76ffd640 1 --2- 172.21.15.45:0/52307208 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d780b3c90 0x7f3d78148600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:32.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.357+0000 7f3d76ffd640 1 -- 172.21.15.45:0/52307208 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d78070540 msgr2=0x7f3d78139de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:32.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.357+0000 7f3d76ffd640 1 --2- 172.21.15.45:0/52307208 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d78070540 0x7f3d78139de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:32.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.357+0000 7f3d76ffd640 1 -- 172.21.15.45:0/52307208 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d6c0093c0 con 0x7f3d7806e130 2023-11-28T18:38:32.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.357+0000 7f3d76ffd640 1 --2- 172.21.15.45:0/52307208 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d7806e130 0x7f3d780abe40 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f3d6800c500 tx=0x7f3d6800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:32.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.357+0000 7f3d5f7fe640 1 -- 172.21.15.45:0/52307208 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d68005cf0 con 0x7f3d7806e130 2023-11-28T18:38:32.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.357+0000 7f3d5f7fe640 1 -- 172.21.15.45:0/52307208 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d68005e50 con 0x7f3d7806e130 2023-11-28T18:38:32.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.357+0000 7f3d5f7fe640 1 -- 172.21.15.45:0/52307208 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d680072f0 con 0x7f3d7806e130 2023-11-28T18:38:32.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.357+0000 7f3d7d5aa640 1 -- 172.21.15.45:0/52307208 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d78149680 con 0x7f3d7806e130 2023-11-28T18:38:32.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.357+0000 7f3d7d5aa640 1 -- 172.21.15.45:0/52307208 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d7813a830 con 0x7f3d7806e130 2023-11-28T18:38:32.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.357+0000 7f3d7d5aa640 1 -- 172.21.15.45:0/52307208 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d7809d0c0 con 0x7f3d7806e130 2023-11-28T18:38:32.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.357+0000 7f3d5f7fe640 1 -- 172.21.15.45:0/52307208 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f3d68007450 con 0x7f3d7806e130 2023-11-28T18:38:32.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.361+0000 7f3d5f7fe640 1 --2- 172.21.15.45:0/52307208 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f3d640668d0 0x7f3d64068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:32.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.361+0000 7f3d5f7fe640 1 -- 172.21.15.45:0/52307208 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3d68083650 con 0x7f3d7806e130 2023-11-28T18:38:32.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.361+0000 7f3d767fc640 1 --2- 172.21.15.45:0/52307208 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f3d640668d0 0x7f3d64068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:32.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.361+0000 7f3d767fc640 1 --2- 172.21.15.45:0/52307208 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f3d640668d0 0x7f3d64068d90 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c0ad000 tx=0x7f3d6c0a4f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:32.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.361+0000 7f3d5f7fe640 1 -- 172.21.15.45:0/52307208 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3d68050c80 con 0x7f3d7806e130 2023-11-28T18:38:32.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.521+0000 7f3d7d5aa640 1 -- 172.21.15.45:0/52307208 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3d7804e970 con 0x7f3d7806e130 2023-11-28T18:38:32.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.521+0000 7f3d5f7fe640 1 -- 172.21.15.45:0/52307208 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3d680170a0 con 0x7f3d7806e130 2023-11-28T18:38:32.523 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-11-28T18:38:32.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.521+0000 7f3d7d5aa640 1 -- 172.21.15.45:0/52307208 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f3d640668d0 msgr2=0x7f3d64068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:32.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.521+0000 7f3d7d5aa640 1 --2- 172.21.15.45:0/52307208 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f3d640668d0 0x7f3d64068d90 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c0ad000 tx=0x7f3d6c0a4f90 comp rx=0 tx=0).stop 2023-11-28T18:38:32.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.521+0000 7f3d7d5aa640 1 -- 172.21.15.45:0/52307208 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d7806e130 msgr2=0x7f3d780abe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:32.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.521+0000 7f3d7d5aa640 1 --2- 172.21.15.45:0/52307208 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d7806e130 0x7f3d780abe40 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f3d6800c500 tx=0x7f3d6800c9c0 comp rx=0 tx=0).stop 2023-11-28T18:38:32.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.521+0000 7f3d7d5aa640 1 -- 172.21.15.45:0/52307208 shutdown_connections 2023-11-28T18:38:32.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.521+0000 7f3d7d5aa640 1 --2- 172.21.15.45:0/52307208 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f3d640668d0 0x7f3d64068d90 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:32.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.521+0000 7f3d7d5aa640 1 --2- 172.21.15.45:0/52307208 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d780b3c90 0x7f3d78148600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:32.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.521+0000 7f3d7d5aa640 1 --2- 172.21.15.45:0/52307208 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d78070540 0x7f3d78139de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:32.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.521+0000 7f3d7d5aa640 1 --2- 172.21.15.45:0/52307208 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d7806e130 0x7f3d780abe40 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:32.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.521+0000 7f3d7d5aa640 1 -- 172.21.15.45:0/52307208 >> 172.21.15.45:0/52307208 conn(0x7f3d780b0960 msgr2=0x7f3d7814ccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:32.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.521+0000 7f3d7d5aa640 1 -- 172.21.15.45:0/52307208 shutdown_connections 2023-11-28T18:38:32.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.521+0000 7f3d7d5aa640 1 -- 172.21.15.45:0/52307208 wait complete. 2023-11-28T18:38:32.545 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-28T18:38:32.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.685+0000 7fdecc50f640 1 Processor -- start 2023-11-28T18:38:32.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.685+0000 7fdecc50f640 1 -- start start 2023-11-28T18:38:32.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.685+0000 7fdecc50f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdec415d3f0 0x7fdec40ad6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:32.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.685+0000 7fdecc50f640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fdec4072010 0x7fdec40af1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:32.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.685+0000 7fdecc50f640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdec40afb60 con 0x7fdec40af720 2023-11-28T18:38:32.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.685+0000 7fdecc50f640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdec40aeb70 con 0x7fdec415d3f0 2023-11-28T18:38:32.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.685+0000 7fdecc50f640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdec40adff0 con 0x7fdec4072010 2023-11-28T18:38:32.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.685+0000 7fdeca2ab640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdec415d3f0 0x7fdec40ad6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:32.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.685+0000 7fdeca2ab640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdec415d3f0 0x7fdec40ad6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60138/0 (socket says 172.21.15.45:60138) 2023-11-28T18:38:32.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.685+0000 7fdeca2ab640 1 -- 172.21.15.45:0/1716620670 learned_addr learned my addr 172.21.15.45:0/1716620670 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:32.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.685+0000 7fdec9aaa640 1 --2- 172.21.15.45:0/1716620670 >> v2:172.21.15.190:3300/0 conn(0x7fdec4072010 0x7fdec40af1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:32.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.689+0000 7fdeca2ab640 1 -- 172.21.15.45:0/1716620670 >> v2:172.21.15.190:3300/0 conn(0x7fdec4072010 msgr2=0x7fdec40af1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:32.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.689+0000 7fdeca2ab640 1 --2- 172.21.15.45:0/1716620670 >> v2:172.21.15.190:3300/0 conn(0x7fdec4072010 0x7fdec40af1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:32.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.689+0000 7fdeca2ab640 1 -- 172.21.15.45:0/1716620670 >> v1:172.21.15.45:6789/0 conn(0x7fdec40af720 legacy=0x7fdec406d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:32.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.689+0000 7fdeca2ab640 1 -- 172.21.15.45:0/1716620670 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec40ae2d0 con 0x7fdec415d3f0 2023-11-28T18:38:32.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.689+0000 7fdec92a9640 1 -- 172.21.15.45:0/1716620670 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 967387139 0 0) 0x7fdec40afb60 con 0x7fdec40af720 2023-11-28T18:38:32.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.689+0000 7fdeca2ab640 1 --2- 172.21.15.45:0/1716620670 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdec415d3f0 0x7fdec40ad6e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fdec4072dd0 tx=0x7fdec001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c37c71fbb04ffe35 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:32.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.689+0000 7fdec92a9640 1 -- 172.21.15.45:0/1716620670 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec00a89f0 con 0x7fdec415d3f0 2023-11-28T18:38:32.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.689+0000 7fdec92a9640 1 -- 172.21.15.45:0/1716620670 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdec00a8b50 con 0x7fdec415d3f0 2023-11-28T18:38:32.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.689+0000 7fdec92a9640 1 -- 172.21.15.45:0/1716620670 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec00b0440 con 0x7fdec415d3f0 2023-11-28T18:38:32.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.689+0000 7fdecc50f640 1 -- 172.21.15.45:0/1716620670 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdec415d3f0 msgr2=0x7fdec40ad6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:32.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.689+0000 7fdecc50f640 1 --2- 172.21.15.45:0/1716620670 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdec415d3f0 0x7fdec40ad6e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fdec4072dd0 tx=0x7fdec001ecf0 comp rx=0 tx=0).stop 2023-11-28T18:38:32.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.693+0000 7fdecc50f640 1 -- 172.21.15.45:0/1716620670 shutdown_connections 2023-11-28T18:38:32.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.693+0000 7fdecc50f640 1 --2- 172.21.15.45:0/1716620670 >> v2:172.21.15.190:3300/0 conn(0x7fdec4072010 0x7fdec40af1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:32.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.693+0000 7fdecc50f640 1 --2- 172.21.15.45:0/1716620670 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdec415d3f0 0x7fdec40ad6e0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:32.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.693+0000 7fdecc50f640 1 -- 172.21.15.45:0/1716620670 >> 172.21.15.45:0/1716620670 conn(0x7fdec406b680 msgr2=0x7fdec406ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:32.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.693+0000 7fdecc50f640 1 -- 172.21.15.45:0/1716620670 shutdown_connections 2023-11-28T18:38:32.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.693+0000 7fdecc50f640 1 -- 172.21.15.45:0/1716620670 wait complete. 2023-11-28T18:38:32.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.693+0000 7fdecc50f640 1 Processor -- start 2023-11-28T18:38:32.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.693+0000 7fdecc50f640 1 -- start start 2023-11-28T18:38:32.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.693+0000 7fdecc50f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdec4072010 0x7fdec415e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:32.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.693+0000 7fdecc50f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdec40af720 0x7fdec41f6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:32.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.693+0000 7fdecc50f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdec415d3f0 0x7fdec40b14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:32.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.693+0000 7fdecc50f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec415f0e0 con 0x7fdec40af720 2023-11-28T18:38:32.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.693+0000 7fdecc50f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec41f6e80 con 0x7fdec4072010 2023-11-28T18:38:32.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.693+0000 7fdecc50f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdec41f7160 con 0x7fdec415d3f0 2023-11-28T18:38:32.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.693+0000 7fdec9aaa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdec40af720 0x7fdec41f6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:32.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.693+0000 7fdec9aaa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdec40af720 0x7fdec41f6630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60148/0 (socket says 172.21.15.45:60148) 2023-11-28T18:38:32.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.693+0000 7fdec9aaa640 1 -- 172.21.15.45:0/2523696688 learned_addr learned my addr 172.21.15.45:0/2523696688 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:32.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.693+0000 7fdeca2ab640 1 --2- 172.21.15.45:0/2523696688 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdec4072010 0x7fdec415e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:32.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.693+0000 7fdecaaac640 1 --2- 172.21.15.45:0/2523696688 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdec415d3f0 0x7fdec40b14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:32.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.693+0000 7fdec9aaa640 1 -- 172.21.15.45:0/2523696688 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdec415d3f0 msgr2=0x7fdec40b14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:32.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.693+0000 7fdec9aaa640 1 --2- 172.21.15.45:0/2523696688 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdec415d3f0 0x7fdec40b14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:32.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.693+0000 7fdec9aaa640 1 -- 172.21.15.45:0/2523696688 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdec4072010 msgr2=0x7fdec415e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:32.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.693+0000 7fdec9aaa640 1 --2- 172.21.15.45:0/2523696688 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdec4072010 0x7fdec415e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:32.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.693+0000 7fdec9aaa640 1 -- 172.21.15.45:0/2523696688 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec00094d0 con 0x7fdec40af720 2023-11-28T18:38:32.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.693+0000 7fdeca2ab640 1 --2- 172.21.15.45:0/2523696688 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdec4072010 0x7fdec415e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:38:32.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.693+0000 7fdec9aaa640 1 --2- 172.21.15.45:0/2523696688 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdec40af720 0x7fdec41f6630 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fdeb400d800 tx=0x7fdeb400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:32.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.693+0000 7fdebaffd640 1 -- 172.21.15.45:0/2523696688 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb400b6c0 con 0x7fdec40af720 2023-11-28T18:38:32.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.697+0000 7fdebaffd640 1 -- 172.21.15.45:0/2523696688 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeb400b820 con 0x7fdec40af720 2023-11-28T18:38:32.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.697+0000 7fdecc50f640 1 -- 172.21.15.45:0/2523696688 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdec41f7440 con 0x7fdec40af720 2023-11-28T18:38:32.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.697+0000 7fdebaffd640 1 -- 172.21.15.45:0/2523696688 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb400bb90 con 0x7fdec40af720 2023-11-28T18:38:32.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.697+0000 7fdecc50f640 1 -- 172.21.15.45:0/2523696688 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdec41f6b70 con 0x7fdec40af720 2023-11-28T18:38:32.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.697+0000 7fdecc50f640 1 -- 172.21.15.45:0/2523696688 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdec4160b30 con 0x7fdec40af720 2023-11-28T18:38:32.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.697+0000 7fdebaffd640 1 -- 172.21.15.45:0/2523696688 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fdeb400bcf0 con 0x7fdec40af720 2023-11-28T18:38:32.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.697+0000 7fdebaffd640 1 --2- 172.21.15.45:0/2523696688 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fdea80668d0 0x7fdea8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:32.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.697+0000 7fdebaffd640 1 -- 172.21.15.45:0/2523696688 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fdeb4084680 con 0x7fdec40af720 2023-11-28T18:38:32.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.697+0000 7fdeca2ab640 1 --2- 172.21.15.45:0/2523696688 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fdea80668d0 0x7fdea8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:32.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.697+0000 7fdeca2ab640 1 --2- 172.21.15.45:0/2523696688 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fdea80668d0 0x7fdea8068d90 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fdec00b2000 tx=0x7fdec0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:32.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.701+0000 7fdebaffd640 1 -- 172.21.15.45:0/2523696688 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdeb4051c00 con 0x7fdec40af720 2023-11-28T18:38:32.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.861+0000 7fdecc50f640 1 -- 172.21.15.45:0/2523696688 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fdec4069480 con 0x7fdec40af720 2023-11-28T18:38:32.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.861+0000 7fdebaffd640 1 -- 172.21.15.45:0/2523696688 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v30) v1 ==== 84+0+65 (secure 0 0 0) 0x7fdeb4055220 con 0x7fdec40af720 2023-11-28T18:38:32.864 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:38:32.864 INFO:teuthology.orchestra.run.smithi045.stdout:[ 2023-11-28T18:38:32.864 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T18:38:32.864 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 1, 2023-11-28T18:38:32.865 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": ".mgr" 2023-11-28T18:38:32.865 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:38:32.865 INFO:teuthology.orchestra.run.smithi045.stdout:] 2023-11-28T18:38:32.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.861+0000 7fdecc50f640 1 -- 172.21.15.45:0/2523696688 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fdea80668d0 msgr2=0x7fdea8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:32.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.861+0000 7fdecc50f640 1 --2- 172.21.15.45:0/2523696688 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fdea80668d0 0x7fdea8068d90 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fdec00b2000 tx=0x7fdec0008040 comp rx=0 tx=0).stop 2023-11-28T18:38:32.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.861+0000 7fdecc50f640 1 -- 172.21.15.45:0/2523696688 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdec40af720 msgr2=0x7fdec41f6630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:32.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.861+0000 7fdecc50f640 1 --2- 172.21.15.45:0/2523696688 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdec40af720 0x7fdec41f6630 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fdeb400d800 tx=0x7fdeb400dcc0 comp rx=0 tx=0).stop 2023-11-28T18:38:32.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.861+0000 7fdecc50f640 1 -- 172.21.15.45:0/2523696688 shutdown_connections 2023-11-28T18:38:32.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.861+0000 7fdecc50f640 1 --2- 172.21.15.45:0/2523696688 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fdea80668d0 0x7fdea8068d90 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:32.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.861+0000 7fdecc50f640 1 --2- 172.21.15.45:0/2523696688 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdec415d3f0 0x7fdec40b14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:32.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.861+0000 7fdecc50f640 1 --2- 172.21.15.45:0/2523696688 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdec40af720 0x7fdec41f6630 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:32.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.861+0000 7fdecc50f640 1 --2- 172.21.15.45:0/2523696688 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdec4072010 0x7fdec415e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:32.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.861+0000 7fdecc50f640 1 -- 172.21.15.45:0/2523696688 >> 172.21.15.45:0/2523696688 conn(0x7fdec406b680 msgr2=0x7fdec415b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:32.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.861+0000 7fdecc50f640 1 -- 172.21.15.45:0/2523696688 shutdown_connections 2023-11-28T18:38:32.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:32.861+0000 7fdecc50f640 1 -- 172.21.15.45:0/2523696688 wait complete. 2023-11-28T18:38:32.885 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-28T18:38:32.885 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-28T18:38:33.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:33.029+0000 7f4ac7432640 1 Processor -- start 2023-11-28T18:38:33.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:33.029+0000 7f4ac7432640 1 -- start start 2023-11-28T18:38:33.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:33.029+0000 7f4ac7432640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f4ac00b2830 0x7f4ac00b3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:33.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:33.029+0000 7f4ac7432640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4ac00b3f90 0x7f4ac00ad520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:33.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:33.029+0000 7f4ac7432640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ac00b43c0 con 0x7f4ac015d1c0 2023-11-28T18:38:33.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:33.029+0000 7f4ac7432640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ac006adc0 con 0x7f4ac00b3f90 2023-11-28T18:38:33.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:33.029+0000 7f4ac7432640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ac006b0a0 con 0x7f4ac00b2830 2023-11-28T18:38:33.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:33.029+0000 7f4ac59cf640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4ac00b3f90 0x7f4ac00ad520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:33.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:33.029+0000 7f4ac59cf640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4ac00b3f90 0x7f4ac00ad520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60162/0 (socket says 172.21.15.45:60162) 2023-11-28T18:38:33.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:33.029+0000 7f4ac59cf640 1 -- 172.21.15.45:0/3728768705 learned_addr learned my addr 172.21.15.45:0/3728768705 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:33.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:33.029+0000 7f4ac59cf640 1 -- 172.21.15.45:0/3728768705 >> v2:172.21.15.190:3300/0 conn(0x7f4ac00b2830 msgr2=0x7f4ac00b3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:33.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:33.029+0000 7f4ac59cf640 1 --2- 172.21.15.45:0/3728768705 >> v2:172.21.15.190:3300/0 conn(0x7f4ac00b2830 0x7f4ac00b3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:33.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:33.029+0000 7f4ac59cf640 1 -- 172.21.15.45:0/3728768705 >> v1:172.21.15.190:6789/0 conn(0x7f4ac015d1c0 legacy=0x7f4ac006a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:33.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:33.029+0000 7f4ac59cf640 1 -- 172.21.15.45:0/3728768705 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ac006b380 con 0x7f4ac00b3f90 2023-11-28T18:38:33.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:33.033+0000 7f4ac59cf640 1 --2- 172.21.15.45:0/3728768705 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ac00b3f90 0x7f4ac00ad520 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f4ac00ad2f0 tx=0x7f4ab801c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13ef9f6861d6e3cf server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:33.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:33.033+0000 7f4ab7fff640 1 -- 172.21.15.45:0/3728768705 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab80a5790 con 0x7f4ac00b3f90 2023-11-28T18:38:33.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:33.033+0000 7f4ab7fff640 1 -- 172.21.15.45:0/3728768705 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ab80a58f0 con 0x7f4ac00b3f90 2023-11-28T18:38:33.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:33.033+0000 7f4ab7fff640 1 -- 172.21.15.45:0/3728768705 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab80a5c80 con 0x7f4ac00b3f90 2023-11-28T18:38:33.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:33.033+0000 7f4ac7432640 1 -- 172.21.15.45:0/3728768705 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ac00b3f90 msgr2=0x7f4ac00ad520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:33.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:33.033+0000 7f4ac7432640 1 --2- 172.21.15.45:0/3728768705 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ac00b3f90 0x7f4ac00ad520 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f4ac00ad2f0 tx=0x7f4ab801c8d0 comp rx=0 tx=0).stop 2023-11-28T18:38:33.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:33.033+0000 7f4ac7432640 1 -- 172.21.15.45:0/3728768705 shutdown_connections 2023-11-28T18:38:33.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:33.033+0000 7f4ac7432640 1 --2- 172.21.15.45:0/3728768705 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ac00b3f90 0x7f4ac00ad520 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:33.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:33.033+0000 7f4ac7432640 1 --2- 172.21.15.45:0/3728768705 >> v2:172.21.15.190:3300/0 conn(0x7f4ac00b2830 0x7f4ac00b3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:33.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:33.033+0000 7f4ac7432640 1 -- 172.21.15.45:0/3728768705 >> 172.21.15.45:0/3728768705 conn(0x7f4ac00b1960 msgr2=0x7f4ac00b1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:33.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:33.033+0000 7f4ac7432640 1 -- 172.21.15.45:0/3728768705 shutdown_connections 2023-11-28T18:38:33.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:33.033+0000 7f4ac7432640 1 -- 172.21.15.45:0/3728768705 wait complete. 2023-11-28T18:38:33.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:33.037+0000 7f4ac7432640 1 Processor -- start 2023-11-28T18:38:33.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:33.037+0000 7f4ac7432640 1 -- start start 2023-11-28T18:38:33.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:33.037+0000 7f4ac7432640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4ac00b2830 0x7f4ac015ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:33.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:33.037+0000 7f4ac7432640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4ac00b3f90 0x7f4ac014ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:33.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:33.037+0000 7f4ac7432640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ac015d1c0 0x7f4ac0138bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:33.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:33.037+0000 7f4ac7432640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac0136880 con 0x7f4ac015d1c0 2023-11-28T18:38:33.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:33.037+0000 7f4ac7432640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac015b160 con 0x7f4ac00b2830 2023-11-28T18:38:33.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:33.037+0000 7f4ac7432640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac015b3e0 con 0x7f4ac00b3f90 2023-11-28T18:38:33.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:33.037+0000 7f4ac59cf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ac015d1c0 0x7f4ac0138bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:33.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:33.037+0000 7f4ac59cf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ac015d1c0 0x7f4ac0138bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60176/0 (socket says 172.21.15.45:60176) 2023-11-28T18:38:33.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:33.037+0000 7f4ac59cf640 1 -- 172.21.15.45:0/1395142565 learned_addr learned my addr 172.21.15.45:0/1395142565 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:33.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:33.037+0000 7f4ac51ce640 1 --2- 172.21.15.45:0/1395142565 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4ac00b2830 0x7f4ac015ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:33.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:33.037+0000 7f4ac49cd640 1 --2- 172.21.15.45:0/1395142565 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4ac00b3f90 0x7f4ac014ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:33.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:33.037+0000 7f4ac59cf640 1 -- 172.21.15.45:0/1395142565 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4ac00b3f90 msgr2=0x7f4ac014ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:33.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:33.037+0000 7f4ac59cf640 1 --2- 172.21.15.45:0/1395142565 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4ac00b3f90 0x7f4ac014ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:33.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:33.037+0000 7f4ac59cf640 1 -- 172.21.15.45:0/1395142565 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4ac00b2830 msgr2=0x7f4ac015ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:33.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:33.037+0000 7f4ac59cf640 1 --2- 172.21.15.45:0/1395142565 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4ac00b2830 0x7f4ac015ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:33.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:33.037+0000 7f4ac59cf640 1 -- 172.21.15.45:0/1395142565 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ab8009b30 con 0x7f4ac015d1c0 2023-11-28T18:38:33.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:33.037+0000 7f4ac49cd640 1 --2- 172.21.15.45:0/1395142565 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4ac00b3f90 0x7f4ac014ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:38:33.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:33.037+0000 7f4ac59cf640 1 --2- 172.21.15.45:0/1395142565 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ac015d1c0 0x7f4ac0138bd0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f4ab801a500 tx=0x7f4ab8019670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:33.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:33.037+0000 7f4ab5ffb640 1 -- 172.21.15.45:0/1395142565 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab80b8670 con 0x7f4ac015d1c0 2023-11-28T18:38:33.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:33.037+0000 7f4ab5ffb640 1 -- 172.21.15.45:0/1395142565 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ab80b87f0 con 0x7f4ac015d1c0 2023-11-28T18:38:33.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:33.037+0000 7f4ab5ffb640 1 -- 172.21.15.45:0/1395142565 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab80b8ba0 con 0x7f4ac015d1c0 2023-11-28T18:38:33.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:33.037+0000 7f4ac7432640 1 -- 172.21.15.45:0/1395142565 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ac015b6c0 con 0x7f4ac015d1c0 2023-11-28T18:38:33.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:33.041+0000 7f4ac7432640 1 -- 172.21.15.45:0/1395142565 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ac015bc80 con 0x7f4ac015d1c0 2023-11-28T18:38:33.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:33.041+0000 7f4ac7432640 1 -- 172.21.15.45:0/1395142565 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ac0069410 con 0x7f4ac015d1c0 2023-11-28T18:38:33.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:33.041+0000 7f4ab5ffb640 1 -- 172.21.15.45:0/1395142565 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f4ab80b8d00 con 0x7f4ac015d1c0 2023-11-28T18:38:33.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:33.041+0000 7f4ab5ffb640 1 --2- 172.21.15.45:0/1395142565 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4aa40668d0 0x7f4aa4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:33.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:33.041+0000 7f4ab5ffb640 1 -- 172.21.15.45:0/1395142565 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4ab811f7f0 con 0x7f4ac015d1c0 2023-11-28T18:38:33.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:33.041+0000 7f4ac51ce640 1 --2- 172.21.15.45:0/1395142565 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4aa40668d0 0x7f4aa4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:33.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:33.045+0000 7f4ac51ce640 1 --2- 172.21.15.45:0/1395142565 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4aa40668d0 0x7f4aa4068d90 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4abc0098e0 tx=0x7f4abc009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:33.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:33.045+0000 7f4ab5ffb640 1 -- 172.21.15.45:0/1395142565 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4ab80ece10 con 0x7f4ac015d1c0 2023-11-28T18:38:33.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:33.205+0000 7f4ac7432640 1 -- 172.21.15.45:0/1395142565 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f4ac006d810 con 0x7f4ac015d1c0 2023-11-28T18:38:34.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:34.005+0000 7f4ab5ffb640 1 -- 172.21.15.45:0/1395142565 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v31) v1 ==== 138+0+0 (secure 0 0 0) 0x7f4ab80bc0b0 con 0x7f4ac015d1c0 2023-11-28T18:38:34.007 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' created 2023-11-28T18:38:34.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:34.005+0000 7f4ac7432640 1 -- 172.21.15.45:0/1395142565 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4aa40668d0 msgr2=0x7f4aa4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:34.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:34.005+0000 7f4ac7432640 1 --2- 172.21.15.45:0/1395142565 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4aa40668d0 0x7f4aa4068d90 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4abc0098e0 tx=0x7f4abc009060 comp rx=0 tx=0).stop 2023-11-28T18:38:34.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:34.005+0000 7f4ac7432640 1 -- 172.21.15.45:0/1395142565 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ac015d1c0 msgr2=0x7f4ac0138bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:34.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:34.005+0000 7f4ac7432640 1 --2- 172.21.15.45:0/1395142565 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ac015d1c0 0x7f4ac0138bd0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f4ab801a500 tx=0x7f4ab8019670 comp rx=0 tx=0).stop 2023-11-28T18:38:34.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:34.005+0000 7f4ac7432640 1 -- 172.21.15.45:0/1395142565 shutdown_connections 2023-11-28T18:38:34.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:34.005+0000 7f4ac7432640 1 --2- 172.21.15.45:0/1395142565 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4aa40668d0 0x7f4aa4068d90 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:34.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:34.005+0000 7f4ac7432640 1 --2- 172.21.15.45:0/1395142565 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ac015d1c0 0x7f4ac0138bd0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:34.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:34.005+0000 7f4ac7432640 1 --2- 172.21.15.45:0/1395142565 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4ac00b3f90 0x7f4ac014ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:34.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:34.005+0000 7f4ac7432640 1 --2- 172.21.15.45:0/1395142565 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4ac00b2830 0x7f4ac015ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:34.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:34.005+0000 7f4ac7432640 1 -- 172.21.15.45:0/1395142565 >> 172.21.15.45:0/1395142565 conn(0x7f4ac00b1960 msgr2=0x7f4ac00afb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:34.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:34.009+0000 7f4ac7432640 1 -- 172.21.15.45:0/1395142565 shutdown_connections 2023-11-28T18:38:34.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:34.009+0000 7f4ac7432640 1 -- 172.21.15.45:0/1395142565 wait complete. 2023-11-28T18:38:34.040 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-28T18:38:34.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:34.189+0000 7f6a4dd1d640 1 Processor -- start 2023-11-28T18:38:34.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:34.189+0000 7f6a4dd1d640 1 -- start start 2023-11-28T18:38:34.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:34.189+0000 7f6a4dd1d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6a48072570 0x7f6a480cdd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:34.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:34.189+0000 7f6a4dd1d640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a480ced50 con 0x7f6a480ce240 2023-11-28T18:38:34.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:34.189+0000 7f6a4dd1d640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a480cea70 con 0x7f6a4813d0e0 2023-11-28T18:38:34.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:34.189+0000 7f6a4dd1d640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a4813d4c0 con 0x7f6a48072570 2023-11-28T18:38:34.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:34.189+0000 7f6a46ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6a48072570 0x7f6a480cdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:34.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:34.189+0000 7f6a46ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6a48072570 0x7f6a480cdd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60186/0 (socket says 172.21.15.45:60186) 2023-11-28T18:38:34.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:34.189+0000 7f6a47fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f6a480ce240 0x7f6a4813e320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47894/0 (socket says 172.21.15.45:47894) 2023-11-28T18:38:34.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:34.189+0000 7f6a46ffd640 1 -- 172.21.15.45:0/1029767773 learned_addr learned my addr 172.21.15.45:0/1029767773 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:34.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:34.193+0000 7f6a46ffd640 1 -- 172.21.15.45:0/1029767773 >> v1:172.21.15.190:6789/0 conn(0x7f6a4813d0e0 legacy=0x7f6a48071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:34.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:34.193+0000 7f6a46ffd640 1 -- 172.21.15.45:0/1029767773 >> v1:172.21.15.45:6789/0 conn(0x7f6a480ce240 legacy=0x7f6a4813e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:34.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:34.193+0000 7f6a46ffd640 1 -- 172.21.15.45:0/1029767773 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a4813d840 con 0x7f6a48072570 2023-11-28T18:38:34.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:34.193+0000 7f6a46ffd640 1 --2- 172.21.15.45:0/1029767773 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a48072570 0x7f6a480cdd00 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c009870 tx=0x7f6a3c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29f5c334e3ef3aa9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:34.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:34.193+0000 7f6a467fc640 1 -- 172.21.15.45:0/1029767773 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c0ab680 con 0x7f6a48072570 2023-11-28T18:38:34.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:34.193+0000 7f6a467fc640 1 -- 172.21.15.45:0/1029767773 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a3c0ab7e0 con 0x7f6a48072570 2023-11-28T18:38:34.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:34.193+0000 7f6a467fc640 1 -- 172.21.15.45:0/1029767773 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c0abb70 con 0x7f6a48072570 2023-11-28T18:38:34.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:34.197+0000 7f6a4dd1d640 1 -- 172.21.15.45:0/1029767773 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a48072570 msgr2=0x7f6a480cdd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:34.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:34.197+0000 7f6a4dd1d640 1 --2- 172.21.15.45:0/1029767773 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a48072570 0x7f6a480cdd00 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c009870 tx=0x7f6a3c01c480 comp rx=0 tx=0).stop 2023-11-28T18:38:34.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:34.197+0000 7f6a4dd1d640 1 -- 172.21.15.45:0/1029767773 shutdown_connections 2023-11-28T18:38:34.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:34.197+0000 7f6a4dd1d640 1 --2- 172.21.15.45:0/1029767773 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a48072570 0x7f6a480cdd00 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:34.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:34.197+0000 7f6a4dd1d640 1 -- 172.21.15.45:0/1029767773 >> 172.21.15.45:0/1029767773 conn(0x7f6a480b0d00 msgr2=0x7f6a480b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:34.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:34.197+0000 7f6a4dd1d640 1 -- 172.21.15.45:0/1029767773 shutdown_connections 2023-11-28T18:38:34.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:34.197+0000 7f6a4dd1d640 1 -- 172.21.15.45:0/1029767773 wait complete. 2023-11-28T18:38:34.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:34.197+0000 7f6a4dd1d640 1 Processor -- start 2023-11-28T18:38:34.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:34.197+0000 7f6a4dd1d640 1 -- start start 2023-11-28T18:38:34.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:34.197+0000 7f6a4dd1d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6a48072570 0x7f6a48139710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:34.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:34.197+0000 7f6a4dd1d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a480ce240 0x7f6a48137360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:34.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:34.197+0000 7f6a4dd1d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6a4813d0e0 0x7f6a48153200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:34.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:34.197+0000 7f6a4dd1d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a481392f0 con 0x7f6a480ce240 2023-11-28T18:38:34.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:34.197+0000 7f6a4dd1d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a48138670 con 0x7f6a48072570 2023-11-28T18:38:34.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:34.197+0000 7f6a4dd1d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a48138950 con 0x7f6a4813d0e0 2023-11-28T18:38:34.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:34.197+0000 7f6a46ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a480ce240 0x7f6a48137360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:34.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:34.197+0000 7f6a46ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a480ce240 0x7f6a48137360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60200/0 (socket says 172.21.15.45:60200) 2023-11-28T18:38:34.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:34.197+0000 7f6a46ffd640 1 -- 172.21.15.45:0/1319606345 learned_addr learned my addr 172.21.15.45:0/1319606345 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:34.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:34.197+0000 7f6a477fe640 1 --2- 172.21.15.45:0/1319606345 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6a48072570 0x7f6a48139710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:34.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:34.197+0000 7f6a47fff640 1 --2- 172.21.15.45:0/1319606345 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6a4813d0e0 0x7f6a48153200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:34.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:34.197+0000 7f6a46ffd640 1 -- 172.21.15.45:0/1319606345 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6a4813d0e0 msgr2=0x7f6a48153200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:34.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:34.197+0000 7f6a46ffd640 1 --2- 172.21.15.45:0/1319606345 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6a4813d0e0 0x7f6a48153200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:34.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:34.197+0000 7f6a46ffd640 1 -- 172.21.15.45:0/1319606345 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6a48072570 msgr2=0x7f6a48139710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:34.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:34.197+0000 7f6a46ffd640 1 --2- 172.21.15.45:0/1319606345 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6a48072570 0x7f6a48139710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:34.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:34.197+0000 7f6a46ffd640 1 -- 172.21.15.45:0/1319606345 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a3c0094d0 con 0x7f6a480ce240 2023-11-28T18:38:34.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:34.201+0000 7f6a46ffd640 1 --2- 172.21.15.45:0/1319606345 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a480ce240 0x7f6a48137360 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c019090 tx=0x7f6a3c01acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:34.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:34.201+0000 7f6a2ffff640 1 -- 172.21.15.45:0/1319606345 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c0b48c0 con 0x7f6a480ce240 2023-11-28T18:38:34.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:34.201+0000 7f6a2ffff640 1 -- 172.21.15.45:0/1319606345 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a3c0b4a40 con 0x7f6a480ce240 2023-11-28T18:38:34.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:34.201+0000 7f6a2ffff640 1 -- 172.21.15.45:0/1319606345 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c0b4df0 con 0x7f6a480ce240 2023-11-28T18:38:34.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:34.201+0000 7f6a4dd1d640 1 -- 172.21.15.45:0/1319606345 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a4813f540 con 0x7f6a480ce240 2023-11-28T18:38:34.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:34.201+0000 7f6a4dd1d640 1 -- 172.21.15.45:0/1319606345 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a48138f10 con 0x7f6a480ce240 2023-11-28T18:38:34.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:34.201+0000 7f6a4dd1d640 1 -- 172.21.15.45:0/1319606345 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a48139430 con 0x7f6a480ce240 2023-11-28T18:38:34.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:34.201+0000 7f6a2ffff640 1 -- 172.21.15.45:0/1319606345 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f6a3c0c7440 con 0x7f6a480ce240 2023-11-28T18:38:34.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:34.201+0000 7f6a2ffff640 1 --2- 172.21.15.45:0/1319606345 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6a340668d0 0x7f6a34068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:34.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:34.201+0000 7f6a2ffff640 1 -- 172.21.15.45:0/1319606345 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f6a3c11f280 con 0x7f6a480ce240 2023-11-28T18:38:34.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:34.205+0000 7f6a477fe640 1 --2- 172.21.15.45:0/1319606345 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6a340668d0 0x7f6a34068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:34.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:34.205+0000 7f6a477fe640 1 --2- 172.21.15.45:0/1319606345 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6a340668d0 0x7f6a34068d90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6a48142920 tx=0x7f6a38009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:34.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:34.205+0000 7f6a2ffff640 1 -- 172.21.15.45:0/1319606345 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6a48139430 con 0x7f6a480ce240 2023-11-28T18:38:34.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:34.365+0000 7f6a4dd1d640 1 -- 172.21.15.45:0/1319606345 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f6a48139430 con 0x7f6a480ce240 2023-11-28T18:38:35.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.005+0000 7f6a2ffff640 1 -- 172.21.15.45:0/1319606345 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v32) v1 ==== 170+0+0 (secure 0 0 0) 0x7f6a48139430 con 0x7f6a480ce240 2023-11-28T18:38:35.011 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' created 2023-11-28T18:38:35.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.009+0000 7f6a4dd1d640 1 -- 172.21.15.45:0/1319606345 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6a340668d0 msgr2=0x7f6a34068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:35.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.009+0000 7f6a4dd1d640 1 --2- 172.21.15.45:0/1319606345 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6a340668d0 0x7f6a34068d90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6a48142920 tx=0x7f6a38009040 comp rx=0 tx=0).stop 2023-11-28T18:38:35.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.009+0000 7f6a4dd1d640 1 -- 172.21.15.45:0/1319606345 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a480ce240 msgr2=0x7f6a48137360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:35.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.009+0000 7f6a4dd1d640 1 --2- 172.21.15.45:0/1319606345 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a480ce240 0x7f6a48137360 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c019090 tx=0x7f6a3c01acc0 comp rx=0 tx=0).stop 2023-11-28T18:38:35.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.009+0000 7f6a4dd1d640 1 -- 172.21.15.45:0/1319606345 shutdown_connections 2023-11-28T18:38:35.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.009+0000 7f6a4dd1d640 1 --2- 172.21.15.45:0/1319606345 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6a340668d0 0x7f6a34068d90 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:35.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.009+0000 7f6a4dd1d640 1 --2- 172.21.15.45:0/1319606345 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6a4813d0e0 0x7f6a48153200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:35.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.009+0000 7f6a4dd1d640 1 --2- 172.21.15.45:0/1319606345 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a480ce240 0x7f6a48137360 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:35.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.009+0000 7f6a4dd1d640 1 --2- 172.21.15.45:0/1319606345 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6a48072570 0x7f6a48139710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:35.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.009+0000 7f6a4dd1d640 1 -- 172.21.15.45:0/1319606345 >> 172.21.15.45:0/1319606345 conn(0x7f6a480b0d00 msgr2=0x7f6a48159dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:35.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.013+0000 7f6a4dd1d640 1 -- 172.21.15.45:0/1319606345 shutdown_connections 2023-11-28T18:38:35.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.013+0000 7f6a4dd1d640 1 -- 172.21.15.45:0/1319606345 wait complete. 2023-11-28T18:38:35.051 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-28T18:38:35.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.197+0000 7f32d0679640 1 Processor -- start 2023-11-28T18:38:35.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.197+0000 7f32d0679640 1 -- start start 2023-11-28T18:38:35.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.197+0000 7f32d0679640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f32c815d2f0 0x7f32c80d17f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:35.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.197+0000 7f32d0679640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f32c80d1d30 0x7f32c80cfc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:35.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.197+0000 7f32d0679640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f32c815d6d0 0x7f32c80d0160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:35.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.197+0000 7f32d0679640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32c80aff70 con 0x7f32c80d1d30 2023-11-28T18:38:35.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.197+0000 7f32d0679640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32c80b0210 con 0x7f32c815d6d0 2023-11-28T18:38:35.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.197+0000 7f32d0679640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32c80b04f0 con 0x7f32c815d2f0 2023-11-28T18:38:35.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.197+0000 7f32cdc14640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f32c80d1d30 0x7f32c80cfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:35.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.197+0000 7f32cdc14640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f32c80d1d30 0x7f32c80cfc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60210/0 (socket says 172.21.15.45:60210) 2023-11-28T18:38:35.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.197+0000 7f32cdc14640 1 -- 172.21.15.45:0/283359183 learned_addr learned my addr 172.21.15.45:0/283359183 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:35.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.197+0000 7f32ce415640 1 --2- 172.21.15.45:0/283359183 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f32c815d2f0 0x7f32c80d17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:35.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.197+0000 7f32cec16640 1 --2- 172.21.15.45:0/283359183 >> v2:172.21.15.190:3300/0 conn(0x7f32c815d6d0 0x7f32c80d0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:35.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.197+0000 7f32cdc14640 1 -- 172.21.15.45:0/283359183 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f32c815d2f0 msgr2=0x7f32c80d17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:35.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.197+0000 7f32cdc14640 1 --2- 172.21.15.45:0/283359183 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f32c815d2f0 0x7f32c80d17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:35.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.197+0000 7f32cdc14640 1 -- 172.21.15.45:0/283359183 >> v2:172.21.15.190:3300/0 conn(0x7f32c815d6d0 msgr2=0x7f32c80d0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:35.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.197+0000 7f32cdc14640 1 --2- 172.21.15.45:0/283359183 >> v2:172.21.15.190:3300/0 conn(0x7f32c815d6d0 0x7f32c80d0160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:35.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.197+0000 7f32cdc14640 1 -- 172.21.15.45:0/283359183 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32c80b07d0 con 0x7f32c80d1d30 2023-11-28T18:38:35.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.201+0000 7f32cdc14640 1 --2- 172.21.15.45:0/283359183 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32c80d1d30 0x7f32c80cfc20 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f32c8160f30 tx=0x7f32b801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1123caadc50ff388 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:35.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.201+0000 7f32cd413640 1 -- 172.21.15.45:0/283359183 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b80ad660 con 0x7f32c80d1d30 2023-11-28T18:38:35.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.201+0000 7f32cd413640 1 -- 172.21.15.45:0/283359183 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32b80ad7c0 con 0x7f32c80d1d30 2023-11-28T18:38:35.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.201+0000 7f32cd413640 1 -- 172.21.15.45:0/283359183 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b80adb50 con 0x7f32c80d1d30 2023-11-28T18:38:35.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.201+0000 7f32d0679640 1 -- 172.21.15.45:0/283359183 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32c80d1d30 msgr2=0x7f32c80cfc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:35.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.201+0000 7f32d0679640 1 --2- 172.21.15.45:0/283359183 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32c80d1d30 0x7f32c80cfc20 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f32c8160f30 tx=0x7f32b801c500 comp rx=0 tx=0).stop 2023-11-28T18:38:35.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.201+0000 7f32d0679640 1 -- 172.21.15.45:0/283359183 shutdown_connections 2023-11-28T18:38:35.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.201+0000 7f32d0679640 1 --2- 172.21.15.45:0/283359183 >> v2:172.21.15.190:3300/0 conn(0x7f32c815d6d0 0x7f32c80d0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:35.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.201+0000 7f32d0679640 1 --2- 172.21.15.45:0/283359183 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32c80d1d30 0x7f32c80cfc20 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:35.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.201+0000 7f32d0679640 1 --2- 172.21.15.45:0/283359183 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f32c815d2f0 0x7f32c80d17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:35.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.201+0000 7f32d0679640 1 -- 172.21.15.45:0/283359183 >> 172.21.15.45:0/283359183 conn(0x7f32c809c550 msgr2=0x7f32c80d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:35.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.201+0000 7f32d0679640 1 -- 172.21.15.45:0/283359183 shutdown_connections 2023-11-28T18:38:35.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.201+0000 7f32d0679640 1 -- 172.21.15.45:0/283359183 wait complete. 2023-11-28T18:38:35.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.205+0000 7f32d0679640 1 Processor -- start 2023-11-28T18:38:35.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.205+0000 7f32d0679640 1 -- start start 2023-11-28T18:38:35.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.205+0000 7f32d0679640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32c80d1d30 0x7f32c81536a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:35.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.205+0000 7f32d0679640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f32c815d2f0 0x7f32c8154d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:35.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.205+0000 7f32d0679640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f32c815d6d0 0x7f32c80c8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:35.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.205+0000 7f32d0679640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c8155a10 con 0x7f32c80d1d30 2023-11-28T18:38:35.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.205+0000 7f32d0679640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c81548d0 con 0x7f32c815d2f0 2023-11-28T18:38:35.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.205+0000 7f32d0679640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32c80c8830 con 0x7f32c815d6d0 2023-11-28T18:38:35.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.205+0000 7f32ce415640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32c80d1d30 0x7f32c81536a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:35.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.205+0000 7f32ce415640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32c80d1d30 0x7f32c81536a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60220/0 (socket says 172.21.15.45:60220) 2023-11-28T18:38:35.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.205+0000 7f32ce415640 1 -- 172.21.15.45:0/4176355752 learned_addr learned my addr 172.21.15.45:0/4176355752 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:35.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.205+0000 7f32cec16640 1 --2- 172.21.15.45:0/4176355752 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f32c815d6d0 0x7f32c80c8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:35.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.205+0000 7f32cdc14640 1 --2- 172.21.15.45:0/4176355752 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f32c815d2f0 0x7f32c8154d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:35.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.205+0000 7f32ce415640 1 -- 172.21.15.45:0/4176355752 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f32c815d6d0 msgr2=0x7f32c80c8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:35.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.205+0000 7f32ce415640 1 --2- 172.21.15.45:0/4176355752 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f32c815d6d0 0x7f32c80c8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:35.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.205+0000 7f32ce415640 1 -- 172.21.15.45:0/4176355752 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f32c815d2f0 msgr2=0x7f32c8154d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:35.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.205+0000 7f32ce415640 1 --2- 172.21.15.45:0/4176355752 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f32c815d2f0 0x7f32c8154d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:35.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.205+0000 7f32ce415640 1 -- 172.21.15.45:0/4176355752 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b80094d0 con 0x7f32c80d1d30 2023-11-28T18:38:35.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.205+0000 7f32ce415640 1 --2- 172.21.15.45:0/4176355752 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32c80d1d30 0x7f32c81536a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f32c400e8b0 tx=0x7f32c400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:35.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.205+0000 7f32beffd640 1 -- 172.21.15.45:0/4176355752 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c400c940 con 0x7f32c80d1d30 2023-11-28T18:38:35.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.205+0000 7f32beffd640 1 -- 172.21.15.45:0/4176355752 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32c400caa0 con 0x7f32c80d1d30 2023-11-28T18:38:35.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.205+0000 7f32d0679640 1 -- 172.21.15.45:0/4176355752 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32c80c8b10 con 0x7f32c80d1d30 2023-11-28T18:38:35.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.205+0000 7f32beffd640 1 -- 172.21.15.45:0/4176355752 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c400ce30 con 0x7f32c80d1d30 2023-11-28T18:38:35.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.205+0000 7f32d0679640 1 -- 172.21.15.45:0/4176355752 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32c815a1c0 con 0x7f32c80d1d30 2023-11-28T18:38:35.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.205+0000 7f32d0679640 1 -- 172.21.15.45:0/4176355752 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32c8067a30 con 0x7f32c80d1d30 2023-11-28T18:38:35.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.209+0000 7f32beffd640 1 -- 172.21.15.45:0/4176355752 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f32c4013470 con 0x7f32c80d1d30 2023-11-28T18:38:35.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.209+0000 7f32beffd640 1 --2- 172.21.15.45:0/4176355752 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f32ac0668d0 0x7f32ac068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:35.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.209+0000 7f32beffd640 1 -- 172.21.15.45:0/4176355752 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f32c4084e20 con 0x7f32c80d1d30 2023-11-28T18:38:35.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.209+0000 7f32cdc14640 1 --2- 172.21.15.45:0/4176355752 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f32ac0668d0 0x7f32ac068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:35.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.209+0000 7f32cdc14640 1 --2- 172.21.15.45:0/4176355752 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f32ac0668d0 0x7f32ac068d90 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f32b80af000 tx=0x7f32b8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:35.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.213+0000 7f32beffd640 1 -- 172.21.15.45:0/4176355752 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f32c40520a0 con 0x7f32c80d1d30 2023-11-28T18:38:35.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:35.401+0000 7f32d0679640 1 -- 172.21.15.45:0/4176355752 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f32c80c8df0 con 0x7f32c80d1d30 2023-11-28T18:38:36.037 INFO:teuthology.orchestra.run.smithi045.stderr:new fs with metadata pool 4 and data pool 5 2023-11-28T18:38:36.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.033+0000 7f32beffd640 1 -- 172.21.15.45:0/4176355752 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7f32c40170c0 con 0x7f32c80d1d30 2023-11-28T18:38:36.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.037+0000 7f32d0679640 1 -- 172.21.15.45:0/4176355752 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f32ac0668d0 msgr2=0x7f32ac068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:36.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.037+0000 7f32d0679640 1 --2- 172.21.15.45:0/4176355752 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f32ac0668d0 0x7f32ac068d90 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f32b80af000 tx=0x7f32b8009040 comp rx=0 tx=0).stop 2023-11-28T18:38:36.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.037+0000 7f32d0679640 1 -- 172.21.15.45:0/4176355752 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32c80d1d30 msgr2=0x7f32c81536a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:36.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.037+0000 7f32d0679640 1 --2- 172.21.15.45:0/4176355752 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32c80d1d30 0x7f32c81536a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f32c400e8b0 tx=0x7f32c400ed70 comp rx=0 tx=0).stop 2023-11-28T18:38:36.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.041+0000 7f32d0679640 1 -- 172.21.15.45:0/4176355752 shutdown_connections 2023-11-28T18:38:36.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.041+0000 7f32d0679640 1 --2- 172.21.15.45:0/4176355752 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f32ac0668d0 0x7f32ac068d90 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:36.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.041+0000 7f32d0679640 1 --2- 172.21.15.45:0/4176355752 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f32c815d6d0 0x7f32c80c8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:36.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.041+0000 7f32d0679640 1 --2- 172.21.15.45:0/4176355752 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f32c815d2f0 0x7f32c8154d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:36.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.041+0000 7f32d0679640 1 --2- 172.21.15.45:0/4176355752 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32c80d1d30 0x7f32c81536a0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:36.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.041+0000 7f32d0679640 1 -- 172.21.15.45:0/4176355752 >> 172.21.15.45:0/4176355752 conn(0x7f32c809c550 msgr2=0x7f32c8155ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:36.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.041+0000 7f32d0679640 1 -- 172.21.15.45:0/4176355752 shutdown_connections 2023-11-28T18:38:36.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.041+0000 7f32d0679640 1 -- 172.21.15.45:0/4176355752 wait complete. 2023-11-28T18:38:36.083 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T18:38:36.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.225+0000 7fbcc4bc4640 1 Processor -- start 2023-11-28T18:38:36.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.225+0000 7fbcc4bc4640 1 -- start start 2023-11-28T18:38:36.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.225+0000 7fbcc4bc4640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbcc0145d70 0x7fbcc00d06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:36.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.225+0000 7fbcc4bc4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbcc006f040 0x7fbcc006b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:36.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.225+0000 7fbcc4bc4640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcc006fdd0 con 0x7fbcc0146150 2023-11-28T18:38:36.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.225+0000 7fbcc4bc4640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcc0070750 con 0x7fbcc0145d70 2023-11-28T18:38:36.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.225+0000 7fbcc4bc4640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc00cf080 con 0x7fbcc006f040 2023-11-28T18:38:36.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.225+0000 7fbcbe59c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbcc0145d70 0x7fbcc00d06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:36.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.225+0000 7fbcbe59c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbcc0145d70 0x7fbcc00d06a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60226/0 (socket says 172.21.15.45:60226) 2023-11-28T18:38:36.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.225+0000 7fbcbe59c640 1 -- 172.21.15.45:0/2753932368 learned_addr learned my addr 172.21.15.45:0/2753932368 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:36.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.225+0000 7fbcbe59c640 1 -- 172.21.15.45:0/2753932368 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbcc006f040 msgr2=0x7fbcc006b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:36.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.225+0000 7fbcbe59c640 1 --2- 172.21.15.45:0/2753932368 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbcc006f040 0x7fbcc006b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:36.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.225+0000 7fbcbe59c640 1 -- 172.21.15.45:0/2753932368 >> v1:172.21.15.190:6789/0 conn(0x7fbcc0146150 legacy=0x7fbcc006e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:36.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.225+0000 7fbcbe59c640 1 -- 172.21.15.45:0/2753932368 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcc0070090 con 0x7fbcc0145d70 2023-11-28T18:38:36.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.229+0000 7fbcbe59c640 1 --2- 172.21.15.45:0/2753932368 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbcc0145d70 0x7fbcc00d06a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fbcb00098a0 tx=0x7fbcb001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc2b7dff260ef890 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:36.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.229+0000 7fbcbdd9b640 1 -- 172.21.15.45:0/2753932368 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb00ad640 con 0x7fbcc0145d70 2023-11-28T18:38:36.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.229+0000 7fbcbdd9b640 1 -- 172.21.15.45:0/2753932368 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcb00ad7a0 con 0x7fbcc0145d70 2023-11-28T18:38:36.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.229+0000 7fbcbdd9b640 1 -- 172.21.15.45:0/2753932368 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb00adb30 con 0x7fbcc0145d70 2023-11-28T18:38:36.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.229+0000 7fbcc4bc4640 1 -- 172.21.15.45:0/2753932368 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbcc0145d70 msgr2=0x7fbcc00d06a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:36.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.229+0000 7fbcc4bc4640 1 --2- 172.21.15.45:0/2753932368 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbcc0145d70 0x7fbcc00d06a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fbcb00098a0 tx=0x7fbcb001c4b0 comp rx=0 tx=0).stop 2023-11-28T18:38:36.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.229+0000 7fbcc4bc4640 1 -- 172.21.15.45:0/2753932368 shutdown_connections 2023-11-28T18:38:36.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.229+0000 7fbcc4bc4640 1 --2- 172.21.15.45:0/2753932368 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbcc006f040 0x7fbcc006b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:36.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.229+0000 7fbcc4bc4640 1 --2- 172.21.15.45:0/2753932368 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbcc0145d70 0x7fbcc00d06a0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:36.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.229+0000 7fbcc4bc4640 1 -- 172.21.15.45:0/2753932368 >> 172.21.15.45:0/2753932368 conn(0x7fbcc00d0ef0 msgr2=0x7fbcc00d1300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:36.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.229+0000 7fbcc4bc4640 1 -- 172.21.15.45:0/2753932368 shutdown_connections 2023-11-28T18:38:36.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.229+0000 7fbcc4bc4640 1 -- 172.21.15.45:0/2753932368 wait complete. 2023-11-28T18:38:36.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.233+0000 7fbcc4bc4640 1 Processor -- start 2023-11-28T18:38:36.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.233+0000 7fbcc4bc4640 1 -- start start 2023-11-28T18:38:36.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.233+0000 7fbcc4bc4640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbcc006f040 0x7fbcc013dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:36.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.233+0000 7fbcc4bc4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbcc0145d70 0x7fbcc0145150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:36.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.233+0000 7fbcc4bc4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbcc0146150 0x7fbcc0144a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:36.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.233+0000 7fbcc4bc4640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc013d7c0 con 0x7fbcc0145d70 2023-11-28T18:38:36.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.233+0000 7fbcc4bc4640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc0144f90 con 0x7fbcc006f040 2023-11-28T18:38:36.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.233+0000 7fbcc4bc4640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc0139bf0 con 0x7fbcc0146150 2023-11-28T18:38:36.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.233+0000 7fbcb7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbcc0145d70 0x7fbcc0145150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:36.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.233+0000 7fbcb7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbcc0145d70 0x7fbcc0145150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60228/0 (socket says 172.21.15.45:60228) 2023-11-28T18:38:36.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.233+0000 7fbcb7fff640 1 -- 172.21.15.45:0/2011620008 learned_addr learned my addr 172.21.15.45:0/2011620008 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:36.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.233+0000 7fbcbe59c640 1 --2- 172.21.15.45:0/2011620008 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbcc006f040 0x7fbcc013dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:36.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.233+0000 7fbcb7fff640 1 -- 172.21.15.45:0/2011620008 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbcc0146150 msgr2=0x7fbcc0144a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:36.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.233+0000 7fbcbed9d640 1 --2- 172.21.15.45:0/2011620008 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbcc0146150 0x7fbcc0144a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:36.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.233+0000 7fbcb7fff640 1 --2- 172.21.15.45:0/2011620008 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbcc0146150 0x7fbcc0144a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:36.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.233+0000 7fbcb7fff640 1 -- 172.21.15.45:0/2011620008 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbcc006f040 msgr2=0x7fbcc013dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:36.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.233+0000 7fbcb7fff640 1 --2- 172.21.15.45:0/2011620008 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbcc006f040 0x7fbcc013dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:36.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.233+0000 7fbcb7fff640 1 -- 172.21.15.45:0/2011620008 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcb00094d0 con 0x7fbcc0145d70 2023-11-28T18:38:36.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.233+0000 7fbcbe59c640 1 --2- 172.21.15.45:0/2011620008 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbcc006f040 0x7fbcc013dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:38:36.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.233+0000 7fbcbed9d640 1 --2- 172.21.15.45:0/2011620008 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbcc0146150 0x7fbcc0144a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:38:36.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.233+0000 7fbcb7fff640 1 --2- 172.21.15.45:0/2011620008 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbcc0145d70 0x7fbcc0145150 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fbca800b3e0 tx=0x7fbca800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:36.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.233+0000 7fbcb6ffd640 1 -- 172.21.15.45:0/2011620008 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca8011830 con 0x7fbcc0145d70 2023-11-28T18:38:36.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.233+0000 7fbcb6ffd640 1 -- 172.21.15.45:0/2011620008 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbca8011990 con 0x7fbcc0145d70 2023-11-28T18:38:36.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.233+0000 7fbcb6ffd640 1 -- 172.21.15.45:0/2011620008 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca8011d60 con 0x7fbcc0145d70 2023-11-28T18:38:36.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.233+0000 7fbcc4bc4640 1 -- 172.21.15.45:0/2011620008 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcc013d100 con 0x7fbcc0145d70 2023-11-28T18:38:36.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.233+0000 7fbcc4bc4640 1 -- 172.21.15.45:0/2011620008 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcc0139ed0 con 0x7fbcc0145d70 2023-11-28T18:38:36.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.237+0000 7fbcc4bc4640 1 -- 172.21.15.45:0/2011620008 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcc013d900 con 0x7fbcc0145d70 2023-11-28T18:38:36.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.237+0000 7fbcb6ffd640 1 -- 172.21.15.45:0/2011620008 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fbca801a400 con 0x7fbcc0145d70 2023-11-28T18:38:36.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.237+0000 7fbcb6ffd640 1 --2- 172.21.15.45:0/2011620008 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbca00668d0 0x7fbca0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:36.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.237+0000 7fbcb6ffd640 1 -- 172.21.15.45:0/2011620008 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbca8084570 con 0x7fbcc0145d70 2023-11-28T18:38:36.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.237+0000 7fbcbe59c640 1 --2- 172.21.15.45:0/2011620008 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbca00668d0 0x7fbca0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:36.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.237+0000 7fbcbe59c640 1 --2- 172.21.15.45:0/2011620008 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbca00668d0 0x7fbca0068d90 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbcb00af000 tx=0x7fbcb0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:36.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.241+0000 7fbcb6ffd640 1 -- 172.21.15.45:0/2011620008 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbcc013d900 con 0x7fbcc0145d70 2023-11-28T18:38:36.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.401+0000 7fbcc4bc4640 1 -- 172.21.15.45:0/2011620008 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbcc013d900 con 0x7fbcc0145d70 2023-11-28T18:38:36.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.401+0000 7fbcb6ffd640 1 -- 172.21.15.45:0/2011620008 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16546 (secure 0 0 0) 0x7fbcc013d900 con 0x7fbcc0145d70 2023-11-28T18:38:36.404 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:38:36.404 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":33,"fsid":"d10f5cd6-1d00-4019-99b6-6fa435498a15","created":"2023-11-28T18:37:08.189030+0000","modified":"2023-11-28T18:38:35.406520+0000","last_up_change":"2023-11-28T18:37:20.196124+0000","last_in_change":"2023-11-28T18:37:10.742043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T18:37:21.293917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-28T18:38:33.254037+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-28T18:38:34.414654+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"84465384-103c-4f2c-a45a-96f5bb9c835f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6809","nonce":555237322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6811","nonce":555237322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6815","nonce":555237322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6813","nonce":555237322}]},"public_addr":"172.21.15.45:6809/555237322","cluster_addr":"172.21.15.45:6811/555237322","heartbeat_back_addr":"172.21.15.45:6815/555237322","heartbeat_front_addr":"172.21.15.45:6813/555237322","state":["exists","up"]},{"osd":1,"uuid":"7d9eed24-a58f-42c7-a787-ac06be8553fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6801","nonce":2857063763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6803","nonce":2857063763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6807","nonce":2857063763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6805","nonce":2857063763}]},"public_addr":"172.21.15.45:6801/2857063763","cluster_addr":"172.21.15.45:6803/2857063763","heartbeat_back_addr":"172.21.15.45:6807/2857063763","heartbeat_front_addr":"172.21.15.45:6805/2857063763","state":["exists","up"]},{"osd":2,"uuid":"575eeccc-4abf-45b4-9caf-f3e797859588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6817","nonce":193884539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6819","nonce":193884539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6823","nonce":193884539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6821","nonce":193884539}]},"public_addr":"172.21.15.45:6817/193884539","cluster_addr":"172.21.15.45:6819/193884539","heartbeat_back_addr":"172.21.15.45:6823/193884539","heartbeat_front_addr":"172.21.15.45:6821/193884539","state":["exists","up"]},{"osd":3,"uuid":"9b0290d6-9a52-4bc8-b2a1-7622c5dc8e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6825","nonce":78541084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6827","nonce":78541084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6831","nonce":78541084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6829","nonce":78541084}]},"public_addr":"172.21.15.45:6825/78541084","cluster_addr":"172.21.15.45:6827/78541084","heartbeat_back_addr":"172.21.15.45:6831/78541084","heartbeat_front_addr":"172.21.15.45:6829/78541084","state":["exists","up"]},{"osd":4,"uuid":"ce632829-f027-4fbf-a627-02c571aa9d53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6809","nonce":1537591987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6811","nonce":1537591987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6815","nonce":1537591987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6813","nonce":1537591987}]},"public_addr":"172.21.15.190:6809/1537591987","cluster_addr":"172.21.15.190:6811/1537591987","heartbeat_back_addr":"172.21.15.190:6815/1537591987","heartbeat_front_addr":"172.21.15.190:6813/1537591987","state":["exists","up"]},{"osd":5,"uuid":"8700b609-27be-40bd-a251-4c0ae0a29ead","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6801","nonce":3296698407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6803","nonce":3296698407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6807","nonce":3296698407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6805","nonce":3296698407}]},"public_addr":"172.21.15.190:6801/3296698407","cluster_addr":"172.21.15.190:6803/3296698407","heartbeat_back_addr":"172.21.15.190:6807/3296698407","heartbeat_front_addr":"172.21.15.190:6805/3296698407","state":["exists","up"]},{"osd":6,"uuid":"44ce4a40-e6ff-4f4d-8e8a-7341e5c91f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6817","nonce":2317686718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6819","nonce":2317686718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6823","nonce":2317686718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6821","nonce":2317686718}]},"public_addr":"172.21.15.190:6817/2317686718","cluster_addr":"172.21.15.190:6819/2317686718","heartbeat_back_addr":"172.21.15.190:6823/2317686718","heartbeat_front_addr":"172.21.15.190:6821/2317686718","state":["exists","up"]},{"osd":7,"uuid":"192238c9-1423-4b7e-ac8f-84ba32113ddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6825","nonce":2493232051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6827","nonce":2493232051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6831","nonce":2493232051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6829","nonce":2493232051}]},"public_addr":"172.21.15.190:6825/2493232051","cluster_addr":"172.21.15.190:6827/2493232051","heartbeat_back_addr":"172.21.15.190:6831/2493232051","heartbeat_front_addr":"172.21.15.190:6829/2493232051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.393552+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.385453+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.361421+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.366408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.363226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.276007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.414605+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.445885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T18:38:36.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.401+0000 7fbcc4bc4640 1 -- 172.21.15.45:0/2011620008 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbca00668d0 msgr2=0x7fbca0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:36.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.401+0000 7fbcc4bc4640 1 --2- 172.21.15.45:0/2011620008 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbca00668d0 0x7fbca0068d90 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbcb00af000 tx=0x7fbcb0008040 comp rx=0 tx=0).stop 2023-11-28T18:38:36.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.401+0000 7fbcc4bc4640 1 -- 172.21.15.45:0/2011620008 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbcc0145d70 msgr2=0x7fbcc0145150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:36.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.401+0000 7fbcc4bc4640 1 --2- 172.21.15.45:0/2011620008 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbcc0145d70 0x7fbcc0145150 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fbca800b3e0 tx=0x7fbca800b8a0 comp rx=0 tx=0).stop 2023-11-28T18:38:36.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.401+0000 7fbcc4bc4640 1 -- 172.21.15.45:0/2011620008 shutdown_connections 2023-11-28T18:38:36.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.401+0000 7fbcc4bc4640 1 --2- 172.21.15.45:0/2011620008 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbca00668d0 0x7fbca0068d90 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:36.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.401+0000 7fbcc4bc4640 1 --2- 172.21.15.45:0/2011620008 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbcc0146150 0x7fbcc0144a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:36.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.401+0000 7fbcc4bc4640 1 --2- 172.21.15.45:0/2011620008 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbcc0145d70 0x7fbcc0145150 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:36.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.401+0000 7fbcc4bc4640 1 --2- 172.21.15.45:0/2011620008 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbcc006f040 0x7fbcc013dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:36.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.401+0000 7fbcc4bc4640 1 -- 172.21.15.45:0/2011620008 >> 172.21.15.45:0/2011620008 conn(0x7fbcc00d0ef0 msgr2=0x7fbcc00b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:36.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.401+0000 7fbcc4bc4640 1 -- 172.21.15.45:0/2011620008 shutdown_connections 2023-11-28T18:38:36.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.401+0000 7fbcc4bc4640 1 -- 172.21.15.45:0/2011620008 wait complete. 2023-11-28T18:38:36.426 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T18:38:36.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.565+0000 7f3a9e85a640 1 Processor -- start 2023-11-28T18:38:36.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.565+0000 7f3a9e85a640 1 -- start start 2023-11-28T18:38:36.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.565+0000 7f3a9e85a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3a9806ca10 0x7f3a9815a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:36.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.565+0000 7f3a9e85a640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f3a9815abb0 0x7f3a980cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:36.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.565+0000 7f3a9e85a640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a9815b3e0 con 0x7f3a9813cf70 2023-11-28T18:38:36.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.565+0000 7f3a9e85a640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a9813d350 con 0x7f3a9815abb0 2023-11-28T18:38:36.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.565+0000 7f3a9e85a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a98140520 con 0x7f3a9806ca10 2023-11-28T18:38:36.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.569+0000 7f3a97fff640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f3a9813cf70 0x7f3a9806c300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.45:36068/0 (socket says 172.21.15.45:36068) 2023-11-28T18:38:36.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.569+0000 7f3a97fff640 1 -- 172.21.15.45:0/405574362 learned_addr learned my addr 172.21.15.45:0/405574362 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:38:36.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.569+0000 7f3a977fe640 1 --2- 172.21.15.45:0/405574362 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3a9806ca10 0x7f3a9815a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:36.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.569+0000 7f3a9cdf7640 1 --2- 172.21.15.45:0/405574362 >> v2:172.21.15.190:3300/0 conn(0x7f3a9815abb0 0x7f3a980cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:36.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.569+0000 7f3a96ffd640 1 -- 172.21.15.45:0/405574362 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2687314060 0 0) 0x7f3a9815b3e0 con 0x7f3a9813cf70 2023-11-28T18:38:36.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.569+0000 7f3a96ffd640 1 -- 172.21.15.45:0/405574362 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a80003530 con 0x7f3a9813cf70 2023-11-28T18:38:36.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.569+0000 7f3a977fe640 1 -- 172.21.15.45:0/405574362 >> v2:172.21.15.190:3300/0 conn(0x7f3a9815abb0 msgr2=0x7f3a980cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:36.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.569+0000 7f3a977fe640 1 --2- 172.21.15.45:0/405574362 >> v2:172.21.15.190:3300/0 conn(0x7f3a9815abb0 0x7f3a980cd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:36.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.569+0000 7f3a977fe640 1 -- 172.21.15.45:0/405574362 >> v1:172.21.15.190:6789/0 conn(0x7f3a9813cf70 legacy=0x7f3a9806c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:36.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.569+0000 7f3a977fe640 1 -- 172.21.15.45:0/405574362 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a9813f760 con 0x7f3a9806ca10 2023-11-28T18:38:36.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.569+0000 7f3a9cdf7640 1 --2- 172.21.15.45:0/405574362 >> v2:172.21.15.190:3300/0 conn(0x7f3a9815abb0 0x7f3a980cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:38:36.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.569+0000 7f3a977fe640 1 --2- 172.21.15.45:0/405574362 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3a9806ca10 0x7f3a9815a670 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c0097c0 tx=0x7f3a8c01c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=234bc44c795a8b1e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:36.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.569+0000 7f3a96ffd640 1 -- 172.21.15.45:0/405574362 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a8c0ac620 con 0x7f3a9806ca10 2023-11-28T18:38:36.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.569+0000 7f3a96ffd640 1 -- 172.21.15.45:0/405574362 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a8c0ac780 con 0x7f3a9806ca10 2023-11-28T18:38:36.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.569+0000 7f3a96ffd640 1 -- 172.21.15.45:0/405574362 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a8c0acaf0 con 0x7f3a9806ca10 2023-11-28T18:38:36.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.573+0000 7f3a9e85a640 1 -- 172.21.15.45:0/405574362 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3a9806ca10 msgr2=0x7f3a9815a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:36.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.573+0000 7f3a9e85a640 1 --2- 172.21.15.45:0/405574362 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3a9806ca10 0x7f3a9815a670 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c0097c0 tx=0x7f3a8c01c3c0 comp rx=0 tx=0).stop 2023-11-28T18:38:36.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.573+0000 7f3a9e85a640 1 -- 172.21.15.45:0/405574362 shutdown_connections 2023-11-28T18:38:36.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.573+0000 7f3a9e85a640 1 --2- 172.21.15.45:0/405574362 >> v2:172.21.15.190:3300/0 conn(0x7f3a9815abb0 0x7f3a980cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:36.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.573+0000 7f3a9e85a640 1 --2- 172.21.15.45:0/405574362 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3a9806ca10 0x7f3a9815a670 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:36.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.573+0000 7f3a9e85a640 1 -- 172.21.15.45:0/405574362 >> 172.21.15.45:0/405574362 conn(0x7f3a9806a570 msgr2=0x7f3a9806a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:36.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.573+0000 7f3a9e85a640 1 -- 172.21.15.45:0/405574362 shutdown_connections 2023-11-28T18:38:36.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.573+0000 7f3a9e85a640 1 -- 172.21.15.45:0/405574362 wait complete. 2023-11-28T18:38:36.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.573+0000 7f3a9e85a640 1 Processor -- start 2023-11-28T18:38:36.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.573+0000 7f3a9e85a640 1 -- start start 2023-11-28T18:38:36.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.573+0000 7f3a9e85a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a9806ca10 0x7f3a9815c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:36.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.573+0000 7f3a9e85a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3a9813cf70 0x7f3a980b1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:36.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.573+0000 7f3a9e85a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3a9815abb0 0x7f3a980b1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:36.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.573+0000 7f3a9e85a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a980b21e0 con 0x7f3a9806ca10 2023-11-28T18:38:36.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.573+0000 7f3a9e85a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a980b1090 con 0x7f3a9813cf70 2023-11-28T18:38:36.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.573+0000 7f3a9e85a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a98159360 con 0x7f3a9815abb0 2023-11-28T18:38:36.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.573+0000 7f3a97fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a9806ca10 0x7f3a9815c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:36.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.573+0000 7f3a9cdf7640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3a9815abb0 0x7f3a980b1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:36.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.573+0000 7f3a97fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a9806ca10 0x7f3a9815c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60232/0 (socket says 172.21.15.45:60232) 2023-11-28T18:38:36.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.573+0000 7f3a97fff640 1 -- 172.21.15.45:0/2065545127 learned_addr learned my addr 172.21.15.45:0/2065545127 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:36.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.573+0000 7f3a977fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3a9813cf70 0x7f3a980b1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:36.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.577+0000 7f3a97fff640 1 -- 172.21.15.45:0/2065545127 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3a9815abb0 msgr2=0x7f3a980b1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:36.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.577+0000 7f3a97fff640 1 --2- 172.21.15.45:0/2065545127 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3a9815abb0 0x7f3a980b1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:36.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.577+0000 7f3a97fff640 1 -- 172.21.15.45:0/2065545127 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3a9813cf70 msgr2=0x7f3a980b1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:36.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.577+0000 7f3a97fff640 1 --2- 172.21.15.45:0/2065545127 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3a9813cf70 0x7f3a980b1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:36.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.577+0000 7f3a97fff640 1 -- 172.21.15.45:0/2065545127 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a90009a70 con 0x7f3a9806ca10 2023-11-28T18:38:36.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.577+0000 7f3a9cdf7640 1 --2- 172.21.15.45:0/2065545127 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3a9815abb0 0x7f3a980b1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:38:36.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.577+0000 7f3a97fff640 1 --2- 172.21.15.45:0/2065545127 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a9806ca10 0x7f3a9815c600 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f3a8800c450 tx=0x7f3a8800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:36.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.577+0000 7f3a94ff9640 1 -- 172.21.15.45:0/2065545127 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a88005cf0 con 0x7f3a9806ca10 2023-11-28T18:38:36.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.577+0000 7f3a94ff9640 1 -- 172.21.15.45:0/2065545127 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a88005e50 con 0x7f3a9806ca10 2023-11-28T18:38:36.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.577+0000 7f3a94ff9640 1 -- 172.21.15.45:0/2065545127 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a880072f0 con 0x7f3a9806ca10 2023-11-28T18:38:36.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.577+0000 7f3a9e85a640 1 -- 172.21.15.45:0/2065545127 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a8c009420 con 0x7f3a9806ca10 2023-11-28T18:38:36.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.577+0000 7f3a9e85a640 1 -- 172.21.15.45:0/2065545127 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a98159920 con 0x7f3a9806ca10 2023-11-28T18:38:36.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.577+0000 7f3a9e85a640 1 -- 172.21.15.45:0/2065545127 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a98069480 con 0x7f3a9806ca10 2023-11-28T18:38:36.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.577+0000 7f3a94ff9640 1 -- 172.21.15.45:0/2065545127 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f3a88007450 con 0x7f3a9806ca10 2023-11-28T18:38:36.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.577+0000 7f3a94ff9640 1 --2- 172.21.15.45:0/2065545127 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f3a840668d0 0x7f3a84068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:36.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.577+0000 7f3a94ff9640 1 -- 172.21.15.45:0/2065545127 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3a880839c0 con 0x7f3a9806ca10 2023-11-28T18:38:36.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.581+0000 7f3a977fe640 1 --2- 172.21.15.45:0/2065545127 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f3a840668d0 0x7f3a84068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:36.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.581+0000 7f3a977fe640 1 --2- 172.21.15.45:0/2065545127 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f3a840668d0 0x7f3a84068d90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c0ae000 tx=0x7f3a8c0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:36.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.581+0000 7f3a94ff9640 1 -- 172.21.15.45:0/2065545127 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3a88050cb0 con 0x7f3a9806ca10 2023-11-28T18:38:36.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.741+0000 7f3a9e85a640 1 -- 172.21.15.45:0/2065545127 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3a980b1450 con 0x7f3a9806ca10 2023-11-28T18:38:36.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.741+0000 7f3a94ff9640 1 -- 172.21.15.45:0/2065545127 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16546 (secure 0 0 0) 0x7f3a88017020 con 0x7f3a9806ca10 2023-11-28T18:38:36.744 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:38:36.744 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":33,"fsid":"d10f5cd6-1d00-4019-99b6-6fa435498a15","created":"2023-11-28T18:37:08.189030+0000","modified":"2023-11-28T18:38:35.406520+0000","last_up_change":"2023-11-28T18:37:20.196124+0000","last_in_change":"2023-11-28T18:37:10.742043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T18:37:21.293917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-28T18:38:33.254037+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-28T18:38:34.414654+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"84465384-103c-4f2c-a45a-96f5bb9c835f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6809","nonce":555237322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6811","nonce":555237322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6815","nonce":555237322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6813","nonce":555237322}]},"public_addr":"172.21.15.45:6809/555237322","cluster_addr":"172.21.15.45:6811/555237322","heartbeat_back_addr":"172.21.15.45:6815/555237322","heartbeat_front_addr":"172.21.15.45:6813/555237322","state":["exists","up"]},{"osd":1,"uuid":"7d9eed24-a58f-42c7-a787-ac06be8553fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6801","nonce":2857063763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6803","nonce":2857063763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6807","nonce":2857063763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6805","nonce":2857063763}]},"public_addr":"172.21.15.45:6801/2857063763","cluster_addr":"172.21.15.45:6803/2857063763","heartbeat_back_addr":"172.21.15.45:6807/2857063763","heartbeat_front_addr":"172.21.15.45:6805/2857063763","state":["exists","up"]},{"osd":2,"uuid":"575eeccc-4abf-45b4-9caf-f3e797859588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6817","nonce":193884539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6819","nonce":193884539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6823","nonce":193884539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6821","nonce":193884539}]},"public_addr":"172.21.15.45:6817/193884539","cluster_addr":"172.21.15.45:6819/193884539","heartbeat_back_addr":"172.21.15.45:6823/193884539","heartbeat_front_addr":"172.21.15.45:6821/193884539","state":["exists","up"]},{"osd":3,"uuid":"9b0290d6-9a52-4bc8-b2a1-7622c5dc8e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6825","nonce":78541084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6827","nonce":78541084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6831","nonce":78541084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6829","nonce":78541084}]},"public_addr":"172.21.15.45:6825/78541084","cluster_addr":"172.21.15.45:6827/78541084","heartbeat_back_addr":"172.21.15.45:6831/78541084","heartbeat_front_addr":"172.21.15.45:6829/78541084","state":["exists","up"]},{"osd":4,"uuid":"ce632829-f027-4fbf-a627-02c571aa9d53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6809","nonce":1537591987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6811","nonce":1537591987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6815","nonce":1537591987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6813","nonce":1537591987}]},"public_addr":"172.21.15.190:6809/1537591987","cluster_addr":"172.21.15.190:6811/1537591987","heartbeat_back_addr":"172.21.15.190:6815/1537591987","heartbeat_front_addr":"172.21.15.190:6813/1537591987","state":["exists","up"]},{"osd":5,"uuid":"8700b609-27be-40bd-a251-4c0ae0a29ead","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6801","nonce":3296698407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6803","nonce":3296698407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6807","nonce":3296698407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6805","nonce":3296698407}]},"public_addr":"172.21.15.190:6801/3296698407","cluster_addr":"172.21.15.190:6803/3296698407","heartbeat_back_addr":"172.21.15.190:6807/3296698407","heartbeat_front_addr":"172.21.15.190:6805/3296698407","state":["exists","up"]},{"osd":6,"uuid":"44ce4a40-e6ff-4f4d-8e8a-7341e5c91f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6817","nonce":2317686718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6819","nonce":2317686718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6823","nonce":2317686718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6821","nonce":2317686718}]},"public_addr":"172.21.15.190:6817/2317686718","cluster_addr":"172.21.15.190:6819/2317686718","heartbeat_back_addr":"172.21.15.190:6823/2317686718","heartbeat_front_addr":"172.21.15.190:6821/2317686718","state":["exists","up"]},{"osd":7,"uuid":"192238c9-1423-4b7e-ac8f-84ba32113ddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6825","nonce":2493232051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6827","nonce":2493232051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6831","nonce":2493232051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6829","nonce":2493232051}]},"public_addr":"172.21.15.190:6825/2493232051","cluster_addr":"172.21.15.190:6827/2493232051","heartbeat_back_addr":"172.21.15.190:6831/2493232051","heartbeat_front_addr":"172.21.15.190:6829/2493232051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.393552+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.385453+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.361421+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.366408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.363226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.276007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.414605+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.445885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T18:38:36.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.741+0000 7f3a9e85a640 1 -- 172.21.15.45:0/2065545127 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f3a840668d0 msgr2=0x7f3a84068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:36.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.741+0000 7f3a9e85a640 1 --2- 172.21.15.45:0/2065545127 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f3a840668d0 0x7f3a84068d90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c0ae000 tx=0x7f3a8c0a7000 comp rx=0 tx=0).stop 2023-11-28T18:38:36.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.741+0000 7f3a9e85a640 1 -- 172.21.15.45:0/2065545127 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a9806ca10 msgr2=0x7f3a9815c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:36.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.741+0000 7f3a9e85a640 1 --2- 172.21.15.45:0/2065545127 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a9806ca10 0x7f3a9815c600 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f3a8800c450 tx=0x7f3a8800c850 comp rx=0 tx=0).stop 2023-11-28T18:38:36.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.741+0000 7f3a9e85a640 1 -- 172.21.15.45:0/2065545127 shutdown_connections 2023-11-28T18:38:36.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.741+0000 7f3a9e85a640 1 --2- 172.21.15.45:0/2065545127 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f3a840668d0 0x7f3a84068d90 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:36.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.741+0000 7f3a9e85a640 1 --2- 172.21.15.45:0/2065545127 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3a9815abb0 0x7f3a980b1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:36.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.741+0000 7f3a9e85a640 1 --2- 172.21.15.45:0/2065545127 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3a9813cf70 0x7f3a980b1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:36.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.741+0000 7f3a9e85a640 1 --2- 172.21.15.45:0/2065545127 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a9806ca10 0x7f3a9815c600 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:36.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.741+0000 7f3a9e85a640 1 -- 172.21.15.45:0/2065545127 >> 172.21.15.45:0/2065545127 conn(0x7f3a9806a570 msgr2=0x7f3a9806c300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:36.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.741+0000 7f3a9e85a640 1 -- 172.21.15.45:0/2065545127 shutdown_connections 2023-11-28T18:38:36.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.741+0000 7f3a9e85a640 1 -- 172.21.15.45:0/2065545127 wait complete. 2023-11-28T18:38:36.766 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-28T18:38:36.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.909+0000 7f4e8e817640 1 Processor -- start 2023-11-28T18:38:36.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.909+0000 7f4e8e817640 1 -- start start 2023-11-28T18:38:36.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.909+0000 7f4e8e817640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f4e8815d2f0 0x7f4e880d17f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:36.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.909+0000 7f4e8e817640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4e880d1d30 0x7f4e880cfc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:36.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.909+0000 7f4e8e817640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e880aff70 con 0x7f4e8815d6d0 2023-11-28T18:38:36.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.909+0000 7f4e8e817640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e880b0210 con 0x7f4e880d1d30 2023-11-28T18:38:36.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.909+0000 7f4e8e817640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e880b04f0 con 0x7f4e8815d2f0 2023-11-28T18:38:36.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.909+0000 7f4e877fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4e880d1d30 0x7f4e880cfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:36.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.909+0000 7f4e8cdb4640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f4e8815d6d0 0x7f4e880cddb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47908/0 (socket says 172.21.15.45:47908) 2023-11-28T18:38:36.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.909+0000 7f4e8cdb4640 1 -- 172.21.15.45:0/1782487100 learned_addr learned my addr 172.21.15.45:0/1782487100 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:38:36.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.909+0000 7f4e87fff640 1 --2- 172.21.15.45:0/1782487100 >> v2:172.21.15.190:3300/0 conn(0x7f4e8815d2f0 0x7f4e880d17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:36.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.909+0000 7f4e877fe640 1 -- 172.21.15.45:0/1782487100 >> v2:172.21.15.190:3300/0 conn(0x7f4e8815d2f0 msgr2=0x7f4e880d17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:36.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.909+0000 7f4e877fe640 1 --2- 172.21.15.45:0/1782487100 >> v2:172.21.15.190:3300/0 conn(0x7f4e8815d2f0 0x7f4e880d17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:36.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.909+0000 7f4e877fe640 1 -- 172.21.15.45:0/1782487100 >> v1:172.21.15.45:6789/0 conn(0x7f4e8815d6d0 legacy=0x7f4e880cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:36.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.909+0000 7f4e877fe640 1 -- 172.21.15.45:0/1782487100 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e880b07d0 con 0x7f4e880d1d30 2023-11-28T18:38:36.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.909+0000 7f4e86ffd640 1 -- 172.21.15.45:0/1782487100 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 782476064 0 0) 0x7f4e880aff70 con 0x7f4e8815d6d0 2023-11-28T18:38:36.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.909+0000 7f4e87fff640 1 --2- 172.21.15.45:0/1782487100 >> v2:172.21.15.190:3300/0 conn(0x7f4e8815d2f0 0x7f4e880d17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:38:36.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.913+0000 7f4e877fe640 1 --2- 172.21.15.45:0/1782487100 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e880d1d30 0x7f4e880cfc20 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4e8808bcf0 tx=0x7f4e7c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a915697ed55299e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:36.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.913+0000 7f4e86ffd640 1 -- 172.21.15.45:0/1782487100 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e7c0ab600 con 0x7f4e880d1d30 2023-11-28T18:38:36.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.913+0000 7f4e86ffd640 1 -- 172.21.15.45:0/1782487100 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e7c0ab760 con 0x7f4e880d1d30 2023-11-28T18:38:36.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.913+0000 7f4e86ffd640 1 -- 172.21.15.45:0/1782487100 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e7c0abaf0 con 0x7f4e880d1d30 2023-11-28T18:38:36.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.913+0000 7f4e8e817640 1 -- 172.21.15.45:0/1782487100 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e880d1d30 msgr2=0x7f4e880cfc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:36.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.913+0000 7f4e8e817640 1 --2- 172.21.15.45:0/1782487100 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e880d1d30 0x7f4e880cfc20 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4e8808bcf0 tx=0x7f4e7c01c460 comp rx=0 tx=0).stop 2023-11-28T18:38:36.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.913+0000 7f4e8e817640 1 -- 172.21.15.45:0/1782487100 shutdown_connections 2023-11-28T18:38:36.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.913+0000 7f4e8e817640 1 --2- 172.21.15.45:0/1782487100 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e880d1d30 0x7f4e880cfc20 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:36.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.913+0000 7f4e8e817640 1 --2- 172.21.15.45:0/1782487100 >> v2:172.21.15.190:3300/0 conn(0x7f4e8815d2f0 0x7f4e880d17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:36.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.913+0000 7f4e8e817640 1 -- 172.21.15.45:0/1782487100 >> 172.21.15.45:0/1782487100 conn(0x7f4e8809c550 msgr2=0x7f4e880d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:36.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.913+0000 7f4e8e817640 1 -- 172.21.15.45:0/1782487100 shutdown_connections 2023-11-28T18:38:36.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.913+0000 7f4e8e817640 1 -- 172.21.15.45:0/1782487100 wait complete. 2023-11-28T18:38:36.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.917+0000 7f4e8e817640 1 Processor -- start 2023-11-28T18:38:36.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.917+0000 7f4e8e817640 1 -- start start 2023-11-28T18:38:36.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.917+0000 7f4e8e817640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e880d1d30 0x7f4e8815b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:36.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.917+0000 7f4e8e817640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4e8815d2f0 0x7f4e88153250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:36.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.917+0000 7f4e8e817640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e8815d6d0 0x7f4e88153790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:36.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.917+0000 7f4e8e817640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e880cd250 con 0x7f4e880d1d30 2023-11-28T18:38:36.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.917+0000 7f4e8e817640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e88154d50 con 0x7f4e8815d2f0 2023-11-28T18:38:36.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.917+0000 7f4e8e817640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e88153e60 con 0x7f4e8815d6d0 2023-11-28T18:38:36.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.917+0000 7f4e87fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e880d1d30 0x7f4e8815b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:36.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.917+0000 7f4e87fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e880d1d30 0x7f4e8815b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60254/0 (socket says 172.21.15.45:60254) 2023-11-28T18:38:36.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.917+0000 7f4e87fff640 1 -- 172.21.15.45:0/509328243 learned_addr learned my addr 172.21.15.45:0/509328243 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:36.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.917+0000 7f4e877fe640 1 --2- 172.21.15.45:0/509328243 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4e8815d2f0 0x7f4e88153250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:36.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.917+0000 7f4e8cdb4640 1 --2- 172.21.15.45:0/509328243 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e8815d6d0 0x7f4e88153790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:36.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.917+0000 7f4e87fff640 1 -- 172.21.15.45:0/509328243 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e8815d6d0 msgr2=0x7f4e88153790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:36.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.917+0000 7f4e87fff640 1 --2- 172.21.15.45:0/509328243 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e8815d6d0 0x7f4e88153790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:36.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.917+0000 7f4e87fff640 1 -- 172.21.15.45:0/509328243 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4e8815d2f0 msgr2=0x7f4e88153250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:36.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.917+0000 7f4e87fff640 1 --2- 172.21.15.45:0/509328243 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4e8815d2f0 0x7f4e88153250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:36.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.917+0000 7f4e87fff640 1 -- 172.21.15.45:0/509328243 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e7c009420 con 0x7f4e880d1d30 2023-11-28T18:38:36.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.917+0000 7f4e87fff640 1 --2- 172.21.15.45:0/509328243 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e880d1d30 0x7f4e8815b320 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f4e7800e810 tx=0x7f4e7800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:36.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.917+0000 7f4e84ff9640 1 -- 172.21.15.45:0/509328243 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e7800c8d0 con 0x7f4e880d1d30 2023-11-28T18:38:36.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.917+0000 7f4e84ff9640 1 -- 172.21.15.45:0/509328243 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e7800ca30 con 0x7f4e880d1d30 2023-11-28T18:38:36.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.917+0000 7f4e84ff9640 1 -- 172.21.15.45:0/509328243 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e7800cdc0 con 0x7f4e880d1d30 2023-11-28T18:38:36.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.917+0000 7f4e8e817640 1 -- 172.21.15.45:0/509328243 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e88154140 con 0x7f4e880d1d30 2023-11-28T18:38:36.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.917+0000 7f4e8e817640 1 -- 172.21.15.45:0/509328243 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e88154700 con 0x7f4e880d1d30 2023-11-28T18:38:36.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.921+0000 7f4e8e817640 1 -- 172.21.15.45:0/509328243 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e88067a30 con 0x7f4e880d1d30 2023-11-28T18:38:36.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.921+0000 7f4e84ff9640 1 -- 172.21.15.45:0/509328243 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f4e78013410 con 0x7f4e880d1d30 2023-11-28T18:38:36.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.921+0000 7f4e84ff9640 1 --2- 172.21.15.45:0/509328243 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4e740668d0 0x7f4e74068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:36.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.921+0000 7f4e84ff9640 1 -- 172.21.15.45:0/509328243 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4e780842a0 con 0x7f4e880d1d30 2023-11-28T18:38:36.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.921+0000 7f4e877fe640 1 --2- 172.21.15.45:0/509328243 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4e740668d0 0x7f4e74068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:36.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.921+0000 7f4e877fe640 1 --2- 172.21.15.45:0/509328243 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4e740668d0 0x7f4e74068d90 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c0af000 tx=0x7f4e7c0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:36.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:36.925+0000 7f4e84ff9640 1 -- 172.21.15.45:0/509328243 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4e780514f0 con 0x7f4e880d1d30 2023-11-28T18:38:37.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:37.121+0000 7f4e8e817640 1 -- 172.21.15.45:0/509328243 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f4e88069410 con 0x7f4e880d1d30 2023-11-28T18:38:38.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.049+0000 7f4e84ff9640 1 -- 172.21.15.45:0/509328243 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7f4e78009480 con 0x7f4e880d1d30 2023-11-28T18:38:38.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.053+0000 7f4e8e817640 1 -- 172.21.15.45:0/509328243 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4e740668d0 msgr2=0x7f4e74068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:38.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.053+0000 7f4e8e817640 1 --2- 172.21.15.45:0/509328243 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4e740668d0 0x7f4e74068d90 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c0af000 tx=0x7f4e7c0a7000 comp rx=0 tx=0).stop 2023-11-28T18:38:38.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.053+0000 7f4e8e817640 1 -- 172.21.15.45:0/509328243 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e880d1d30 msgr2=0x7f4e8815b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:38.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.053+0000 7f4e8e817640 1 --2- 172.21.15.45:0/509328243 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e880d1d30 0x7f4e8815b320 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f4e7800e810 tx=0x7f4e7800ecd0 comp rx=0 tx=0).stop 2023-11-28T18:38:38.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.053+0000 7f4e8e817640 1 -- 172.21.15.45:0/509328243 shutdown_connections 2023-11-28T18:38:38.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.053+0000 7f4e8e817640 1 --2- 172.21.15.45:0/509328243 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4e740668d0 0x7f4e74068d90 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:38.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.053+0000 7f4e8e817640 1 --2- 172.21.15.45:0/509328243 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e8815d6d0 0x7f4e88153790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:38.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.053+0000 7f4e8e817640 1 --2- 172.21.15.45:0/509328243 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4e8815d2f0 0x7f4e88153250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:38.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.053+0000 7f4e8e817640 1 --2- 172.21.15.45:0/509328243 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e880d1d30 0x7f4e8815b320 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:38.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.053+0000 7f4e8e817640 1 -- 172.21.15.45:0/509328243 >> 172.21.15.45:0/509328243 conn(0x7f4e8809c550 msgr2=0x7f4e88159ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:38.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.053+0000 7f4e8e817640 1 -- 172.21.15.45:0/509328243 shutdown_connections 2023-11-28T18:38:38.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.053+0000 7f4e8e817640 1 -- 172.21.15.45:0/509328243 wait complete. 2023-11-28T18:38:38.080 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-28T18:38:38.080 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-28T18:38:38.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.225+0000 7fc2c859d640 1 Processor -- start 2023-11-28T18:38:38.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.229+0000 7fc2c859d640 1 -- start start 2023-11-28T18:38:38.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.229+0000 7fc2c859d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc2c01469a0 0x7fc2c006cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:38.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.229+0000 7fc2c859d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2c015fde0 0x7fc2c00b4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:38.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.229+0000 7fc2c859d640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2c015e940 con 0x7fc2c00b4070 2023-11-28T18:38:38.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.229+0000 7fc2c859d640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2c00b4a40 con 0x7fc2c01469a0 2023-11-28T18:38:38.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.229+0000 7fc2c859d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c015dd30 con 0x7fc2c015fde0 2023-11-28T18:38:38.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.229+0000 7fc2c6339640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc2c01469a0 0x7fc2c006cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:38.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.229+0000 7fc2c5b38640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fc2c00b4070 0x7fc2c006e8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33798/0 (socket says 172.21.15.45:33798) 2023-11-28T18:38:38.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.229+0000 7fc2c5b38640 1 -- 172.21.15.45:0/4284119421 learned_addr learned my addr 172.21.15.45:0/4284119421 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:38:38.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.229+0000 7fc2c6b3a640 1 --2- 172.21.15.45:0/4284119421 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2c015fde0 0x7fc2c00b4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:38.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.229+0000 7fc2c6339640 1 -- 172.21.15.45:0/4284119421 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2c015fde0 msgr2=0x7fc2c00b4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:38.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.229+0000 7fc2c6339640 1 --2- 172.21.15.45:0/4284119421 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2c015fde0 0x7fc2c00b4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:38.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.229+0000 7fc2c6339640 1 -- 172.21.15.45:0/4284119421 >> v1:172.21.15.45:6789/0 conn(0x7fc2c00b4070 legacy=0x7fc2c006e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:38.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.229+0000 7fc2c6339640 1 -- 172.21.15.45:0/4284119421 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2c015e010 con 0x7fc2c01469a0 2023-11-28T18:38:38.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.229+0000 7fc2c5337640 1 -- 172.21.15.45:0/4284119421 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3542802204 0 0) 0x7fc2c015e940 con 0x7fc2c00b4070 2023-11-28T18:38:38.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.233+0000 7fc2c6339640 1 --2- 172.21.15.45:0/4284119421 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2c01469a0 0x7fc2c006cab0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc0097c0 tx=0x7fc2bc01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8297410f2605ccd5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:38.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.233+0000 7fc2c5337640 1 -- 172.21.15.45:0/4284119421 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc0ab600 con 0x7fc2c01469a0 2023-11-28T18:38:38.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.233+0000 7fc2c5337640 1 -- 172.21.15.45:0/4284119421 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2bc0a7050 con 0x7fc2c01469a0 2023-11-28T18:38:38.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.233+0000 7fc2c5337640 1 -- 172.21.15.45:0/4284119421 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc0ab980 con 0x7fc2c01469a0 2023-11-28T18:38:38.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.233+0000 7fc2c859d640 1 -- 172.21.15.45:0/4284119421 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2c01469a0 msgr2=0x7fc2c006cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:38.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.233+0000 7fc2c859d640 1 --2- 172.21.15.45:0/4284119421 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2c01469a0 0x7fc2c006cab0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc0097c0 tx=0x7fc2bc01c480 comp rx=0 tx=0).stop 2023-11-28T18:38:38.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.233+0000 7fc2c859d640 1 -- 172.21.15.45:0/4284119421 shutdown_connections 2023-11-28T18:38:38.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.233+0000 7fc2c859d640 1 --2- 172.21.15.45:0/4284119421 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2c015fde0 0x7fc2c00b4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:38.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.233+0000 7fc2c859d640 1 --2- 172.21.15.45:0/4284119421 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2c01469a0 0x7fc2c006cab0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:38.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.233+0000 7fc2c859d640 1 -- 172.21.15.45:0/4284119421 >> 172.21.15.45:0/4284119421 conn(0x7fc2c0070b80 msgr2=0x7fc2c0066360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:38.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.233+0000 7fc2c859d640 1 -- 172.21.15.45:0/4284119421 shutdown_connections 2023-11-28T18:38:38.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.233+0000 7fc2c859d640 1 -- 172.21.15.45:0/4284119421 wait complete. 2023-11-28T18:38:38.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.233+0000 7fc2c859d640 1 Processor -- start 2023-11-28T18:38:38.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.233+0000 7fc2c859d640 1 -- start start 2023-11-28T18:38:38.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.237+0000 7fc2c859d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2c00b4070 0x7fc2c013e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:38.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.237+0000 7fc2c859d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2c01469a0 0x7fc2c0141100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:38.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.237+0000 7fc2c859d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2c015fde0 0x7fc2c0141640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:38.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.237+0000 7fc2c859d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c015bea0 con 0x7fc2c01469a0 2023-11-28T18:38:38.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.237+0000 7fc2c859d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c015c180 con 0x7fc2c00b4070 2023-11-28T18:38:38.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.237+0000 7fc2c859d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c015c460 con 0x7fc2c015fde0 2023-11-28T18:38:38.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.237+0000 7fc2c5b38640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2c01469a0 0x7fc2c0141100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:38.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.237+0000 7fc2c5b38640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2c01469a0 0x7fc2c0141100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58438/0 (socket says 172.21.15.45:58438) 2023-11-28T18:38:38.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.237+0000 7fc2c5b38640 1 -- 172.21.15.45:0/2346392968 learned_addr learned my addr 172.21.15.45:0/2346392968 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:38.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.237+0000 7fc2c6b3a640 1 --2- 172.21.15.45:0/2346392968 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2c015fde0 0x7fc2c0141640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:38.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.237+0000 7fc2c6339640 1 --2- 172.21.15.45:0/2346392968 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2c00b4070 0x7fc2c013e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:38.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.237+0000 7fc2c5b38640 1 -- 172.21.15.45:0/2346392968 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2c015fde0 msgr2=0x7fc2c0141640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:38.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.237+0000 7fc2c5b38640 1 --2- 172.21.15.45:0/2346392968 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2c015fde0 0x7fc2c0141640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:38.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.237+0000 7fc2c5b38640 1 -- 172.21.15.45:0/2346392968 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2c00b4070 msgr2=0x7fc2c013e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:38.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.237+0000 7fc2c5b38640 1 --2- 172.21.15.45:0/2346392968 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2c00b4070 0x7fc2c013e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:38.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.237+0000 7fc2c5b38640 1 -- 172.21.15.45:0/2346392968 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2bc009420 con 0x7fc2c01469a0 2023-11-28T18:38:38.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.237+0000 7fc2c6339640 1 --2- 172.21.15.45:0/2346392968 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2c00b4070 0x7fc2c013e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:38:38.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.237+0000 7fc2c6b3a640 1 --2- 172.21.15.45:0/2346392968 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2c015fde0 0x7fc2c0141640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:38:38.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.237+0000 7fc2c5b38640 1 --2- 172.21.15.45:0/2346392968 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2c01469a0 0x7fc2c0141100 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc2b000c480 tx=0x7fc2b000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:38.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.237+0000 7fc2b6ffd640 1 -- 172.21.15.45:0/2346392968 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b00074e0 con 0x7fc2c01469a0 2023-11-28T18:38:38.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.237+0000 7fc2b6ffd640 1 -- 172.21.15.45:0/2346392968 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2b0007660 con 0x7fc2c01469a0 2023-11-28T18:38:38.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.237+0000 7fc2b6ffd640 1 -- 172.21.15.45:0/2346392968 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b0004a30 con 0x7fc2c01469a0 2023-11-28T18:38:38.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.237+0000 7fc2c859d640 1 -- 172.21.15.45:0/2346392968 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2c015c740 con 0x7fc2c01469a0 2023-11-28T18:38:38.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.237+0000 7fc2c859d640 1 -- 172.21.15.45:0/2346392968 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2c015cf90 con 0x7fc2c01469a0 2023-11-28T18:38:38.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.237+0000 7fc2c859d640 1 -- 172.21.15.45:0/2346392968 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2c0163050 con 0x7fc2c01469a0 2023-11-28T18:38:38.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.241+0000 7fc2b6ffd640 1 -- 172.21.15.45:0/2346392968 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fc2b0004b90 con 0x7fc2c01469a0 2023-11-28T18:38:38.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.241+0000 7fc2b6ffd640 1 --2- 172.21.15.45:0/2346392968 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fc2a40668d0 0x7fc2a4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:38.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.241+0000 7fc2b6ffd640 1 -- 172.21.15.45:0/2346392968 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc2b00836d0 con 0x7fc2c01469a0 2023-11-28T18:38:38.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.241+0000 7fc2c6339640 1 --2- 172.21.15.45:0/2346392968 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fc2a40668d0 0x7fc2a4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:38.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.241+0000 7fc2c6339640 1 --2- 172.21.15.45:0/2346392968 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fc2a40668d0 0x7fc2a4068d90 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc0ad000 tx=0x7fc2bc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:38.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.245+0000 7fc2b6ffd640 1 -- 172.21.15.45:0/2346392968 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc2b0054300 con 0x7fc2c01469a0 2023-11-28T18:38:38.260 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-11-28T18:38:38.257+0000 7f79c9391640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T18:38:38.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:38.437+0000 7fc2c859d640 1 -- 172.21.15.45:0/2346392968 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fc2c0069410 con 0x7fc2c01469a0 2023-11-28T18:38:39.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.053+0000 7fc2b6ffd640 1 -- 172.21.15.45:0/2346392968 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc2b0053e90 con 0x7fc2c01469a0 2023-11-28T18:38:39.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.057+0000 7fc2c859d640 1 -- 172.21.15.45:0/2346392968 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fc2a40668d0 msgr2=0x7fc2a4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:39.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.057+0000 7fc2c859d640 1 --2- 172.21.15.45:0/2346392968 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fc2a40668d0 0x7fc2a4068d90 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc0ad000 tx=0x7fc2bc008040 comp rx=0 tx=0).stop 2023-11-28T18:38:39.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.057+0000 7fc2c859d640 1 -- 172.21.15.45:0/2346392968 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2c01469a0 msgr2=0x7fc2c0141100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:39.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.057+0000 7fc2c859d640 1 --2- 172.21.15.45:0/2346392968 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2c01469a0 0x7fc2c0141100 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc2b000c480 tx=0x7fc2b000c940 comp rx=0 tx=0).stop 2023-11-28T18:38:39.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.057+0000 7fc2c859d640 1 -- 172.21.15.45:0/2346392968 shutdown_connections 2023-11-28T18:38:39.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.057+0000 7fc2c859d640 1 --2- 172.21.15.45:0/2346392968 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fc2a40668d0 0x7fc2a4068d90 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:39.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.057+0000 7fc2c859d640 1 --2- 172.21.15.45:0/2346392968 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2c015fde0 0x7fc2c0141640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:39.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.057+0000 7fc2c859d640 1 --2- 172.21.15.45:0/2346392968 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2c01469a0 0x7fc2c0141100 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:39.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.057+0000 7fc2c859d640 1 --2- 172.21.15.45:0/2346392968 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2c00b4070 0x7fc2c013e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:39.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.057+0000 7fc2c859d640 1 -- 172.21.15.45:0/2346392968 >> 172.21.15.45:0/2346392968 conn(0x7fc2c0070b80 msgr2=0x7fc2c0145c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:39.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.057+0000 7fc2c859d640 1 -- 172.21.15.45:0/2346392968 shutdown_connections 2023-11-28T18:38:39.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.057+0000 7fc2c859d640 1 -- 172.21.15.45:0/2346392968 wait complete. 2023-11-28T18:38:39.083 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-28T18:38:39.084 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T18:38:39.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.229+0000 7f4dad65a640 1 Processor -- start 2023-11-28T18:38:39.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.229+0000 7f4dad65a640 1 -- start start 2023-11-28T18:38:39.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.229+0000 7f4dad65a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4da815e430 0x7f4da80b2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:39.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.229+0000 7f4dad65a640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4da8146fe0 con 0x7f4da80b30f0 2023-11-28T18:38:39.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.233+0000 7f4dad65a640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4da815e8b0 con 0x7f4da8146c00 2023-11-28T18:38:39.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.233+0000 7f4dad65a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4da80b3560 con 0x7f4da815e430 2023-11-28T18:38:39.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.233+0000 7f4d9ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4da815e430 0x7f4da80b2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:39.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.233+0000 7f4d9ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4da815e430 0x7f4da80b2bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58452/0 (socket says 172.21.15.45:58452) 2023-11-28T18:38:39.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.233+0000 7f4d9ffff640 1 -- 172.21.15.45:0/1617221751 learned_addr learned my addr 172.21.15.45:0/1617221751 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:39.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.233+0000 7f4da77fe640 1 --1- 172.21.15.45:0/1617221751 >> v1:172.21.15.45:6789/0 conn(0x7f4da80b30f0 0x7f4da8160f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33810/0 (socket says 172.21.15.45:33810) 2023-11-28T18:38:39.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.233+0000 7f4d9ffff640 1 -- 172.21.15.45:0/1617221751 >> v1:172.21.15.190:6789/0 conn(0x7f4da8146c00 legacy=0x7f4da806e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:39.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.233+0000 7f4d9ffff640 1 -- 172.21.15.45:0/1617221751 >> v1:172.21.15.45:6789/0 conn(0x7f4da80b30f0 legacy=0x7f4da8160f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:39.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.233+0000 7f4d9ffff640 1 -- 172.21.15.45:0/1617221751 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4da806f390 con 0x7f4da815e430 2023-11-28T18:38:39.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.233+0000 7f4d9ffff640 1 --2- 172.21.15.45:0/1617221751 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4da815e430 0x7f4da80b2bb0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f4d90009870 tx=0x7f4d9001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1c6927e805fd79c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:39.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.233+0000 7f4da67fc640 1 -- 172.21.15.45:0/1617221751 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d900aa670 con 0x7f4da815e430 2023-11-28T18:38:39.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.233+0000 7f4da67fc640 1 -- 172.21.15.45:0/1617221751 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d900aa7d0 con 0x7f4da815e430 2023-11-28T18:38:39.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.233+0000 7f4da67fc640 1 -- 172.21.15.45:0/1617221751 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d900aab60 con 0x7f4da815e430 2023-11-28T18:38:39.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.237+0000 7f4dad65a640 1 -- 172.21.15.45:0/1617221751 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4da815e430 msgr2=0x7f4da80b2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:39.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.237+0000 7f4dad65a640 1 --2- 172.21.15.45:0/1617221751 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4da815e430 0x7f4da80b2bb0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f4d90009870 tx=0x7f4d9001c510 comp rx=0 tx=0).stop 2023-11-28T18:38:39.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.237+0000 7f4dad65a640 1 -- 172.21.15.45:0/1617221751 shutdown_connections 2023-11-28T18:38:39.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.237+0000 7f4dad65a640 1 --2- 172.21.15.45:0/1617221751 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4da815e430 0x7f4da80b2bb0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:39.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.237+0000 7f4dad65a640 1 -- 172.21.15.45:0/1617221751 >> 172.21.15.45:0/1617221751 conn(0x7f4da806a570 msgr2=0x7f4da806a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:39.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.237+0000 7f4dad65a640 1 -- 172.21.15.45:0/1617221751 shutdown_connections 2023-11-28T18:38:39.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.237+0000 7f4dad65a640 1 -- 172.21.15.45:0/1617221751 wait complete. 2023-11-28T18:38:39.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.237+0000 7f4dad65a640 1 Processor -- start 2023-11-28T18:38:39.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.237+0000 7f4dad65a640 1 -- start start 2023-11-28T18:38:39.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.237+0000 7f4dad65a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4da80b30f0 0x7f4da8140750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:39.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.237+0000 7f4dad65a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4da8146c00 0x7f4da815c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:39.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.237+0000 7f4dad65a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4da815e430 0x7f4da80b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:39.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.237+0000 7f4dad65a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da8140fa0 con 0x7f4da815e430 2023-11-28T18:38:39.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.237+0000 7f4dad65a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da8141280 con 0x7f4da80b30f0 2023-11-28T18:38:39.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.237+0000 7f4dad65a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4da8141560 con 0x7f4da8146c00 2023-11-28T18:38:39.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.237+0000 7f4da77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4da815e430 0x7f4da80b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:39.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.237+0000 7f4da77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4da815e430 0x7f4da80b4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58456/0 (socket says 172.21.15.45:58456) 2023-11-28T18:38:39.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.237+0000 7f4da77fe640 1 -- 172.21.15.45:0/137952817 learned_addr learned my addr 172.21.15.45:0/137952817 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:39.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.241+0000 7f4d9ffff640 1 --2- 172.21.15.45:0/137952817 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4da8146c00 0x7f4da815c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:39.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.241+0000 7f4da6ffd640 1 --2- 172.21.15.45:0/137952817 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4da80b30f0 0x7f4da8140750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:39.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.241+0000 7f4da77fe640 1 -- 172.21.15.45:0/137952817 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4da8146c00 msgr2=0x7f4da815c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:39.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.241+0000 7f4da77fe640 1 --2- 172.21.15.45:0/137952817 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4da8146c00 0x7f4da815c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:39.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.241+0000 7f4da77fe640 1 -- 172.21.15.45:0/137952817 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4da80b30f0 msgr2=0x7f4da8140750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:39.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.241+0000 7f4da77fe640 1 --2- 172.21.15.45:0/137952817 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4da80b30f0 0x7f4da8140750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:39.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.241+0000 7f4da77fe640 1 -- 172.21.15.45:0/137952817 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d900094d0 con 0x7f4da815e430 2023-11-28T18:38:39.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.241+0000 7f4da6ffd640 1 --2- 172.21.15.45:0/137952817 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4da80b30f0 0x7f4da8140750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:38:39.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.241+0000 7f4da77fe640 1 --2- 172.21.15.45:0/137952817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4da815e430 0x7f4da80b4cc0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f4da000c700 tx=0x7f4da000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:39.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.241+0000 7f4d9f7fe640 1 -- 172.21.15.45:0/137952817 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da000ce10 con 0x7f4da815e430 2023-11-28T18:38:39.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.241+0000 7f4d9f7fe640 1 -- 172.21.15.45:0/137952817 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4da000a640 con 0x7f4da815e430 2023-11-28T18:38:39.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.241+0000 7f4d9f7fe640 1 -- 172.21.15.45:0/137952817 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da000a9b0 con 0x7f4da815e430 2023-11-28T18:38:39.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.241+0000 7f4dad65a640 1 -- 172.21.15.45:0/137952817 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4da8141840 con 0x7f4da815e430 2023-11-28T18:38:39.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.241+0000 7f4dad65a640 1 -- 172.21.15.45:0/137952817 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4da8140c90 con 0x7f4da815e430 2023-11-28T18:38:39.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.241+0000 7f4dad65a640 1 -- 172.21.15.45:0/137952817 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4da8069480 con 0x7f4da815e430 2023-11-28T18:38:39.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.241+0000 7f4d9f7fe640 1 -- 172.21.15.45:0/137952817 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f4da000ab10 con 0x7f4da815e430 2023-11-28T18:38:39.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.241+0000 7f4d9f7fe640 1 --2- 172.21.15.45:0/137952817 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4d880668d0 0x7f4d88068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:39.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.241+0000 7f4d9f7fe640 1 -- 172.21.15.45:0/137952817 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4da0083b70 con 0x7f4da815e430 2023-11-28T18:38:39.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.245+0000 7f4da6ffd640 1 --2- 172.21.15.45:0/137952817 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4d880668d0 0x7f4d88068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:39.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.245+0000 7f4da6ffd640 1 --2- 172.21.15.45:0/137952817 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4d880668d0 0x7f4d88068d90 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4d98000f70 tx=0x7f4d98009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:39.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.245+0000 7f4d9f7fe640 1 -- 172.21.15.45:0/137952817 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4da0050dc0 con 0x7f4da815e430 2023-11-28T18:38:39.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.441+0000 7f4dad65a640 1 -- 172.21.15.45:0/137952817 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4da80cacd0 con 0x7f4da815e430 2023-11-28T18:38:39.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.441+0000 7f4d9f7fe640 1 -- 172.21.15.45:0/137952817 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4916 (secure 0 0 0) 0x7f4da0017020 con 0x7f4da815e430 2023-11-28T18:38:39.446 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:38:39.446 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5188,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/270858280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":270858280},{"type":"v1","addr":"172.21.15.190:6836","nonce":270858280}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5191,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/4006352118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":4006352118},{"type":"v1","addr":"172.21.15.190:6837","nonce":4006352118}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5197,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2204012451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":2204012451},{"type":"v1","addr":"172.21.15.45:6835","nonce":2204012451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T18:38:35.406884+0000","modified":"2023-11-28T18:38:38.439497+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5253},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5253":{"gid":5253,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.45:6834/2398964901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2398964901},{"type":"v1","addr":"172.21.15.45:6834","nonce":2398964901}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-28T18:38:39.448 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 16 2023-11-28T18:38:39.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.445+0000 7f4dad65a640 1 -- 172.21.15.45:0/137952817 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4d880668d0 msgr2=0x7f4d88068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:39.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.445+0000 7f4dad65a640 1 --2- 172.21.15.45:0/137952817 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4d880668d0 0x7f4d88068d90 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4d98000f70 tx=0x7f4d98009040 comp rx=0 tx=0).stop 2023-11-28T18:38:39.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.445+0000 7f4dad65a640 1 -- 172.21.15.45:0/137952817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4da815e430 msgr2=0x7f4da80b4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:39.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.445+0000 7f4dad65a640 1 --2- 172.21.15.45:0/137952817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4da815e430 0x7f4da80b4cc0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f4da000c700 tx=0x7f4da000cbc0 comp rx=0 tx=0).stop 2023-11-28T18:38:39.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.445+0000 7f4dad65a640 1 -- 172.21.15.45:0/137952817 shutdown_connections 2023-11-28T18:38:39.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.445+0000 7f4dad65a640 1 --2- 172.21.15.45:0/137952817 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4d880668d0 0x7f4d88068d90 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:39.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.445+0000 7f4dad65a640 1 --2- 172.21.15.45:0/137952817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4da815e430 0x7f4da80b4cc0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:39.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.445+0000 7f4dad65a640 1 --2- 172.21.15.45:0/137952817 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4da8146c00 0x7f4da815c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:39.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.445+0000 7f4dad65a640 1 --2- 172.21.15.45:0/137952817 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4da80b30f0 0x7f4da8140750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:39.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.445+0000 7f4dad65a640 1 -- 172.21.15.45:0/137952817 >> 172.21.15.45:0/137952817 conn(0x7f4da806a570 msgr2=0x7f4da806e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:39.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.445+0000 7f4dad65a640 1 -- 172.21.15.45:0/137952817 shutdown_connections 2023-11-28T18:38:39.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.445+0000 7f4dad65a640 1 -- 172.21.15.45:0/137952817 wait complete. 2023-11-28T18:38:39.467 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T18:38:39.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.605+0000 7f5634365640 1 Processor -- start 2023-11-28T18:38:39.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.605+0000 7f5634365640 1 -- start start 2023-11-28T18:38:39.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.609+0000 7f5634365640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f562c144880 0x7f562c06c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:39.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.609+0000 7f5634365640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f562c0721c0 0x7f562c06c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:39.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.609+0000 7f5634365640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f562c0704a0 0x7f562c070920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:39.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.609+0000 7f5634365640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f562c15f050 con 0x7f562c0721c0 2023-11-28T18:38:39.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.609+0000 7f5634365640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f562c070e60 con 0x7f562c0704a0 2023-11-28T18:38:39.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.609+0000 7f5634365640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f562c071120 con 0x7f562c144880 2023-11-28T18:38:39.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.609+0000 7f5631900640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f562c0721c0 0x7f562c06c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:39.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.609+0000 7f5631900640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f562c0721c0 0x7f562c06c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58458/0 (socket says 172.21.15.45:58458) 2023-11-28T18:38:39.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.609+0000 7f5631900640 1 -- 172.21.15.45:0/3275800254 learned_addr learned my addr 172.21.15.45:0/3275800254 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:39.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.609+0000 7f5632902640 1 --2- 172.21.15.45:0/3275800254 >> v2:172.21.15.190:3300/0 conn(0x7f562c0704a0 0x7f562c070920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:39.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.609+0000 7f5632101640 1 --2- 172.21.15.45:0/3275800254 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f562c144880 0x7f562c06c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:39.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.609+0000 7f5631900640 1 -- 172.21.15.45:0/3275800254 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f562c144880 msgr2=0x7f562c06c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:39.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.609+0000 7f5631900640 1 --2- 172.21.15.45:0/3275800254 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f562c144880 0x7f562c06c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:39.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.609+0000 7f5631900640 1 -- 172.21.15.45:0/3275800254 >> v2:172.21.15.190:3300/0 conn(0x7f562c0704a0 msgr2=0x7f562c070920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:39.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.609+0000 7f5631900640 1 --2- 172.21.15.45:0/3275800254 >> v2:172.21.15.190:3300/0 conn(0x7f562c0704a0 0x7f562c070920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:39.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.609+0000 7f5631900640 1 -- 172.21.15.45:0/3275800254 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f562c071400 con 0x7f562c0721c0 2023-11-28T18:38:39.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.609+0000 7f5632101640 1 --2- 172.21.15.45:0/3275800254 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f562c144880 0x7f562c06c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:38:39.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.613+0000 7f5631900640 1 --2- 172.21.15.45:0/3275800254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f562c0721c0 0x7f562c06c840 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f562c15ebf0 tx=0x7f561c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c744a3af399d3a79 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:39.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.613+0000 7f56310ff640 1 -- 172.21.15.45:0/3275800254 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f561c0aa5f0 con 0x7f562c0721c0 2023-11-28T18:38:39.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.613+0000 7f56310ff640 1 -- 172.21.15.45:0/3275800254 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f561c0aa750 con 0x7f562c0721c0 2023-11-28T18:38:39.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.613+0000 7f56310ff640 1 -- 172.21.15.45:0/3275800254 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f561c0aaae0 con 0x7f562c0721c0 2023-11-28T18:38:39.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.613+0000 7f5634365640 1 -- 172.21.15.45:0/3275800254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f562c0721c0 msgr2=0x7f562c06c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:39.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.613+0000 7f5634365640 1 --2- 172.21.15.45:0/3275800254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f562c0721c0 0x7f562c06c840 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f562c15ebf0 tx=0x7f561c01c4d0 comp rx=0 tx=0).stop 2023-11-28T18:38:39.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.613+0000 7f5634365640 1 -- 172.21.15.45:0/3275800254 shutdown_connections 2023-11-28T18:38:39.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.613+0000 7f5634365640 1 --2- 172.21.15.45:0/3275800254 >> v2:172.21.15.190:3300/0 conn(0x7f562c0704a0 0x7f562c070920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:39.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.613+0000 7f5634365640 1 --2- 172.21.15.45:0/3275800254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f562c0721c0 0x7f562c06c840 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:39.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.613+0000 7f5634365640 1 --2- 172.21.15.45:0/3275800254 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f562c144880 0x7f562c06c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:39.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.613+0000 7f5634365640 1 -- 172.21.15.45:0/3275800254 >> 172.21.15.45:0/3275800254 conn(0x7f562c06a570 msgr2=0x7f562c06a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:39.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.613+0000 7f5634365640 1 -- 172.21.15.45:0/3275800254 shutdown_connections 2023-11-28T18:38:39.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.613+0000 7f5634365640 1 -- 172.21.15.45:0/3275800254 wait complete. 2023-11-28T18:38:39.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.613+0000 7f5634365640 1 Processor -- start 2023-11-28T18:38:39.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.613+0000 7f5634365640 1 -- start start 2023-11-28T18:38:39.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.617+0000 7f5634365640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f562c0704a0 0x7f562c157540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:39.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.617+0000 7f5634365640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f562c0721c0 0x7f562c1f6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:39.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.617+0000 7f5634365640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f562c144880 0x7f562c1f71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:39.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.617+0000 7f5634365640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f562c13f170 con 0x7f562c0721c0 2023-11-28T18:38:39.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.617+0000 7f5634365640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f562c139720 con 0x7f562c0704a0 2023-11-28T18:38:39.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.617+0000 7f5634365640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f562c139a00 con 0x7f562c144880 2023-11-28T18:38:39.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.617+0000 7f5631900640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f562c0721c0 0x7f562c1f6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:39.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.617+0000 7f5631900640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f562c0721c0 0x7f562c1f6c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58472/0 (socket says 172.21.15.45:58472) 2023-11-28T18:38:39.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.617+0000 7f5631900640 1 -- 172.21.15.45:0/77656983 learned_addr learned my addr 172.21.15.45:0/77656983 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:39.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.617+0000 7f5632101640 1 --2- 172.21.15.45:0/77656983 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f562c0704a0 0x7f562c157540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:39.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.617+0000 7f5632902640 1 --2- 172.21.15.45:0/77656983 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f562c144880 0x7f562c1f71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:39.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.617+0000 7f5631900640 1 -- 172.21.15.45:0/77656983 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f562c144880 msgr2=0x7f562c1f71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:39.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.617+0000 7f5631900640 1 --2- 172.21.15.45:0/77656983 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f562c144880 0x7f562c1f71c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:39.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.617+0000 7f5631900640 1 -- 172.21.15.45:0/77656983 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f562c0704a0 msgr2=0x7f562c157540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:39.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.617+0000 7f5631900640 1 --2- 172.21.15.45:0/77656983 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f562c0704a0 0x7f562c157540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:39.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.617+0000 7f5631900640 1 -- 172.21.15.45:0/77656983 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f561c0094d0 con 0x7f562c0721c0 2023-11-28T18:38:39.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.617+0000 7f5631900640 1 --2- 172.21.15.45:0/77656983 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f562c0721c0 0x7f562c1f6c80 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f561c01ab80 tx=0x7f561c01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:39.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.617+0000 7f5622ffd640 1 -- 172.21.15.45:0/77656983 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f561c0bd5f0 con 0x7f562c0721c0 2023-11-28T18:38:39.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.617+0000 7f5622ffd640 1 -- 172.21.15.45:0/77656983 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f561c0bd750 con 0x7f562c0721c0 2023-11-28T18:38:39.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.617+0000 7f5622ffd640 1 -- 172.21.15.45:0/77656983 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f561c0bdb00 con 0x7f562c0721c0 2023-11-28T18:38:39.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.617+0000 7f5634365640 1 -- 172.21.15.45:0/77656983 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f562c13eb20 con 0x7f562c0721c0 2023-11-28T18:38:39.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.617+0000 7f5634365640 1 -- 172.21.15.45:0/77656983 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f562c157a80 con 0x7f562c0721c0 2023-11-28T18:38:39.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.617+0000 7f5634365640 1 -- 172.21.15.45:0/77656983 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f562c069480 con 0x7f562c0721c0 2023-11-28T18:38:39.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.617+0000 7f5622ffd640 1 -- 172.21.15.45:0/77656983 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f561c0b33f0 con 0x7f562c0721c0 2023-11-28T18:38:39.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.621+0000 7f5622ffd640 1 --2- 172.21.15.45:0/77656983 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f56100668d0 0x7f5610068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:39.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.621+0000 7f5622ffd640 1 -- 172.21.15.45:0/77656983 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f561c0a7070 con 0x7f562c0721c0 2023-11-28T18:38:39.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.621+0000 7f5632101640 1 --2- 172.21.15.45:0/77656983 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f56100668d0 0x7f5610068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:39.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.621+0000 7f5632101640 1 --2- 172.21.15.45:0/77656983 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f56100668d0 0x7f5610068d90 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5628006e90 tx=0x7f5628008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:39.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.625+0000 7f5622ffd640 1 -- 172.21.15.45:0/77656983 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f561c0ec290 con 0x7f562c0721c0 2023-11-28T18:38:39.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.781+0000 7f5634365640 1 -- 172.21.15.45:0/77656983 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f562c06d1b0 con 0x7f562c0721c0 2023-11-28T18:38:39.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.781+0000 7f5622ffd640 1 -- 172.21.15.45:0/77656983 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16533 (secure 0 0 0) 0x7f561c0ef8b0 con 0x7f562c0721c0 2023-11-28T18:38:39.785 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:38:39.785 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":34,"fsid":"d10f5cd6-1d00-4019-99b6-6fa435498a15","created":"2023-11-28T18:37:08.189030+0000","modified":"2023-11-28T18:38:37.036797+0000","last_up_change":"2023-11-28T18:37:20.196124+0000","last_in_change":"2023-11-28T18:37:10.742043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T18:37:21.293917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-28T18:38:33.254037+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-28T18:38:34.414654+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"84465384-103c-4f2c-a45a-96f5bb9c835f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6809","nonce":555237322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6811","nonce":555237322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6815","nonce":555237322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6813","nonce":555237322}]},"public_addr":"172.21.15.45:6809/555237322","cluster_addr":"172.21.15.45:6811/555237322","heartbeat_back_addr":"172.21.15.45:6815/555237322","heartbeat_front_addr":"172.21.15.45:6813/555237322","state":["exists","up"]},{"osd":1,"uuid":"7d9eed24-a58f-42c7-a787-ac06be8553fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6801","nonce":2857063763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6803","nonce":2857063763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6807","nonce":2857063763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6805","nonce":2857063763}]},"public_addr":"172.21.15.45:6801/2857063763","cluster_addr":"172.21.15.45:6803/2857063763","heartbeat_back_addr":"172.21.15.45:6807/2857063763","heartbeat_front_addr":"172.21.15.45:6805/2857063763","state":["exists","up"]},{"osd":2,"uuid":"575eeccc-4abf-45b4-9caf-f3e797859588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6817","nonce":193884539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6819","nonce":193884539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6823","nonce":193884539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6821","nonce":193884539}]},"public_addr":"172.21.15.45:6817/193884539","cluster_addr":"172.21.15.45:6819/193884539","heartbeat_back_addr":"172.21.15.45:6823/193884539","heartbeat_front_addr":"172.21.15.45:6821/193884539","state":["exists","up"]},{"osd":3,"uuid":"9b0290d6-9a52-4bc8-b2a1-7622c5dc8e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6825","nonce":78541084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6827","nonce":78541084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6831","nonce":78541084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6829","nonce":78541084}]},"public_addr":"172.21.15.45:6825/78541084","cluster_addr":"172.21.15.45:6827/78541084","heartbeat_back_addr":"172.21.15.45:6831/78541084","heartbeat_front_addr":"172.21.15.45:6829/78541084","state":["exists","up"]},{"osd":4,"uuid":"ce632829-f027-4fbf-a627-02c571aa9d53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6809","nonce":1537591987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6811","nonce":1537591987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6815","nonce":1537591987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6813","nonce":1537591987}]},"public_addr":"172.21.15.190:6809/1537591987","cluster_addr":"172.21.15.190:6811/1537591987","heartbeat_back_addr":"172.21.15.190:6815/1537591987","heartbeat_front_addr":"172.21.15.190:6813/1537591987","state":["exists","up"]},{"osd":5,"uuid":"8700b609-27be-40bd-a251-4c0ae0a29ead","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6801","nonce":3296698407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6803","nonce":3296698407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6807","nonce":3296698407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6805","nonce":3296698407}]},"public_addr":"172.21.15.190:6801/3296698407","cluster_addr":"172.21.15.190:6803/3296698407","heartbeat_back_addr":"172.21.15.190:6807/3296698407","heartbeat_front_addr":"172.21.15.190:6805/3296698407","state":["exists","up"]},{"osd":6,"uuid":"44ce4a40-e6ff-4f4d-8e8a-7341e5c91f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6817","nonce":2317686718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6819","nonce":2317686718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6823","nonce":2317686718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6821","nonce":2317686718}]},"public_addr":"172.21.15.190:6817/2317686718","cluster_addr":"172.21.15.190:6819/2317686718","heartbeat_back_addr":"172.21.15.190:6823/2317686718","heartbeat_front_addr":"172.21.15.190:6821/2317686718","state":["exists","up"]},{"osd":7,"uuid":"192238c9-1423-4b7e-ac8f-84ba32113ddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6825","nonce":2493232051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6827","nonce":2493232051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6831","nonce":2493232051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6829","nonce":2493232051}]},"public_addr":"172.21.15.190:6825/2493232051","cluster_addr":"172.21.15.190:6827/2493232051","heartbeat_back_addr":"172.21.15.190:6831/2493232051","heartbeat_front_addr":"172.21.15.190:6829/2493232051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.393552+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.385453+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.361421+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.366408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.363226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.276007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.414605+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.445885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T18:38:39.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.781+0000 7f5634365640 1 -- 172.21.15.45:0/77656983 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f56100668d0 msgr2=0x7f5610068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:39.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.781+0000 7f5634365640 1 --2- 172.21.15.45:0/77656983 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f56100668d0 0x7f5610068d90 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5628006e90 tx=0x7f5628008040 comp rx=0 tx=0).stop 2023-11-28T18:38:39.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.781+0000 7f5634365640 1 -- 172.21.15.45:0/77656983 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f562c0721c0 msgr2=0x7f562c1f6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:39.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.781+0000 7f5634365640 1 --2- 172.21.15.45:0/77656983 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f562c0721c0 0x7f562c1f6c80 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f561c01ab80 tx=0x7f561c01ad10 comp rx=0 tx=0).stop 2023-11-28T18:38:39.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.785+0000 7f5634365640 1 -- 172.21.15.45:0/77656983 shutdown_connections 2023-11-28T18:38:39.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.785+0000 7f5634365640 1 --2- 172.21.15.45:0/77656983 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f56100668d0 0x7f5610068d90 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:39.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.785+0000 7f5634365640 1 --2- 172.21.15.45:0/77656983 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f562c144880 0x7f562c1f71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:39.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.785+0000 7f5634365640 1 --2- 172.21.15.45:0/77656983 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f562c0721c0 0x7f562c1f6c80 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:39.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.785+0000 7f5634365640 1 --2- 172.21.15.45:0/77656983 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f562c0704a0 0x7f562c157540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:39.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.785+0000 7f5634365640 1 -- 172.21.15.45:0/77656983 >> 172.21.15.45:0/77656983 conn(0x7f562c06a570 msgr2=0x7f562c15d790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:39.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.785+0000 7f5634365640 1 -- 172.21.15.45:0/77656983 shutdown_connections 2023-11-28T18:38:39.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.785+0000 7f5634365640 1 -- 172.21.15.45:0/77656983 wait complete. 2023-11-28T18:38:39.807 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-28T18:38:39.807 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T18:38:39.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.949+0000 7fef35c54640 1 Processor -- start 2023-11-28T18:38:39.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.949+0000 7fef35c54640 1 -- start start 2023-11-28T18:38:39.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.949+0000 7fef35c54640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fef300d2be0 0x7fef300cde30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:39.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.949+0000 7fef35c54640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef300b2a30 con 0x7fef300ce370 2023-11-28T18:38:39.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.949+0000 7fef35c54640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef300d18b0 con 0x7fef3015d240 2023-11-28T18:38:39.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.949+0000 7fef35c54640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef300d3020 con 0x7fef300d2be0 2023-11-28T18:38:39.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.949+0000 7fef2ffff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fef300ce370 0x7fef300b61d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33828/0 (socket says 172.21.15.45:33828) 2023-11-28T18:38:39.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.949+0000 7fef2ffff640 1 -- 172.21.15.45:0/649581036 learned_addr learned my addr 172.21.15.45:0/649581036 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:38:39.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.949+0000 7fef2effd640 1 --2- 172.21.15.45:0/649581036 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fef300d2be0 0x7fef300cde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:39.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.949+0000 7fef2e7fc640 1 -- 172.21.15.45:0/649581036 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1516943063 0 0) 0x7fef300b2a30 con 0x7fef300ce370 2023-11-28T18:38:39.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.949+0000 7fef2e7fc640 1 -- 172.21.15.45:0/649581036 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef18003530 con 0x7fef300ce370 2023-11-28T18:38:39.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.949+0000 7fef2e7fc640 1 -- 172.21.15.45:0/649581036 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 416174877 0 0) 0x7fef300d18b0 con 0x7fef3015d240 2023-11-28T18:38:39.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.949+0000 7fef2effd640 1 -- 172.21.15.45:0/649581036 >> v1:172.21.15.190:6789/0 conn(0x7fef3015d240 legacy=0x7fef300d11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:39.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.949+0000 7fef2effd640 1 -- 172.21.15.45:0/649581036 >> v1:172.21.15.45:6789/0 conn(0x7fef300ce370 legacy=0x7fef300b61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:39.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.949+0000 7fef2effd640 1 -- 172.21.15.45:0/649581036 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef300ce7e0 con 0x7fef300d2be0 2023-11-28T18:38:39.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.953+0000 7fef2effd640 1 --2- 172.21.15.45:0/649581036 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fef300d2be0 0x7fef300cde30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fef240097f0 tx=0x7fef2401ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2165a78aac53851 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:39.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.953+0000 7fef2e7fc640 1 -- 172.21.15.45:0/649581036 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef240a89b0 con 0x7fef300d2be0 2023-11-28T18:38:39.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.953+0000 7fef2e7fc640 1 -- 172.21.15.45:0/649581036 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef240a8b10 con 0x7fef300d2be0 2023-11-28T18:38:39.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.953+0000 7fef2e7fc640 1 -- 172.21.15.45:0/649581036 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef240a8ea0 con 0x7fef300d2be0 2023-11-28T18:38:39.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.953+0000 7fef35c54640 1 -- 172.21.15.45:0/649581036 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fef300d2be0 msgr2=0x7fef300cde30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:39.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.953+0000 7fef35c54640 1 --2- 172.21.15.45:0/649581036 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fef300d2be0 0x7fef300cde30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fef240097f0 tx=0x7fef2401ecb0 comp rx=0 tx=0).stop 2023-11-28T18:38:39.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.957+0000 7fef35c54640 1 -- 172.21.15.45:0/649581036 shutdown_connections 2023-11-28T18:38:39.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.957+0000 7fef35c54640 1 --2- 172.21.15.45:0/649581036 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fef300d2be0 0x7fef300cde30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:39.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.957+0000 7fef35c54640 1 -- 172.21.15.45:0/649581036 >> 172.21.15.45:0/649581036 conn(0x7fef300722a0 msgr2=0x7fef300cfbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:39.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.957+0000 7fef35c54640 1 -- 172.21.15.45:0/649581036 shutdown_connections 2023-11-28T18:38:39.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.957+0000 7fef35c54640 1 -- 172.21.15.45:0/649581036 wait complete. 2023-11-28T18:38:39.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.957+0000 7fef35c54640 1 Processor -- start 2023-11-28T18:38:39.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.957+0000 7fef35c54640 1 -- start start 2023-11-28T18:38:39.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.957+0000 7fef35c54640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef300ce370 0x7fef3015b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:39.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.957+0000 7fef35c54640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef300d2be0 0x7fef3015ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:39.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.957+0000 7fef35c54640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fef3015d240 0x7fef300cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:39.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.957+0000 7fef35c54640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef301e97f0 con 0x7fef300d2be0 2023-11-28T18:38:39.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.957+0000 7fef35c54640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef3015ee10 con 0x7fef300ce370 2023-11-28T18:38:39.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.957+0000 7fef35c54640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef3015e1d0 con 0x7fef3015d240 2023-11-28T18:38:39.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.957+0000 7fef2effd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef300d2be0 0x7fef3015ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:39.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.957+0000 7fef2effd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef300d2be0 0x7fef3015ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58474/0 (socket says 172.21.15.45:58474) 2023-11-28T18:38:39.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.957+0000 7fef2effd640 1 -- 172.21.15.45:0/1046582242 learned_addr learned my addr 172.21.15.45:0/1046582242 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:39.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.957+0000 7fef2f7fe640 1 --2- 172.21.15.45:0/1046582242 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef300ce370 0x7fef3015b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:39.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.957+0000 7fef2ffff640 1 --2- 172.21.15.45:0/1046582242 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fef3015d240 0x7fef300cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:39.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.957+0000 7fef2effd640 1 -- 172.21.15.45:0/1046582242 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fef3015d240 msgr2=0x7fef300cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:39.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.957+0000 7fef2effd640 1 --2- 172.21.15.45:0/1046582242 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fef3015d240 0x7fef300cbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:39.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.957+0000 7fef2effd640 1 -- 172.21.15.45:0/1046582242 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef300ce370 msgr2=0x7fef3015b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:39.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.957+0000 7fef2effd640 1 --2- 172.21.15.45:0/1046582242 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef300ce370 0x7fef3015b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:39.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.957+0000 7fef2effd640 1 -- 172.21.15.45:0/1046582242 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef24009420 con 0x7fef300d2be0 2023-11-28T18:38:39.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.957+0000 7fef2effd640 1 --2- 172.21.15.45:0/1046582242 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef300d2be0 0x7fef3015ff20 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fef240097f0 tx=0x7fef2401ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:39.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.961+0000 7fef17fff640 1 -- 172.21.15.45:0/1046582242 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef240bf070 con 0x7fef300d2be0 2023-11-28T18:38:39.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.961+0000 7fef17fff640 1 -- 172.21.15.45:0/1046582242 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef240b0bf0 con 0x7fef300d2be0 2023-11-28T18:38:39.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.961+0000 7fef17fff640 1 -- 172.21.15.45:0/1046582242 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef240b9410 con 0x7fef300d2be0 2023-11-28T18:38:39.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.961+0000 7fef35c54640 1 -- 172.21.15.45:0/1046582242 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef3015e470 con 0x7fef300d2be0 2023-11-28T18:38:39.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.961+0000 7fef35c54640 1 -- 172.21.15.45:0/1046582242 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef3015ea30 con 0x7fef300d2be0 2023-11-28T18:38:39.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.961+0000 7fef35c54640 1 -- 172.21.15.45:0/1046582242 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef3015ef50 con 0x7fef300d2be0 2023-11-28T18:38:39.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.961+0000 7fef17fff640 1 -- 172.21.15.45:0/1046582242 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fef240b7040 con 0x7fef300d2be0 2023-11-28T18:38:39.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.961+0000 7fef17fff640 1 --2- 172.21.15.45:0/1046582242 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fef1c0668d0 0x7fef1c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:39.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.961+0000 7fef17fff640 1 -- 172.21.15.45:0/1046582242 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fef24121820 con 0x7fef300d2be0 2023-11-28T18:38:39.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.961+0000 7fef2f7fe640 1 --2- 172.21.15.45:0/1046582242 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fef1c0668d0 0x7fef1c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:39.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.965+0000 7fef2f7fe640 1 --2- 172.21.15.45:0/1046582242 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fef1c0668d0 0x7fef1c068d90 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fef20000f70 tx=0x7fef20009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:39.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:39.965+0000 7fef17fff640 1 -- 172.21.15.45:0/1046582242 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fef240ee9c0 con 0x7fef300d2be0 2023-11-28T18:38:40.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.121+0000 7fef35c54640 1 -- 172.21.15.45:0/1046582242 --> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fef300d23e0 con 0x7fef1c0668d0 2023-11-28T18:38:40.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.133+0000 7fef17fff640 1 -- 172.21.15.45:0/1046582242 <== mgr.4100 v2:172.21.15.190:6832/645101166 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283709 (secure 0 0 0) 0x7fef20001c50 con 0x7fef1c0668d0 2023-11-28T18:38:40.139 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:38:40.141 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-11-28T18:38:40.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.133+0000 7fef35c54640 1 -- 172.21.15.45:0/1046582242 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fef1c0668d0 msgr2=0x7fef1c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:40.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.133+0000 7fef35c54640 1 --2- 172.21.15.45:0/1046582242 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fef1c0668d0 0x7fef1c068d90 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fef20000f70 tx=0x7fef20009040 comp rx=0 tx=0).stop 2023-11-28T18:38:40.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.133+0000 7fef35c54640 1 -- 172.21.15.45:0/1046582242 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef300d2be0 msgr2=0x7fef3015ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:40.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.133+0000 7fef35c54640 1 --2- 172.21.15.45:0/1046582242 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef300d2be0 0x7fef3015ff20 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fef240097f0 tx=0x7fef2401ba50 comp rx=0 tx=0).stop 2023-11-28T18:38:40.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.133+0000 7fef35c54640 1 -- 172.21.15.45:0/1046582242 shutdown_connections 2023-11-28T18:38:40.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.133+0000 7fef35c54640 1 --2- 172.21.15.45:0/1046582242 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fef1c0668d0 0x7fef1c068d90 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:40.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.133+0000 7fef35c54640 1 --2- 172.21.15.45:0/1046582242 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fef3015d240 0x7fef300cbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:40.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.133+0000 7fef35c54640 1 --2- 172.21.15.45:0/1046582242 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef300d2be0 0x7fef3015ff20 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:40.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.133+0000 7fef35c54640 1 --2- 172.21.15.45:0/1046582242 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef300ce370 0x7fef3015b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:40.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.133+0000 7fef35c54640 1 -- 172.21.15.45:0/1046582242 >> 172.21.15.45:0/1046582242 conn(0x7fef300722a0 msgr2=0x7fef3015c840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:40.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.137+0000 7fef35c54640 1 -- 172.21.15.45:0/1046582242 shutdown_connections 2023-11-28T18:38:40.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.137+0000 7fef35c54640 1 -- 172.21.15.45:0/1046582242 wait complete. 2023-11-28T18:38:40.158 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2023-11-28T18:38:39.248523+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":6,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236696,"kb_used_data":3892,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738024,"statfs":{"total":773094113280,"available":772851736576,"internally_reserved":0,"allocated":3985408,"data_stored":2246483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.239837"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.026765+0000","last_change":"2023-11-28T18:38:35.026765+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.026765+0000","last_undegraded":"2023-11-28T18:38:35.026765+0000","last_fullsized":"2023-11-28T18:38:35.026765+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.028264+0000","last_change":"2023-11-28T18:38:35.028264+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.028264+0000","last_undegraded":"2023-11-28T18:38:35.028264+0000","last_fullsized":"2023-11-28T18:38:35.028264+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.021342+0000","last_change":"2023-11-28T18:38:35.021342+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.021342+0000","last_undegraded":"2023-11-28T18:38:35.021342+0000","last_fullsized":"2023-11-28T18:38:35.021342+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.030480+0000","last_change":"2023-11-28T18:38:35.030480+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.030480+0000","last_undegraded":"2023-11-28T18:38:35.030480+0000","last_fullsized":"2023-11-28T18:38:35.030480+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.024376+0000","last_change":"2023-11-28T18:38:35.024376+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.024376+0000","last_undegraded":"2023-11-28T18:38:35.024376+0000","last_fullsized":"2023-11-28T18:38:35.024376+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.025354+0000","last_change":"2023-11-28T18:38:35.025354+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.025354+0000","last_undegraded":"2023-11-28T18:38:35.025354+0000","last_fullsized":"2023-11-28T18:38:35.025354+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.025165+0000","last_change":"2023-11-28T18:38:35.025165+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.025165+0000","last_undegraded":"2023-11-28T18:38:35.025165+0000","last_fullsized":"2023-11-28T18:38:35.025165+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.030364+0000","last_change":"2023-11-28T18:38:35.030364+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.030364+0000","last_undegraded":"2023-11-28T18:38:35.030364+0000","last_fullsized":"2023-11-28T18:38:35.030364+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.016603+0000","last_change":"2023-11-28T18:38:35.016603+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.016603+0000","last_undegraded":"2023-11-28T18:38:35.016603+0000","last_fullsized":"2023-11-28T18:38:35.016603+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.028332+0000","last_change":"2023-11-28T18:38:35.028332+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.028332+0000","last_undegraded":"2023-11-28T18:38:35.028332+0000","last_fullsized":"2023-11-28T18:38:35.028332+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.035054+0000","last_change":"2023-11-28T18:38:35.035054+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.035054+0000","last_undegraded":"2023-11-28T18:38:35.035054+0000","last_fullsized":"2023-11-28T18:38:35.035054+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.019498+0000","last_change":"2023-11-28T18:38:35.019498+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.019498+0000","last_undegraded":"2023-11-28T18:38:35.019498+0000","last_fullsized":"2023-11-28T18:38:35.019498+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.023737+0000","last_change":"2023-11-28T18:38:35.023737+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.023737+0000","last_undegraded":"2023-11-28T18:38:35.023737+0000","last_fullsized":"2023-11-28T18:38:35.023737+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.024782+0000","last_change":"2023-11-28T18:38:35.024782+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.024782+0000","last_undegraded":"2023-11-28T18:38:35.024782+0000","last_fullsized":"2023-11-28T18:38:35.024782+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.020038+0000","last_change":"2023-11-28T18:38:35.020038+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.020038+0000","last_undegraded":"2023-11-28T18:38:35.020038+0000","last_fullsized":"2023-11-28T18:38:35.020038+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.024418+0000","last_change":"2023-11-28T18:38:35.024418+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.024418+0000","last_undegraded":"2023-11-28T18:38:35.024418+0000","last_fullsized":"2023-11-28T18:38:35.024418+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.037840+0000","last_change":"2023-11-28T18:38:35.037840+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.037840+0000","last_undegraded":"2023-11-28T18:38:35.037840+0000","last_fullsized":"2023-11-28T18:38:35.037840+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.027775+0000","last_change":"2023-11-28T18:38:35.027775+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.027775+0000","last_undegraded":"2023-11-28T18:38:35.027775+0000","last_fullsized":"2023-11-28T18:38:35.027775+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.024051+0000","last_change":"2023-11-28T18:38:35.024051+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.024051+0000","last_undegraded":"2023-11-28T18:38:35.024051+0000","last_fullsized":"2023-11-28T18:38:35.024051+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.022099+0000","last_change":"2023-11-28T18:38:35.022099+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.022099+0000","last_undegraded":"2023-11-28T18:38:35.022099+0000","last_fullsized":"2023-11-28T18:38:35.022099+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.017937+0000","last_change":"2023-11-28T18:38:35.017937+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.017937+0000","last_undegraded":"2023-11-28T18:38:35.017937+0000","last_fullsized":"2023-11-28T18:38:35.017937+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.015828+0000","last_change":"2023-11-28T18:38:35.015828+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.015828+0000","last_undegraded":"2023-11-28T18:38:35.015828+0000","last_fullsized":"2023-11-28T18:38:35.015828+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.019587+0000","last_change":"2023-11-28T18:38:35.019587+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.019587+0000","last_undegraded":"2023-11-28T18:38:35.019587+0000","last_fullsized":"2023-11-28T18:38:35.019587+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.018025+0000","last_change":"2023-11-28T18:38:35.018025+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.018025+0000","last_undegraded":"2023-11-28T18:38:35.018025+0000","last_fullsized":"2023-11-28T18:38:35.018025+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.027110+0000","last_change":"2023-11-28T18:38:35.027110+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.027110+0000","last_undegraded":"2023-11-28T18:38:35.027110+0000","last_fullsized":"2023-11-28T18:38:35.027110+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.027244+0000","last_change":"2023-11-28T18:38:35.027244+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.027244+0000","last_undegraded":"2023-11-28T18:38:35.027244+0000","last_fullsized":"2023-11-28T18:38:35.027244+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.030036+0000","last_change":"2023-11-28T18:38:35.030036+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.030036+0000","last_undegraded":"2023-11-28T18:38:35.030036+0000","last_fullsized":"2023-11-28T18:38:35.030036+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.018981+0000","last_change":"2023-11-28T18:38:35.018981+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.018981+0000","last_undegraded":"2023-11-28T18:38:35.018981+0000","last_fullsized":"2023-11-28T18:38:35.018981+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.016270+0000","last_change":"2023-11-28T18:38:35.016270+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.016270+0000","last_undegraded":"2023-11-28T18:38:35.016270+0000","last_fullsized":"2023-11-28T18:38:35.016270+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.028493+0000","last_change":"2023-11-28T18:38:35.028493+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.028493+0000","last_undegraded":"2023-11-28T18:38:35.028493+0000","last_fullsized":"2023-11-28T18:38:35.028493+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.026899+0000","last_change":"2023-11-28T18:38:35.026899+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.026899+0000","last_undegraded":"2023-11-28T18:38:35.026899+0000","last_fullsized":"2023-11-28T18:38:35.026899+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.029918+0000","last_change":"2023-11-28T18:38:35.029918+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.029918+0000","last_undegraded":"2023-11-28T18:38:35.029918+0000","last_fullsized":"2023-11-28T18:38:35.029918+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.020563+0000","last_change":"2023-11-28T18:38:35.020563+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.020563+0000","last_undegraded":"2023-11-28T18:38:35.020563+0000","last_fullsized":"2023-11-28T18:38:35.020563+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.043687+0000","last_change":"2023-11-28T18:38:35.042345+0000","last_active":"2023-11-28T18:38:35.043687+0000","last_peered":"2023-11-28T18:38:35.043687+0000","last_clean":"2023-11-28T18:38:35.043687+0000","last_became_active":"2023-11-28T18:38:35.042014+0000","last_became_peered":"2023-11-28T18:38:35.042014+0000","last_unstale":"2023-11-28T18:38:35.043687+0000","last_undegraded":"2023-11-28T18:38:35.043687+0000","last_fullsized":"2023-11-28T18:38:35.043687+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:06:47.136477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.025671+0000","last_change":"2023-11-28T18:38:35.025671+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.025671+0000","last_undegraded":"2023-11-28T18:38:35.025671+0000","last_fullsized":"2023-11-28T18:38:35.025671+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.045962+0000","last_change":"2023-11-28T18:38:35.044546+0000","last_active":"2023-11-28T18:38:35.045962+0000","last_peered":"2023-11-28T18:38:35.045962+0000","last_clean":"2023-11-28T18:38:35.045962+0000","last_became_active":"2023-11-28T18:38:35.044235+0000","last_became_peered":"2023-11-28T18:38:35.044235+0000","last_unstale":"2023-11-28T18:38:35.045962+0000","last_undegraded":"2023-11-28T18:38:35.045962+0000","last_fullsized":"2023-11-28T18:38:35.045962+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:34:41.136709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.016469+0000","last_change":"2023-11-28T18:38:35.016469+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.016469+0000","last_undegraded":"2023-11-28T18:38:35.016469+0000","last_fullsized":"2023-11-28T18:38:35.016469+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.044908+0000","last_change":"2023-11-28T18:38:35.040826+0000","last_active":"2023-11-28T18:38:35.044908+0000","last_peered":"2023-11-28T18:38:35.044908+0000","last_clean":"2023-11-28T18:38:35.044908+0000","last_became_active":"2023-11-28T18:38:35.040557+0000","last_became_peered":"2023-11-28T18:38:35.040557+0000","last_unstale":"2023-11-28T18:38:35.044908+0000","last_undegraded":"2023-11-28T18:38:35.044908+0000","last_fullsized":"2023-11-28T18:38:35.044908+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:52:24.975704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.029593+0000","last_change":"2023-11-28T18:38:35.029593+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.029593+0000","last_undegraded":"2023-11-28T18:38:35.029593+0000","last_fullsized":"2023-11-28T18:38:35.029593+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.042053+0000","last_change":"2023-11-28T18:38:35.038443+0000","last_active":"2023-11-28T18:38:35.042053+0000","last_peered":"2023-11-28T18:38:35.042053+0000","last_clean":"2023-11-28T18:38:35.042053+0000","last_became_active":"2023-11-28T18:38:35.037937+0000","last_became_peered":"2023-11-28T18:38:35.037937+0000","last_unstale":"2023-11-28T18:38:35.042053+0000","last_undegraded":"2023-11-28T18:38:35.042053+0000","last_fullsized":"2023-11-28T18:38:35.042053+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:32:55.075873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.027906+0000","last_change":"2023-11-28T18:38:35.027906+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.027906+0000","last_undegraded":"2023-11-28T18:38:35.027906+0000","last_fullsized":"2023-11-28T18:38:35.027906+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.026698+0000","last_change":"2023-11-28T18:38:35.022767+0000","last_active":"2023-11-28T18:38:35.026698+0000","last_peered":"2023-11-28T18:38:35.026698+0000","last_clean":"2023-11-28T18:38:35.026698+0000","last_became_active":"2023-11-28T18:38:35.022394+0000","last_became_peered":"2023-11-28T18:38:35.022394+0000","last_unstale":"2023-11-28T18:38:35.026698+0000","last_undegraded":"2023-11-28T18:38:35.026698+0000","last_fullsized":"2023-11-28T18:38:35.026698+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:21:35.227388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.020339+0000","last_change":"2023-11-28T18:38:35.020339+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.020339+0000","last_undegraded":"2023-11-28T18:38:35.020339+0000","last_fullsized":"2023-11-28T18:38:35.020339+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.036729+0000","last_change":"2023-11-28T18:38:35.033844+0000","last_active":"2023-11-28T18:38:35.036729+0000","last_peered":"2023-11-28T18:38:35.036729+0000","last_clean":"2023-11-28T18:38:35.036729+0000","last_became_active":"2023-11-28T18:38:35.033053+0000","last_became_peered":"2023-11-28T18:38:35.033053+0000","last_unstale":"2023-11-28T18:38:35.036729+0000","last_undegraded":"2023-11-28T18:38:35.036729+0000","last_fullsized":"2023-11-28T18:38:35.036729+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:32:55.075873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.016575+0000","last_change":"2023-11-28T18:38:35.016575+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.016575+0000","last_undegraded":"2023-11-28T18:38:35.016575+0000","last_fullsized":"2023-11-28T18:38:35.016575+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.037297+0000","last_change":"2023-11-28T18:38:35.034039+0000","last_active":"2023-11-28T18:38:35.037297+0000","last_peered":"2023-11-28T18:38:35.037297+0000","last_clean":"2023-11-28T18:38:35.037297+0000","last_became_active":"2023-11-28T18:38:35.033740+0000","last_became_peered":"2023-11-28T18:38:35.033740+0000","last_unstale":"2023-11-28T18:38:35.037297+0000","last_undegraded":"2023-11-28T18:38:35.037297+0000","last_fullsized":"2023-11-28T18:38:35.037297+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:06:47.136477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.022571+0000","last_change":"2023-11-28T18:38:35.022571+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.022571+0000","last_undegraded":"2023-11-28T18:38:35.022571+0000","last_fullsized":"2023-11-28T18:38:35.022571+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.036530+0000","last_change":"2023-11-28T18:38:35.032151+0000","last_active":"2023-11-28T18:38:35.036530+0000","last_peered":"2023-11-28T18:38:35.036530+0000","last_clean":"2023-11-28T18:38:35.036530+0000","last_became_active":"2023-11-28T18:38:35.031820+0000","last_became_peered":"2023-11-28T18:38:35.031820+0000","last_unstale":"2023-11-28T18:38:35.036530+0000","last_undegraded":"2023-11-28T18:38:35.036530+0000","last_fullsized":"2023-11-28T18:38:35.036530+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:32:53.815496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.018726+0000","last_change":"2023-11-28T18:38:35.018726+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.018726+0000","last_undegraded":"2023-11-28T18:38:35.018726+0000","last_fullsized":"2023-11-28T18:38:35.018726+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.045280+0000","last_change":"2023-11-28T18:38:35.044014+0000","last_active":"2023-11-28T18:38:35.045280+0000","last_peered":"2023-11-28T18:38:35.045280+0000","last_clean":"2023-11-28T18:38:35.045280+0000","last_became_active":"2023-11-28T18:38:35.042731+0000","last_became_peered":"2023-11-28T18:38:35.042731+0000","last_unstale":"2023-11-28T18:38:35.045280+0000","last_undegraded":"2023-11-28T18:38:35.045280+0000","last_fullsized":"2023-11-28T18:38:35.045280+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:06:48.055994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.023319+0000","last_change":"2023-11-28T18:38:35.023319+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.023319+0000","last_undegraded":"2023-11-28T18:38:35.023319+0000","last_fullsized":"2023-11-28T18:38:35.023319+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.044442+0000","last_change":"2023-11-28T18:38:35.041965+0000","last_active":"2023-11-28T18:38:35.044442+0000","last_peered":"2023-11-28T18:38:35.044442+0000","last_clean":"2023-11-28T18:38:35.044442+0000","last_became_active":"2023-11-28T18:38:35.041387+0000","last_became_peered":"2023-11-28T18:38:35.041387+0000","last_unstale":"2023-11-28T18:38:35.044442+0000","last_undegraded":"2023-11-28T18:38:35.044442+0000","last_fullsized":"2023-11-28T18:38:35.044442+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:06:47.136477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.022334+0000","last_change":"2023-11-28T18:38:35.022334+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.022334+0000","last_undegraded":"2023-11-28T18:38:35.022334+0000","last_fullsized":"2023-11-28T18:38:35.022334+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.045179+0000","last_change":"2023-11-28T18:38:35.043644+0000","last_active":"2023-11-28T18:38:35.045179+0000","last_peered":"2023-11-28T18:38:35.045179+0000","last_clean":"2023-11-28T18:38:35.045179+0000","last_became_active":"2023-11-28T18:38:35.043329+0000","last_became_peered":"2023-11-28T18:38:35.043329+0000","last_unstale":"2023-11-28T18:38:35.045179+0000","last_undegraded":"2023-11-28T18:38:35.045179+0000","last_fullsized":"2023-11-28T18:38:35.045179+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:58:12.029100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.021907+0000","last_change":"2023-11-28T18:38:35.021907+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.021907+0000","last_undegraded":"2023-11-28T18:38:35.021907+0000","last_fullsized":"2023-11-28T18:38:35.021907+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.037997+0000","last_change":"2023-11-28T18:38:35.035852+0000","last_active":"2023-11-28T18:38:35.037997+0000","last_peered":"2023-11-28T18:38:35.037997+0000","last_clean":"2023-11-28T18:38:35.037997+0000","last_became_active":"2023-11-28T18:38:35.035554+0000","last_became_peered":"2023-11-28T18:38:35.035554+0000","last_unstale":"2023-11-28T18:38:35.037997+0000","last_undegraded":"2023-11-28T18:38:35.037997+0000","last_fullsized":"2023-11-28T18:38:35.037997+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:48:52.205118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.023841+0000","last_change":"2023-11-28T18:38:35.023841+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.023841+0000","last_undegraded":"2023-11-28T18:38:35.023841+0000","last_fullsized":"2023-11-28T18:38:35.023841+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.037372+0000","last_change":"2023-11-28T18:38:35.031263+0000","last_active":"2023-11-28T18:38:35.037372+0000","last_peered":"2023-11-28T18:38:35.037372+0000","last_clean":"2023-11-28T18:38:35.037372+0000","last_became_active":"2023-11-28T18:38:35.031028+0000","last_became_peered":"2023-11-28T18:38:35.031028+0000","last_unstale":"2023-11-28T18:38:35.037372+0000","last_undegraded":"2023-11-28T18:38:35.037372+0000","last_fullsized":"2023-11-28T18:38:35.037372+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:22:15.084082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.022151+0000","last_change":"2023-11-28T18:38:35.022151+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.022151+0000","last_undegraded":"2023-11-28T18:38:35.022151+0000","last_fullsized":"2023-11-28T18:38:35.022151+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.046193+0000","last_change":"2023-11-28T18:38:35.044333+0000","last_active":"2023-11-28T18:38:35.046193+0000","last_peered":"2023-11-28T18:38:35.046193+0000","last_clean":"2023-11-28T18:38:35.046193+0000","last_became_active":"2023-11-28T18:38:35.043246+0000","last_became_peered":"2023-11-28T18:38:35.043246+0000","last_unstale":"2023-11-28T18:38:35.046193+0000","last_undegraded":"2023-11-28T18:38:35.046193+0000","last_fullsized":"2023-11-28T18:38:35.046193+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:07:08.162461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.029514+0000","last_change":"2023-11-28T18:38:35.029514+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.029514+0000","last_undegraded":"2023-11-28T18:38:35.029514+0000","last_fullsized":"2023-11-28T18:38:35.029514+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.041431+0000","last_change":"2023-11-28T18:38:35.039112+0000","last_active":"2023-11-28T18:38:35.041431+0000","last_peered":"2023-11-28T18:38:35.041431+0000","last_clean":"2023-11-28T18:38:35.041431+0000","last_became_active":"2023-11-28T18:38:35.038761+0000","last_became_peered":"2023-11-28T18:38:35.038761+0000","last_unstale":"2023-11-28T18:38:35.041431+0000","last_undegraded":"2023-11-28T18:38:35.041431+0000","last_fullsized":"2023-11-28T18:38:35.041431+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:57:34.906080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.026360+0000","last_change":"2023-11-28T18:38:35.026360+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.026360+0000","last_undegraded":"2023-11-28T18:38:35.026360+0000","last_fullsized":"2023-11-28T18:38:35.026360+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.042933+0000","last_change":"2023-11-28T18:38:35.039997+0000","last_active":"2023-11-28T18:38:35.042933+0000","last_peered":"2023-11-28T18:38:35.042933+0000","last_clean":"2023-11-28T18:38:35.042933+0000","last_became_active":"2023-11-28T18:38:35.039693+0000","last_became_peered":"2023-11-28T18:38:35.039693+0000","last_unstale":"2023-11-28T18:38:35.042933+0000","last_undegraded":"2023-11-28T18:38:35.042933+0000","last_fullsized":"2023-11-28T18:38:35.042933+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:11:13.755446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.016792+0000","last_change":"2023-11-28T18:38:35.016792+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.016792+0000","last_undegraded":"2023-11-28T18:38:35.016792+0000","last_fullsized":"2023-11-28T18:38:35.016792+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.046037+0000","last_change":"2023-11-28T18:38:35.043865+0000","last_active":"2023-11-28T18:38:35.046037+0000","last_peered":"2023-11-28T18:38:35.046037+0000","last_clean":"2023-11-28T18:38:35.046037+0000","last_became_active":"2023-11-28T18:38:35.043574+0000","last_became_peered":"2023-11-28T18:38:35.043574+0000","last_unstale":"2023-11-28T18:38:35.046037+0000","last_undegraded":"2023-11-28T18:38:35.046037+0000","last_fullsized":"2023-11-28T18:38:35.046037+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:52:24.975704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.021652+0000","last_change":"2023-11-28T18:38:35.021652+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.021652+0000","last_undegraded":"2023-11-28T18:38:35.021652+0000","last_fullsized":"2023-11-28T18:38:35.021652+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.042000+0000","last_change":"2023-11-28T18:38:35.038493+0000","last_active":"2023-11-28T18:38:35.042000+0000","last_peered":"2023-11-28T18:38:35.042000+0000","last_clean":"2023-11-28T18:38:35.042000+0000","last_became_active":"2023-11-28T18:38:35.038065+0000","last_became_peered":"2023-11-28T18:38:35.038065+0000","last_unstale":"2023-11-28T18:38:35.042000+0000","last_undegraded":"2023-11-28T18:38:35.042000+0000","last_fullsized":"2023-11-28T18:38:35.042000+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:44:34.044747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.026820+0000","last_change":"2023-11-28T18:38:35.026820+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.026820+0000","last_undegraded":"2023-11-28T18:38:35.026820+0000","last_fullsized":"2023-11-28T18:38:35.026820+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.039354+0000","last_change":"2023-11-28T18:38:35.036943+0000","last_active":"2023-11-28T18:38:35.039354+0000","last_peered":"2023-11-28T18:38:35.039354+0000","last_clean":"2023-11-28T18:38:35.039354+0000","last_became_active":"2023-11-28T18:38:35.036630+0000","last_became_peered":"2023-11-28T18:38:35.036630+0000","last_unstale":"2023-11-28T18:38:35.039354+0000","last_undegraded":"2023-11-28T18:38:35.039354+0000","last_fullsized":"2023-11-28T18:38:35.039354+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:40:01.118721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.023651+0000","last_change":"2023-11-28T18:38:35.023651+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.023651+0000","last_undegraded":"2023-11-28T18:38:35.023651+0000","last_fullsized":"2023-11-28T18:38:35.023651+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.027089+0000","last_change":"2023-11-28T18:38:35.023682+0000","last_active":"2023-11-28T18:38:35.027089+0000","last_peered":"2023-11-28T18:38:35.027089+0000","last_clean":"2023-11-28T18:38:35.027089+0000","last_became_active":"2023-11-28T18:38:35.022730+0000","last_became_peered":"2023-11-28T18:38:35.022730+0000","last_unstale":"2023-11-28T18:38:35.027089+0000","last_undegraded":"2023-11-28T18:38:35.027089+0000","last_fullsized":"2023-11-28T18:38:35.027089+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:13:17.633662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.021628+0000","last_change":"2023-11-28T18:38:35.021628+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.021628+0000","last_undegraded":"2023-11-28T18:38:35.021628+0000","last_fullsized":"2023-11-28T18:38:35.021628+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.040951+0000","last_change":"2023-11-28T18:38:35.033842+0000","last_active":"2023-11-28T18:38:35.040951+0000","last_peered":"2023-11-28T18:38:35.040951+0000","last_clean":"2023-11-28T18:38:35.040951+0000","last_became_active":"2023-11-28T18:38:35.033482+0000","last_became_peered":"2023-11-28T18:38:35.033482+0000","last_unstale":"2023-11-28T18:38:35.040951+0000","last_undegraded":"2023-11-28T18:38:35.040951+0000","last_fullsized":"2023-11-28T18:38:35.040951+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:47:24.249639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.023141+0000","last_change":"2023-11-28T18:38:35.023141+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.023141+0000","last_undegraded":"2023-11-28T18:38:35.023141+0000","last_fullsized":"2023-11-28T18:38:35.023141+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.042583+0000","last_change":"2023-11-28T18:38:35.040401+0000","last_active":"2023-11-28T18:38:35.042583+0000","last_peered":"2023-11-28T18:38:35.042583+0000","last_clean":"2023-11-28T18:38:35.042583+0000","last_became_active":"2023-11-28T18:38:35.039986+0000","last_became_peered":"2023-11-28T18:38:35.039986+0000","last_unstale":"2023-11-28T18:38:35.042583+0000","last_undegraded":"2023-11-28T18:38:35.042583+0000","last_fullsized":"2023-11-28T18:38:35.042583+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:34:41.136709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.022670+0000","last_change":"2023-11-28T18:38:35.022670+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.022670+0000","last_undegraded":"2023-11-28T18:38:35.022670+0000","last_fullsized":"2023-11-28T18:38:35.022670+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.041967+0000","last_change":"2023-11-28T18:38:35.037979+0000","last_active":"2023-11-28T18:38:35.041967+0000","last_peered":"2023-11-28T18:38:35.041967+0000","last_clean":"2023-11-28T18:38:35.041967+0000","last_became_active":"2023-11-28T18:38:35.037674+0000","last_became_peered":"2023-11-28T18:38:35.037674+0000","last_unstale":"2023-11-28T18:38:35.041967+0000","last_undegraded":"2023-11-28T18:38:35.041967+0000","last_fullsized":"2023-11-28T18:38:35.041967+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:52:33.974326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.032944+0000","last_change":"2023-11-28T18:38:35.032944+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.032944+0000","last_undegraded":"2023-11-28T18:38:35.032944+0000","last_fullsized":"2023-11-28T18:38:35.032944+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.034841+0000","last_change":"2023-11-28T18:38:35.031421+0000","last_active":"2023-11-28T18:38:35.034841+0000","last_peered":"2023-11-28T18:38:35.034841+0000","last_clean":"2023-11-28T18:38:35.034841+0000","last_became_active":"2023-11-28T18:38:35.031138+0000","last_became_peered":"2023-11-28T18:38:35.031138+0000","last_unstale":"2023-11-28T18:38:35.034841+0000","last_undegraded":"2023-11-28T18:38:35.034841+0000","last_fullsized":"2023-11-28T18:38:35.034841+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:51:52.296626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.022643+0000","last_change":"2023-11-28T18:38:35.022643+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.022643+0000","last_undegraded":"2023-11-28T18:38:35.022643+0000","last_fullsized":"2023-11-28T18:38:35.022643+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.045769+0000","last_change":"2023-11-28T18:38:35.042278+0000","last_active":"2023-11-28T18:38:35.045769+0000","last_peered":"2023-11-28T18:38:35.045769+0000","last_clean":"2023-11-28T18:38:35.045769+0000","last_became_active":"2023-11-28T18:38:35.041885+0000","last_became_peered":"2023-11-28T18:38:35.041885+0000","last_unstale":"2023-11-28T18:38:35.045769+0000","last_undegraded":"2023-11-28T18:38:35.045769+0000","last_fullsized":"2023-11-28T18:38:35.045769+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:06:47.136477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.021241+0000","last_change":"2023-11-28T18:38:35.021241+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.021241+0000","last_undegraded":"2023-11-28T18:38:35.021241+0000","last_fullsized":"2023-11-28T18:38:35.021241+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.041637+0000","last_change":"2023-11-28T18:38:35.036513+0000","last_active":"2023-11-28T18:38:35.041637+0000","last_peered":"2023-11-28T18:38:35.041637+0000","last_clean":"2023-11-28T18:38:35.041637+0000","last_became_active":"2023-11-28T18:38:35.036218+0000","last_became_peered":"2023-11-28T18:38:35.036218+0000","last_unstale":"2023-11-28T18:38:35.041637+0000","last_undegraded":"2023-11-28T18:38:35.041637+0000","last_fullsized":"2023-11-28T18:38:35.041637+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:52:24.975704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.019286+0000","last_change":"2023-11-28T18:38:35.019286+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.019286+0000","last_undegraded":"2023-11-28T18:38:35.019286+0000","last_fullsized":"2023-11-28T18:38:35.019286+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.045742+0000","last_change":"2023-11-28T18:38:35.042254+0000","last_active":"2023-11-28T18:38:35.045742+0000","last_peered":"2023-11-28T18:38:35.045742+0000","last_clean":"2023-11-28T18:38:35.045742+0000","last_became_active":"2023-11-28T18:38:35.041942+0000","last_became_peered":"2023-11-28T18:38:35.041942+0000","last_unstale":"2023-11-28T18:38:35.045742+0000","last_undegraded":"2023-11-28T18:38:35.045742+0000","last_fullsized":"2023-11-28T18:38:35.045742+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:34:41.136709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.027923+0000","last_change":"2023-11-28T18:38:35.027923+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.027923+0000","last_undegraded":"2023-11-28T18:38:35.027923+0000","last_fullsized":"2023-11-28T18:38:35.027923+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.033955+0000","last_change":"2023-11-28T18:38:35.029334+0000","last_active":"2023-11-28T18:38:35.033955+0000","last_peered":"2023-11-28T18:38:35.033955+0000","last_clean":"2023-11-28T18:38:35.033955+0000","last_became_active":"2023-11-28T18:38:35.029088+0000","last_became_peered":"2023-11-28T18:38:35.029088+0000","last_unstale":"2023-11-28T18:38:35.033955+0000","last_undegraded":"2023-11-28T18:38:35.033955+0000","last_fullsized":"2023-11-28T18:38:35.033955+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:07:08.162461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.019528+0000","last_change":"2023-11-28T18:38:35.019528+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.019528+0000","last_undegraded":"2023-11-28T18:38:35.019528+0000","last_fullsized":"2023-11-28T18:38:35.019528+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.038195+0000","last_change":"2023-11-28T18:38:35.036038+0000","last_active":"2023-11-28T18:38:35.038195+0000","last_peered":"2023-11-28T18:38:35.038195+0000","last_clean":"2023-11-28T18:38:35.038195+0000","last_became_active":"2023-11-28T18:38:35.035686+0000","last_became_peered":"2023-11-28T18:38:35.035686+0000","last_unstale":"2023-11-28T18:38:35.038195+0000","last_undegraded":"2023-11-28T18:38:35.038195+0000","last_fullsized":"2023-11-28T18:38:35.038195+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:47:24.249639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.026252+0000","last_change":"2023-11-28T18:38:35.026252+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.026252+0000","last_undegraded":"2023-11-28T18:38:35.026252+0000","last_fullsized":"2023-11-28T18:38:35.026252+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.037853+0000","last_change":"2023-11-28T18:38:35.035526+0000","last_active":"2023-11-28T18:38:35.037853+0000","last_peered":"2023-11-28T18:38:35.037853+0000","last_clean":"2023-11-28T18:38:35.037853+0000","last_became_active":"2023-11-28T18:38:35.034566+0000","last_became_peered":"2023-11-28T18:38:35.034566+0000","last_unstale":"2023-11-28T18:38:35.037853+0000","last_undegraded":"2023-11-28T18:38:35.037853+0000","last_fullsized":"2023-11-28T18:38:35.037853+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:24:41.379481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.018130+0000","last_change":"2023-11-28T18:38:35.018130+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.018130+0000","last_undegraded":"2023-11-28T18:38:35.018130+0000","last_fullsized":"2023-11-28T18:38:35.018130+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.044594+0000","last_change":"2023-11-28T18:38:35.043063+0000","last_active":"2023-11-28T18:38:35.044594+0000","last_peered":"2023-11-28T18:38:35.044594+0000","last_clean":"2023-11-28T18:38:35.044594+0000","last_became_active":"2023-11-28T18:38:35.042719+0000","last_became_peered":"2023-11-28T18:38:35.042719+0000","last_unstale":"2023-11-28T18:38:35.044594+0000","last_undegraded":"2023-11-28T18:38:35.044594+0000","last_fullsized":"2023-11-28T18:38:35.044594+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:00:43.620322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.031614+0000","last_change":"2023-11-28T18:38:35.031614+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.031614+0000","last_undegraded":"2023-11-28T18:38:35.031614+0000","last_fullsized":"2023-11-28T18:38:35.031614+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.042502+0000","last_change":"2023-11-28T18:38:35.040261+0000","last_active":"2023-11-28T18:38:35.042502+0000","last_peered":"2023-11-28T18:38:35.042502+0000","last_clean":"2023-11-28T18:38:35.042502+0000","last_became_active":"2023-11-28T18:38:35.040006+0000","last_became_peered":"2023-11-28T18:38:35.040006+0000","last_unstale":"2023-11-28T18:38:35.042502+0000","last_undegraded":"2023-11-28T18:38:35.042502+0000","last_fullsized":"2023-11-28T18:38:35.042502+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:07:08.162461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":174,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T18:38:34.015523+0000","last_change":"2023-11-28T18:37:22.369132+0000","last_active":"2023-11-28T18:38:34.015523+0000","last_peered":"2023-11-28T18:38:34.015523+0000","last_clean":"2023-11-28T18:38:34.015523+0000","last_became_active":"2023-11-28T18:37:22.368142+0000","last_became_peered":"2023-11-28T18:37:22.368142+0000","last_unstale":"2023-11-28T18:38:34.015523+0000","last_undegraded":"2023-11-28T18:38:34.015523+0000","last_fullsized":"2023-11-28T18:38:34.015523+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:21.313053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:21.313053+0000","last_clean_scrub_stamp":"2023-11-28T18:37:21.313053+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:55:01.432028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":942080,"data_stored":722803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":4.8559999999999999,"5min":4.8559999999999999,"15min":4.8559999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":4.8319999999999999,"5min":4.8319999999999999,"15min":4.8319999999999999},"last":0.67500000000000004}]},{"osd":1,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":4.8109999999999999,"5min":4.8109999999999999,"15min":4.8109999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":4.8700000000000001,"5min":4.8700000000000001,"15min":4.8700000000000001},"last":0.71999999999999997}]},{"osd":2,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.76300000000000001}]},{"osd":3,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":4.7619999999999996,"5min":4.7619999999999996,"15min":4.7619999999999996},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.63700000000000001}]},{"osd":4,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.502},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.57299999999999995}]},{"osd":5,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.433}]},{"osd":6,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.52700000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":132435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 18:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.78100000000000003}]},{"osd":1,"last update":"Tue Nov 28 18:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.81999999999999995}]},{"osd":2,"last update":"Tue Nov 28 18:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.622}]},{"osd":3,"last update":"Tue Nov 28 18:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.63400000000000001}]},{"osd":4,"last update":"Tue Nov 28 18:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.59199999999999997}]},{"osd":5,"last update":"Tue Nov 28 18:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.747}]},{"osd":7,"last update":"Tue Nov 28 18:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.76500000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":138702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.77100000000000002}]},{"osd":1,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.86099999999999999}]},{"osd":2,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.82799999999999996}]},{"osd":3,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.92800000000000005}]},{"osd":4,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.753},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.72999999999999998}]},{"osd":6,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.67300000000000004}]},{"osd":7,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.88100000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":132435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":3.5179999999999998,"5min":3.5179999999999998,"15min":3.5179999999999998},"last":0.56100000000000005}]},{"osd":1,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":3.5019999999999998,"5min":3.5019999999999998,"15min":3.5019999999999998},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":3.5630000000000002,"5min":3.5630000000000002,"15min":3.5630000000000002},"last":0.70199999999999996}]},{"osd":2,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":3.6709999999999998,"5min":3.6709999999999998,"15min":3.6709999999999998},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":3.4849999999999999,"5min":3.4849999999999999,"15min":3.4849999999999999},"last":0.59699999999999998}]},{"osd":3,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":3.7130000000000001,"5min":3.7130000000000001,"15min":3.7130000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.80100000000000005}]},{"osd":5,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.75600000000000001}]},{"osd":6,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.718,"5min":1.718,"15min":1.718},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.77700000000000002}]},{"osd":7,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.83199999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":348160,"data_stored":132435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 18:38:22 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.54200000000000004}]},{"osd":1,"last update":"Tue Nov 28 18:38:22 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.59799999999999998}]},{"osd":2,"last update":"Tue Nov 28 18:38:22 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.624},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.63700000000000001}]},{"osd":4,"last update":"Tue Nov 28 18:38:22 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.88800000000000001}]},{"osd":5,"last update":"Tue Nov 28 18:38:22 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.91500000000000004}]},{"osd":6,"last update":"Tue Nov 28 18:38:22 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":0.98799999999999999}]},{"osd":7,"last update":"Tue Nov 28 18:38:22 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.92800000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":348160,"data_stored":132435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 18:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":0.45700000000000002}]},{"osd":1,"last update":"Tue Nov 28 18:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.47799999999999998}]},{"osd":3,"last update":"Tue Nov 28 18:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.439},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.41899999999999998}]},{"osd":4,"last update":"Tue Nov 28 18:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":0.56100000000000005}]},{"osd":5,"last update":"Tue Nov 28 18:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.69999999999999996}]},{"osd":6,"last update":"Tue Nov 28 18:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.7070000000000001,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.56999999999999995}]},{"osd":7,"last update":"Tue Nov 28 18:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.7509999999999999,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.65700000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":348160,"data_stored":132435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":2.2090000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":4.0899999999999999,"5min":4.0899999999999999,"15min":4.0899999999999999},"last":0.372}]},{"osd":2,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":3.8620000000000001,"5min":3.8620000000000001,"15min":3.8620000000000001},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":2.823,"5min":2.823,"15min":2.823},"last":0.41699999999999998}]},{"osd":3,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":4.0739999999999998,"5min":4.0739999999999998,"15min":4.0739999999999998},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":3.6659999999999999,"5min":3.6659999999999999,"15min":3.6659999999999999},"last":0.52000000000000002}]},{"osd":4,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":5.3540000000000001,"5min":5.3540000000000001,"15min":5.3540000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":5.5,"5min":5.5,"15min":5.5},"last":0.58299999999999996}]},{"osd":5,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":5.4379999999999997,"5min":5.4379999999999997,"15min":5.4379999999999997},"last":0.71599999999999997},{"interface":"front","average":{"1min":1.129,"5min":1.129,"15min":1.129},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":3.4500000000000002,"5min":3.4500000000000002,"15min":3.4500000000000002},"last":0.745}]},{"osd":6,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":3.0369999999999999,"5min":3.0369999999999999,"15min":3.0369999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":5.4000000000000004,"5min":5.4000000000000004,"15min":5.4000000000000004},"last":0.59499999999999997}]},{"osd":7,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":5.5369999999999999,"5min":5.5369999999999999,"15min":5.5369999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":3.2480000000000002,"5min":3.2480000000000002,"15min":3.2480000000000002},"last":0.69999999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32100,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339740,"statfs":{"total":96636764160,"available":96603893760,"internally_reserved":0,"allocated":942080,"data_stored":722803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 18:38:22 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.432},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.51800000000000002}]},{"osd":2,"last update":"Tue Nov 28 18:38:22 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.503},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.38100000000000001}]},{"osd":3,"last update":"Tue Nov 28 18:38:22 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.46999999999999997}]},{"osd":4,"last update":"Tue Nov 28 18:38:22 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.879},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.84399999999999997}]},{"osd":5,"last update":"Tue Nov 28 18:38:22 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.66000000000000003}]},{"osd":6,"last update":"Tue Nov 28 18:38:22 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1,"5min":1,"15min":1},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.76100000000000001}]},{"osd":7,"last update":"Tue Nov 28 18:38:22 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.73999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T18:38:40.170 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T18:38:40.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.341+0000 7f15895aa640 1 Processor -- start 2023-11-28T18:38:40.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.341+0000 7f15895aa640 1 -- start start 2023-11-28T18:38:40.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.341+0000 7f15895aa640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f158406ca10 0x7f158415a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:40.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.341+0000 7f15895aa640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f158415abb0 0x7f15840cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:40.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.345+0000 7f15895aa640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f158415b3e0 con 0x7f158413cf70 2023-11-28T18:38:40.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.345+0000 7f15895aa640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f158413d350 con 0x7f158415abb0 2023-11-28T18:38:40.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.345+0000 7f15895aa640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1584140520 con 0x7f158406ca10 2023-11-28T18:38:40.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.345+0000 7f15837fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f158415abb0 0x7f15840cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:40.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.345+0000 7f15837fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f158415abb0 0x7f15840cd8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58486/0 (socket says 172.21.15.45:58486) 2023-11-28T18:38:40.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.345+0000 7f15837fe640 1 -- 172.21.15.45:0/265974420 learned_addr learned my addr 172.21.15.45:0/265974420 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:40.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.345+0000 7f157bfff640 1 --2- 172.21.15.45:0/265974420 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f158406ca10 0x7f158415a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:40.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.345+0000 7f15837fe640 1 -- 172.21.15.45:0/265974420 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f158406ca10 msgr2=0x7f158415a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:40.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.345+0000 7f15837fe640 1 --2- 172.21.15.45:0/265974420 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f158406ca10 0x7f158415a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:40.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.345+0000 7f15837fe640 1 -- 172.21.15.45:0/265974420 >> v1:172.21.15.45:6789/0 conn(0x7f158413cf70 legacy=0x7f158406c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:40.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.345+0000 7f15837fe640 1 -- 172.21.15.45:0/265974420 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f158413f760 con 0x7f158415abb0 2023-11-28T18:38:40.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.345+0000 7f157bfff640 1 --2- 172.21.15.45:0/265974420 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f158406ca10 0x7f158415a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:38:40.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.345+0000 7f15837fe640 1 --2- 172.21.15.45:0/265974420 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f158415abb0 0x7f15840cd8c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f157c009e50 tx=0x7f157c01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d80bde9386573f3c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:40.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.345+0000 7f15827fc640 1 -- 172.21.15.45:0/265974420 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f157c0a5810 con 0x7f158415abb0 2023-11-28T18:38:40.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.345+0000 7f15827fc640 1 -- 172.21.15.45:0/265974420 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f157c0a5970 con 0x7f158415abb0 2023-11-28T18:38:40.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.345+0000 7f15827fc640 1 -- 172.21.15.45:0/265974420 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f157c0a5d00 con 0x7f158415abb0 2023-11-28T18:38:40.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.349+0000 7f15895aa640 1 -- 172.21.15.45:0/265974420 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f158415abb0 msgr2=0x7f15840cd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:40.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.349+0000 7f15895aa640 1 --2- 172.21.15.45:0/265974420 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f158415abb0 0x7f15840cd8c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f157c009e50 tx=0x7f157c01c950 comp rx=0 tx=0).stop 2023-11-28T18:38:40.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.349+0000 7f15895aa640 1 -- 172.21.15.45:0/265974420 shutdown_connections 2023-11-28T18:38:40.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.349+0000 7f15895aa640 1 --2- 172.21.15.45:0/265974420 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f158415abb0 0x7f15840cd8c0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:40.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.349+0000 7f15895aa640 1 --2- 172.21.15.45:0/265974420 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f158406ca10 0x7f158415a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:40.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.349+0000 7f15895aa640 1 -- 172.21.15.45:0/265974420 >> 172.21.15.45:0/265974420 conn(0x7f158406a570 msgr2=0x7f158406a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:40.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.349+0000 7f15895aa640 1 -- 172.21.15.45:0/265974420 shutdown_connections 2023-11-28T18:38:40.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.349+0000 7f15895aa640 1 -- 172.21.15.45:0/265974420 wait complete. 2023-11-28T18:38:40.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.349+0000 7f15895aa640 1 Processor -- start 2023-11-28T18:38:40.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.349+0000 7f15895aa640 1 -- start start 2023-11-28T18:38:40.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.349+0000 7f15895aa640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f158406ca10 0x7f1584136780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:40.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.349+0000 7f15895aa640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f158413cf70 0x7f1584154ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:40.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.349+0000 7f15895aa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f158415abb0 0x7f15840b3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:40.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.349+0000 7f15895aa640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1584136cc0 con 0x7f158415abb0 2023-11-28T18:38:40.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.349+0000 7f15895aa640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15841f68b0 con 0x7f158413cf70 2023-11-28T18:38:40.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.349+0000 7f15895aa640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1584155f20 con 0x7f158406ca10 2023-11-28T18:38:40.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.349+0000 7f15837fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f158415abb0 0x7f15840b3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:40.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.349+0000 7f15837fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f158415abb0 0x7f15840b3080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58500/0 (socket says 172.21.15.45:58500) 2023-11-28T18:38:40.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.349+0000 7f15837fe640 1 -- 172.21.15.45:0/1639998623 learned_addr learned my addr 172.21.15.45:0/1639998623 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:40.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.349+0000 7f1582ffd640 1 --2- 172.21.15.45:0/1639998623 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f158406ca10 0x7f1584136780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:40.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.349+0000 7f157bfff640 1 --2- 172.21.15.45:0/1639998623 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f158413cf70 0x7f1584154ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:40.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.349+0000 7f15837fe640 1 -- 172.21.15.45:0/1639998623 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f158406ca10 msgr2=0x7f1584136780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:40.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.349+0000 7f15837fe640 1 --2- 172.21.15.45:0/1639998623 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f158406ca10 0x7f1584136780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:40.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.349+0000 7f15837fe640 1 -- 172.21.15.45:0/1639998623 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f158413cf70 msgr2=0x7f1584154ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:40.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.349+0000 7f15837fe640 1 --2- 172.21.15.45:0/1639998623 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f158413cf70 0x7f1584154ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:40.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.349+0000 7f15837fe640 1 -- 172.21.15.45:0/1639998623 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f157c009b30 con 0x7f158415abb0 2023-11-28T18:38:40.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.349+0000 7f157bfff640 1 --2- 172.21.15.45:0/1639998623 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f158413cf70 0x7f1584154ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:38:40.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.349+0000 7f1582ffd640 1 --2- 172.21.15.45:0/1639998623 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f158406ca10 0x7f1584136780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:38:40.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.353+0000 7f15837fe640 1 --2- 172.21.15.45:0/1639998623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f158415abb0 0x7f15840b3080 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f157c01a580 tx=0x7f157c0196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:40.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.353+0000 7f157b7fe640 1 -- 172.21.15.45:0/1639998623 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f157c0b8670 con 0x7f158415abb0 2023-11-28T18:38:40.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.353+0000 7f157b7fe640 1 -- 172.21.15.45:0/1639998623 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f157c0b87d0 con 0x7f158415abb0 2023-11-28T18:38:40.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.353+0000 7f157b7fe640 1 -- 172.21.15.45:0/1639998623 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f157c0b8b40 con 0x7f158415abb0 2023-11-28T18:38:40.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.353+0000 7f15895aa640 1 -- 172.21.15.45:0/1639998623 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1584155960 con 0x7f158415abb0 2023-11-28T18:38:40.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.353+0000 7f15895aa640 1 -- 172.21.15.45:0/1639998623 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f158414da40 con 0x7f158415abb0 2023-11-28T18:38:40.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.353+0000 7f15895aa640 1 -- 172.21.15.45:0/1639998623 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1584069480 con 0x7f158415abb0 2023-11-28T18:38:40.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.353+0000 7f157b7fe640 1 -- 172.21.15.45:0/1639998623 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f157c0b8ca0 con 0x7f158415abb0 2023-11-28T18:38:40.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.353+0000 7f157b7fe640 1 --2- 172.21.15.45:0/1639998623 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f15640668d0 0x7f1564068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:40.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.353+0000 7f157b7fe640 1 -- 172.21.15.45:0/1639998623 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f157c11f9f0 con 0x7f158415abb0 2023-11-28T18:38:40.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.357+0000 7f1582ffd640 1 --2- 172.21.15.45:0/1639998623 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f15640668d0 0x7f1564068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:40.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.357+0000 7f1582ffd640 1 --2- 172.21.15.45:0/1639998623 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f15640668d0 0x7f1564068d90 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1574000f70 tx=0x7f1574009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:40.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.357+0000 7f157b7fe640 1 -- 172.21.15.45:0/1639998623 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f157c0ecd40 con 0x7f158415abb0 2023-11-28T18:38:40.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.513+0000 7f15895aa640 1 -- 172.21.15.45:0/1639998623 --> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f15840ce610 con 0x7f15640668d0 2023-11-28T18:38:40.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.521+0000 7f157b7fe640 1 -- 172.21.15.45:0/1639998623 <== mgr.4100 v2:172.21.15.190:6832/645101166 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283709 (secure 0 0 0) 0x7f15740013f0 con 0x7f15640668d0 2023-11-28T18:38:40.528 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:38:40.529 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-11-28T18:38:40.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.525+0000 7f15895aa640 1 -- 172.21.15.45:0/1639998623 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f15640668d0 msgr2=0x7f1564068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:40.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.525+0000 7f15895aa640 1 --2- 172.21.15.45:0/1639998623 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f15640668d0 0x7f1564068d90 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1574000f70 tx=0x7f1574009040 comp rx=0 tx=0).stop 2023-11-28T18:38:40.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.525+0000 7f15895aa640 1 -- 172.21.15.45:0/1639998623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f158415abb0 msgr2=0x7f15840b3080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:40.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.525+0000 7f15895aa640 1 --2- 172.21.15.45:0/1639998623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f158415abb0 0x7f15840b3080 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f157c01a580 tx=0x7f157c0196f0 comp rx=0 tx=0).stop 2023-11-28T18:38:40.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.525+0000 7f15895aa640 1 -- 172.21.15.45:0/1639998623 shutdown_connections 2023-11-28T18:38:40.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.525+0000 7f15895aa640 1 --2- 172.21.15.45:0/1639998623 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f15640668d0 0x7f1564068d90 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:40.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.525+0000 7f15895aa640 1 --2- 172.21.15.45:0/1639998623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f158415abb0 0x7f15840b3080 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:40.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.525+0000 7f15895aa640 1 --2- 172.21.15.45:0/1639998623 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f158413cf70 0x7f1584154ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:40.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.525+0000 7f15895aa640 1 --2- 172.21.15.45:0/1639998623 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f158406ca10 0x7f1584136780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:40.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.525+0000 7f15895aa640 1 -- 172.21.15.45:0/1639998623 >> 172.21.15.45:0/1639998623 conn(0x7f158406a570 msgr2=0x7f158415c100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:40.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.525+0000 7f15895aa640 1 -- 172.21.15.45:0/1639998623 shutdown_connections 2023-11-28T18:38:40.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.525+0000 7f15895aa640 1 -- 172.21.15.45:0/1639998623 wait complete. 2023-11-28T18:38:40.548 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2023-11-28T18:38:39.248523+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":6,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236696,"kb_used_data":3892,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738024,"statfs":{"total":773094113280,"available":772851736576,"internally_reserved":0,"allocated":3985408,"data_stored":2246483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.239837"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.026765+0000","last_change":"2023-11-28T18:38:35.026765+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.026765+0000","last_undegraded":"2023-11-28T18:38:35.026765+0000","last_fullsized":"2023-11-28T18:38:35.026765+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.028264+0000","last_change":"2023-11-28T18:38:35.028264+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.028264+0000","last_undegraded":"2023-11-28T18:38:35.028264+0000","last_fullsized":"2023-11-28T18:38:35.028264+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.021342+0000","last_change":"2023-11-28T18:38:35.021342+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.021342+0000","last_undegraded":"2023-11-28T18:38:35.021342+0000","last_fullsized":"2023-11-28T18:38:35.021342+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.030480+0000","last_change":"2023-11-28T18:38:35.030480+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.030480+0000","last_undegraded":"2023-11-28T18:38:35.030480+0000","last_fullsized":"2023-11-28T18:38:35.030480+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.024376+0000","last_change":"2023-11-28T18:38:35.024376+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.024376+0000","last_undegraded":"2023-11-28T18:38:35.024376+0000","last_fullsized":"2023-11-28T18:38:35.024376+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.025354+0000","last_change":"2023-11-28T18:38:35.025354+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.025354+0000","last_undegraded":"2023-11-28T18:38:35.025354+0000","last_fullsized":"2023-11-28T18:38:35.025354+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.025165+0000","last_change":"2023-11-28T18:38:35.025165+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.025165+0000","last_undegraded":"2023-11-28T18:38:35.025165+0000","last_fullsized":"2023-11-28T18:38:35.025165+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.030364+0000","last_change":"2023-11-28T18:38:35.030364+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.030364+0000","last_undegraded":"2023-11-28T18:38:35.030364+0000","last_fullsized":"2023-11-28T18:38:35.030364+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.016603+0000","last_change":"2023-11-28T18:38:35.016603+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.016603+0000","last_undegraded":"2023-11-28T18:38:35.016603+0000","last_fullsized":"2023-11-28T18:38:35.016603+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.028332+0000","last_change":"2023-11-28T18:38:35.028332+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.028332+0000","last_undegraded":"2023-11-28T18:38:35.028332+0000","last_fullsized":"2023-11-28T18:38:35.028332+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.035054+0000","last_change":"2023-11-28T18:38:35.035054+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.035054+0000","last_undegraded":"2023-11-28T18:38:35.035054+0000","last_fullsized":"2023-11-28T18:38:35.035054+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.019498+0000","last_change":"2023-11-28T18:38:35.019498+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.019498+0000","last_undegraded":"2023-11-28T18:38:35.019498+0000","last_fullsized":"2023-11-28T18:38:35.019498+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.023737+0000","last_change":"2023-11-28T18:38:35.023737+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.023737+0000","last_undegraded":"2023-11-28T18:38:35.023737+0000","last_fullsized":"2023-11-28T18:38:35.023737+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.024782+0000","last_change":"2023-11-28T18:38:35.024782+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.024782+0000","last_undegraded":"2023-11-28T18:38:35.024782+0000","last_fullsized":"2023-11-28T18:38:35.024782+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.020038+0000","last_change":"2023-11-28T18:38:35.020038+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.020038+0000","last_undegraded":"2023-11-28T18:38:35.020038+0000","last_fullsized":"2023-11-28T18:38:35.020038+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.024418+0000","last_change":"2023-11-28T18:38:35.024418+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.024418+0000","last_undegraded":"2023-11-28T18:38:35.024418+0000","last_fullsized":"2023-11-28T18:38:35.024418+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.037840+0000","last_change":"2023-11-28T18:38:35.037840+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.037840+0000","last_undegraded":"2023-11-28T18:38:35.037840+0000","last_fullsized":"2023-11-28T18:38:35.037840+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.027775+0000","last_change":"2023-11-28T18:38:35.027775+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.027775+0000","last_undegraded":"2023-11-28T18:38:35.027775+0000","last_fullsized":"2023-11-28T18:38:35.027775+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.024051+0000","last_change":"2023-11-28T18:38:35.024051+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.024051+0000","last_undegraded":"2023-11-28T18:38:35.024051+0000","last_fullsized":"2023-11-28T18:38:35.024051+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.022099+0000","last_change":"2023-11-28T18:38:35.022099+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.022099+0000","last_undegraded":"2023-11-28T18:38:35.022099+0000","last_fullsized":"2023-11-28T18:38:35.022099+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.017937+0000","last_change":"2023-11-28T18:38:35.017937+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.017937+0000","last_undegraded":"2023-11-28T18:38:35.017937+0000","last_fullsized":"2023-11-28T18:38:35.017937+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.015828+0000","last_change":"2023-11-28T18:38:35.015828+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.015828+0000","last_undegraded":"2023-11-28T18:38:35.015828+0000","last_fullsized":"2023-11-28T18:38:35.015828+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.019587+0000","last_change":"2023-11-28T18:38:35.019587+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.019587+0000","last_undegraded":"2023-11-28T18:38:35.019587+0000","last_fullsized":"2023-11-28T18:38:35.019587+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.018025+0000","last_change":"2023-11-28T18:38:35.018025+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.018025+0000","last_undegraded":"2023-11-28T18:38:35.018025+0000","last_fullsized":"2023-11-28T18:38:35.018025+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.027110+0000","last_change":"2023-11-28T18:38:35.027110+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.027110+0000","last_undegraded":"2023-11-28T18:38:35.027110+0000","last_fullsized":"2023-11-28T18:38:35.027110+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.027244+0000","last_change":"2023-11-28T18:38:35.027244+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.027244+0000","last_undegraded":"2023-11-28T18:38:35.027244+0000","last_fullsized":"2023-11-28T18:38:35.027244+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.030036+0000","last_change":"2023-11-28T18:38:35.030036+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.030036+0000","last_undegraded":"2023-11-28T18:38:35.030036+0000","last_fullsized":"2023-11-28T18:38:35.030036+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.018981+0000","last_change":"2023-11-28T18:38:35.018981+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.018981+0000","last_undegraded":"2023-11-28T18:38:35.018981+0000","last_fullsized":"2023-11-28T18:38:35.018981+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.016270+0000","last_change":"2023-11-28T18:38:35.016270+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.016270+0000","last_undegraded":"2023-11-28T18:38:35.016270+0000","last_fullsized":"2023-11-28T18:38:35.016270+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.028493+0000","last_change":"2023-11-28T18:38:35.028493+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.028493+0000","last_undegraded":"2023-11-28T18:38:35.028493+0000","last_fullsized":"2023-11-28T18:38:35.028493+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.026899+0000","last_change":"2023-11-28T18:38:35.026899+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.026899+0000","last_undegraded":"2023-11-28T18:38:35.026899+0000","last_fullsized":"2023-11-28T18:38:35.026899+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.029918+0000","last_change":"2023-11-28T18:38:35.029918+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.029918+0000","last_undegraded":"2023-11-28T18:38:35.029918+0000","last_fullsized":"2023-11-28T18:38:35.029918+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.020563+0000","last_change":"2023-11-28T18:38:35.020563+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.020563+0000","last_undegraded":"2023-11-28T18:38:35.020563+0000","last_fullsized":"2023-11-28T18:38:35.020563+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.043687+0000","last_change":"2023-11-28T18:38:35.042345+0000","last_active":"2023-11-28T18:38:35.043687+0000","last_peered":"2023-11-28T18:38:35.043687+0000","last_clean":"2023-11-28T18:38:35.043687+0000","last_became_active":"2023-11-28T18:38:35.042014+0000","last_became_peered":"2023-11-28T18:38:35.042014+0000","last_unstale":"2023-11-28T18:38:35.043687+0000","last_undegraded":"2023-11-28T18:38:35.043687+0000","last_fullsized":"2023-11-28T18:38:35.043687+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:06:47.136477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.025671+0000","last_change":"2023-11-28T18:38:35.025671+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.025671+0000","last_undegraded":"2023-11-28T18:38:35.025671+0000","last_fullsized":"2023-11-28T18:38:35.025671+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.045962+0000","last_change":"2023-11-28T18:38:35.044546+0000","last_active":"2023-11-28T18:38:35.045962+0000","last_peered":"2023-11-28T18:38:35.045962+0000","last_clean":"2023-11-28T18:38:35.045962+0000","last_became_active":"2023-11-28T18:38:35.044235+0000","last_became_peered":"2023-11-28T18:38:35.044235+0000","last_unstale":"2023-11-28T18:38:35.045962+0000","last_undegraded":"2023-11-28T18:38:35.045962+0000","last_fullsized":"2023-11-28T18:38:35.045962+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:34:41.136709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.016469+0000","last_change":"2023-11-28T18:38:35.016469+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.016469+0000","last_undegraded":"2023-11-28T18:38:35.016469+0000","last_fullsized":"2023-11-28T18:38:35.016469+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.044908+0000","last_change":"2023-11-28T18:38:35.040826+0000","last_active":"2023-11-28T18:38:35.044908+0000","last_peered":"2023-11-28T18:38:35.044908+0000","last_clean":"2023-11-28T18:38:35.044908+0000","last_became_active":"2023-11-28T18:38:35.040557+0000","last_became_peered":"2023-11-28T18:38:35.040557+0000","last_unstale":"2023-11-28T18:38:35.044908+0000","last_undegraded":"2023-11-28T18:38:35.044908+0000","last_fullsized":"2023-11-28T18:38:35.044908+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:52:24.975704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.029593+0000","last_change":"2023-11-28T18:38:35.029593+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.029593+0000","last_undegraded":"2023-11-28T18:38:35.029593+0000","last_fullsized":"2023-11-28T18:38:35.029593+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.042053+0000","last_change":"2023-11-28T18:38:35.038443+0000","last_active":"2023-11-28T18:38:35.042053+0000","last_peered":"2023-11-28T18:38:35.042053+0000","last_clean":"2023-11-28T18:38:35.042053+0000","last_became_active":"2023-11-28T18:38:35.037937+0000","last_became_peered":"2023-11-28T18:38:35.037937+0000","last_unstale":"2023-11-28T18:38:35.042053+0000","last_undegraded":"2023-11-28T18:38:35.042053+0000","last_fullsized":"2023-11-28T18:38:35.042053+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:32:55.075873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.027906+0000","last_change":"2023-11-28T18:38:35.027906+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.027906+0000","last_undegraded":"2023-11-28T18:38:35.027906+0000","last_fullsized":"2023-11-28T18:38:35.027906+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.026698+0000","last_change":"2023-11-28T18:38:35.022767+0000","last_active":"2023-11-28T18:38:35.026698+0000","last_peered":"2023-11-28T18:38:35.026698+0000","last_clean":"2023-11-28T18:38:35.026698+0000","last_became_active":"2023-11-28T18:38:35.022394+0000","last_became_peered":"2023-11-28T18:38:35.022394+0000","last_unstale":"2023-11-28T18:38:35.026698+0000","last_undegraded":"2023-11-28T18:38:35.026698+0000","last_fullsized":"2023-11-28T18:38:35.026698+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:21:35.227388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.020339+0000","last_change":"2023-11-28T18:38:35.020339+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.020339+0000","last_undegraded":"2023-11-28T18:38:35.020339+0000","last_fullsized":"2023-11-28T18:38:35.020339+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.036729+0000","last_change":"2023-11-28T18:38:35.033844+0000","last_active":"2023-11-28T18:38:35.036729+0000","last_peered":"2023-11-28T18:38:35.036729+0000","last_clean":"2023-11-28T18:38:35.036729+0000","last_became_active":"2023-11-28T18:38:35.033053+0000","last_became_peered":"2023-11-28T18:38:35.033053+0000","last_unstale":"2023-11-28T18:38:35.036729+0000","last_undegraded":"2023-11-28T18:38:35.036729+0000","last_fullsized":"2023-11-28T18:38:35.036729+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:32:55.075873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.016575+0000","last_change":"2023-11-28T18:38:35.016575+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.016575+0000","last_undegraded":"2023-11-28T18:38:35.016575+0000","last_fullsized":"2023-11-28T18:38:35.016575+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.037297+0000","last_change":"2023-11-28T18:38:35.034039+0000","last_active":"2023-11-28T18:38:35.037297+0000","last_peered":"2023-11-28T18:38:35.037297+0000","last_clean":"2023-11-28T18:38:35.037297+0000","last_became_active":"2023-11-28T18:38:35.033740+0000","last_became_peered":"2023-11-28T18:38:35.033740+0000","last_unstale":"2023-11-28T18:38:35.037297+0000","last_undegraded":"2023-11-28T18:38:35.037297+0000","last_fullsized":"2023-11-28T18:38:35.037297+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:06:47.136477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.022571+0000","last_change":"2023-11-28T18:38:35.022571+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.022571+0000","last_undegraded":"2023-11-28T18:38:35.022571+0000","last_fullsized":"2023-11-28T18:38:35.022571+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.036530+0000","last_change":"2023-11-28T18:38:35.032151+0000","last_active":"2023-11-28T18:38:35.036530+0000","last_peered":"2023-11-28T18:38:35.036530+0000","last_clean":"2023-11-28T18:38:35.036530+0000","last_became_active":"2023-11-28T18:38:35.031820+0000","last_became_peered":"2023-11-28T18:38:35.031820+0000","last_unstale":"2023-11-28T18:38:35.036530+0000","last_undegraded":"2023-11-28T18:38:35.036530+0000","last_fullsized":"2023-11-28T18:38:35.036530+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:32:53.815496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.018726+0000","last_change":"2023-11-28T18:38:35.018726+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.018726+0000","last_undegraded":"2023-11-28T18:38:35.018726+0000","last_fullsized":"2023-11-28T18:38:35.018726+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.045280+0000","last_change":"2023-11-28T18:38:35.044014+0000","last_active":"2023-11-28T18:38:35.045280+0000","last_peered":"2023-11-28T18:38:35.045280+0000","last_clean":"2023-11-28T18:38:35.045280+0000","last_became_active":"2023-11-28T18:38:35.042731+0000","last_became_peered":"2023-11-28T18:38:35.042731+0000","last_unstale":"2023-11-28T18:38:35.045280+0000","last_undegraded":"2023-11-28T18:38:35.045280+0000","last_fullsized":"2023-11-28T18:38:35.045280+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:06:48.055994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.023319+0000","last_change":"2023-11-28T18:38:35.023319+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.023319+0000","last_undegraded":"2023-11-28T18:38:35.023319+0000","last_fullsized":"2023-11-28T18:38:35.023319+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.044442+0000","last_change":"2023-11-28T18:38:35.041965+0000","last_active":"2023-11-28T18:38:35.044442+0000","last_peered":"2023-11-28T18:38:35.044442+0000","last_clean":"2023-11-28T18:38:35.044442+0000","last_became_active":"2023-11-28T18:38:35.041387+0000","last_became_peered":"2023-11-28T18:38:35.041387+0000","last_unstale":"2023-11-28T18:38:35.044442+0000","last_undegraded":"2023-11-28T18:38:35.044442+0000","last_fullsized":"2023-11-28T18:38:35.044442+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:06:47.136477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.022334+0000","last_change":"2023-11-28T18:38:35.022334+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.022334+0000","last_undegraded":"2023-11-28T18:38:35.022334+0000","last_fullsized":"2023-11-28T18:38:35.022334+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.045179+0000","last_change":"2023-11-28T18:38:35.043644+0000","last_active":"2023-11-28T18:38:35.045179+0000","last_peered":"2023-11-28T18:38:35.045179+0000","last_clean":"2023-11-28T18:38:35.045179+0000","last_became_active":"2023-11-28T18:38:35.043329+0000","last_became_peered":"2023-11-28T18:38:35.043329+0000","last_unstale":"2023-11-28T18:38:35.045179+0000","last_undegraded":"2023-11-28T18:38:35.045179+0000","last_fullsized":"2023-11-28T18:38:35.045179+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:58:12.029100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.021907+0000","last_change":"2023-11-28T18:38:35.021907+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.021907+0000","last_undegraded":"2023-11-28T18:38:35.021907+0000","last_fullsized":"2023-11-28T18:38:35.021907+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.037997+0000","last_change":"2023-11-28T18:38:35.035852+0000","last_active":"2023-11-28T18:38:35.037997+0000","last_peered":"2023-11-28T18:38:35.037997+0000","last_clean":"2023-11-28T18:38:35.037997+0000","last_became_active":"2023-11-28T18:38:35.035554+0000","last_became_peered":"2023-11-28T18:38:35.035554+0000","last_unstale":"2023-11-28T18:38:35.037997+0000","last_undegraded":"2023-11-28T18:38:35.037997+0000","last_fullsized":"2023-11-28T18:38:35.037997+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:48:52.205118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.023841+0000","last_change":"2023-11-28T18:38:35.023841+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.023841+0000","last_undegraded":"2023-11-28T18:38:35.023841+0000","last_fullsized":"2023-11-28T18:38:35.023841+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.037372+0000","last_change":"2023-11-28T18:38:35.031263+0000","last_active":"2023-11-28T18:38:35.037372+0000","last_peered":"2023-11-28T18:38:35.037372+0000","last_clean":"2023-11-28T18:38:35.037372+0000","last_became_active":"2023-11-28T18:38:35.031028+0000","last_became_peered":"2023-11-28T18:38:35.031028+0000","last_unstale":"2023-11-28T18:38:35.037372+0000","last_undegraded":"2023-11-28T18:38:35.037372+0000","last_fullsized":"2023-11-28T18:38:35.037372+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:22:15.084082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.022151+0000","last_change":"2023-11-28T18:38:35.022151+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.022151+0000","last_undegraded":"2023-11-28T18:38:35.022151+0000","last_fullsized":"2023-11-28T18:38:35.022151+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.046193+0000","last_change":"2023-11-28T18:38:35.044333+0000","last_active":"2023-11-28T18:38:35.046193+0000","last_peered":"2023-11-28T18:38:35.046193+0000","last_clean":"2023-11-28T18:38:35.046193+0000","last_became_active":"2023-11-28T18:38:35.043246+0000","last_became_peered":"2023-11-28T18:38:35.043246+0000","last_unstale":"2023-11-28T18:38:35.046193+0000","last_undegraded":"2023-11-28T18:38:35.046193+0000","last_fullsized":"2023-11-28T18:38:35.046193+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:07:08.162461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.029514+0000","last_change":"2023-11-28T18:38:35.029514+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.029514+0000","last_undegraded":"2023-11-28T18:38:35.029514+0000","last_fullsized":"2023-11-28T18:38:35.029514+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.041431+0000","last_change":"2023-11-28T18:38:35.039112+0000","last_active":"2023-11-28T18:38:35.041431+0000","last_peered":"2023-11-28T18:38:35.041431+0000","last_clean":"2023-11-28T18:38:35.041431+0000","last_became_active":"2023-11-28T18:38:35.038761+0000","last_became_peered":"2023-11-28T18:38:35.038761+0000","last_unstale":"2023-11-28T18:38:35.041431+0000","last_undegraded":"2023-11-28T18:38:35.041431+0000","last_fullsized":"2023-11-28T18:38:35.041431+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:57:34.906080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.026360+0000","last_change":"2023-11-28T18:38:35.026360+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.026360+0000","last_undegraded":"2023-11-28T18:38:35.026360+0000","last_fullsized":"2023-11-28T18:38:35.026360+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.042933+0000","last_change":"2023-11-28T18:38:35.039997+0000","last_active":"2023-11-28T18:38:35.042933+0000","last_peered":"2023-11-28T18:38:35.042933+0000","last_clean":"2023-11-28T18:38:35.042933+0000","last_became_active":"2023-11-28T18:38:35.039693+0000","last_became_peered":"2023-11-28T18:38:35.039693+0000","last_unstale":"2023-11-28T18:38:35.042933+0000","last_undegraded":"2023-11-28T18:38:35.042933+0000","last_fullsized":"2023-11-28T18:38:35.042933+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:11:13.755446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.016792+0000","last_change":"2023-11-28T18:38:35.016792+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.016792+0000","last_undegraded":"2023-11-28T18:38:35.016792+0000","last_fullsized":"2023-11-28T18:38:35.016792+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.046037+0000","last_change":"2023-11-28T18:38:35.043865+0000","last_active":"2023-11-28T18:38:35.046037+0000","last_peered":"2023-11-28T18:38:35.046037+0000","last_clean":"2023-11-28T18:38:35.046037+0000","last_became_active":"2023-11-28T18:38:35.043574+0000","last_became_peered":"2023-11-28T18:38:35.043574+0000","last_unstale":"2023-11-28T18:38:35.046037+0000","last_undegraded":"2023-11-28T18:38:35.046037+0000","last_fullsized":"2023-11-28T18:38:35.046037+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:52:24.975704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.021652+0000","last_change":"2023-11-28T18:38:35.021652+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.021652+0000","last_undegraded":"2023-11-28T18:38:35.021652+0000","last_fullsized":"2023-11-28T18:38:35.021652+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.042000+0000","last_change":"2023-11-28T18:38:35.038493+0000","last_active":"2023-11-28T18:38:35.042000+0000","last_peered":"2023-11-28T18:38:35.042000+0000","last_clean":"2023-11-28T18:38:35.042000+0000","last_became_active":"2023-11-28T18:38:35.038065+0000","last_became_peered":"2023-11-28T18:38:35.038065+0000","last_unstale":"2023-11-28T18:38:35.042000+0000","last_undegraded":"2023-11-28T18:38:35.042000+0000","last_fullsized":"2023-11-28T18:38:35.042000+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:44:34.044747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.026820+0000","last_change":"2023-11-28T18:38:35.026820+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.026820+0000","last_undegraded":"2023-11-28T18:38:35.026820+0000","last_fullsized":"2023-11-28T18:38:35.026820+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.039354+0000","last_change":"2023-11-28T18:38:35.036943+0000","last_active":"2023-11-28T18:38:35.039354+0000","last_peered":"2023-11-28T18:38:35.039354+0000","last_clean":"2023-11-28T18:38:35.039354+0000","last_became_active":"2023-11-28T18:38:35.036630+0000","last_became_peered":"2023-11-28T18:38:35.036630+0000","last_unstale":"2023-11-28T18:38:35.039354+0000","last_undegraded":"2023-11-28T18:38:35.039354+0000","last_fullsized":"2023-11-28T18:38:35.039354+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:40:01.118721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.023651+0000","last_change":"2023-11-28T18:38:35.023651+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.023651+0000","last_undegraded":"2023-11-28T18:38:35.023651+0000","last_fullsized":"2023-11-28T18:38:35.023651+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.027089+0000","last_change":"2023-11-28T18:38:35.023682+0000","last_active":"2023-11-28T18:38:35.027089+0000","last_peered":"2023-11-28T18:38:35.027089+0000","last_clean":"2023-11-28T18:38:35.027089+0000","last_became_active":"2023-11-28T18:38:35.022730+0000","last_became_peered":"2023-11-28T18:38:35.022730+0000","last_unstale":"2023-11-28T18:38:35.027089+0000","last_undegraded":"2023-11-28T18:38:35.027089+0000","last_fullsized":"2023-11-28T18:38:35.027089+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:13:17.633662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.021628+0000","last_change":"2023-11-28T18:38:35.021628+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.021628+0000","last_undegraded":"2023-11-28T18:38:35.021628+0000","last_fullsized":"2023-11-28T18:38:35.021628+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.040951+0000","last_change":"2023-11-28T18:38:35.033842+0000","last_active":"2023-11-28T18:38:35.040951+0000","last_peered":"2023-11-28T18:38:35.040951+0000","last_clean":"2023-11-28T18:38:35.040951+0000","last_became_active":"2023-11-28T18:38:35.033482+0000","last_became_peered":"2023-11-28T18:38:35.033482+0000","last_unstale":"2023-11-28T18:38:35.040951+0000","last_undegraded":"2023-11-28T18:38:35.040951+0000","last_fullsized":"2023-11-28T18:38:35.040951+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:47:24.249639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.023141+0000","last_change":"2023-11-28T18:38:35.023141+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.023141+0000","last_undegraded":"2023-11-28T18:38:35.023141+0000","last_fullsized":"2023-11-28T18:38:35.023141+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.042583+0000","last_change":"2023-11-28T18:38:35.040401+0000","last_active":"2023-11-28T18:38:35.042583+0000","last_peered":"2023-11-28T18:38:35.042583+0000","last_clean":"2023-11-28T18:38:35.042583+0000","last_became_active":"2023-11-28T18:38:35.039986+0000","last_became_peered":"2023-11-28T18:38:35.039986+0000","last_unstale":"2023-11-28T18:38:35.042583+0000","last_undegraded":"2023-11-28T18:38:35.042583+0000","last_fullsized":"2023-11-28T18:38:35.042583+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:34:41.136709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.022670+0000","last_change":"2023-11-28T18:38:35.022670+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.022670+0000","last_undegraded":"2023-11-28T18:38:35.022670+0000","last_fullsized":"2023-11-28T18:38:35.022670+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.041967+0000","last_change":"2023-11-28T18:38:35.037979+0000","last_active":"2023-11-28T18:38:35.041967+0000","last_peered":"2023-11-28T18:38:35.041967+0000","last_clean":"2023-11-28T18:38:35.041967+0000","last_became_active":"2023-11-28T18:38:35.037674+0000","last_became_peered":"2023-11-28T18:38:35.037674+0000","last_unstale":"2023-11-28T18:38:35.041967+0000","last_undegraded":"2023-11-28T18:38:35.041967+0000","last_fullsized":"2023-11-28T18:38:35.041967+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:52:33.974326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.032944+0000","last_change":"2023-11-28T18:38:35.032944+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.032944+0000","last_undegraded":"2023-11-28T18:38:35.032944+0000","last_fullsized":"2023-11-28T18:38:35.032944+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.034841+0000","last_change":"2023-11-28T18:38:35.031421+0000","last_active":"2023-11-28T18:38:35.034841+0000","last_peered":"2023-11-28T18:38:35.034841+0000","last_clean":"2023-11-28T18:38:35.034841+0000","last_became_active":"2023-11-28T18:38:35.031138+0000","last_became_peered":"2023-11-28T18:38:35.031138+0000","last_unstale":"2023-11-28T18:38:35.034841+0000","last_undegraded":"2023-11-28T18:38:35.034841+0000","last_fullsized":"2023-11-28T18:38:35.034841+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:51:52.296626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.022643+0000","last_change":"2023-11-28T18:38:35.022643+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.022643+0000","last_undegraded":"2023-11-28T18:38:35.022643+0000","last_fullsized":"2023-11-28T18:38:35.022643+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.045769+0000","last_change":"2023-11-28T18:38:35.042278+0000","last_active":"2023-11-28T18:38:35.045769+0000","last_peered":"2023-11-28T18:38:35.045769+0000","last_clean":"2023-11-28T18:38:35.045769+0000","last_became_active":"2023-11-28T18:38:35.041885+0000","last_became_peered":"2023-11-28T18:38:35.041885+0000","last_unstale":"2023-11-28T18:38:35.045769+0000","last_undegraded":"2023-11-28T18:38:35.045769+0000","last_fullsized":"2023-11-28T18:38:35.045769+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:06:47.136477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.021241+0000","last_change":"2023-11-28T18:38:35.021241+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.021241+0000","last_undegraded":"2023-11-28T18:38:35.021241+0000","last_fullsized":"2023-11-28T18:38:35.021241+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.041637+0000","last_change":"2023-11-28T18:38:35.036513+0000","last_active":"2023-11-28T18:38:35.041637+0000","last_peered":"2023-11-28T18:38:35.041637+0000","last_clean":"2023-11-28T18:38:35.041637+0000","last_became_active":"2023-11-28T18:38:35.036218+0000","last_became_peered":"2023-11-28T18:38:35.036218+0000","last_unstale":"2023-11-28T18:38:35.041637+0000","last_undegraded":"2023-11-28T18:38:35.041637+0000","last_fullsized":"2023-11-28T18:38:35.041637+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:52:24.975704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.019286+0000","last_change":"2023-11-28T18:38:35.019286+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.019286+0000","last_undegraded":"2023-11-28T18:38:35.019286+0000","last_fullsized":"2023-11-28T18:38:35.019286+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.045742+0000","last_change":"2023-11-28T18:38:35.042254+0000","last_active":"2023-11-28T18:38:35.045742+0000","last_peered":"2023-11-28T18:38:35.045742+0000","last_clean":"2023-11-28T18:38:35.045742+0000","last_became_active":"2023-11-28T18:38:35.041942+0000","last_became_peered":"2023-11-28T18:38:35.041942+0000","last_unstale":"2023-11-28T18:38:35.045742+0000","last_undegraded":"2023-11-28T18:38:35.045742+0000","last_fullsized":"2023-11-28T18:38:35.045742+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:34:41.136709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.027923+0000","last_change":"2023-11-28T18:38:35.027923+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.027923+0000","last_undegraded":"2023-11-28T18:38:35.027923+0000","last_fullsized":"2023-11-28T18:38:35.027923+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.033955+0000","last_change":"2023-11-28T18:38:35.029334+0000","last_active":"2023-11-28T18:38:35.033955+0000","last_peered":"2023-11-28T18:38:35.033955+0000","last_clean":"2023-11-28T18:38:35.033955+0000","last_became_active":"2023-11-28T18:38:35.029088+0000","last_became_peered":"2023-11-28T18:38:35.029088+0000","last_unstale":"2023-11-28T18:38:35.033955+0000","last_undegraded":"2023-11-28T18:38:35.033955+0000","last_fullsized":"2023-11-28T18:38:35.033955+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:07:08.162461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.019528+0000","last_change":"2023-11-28T18:38:35.019528+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.019528+0000","last_undegraded":"2023-11-28T18:38:35.019528+0000","last_fullsized":"2023-11-28T18:38:35.019528+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.038195+0000","last_change":"2023-11-28T18:38:35.036038+0000","last_active":"2023-11-28T18:38:35.038195+0000","last_peered":"2023-11-28T18:38:35.038195+0000","last_clean":"2023-11-28T18:38:35.038195+0000","last_became_active":"2023-11-28T18:38:35.035686+0000","last_became_peered":"2023-11-28T18:38:35.035686+0000","last_unstale":"2023-11-28T18:38:35.038195+0000","last_undegraded":"2023-11-28T18:38:35.038195+0000","last_fullsized":"2023-11-28T18:38:35.038195+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:47:24.249639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.026252+0000","last_change":"2023-11-28T18:38:35.026252+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.026252+0000","last_undegraded":"2023-11-28T18:38:35.026252+0000","last_fullsized":"2023-11-28T18:38:35.026252+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.037853+0000","last_change":"2023-11-28T18:38:35.035526+0000","last_active":"2023-11-28T18:38:35.037853+0000","last_peered":"2023-11-28T18:38:35.037853+0000","last_clean":"2023-11-28T18:38:35.037853+0000","last_became_active":"2023-11-28T18:38:35.034566+0000","last_became_peered":"2023-11-28T18:38:35.034566+0000","last_unstale":"2023-11-28T18:38:35.037853+0000","last_undegraded":"2023-11-28T18:38:35.037853+0000","last_fullsized":"2023-11-28T18:38:35.037853+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:24:41.379481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.018130+0000","last_change":"2023-11-28T18:38:35.018130+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.018130+0000","last_undegraded":"2023-11-28T18:38:35.018130+0000","last_fullsized":"2023-11-28T18:38:35.018130+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.044594+0000","last_change":"2023-11-28T18:38:35.043063+0000","last_active":"2023-11-28T18:38:35.044594+0000","last_peered":"2023-11-28T18:38:35.044594+0000","last_clean":"2023-11-28T18:38:35.044594+0000","last_became_active":"2023-11-28T18:38:35.042719+0000","last_became_peered":"2023-11-28T18:38:35.042719+0000","last_unstale":"2023-11-28T18:38:35.044594+0000","last_undegraded":"2023-11-28T18:38:35.044594+0000","last_fullsized":"2023-11-28T18:38:35.044594+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:00:43.620322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.031614+0000","last_change":"2023-11-28T18:38:35.031614+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.031614+0000","last_undegraded":"2023-11-28T18:38:35.031614+0000","last_fullsized":"2023-11-28T18:38:35.031614+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.042502+0000","last_change":"2023-11-28T18:38:35.040261+0000","last_active":"2023-11-28T18:38:35.042502+0000","last_peered":"2023-11-28T18:38:35.042502+0000","last_clean":"2023-11-28T18:38:35.042502+0000","last_became_active":"2023-11-28T18:38:35.040006+0000","last_became_peered":"2023-11-28T18:38:35.040006+0000","last_unstale":"2023-11-28T18:38:35.042502+0000","last_undegraded":"2023-11-28T18:38:35.042502+0000","last_fullsized":"2023-11-28T18:38:35.042502+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:07:08.162461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":174,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T18:38:34.015523+0000","last_change":"2023-11-28T18:37:22.369132+0000","last_active":"2023-11-28T18:38:34.015523+0000","last_peered":"2023-11-28T18:38:34.015523+0000","last_clean":"2023-11-28T18:38:34.015523+0000","last_became_active":"2023-11-28T18:37:22.368142+0000","last_became_peered":"2023-11-28T18:37:22.368142+0000","last_unstale":"2023-11-28T18:38:34.015523+0000","last_undegraded":"2023-11-28T18:38:34.015523+0000","last_fullsized":"2023-11-28T18:38:34.015523+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:21.313053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:21.313053+0000","last_clean_scrub_stamp":"2023-11-28T18:37:21.313053+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:55:01.432028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":942080,"data_stored":722803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":4.8559999999999999,"5min":4.8559999999999999,"15min":4.8559999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":4.8319999999999999,"5min":4.8319999999999999,"15min":4.8319999999999999},"last":0.67500000000000004}]},{"osd":1,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":4.8109999999999999,"5min":4.8109999999999999,"15min":4.8109999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":4.8700000000000001,"5min":4.8700000000000001,"15min":4.8700000000000001},"last":0.71999999999999997}]},{"osd":2,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.76300000000000001}]},{"osd":3,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":4.7619999999999996,"5min":4.7619999999999996,"15min":4.7619999999999996},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.63700000000000001}]},{"osd":4,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.502},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.57299999999999995}]},{"osd":5,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.433}]},{"osd":6,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.52700000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":132435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 18:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.78100000000000003}]},{"osd":1,"last update":"Tue Nov 28 18:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.81999999999999995}]},{"osd":2,"last update":"Tue Nov 28 18:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.622}]},{"osd":3,"last update":"Tue Nov 28 18:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.63400000000000001}]},{"osd":4,"last update":"Tue Nov 28 18:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.59199999999999997}]},{"osd":5,"last update":"Tue Nov 28 18:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.747}]},{"osd":7,"last update":"Tue Nov 28 18:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.76500000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":138702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.77100000000000002}]},{"osd":1,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.86099999999999999}]},{"osd":2,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.82799999999999996}]},{"osd":3,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.92800000000000005}]},{"osd":4,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.753},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.72999999999999998}]},{"osd":6,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.67300000000000004}]},{"osd":7,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.88100000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":132435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":3.5179999999999998,"5min":3.5179999999999998,"15min":3.5179999999999998},"last":0.56100000000000005}]},{"osd":1,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":3.5019999999999998,"5min":3.5019999999999998,"15min":3.5019999999999998},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":3.5630000000000002,"5min":3.5630000000000002,"15min":3.5630000000000002},"last":0.70199999999999996}]},{"osd":2,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":3.6709999999999998,"5min":3.6709999999999998,"15min":3.6709999999999998},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":3.4849999999999999,"5min":3.4849999999999999,"15min":3.4849999999999999},"last":0.59699999999999998}]},{"osd":3,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":3.7130000000000001,"5min":3.7130000000000001,"15min":3.7130000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.80100000000000005}]},{"osd":5,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.75600000000000001}]},{"osd":6,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.718,"5min":1.718,"15min":1.718},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.77700000000000002}]},{"osd":7,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.83199999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":348160,"data_stored":132435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 18:38:22 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.54200000000000004}]},{"osd":1,"last update":"Tue Nov 28 18:38:22 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.59799999999999998}]},{"osd":2,"last update":"Tue Nov 28 18:38:22 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.624},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.63700000000000001}]},{"osd":4,"last update":"Tue Nov 28 18:38:22 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.88800000000000001}]},{"osd":5,"last update":"Tue Nov 28 18:38:22 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.91500000000000004}]},{"osd":6,"last update":"Tue Nov 28 18:38:22 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":0.98799999999999999}]},{"osd":7,"last update":"Tue Nov 28 18:38:22 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.92800000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":348160,"data_stored":132435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 18:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":0.45700000000000002}]},{"osd":1,"last update":"Tue Nov 28 18:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.47799999999999998}]},{"osd":3,"last update":"Tue Nov 28 18:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.439},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.41899999999999998}]},{"osd":4,"last update":"Tue Nov 28 18:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":0.56100000000000005}]},{"osd":5,"last update":"Tue Nov 28 18:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.69999999999999996}]},{"osd":6,"last update":"Tue Nov 28 18:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.7070000000000001,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.56999999999999995}]},{"osd":7,"last update":"Tue Nov 28 18:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.7509999999999999,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.65700000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":348160,"data_stored":132435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":2.2090000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":4.0899999999999999,"5min":4.0899999999999999,"15min":4.0899999999999999},"last":0.372}]},{"osd":2,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":3.8620000000000001,"5min":3.8620000000000001,"15min":3.8620000000000001},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":2.823,"5min":2.823,"15min":2.823},"last":0.41699999999999998}]},{"osd":3,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":4.0739999999999998,"5min":4.0739999999999998,"15min":4.0739999999999998},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":3.6659999999999999,"5min":3.6659999999999999,"15min":3.6659999999999999},"last":0.52000000000000002}]},{"osd":4,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":5.3540000000000001,"5min":5.3540000000000001,"15min":5.3540000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":5.5,"5min":5.5,"15min":5.5},"last":0.58299999999999996}]},{"osd":5,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":5.4379999999999997,"5min":5.4379999999999997,"15min":5.4379999999999997},"last":0.71599999999999997},{"interface":"front","average":{"1min":1.129,"5min":1.129,"15min":1.129},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":3.4500000000000002,"5min":3.4500000000000002,"15min":3.4500000000000002},"last":0.745}]},{"osd":6,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":3.0369999999999999,"5min":3.0369999999999999,"15min":3.0369999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":5.4000000000000004,"5min":5.4000000000000004,"15min":5.4000000000000004},"last":0.59499999999999997}]},{"osd":7,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":5.5369999999999999,"5min":5.5369999999999999,"15min":5.5369999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":3.2480000000000002,"5min":3.2480000000000002,"15min":3.2480000000000002},"last":0.69999999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32100,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339740,"statfs":{"total":96636764160,"available":96603893760,"internally_reserved":0,"allocated":942080,"data_stored":722803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 18:38:22 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.432},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.51800000000000002}]},{"osd":2,"last update":"Tue Nov 28 18:38:22 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.503},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.38100000000000001}]},{"osd":3,"last update":"Tue Nov 28 18:38:22 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.46999999999999997}]},{"osd":4,"last update":"Tue Nov 28 18:38:22 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.879},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.84399999999999997}]},{"osd":5,"last update":"Tue Nov 28 18:38:22 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.66000000000000003}]},{"osd":6,"last update":"Tue Nov 28 18:38:22 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1,"5min":1,"15min":1},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.76100000000000001}]},{"osd":7,"last update":"Tue Nov 28 18:38:22 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.73999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T18:38:40.555 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T18:38:40.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.733+0000 7f7fb529c640 1 Processor -- start 2023-11-28T18:38:40.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.733+0000 7f7fb529c640 1 -- start start 2023-11-28T18:38:40.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.737+0000 7f7fb529c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f7fb006ca10 0x7f7fb015a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:40.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.737+0000 7f7fb529c640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fb015b3e0 con 0x7f7fb015abb0 2023-11-28T18:38:40.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.737+0000 7f7fb529c640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fb013f760 con 0x7f7fb013cf70 2023-11-28T18:38:40.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.737+0000 7f7fb529c640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fb013d350 con 0x7f7fb006ca10 2023-11-28T18:38:40.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.737+0000 7f7faf7fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f7fb015abb0 0x7f7fb00cd8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33848/0 (socket says 172.21.15.45:33848) 2023-11-28T18:38:40.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.737+0000 7f7faf7fe640 1 -- 172.21.15.45:0/3425878266 learned_addr learned my addr 172.21.15.45:0/3425878266 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:38:40.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.737+0000 7f7fae7fc640 1 --2- 172.21.15.45:0/3425878266 >> v2:172.21.15.190:3300/0 conn(0x7f7fb006ca10 0x7f7fb015a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:40.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.737+0000 7f7fadffb640 1 -- 172.21.15.45:0/3425878266 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1776970138 0 0) 0x7f7fb015b3e0 con 0x7f7fb015abb0 2023-11-28T18:38:40.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.737+0000 7f7fadffb640 1 -- 172.21.15.45:0/3425878266 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f98003530 con 0x7f7fb015abb0 2023-11-28T18:38:40.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.737+0000 7f7fadffb640 1 -- 172.21.15.45:0/3425878266 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 776343006 0 0) 0x7f7fb013f760 con 0x7f7fb013cf70 2023-11-28T18:38:40.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.737+0000 7f7fadffb640 1 -- 172.21.15.45:0/3425878266 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fb015b3e0 con 0x7f7fb013cf70 2023-11-28T18:38:40.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.737+0000 7f7fae7fc640 1 -- 172.21.15.45:0/3425878266 >> v1:172.21.15.190:6789/0 conn(0x7f7fb013cf70 legacy=0x7f7fb006c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:40.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.737+0000 7f7fadffb640 1 -- 172.21.15.45:0/3425878266 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4156721019 0 0) 0x7f7f98003530 con 0x7f7fb015abb0 2023-11-28T18:38:40.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.737+0000 7f7fae7fc640 1 -- 172.21.15.45:0/3425878266 >> v1:172.21.15.45:6789/0 conn(0x7f7fb015abb0 legacy=0x7f7fb00cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:40.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.737+0000 7f7fae7fc640 1 -- 172.21.15.45:0/3425878266 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb013fa40 con 0x7f7fb006ca10 2023-11-28T18:38:40.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.741+0000 7f7fae7fc640 1 --2- 172.21.15.45:0/3425878266 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7fb006ca10 0x7f7fb015a670 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7fa40097c0 tx=0x7f7fa401c310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4364abcdff317ad server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:40.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.741+0000 7f7fadffb640 1 -- 172.21.15.45:0/3425878266 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa8001a00 con 0x7f7fb006ca10 2023-11-28T18:38:40.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.741+0000 7f7fadffb640 1 -- 172.21.15.45:0/3425878266 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa40a7050 con 0x7f7fb006ca10 2023-11-28T18:38:40.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.741+0000 7f7fadffb640 1 -- 172.21.15.45:0/3425878266 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa40ab620 con 0x7f7fb006ca10 2023-11-28T18:38:40.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.741+0000 7f7fb529c640 1 -- 172.21.15.45:0/3425878266 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7fb006ca10 msgr2=0x7f7fb015a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:40.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.741+0000 7f7fb529c640 1 --2- 172.21.15.45:0/3425878266 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7fb006ca10 0x7f7fb015a670 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7fa40097c0 tx=0x7f7fa401c310 comp rx=0 tx=0).stop 2023-11-28T18:38:40.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.741+0000 7f7fb529c640 1 -- 172.21.15.45:0/3425878266 shutdown_connections 2023-11-28T18:38:40.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.741+0000 7f7fb529c640 1 --2- 172.21.15.45:0/3425878266 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7fb006ca10 0x7f7fb015a670 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:40.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.741+0000 7f7fb529c640 1 -- 172.21.15.45:0/3425878266 >> 172.21.15.45:0/3425878266 conn(0x7f7fb006a570 msgr2=0x7f7fb006a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:40.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.741+0000 7f7fb529c640 1 -- 172.21.15.45:0/3425878266 shutdown_connections 2023-11-28T18:38:40.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.741+0000 7f7fb529c640 1 -- 172.21.15.45:0/3425878266 wait complete. 2023-11-28T18:38:40.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.741+0000 7f7fb529c640 1 Processor -- start 2023-11-28T18:38:40.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.741+0000 7f7fb529c640 1 -- start start 2023-11-28T18:38:40.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.745+0000 7f7fb529c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7fb006ca10 0x7f7fb01503c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:40.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.745+0000 7f7fb529c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7fb013cf70 0x7f7fb0154b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:40.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.745+0000 7f7fb529c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7fb015abb0 0x7f7fb0135770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:40.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.745+0000 7f7fb529c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb0135cb0 con 0x7f7fb015abb0 2023-11-28T18:38:40.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.745+0000 7f7fb529c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb0070ba0 con 0x7f7fb013cf70 2023-11-28T18:38:40.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.745+0000 7f7fb529c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb0070e80 con 0x7f7fb006ca10 2023-11-28T18:38:40.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.745+0000 7f7faf7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7fb015abb0 0x7f7fb0135770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:40.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.745+0000 7f7faf7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7fb015abb0 0x7f7fb0135770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58504/0 (socket says 172.21.15.45:58504) 2023-11-28T18:38:40.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.745+0000 7f7faf7fe640 1 -- 172.21.15.45:0/4111632073 learned_addr learned my addr 172.21.15.45:0/4111632073 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:40.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.745+0000 7f7fae7fc640 1 --2- 172.21.15.45:0/4111632073 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7fb013cf70 0x7f7fb0154b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:40.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.745+0000 7f7faeffd640 1 --2- 172.21.15.45:0/4111632073 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7fb006ca10 0x7f7fb01503c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:40.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.745+0000 7f7faf7fe640 1 -- 172.21.15.45:0/4111632073 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7fb006ca10 msgr2=0x7f7fb01503c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:40.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.745+0000 7f7faf7fe640 1 --2- 172.21.15.45:0/4111632073 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7fb006ca10 0x7f7fb01503c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:40.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.745+0000 7f7faf7fe640 1 -- 172.21.15.45:0/4111632073 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7fb013cf70 msgr2=0x7f7fb0154b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:40.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.745+0000 7f7faf7fe640 1 --2- 172.21.15.45:0/4111632073 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7fb013cf70 0x7f7fb0154b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:40.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.745+0000 7f7faf7fe640 1 -- 172.21.15.45:0/4111632073 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa4009420 con 0x7f7fb015abb0 2023-11-28T18:38:40.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.745+0000 7f7faf7fe640 1 --2- 172.21.15.45:0/4111632073 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7fb015abb0 0x7f7fb0135770 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f7fa800cc60 tx=0x7f7fa800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:40.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.745+0000 7f7f977fe640 1 -- 172.21.15.45:0/4111632073 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa800ce70 con 0x7f7fb015abb0 2023-11-28T18:38:40.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.745+0000 7f7f977fe640 1 -- 172.21.15.45:0/4111632073 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa8012400 con 0x7f7fb015abb0 2023-11-28T18:38:40.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.745+0000 7f7f977fe640 1 -- 172.21.15.45:0/4111632073 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa80127b0 con 0x7f7fb015abb0 2023-11-28T18:38:40.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.745+0000 7f7fb529c640 1 -- 172.21.15.45:0/4111632073 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fb0071160 con 0x7f7fb015abb0 2023-11-28T18:38:40.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.745+0000 7f7fb529c640 1 -- 172.21.15.45:0/4111632073 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fb0070890 con 0x7f7fb015abb0 2023-11-28T18:38:40.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.745+0000 7f7fb529c640 1 -- 172.21.15.45:0/4111632073 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fb01360d0 con 0x7f7fb015abb0 2023-11-28T18:38:40.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.745+0000 7f7f977fe640 1 -- 172.21.15.45:0/4111632073 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f7fa8012910 con 0x7f7fb015abb0 2023-11-28T18:38:40.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.749+0000 7f7f977fe640 1 --2- 172.21.15.45:0/4111632073 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f7f9c066920 0x7f7f9c068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:40.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.749+0000 7f7f977fe640 1 -- 172.21.15.45:0/4111632073 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7fa8084a40 con 0x7f7fb015abb0 2023-11-28T18:38:40.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.749+0000 7f7faeffd640 1 --2- 172.21.15.45:0/4111632073 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f7f9c066920 0x7f7f9c068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:40.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.749+0000 7f7faeffd640 1 --2- 172.21.15.45:0/4111632073 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f7f9c066920 0x7f7f9c068de0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7fa00011f0 tx=0x7f7fa0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:40.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.753+0000 7f7f977fe640 1 -- 172.21.15.45:0/4111632073 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7fb01360d0 con 0x7f7fb015abb0 2023-11-28T18:38:40.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.913+0000 7f7fb529c640 1 -- 172.21.15.45:0/4111632073 --> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7fb0070ff0 con 0x7f7f9c066920 2023-11-28T18:38:40.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.921+0000 7f7f977fe640 1 -- 172.21.15.45:0/4111632073 <== mgr.4100 v2:172.21.15.190:6832/645101166 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283709 (secure 0 0 0) 0x7f7fb0070ff0 con 0x7f7f9c066920 2023-11-28T18:38:40.926 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:38:40.927 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-11-28T18:38:40.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.925+0000 7f7fb529c640 1 -- 172.21.15.45:0/4111632073 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f7f9c066920 msgr2=0x7f7f9c068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:40.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.925+0000 7f7fb529c640 1 --2- 172.21.15.45:0/4111632073 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f7f9c066920 0x7f7f9c068de0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7fa00011f0 tx=0x7f7fa0009040 comp rx=0 tx=0).stop 2023-11-28T18:38:40.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.925+0000 7f7fb529c640 1 -- 172.21.15.45:0/4111632073 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7fb015abb0 msgr2=0x7f7fb0135770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:40.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.925+0000 7f7fb529c640 1 --2- 172.21.15.45:0/4111632073 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7fb015abb0 0x7f7fb0135770 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f7fa800cc60 tx=0x7f7fa800a430 comp rx=0 tx=0).stop 2023-11-28T18:38:40.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.925+0000 7f7fb529c640 1 -- 172.21.15.45:0/4111632073 shutdown_connections 2023-11-28T18:38:40.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.925+0000 7f7fb529c640 1 --2- 172.21.15.45:0/4111632073 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f7f9c066920 0x7f7f9c068de0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:40.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.925+0000 7f7fb529c640 1 --2- 172.21.15.45:0/4111632073 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7fb015abb0 0x7f7fb0135770 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:40.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.925+0000 7f7fb529c640 1 --2- 172.21.15.45:0/4111632073 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7fb013cf70 0x7f7fb0154b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:40.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.925+0000 7f7fb529c640 1 --2- 172.21.15.45:0/4111632073 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7fb006ca10 0x7f7fb01503c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:40.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.925+0000 7f7fb529c640 1 -- 172.21.15.45:0/4111632073 >> 172.21.15.45:0/4111632073 conn(0x7f7fb006a570 msgr2=0x7f7fb00cd880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:40.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.925+0000 7f7fb529c640 1 -- 172.21.15.45:0/4111632073 shutdown_connections 2023-11-28T18:38:40.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:40.925+0000 7f7fb529c640 1 -- 172.21.15.45:0/4111632073 wait complete. 2023-11-28T18:38:40.946 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2023-11-28T18:38:39.248523+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":6,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236696,"kb_used_data":3892,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738024,"statfs":{"total":773094113280,"available":772851736576,"internally_reserved":0,"allocated":3985408,"data_stored":2246483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.239837"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.026765+0000","last_change":"2023-11-28T18:38:35.026765+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.026765+0000","last_undegraded":"2023-11-28T18:38:35.026765+0000","last_fullsized":"2023-11-28T18:38:35.026765+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.028264+0000","last_change":"2023-11-28T18:38:35.028264+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.028264+0000","last_undegraded":"2023-11-28T18:38:35.028264+0000","last_fullsized":"2023-11-28T18:38:35.028264+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.021342+0000","last_change":"2023-11-28T18:38:35.021342+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.021342+0000","last_undegraded":"2023-11-28T18:38:35.021342+0000","last_fullsized":"2023-11-28T18:38:35.021342+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.030480+0000","last_change":"2023-11-28T18:38:35.030480+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.030480+0000","last_undegraded":"2023-11-28T18:38:35.030480+0000","last_fullsized":"2023-11-28T18:38:35.030480+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.024376+0000","last_change":"2023-11-28T18:38:35.024376+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.024376+0000","last_undegraded":"2023-11-28T18:38:35.024376+0000","last_fullsized":"2023-11-28T18:38:35.024376+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.025354+0000","last_change":"2023-11-28T18:38:35.025354+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.025354+0000","last_undegraded":"2023-11-28T18:38:35.025354+0000","last_fullsized":"2023-11-28T18:38:35.025354+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.025165+0000","last_change":"2023-11-28T18:38:35.025165+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.025165+0000","last_undegraded":"2023-11-28T18:38:35.025165+0000","last_fullsized":"2023-11-28T18:38:35.025165+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.030364+0000","last_change":"2023-11-28T18:38:35.030364+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.030364+0000","last_undegraded":"2023-11-28T18:38:35.030364+0000","last_fullsized":"2023-11-28T18:38:35.030364+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.016603+0000","last_change":"2023-11-28T18:38:35.016603+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.016603+0000","last_undegraded":"2023-11-28T18:38:35.016603+0000","last_fullsized":"2023-11-28T18:38:35.016603+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.028332+0000","last_change":"2023-11-28T18:38:35.028332+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.028332+0000","last_undegraded":"2023-11-28T18:38:35.028332+0000","last_fullsized":"2023-11-28T18:38:35.028332+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.035054+0000","last_change":"2023-11-28T18:38:35.035054+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.035054+0000","last_undegraded":"2023-11-28T18:38:35.035054+0000","last_fullsized":"2023-11-28T18:38:35.035054+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.019498+0000","last_change":"2023-11-28T18:38:35.019498+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.019498+0000","last_undegraded":"2023-11-28T18:38:35.019498+0000","last_fullsized":"2023-11-28T18:38:35.019498+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.023737+0000","last_change":"2023-11-28T18:38:35.023737+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.023737+0000","last_undegraded":"2023-11-28T18:38:35.023737+0000","last_fullsized":"2023-11-28T18:38:35.023737+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.024782+0000","last_change":"2023-11-28T18:38:35.024782+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.024782+0000","last_undegraded":"2023-11-28T18:38:35.024782+0000","last_fullsized":"2023-11-28T18:38:35.024782+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.020038+0000","last_change":"2023-11-28T18:38:35.020038+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.020038+0000","last_undegraded":"2023-11-28T18:38:35.020038+0000","last_fullsized":"2023-11-28T18:38:35.020038+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.024418+0000","last_change":"2023-11-28T18:38:35.024418+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.024418+0000","last_undegraded":"2023-11-28T18:38:35.024418+0000","last_fullsized":"2023-11-28T18:38:35.024418+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.037840+0000","last_change":"2023-11-28T18:38:35.037840+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.037840+0000","last_undegraded":"2023-11-28T18:38:35.037840+0000","last_fullsized":"2023-11-28T18:38:35.037840+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.027775+0000","last_change":"2023-11-28T18:38:35.027775+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.027775+0000","last_undegraded":"2023-11-28T18:38:35.027775+0000","last_fullsized":"2023-11-28T18:38:35.027775+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.024051+0000","last_change":"2023-11-28T18:38:35.024051+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.024051+0000","last_undegraded":"2023-11-28T18:38:35.024051+0000","last_fullsized":"2023-11-28T18:38:35.024051+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.022099+0000","last_change":"2023-11-28T18:38:35.022099+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.022099+0000","last_undegraded":"2023-11-28T18:38:35.022099+0000","last_fullsized":"2023-11-28T18:38:35.022099+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.017937+0000","last_change":"2023-11-28T18:38:35.017937+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.017937+0000","last_undegraded":"2023-11-28T18:38:35.017937+0000","last_fullsized":"2023-11-28T18:38:35.017937+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.015828+0000","last_change":"2023-11-28T18:38:35.015828+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.015828+0000","last_undegraded":"2023-11-28T18:38:35.015828+0000","last_fullsized":"2023-11-28T18:38:35.015828+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.019587+0000","last_change":"2023-11-28T18:38:35.019587+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.019587+0000","last_undegraded":"2023-11-28T18:38:35.019587+0000","last_fullsized":"2023-11-28T18:38:35.019587+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.018025+0000","last_change":"2023-11-28T18:38:35.018025+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.018025+0000","last_undegraded":"2023-11-28T18:38:35.018025+0000","last_fullsized":"2023-11-28T18:38:35.018025+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.027110+0000","last_change":"2023-11-28T18:38:35.027110+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.027110+0000","last_undegraded":"2023-11-28T18:38:35.027110+0000","last_fullsized":"2023-11-28T18:38:35.027110+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.027244+0000","last_change":"2023-11-28T18:38:35.027244+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.027244+0000","last_undegraded":"2023-11-28T18:38:35.027244+0000","last_fullsized":"2023-11-28T18:38:35.027244+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.030036+0000","last_change":"2023-11-28T18:38:35.030036+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.030036+0000","last_undegraded":"2023-11-28T18:38:35.030036+0000","last_fullsized":"2023-11-28T18:38:35.030036+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.018981+0000","last_change":"2023-11-28T18:38:35.018981+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.018981+0000","last_undegraded":"2023-11-28T18:38:35.018981+0000","last_fullsized":"2023-11-28T18:38:35.018981+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.016270+0000","last_change":"2023-11-28T18:38:35.016270+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.016270+0000","last_undegraded":"2023-11-28T18:38:35.016270+0000","last_fullsized":"2023-11-28T18:38:35.016270+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.028493+0000","last_change":"2023-11-28T18:38:35.028493+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.028493+0000","last_undegraded":"2023-11-28T18:38:35.028493+0000","last_fullsized":"2023-11-28T18:38:35.028493+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.026899+0000","last_change":"2023-11-28T18:38:35.026899+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.026899+0000","last_undegraded":"2023-11-28T18:38:35.026899+0000","last_fullsized":"2023-11-28T18:38:35.026899+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.029918+0000","last_change":"2023-11-28T18:38:35.029918+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.029918+0000","last_undegraded":"2023-11-28T18:38:35.029918+0000","last_fullsized":"2023-11-28T18:38:35.029918+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.020563+0000","last_change":"2023-11-28T18:38:35.020563+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.020563+0000","last_undegraded":"2023-11-28T18:38:35.020563+0000","last_fullsized":"2023-11-28T18:38:35.020563+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.043687+0000","last_change":"2023-11-28T18:38:35.042345+0000","last_active":"2023-11-28T18:38:35.043687+0000","last_peered":"2023-11-28T18:38:35.043687+0000","last_clean":"2023-11-28T18:38:35.043687+0000","last_became_active":"2023-11-28T18:38:35.042014+0000","last_became_peered":"2023-11-28T18:38:35.042014+0000","last_unstale":"2023-11-28T18:38:35.043687+0000","last_undegraded":"2023-11-28T18:38:35.043687+0000","last_fullsized":"2023-11-28T18:38:35.043687+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:06:47.136477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.025671+0000","last_change":"2023-11-28T18:38:35.025671+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.025671+0000","last_undegraded":"2023-11-28T18:38:35.025671+0000","last_fullsized":"2023-11-28T18:38:35.025671+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.045962+0000","last_change":"2023-11-28T18:38:35.044546+0000","last_active":"2023-11-28T18:38:35.045962+0000","last_peered":"2023-11-28T18:38:35.045962+0000","last_clean":"2023-11-28T18:38:35.045962+0000","last_became_active":"2023-11-28T18:38:35.044235+0000","last_became_peered":"2023-11-28T18:38:35.044235+0000","last_unstale":"2023-11-28T18:38:35.045962+0000","last_undegraded":"2023-11-28T18:38:35.045962+0000","last_fullsized":"2023-11-28T18:38:35.045962+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:34:41.136709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.016469+0000","last_change":"2023-11-28T18:38:35.016469+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.016469+0000","last_undegraded":"2023-11-28T18:38:35.016469+0000","last_fullsized":"2023-11-28T18:38:35.016469+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.044908+0000","last_change":"2023-11-28T18:38:35.040826+0000","last_active":"2023-11-28T18:38:35.044908+0000","last_peered":"2023-11-28T18:38:35.044908+0000","last_clean":"2023-11-28T18:38:35.044908+0000","last_became_active":"2023-11-28T18:38:35.040557+0000","last_became_peered":"2023-11-28T18:38:35.040557+0000","last_unstale":"2023-11-28T18:38:35.044908+0000","last_undegraded":"2023-11-28T18:38:35.044908+0000","last_fullsized":"2023-11-28T18:38:35.044908+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:52:24.975704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.029593+0000","last_change":"2023-11-28T18:38:35.029593+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.029593+0000","last_undegraded":"2023-11-28T18:38:35.029593+0000","last_fullsized":"2023-11-28T18:38:35.029593+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.042053+0000","last_change":"2023-11-28T18:38:35.038443+0000","last_active":"2023-11-28T18:38:35.042053+0000","last_peered":"2023-11-28T18:38:35.042053+0000","last_clean":"2023-11-28T18:38:35.042053+0000","last_became_active":"2023-11-28T18:38:35.037937+0000","last_became_peered":"2023-11-28T18:38:35.037937+0000","last_unstale":"2023-11-28T18:38:35.042053+0000","last_undegraded":"2023-11-28T18:38:35.042053+0000","last_fullsized":"2023-11-28T18:38:35.042053+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:32:55.075873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.027906+0000","last_change":"2023-11-28T18:38:35.027906+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.027906+0000","last_undegraded":"2023-11-28T18:38:35.027906+0000","last_fullsized":"2023-11-28T18:38:35.027906+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.026698+0000","last_change":"2023-11-28T18:38:35.022767+0000","last_active":"2023-11-28T18:38:35.026698+0000","last_peered":"2023-11-28T18:38:35.026698+0000","last_clean":"2023-11-28T18:38:35.026698+0000","last_became_active":"2023-11-28T18:38:35.022394+0000","last_became_peered":"2023-11-28T18:38:35.022394+0000","last_unstale":"2023-11-28T18:38:35.026698+0000","last_undegraded":"2023-11-28T18:38:35.026698+0000","last_fullsized":"2023-11-28T18:38:35.026698+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:21:35.227388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.020339+0000","last_change":"2023-11-28T18:38:35.020339+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.020339+0000","last_undegraded":"2023-11-28T18:38:35.020339+0000","last_fullsized":"2023-11-28T18:38:35.020339+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.036729+0000","last_change":"2023-11-28T18:38:35.033844+0000","last_active":"2023-11-28T18:38:35.036729+0000","last_peered":"2023-11-28T18:38:35.036729+0000","last_clean":"2023-11-28T18:38:35.036729+0000","last_became_active":"2023-11-28T18:38:35.033053+0000","last_became_peered":"2023-11-28T18:38:35.033053+0000","last_unstale":"2023-11-28T18:38:35.036729+0000","last_undegraded":"2023-11-28T18:38:35.036729+0000","last_fullsized":"2023-11-28T18:38:35.036729+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:32:55.075873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.016575+0000","last_change":"2023-11-28T18:38:35.016575+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.016575+0000","last_undegraded":"2023-11-28T18:38:35.016575+0000","last_fullsized":"2023-11-28T18:38:35.016575+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.037297+0000","last_change":"2023-11-28T18:38:35.034039+0000","last_active":"2023-11-28T18:38:35.037297+0000","last_peered":"2023-11-28T18:38:35.037297+0000","last_clean":"2023-11-28T18:38:35.037297+0000","last_became_active":"2023-11-28T18:38:35.033740+0000","last_became_peered":"2023-11-28T18:38:35.033740+0000","last_unstale":"2023-11-28T18:38:35.037297+0000","last_undegraded":"2023-11-28T18:38:35.037297+0000","last_fullsized":"2023-11-28T18:38:35.037297+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:06:47.136477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.022571+0000","last_change":"2023-11-28T18:38:35.022571+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.022571+0000","last_undegraded":"2023-11-28T18:38:35.022571+0000","last_fullsized":"2023-11-28T18:38:35.022571+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.036530+0000","last_change":"2023-11-28T18:38:35.032151+0000","last_active":"2023-11-28T18:38:35.036530+0000","last_peered":"2023-11-28T18:38:35.036530+0000","last_clean":"2023-11-28T18:38:35.036530+0000","last_became_active":"2023-11-28T18:38:35.031820+0000","last_became_peered":"2023-11-28T18:38:35.031820+0000","last_unstale":"2023-11-28T18:38:35.036530+0000","last_undegraded":"2023-11-28T18:38:35.036530+0000","last_fullsized":"2023-11-28T18:38:35.036530+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:32:53.815496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.018726+0000","last_change":"2023-11-28T18:38:35.018726+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.018726+0000","last_undegraded":"2023-11-28T18:38:35.018726+0000","last_fullsized":"2023-11-28T18:38:35.018726+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.045280+0000","last_change":"2023-11-28T18:38:35.044014+0000","last_active":"2023-11-28T18:38:35.045280+0000","last_peered":"2023-11-28T18:38:35.045280+0000","last_clean":"2023-11-28T18:38:35.045280+0000","last_became_active":"2023-11-28T18:38:35.042731+0000","last_became_peered":"2023-11-28T18:38:35.042731+0000","last_unstale":"2023-11-28T18:38:35.045280+0000","last_undegraded":"2023-11-28T18:38:35.045280+0000","last_fullsized":"2023-11-28T18:38:35.045280+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:06:48.055994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.023319+0000","last_change":"2023-11-28T18:38:35.023319+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.023319+0000","last_undegraded":"2023-11-28T18:38:35.023319+0000","last_fullsized":"2023-11-28T18:38:35.023319+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.044442+0000","last_change":"2023-11-28T18:38:35.041965+0000","last_active":"2023-11-28T18:38:35.044442+0000","last_peered":"2023-11-28T18:38:35.044442+0000","last_clean":"2023-11-28T18:38:35.044442+0000","last_became_active":"2023-11-28T18:38:35.041387+0000","last_became_peered":"2023-11-28T18:38:35.041387+0000","last_unstale":"2023-11-28T18:38:35.044442+0000","last_undegraded":"2023-11-28T18:38:35.044442+0000","last_fullsized":"2023-11-28T18:38:35.044442+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:06:47.136477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.022334+0000","last_change":"2023-11-28T18:38:35.022334+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.022334+0000","last_undegraded":"2023-11-28T18:38:35.022334+0000","last_fullsized":"2023-11-28T18:38:35.022334+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.045179+0000","last_change":"2023-11-28T18:38:35.043644+0000","last_active":"2023-11-28T18:38:35.045179+0000","last_peered":"2023-11-28T18:38:35.045179+0000","last_clean":"2023-11-28T18:38:35.045179+0000","last_became_active":"2023-11-28T18:38:35.043329+0000","last_became_peered":"2023-11-28T18:38:35.043329+0000","last_unstale":"2023-11-28T18:38:35.045179+0000","last_undegraded":"2023-11-28T18:38:35.045179+0000","last_fullsized":"2023-11-28T18:38:35.045179+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:58:12.029100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.021907+0000","last_change":"2023-11-28T18:38:35.021907+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.021907+0000","last_undegraded":"2023-11-28T18:38:35.021907+0000","last_fullsized":"2023-11-28T18:38:35.021907+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.037997+0000","last_change":"2023-11-28T18:38:35.035852+0000","last_active":"2023-11-28T18:38:35.037997+0000","last_peered":"2023-11-28T18:38:35.037997+0000","last_clean":"2023-11-28T18:38:35.037997+0000","last_became_active":"2023-11-28T18:38:35.035554+0000","last_became_peered":"2023-11-28T18:38:35.035554+0000","last_unstale":"2023-11-28T18:38:35.037997+0000","last_undegraded":"2023-11-28T18:38:35.037997+0000","last_fullsized":"2023-11-28T18:38:35.037997+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:48:52.205118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.023841+0000","last_change":"2023-11-28T18:38:35.023841+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.023841+0000","last_undegraded":"2023-11-28T18:38:35.023841+0000","last_fullsized":"2023-11-28T18:38:35.023841+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.037372+0000","last_change":"2023-11-28T18:38:35.031263+0000","last_active":"2023-11-28T18:38:35.037372+0000","last_peered":"2023-11-28T18:38:35.037372+0000","last_clean":"2023-11-28T18:38:35.037372+0000","last_became_active":"2023-11-28T18:38:35.031028+0000","last_became_peered":"2023-11-28T18:38:35.031028+0000","last_unstale":"2023-11-28T18:38:35.037372+0000","last_undegraded":"2023-11-28T18:38:35.037372+0000","last_fullsized":"2023-11-28T18:38:35.037372+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:22:15.084082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.022151+0000","last_change":"2023-11-28T18:38:35.022151+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.022151+0000","last_undegraded":"2023-11-28T18:38:35.022151+0000","last_fullsized":"2023-11-28T18:38:35.022151+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.046193+0000","last_change":"2023-11-28T18:38:35.044333+0000","last_active":"2023-11-28T18:38:35.046193+0000","last_peered":"2023-11-28T18:38:35.046193+0000","last_clean":"2023-11-28T18:38:35.046193+0000","last_became_active":"2023-11-28T18:38:35.043246+0000","last_became_peered":"2023-11-28T18:38:35.043246+0000","last_unstale":"2023-11-28T18:38:35.046193+0000","last_undegraded":"2023-11-28T18:38:35.046193+0000","last_fullsized":"2023-11-28T18:38:35.046193+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:07:08.162461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.029514+0000","last_change":"2023-11-28T18:38:35.029514+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.029514+0000","last_undegraded":"2023-11-28T18:38:35.029514+0000","last_fullsized":"2023-11-28T18:38:35.029514+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.041431+0000","last_change":"2023-11-28T18:38:35.039112+0000","last_active":"2023-11-28T18:38:35.041431+0000","last_peered":"2023-11-28T18:38:35.041431+0000","last_clean":"2023-11-28T18:38:35.041431+0000","last_became_active":"2023-11-28T18:38:35.038761+0000","last_became_peered":"2023-11-28T18:38:35.038761+0000","last_unstale":"2023-11-28T18:38:35.041431+0000","last_undegraded":"2023-11-28T18:38:35.041431+0000","last_fullsized":"2023-11-28T18:38:35.041431+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:57:34.906080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.026360+0000","last_change":"2023-11-28T18:38:35.026360+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.026360+0000","last_undegraded":"2023-11-28T18:38:35.026360+0000","last_fullsized":"2023-11-28T18:38:35.026360+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.042933+0000","last_change":"2023-11-28T18:38:35.039997+0000","last_active":"2023-11-28T18:38:35.042933+0000","last_peered":"2023-11-28T18:38:35.042933+0000","last_clean":"2023-11-28T18:38:35.042933+0000","last_became_active":"2023-11-28T18:38:35.039693+0000","last_became_peered":"2023-11-28T18:38:35.039693+0000","last_unstale":"2023-11-28T18:38:35.042933+0000","last_undegraded":"2023-11-28T18:38:35.042933+0000","last_fullsized":"2023-11-28T18:38:35.042933+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:11:13.755446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.016792+0000","last_change":"2023-11-28T18:38:35.016792+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.016792+0000","last_undegraded":"2023-11-28T18:38:35.016792+0000","last_fullsized":"2023-11-28T18:38:35.016792+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.046037+0000","last_change":"2023-11-28T18:38:35.043865+0000","last_active":"2023-11-28T18:38:35.046037+0000","last_peered":"2023-11-28T18:38:35.046037+0000","last_clean":"2023-11-28T18:38:35.046037+0000","last_became_active":"2023-11-28T18:38:35.043574+0000","last_became_peered":"2023-11-28T18:38:35.043574+0000","last_unstale":"2023-11-28T18:38:35.046037+0000","last_undegraded":"2023-11-28T18:38:35.046037+0000","last_fullsized":"2023-11-28T18:38:35.046037+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:52:24.975704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.021652+0000","last_change":"2023-11-28T18:38:35.021652+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.021652+0000","last_undegraded":"2023-11-28T18:38:35.021652+0000","last_fullsized":"2023-11-28T18:38:35.021652+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.042000+0000","last_change":"2023-11-28T18:38:35.038493+0000","last_active":"2023-11-28T18:38:35.042000+0000","last_peered":"2023-11-28T18:38:35.042000+0000","last_clean":"2023-11-28T18:38:35.042000+0000","last_became_active":"2023-11-28T18:38:35.038065+0000","last_became_peered":"2023-11-28T18:38:35.038065+0000","last_unstale":"2023-11-28T18:38:35.042000+0000","last_undegraded":"2023-11-28T18:38:35.042000+0000","last_fullsized":"2023-11-28T18:38:35.042000+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:44:34.044747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.026820+0000","last_change":"2023-11-28T18:38:35.026820+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.026820+0000","last_undegraded":"2023-11-28T18:38:35.026820+0000","last_fullsized":"2023-11-28T18:38:35.026820+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.039354+0000","last_change":"2023-11-28T18:38:35.036943+0000","last_active":"2023-11-28T18:38:35.039354+0000","last_peered":"2023-11-28T18:38:35.039354+0000","last_clean":"2023-11-28T18:38:35.039354+0000","last_became_active":"2023-11-28T18:38:35.036630+0000","last_became_peered":"2023-11-28T18:38:35.036630+0000","last_unstale":"2023-11-28T18:38:35.039354+0000","last_undegraded":"2023-11-28T18:38:35.039354+0000","last_fullsized":"2023-11-28T18:38:35.039354+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:40:01.118721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.023651+0000","last_change":"2023-11-28T18:38:35.023651+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.023651+0000","last_undegraded":"2023-11-28T18:38:35.023651+0000","last_fullsized":"2023-11-28T18:38:35.023651+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.027089+0000","last_change":"2023-11-28T18:38:35.023682+0000","last_active":"2023-11-28T18:38:35.027089+0000","last_peered":"2023-11-28T18:38:35.027089+0000","last_clean":"2023-11-28T18:38:35.027089+0000","last_became_active":"2023-11-28T18:38:35.022730+0000","last_became_peered":"2023-11-28T18:38:35.022730+0000","last_unstale":"2023-11-28T18:38:35.027089+0000","last_undegraded":"2023-11-28T18:38:35.027089+0000","last_fullsized":"2023-11-28T18:38:35.027089+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:13:17.633662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.021628+0000","last_change":"2023-11-28T18:38:35.021628+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.021628+0000","last_undegraded":"2023-11-28T18:38:35.021628+0000","last_fullsized":"2023-11-28T18:38:35.021628+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.040951+0000","last_change":"2023-11-28T18:38:35.033842+0000","last_active":"2023-11-28T18:38:35.040951+0000","last_peered":"2023-11-28T18:38:35.040951+0000","last_clean":"2023-11-28T18:38:35.040951+0000","last_became_active":"2023-11-28T18:38:35.033482+0000","last_became_peered":"2023-11-28T18:38:35.033482+0000","last_unstale":"2023-11-28T18:38:35.040951+0000","last_undegraded":"2023-11-28T18:38:35.040951+0000","last_fullsized":"2023-11-28T18:38:35.040951+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:47:24.249639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.023141+0000","last_change":"2023-11-28T18:38:35.023141+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.023141+0000","last_undegraded":"2023-11-28T18:38:35.023141+0000","last_fullsized":"2023-11-28T18:38:35.023141+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.042583+0000","last_change":"2023-11-28T18:38:35.040401+0000","last_active":"2023-11-28T18:38:35.042583+0000","last_peered":"2023-11-28T18:38:35.042583+0000","last_clean":"2023-11-28T18:38:35.042583+0000","last_became_active":"2023-11-28T18:38:35.039986+0000","last_became_peered":"2023-11-28T18:38:35.039986+0000","last_unstale":"2023-11-28T18:38:35.042583+0000","last_undegraded":"2023-11-28T18:38:35.042583+0000","last_fullsized":"2023-11-28T18:38:35.042583+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:34:41.136709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.022670+0000","last_change":"2023-11-28T18:38:35.022670+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.022670+0000","last_undegraded":"2023-11-28T18:38:35.022670+0000","last_fullsized":"2023-11-28T18:38:35.022670+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.041967+0000","last_change":"2023-11-28T18:38:35.037979+0000","last_active":"2023-11-28T18:38:35.041967+0000","last_peered":"2023-11-28T18:38:35.041967+0000","last_clean":"2023-11-28T18:38:35.041967+0000","last_became_active":"2023-11-28T18:38:35.037674+0000","last_became_peered":"2023-11-28T18:38:35.037674+0000","last_unstale":"2023-11-28T18:38:35.041967+0000","last_undegraded":"2023-11-28T18:38:35.041967+0000","last_fullsized":"2023-11-28T18:38:35.041967+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:52:33.974326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.032944+0000","last_change":"2023-11-28T18:38:35.032944+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.032944+0000","last_undegraded":"2023-11-28T18:38:35.032944+0000","last_fullsized":"2023-11-28T18:38:35.032944+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.034841+0000","last_change":"2023-11-28T18:38:35.031421+0000","last_active":"2023-11-28T18:38:35.034841+0000","last_peered":"2023-11-28T18:38:35.034841+0000","last_clean":"2023-11-28T18:38:35.034841+0000","last_became_active":"2023-11-28T18:38:35.031138+0000","last_became_peered":"2023-11-28T18:38:35.031138+0000","last_unstale":"2023-11-28T18:38:35.034841+0000","last_undegraded":"2023-11-28T18:38:35.034841+0000","last_fullsized":"2023-11-28T18:38:35.034841+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:51:52.296626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.022643+0000","last_change":"2023-11-28T18:38:35.022643+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.022643+0000","last_undegraded":"2023-11-28T18:38:35.022643+0000","last_fullsized":"2023-11-28T18:38:35.022643+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.045769+0000","last_change":"2023-11-28T18:38:35.042278+0000","last_active":"2023-11-28T18:38:35.045769+0000","last_peered":"2023-11-28T18:38:35.045769+0000","last_clean":"2023-11-28T18:38:35.045769+0000","last_became_active":"2023-11-28T18:38:35.041885+0000","last_became_peered":"2023-11-28T18:38:35.041885+0000","last_unstale":"2023-11-28T18:38:35.045769+0000","last_undegraded":"2023-11-28T18:38:35.045769+0000","last_fullsized":"2023-11-28T18:38:35.045769+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:06:47.136477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.021241+0000","last_change":"2023-11-28T18:38:35.021241+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.021241+0000","last_undegraded":"2023-11-28T18:38:35.021241+0000","last_fullsized":"2023-11-28T18:38:35.021241+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.041637+0000","last_change":"2023-11-28T18:38:35.036513+0000","last_active":"2023-11-28T18:38:35.041637+0000","last_peered":"2023-11-28T18:38:35.041637+0000","last_clean":"2023-11-28T18:38:35.041637+0000","last_became_active":"2023-11-28T18:38:35.036218+0000","last_became_peered":"2023-11-28T18:38:35.036218+0000","last_unstale":"2023-11-28T18:38:35.041637+0000","last_undegraded":"2023-11-28T18:38:35.041637+0000","last_fullsized":"2023-11-28T18:38:35.041637+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:52:24.975704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.019286+0000","last_change":"2023-11-28T18:38:35.019286+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.019286+0000","last_undegraded":"2023-11-28T18:38:35.019286+0000","last_fullsized":"2023-11-28T18:38:35.019286+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.045742+0000","last_change":"2023-11-28T18:38:35.042254+0000","last_active":"2023-11-28T18:38:35.045742+0000","last_peered":"2023-11-28T18:38:35.045742+0000","last_clean":"2023-11-28T18:38:35.045742+0000","last_became_active":"2023-11-28T18:38:35.041942+0000","last_became_peered":"2023-11-28T18:38:35.041942+0000","last_unstale":"2023-11-28T18:38:35.045742+0000","last_undegraded":"2023-11-28T18:38:35.045742+0000","last_fullsized":"2023-11-28T18:38:35.045742+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:34:41.136709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.027923+0000","last_change":"2023-11-28T18:38:35.027923+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.027923+0000","last_undegraded":"2023-11-28T18:38:35.027923+0000","last_fullsized":"2023-11-28T18:38:35.027923+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.033955+0000","last_change":"2023-11-28T18:38:35.029334+0000","last_active":"2023-11-28T18:38:35.033955+0000","last_peered":"2023-11-28T18:38:35.033955+0000","last_clean":"2023-11-28T18:38:35.033955+0000","last_became_active":"2023-11-28T18:38:35.029088+0000","last_became_peered":"2023-11-28T18:38:35.029088+0000","last_unstale":"2023-11-28T18:38:35.033955+0000","last_undegraded":"2023-11-28T18:38:35.033955+0000","last_fullsized":"2023-11-28T18:38:35.033955+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:07:08.162461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.019528+0000","last_change":"2023-11-28T18:38:35.019528+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.019528+0000","last_undegraded":"2023-11-28T18:38:35.019528+0000","last_fullsized":"2023-11-28T18:38:35.019528+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.038195+0000","last_change":"2023-11-28T18:38:35.036038+0000","last_active":"2023-11-28T18:38:35.038195+0000","last_peered":"2023-11-28T18:38:35.038195+0000","last_clean":"2023-11-28T18:38:35.038195+0000","last_became_active":"2023-11-28T18:38:35.035686+0000","last_became_peered":"2023-11-28T18:38:35.035686+0000","last_unstale":"2023-11-28T18:38:35.038195+0000","last_undegraded":"2023-11-28T18:38:35.038195+0000","last_fullsized":"2023-11-28T18:38:35.038195+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:47:24.249639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.026252+0000","last_change":"2023-11-28T18:38:35.026252+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.026252+0000","last_undegraded":"2023-11-28T18:38:35.026252+0000","last_fullsized":"2023-11-28T18:38:35.026252+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.037853+0000","last_change":"2023-11-28T18:38:35.035526+0000","last_active":"2023-11-28T18:38:35.037853+0000","last_peered":"2023-11-28T18:38:35.037853+0000","last_clean":"2023-11-28T18:38:35.037853+0000","last_became_active":"2023-11-28T18:38:35.034566+0000","last_became_peered":"2023-11-28T18:38:35.034566+0000","last_unstale":"2023-11-28T18:38:35.037853+0000","last_undegraded":"2023-11-28T18:38:35.037853+0000","last_fullsized":"2023-11-28T18:38:35.037853+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:24:41.379481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.018130+0000","last_change":"2023-11-28T18:38:35.018130+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.018130+0000","last_undegraded":"2023-11-28T18:38:35.018130+0000","last_fullsized":"2023-11-28T18:38:35.018130+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.044594+0000","last_change":"2023-11-28T18:38:35.043063+0000","last_active":"2023-11-28T18:38:35.044594+0000","last_peered":"2023-11-28T18:38:35.044594+0000","last_clean":"2023-11-28T18:38:35.044594+0000","last_became_active":"2023-11-28T18:38:35.042719+0000","last_became_peered":"2023-11-28T18:38:35.042719+0000","last_unstale":"2023-11-28T18:38:35.044594+0000","last_undegraded":"2023-11-28T18:38:35.044594+0000","last_fullsized":"2023-11-28T18:38:35.044594+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:00:43.620322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T18:38:35.031614+0000","last_change":"2023-11-28T18:38:35.031614+0000","last_active":"2023-11-28T18:38:35.006358+0000","last_peered":"2023-11-28T18:38:35.006358+0000","last_clean":"2023-11-28T18:38:35.006358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:38:35.031614+0000","last_undegraded":"2023-11-28T18:38:35.031614+0000","last_fullsized":"2023-11-28T18:38:35.031614+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T18:38:35.042502+0000","last_change":"2023-11-28T18:38:35.040261+0000","last_active":"2023-11-28T18:38:35.042502+0000","last_peered":"2023-11-28T18:38:35.042502+0000","last_clean":"2023-11-28T18:38:35.042502+0000","last_became_active":"2023-11-28T18:38:35.040006+0000","last_became_peered":"2023-11-28T18:38:35.040006+0000","last_unstale":"2023-11-28T18:38:35.042502+0000","last_undegraded":"2023-11-28T18:38:35.042502+0000","last_fullsized":"2023-11-28T18:38:35.042502+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:07:08.162461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":174,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T18:38:34.015523+0000","last_change":"2023-11-28T18:37:22.369132+0000","last_active":"2023-11-28T18:38:34.015523+0000","last_peered":"2023-11-28T18:38:34.015523+0000","last_clean":"2023-11-28T18:38:34.015523+0000","last_became_active":"2023-11-28T18:37:22.368142+0000","last_became_peered":"2023-11-28T18:37:22.368142+0000","last_unstale":"2023-11-28T18:38:34.015523+0000","last_undegraded":"2023-11-28T18:38:34.015523+0000","last_fullsized":"2023-11-28T18:38:34.015523+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:21.313053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:21.313053+0000","last_clean_scrub_stamp":"2023-11-28T18:37:21.313053+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:55:01.432028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":942080,"data_stored":722803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":4.8559999999999999,"5min":4.8559999999999999,"15min":4.8559999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":4.8319999999999999,"5min":4.8319999999999999,"15min":4.8319999999999999},"last":0.67500000000000004}]},{"osd":1,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":4.8109999999999999,"5min":4.8109999999999999,"15min":4.8109999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":4.8700000000000001,"5min":4.8700000000000001,"15min":4.8700000000000001},"last":0.71999999999999997}]},{"osd":2,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.76300000000000001}]},{"osd":3,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":4.7619999999999996,"5min":4.7619999999999996,"15min":4.7619999999999996},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.63700000000000001}]},{"osd":4,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.502},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.57299999999999995}]},{"osd":5,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.433}]},{"osd":6,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.52700000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":132435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 18:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.78100000000000003}]},{"osd":1,"last update":"Tue Nov 28 18:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.81999999999999995}]},{"osd":2,"last update":"Tue Nov 28 18:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.622}]},{"osd":3,"last update":"Tue Nov 28 18:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.63400000000000001}]},{"osd":4,"last update":"Tue Nov 28 18:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.59199999999999997}]},{"osd":5,"last update":"Tue Nov 28 18:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.747}]},{"osd":7,"last update":"Tue Nov 28 18:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.76500000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":138702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.77100000000000002}]},{"osd":1,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.86099999999999999}]},{"osd":2,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.82799999999999996}]},{"osd":3,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.92800000000000005}]},{"osd":4,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.753},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.72999999999999998}]},{"osd":6,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.67300000000000004}]},{"osd":7,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.88100000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":132435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":3.5179999999999998,"5min":3.5179999999999998,"15min":3.5179999999999998},"last":0.56100000000000005}]},{"osd":1,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":3.5019999999999998,"5min":3.5019999999999998,"15min":3.5019999999999998},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":3.5630000000000002,"5min":3.5630000000000002,"15min":3.5630000000000002},"last":0.70199999999999996}]},{"osd":2,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":3.6709999999999998,"5min":3.6709999999999998,"15min":3.6709999999999998},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":3.4849999999999999,"5min":3.4849999999999999,"15min":3.4849999999999999},"last":0.59699999999999998}]},{"osd":3,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":3.7130000000000001,"5min":3.7130000000000001,"15min":3.7130000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.80100000000000005}]},{"osd":5,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.75600000000000001}]},{"osd":6,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.718,"5min":1.718,"15min":1.718},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.77700000000000002}]},{"osd":7,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.83199999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":348160,"data_stored":132435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 18:38:22 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.54200000000000004}]},{"osd":1,"last update":"Tue Nov 28 18:38:22 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.59799999999999998}]},{"osd":2,"last update":"Tue Nov 28 18:38:22 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.624},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.63700000000000001}]},{"osd":4,"last update":"Tue Nov 28 18:38:22 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.88800000000000001}]},{"osd":5,"last update":"Tue Nov 28 18:38:22 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.91500000000000004}]},{"osd":6,"last update":"Tue Nov 28 18:38:22 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":0.98799999999999999}]},{"osd":7,"last update":"Tue Nov 28 18:38:22 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.92800000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":348160,"data_stored":132435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 18:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":0.45700000000000002}]},{"osd":1,"last update":"Tue Nov 28 18:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.47799999999999998}]},{"osd":3,"last update":"Tue Nov 28 18:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.439},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.41899999999999998}]},{"osd":4,"last update":"Tue Nov 28 18:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":0.56100000000000005}]},{"osd":5,"last update":"Tue Nov 28 18:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.69999999999999996}]},{"osd":6,"last update":"Tue Nov 28 18:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.7070000000000001,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.56999999999999995}]},{"osd":7,"last update":"Tue Nov 28 18:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.7509999999999999,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.65700000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":348160,"data_stored":132435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":2.2090000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":4.0899999999999999,"5min":4.0899999999999999,"15min":4.0899999999999999},"last":0.372}]},{"osd":2,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":3.8620000000000001,"5min":3.8620000000000001,"15min":3.8620000000000001},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":2.823,"5min":2.823,"15min":2.823},"last":0.41699999999999998}]},{"osd":3,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":4.0739999999999998,"5min":4.0739999999999998,"15min":4.0739999999999998},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":3.6659999999999999,"5min":3.6659999999999999,"15min":3.6659999999999999},"last":0.52000000000000002}]},{"osd":4,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":5.3540000000000001,"5min":5.3540000000000001,"15min":5.3540000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":5.5,"5min":5.5,"15min":5.5},"last":0.58299999999999996}]},{"osd":5,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":5.4379999999999997,"5min":5.4379999999999997,"15min":5.4379999999999997},"last":0.71599999999999997},{"interface":"front","average":{"1min":1.129,"5min":1.129,"15min":1.129},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":3.4500000000000002,"5min":3.4500000000000002,"15min":3.4500000000000002},"last":0.745}]},{"osd":6,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":3.0369999999999999,"5min":3.0369999999999999,"15min":3.0369999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":5.4000000000000004,"5min":5.4000000000000004,"15min":5.4000000000000004},"last":0.59499999999999997}]},{"osd":7,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":5.5369999999999999,"5min":5.5369999999999999,"15min":5.5369999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":3.2480000000000002,"5min":3.2480000000000002,"15min":3.2480000000000002},"last":0.69999999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32100,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339740,"statfs":{"total":96636764160,"available":96603893760,"internally_reserved":0,"allocated":942080,"data_stored":722803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 18:38:22 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.432},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.51800000000000002}]},{"osd":2,"last update":"Tue Nov 28 18:38:22 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.503},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.38100000000000001}]},{"osd":3,"last update":"Tue Nov 28 18:38:22 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.46999999999999997}]},{"osd":4,"last update":"Tue Nov 28 18:38:22 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.879},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.84399999999999997}]},{"osd":5,"last update":"Tue Nov 28 18:38:22 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.66000000000000003}]},{"osd":6,"last update":"Tue Nov 28 18:38:22 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1,"5min":1,"15min":1},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.76100000000000001}]},{"osd":7,"last update":"Tue Nov 28 18:38:22 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.73999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T18:38:40.951 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3f is not active+clean 2023-11-28T18:38:40.951 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T18:38:35.026765+0000', 'last_change': '2023-11-28T18:38:35.026765+0000', 'last_active': '2023-11-28T18:38:35.006358+0000', 'last_peered': '2023-11-28T18:38:35.006358+0000', 'last_clean': '2023-11-28T18:38:35.006358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T18:38:35.026765+0000', 'last_undegraded': '2023-11-28T18:38:35.026765+0000', 'last_fullsized': '2023-11-28T18:38:35.026765+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_clean_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-28T18:38:40.951 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3e is not active+clean 2023-11-28T18:38:40.951 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T18:38:35.028264+0000', 'last_change': '2023-11-28T18:38:35.028264+0000', 'last_active': '2023-11-28T18:38:35.006358+0000', 'last_peered': '2023-11-28T18:38:35.006358+0000', 'last_clean': '2023-11-28T18:38:35.006358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T18:38:35.028264+0000', 'last_undegraded': '2023-11-28T18:38:35.028264+0000', 'last_fullsized': '2023-11-28T18:38:35.028264+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_clean_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T18:38:40.951 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3d is not active+clean 2023-11-28T18:38:40.951 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T18:38:35.021342+0000', 'last_change': '2023-11-28T18:38:35.021342+0000', 'last_active': '2023-11-28T18:38:35.006358+0000', 'last_peered': '2023-11-28T18:38:35.006358+0000', 'last_clean': '2023-11-28T18:38:35.006358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T18:38:35.021342+0000', 'last_undegraded': '2023-11-28T18:38:35.021342+0000', 'last_fullsized': '2023-11-28T18:38:35.021342+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_clean_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T18:38:40.951 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3c is not active+clean 2023-11-28T18:38:40.952 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T18:38:35.030480+0000', 'last_change': '2023-11-28T18:38:35.030480+0000', 'last_active': '2023-11-28T18:38:35.006358+0000', 'last_peered': '2023-11-28T18:38:35.006358+0000', 'last_clean': '2023-11-28T18:38:35.006358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T18:38:35.030480+0000', 'last_undegraded': '2023-11-28T18:38:35.030480+0000', 'last_fullsized': '2023-11-28T18:38:35.030480+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_clean_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T18:38:40.952 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3b is not active+clean 2023-11-28T18:38:40.952 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T18:38:35.024376+0000', 'last_change': '2023-11-28T18:38:35.024376+0000', 'last_active': '2023-11-28T18:38:35.006358+0000', 'last_peered': '2023-11-28T18:38:35.006358+0000', 'last_clean': '2023-11-28T18:38:35.006358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T18:38:35.024376+0000', 'last_undegraded': '2023-11-28T18:38:35.024376+0000', 'last_fullsized': '2023-11-28T18:38:35.024376+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_clean_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-28T18:38:40.952 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3a is not active+clean 2023-11-28T18:38:40.952 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T18:38:35.025354+0000', 'last_change': '2023-11-28T18:38:35.025354+0000', 'last_active': '2023-11-28T18:38:35.006358+0000', 'last_peered': '2023-11-28T18:38:35.006358+0000', 'last_clean': '2023-11-28T18:38:35.006358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T18:38:35.025354+0000', 'last_undegraded': '2023-11-28T18:38:35.025354+0000', 'last_fullsized': '2023-11-28T18:38:35.025354+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_clean_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T18:38:40.952 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.39 is not active+clean 2023-11-28T18:38:40.952 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T18:38:35.025165+0000', 'last_change': '2023-11-28T18:38:35.025165+0000', 'last_active': '2023-11-28T18:38:35.006358+0000', 'last_peered': '2023-11-28T18:38:35.006358+0000', 'last_clean': '2023-11-28T18:38:35.006358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T18:38:35.025165+0000', 'last_undegraded': '2023-11-28T18:38:35.025165+0000', 'last_fullsized': '2023-11-28T18:38:35.025165+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_clean_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T18:38:40.952 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.38 is not active+clean 2023-11-28T18:38:40.952 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T18:38:35.030364+0000', 'last_change': '2023-11-28T18:38:35.030364+0000', 'last_active': '2023-11-28T18:38:35.006358+0000', 'last_peered': '2023-11-28T18:38:35.006358+0000', 'last_clean': '2023-11-28T18:38:35.006358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T18:38:35.030364+0000', 'last_undegraded': '2023-11-28T18:38:35.030364+0000', 'last_fullsized': '2023-11-28T18:38:35.030364+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_clean_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T18:38:40.952 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.37 is not active+clean 2023-11-28T18:38:40.953 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T18:38:35.016603+0000', 'last_change': '2023-11-28T18:38:35.016603+0000', 'last_active': '2023-11-28T18:38:35.006358+0000', 'last_peered': '2023-11-28T18:38:35.006358+0000', 'last_clean': '2023-11-28T18:38:35.006358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T18:38:35.016603+0000', 'last_undegraded': '2023-11-28T18:38:35.016603+0000', 'last_fullsized': '2023-11-28T18:38:35.016603+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_clean_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T18:38:40.953 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.36 is not active+clean 2023-11-28T18:38:40.953 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T18:38:35.028332+0000', 'last_change': '2023-11-28T18:38:35.028332+0000', 'last_active': '2023-11-28T18:38:35.006358+0000', 'last_peered': '2023-11-28T18:38:35.006358+0000', 'last_clean': '2023-11-28T18:38:35.006358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T18:38:35.028332+0000', 'last_undegraded': '2023-11-28T18:38:35.028332+0000', 'last_fullsized': '2023-11-28T18:38:35.028332+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_clean_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T18:38:40.953 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.35 is not active+clean 2023-11-28T18:38:40.953 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T18:38:35.035054+0000', 'last_change': '2023-11-28T18:38:35.035054+0000', 'last_active': '2023-11-28T18:38:35.006358+0000', 'last_peered': '2023-11-28T18:38:35.006358+0000', 'last_clean': '2023-11-28T18:38:35.006358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T18:38:35.035054+0000', 'last_undegraded': '2023-11-28T18:38:35.035054+0000', 'last_fullsized': '2023-11-28T18:38:35.035054+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_clean_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T18:38:40.953 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.34 is not active+clean 2023-11-28T18:38:40.953 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T18:38:35.019498+0000', 'last_change': '2023-11-28T18:38:35.019498+0000', 'last_active': '2023-11-28T18:38:35.006358+0000', 'last_peered': '2023-11-28T18:38:35.006358+0000', 'last_clean': '2023-11-28T18:38:35.006358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T18:38:35.019498+0000', 'last_undegraded': '2023-11-28T18:38:35.019498+0000', 'last_fullsized': '2023-11-28T18:38:35.019498+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_clean_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T18:38:40.953 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.33 is not active+clean 2023-11-28T18:38:40.953 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T18:38:35.023737+0000', 'last_change': '2023-11-28T18:38:35.023737+0000', 'last_active': '2023-11-28T18:38:35.006358+0000', 'last_peered': '2023-11-28T18:38:35.006358+0000', 'last_clean': '2023-11-28T18:38:35.006358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T18:38:35.023737+0000', 'last_undegraded': '2023-11-28T18:38:35.023737+0000', 'last_fullsized': '2023-11-28T18:38:35.023737+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_clean_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-28T18:38:40.953 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.32 is not active+clean 2023-11-28T18:38:40.954 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T18:38:35.024782+0000', 'last_change': '2023-11-28T18:38:35.024782+0000', 'last_active': '2023-11-28T18:38:35.006358+0000', 'last_peered': '2023-11-28T18:38:35.006358+0000', 'last_clean': '2023-11-28T18:38:35.006358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T18:38:35.024782+0000', 'last_undegraded': '2023-11-28T18:38:35.024782+0000', 'last_fullsized': '2023-11-28T18:38:35.024782+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_clean_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T18:38:40.954 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.31 is not active+clean 2023-11-28T18:38:40.954 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T18:38:35.020038+0000', 'last_change': '2023-11-28T18:38:35.020038+0000', 'last_active': '2023-11-28T18:38:35.006358+0000', 'last_peered': '2023-11-28T18:38:35.006358+0000', 'last_clean': '2023-11-28T18:38:35.006358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T18:38:35.020038+0000', 'last_undegraded': '2023-11-28T18:38:35.020038+0000', 'last_fullsized': '2023-11-28T18:38:35.020038+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_clean_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T18:38:40.954 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.30 is not active+clean 2023-11-28T18:38:40.954 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T18:38:35.024418+0000', 'last_change': '2023-11-28T18:38:35.024418+0000', 'last_active': '2023-11-28T18:38:35.006358+0000', 'last_peered': '2023-11-28T18:38:35.006358+0000', 'last_clean': '2023-11-28T18:38:35.006358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T18:38:35.024418+0000', 'last_undegraded': '2023-11-28T18:38:35.024418+0000', 'last_fullsized': '2023-11-28T18:38:35.024418+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_clean_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T18:38:40.954 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2f is not active+clean 2023-11-28T18:38:40.954 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T18:38:35.037840+0000', 'last_change': '2023-11-28T18:38:35.037840+0000', 'last_active': '2023-11-28T18:38:35.006358+0000', 'last_peered': '2023-11-28T18:38:35.006358+0000', 'last_clean': '2023-11-28T18:38:35.006358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T18:38:35.037840+0000', 'last_undegraded': '2023-11-28T18:38:35.037840+0000', 'last_fullsized': '2023-11-28T18:38:35.037840+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_clean_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T18:38:40.954 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2e is not active+clean 2023-11-28T18:38:40.954 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T18:38:35.027775+0000', 'last_change': '2023-11-28T18:38:35.027775+0000', 'last_active': '2023-11-28T18:38:35.006358+0000', 'last_peered': '2023-11-28T18:38:35.006358+0000', 'last_clean': '2023-11-28T18:38:35.006358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T18:38:35.027775+0000', 'last_undegraded': '2023-11-28T18:38:35.027775+0000', 'last_fullsized': '2023-11-28T18:38:35.027775+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_clean_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T18:38:40.955 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2d is not active+clean 2023-11-28T18:38:40.955 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T18:38:35.024051+0000', 'last_change': '2023-11-28T18:38:35.024051+0000', 'last_active': '2023-11-28T18:38:35.006358+0000', 'last_peered': '2023-11-28T18:38:35.006358+0000', 'last_clean': '2023-11-28T18:38:35.006358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T18:38:35.024051+0000', 'last_undegraded': '2023-11-28T18:38:35.024051+0000', 'last_fullsized': '2023-11-28T18:38:35.024051+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_clean_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T18:38:40.955 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2c is not active+clean 2023-11-28T18:38:40.955 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T18:38:35.022099+0000', 'last_change': '2023-11-28T18:38:35.022099+0000', 'last_active': '2023-11-28T18:38:35.006358+0000', 'last_peered': '2023-11-28T18:38:35.006358+0000', 'last_clean': '2023-11-28T18:38:35.006358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T18:38:35.022099+0000', 'last_undegraded': '2023-11-28T18:38:35.022099+0000', 'last_fullsized': '2023-11-28T18:38:35.022099+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_clean_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-28T18:38:40.955 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2b is not active+clean 2023-11-28T18:38:40.955 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T18:38:35.017937+0000', 'last_change': '2023-11-28T18:38:35.017937+0000', 'last_active': '2023-11-28T18:38:35.006358+0000', 'last_peered': '2023-11-28T18:38:35.006358+0000', 'last_clean': '2023-11-28T18:38:35.006358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T18:38:35.017937+0000', 'last_undegraded': '2023-11-28T18:38:35.017937+0000', 'last_fullsized': '2023-11-28T18:38:35.017937+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_clean_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T18:38:40.955 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2a is not active+clean 2023-11-28T18:38:40.955 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T18:38:35.015828+0000', 'last_change': '2023-11-28T18:38:35.015828+0000', 'last_active': '2023-11-28T18:38:35.006358+0000', 'last_peered': '2023-11-28T18:38:35.006358+0000', 'last_clean': '2023-11-28T18:38:35.006358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T18:38:35.015828+0000', 'last_undegraded': '2023-11-28T18:38:35.015828+0000', 'last_fullsized': '2023-11-28T18:38:35.015828+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_clean_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T18:38:40.955 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.29 is not active+clean 2023-11-28T18:38:40.955 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T18:38:35.019587+0000', 'last_change': '2023-11-28T18:38:35.019587+0000', 'last_active': '2023-11-28T18:38:35.006358+0000', 'last_peered': '2023-11-28T18:38:35.006358+0000', 'last_clean': '2023-11-28T18:38:35.006358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T18:38:35.019587+0000', 'last_undegraded': '2023-11-28T18:38:35.019587+0000', 'last_fullsized': '2023-11-28T18:38:35.019587+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_clean_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T18:38:40.956 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.28 is not active+clean 2023-11-28T18:38:40.956 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T18:38:35.018025+0000', 'last_change': '2023-11-28T18:38:35.018025+0000', 'last_active': '2023-11-28T18:38:35.006358+0000', 'last_peered': '2023-11-28T18:38:35.006358+0000', 'last_clean': '2023-11-28T18:38:35.006358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T18:38:35.018025+0000', 'last_undegraded': '2023-11-28T18:38:35.018025+0000', 'last_fullsized': '2023-11-28T18:38:35.018025+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_clean_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T18:38:40.956 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.27 is not active+clean 2023-11-28T18:38:40.956 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T18:38:35.027110+0000', 'last_change': '2023-11-28T18:38:35.027110+0000', 'last_active': '2023-11-28T18:38:35.006358+0000', 'last_peered': '2023-11-28T18:38:35.006358+0000', 'last_clean': '2023-11-28T18:38:35.006358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T18:38:35.027110+0000', 'last_undegraded': '2023-11-28T18:38:35.027110+0000', 'last_fullsized': '2023-11-28T18:38:35.027110+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_clean_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T18:38:40.956 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.26 is not active+clean 2023-11-28T18:38:40.956 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T18:38:35.027244+0000', 'last_change': '2023-11-28T18:38:35.027244+0000', 'last_active': '2023-11-28T18:38:35.006358+0000', 'last_peered': '2023-11-28T18:38:35.006358+0000', 'last_clean': '2023-11-28T18:38:35.006358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T18:38:35.027244+0000', 'last_undegraded': '2023-11-28T18:38:35.027244+0000', 'last_fullsized': '2023-11-28T18:38:35.027244+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_clean_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T18:38:40.956 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.25 is not active+clean 2023-11-28T18:38:40.956 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T18:38:35.030036+0000', 'last_change': '2023-11-28T18:38:35.030036+0000', 'last_active': '2023-11-28T18:38:35.006358+0000', 'last_peered': '2023-11-28T18:38:35.006358+0000', 'last_clean': '2023-11-28T18:38:35.006358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T18:38:35.030036+0000', 'last_undegraded': '2023-11-28T18:38:35.030036+0000', 'last_fullsized': '2023-11-28T18:38:35.030036+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_clean_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T18:38:40.956 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.24 is not active+clean 2023-11-28T18:38:40.956 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T18:38:35.018981+0000', 'last_change': '2023-11-28T18:38:35.018981+0000', 'last_active': '2023-11-28T18:38:35.006358+0000', 'last_peered': '2023-11-28T18:38:35.006358+0000', 'last_clean': '2023-11-28T18:38:35.006358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T18:38:35.018981+0000', 'last_undegraded': '2023-11-28T18:38:35.018981+0000', 'last_fullsized': '2023-11-28T18:38:35.018981+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_clean_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T18:38:40.957 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.23 is not active+clean 2023-11-28T18:38:40.957 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T18:38:35.016270+0000', 'last_change': '2023-11-28T18:38:35.016270+0000', 'last_active': '2023-11-28T18:38:35.006358+0000', 'last_peered': '2023-11-28T18:38:35.006358+0000', 'last_clean': '2023-11-28T18:38:35.006358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T18:38:35.016270+0000', 'last_undegraded': '2023-11-28T18:38:35.016270+0000', 'last_fullsized': '2023-11-28T18:38:35.016270+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_clean_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T18:38:40.957 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.22 is not active+clean 2023-11-28T18:38:40.957 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T18:38:35.028493+0000', 'last_change': '2023-11-28T18:38:35.028493+0000', 'last_active': '2023-11-28T18:38:35.006358+0000', 'last_peered': '2023-11-28T18:38:35.006358+0000', 'last_clean': '2023-11-28T18:38:35.006358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T18:38:35.028493+0000', 'last_undegraded': '2023-11-28T18:38:35.028493+0000', 'last_fullsized': '2023-11-28T18:38:35.028493+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_clean_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T18:38:40.957 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.21 is not active+clean 2023-11-28T18:38:40.957 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T18:38:35.026899+0000', 'last_change': '2023-11-28T18:38:35.026899+0000', 'last_active': '2023-11-28T18:38:35.006358+0000', 'last_peered': '2023-11-28T18:38:35.006358+0000', 'last_clean': '2023-11-28T18:38:35.006358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T18:38:35.026899+0000', 'last_undegraded': '2023-11-28T18:38:35.026899+0000', 'last_fullsized': '2023-11-28T18:38:35.026899+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_clean_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-28T18:38:40.957 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.20 is not active+clean 2023-11-28T18:38:40.957 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T18:38:35.029918+0000', 'last_change': '2023-11-28T18:38:35.029918+0000', 'last_active': '2023-11-28T18:38:35.006358+0000', 'last_peered': '2023-11-28T18:38:35.006358+0000', 'last_clean': '2023-11-28T18:38:35.006358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T18:38:35.029918+0000', 'last_undegraded': '2023-11-28T18:38:35.029918+0000', 'last_fullsized': '2023-11-28T18:38:35.029918+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_clean_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T18:38:40.957 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1e is not active+clean 2023-11-28T18:38:40.957 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T18:38:35.020563+0000', 'last_change': '2023-11-28T18:38:35.020563+0000', 'last_active': '2023-11-28T18:38:35.006358+0000', 'last_peered': '2023-11-28T18:38:35.006358+0000', 'last_clean': '2023-11-28T18:38:35.006358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T18:38:35.020563+0000', 'last_undegraded': '2023-11-28T18:38:35.020563+0000', 'last_fullsized': '2023-11-28T18:38:35.020563+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_clean_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T18:38:40.958 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2023-11-28T18:38:40.958 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T18:38:35.025671+0000', 'last_change': '2023-11-28T18:38:35.025671+0000', 'last_active': '2023-11-28T18:38:35.006358+0000', 'last_peered': '2023-11-28T18:38:35.006358+0000', 'last_clean': '2023-11-28T18:38:35.006358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T18:38:35.025671+0000', 'last_undegraded': '2023-11-28T18:38:35.025671+0000', 'last_fullsized': '2023-11-28T18:38:35.025671+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_clean_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-28T18:38:40.958 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1c is not active+clean 2023-11-28T18:38:40.958 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T18:38:35.016469+0000', 'last_change': '2023-11-28T18:38:35.016469+0000', 'last_active': '2023-11-28T18:38:35.006358+0000', 'last_peered': '2023-11-28T18:38:35.006358+0000', 'last_clean': '2023-11-28T18:38:35.006358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T18:38:35.016469+0000', 'last_undegraded': '2023-11-28T18:38:35.016469+0000', 'last_fullsized': '2023-11-28T18:38:35.016469+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_clean_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T18:38:40.958 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1d is not active+clean 2023-11-28T18:38:40.958 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T18:38:35.029593+0000', 'last_change': '2023-11-28T18:38:35.029593+0000', 'last_active': '2023-11-28T18:38:35.006358+0000', 'last_peered': '2023-11-28T18:38:35.006358+0000', 'last_clean': '2023-11-28T18:38:35.006358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T18:38:35.029593+0000', 'last_undegraded': '2023-11-28T18:38:35.029593+0000', 'last_fullsized': '2023-11-28T18:38:35.029593+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_clean_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T18:38:40.958 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1a is not active+clean 2023-11-28T18:38:40.958 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T18:38:35.027906+0000', 'last_change': '2023-11-28T18:38:35.027906+0000', 'last_active': '2023-11-28T18:38:35.006358+0000', 'last_peered': '2023-11-28T18:38:35.006358+0000', 'last_clean': '2023-11-28T18:38:35.006358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T18:38:35.027906+0000', 'last_undegraded': '2023-11-28T18:38:35.027906+0000', 'last_fullsized': '2023-11-28T18:38:35.027906+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_clean_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T18:38:40.958 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1b is not active+clean 2023-11-28T18:38:40.959 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T18:38:35.020339+0000', 'last_change': '2023-11-28T18:38:35.020339+0000', 'last_active': '2023-11-28T18:38:35.006358+0000', 'last_peered': '2023-11-28T18:38:35.006358+0000', 'last_clean': '2023-11-28T18:38:35.006358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T18:38:35.020339+0000', 'last_undegraded': '2023-11-28T18:38:35.020339+0000', 'last_fullsized': '2023-11-28T18:38:35.020339+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_clean_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T18:38:40.959 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.18 is not active+clean 2023-11-28T18:38:40.959 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T18:38:35.016575+0000', 'last_change': '2023-11-28T18:38:35.016575+0000', 'last_active': '2023-11-28T18:38:35.006358+0000', 'last_peered': '2023-11-28T18:38:35.006358+0000', 'last_clean': '2023-11-28T18:38:35.006358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T18:38:35.016575+0000', 'last_undegraded': '2023-11-28T18:38:35.016575+0000', 'last_fullsized': '2023-11-28T18:38:35.016575+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_clean_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T18:38:40.959 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.19 is not active+clean 2023-11-28T18:38:40.959 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T18:38:35.022571+0000', 'last_change': '2023-11-28T18:38:35.022571+0000', 'last_active': '2023-11-28T18:38:35.006358+0000', 'last_peered': '2023-11-28T18:38:35.006358+0000', 'last_clean': '2023-11-28T18:38:35.006358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T18:38:35.022571+0000', 'last_undegraded': '2023-11-28T18:38:35.022571+0000', 'last_fullsized': '2023-11-28T18:38:35.022571+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_clean_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T18:38:40.959 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2023-11-28T18:38:40.959 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T18:38:35.018726+0000', 'last_change': '2023-11-28T18:38:35.018726+0000', 'last_active': '2023-11-28T18:38:35.006358+0000', 'last_peered': '2023-11-28T18:38:35.006358+0000', 'last_clean': '2023-11-28T18:38:35.006358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T18:38:35.018726+0000', 'last_undegraded': '2023-11-28T18:38:35.018726+0000', 'last_fullsized': '2023-11-28T18:38:35.018726+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_clean_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T18:38:40.959 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.17 is not active+clean 2023-11-28T18:38:40.959 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T18:38:35.023319+0000', 'last_change': '2023-11-28T18:38:35.023319+0000', 'last_active': '2023-11-28T18:38:35.006358+0000', 'last_peered': '2023-11-28T18:38:35.006358+0000', 'last_clean': '2023-11-28T18:38:35.006358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T18:38:35.023319+0000', 'last_undegraded': '2023-11-28T18:38:35.023319+0000', 'last_fullsized': '2023-11-28T18:38:35.023319+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_clean_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T18:38:40.959 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.14 is not active+clean 2023-11-28T18:38:40.960 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T18:38:35.022334+0000', 'last_change': '2023-11-28T18:38:35.022334+0000', 'last_active': '2023-11-28T18:38:35.006358+0000', 'last_peered': '2023-11-28T18:38:35.006358+0000', 'last_clean': '2023-11-28T18:38:35.006358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T18:38:35.022334+0000', 'last_undegraded': '2023-11-28T18:38:35.022334+0000', 'last_fullsized': '2023-11-28T18:38:35.022334+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_clean_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T18:38:40.960 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.15 is not active+clean 2023-11-28T18:38:40.960 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T18:38:35.021907+0000', 'last_change': '2023-11-28T18:38:35.021907+0000', 'last_active': '2023-11-28T18:38:35.006358+0000', 'last_peered': '2023-11-28T18:38:35.006358+0000', 'last_clean': '2023-11-28T18:38:35.006358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T18:38:35.021907+0000', 'last_undegraded': '2023-11-28T18:38:35.021907+0000', 'last_fullsized': '2023-11-28T18:38:35.021907+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_clean_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T18:38:40.960 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.12 is not active+clean 2023-11-28T18:38:40.960 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T18:38:35.023841+0000', 'last_change': '2023-11-28T18:38:35.023841+0000', 'last_active': '2023-11-28T18:38:35.006358+0000', 'last_peered': '2023-11-28T18:38:35.006358+0000', 'last_clean': '2023-11-28T18:38:35.006358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T18:38:35.023841+0000', 'last_undegraded': '2023-11-28T18:38:35.023841+0000', 'last_fullsized': '2023-11-28T18:38:35.023841+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_clean_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T18:38:40.960 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.13 is not active+clean 2023-11-28T18:38:40.960 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T18:38:35.022151+0000', 'last_change': '2023-11-28T18:38:35.022151+0000', 'last_active': '2023-11-28T18:38:35.006358+0000', 'last_peered': '2023-11-28T18:38:35.006358+0000', 'last_clean': '2023-11-28T18:38:35.006358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T18:38:35.022151+0000', 'last_undegraded': '2023-11-28T18:38:35.022151+0000', 'last_fullsized': '2023-11-28T18:38:35.022151+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_clean_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T18:38:40.960 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.10 is not active+clean 2023-11-28T18:38:40.960 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T18:38:35.029514+0000', 'last_change': '2023-11-28T18:38:35.029514+0000', 'last_active': '2023-11-28T18:38:35.006358+0000', 'last_peered': '2023-11-28T18:38:35.006358+0000', 'last_clean': '2023-11-28T18:38:35.006358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T18:38:35.029514+0000', 'last_undegraded': '2023-11-28T18:38:35.029514+0000', 'last_fullsized': '2023-11-28T18:38:35.029514+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_clean_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T18:38:40.961 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2023-11-28T18:38:40.961 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T18:38:35.026360+0000', 'last_change': '2023-11-28T18:38:35.026360+0000', 'last_active': '2023-11-28T18:38:35.006358+0000', 'last_peered': '2023-11-28T18:38:35.006358+0000', 'last_clean': '2023-11-28T18:38:35.006358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T18:38:35.026360+0000', 'last_undegraded': '2023-11-28T18:38:35.026360+0000', 'last_fullsized': '2023-11-28T18:38:35.026360+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_clean_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-28T18:38:40.961 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.e is not active+clean 2023-11-28T18:38:40.961 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T18:38:35.016792+0000', 'last_change': '2023-11-28T18:38:35.016792+0000', 'last_active': '2023-11-28T18:38:35.006358+0000', 'last_peered': '2023-11-28T18:38:35.006358+0000', 'last_clean': '2023-11-28T18:38:35.006358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T18:38:35.016792+0000', 'last_undegraded': '2023-11-28T18:38:35.016792+0000', 'last_fullsized': '2023-11-28T18:38:35.016792+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_clean_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T18:38:40.961 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2023-11-28T18:38:40.961 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T18:38:35.021652+0000', 'last_change': '2023-11-28T18:38:35.021652+0000', 'last_active': '2023-11-28T18:38:35.006358+0000', 'last_peered': '2023-11-28T18:38:35.006358+0000', 'last_clean': '2023-11-28T18:38:35.006358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T18:38:35.021652+0000', 'last_undegraded': '2023-11-28T18:38:35.021652+0000', 'last_fullsized': '2023-11-28T18:38:35.021652+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_clean_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T18:38:40.961 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.c is not active+clean 2023-11-28T18:38:40.961 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T18:38:35.026820+0000', 'last_change': '2023-11-28T18:38:35.026820+0000', 'last_active': '2023-11-28T18:38:35.006358+0000', 'last_peered': '2023-11-28T18:38:35.006358+0000', 'last_clean': '2023-11-28T18:38:35.006358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T18:38:35.026820+0000', 'last_undegraded': '2023-11-28T18:38:35.026820+0000', 'last_fullsized': '2023-11-28T18:38:35.026820+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_clean_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T18:38:40.961 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.d is not active+clean 2023-11-28T18:38:40.961 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T18:38:35.023651+0000', 'last_change': '2023-11-28T18:38:35.023651+0000', 'last_active': '2023-11-28T18:38:35.006358+0000', 'last_peered': '2023-11-28T18:38:35.006358+0000', 'last_clean': '2023-11-28T18:38:35.006358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T18:38:35.023651+0000', 'last_undegraded': '2023-11-28T18:38:35.023651+0000', 'last_fullsized': '2023-11-28T18:38:35.023651+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_clean_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-28T18:38:40.962 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.a is not active+clean 2023-11-28T18:38:40.962 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T18:38:35.021628+0000', 'last_change': '2023-11-28T18:38:35.021628+0000', 'last_active': '2023-11-28T18:38:35.006358+0000', 'last_peered': '2023-11-28T18:38:35.006358+0000', 'last_clean': '2023-11-28T18:38:35.006358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T18:38:35.021628+0000', 'last_undegraded': '2023-11-28T18:38:35.021628+0000', 'last_fullsized': '2023-11-28T18:38:35.021628+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_clean_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-28T18:38:40.962 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.b is not active+clean 2023-11-28T18:38:40.962 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T18:38:35.023141+0000', 'last_change': '2023-11-28T18:38:35.023141+0000', 'last_active': '2023-11-28T18:38:35.006358+0000', 'last_peered': '2023-11-28T18:38:35.006358+0000', 'last_clean': '2023-11-28T18:38:35.006358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T18:38:35.023141+0000', 'last_undegraded': '2023-11-28T18:38:35.023141+0000', 'last_fullsized': '2023-11-28T18:38:35.023141+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_clean_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-28T18:38:40.962 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.8 is not active+clean 2023-11-28T18:38:40.962 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T18:38:35.022670+0000', 'last_change': '2023-11-28T18:38:35.022670+0000', 'last_active': '2023-11-28T18:38:35.006358+0000', 'last_peered': '2023-11-28T18:38:35.006358+0000', 'last_clean': '2023-11-28T18:38:35.006358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T18:38:35.022670+0000', 'last_undegraded': '2023-11-28T18:38:35.022670+0000', 'last_fullsized': '2023-11-28T18:38:35.022670+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_clean_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-28T18:38:40.962 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.9 is not active+clean 2023-11-28T18:38:40.962 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T18:38:35.032944+0000', 'last_change': '2023-11-28T18:38:35.032944+0000', 'last_active': '2023-11-28T18:38:35.006358+0000', 'last_peered': '2023-11-28T18:38:35.006358+0000', 'last_clean': '2023-11-28T18:38:35.006358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T18:38:35.032944+0000', 'last_undegraded': '2023-11-28T18:38:35.032944+0000', 'last_fullsized': '2023-11-28T18:38:35.032944+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_clean_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T18:38:40.962 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.6 is not active+clean 2023-11-28T18:38:40.962 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T18:38:35.022643+0000', 'last_change': '2023-11-28T18:38:35.022643+0000', 'last_active': '2023-11-28T18:38:35.006358+0000', 'last_peered': '2023-11-28T18:38:35.006358+0000', 'last_clean': '2023-11-28T18:38:35.006358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T18:38:35.022643+0000', 'last_undegraded': '2023-11-28T18:38:35.022643+0000', 'last_fullsized': '2023-11-28T18:38:35.022643+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_clean_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-28T18:38:40.963 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2023-11-28T18:38:40.963 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T18:38:35.021241+0000', 'last_change': '2023-11-28T18:38:35.021241+0000', 'last_active': '2023-11-28T18:38:35.006358+0000', 'last_peered': '2023-11-28T18:38:35.006358+0000', 'last_clean': '2023-11-28T18:38:35.006358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T18:38:35.021241+0000', 'last_undegraded': '2023-11-28T18:38:35.021241+0000', 'last_fullsized': '2023-11-28T18:38:35.021241+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_clean_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T18:38:40.963 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.5 is not active+clean 2023-11-28T18:38:40.963 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T18:38:35.019286+0000', 'last_change': '2023-11-28T18:38:35.019286+0000', 'last_active': '2023-11-28T18:38:35.006358+0000', 'last_peered': '2023-11-28T18:38:35.006358+0000', 'last_clean': '2023-11-28T18:38:35.006358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T18:38:35.019286+0000', 'last_undegraded': '2023-11-28T18:38:35.019286+0000', 'last_fullsized': '2023-11-28T18:38:35.019286+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_clean_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T18:38:40.963 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2 is not active+clean 2023-11-28T18:38:40.963 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T18:38:35.027923+0000', 'last_change': '2023-11-28T18:38:35.027923+0000', 'last_active': '2023-11-28T18:38:35.006358+0000', 'last_peered': '2023-11-28T18:38:35.006358+0000', 'last_clean': '2023-11-28T18:38:35.006358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T18:38:35.027923+0000', 'last_undegraded': '2023-11-28T18:38:35.027923+0000', 'last_fullsized': '2023-11-28T18:38:35.027923+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_clean_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-28T18:38:40.963 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3 is not active+clean 2023-11-28T18:38:40.963 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T18:38:35.019528+0000', 'last_change': '2023-11-28T18:38:35.019528+0000', 'last_active': '2023-11-28T18:38:35.006358+0000', 'last_peered': '2023-11-28T18:38:35.006358+0000', 'last_clean': '2023-11-28T18:38:35.006358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T18:38:35.019528+0000', 'last_undegraded': '2023-11-28T18:38:35.019528+0000', 'last_fullsized': '2023-11-28T18:38:35.019528+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_clean_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T18:38:40.963 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.0 is not active+clean 2023-11-28T18:38:40.964 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T18:38:35.026252+0000', 'last_change': '2023-11-28T18:38:35.026252+0000', 'last_active': '2023-11-28T18:38:35.006358+0000', 'last_peered': '2023-11-28T18:38:35.006358+0000', 'last_clean': '2023-11-28T18:38:35.006358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T18:38:35.026252+0000', 'last_undegraded': '2023-11-28T18:38:35.026252+0000', 'last_fullsized': '2023-11-28T18:38:35.026252+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_clean_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T18:38:40.964 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1 is not active+clean 2023-11-28T18:38:40.964 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T18:38:35.018130+0000', 'last_change': '2023-11-28T18:38:35.018130+0000', 'last_active': '2023-11-28T18:38:35.006358+0000', 'last_peered': '2023-11-28T18:38:35.006358+0000', 'last_clean': '2023-11-28T18:38:35.006358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T18:38:35.018130+0000', 'last_undegraded': '2023-11-28T18:38:35.018130+0000', 'last_fullsized': '2023-11-28T18:38:35.018130+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_clean_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T18:38:40.964 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.4 is not active+clean 2023-11-28T18:38:40.964 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T18:38:35.031614+0000', 'last_change': '2023-11-28T18:38:35.031614+0000', 'last_active': '2023-11-28T18:38:35.006358+0000', 'last_peered': '2023-11-28T18:38:35.006358+0000', 'last_clean': '2023-11-28T18:38:35.006358+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T18:38:35.031614+0000', 'last_undegraded': '2023-11-28T18:38:35.031614+0000', 'last_fullsized': '2023-11-28T18:38:35.031614+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'last_clean_scrub_stamp': '2023-11-28T18:38:35.006358+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T18:38:40.964 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-28T18:38:41.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.133+0000 7fbfbb901640 1 Processor -- start 2023-11-28T18:38:41.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.133+0000 7fbfbb901640 1 -- start start 2023-11-28T18:38:41.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.133+0000 7fbfbb901640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fbfb40b3cb0 0x7fbfb40d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:41.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.133+0000 7fbfbb901640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfb40d38c0 con 0x7fbfb40b35f0 2023-11-28T18:38:41.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.133+0000 7fbfbb901640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfb40cdcc0 con 0x7fbfb40cfed0 2023-11-28T18:38:41.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.133+0000 7fbfbb901640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfb40d40d0 con 0x7fbfb40b3cb0 2023-11-28T18:38:41.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.133+0000 7fbfb969d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fbfb40b35f0 0x7fbfb40cf7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33850/0 (socket says 172.21.15.45:33850) 2023-11-28T18:38:41.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.133+0000 7fbfb969d640 1 -- 172.21.15.45:0/2826011604 learned_addr learned my addr 172.21.15.45:0/2826011604 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:38:41.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.133+0000 7fbfb9e9e640 1 --2- 172.21.15.45:0/2826011604 >> v2:172.21.15.190:3300/0 conn(0x7fbfb40b3cb0 0x7fbfb40d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:41.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.133+0000 7fbfabfff640 1 -- 172.21.15.45:0/2826011604 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 987322193 0 0) 0x7fbfb40d38c0 con 0x7fbfb40b35f0 2023-11-28T18:38:41.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.133+0000 7fbfabfff640 1 -- 172.21.15.45:0/2826011604 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfa0003530 con 0x7fbfb40b35f0 2023-11-28T18:38:41.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.133+0000 7fbfabfff640 1 -- 172.21.15.45:0/2826011604 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2357326711 0 0) 0x7fbfb40cdcc0 con 0x7fbfb40cfed0 2023-11-28T18:38:41.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.133+0000 7fbfabfff640 1 -- 172.21.15.45:0/2826011604 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfb40d38c0 con 0x7fbfb40cfed0 2023-11-28T18:38:41.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.133+0000 7fbfb9e9e640 1 -- 172.21.15.45:0/2826011604 >> v1:172.21.15.190:6789/0 conn(0x7fbfb40cfed0 legacy=0x7fbfb40ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:41.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.133+0000 7fbfb9e9e640 1 -- 172.21.15.45:0/2826011604 >> v1:172.21.15.45:6789/0 conn(0x7fbfb40b35f0 legacy=0x7fbfb40cf7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:41.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.133+0000 7fbfb9e9e640 1 -- 172.21.15.45:0/2826011604 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfb40d3b10 con 0x7fbfb40b3cb0 2023-11-28T18:38:41.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.137+0000 7fbfb9e9e640 1 --2- 172.21.15.45:0/2826011604 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbfb40b3cb0 0x7fbfb40d0f90 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbfac009d90 tx=0x7fbfac01c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ce0be355a4dc1d5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:41.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.137+0000 7fbfabfff640 1 -- 172.21.15.45:0/2826011604 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfac0a59e0 con 0x7fbfb40b3cb0 2023-11-28T18:38:41.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.137+0000 7fbfabfff640 1 -- 172.21.15.45:0/2826011604 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfac0a5b40 con 0x7fbfb40b3cb0 2023-11-28T18:38:41.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.137+0000 7fbfabfff640 1 -- 172.21.15.45:0/2826011604 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfac0ad440 con 0x7fbfb40b3cb0 2023-11-28T18:38:41.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.137+0000 7fbfbb901640 1 -- 172.21.15.45:0/2826011604 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbfb40b3cb0 msgr2=0x7fbfb40d0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:41.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.137+0000 7fbfbb901640 1 --2- 172.21.15.45:0/2826011604 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbfb40b3cb0 0x7fbfb40d0f90 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbfac009d90 tx=0x7fbfac01c920 comp rx=0 tx=0).stop 2023-11-28T18:38:41.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.137+0000 7fbfbb901640 1 -- 172.21.15.45:0/2826011604 shutdown_connections 2023-11-28T18:38:41.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.137+0000 7fbfbb901640 1 --2- 172.21.15.45:0/2826011604 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbfb40b3cb0 0x7fbfb40d0f90 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:41.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.137+0000 7fbfbb901640 1 -- 172.21.15.45:0/2826011604 >> 172.21.15.45:0/2826011604 conn(0x7fbfb409c4f0 msgr2=0x7fbfb40d31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:41.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.137+0000 7fbfbb901640 1 -- 172.21.15.45:0/2826011604 shutdown_connections 2023-11-28T18:38:41.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.137+0000 7fbfbb901640 1 -- 172.21.15.45:0/2826011604 wait complete. 2023-11-28T18:38:41.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.141+0000 7fbfbb901640 1 Processor -- start 2023-11-28T18:38:41.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.141+0000 7fbfbb901640 1 -- start start 2023-11-28T18:38:41.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.141+0000 7fbfbb901640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbfb40b35f0 0x7fbfb40ccf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:41.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.141+0000 7fbfbb901640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfb40b3cb0 0x7fbfb409e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:41.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.141+0000 7fbfbb901640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbfb40cfed0 0x7fbfb406c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:41.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.141+0000 7fbfbb901640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb409f260 con 0x7fbfb40b3cb0 2023-11-28T18:38:41.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.141+0000 7fbfbb901640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb41f9a70 con 0x7fbfb40cfed0 2023-11-28T18:38:41.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.141+0000 7fbfbb901640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb41f9d50 con 0x7fbfb40b35f0 2023-11-28T18:38:41.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.141+0000 7fbfb8e9c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfb40b3cb0 0x7fbfb409e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:41.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.141+0000 7fbfb8e9c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfb40b3cb0 0x7fbfb409e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58516/0 (socket says 172.21.15.45:58516) 2023-11-28T18:38:41.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.141+0000 7fbfb8e9c640 1 -- 172.21.15.45:0/3648728962 learned_addr learned my addr 172.21.15.45:0/3648728962 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:41.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.141+0000 7fbfb969d640 1 --2- 172.21.15.45:0/3648728962 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbfb40b35f0 0x7fbfb40ccf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:41.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.141+0000 7fbfb9e9e640 1 --2- 172.21.15.45:0/3648728962 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbfb40cfed0 0x7fbfb406c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:41.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.141+0000 7fbfb8e9c640 1 -- 172.21.15.45:0/3648728962 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbfb40b35f0 msgr2=0x7fbfb40ccf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:41.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.141+0000 7fbfb8e9c640 1 --2- 172.21.15.45:0/3648728962 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbfb40b35f0 0x7fbfb40ccf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:41.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.141+0000 7fbfb8e9c640 1 -- 172.21.15.45:0/3648728962 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbfb40cfed0 msgr2=0x7fbfb406c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:41.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.141+0000 7fbfb8e9c640 1 --2- 172.21.15.45:0/3648728962 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbfb40cfed0 0x7fbfb406c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:41.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.141+0000 7fbfb8e9c640 1 -- 172.21.15.45:0/3648728962 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfac009a70 con 0x7fbfb40b3cb0 2023-11-28T18:38:41.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.141+0000 7fbfb8e9c640 1 --2- 172.21.15.45:0/3648728962 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfb40b3cb0 0x7fbfb409e8f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fbfa400c430 tx=0x7fbfa400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:41.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.141+0000 7fbfa9ffb640 1 -- 172.21.15.45:0/3648728962 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa40052d0 con 0x7fbfb40b3cb0 2023-11-28T18:38:41.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.141+0000 7fbfa9ffb640 1 -- 172.21.15.45:0/3648728962 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfa4005450 con 0x7fbfb40b3cb0 2023-11-28T18:38:41.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.141+0000 7fbfa9ffb640 1 -- 172.21.15.45:0/3648728962 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa4003840 con 0x7fbfb40b3cb0 2023-11-28T18:38:41.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.141+0000 7fbfbb901640 1 -- 172.21.15.45:0/3648728962 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfb41fa030 con 0x7fbfb40b3cb0 2023-11-28T18:38:41.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.141+0000 7fbfbb901640 1 -- 172.21.15.45:0/3648728962 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfb40cd4a0 con 0x7fbfb40b3cb0 2023-11-28T18:38:41.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.145+0000 7fbfbb901640 1 -- 172.21.15.45:0/3648728962 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfb41fa270 con 0x7fbfb40b3cb0 2023-11-28T18:38:41.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.145+0000 7fbfa9ffb640 1 -- 172.21.15.45:0/3648728962 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fbfa40039a0 con 0x7fbfb40b3cb0 2023-11-28T18:38:41.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.145+0000 7fbfa9ffb640 1 --2- 172.21.15.45:0/3648728962 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbf980668d0 0x7fbf98068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:41.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.145+0000 7fbfa9ffb640 1 -- 172.21.15.45:0/3648728962 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbfa40839d0 con 0x7fbfb40b3cb0 2023-11-28T18:38:41.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.145+0000 7fbfb969d640 1 --2- 172.21.15.45:0/3648728962 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbf980668d0 0x7fbf98068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:41.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.145+0000 7fbfb969d640 1 --2- 172.21.15.45:0/3648728962 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbf980668d0 0x7fbf98068d90 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fbfb0000f70 tx=0x7fbfb0007d40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:41.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.149+0000 7fbfa9ffb640 1 -- 172.21.15.45:0/3648728962 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbfb41fa270 con 0x7fbfb40b3cb0 2023-11-28T18:38:41.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.361+0000 7fbfbb901640 1 -- 172.21.15.45:0/3648728962 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fbfb41fa270 con 0x7fbfb40b3cb0 2023-11-28T18:38:41.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.361+0000 7fbfa9ffb640 1 -- 172.21.15.45:0/3648728962 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1580 (secure 0 0 0) 0x7fbfa4017640 con 0x7fbfb40b3cb0 2023-11-28T18:38:41.364 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:38:41.364 INFO:teuthology.orchestra.run.smithi045.stdout:{"fsid":"d10f5cd6-1d00-4019-99b6-6fa435498a15","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":93,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":34,"num_osds":8,"num_up_osds":8,"osd_up_since":1701196640,"num_in_osds":8,"osd_in_since":1701196630,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":242376704,"bytes_avail":772851736576,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":16,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":5253}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2023-11-28T18:38:21.245040+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-11-28T18:38:41.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.361+0000 7fbfbb901640 1 -- 172.21.15.45:0/3648728962 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbf980668d0 msgr2=0x7fbf98068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:41.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.361+0000 7fbfbb901640 1 --2- 172.21.15.45:0/3648728962 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbf980668d0 0x7fbf98068d90 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fbfb0000f70 tx=0x7fbfb0007d40 comp rx=0 tx=0).stop 2023-11-28T18:38:41.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.361+0000 7fbfbb901640 1 -- 172.21.15.45:0/3648728962 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfb40b3cb0 msgr2=0x7fbfb409e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:41.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.361+0000 7fbfbb901640 1 --2- 172.21.15.45:0/3648728962 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfb40b3cb0 0x7fbfb409e8f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fbfa400c430 tx=0x7fbfa400c8f0 comp rx=0 tx=0).stop 2023-11-28T18:38:41.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.361+0000 7fbfbb901640 1 -- 172.21.15.45:0/3648728962 shutdown_connections 2023-11-28T18:38:41.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.361+0000 7fbfbb901640 1 --2- 172.21.15.45:0/3648728962 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbf980668d0 0x7fbf98068d90 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:41.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.361+0000 7fbfbb901640 1 --2- 172.21.15.45:0/3648728962 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbfb40cfed0 0x7fbfb406c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:41.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.361+0000 7fbfbb901640 1 --2- 172.21.15.45:0/3648728962 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfb40b3cb0 0x7fbfb409e8f0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:41.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.361+0000 7fbfbb901640 1 --2- 172.21.15.45:0/3648728962 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbfb40b35f0 0x7fbfb40ccf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:41.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.361+0000 7fbfbb901640 1 -- 172.21.15.45:0/3648728962 >> 172.21.15.45:0/3648728962 conn(0x7fbfb409c4f0 msgr2=0x7fbfb415d240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:41.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.361+0000 7fbfbb901640 1 -- 172.21.15.45:0/3648728962 shutdown_connections 2023-11-28T18:38:41.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.361+0000 7fbfbb901640 1 -- 172.21.15.45:0/3648728962 wait complete. 2023-11-28T18:38:41.385 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-28T18:38:41.385 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T18:38:41.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.525+0000 7f4cfdbb8640 1 Processor -- start 2023-11-28T18:38:44.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.525+0000 7f4cfdbb8640 1 -- start start 2023-11-28T18:38:44.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.525+0000 7f4cfdbb8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4cf80cfed0 0x7f4cf80d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:44.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.525+0000 7f4cfdbb8640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f4cf80b3cb0 0x7f4cf815f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:44.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.525+0000 7f4cfdbb8640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cf80d38c0 con 0x7f4cf80b35f0 2023-11-28T18:38:44.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.525+0000 7f4cfdbb8640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cf80d40d0 con 0x7f4cf80cfed0 2023-11-28T18:38:44.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.525+0000 7f4cfdbb8640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cf80cdcc0 con 0x7f4cf80b3cb0 2023-11-28T18:38:44.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.525+0000 7f4ceffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4cf80cfed0 0x7f4cf80d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:44.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.525+0000 7f4cf77fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f4cf80b35f0 0x7f4cf80cf7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33856/0 (socket says 172.21.15.45:33856) 2023-11-28T18:38:44.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.525+0000 7f4ceffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4cf80cfed0 0x7f4cf80d0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58518/0 (socket says 172.21.15.45:58518) 2023-11-28T18:38:44.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.525+0000 7f4cf77fe640 1 -- 172.21.15.45:0/3902035938 learned_addr learned my addr 172.21.15.45:0/3902035938 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:38:44.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.525+0000 7f4cf7fff640 1 --2- 172.21.15.45:0/3902035938 >> v2:172.21.15.190:3300/0 conn(0x7f4cf80b3cb0 0x7f4cf815f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:44.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.525+0000 7f4ceffff640 1 -- 172.21.15.45:0/3902035938 >> v2:172.21.15.190:3300/0 conn(0x7f4cf80b3cb0 msgr2=0x7f4cf815f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:44.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.525+0000 7f4ceffff640 1 --2- 172.21.15.45:0/3902035938 >> v2:172.21.15.190:3300/0 conn(0x7f4cf80b3cb0 0x7f4cf815f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:44.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.525+0000 7f4ceffff640 1 -- 172.21.15.45:0/3902035938 >> v1:172.21.15.45:6789/0 conn(0x7f4cf80b35f0 legacy=0x7f4cf80cf7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:44.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.525+0000 7f4ceffff640 1 -- 172.21.15.45:0/3902035938 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf80d3b10 con 0x7f4cf80cfed0 2023-11-28T18:38:44.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.529+0000 7f4ceffff640 1 --2- 172.21.15.45:0/3902035938 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cf80cfed0 0x7f4cf80d0f90 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f4cf80d2b20 tx=0x7f4ce001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3306807513d51c9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:44.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.529+0000 7f4cf6ffd640 1 -- 172.21.15.45:0/3902035938 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce00ab660 con 0x7f4cf80cfed0 2023-11-28T18:38:44.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.529+0000 7f4cf6ffd640 1 -- 172.21.15.45:0/3902035938 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ce00ab7c0 con 0x7f4cf80cfed0 2023-11-28T18:38:44.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.529+0000 7f4cf6ffd640 1 -- 172.21.15.45:0/3902035938 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce00abb50 con 0x7f4cf80cfed0 2023-11-28T18:38:44.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.529+0000 7f4cfdbb8640 1 -- 172.21.15.45:0/3902035938 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cf80cfed0 msgr2=0x7f4cf80d0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:44.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.529+0000 7f4cfdbb8640 1 --2- 172.21.15.45:0/3902035938 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cf80cfed0 0x7f4cf80d0f90 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f4cf80d2b20 tx=0x7f4ce001c460 comp rx=0 tx=0).stop 2023-11-28T18:38:44.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.529+0000 7f4cfdbb8640 1 -- 172.21.15.45:0/3902035938 shutdown_connections 2023-11-28T18:38:44.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.529+0000 7f4cfdbb8640 1 --2- 172.21.15.45:0/3902035938 >> v2:172.21.15.190:3300/0 conn(0x7f4cf80b3cb0 0x7f4cf815f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:44.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.529+0000 7f4cfdbb8640 1 --2- 172.21.15.45:0/3902035938 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cf80cfed0 0x7f4cf80d0f90 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:44.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.529+0000 7f4cfdbb8640 1 -- 172.21.15.45:0/3902035938 >> 172.21.15.45:0/3902035938 conn(0x7f4cf809c4f0 msgr2=0x7f4cf80d31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:44.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.529+0000 7f4cfdbb8640 1 -- 172.21.15.45:0/3902035938 shutdown_connections 2023-11-28T18:38:44.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.529+0000 7f4cfdbb8640 1 -- 172.21.15.45:0/3902035938 wait complete. 2023-11-28T18:38:44.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.533+0000 7f4cfdbb8640 1 Processor -- start 2023-11-28T18:38:44.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.533+0000 7f4cfdbb8640 1 -- start start 2023-11-28T18:38:44.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.533+0000 7f4cfdbb8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4cf80b35f0 0x7f4cf80b7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:44.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.533+0000 7f4cfdbb8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4cf80b3cb0 0x7f4cf80cbce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:44.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.533+0000 7f4cfdbb8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cf80cfed0 0x7f4cf80cc220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:44.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.533+0000 7f4cfdbb8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf815b300 con 0x7f4cf80cfed0 2023-11-28T18:38:44.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.533+0000 7f4cfdbb8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf8145940 con 0x7f4cf80b35f0 2023-11-28T18:38:44.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.533+0000 7f4cfdbb8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf8145f00 con 0x7f4cf80b3cb0 2023-11-28T18:38:44.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.533+0000 7f4cf7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cf80cfed0 0x7f4cf80cc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:44.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.533+0000 7f4cf7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cf80cfed0 0x7f4cf80cc220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58528/0 (socket says 172.21.15.45:58528) 2023-11-28T18:38:44.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.533+0000 7f4cf7fff640 1 -- 172.21.15.45:0/2385473821 learned_addr learned my addr 172.21.15.45:0/2385473821 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:44.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.533+0000 7f4cf77fe640 1 --2- 172.21.15.45:0/2385473821 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4cf80b35f0 0x7f4cf80b7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:44.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.533+0000 7f4ceffff640 1 --2- 172.21.15.45:0/2385473821 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4cf80b3cb0 0x7f4cf80cbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:44.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.533+0000 7f4cf7fff640 1 -- 172.21.15.45:0/2385473821 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4cf80b3cb0 msgr2=0x7f4cf80cbce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:44.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.533+0000 7f4cf7fff640 1 --2- 172.21.15.45:0/2385473821 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4cf80b3cb0 0x7f4cf80cbce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:44.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.533+0000 7f4cf7fff640 1 -- 172.21.15.45:0/2385473821 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4cf80b35f0 msgr2=0x7f4cf80b7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:44.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.533+0000 7f4cf7fff640 1 --2- 172.21.15.45:0/2385473821 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4cf80b35f0 0x7f4cf80b7890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:44.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.533+0000 7f4cf7fff640 1 -- 172.21.15.45:0/2385473821 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ce0009420 con 0x7f4cf80cfed0 2023-11-28T18:38:44.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.533+0000 7f4cf7fff640 1 --2- 172.21.15.45:0/2385473821 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cf80cfed0 0x7f4cf80cc220 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f4cf0007dc0 tx=0x7f4cf000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:44.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.533+0000 7f4cf4ff9640 1 -- 172.21.15.45:0/2385473821 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf0014420 con 0x7f4cf80cfed0 2023-11-28T18:38:44.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.533+0000 7f4cf4ff9640 1 -- 172.21.15.45:0/2385473821 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cf00145a0 con 0x7f4cf80cfed0 2023-11-28T18:38:44.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.533+0000 7f4cf4ff9640 1 -- 172.21.15.45:0/2385473821 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf0014950 con 0x7f4cf80cfed0 2023-11-28T18:38:44.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.533+0000 7f4cfdbb8640 1 -- 172.21.15.45:0/2385473821 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cf80cc8c0 con 0x7f4cf80cfed0 2023-11-28T18:38:44.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.533+0000 7f4cfdbb8640 1 -- 172.21.15.45:0/2385473821 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cf8145b90 con 0x7f4cf80cfed0 2023-11-28T18:38:44.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.537+0000 7f4cfdbb8640 1 -- 172.21.15.45:0/2385473821 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cf8069480 con 0x7f4cf80cfed0 2023-11-28T18:38:44.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.537+0000 7f4cf4ff9640 1 -- 172.21.15.45:0/2385473821 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f4cf0014ab0 con 0x7f4cf80cfed0 2023-11-28T18:38:44.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.537+0000 7f4cf4ff9640 1 --2- 172.21.15.45:0/2385473821 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4cd80668d0 0x7f4cd8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:44.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.537+0000 7f4cf4ff9640 1 -- 172.21.15.45:0/2385473821 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4cf0084c40 con 0x7f4cf80cfed0 2023-11-28T18:38:44.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.537+0000 7f4cf77fe640 1 --2- 172.21.15.45:0/2385473821 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4cd80668d0 0x7f4cd8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:44.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.537+0000 7f4cf77fe640 1 --2- 172.21.15.45:0/2385473821 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4cd80668d0 0x7f4cd8068d90 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4ce8000f70 tx=0x7f4ce8007e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:44.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.541+0000 7f4cf4ff9640 1 -- 172.21.15.45:0/2385473821 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4cf0051f20 con 0x7f4cf80cfed0 2023-11-28T18:38:44.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.697+0000 7f4cfdbb8640 1 -- 172.21.15.45:0/2385473821 --> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4cf80b39d0 con 0x7f4cd80668d0 2023-11-28T18:38:44.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.705+0000 7f4cf4ff9640 1 -- 172.21.15.45:0/2385473821 <== mgr.4100 v2:172.21.15.190:6832/645101166 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289027 (secure 0 0 0) 0x7f4ce80014a0 con 0x7f4cd80668d0 2023-11-28T18:38:44.342 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:38:44.343 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-11-28T18:38:44.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.709+0000 7f4cfdbb8640 1 -- 172.21.15.45:0/2385473821 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4cd80668d0 msgr2=0x7f4cd8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:44.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.709+0000 7f4cfdbb8640 1 --2- 172.21.15.45:0/2385473821 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4cd80668d0 0x7f4cd8068d90 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4ce8000f70 tx=0x7f4ce8007e90 comp rx=0 tx=0).stop 2023-11-28T18:38:44.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.709+0000 7f4cfdbb8640 1 -- 172.21.15.45:0/2385473821 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cf80cfed0 msgr2=0x7f4cf80cc220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:44.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.709+0000 7f4cfdbb8640 1 --2- 172.21.15.45:0/2385473821 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cf80cfed0 0x7f4cf80cc220 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f4cf0007dc0 tx=0x7f4cf000e4b0 comp rx=0 tx=0).stop 2023-11-28T18:38:44.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.709+0000 7f4cfdbb8640 1 -- 172.21.15.45:0/2385473821 shutdown_connections 2023-11-28T18:38:44.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.709+0000 7f4cfdbb8640 1 --2- 172.21.15.45:0/2385473821 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4cd80668d0 0x7f4cd8068d90 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:44.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.709+0000 7f4cfdbb8640 1 --2- 172.21.15.45:0/2385473821 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cf80cfed0 0x7f4cf80cc220 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:44.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.709+0000 7f4cfdbb8640 1 --2- 172.21.15.45:0/2385473821 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4cf80b3cb0 0x7f4cf80cbce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:44.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.709+0000 7f4cfdbb8640 1 --2- 172.21.15.45:0/2385473821 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4cf80b35f0 0x7f4cf80b7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:44.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.709+0000 7f4cfdbb8640 1 -- 172.21.15.45:0/2385473821 >> 172.21.15.45:0/2385473821 conn(0x7f4cf809c4f0 msgr2=0x7f4cf80cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:44.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.709+0000 7f4cfdbb8640 1 -- 172.21.15.45:0/2385473821 shutdown_connections 2023-11-28T18:38:44.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:41.709+0000 7f4cfdbb8640 1 -- 172.21.15.45:0/2385473821 wait complete. 2023-11-28T18:38:44.346 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":68,"stamp":"2023-11-28T18:38:41.248950+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237036,"kb_used_data":4232,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737684,"statfs":{"total":773094113280,"available":772851388416,"internally_reserved":0,"allocated":4333568,"data_stored":2399772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.236308"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.557296+0000","last_change":"2023-11-28T18:38:36.048499+0000","last_active":"2023-11-28T18:38:37.557296+0000","last_peered":"2023-11-28T18:38:37.557296+0000","last_clean":"2023-11-28T18:38:37.557296+0000","last_became_active":"2023-11-28T18:38:36.048195+0000","last_became_peered":"2023-11-28T18:38:36.048195+0000","last_unstale":"2023-11-28T18:38:37.557296+0000","last_undegraded":"2023-11-28T18:38:37.557296+0000","last_fullsized":"2023-11-28T18:38:37.557296+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:24:41.610022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.046664+0000","last_change":"2023-11-28T18:38:36.049196+0000","last_active":"2023-11-28T18:38:37.046664+0000","last_peered":"2023-11-28T18:38:37.046664+0000","last_clean":"2023-11-28T18:38:37.046664+0000","last_became_active":"2023-11-28T18:38:36.048516+0000","last_became_peered":"2023-11-28T18:38:36.048516+0000","last_unstale":"2023-11-28T18:38:37.046664+0000","last_undegraded":"2023-11-28T18:38:37.046664+0000","last_fullsized":"2023-11-28T18:38:37.046664+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:50:14.192746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.053609+0000","last_change":"2023-11-28T18:38:36.044114+0000","last_active":"2023-11-28T18:38:37.053609+0000","last_peered":"2023-11-28T18:38:37.053609+0000","last_clean":"2023-11-28T18:38:37.053609+0000","last_became_active":"2023-11-28T18:38:36.043737+0000","last_became_peered":"2023-11-28T18:38:36.043737+0000","last_unstale":"2023-11-28T18:38:37.053609+0000","last_undegraded":"2023-11-28T18:38:37.053609+0000","last_fullsized":"2023-11-28T18:38:37.053609+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:50:14.192746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.440583+0000","last_change":"2023-11-28T18:38:36.050806+0000","last_active":"2023-11-28T18:38:37.440583+0000","last_peered":"2023-11-28T18:38:37.440583+0000","last_clean":"2023-11-28T18:38:37.440583+0000","last_became_active":"2023-11-28T18:38:36.050513+0000","last_became_peered":"2023-11-28T18:38:36.050513+0000","last_unstale":"2023-11-28T18:38:37.440583+0000","last_undegraded":"2023-11-28T18:38:37.440583+0000","last_fullsized":"2023-11-28T18:38:37.440583+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:00:56.446902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.555498+0000","last_change":"2023-11-28T18:38:36.056292+0000","last_active":"2023-11-28T18:38:37.555498+0000","last_peered":"2023-11-28T18:38:37.555498+0000","last_clean":"2023-11-28T18:38:37.555498+0000","last_became_active":"2023-11-28T18:38:36.056053+0000","last_became_peered":"2023-11-28T18:38:36.056053+0000","last_unstale":"2023-11-28T18:38:37.555498+0000","last_undegraded":"2023-11-28T18:38:37.555498+0000","last_fullsized":"2023-11-28T18:38:37.555498+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:07:09.168762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.046084+0000","last_change":"2023-11-28T18:38:36.044845+0000","last_active":"2023-11-28T18:38:37.046084+0000","last_peered":"2023-11-28T18:38:37.046084+0000","last_clean":"2023-11-28T18:38:37.046084+0000","last_became_active":"2023-11-28T18:38:36.044564+0000","last_became_peered":"2023-11-28T18:38:36.044564+0000","last_unstale":"2023-11-28T18:38:37.046084+0000","last_undegraded":"2023-11-28T18:38:37.046084+0000","last_fullsized":"2023-11-28T18:38:37.046084+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:13:10.806764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.053703+0000","last_change":"2023-11-28T18:38:36.057741+0000","last_active":"2023-11-28T18:38:37.053703+0000","last_peered":"2023-11-28T18:38:37.053703+0000","last_clean":"2023-11-28T18:38:37.053703+0000","last_became_active":"2023-11-28T18:38:36.057436+0000","last_became_peered":"2023-11-28T18:38:36.057436+0000","last_unstale":"2023-11-28T18:38:37.053703+0000","last_undegraded":"2023-11-28T18:38:37.053703+0000","last_fullsized":"2023-11-28T18:38:37.053703+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:50:14.192746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.053015+0000","last_change":"2023-11-28T18:38:36.048935+0000","last_active":"2023-11-28T18:38:37.053015+0000","last_peered":"2023-11-28T18:38:37.053015+0000","last_clean":"2023-11-28T18:38:37.053015+0000","last_became_active":"2023-11-28T18:38:36.048664+0000","last_became_peered":"2023-11-28T18:38:36.048664+0000","last_unstale":"2023-11-28T18:38:37.053015+0000","last_undegraded":"2023-11-28T18:38:37.053015+0000","last_fullsized":"2023-11-28T18:38:37.053015+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:30:37.191534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.557083+0000","last_change":"2023-11-28T18:38:36.049359+0000","last_active":"2023-11-28T18:38:37.557083+0000","last_peered":"2023-11-28T18:38:37.557083+0000","last_clean":"2023-11-28T18:38:37.557083+0000","last_became_active":"2023-11-28T18:38:36.049058+0000","last_became_peered":"2023-11-28T18:38:36.049058+0000","last_unstale":"2023-11-28T18:38:37.557083+0000","last_undegraded":"2023-11-28T18:38:37.557083+0000","last_fullsized":"2023-11-28T18:38:37.557083+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:05:48.872445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.440739+0000","last_change":"2023-11-28T18:38:36.055059+0000","last_active":"2023-11-28T18:38:37.440739+0000","last_peered":"2023-11-28T18:38:37.440739+0000","last_clean":"2023-11-28T18:38:37.440739+0000","last_became_active":"2023-11-28T18:38:36.054791+0000","last_became_peered":"2023-11-28T18:38:36.054791+0000","last_unstale":"2023-11-28T18:38:37.440739+0000","last_undegraded":"2023-11-28T18:38:37.440739+0000","last_fullsized":"2023-11-28T18:38:37.440739+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:51:56.251868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.053793+0000","last_change":"2023-11-28T18:38:36.049539+0000","last_active":"2023-11-28T18:38:37.053793+0000","last_peered":"2023-11-28T18:38:37.053793+0000","last_clean":"2023-11-28T18:38:37.053793+0000","last_became_active":"2023-11-28T18:38:36.049258+0000","last_became_peered":"2023-11-28T18:38:36.049258+0000","last_unstale":"2023-11-28T18:38:37.053793+0000","last_undegraded":"2023-11-28T18:38:37.053793+0000","last_fullsized":"2023-11-28T18:38:37.053793+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:22:24.110740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.053462+0000","last_change":"2023-11-28T18:38:36.053117+0000","last_active":"2023-11-28T18:38:37.053462+0000","last_peered":"2023-11-28T18:38:37.053462+0000","last_clean":"2023-11-28T18:38:37.053462+0000","last_became_active":"2023-11-28T18:38:36.052777+0000","last_became_peered":"2023-11-28T18:38:36.052777+0000","last_unstale":"2023-11-28T18:38:37.053462+0000","last_undegraded":"2023-11-28T18:38:37.053462+0000","last_fullsized":"2023-11-28T18:38:37.053462+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:47:23.624240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.555565+0000","last_change":"2023-11-28T18:38:36.048096+0000","last_active":"2023-11-28T18:38:37.555565+0000","last_peered":"2023-11-28T18:38:37.555565+0000","last_clean":"2023-11-28T18:38:37.555565+0000","last_became_active":"2023-11-28T18:38:36.047805+0000","last_became_peered":"2023-11-28T18:38:36.047805+0000","last_unstale":"2023-11-28T18:38:37.555565+0000","last_undegraded":"2023-11-28T18:38:37.555565+0000","last_fullsized":"2023-11-28T18:38:37.555565+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:06:48.142778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.046154+0000","last_change":"2023-11-28T18:38:36.048850+0000","last_active":"2023-11-28T18:38:37.046154+0000","last_peered":"2023-11-28T18:38:37.046154+0000","last_clean":"2023-11-28T18:38:37.046154+0000","last_became_active":"2023-11-28T18:38:36.048587+0000","last_became_peered":"2023-11-28T18:38:36.048587+0000","last_unstale":"2023-11-28T18:38:37.046154+0000","last_undegraded":"2023-11-28T18:38:37.046154+0000","last_fullsized":"2023-11-28T18:38:37.046154+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:47:23.624240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.053192+0000","last_change":"2023-11-28T18:38:36.053163+0000","last_active":"2023-11-28T18:38:37.053192+0000","last_peered":"2023-11-28T18:38:37.053192+0000","last_clean":"2023-11-28T18:38:37.053192+0000","last_became_active":"2023-11-28T18:38:36.052492+0000","last_became_peered":"2023-11-28T18:38:36.052492+0000","last_unstale":"2023-11-28T18:38:37.053192+0000","last_undegraded":"2023-11-28T18:38:37.053192+0000","last_fullsized":"2023-11-28T18:38:37.053192+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:13:10.806764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.053507+0000","last_change":"2023-11-28T18:38:36.056414+0000","last_active":"2023-11-28T18:38:37.053507+0000","last_peered":"2023-11-28T18:38:37.053507+0000","last_clean":"2023-11-28T18:38:37.053507+0000","last_became_active":"2023-11-28T18:38:36.056067+0000","last_became_peered":"2023-11-28T18:38:36.056067+0000","last_unstale":"2023-11-28T18:38:37.053507+0000","last_undegraded":"2023-11-28T18:38:37.053507+0000","last_fullsized":"2023-11-28T18:38:37.053507+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:22:01.056346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.054083+0000","last_change":"2023-11-28T18:38:36.056315+0000","last_active":"2023-11-28T18:38:37.054083+0000","last_peered":"2023-11-28T18:38:37.054083+0000","last_clean":"2023-11-28T18:38:37.054083+0000","last_became_active":"2023-11-28T18:38:36.056108+0000","last_became_peered":"2023-11-28T18:38:36.056108+0000","last_unstale":"2023-11-28T18:38:37.054083+0000","last_undegraded":"2023-11-28T18:38:37.054083+0000","last_fullsized":"2023-11-28T18:38:37.054083+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:12:23.813010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.046670+0000","last_change":"2023-11-28T18:38:36.049035+0000","last_active":"2023-11-28T18:38:37.046670+0000","last_peered":"2023-11-28T18:38:37.046670+0000","last_clean":"2023-11-28T18:38:37.046670+0000","last_became_active":"2023-11-28T18:38:36.048236+0000","last_became_peered":"2023-11-28T18:38:36.048236+0000","last_unstale":"2023-11-28T18:38:37.046670+0000","last_undegraded":"2023-11-28T18:38:37.046670+0000","last_fullsized":"2023-11-28T18:38:37.046670+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:22:24.110740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.046448+0000","last_change":"2023-11-28T18:38:36.054163+0000","last_active":"2023-11-28T18:38:37.046448+0000","last_peered":"2023-11-28T18:38:37.046448+0000","last_clean":"2023-11-28T18:38:37.046448+0000","last_became_active":"2023-11-28T18:38:36.053935+0000","last_became_peered":"2023-11-28T18:38:36.053935+0000","last_unstale":"2023-11-28T18:38:37.046448+0000","last_undegraded":"2023-11-28T18:38:37.046448+0000","last_fullsized":"2023-11-28T18:38:37.046448+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:22:01.056346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.555720+0000","last_change":"2023-11-28T18:38:36.045594+0000","last_active":"2023-11-28T18:38:37.555720+0000","last_peered":"2023-11-28T18:38:37.555720+0000","last_clean":"2023-11-28T18:38:37.555720+0000","last_became_active":"2023-11-28T18:38:36.045334+0000","last_became_peered":"2023-11-28T18:38:36.045334+0000","last_unstale":"2023-11-28T18:38:37.555720+0000","last_undegraded":"2023-11-28T18:38:37.555720+0000","last_fullsized":"2023-11-28T18:38:37.555720+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:57:35.912381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.557070+0000","last_change":"2023-11-28T18:38:36.041953+0000","last_active":"2023-11-28T18:38:37.557070+0000","last_peered":"2023-11-28T18:38:37.557070+0000","last_clean":"2023-11-28T18:38:37.557070+0000","last_became_active":"2023-11-28T18:38:36.041500+0000","last_became_peered":"2023-11-28T18:38:36.041500+0000","last_unstale":"2023-11-28T18:38:37.557070+0000","last_undegraded":"2023-11-28T18:38:37.557070+0000","last_fullsized":"2023-11-28T18:38:37.557070+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:30:41.654711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.556607+0000","last_change":"2023-11-28T18:38:36.055692+0000","last_active":"2023-11-28T18:38:37.556607+0000","last_peered":"2023-11-28T18:38:37.556607+0000","last_clean":"2023-11-28T18:38:37.556607+0000","last_became_active":"2023-11-28T18:38:36.055413+0000","last_became_peered":"2023-11-28T18:38:36.055413+0000","last_unstale":"2023-11-28T18:38:37.556607+0000","last_undegraded":"2023-11-28T18:38:37.556607+0000","last_fullsized":"2023-11-28T18:38:37.556607+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:20:40.669777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.437820+0000","last_change":"2023-11-28T18:38:36.043333+0000","last_active":"2023-11-28T18:38:37.437820+0000","last_peered":"2023-11-28T18:38:37.437820+0000","last_clean":"2023-11-28T18:38:37.437820+0000","last_became_active":"2023-11-28T18:38:36.042973+0000","last_became_peered":"2023-11-28T18:38:36.042973+0000","last_unstale":"2023-11-28T18:38:37.437820+0000","last_undegraded":"2023-11-28T18:38:37.437820+0000","last_fullsized":"2023-11-28T18:38:37.437820+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:04:21.753781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.053039+0000","last_change":"2023-11-28T18:38:36.050584+0000","last_active":"2023-11-28T18:38:37.053039+0000","last_peered":"2023-11-28T18:38:37.053039+0000","last_clean":"2023-11-28T18:38:37.053039+0000","last_became_active":"2023-11-28T18:38:36.048024+0000","last_became_peered":"2023-11-28T18:38:36.048024+0000","last_unstale":"2023-11-28T18:38:37.053039+0000","last_undegraded":"2023-11-28T18:38:37.053039+0000","last_fullsized":"2023-11-28T18:38:37.053039+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:30:37.191534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.440959+0000","last_change":"2023-11-28T18:38:36.041567+0000","last_active":"2023-11-28T18:38:37.440959+0000","last_peered":"2023-11-28T18:38:37.440959+0000","last_clean":"2023-11-28T18:38:37.440959+0000","last_became_active":"2023-11-28T18:38:36.041223+0000","last_became_peered":"2023-11-28T18:38:36.041223+0000","last_unstale":"2023-11-28T18:38:37.440959+0000","last_undegraded":"2023-11-28T18:38:37.440959+0000","last_fullsized":"2023-11-28T18:38:37.440959+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:24:09.636223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.046786+0000","last_change":"2023-11-28T18:38:36.048865+0000","last_active":"2023-11-28T18:38:37.046786+0000","last_peered":"2023-11-28T18:38:37.046786+0000","last_clean":"2023-11-28T18:38:37.046786+0000","last_became_active":"2023-11-28T18:38:36.047907+0000","last_became_peered":"2023-11-28T18:38:36.047907+0000","last_unstale":"2023-11-28T18:38:37.046786+0000","last_undegraded":"2023-11-28T18:38:37.046786+0000","last_fullsized":"2023-11-28T18:38:37.046786+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:02:31.666914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.440867+0000","last_change":"2023-11-28T18:38:36.048985+0000","last_active":"2023-11-28T18:38:37.440867+0000","last_peered":"2023-11-28T18:38:37.440867+0000","last_clean":"2023-11-28T18:38:37.440867+0000","last_became_active":"2023-11-28T18:38:36.048728+0000","last_became_peered":"2023-11-28T18:38:36.048728+0000","last_unstale":"2023-11-28T18:38:37.440867+0000","last_undegraded":"2023-11-28T18:38:37.440867+0000","last_fullsized":"2023-11-28T18:38:37.440867+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:55:16.262321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.053550+0000","last_change":"2023-11-28T18:38:36.040263+0000","last_active":"2023-11-28T18:38:37.053550+0000","last_peered":"2023-11-28T18:38:37.053550+0000","last_clean":"2023-11-28T18:38:37.053550+0000","last_became_active":"2023-11-28T18:38:36.039983+0000","last_became_peered":"2023-11-28T18:38:36.039983+0000","last_unstale":"2023-11-28T18:38:37.053550+0000","last_undegraded":"2023-11-28T18:38:37.053550+0000","last_fullsized":"2023-11-28T18:38:37.053550+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:08:33.135094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.556611+0000","last_change":"2023-11-28T18:38:36.057225+0000","last_active":"2023-11-28T18:38:37.556611+0000","last_peered":"2023-11-28T18:38:37.556611+0000","last_clean":"2023-11-28T18:38:37.556611+0000","last_became_active":"2023-11-28T18:38:36.056813+0000","last_became_peered":"2023-11-28T18:38:36.056813+0000","last_unstale":"2023-11-28T18:38:37.556611+0000","last_undegraded":"2023-11-28T18:38:37.556611+0000","last_fullsized":"2023-11-28T18:38:37.556611+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:23:34.143756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.053539+0000","last_change":"2023-11-28T18:38:36.057518+0000","last_active":"2023-11-28T18:38:37.053539+0000","last_peered":"2023-11-28T18:38:37.053539+0000","last_clean":"2023-11-28T18:38:37.053539+0000","last_became_active":"2023-11-28T18:38:36.057236+0000","last_became_peered":"2023-11-28T18:38:36.057236+0000","last_unstale":"2023-11-28T18:38:37.053539+0000","last_undegraded":"2023-11-28T18:38:37.053539+0000","last_fullsized":"2023-11-28T18:38:37.053539+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:08:33.135094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.556616+0000","last_change":"2023-11-28T18:38:36.051017+0000","last_active":"2023-11-28T18:38:37.556616+0000","last_peered":"2023-11-28T18:38:37.556616+0000","last_clean":"2023-11-28T18:38:37.556616+0000","last_became_active":"2023-11-28T18:38:36.050722+0000","last_became_peered":"2023-11-28T18:38:36.050722+0000","last_unstale":"2023-11-28T18:38:37.556616+0000","last_undegraded":"2023-11-28T18:38:37.556616+0000","last_fullsized":"2023-11-28T18:38:37.556616+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:10:41.635773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.053096+0000","last_change":"2023-11-28T18:38:36.059859+0000","last_active":"2023-11-28T18:38:37.053096+0000","last_peered":"2023-11-28T18:38:37.053096+0000","last_clean":"2023-11-28T18:38:37.053096+0000","last_became_active":"2023-11-28T18:38:36.058957+0000","last_became_peered":"2023-11-28T18:38:36.058957+0000","last_unstale":"2023-11-28T18:38:37.053096+0000","last_undegraded":"2023-11-28T18:38:37.053096+0000","last_fullsized":"2023-11-28T18:38:37.053096+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:39:58.972690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.437842+0000","last_change":"2023-11-28T18:38:36.043986+0000","last_active":"2023-11-28T18:38:37.437842+0000","last_peered":"2023-11-28T18:38:37.437842+0000","last_clean":"2023-11-28T18:38:37.437842+0000","last_became_active":"2023-11-28T18:38:36.043705+0000","last_became_peered":"2023-11-28T18:38:36.043705+0000","last_unstale":"2023-11-28T18:38:37.437842+0000","last_undegraded":"2023-11-28T18:38:37.437842+0000","last_fullsized":"2023-11-28T18:38:37.437842+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:06:35.371066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T18:38:36.072434+0000","last_change":"2023-11-28T18:38:35.042345+0000","last_active":"2023-11-28T18:38:36.072434+0000","last_peered":"2023-11-28T18:38:36.072434+0000","last_clean":"2023-11-28T18:38:36.072434+0000","last_became_active":"2023-11-28T18:38:35.042014+0000","last_became_peered":"2023-11-28T18:38:35.042014+0000","last_unstale":"2023-11-28T18:38:36.072434+0000","last_undegraded":"2023-11-28T18:38:36.072434+0000","last_fullsized":"2023-11-28T18:38:36.072434+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:51:52.296626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.557376+0000","last_change":"2023-11-28T18:38:36.059686+0000","last_active":"2023-11-28T18:38:37.557376+0000","last_peered":"2023-11-28T18:38:37.557376+0000","last_clean":"2023-11-28T18:38:37.557376+0000","last_became_active":"2023-11-28T18:38:36.059294+0000","last_became_peered":"2023-11-28T18:38:36.059294+0000","last_unstale":"2023-11-28T18:38:37.557376+0000","last_undegraded":"2023-11-28T18:38:37.557376+0000","last_fullsized":"2023-11-28T18:38:37.557376+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:04:21.753781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T18:38:36.068713+0000","last_change":"2023-11-28T18:38:35.044546+0000","last_active":"2023-11-28T18:38:36.068713+0000","last_peered":"2023-11-28T18:38:36.068713+0000","last_clean":"2023-11-28T18:38:36.068713+0000","last_became_active":"2023-11-28T18:38:35.044235+0000","last_became_peered":"2023-11-28T18:38:35.044235+0000","last_unstale":"2023-11-28T18:38:36.068713+0000","last_undegraded":"2023-11-28T18:38:36.068713+0000","last_fullsized":"2023-11-28T18:38:36.068713+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:51:52.296626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.556615+0000","last_change":"2023-11-28T18:38:36.056687+0000","last_active":"2023-11-28T18:38:37.556615+0000","last_peered":"2023-11-28T18:38:37.556615+0000","last_clean":"2023-11-28T18:38:37.556615+0000","last_became_active":"2023-11-28T18:38:36.055076+0000","last_became_peered":"2023-11-28T18:38:36.055076+0000","last_unstale":"2023-11-28T18:38:37.556615+0000","last_undegraded":"2023-11-28T18:38:37.556615+0000","last_fullsized":"2023-11-28T18:38:37.556615+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:24:41.610022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T18:38:36.073473+0000","last_change":"2023-11-28T18:38:35.040826+0000","last_active":"2023-11-28T18:38:36.073473+0000","last_peered":"2023-11-28T18:38:36.073473+0000","last_clean":"2023-11-28T18:38:36.073473+0000","last_became_active":"2023-11-28T18:38:35.040557+0000","last_became_peered":"2023-11-28T18:38:35.040557+0000","last_unstale":"2023-11-28T18:38:36.073473+0000","last_undegraded":"2023-11-28T18:38:36.073473+0000","last_fullsized":"2023-11-28T18:38:36.073473+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:06:34.364765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.440911+0000","last_change":"2023-11-28T18:38:36.059035+0000","last_active":"2023-11-28T18:38:37.440911+0000","last_peered":"2023-11-28T18:38:37.440911+0000","last_clean":"2023-11-28T18:38:37.440911+0000","last_became_active":"2023-11-28T18:38:36.058522+0000","last_became_peered":"2023-11-28T18:38:36.058522+0000","last_unstale":"2023-11-28T18:38:37.440911+0000","last_undegraded":"2023-11-28T18:38:37.440911+0000","last_fullsized":"2023-11-28T18:38:37.440911+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:34:30.267747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T18:38:36.070437+0000","last_change":"2023-11-28T18:38:35.038443+0000","last_active":"2023-11-28T18:38:36.070437+0000","last_peered":"2023-11-28T18:38:36.070437+0000","last_clean":"2023-11-28T18:38:36.070437+0000","last_became_active":"2023-11-28T18:38:35.037937+0000","last_became_peered":"2023-11-28T18:38:35.037937+0000","last_unstale":"2023-11-28T18:38:36.070437+0000","last_undegraded":"2023-11-28T18:38:36.070437+0000","last_fullsized":"2023-11-28T18:38:36.070437+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:55:20.432764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.053700+0000","last_change":"2023-11-28T18:38:36.060792+0000","last_active":"2023-11-28T18:38:37.053700+0000","last_peered":"2023-11-28T18:38:37.053700+0000","last_clean":"2023-11-28T18:38:37.053700+0000","last_became_active":"2023-11-28T18:38:36.058863+0000","last_became_peered":"2023-11-28T18:38:36.058863+0000","last_unstale":"2023-11-28T18:38:37.053700+0000","last_undegraded":"2023-11-28T18:38:37.053700+0000","last_fullsized":"2023-11-28T18:38:37.053700+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:43:30.760891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T18:38:36.069360+0000","last_change":"2023-11-28T18:38:35.022767+0000","last_active":"2023-11-28T18:38:36.069360+0000","last_peered":"2023-11-28T18:38:36.069360+0000","last_clean":"2023-11-28T18:38:36.069360+0000","last_became_active":"2023-11-28T18:38:35.022394+0000","last_became_peered":"2023-11-28T18:38:35.022394+0000","last_unstale":"2023-11-28T18:38:36.069360+0000","last_undegraded":"2023-11-28T18:38:36.069360+0000","last_fullsized":"2023-11-28T18:38:36.069360+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:34:41.136709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.053360+0000","last_change":"2023-11-28T18:38:36.047037+0000","last_active":"2023-11-28T18:38:37.053360+0000","last_peered":"2023-11-28T18:38:37.053360+0000","last_clean":"2023-11-28T18:38:37.053360+0000","last_became_active":"2023-11-28T18:38:36.044136+0000","last_became_peered":"2023-11-28T18:38:36.044136+0000","last_unstale":"2023-11-28T18:38:37.053360+0000","last_undegraded":"2023-11-28T18:38:37.053360+0000","last_fullsized":"2023-11-28T18:38:37.053360+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:39:58.972690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T18:38:36.069343+0000","last_change":"2023-11-28T18:38:35.033844+0000","last_active":"2023-11-28T18:38:36.069343+0000","last_peered":"2023-11-28T18:38:36.069343+0000","last_clean":"2023-11-28T18:38:36.069343+0000","last_became_active":"2023-11-28T18:38:35.033053+0000","last_became_peered":"2023-11-28T18:38:35.033053+0000","last_unstale":"2023-11-28T18:38:36.069343+0000","last_undegraded":"2023-11-28T18:38:36.069343+0000","last_fullsized":"2023-11-28T18:38:36.069343+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:00:43.620322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.556791+0000","last_change":"2023-11-28T18:38:36.052169+0000","last_active":"2023-11-28T18:38:37.556791+0000","last_peered":"2023-11-28T18:38:37.556791+0000","last_clean":"2023-11-28T18:38:37.556791+0000","last_became_active":"2023-11-28T18:38:36.051080+0000","last_became_peered":"2023-11-28T18:38:36.051080+0000","last_unstale":"2023-11-28T18:38:37.556791+0000","last_undegraded":"2023-11-28T18:38:37.556791+0000","last_fullsized":"2023-11-28T18:38:37.556791+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:04:21.753781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T18:38:36.030331+0000","last_change":"2023-11-28T18:38:35.034039+0000","last_active":"2023-11-28T18:38:36.030331+0000","last_peered":"2023-11-28T18:38:36.030331+0000","last_clean":"2023-11-28T18:38:36.030331+0000","last_became_active":"2023-11-28T18:38:35.033740+0000","last_became_peered":"2023-11-28T18:38:35.033740+0000","last_unstale":"2023-11-28T18:38:36.030331+0000","last_undegraded":"2023-11-28T18:38:36.030331+0000","last_fullsized":"2023-11-28T18:38:36.030331+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:11:14.111764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.440382+0000","last_change":"2023-11-28T18:38:36.045771+0000","last_active":"2023-11-28T18:38:37.440382+0000","last_peered":"2023-11-28T18:38:37.440382+0000","last_clean":"2023-11-28T18:38:37.440382+0000","last_became_active":"2023-11-28T18:38:36.045506+0000","last_became_peered":"2023-11-28T18:38:36.045506+0000","last_unstale":"2023-11-28T18:38:37.440382+0000","last_undegraded":"2023-11-28T18:38:37.440382+0000","last_fullsized":"2023-11-28T18:38:37.440382+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:30:41.654711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T18:38:36.032386+0000","last_change":"2023-11-28T18:38:35.032151+0000","last_active":"2023-11-28T18:38:36.032386+0000","last_peered":"2023-11-28T18:38:36.032386+0000","last_clean":"2023-11-28T18:38:36.032386+0000","last_became_active":"2023-11-28T18:38:35.031820+0000","last_became_peered":"2023-11-28T18:38:35.031820+0000","last_unstale":"2023-11-28T18:38:36.032386+0000","last_undegraded":"2023-11-28T18:38:36.032386+0000","last_fullsized":"2023-11-28T18:38:36.032386+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:07:08.162461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.053577+0000","last_change":"2023-11-28T18:38:36.056114+0000","last_active":"2023-11-28T18:38:37.053577+0000","last_peered":"2023-11-28T18:38:37.053577+0000","last_clean":"2023-11-28T18:38:37.053577+0000","last_became_active":"2023-11-28T18:38:36.055779+0000","last_became_peered":"2023-11-28T18:38:36.055779+0000","last_unstale":"2023-11-28T18:38:37.053577+0000","last_undegraded":"2023-11-28T18:38:37.053577+0000","last_fullsized":"2023-11-28T18:38:37.053577+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:43:30.760891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T18:38:36.032396+0000","last_change":"2023-11-28T18:38:35.044014+0000","last_active":"2023-11-28T18:38:36.032396+0000","last_peered":"2023-11-28T18:38:36.032396+0000","last_clean":"2023-11-28T18:38:36.032396+0000","last_became_active":"2023-11-28T18:38:35.042731+0000","last_became_peered":"2023-11-28T18:38:35.042731+0000","last_unstale":"2023-11-28T18:38:36.032396+0000","last_undegraded":"2023-11-28T18:38:36.032396+0000","last_fullsized":"2023-11-28T18:38:36.032396+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:05:24.281995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.046596+0000","last_change":"2023-11-28T18:38:36.049662+0000","last_active":"2023-11-28T18:38:37.046596+0000","last_peered":"2023-11-28T18:38:37.046596+0000","last_clean":"2023-11-28T18:38:37.046596+0000","last_became_active":"2023-11-28T18:38:36.049415+0000","last_became_peered":"2023-11-28T18:38:36.049415+0000","last_unstale":"2023-11-28T18:38:37.046596+0000","last_undegraded":"2023-11-28T18:38:37.046596+0000","last_fullsized":"2023-11-28T18:38:37.046596+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:08:33.135094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T18:38:36.027137+0000","last_change":"2023-11-28T18:38:35.041965+0000","last_active":"2023-11-28T18:38:36.027137+0000","last_peered":"2023-11-28T18:38:36.027137+0000","last_clean":"2023-11-28T18:38:36.027137+0000","last_became_active":"2023-11-28T18:38:35.041387+0000","last_became_peered":"2023-11-28T18:38:35.041387+0000","last_unstale":"2023-11-28T18:38:36.027137+0000","last_undegraded":"2023-11-28T18:38:36.027137+0000","last_fullsized":"2023-11-28T18:38:36.027137+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:58:12.029100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.046611+0000","last_change":"2023-11-28T18:38:36.045069+0000","last_active":"2023-11-28T18:38:37.046611+0000","last_peered":"2023-11-28T18:38:37.046611+0000","last_clean":"2023-11-28T18:38:37.046611+0000","last_became_active":"2023-11-28T18:38:36.044695+0000","last_became_peered":"2023-11-28T18:38:36.044695+0000","last_unstale":"2023-11-28T18:38:37.046611+0000","last_undegraded":"2023-11-28T18:38:37.046611+0000","last_fullsized":"2023-11-28T18:38:37.046611+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:43:30.760891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T18:38:36.072105+0000","last_change":"2023-11-28T18:38:35.043644+0000","last_active":"2023-11-28T18:38:36.072105+0000","last_peered":"2023-11-28T18:38:36.072105+0000","last_clean":"2023-11-28T18:38:36.072105+0000","last_became_active":"2023-11-28T18:38:35.043329+0000","last_became_peered":"2023-11-28T18:38:35.043329+0000","last_unstale":"2023-11-28T18:38:36.072105+0000","last_undegraded":"2023-11-28T18:38:36.072105+0000","last_fullsized":"2023-11-28T18:38:36.072105+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:34:29.261446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.053478+0000","last_change":"2023-11-28T18:38:36.046174+0000","last_active":"2023-11-28T18:38:37.053478+0000","last_peered":"2023-11-28T18:38:37.053478+0000","last_clean":"2023-11-28T18:38:37.053478+0000","last_became_active":"2023-11-28T18:38:36.045879+0000","last_became_peered":"2023-11-28T18:38:36.045879+0000","last_unstale":"2023-11-28T18:38:37.053478+0000","last_undegraded":"2023-11-28T18:38:37.053478+0000","last_fullsized":"2023-11-28T18:38:37.053478+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:22:01.056346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T18:38:36.075594+0000","last_change":"2023-11-28T18:38:35.035852+0000","last_active":"2023-11-28T18:38:36.075594+0000","last_peered":"2023-11-28T18:38:36.075594+0000","last_clean":"2023-11-28T18:38:36.075594+0000","last_became_active":"2023-11-28T18:38:35.035554+0000","last_became_peered":"2023-11-28T18:38:35.035554+0000","last_unstale":"2023-11-28T18:38:36.075594+0000","last_undegraded":"2023-11-28T18:38:36.075594+0000","last_fullsized":"2023-11-28T18:38:36.075594+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:04:20.747481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.440460+0000","last_change":"2023-11-28T18:38:36.045725+0000","last_active":"2023-11-28T18:38:37.440460+0000","last_peered":"2023-11-28T18:38:37.440460+0000","last_clean":"2023-11-28T18:38:37.440460+0000","last_became_active":"2023-11-28T18:38:36.045448+0000","last_became_peered":"2023-11-28T18:38:36.045448+0000","last_unstale":"2023-11-28T18:38:37.440460+0000","last_undegraded":"2023-11-28T18:38:37.440460+0000","last_fullsized":"2023-11-28T18:38:37.440460+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:05:48.872445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T18:38:36.072246+0000","last_change":"2023-11-28T18:38:35.031263+0000","last_active":"2023-11-28T18:38:36.072246+0000","last_peered":"2023-11-28T18:38:36.072246+0000","last_clean":"2023-11-28T18:38:36.072246+0000","last_became_active":"2023-11-28T18:38:35.031028+0000","last_became_peered":"2023-11-28T18:38:35.031028+0000","last_unstale":"2023-11-28T18:38:36.072246+0000","last_undegraded":"2023-11-28T18:38:36.072246+0000","last_fullsized":"2023-11-28T18:38:36.072246+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:06:47.136477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.046138+0000","last_change":"2023-11-28T18:38:36.046881+0000","last_active":"2023-11-28T18:38:37.046138+0000","last_peered":"2023-11-28T18:38:37.046138+0000","last_clean":"2023-11-28T18:38:37.046138+0000","last_became_active":"2023-11-28T18:38:36.043416+0000","last_became_peered":"2023-11-28T18:38:36.043416+0000","last_unstale":"2023-11-28T18:38:37.046138+0000","last_undegraded":"2023-11-28T18:38:37.046138+0000","last_fullsized":"2023-11-28T18:38:37.046138+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:39:58.972690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T18:38:36.035518+0000","last_change":"2023-11-28T18:38:35.044333+0000","last_active":"2023-11-28T18:38:36.035518+0000","last_peered":"2023-11-28T18:38:36.035518+0000","last_clean":"2023-11-28T18:38:36.035518+0000","last_became_active":"2023-11-28T18:38:35.043246+0000","last_became_peered":"2023-11-28T18:38:35.043246+0000","last_unstale":"2023-11-28T18:38:36.035518+0000","last_undegraded":"2023-11-28T18:38:36.035518+0000","last_fullsized":"2023-11-28T18:38:36.035518+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:04:20.747481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.053166+0000","last_change":"2023-11-28T18:38:36.060402+0000","last_active":"2023-11-28T18:38:37.053166+0000","last_peered":"2023-11-28T18:38:37.053166+0000","last_clean":"2023-11-28T18:38:37.053166+0000","last_became_active":"2023-11-28T18:38:36.059804+0000","last_became_peered":"2023-11-28T18:38:36.059804+0000","last_unstale":"2023-11-28T18:38:37.053166+0000","last_undegraded":"2023-11-28T18:38:37.053166+0000","last_fullsized":"2023-11-28T18:38:37.053166+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:13:10.806764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T18:38:36.034319+0000","last_change":"2023-11-28T18:38:35.039112+0000","last_active":"2023-11-28T18:38:36.034319+0000","last_peered":"2023-11-28T18:38:36.034319+0000","last_clean":"2023-11-28T18:38:36.034319+0000","last_became_active":"2023-11-28T18:38:35.038761+0000","last_became_peered":"2023-11-28T18:38:35.038761+0000","last_unstale":"2023-11-28T18:38:36.034319+0000","last_undegraded":"2023-11-28T18:38:36.034319+0000","last_fullsized":"2023-11-28T18:38:36.034319+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:24:08.629922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.556707+0000","last_change":"2023-11-28T18:38:36.058784+0000","last_active":"2023-11-28T18:38:37.556707+0000","last_peered":"2023-11-28T18:38:37.556707+0000","last_clean":"2023-11-28T18:38:37.556707+0000","last_became_active":"2023-11-28T18:38:36.058506+0000","last_became_peered":"2023-11-28T18:38:36.058506+0000","last_unstale":"2023-11-28T18:38:37.556707+0000","last_undegraded":"2023-11-28T18:38:37.556707+0000","last_fullsized":"2023-11-28T18:38:37.556707+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:20:40.669777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T18:38:36.073913+0000","last_change":"2023-11-28T18:38:35.039997+0000","last_active":"2023-11-28T18:38:36.073913+0000","last_peered":"2023-11-28T18:38:36.073913+0000","last_clean":"2023-11-28T18:38:36.073913+0000","last_became_active":"2023-11-28T18:38:35.039693+0000","last_became_peered":"2023-11-28T18:38:35.039693+0000","last_unstale":"2023-11-28T18:38:36.073913+0000","last_undegraded":"2023-11-28T18:38:36.073913+0000","last_fullsized":"2023-11-28T18:38:36.073913+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:34:29.261446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.556934+0000","last_change":"2023-11-28T18:38:36.051189+0000","last_active":"2023-11-28T18:38:37.556934+0000","last_peered":"2023-11-28T18:38:37.556934+0000","last_clean":"2023-11-28T18:38:37.556934+0000","last_became_active":"2023-11-28T18:38:36.049444+0000","last_became_peered":"2023-11-28T18:38:36.049444+0000","last_unstale":"2023-11-28T18:38:37.556934+0000","last_undegraded":"2023-11-28T18:38:37.556934+0000","last_fullsized":"2023-11-28T18:38:37.556934+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:06:35.371066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T18:38:36.070824+0000","last_change":"2023-11-28T18:38:35.043865+0000","last_active":"2023-11-28T18:38:36.070824+0000","last_peered":"2023-11-28T18:38:36.070824+0000","last_clean":"2023-11-28T18:38:36.070824+0000","last_became_active":"2023-11-28T18:38:35.043574+0000","last_became_peered":"2023-11-28T18:38:35.043574+0000","last_unstale":"2023-11-28T18:38:36.070824+0000","last_undegraded":"2023-11-28T18:38:36.070824+0000","last_fullsized":"2023-11-28T18:38:36.070824+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:10:40.629473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.053839+0000","last_change":"2023-11-28T18:38:36.052008+0000","last_active":"2023-11-28T18:38:37.053839+0000","last_peered":"2023-11-28T18:38:37.053839+0000","last_clean":"2023-11-28T18:38:37.053839+0000","last_became_active":"2023-11-28T18:38:36.051699+0000","last_became_peered":"2023-11-28T18:38:36.051699+0000","last_unstale":"2023-11-28T18:38:37.053839+0000","last_undegraded":"2023-11-28T18:38:37.053839+0000","last_fullsized":"2023-11-28T18:38:37.053839+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:22:24.110740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T18:38:36.072207+0000","last_change":"2023-11-28T18:38:35.038493+0000","last_active":"2023-11-28T18:38:36.072207+0000","last_peered":"2023-11-28T18:38:36.072207+0000","last_clean":"2023-11-28T18:38:36.072207+0000","last_became_active":"2023-11-28T18:38:35.038065+0000","last_became_peered":"2023-11-28T18:38:35.038065+0000","last_unstale":"2023-11-28T18:38:36.072207+0000","last_undegraded":"2023-11-28T18:38:36.072207+0000","last_fullsized":"2023-11-28T18:38:36.072207+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:11:13.755446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.440656+0000","last_change":"2023-11-28T18:38:36.050799+0000","last_active":"2023-11-28T18:38:37.440656+0000","last_peered":"2023-11-28T18:38:37.440656+0000","last_clean":"2023-11-28T18:38:37.440656+0000","last_became_active":"2023-11-28T18:38:36.050482+0000","last_became_peered":"2023-11-28T18:38:36.050482+0000","last_unstale":"2023-11-28T18:38:37.440656+0000","last_undegraded":"2023-11-28T18:38:37.440656+0000","last_fullsized":"2023-11-28T18:38:37.440656+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:05:25.288296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T18:38:36.070962+0000","last_change":"2023-11-28T18:38:35.036943+0000","last_active":"2023-11-28T18:38:36.070962+0000","last_peered":"2023-11-28T18:38:36.070962+0000","last_clean":"2023-11-28T18:38:36.070962+0000","last_became_active":"2023-11-28T18:38:35.036630+0000","last_became_peered":"2023-11-28T18:38:35.036630+0000","last_unstale":"2023-11-28T18:38:36.070962+0000","last_undegraded":"2023-11-28T18:38:36.070962+0000","last_fullsized":"2023-11-28T18:38:36.070962+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:06:48.055994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.555777+0000","last_change":"2023-11-28T18:38:36.049172+0000","last_active":"2023-11-28T18:38:37.555777+0000","last_peered":"2023-11-28T18:38:37.555777+0000","last_clean":"2023-11-28T18:38:37.555777+0000","last_became_active":"2023-11-28T18:38:36.048879+0000","last_became_peered":"2023-11-28T18:38:36.048879+0000","last_unstale":"2023-11-28T18:38:37.555777+0000","last_undegraded":"2023-11-28T18:38:37.555777+0000","last_fullsized":"2023-11-28T18:38:37.555777+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:00:44.626623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T18:38:36.041935+0000","last_change":"2023-11-28T18:38:35.023682+0000","last_active":"2023-11-28T18:38:36.041935+0000","last_peered":"2023-11-28T18:38:36.041935+0000","last_clean":"2023-11-28T18:38:36.041935+0000","last_became_active":"2023-11-28T18:38:35.022730+0000","last_became_peered":"2023-11-28T18:38:35.022730+0000","last_unstale":"2023-11-28T18:38:36.041935+0000","last_undegraded":"2023-11-28T18:38:36.041935+0000","last_fullsized":"2023-11-28T18:38:36.041935+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:11:14.111764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.555474+0000","last_change":"2023-11-28T18:38:36.050870+0000","last_active":"2023-11-28T18:38:37.555474+0000","last_peered":"2023-11-28T18:38:37.555474+0000","last_clean":"2023-11-28T18:38:37.555474+0000","last_became_active":"2023-11-28T18:38:36.050578+0000","last_became_peered":"2023-11-28T18:38:36.050578+0000","last_unstale":"2023-11-28T18:38:37.555474+0000","last_undegraded":"2023-11-28T18:38:37.555474+0000","last_fullsized":"2023-11-28T18:38:37.555474+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:47:25.255940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T18:38:36.071165+0000","last_change":"2023-11-28T18:38:35.033842+0000","last_active":"2023-11-28T18:38:36.071165+0000","last_peered":"2023-11-28T18:38:36.071165+0000","last_clean":"2023-11-28T18:38:36.071165+0000","last_became_active":"2023-11-28T18:38:35.033482+0000","last_became_peered":"2023-11-28T18:38:35.033482+0000","last_unstale":"2023-11-28T18:38:36.071165+0000","last_undegraded":"2023-11-28T18:38:36.071165+0000","last_fullsized":"2023-11-28T18:38:36.071165+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:57:34.906080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.555678+0000","last_change":"2023-11-28T18:38:36.045348+0000","last_active":"2023-11-28T18:38:37.555678+0000","last_peered":"2023-11-28T18:38:37.555678+0000","last_clean":"2023-11-28T18:38:37.555678+0000","last_became_active":"2023-11-28T18:38:36.045049+0000","last_became_peered":"2023-11-28T18:38:36.045049+0000","last_unstale":"2023-11-28T18:38:37.555678+0000","last_undegraded":"2023-11-28T18:38:37.555678+0000","last_fullsized":"2023-11-28T18:38:37.555678+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:52:25.982005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T18:38:36.037258+0000","last_change":"2023-11-28T18:38:35.040401+0000","last_active":"2023-11-28T18:38:36.037258+0000","last_peered":"2023-11-28T18:38:36.037258+0000","last_clean":"2023-11-28T18:38:36.037258+0000","last_became_active":"2023-11-28T18:38:35.039986+0000","last_became_peered":"2023-11-28T18:38:35.039986+0000","last_unstale":"2023-11-28T18:38:36.037258+0000","last_undegraded":"2023-11-28T18:38:36.037258+0000","last_fullsized":"2023-11-28T18:38:36.037258+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:48:52.205118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.555554+0000","last_change":"2023-11-28T18:38:36.045843+0000","last_active":"2023-11-28T18:38:37.555554+0000","last_peered":"2023-11-28T18:38:37.555554+0000","last_clean":"2023-11-28T18:38:37.555554+0000","last_became_active":"2023-11-28T18:38:36.043085+0000","last_became_peered":"2023-11-28T18:38:36.043085+0000","last_unstale":"2023-11-28T18:38:37.555554+0000","last_undegraded":"2023-11-28T18:38:37.555554+0000","last_fullsized":"2023-11-28T18:38:37.555554+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:34:42.143010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T18:38:36.033012+0000","last_change":"2023-11-28T18:38:35.037979+0000","last_active":"2023-11-28T18:38:36.033012+0000","last_peered":"2023-11-28T18:38:36.033012+0000","last_clean":"2023-11-28T18:38:36.033012+0000","last_became_active":"2023-11-28T18:38:35.037674+0000","last_became_peered":"2023-11-28T18:38:35.037674+0000","last_unstale":"2023-11-28T18:38:36.033012+0000","last_undegraded":"2023-11-28T18:38:36.033012+0000","last_fullsized":"2023-11-28T18:38:36.033012+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:52:24.975704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.053402+0000","last_change":"2023-11-28T18:38:36.056988+0000","last_active":"2023-11-28T18:38:37.053402+0000","last_peered":"2023-11-28T18:38:37.053402+0000","last_clean":"2023-11-28T18:38:37.053402+0000","last_became_active":"2023-11-28T18:38:36.056767+0000","last_became_peered":"2023-11-28T18:38:36.056767+0000","last_unstale":"2023-11-28T18:38:37.053402+0000","last_undegraded":"2023-11-28T18:38:37.053402+0000","last_fullsized":"2023-11-28T18:38:37.053402+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:47:23.624240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T18:38:36.030277+0000","last_change":"2023-11-28T18:38:35.031421+0000","last_active":"2023-11-28T18:38:36.030277+0000","last_peered":"2023-11-28T18:38:36.030277+0000","last_clean":"2023-11-28T18:38:36.030277+0000","last_became_active":"2023-11-28T18:38:35.031138+0000","last_became_peered":"2023-11-28T18:38:35.031138+0000","last_unstale":"2023-11-28T18:38:36.030277+0000","last_undegraded":"2023-11-28T18:38:36.030277+0000","last_fullsized":"2023-11-28T18:38:36.030277+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:24:40.603721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.555796+0000","last_change":"2023-11-28T18:38:36.044514+0000","last_active":"2023-11-28T18:38:37.555796+0000","last_peered":"2023-11-28T18:38:37.555796+0000","last_clean":"2023-11-28T18:38:37.555796+0000","last_became_active":"2023-11-28T18:38:36.044149+0000","last_became_peered":"2023-11-28T18:38:36.044149+0000","last_unstale":"2023-11-28T18:38:37.555796+0000","last_undegraded":"2023-11-28T18:38:37.555796+0000","last_fullsized":"2023-11-28T18:38:37.555796+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:06:49.062295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T18:38:36.068497+0000","last_change":"2023-11-28T18:38:35.042278+0000","last_active":"2023-11-28T18:38:36.068497+0000","last_peered":"2023-11-28T18:38:36.068497+0000","last_clean":"2023-11-28T18:38:36.068497+0000","last_became_active":"2023-11-28T18:38:35.041885+0000","last_became_peered":"2023-11-28T18:38:35.041885+0000","last_unstale":"2023-11-28T18:38:36.068497+0000","last_undegraded":"2023-11-28T18:38:36.068497+0000","last_fullsized":"2023-11-28T18:38:36.068497+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:24:40.603721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.053846+0000","last_change":"2023-11-28T18:38:36.046270+0000","last_active":"2023-11-28T18:38:37.053846+0000","last_peered":"2023-11-28T18:38:37.053846+0000","last_clean":"2023-11-28T18:38:37.053846+0000","last_became_active":"2023-11-28T18:38:36.045944+0000","last_became_peered":"2023-11-28T18:38:36.045944+0000","last_unstale":"2023-11-28T18:38:37.053846+0000","last_undegraded":"2023-11-28T18:38:37.053846+0000","last_fullsized":"2023-11-28T18:38:37.053846+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:02:31.666914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.438008+0000","last_change":"2023-11-28T18:38:35.036513+0000","last_active":"2023-11-28T18:38:37.438008+0000","last_peered":"2023-11-28T18:38:37.438008+0000","last_clean":"2023-11-28T18:38:37.438008+0000","last_became_active":"2023-11-28T18:38:35.036218+0000","last_became_peered":"2023-11-28T18:38:35.036218+0000","last_unstale":"2023-11-28T18:38:37.438008+0000","last_undegraded":"2023-11-28T18:38:37.438008+0000","last_fullsized":"2023-11-28T18:38:37.438008+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:10:40.629473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.437820+0000","last_change":"2023-11-28T18:38:36.038641+0000","last_active":"2023-11-28T18:38:37.437820+0000","last_peered":"2023-11-28T18:38:37.437820+0000","last_clean":"2023-11-28T18:38:37.437820+0000","last_became_active":"2023-11-28T18:38:36.038314+0000","last_became_peered":"2023-11-28T18:38:36.038314+0000","last_unstale":"2023-11-28T18:38:37.437820+0000","last_undegraded":"2023-11-28T18:38:37.437820+0000","last_fullsized":"2023-11-28T18:38:37.437820+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:24:41.610022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T18:38:36.030089+0000","last_change":"2023-11-28T18:38:35.042254+0000","last_active":"2023-11-28T18:38:36.030089+0000","last_peered":"2023-11-28T18:38:36.030089+0000","last_clean":"2023-11-28T18:38:36.030089+0000","last_became_active":"2023-11-28T18:38:35.041942+0000","last_became_peered":"2023-11-28T18:38:35.041942+0000","last_unstale":"2023-11-28T18:38:36.030089+0000","last_undegraded":"2023-11-28T18:38:36.030089+0000","last_fullsized":"2023-11-28T18:38:36.030089+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:58:12.029100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.556847+0000","last_change":"2023-11-28T18:38:36.048609+0000","last_active":"2023-11-28T18:38:37.556847+0000","last_peered":"2023-11-28T18:38:37.556847+0000","last_clean":"2023-11-28T18:38:37.556847+0000","last_became_active":"2023-11-28T18:38:36.048241+0000","last_became_peered":"2023-11-28T18:38:36.048241+0000","last_unstale":"2023-11-28T18:38:37.556847+0000","last_undegraded":"2023-11-28T18:38:37.556847+0000","last_fullsized":"2023-11-28T18:38:37.556847+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:23:34.143756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T18:38:36.026304+0000","last_change":"2023-11-28T18:38:35.029334+0000","last_active":"2023-11-28T18:38:36.026304+0000","last_peered":"2023-11-28T18:38:36.026304+0000","last_clean":"2023-11-28T18:38:36.026304+0000","last_became_active":"2023-11-28T18:38:35.029088+0000","last_became_peered":"2023-11-28T18:38:35.029088+0000","last_unstale":"2023-11-28T18:38:36.026304+0000","last_undegraded":"2023-11-28T18:38:36.026304+0000","last_fullsized":"2023-11-28T18:38:36.026304+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:06:48.055994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.437840+0000","last_change":"2023-11-28T18:38:36.052359+0000","last_active":"2023-11-28T18:38:37.437840+0000","last_peered":"2023-11-28T18:38:37.437840+0000","last_clean":"2023-11-28T18:38:37.437840+0000","last_became_active":"2023-11-28T18:38:36.052125+0000","last_became_peered":"2023-11-28T18:38:36.052125+0000","last_unstale":"2023-11-28T18:38:37.437840+0000","last_undegraded":"2023-11-28T18:38:37.437840+0000","last_fullsized":"2023-11-28T18:38:37.437840+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:23:34.143756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T18:38:36.032048+0000","last_change":"2023-11-28T18:38:35.036038+0000","last_active":"2023-11-28T18:38:36.032048+0000","last_peered":"2023-11-28T18:38:36.032048+0000","last_clean":"2023-11-28T18:38:36.032048+0000","last_became_active":"2023-11-28T18:38:35.035686+0000","last_became_peered":"2023-11-28T18:38:35.035686+0000","last_unstale":"2023-11-28T18:38:36.032048+0000","last_undegraded":"2023-11-28T18:38:36.032048+0000","last_fullsized":"2023-11-28T18:38:36.032048+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:23:33.137455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.045830+0000","last_change":"2023-11-28T18:38:36.052679+0000","last_active":"2023-11-28T18:38:37.045830+0000","last_peered":"2023-11-28T18:38:37.045830+0000","last_clean":"2023-11-28T18:38:37.045830+0000","last_became_active":"2023-11-28T18:38:36.052359+0000","last_became_peered":"2023-11-28T18:38:36.052359+0000","last_unstale":"2023-11-28T18:38:37.045830+0000","last_undegraded":"2023-11-28T18:38:37.045830+0000","last_fullsized":"2023-11-28T18:38:37.045830+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:30:37.191534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T18:38:36.033150+0000","last_change":"2023-11-28T18:38:35.035526+0000","last_active":"2023-11-28T18:38:36.033150+0000","last_peered":"2023-11-28T18:38:36.033150+0000","last_clean":"2023-11-28T18:38:36.033150+0000","last_became_active":"2023-11-28T18:38:35.034566+0000","last_became_peered":"2023-11-28T18:38:35.034566+0000","last_unstale":"2023-11-28T18:38:36.033150+0000","last_undegraded":"2023-11-28T18:38:36.033150+0000","last_fullsized":"2023-11-28T18:38:36.033150+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:57:34.906080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.556546+0000","last_change":"2023-11-28T18:38:36.053235+0000","last_active":"2023-11-28T18:38:37.556546+0000","last_peered":"2023-11-28T18:38:37.556546+0000","last_clean":"2023-11-28T18:38:37.556546+0000","last_became_active":"2023-11-28T18:38:36.052691+0000","last_became_peered":"2023-11-28T18:38:36.052691+0000","last_unstale":"2023-11-28T18:38:37.556546+0000","last_undegraded":"2023-11-28T18:38:37.556546+0000","last_fullsized":"2023-11-28T18:38:37.556546+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:10:41.635773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T18:38:36.033652+0000","last_change":"2023-11-28T18:38:35.043063+0000","last_active":"2023-11-28T18:38:36.033652+0000","last_peered":"2023-11-28T18:38:36.033652+0000","last_clean":"2023-11-28T18:38:36.033652+0000","last_became_active":"2023-11-28T18:38:35.042719+0000","last_became_peered":"2023-11-28T18:38:35.042719+0000","last_unstale":"2023-11-28T18:38:36.033652+0000","last_undegraded":"2023-11-28T18:38:36.033652+0000","last_fullsized":"2023-11-28T18:38:36.033652+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:55:15.256020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.053825+0000","last_change":"2023-11-28T18:38:36.056922+0000","last_active":"2023-11-28T18:38:37.053825+0000","last_peered":"2023-11-28T18:38:37.053825+0000","last_clean":"2023-11-28T18:38:37.053825+0000","last_became_active":"2023-11-28T18:38:36.056602+0000","last_became_peered":"2023-11-28T18:38:36.056602+0000","last_unstale":"2023-11-28T18:38:37.053825+0000","last_undegraded":"2023-11-28T18:38:37.053825+0000","last_fullsized":"2023-11-28T18:38:37.053825+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:02:31.666914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T18:38:36.040423+0000","last_change":"2023-11-28T18:38:35.040261+0000","last_active":"2023-11-28T18:38:36.040423+0000","last_peered":"2023-11-28T18:38:36.040423+0000","last_clean":"2023-11-28T18:38:36.040423+0000","last_became_active":"2023-11-28T18:38:35.040006+0000","last_became_peered":"2023-11-28T18:38:35.040006+0000","last_unstale":"2023-11-28T18:38:36.040423+0000","last_undegraded":"2023-11-28T18:38:36.040423+0000","last_fullsized":"2023-11-28T18:38:36.040423+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:11:14.111764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":176,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T18:38:36.038968+0000","last_change":"2023-11-28T18:37:22.369132+0000","last_active":"2023-11-28T18:38:36.038968+0000","last_peered":"2023-11-28T18:38:36.038968+0000","last_clean":"2023-11-28T18:38:36.038968+0000","last_became_active":"2023-11-28T18:37:22.368142+0000","last_became_peered":"2023-11-28T18:37:22.368142+0000","last_unstale":"2023-11-28T18:38:36.038968+0000","last_undegraded":"2023-11-28T18:38:36.038968+0000","last_fullsized":"2023-11-28T18:38:36.038968+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:21.313053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:21.313053+0000","last_clean_scrub_stamp":"2023-11-28T18:37:21.313053+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:55:01.432028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":983040,"data_stored":742235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":4.8559999999999999,"5min":4.8559999999999999,"15min":4.8559999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":4.8319999999999999,"5min":4.8319999999999999,"15min":4.8319999999999999},"last":0.82099999999999995}]},{"osd":1,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":4.8109999999999999,"5min":4.8109999999999999,"15min":4.8109999999999999},"last":0.751},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":4.8700000000000001,"5min":4.8700000000000001,"15min":4.8700000000000001},"last":0.69399999999999995}]},{"osd":2,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.78700000000000003}]},{"osd":3,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":4.7619999999999996,"5min":4.7619999999999996,"15min":4.7619999999999996},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.70599999999999996}]},{"osd":4,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.57599999999999996}]},{"osd":5,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.65000000000000002}]},{"osd":6,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.622}]}]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":393216,"data_stored":152393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 18:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.59399999999999997}]},{"osd":1,"last update":"Tue Nov 28 18:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.64400000000000002}]},{"osd":2,"last update":"Tue Nov 28 18:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.56299999999999994}]},{"osd":3,"last update":"Tue Nov 28 18:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.54400000000000004}]},{"osd":4,"last update":"Tue Nov 28 18:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.42799999999999999}]},{"osd":5,"last update":"Tue Nov 28 18:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.626}]},{"osd":7,"last update":"Tue Nov 28 18:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.61099999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":393216,"data_stored":152449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.57199999999999995}]},{"osd":1,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.63200000000000001}]},{"osd":2,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.54400000000000004}]},{"osd":3,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.61899999999999999}]},{"osd":4,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.68100000000000005}]},{"osd":6,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.55600000000000005}]},{"osd":7,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.59499999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":393216,"data_stored":151881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.504},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":3.5179999999999998,"5min":3.5179999999999998,"15min":3.5179999999999998},"last":0.55200000000000005}]},{"osd":1,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":3.5019999999999998,"5min":3.5019999999999998,"15min":3.5019999999999998},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":3.5630000000000002,"5min":3.5630000000000002,"15min":3.5630000000000002},"last":0.52200000000000002}]},{"osd":2,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":3.6709999999999998,"5min":3.6709999999999998,"15min":3.6709999999999998},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":3.4849999999999999,"5min":3.4849999999999999,"15min":3.4849999999999999},"last":0.56999999999999995}]},{"osd":3,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":3.7130000000000001,"5min":3.7130000000000001,"15min":3.7130000000000001},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.51000000000000001}]},{"osd":5,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.38300000000000001}]},{"osd":6,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.718,"5min":1.718,"15min":1.718},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.46800000000000003}]},{"osd":7,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.58199999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31572,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340268,"statfs":{"total":96636764160,"available":96604434432,"internally_reserved":0,"allocated":401408,"data_stored":153411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 18:38:22 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.45500000000000002}]},{"osd":1,"last update":"Tue Nov 28 18:38:22 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.48799999999999999}]},{"osd":2,"last update":"Tue Nov 28 18:38:22 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.56799999999999995}]},{"osd":4,"last update":"Tue Nov 28 18:38:22 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.97399999999999998}]},{"osd":5,"last update":"Tue Nov 28 18:38:22 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":1.046},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.91200000000000003}]},{"osd":6,"last update":"Tue Nov 28 18:38:22 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":0.997}]},{"osd":7,"last update":"Tue Nov 28 18:38:22 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":1.0249999999999999},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":1.0660000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31560,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340280,"statfs":{"total":96636764160,"available":96604446720,"internally_reserved":0,"allocated":389120,"data_stored":151847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 18:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.309},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":0.42599999999999999}]},{"osd":1,"last update":"Tue Nov 28 18:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.45400000000000001}]},{"osd":3,"last update":"Tue Nov 28 18:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.61099999999999999}]},{"osd":4,"last update":"Tue Nov 28 18:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":0.54900000000000004}]},{"osd":5,"last update":"Tue Nov 28 18:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.73899999999999999}]},{"osd":6,"last update":"Tue Nov 28 18:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.7070000000000001,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.57999999999999996}]},{"osd":7,"last update":"Tue Nov 28 18:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.7509999999999999,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.65500000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31572,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340268,"statfs":{"total":96636764160,"available":96604434432,"internally_reserved":0,"allocated":401408,"data_stored":153411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":2.2090000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":0.311},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":4.0899999999999999,"5min":4.0899999999999999,"15min":4.0899999999999999},"last":0.40899999999999997}]},{"osd":2,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":3.8620000000000001,"5min":3.8620000000000001,"15min":3.8620000000000001},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":2.823,"5min":2.823,"15min":2.823},"last":0.35199999999999998}]},{"osd":3,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":4.0739999999999998,"5min":4.0739999999999998,"15min":4.0739999999999998},"last":0.438},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":3.6659999999999999,"5min":3.6659999999999999,"15min":3.6659999999999999},"last":0.48599999999999999}]},{"osd":4,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":5.3540000000000001,"5min":5.3540000000000001,"15min":5.3540000000000001},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":5.5,"5min":5.5,"15min":5.5},"last":0.751}]},{"osd":5,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":5.4379999999999997,"5min":5.4379999999999997,"15min":5.4379999999999997},"last":0.63500000000000001},{"interface":"front","average":{"1min":1.129,"5min":1.129,"15min":1.129},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":3.4500000000000002,"5min":3.4500000000000002,"15min":3.4500000000000002},"last":0.78300000000000003}]},{"osd":6,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":3.0369999999999999,"5min":3.0369999999999999,"15min":3.0369999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":5.4000000000000004,"5min":5.4000000000000004,"15min":5.4000000000000004},"last":0.76800000000000002}]},{"osd":7,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":5.5369999999999999,"5min":5.5369999999999999,"15min":5.5369999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":3.2480000000000002,"5min":3.2480000000000002,"15min":3.2480000000000002},"last":0.82999999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":978944,"data_stored":742145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 18:38:22 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.504}]},{"osd":2,"last update":"Tue Nov 28 18:38:22 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.46600000000000003}]},{"osd":3,"last update":"Tue Nov 28 18:38:22 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.48799999999999999}]},{"osd":4,"last update":"Tue Nov 28 18:38:22 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.753}]},{"osd":5,"last update":"Tue Nov 28 18:38:22 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.56999999999999995}]},{"osd":6,"last update":"Tue Nov 28 18:38:22 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1,"5min":1,"15min":1},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.67300000000000004}]},{"osd":7,"last update":"Tue Nov 28 18:38:22 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.60499999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T18:38:47.358 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T18:38:47.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.509+0000 7fba409c4640 1 Processor -- start 2023-11-28T18:38:47.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.509+0000 7fba409c4640 1 -- start start 2023-11-28T18:38:47.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.513+0000 7fba409c4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fba3c06cdc0 0x7fba3c0aeed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:47.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.513+0000 7fba409c4640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fba3c06b580 0x7fba3c06b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:47.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.513+0000 7fba409c4640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba3c06bf10 con 0x7fba3c15d1a0 2023-11-28T18:38:47.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.513+0000 7fba409c4640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba3c06e050 con 0x7fba3c06b580 2023-11-28T18:38:47.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.513+0000 7fba409c4640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba3c0aeab0 con 0x7fba3c06cdc0 2023-11-28T18:38:47.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.513+0000 7fba3a59c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fba3c15d1a0 0x7fba3c0ad5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33860/0 (socket says 172.21.15.45:33860) 2023-11-28T18:38:47.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.513+0000 7fba3a59c640 1 -- 172.21.15.45:0/2057646819 learned_addr learned my addr 172.21.15.45:0/2057646819 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:38:47.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.513+0000 7fba3ad9d640 1 --2- 172.21.15.45:0/2057646819 >> v2:172.21.15.45:3300/0 conn(0x7fba3c06b580 0x7fba3c06b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:47.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.513+0000 7fba33fff640 1 --2- 172.21.15.45:0/2057646819 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fba3c06cdc0 0x7fba3c0aeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:47.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.513+0000 7fba39d9b640 1 -- 172.21.15.45:0/2057646819 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1619903389 0 0) 0x7fba2c001120 con 0x7fba3c15d1a0 2023-11-28T18:38:47.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.513+0000 7fba39d9b640 1 -- 172.21.15.45:0/2057646819 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba28003530 con 0x7fba3c15d1a0 2023-11-28T18:38:47.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.513+0000 7fba3ad9d640 1 -- 172.21.15.45:0/2057646819 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fba3c06cdc0 msgr2=0x7fba3c0aeed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:47.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.513+0000 7fba3ad9d640 1 --2- 172.21.15.45:0/2057646819 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fba3c06cdc0 0x7fba3c0aeed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:47.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.513+0000 7fba3ad9d640 1 -- 172.21.15.45:0/2057646819 >> v1:172.21.15.45:6789/0 conn(0x7fba3c15d1a0 legacy=0x7fba3c0ad5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:47.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.513+0000 7fba3ad9d640 1 -- 172.21.15.45:0/2057646819 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba3c0ade30 con 0x7fba3c06b580 2023-11-28T18:38:47.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.517+0000 7fba3ad9d640 1 --2- 172.21.15.45:0/2057646819 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba3c06b580 0x7fba3c06b9d0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fba34009d90 tx=0x7fba3401c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f66d069705e6fb8e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:47.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.517+0000 7fba39d9b640 1 -- 172.21.15.45:0/2057646819 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba340a5870 con 0x7fba3c06b580 2023-11-28T18:38:47.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.517+0000 7fba39d9b640 1 -- 172.21.15.45:0/2057646819 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba340a59d0 con 0x7fba3c06b580 2023-11-28T18:38:47.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.517+0000 7fba39d9b640 1 -- 172.21.15.45:0/2057646819 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba340a5d60 con 0x7fba3c06b580 2023-11-28T18:38:47.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.517+0000 7fba409c4640 1 -- 172.21.15.45:0/2057646819 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba3c06b580 msgr2=0x7fba3c06b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:47.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.517+0000 7fba409c4640 1 --2- 172.21.15.45:0/2057646819 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba3c06b580 0x7fba3c06b9d0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fba34009d90 tx=0x7fba3401c8c0 comp rx=0 tx=0).stop 2023-11-28T18:38:47.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.517+0000 7fba409c4640 1 -- 172.21.15.45:0/2057646819 shutdown_connections 2023-11-28T18:38:47.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.517+0000 7fba409c4640 1 --2- 172.21.15.45:0/2057646819 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba3c06b580 0x7fba3c06b9d0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:47.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.517+0000 7fba409c4640 1 --2- 172.21.15.45:0/2057646819 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fba3c06cdc0 0x7fba3c0aeed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:47.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.517+0000 7fba409c4640 1 -- 172.21.15.45:0/2057646819 >> 172.21.15.45:0/2057646819 conn(0x7fba3c0b1b30 msgr2=0x7fba3c070d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:47.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.517+0000 7fba409c4640 1 -- 172.21.15.45:0/2057646819 shutdown_connections 2023-11-28T18:38:47.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.517+0000 7fba409c4640 1 -- 172.21.15.45:0/2057646819 wait complete. 2023-11-28T18:38:47.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.517+0000 7fba409c4640 1 Processor -- start 2023-11-28T18:38:47.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.517+0000 7fba409c4640 1 -- start start 2023-11-28T18:38:47.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.521+0000 7fba409c4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fba3c06b580 0x7fba3c14a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:47.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.521+0000 7fba409c4640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fba3c06cdc0 0x7fba3c154ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:47.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.521+0000 7fba409c4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba3c15d1a0 0x7fba3c155220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:47.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.521+0000 7fba409c4640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba3c15e9c0 con 0x7fba3c15d1a0 2023-11-28T18:38:47.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.521+0000 7fba409c4640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba3c15d920 con 0x7fba3c06cdc0 2023-11-28T18:38:47.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.521+0000 7fba409c4640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba3c15dc00 con 0x7fba3c06b580 2023-11-28T18:38:47.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.521+0000 7fba3ad9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba3c15d1a0 0x7fba3c155220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:47.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.521+0000 7fba3ad9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba3c15d1a0 0x7fba3c155220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58546/0 (socket says 172.21.15.45:58546) 2023-11-28T18:38:47.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.521+0000 7fba3ad9d640 1 -- 172.21.15.45:0/2315045351 learned_addr learned my addr 172.21.15.45:0/2315045351 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:47.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.521+0000 7fba33fff640 1 --2- 172.21.15.45:0/2315045351 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fba3c06cdc0 0x7fba3c154ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:47.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.521+0000 7fba3a59c640 1 --2- 172.21.15.45:0/2315045351 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fba3c06b580 0x7fba3c14a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:47.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.521+0000 7fba3ad9d640 1 -- 172.21.15.45:0/2315045351 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fba3c06b580 msgr2=0x7fba3c14a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:47.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.521+0000 7fba3ad9d640 1 --2- 172.21.15.45:0/2315045351 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fba3c06b580 0x7fba3c14a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:47.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.521+0000 7fba3ad9d640 1 -- 172.21.15.45:0/2315045351 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fba3c06cdc0 msgr2=0x7fba3c154ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:47.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.521+0000 7fba3ad9d640 1 --2- 172.21.15.45:0/2315045351 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fba3c06cdc0 0x7fba3c154ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:47.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.521+0000 7fba3ad9d640 1 -- 172.21.15.45:0/2315045351 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba34009a70 con 0x7fba3c15d1a0 2023-11-28T18:38:47.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.521+0000 7fba33fff640 1 --2- 172.21.15.45:0/2315045351 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fba3c06cdc0 0x7fba3c154ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:38:47.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.521+0000 7fba3ad9d640 1 --2- 172.21.15.45:0/2315045351 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba3c15d1a0 0x7fba3c155220 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fba340b0040 tx=0x7fba34019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:47.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.521+0000 7fba32ffd640 1 -- 172.21.15.45:0/2315045351 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba340b9650 con 0x7fba3c15d1a0 2023-11-28T18:38:47.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.521+0000 7fba32ffd640 1 -- 172.21.15.45:0/2315045351 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba340b97b0 con 0x7fba3c15d1a0 2023-11-28T18:38:47.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.521+0000 7fba32ffd640 1 -- 172.21.15.45:0/2315045351 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba340b9b60 con 0x7fba3c15d1a0 2023-11-28T18:38:47.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.521+0000 7fba409c4640 1 -- 172.21.15.45:0/2315045351 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba3c15dee0 con 0x7fba3c15d1a0 2023-11-28T18:38:47.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.521+0000 7fba409c4640 1 -- 172.21.15.45:0/2315045351 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba3c15e4a0 con 0x7fba3c15d1a0 2023-11-28T18:38:47.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.521+0000 7fba409c4640 1 -- 172.21.15.45:0/2315045351 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba3c15e690 con 0x7fba3c15d1a0 2023-11-28T18:38:47.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.521+0000 7fba32ffd640 1 -- 172.21.15.45:0/2315045351 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fba340b9cc0 con 0x7fba3c15d1a0 2023-11-28T18:38:47.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.525+0000 7fba32ffd640 1 --2- 172.21.15.45:0/2315045351 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fba1c0668d0 0x7fba1c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:47.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.525+0000 7fba32ffd640 1 -- 172.21.15.45:0/2315045351 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fba3411f720 con 0x7fba3c15d1a0 2023-11-28T18:38:47.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.525+0000 7fba3a59c640 1 --2- 172.21.15.45:0/2315045351 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fba1c0668d0 0x7fba1c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:47.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.525+0000 7fba3a59c640 1 --2- 172.21.15.45:0/2315045351 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fba1c0668d0 0x7fba1c068d90 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fba2c001280 tx=0x7fba2c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:47.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.529+0000 7fba32ffd640 1 -- 172.21.15.45:0/2315045351 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fba340ec950 con 0x7fba3c15d1a0 2023-11-28T18:38:47.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.681+0000 7fba409c4640 1 -- 172.21.15.45:0/2315045351 --> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fba3c158d10 con 0x7fba1c0668d0 2023-11-28T18:38:47.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.689+0000 7fba32ffd640 1 -- 172.21.15.45:0/2315045351 <== mgr.4100 v2:172.21.15.190:6832/645101166 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288960 (secure 0 0 0) 0x7fba3c158d10 con 0x7fba1c0668d0 2023-11-28T18:38:47.694 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:38:47.696 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-11-28T18:38:47.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.693+0000 7fba409c4640 1 -- 172.21.15.45:0/2315045351 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fba1c0668d0 msgr2=0x7fba1c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:47.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.693+0000 7fba409c4640 1 --2- 172.21.15.45:0/2315045351 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fba1c0668d0 0x7fba1c068d90 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fba2c001280 tx=0x7fba2c009040 comp rx=0 tx=0).stop 2023-11-28T18:38:47.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.693+0000 7fba409c4640 1 -- 172.21.15.45:0/2315045351 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba3c15d1a0 msgr2=0x7fba3c155220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:47.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.693+0000 7fba409c4640 1 --2- 172.21.15.45:0/2315045351 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba3c15d1a0 0x7fba3c155220 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fba340b0040 tx=0x7fba34019660 comp rx=0 tx=0).stop 2023-11-28T18:38:47.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.693+0000 7fba409c4640 1 -- 172.21.15.45:0/2315045351 shutdown_connections 2023-11-28T18:38:47.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.693+0000 7fba409c4640 1 --2- 172.21.15.45:0/2315045351 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fba1c0668d0 0x7fba1c068d90 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:47.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.693+0000 7fba409c4640 1 --2- 172.21.15.45:0/2315045351 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba3c15d1a0 0x7fba3c155220 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:47.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.693+0000 7fba409c4640 1 --2- 172.21.15.45:0/2315045351 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fba3c06cdc0 0x7fba3c154ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:47.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.693+0000 7fba409c4640 1 --2- 172.21.15.45:0/2315045351 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fba3c06b580 0x7fba3c14a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:47.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.693+0000 7fba409c4640 1 -- 172.21.15.45:0/2315045351 >> 172.21.15.45:0/2315045351 conn(0x7fba3c0b1b30 msgr2=0x7fba3c0b0200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:47.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.693+0000 7fba409c4640 1 -- 172.21.15.45:0/2315045351 shutdown_connections 2023-11-28T18:38:47.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.693+0000 7fba409c4640 1 -- 172.21.15.45:0/2315045351 wait complete. 2023-11-28T18:38:47.715 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":71,"stamp":"2023-11-28T18:38:47.250489+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237036,"kb_used_data":4232,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737684,"statfs":{"total":773094113280,"available":772851388416,"internally_reserved":0,"allocated":4333568,"data_stored":2399772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.203009"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.557296+0000","last_change":"2023-11-28T18:38:36.048499+0000","last_active":"2023-11-28T18:38:37.557296+0000","last_peered":"2023-11-28T18:38:37.557296+0000","last_clean":"2023-11-28T18:38:37.557296+0000","last_became_active":"2023-11-28T18:38:36.048195+0000","last_became_peered":"2023-11-28T18:38:36.048195+0000","last_unstale":"2023-11-28T18:38:37.557296+0000","last_undegraded":"2023-11-28T18:38:37.557296+0000","last_fullsized":"2023-11-28T18:38:37.557296+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:24:41.610022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.046664+0000","last_change":"2023-11-28T18:38:36.049196+0000","last_active":"2023-11-28T18:38:37.046664+0000","last_peered":"2023-11-28T18:38:37.046664+0000","last_clean":"2023-11-28T18:38:37.046664+0000","last_became_active":"2023-11-28T18:38:36.048516+0000","last_became_peered":"2023-11-28T18:38:36.048516+0000","last_unstale":"2023-11-28T18:38:37.046664+0000","last_undegraded":"2023-11-28T18:38:37.046664+0000","last_fullsized":"2023-11-28T18:38:37.046664+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:50:14.192746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.053609+0000","last_change":"2023-11-28T18:38:36.044114+0000","last_active":"2023-11-28T18:38:37.053609+0000","last_peered":"2023-11-28T18:38:37.053609+0000","last_clean":"2023-11-28T18:38:37.053609+0000","last_became_active":"2023-11-28T18:38:36.043737+0000","last_became_peered":"2023-11-28T18:38:36.043737+0000","last_unstale":"2023-11-28T18:38:37.053609+0000","last_undegraded":"2023-11-28T18:38:37.053609+0000","last_fullsized":"2023-11-28T18:38:37.053609+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:50:14.192746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.440583+0000","last_change":"2023-11-28T18:38:36.050806+0000","last_active":"2023-11-28T18:38:37.440583+0000","last_peered":"2023-11-28T18:38:37.440583+0000","last_clean":"2023-11-28T18:38:37.440583+0000","last_became_active":"2023-11-28T18:38:36.050513+0000","last_became_peered":"2023-11-28T18:38:36.050513+0000","last_unstale":"2023-11-28T18:38:37.440583+0000","last_undegraded":"2023-11-28T18:38:37.440583+0000","last_fullsized":"2023-11-28T18:38:37.440583+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:00:56.446902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.555498+0000","last_change":"2023-11-28T18:38:36.056292+0000","last_active":"2023-11-28T18:38:37.555498+0000","last_peered":"2023-11-28T18:38:37.555498+0000","last_clean":"2023-11-28T18:38:37.555498+0000","last_became_active":"2023-11-28T18:38:36.056053+0000","last_became_peered":"2023-11-28T18:38:36.056053+0000","last_unstale":"2023-11-28T18:38:37.555498+0000","last_undegraded":"2023-11-28T18:38:37.555498+0000","last_fullsized":"2023-11-28T18:38:37.555498+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:07:09.168762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.046084+0000","last_change":"2023-11-28T18:38:36.044845+0000","last_active":"2023-11-28T18:38:37.046084+0000","last_peered":"2023-11-28T18:38:37.046084+0000","last_clean":"2023-11-28T18:38:37.046084+0000","last_became_active":"2023-11-28T18:38:36.044564+0000","last_became_peered":"2023-11-28T18:38:36.044564+0000","last_unstale":"2023-11-28T18:38:37.046084+0000","last_undegraded":"2023-11-28T18:38:37.046084+0000","last_fullsized":"2023-11-28T18:38:37.046084+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:13:10.806764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.053703+0000","last_change":"2023-11-28T18:38:36.057741+0000","last_active":"2023-11-28T18:38:37.053703+0000","last_peered":"2023-11-28T18:38:37.053703+0000","last_clean":"2023-11-28T18:38:37.053703+0000","last_became_active":"2023-11-28T18:38:36.057436+0000","last_became_peered":"2023-11-28T18:38:36.057436+0000","last_unstale":"2023-11-28T18:38:37.053703+0000","last_undegraded":"2023-11-28T18:38:37.053703+0000","last_fullsized":"2023-11-28T18:38:37.053703+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:50:14.192746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.053015+0000","last_change":"2023-11-28T18:38:36.048935+0000","last_active":"2023-11-28T18:38:37.053015+0000","last_peered":"2023-11-28T18:38:37.053015+0000","last_clean":"2023-11-28T18:38:37.053015+0000","last_became_active":"2023-11-28T18:38:36.048664+0000","last_became_peered":"2023-11-28T18:38:36.048664+0000","last_unstale":"2023-11-28T18:38:37.053015+0000","last_undegraded":"2023-11-28T18:38:37.053015+0000","last_fullsized":"2023-11-28T18:38:37.053015+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:30:37.191534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.557083+0000","last_change":"2023-11-28T18:38:36.049359+0000","last_active":"2023-11-28T18:38:37.557083+0000","last_peered":"2023-11-28T18:38:37.557083+0000","last_clean":"2023-11-28T18:38:37.557083+0000","last_became_active":"2023-11-28T18:38:36.049058+0000","last_became_peered":"2023-11-28T18:38:36.049058+0000","last_unstale":"2023-11-28T18:38:37.557083+0000","last_undegraded":"2023-11-28T18:38:37.557083+0000","last_fullsized":"2023-11-28T18:38:37.557083+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:05:48.872445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.440739+0000","last_change":"2023-11-28T18:38:36.055059+0000","last_active":"2023-11-28T18:38:37.440739+0000","last_peered":"2023-11-28T18:38:37.440739+0000","last_clean":"2023-11-28T18:38:37.440739+0000","last_became_active":"2023-11-28T18:38:36.054791+0000","last_became_peered":"2023-11-28T18:38:36.054791+0000","last_unstale":"2023-11-28T18:38:37.440739+0000","last_undegraded":"2023-11-28T18:38:37.440739+0000","last_fullsized":"2023-11-28T18:38:37.440739+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:51:56.251868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.053793+0000","last_change":"2023-11-28T18:38:36.049539+0000","last_active":"2023-11-28T18:38:37.053793+0000","last_peered":"2023-11-28T18:38:37.053793+0000","last_clean":"2023-11-28T18:38:37.053793+0000","last_became_active":"2023-11-28T18:38:36.049258+0000","last_became_peered":"2023-11-28T18:38:36.049258+0000","last_unstale":"2023-11-28T18:38:37.053793+0000","last_undegraded":"2023-11-28T18:38:37.053793+0000","last_fullsized":"2023-11-28T18:38:37.053793+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:22:24.110740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.053462+0000","last_change":"2023-11-28T18:38:36.053117+0000","last_active":"2023-11-28T18:38:37.053462+0000","last_peered":"2023-11-28T18:38:37.053462+0000","last_clean":"2023-11-28T18:38:37.053462+0000","last_became_active":"2023-11-28T18:38:36.052777+0000","last_became_peered":"2023-11-28T18:38:36.052777+0000","last_unstale":"2023-11-28T18:38:37.053462+0000","last_undegraded":"2023-11-28T18:38:37.053462+0000","last_fullsized":"2023-11-28T18:38:37.053462+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:47:23.624240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.555565+0000","last_change":"2023-11-28T18:38:36.048096+0000","last_active":"2023-11-28T18:38:37.555565+0000","last_peered":"2023-11-28T18:38:37.555565+0000","last_clean":"2023-11-28T18:38:37.555565+0000","last_became_active":"2023-11-28T18:38:36.047805+0000","last_became_peered":"2023-11-28T18:38:36.047805+0000","last_unstale":"2023-11-28T18:38:37.555565+0000","last_undegraded":"2023-11-28T18:38:37.555565+0000","last_fullsized":"2023-11-28T18:38:37.555565+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:06:48.142778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.046154+0000","last_change":"2023-11-28T18:38:36.048850+0000","last_active":"2023-11-28T18:38:37.046154+0000","last_peered":"2023-11-28T18:38:37.046154+0000","last_clean":"2023-11-28T18:38:37.046154+0000","last_became_active":"2023-11-28T18:38:36.048587+0000","last_became_peered":"2023-11-28T18:38:36.048587+0000","last_unstale":"2023-11-28T18:38:37.046154+0000","last_undegraded":"2023-11-28T18:38:37.046154+0000","last_fullsized":"2023-11-28T18:38:37.046154+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:47:23.624240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.053192+0000","last_change":"2023-11-28T18:38:36.053163+0000","last_active":"2023-11-28T18:38:37.053192+0000","last_peered":"2023-11-28T18:38:37.053192+0000","last_clean":"2023-11-28T18:38:37.053192+0000","last_became_active":"2023-11-28T18:38:36.052492+0000","last_became_peered":"2023-11-28T18:38:36.052492+0000","last_unstale":"2023-11-28T18:38:37.053192+0000","last_undegraded":"2023-11-28T18:38:37.053192+0000","last_fullsized":"2023-11-28T18:38:37.053192+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:13:10.806764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.053507+0000","last_change":"2023-11-28T18:38:36.056414+0000","last_active":"2023-11-28T18:38:37.053507+0000","last_peered":"2023-11-28T18:38:37.053507+0000","last_clean":"2023-11-28T18:38:37.053507+0000","last_became_active":"2023-11-28T18:38:36.056067+0000","last_became_peered":"2023-11-28T18:38:36.056067+0000","last_unstale":"2023-11-28T18:38:37.053507+0000","last_undegraded":"2023-11-28T18:38:37.053507+0000","last_fullsized":"2023-11-28T18:38:37.053507+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:22:01.056346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.054083+0000","last_change":"2023-11-28T18:38:36.056315+0000","last_active":"2023-11-28T18:38:37.054083+0000","last_peered":"2023-11-28T18:38:37.054083+0000","last_clean":"2023-11-28T18:38:37.054083+0000","last_became_active":"2023-11-28T18:38:36.056108+0000","last_became_peered":"2023-11-28T18:38:36.056108+0000","last_unstale":"2023-11-28T18:38:37.054083+0000","last_undegraded":"2023-11-28T18:38:37.054083+0000","last_fullsized":"2023-11-28T18:38:37.054083+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:12:23.813010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.046670+0000","last_change":"2023-11-28T18:38:36.049035+0000","last_active":"2023-11-28T18:38:37.046670+0000","last_peered":"2023-11-28T18:38:37.046670+0000","last_clean":"2023-11-28T18:38:37.046670+0000","last_became_active":"2023-11-28T18:38:36.048236+0000","last_became_peered":"2023-11-28T18:38:36.048236+0000","last_unstale":"2023-11-28T18:38:37.046670+0000","last_undegraded":"2023-11-28T18:38:37.046670+0000","last_fullsized":"2023-11-28T18:38:37.046670+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:22:24.110740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.046448+0000","last_change":"2023-11-28T18:38:36.054163+0000","last_active":"2023-11-28T18:38:37.046448+0000","last_peered":"2023-11-28T18:38:37.046448+0000","last_clean":"2023-11-28T18:38:37.046448+0000","last_became_active":"2023-11-28T18:38:36.053935+0000","last_became_peered":"2023-11-28T18:38:36.053935+0000","last_unstale":"2023-11-28T18:38:37.046448+0000","last_undegraded":"2023-11-28T18:38:37.046448+0000","last_fullsized":"2023-11-28T18:38:37.046448+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:22:01.056346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.555720+0000","last_change":"2023-11-28T18:38:36.045594+0000","last_active":"2023-11-28T18:38:37.555720+0000","last_peered":"2023-11-28T18:38:37.555720+0000","last_clean":"2023-11-28T18:38:37.555720+0000","last_became_active":"2023-11-28T18:38:36.045334+0000","last_became_peered":"2023-11-28T18:38:36.045334+0000","last_unstale":"2023-11-28T18:38:37.555720+0000","last_undegraded":"2023-11-28T18:38:37.555720+0000","last_fullsized":"2023-11-28T18:38:37.555720+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:57:35.912381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.557070+0000","last_change":"2023-11-28T18:38:36.041953+0000","last_active":"2023-11-28T18:38:37.557070+0000","last_peered":"2023-11-28T18:38:37.557070+0000","last_clean":"2023-11-28T18:38:37.557070+0000","last_became_active":"2023-11-28T18:38:36.041500+0000","last_became_peered":"2023-11-28T18:38:36.041500+0000","last_unstale":"2023-11-28T18:38:37.557070+0000","last_undegraded":"2023-11-28T18:38:37.557070+0000","last_fullsized":"2023-11-28T18:38:37.557070+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:30:41.654711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.556607+0000","last_change":"2023-11-28T18:38:36.055692+0000","last_active":"2023-11-28T18:38:37.556607+0000","last_peered":"2023-11-28T18:38:37.556607+0000","last_clean":"2023-11-28T18:38:37.556607+0000","last_became_active":"2023-11-28T18:38:36.055413+0000","last_became_peered":"2023-11-28T18:38:36.055413+0000","last_unstale":"2023-11-28T18:38:37.556607+0000","last_undegraded":"2023-11-28T18:38:37.556607+0000","last_fullsized":"2023-11-28T18:38:37.556607+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:20:40.669777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.437820+0000","last_change":"2023-11-28T18:38:36.043333+0000","last_active":"2023-11-28T18:38:37.437820+0000","last_peered":"2023-11-28T18:38:37.437820+0000","last_clean":"2023-11-28T18:38:37.437820+0000","last_became_active":"2023-11-28T18:38:36.042973+0000","last_became_peered":"2023-11-28T18:38:36.042973+0000","last_unstale":"2023-11-28T18:38:37.437820+0000","last_undegraded":"2023-11-28T18:38:37.437820+0000","last_fullsized":"2023-11-28T18:38:37.437820+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:04:21.753781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.053039+0000","last_change":"2023-11-28T18:38:36.050584+0000","last_active":"2023-11-28T18:38:37.053039+0000","last_peered":"2023-11-28T18:38:37.053039+0000","last_clean":"2023-11-28T18:38:37.053039+0000","last_became_active":"2023-11-28T18:38:36.048024+0000","last_became_peered":"2023-11-28T18:38:36.048024+0000","last_unstale":"2023-11-28T18:38:37.053039+0000","last_undegraded":"2023-11-28T18:38:37.053039+0000","last_fullsized":"2023-11-28T18:38:37.053039+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:30:37.191534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.440959+0000","last_change":"2023-11-28T18:38:36.041567+0000","last_active":"2023-11-28T18:38:37.440959+0000","last_peered":"2023-11-28T18:38:37.440959+0000","last_clean":"2023-11-28T18:38:37.440959+0000","last_became_active":"2023-11-28T18:38:36.041223+0000","last_became_peered":"2023-11-28T18:38:36.041223+0000","last_unstale":"2023-11-28T18:38:37.440959+0000","last_undegraded":"2023-11-28T18:38:37.440959+0000","last_fullsized":"2023-11-28T18:38:37.440959+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:24:09.636223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.046786+0000","last_change":"2023-11-28T18:38:36.048865+0000","last_active":"2023-11-28T18:38:37.046786+0000","last_peered":"2023-11-28T18:38:37.046786+0000","last_clean":"2023-11-28T18:38:37.046786+0000","last_became_active":"2023-11-28T18:38:36.047907+0000","last_became_peered":"2023-11-28T18:38:36.047907+0000","last_unstale":"2023-11-28T18:38:37.046786+0000","last_undegraded":"2023-11-28T18:38:37.046786+0000","last_fullsized":"2023-11-28T18:38:37.046786+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:02:31.666914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.440867+0000","last_change":"2023-11-28T18:38:36.048985+0000","last_active":"2023-11-28T18:38:37.440867+0000","last_peered":"2023-11-28T18:38:37.440867+0000","last_clean":"2023-11-28T18:38:37.440867+0000","last_became_active":"2023-11-28T18:38:36.048728+0000","last_became_peered":"2023-11-28T18:38:36.048728+0000","last_unstale":"2023-11-28T18:38:37.440867+0000","last_undegraded":"2023-11-28T18:38:37.440867+0000","last_fullsized":"2023-11-28T18:38:37.440867+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:55:16.262321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.053550+0000","last_change":"2023-11-28T18:38:36.040263+0000","last_active":"2023-11-28T18:38:37.053550+0000","last_peered":"2023-11-28T18:38:37.053550+0000","last_clean":"2023-11-28T18:38:37.053550+0000","last_became_active":"2023-11-28T18:38:36.039983+0000","last_became_peered":"2023-11-28T18:38:36.039983+0000","last_unstale":"2023-11-28T18:38:37.053550+0000","last_undegraded":"2023-11-28T18:38:37.053550+0000","last_fullsized":"2023-11-28T18:38:37.053550+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:08:33.135094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.556611+0000","last_change":"2023-11-28T18:38:36.057225+0000","last_active":"2023-11-28T18:38:37.556611+0000","last_peered":"2023-11-28T18:38:37.556611+0000","last_clean":"2023-11-28T18:38:37.556611+0000","last_became_active":"2023-11-28T18:38:36.056813+0000","last_became_peered":"2023-11-28T18:38:36.056813+0000","last_unstale":"2023-11-28T18:38:37.556611+0000","last_undegraded":"2023-11-28T18:38:37.556611+0000","last_fullsized":"2023-11-28T18:38:37.556611+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:23:34.143756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.053539+0000","last_change":"2023-11-28T18:38:36.057518+0000","last_active":"2023-11-28T18:38:37.053539+0000","last_peered":"2023-11-28T18:38:37.053539+0000","last_clean":"2023-11-28T18:38:37.053539+0000","last_became_active":"2023-11-28T18:38:36.057236+0000","last_became_peered":"2023-11-28T18:38:36.057236+0000","last_unstale":"2023-11-28T18:38:37.053539+0000","last_undegraded":"2023-11-28T18:38:37.053539+0000","last_fullsized":"2023-11-28T18:38:37.053539+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:08:33.135094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.556616+0000","last_change":"2023-11-28T18:38:36.051017+0000","last_active":"2023-11-28T18:38:37.556616+0000","last_peered":"2023-11-28T18:38:37.556616+0000","last_clean":"2023-11-28T18:38:37.556616+0000","last_became_active":"2023-11-28T18:38:36.050722+0000","last_became_peered":"2023-11-28T18:38:36.050722+0000","last_unstale":"2023-11-28T18:38:37.556616+0000","last_undegraded":"2023-11-28T18:38:37.556616+0000","last_fullsized":"2023-11-28T18:38:37.556616+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:10:41.635773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.053096+0000","last_change":"2023-11-28T18:38:36.059859+0000","last_active":"2023-11-28T18:38:37.053096+0000","last_peered":"2023-11-28T18:38:37.053096+0000","last_clean":"2023-11-28T18:38:37.053096+0000","last_became_active":"2023-11-28T18:38:36.058957+0000","last_became_peered":"2023-11-28T18:38:36.058957+0000","last_unstale":"2023-11-28T18:38:37.053096+0000","last_undegraded":"2023-11-28T18:38:37.053096+0000","last_fullsized":"2023-11-28T18:38:37.053096+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:39:58.972690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.437842+0000","last_change":"2023-11-28T18:38:36.043986+0000","last_active":"2023-11-28T18:38:37.437842+0000","last_peered":"2023-11-28T18:38:37.437842+0000","last_clean":"2023-11-28T18:38:37.437842+0000","last_became_active":"2023-11-28T18:38:36.043705+0000","last_became_peered":"2023-11-28T18:38:36.043705+0000","last_unstale":"2023-11-28T18:38:37.437842+0000","last_undegraded":"2023-11-28T18:38:37.437842+0000","last_fullsized":"2023-11-28T18:38:37.437842+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:06:35.371066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T18:38:36.072434+0000","last_change":"2023-11-28T18:38:35.042345+0000","last_active":"2023-11-28T18:38:36.072434+0000","last_peered":"2023-11-28T18:38:36.072434+0000","last_clean":"2023-11-28T18:38:36.072434+0000","last_became_active":"2023-11-28T18:38:35.042014+0000","last_became_peered":"2023-11-28T18:38:35.042014+0000","last_unstale":"2023-11-28T18:38:36.072434+0000","last_undegraded":"2023-11-28T18:38:36.072434+0000","last_fullsized":"2023-11-28T18:38:36.072434+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:51:52.296626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.557376+0000","last_change":"2023-11-28T18:38:36.059686+0000","last_active":"2023-11-28T18:38:37.557376+0000","last_peered":"2023-11-28T18:38:37.557376+0000","last_clean":"2023-11-28T18:38:37.557376+0000","last_became_active":"2023-11-28T18:38:36.059294+0000","last_became_peered":"2023-11-28T18:38:36.059294+0000","last_unstale":"2023-11-28T18:38:37.557376+0000","last_undegraded":"2023-11-28T18:38:37.557376+0000","last_fullsized":"2023-11-28T18:38:37.557376+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:04:21.753781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T18:38:36.068713+0000","last_change":"2023-11-28T18:38:35.044546+0000","last_active":"2023-11-28T18:38:36.068713+0000","last_peered":"2023-11-28T18:38:36.068713+0000","last_clean":"2023-11-28T18:38:36.068713+0000","last_became_active":"2023-11-28T18:38:35.044235+0000","last_became_peered":"2023-11-28T18:38:35.044235+0000","last_unstale":"2023-11-28T18:38:36.068713+0000","last_undegraded":"2023-11-28T18:38:36.068713+0000","last_fullsized":"2023-11-28T18:38:36.068713+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:51:52.296626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.556615+0000","last_change":"2023-11-28T18:38:36.056687+0000","last_active":"2023-11-28T18:38:37.556615+0000","last_peered":"2023-11-28T18:38:37.556615+0000","last_clean":"2023-11-28T18:38:37.556615+0000","last_became_active":"2023-11-28T18:38:36.055076+0000","last_became_peered":"2023-11-28T18:38:36.055076+0000","last_unstale":"2023-11-28T18:38:37.556615+0000","last_undegraded":"2023-11-28T18:38:37.556615+0000","last_fullsized":"2023-11-28T18:38:37.556615+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:24:41.610022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T18:38:36.073473+0000","last_change":"2023-11-28T18:38:35.040826+0000","last_active":"2023-11-28T18:38:36.073473+0000","last_peered":"2023-11-28T18:38:36.073473+0000","last_clean":"2023-11-28T18:38:36.073473+0000","last_became_active":"2023-11-28T18:38:35.040557+0000","last_became_peered":"2023-11-28T18:38:35.040557+0000","last_unstale":"2023-11-28T18:38:36.073473+0000","last_undegraded":"2023-11-28T18:38:36.073473+0000","last_fullsized":"2023-11-28T18:38:36.073473+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:06:34.364765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.440911+0000","last_change":"2023-11-28T18:38:36.059035+0000","last_active":"2023-11-28T18:38:37.440911+0000","last_peered":"2023-11-28T18:38:37.440911+0000","last_clean":"2023-11-28T18:38:37.440911+0000","last_became_active":"2023-11-28T18:38:36.058522+0000","last_became_peered":"2023-11-28T18:38:36.058522+0000","last_unstale":"2023-11-28T18:38:37.440911+0000","last_undegraded":"2023-11-28T18:38:37.440911+0000","last_fullsized":"2023-11-28T18:38:37.440911+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:34:30.267747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T18:38:36.070437+0000","last_change":"2023-11-28T18:38:35.038443+0000","last_active":"2023-11-28T18:38:36.070437+0000","last_peered":"2023-11-28T18:38:36.070437+0000","last_clean":"2023-11-28T18:38:36.070437+0000","last_became_active":"2023-11-28T18:38:35.037937+0000","last_became_peered":"2023-11-28T18:38:35.037937+0000","last_unstale":"2023-11-28T18:38:36.070437+0000","last_undegraded":"2023-11-28T18:38:36.070437+0000","last_fullsized":"2023-11-28T18:38:36.070437+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:55:20.432764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.053700+0000","last_change":"2023-11-28T18:38:36.060792+0000","last_active":"2023-11-28T18:38:37.053700+0000","last_peered":"2023-11-28T18:38:37.053700+0000","last_clean":"2023-11-28T18:38:37.053700+0000","last_became_active":"2023-11-28T18:38:36.058863+0000","last_became_peered":"2023-11-28T18:38:36.058863+0000","last_unstale":"2023-11-28T18:38:37.053700+0000","last_undegraded":"2023-11-28T18:38:37.053700+0000","last_fullsized":"2023-11-28T18:38:37.053700+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:43:30.760891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T18:38:36.069360+0000","last_change":"2023-11-28T18:38:35.022767+0000","last_active":"2023-11-28T18:38:36.069360+0000","last_peered":"2023-11-28T18:38:36.069360+0000","last_clean":"2023-11-28T18:38:36.069360+0000","last_became_active":"2023-11-28T18:38:35.022394+0000","last_became_peered":"2023-11-28T18:38:35.022394+0000","last_unstale":"2023-11-28T18:38:36.069360+0000","last_undegraded":"2023-11-28T18:38:36.069360+0000","last_fullsized":"2023-11-28T18:38:36.069360+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:34:41.136709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.053360+0000","last_change":"2023-11-28T18:38:36.047037+0000","last_active":"2023-11-28T18:38:37.053360+0000","last_peered":"2023-11-28T18:38:37.053360+0000","last_clean":"2023-11-28T18:38:37.053360+0000","last_became_active":"2023-11-28T18:38:36.044136+0000","last_became_peered":"2023-11-28T18:38:36.044136+0000","last_unstale":"2023-11-28T18:38:37.053360+0000","last_undegraded":"2023-11-28T18:38:37.053360+0000","last_fullsized":"2023-11-28T18:38:37.053360+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:39:58.972690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T18:38:36.069343+0000","last_change":"2023-11-28T18:38:35.033844+0000","last_active":"2023-11-28T18:38:36.069343+0000","last_peered":"2023-11-28T18:38:36.069343+0000","last_clean":"2023-11-28T18:38:36.069343+0000","last_became_active":"2023-11-28T18:38:35.033053+0000","last_became_peered":"2023-11-28T18:38:35.033053+0000","last_unstale":"2023-11-28T18:38:36.069343+0000","last_undegraded":"2023-11-28T18:38:36.069343+0000","last_fullsized":"2023-11-28T18:38:36.069343+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:00:43.620322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.556791+0000","last_change":"2023-11-28T18:38:36.052169+0000","last_active":"2023-11-28T18:38:37.556791+0000","last_peered":"2023-11-28T18:38:37.556791+0000","last_clean":"2023-11-28T18:38:37.556791+0000","last_became_active":"2023-11-28T18:38:36.051080+0000","last_became_peered":"2023-11-28T18:38:36.051080+0000","last_unstale":"2023-11-28T18:38:37.556791+0000","last_undegraded":"2023-11-28T18:38:37.556791+0000","last_fullsized":"2023-11-28T18:38:37.556791+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:04:21.753781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T18:38:36.030331+0000","last_change":"2023-11-28T18:38:35.034039+0000","last_active":"2023-11-28T18:38:36.030331+0000","last_peered":"2023-11-28T18:38:36.030331+0000","last_clean":"2023-11-28T18:38:36.030331+0000","last_became_active":"2023-11-28T18:38:35.033740+0000","last_became_peered":"2023-11-28T18:38:35.033740+0000","last_unstale":"2023-11-28T18:38:36.030331+0000","last_undegraded":"2023-11-28T18:38:36.030331+0000","last_fullsized":"2023-11-28T18:38:36.030331+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:11:14.111764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.440382+0000","last_change":"2023-11-28T18:38:36.045771+0000","last_active":"2023-11-28T18:38:37.440382+0000","last_peered":"2023-11-28T18:38:37.440382+0000","last_clean":"2023-11-28T18:38:37.440382+0000","last_became_active":"2023-11-28T18:38:36.045506+0000","last_became_peered":"2023-11-28T18:38:36.045506+0000","last_unstale":"2023-11-28T18:38:37.440382+0000","last_undegraded":"2023-11-28T18:38:37.440382+0000","last_fullsized":"2023-11-28T18:38:37.440382+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:30:41.654711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T18:38:36.032386+0000","last_change":"2023-11-28T18:38:35.032151+0000","last_active":"2023-11-28T18:38:36.032386+0000","last_peered":"2023-11-28T18:38:36.032386+0000","last_clean":"2023-11-28T18:38:36.032386+0000","last_became_active":"2023-11-28T18:38:35.031820+0000","last_became_peered":"2023-11-28T18:38:35.031820+0000","last_unstale":"2023-11-28T18:38:36.032386+0000","last_undegraded":"2023-11-28T18:38:36.032386+0000","last_fullsized":"2023-11-28T18:38:36.032386+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:07:08.162461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.053577+0000","last_change":"2023-11-28T18:38:36.056114+0000","last_active":"2023-11-28T18:38:37.053577+0000","last_peered":"2023-11-28T18:38:37.053577+0000","last_clean":"2023-11-28T18:38:37.053577+0000","last_became_active":"2023-11-28T18:38:36.055779+0000","last_became_peered":"2023-11-28T18:38:36.055779+0000","last_unstale":"2023-11-28T18:38:37.053577+0000","last_undegraded":"2023-11-28T18:38:37.053577+0000","last_fullsized":"2023-11-28T18:38:37.053577+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:43:30.760891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T18:38:36.032396+0000","last_change":"2023-11-28T18:38:35.044014+0000","last_active":"2023-11-28T18:38:36.032396+0000","last_peered":"2023-11-28T18:38:36.032396+0000","last_clean":"2023-11-28T18:38:36.032396+0000","last_became_active":"2023-11-28T18:38:35.042731+0000","last_became_peered":"2023-11-28T18:38:35.042731+0000","last_unstale":"2023-11-28T18:38:36.032396+0000","last_undegraded":"2023-11-28T18:38:36.032396+0000","last_fullsized":"2023-11-28T18:38:36.032396+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:05:24.281995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.046596+0000","last_change":"2023-11-28T18:38:36.049662+0000","last_active":"2023-11-28T18:38:37.046596+0000","last_peered":"2023-11-28T18:38:37.046596+0000","last_clean":"2023-11-28T18:38:37.046596+0000","last_became_active":"2023-11-28T18:38:36.049415+0000","last_became_peered":"2023-11-28T18:38:36.049415+0000","last_unstale":"2023-11-28T18:38:37.046596+0000","last_undegraded":"2023-11-28T18:38:37.046596+0000","last_fullsized":"2023-11-28T18:38:37.046596+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:08:33.135094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T18:38:36.027137+0000","last_change":"2023-11-28T18:38:35.041965+0000","last_active":"2023-11-28T18:38:36.027137+0000","last_peered":"2023-11-28T18:38:36.027137+0000","last_clean":"2023-11-28T18:38:36.027137+0000","last_became_active":"2023-11-28T18:38:35.041387+0000","last_became_peered":"2023-11-28T18:38:35.041387+0000","last_unstale":"2023-11-28T18:38:36.027137+0000","last_undegraded":"2023-11-28T18:38:36.027137+0000","last_fullsized":"2023-11-28T18:38:36.027137+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:58:12.029100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.046611+0000","last_change":"2023-11-28T18:38:36.045069+0000","last_active":"2023-11-28T18:38:37.046611+0000","last_peered":"2023-11-28T18:38:37.046611+0000","last_clean":"2023-11-28T18:38:37.046611+0000","last_became_active":"2023-11-28T18:38:36.044695+0000","last_became_peered":"2023-11-28T18:38:36.044695+0000","last_unstale":"2023-11-28T18:38:37.046611+0000","last_undegraded":"2023-11-28T18:38:37.046611+0000","last_fullsized":"2023-11-28T18:38:37.046611+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:43:30.760891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T18:38:36.072105+0000","last_change":"2023-11-28T18:38:35.043644+0000","last_active":"2023-11-28T18:38:36.072105+0000","last_peered":"2023-11-28T18:38:36.072105+0000","last_clean":"2023-11-28T18:38:36.072105+0000","last_became_active":"2023-11-28T18:38:35.043329+0000","last_became_peered":"2023-11-28T18:38:35.043329+0000","last_unstale":"2023-11-28T18:38:36.072105+0000","last_undegraded":"2023-11-28T18:38:36.072105+0000","last_fullsized":"2023-11-28T18:38:36.072105+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:34:29.261446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.053478+0000","last_change":"2023-11-28T18:38:36.046174+0000","last_active":"2023-11-28T18:38:37.053478+0000","last_peered":"2023-11-28T18:38:37.053478+0000","last_clean":"2023-11-28T18:38:37.053478+0000","last_became_active":"2023-11-28T18:38:36.045879+0000","last_became_peered":"2023-11-28T18:38:36.045879+0000","last_unstale":"2023-11-28T18:38:37.053478+0000","last_undegraded":"2023-11-28T18:38:37.053478+0000","last_fullsized":"2023-11-28T18:38:37.053478+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:22:01.056346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T18:38:36.075594+0000","last_change":"2023-11-28T18:38:35.035852+0000","last_active":"2023-11-28T18:38:36.075594+0000","last_peered":"2023-11-28T18:38:36.075594+0000","last_clean":"2023-11-28T18:38:36.075594+0000","last_became_active":"2023-11-28T18:38:35.035554+0000","last_became_peered":"2023-11-28T18:38:35.035554+0000","last_unstale":"2023-11-28T18:38:36.075594+0000","last_undegraded":"2023-11-28T18:38:36.075594+0000","last_fullsized":"2023-11-28T18:38:36.075594+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:04:20.747481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.440460+0000","last_change":"2023-11-28T18:38:36.045725+0000","last_active":"2023-11-28T18:38:37.440460+0000","last_peered":"2023-11-28T18:38:37.440460+0000","last_clean":"2023-11-28T18:38:37.440460+0000","last_became_active":"2023-11-28T18:38:36.045448+0000","last_became_peered":"2023-11-28T18:38:36.045448+0000","last_unstale":"2023-11-28T18:38:37.440460+0000","last_undegraded":"2023-11-28T18:38:37.440460+0000","last_fullsized":"2023-11-28T18:38:37.440460+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:05:48.872445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T18:38:36.072246+0000","last_change":"2023-11-28T18:38:35.031263+0000","last_active":"2023-11-28T18:38:36.072246+0000","last_peered":"2023-11-28T18:38:36.072246+0000","last_clean":"2023-11-28T18:38:36.072246+0000","last_became_active":"2023-11-28T18:38:35.031028+0000","last_became_peered":"2023-11-28T18:38:35.031028+0000","last_unstale":"2023-11-28T18:38:36.072246+0000","last_undegraded":"2023-11-28T18:38:36.072246+0000","last_fullsized":"2023-11-28T18:38:36.072246+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:06:47.136477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.046138+0000","last_change":"2023-11-28T18:38:36.046881+0000","last_active":"2023-11-28T18:38:37.046138+0000","last_peered":"2023-11-28T18:38:37.046138+0000","last_clean":"2023-11-28T18:38:37.046138+0000","last_became_active":"2023-11-28T18:38:36.043416+0000","last_became_peered":"2023-11-28T18:38:36.043416+0000","last_unstale":"2023-11-28T18:38:37.046138+0000","last_undegraded":"2023-11-28T18:38:37.046138+0000","last_fullsized":"2023-11-28T18:38:37.046138+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:39:58.972690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T18:38:36.035518+0000","last_change":"2023-11-28T18:38:35.044333+0000","last_active":"2023-11-28T18:38:36.035518+0000","last_peered":"2023-11-28T18:38:36.035518+0000","last_clean":"2023-11-28T18:38:36.035518+0000","last_became_active":"2023-11-28T18:38:35.043246+0000","last_became_peered":"2023-11-28T18:38:35.043246+0000","last_unstale":"2023-11-28T18:38:36.035518+0000","last_undegraded":"2023-11-28T18:38:36.035518+0000","last_fullsized":"2023-11-28T18:38:36.035518+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:04:20.747481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.053166+0000","last_change":"2023-11-28T18:38:36.060402+0000","last_active":"2023-11-28T18:38:37.053166+0000","last_peered":"2023-11-28T18:38:37.053166+0000","last_clean":"2023-11-28T18:38:37.053166+0000","last_became_active":"2023-11-28T18:38:36.059804+0000","last_became_peered":"2023-11-28T18:38:36.059804+0000","last_unstale":"2023-11-28T18:38:37.053166+0000","last_undegraded":"2023-11-28T18:38:37.053166+0000","last_fullsized":"2023-11-28T18:38:37.053166+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:13:10.806764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T18:38:36.034319+0000","last_change":"2023-11-28T18:38:35.039112+0000","last_active":"2023-11-28T18:38:36.034319+0000","last_peered":"2023-11-28T18:38:36.034319+0000","last_clean":"2023-11-28T18:38:36.034319+0000","last_became_active":"2023-11-28T18:38:35.038761+0000","last_became_peered":"2023-11-28T18:38:35.038761+0000","last_unstale":"2023-11-28T18:38:36.034319+0000","last_undegraded":"2023-11-28T18:38:36.034319+0000","last_fullsized":"2023-11-28T18:38:36.034319+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:24:08.629922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.556707+0000","last_change":"2023-11-28T18:38:36.058784+0000","last_active":"2023-11-28T18:38:37.556707+0000","last_peered":"2023-11-28T18:38:37.556707+0000","last_clean":"2023-11-28T18:38:37.556707+0000","last_became_active":"2023-11-28T18:38:36.058506+0000","last_became_peered":"2023-11-28T18:38:36.058506+0000","last_unstale":"2023-11-28T18:38:37.556707+0000","last_undegraded":"2023-11-28T18:38:37.556707+0000","last_fullsized":"2023-11-28T18:38:37.556707+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:20:40.669777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T18:38:36.073913+0000","last_change":"2023-11-28T18:38:35.039997+0000","last_active":"2023-11-28T18:38:36.073913+0000","last_peered":"2023-11-28T18:38:36.073913+0000","last_clean":"2023-11-28T18:38:36.073913+0000","last_became_active":"2023-11-28T18:38:35.039693+0000","last_became_peered":"2023-11-28T18:38:35.039693+0000","last_unstale":"2023-11-28T18:38:36.073913+0000","last_undegraded":"2023-11-28T18:38:36.073913+0000","last_fullsized":"2023-11-28T18:38:36.073913+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:34:29.261446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.556934+0000","last_change":"2023-11-28T18:38:36.051189+0000","last_active":"2023-11-28T18:38:37.556934+0000","last_peered":"2023-11-28T18:38:37.556934+0000","last_clean":"2023-11-28T18:38:37.556934+0000","last_became_active":"2023-11-28T18:38:36.049444+0000","last_became_peered":"2023-11-28T18:38:36.049444+0000","last_unstale":"2023-11-28T18:38:37.556934+0000","last_undegraded":"2023-11-28T18:38:37.556934+0000","last_fullsized":"2023-11-28T18:38:37.556934+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:06:35.371066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T18:38:36.070824+0000","last_change":"2023-11-28T18:38:35.043865+0000","last_active":"2023-11-28T18:38:36.070824+0000","last_peered":"2023-11-28T18:38:36.070824+0000","last_clean":"2023-11-28T18:38:36.070824+0000","last_became_active":"2023-11-28T18:38:35.043574+0000","last_became_peered":"2023-11-28T18:38:35.043574+0000","last_unstale":"2023-11-28T18:38:36.070824+0000","last_undegraded":"2023-11-28T18:38:36.070824+0000","last_fullsized":"2023-11-28T18:38:36.070824+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:10:40.629473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.053839+0000","last_change":"2023-11-28T18:38:36.052008+0000","last_active":"2023-11-28T18:38:37.053839+0000","last_peered":"2023-11-28T18:38:37.053839+0000","last_clean":"2023-11-28T18:38:37.053839+0000","last_became_active":"2023-11-28T18:38:36.051699+0000","last_became_peered":"2023-11-28T18:38:36.051699+0000","last_unstale":"2023-11-28T18:38:37.053839+0000","last_undegraded":"2023-11-28T18:38:37.053839+0000","last_fullsized":"2023-11-28T18:38:37.053839+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:22:24.110740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T18:38:36.072207+0000","last_change":"2023-11-28T18:38:35.038493+0000","last_active":"2023-11-28T18:38:36.072207+0000","last_peered":"2023-11-28T18:38:36.072207+0000","last_clean":"2023-11-28T18:38:36.072207+0000","last_became_active":"2023-11-28T18:38:35.038065+0000","last_became_peered":"2023-11-28T18:38:35.038065+0000","last_unstale":"2023-11-28T18:38:36.072207+0000","last_undegraded":"2023-11-28T18:38:36.072207+0000","last_fullsized":"2023-11-28T18:38:36.072207+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:11:13.755446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.440656+0000","last_change":"2023-11-28T18:38:36.050799+0000","last_active":"2023-11-28T18:38:37.440656+0000","last_peered":"2023-11-28T18:38:37.440656+0000","last_clean":"2023-11-28T18:38:37.440656+0000","last_became_active":"2023-11-28T18:38:36.050482+0000","last_became_peered":"2023-11-28T18:38:36.050482+0000","last_unstale":"2023-11-28T18:38:37.440656+0000","last_undegraded":"2023-11-28T18:38:37.440656+0000","last_fullsized":"2023-11-28T18:38:37.440656+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:05:25.288296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T18:38:36.070962+0000","last_change":"2023-11-28T18:38:35.036943+0000","last_active":"2023-11-28T18:38:36.070962+0000","last_peered":"2023-11-28T18:38:36.070962+0000","last_clean":"2023-11-28T18:38:36.070962+0000","last_became_active":"2023-11-28T18:38:35.036630+0000","last_became_peered":"2023-11-28T18:38:35.036630+0000","last_unstale":"2023-11-28T18:38:36.070962+0000","last_undegraded":"2023-11-28T18:38:36.070962+0000","last_fullsized":"2023-11-28T18:38:36.070962+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:06:48.055994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.555777+0000","last_change":"2023-11-28T18:38:36.049172+0000","last_active":"2023-11-28T18:38:37.555777+0000","last_peered":"2023-11-28T18:38:37.555777+0000","last_clean":"2023-11-28T18:38:37.555777+0000","last_became_active":"2023-11-28T18:38:36.048879+0000","last_became_peered":"2023-11-28T18:38:36.048879+0000","last_unstale":"2023-11-28T18:38:37.555777+0000","last_undegraded":"2023-11-28T18:38:37.555777+0000","last_fullsized":"2023-11-28T18:38:37.555777+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:00:44.626623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T18:38:36.041935+0000","last_change":"2023-11-28T18:38:35.023682+0000","last_active":"2023-11-28T18:38:36.041935+0000","last_peered":"2023-11-28T18:38:36.041935+0000","last_clean":"2023-11-28T18:38:36.041935+0000","last_became_active":"2023-11-28T18:38:35.022730+0000","last_became_peered":"2023-11-28T18:38:35.022730+0000","last_unstale":"2023-11-28T18:38:36.041935+0000","last_undegraded":"2023-11-28T18:38:36.041935+0000","last_fullsized":"2023-11-28T18:38:36.041935+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:11:14.111764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.555474+0000","last_change":"2023-11-28T18:38:36.050870+0000","last_active":"2023-11-28T18:38:37.555474+0000","last_peered":"2023-11-28T18:38:37.555474+0000","last_clean":"2023-11-28T18:38:37.555474+0000","last_became_active":"2023-11-28T18:38:36.050578+0000","last_became_peered":"2023-11-28T18:38:36.050578+0000","last_unstale":"2023-11-28T18:38:37.555474+0000","last_undegraded":"2023-11-28T18:38:37.555474+0000","last_fullsized":"2023-11-28T18:38:37.555474+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:47:25.255940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T18:38:36.071165+0000","last_change":"2023-11-28T18:38:35.033842+0000","last_active":"2023-11-28T18:38:36.071165+0000","last_peered":"2023-11-28T18:38:36.071165+0000","last_clean":"2023-11-28T18:38:36.071165+0000","last_became_active":"2023-11-28T18:38:35.033482+0000","last_became_peered":"2023-11-28T18:38:35.033482+0000","last_unstale":"2023-11-28T18:38:36.071165+0000","last_undegraded":"2023-11-28T18:38:36.071165+0000","last_fullsized":"2023-11-28T18:38:36.071165+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:57:34.906080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.555678+0000","last_change":"2023-11-28T18:38:36.045348+0000","last_active":"2023-11-28T18:38:37.555678+0000","last_peered":"2023-11-28T18:38:37.555678+0000","last_clean":"2023-11-28T18:38:37.555678+0000","last_became_active":"2023-11-28T18:38:36.045049+0000","last_became_peered":"2023-11-28T18:38:36.045049+0000","last_unstale":"2023-11-28T18:38:37.555678+0000","last_undegraded":"2023-11-28T18:38:37.555678+0000","last_fullsized":"2023-11-28T18:38:37.555678+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:52:25.982005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T18:38:36.037258+0000","last_change":"2023-11-28T18:38:35.040401+0000","last_active":"2023-11-28T18:38:36.037258+0000","last_peered":"2023-11-28T18:38:36.037258+0000","last_clean":"2023-11-28T18:38:36.037258+0000","last_became_active":"2023-11-28T18:38:35.039986+0000","last_became_peered":"2023-11-28T18:38:35.039986+0000","last_unstale":"2023-11-28T18:38:36.037258+0000","last_undegraded":"2023-11-28T18:38:36.037258+0000","last_fullsized":"2023-11-28T18:38:36.037258+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:48:52.205118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.555554+0000","last_change":"2023-11-28T18:38:36.045843+0000","last_active":"2023-11-28T18:38:37.555554+0000","last_peered":"2023-11-28T18:38:37.555554+0000","last_clean":"2023-11-28T18:38:37.555554+0000","last_became_active":"2023-11-28T18:38:36.043085+0000","last_became_peered":"2023-11-28T18:38:36.043085+0000","last_unstale":"2023-11-28T18:38:37.555554+0000","last_undegraded":"2023-11-28T18:38:37.555554+0000","last_fullsized":"2023-11-28T18:38:37.555554+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:34:42.143010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T18:38:36.033012+0000","last_change":"2023-11-28T18:38:35.037979+0000","last_active":"2023-11-28T18:38:36.033012+0000","last_peered":"2023-11-28T18:38:36.033012+0000","last_clean":"2023-11-28T18:38:36.033012+0000","last_became_active":"2023-11-28T18:38:35.037674+0000","last_became_peered":"2023-11-28T18:38:35.037674+0000","last_unstale":"2023-11-28T18:38:36.033012+0000","last_undegraded":"2023-11-28T18:38:36.033012+0000","last_fullsized":"2023-11-28T18:38:36.033012+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:52:24.975704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.053402+0000","last_change":"2023-11-28T18:38:36.056988+0000","last_active":"2023-11-28T18:38:37.053402+0000","last_peered":"2023-11-28T18:38:37.053402+0000","last_clean":"2023-11-28T18:38:37.053402+0000","last_became_active":"2023-11-28T18:38:36.056767+0000","last_became_peered":"2023-11-28T18:38:36.056767+0000","last_unstale":"2023-11-28T18:38:37.053402+0000","last_undegraded":"2023-11-28T18:38:37.053402+0000","last_fullsized":"2023-11-28T18:38:37.053402+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:47:23.624240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T18:38:36.030277+0000","last_change":"2023-11-28T18:38:35.031421+0000","last_active":"2023-11-28T18:38:36.030277+0000","last_peered":"2023-11-28T18:38:36.030277+0000","last_clean":"2023-11-28T18:38:36.030277+0000","last_became_active":"2023-11-28T18:38:35.031138+0000","last_became_peered":"2023-11-28T18:38:35.031138+0000","last_unstale":"2023-11-28T18:38:36.030277+0000","last_undegraded":"2023-11-28T18:38:36.030277+0000","last_fullsized":"2023-11-28T18:38:36.030277+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:24:40.603721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.555796+0000","last_change":"2023-11-28T18:38:36.044514+0000","last_active":"2023-11-28T18:38:37.555796+0000","last_peered":"2023-11-28T18:38:37.555796+0000","last_clean":"2023-11-28T18:38:37.555796+0000","last_became_active":"2023-11-28T18:38:36.044149+0000","last_became_peered":"2023-11-28T18:38:36.044149+0000","last_unstale":"2023-11-28T18:38:37.555796+0000","last_undegraded":"2023-11-28T18:38:37.555796+0000","last_fullsized":"2023-11-28T18:38:37.555796+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:06:49.062295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T18:38:36.068497+0000","last_change":"2023-11-28T18:38:35.042278+0000","last_active":"2023-11-28T18:38:36.068497+0000","last_peered":"2023-11-28T18:38:36.068497+0000","last_clean":"2023-11-28T18:38:36.068497+0000","last_became_active":"2023-11-28T18:38:35.041885+0000","last_became_peered":"2023-11-28T18:38:35.041885+0000","last_unstale":"2023-11-28T18:38:36.068497+0000","last_undegraded":"2023-11-28T18:38:36.068497+0000","last_fullsized":"2023-11-28T18:38:36.068497+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:24:40.603721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.053846+0000","last_change":"2023-11-28T18:38:36.046270+0000","last_active":"2023-11-28T18:38:37.053846+0000","last_peered":"2023-11-28T18:38:37.053846+0000","last_clean":"2023-11-28T18:38:37.053846+0000","last_became_active":"2023-11-28T18:38:36.045944+0000","last_became_peered":"2023-11-28T18:38:36.045944+0000","last_unstale":"2023-11-28T18:38:37.053846+0000","last_undegraded":"2023-11-28T18:38:37.053846+0000","last_fullsized":"2023-11-28T18:38:37.053846+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:02:31.666914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.438008+0000","last_change":"2023-11-28T18:38:35.036513+0000","last_active":"2023-11-28T18:38:37.438008+0000","last_peered":"2023-11-28T18:38:37.438008+0000","last_clean":"2023-11-28T18:38:37.438008+0000","last_became_active":"2023-11-28T18:38:35.036218+0000","last_became_peered":"2023-11-28T18:38:35.036218+0000","last_unstale":"2023-11-28T18:38:37.438008+0000","last_undegraded":"2023-11-28T18:38:37.438008+0000","last_fullsized":"2023-11-28T18:38:37.438008+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:10:40.629473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.437820+0000","last_change":"2023-11-28T18:38:36.038641+0000","last_active":"2023-11-28T18:38:37.437820+0000","last_peered":"2023-11-28T18:38:37.437820+0000","last_clean":"2023-11-28T18:38:37.437820+0000","last_became_active":"2023-11-28T18:38:36.038314+0000","last_became_peered":"2023-11-28T18:38:36.038314+0000","last_unstale":"2023-11-28T18:38:37.437820+0000","last_undegraded":"2023-11-28T18:38:37.437820+0000","last_fullsized":"2023-11-28T18:38:37.437820+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:24:41.610022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T18:38:36.030089+0000","last_change":"2023-11-28T18:38:35.042254+0000","last_active":"2023-11-28T18:38:36.030089+0000","last_peered":"2023-11-28T18:38:36.030089+0000","last_clean":"2023-11-28T18:38:36.030089+0000","last_became_active":"2023-11-28T18:38:35.041942+0000","last_became_peered":"2023-11-28T18:38:35.041942+0000","last_unstale":"2023-11-28T18:38:36.030089+0000","last_undegraded":"2023-11-28T18:38:36.030089+0000","last_fullsized":"2023-11-28T18:38:36.030089+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:58:12.029100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.556847+0000","last_change":"2023-11-28T18:38:36.048609+0000","last_active":"2023-11-28T18:38:37.556847+0000","last_peered":"2023-11-28T18:38:37.556847+0000","last_clean":"2023-11-28T18:38:37.556847+0000","last_became_active":"2023-11-28T18:38:36.048241+0000","last_became_peered":"2023-11-28T18:38:36.048241+0000","last_unstale":"2023-11-28T18:38:37.556847+0000","last_undegraded":"2023-11-28T18:38:37.556847+0000","last_fullsized":"2023-11-28T18:38:37.556847+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:23:34.143756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T18:38:36.026304+0000","last_change":"2023-11-28T18:38:35.029334+0000","last_active":"2023-11-28T18:38:36.026304+0000","last_peered":"2023-11-28T18:38:36.026304+0000","last_clean":"2023-11-28T18:38:36.026304+0000","last_became_active":"2023-11-28T18:38:35.029088+0000","last_became_peered":"2023-11-28T18:38:35.029088+0000","last_unstale":"2023-11-28T18:38:36.026304+0000","last_undegraded":"2023-11-28T18:38:36.026304+0000","last_fullsized":"2023-11-28T18:38:36.026304+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:06:48.055994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.437840+0000","last_change":"2023-11-28T18:38:36.052359+0000","last_active":"2023-11-28T18:38:37.437840+0000","last_peered":"2023-11-28T18:38:37.437840+0000","last_clean":"2023-11-28T18:38:37.437840+0000","last_became_active":"2023-11-28T18:38:36.052125+0000","last_became_peered":"2023-11-28T18:38:36.052125+0000","last_unstale":"2023-11-28T18:38:37.437840+0000","last_undegraded":"2023-11-28T18:38:37.437840+0000","last_fullsized":"2023-11-28T18:38:37.437840+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:23:34.143756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T18:38:36.032048+0000","last_change":"2023-11-28T18:38:35.036038+0000","last_active":"2023-11-28T18:38:36.032048+0000","last_peered":"2023-11-28T18:38:36.032048+0000","last_clean":"2023-11-28T18:38:36.032048+0000","last_became_active":"2023-11-28T18:38:35.035686+0000","last_became_peered":"2023-11-28T18:38:35.035686+0000","last_unstale":"2023-11-28T18:38:36.032048+0000","last_undegraded":"2023-11-28T18:38:36.032048+0000","last_fullsized":"2023-11-28T18:38:36.032048+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:23:33.137455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.045830+0000","last_change":"2023-11-28T18:38:36.052679+0000","last_active":"2023-11-28T18:38:37.045830+0000","last_peered":"2023-11-28T18:38:37.045830+0000","last_clean":"2023-11-28T18:38:37.045830+0000","last_became_active":"2023-11-28T18:38:36.052359+0000","last_became_peered":"2023-11-28T18:38:36.052359+0000","last_unstale":"2023-11-28T18:38:37.045830+0000","last_undegraded":"2023-11-28T18:38:37.045830+0000","last_fullsized":"2023-11-28T18:38:37.045830+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:30:37.191534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T18:38:36.033150+0000","last_change":"2023-11-28T18:38:35.035526+0000","last_active":"2023-11-28T18:38:36.033150+0000","last_peered":"2023-11-28T18:38:36.033150+0000","last_clean":"2023-11-28T18:38:36.033150+0000","last_became_active":"2023-11-28T18:38:35.034566+0000","last_became_peered":"2023-11-28T18:38:35.034566+0000","last_unstale":"2023-11-28T18:38:36.033150+0000","last_undegraded":"2023-11-28T18:38:36.033150+0000","last_fullsized":"2023-11-28T18:38:36.033150+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:57:34.906080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.556546+0000","last_change":"2023-11-28T18:38:36.053235+0000","last_active":"2023-11-28T18:38:37.556546+0000","last_peered":"2023-11-28T18:38:37.556546+0000","last_clean":"2023-11-28T18:38:37.556546+0000","last_became_active":"2023-11-28T18:38:36.052691+0000","last_became_peered":"2023-11-28T18:38:36.052691+0000","last_unstale":"2023-11-28T18:38:37.556546+0000","last_undegraded":"2023-11-28T18:38:37.556546+0000","last_fullsized":"2023-11-28T18:38:37.556546+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:10:41.635773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T18:38:36.033652+0000","last_change":"2023-11-28T18:38:35.043063+0000","last_active":"2023-11-28T18:38:36.033652+0000","last_peered":"2023-11-28T18:38:36.033652+0000","last_clean":"2023-11-28T18:38:36.033652+0000","last_became_active":"2023-11-28T18:38:35.042719+0000","last_became_peered":"2023-11-28T18:38:35.042719+0000","last_unstale":"2023-11-28T18:38:36.033652+0000","last_undegraded":"2023-11-28T18:38:36.033652+0000","last_fullsized":"2023-11-28T18:38:36.033652+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:55:15.256020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T18:38:37.053825+0000","last_change":"2023-11-28T18:38:36.056922+0000","last_active":"2023-11-28T18:38:37.053825+0000","last_peered":"2023-11-28T18:38:37.053825+0000","last_clean":"2023-11-28T18:38:37.053825+0000","last_became_active":"2023-11-28T18:38:36.056602+0000","last_became_peered":"2023-11-28T18:38:36.056602+0000","last_unstale":"2023-11-28T18:38:37.053825+0000","last_undegraded":"2023-11-28T18:38:37.053825+0000","last_fullsized":"2023-11-28T18:38:37.053825+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:35.006358+0000","last_clean_scrub_stamp":"2023-11-28T18:38:35.006358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:02:31.666914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T18:38:36.040423+0000","last_change":"2023-11-28T18:38:35.040261+0000","last_active":"2023-11-28T18:38:36.040423+0000","last_peered":"2023-11-28T18:38:36.040423+0000","last_clean":"2023-11-28T18:38:36.040423+0000","last_became_active":"2023-11-28T18:38:35.040006+0000","last_became_peered":"2023-11-28T18:38:35.040006+0000","last_unstale":"2023-11-28T18:38:36.040423+0000","last_undegraded":"2023-11-28T18:38:36.040423+0000","last_fullsized":"2023-11-28T18:38:36.040423+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:38:34.000057+0000","last_clean_scrub_stamp":"2023-11-28T18:38:34.000057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:11:14.111764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":176,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T18:38:36.038968+0000","last_change":"2023-11-28T18:37:22.369132+0000","last_active":"2023-11-28T18:38:36.038968+0000","last_peered":"2023-11-28T18:38:36.038968+0000","last_clean":"2023-11-28T18:38:36.038968+0000","last_became_active":"2023-11-28T18:37:22.368142+0000","last_became_peered":"2023-11-28T18:37:22.368142+0000","last_unstale":"2023-11-28T18:38:36.038968+0000","last_undegraded":"2023-11-28T18:38:36.038968+0000","last_fullsized":"2023-11-28T18:38:36.038968+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:21.313053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:21.313053+0000","last_clean_scrub_stamp":"2023-11-28T18:37:21.313053+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:55:01.432028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":983040,"data_stored":742235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":4.8559999999999999,"5min":4.8559999999999999,"15min":4.8559999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":4.8319999999999999,"5min":4.8319999999999999,"15min":4.8319999999999999},"last":0.58599999999999997}]},{"osd":1,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":4.8109999999999999,"5min":4.8109999999999999,"15min":4.8109999999999999},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":4.8700000000000001,"5min":4.8700000000000001,"15min":4.8700000000000001},"last":0.752}]},{"osd":2,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.80700000000000005}]},{"osd":3,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":4.7619999999999996,"5min":4.7619999999999996,"15min":4.7619999999999996},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.64700000000000002}]},{"osd":4,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.82599999999999996}]},{"osd":5,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.84299999999999997}]},{"osd":6,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.86699999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":393216,"data_stored":152393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 18:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.443},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.53200000000000003}]},{"osd":1,"last update":"Tue Nov 28 18:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.65300000000000002}]},{"osd":2,"last update":"Tue Nov 28 18:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.96899999999999997}]},{"osd":3,"last update":"Tue Nov 28 18:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.626}]},{"osd":4,"last update":"Tue Nov 28 18:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.499},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.71499999999999997}]},{"osd":5,"last update":"Tue Nov 28 18:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.745},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.85399999999999998}]},{"osd":7,"last update":"Tue Nov 28 18:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.79200000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":393216,"data_stored":152449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.63200000000000001}]},{"osd":1,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.74099999999999999}]},{"osd":2,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.78800000000000003}]},{"osd":3,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.65300000000000002}]},{"osd":4,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.55400000000000005}]},{"osd":6,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.77000000000000002}]},{"osd":7,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.57899999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":393216,"data_stored":151881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":3.5179999999999998,"5min":3.5179999999999998,"15min":3.5179999999999998},"last":0.77000000000000002}]},{"osd":1,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":3.5019999999999998,"5min":3.5019999999999998,"15min":3.5019999999999998},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":3.5630000000000002,"5min":3.5630000000000002,"15min":3.5630000000000002},"last":0.84799999999999998}]},{"osd":2,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":3.6709999999999998,"5min":3.6709999999999998,"15min":3.6709999999999998},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":3.4849999999999999,"5min":3.4849999999999999,"15min":3.4849999999999999},"last":0.80400000000000005}]},{"osd":3,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":3.7130000000000001,"5min":3.7130000000000001,"15min":3.7130000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.82799999999999996}]},{"osd":5,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.52500000000000002}]},{"osd":6,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.718,"5min":1.718,"15min":1.718},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.54600000000000004}]},{"osd":7,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.55400000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31572,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340268,"statfs":{"total":96636764160,"available":96604434432,"internally_reserved":0,"allocated":401408,"data_stored":153411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 18:38:22 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.53100000000000003}]},{"osd":1,"last update":"Tue Nov 28 18:38:22 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.505},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.78300000000000003}]},{"osd":2,"last update":"Tue Nov 28 18:38:22 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.70199999999999996}]},{"osd":4,"last update":"Tue Nov 28 18:38:22 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.73699999999999999}]},{"osd":5,"last update":"Tue Nov 28 18:38:22 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.83499999999999996}]},{"osd":6,"last update":"Tue Nov 28 18:38:22 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":0.76000000000000001}]},{"osd":7,"last update":"Tue Nov 28 18:38:22 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.77400000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31560,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340280,"statfs":{"total":96636764160,"available":96604446720,"internally_reserved":0,"allocated":389120,"data_stored":151847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 18:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":0.48299999999999998}]},{"osd":1,"last update":"Tue Nov 28 18:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.63900000000000001}]},{"osd":3,"last update":"Tue Nov 28 18:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.52900000000000003}]},{"osd":4,"last update":"Tue Nov 28 18:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.877},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":0.83699999999999997}]},{"osd":5,"last update":"Tue Nov 28 18:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.81100000000000005}]},{"osd":6,"last update":"Tue Nov 28 18:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.7070000000000001,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.85899999999999999}]},{"osd":7,"last update":"Tue Nov 28 18:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.7509999999999999,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.92000000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31572,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340268,"statfs":{"total":96636764160,"available":96604434432,"internally_reserved":0,"allocated":401408,"data_stored":153411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":2.2090000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":4.0899999999999999,"5min":4.0899999999999999,"15min":4.0899999999999999},"last":0.52900000000000003}]},{"osd":2,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":3.8620000000000001,"5min":3.8620000000000001,"15min":3.8620000000000001},"last":0.505},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":2.823,"5min":2.823,"15min":2.823},"last":0.42099999999999999}]},{"osd":3,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":4.0739999999999998,"5min":4.0739999999999998,"15min":4.0739999999999998},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":3.6659999999999999,"5min":3.6659999999999999,"15min":3.6659999999999999},"last":0.79600000000000004}]},{"osd":4,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":5.3540000000000001,"5min":5.3540000000000001,"15min":5.3540000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":5.5,"5min":5.5,"15min":5.5},"last":0.56299999999999994}]},{"osd":5,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":5.4379999999999997,"5min":5.4379999999999997,"15min":5.4379999999999997},"last":0.68899999999999995},{"interface":"front","average":{"1min":1.129,"5min":1.129,"15min":1.129},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":3.4500000000000002,"5min":3.4500000000000002,"15min":3.4500000000000002},"last":0.76000000000000001}]},{"osd":6,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":3.0369999999999999,"5min":3.0369999999999999,"15min":3.0369999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":5.4000000000000004,"5min":5.4000000000000004,"15min":5.4000000000000004},"last":0.624}]},{"osd":7,"last update":"Tue Nov 28 18:38:21 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":5.5369999999999999,"5min":5.5369999999999999,"15min":5.5369999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":3.2480000000000002,"5min":3.2480000000000002,"15min":3.2480000000000002},"last":0.82299999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":978944,"data_stored":742145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 18:38:22 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.57099999999999995}]},{"osd":2,"last update":"Tue Nov 28 18:38:22 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.64900000000000002}]},{"osd":3,"last update":"Tue Nov 28 18:38:22 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.67100000000000004}]},{"osd":4,"last update":"Tue Nov 28 18:38:22 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.73599999999999999}]},{"osd":5,"last update":"Tue Nov 28 18:38:22 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.75600000000000001}]},{"osd":6,"last update":"Tue Nov 28 18:38:22 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1,"5min":1,"15min":1},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.82699999999999996}]},{"osd":7,"last update":"Tue Nov 28 18:38:22 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.72999999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T18:38:47.721 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-28T18:38:47.722 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-28T18:38:47.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.909+0000 7f44f7c17640 1 Processor -- start 2023-11-28T18:38:47.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.909+0000 7f44f7c17640 1 -- start start 2023-11-28T18:38:47.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.909+0000 7f44f7c17640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f44f00b3f70 0x7f44f00cdb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:47.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.909+0000 7f44f7c17640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44f00cbc20 con 0x7f44f01597f0 2023-11-28T18:38:47.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.909+0000 7f44f7c17640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44f0071a40 con 0x7f44f00b4d60 2023-11-28T18:38:47.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.909+0000 7f44f7c17640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44f0071d20 con 0x7f44f00b3f70 2023-11-28T18:38:47.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.909+0000 7f44f59b3640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f44f01597f0 0x7f44f00b4650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:60404/0 (socket says 172.21.15.45:60404) 2023-11-28T18:38:47.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.909+0000 7f44f59b3640 1 -- 172.21.15.45:0/3101708978 learned_addr learned my addr 172.21.15.45:0/3101708978 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:38:47.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.909+0000 7f44f61b4640 1 --2- 172.21.15.45:0/3101708978 >> v2:172.21.15.190:3300/0 conn(0x7f44f00b3f70 0x7f44f00cdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:47.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.909+0000 7f44f49b1640 1 -- 172.21.15.45:0/3101708978 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4245960172 0 0) 0x7f44f00cbc20 con 0x7f44f01597f0 2023-11-28T18:38:47.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.909+0000 7f44f49b1640 1 -- 172.21.15.45:0/3101708978 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44dc003530 con 0x7f44f01597f0 2023-11-28T18:38:47.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.909+0000 7f44f49b1640 1 -- 172.21.15.45:0/3101708978 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2236859422 0 0) 0x7f44dc003530 con 0x7f44f01597f0 2023-11-28T18:38:47.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.909+0000 7f44f49b1640 1 -- 172.21.15.45:0/3101708978 >> v2:172.21.15.190:3300/0 conn(0x7f44f00b3f70 msgr2=0x7f44f00cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:47.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.909+0000 7f44f49b1640 1 --2- 172.21.15.45:0/3101708978 >> v2:172.21.15.190:3300/0 conn(0x7f44f00b3f70 0x7f44f00cdb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:47.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.909+0000 7f44f49b1640 1 -- 172.21.15.45:0/3101708978 >> v1:172.21.15.190:6789/0 conn(0x7f44f00b4d60 legacy=0x7f44f00cd410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:47.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.909+0000 7f44f49b1640 1 -- 172.21.15.45:0/3101708978 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f0072000 con 0x7f44f01597f0 2023-11-28T18:38:47.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.909+0000 7f44f49b1640 1 -- 172.21.15.45:0/3101708978 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4084481567 0 0) 0x7f44ec001680 con 0x7f44f01597f0 2023-11-28T18:38:47.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.909+0000 7f44f49b1640 1 -- 172.21.15.45:0/3101708978 >> v1:172.21.15.45:6789/0 conn(0x7f44f01597f0 legacy=0x7f44f00b4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:47.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.909+0000 7f44f49b1640 1 --2- 172.21.15.45:0/3101708978 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44dc003980 0x7f44dc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:47.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.909+0000 7f44f49b1640 1 --2- 172.21.15.45:0/3101708978 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44dc0047d0 0x7f44dc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:47.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.909+0000 7f44f49b1640 1 --2- 172.21.15.45:0/3101708978 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44dc005190 0x7f44dc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:47.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.909+0000 7f44f49b1640 1 -- 172.21.15.45:0/3101708978 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44f0071d20 con 0x7f44dc003980 2023-11-28T18:38:47.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.909+0000 7f44f49b1640 1 -- 172.21.15.45:0/3101708978 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44dc00c030 con 0x7f44dc005190 2023-11-28T18:38:47.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.909+0000 7f44f49b1640 1 -- 172.21.15.45:0/3101708978 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44dc00c1f0 con 0x7f44dc0047d0 2023-11-28T18:38:47.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.909+0000 7f44f59b3640 1 --2- 172.21.15.45:0/3101708978 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44dc003980 0x7f44dc003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:47.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.909+0000 7f44f61b4640 1 --2- 172.21.15.45:0/3101708978 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44dc005190 0x7f44dc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:47.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.909+0000 7f44f51b2640 1 --2- 172.21.15.45:0/3101708978 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44dc0047d0 0x7f44dc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:47.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.909+0000 7f44f59b3640 1 -- 172.21.15.45:0/3101708978 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44dc0047d0 msgr2=0x7f44dc004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:47.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.909+0000 7f44f59b3640 1 --2- 172.21.15.45:0/3101708978 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44dc0047d0 0x7f44dc004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:47.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.909+0000 7f44f59b3640 1 -- 172.21.15.45:0/3101708978 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44dc005190 msgr2=0x7f44dc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:47.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.909+0000 7f44f59b3640 1 --2- 172.21.15.45:0/3101708978 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44dc005190 0x7f44dc00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:47.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.909+0000 7f44f59b3640 1 -- 172.21.15.45:0/3101708978 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44dc003530 con 0x7f44dc003980 2023-11-28T18:38:47.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.909+0000 7f44f61b4640 1 -- 172.21.15.45:0/3101708978 reap_dead start 2023-11-28T18:38:47.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.913+0000 7f44f59b3640 1 --2- 172.21.15.45:0/3101708978 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44dc003980 0x7f44dc003da0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f44ec00c240 tx=0x7f44ec01cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9cc39b416928564 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:47.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.913+0000 7f44f49b1640 1 -- 172.21.15.45:0/3101708978 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ec005ae0 con 0x7f44dc003980 2023-11-28T18:38:47.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.913+0000 7f44f49b1640 1 -- 172.21.15.45:0/3101708978 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44ec005c60 con 0x7f44dc003980 2023-11-28T18:38:47.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.913+0000 7f44f49b1640 1 -- 172.21.15.45:0/3101708978 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ec007070 con 0x7f44dc003980 2023-11-28T18:38:47.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.913+0000 7f44f7c17640 1 -- 172.21.15.45:0/3101708978 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44dc003980 msgr2=0x7f44dc003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:47.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.913+0000 7f44f7c17640 1 --2- 172.21.15.45:0/3101708978 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44dc003980 0x7f44dc003da0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f44ec00c240 tx=0x7f44ec01cc00 comp rx=0 tx=0).stop 2023-11-28T18:38:47.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.913+0000 7f44f7c17640 1 -- 172.21.15.45:0/3101708978 shutdown_connections 2023-11-28T18:38:47.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.913+0000 7f44f7c17640 1 --2- 172.21.15.45:0/3101708978 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44dc003980 0x7f44dc003da0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:47.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.913+0000 7f44f7c17640 1 -- 172.21.15.45:0/3101708978 >> 172.21.15.45:0/3101708978 conn(0x7f44f00b0d00 msgr2=0x7f44f00b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:47.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.913+0000 7f44f7c17640 1 -- 172.21.15.45:0/3101708978 shutdown_connections 2023-11-28T18:38:47.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.913+0000 7f44f7c17640 1 -- 172.21.15.45:0/3101708978 wait complete. 2023-11-28T18:38:47.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.917+0000 7f44f7c17640 1 Processor -- start 2023-11-28T18:38:47.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.917+0000 7f44f7c17640 1 -- start start 2023-11-28T18:38:47.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.917+0000 7f44f7c17640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44dc003980 0x7f44f0141400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:47.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.917+0000 7f44f7c17640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44f0141bc0 0x7f44f0159ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:47.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.917+0000 7f44f7c17640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44f014a180 0x7f44f015ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:47.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.917+0000 7f44f7c17640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44f01490e0 con 0x7f44f0141bc0 2023-11-28T18:38:47.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.917+0000 7f44f7c17640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44f01493c0 con 0x7f44f014a180 2023-11-28T18:38:47.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.917+0000 7f44f7c17640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44f01496a0 con 0x7f44dc003980 2023-11-28T18:38:47.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.917+0000 7f44f51b2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44f0141bc0 0x7f44f0159ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:47.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.917+0000 7f44f51b2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44f0141bc0 0x7f44f0159ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39486/0 (socket says 172.21.15.45:39486) 2023-11-28T18:38:47.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.917+0000 7f44f51b2640 1 -- 172.21.15.45:0/832536403 learned_addr learned my addr 172.21.15.45:0/832536403 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:47.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.917+0000 7f44f59b3640 1 --2- 172.21.15.45:0/832536403 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44dc003980 0x7f44f0141400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:47.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.917+0000 7f44f61b4640 1 --2- 172.21.15.45:0/832536403 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44f014a180 0x7f44f015ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:47.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.917+0000 7f44f51b2640 1 -- 172.21.15.45:0/832536403 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44dc003980 msgr2=0x7f44f0141400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:47.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.917+0000 7f44f51b2640 1 --2- 172.21.15.45:0/832536403 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44dc003980 0x7f44f0141400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:47.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.917+0000 7f44f51b2640 1 -- 172.21.15.45:0/832536403 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44f014a180 msgr2=0x7f44f015ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:47.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.917+0000 7f44f51b2640 1 --2- 172.21.15.45:0/832536403 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44f014a180 0x7f44f015ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:47.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.917+0000 7f44f51b2640 1 -- 172.21.15.45:0/832536403 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f0149980 con 0x7f44f0141bc0 2023-11-28T18:38:47.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.917+0000 7f44f51b2640 1 --2- 172.21.15.45:0/832536403 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44f0141bc0 0x7f44f0159ce0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f44e000e710 tx=0x7f44e000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:47.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.917+0000 7f44e67fc640 1 -- 172.21.15.45:0/832536403 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e000b070 con 0x7f44f0141bc0 2023-11-28T18:38:47.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.917+0000 7f44e67fc640 1 -- 172.21.15.45:0/832536403 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44e00052d0 con 0x7f44f0141bc0 2023-11-28T18:38:47.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.917+0000 7f44e67fc640 1 -- 172.21.15.45:0/832536403 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e000c940 con 0x7f44f0141bc0 2023-11-28T18:38:47.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.917+0000 7f44f7c17640 1 -- 172.21.15.45:0/832536403 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44f0149c60 con 0x7f44f0141bc0 2023-11-28T18:38:47.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.917+0000 7f44f7c17640 1 -- 172.21.15.45:0/832536403 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44f015b080 con 0x7f44f0141bc0 2023-11-28T18:38:47.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.921+0000 7f44f7c17640 1 -- 172.21.15.45:0/832536403 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44f00b26b0 con 0x7f44f0141bc0 2023-11-28T18:38:47.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.921+0000 7f44e67fc640 1 -- 172.21.15.45:0/832536403 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f44e000caa0 con 0x7f44f0141bc0 2023-11-28T18:38:47.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.921+0000 7f44e67fc640 1 --2- 172.21.15.45:0/832536403 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f44d4066900 0x7f44d4068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:47.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.921+0000 7f44e67fc640 1 -- 172.21.15.45:0/832536403 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f44e0084490 con 0x7f44f0141bc0 2023-11-28T18:38:47.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.921+0000 7f44f59b3640 1 --2- 172.21.15.45:0/832536403 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f44d4066900 0x7f44d4068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:47.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.921+0000 7f44f59b3640 1 --2- 172.21.15.45:0/832536403 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f44d4066900 0x7f44d4068dc0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f44ec0ab000 tx=0x7f44ec0b1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:47.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:47.925+0000 7f44e67fc640 1 -- 172.21.15.45:0/832536403 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f44e00516f0 con 0x7f44f0141bc0 2023-11-28T18:38:48.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.141+0000 7f44f7c17640 1 -- 172.21.15.45:0/832536403 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f44f0069480 con 0x7f44f0141bc0 2023-11-28T18:38:48.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.141+0000 7f44e67fc640 1 -- 172.21.15.45:0/832536403 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+147 (secure 0 0 0) 0x7f44e0054d10 con 0x7f44f0141bc0 2023-11-28T18:38:48.145 INFO:teuthology.orchestra.run.smithi045.stdout:[client.0] 2023-11-28T18:38:48.146 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQApM2ZlTJxNMBAAwJAMWm1Y180iNJmgHnWFnw== 2023-11-28T18:38:48.146 INFO:teuthology.orchestra.run.smithi045.stdout: caps mds = "allow" 2023-11-28T18:38:48.146 INFO:teuthology.orchestra.run.smithi045.stdout: caps mon = "allow r" 2023-11-28T18:38:48.146 INFO:teuthology.orchestra.run.smithi045.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-28T18:38:48.146 INFO:teuthology.orchestra.run.smithi045.stderr:updated caps for client.0 2023-11-28T18:38:48.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.145+0000 7f44f7c17640 1 -- 172.21.15.45:0/832536403 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f44d4066900 msgr2=0x7f44d4068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:48.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.145+0000 7f44f7c17640 1 --2- 172.21.15.45:0/832536403 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f44d4066900 0x7f44d4068dc0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f44ec0ab000 tx=0x7f44ec0b1040 comp rx=0 tx=0).stop 2023-11-28T18:38:48.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.145+0000 7f44f7c17640 1 -- 172.21.15.45:0/832536403 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44f0141bc0 msgr2=0x7f44f0159ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:48.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.145+0000 7f44f7c17640 1 --2- 172.21.15.45:0/832536403 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44f0141bc0 0x7f44f0159ce0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f44e000e710 tx=0x7f44e000ebd0 comp rx=0 tx=0).stop 2023-11-28T18:38:48.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.145+0000 7f44f7c17640 1 -- 172.21.15.45:0/832536403 shutdown_connections 2023-11-28T18:38:48.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.145+0000 7f44f7c17640 1 --2- 172.21.15.45:0/832536403 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f44d4066900 0x7f44d4068dc0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:48.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.145+0000 7f44f7c17640 1 --2- 172.21.15.45:0/832536403 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44f014a180 0x7f44f015ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:48.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.145+0000 7f44f7c17640 1 --2- 172.21.15.45:0/832536403 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44f0141bc0 0x7f44f0159ce0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:48.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.145+0000 7f44f7c17640 1 --2- 172.21.15.45:0/832536403 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44dc003980 0x7f44f0141400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:48.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.145+0000 7f44f7c17640 1 -- 172.21.15.45:0/832536403 >> 172.21.15.45:0/832536403 conn(0x7f44f00b0d00 msgr2=0x7f44f0155710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:48.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.145+0000 7f44f7c17640 1 -- 172.21.15.45:0/832536403 shutdown_connections 2023-11-28T18:38:48.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.145+0000 7f44f7c17640 1 -- 172.21.15.45:0/832536403 wait complete. 2023-11-28T18:38:48.167 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T18:38:48.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.309+0000 7fa29c6fe640 1 Processor -- start 2023-11-28T18:38:48.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.309+0000 7fa29c6fe640 1 -- start start 2023-11-28T18:38:48.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.309+0000 7fa29c6fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa29413cf70 0x7fa29406c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:48.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.309+0000 7fa29c6fe640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa29415b1b0 con 0x7fa29406c840 2023-11-28T18:38:48.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.309+0000 7fa29c6fe640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa29415b3e0 con 0x7fa29415ad80 2023-11-28T18:38:48.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.309+0000 7fa29c6fe640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa29413d350 con 0x7fa29413cf70 2023-11-28T18:38:48.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.309+0000 7fa29a49a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa29413cf70 0x7fa29406c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:48.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.309+0000 7fa299c99640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fa29406c840 0x7fa29415a670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:60406/0 (socket says 172.21.15.45:60406) 2023-11-28T18:38:48.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.309+0000 7fa299c99640 1 -- 172.21.15.45:0/2525001348 learned_addr learned my addr 172.21.15.45:0/2525001348 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:38:48.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.309+0000 7fa29a49a640 1 -- 172.21.15.45:0/2525001348 >> v1:172.21.15.190:6789/0 conn(0x7fa29415ad80 legacy=0x7fa2940cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:48.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.309+0000 7fa29a49a640 1 -- 172.21.15.45:0/2525001348 >> v1:172.21.15.45:6789/0 conn(0x7fa29406c840 legacy=0x7fa29415a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:48.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.309+0000 7fa29a49a640 1 -- 172.21.15.45:0/2525001348 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa29413f760 con 0x7fa29413cf70 2023-11-28T18:38:48.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.309+0000 7fa299498640 1 -- 172.21.15.45:0/2525001348 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3290374393 0 0) 0x7fa29415b1b0 con 0x7fa29406c840 2023-11-28T18:38:48.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.313+0000 7fa29a49a640 1 --2- 172.21.15.45:0/2525001348 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa29413cf70 0x7fa29406c300 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fa2900097c0 tx=0x7fa29001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f059fff28800dc46 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:48.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.313+0000 7fa299498640 1 -- 172.21.15.45:0/2525001348 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2900ab600 con 0x7fa29413cf70 2023-11-28T18:38:48.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.313+0000 7fa299498640 1 -- 172.21.15.45:0/2525001348 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2900a7050 con 0x7fa29413cf70 2023-11-28T18:38:48.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.313+0000 7fa299498640 1 -- 172.21.15.45:0/2525001348 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2900ab980 con 0x7fa29413cf70 2023-11-28T18:38:48.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.313+0000 7fa29c6fe640 1 -- 172.21.15.45:0/2525001348 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa29413cf70 msgr2=0x7fa29406c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:48.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.313+0000 7fa29c6fe640 1 --2- 172.21.15.45:0/2525001348 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa29413cf70 0x7fa29406c300 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fa2900097c0 tx=0x7fa29001c3f0 comp rx=0 tx=0).stop 2023-11-28T18:38:48.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.313+0000 7fa29c6fe640 1 -- 172.21.15.45:0/2525001348 shutdown_connections 2023-11-28T18:38:48.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.313+0000 7fa29c6fe640 1 --2- 172.21.15.45:0/2525001348 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa29413cf70 0x7fa29406c300 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:48.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.313+0000 7fa29c6fe640 1 -- 172.21.15.45:0/2525001348 >> 172.21.15.45:0/2525001348 conn(0x7fa29406a570 msgr2=0x7fa29406a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:48.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.313+0000 7fa29c6fe640 1 -- 172.21.15.45:0/2525001348 shutdown_connections 2023-11-28T18:38:48.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.313+0000 7fa29c6fe640 1 -- 172.21.15.45:0/2525001348 wait complete. 2023-11-28T18:38:48.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.317+0000 7fa29c6fe640 1 Processor -- start 2023-11-28T18:38:48.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.317+0000 7fa29c6fe640 1 -- start start 2023-11-28T18:38:48.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.317+0000 7fa29c6fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa29406c840 0x7fa29413bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:48.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.317+0000 7fa29c6fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa29413cf70 0x7fa29414d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:48.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.317+0000 7fa29c6fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa29415ad80 0x7fa29414b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:48.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.317+0000 7fa29c6fe640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa294142300 con 0x7fa29406c840 2023-11-28T18:38:48.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.317+0000 7fa29c6fe640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa294155af0 con 0x7fa29415ad80 2023-11-28T18:38:48.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.317+0000 7fa29c6fe640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa294154ee0 con 0x7fa29413cf70 2023-11-28T18:38:48.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.317+0000 7fa29a49a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa29406c840 0x7fa29413bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:48.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.317+0000 7fa29a49a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa29406c840 0x7fa29413bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39508/0 (socket says 172.21.15.45:39508) 2023-11-28T18:38:48.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.317+0000 7fa29a49a640 1 -- 172.21.15.45:0/80877683 learned_addr learned my addr 172.21.15.45:0/80877683 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:48.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.317+0000 7fa299c99640 1 --2- 172.21.15.45:0/80877683 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa29413cf70 0x7fa29414d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:48.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.317+0000 7fa29ac9b640 1 --2- 172.21.15.45:0/80877683 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa29415ad80 0x7fa29414b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:48.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.317+0000 7fa29a49a640 1 -- 172.21.15.45:0/80877683 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa29413cf70 msgr2=0x7fa29414d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:48.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.317+0000 7fa29a49a640 1 --2- 172.21.15.45:0/80877683 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa29413cf70 0x7fa29414d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:48.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.317+0000 7fa29a49a640 1 -- 172.21.15.45:0/80877683 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa29415ad80 msgr2=0x7fa29414b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:48.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.317+0000 7fa29a49a640 1 --2- 172.21.15.45:0/80877683 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa29415ad80 0x7fa29414b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:48.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.317+0000 7fa29a49a640 1 -- 172.21.15.45:0/80877683 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa290009420 con 0x7fa29406c840 2023-11-28T18:38:48.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.317+0000 7fa29ac9b640 1 --2- 172.21.15.45:0/80877683 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa29415ad80 0x7fa29414b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:38:48.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.317+0000 7fa29a49a640 1 --2- 172.21.15.45:0/80877683 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa29406c840 0x7fa29413bd90 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fa290019000 tx=0x7fa290019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:48.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.317+0000 7fa28affd640 1 -- 172.21.15.45:0/80877683 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2900b4840 con 0x7fa29406c840 2023-11-28T18:38:48.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.317+0000 7fa28affd640 1 -- 172.21.15.45:0/80877683 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2900b49a0 con 0x7fa29406c840 2023-11-28T18:38:48.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.317+0000 7fa28affd640 1 -- 172.21.15.45:0/80877683 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2900b4d50 con 0x7fa29406c840 2023-11-28T18:38:48.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.317+0000 7fa29c6fe640 1 -- 172.21.15.45:0/80877683 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2941551c0 con 0x7fa29406c840 2023-11-28T18:38:48.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.317+0000 7fa29c6fe640 1 -- 172.21.15.45:0/80877683 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa294155780 con 0x7fa29406c840 2023-11-28T18:38:48.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.317+0000 7fa29c6fe640 1 -- 172.21.15.45:0/80877683 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa294069480 con 0x7fa29406c840 2023-11-28T18:38:48.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.321+0000 7fa28affd640 1 -- 172.21.15.45:0/80877683 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa2900b2040 con 0x7fa29406c840 2023-11-28T18:38:48.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.321+0000 7fa28affd640 1 --2- 172.21.15.45:0/80877683 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa2780668d0 0x7fa278068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:48.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.321+0000 7fa28affd640 1 -- 172.21.15.45:0/80877683 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa29011e910 con 0x7fa29406c840 2023-11-28T18:38:48.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.321+0000 7fa299c99640 1 --2- 172.21.15.45:0/80877683 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa2780668d0 0x7fa278068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:48.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.321+0000 7fa299c99640 1 --2- 172.21.15.45:0/80877683 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa2780668d0 0x7fa278068d90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa2941f77f0 tx=0x7fa284007d10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:48.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.325+0000 7fa28affd640 1 -- 172.21.15.45:0/80877683 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa2900ebab0 con 0x7fa29406c840 2023-11-28T18:38:48.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.517+0000 7fa29c6fe640 1 -- 172.21.15.45:0/80877683 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa29406d220 con 0x7fa29406c840 2023-11-28T18:38:48.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.517+0000 7fa28affd640 1 -- 172.21.15.45:0/80877683 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4916 (secure 0 0 0) 0x7fa2900b0090 con 0x7fa29406c840 2023-11-28T18:38:48.520 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:38:48.520 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5188,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/270858280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":270858280},{"type":"v1","addr":"172.21.15.190:6836","nonce":270858280}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5191,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/4006352118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":4006352118},{"type":"v1","addr":"172.21.15.190:6837","nonce":4006352118}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5197,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2204012451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":2204012451},{"type":"v1","addr":"172.21.15.45:6835","nonce":2204012451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T18:38:35.406884+0000","modified":"2023-11-28T18:38:38.439497+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5253},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5253":{"gid":5253,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.45:6834/2398964901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2398964901},{"type":"v1","addr":"172.21.15.45:6834","nonce":2398964901}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-28T18:38:48.521 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 16 2023-11-28T18:38:48.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.517+0000 7fa29c6fe640 1 -- 172.21.15.45:0/80877683 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa2780668d0 msgr2=0x7fa278068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:48.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.517+0000 7fa29c6fe640 1 --2- 172.21.15.45:0/80877683 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa2780668d0 0x7fa278068d90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa2941f77f0 tx=0x7fa284007d10 comp rx=0 tx=0).stop 2023-11-28T18:38:48.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.517+0000 7fa29c6fe640 1 -- 172.21.15.45:0/80877683 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa29406c840 msgr2=0x7fa29413bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:48.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.517+0000 7fa29c6fe640 1 --2- 172.21.15.45:0/80877683 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa29406c840 0x7fa29413bd90 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fa290019000 tx=0x7fa290019190 comp rx=0 tx=0).stop 2023-11-28T18:38:48.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.517+0000 7fa29c6fe640 1 -- 172.21.15.45:0/80877683 shutdown_connections 2023-11-28T18:38:48.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.517+0000 7fa29c6fe640 1 --2- 172.21.15.45:0/80877683 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa2780668d0 0x7fa278068d90 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:48.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.517+0000 7fa29c6fe640 1 --2- 172.21.15.45:0/80877683 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa29415ad80 0x7fa29414b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:48.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.517+0000 7fa29c6fe640 1 --2- 172.21.15.45:0/80877683 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa29413cf70 0x7fa29414d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:48.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.517+0000 7fa29c6fe640 1 --2- 172.21.15.45:0/80877683 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa29406c840 0x7fa29413bd90 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:48.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.517+0000 7fa29c6fe640 1 -- 172.21.15.45:0/80877683 >> 172.21.15.45:0/80877683 conn(0x7fa29406a570 msgr2=0x7fa29414fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:48.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.517+0000 7fa29c6fe640 1 -- 172.21.15.45:0/80877683 shutdown_connections 2023-11-28T18:38:48.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:48.517+0000 7fa29c6fe640 1 -- 172.21.15.45:0/80877683 wait complete. 2023-11-28T18:38:48.943 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-28T18:38:35.406884+0000', 'modified': '2023-11-28T18:38:38.439497+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5253}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5253': {'gid': 5253, 'name': 'a', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.45:6834/2398964901', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.45:6832', 'nonce': 2398964901}, {'type': 'v1', 'addr': '172.21.15.45:6834', 'nonce': 2398964901}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-28T18:38:48.943 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-28T18:38:48.943 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-28T18:38:49.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.093+0000 7fb9f62ad640 1 Processor -- start 2023-11-28T18:38:49.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.093+0000 7fb9f62ad640 1 -- start start 2023-11-28T18:38:49.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.093+0000 7fb9f62ad640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fb9f00c84a0 0x7fb9f0161960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:49.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.093+0000 7fb9f62ad640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9f00c7000 con 0x7fb9f00cf950 2023-11-28T18:38:49.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.093+0000 7fb9f62ad640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9f00d08d0 con 0x7fb9f00d0440 2023-11-28T18:38:49.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.093+0000 7fb9f62ad640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9f00cf0a0 con 0x7fb9f00c84a0 2023-11-28T18:38:49.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.093+0000 7fb9f52ab640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fb9f00cf950 0x7fb9f00cfd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:60414/0 (socket says 172.21.15.45:60414) 2023-11-28T18:38:49.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.093+0000 7fb9f52ab640 1 -- 172.21.15.45:0/1339905344 learned_addr learned my addr 172.21.15.45:0/1339905344 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:38:49.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.093+0000 7fb9f5aac640 1 --2- 172.21.15.45:0/1339905344 >> v2:172.21.15.190:3300/0 conn(0x7fb9f00c84a0 0x7fb9f0161960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:49.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.093+0000 7fb9e7fff640 1 -- 172.21.15.45:0/1339905344 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2638837237 0 0) 0x7fb9f00c7000 con 0x7fb9f00cf950 2023-11-28T18:38:49.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.093+0000 7fb9e7fff640 1 -- 172.21.15.45:0/1339905344 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9dc003530 con 0x7fb9f00cf950 2023-11-28T18:38:49.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.093+0000 7fb9e7fff640 1 -- 172.21.15.45:0/1339905344 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2998896361 0 0) 0x7fb9f00d08d0 con 0x7fb9f00d0440 2023-11-28T18:38:49.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.093+0000 7fb9e7fff640 1 -- 172.21.15.45:0/1339905344 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9f00c7000 con 0x7fb9f00d0440 2023-11-28T18:38:49.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.093+0000 7fb9f5aac640 1 -- 172.21.15.45:0/1339905344 >> v1:172.21.15.190:6789/0 conn(0x7fb9f00d0440 legacy=0x7fb9f0161250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:49.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.093+0000 7fb9f5aac640 1 -- 172.21.15.45:0/1339905344 >> v1:172.21.15.45:6789/0 conn(0x7fb9f00cf950 legacy=0x7fb9f00cfd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:49.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.093+0000 7fb9f5aac640 1 -- 172.21.15.45:0/1339905344 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9f00ceae0 con 0x7fb9f00c84a0 2023-11-28T18:38:49.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.097+0000 7fb9f5aac640 1 --2- 172.21.15.45:0/1339905344 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb9f00c84a0 0x7fb9f0161960 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb9e8009df0 tx=0x7fb9e801c870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8a0cc3e2701d024 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:49.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.097+0000 7fb9e7fff640 1 -- 172.21.15.45:0/1339905344 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e80a5930 con 0x7fb9f00c84a0 2023-11-28T18:38:49.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.097+0000 7fb9e7fff640 1 -- 172.21.15.45:0/1339905344 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9e80a5a90 con 0x7fb9f00c84a0 2023-11-28T18:38:49.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.097+0000 7fb9e7fff640 1 -- 172.21.15.45:0/1339905344 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e80a5e20 con 0x7fb9f00c84a0 2023-11-28T18:38:49.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.097+0000 7fb9f62ad640 1 -- 172.21.15.45:0/1339905344 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb9f00c84a0 msgr2=0x7fb9f0161960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:49.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.097+0000 7fb9f62ad640 1 --2- 172.21.15.45:0/1339905344 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb9f00c84a0 0x7fb9f0161960 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb9e8009df0 tx=0x7fb9e801c870 comp rx=0 tx=0).stop 2023-11-28T18:38:49.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.097+0000 7fb9f62ad640 1 -- 172.21.15.45:0/1339905344 shutdown_connections 2023-11-28T18:38:49.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.097+0000 7fb9f62ad640 1 --2- 172.21.15.45:0/1339905344 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb9f00c84a0 0x7fb9f0161960 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:49.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.097+0000 7fb9f62ad640 1 -- 172.21.15.45:0/1339905344 >> 172.21.15.45:0/1339905344 conn(0x7fb9f00d2fa0 msgr2=0x7fb9f00d3380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:49.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.097+0000 7fb9f62ad640 1 -- 172.21.15.45:0/1339905344 shutdown_connections 2023-11-28T18:38:49.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.097+0000 7fb9f62ad640 1 -- 172.21.15.45:0/1339905344 wait complete. 2023-11-28T18:38:49.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.101+0000 7fb9f62ad640 1 Processor -- start 2023-11-28T18:38:49.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.101+0000 7fb9f62ad640 1 -- start start 2023-11-28T18:38:49.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.101+0000 7fb9f62ad640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb9f00c84a0 0x7fb9f013ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:49.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.101+0000 7fb9f62ad640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb9f00cf950 0x7fb9f015a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:49.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.101+0000 7fb9f62ad640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb9f00d0440 0x7fb9f01590b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:49.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.101+0000 7fb9f62ad640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f015bf30 con 0x7fb9f00d0440 2023-11-28T18:38:49.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.101+0000 7fb9f62ad640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f015c1d0 con 0x7fb9f00cf950 2023-11-28T18:38:49.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.101+0000 7fb9f62ad640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f015c4b0 con 0x7fb9f00c84a0 2023-11-28T18:38:49.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.101+0000 7fb9f5aac640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb9f00d0440 0x7fb9f01590b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:49.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.101+0000 7fb9f5aac640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb9f00d0440 0x7fb9f01590b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39510/0 (socket says 172.21.15.45:39510) 2023-11-28T18:38:49.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.101+0000 7fb9f5aac640 1 -- 172.21.15.45:0/3549266894 learned_addr learned my addr 172.21.15.45:0/3549266894 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:49.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.101+0000 7fb9f4aaa640 1 --2- 172.21.15.45:0/3549266894 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb9f00cf950 0x7fb9f015a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:49.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.101+0000 7fb9f52ab640 1 --2- 172.21.15.45:0/3549266894 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb9f00c84a0 0x7fb9f013ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:49.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.101+0000 7fb9f5aac640 1 -- 172.21.15.45:0/3549266894 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb9f00c84a0 msgr2=0x7fb9f013ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:49.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.101+0000 7fb9f5aac640 1 --2- 172.21.15.45:0/3549266894 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb9f00c84a0 0x7fb9f013ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:49.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.101+0000 7fb9f5aac640 1 -- 172.21.15.45:0/3549266894 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb9f00cf950 msgr2=0x7fb9f015a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:49.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.101+0000 7fb9f5aac640 1 --2- 172.21.15.45:0/3549266894 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb9f00cf950 0x7fb9f015a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:49.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.101+0000 7fb9f5aac640 1 -- 172.21.15.45:0/3549266894 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e8009a70 con 0x7fb9f00d0440 2023-11-28T18:38:49.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.101+0000 7fb9f52ab640 1 --2- 172.21.15.45:0/3549266894 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb9f00c84a0 0x7fb9f013ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:38:49.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.101+0000 7fb9f4aaa640 1 --2- 172.21.15.45:0/3549266894 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb9f00cf950 0x7fb9f015a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:38:49.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.101+0000 7fb9f5aac640 1 --2- 172.21.15.45:0/3549266894 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb9f00d0440 0x7fb9f01590b0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fb9e8019480 tx=0x7fb9e8019610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:49.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.101+0000 7fb9e5ffb640 1 -- 172.21.15.45:0/3549266894 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e80adcc0 con 0x7fb9f00d0440 2023-11-28T18:38:49.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.101+0000 7fb9e5ffb640 1 -- 172.21.15.45:0/3549266894 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9e80ade20 con 0x7fb9f00d0440 2023-11-28T18:38:49.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.101+0000 7fb9f62ad640 1 -- 172.21.15.45:0/3549266894 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9f015c790 con 0x7fb9f00d0440 2023-11-28T18:38:49.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.101+0000 7fb9e5ffb640 1 -- 172.21.15.45:0/3549266894 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e80b9690 con 0x7fb9f00d0440 2023-11-28T18:38:49.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.101+0000 7fb9f62ad640 1 -- 172.21.15.45:0/3549266894 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9f013f4c0 con 0x7fb9f00d0440 2023-11-28T18:38:49.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.105+0000 7fb9e5ffb640 1 -- 172.21.15.45:0/3549266894 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fb9e80b97f0 con 0x7fb9f00d0440 2023-11-28T18:38:49.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.105+0000 7fb9e5ffb640 1 --2- 172.21.15.45:0/3549266894 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fb9d40668d0 0x7fb9d4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:49.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.105+0000 7fb9e5ffb640 1 -- 172.21.15.45:0/3549266894 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb9e811fb50 con 0x7fb9f00d0440 2023-11-28T18:38:49.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.105+0000 7fb9fa88d000 1 Processor -- start 2023-11-28T18:38:49.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.105+0000 7fb9f52ab640 1 --2- 172.21.15.45:0/3549266894 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fb9d40668d0 0x7fb9d4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:49.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.105+0000 7fb9fa88d000 1 -- start start 2023-11-28T18:38:49.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.109+0000 7fb9f52ab640 1 --2- 172.21.15.45:0/3549266894 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fb9d40668d0 0x7fb9d4068d90 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec000f70 tx=0x7fb9ec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:49.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.109+0000 7fb9fa88d000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5589a9c69d30 0x5589a9c6a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:49.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.109+0000 7fb9fa88d000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5589a9c6a650 0x5589a9c1cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:49.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.109+0000 7fb9fa88d000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5589a9c1d500 0x5589a9c1d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:49.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.109+0000 7fb9fa88d000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589a9ae6110 con 0x5589a9c69d30 2023-11-28T18:38:49.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.109+0000 7fb9fa88d000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589a9a769a0 con 0x5589a9c1d500 2023-11-28T18:38:49.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.109+0000 7fb9fa88d000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x5589a9a73ed0 con 0x5589a9c6a650 2023-11-28T18:38:49.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.109+0000 7fb9f52ab640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5589a9c69d30 0x5589a9c6a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:49.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.109+0000 7fb9f52ab640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5589a9c69d30 0x5589a9c6a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39518/0 (socket says 172.21.15.45:39518) 2023-11-28T18:38:49.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.109+0000 7fb9f52ab640 1 -- 172.21.15.45:0/252553088 learned_addr learned my addr 172.21.15.45:0/252553088 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:49.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.109+0000 7fb9f4aaa640 1 --2- 172.21.15.45:0/252553088 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5589a9c6a650 0x5589a9c1cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:49.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.109+0000 7fb9f5aac640 1 --2- 172.21.15.45:0/252553088 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5589a9c1d500 0x5589a9c1d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:49.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.109+0000 7fb9f52ab640 1 -- 172.21.15.45:0/252553088 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5589a9c6a650 msgr2=0x5589a9c1cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:49.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.109+0000 7fb9f52ab640 1 --2- 172.21.15.45:0/252553088 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5589a9c6a650 0x5589a9c1cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:49.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.109+0000 7fb9f52ab640 1 -- 172.21.15.45:0/252553088 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5589a9c1d500 msgr2=0x5589a9c1d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:49.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.109+0000 7fb9f52ab640 1 --2- 172.21.15.45:0/252553088 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5589a9c1d500 0x5589a9c1d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:49.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.109+0000 7fb9f52ab640 1 -- 172.21.15.45:0/252553088 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5589a9767890 con 0x5589a9c69d30 2023-11-28T18:38:49.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.109+0000 7fb9f5aac640 1 --2- 172.21.15.45:0/252553088 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5589a9c1d500 0x5589a9c1d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:38:49.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.109+0000 7fb9f52ab640 1 --2- 172.21.15.45:0/252553088 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5589a9c69d30 0x5589a9c6a110 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec005950 tx=0x7fb9ec011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4452d2aa21f2799 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:49.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.109+0000 7fb9daffd640 1 -- 172.21.15.45:0/252553088 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec00e7b0 con 0x5589a9c69d30 2023-11-28T18:38:49.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.109+0000 7fb9daffd640 1 -- 172.21.15.45:0/252553088 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9ec00e910 con 0x5589a9c69d30 2023-11-28T18:38:49.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.109+0000 7fb9daffd640 1 -- 172.21.15.45:0/252553088 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec00ec80 con 0x5589a9c69d30 2023-11-28T18:38:49.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.109+0000 7fb9fa88d000 1 -- 172.21.15.45:0/252553088 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5589a9c69d30 msgr2=0x5589a9c6a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:49.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.109+0000 7fb9fa88d000 1 --2- 172.21.15.45:0/252553088 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5589a9c69d30 0x5589a9c6a110 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec005950 tx=0x7fb9ec011000 comp rx=0 tx=0).stop 2023-11-28T18:38:49.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.109+0000 7fb9fa88d000 1 -- 172.21.15.45:0/252553088 shutdown_connections 2023-11-28T18:38:49.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.109+0000 7fb9fa88d000 1 --2- 172.21.15.45:0/252553088 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5589a9c1d500 0x5589a9c1d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:49.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.109+0000 7fb9fa88d000 1 --2- 172.21.15.45:0/252553088 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5589a9c6a650 0x5589a9c1cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:49.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.109+0000 7fb9fa88d000 1 --2- 172.21.15.45:0/252553088 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5589a9c69d30 0x5589a9c6a110 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:49.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.109+0000 7fb9fa88d000 1 -- 172.21.15.45:0/252553088 >> 172.21.15.45:0/252553088 conn(0x5589a9c4a8c0 msgr2=0x5589a9c4ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:49.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.109+0000 7fb9fa88d000 1 -- 172.21.15.45:0/252553088 shutdown_connections 2023-11-28T18:38:49.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.109+0000 7fb9fa88d000 1 -- 172.21.15.45:0/252553088 wait complete. 2023-11-28T18:38:49.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.109+0000 7fb9fa88d000 1 -- start start 2023-11-28T18:38:49.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.109+0000 7fb9fa88d000 1 Processor -- start 2023-11-28T18:38:49.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.113+0000 7fb9fa88d000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5589a9c1d500 0x5589a9c234e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:49.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.113+0000 7fb9fa88d000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5589a9c69d30 0x5589a9c23a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:49.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.113+0000 7fb9fa88d000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5589a9c6a650 0x5589a9c23f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:49.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.113+0000 7fb9fa88d000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589a9a6f7c0 con 0x5589a9c6a650 2023-11-28T18:38:49.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.113+0000 7fb9fa88d000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589a9a27bf0 con 0x5589a9c69d30 2023-11-28T18:38:49.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.113+0000 7fb9fa88d000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x5589a9a2da90 con 0x5589a9c1d500 2023-11-28T18:38:49.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.113+0000 7fb9fa88d000 10 client.0 _ll_register_callbacks cb 0x5589a9c0ae20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T18:38:49.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.113+0000 7fb9f5aac640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5589a9c6a650 0x5589a9c23f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:49.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.113+0000 7fb9f5aac640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5589a9c6a650 0x5589a9c23f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39532/0 (socket says 172.21.15.45:39532) 2023-11-28T18:38:49.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.113+0000 7fb9f5aac640 1 -- 172.21.15.45:0/3546706622 learned_addr learned my addr 172.21.15.45:0/3546706622 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:49.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.113+0000 7fb9f5aac640 1 -- 172.21.15.45:0/3546706622 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5589a9c1d500 msgr2=0x5589a9c234e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:49.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.113+0000 7fb9f5aac640 1 --2- 172.21.15.45:0/3546706622 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5589a9c1d500 0x5589a9c234e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:49.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.113+0000 7fb9f4aaa640 1 --2- 172.21.15.45:0/3546706622 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5589a9c69d30 0x5589a9c23a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:49.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.113+0000 7fb9f5aac640 1 -- 172.21.15.45:0/3546706622 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5589a9c69d30 msgr2=0x5589a9c23a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:49.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.113+0000 7fb9f5aac640 1 --2- 172.21.15.45:0/3546706622 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5589a9c69d30 0x5589a9c23a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:49.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.113+0000 7fb9f5aac640 1 -- 172.21.15.45:0/3546706622 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9f013f4c0 con 0x5589a9c6a650 2023-11-28T18:38:49.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.113+0000 7fb9f4aaa640 1 --2- 172.21.15.45:0/3546706622 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5589a9c69d30 0x5589a9c23a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:38:49.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.113+0000 7fb9f5aac640 1 --2- 172.21.15.45:0/3546706622 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5589a9c6a650 0x5589a9c23f60 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fb9e80ece60 tx=0x7fb9e80c93c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b079c1ab5175b5f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:49.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.113+0000 7fb9cffff640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-11-28T18:38:49.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.113+0000 7fb9cffff640 1 -- 172.21.15.45:0/3546706622 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e80f4b00 con 0x5589a9c6a650 2023-11-28T18:38:49.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.113+0000 7fb9cffff640 1 -- 172.21.15.45:0/3546706622 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb9e80f8cb0 con 0x5589a9c6a650 2023-11-28T18:38:49.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.113+0000 7fb9fa88d000 1 -- 172.21.15.45:0/3546706622 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5589a9a31470 con 0x5589a9c6a650 2023-11-28T18:38:49.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.113+0000 7fb9cffff640 1 -- 172.21.15.45:0/3546706622 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb9e80f0c10 con 0x5589a9c6a650 2023-11-28T18:38:49.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.113+0000 7fb9fa88d000 10 client.5469 fetch_fsmap learned FSMap version 16 2023-11-28T18:38:49.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.113+0000 7fb9fa88d000 1 -- 172.21.15.45:0/3546706622 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x7fb9ec00f040 con 0x5589a9c6a650 2023-11-28T18:38:49.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.113+0000 7fb9cffff640 1 -- 172.21.15.45:0/3546706622 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5589a9a31470 con 0x5589a9c6a650 2023-11-28T18:38:49.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.113+0000 7fb9cffff640 1 -- 172.21.15.45:0/3546706622 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 16) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fb9e8005d20 con 0x5589a9c6a650 2023-11-28T18:38:49.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.113+0000 7fb9fa88d000 10 client.5469 fetch_fsmap finished waiting for FSMap version 16 2023-11-28T18:38:49.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.113+0000 7fb9fa88d000 10 client.5469 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-28T18:38:49.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.113+0000 7fb9fa88d000 20 client.5469 populate_metadata read hostname 'smithi045' 2023-11-28T18:38:49.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.113+0000 7fb9fa88d000 1 --2- 172.21.15.45:0/3546706622 >> [v2:172.21.15.45:6832/2398964901,v1:172.21.15.45:6834/2398964901] conn(0x5589a9c24970 0x5589a9c7bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:49.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.113+0000 7fb9fa88d000 4 client.5469 mds_command: new command op to 5253 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-28T18:38:49.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.113+0000 7fb9fa88d000 1 -- 172.21.15.45:0/3546706622 --> [v2:172.21.15.45:6832/2398964901,v1:172.21.15.45:6834/2398964901] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5589a9a34b50 con 0x5589a9c24970 2023-11-28T18:38:49.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.113+0000 7fb9f52ab640 1 --2- 172.21.15.45:0/3546706622 >> [v2:172.21.15.45:6832/2398964901,v1:172.21.15.45:6834/2398964901] conn(0x5589a9c24970 0x5589a9c7bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:49.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.113+0000 7fb9f52ab640 1 --2- 172.21.15.45:0/3546706622 >> [v2:172.21.15.45:6832/2398964901,v1:172.21.15.45:6834/2398964901] conn(0x5589a9c24970 0x5589a9c7bff0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a413d17d91f3d1c server_cookie=7d53503bdc25ae24 in_seq=0 out_seq=0 2023-11-28T18:38:49.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.113+0000 7fb9cffff640 10 client.5469 ms_handle_connect on v2:172.21.15.45:6832/2398964901 2023-11-28T18:38:49.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.117+0000 7fb9cffff640 1 -- 172.21.15.45:0/3546706622 <== mds.0 v2:172.21.15.45:6832/2398964901 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5589a9a34b50 con 0x5589a9c24970 2023-11-28T18:38:49.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.117+0000 7fb9cffff640 10 client.5469 handle_command_reply: tid=0 2023-11-28T18:38:49.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.117+0000 7fb9fa88d000 1 client.5469 shutdown 2023-11-28T18:38:49.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.117+0000 7fb9fa88d000 1 -- 172.21.15.45:0/3546706622 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5589a9c6a650 msgr2=0x5589a9c23f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:49.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.117+0000 7fb9fa88d000 1 --2- 172.21.15.45:0/3546706622 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5589a9c6a650 0x5589a9c23f60 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fb9e80ece60 tx=0x7fb9e80c93c0 comp rx=0 tx=0).stop 2023-11-28T18:38:49.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.117+0000 7fb9fa88d000 1 -- 172.21.15.45:0/3546706622 shutdown_connections 2023-11-28T18:38:49.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.117+0000 7fb9fa88d000 1 --2- 172.21.15.45:0/3546706622 >> [v2:172.21.15.45:6832/2398964901,v1:172.21.15.45:6834/2398964901] conn(0x5589a9c24970 0x5589a9c7bff0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:49.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.117+0000 7fb9fa88d000 1 --2- 172.21.15.45:0/3546706622 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5589a9c6a650 0x5589a9c23f60 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:49.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.117+0000 7fb9fa88d000 1 --2- 172.21.15.45:0/3546706622 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5589a9c69d30 0x5589a9c23a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:49.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.117+0000 7fb9fa88d000 1 --2- 172.21.15.45:0/3546706622 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5589a9c1d500 0x5589a9c234e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:49.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.117+0000 7fb9cffff640 0 client.5469 ms_handle_reset on v2:172.21.15.45:6832/2398964901 2023-11-28T18:38:49.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.117+0000 7fb9fa88d000 1 -- 172.21.15.45:0/3546706622 >> 172.21.15.45:0/3546706622 conn(0x5589a9c4a8c0 msgr2=0x5589a9c1c6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:49.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.117+0000 7fb9fa88d000 1 -- 172.21.15.45:0/3546706622 shutdown_connections 2023-11-28T18:38:49.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.117+0000 7fb9fa88d000 1 -- 172.21.15.45:0/3546706622 wait complete. 2023-11-28T18:38:49.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.117+0000 7fb9fa88d000 20 client.5469 trim_cache size 0 max 16384 2023-11-28T18:38:49.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.133+0000 7fb9fa88d000 1 Processor -- start 2023-11-28T18:38:49.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.133+0000 7fb9fa88d000 1 -- start start 2023-11-28T18:38:49.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.133+0000 7fb9fa88d000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5589a9c1d500 0x5589a9c493a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:49.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.133+0000 7fb9fa88d000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5589a9c69d30 0x5589a9c498e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:49.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.133+0000 7fb9fa88d000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5589a9c6a650 0x5589a9c7bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:49.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.133+0000 7fb9fa88d000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589a9728940 con 0x5589a9c6a650 2023-11-28T18:38:49.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.133+0000 7fb9fa88d000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589a9c17430 con 0x5589a9c69d30 2023-11-28T18:38:49.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.133+0000 7fb9fa88d000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x5589a9c20dd0 con 0x5589a9c1d500 2023-11-28T18:38:49.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.133+0000 7fb9f5aac640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5589a9c6a650 0x5589a9c7bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:49.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.133+0000 7fb9f5aac640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5589a9c6a650 0x5589a9c7bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39536/0 (socket says 172.21.15.45:39536) 2023-11-28T18:38:49.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.133+0000 7fb9f5aac640 1 -- 172.21.15.45:0/3346489635 learned_addr learned my addr 172.21.15.45:0/3346489635 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:49.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.133+0000 7fb9f5aac640 1 -- 172.21.15.45:0/3346489635 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5589a9c1d500 msgr2=0x5589a9c493a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:49.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.133+0000 7fb9f52ab640 1 --2- 172.21.15.45:0/3346489635 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5589a9c1d500 0x5589a9c493a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:49.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.133+0000 7fb9f4aaa640 1 --2- 172.21.15.45:0/3346489635 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5589a9c69d30 0x5589a9c498e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:49.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.133+0000 7fb9f5aac640 1 --2- 172.21.15.45:0/3346489635 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5589a9c1d500 0x5589a9c493a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:49.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.133+0000 7fb9f5aac640 1 -- 172.21.15.45:0/3346489635 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5589a9c69d30 msgr2=0x5589a9c498e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:49.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.133+0000 7fb9f5aac640 1 --2- 172.21.15.45:0/3346489635 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5589a9c69d30 0x5589a9c498e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:49.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.133+0000 7fb9f5aac640 1 -- 172.21.15.45:0/3346489635 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5589a9c1d370 con 0x5589a9c6a650 2023-11-28T18:38:49.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.133+0000 7fb9f52ab640 1 --2- 172.21.15.45:0/3346489635 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5589a9c1d500 0x5589a9c493a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:38:49.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.133+0000 7fb9f4aaa640 1 --2- 172.21.15.45:0/3346489635 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5589a9c69d30 0x5589a9c498e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:38:49.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.133+0000 7fb9f5aac640 1 --2- 172.21.15.45:0/3346489635 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5589a9c6a650 0x5589a9c7bff0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fb9e801a4a0 tx=0x7fb9e80c3000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6590fd5c8d9142aa server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:49.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.133+0000 7fb9db7fe640 1 -- 172.21.15.45:0/3346489635 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e80f4b00 con 0x5589a9c6a650 2023-11-28T18:38:49.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.133+0000 7fb9db7fe640 1 -- 172.21.15.45:0/3346489635 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9e80f04f0 con 0x5589a9c6a650 2023-11-28T18:38:49.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.133+0000 7fb9db7fe640 1 -- 172.21.15.45:0/3346489635 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e80f8cb0 con 0x5589a9c6a650 2023-11-28T18:38:49.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.133+0000 7fb9fa88d000 1 -- 172.21.15.45:0/3346489635 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5589a9c6a650 msgr2=0x5589a9c7bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:49.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.133+0000 7fb9fa88d000 1 --2- 172.21.15.45:0/3346489635 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5589a9c6a650 0x5589a9c7bff0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fb9e801a4a0 tx=0x7fb9e80c3000 comp rx=0 tx=0).stop 2023-11-28T18:38:49.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.133+0000 7fb9fa88d000 1 -- 172.21.15.45:0/3346489635 shutdown_connections 2023-11-28T18:38:49.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.133+0000 7fb9fa88d000 1 --2- 172.21.15.45:0/3346489635 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5589a9c6a650 0x5589a9c7bff0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:49.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.133+0000 7fb9fa88d000 1 --2- 172.21.15.45:0/3346489635 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5589a9c69d30 0x5589a9c498e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:49.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.133+0000 7fb9fa88d000 1 --2- 172.21.15.45:0/3346489635 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5589a9c1d500 0x5589a9c493a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:49.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.133+0000 7fb9fa88d000 1 -- 172.21.15.45:0/3346489635 >> 172.21.15.45:0/3346489635 conn(0x5589a9c4a8c0 msgr2=0x5589a9c1b720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:49.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.133+0000 7fb9fa88d000 1 -- 172.21.15.45:0/3346489635 shutdown_connections 2023-11-28T18:38:49.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.133+0000 7fb9fa88d000 1 -- 172.21.15.45:0/3346489635 wait complete. 2023-11-28T18:38:49.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.133+0000 7fb9fa88d000 1 -- start start 2023-11-28T18:38:49.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.133+0000 7fb9fa88d000 1 Processor -- start 2023-11-28T18:38:49.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.137+0000 7fb9fa88d000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5589a9c1d500 0x5589a9cca810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:49.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.137+0000 7fb9fa88d000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5589a9c69d30 0x5589a9ccad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:49.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.137+0000 7fb9fa88d000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5589a9c6a650 0x5589a9c85a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:49.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.137+0000 7fb9fa88d000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589a97681b0 con 0x5589a9c6a650 2023-11-28T18:38:49.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.137+0000 7fb9fa88d000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589a9ab0440 con 0x5589a9c1d500 2023-11-28T18:38:49.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.137+0000 7fb9fa88d000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x5589a9c20dd0 con 0x5589a9c69d30 2023-11-28T18:38:49.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.137+0000 7fb9fa88d000 10 client.0 _ll_register_callbacks cb 0x5589a9ae6060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T18:38:49.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.137+0000 7fb9f5aac640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5589a9c6a650 0x5589a9c85a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:49.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.137+0000 7fb9f5aac640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5589a9c6a650 0x5589a9c85a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39548/0 (socket says 172.21.15.45:39548) 2023-11-28T18:38:49.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.137+0000 7fb9f5aac640 1 -- 172.21.15.45:0/3360501825 learned_addr learned my addr 172.21.15.45:0/3360501825 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:49.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.137+0000 7fb9f4aaa640 1 --2- 172.21.15.45:0/3360501825 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5589a9c69d30 0x5589a9ccad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:49.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.137+0000 7fb9f52ab640 1 --2- 172.21.15.45:0/3360501825 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5589a9c1d500 0x5589a9cca810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:49.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.137+0000 7fb9f5aac640 1 -- 172.21.15.45:0/3360501825 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5589a9c69d30 msgr2=0x5589a9ccad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:49.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.137+0000 7fb9f5aac640 1 --2- 172.21.15.45:0/3360501825 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5589a9c69d30 0x5589a9ccad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:49.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.137+0000 7fb9f5aac640 1 -- 172.21.15.45:0/3360501825 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5589a9c1d500 msgr2=0x5589a9cca810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:49.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.137+0000 7fb9f5aac640 1 --2- 172.21.15.45:0/3360501825 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5589a9c1d500 0x5589a9cca810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:49.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.137+0000 7fb9f5aac640 1 -- 172.21.15.45:0/3360501825 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9ec00f040 con 0x5589a9c6a650 2023-11-28T18:38:49.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.137+0000 7fb9f52ab640 1 --2- 172.21.15.45:0/3360501825 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5589a9c1d500 0x5589a9cca810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:38:49.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.137+0000 7fb9f4aaa640 1 --2- 172.21.15.45:0/3360501825 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5589a9c69d30 0x5589a9ccad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:38:49.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.137+0000 7fb9f5aac640 1 --2- 172.21.15.45:0/3360501825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5589a9c6a650 0x5589a9c85a70 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fb9e80eceb0 tx=0x7fb9e811deb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb800002b3055dfb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:49.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.137+0000 7fb9cffff640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-11-28T18:38:49.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.137+0000 7fb9cffff640 1 -- 172.21.15.45:0/3360501825 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e80f8a20 con 0x5589a9c6a650 2023-11-28T18:38:49.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.137+0000 7fb9cffff640 1 -- 172.21.15.45:0/3360501825 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb9e80ec7a0 con 0x5589a9c6a650 2023-11-28T18:38:49.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.137+0000 7fb9fa88d000 1 -- 172.21.15.45:0/3360501825 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5589a9a6e110 con 0x5589a9c6a650 2023-11-28T18:38:49.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.137+0000 7fb9cffff640 1 -- 172.21.15.45:0/3360501825 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb9e80f0130 con 0x5589a9c6a650 2023-11-28T18:38:49.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.137+0000 7fb9fa88d000 10 client.5475 fetch_fsmap learned FSMap version 16 2023-11-28T18:38:49.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.137+0000 7fb9fa88d000 1 -- 172.21.15.45:0/3360501825 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x5589a9a30190 con 0x5589a9c6a650 2023-11-28T18:38:49.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.137+0000 7fb9cffff640 1 -- 172.21.15.45:0/3360501825 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5589a9a6e110 con 0x5589a9c6a650 2023-11-28T18:38:49.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.137+0000 7fb9cffff640 1 -- 172.21.15.45:0/3360501825 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 16) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fb9e8005d20 con 0x5589a9c6a650 2023-11-28T18:38:49.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.137+0000 7fb9fa88d000 10 client.5475 fetch_fsmap finished waiting for FSMap version 16 2023-11-28T18:38:49.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.137+0000 7fb9fa88d000 10 client.5475 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-28T18:38:49.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.137+0000 7fb9fa88d000 20 client.5475 populate_metadata read hostname 'smithi045' 2023-11-28T18:38:49.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.137+0000 7fb9fa88d000 1 --2- 172.21.15.45:0/3360501825 >> [v2:172.21.15.45:6832/2398964901,v1:172.21.15.45:6834/2398964901] conn(0x5589a9c863d0 0x5589a9c867b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:49.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.137+0000 7fb9fa88d000 4 client.5475 mds_command: new command op to 5253 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-28T18:38:49.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.137+0000 7fb9fa88d000 1 -- 172.21.15.45:0/3360501825 --> [v2:172.21.15.45:6832/2398964901,v1:172.21.15.45:6834/2398964901] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5589a9a9c650 con 0x5589a9c863d0 2023-11-28T18:38:49.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.137+0000 7fb9f52ab640 1 --2- 172.21.15.45:0/3360501825 >> [v2:172.21.15.45:6832/2398964901,v1:172.21.15.45:6834/2398964901] conn(0x5589a9c863d0 0x5589a9c867b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:49.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.137+0000 7fb9f52ab640 1 --2- 172.21.15.45:0/3360501825 >> [v2:172.21.15.45:6832/2398964901,v1:172.21.15.45:6834/2398964901] conn(0x5589a9c863d0 0x5589a9c867b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a9c64b3d8bde70a server_cookie=e0e8d57c288fe2ae in_seq=0 out_seq=0 2023-11-28T18:38:49.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.137+0000 7fb9cffff640 10 client.5475 ms_handle_connect on v2:172.21.15.45:6832/2398964901 2023-11-28T18:38:49.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.137+0000 7fb9cffff640 1 -- 172.21.15.45:0/3360501825 <== mds.0 v2:172.21.15.45:6832/2398964901 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x5589a9a9c650 con 0x5589a9c863d0 2023-11-28T18:38:49.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.137+0000 7fb9cffff640 10 client.5475 handle_command_reply: tid=0 2023-11-28T18:38:49.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.137+0000 7fb9fa88d000 1 client.5475 shutdown 2023-11-28T18:38:49.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.137+0000 7fb9fa88d000 1 -- 172.21.15.45:0/3360501825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5589a9c6a650 msgr2=0x5589a9c85a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:49.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.137+0000 7fb9fa88d000 1 --2- 172.21.15.45:0/3360501825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5589a9c6a650 0x5589a9c85a70 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fb9e80eceb0 tx=0x7fb9e811deb0 comp rx=0 tx=0).stop 2023-11-28T18:38:49.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.141+0000 7fb9fa88d000 1 -- 172.21.15.45:0/3360501825 shutdown_connections 2023-11-28T18:38:49.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.141+0000 7fb9fa88d000 1 --2- 172.21.15.45:0/3360501825 >> [v2:172.21.15.45:6832/2398964901,v1:172.21.15.45:6834/2398964901] conn(0x5589a9c863d0 0x5589a9c867b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:49.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.141+0000 7fb9fa88d000 1 --2- 172.21.15.45:0/3360501825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5589a9c6a650 0x5589a9c85a70 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:49.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.141+0000 7fb9fa88d000 1 --2- 172.21.15.45:0/3360501825 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5589a9c69d30 0x5589a9ccad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:49.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.141+0000 7fb9cffff640 0 client.5475 ms_handle_reset on v2:172.21.15.45:6832/2398964901 2023-11-28T18:38:49.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.141+0000 7fb9fa88d000 1 --2- 172.21.15.45:0/3360501825 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5589a9c1d500 0x5589a9cca810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:49.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.141+0000 7fb9fa88d000 1 -- 172.21.15.45:0/3360501825 >> 172.21.15.45:0/3360501825 conn(0x5589a9c4a8c0 msgr2=0x5589a9c1bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:49.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.141+0000 7fb9fa88d000 1 -- 172.21.15.45:0/3360501825 shutdown_connections 2023-11-28T18:38:49.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.141+0000 7fb9fa88d000 1 -- 172.21.15.45:0/3360501825 wait complete. 2023-11-28T18:38:49.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.141+0000 7fb9fa88d000 20 client.5475 trim_cache size 0 max 16384 2023-11-28T18:38:49.148 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-11-28T18:38:49.148 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_fsid": "d10f5cd6-1d00-4019-99b6-6fa435498a15", 2023-11-28T18:38:49.148 INFO:teuthology.orchestra.run.smithi045.stdout: "whoami": 0, 2023-11-28T18:38:49.148 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 5253, 2023-11-28T18:38:49.148 INFO:teuthology.orchestra.run.smithi045.stdout: "want_state": "up:active", 2023-11-28T18:38:49.148 INFO:teuthology.orchestra.run.smithi045.stdout: "state": "up:active", 2023-11-28T18:38:49.148 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs", 2023-11-28T18:38:49.148 INFO:teuthology.orchestra.run.smithi045.stdout: "rank_uptime": 13.104378361, 2023-11-28T18:38:49.148 INFO:teuthology.orchestra.run.smithi045.stdout: "mdsmap_epoch": 16, 2023-11-28T18:38:49.148 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch": 34, 2023-11-28T18:38:49.149 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch_barrier": 34, 2023-11-28T18:38:49.149 INFO:teuthology.orchestra.run.smithi045.stdout: "uptime": 21.709738557000001 2023-11-28T18:38:49.149 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-11-28T18:38:49.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.141+0000 7fb9f62ad640 1 -- 172.21.15.45:0/3549266894 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fb9d40668d0 msgr2=0x7fb9d4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:49.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.141+0000 7fb9f62ad640 1 --2- 172.21.15.45:0/3549266894 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fb9d40668d0 0x7fb9d4068d90 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec000f70 tx=0x7fb9ec009040 comp rx=0 tx=0).stop 2023-11-28T18:38:49.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.141+0000 7fb9f62ad640 1 -- 172.21.15.45:0/3549266894 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb9f00d0440 msgr2=0x7fb9f01590b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:49.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.141+0000 7fb9f62ad640 1 --2- 172.21.15.45:0/3549266894 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb9f00d0440 0x7fb9f01590b0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fb9e8019480 tx=0x7fb9e8019610 comp rx=0 tx=0).stop 2023-11-28T18:38:49.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.141+0000 7fb9f62ad640 1 -- 172.21.15.45:0/3549266894 shutdown_connections 2023-11-28T18:38:49.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.141+0000 7fb9f62ad640 1 --2- 172.21.15.45:0/3549266894 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fb9d40668d0 0x7fb9d4068d90 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:49.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.141+0000 7fb9f62ad640 1 --2- 172.21.15.45:0/3549266894 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb9f00d0440 0x7fb9f01590b0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:49.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.141+0000 7fb9f62ad640 1 --2- 172.21.15.45:0/3549266894 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb9f00cf950 0x7fb9f015a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:49.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.141+0000 7fb9f62ad640 1 --2- 172.21.15.45:0/3549266894 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb9f00c84a0 0x7fb9f013ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:49.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.141+0000 7fb9f62ad640 1 -- 172.21.15.45:0/3549266894 >> 172.21.15.45:0/3549266894 conn(0x7fb9f00d2fa0 msgr2=0x7fb9f00b7dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:49.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.141+0000 7fb9f62ad640 1 -- 172.21.15.45:0/3549266894 shutdown_connections 2023-11-28T18:38:49.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.141+0000 7fb9f62ad640 1 -- 172.21.15.45:0/3549266894 wait complete. 2023-11-28T18:38:49.163 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T18:38:49.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.305+0000 7f9fbdb1d640 1 Processor -- start 2023-11-28T18:38:49.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.305+0000 7f9fbdb1d640 1 -- start start 2023-11-28T18:38:49.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.305+0000 7f9fbdb1d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9fb80d2be0 0x7f9fb80cde30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:49.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.305+0000 7f9fbdb1d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f9fb80ce370 0x7f9fb80b61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:49.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.305+0000 7f9fbdb1d640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fb80b2a30 con 0x7f9fb815d240 2023-11-28T18:38:49.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.305+0000 7f9fbdb1d640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fb80d3020 con 0x7f9fb80ce370 2023-11-28T18:38:49.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.305+0000 7f9fbdb1d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb80d18b0 con 0x7f9fb80d2be0 2023-11-28T18:38:49.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.305+0000 7f9fb6ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9fb80d2be0 0x7f9fb80cde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:49.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.305+0000 7f9fb7fff640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f9fb80ce370 0x7f9fb80b61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:49.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.305+0000 7f9fb7fff640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f9fb80ce370 0x7f9fb80b61d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.45:58070/0 (socket says 172.21.15.45:58070) 2023-11-28T18:38:49.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.305+0000 7f9fb77fe640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f9fb815d240 0x7f9fb80d11a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.45:55906/0 (socket says 172.21.15.45:55906) 2023-11-28T18:38:49.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.305+0000 7f9fb7fff640 1 -- 172.21.15.45:0/533250998 learned_addr learned my addr 172.21.15.45:0/533250998 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:49.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.305+0000 7f9fb6ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9fb80d2be0 0x7f9fb80cde30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.45:50356/0 (socket says 172.21.15.45:50356) 2023-11-28T18:38:49.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.305+0000 7f9fb6ffd640 1 -- 172.21.15.45:0/533250998 >> v2:172.21.15.190:3300/0 conn(0x7f9fb80ce370 msgr2=0x7f9fb80b61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:49.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.305+0000 7f9fb6ffd640 1 --2- 172.21.15.45:0/533250998 >> v2:172.21.15.190:3300/0 conn(0x7f9fb80ce370 0x7f9fb80b61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:49.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.305+0000 7f9fb6ffd640 1 -- 172.21.15.45:0/533250998 >> v1:172.21.15.190:6789/0 conn(0x7f9fb815d240 legacy=0x7f9fb80d11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:49.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.305+0000 7f9fb6ffd640 1 -- 172.21.15.45:0/533250998 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fb80ce7e0 con 0x7f9fb80d2be0 2023-11-28T18:38:49.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.305+0000 7f9fb7fff640 1 --2- 172.21.15.45:0/533250998 >> v2:172.21.15.190:3300/0 conn(0x7f9fb80ce370 0x7f9fb80b61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:38:49.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.309+0000 7f9fb6ffd640 1 --2- 172.21.15.45:0/533250998 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9fb80d2be0 0x7f9fb80cde30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9fac0097c0 tx=0x7f9fac01ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd2523fe6e2b1665 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:49.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.309+0000 7f9fb67fc640 1 -- 172.21.15.45:0/533250998 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fac0a8970 con 0x7f9fb80d2be0 2023-11-28T18:38:49.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.309+0000 7f9fb67fc640 1 -- 172.21.15.45:0/533250998 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fac0a8ad0 con 0x7f9fb80d2be0 2023-11-28T18:38:49.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.309+0000 7f9fb67fc640 1 -- 172.21.15.45:0/533250998 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fac0a8e60 con 0x7f9fb80d2be0 2023-11-28T18:38:49.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.309+0000 7f9fbdb1d640 1 -- 172.21.15.45:0/533250998 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9fb80d2be0 msgr2=0x7f9fb80cde30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:49.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.309+0000 7f9fbdb1d640 1 --2- 172.21.15.45:0/533250998 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9fb80d2be0 0x7f9fb80cde30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9fac0097c0 tx=0x7f9fac01ec70 comp rx=0 tx=0).stop 2023-11-28T18:38:49.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.309+0000 7f9fbdb1d640 1 -- 172.21.15.45:0/533250998 shutdown_connections 2023-11-28T18:38:49.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.309+0000 7f9fbdb1d640 1 --2- 172.21.15.45:0/533250998 >> v2:172.21.15.190:3300/0 conn(0x7f9fb80ce370 0x7f9fb80b61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:49.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.309+0000 7f9fbdb1d640 1 --2- 172.21.15.45:0/533250998 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9fb80d2be0 0x7f9fb80cde30 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:49.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.309+0000 7f9fbdb1d640 1 -- 172.21.15.45:0/533250998 >> 172.21.15.45:0/533250998 conn(0x7f9fb80722a0 msgr2=0x7f9fb80cfbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:49.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.309+0000 7f9fbdb1d640 1 -- 172.21.15.45:0/533250998 shutdown_connections 2023-11-28T18:38:49.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.309+0000 7f9fbdb1d640 1 -- 172.21.15.45:0/533250998 wait complete. 2023-11-28T18:38:49.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.313+0000 7f9fbdb1d640 1 Processor -- start 2023-11-28T18:38:49.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.313+0000 7f9fbdb1d640 1 -- start start 2023-11-28T18:38:49.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.313+0000 7f9fbdb1d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9fb80ce370 0x7f9fb8156e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:49.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.313+0000 7f9fbdb1d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fb80d2be0 0x7f9fb80c9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:49.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.313+0000 7f9fbdb1d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9fb815d240 0x7f9fb815f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:49.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.313+0000 7f9fbdb1d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb80ca230 con 0x7f9fb80d2be0 2023-11-28T18:38:49.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.313+0000 7f9fbdb1d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb80ca510 con 0x7f9fb815d240 2023-11-28T18:38:49.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.313+0000 7f9fbdb1d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb80ca7f0 con 0x7f9fb80ce370 2023-11-28T18:38:49.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.313+0000 7f9fb6ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fb80d2be0 0x7f9fb80c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:49.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.313+0000 7f9fb6ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fb80d2be0 0x7f9fb80c9040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39562/0 (socket says 172.21.15.45:39562) 2023-11-28T18:38:49.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.313+0000 7f9fb6ffd640 1 -- 172.21.15.45:0/2908047460 learned_addr learned my addr 172.21.15.45:0/2908047460 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:49.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.313+0000 7f9fb77fe640 1 --2- 172.21.15.45:0/2908047460 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9fb80ce370 0x7f9fb8156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:49.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.313+0000 7f9fb7fff640 1 --2- 172.21.15.45:0/2908047460 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9fb815d240 0x7f9fb815f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:49.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.313+0000 7f9fb6ffd640 1 -- 172.21.15.45:0/2908047460 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9fb80ce370 msgr2=0x7f9fb8156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:49.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.313+0000 7f9fb6ffd640 1 --2- 172.21.15.45:0/2908047460 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9fb80ce370 0x7f9fb8156e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:49.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.313+0000 7f9fb6ffd640 1 -- 172.21.15.45:0/2908047460 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9fb815d240 msgr2=0x7f9fb815f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:49.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.313+0000 7f9fb6ffd640 1 --2- 172.21.15.45:0/2908047460 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9fb815d240 0x7f9fb815f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:49.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.313+0000 7f9fb6ffd640 1 -- 172.21.15.45:0/2908047460 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fb0009b30 con 0x7f9fb80d2be0 2023-11-28T18:38:49.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.313+0000 7f9fb77fe640 1 --2- 172.21.15.45:0/2908047460 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9fb80ce370 0x7f9fb8156e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:38:49.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.313+0000 7f9fb6ffd640 1 --2- 172.21.15.45:0/2908047460 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fb80d2be0 0x7f9fb80c9040 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f9fac0b3040 tx=0x7f9fac01ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:49.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.313+0000 7f9f9ffff640 1 -- 172.21.15.45:0/2908047460 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fac0b9630 con 0x7f9fb80d2be0 2023-11-28T18:38:49.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.313+0000 7f9f9ffff640 1 -- 172.21.15.45:0/2908047460 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fac0b97b0 con 0x7f9fb80d2be0 2023-11-28T18:38:49.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.313+0000 7f9f9ffff640 1 -- 172.21.15.45:0/2908047460 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fac0b9b60 con 0x7f9fb80d2be0 2023-11-28T18:38:49.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.313+0000 7f9fbdb1d640 1 -- 172.21.15.45:0/2908047460 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fac009420 con 0x7f9fb80d2be0 2023-11-28T18:38:49.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.313+0000 7f9fbdb1d640 1 -- 172.21.15.45:0/2908047460 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fb80cadb0 con 0x7f9fb80d2be0 2023-11-28T18:38:49.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.313+0000 7f9fbdb1d640 1 -- 172.21.15.45:0/2908047460 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fb80cafa0 con 0x7f9fb80d2be0 2023-11-28T18:38:49.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.317+0000 7f9f9ffff640 1 -- 172.21.15.45:0/2908047460 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f9fac0b7040 con 0x7f9fb80d2be0 2023-11-28T18:38:49.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.317+0000 7f9f9ffff640 1 --2- 172.21.15.45:0/2908047460 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9fa40668d0 0x7f9fa4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:49.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.317+0000 7f9f9ffff640 1 -- 172.21.15.45:0/2908047460 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9fac1223f0 con 0x7f9fb80d2be0 2023-11-28T18:38:49.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.317+0000 7f9fb77fe640 1 --2- 172.21.15.45:0/2908047460 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9fa40668d0 0x7f9fa4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:49.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.317+0000 7f9fb77fe640 1 --2- 172.21.15.45:0/2908047460 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9fa40668d0 0x7f9fa4068d90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9fa8000f70 tx=0x7f9fa8007d50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:49.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.321+0000 7f9f9ffff640 1 -- 172.21.15.45:0/2908047460 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9fac0ef6b0 con 0x7f9fb80d2be0 2023-11-28T18:38:49.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.513+0000 7f9fbdb1d640 1 -- 172.21.15.45:0/2908047460 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9fb80d1ba0 con 0x7f9fb80d2be0 2023-11-28T18:38:49.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.513+0000 7f9f9ffff640 1 -- 172.21.15.45:0/2908047460 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7f9fac0b5070 con 0x7f9fb80d2be0 2023-11-28T18:38:49.517 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T18:38:49.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.513+0000 7f9fbdb1d640 1 -- 172.21.15.45:0/2908047460 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9fa40668d0 msgr2=0x7f9fa4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:49.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.513+0000 7f9fbdb1d640 1 --2- 172.21.15.45:0/2908047460 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9fa40668d0 0x7f9fa4068d90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9fa8000f70 tx=0x7f9fa8007d50 comp rx=0 tx=0).stop 2023-11-28T18:38:49.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.513+0000 7f9fbdb1d640 1 -- 172.21.15.45:0/2908047460 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fb80d2be0 msgr2=0x7f9fb80c9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:49.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.513+0000 7f9fbdb1d640 1 --2- 172.21.15.45:0/2908047460 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fb80d2be0 0x7f9fb80c9040 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f9fac0b3040 tx=0x7f9fac01ba10 comp rx=0 tx=0).stop 2023-11-28T18:38:49.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.517+0000 7f9fbdb1d640 1 -- 172.21.15.45:0/2908047460 shutdown_connections 2023-11-28T18:38:49.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.517+0000 7f9fbdb1d640 1 --2- 172.21.15.45:0/2908047460 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9fa40668d0 0x7f9fa4068d90 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:49.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.517+0000 7f9fbdb1d640 1 --2- 172.21.15.45:0/2908047460 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9fb815d240 0x7f9fb815f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:49.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.517+0000 7f9fbdb1d640 1 --2- 172.21.15.45:0/2908047460 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fb80d2be0 0x7f9fb80c9040 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:49.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.517+0000 7f9fbdb1d640 1 --2- 172.21.15.45:0/2908047460 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9fb80ce370 0x7f9fb8156e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:49.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.517+0000 7f9fbdb1d640 1 -- 172.21.15.45:0/2908047460 >> 172.21.15.45:0/2908047460 conn(0x7f9fb80722a0 msgr2=0x7f9fb80d1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:49.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.517+0000 7f9fbdb1d640 1 -- 172.21.15.45:0/2908047460 shutdown_connections 2023-11-28T18:38:49.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:49.517+0000 7f9fbdb1d640 1 -- 172.21.15.45:0/2908047460 wait complete. 2023-11-28T18:38:49.538 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-28T18:38:49.538 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T18:38:49.538 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi045.front.sepia.ceph.com 2023-11-28T18:38:49.538 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-28T18:38:49.538 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-28T18:38:49.538 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-28T18:38:49.538 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-28T18:38:49.538 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T18:38:49.538 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T18:38:49.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:38:49.539 DEBUG:teuthology.orchestra.run.smithi045:> ip addr 2023-11-28T18:38:49.549 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T18:38:49.549 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T18:38:49.549 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T18:38:49.549 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:38:49.549 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2023-11-28T18:38:49.549 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:38:49.550 INFO:teuthology.orchestra.run.smithi045.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T18:38:49.550 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a6 brd ff:ff:ff:ff:ff:ff 2023-11-28T18:38:49.550 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f0 2023-11-28T18:38:49.550 INFO:teuthology.orchestra.run.smithi045.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T18:38:49.550 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a7 brd ff:ff:ff:ff:ff:ff 2023-11-28T18:38:49.550 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f1 2023-11-28T18:38:49.550 INFO:teuthology.orchestra.run.smithi045.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T18:38:49.550 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:be brd ff:ff:ff:ff:ff:ff 2023-11-28T18:38:49.550 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f0 2023-11-28T18:38:49.550 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.21.15.45/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-11-28T18:38:49.550 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft 42328sec preferred_lft 42328sec 2023-11-28T18:38:49.550 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec4:7aff:febd:12be/64 scope link 2023-11-28T18:38:49.551 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:38:49.551 INFO:teuthology.orchestra.run.smithi045.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T18:38:49.551 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:bf brd ff:ff:ff:ff:ff:ff 2023-11-28T18:38:49.551 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f1 2023-11-28T18:38:49.551 INFO:teuthology.orchestra.run.smithi045.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T18:38:49.551 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 02:42:ab:69:35:3d brd ff:ff:ff:ff:ff:ff 2023-11-28T18:38:49.551 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T18:38:49.551 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:38:49.551 INFO:teuthology.orchestra.run.smithi045.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T18:38:49.551 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-28T18:38:49.551 INFO:teuthology.orchestra.run.smithi045.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-28T18:38:49.551 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:38:49.551 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-28T18:38:49.552 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:38:49.552 INFO:teuthology.orchestra.run.smithi045.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T18:38:49.552 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T18:38:49.552 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-28T18:38:49.552 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:38:49.552 INFO:teuthology.orchestra.run.smithi045.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T18:38:49.552 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T18:38:49.552 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-11-28T18:38:49.552 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:38:49.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:38:49.553 DEBUG:teuthology.orchestra.run.smithi045:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T18:38:49.609 INFO:teuthology.orchestra.run.smithi045.stdout:1 2023-11-28T18:38:49.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:38:49.611 DEBUG:teuthology.orchestra.run.smithi045:> route 2023-11-28T18:38:49.664 INFO:teuthology.orchestra.run.smithi045.stdout:Kernel IP routing table 2023-11-28T18:38:49.664 INFO:teuthology.orchestra.run.smithi045.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T18:38:49.664 INFO:teuthology.orchestra.run.smithi045.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-11-28T18:38:49.664 INFO:teuthology.orchestra.run.smithi045.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T18:38:49.664 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-11-28T18:38:49.664 INFO:teuthology.orchestra.run.smithi045.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T18:38:49.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:38:49.665 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-11-28T18:38:49.665 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-11-28T18:38:49.665 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-28T18:38:49.665 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-28T18:38:49.665 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-28T18:38:49.665 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-11-28T18:38:49.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:38:49.759 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-11-28T18:38:49.771 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-28T18:38:49.771 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-28T18:38:49.772 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T18:38:49.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:38:49.773 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set brx.0 up 2023-11-28T18:38:49.835 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-28T18:38:49.835 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T18:38:49.836 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-28T18:38:49.887 INFO:teuthology.orchestra.run.smithi045.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-28T18:38:49.887 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T18:38:49.887 DEBUG:teuthology.orchestra.run.smithi045:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-28T18:38:49.938 DEBUG:teuthology.orchestra.run.smithi045:> sudo modprobe fuse 2023-11-28T18:38:50.004 DEBUG:teuthology.orchestra.run.smithi045:> cat /proc/self/mounts | awk '{print $2}' 2023-11-28T18:38:50.056 INFO:teuthology.orchestra.run.smithi045.stdout:/sys 2023-11-28T18:38:50.056 INFO:teuthology.orchestra.run.smithi045.stdout:/proc 2023-11-28T18:38:50.056 INFO:teuthology.orchestra.run.smithi045.stdout:/dev 2023-11-28T18:38:50.056 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/pts 2023-11-28T18:38:50.057 INFO:teuthology.orchestra.run.smithi045.stdout:/run 2023-11-28T18:38:50.057 INFO:teuthology.orchestra.run.smithi045.stdout:/ 2023-11-28T18:38:50.057 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/security 2023-11-28T18:38:50.057 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/shm 2023-11-28T18:38:50.057 INFO:teuthology.orchestra.run.smithi045.stdout:/run/lock 2023-11-28T18:38:50.057 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/cgroup 2023-11-28T18:38:50.057 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/pstore 2023-11-28T18:38:50.057 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/bpf 2023-11-28T18:38:50.057 INFO:teuthology.orchestra.run.smithi045.stdout:/proc/sys/fs/binfmt_misc 2023-11-28T18:38:50.057 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/hugepages 2023-11-28T18:38:50.057 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/mqueue 2023-11-28T18:38:50.058 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/debug 2023-11-28T18:38:50.058 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/tracing 2023-11-28T18:38:50.058 INFO:teuthology.orchestra.run.smithi045.stdout:/proc/fs/nfsd 2023-11-28T18:38:50.058 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/fuse/connections 2023-11-28T18:38:50.058 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/config 2023-11-28T18:38:50.058 INFO:teuthology.orchestra.run.smithi045.stdout:/run/credentials/systemd-sysusers.service 2023-11-28T18:38:50.058 INFO:teuthology.orchestra.run.smithi045.stdout:/run/rpc_pipefs 2023-11-28T18:38:50.058 INFO:teuthology.orchestra.run.smithi045.stdout:/run/user/1000 2023-11-28T18:38:50.058 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph 2023-11-28T18:38:50.058 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-0 2023-11-28T18:38:50.059 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-1 2023-11-28T18:38:50.059 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-2 2023-11-28T18:38:50.059 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-3 2023-11-28T18:38:50.059 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns 2023-11-28T18:38:50.059 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T18:38:50.059 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T18:38:50.059 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T18:38:50.059 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T18:38:50.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:38:50.060 DEBUG:teuthology.orchestra.run.smithi045:> ls /sys/fs/fuse/connections 2023-11-28T18:38:50.118 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-28T18:38:50.119 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-28T18:38:50.170 DEBUG:teuthology.orchestra.run.smithi045:> sudo modprobe fuse 2023-11-28T18:38:50.192 DEBUG:teuthology.orchestra.run.smithi045:> cat /proc/self/mounts | awk '{print $2}' 2023-11-28T18:38:50.244 INFO:teuthology.orchestra.run.smithi045.stdout:/sys 2023-11-28T18:38:50.244 INFO:teuthology.orchestra.run.smithi045.stdout:/proc 2023-11-28T18:38:50.244 INFO:teuthology.orchestra.run.smithi045.stdout:/dev 2023-11-28T18:38:50.245 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/pts 2023-11-28T18:38:50.245 INFO:teuthology.orchestra.run.smithi045.stdout:/run 2023-11-28T18:38:50.245 INFO:teuthology.orchestra.run.smithi045.stdout:/ 2023-11-28T18:38:50.245 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/security 2023-11-28T18:38:50.245 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/shm 2023-11-28T18:38:50.245 INFO:teuthology.orchestra.run.smithi045.stdout:/run/lock 2023-11-28T18:38:50.245 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/cgroup 2023-11-28T18:38:50.245 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/pstore 2023-11-28T18:38:50.245 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/bpf 2023-11-28T18:38:50.245 INFO:teuthology.orchestra.run.smithi045.stdout:/proc/sys/fs/binfmt_misc 2023-11-28T18:38:50.245 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/hugepages 2023-11-28T18:38:50.245 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/mqueue 2023-11-28T18:38:50.245 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/debug 2023-11-28T18:38:50.246 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/tracing 2023-11-28T18:38:50.246 INFO:teuthology.orchestra.run.smithi045.stdout:/proc/fs/nfsd 2023-11-28T18:38:50.246 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/fuse/connections 2023-11-28T18:38:50.246 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/config 2023-11-28T18:38:50.246 INFO:teuthology.orchestra.run.smithi045.stdout:/run/credentials/systemd-sysusers.service 2023-11-28T18:38:50.246 INFO:teuthology.orchestra.run.smithi045.stdout:/run/rpc_pipefs 2023-11-28T18:38:50.246 INFO:teuthology.orchestra.run.smithi045.stdout:/run/user/1000 2023-11-28T18:38:50.246 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph 2023-11-28T18:38:50.246 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-0 2023-11-28T18:38:50.246 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-1 2023-11-28T18:38:50.246 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-2 2023-11-28T18:38:50.246 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-3 2023-11-28T18:38:50.246 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns 2023-11-28T18:38:50.247 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T18:38:50.247 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T18:38:50.247 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T18:38:50.247 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T18:38:50.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:38:50.248 DEBUG:teuthology.orchestra.run.smithi045:> ls /sys/fs/fuse/connections 2023-11-28T18:38:50.269 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:2023-11-28T18:38:50.265+0000 7f797182f580 -1 init, newargv = 0x55fe278700e0 newargc=15 2023-11-28T18:38:50.269 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:ceph-fuse[47532]: starting ceph client 2023-11-28T18:38:50.275 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:ceph-fuse[47532]: starting fuse 2023-11-28T18:38:50.280 INFO:teuthology.orchestra.run.smithi045.stdout:43 2023-11-28T18:38:50.280 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-11-28T18:38:50.280 DEBUG:teuthology.orchestra.run.smithi045:> sudo stdin-killer -- python3 -c ' 2023-11-28T18:38:50.280 DEBUG:teuthology.orchestra.run.smithi045:> import glob 2023-11-28T18:38:50.281 DEBUG:teuthology.orchestra.run.smithi045:> import re 2023-11-28T18:38:50.281 DEBUG:teuthology.orchestra.run.smithi045:> import os 2023-11-28T18:38:50.281 DEBUG:teuthology.orchestra.run.smithi045:> import subprocess 2023-11-28T18:38:50.281 DEBUG:teuthology.orchestra.run.smithi045:> 2023-11-28T18:38:50.281 DEBUG:teuthology.orchestra.run.smithi045:> def _find_admin_socket(client_name): 2023-11-28T18:38:50.281 DEBUG:teuthology.orchestra.run.smithi045:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-28T18:38:50.281 DEBUG:teuthology.orchestra.run.smithi045:> files = glob.glob(asok_path) 2023-11-28T18:38:50.281 DEBUG:teuthology.orchestra.run.smithi045:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-28T18:38:50.281 DEBUG:teuthology.orchestra.run.smithi045:> 2023-11-28T18:38:50.281 DEBUG:teuthology.orchestra.run.smithi045:> # Given a non-glob path, it better be there 2023-11-28T18:38:50.281 DEBUG:teuthology.orchestra.run.smithi045:> if "*" not in asok_path: 2023-11-28T18:38:50.281 DEBUG:teuthology.orchestra.run.smithi045:> assert(len(files) == 1) 2023-11-28T18:38:50.281 DEBUG:teuthology.orchestra.run.smithi045:> return files[0] 2023-11-28T18:38:50.281 DEBUG:teuthology.orchestra.run.smithi045:> 2023-11-28T18:38:50.281 DEBUG:teuthology.orchestra.run.smithi045:> for f in files: 2023-11-28T18:38:50.282 DEBUG:teuthology.orchestra.run.smithi045:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-28T18:38:50.282 DEBUG:teuthology.orchestra.run.smithi045:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-28T18:38:50.282 DEBUG:teuthology.orchestra.run.smithi045:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-28T18:38:50.282 DEBUG:teuthology.orchestra.run.smithi045:> contents = proc_f.read() 2023-11-28T18:38:50.282 DEBUG:teuthology.orchestra.run.smithi045:> if mountpoint in contents: 2023-11-28T18:38:50.282 DEBUG:teuthology.orchestra.run.smithi045:> return f 2023-11-28T18:38:50.282 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-28T18:38:50.282 DEBUG:teuthology.orchestra.run.smithi045:> 2023-11-28T18:38:50.282 DEBUG:teuthology.orchestra.run.smithi045:> print(_find_admin_socket("client.0")) 2023-11-28T18:38:50.282 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-11-28T18:38:50.410 INFO:teuthology.orchestra.run.smithi045.stdout:/var/run/ceph/ceph-client.0.47532.asok 2023-11-28T18:38:50.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-28T18:38:50.422 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.47532.asok 2023-11-28T18:38:50.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:38:50.423 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.47532.asok status 2023-11-28T18:38:50.596 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-11-28T18:38:50.596 INFO:teuthology.orchestra.run.smithi045.stdout: "metadata": { 2023-11-28T18:38:50.596 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_sha1": "47c1c547372ed5bff7984647dc200bac0e019caf", 2023-11-28T18:38:50.596 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_version": "ceph version 18.0.0-7531-g47c1c547 (47c1c547372ed5bff7984647dc200bac0e019caf) reef (dev)", 2023-11-28T18:38:50.597 INFO:teuthology.orchestra.run.smithi045.stdout: "entity_id": "0", 2023-11-28T18:38:50.597 INFO:teuthology.orchestra.run.smithi045.stdout: "hostname": "smithi045", 2023-11-28T18:38:50.597 INFO:teuthology.orchestra.run.smithi045.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-28T18:38:50.598 INFO:teuthology.orchestra.run.smithi045.stdout: "pid": "47532", 2023-11-28T18:38:50.598 INFO:teuthology.orchestra.run.smithi045.stdout: "root": "/" 2023-11-28T18:38:50.598 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:38:50.598 INFO:teuthology.orchestra.run.smithi045.stdout: "dentry_count": 0, 2023-11-28T18:38:50.598 INFO:teuthology.orchestra.run.smithi045.stdout: "dentry_pinned_count": 0, 2023-11-28T18:38:50.598 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 5487, 2023-11-28T18:38:50.598 INFO:teuthology.orchestra.run.smithi045.stdout: "inst": { 2023-11-28T18:38:50.598 INFO:teuthology.orchestra.run.smithi045.stdout: "name": { 2023-11-28T18:38:50.598 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "client", 2023-11-28T18:38:50.598 INFO:teuthology.orchestra.run.smithi045.stdout: "num": 5487 2023-11-28T18:38:50.598 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:38:50.599 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": { 2023-11-28T18:38:50.599 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-11-28T18:38:50.599 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "192.168.0.1:0", 2023-11-28T18:38:50.599 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4166893224 2023-11-28T18:38:50.599 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:38:50.599 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:38:50.599 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": { 2023-11-28T18:38:50.599 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-11-28T18:38:50.599 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "192.168.0.1:0", 2023-11-28T18:38:50.599 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4166893224 2023-11-28T18:38:50.599 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:38:50.599 INFO:teuthology.orchestra.run.smithi045.stdout: "inst_str": "client.5487 192.168.0.1:0/4166893224", 2023-11-28T18:38:50.600 INFO:teuthology.orchestra.run.smithi045.stdout: "addr_str": "192.168.0.1:0/4166893224", 2023-11-28T18:38:50.600 INFO:teuthology.orchestra.run.smithi045.stdout: "inode_count": 1, 2023-11-28T18:38:50.600 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_epoch": 16, 2023-11-28T18:38:50.600 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_epoch": 34, 2023-11-28T18:38:50.600 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_epoch_barrier": 0, 2023-11-28T18:38:50.600 INFO:teuthology.orchestra.run.smithi045.stdout: "blocklisted": false, 2023-11-28T18:38:50.600 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs" 2023-11-28T18:38:50.600 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-11-28T18:38:50.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:38:50.611 DEBUG:teuthology.orchestra.run.smithi045:> stat --file-system '--printf=%T 2023-11-28T18:38:50.611 DEBUG:teuthology.orchestra.run.smithi045:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-28T18:38:50.622 INFO:teuthology.orchestra.run.smithi045.stdout:fuseblk 2023-11-28T18:38:50.622 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-28T18:38:50.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:38:50.623 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-28T18:38:50.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:38:50.688 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch rootfile) 2023-11-28T18:38:50.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:38:50.747 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir) 2023-11-28T18:38:50.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:38:50.807 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch subdir/subdirfile) 2023-11-28T18:38:50.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:38:50.863 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir linkdir) 2023-11-28T18:38:50.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:38:50.922 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch linkdir/link0) 2023-11-28T18:38:50.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:38:50.980 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f linkdir/link0) 2023-11-28T18:38:51.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:38:51.049 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec ln subdir/subdirfile linkdir/link0) 2023-11-28T18:38:51.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:38:51.109 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec ln subdir/subdirfile linkdir/link1) 2023-11-28T18:38:51.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:38:51.167 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec ln subdir/subdirfile linkdir/link2) 2023-11-28T18:38:51.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:38:51.226 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f linkdir/link2) 2023-11-28T18:38:51.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:38:51.286 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch linkdir/link2) 2023-11-28T18:38:51.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:38:51.345 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec ln subdir/subdirfile linkdir/link3) 2023-11-28T18:38:51.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:38:51.402 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f linkdir/link3) 2023-11-28T18:38:51.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:38:51.458 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec ln rootfile linkdir/link3) 2023-11-28T18:38:51.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:38:51.513 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir/subsubdir) 2023-11-28T18:38:51.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:38:51.566 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec sync) 2023-11-28T18:38:52.031 DEBUG:teuthology.orchestra.run.smithi045:> stdin-killer -- python3 -c ' 2023-11-28T18:38:52.031 DEBUG:teuthology.orchestra.run.smithi045:> import os 2023-11-28T18:38:52.031 DEBUG:teuthology.orchestra.run.smithi045:> import stat 2023-11-28T18:38:52.031 DEBUG:teuthology.orchestra.run.smithi045:> 2023-11-28T18:38:52.031 DEBUG:teuthology.orchestra.run.smithi045:> print(os.stat("/home/ubuntu/cephtest/mnt.0/rootfile").st_ino) 2023-11-28T18:38:52.032 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-11-28T18:38:52.110 INFO:teuthology.orchestra.run.smithi045.stdout:1099511627776 2023-11-28T18:38:52.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-28T18:38:52.120 DEBUG:teuthology.orchestra.run.smithi045:> stdin-killer -- python3 -c ' 2023-11-28T18:38:52.120 DEBUG:teuthology.orchestra.run.smithi045:> import os 2023-11-28T18:38:52.120 DEBUG:teuthology.orchestra.run.smithi045:> import stat 2023-11-28T18:38:52.121 DEBUG:teuthology.orchestra.run.smithi045:> 2023-11-28T18:38:52.121 DEBUG:teuthology.orchestra.run.smithi045:> print(os.stat("/home/ubuntu/cephtest/mnt.0/subdir").st_ino) 2023-11-28T18:38:52.121 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-11-28T18:38:52.231 INFO:teuthology.orchestra.run.smithi045.stdout:1099511627777 2023-11-28T18:38:52.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-28T18:38:52.240 DEBUG:teuthology.orchestra.run.smithi045:> stdin-killer -- python3 -c ' 2023-11-28T18:38:52.240 DEBUG:teuthology.orchestra.run.smithi045:> import os 2023-11-28T18:38:52.240 DEBUG:teuthology.orchestra.run.smithi045:> import stat 2023-11-28T18:38:52.240 DEBUG:teuthology.orchestra.run.smithi045:> 2023-11-28T18:38:52.240 DEBUG:teuthology.orchestra.run.smithi045:> print(os.stat("/home/ubuntu/cephtest/mnt.0/linkdir").st_ino) 2023-11-28T18:38:52.240 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-11-28T18:38:52.349 INFO:teuthology.orchestra.run.smithi045.stdout:1099511628279 2023-11-28T18:38:52.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-28T18:38:52.358 DEBUG:teuthology.orchestra.run.smithi045:> stdin-killer -- python3 -c ' 2023-11-28T18:38:52.358 DEBUG:teuthology.orchestra.run.smithi045:> import os 2023-11-28T18:38:52.358 DEBUG:teuthology.orchestra.run.smithi045:> import stat 2023-11-28T18:38:52.358 DEBUG:teuthology.orchestra.run.smithi045:> 2023-11-28T18:38:52.358 DEBUG:teuthology.orchestra.run.smithi045:> print(os.stat("/home/ubuntu/cephtest/mnt.0/subdir/subdirfile").st_ino) 2023-11-28T18:38:52.358 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-11-28T18:38:52.467 INFO:teuthology.orchestra.run.smithi045.stdout:1099511627778 2023-11-28T18:38:52.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-28T18:38:52.475 DEBUG:teuthology.orchestra.run.smithi045:> stdin-killer -- python3 -c ' 2023-11-28T18:38:52.476 DEBUG:teuthology.orchestra.run.smithi045:> import os 2023-11-28T18:38:52.476 DEBUG:teuthology.orchestra.run.smithi045:> import stat 2023-11-28T18:38:52.476 DEBUG:teuthology.orchestra.run.smithi045:> 2023-11-28T18:38:52.476 DEBUG:teuthology.orchestra.run.smithi045:> print(os.stat("/home/ubuntu/cephtest/mnt.0/subdir/subsubdir").st_ino) 2023-11-28T18:38:52.476 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-11-28T18:38:52.589 INFO:teuthology.orchestra.run.smithi045.stdout:1099511628282 2023-11-28T18:38:52.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-28T18:38:52.598 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T18:38:52.599 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T18:38:52.655 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T18:38:52.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.841+0000 7ff605348640 1 Processor -- start 2023-11-28T18:38:52.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.841+0000 7ff605348640 1 -- start start 2023-11-28T18:38:52.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.841+0000 7ff605348640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff6000d0440 0x7ff600161250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:52.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.841+0000 7ff605348640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff600161790 0x7ff600161be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:52.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.841+0000 7ff605348640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6000c7000 con 0x7ff6000cf950 2023-11-28T18:38:52.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.841+0000 7ff605348640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6000cf0a0 con 0x7ff6000d0440 2023-11-28T18:38:52.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.841+0000 7ff605348640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff600162120 con 0x7ff600161790 2023-11-28T18:38:52.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.841+0000 7ff5fffff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff6000cf950 0x7ff6000cfd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:60416/0 (socket says 172.21.15.45:60416) 2023-11-28T18:38:52.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.841+0000 7ff5fffff640 1 -- 172.21.15.45:0/1832033727 learned_addr learned my addr 172.21.15.45:0/1832033727 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:38:52.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.841+0000 7ff604b47640 1 --2- 172.21.15.45:0/1832033727 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff600161790 0x7ff600161be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:52.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.841+0000 7ff5ff7fe640 1 --2- 172.21.15.45:0/1832033727 >> v2:172.21.15.190:3300/0 conn(0x7ff6000d0440 0x7ff600161250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:52.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.841+0000 7ff5feffd640 1 -- 172.21.15.45:0/1832033727 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2353209265 0 0) 0x7ff6000c7000 con 0x7ff6000cf950 2023-11-28T18:38:52.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.841+0000 7ff5feffd640 1 -- 172.21.15.45:0/1832033727 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5e8003530 con 0x7ff6000cf950 2023-11-28T18:38:52.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.841+0000 7ff5feffd640 1 -- 172.21.15.45:0/1832033727 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1163993234 0 0) 0x7ff5e8003530 con 0x7ff6000cf950 2023-11-28T18:38:52.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.841+0000 7ff5feffd640 1 -- 172.21.15.45:0/1832033727 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff600161790 msgr2=0x7ff600161be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:52.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.841+0000 7ff5feffd640 1 --2- 172.21.15.45:0/1832033727 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff600161790 0x7ff600161be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:52.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.841+0000 7ff5feffd640 1 -- 172.21.15.45:0/1832033727 >> v2:172.21.15.190:3300/0 conn(0x7ff6000d0440 msgr2=0x7ff600161250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:52.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.841+0000 7ff5feffd640 1 --2- 172.21.15.45:0/1832033727 >> v2:172.21.15.190:3300/0 conn(0x7ff6000d0440 0x7ff600161250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:52.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.841+0000 7ff5feffd640 1 -- 172.21.15.45:0/1832033727 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6000d08d0 con 0x7ff6000cf950 2023-11-28T18:38:52.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.841+0000 7ff5feffd640 1 -- 172.21.15.45:0/1832033727 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4084481567 0 0) 0x7ff5f0001680 con 0x7ff6000cf950 2023-11-28T18:38:52.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.841+0000 7ff604b47640 1 --2- 172.21.15.45:0/1832033727 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff600161790 0x7ff600161be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:38:52.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.841+0000 7ff5feffd640 1 -- 172.21.15.45:0/1832033727 >> v1:172.21.15.45:6789/0 conn(0x7ff6000cf950 legacy=0x7ff6000cfd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:52.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.841+0000 7ff5feffd640 1 --2- 172.21.15.45:0/1832033727 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5e8003980 0x7ff5e8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:52.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.841+0000 7ff5feffd640 1 --2- 172.21.15.45:0/1832033727 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff600161790 0x7ff5e80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:52.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.841+0000 7ff5feffd640 1 --2- 172.21.15.45:0/1832033727 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff5e8004d10 0x7ff5e8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:52.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.841+0000 7ff5feffd640 1 -- 172.21.15.45:0/1832033727 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6000cf0a0 con 0x7ff5e8003980 2023-11-28T18:38:52.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.841+0000 7ff5feffd640 1 -- 172.21.15.45:0/1832033727 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff600162120 con 0x7ff5e8004d10 2023-11-28T18:38:52.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.841+0000 7ff5feffd640 1 -- 172.21.15.45:0/1832033727 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e800b990 con 0x7ff600161790 2023-11-28T18:38:52.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.841+0000 7ff5ff7fe640 1 --2- 172.21.15.45:0/1832033727 >> v2:172.21.15.190:3300/0 conn(0x7ff6000d0440 0x7ff600161250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:38:52.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.841+0000 7ff5fffff640 1 --2- 172.21.15.45:0/1832033727 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5e8003980 0x7ff5e8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:52.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.841+0000 7ff604b47640 1 --2- 172.21.15.45:0/1832033727 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff5e8004d10 0x7ff5e8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:52.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.841+0000 7ff5ff7fe640 1 --2- 172.21.15.45:0/1832033727 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff600161790 0x7ff5e80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:52.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.841+0000 7ff5fffff640 1 -- 172.21.15.45:0/1832033727 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff600161790 msgr2=0x7ff5e80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:52.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.841+0000 7ff5fffff640 1 --2- 172.21.15.45:0/1832033727 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff600161790 0x7ff5e80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:52.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.841+0000 7ff5fffff640 1 -- 172.21.15.45:0/1832033727 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff5e8004d10 msgr2=0x7ff5e8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:52.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.841+0000 7ff5fffff640 1 --2- 172.21.15.45:0/1832033727 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff5e8004d10 0x7ff5e8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:52.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.841+0000 7ff5fffff640 1 -- 172.21.15.45:0/1832033727 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5f8009a70 con 0x7ff5e8003980 2023-11-28T18:38:52.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.841+0000 7ff5ff7fe640 1 --2- 172.21.15.45:0/1832033727 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff600161790 0x7ff5e80047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:38:52.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.841+0000 7ff604b47640 1 --2- 172.21.15.45:0/1832033727 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff5e8004d10 0x7ff5e8005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:38:52.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.845+0000 7ff5fffff640 1 --2- 172.21.15.45:0/1832033727 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5e8003980 0x7ff5e8003da0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7ff5f000c110 tx=0x7ff5f001cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68dd979534a0c3e1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:52.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.845+0000 7ff5feffd640 1 -- 172.21.15.45:0/1832033727 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f0005ae0 con 0x7ff5e8003980 2023-11-28T18:38:52.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.845+0000 7ff5feffd640 1 -- 172.21.15.45:0/1832033727 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5f0005c40 con 0x7ff5e8003980 2023-11-28T18:38:52.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.845+0000 7ff5feffd640 1 -- 172.21.15.45:0/1832033727 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f0007070 con 0x7ff5e8003980 2023-11-28T18:38:52.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.845+0000 7ff605348640 1 -- 172.21.15.45:0/1832033727 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5e8003980 msgr2=0x7ff5e8003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:52.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.845+0000 7ff605348640 1 --2- 172.21.15.45:0/1832033727 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5e8003980 0x7ff5e8003da0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7ff5f000c110 tx=0x7ff5f001cb30 comp rx=0 tx=0).stop 2023-11-28T18:38:52.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.845+0000 7ff604b47640 1 -- 172.21.15.45:0/1832033727 reap_dead start 2023-11-28T18:38:52.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.845+0000 7ff605348640 1 -- 172.21.15.45:0/1832033727 shutdown_connections 2023-11-28T18:38:52.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.845+0000 7ff605348640 1 -- 172.21.15.45:0/1832033727 >> 172.21.15.45:0/1832033727 conn(0x7ff6000d2fa0 msgr2=0x7ff6000d3380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:52.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.845+0000 7ff605348640 1 -- 172.21.15.45:0/1832033727 shutdown_connections 2023-11-28T18:38:52.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.845+0000 7ff605348640 1 -- 172.21.15.45:0/1832033727 wait complete. 2023-11-28T18:38:52.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.849+0000 7ff605348640 1 Processor -- start 2023-11-28T18:38:52.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.849+0000 7ff605348640 1 -- start start 2023-11-28T18:38:52.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.849+0000 7ff605348640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff5e8003980 0x7ff6000a07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:52.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.849+0000 7ff605348640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff60009ee40 0x7ff60009cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:52.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.849+0000 7ff605348640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff60015e250 0x7ff60015e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:52.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.849+0000 7ff605348640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6000a0390 con 0x7ff60009ee40 2023-11-28T18:38:52.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.849+0000 7ff605348640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6000a0cf0 con 0x7ff60015e250 2023-11-28T18:38:52.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.849+0000 7ff605348640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff60009f710 con 0x7ff5e8003980 2023-11-28T18:38:52.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.849+0000 7ff5ff7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff60009ee40 0x7ff60009cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:52.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.849+0000 7ff5ff7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff60009ee40 0x7ff60009cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39578/0 (socket says 172.21.15.45:39578) 2023-11-28T18:38:52.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.849+0000 7ff5ff7fe640 1 -- 172.21.15.45:0/939686888 learned_addr learned my addr 172.21.15.45:0/939686888 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:52.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.849+0000 7ff5fffff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff5e8003980 0x7ff6000a07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:52.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.849+0000 7ff604b47640 1 --2- 172.21.15.45:0/939686888 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff60015e250 0x7ff60015e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:52.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.849+0000 7ff5ff7fe640 1 -- 172.21.15.45:0/939686888 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff5e8003980 msgr2=0x7ff6000a07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:52.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.849+0000 7ff5ff7fe640 1 --2- 172.21.15.45:0/939686888 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff5e8003980 0x7ff6000a07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:52.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.849+0000 7ff5ff7fe640 1 -- 172.21.15.45:0/939686888 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff60015e250 msgr2=0x7ff60015e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:52.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.849+0000 7ff5ff7fe640 1 --2- 172.21.15.45:0/939686888 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff60015e250 0x7ff60015e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:52.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.849+0000 7ff5ff7fe640 1 -- 172.21.15.45:0/939686888 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff60009f9f0 con 0x7ff60009ee40 2023-11-28T18:38:52.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.849+0000 7ff5ff7fe640 1 --2- 172.21.15.45:0/939686888 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff60009ee40 0x7ff60009cd70 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7ff5f40118d0 tx=0x7ff5f4011d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:52.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.849+0000 7ff5fcff9640 1 -- 172.21.15.45:0/939686888 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f400fbd0 con 0x7ff60009ee40 2023-11-28T18:38:52.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.849+0000 7ff5fcff9640 1 -- 172.21.15.45:0/939686888 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5f400fd30 con 0x7ff60009ee40 2023-11-28T18:38:52.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.849+0000 7ff5fcff9640 1 -- 172.21.15.45:0/939686888 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f4015680 con 0x7ff60009ee40 2023-11-28T18:38:52.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.849+0000 7ff605348640 1 -- 172.21.15.45:0/939686888 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff60009fcd0 con 0x7ff60009ee40 2023-11-28T18:38:52.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.849+0000 7ff605348640 1 -- 172.21.15.45:0/939686888 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff60015b810 con 0x7ff60009ee40 2023-11-28T18:38:52.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.853+0000 7ff605348640 1 -- 172.21.15.45:0/939686888 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6000c6420 con 0x7ff60009ee40 2023-11-28T18:38:52.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.853+0000 7ff5fcff9640 1 -- 172.21.15.45:0/939686888 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ff5f40157e0 con 0x7ff60009ee40 2023-11-28T18:38:52.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.853+0000 7ff5fcff9640 1 --2- 172.21.15.45:0/939686888 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff5ec0668d0 0x7ff5ec068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:52.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.853+0000 7ff5fcff9640 1 -- 172.21.15.45:0/939686888 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff5f4084d30 con 0x7ff60009ee40 2023-11-28T18:38:52.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.853+0000 7ff5fffff640 1 --2- 172.21.15.45:0/939686888 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff5ec0668d0 0x7ff5ec068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:52.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.853+0000 7ff5fffff640 1 --2- 172.21.15.45:0/939686888 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff5ec0668d0 0x7ff5ec068d90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff5f00ab000 tx=0x7ff5f00a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:52.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:52.857+0000 7ff5fcff9640 1 -- 172.21.15.45:0/939686888 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff5f4052040 con 0x7ff60009ee40 2023-11-28T18:38:53.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.017+0000 7ff605348640 1 -- 172.21.15.45:0/939686888 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff60004e970 con 0x7ff60009ee40 2023-11-28T18:38:53.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.021+0000 7ff5fcff9640 1 -- 172.21.15.45:0/939686888 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16533 (secure 0 0 0) 0x7ff5f400fea0 con 0x7ff60009ee40 2023-11-28T18:38:53.023 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:38:53.023 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":34,"fsid":"d10f5cd6-1d00-4019-99b6-6fa435498a15","created":"2023-11-28T18:37:08.189030+0000","modified":"2023-11-28T18:38:37.036797+0000","last_up_change":"2023-11-28T18:37:20.196124+0000","last_in_change":"2023-11-28T18:37:10.742043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T18:37:21.293917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-28T18:38:33.254037+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-28T18:38:34.414654+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"84465384-103c-4f2c-a45a-96f5bb9c835f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6809","nonce":555237322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6811","nonce":555237322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6815","nonce":555237322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6813","nonce":555237322}]},"public_addr":"172.21.15.45:6809/555237322","cluster_addr":"172.21.15.45:6811/555237322","heartbeat_back_addr":"172.21.15.45:6815/555237322","heartbeat_front_addr":"172.21.15.45:6813/555237322","state":["exists","up"]},{"osd":1,"uuid":"7d9eed24-a58f-42c7-a787-ac06be8553fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6801","nonce":2857063763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6803","nonce":2857063763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6807","nonce":2857063763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6805","nonce":2857063763}]},"public_addr":"172.21.15.45:6801/2857063763","cluster_addr":"172.21.15.45:6803/2857063763","heartbeat_back_addr":"172.21.15.45:6807/2857063763","heartbeat_front_addr":"172.21.15.45:6805/2857063763","state":["exists","up"]},{"osd":2,"uuid":"575eeccc-4abf-45b4-9caf-f3e797859588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6817","nonce":193884539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6819","nonce":193884539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6823","nonce":193884539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6821","nonce":193884539}]},"public_addr":"172.21.15.45:6817/193884539","cluster_addr":"172.21.15.45:6819/193884539","heartbeat_back_addr":"172.21.15.45:6823/193884539","heartbeat_front_addr":"172.21.15.45:6821/193884539","state":["exists","up"]},{"osd":3,"uuid":"9b0290d6-9a52-4bc8-b2a1-7622c5dc8e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6825","nonce":78541084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6827","nonce":78541084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6831","nonce":78541084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6829","nonce":78541084}]},"public_addr":"172.21.15.45:6825/78541084","cluster_addr":"172.21.15.45:6827/78541084","heartbeat_back_addr":"172.21.15.45:6831/78541084","heartbeat_front_addr":"172.21.15.45:6829/78541084","state":["exists","up"]},{"osd":4,"uuid":"ce632829-f027-4fbf-a627-02c571aa9d53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6809","nonce":1537591987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6811","nonce":1537591987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6815","nonce":1537591987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6813","nonce":1537591987}]},"public_addr":"172.21.15.190:6809/1537591987","cluster_addr":"172.21.15.190:6811/1537591987","heartbeat_back_addr":"172.21.15.190:6815/1537591987","heartbeat_front_addr":"172.21.15.190:6813/1537591987","state":["exists","up"]},{"osd":5,"uuid":"8700b609-27be-40bd-a251-4c0ae0a29ead","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6801","nonce":3296698407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6803","nonce":3296698407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6807","nonce":3296698407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6805","nonce":3296698407}]},"public_addr":"172.21.15.190:6801/3296698407","cluster_addr":"172.21.15.190:6803/3296698407","heartbeat_back_addr":"172.21.15.190:6807/3296698407","heartbeat_front_addr":"172.21.15.190:6805/3296698407","state":["exists","up"]},{"osd":6,"uuid":"44ce4a40-e6ff-4f4d-8e8a-7341e5c91f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6817","nonce":2317686718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6819","nonce":2317686718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6823","nonce":2317686718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6821","nonce":2317686718}]},"public_addr":"172.21.15.190:6817/2317686718","cluster_addr":"172.21.15.190:6819/2317686718","heartbeat_back_addr":"172.21.15.190:6823/2317686718","heartbeat_front_addr":"172.21.15.190:6821/2317686718","state":["exists","up"]},{"osd":7,"uuid":"192238c9-1423-4b7e-ac8f-84ba32113ddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6825","nonce":2493232051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6827","nonce":2493232051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6831","nonce":2493232051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6829","nonce":2493232051}]},"public_addr":"172.21.15.190:6825/2493232051","cluster_addr":"172.21.15.190:6827/2493232051","heartbeat_back_addr":"172.21.15.190:6831/2493232051","heartbeat_front_addr":"172.21.15.190:6829/2493232051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.393552+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.385453+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.361421+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.366408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.363226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.276007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.414605+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.445885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T18:38:53.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.021+0000 7ff605348640 1 -- 172.21.15.45:0/939686888 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff5ec0668d0 msgr2=0x7ff5ec068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:53.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.021+0000 7ff605348640 1 --2- 172.21.15.45:0/939686888 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff5ec0668d0 0x7ff5ec068d90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff5f00ab000 tx=0x7ff5f00a7070 comp rx=0 tx=0).stop 2023-11-28T18:38:53.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.021+0000 7ff605348640 1 -- 172.21.15.45:0/939686888 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff60009ee40 msgr2=0x7ff60009cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:53.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.021+0000 7ff605348640 1 --2- 172.21.15.45:0/939686888 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff60009ee40 0x7ff60009cd70 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7ff5f40118d0 tx=0x7ff5f4011d90 comp rx=0 tx=0).stop 2023-11-28T18:38:53.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.021+0000 7ff605348640 1 -- 172.21.15.45:0/939686888 shutdown_connections 2023-11-28T18:38:53.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.021+0000 7ff605348640 1 --2- 172.21.15.45:0/939686888 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff5ec0668d0 0x7ff5ec068d90 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:53.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.021+0000 7ff605348640 1 --2- 172.21.15.45:0/939686888 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff60015e250 0x7ff60015e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:53.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.021+0000 7ff605348640 1 --2- 172.21.15.45:0/939686888 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff60009ee40 0x7ff60009cd70 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:53.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.021+0000 7ff605348640 1 --2- 172.21.15.45:0/939686888 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff5e8003980 0x7ff6000a07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:53.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.021+0000 7ff605348640 1 -- 172.21.15.45:0/939686888 >> 172.21.15.45:0/939686888 conn(0x7ff6000d2fa0 msgr2=0x7ff6000d0b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:53.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.021+0000 7ff605348640 1 -- 172.21.15.45:0/939686888 shutdown_connections 2023-11-28T18:38:53.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.021+0000 7ff605348640 1 -- 172.21.15.45:0/939686888 wait complete. 2023-11-28T18:38:53.044 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T18:37:21.293917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T18:38:33.254037+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T18:38:34.414654+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T18:38:53.045 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T18:38:53.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.189+0000 7f6bc1780640 1 Processor -- start 2023-11-28T18:38:53.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.189+0000 7f6bc1780640 1 -- start start 2023-11-28T18:38:53.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.189+0000 7f6bc1780640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f6bbc071dd0 0x7f6bbc0721b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:53.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.189+0000 7f6bc1780640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6bbc13f630 0x7f6bbc0ce240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:53.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.189+0000 7f6bc1780640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bbc13d2f0 con 0x7f6bbc15adf0 2023-11-28T18:38:53.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.189+0000 7f6bc1780640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bbc140560 con 0x7f6bbc13f630 2023-11-28T18:38:53.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.189+0000 7f6bc1780640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bbc0cd830 con 0x7f6bbc071dd0 2023-11-28T18:38:53.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.189+0000 7f6bbb7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6bbc13f630 0x7f6bbc0ce240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:53.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.189+0000 7f6bbb7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6bbc13f630 0x7f6bbc0ce240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39584/0 (socket says 172.21.15.45:39584) 2023-11-28T18:38:53.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.189+0000 7f6bbb7fe640 1 -- 172.21.15.45:0/7450353 learned_addr learned my addr 172.21.15.45:0/7450353 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:53.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.189+0000 7f6bbaffd640 1 --2- 172.21.15.45:0/7450353 >> v2:172.21.15.190:3300/0 conn(0x7f6bbc071dd0 0x7f6bbc0721b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:53.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.193+0000 7f6bbb7fe640 1 -- 172.21.15.45:0/7450353 >> v2:172.21.15.190:3300/0 conn(0x7f6bbc071dd0 msgr2=0x7f6bbc0721b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:53.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.193+0000 7f6bbb7fe640 1 --2- 172.21.15.45:0/7450353 >> v2:172.21.15.190:3300/0 conn(0x7f6bbc071dd0 0x7f6bbc0721b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:53.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.193+0000 7f6bbb7fe640 1 -- 172.21.15.45:0/7450353 >> v1:172.21.15.190:6789/0 conn(0x7f6bbc15adf0 legacy=0x7f6bbc13d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:53.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.193+0000 7f6bbb7fe640 1 -- 172.21.15.45:0/7450353 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bbc0cddb0 con 0x7f6bbc13f630 2023-11-28T18:38:53.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.193+0000 7f6bbb7fe640 1 --2- 172.21.15.45:0/7450353 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6bbc13f630 0x7f6bbc0ce240 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc0b1dc0 tx=0x7f6bb401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68540ef0abf31647 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:53.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.193+0000 7f6bba7fc640 1 -- 172.21.15.45:0/7450353 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb40a5890 con 0x7f6bbc13f630 2023-11-28T18:38:53.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.193+0000 7f6bba7fc640 1 -- 172.21.15.45:0/7450353 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb40a59f0 con 0x7f6bbc13f630 2023-11-28T18:38:53.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.193+0000 7f6bba7fc640 1 -- 172.21.15.45:0/7450353 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb40a5d80 con 0x7f6bbc13f630 2023-11-28T18:38:53.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.193+0000 7f6bc1780640 1 -- 172.21.15.45:0/7450353 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6bbc13f630 msgr2=0x7f6bbc0ce240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:53.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.193+0000 7f6bc1780640 1 --2- 172.21.15.45:0/7450353 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6bbc13f630 0x7f6bbc0ce240 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc0b1dc0 tx=0x7f6bb401c9d0 comp rx=0 tx=0).stop 2023-11-28T18:38:53.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.193+0000 7f6bc1780640 1 -- 172.21.15.45:0/7450353 shutdown_connections 2023-11-28T18:38:53.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.193+0000 7f6bc1780640 1 --2- 172.21.15.45:0/7450353 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6bbc13f630 0x7f6bbc0ce240 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:53.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.193+0000 7f6bc1780640 1 --2- 172.21.15.45:0/7450353 >> v2:172.21.15.190:3300/0 conn(0x7f6bbc071dd0 0x7f6bbc0721b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:53.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.193+0000 7f6bc1780640 1 -- 172.21.15.45:0/7450353 >> 172.21.15.45:0/7450353 conn(0x7f6bbc0b0d00 msgr2=0x7f6bbc0b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:53.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.197+0000 7f6bc1780640 1 -- 172.21.15.45:0/7450353 shutdown_connections 2023-11-28T18:38:53.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.197+0000 7f6bc1780640 1 -- 172.21.15.45:0/7450353 wait complete. 2023-11-28T18:38:53.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.197+0000 7f6bc1780640 1 Processor -- start 2023-11-28T18:38:53.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.197+0000 7f6bc1780640 1 -- start start 2023-11-28T18:38:53.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.197+0000 7f6bc1780640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6bbc071dd0 0x7f6bbc138050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:53.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.197+0000 7f6bc1780640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6bbc13f630 0x7f6bbc0b28a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:53.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.197+0000 7f6bc1780640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6bbc15adf0 0x7f6bbc136960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:53.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.197+0000 7f6bc1780640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bbc139520 con 0x7f6bbc15adf0 2023-11-28T18:38:53.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.197+0000 7f6bc1780640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bbc140720 con 0x7f6bbc13f630 2023-11-28T18:38:53.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.197+0000 7f6bc1780640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bbc1388a0 con 0x7f6bbc071dd0 2023-11-28T18:38:53.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.197+0000 7f6bbb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6bbc15adf0 0x7f6bbc136960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:53.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.197+0000 7f6bbb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6bbc15adf0 0x7f6bbc136960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39590/0 (socket says 172.21.15.45:39590) 2023-11-28T18:38:53.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.197+0000 7f6bbb7fe640 1 -- 172.21.15.45:0/3438132325 learned_addr learned my addr 172.21.15.45:0/3438132325 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:53.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.197+0000 7f6bb3fff640 1 --2- 172.21.15.45:0/3438132325 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6bbc13f630 0x7f6bbc0b28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:53.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.197+0000 7f6bbaffd640 1 --2- 172.21.15.45:0/3438132325 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6bbc071dd0 0x7f6bbc138050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:53.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.197+0000 7f6bbb7fe640 1 -- 172.21.15.45:0/3438132325 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6bbc071dd0 msgr2=0x7f6bbc138050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:53.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.197+0000 7f6bbb7fe640 1 --2- 172.21.15.45:0/3438132325 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6bbc071dd0 0x7f6bbc138050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:53.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.197+0000 7f6bbb7fe640 1 -- 172.21.15.45:0/3438132325 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6bbc13f630 msgr2=0x7f6bbc0b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:53.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.197+0000 7f6bbb7fe640 1 --2- 172.21.15.45:0/3438132325 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6bbc13f630 0x7f6bbc0b28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:53.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.197+0000 7f6bbb7fe640 1 -- 172.21.15.45:0/3438132325 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb4009b30 con 0x7f6bbc15adf0 2023-11-28T18:38:53.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.197+0000 7f6bbaffd640 1 --2- 172.21.15.45:0/3438132325 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6bbc071dd0 0x7f6bbc138050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:38:53.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.197+0000 7f6bbb7fe640 1 --2- 172.21.15.45:0/3438132325 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6bbc15adf0 0x7f6bbc136960 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f6bb40195e0 tx=0x7f6bb4019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:53.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.201+0000 7f6bb37fe640 1 -- 172.21.15.45:0/3438132325 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb40b8880 con 0x7f6bbc15adf0 2023-11-28T18:38:53.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.201+0000 7f6bb37fe640 1 -- 172.21.15.45:0/3438132325 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb40b8a00 con 0x7f6bbc15adf0 2023-11-28T18:38:53.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.201+0000 7f6bb37fe640 1 -- 172.21.15.45:0/3438132325 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb40b8db0 con 0x7f6bbc15adf0 2023-11-28T18:38:53.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.201+0000 7f6bc1780640 1 -- 172.21.15.45:0/3438132325 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bbc138b80 con 0x7f6bbc15adf0 2023-11-28T18:38:53.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.201+0000 7f6bc1780640 1 -- 172.21.15.45:0/3438132325 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bbc139140 con 0x7f6bbc15adf0 2023-11-28T18:38:53.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.201+0000 7f6bc1780640 1 -- 172.21.15.45:0/3438132325 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bbc139660 con 0x7f6bbc15adf0 2023-11-28T18:38:53.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.201+0000 7f6bb37fe640 1 -- 172.21.15.45:0/3438132325 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f6bb40c1410 con 0x7f6bbc15adf0 2023-11-28T18:38:53.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.201+0000 7f6bb37fe640 1 --2- 172.21.15.45:0/3438132325 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6b9c066900 0x7f6b9c068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:53.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.201+0000 7f6bb37fe640 1 -- 172.21.15.45:0/3438132325 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6bb411f780 con 0x7f6bbc15adf0 2023-11-28T18:38:53.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.201+0000 7f6bbaffd640 1 --2- 172.21.15.45:0/3438132325 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6b9c066900 0x7f6b9c068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:53.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.205+0000 7f6bbaffd640 1 --2- 172.21.15.45:0/3438132325 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6b9c066900 0x7f6b9c068dc0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc1439c0 tx=0x7f6bac008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:53.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.205+0000 7f6bb37fe640 1 -- 172.21.15.45:0/3438132325 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6bbc139660 con 0x7f6bbc15adf0 2023-11-28T18:38:53.327 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:38:53.332 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:38:53.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.373+0000 7f6bc1780640 1 -- 172.21.15.45:0/3438132325 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6bbc139660 con 0x7f6bbc15adf0 2023-11-28T18:38:53.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.373+0000 7f6bb37fe640 1 -- 172.21.15.45:0/3438132325 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6bbc139660 con 0x7f6bbc15adf0 2023-11-28T18:38:53.375 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-11-28T18:38:53.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.373+0000 7f6bc1780640 1 -- 172.21.15.45:0/3438132325 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6b9c066900 msgr2=0x7f6b9c068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:53.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.373+0000 7f6bc1780640 1 --2- 172.21.15.45:0/3438132325 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6b9c066900 0x7f6b9c068dc0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc1439c0 tx=0x7f6bac008040 comp rx=0 tx=0).stop 2023-11-28T18:38:53.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.373+0000 7f6bc1780640 1 -- 172.21.15.45:0/3438132325 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6bbc15adf0 msgr2=0x7f6bbc136960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:53.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.373+0000 7f6bc1780640 1 --2- 172.21.15.45:0/3438132325 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6bbc15adf0 0x7f6bbc136960 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f6bb40195e0 tx=0x7f6bb4019770 comp rx=0 tx=0).stop 2023-11-28T18:38:53.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.373+0000 7f6bc1780640 1 -- 172.21.15.45:0/3438132325 shutdown_connections 2023-11-28T18:38:53.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.373+0000 7f6bc1780640 1 --2- 172.21.15.45:0/3438132325 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6b9c066900 0x7f6b9c068dc0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:53.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.373+0000 7f6bc1780640 1 --2- 172.21.15.45:0/3438132325 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6bbc15adf0 0x7f6bbc136960 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:53.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.373+0000 7f6bc1780640 1 --2- 172.21.15.45:0/3438132325 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6bbc13f630 0x7f6bbc0b28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:53.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.373+0000 7f6bc1780640 1 --2- 172.21.15.45:0/3438132325 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6bbc071dd0 0x7f6bbc138050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:53.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.373+0000 7f6bc1780640 1 -- 172.21.15.45:0/3438132325 >> 172.21.15.45:0/3438132325 conn(0x7f6bbc0b0d00 msgr2=0x7f6bbc13c830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:53.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.373+0000 7f6bc1780640 1 -- 172.21.15.45:0/3438132325 shutdown_connections 2023-11-28T18:38:53.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.373+0000 7f6bc1780640 1 -- 172.21.15.45:0/3438132325 wait complete. 2023-11-28T18:38:53.396 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T18:38:53.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.537+0000 7f3494f65640 1 Processor -- start 2023-11-28T18:38:53.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.537+0000 7f3494f65640 1 -- start start 2023-11-28T18:38:53.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.541+0000 7f3494f65640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f34900ac110 0x7f34900af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:53.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.541+0000 7f3494f65640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f34900afc60 0x7f34900b0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:53.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.541+0000 7f3494f65640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34900b00b0 con 0x7f349015d350 2023-11-28T18:38:53.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.541+0000 7f3494f65640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3490161340 con 0x7f34900afc60 2023-11-28T18:38:53.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.541+0000 7f3494f65640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3490161620 con 0x7f34900ac110 2023-11-28T18:38:53.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.541+0000 7f348e59c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f349015d350 0x7f349015e4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:60422/0 (socket says 172.21.15.45:60422) 2023-11-28T18:38:53.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.541+0000 7f348e59c640 1 -- 172.21.15.45:0/3043528857 learned_addr learned my addr 172.21.15.45:0/3043528857 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:38:53.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.541+0000 7f348ed9d640 1 --2- 172.21.15.45:0/3043528857 >> v2:172.21.15.45:3300/0 conn(0x7f34900afc60 0x7f34900b0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:53.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.541+0000 7f3487fff640 1 --2- 172.21.15.45:0/3043528857 >> v2:172.21.15.190:3300/0 conn(0x7f34900ac110 0x7f34900af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:53.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.541+0000 7f348ed9d640 1 -- 172.21.15.45:0/3043528857 >> v2:172.21.15.190:3300/0 conn(0x7f34900ac110 msgr2=0x7f34900af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:53.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.541+0000 7f348ed9d640 1 --2- 172.21.15.45:0/3043528857 >> v2:172.21.15.190:3300/0 conn(0x7f34900ac110 0x7f34900af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:53.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.541+0000 7f348ed9d640 1 -- 172.21.15.45:0/3043528857 >> v1:172.21.15.45:6789/0 conn(0x7f349015d350 legacy=0x7f349015e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:53.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.541+0000 7f348ed9d640 1 -- 172.21.15.45:0/3043528857 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3490161900 con 0x7f34900afc60 2023-11-28T18:38:53.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.541+0000 7f348dd9b640 1 -- 172.21.15.45:0/3043528857 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1056090558 0 0) 0x7f3480001120 con 0x7f349015d350 2023-11-28T18:38:53.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.545+0000 7f348ed9d640 1 --2- 172.21.15.45:0/3043528857 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f34900afc60 0x7f34900b0fa0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f34900d0240 tx=0x7f348801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b340d0c8fb95fa29 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:53.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.545+0000 7f348dd9b640 1 -- 172.21.15.45:0/3043528857 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34880a56b0 con 0x7f34900afc60 2023-11-28T18:38:53.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.545+0000 7f348dd9b640 1 -- 172.21.15.45:0/3043528857 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34880a5810 con 0x7f34900afc60 2023-11-28T18:38:53.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.545+0000 7f348dd9b640 1 -- 172.21.15.45:0/3043528857 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34880a5ba0 con 0x7f34900afc60 2023-11-28T18:38:53.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.545+0000 7f3494f65640 1 -- 172.21.15.45:0/3043528857 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f34900afc60 msgr2=0x7f34900b0fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:53.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.545+0000 7f3494f65640 1 --2- 172.21.15.45:0/3043528857 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f34900afc60 0x7f34900b0fa0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f34900d0240 tx=0x7f348801c8e0 comp rx=0 tx=0).stop 2023-11-28T18:38:53.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.545+0000 7f3494f65640 1 -- 172.21.15.45:0/3043528857 shutdown_connections 2023-11-28T18:38:53.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.545+0000 7f3494f65640 1 --2- 172.21.15.45:0/3043528857 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f34900afc60 0x7f34900b0fa0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:53.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.545+0000 7f3494f65640 1 --2- 172.21.15.45:0/3043528857 >> v2:172.21.15.190:3300/0 conn(0x7f34900ac110 0x7f34900af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:53.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.545+0000 7f3494f65640 1 -- 172.21.15.45:0/3043528857 >> 172.21.15.45:0/3043528857 conn(0x7f34900b4650 msgr2=0x7f34900b4a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:53.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.545+0000 7f3494f65640 1 -- 172.21.15.45:0/3043528857 shutdown_connections 2023-11-28T18:38:53.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.545+0000 7f3494f65640 1 -- 172.21.15.45:0/3043528857 wait complete. 2023-11-28T18:38:53.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.545+0000 7f3494f65640 1 Processor -- start 2023-11-28T18:38:53.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.545+0000 7f3494f65640 1 -- start start 2023-11-28T18:38:53.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.549+0000 7f3494f65640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f34900ac110 0x7f349015fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:53.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.549+0000 7f3494f65640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f34900afc60 0x7f349014d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:53.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.549+0000 7f3494f65640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f349015d350 0x7f349015a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:53.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.549+0000 7f3494f65640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f349015ca10 con 0x7f349015d350 2023-11-28T18:38:53.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.549+0000 7f3494f65640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34900cff50 con 0x7f34900afc60 2023-11-28T18:38:53.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.549+0000 7f3494f65640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34900ce1e0 con 0x7f34900ac110 2023-11-28T18:38:53.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.549+0000 7f348ed9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f349015d350 0x7f349015a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:53.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.549+0000 7f348ed9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f349015d350 0x7f349015a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39618/0 (socket says 172.21.15.45:39618) 2023-11-28T18:38:53.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.549+0000 7f348ed9d640 1 -- 172.21.15.45:0/2725771748 learned_addr learned my addr 172.21.15.45:0/2725771748 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:53.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.549+0000 7f3487fff640 1 --2- 172.21.15.45:0/2725771748 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f34900afc60 0x7f349014d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:53.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.549+0000 7f348e59c640 1 --2- 172.21.15.45:0/2725771748 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f34900ac110 0x7f349015fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:53.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.549+0000 7f348ed9d640 1 -- 172.21.15.45:0/2725771748 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f34900ac110 msgr2=0x7f349015fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:53.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.549+0000 7f348ed9d640 1 --2- 172.21.15.45:0/2725771748 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f34900ac110 0x7f349015fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:53.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.549+0000 7f348ed9d640 1 -- 172.21.15.45:0/2725771748 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f34900afc60 msgr2=0x7f349014d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:53.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.549+0000 7f348ed9d640 1 --2- 172.21.15.45:0/2725771748 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f34900afc60 0x7f349014d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:53.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.549+0000 7f348ed9d640 1 -- 172.21.15.45:0/2725771748 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3488009a70 con 0x7f349015d350 2023-11-28T18:38:53.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.549+0000 7f348ed9d640 1 --2- 172.21.15.45:0/2725771748 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f349015d350 0x7f349015a2a0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f348801cdc0 tx=0x7f3488019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:53.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.549+0000 7f3486ffd640 1 -- 172.21.15.45:0/2725771748 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34880ad650 con 0x7f349015d350 2023-11-28T18:38:53.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.549+0000 7f3486ffd640 1 -- 172.21.15.45:0/2725771748 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34880ad7b0 con 0x7f349015d350 2023-11-28T18:38:53.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.549+0000 7f3494f65640 1 -- 172.21.15.45:0/2725771748 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34900ce4c0 con 0x7f349015d350 2023-11-28T18:38:53.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.549+0000 7f3486ffd640 1 -- 172.21.15.45:0/2725771748 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34880adb40 con 0x7f349015d350 2023-11-28T18:38:53.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.549+0000 7f3494f65640 1 -- 172.21.15.45:0/2725771748 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34900ce7a0 con 0x7f349015d350 2023-11-28T18:38:53.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.549+0000 7f3494f65640 1 -- 172.21.15.45:0/2725771748 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f349015cba0 con 0x7f349015d350 2023-11-28T18:38:53.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.553+0000 7f3486ffd640 1 -- 172.21.15.45:0/2725771748 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f34880adca0 con 0x7f349015d350 2023-11-28T18:38:53.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.553+0000 7f3486ffd640 1 --2- 172.21.15.45:0/2725771748 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f34700668d0 0x7f3470068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:53.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.553+0000 7f3486ffd640 1 -- 172.21.15.45:0/2725771748 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f348811f230 con 0x7f349015d350 2023-11-28T18:38:53.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.553+0000 7f348e59c640 1 --2- 172.21.15.45:0/2725771748 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f34700668d0 0x7f3470068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:53.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.553+0000 7f348e59c640 1 --2- 172.21.15.45:0/2725771748 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f34700668d0 0x7f3470068d90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3480000f70 tx=0x7f3480007df0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:53.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.557+0000 7f3486ffd640 1 -- 172.21.15.45:0/2725771748 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f34880ec510 con 0x7f349015d350 2023-11-28T18:38:53.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.713+0000 7f3494f65640 1 -- 172.21.15.45:0/2725771748 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3490069410 con 0x7f349015d350 2023-11-28T18:38:53.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.713+0000 7f3486ffd640 1 -- 172.21.15.45:0/2725771748 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v34) v1 ==== 104+0+11 (secure 0 0 0) 0x7f34880efb30 con 0x7f349015d350 2023-11-28T18:38:53.716 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-11-28T18:38:53.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.713+0000 7f3494f65640 1 -- 172.21.15.45:0/2725771748 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f34700668d0 msgr2=0x7f3470068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:53.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.713+0000 7f3494f65640 1 --2- 172.21.15.45:0/2725771748 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f34700668d0 0x7f3470068d90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3480000f70 tx=0x7f3480007df0 comp rx=0 tx=0).stop 2023-11-28T18:38:53.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.713+0000 7f3494f65640 1 -- 172.21.15.45:0/2725771748 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f349015d350 msgr2=0x7f349015a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:53.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.713+0000 7f3494f65640 1 --2- 172.21.15.45:0/2725771748 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f349015d350 0x7f349015a2a0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f348801cdc0 tx=0x7f3488019680 comp rx=0 tx=0).stop 2023-11-28T18:38:53.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.713+0000 7f3494f65640 1 -- 172.21.15.45:0/2725771748 shutdown_connections 2023-11-28T18:38:53.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.713+0000 7f3494f65640 1 --2- 172.21.15.45:0/2725771748 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f34700668d0 0x7f3470068d90 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:53.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.713+0000 7f3494f65640 1 --2- 172.21.15.45:0/2725771748 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f349015d350 0x7f349015a2a0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:53.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.713+0000 7f3494f65640 1 --2- 172.21.15.45:0/2725771748 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f34900afc60 0x7f349014d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:53.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.713+0000 7f3494f65640 1 --2- 172.21.15.45:0/2725771748 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f34900ac110 0x7f349015fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:53.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.713+0000 7f3494f65640 1 -- 172.21.15.45:0/2725771748 >> 172.21.15.45:0/2725771748 conn(0x7f34900b4650 msgr2=0x7f349006e120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:53.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.713+0000 7f3494f65640 1 -- 172.21.15.45:0/2725771748 shutdown_connections 2023-11-28T18:38:53.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.713+0000 7f3494f65640 1 -- 172.21.15.45:0/2725771748 wait complete. 2023-11-28T18:38:53.737 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T18:38:53.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.881+0000 7f6dadc09640 1 Processor -- start 2023-11-28T18:38:53.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.881+0000 7f6dadc09640 1 -- start start 2023-11-28T18:38:53.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.881+0000 7f6dadc09640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f6da8157210 0x7f6da8070cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:53.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.881+0000 7f6dadc09640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6da80ae870 0x7f6da815d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:53.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.881+0000 7f6dadc09640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6da81575f0 con 0x7f6da815d750 2023-11-28T18:38:53.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.881+0000 7f6dadc09640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6da815dbe0 con 0x7f6da8157210 2023-11-28T18:38:53.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.881+0000 7f6dadc09640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6da8071640 con 0x7f6da80ae870 2023-11-28T18:38:53.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.881+0000 7f6da6ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6da80ae870 0x7f6da815d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:53.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.881+0000 7f6da77fe640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f6da8157210 0x7f6da8070cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:53.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.881+0000 7f6da7fff640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f6da815d750 0x7f6da8159c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.45:55922/0 (socket says 172.21.15.45:55922) 2023-11-28T18:38:53.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.881+0000 7f6da7fff640 1 -- 172.21.15.45:0/2490930381 learned_addr learned my addr 172.21.15.45:0/2490930381 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:38:53.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.881+0000 7f6da77fe640 1 -- 172.21.15.45:0/2490930381 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6da80ae870 msgr2=0x7f6da815d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:53.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.881+0000 7f6da77fe640 1 --2- 172.21.15.45:0/2490930381 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6da80ae870 0x7f6da815d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:53.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.881+0000 7f6da77fe640 1 -- 172.21.15.45:0/2490930381 >> v1:172.21.15.190:6789/0 conn(0x7f6da815d750 legacy=0x7f6da8159c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:53.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.881+0000 7f6da77fe640 1 -- 172.21.15.45:0/2490930381 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6da8071920 con 0x7f6da8157210 2023-11-28T18:38:53.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.881+0000 7f6da67fc640 1 -- 172.21.15.45:0/2490930381 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2632413799 0 0) 0x7f6da81575f0 con 0x7f6da815d750 2023-11-28T18:38:53.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.881+0000 7f6da6ffd640 1 --2- 172.21.15.45:0/2490930381 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6da80ae870 0x7f6da815d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:38:53.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.885+0000 7f6da77fe640 1 --2- 172.21.15.45:0/2490930381 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6da8157210 0x7f6da8070cc0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6d980097c0 tx=0x7f6d9801c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=881706931f0776a1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:53.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.885+0000 7f6da67fc640 1 -- 172.21.15.45:0/2490930381 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d980ab600 con 0x7f6da8157210 2023-11-28T18:38:53.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.885+0000 7f6da67fc640 1 -- 172.21.15.45:0/2490930381 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d980a7050 con 0x7f6da8157210 2023-11-28T18:38:53.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.885+0000 7f6da67fc640 1 -- 172.21.15.45:0/2490930381 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d980ab980 con 0x7f6da8157210 2023-11-28T18:38:53.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.885+0000 7f6dadc09640 1 -- 172.21.15.45:0/2490930381 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6da8157210 msgr2=0x7f6da8070cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:53.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.885+0000 7f6dadc09640 1 --2- 172.21.15.45:0/2490930381 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6da8157210 0x7f6da8070cc0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6d980097c0 tx=0x7f6d9801c3f0 comp rx=0 tx=0).stop 2023-11-28T18:38:53.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.885+0000 7f6dadc09640 1 -- 172.21.15.45:0/2490930381 shutdown_connections 2023-11-28T18:38:53.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.885+0000 7f6dadc09640 1 --2- 172.21.15.45:0/2490930381 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6da80ae870 0x7f6da815d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:53.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.885+0000 7f6dadc09640 1 --2- 172.21.15.45:0/2490930381 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6da8157210 0x7f6da8070cc0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:53.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.885+0000 7f6dadc09640 1 -- 172.21.15.45:0/2490930381 >> 172.21.15.45:0/2490930381 conn(0x7f6da80b0d00 msgr2=0x7f6da80b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:53.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.885+0000 7f6dadc09640 1 -- 172.21.15.45:0/2490930381 shutdown_connections 2023-11-28T18:38:53.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.885+0000 7f6dadc09640 1 -- 172.21.15.45:0/2490930381 wait complete. 2023-11-28T18:38:53.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.889+0000 7f6dadc09640 1 Processor -- start 2023-11-28T18:38:53.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.889+0000 7f6dadc09640 1 -- start start 2023-11-28T18:38:53.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.889+0000 7f6dadc09640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6da80ae870 0x7f6da81411d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:53.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.889+0000 7f6dadc09640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6da8157210 0x7f6da81581a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:53.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.889+0000 7f6dadc09640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6da815d750 0x7f6da81586e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:53.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.889+0000 7f6dadc09640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6da8141710 con 0x7f6da8157210 2023-11-28T18:38:53.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.889+0000 7f6dadc09640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6da8143d10 con 0x7f6da80ae870 2023-11-28T18:38:53.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.889+0000 7f6dadc09640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6da8143ff0 con 0x7f6da815d750 2023-11-28T18:38:53.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.889+0000 7f6da6ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6da8157210 0x7f6da81581a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:53.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.889+0000 7f6da6ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6da8157210 0x7f6da81581a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39622/0 (socket says 172.21.15.45:39622) 2023-11-28T18:38:53.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.889+0000 7f6da6ffd640 1 -- 172.21.15.45:0/3448596008 learned_addr learned my addr 172.21.15.45:0/3448596008 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:53.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.889+0000 7f6da77fe640 1 --2- 172.21.15.45:0/3448596008 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6da80ae870 0x7f6da81411d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:53.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.889+0000 7f6da7fff640 1 --2- 172.21.15.45:0/3448596008 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6da815d750 0x7f6da81586e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:53.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.889+0000 7f6da6ffd640 1 -- 172.21.15.45:0/3448596008 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6da815d750 msgr2=0x7f6da81586e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:53.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.889+0000 7f6da6ffd640 1 --2- 172.21.15.45:0/3448596008 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6da815d750 0x7f6da81586e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:53.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.889+0000 7f6da6ffd640 1 -- 172.21.15.45:0/3448596008 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6da80ae870 msgr2=0x7f6da81411d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:53.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.889+0000 7f6da6ffd640 1 --2- 172.21.15.45:0/3448596008 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6da80ae870 0x7f6da81411d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:53.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.889+0000 7f6da6ffd640 1 -- 172.21.15.45:0/3448596008 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d9c009420 con 0x7f6da8157210 2023-11-28T18:38:53.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.889+0000 7f6da6ffd640 1 --2- 172.21.15.45:0/3448596008 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6da8157210 0x7f6da81581a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c00ebe0 tx=0x7f6d9c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:53.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.889+0000 7f6d8ffff640 1 -- 172.21.15.45:0/3448596008 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d9c00eee0 con 0x7f6da8157210 2023-11-28T18:38:53.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.889+0000 7f6d8ffff640 1 -- 172.21.15.45:0/3448596008 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d9c00cc30 con 0x7f6da8157210 2023-11-28T18:38:53.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.889+0000 7f6d8ffff640 1 -- 172.21.15.45:0/3448596008 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d9c013470 con 0x7f6da8157210 2023-11-28T18:38:53.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.889+0000 7f6dadc09640 1 -- 172.21.15.45:0/3448596008 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d98009420 con 0x7f6da8157210 2023-11-28T18:38:53.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.889+0000 7f6dadc09640 1 -- 172.21.15.45:0/3448596008 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6da81445b0 con 0x7f6da8157210 2023-11-28T18:38:53.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.893+0000 7f6dadc09640 1 -- 172.21.15.45:0/3448596008 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6da8069410 con 0x7f6da8157210 2023-11-28T18:38:53.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.893+0000 7f6d8ffff640 1 -- 172.21.15.45:0/3448596008 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f6d9c0135d0 con 0x7f6da8157210 2023-11-28T18:38:53.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.893+0000 7f6d8ffff640 1 --2- 172.21.15.45:0/3448596008 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6d940668d0 0x7f6d94068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:53.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.893+0000 7f6d8ffff640 1 -- 172.21.15.45:0/3448596008 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6d9c084730 con 0x7f6da8157210 2023-11-28T18:38:53.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.893+0000 7f6da77fe640 1 --2- 172.21.15.45:0/3448596008 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6d940668d0 0x7f6d94068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:53.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.897+0000 7f6da77fe640 1 --2- 172.21.15.45:0/3448596008 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6d940668d0 0x7f6d94068d90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6d980ad000 tx=0x7f6d980a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:53.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:53.897+0000 7f6d8ffff640 1 -- 172.21.15.45:0/3448596008 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6d9c051980 con 0x7f6da8157210 2023-11-28T18:38:54.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.057+0000 7f6dadc09640 1 -- 172.21.15.45:0/3448596008 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6da80add00 con 0x7f6da8157210 2023-11-28T18:38:54.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.057+0000 7f6d8ffff640 1 -- 172.21.15.45:0/3448596008 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v34) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6d9c054fa0 con 0x7f6da8157210 2023-11-28T18:38:54.059 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-11-28T18:38:54.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.057+0000 7f6dadc09640 1 -- 172.21.15.45:0/3448596008 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6d940668d0 msgr2=0x7f6d94068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:54.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.057+0000 7f6dadc09640 1 --2- 172.21.15.45:0/3448596008 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6d940668d0 0x7f6d94068d90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6d980ad000 tx=0x7f6d980a6000 comp rx=0 tx=0).stop 2023-11-28T18:38:54.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.057+0000 7f6dadc09640 1 -- 172.21.15.45:0/3448596008 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6da8157210 msgr2=0x7f6da81581a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:54.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.057+0000 7f6dadc09640 1 --2- 172.21.15.45:0/3448596008 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6da8157210 0x7f6da81581a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c00ebe0 tx=0x7f6d9c00c520 comp rx=0 tx=0).stop 2023-11-28T18:38:54.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.057+0000 7f6dadc09640 1 -- 172.21.15.45:0/3448596008 shutdown_connections 2023-11-28T18:38:54.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.057+0000 7f6dadc09640 1 --2- 172.21.15.45:0/3448596008 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6d940668d0 0x7f6d94068d90 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:54.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.057+0000 7f6dadc09640 1 --2- 172.21.15.45:0/3448596008 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6da815d750 0x7f6da81586e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:54.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.057+0000 7f6dadc09640 1 --2- 172.21.15.45:0/3448596008 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6da8157210 0x7f6da81581a0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:54.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.057+0000 7f6dadc09640 1 --2- 172.21.15.45:0/3448596008 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6da80ae870 0x7f6da81411d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:54.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.057+0000 7f6dadc09640 1 -- 172.21.15.45:0/3448596008 >> 172.21.15.45:0/3448596008 conn(0x7f6da80b0d00 msgr2=0x7f6da80ce770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:54.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.057+0000 7f6dadc09640 1 -- 172.21.15.45:0/3448596008 shutdown_connections 2023-11-28T18:38:54.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.057+0000 7f6dadc09640 1 -- 172.21.15.45:0/3448596008 wait complete. 2023-11-28T18:38:54.081 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T18:38:54.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.221+0000 7fdf05df8640 1 Processor -- start 2023-11-28T18:38:54.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.221+0000 7fdf05df8640 1 -- start start 2023-11-28T18:38:54.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.225+0000 7fdf05df8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdf00146c00 0x7fdf0015e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:54.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.225+0000 7fdf05df8640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf00146fe0 con 0x7fdf0006e8f0 2023-11-28T18:38:54.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.225+0000 7fdf05df8640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf0006f390 con 0x7fdf000b32c0 2023-11-28T18:38:54.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.225+0000 7fdf05df8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0015e970 con 0x7fdf00146c00 2023-11-28T18:38:54.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.225+0000 7fdefeffd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fdf0006e8f0 0x7fdf000b2bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:60430/0 (socket says 172.21.15.45:60430) 2023-11-28T18:38:54.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.225+0000 7fdefeffd640 1 -- 172.21.15.45:0/2883126894 learned_addr learned my addr 172.21.15.45:0/2883126894 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:38:54.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.225+0000 7fdefe7fc640 1 -- 172.21.15.45:0/2883126894 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3529926901 0 0) 0x7fdf00146fe0 con 0x7fdf0006e8f0 2023-11-28T18:38:54.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.225+0000 7fdefe7fc640 1 -- 172.21.15.45:0/2883126894 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdee8003530 con 0x7fdf0006e8f0 2023-11-28T18:38:54.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.225+0000 7fdeff7fe640 1 --2- 172.21.15.45:0/2883126894 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdf00146c00 0x7fdf0015e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:54.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.225+0000 7fdefe7fc640 1 -- 172.21.15.45:0/2883126894 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4144387091 0 0) 0x7fdee8003530 con 0x7fdf0006e8f0 2023-11-28T18:38:54.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.225+0000 7fdefe7fc640 1 -- 172.21.15.45:0/2883126894 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdf00146c00 msgr2=0x7fdf0015e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:54.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.225+0000 7fdefe7fc640 1 --2- 172.21.15.45:0/2883126894 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdf00146c00 0x7fdf0015e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:54.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.225+0000 7fdefe7fc640 1 -- 172.21.15.45:0/2883126894 >> v1:172.21.15.190:6789/0 conn(0x7fdf000b32c0 legacy=0x7fdf00160f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:54.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.225+0000 7fdefe7fc640 1 -- 172.21.15.45:0/2883126894 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf0006f670 con 0x7fdf0006e8f0 2023-11-28T18:38:54.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.225+0000 7fdefe7fc640 1 -- 172.21.15.45:0/2883126894 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4084481567 0 0) 0x7fdef4001680 con 0x7fdf0006e8f0 2023-11-28T18:38:54.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.225+0000 7fdefe7fc640 1 -- 172.21.15.45:0/2883126894 >> v1:172.21.15.45:6789/0 conn(0x7fdf0006e8f0 legacy=0x7fdf000b2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:54.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.225+0000 7fdefe7fc640 1 --2- 172.21.15.45:0/2883126894 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdf00146c00 0x7fdee80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:54.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.225+0000 7fdefe7fc640 1 --2- 172.21.15.45:0/2883126894 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdee8003f30 0x7fdee80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:54.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.225+0000 7fdefe7fc640 1 --2- 172.21.15.45:0/2883126894 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdee8004d10 0x7fdee8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:54.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.225+0000 7fdefe7fc640 1 -- 172.21.15.45:0/2883126894 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdee800ba40 con 0x7fdee8003f30 2023-11-28T18:38:54.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.225+0000 7fdefe7fc640 1 -- 172.21.15.45:0/2883126894 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdee800bbb0 con 0x7fdee8004d10 2023-11-28T18:38:54.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.225+0000 7fdefe7fc640 1 -- 172.21.15.45:0/2883126894 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdee800bd70 con 0x7fdf00146c00 2023-11-28T18:38:54.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.225+0000 7fdefeffd640 1 --2- 172.21.15.45:0/2883126894 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdee8003f30 0x7fdee80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:54.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.225+0000 7fdeff7fe640 1 --2- 172.21.15.45:0/2883126894 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdf00146c00 0x7fdee80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:54.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.225+0000 7fdefffff640 1 --2- 172.21.15.45:0/2883126894 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdee8004d10 0x7fdee8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:54.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.225+0000 7fdefeffd640 1 -- 172.21.15.45:0/2883126894 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdf00146c00 msgr2=0x7fdee80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:54.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.225+0000 7fdefeffd640 1 --2- 172.21.15.45:0/2883126894 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdf00146c00 0x7fdee80039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:54.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.225+0000 7fdefeffd640 1 -- 172.21.15.45:0/2883126894 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdee8004d10 msgr2=0x7fdee8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:54.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.225+0000 7fdefeffd640 1 --2- 172.21.15.45:0/2883126894 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdee8004d10 0x7fdee8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:54.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.225+0000 7fdefeffd640 1 -- 172.21.15.45:0/2883126894 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdee8003530 con 0x7fdee8003f30 2023-11-28T18:38:54.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.229+0000 7fdefeffd640 1 --2- 172.21.15.45:0/2883126894 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdee8003f30 0x7fdee80047d0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fdef400c240 tx=0x7fdef401f3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=943685d5be41956f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:54.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.229+0000 7fdefe7fc640 1 -- 172.21.15.45:0/2883126894 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef4005ae0 con 0x7fdee8003f30 2023-11-28T18:38:54.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.229+0000 7fdefe7fc640 1 -- 172.21.15.45:0/2883126894 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdef40ab070 con 0x7fdee8003f30 2023-11-28T18:38:54.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.229+0000 7fdefe7fc640 1 -- 172.21.15.45:0/2883126894 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef4007070 con 0x7fdee8003f30 2023-11-28T18:38:54.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.229+0000 7fdf05df8640 1 -- 172.21.15.45:0/2883126894 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdee8003f30 msgr2=0x7fdee80047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:54.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.229+0000 7fdf05df8640 1 --2- 172.21.15.45:0/2883126894 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdee8003f30 0x7fdee80047d0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fdef400c240 tx=0x7fdef401f3b0 comp rx=0 tx=0).stop 2023-11-28T18:38:54.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.229+0000 7fdefffff640 1 -- 172.21.15.45:0/2883126894 reap_dead start 2023-11-28T18:38:54.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.229+0000 7fdf05df8640 1 -- 172.21.15.45:0/2883126894 shutdown_connections 2023-11-28T18:38:54.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.229+0000 7fdf05df8640 1 -- 172.21.15.45:0/2883126894 >> 172.21.15.45:0/2883126894 conn(0x7fdf0006a570 msgr2=0x7fdf0006a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:54.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.229+0000 7fdf05df8640 1 -- 172.21.15.45:0/2883126894 shutdown_connections 2023-11-28T18:38:54.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.229+0000 7fdf05df8640 1 -- 172.21.15.45:0/2883126894 wait complete. 2023-11-28T18:38:54.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.229+0000 7fdf05df8640 1 Processor -- start 2023-11-28T18:38:54.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.233+0000 7fdf05df8640 1 -- start start 2023-11-28T18:38:54.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.233+0000 7fdf05df8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf0013ed10 0x7fdf001602c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:54.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.233+0000 7fdf05df8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdf00160800 0x7fdf000b6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:54.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.233+0000 7fdf05df8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdf000b69a0 0x7fdf000b44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:54.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.233+0000 7fdf05df8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0015f220 con 0x7fdf0013ed10 2023-11-28T18:38:54.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.233+0000 7fdf05df8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0015f500 con 0x7fdf000b69a0 2023-11-28T18:38:54.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.233+0000 7fdf05df8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0015f7e0 con 0x7fdf00160800 2023-11-28T18:38:54.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.233+0000 7fdeff7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf0013ed10 0x7fdf001602c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:54.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.233+0000 7fdeff7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf0013ed10 0x7fdf001602c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39644/0 (socket says 172.21.15.45:39644) 2023-11-28T18:38:54.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.233+0000 7fdeff7fe640 1 -- 172.21.15.45:0/2965241469 learned_addr learned my addr 172.21.15.45:0/2965241469 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:54.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.233+0000 7fdefeffd640 1 --2- 172.21.15.45:0/2965241469 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdf00160800 0x7fdf000b6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:54.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.233+0000 7fdefffff640 1 --2- 172.21.15.45:0/2965241469 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdf000b69a0 0x7fdf000b44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:54.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.233+0000 7fdeff7fe640 1 -- 172.21.15.45:0/2965241469 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdf00160800 msgr2=0x7fdf000b6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:54.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.233+0000 7fdeff7fe640 1 --2- 172.21.15.45:0/2965241469 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdf00160800 0x7fdf000b6460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:54.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.233+0000 7fdeff7fe640 1 -- 172.21.15.45:0/2965241469 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdf000b69a0 msgr2=0x7fdf000b44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:54.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.233+0000 7fdeff7fe640 1 --2- 172.21.15.45:0/2965241469 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdf000b69a0 0x7fdf000b44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:54.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.233+0000 7fdeff7fe640 1 -- 172.21.15.45:0/2965241469 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf0015fac0 con 0x7fdf0013ed10 2023-11-28T18:38:54.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.233+0000 7fdeff7fe640 1 --2- 172.21.15.45:0/2965241469 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf0013ed10 0x7fdf001602c0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fdef00119d0 tx=0x7fdef0011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:54.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.233+0000 7fdee7fff640 1 -- 172.21.15.45:0/2965241469 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef000fb50 con 0x7fdf0013ed10 2023-11-28T18:38:54.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.233+0000 7fdee7fff640 1 -- 172.21.15.45:0/2965241469 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdef000fcb0 con 0x7fdf0013ed10 2023-11-28T18:38:54.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.233+0000 7fdee7fff640 1 -- 172.21.15.45:0/2965241469 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef0014440 con 0x7fdf0013ed10 2023-11-28T18:38:54.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.233+0000 7fdf05df8640 1 -- 172.21.15.45:0/2965241469 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf0015fda0 con 0x7fdf0013ed10 2023-11-28T18:38:54.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.233+0000 7fdf05df8640 1 -- 172.21.15.45:0/2965241469 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf0015ef10 con 0x7fdf0013ed10 2023-11-28T18:38:54.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.233+0000 7fdf05df8640 1 -- 172.21.15.45:0/2965241469 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf00069480 con 0x7fdf0013ed10 2023-11-28T18:38:54.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.237+0000 7fdee7fff640 1 -- 172.21.15.45:0/2965241469 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fdef00145a0 con 0x7fdf0013ed10 2023-11-28T18:38:54.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.237+0000 7fdee7fff640 1 --2- 172.21.15.45:0/2965241469 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fdeec0668d0 0x7fdeec068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:54.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.237+0000 7fdee7fff640 1 -- 172.21.15.45:0/2965241469 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdef0084be0 con 0x7fdf0013ed10 2023-11-28T18:38:54.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.237+0000 7fdefeffd640 1 --2- 172.21.15.45:0/2965241469 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fdeec0668d0 0x7fdeec068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:54.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.237+0000 7fdefeffd640 1 --2- 172.21.15.45:0/2965241469 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fdeec0668d0 0x7fdeec068d90 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fdef40af000 tx=0x7fdef40aa000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:54.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.241+0000 7fdee7fff640 1 -- 172.21.15.45:0/2965241469 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdef0051f90 con 0x7fdf0013ed10 2023-11-28T18:38:54.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.409+0000 7fdf05df8640 1 -- 172.21.15.45:0/2965241469 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fdf000ca8b0 con 0x7fdf0013ed10 2023-11-28T18:38:54.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.409+0000 7fdee7fff640 1 -- 172.21.15.45:0/2965241469 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v34) v1 ==== 80+0+0 (secure 0 0 0) 0x7fdef00555b0 con 0x7fdf0013ed10 2023-11-28T18:38:54.412 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-11-28T18:38:54.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.409+0000 7fdf05df8640 1 -- 172.21.15.45:0/2965241469 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fdeec0668d0 msgr2=0x7fdeec068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:54.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.409+0000 7fdf05df8640 1 --2- 172.21.15.45:0/2965241469 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fdeec0668d0 0x7fdeec068d90 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fdef40af000 tx=0x7fdef40aa000 comp rx=0 tx=0).stop 2023-11-28T18:38:54.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.409+0000 7fdf05df8640 1 -- 172.21.15.45:0/2965241469 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf0013ed10 msgr2=0x7fdf001602c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:54.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.409+0000 7fdf05df8640 1 --2- 172.21.15.45:0/2965241469 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf0013ed10 0x7fdf001602c0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fdef00119d0 tx=0x7fdef0011e90 comp rx=0 tx=0).stop 2023-11-28T18:38:54.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.409+0000 7fdf05df8640 1 -- 172.21.15.45:0/2965241469 shutdown_connections 2023-11-28T18:38:54.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.409+0000 7fdf05df8640 1 --2- 172.21.15.45:0/2965241469 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fdeec0668d0 0x7fdeec068d90 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:54.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.409+0000 7fdf05df8640 1 --2- 172.21.15.45:0/2965241469 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdf000b69a0 0x7fdf000b44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:54.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.409+0000 7fdf05df8640 1 --2- 172.21.15.45:0/2965241469 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdf00160800 0x7fdf000b6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:54.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.409+0000 7fdf05df8640 1 --2- 172.21.15.45:0/2965241469 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf0013ed10 0x7fdf001602c0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:54.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.409+0000 7fdf05df8640 1 -- 172.21.15.45:0/2965241469 >> 172.21.15.45:0/2965241469 conn(0x7fdf0006a570 msgr2=0x7fdf000d03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:54.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.413+0000 7fdf05df8640 1 -- 172.21.15.45:0/2965241469 shutdown_connections 2023-11-28T18:38:54.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.413+0000 7fdf05df8640 1 -- 172.21.15.45:0/2965241469 wait complete. 2023-11-28T18:38:54.434 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T18:38:54.435 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T18:38:54.445 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T18:38:54.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.625+0000 7fa47c3f8640 1 Processor -- start 2023-11-28T18:38:54.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.625+0000 7fa47c3f8640 1 -- start start 2023-11-28T18:38:54.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.625+0000 7fa47c3f8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa47413cf70 0x7fa47406c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:54.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.625+0000 7fa47c3f8640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa47406c840 0x7fa47415a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:54.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.625+0000 7fa47c3f8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa47415abb0 0x7fa4740715b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:54.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.625+0000 7fa47c3f8640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa47413d350 con 0x7fa47413cf70 2023-11-28T18:38:54.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.625+0000 7fa47c3f8640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa474140520 con 0x7fa47406c840 2023-11-28T18:38:54.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.625+0000 7fa47c3f8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa47406ccb0 con 0x7fa47415abb0 2023-11-28T18:38:54.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.625+0000 7fa47a194640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa47413cf70 0x7fa47406c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:54.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.625+0000 7fa47a194640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa47413cf70 0x7fa47406c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39658/0 (socket says 172.21.15.45:39658) 2023-11-28T18:38:54.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.625+0000 7fa47a194640 1 -- 172.21.15.45:0/1097057162 learned_addr learned my addr 172.21.15.45:0/1097057162 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:54.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.625+0000 7fa479993640 1 --2- 172.21.15.45:0/1097057162 >> v2:172.21.15.190:3300/0 conn(0x7fa47406c840 0x7fa47415a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:54.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.625+0000 7fa47a995640 1 --2- 172.21.15.45:0/1097057162 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa47415abb0 0x7fa4740715b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:54.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.629+0000 7fa47a194640 1 -- 172.21.15.45:0/1097057162 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa47415abb0 msgr2=0x7fa4740715b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:54.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.629+0000 7fa47a194640 1 --2- 172.21.15.45:0/1097057162 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa47415abb0 0x7fa4740715b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:54.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.629+0000 7fa47a194640 1 -- 172.21.15.45:0/1097057162 >> v2:172.21.15.190:3300/0 conn(0x7fa47406c840 msgr2=0x7fa47415a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:54.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.629+0000 7fa47a194640 1 --2- 172.21.15.45:0/1097057162 >> v2:172.21.15.190:3300/0 conn(0x7fa47406c840 0x7fa47415a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:54.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.629+0000 7fa47a194640 1 -- 172.21.15.45:0/1097057162 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa47415b3e0 con 0x7fa47413cf70 2023-11-28T18:38:54.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.629+0000 7fa47a194640 1 --2- 172.21.15.45:0/1097057162 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa47413cf70 0x7fa47406c300 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fa4740cc7d0 tx=0x7fa47001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4263aa3c30ee3ab server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:54.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.629+0000 7fa479192640 1 -- 172.21.15.45:0/1097057162 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4700ac640 con 0x7fa47413cf70 2023-11-28T18:38:54.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.629+0000 7fa479192640 1 -- 172.21.15.45:0/1097057162 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4700ac7a0 con 0x7fa47413cf70 2023-11-28T18:38:54.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.629+0000 7fa479192640 1 -- 172.21.15.45:0/1097057162 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4700acb30 con 0x7fa47413cf70 2023-11-28T18:38:54.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.629+0000 7fa47c3f8640 1 -- 172.21.15.45:0/1097057162 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa47413cf70 msgr2=0x7fa47406c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:54.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.629+0000 7fa47c3f8640 1 --2- 172.21.15.45:0/1097057162 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa47413cf70 0x7fa47406c300 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fa4740cc7d0 tx=0x7fa47001c420 comp rx=0 tx=0).stop 2023-11-28T18:38:54.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.633+0000 7fa47c3f8640 1 -- 172.21.15.45:0/1097057162 shutdown_connections 2023-11-28T18:38:54.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.633+0000 7fa47c3f8640 1 --2- 172.21.15.45:0/1097057162 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa47415abb0 0x7fa4740715b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:54.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.633+0000 7fa47c3f8640 1 --2- 172.21.15.45:0/1097057162 >> v2:172.21.15.190:3300/0 conn(0x7fa47406c840 0x7fa47415a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:54.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.633+0000 7fa47c3f8640 1 --2- 172.21.15.45:0/1097057162 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa47413cf70 0x7fa47406c300 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:54.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.633+0000 7fa47c3f8640 1 -- 172.21.15.45:0/1097057162 >> 172.21.15.45:0/1097057162 conn(0x7fa47406a570 msgr2=0x7fa47406a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:54.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.633+0000 7fa47c3f8640 1 -- 172.21.15.45:0/1097057162 shutdown_connections 2023-11-28T18:38:54.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.633+0000 7fa47c3f8640 1 -- 172.21.15.45:0/1097057162 wait complete. 2023-11-28T18:38:54.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.633+0000 7fa47c3f8640 1 Processor -- start 2023-11-28T18:38:54.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.633+0000 7fa47c3f8640 1 -- start start 2023-11-28T18:38:54.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.633+0000 7fa47c3f8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa47406c840 0x7fa474154b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:54.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.633+0000 7fa47c3f8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa47413cf70 0x7fa4741383b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:54.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.633+0000 7fa47c3f8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa47415abb0 0x7fa47413e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:54.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.633+0000 7fa47c3f8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa474159150 con 0x7fa47415abb0 2023-11-28T18:38:54.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.633+0000 7fa47c3f8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4741388f0 con 0x7fa47406c840 2023-11-28T18:38:54.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.633+0000 7fa47c3f8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4741584d0 con 0x7fa47413cf70 2023-11-28T18:38:54.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.633+0000 7fa47a995640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa47415abb0 0x7fa47413e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:54.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.633+0000 7fa47a995640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa47415abb0 0x7fa47413e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39664/0 (socket says 172.21.15.45:39664) 2023-11-28T18:38:54.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.633+0000 7fa47a995640 1 -- 172.21.15.45:0/3307260803 learned_addr learned my addr 172.21.15.45:0/3307260803 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:54.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.633+0000 7fa47a194640 1 --2- 172.21.15.45:0/3307260803 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa47406c840 0x7fa474154b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:54.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.633+0000 7fa479993640 1 --2- 172.21.15.45:0/3307260803 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa47413cf70 0x7fa4741383b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:54.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.633+0000 7fa47a995640 1 -- 172.21.15.45:0/3307260803 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa47413cf70 msgr2=0x7fa4741383b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:54.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.633+0000 7fa47a995640 1 --2- 172.21.15.45:0/3307260803 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa47413cf70 0x7fa4741383b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:54.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.633+0000 7fa47a995640 1 -- 172.21.15.45:0/3307260803 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa47406c840 msgr2=0x7fa474154b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:54.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.633+0000 7fa47a995640 1 --2- 172.21.15.45:0/3307260803 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa47406c840 0x7fa474154b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:54.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.633+0000 7fa47a995640 1 -- 172.21.15.45:0/3307260803 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4700094d0 con 0x7fa47415abb0 2023-11-28T18:38:54.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.633+0000 7fa47a194640 1 --2- 172.21.15.45:0/3307260803 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa47406c840 0x7fa474154b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:38:54.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.633+0000 7fa47a995640 1 --2- 172.21.15.45:0/3307260803 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa47415abb0 0x7fa47413e910 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fa46c007e60 tx=0x7fa46c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:54.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.637+0000 7fa46affd640 1 -- 172.21.15.45:0/3307260803 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46c014420 con 0x7fa47415abb0 2023-11-28T18:38:54.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.637+0000 7fa46affd640 1 -- 172.21.15.45:0/3307260803 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa46c0145a0 con 0x7fa47415abb0 2023-11-28T18:38:54.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.637+0000 7fa46affd640 1 -- 172.21.15.45:0/3307260803 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46c014950 con 0x7fa47415abb0 2023-11-28T18:38:54.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.637+0000 7fa47c3f8640 1 -- 172.21.15.45:0/3307260803 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4741587b0 con 0x7fa47415abb0 2023-11-28T18:38:54.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.637+0000 7fa47c3f8640 1 -- 172.21.15.45:0/3307260803 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa474158d70 con 0x7fa47415abb0 2023-11-28T18:38:54.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.637+0000 7fa47c3f8640 1 -- 172.21.15.45:0/3307260803 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa474159290 con 0x7fa47415abb0 2023-11-28T18:38:54.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.637+0000 7fa46affd640 1 -- 172.21.15.45:0/3307260803 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa46c014ab0 con 0x7fa47415abb0 2023-11-28T18:38:54.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.637+0000 7fa46affd640 1 --2- 172.21.15.45:0/3307260803 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa4580668d0 0x7fa458068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:54.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.637+0000 7fa46affd640 1 -- 172.21.15.45:0/3307260803 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa46c084b50 con 0x7fa47415abb0 2023-11-28T18:38:54.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.637+0000 7fa47a194640 1 --2- 172.21.15.45:0/3307260803 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa4580668d0 0x7fa458068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:54.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.641+0000 7fa47a194640 1 --2- 172.21.15.45:0/3307260803 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa4580668d0 0x7fa458068d90 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa4700ae000 tx=0x7fa4700a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:54.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.641+0000 7fa46affd640 1 -- 172.21.15.45:0/3307260803 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa474159290 con 0x7fa47415abb0 2023-11-28T18:38:54.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.809+0000 7fa47c3f8640 1 -- 172.21.15.45:0/3307260803 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa474159290 con 0x7fa47415abb0 2023-11-28T18:38:54.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.809+0000 7fa46affd640 1 -- 172.21.15.45:0/3307260803 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16533 (secure 0 0 0) 0x7fa474159290 con 0x7fa47415abb0 2023-11-28T18:38:54.813 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:38:54.814 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":34,"fsid":"d10f5cd6-1d00-4019-99b6-6fa435498a15","created":"2023-11-28T18:37:08.189030+0000","modified":"2023-11-28T18:38:37.036797+0000","last_up_change":"2023-11-28T18:37:20.196124+0000","last_in_change":"2023-11-28T18:37:10.742043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T18:37:21.293917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-28T18:38:33.254037+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-28T18:38:34.414654+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"84465384-103c-4f2c-a45a-96f5bb9c835f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6809","nonce":555237322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6811","nonce":555237322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6815","nonce":555237322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6813","nonce":555237322}]},"public_addr":"172.21.15.45:6809/555237322","cluster_addr":"172.21.15.45:6811/555237322","heartbeat_back_addr":"172.21.15.45:6815/555237322","heartbeat_front_addr":"172.21.15.45:6813/555237322","state":["exists","up"]},{"osd":1,"uuid":"7d9eed24-a58f-42c7-a787-ac06be8553fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6801","nonce":2857063763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6803","nonce":2857063763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6807","nonce":2857063763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6805","nonce":2857063763}]},"public_addr":"172.21.15.45:6801/2857063763","cluster_addr":"172.21.15.45:6803/2857063763","heartbeat_back_addr":"172.21.15.45:6807/2857063763","heartbeat_front_addr":"172.21.15.45:6805/2857063763","state":["exists","up"]},{"osd":2,"uuid":"575eeccc-4abf-45b4-9caf-f3e797859588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6817","nonce":193884539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6819","nonce":193884539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6823","nonce":193884539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6821","nonce":193884539}]},"public_addr":"172.21.15.45:6817/193884539","cluster_addr":"172.21.15.45:6819/193884539","heartbeat_back_addr":"172.21.15.45:6823/193884539","heartbeat_front_addr":"172.21.15.45:6821/193884539","state":["exists","up"]},{"osd":3,"uuid":"9b0290d6-9a52-4bc8-b2a1-7622c5dc8e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6825","nonce":78541084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6827","nonce":78541084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6831","nonce":78541084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6829","nonce":78541084}]},"public_addr":"172.21.15.45:6825/78541084","cluster_addr":"172.21.15.45:6827/78541084","heartbeat_back_addr":"172.21.15.45:6831/78541084","heartbeat_front_addr":"172.21.15.45:6829/78541084","state":["exists","up"]},{"osd":4,"uuid":"ce632829-f027-4fbf-a627-02c571aa9d53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6809","nonce":1537591987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6811","nonce":1537591987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6815","nonce":1537591987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6813","nonce":1537591987}]},"public_addr":"172.21.15.190:6809/1537591987","cluster_addr":"172.21.15.190:6811/1537591987","heartbeat_back_addr":"172.21.15.190:6815/1537591987","heartbeat_front_addr":"172.21.15.190:6813/1537591987","state":["exists","up"]},{"osd":5,"uuid":"8700b609-27be-40bd-a251-4c0ae0a29ead","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6801","nonce":3296698407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6803","nonce":3296698407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6807","nonce":3296698407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6805","nonce":3296698407}]},"public_addr":"172.21.15.190:6801/3296698407","cluster_addr":"172.21.15.190:6803/3296698407","heartbeat_back_addr":"172.21.15.190:6807/3296698407","heartbeat_front_addr":"172.21.15.190:6805/3296698407","state":["exists","up"]},{"osd":6,"uuid":"44ce4a40-e6ff-4f4d-8e8a-7341e5c91f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6817","nonce":2317686718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6819","nonce":2317686718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6823","nonce":2317686718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6821","nonce":2317686718}]},"public_addr":"172.21.15.190:6817/2317686718","cluster_addr":"172.21.15.190:6819/2317686718","heartbeat_back_addr":"172.21.15.190:6823/2317686718","heartbeat_front_addr":"172.21.15.190:6821/2317686718","state":["exists","up"]},{"osd":7,"uuid":"192238c9-1423-4b7e-ac8f-84ba32113ddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6825","nonce":2493232051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6827","nonce":2493232051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6831","nonce":2493232051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6829","nonce":2493232051}]},"public_addr":"172.21.15.190:6825/2493232051","cluster_addr":"172.21.15.190:6827/2493232051","heartbeat_back_addr":"172.21.15.190:6831/2493232051","heartbeat_front_addr":"172.21.15.190:6829/2493232051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.393552+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.385453+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.361421+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.366408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.363226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.276007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.414605+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.445885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T18:38:54.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.813+0000 7fa47c3f8640 1 -- 172.21.15.45:0/3307260803 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa4580668d0 msgr2=0x7fa458068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:54.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.813+0000 7fa47c3f8640 1 --2- 172.21.15.45:0/3307260803 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa4580668d0 0x7fa458068d90 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa4700ae000 tx=0x7fa4700a7000 comp rx=0 tx=0).stop 2023-11-28T18:38:54.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.813+0000 7fa47c3f8640 1 -- 172.21.15.45:0/3307260803 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa47415abb0 msgr2=0x7fa47413e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:54.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.813+0000 7fa47c3f8640 1 --2- 172.21.15.45:0/3307260803 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa47415abb0 0x7fa47413e910 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fa46c007e60 tx=0x7fa46c00e4b0 comp rx=0 tx=0).stop 2023-11-28T18:38:54.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.813+0000 7fa47c3f8640 1 -- 172.21.15.45:0/3307260803 shutdown_connections 2023-11-28T18:38:54.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.813+0000 7fa47c3f8640 1 --2- 172.21.15.45:0/3307260803 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa4580668d0 0x7fa458068d90 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:54.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.813+0000 7fa47c3f8640 1 --2- 172.21.15.45:0/3307260803 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa47415abb0 0x7fa47413e910 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:54.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.813+0000 7fa47c3f8640 1 --2- 172.21.15.45:0/3307260803 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa47413cf70 0x7fa4741383b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:54.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.813+0000 7fa47c3f8640 1 --2- 172.21.15.45:0/3307260803 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa47406c840 0x7fa474154b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:54.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.813+0000 7fa47c3f8640 1 -- 172.21.15.45:0/3307260803 >> 172.21.15.45:0/3307260803 conn(0x7fa47406a570 msgr2=0x7fa4740cd950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:54.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.813+0000 7fa47c3f8640 1 -- 172.21.15.45:0/3307260803 shutdown_connections 2023-11-28T18:38:54.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.813+0000 7fa47c3f8640 1 -- 172.21.15.45:0/3307260803 wait complete. 2023-11-28T18:38:54.835 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T18:37:21.293917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T18:38:33.254037+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T18:38:34.414654+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T18:38:54.836 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T18:38:54.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.977+0000 7f407bb96640 1 Processor -- start 2023-11-28T18:38:54.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.977+0000 7f407bb96640 1 -- start start 2023-11-28T18:38:54.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.981+0000 7f407bb96640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f4074158ce0 0x7f407415eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:54.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.981+0000 7f407bb96640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f40740cba50 0x7f407415be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:54.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.981+0000 7f407bb96640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f407415b6b0 con 0x7f40740b4310 2023-11-28T18:38:54.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.981+0000 7f407bb96640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f407415f450 con 0x7f40740cba50 2023-11-28T18:38:54.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.981+0000 7f407bb96640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f407415f730 con 0x7f4074158ce0 2023-11-28T18:38:54.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.981+0000 7f4079131640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f40740cba50 0x7f407415be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:54.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.981+0000 7f4079131640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f40740cba50 0x7f407415be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39674/0 (socket says 172.21.15.45:39674) 2023-11-28T18:38:54.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.981+0000 7f4079131640 1 -- 172.21.15.45:0/568821695 learned_addr learned my addr 172.21.15.45:0/568821695 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:54.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.981+0000 7f4079932640 1 --2- 172.21.15.45:0/568821695 >> v2:172.21.15.190:3300/0 conn(0x7f4074158ce0 0x7f407415eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:54.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.981+0000 7f4079131640 1 -- 172.21.15.45:0/568821695 >> v2:172.21.15.190:3300/0 conn(0x7f4074158ce0 msgr2=0x7f407415eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:54.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.981+0000 7f4079131640 1 --2- 172.21.15.45:0/568821695 >> v2:172.21.15.190:3300/0 conn(0x7f4074158ce0 0x7f407415eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:54.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.981+0000 7f4079131640 1 -- 172.21.15.45:0/568821695 >> v1:172.21.15.190:6789/0 conn(0x7f40740b4310 legacy=0x7f4074070430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:54.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.981+0000 7f4079131640 1 -- 172.21.15.45:0/568821695 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f407415b920 con 0x7f40740cba50 2023-11-28T18:38:54.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.985+0000 7f4079131640 1 --2- 172.21.15.45:0/568821695 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40740cba50 0x7f407415be40 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f4074067fb0 tx=0x7f406401c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b420107b79b6bc27 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:54.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.985+0000 7f4078930640 1 -- 172.21.15.45:0/568821695 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40640aa640 con 0x7f40740cba50 2023-11-28T18:38:54.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.985+0000 7f4078930640 1 -- 172.21.15.45:0/568821695 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40640aa7a0 con 0x7f40740cba50 2023-11-28T18:38:54.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.985+0000 7f4078930640 1 -- 172.21.15.45:0/568821695 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40640aab30 con 0x7f40740cba50 2023-11-28T18:38:54.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.985+0000 7f407bb96640 1 -- 172.21.15.45:0/568821695 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40740cba50 msgr2=0x7f407415be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:54.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.985+0000 7f407bb96640 1 --2- 172.21.15.45:0/568821695 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40740cba50 0x7f407415be40 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f4074067fb0 tx=0x7f406401c4c0 comp rx=0 tx=0).stop 2023-11-28T18:38:54.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.985+0000 7f407bb96640 1 -- 172.21.15.45:0/568821695 shutdown_connections 2023-11-28T18:38:54.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.985+0000 7f407bb96640 1 --2- 172.21.15.45:0/568821695 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40740cba50 0x7f407415be40 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:54.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.985+0000 7f407bb96640 1 --2- 172.21.15.45:0/568821695 >> v2:172.21.15.190:3300/0 conn(0x7f4074158ce0 0x7f407415eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:54.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.985+0000 7f407bb96640 1 -- 172.21.15.45:0/568821695 >> 172.21.15.45:0/568821695 conn(0x7f40740b0d00 msgr2=0x7f40740b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:54.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.985+0000 7f407bb96640 1 -- 172.21.15.45:0/568821695 shutdown_connections 2023-11-28T18:38:54.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.985+0000 7f407bb96640 1 -- 172.21.15.45:0/568821695 wait complete. 2023-11-28T18:38:54.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.985+0000 7f407bb96640 1 Processor -- start 2023-11-28T18:38:54.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.985+0000 7f407bb96640 1 -- start start 2023-11-28T18:38:54.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.989+0000 7f407bb96640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f40740b4310 0x7f407414ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:54.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.989+0000 7f407bb96640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f40740cba50 0x7f40741526f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:54.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.989+0000 7f407bb96640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4074158ce0 0x7f407413a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:54.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.989+0000 7f407bb96640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4074153a90 con 0x7f4074158ce0 2023-11-28T18:38:54.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.989+0000 7f407bb96640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f407414fe10 con 0x7f40740cba50 2023-11-28T18:38:54.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.989+0000 7f407bb96640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f407414f600 con 0x7f40740b4310 2023-11-28T18:38:54.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.989+0000 7f407a133640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4074158ce0 0x7f407413a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:54.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.989+0000 7f407a133640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4074158ce0 0x7f407413a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39688/0 (socket says 172.21.15.45:39688) 2023-11-28T18:38:54.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.989+0000 7f407a133640 1 -- 172.21.15.45:0/642378369 learned_addr learned my addr 172.21.15.45:0/642378369 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:54.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.989+0000 7f4079932640 1 --2- 172.21.15.45:0/642378369 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f40740b4310 0x7f407414ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:54.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.989+0000 7f4079131640 1 --2- 172.21.15.45:0/642378369 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f40740cba50 0x7f40741526f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:54.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.989+0000 7f407a133640 1 -- 172.21.15.45:0/642378369 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f40740b4310 msgr2=0x7f407414ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:54.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.989+0000 7f407a133640 1 --2- 172.21.15.45:0/642378369 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f40740b4310 0x7f407414ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:54.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.989+0000 7f407a133640 1 -- 172.21.15.45:0/642378369 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f40740cba50 msgr2=0x7f40741526f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:54.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.989+0000 7f407a133640 1 --2- 172.21.15.45:0/642378369 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f40740cba50 0x7f40741526f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:54.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.989+0000 7f407a133640 1 -- 172.21.15.45:0/642378369 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40640094d0 con 0x7f4074158ce0 2023-11-28T18:38:54.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.989+0000 7f407a133640 1 --2- 172.21.15.45:0/642378369 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4074158ce0 0x7f407413a000 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f406c00c780 tx=0x7f406c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:54.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.989+0000 7f406a7fc640 1 -- 172.21.15.45:0/642378369 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f406c004b70 con 0x7f4074158ce0 2023-11-28T18:38:54.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.989+0000 7f406a7fc640 1 -- 172.21.15.45:0/642378369 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f406c00ce90 con 0x7f4074158ce0 2023-11-28T18:38:54.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.989+0000 7f407bb96640 1 -- 172.21.15.45:0/642378369 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4074153fe0 con 0x7f4074158ce0 2023-11-28T18:38:54.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.989+0000 7f406a7fc640 1 -- 172.21.15.45:0/642378369 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f406c00a850 con 0x7f4074158ce0 2023-11-28T18:38:54.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.989+0000 7f407bb96640 1 -- 172.21.15.45:0/642378369 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f407414fb30 con 0x7f4074158ce0 2023-11-28T18:38:54.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.989+0000 7f407bb96640 1 -- 172.21.15.45:0/642378369 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4074154170 con 0x7f4074158ce0 2023-11-28T18:38:54.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.989+0000 7f406a7fc640 1 -- 172.21.15.45:0/642378369 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f406c00a9b0 con 0x7f4074158ce0 2023-11-28T18:38:54.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.993+0000 7f406a7fc640 1 --2- 172.21.15.45:0/642378369 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4058066920 0x7f4058068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:54.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.993+0000 7f406a7fc640 1 -- 172.21.15.45:0/642378369 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f406c0844e0 con 0x7f4074158ce0 2023-11-28T18:38:54.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.993+0000 7f4079932640 1 --2- 172.21.15.45:0/642378369 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4058066920 0x7f4058068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:54.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.993+0000 7f4079932640 1 --2- 172.21.15.45:0/642378369 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4058066920 0x7f4058068de0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f40700079c0 tx=0x7f4070008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:54.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:54.997+0000 7f406a7fc640 1 -- 172.21.15.45:0/642378369 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f406c0517b0 con 0x7f4074158ce0 2023-11-28T18:38:55.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.153+0000 7f407bb96640 1 -- 172.21.15.45:0/642378369 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4074069410 con 0x7f4074158ce0 2023-11-28T18:38:55.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.157+0000 7f406a7fc640 1 -- 172.21.15.45:0/642378369 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) v1 ==== 93+0+10 (secure 0 0 0) 0x7f406c054dd0 con 0x7f4074158ce0 2023-11-28T18:38:55.159 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-11-28T18:38:55.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.157+0000 7f407bb96640 1 -- 172.21.15.45:0/642378369 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4058066920 msgr2=0x7f4058068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:55.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.157+0000 7f407bb96640 1 --2- 172.21.15.45:0/642378369 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4058066920 0x7f4058068de0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f40700079c0 tx=0x7f4070008040 comp rx=0 tx=0).stop 2023-11-28T18:38:55.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.157+0000 7f407bb96640 1 -- 172.21.15.45:0/642378369 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4074158ce0 msgr2=0x7f407413a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:55.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.157+0000 7f407bb96640 1 --2- 172.21.15.45:0/642378369 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4074158ce0 0x7f407413a000 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f406c00c780 tx=0x7f406c00cc40 comp rx=0 tx=0).stop 2023-11-28T18:38:55.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.157+0000 7f407bb96640 1 -- 172.21.15.45:0/642378369 shutdown_connections 2023-11-28T18:38:55.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.157+0000 7f407bb96640 1 --2- 172.21.15.45:0/642378369 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4058066920 0x7f4058068de0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:55.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.157+0000 7f407bb96640 1 --2- 172.21.15.45:0/642378369 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4074158ce0 0x7f407413a000 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:55.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.157+0000 7f407bb96640 1 --2- 172.21.15.45:0/642378369 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f40740cba50 0x7f40741526f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:55.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.157+0000 7f407bb96640 1 --2- 172.21.15.45:0/642378369 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f40740b4310 0x7f407414ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:55.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.157+0000 7f407bb96640 1 -- 172.21.15.45:0/642378369 >> 172.21.15.45:0/642378369 conn(0x7f40740b0d00 msgr2=0x7f4074071950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:55.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.157+0000 7f407bb96640 1 -- 172.21.15.45:0/642378369 shutdown_connections 2023-11-28T18:38:55.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.157+0000 7f407bb96640 1 -- 172.21.15.45:0/642378369 wait complete. 2023-11-28T18:38:55.180 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T18:38:55.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.321+0000 7f39f8df8640 1 Processor -- start 2023-11-28T18:38:55.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.321+0000 7f39f8df8640 1 -- start start 2023-11-28T18:38:55.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.325+0000 7f39f8df8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f39f41469a0 0x7f39f406cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:55.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.325+0000 7f39f8df8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f39f415fde0 0x7f39f40b4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:55.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.325+0000 7f39f8df8640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39f415e940 con 0x7f39f40b4070 2023-11-28T18:38:55.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.325+0000 7f39f8df8640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39f40b4a40 con 0x7f39f41469a0 2023-11-28T18:38:55.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.325+0000 7f39f8df8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39f415dd30 con 0x7f39f415fde0 2023-11-28T18:38:55.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.325+0000 7f39f259c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f39f41469a0 0x7f39f406cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:55.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.325+0000 7f39ebfff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f39f40b4070 0x7f39f406e8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:60432/0 (socket says 172.21.15.45:60432) 2023-11-28T18:38:55.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.325+0000 7f39ebfff640 1 -- 172.21.15.45:0/1334151029 learned_addr learned my addr 172.21.15.45:0/1334151029 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:38:55.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.325+0000 7f39f2d9d640 1 --2- 172.21.15.45:0/1334151029 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f39f415fde0 0x7f39f40b4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:55.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.325+0000 7f39f259c640 1 -- 172.21.15.45:0/1334151029 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f39f415fde0 msgr2=0x7f39f40b4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:55.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.325+0000 7f39f259c640 1 --2- 172.21.15.45:0/1334151029 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f39f415fde0 0x7f39f40b4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:55.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.325+0000 7f39f259c640 1 -- 172.21.15.45:0/1334151029 >> v1:172.21.15.45:6789/0 conn(0x7f39f40b4070 legacy=0x7f39f406e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:55.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.325+0000 7f39f259c640 1 -- 172.21.15.45:0/1334151029 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39f415e010 con 0x7f39f41469a0 2023-11-28T18:38:55.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.329+0000 7f39f259c640 1 --2- 172.21.15.45:0/1334151029 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39f41469a0 0x7f39f406cab0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f39e40097c0 tx=0x7f39e401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7bcc60a35eb6832 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:55.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.329+0000 7f39f1d9b640 1 -- 172.21.15.45:0/1334151029 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e40ab600 con 0x7f39f41469a0 2023-11-28T18:38:55.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.329+0000 7f39f1d9b640 1 -- 172.21.15.45:0/1334151029 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39e40a7050 con 0x7f39f41469a0 2023-11-28T18:38:55.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.329+0000 7f39f1d9b640 1 -- 172.21.15.45:0/1334151029 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e40ab980 con 0x7f39f41469a0 2023-11-28T18:38:55.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.329+0000 7f39f8df8640 1 -- 172.21.15.45:0/1334151029 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39f41469a0 msgr2=0x7f39f406cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:55.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.329+0000 7f39f8df8640 1 --2- 172.21.15.45:0/1334151029 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39f41469a0 0x7f39f406cab0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f39e40097c0 tx=0x7f39e401c480 comp rx=0 tx=0).stop 2023-11-28T18:38:55.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.329+0000 7f39f8df8640 1 -- 172.21.15.45:0/1334151029 shutdown_connections 2023-11-28T18:38:55.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.329+0000 7f39f8df8640 1 --2- 172.21.15.45:0/1334151029 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f39f415fde0 0x7f39f40b4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:55.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.329+0000 7f39f8df8640 1 --2- 172.21.15.45:0/1334151029 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39f41469a0 0x7f39f406cab0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:55.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.329+0000 7f39f8df8640 1 -- 172.21.15.45:0/1334151029 >> 172.21.15.45:0/1334151029 conn(0x7f39f4070b80 msgr2=0x7f39f4066360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:55.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.329+0000 7f39f8df8640 1 -- 172.21.15.45:0/1334151029 shutdown_connections 2023-11-28T18:38:55.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.329+0000 7f39f8df8640 1 -- 172.21.15.45:0/1334151029 wait complete. 2023-11-28T18:38:55.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.329+0000 7f39f8df8640 1 Processor -- start 2023-11-28T18:38:55.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.329+0000 7f39f8df8640 1 -- start start 2023-11-28T18:38:55.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.333+0000 7f39f8df8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f39f40b4070 0x7f39f4166c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:55.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.333+0000 7f39f8df8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39f41469a0 0x7f39f40b0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:55.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.333+0000 7f39f8df8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f39f415fde0 0x7f39f413e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:55.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.333+0000 7f39f8df8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f41f6570 con 0x7f39f41469a0 2023-11-28T18:38:55.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.333+0000 7f39f8df8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f41f7320 con 0x7f39f415fde0 2023-11-28T18:38:55.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.333+0000 7f39f8df8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39f41f6750 con 0x7f39f40b4070 2023-11-28T18:38:55.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.333+0000 7f39ebfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39f41469a0 0x7f39f40b0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:55.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.333+0000 7f39ebfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39f41469a0 0x7f39f40b0f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39702/0 (socket says 172.21.15.45:39702) 2023-11-28T18:38:55.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.333+0000 7f39ebfff640 1 -- 172.21.15.45:0/1220472724 learned_addr learned my addr 172.21.15.45:0/1220472724 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:55.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.333+0000 7f39f259c640 1 --2- 172.21.15.45:0/1220472724 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f39f40b4070 0x7f39f4166c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:55.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.333+0000 7f39f2d9d640 1 --2- 172.21.15.45:0/1220472724 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f39f415fde0 0x7f39f413e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:55.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.333+0000 7f39ebfff640 1 -- 172.21.15.45:0/1220472724 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f39f40b4070 msgr2=0x7f39f4166c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:55.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.333+0000 7f39ebfff640 1 --2- 172.21.15.45:0/1220472724 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f39f40b4070 0x7f39f4166c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:55.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.333+0000 7f39ebfff640 1 -- 172.21.15.45:0/1220472724 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f39f415fde0 msgr2=0x7f39f413e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:55.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.333+0000 7f39ebfff640 1 --2- 172.21.15.45:0/1220472724 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f39f415fde0 0x7f39f413e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:55.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.333+0000 7f39ebfff640 1 -- 172.21.15.45:0/1220472724 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39e4009420 con 0x7f39f41469a0 2023-11-28T18:38:55.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.333+0000 7f39ebfff640 1 --2- 172.21.15.45:0/1220472724 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39f41469a0 0x7f39f40b0f40 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f39dc00c400 tx=0x7f39dc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:55.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.333+0000 7f39eaffd640 1 -- 172.21.15.45:0/1220472724 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39dc005cf0 con 0x7f39f41469a0 2023-11-28T18:38:55.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.333+0000 7f39eaffd640 1 -- 172.21.15.45:0/1220472724 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39dc005e50 con 0x7f39f41469a0 2023-11-28T18:38:55.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.333+0000 7f39eaffd640 1 -- 172.21.15.45:0/1220472724 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39dc0072d0 con 0x7f39f41469a0 2023-11-28T18:38:55.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.333+0000 7f39f8df8640 1 -- 172.21.15.45:0/1220472724 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39f41f69f0 con 0x7f39f41469a0 2023-11-28T18:38:55.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.333+0000 7f39f8df8640 1 -- 172.21.15.45:0/1220472724 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39f41f6fb0 con 0x7f39f41469a0 2023-11-28T18:38:55.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.333+0000 7f39f8df8640 1 -- 172.21.15.45:0/1220472724 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39f4069410 con 0x7f39f41469a0 2023-11-28T18:38:55.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.333+0000 7f39eaffd640 1 -- 172.21.15.45:0/1220472724 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f39dc007430 con 0x7f39f41469a0 2023-11-28T18:38:55.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.337+0000 7f39eaffd640 1 --2- 172.21.15.45:0/1220472724 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f39d40668d0 0x7f39d4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:55.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.337+0000 7f39eaffd640 1 -- 172.21.15.45:0/1220472724 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f39dc083960 con 0x7f39f41469a0 2023-11-28T18:38:55.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.337+0000 7f39f259c640 1 --2- 172.21.15.45:0/1220472724 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f39d40668d0 0x7f39d4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:55.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.337+0000 7f39f259c640 1 --2- 172.21.15.45:0/1220472724 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f39d40668d0 0x7f39d4068d90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f39e40ad000 tx=0x7f39e4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:55.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.341+0000 7f39eaffd640 1 -- 172.21.15.45:0/1220472724 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f39dc050bb0 con 0x7f39f41469a0 2023-11-28T18:38:55.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.493+0000 7f39f8df8640 1 -- 172.21.15.45:0/1220472724 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f39f40d1920 con 0x7f39f41469a0 2023-11-28T18:38:55.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.497+0000 7f39eaffd640 1 -- 172.21.15.45:0/1220472724 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v34) v1 ==== 104+0+11 (secure 0 0 0) 0x7f39dc017020 con 0x7f39f41469a0 2023-11-28T18:38:55.499 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-11-28T18:38:55.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.497+0000 7f39f8df8640 1 -- 172.21.15.45:0/1220472724 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f39d40668d0 msgr2=0x7f39d4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:55.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.497+0000 7f39f8df8640 1 --2- 172.21.15.45:0/1220472724 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f39d40668d0 0x7f39d4068d90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f39e40ad000 tx=0x7f39e4008040 comp rx=0 tx=0).stop 2023-11-28T18:38:55.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.497+0000 7f39f8df8640 1 -- 172.21.15.45:0/1220472724 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39f41469a0 msgr2=0x7f39f40b0f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:55.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.497+0000 7f39f8df8640 1 --2- 172.21.15.45:0/1220472724 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39f41469a0 0x7f39f40b0f40 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f39dc00c400 tx=0x7f39dc00c8c0 comp rx=0 tx=0).stop 2023-11-28T18:38:55.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.497+0000 7f39f8df8640 1 -- 172.21.15.45:0/1220472724 shutdown_connections 2023-11-28T18:38:55.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.497+0000 7f39f8df8640 1 --2- 172.21.15.45:0/1220472724 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f39d40668d0 0x7f39d4068d90 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:55.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.497+0000 7f39f8df8640 1 --2- 172.21.15.45:0/1220472724 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f39f415fde0 0x7f39f413e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:55.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.497+0000 7f39f8df8640 1 --2- 172.21.15.45:0/1220472724 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39f41469a0 0x7f39f40b0f40 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:55.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.497+0000 7f39f8df8640 1 --2- 172.21.15.45:0/1220472724 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f39f40b4070 0x7f39f4166c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:55.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.497+0000 7f39f8df8640 1 -- 172.21.15.45:0/1220472724 >> 172.21.15.45:0/1220472724 conn(0x7f39f4070b80 msgr2=0x7f39f406e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:55.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.497+0000 7f39f8df8640 1 -- 172.21.15.45:0/1220472724 shutdown_connections 2023-11-28T18:38:55.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.497+0000 7f39f8df8640 1 -- 172.21.15.45:0/1220472724 wait complete. 2023-11-28T18:38:55.520 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T18:38:55.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.661+0000 7ff20d11d640 1 Processor -- start 2023-11-28T18:38:55.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.661+0000 7ff20d11d640 1 -- start start 2023-11-28T18:38:55.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.665+0000 7ff20d11d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff2081469a0 0x7ff20806cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:55.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.665+0000 7ff20d11d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff20815fde0 0x7ff2080b4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:55.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.665+0000 7ff20d11d640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff20815e940 con 0x7ff2080b4070 2023-11-28T18:38:55.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.665+0000 7ff20d11d640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2080b4a40 con 0x7ff20815fde0 2023-11-28T18:38:55.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.665+0000 7ff20d11d640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff20815dd30 con 0x7ff2081469a0 2023-11-28T18:38:55.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.665+0000 7ff20759e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff20815fde0 0x7ff2080b4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:55.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.665+0000 7ff20759e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff20815fde0 0x7ff2080b4500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39714/0 (socket says 172.21.15.45:39714) 2023-11-28T18:38:55.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.665+0000 7ff20759e640 1 -- 172.21.15.45:0/476085529 learned_addr learned my addr 172.21.15.45:0/476085529 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:55.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.665+0000 7ff206d9d640 1 --2- 172.21.15.45:0/476085529 >> v2:172.21.15.190:3300/0 conn(0x7ff2081469a0 0x7ff20806cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:55.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.665+0000 7ff20759e640 1 -- 172.21.15.45:0/476085529 >> v2:172.21.15.190:3300/0 conn(0x7ff2081469a0 msgr2=0x7ff20806cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:55.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.665+0000 7ff20759e640 1 --2- 172.21.15.45:0/476085529 >> v2:172.21.15.190:3300/0 conn(0x7ff2081469a0 0x7ff20806cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:55.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.665+0000 7ff20759e640 1 -- 172.21.15.45:0/476085529 >> v1:172.21.15.190:6789/0 conn(0x7ff2080b4070 legacy=0x7ff20806e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:55.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.665+0000 7ff20759e640 1 -- 172.21.15.45:0/476085529 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff20815e010 con 0x7ff20815fde0 2023-11-28T18:38:55.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.669+0000 7ff20759e640 1 --2- 172.21.15.45:0/476085529 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff20815fde0 0x7ff2080b4500 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7ff208066e10 tx=0x7ff20001c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d43dd45ffd8fedf2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:55.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.669+0000 7ff20659c640 1 -- 172.21.15.45:0/476085529 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2000a56a0 con 0x7ff20815fde0 2023-11-28T18:38:55.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.669+0000 7ff20659c640 1 -- 172.21.15.45:0/476085529 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2000a5800 con 0x7ff20815fde0 2023-11-28T18:38:55.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.669+0000 7ff20659c640 1 -- 172.21.15.45:0/476085529 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2000a5b90 con 0x7ff20815fde0 2023-11-28T18:38:55.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.669+0000 7ff20d11d640 1 -- 172.21.15.45:0/476085529 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff20815fde0 msgr2=0x7ff2080b4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:55.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.669+0000 7ff20d11d640 1 --2- 172.21.15.45:0/476085529 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff20815fde0 0x7ff2080b4500 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7ff208066e10 tx=0x7ff20001c9d0 comp rx=0 tx=0).stop 2023-11-28T18:38:55.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.669+0000 7ff20d11d640 1 -- 172.21.15.45:0/476085529 shutdown_connections 2023-11-28T18:38:55.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.669+0000 7ff20d11d640 1 --2- 172.21.15.45:0/476085529 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff20815fde0 0x7ff2080b4500 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:55.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.669+0000 7ff20d11d640 1 --2- 172.21.15.45:0/476085529 >> v2:172.21.15.190:3300/0 conn(0x7ff2081469a0 0x7ff20806cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:55.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.669+0000 7ff20d11d640 1 -- 172.21.15.45:0/476085529 >> 172.21.15.45:0/476085529 conn(0x7ff208070b80 msgr2=0x7ff208066360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:55.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.669+0000 7ff20d11d640 1 -- 172.21.15.45:0/476085529 shutdown_connections 2023-11-28T18:38:55.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.669+0000 7ff20d11d640 1 -- 172.21.15.45:0/476085529 wait complete. 2023-11-28T18:38:55.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.669+0000 7ff20d11d640 1 Processor -- start 2023-11-28T18:38:55.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.669+0000 7ff20d11d640 1 -- start start 2023-11-28T18:38:55.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.673+0000 7ff20d11d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff2080b4070 0x7ff20815b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:55.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.673+0000 7ff20d11d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff2081469a0 0x7ff208166ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:55.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.673+0000 7ff20d11d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff20815fde0 0x7ff20813eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:55.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.673+0000 7ff20d11d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff20815cba0 con 0x7ff20815fde0 2023-11-28T18:38:55.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.673+0000 7ff20d11d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff208167020 con 0x7ff2081469a0 2023-11-28T18:38:55.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.673+0000 7ff20d11d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff20815bf90 con 0x7ff2080b4070 2023-11-28T18:38:55.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.673+0000 7ff20759e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff20815fde0 0x7ff20813eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:55.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.673+0000 7ff206d9d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff2080b4070 0x7ff20815b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:55.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.673+0000 7ff20759e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff20815fde0 0x7ff20813eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39724/0 (socket says 172.21.15.45:39724) 2023-11-28T18:38:55.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.673+0000 7ff20759e640 1 -- 172.21.15.45:0/1620085781 learned_addr learned my addr 172.21.15.45:0/1620085781 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:55.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.673+0000 7ff1fffff640 1 --2- 172.21.15.45:0/1620085781 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff2081469a0 0x7ff208166ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:55.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.673+0000 7ff20759e640 1 -- 172.21.15.45:0/1620085781 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff2080b4070 msgr2=0x7ff20815b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:55.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.673+0000 7ff20759e640 1 --2- 172.21.15.45:0/1620085781 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff2080b4070 0x7ff20815b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:55.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.673+0000 7ff20759e640 1 -- 172.21.15.45:0/1620085781 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff2081469a0 msgr2=0x7ff208166ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:55.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.673+0000 7ff20759e640 1 --2- 172.21.15.45:0/1620085781 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff2081469a0 0x7ff208166ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:55.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.673+0000 7ff20759e640 1 -- 172.21.15.45:0/1620085781 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff200009b30 con 0x7ff20815fde0 2023-11-28T18:38:55.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.673+0000 7ff206d9d640 1 --2- 172.21.15.45:0/1620085781 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff2080b4070 0x7ff20815b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:38:55.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.673+0000 7ff20759e640 1 --2- 172.21.15.45:0/1620085781 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff20815fde0 0x7ff20813eab0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7ff2000af040 tx=0x7ff200019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:55.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.673+0000 7ff1ff7fe640 1 -- 172.21.15.45:0/1620085781 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2000b8670 con 0x7ff20815fde0 2023-11-28T18:38:55.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.673+0000 7ff1ff7fe640 1 -- 172.21.15.45:0/1620085781 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2000b8810 con 0x7ff20815fde0 2023-11-28T18:38:55.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.673+0000 7ff20d11d640 1 -- 172.21.15.45:0/1620085781 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff20815c270 con 0x7ff20815fde0 2023-11-28T18:38:55.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.673+0000 7ff1ff7fe640 1 -- 172.21.15.45:0/1620085781 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2000b8bc0 con 0x7ff20815fde0 2023-11-28T18:38:55.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.673+0000 7ff20d11d640 1 -- 172.21.15.45:0/1620085781 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff20815c830 con 0x7ff20815fde0 2023-11-28T18:38:55.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.673+0000 7ff20d11d640 1 -- 172.21.15.45:0/1620085781 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff208162140 con 0x7ff20815fde0 2023-11-28T18:38:55.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.673+0000 7ff1ff7fe640 1 -- 172.21.15.45:0/1620085781 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ff2000b8d20 con 0x7ff20815fde0 2023-11-28T18:38:55.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.677+0000 7ff1ff7fe640 1 --2- 172.21.15.45:0/1620085781 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff1e80668d0 0x7ff1e8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:55.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.677+0000 7ff1ff7fe640 1 -- 172.21.15.45:0/1620085781 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff20011f7a0 con 0x7ff20815fde0 2023-11-28T18:38:55.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.677+0000 7ff206d9d640 1 --2- 172.21.15.45:0/1620085781 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff1e80668d0 0x7ff1e8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:55.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.677+0000 7ff206d9d640 1 --2- 172.21.15.45:0/1620085781 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff1e80668d0 0x7ff1e8068d90 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff1f8009f50 tx=0x7ff1f8009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:55.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.681+0000 7ff1ff7fe640 1 -- 172.21.15.45:0/1620085781 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff208162140 con 0x7ff20815fde0 2023-11-28T18:38:55.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.837+0000 7ff20d11d640 1 -- 172.21.15.45:0/1620085781 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff208162140 con 0x7ff20815fde0 2023-11-28T18:38:55.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.837+0000 7ff1ff7fe640 1 -- 172.21.15.45:0/1620085781 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v34) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff208162140 con 0x7ff20815fde0 2023-11-28T18:38:55.839 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-11-28T18:38:55.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.837+0000 7ff20d11d640 1 -- 172.21.15.45:0/1620085781 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff1e80668d0 msgr2=0x7ff1e8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:55.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.837+0000 7ff20d11d640 1 --2- 172.21.15.45:0/1620085781 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff1e80668d0 0x7ff1e8068d90 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff1f8009f50 tx=0x7ff1f8009190 comp rx=0 tx=0).stop 2023-11-28T18:38:55.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.837+0000 7ff20d11d640 1 -- 172.21.15.45:0/1620085781 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff20815fde0 msgr2=0x7ff20813eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:55.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.837+0000 7ff20d11d640 1 --2- 172.21.15.45:0/1620085781 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff20815fde0 0x7ff20813eab0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7ff2000af040 tx=0x7ff200019770 comp rx=0 tx=0).stop 2023-11-28T18:38:55.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.837+0000 7ff20d11d640 1 -- 172.21.15.45:0/1620085781 shutdown_connections 2023-11-28T18:38:55.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.837+0000 7ff20d11d640 1 --2- 172.21.15.45:0/1620085781 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff1e80668d0 0x7ff1e8068d90 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:55.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.837+0000 7ff20d11d640 1 --2- 172.21.15.45:0/1620085781 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff20815fde0 0x7ff20813eab0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:55.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.837+0000 7ff20d11d640 1 --2- 172.21.15.45:0/1620085781 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff2081469a0 0x7ff208166ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:55.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.837+0000 7ff20d11d640 1 --2- 172.21.15.45:0/1620085781 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff2080b4070 0x7ff20815b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:55.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.837+0000 7ff20d11d640 1 -- 172.21.15.45:0/1620085781 >> 172.21.15.45:0/1620085781 conn(0x7ff208070b80 msgr2=0x7ff20813f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:55.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.837+0000 7ff20d11d640 1 -- 172.21.15.45:0/1620085781 shutdown_connections 2023-11-28T18:38:55.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:55.837+0000 7ff20d11d640 1 -- 172.21.15.45:0/1620085781 wait complete. 2023-11-28T18:38:55.861 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T18:38:56.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:56.001+0000 7fdf849aa640 1 Processor -- start 2023-11-28T18:38:56.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:56.001+0000 7fdf849aa640 1 -- start start 2023-11-28T18:38:56.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:56.001+0000 7fdf849aa640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdf8006ca10 0x7fdf80145290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:56.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:56.001+0000 7fdf849aa640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdf8015c0b0 0x7fdf801457d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:56.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:56.001+0000 7fdf849aa640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf80146000 con 0x7fdf8015bcd0 2023-11-28T18:38:56.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:56.001+0000 7fdf849aa640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf801462e0 con 0x7fdf8015c0b0 2023-11-28T18:38:56.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:56.001+0000 7fdf849aa640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf801465c0 con 0x7fdf8006ca10 2023-11-28T18:38:56.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:56.005+0000 7fdf7ed9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdf8015c0b0 0x7fdf801457d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:56.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:56.005+0000 7fdf7e59c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fdf8015bcd0 0x7fdf8006c300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:60442/0 (socket says 172.21.15.45:60442) 2023-11-28T18:38:56.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:56.005+0000 7fdf77fff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdf8006ca10 0x7fdf80145290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:56.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:56.005+0000 7fdf7e59c640 1 -- 172.21.15.45:0/731658843 learned_addr learned my addr 172.21.15.45:0/731658843 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:38:56.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:56.005+0000 7fdf7ed9d640 1 -- 172.21.15.45:0/731658843 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdf8006ca10 msgr2=0x7fdf80145290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:38:56.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:56.005+0000 7fdf7ed9d640 1 --2- 172.21.15.45:0/731658843 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdf8006ca10 0x7fdf80145290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:56.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:56.005+0000 7fdf7ed9d640 1 -- 172.21.15.45:0/731658843 >> v1:172.21.15.45:6789/0 conn(0x7fdf8015bcd0 legacy=0x7fdf8006c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:56.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:56.005+0000 7fdf7ed9d640 1 -- 172.21.15.45:0/731658843 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf801468a0 con 0x7fdf8015c0b0 2023-11-28T18:38:56.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:56.005+0000 7fdf7dd9b640 1 -- 172.21.15.45:0/731658843 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 963936485 0 0) 0x7fdf80146000 con 0x7fdf8015bcd0 2023-11-28T18:38:56.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:56.005+0000 7fdf7ed9d640 1 --2- 172.21.15.45:0/731658843 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf8015c0b0 0x7fdf801457d0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fdf78009d90 tx=0x7fdf7801c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e0d15d4a1f51185 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:56.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:56.005+0000 7fdf7dd9b640 1 -- 172.21.15.45:0/731658843 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf780a5930 con 0x7fdf8015c0b0 2023-11-28T18:38:56.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:56.005+0000 7fdf7dd9b640 1 -- 172.21.15.45:0/731658843 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf780a5a90 con 0x7fdf8015c0b0 2023-11-28T18:38:56.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:56.005+0000 7fdf7dd9b640 1 -- 172.21.15.45:0/731658843 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf780a5e20 con 0x7fdf8015c0b0 2023-11-28T18:38:56.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:56.009+0000 7fdf849aa640 1 -- 172.21.15.45:0/731658843 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf8015c0b0 msgr2=0x7fdf801457d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:56.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:56.009+0000 7fdf849aa640 1 --2- 172.21.15.45:0/731658843 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf8015c0b0 0x7fdf801457d0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fdf78009d90 tx=0x7fdf7801c890 comp rx=0 tx=0).stop 2023-11-28T18:38:56.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:56.009+0000 7fdf849aa640 1 -- 172.21.15.45:0/731658843 shutdown_connections 2023-11-28T18:38:56.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:56.009+0000 7fdf849aa640 1 --2- 172.21.15.45:0/731658843 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf8015c0b0 0x7fdf801457d0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:56.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:56.009+0000 7fdf849aa640 1 --2- 172.21.15.45:0/731658843 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdf8006ca10 0x7fdf80145290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:56.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:56.009+0000 7fdf849aa640 1 -- 172.21.15.45:0/731658843 >> 172.21.15.45:0/731658843 conn(0x7fdf8006a570 msgr2=0x7fdf8006a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:56.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:56.009+0000 7fdf849aa640 1 -- 172.21.15.45:0/731658843 shutdown_connections 2023-11-28T18:38:56.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:56.009+0000 7fdf849aa640 1 -- 172.21.15.45:0/731658843 wait complete. 2023-11-28T18:38:56.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:56.009+0000 7fdf849aa640 1 Processor -- start 2023-11-28T18:38:56.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:56.009+0000 7fdf849aa640 1 -- start start 2023-11-28T18:38:56.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:56.009+0000 7fdf849aa640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdf8006ca10 0x7fdf80142320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:56.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:56.009+0000 7fdf849aa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf8015bcd0 0x7fdf800ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:56.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:56.009+0000 7fdf849aa640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdf8015c0b0 0x7fdf8013f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:56.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:56.009+0000 7fdf849aa640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8013fb40 con 0x7fdf8015bcd0 2023-11-28T18:38:56.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:56.009+0000 7fdf849aa640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf800cecb0 con 0x7fdf8006ca10 2023-11-28T18:38:56.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:56.009+0000 7fdf849aa640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf800ce410 con 0x7fdf8015c0b0 2023-11-28T18:38:56.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:56.009+0000 7fdf77fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf8015bcd0 0x7fdf800ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:56.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:56.009+0000 7fdf77fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf8015bcd0 0x7fdf800ccb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39738/0 (socket says 172.21.15.45:39738) 2023-11-28T18:38:56.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:56.009+0000 7fdf77fff640 1 -- 172.21.15.45:0/2264634741 learned_addr learned my addr 172.21.15.45:0/2264634741 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:38:56.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:56.009+0000 7fdf7ed9d640 1 --2- 172.21.15.45:0/2264634741 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdf8015c0b0 0x7fdf8013f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:56.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:56.009+0000 7fdf7e59c640 1 --2- 172.21.15.45:0/2264634741 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdf8006ca10 0x7fdf80142320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:56.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:56.013+0000 7fdf77fff640 1 -- 172.21.15.45:0/2264634741 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdf8015c0b0 msgr2=0x7fdf8013f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:56.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:56.013+0000 7fdf77fff640 1 --2- 172.21.15.45:0/2264634741 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdf8015c0b0 0x7fdf8013f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:56.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:56.013+0000 7fdf77fff640 1 -- 172.21.15.45:0/2264634741 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdf8006ca10 msgr2=0x7fdf80142320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:56.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:56.013+0000 7fdf77fff640 1 --2- 172.21.15.45:0/2264634741 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdf8006ca10 0x7fdf80142320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:56.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:56.013+0000 7fdf77fff640 1 -- 172.21.15.45:0/2264634741 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf78009a70 con 0x7fdf8015bcd0 2023-11-28T18:38:56.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:56.013+0000 7fdf7e59c640 1 --2- 172.21.15.45:0/2264634741 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdf8006ca10 0x7fdf80142320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:38:56.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:56.013+0000 7fdf77fff640 1 --2- 172.21.15.45:0/2264634741 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf8015bcd0 0x7fdf800ccb90 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fdf6800e930 tx=0x7fdf6800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:56.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:56.013+0000 7fdf76ffd640 1 -- 172.21.15.45:0/2264634741 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf68009690 con 0x7fdf8015bcd0 2023-11-28T18:38:56.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:56.013+0000 7fdf76ffd640 1 -- 172.21.15.45:0/2264634741 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf6800ca00 con 0x7fdf8015bcd0 2023-11-28T18:38:56.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:56.013+0000 7fdf76ffd640 1 -- 172.21.15.45:0/2264634741 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6800cd70 con 0x7fdf8015bcd0 2023-11-28T18:38:56.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:56.013+0000 7fdf849aa640 1 -- 172.21.15.45:0/2264634741 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf800ce6f0 con 0x7fdf8015bcd0 2023-11-28T18:38:56.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:56.013+0000 7fdf849aa640 1 -- 172.21.15.45:0/2264634741 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf80142a20 con 0x7fdf8015bcd0 2023-11-28T18:38:56.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:56.013+0000 7fdf849aa640 1 -- 172.21.15.45:0/2264634741 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf80069480 con 0x7fdf8015bcd0 2023-11-28T18:38:56.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:56.013+0000 7fdf76ffd640 1 -- 172.21.15.45:0/2264634741 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fdf68013470 con 0x7fdf8015bcd0 2023-11-28T18:38:56.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:56.013+0000 7fdf76ffd640 1 --2- 172.21.15.45:0/2264634741 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fdf60066900 0x7fdf60068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:38:56.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:56.013+0000 7fdf76ffd640 1 -- 172.21.15.45:0/2264634741 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdf68084640 con 0x7fdf8015bcd0 2023-11-28T18:38:56.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:56.017+0000 7fdf7e59c640 1 --2- 172.21.15.45:0/2264634741 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fdf60066900 0x7fdf60068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:38:56.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:56.017+0000 7fdf7e59c640 1 --2- 172.21.15.45:0/2264634741 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fdf60066900 0x7fdf60068dc0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fdf70007fd0 tx=0x7fdf70007c20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:38:56.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:56.017+0000 7fdf76ffd640 1 -- 172.21.15.45:0/2264634741 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdf680519e0 con 0x7fdf8015bcd0 2023-11-28T18:38:56.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:56.189+0000 7fdf849aa640 1 -- 172.21.15.45:0/2264634741 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fdf800ae990 con 0x7fdf8015bcd0 2023-11-28T18:38:56.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:56.189+0000 7fdf76ffd640 1 -- 172.21.15.45:0/2264634741 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v34) v1 ==== 80+0+0 (secure 0 0 0) 0x7fdf68055000 con 0x7fdf8015bcd0 2023-11-28T18:38:56.193 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-11-28T18:38:56.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:56.193+0000 7fdf849aa640 1 -- 172.21.15.45:0/2264634741 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fdf60066900 msgr2=0x7fdf60068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:56.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:56.193+0000 7fdf849aa640 1 --2- 172.21.15.45:0/2264634741 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fdf60066900 0x7fdf60068dc0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fdf70007fd0 tx=0x7fdf70007c20 comp rx=0 tx=0).stop 2023-11-28T18:38:56.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:56.193+0000 7fdf849aa640 1 -- 172.21.15.45:0/2264634741 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf8015bcd0 msgr2=0x7fdf800ccb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:38:56.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:56.193+0000 7fdf849aa640 1 --2- 172.21.15.45:0/2264634741 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf8015bcd0 0x7fdf800ccb90 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fdf6800e930 tx=0x7fdf6800edf0 comp rx=0 tx=0).stop 2023-11-28T18:38:56.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:56.193+0000 7fdf849aa640 1 -- 172.21.15.45:0/2264634741 shutdown_connections 2023-11-28T18:38:56.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:56.193+0000 7fdf849aa640 1 --2- 172.21.15.45:0/2264634741 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fdf60066900 0x7fdf60068dc0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:56.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:56.193+0000 7fdf849aa640 1 --2- 172.21.15.45:0/2264634741 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdf8015c0b0 0x7fdf8013f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:56.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:56.193+0000 7fdf849aa640 1 --2- 172.21.15.45:0/2264634741 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf8015bcd0 0x7fdf800ccb90 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:56.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:56.193+0000 7fdf849aa640 1 --2- 172.21.15.45:0/2264634741 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdf8006ca10 0x7fdf80142320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:38:56.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:56.193+0000 7fdf849aa640 1 -- 172.21.15.45:0/2264634741 >> 172.21.15.45:0/2264634741 conn(0x7fdf8006a570 msgr2=0x7fdf8006c300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:38:56.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:56.193+0000 7fdf849aa640 1 -- 172.21.15.45:0/2264634741 shutdown_connections 2023-11-28T18:38:56.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:38:56.193+0000 7fdf849aa640 1 -- 172.21.15.45:0/2264634741 wait complete. 2023-11-28T18:38:56.214 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi045.front.sepia.ceph.com... 2023-11-28T18:38:56.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:38:56.214 DEBUG:teuthology.orchestra.run.smithi045:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-28T18:38:56.234 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:ceph-fuse[47532]: fuse finished with error 0 and tester_r 0 2023-11-28T18:38:56.237 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T18:39:02.340 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi045.front.sepia.ceph.com 2023-11-28T18:39:02.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:39:02.341 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-28T18:39:02.353 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-28T18:39:02.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.549+0000 7f1cd6b0f640 1 Processor -- start 2023-11-28T18:39:02.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.549+0000 7f1cd6b0f640 1 -- start start 2023-11-28T18:39:02.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.549+0000 7f1cd6b0f640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f1cd013cf70 0x7f1cd006c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:02.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.549+0000 7f1cd6b0f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1cd015ad80 0x7f1cd00cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:02.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.549+0000 7f1cd6b0f640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cd015b1b0 con 0x7f1cd006c840 2023-11-28T18:39:02.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.549+0000 7f1cd6b0f640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cd013d350 con 0x7f1cd015ad80 2023-11-28T18:39:02.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.549+0000 7f1cd6b0f640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cd0140520 con 0x7f1cd013cf70 2023-11-28T18:39:02.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.549+0000 7f1cd50ac640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1cd015ad80 0x7f1cd00cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:02.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.549+0000 7f1cd50ac640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1cd015ad80 0x7f1cd00cd8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53546/0 (socket says 172.21.15.45:53546) 2023-11-28T18:39:02.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.549+0000 7f1ccffff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f1cd006c840 0x7f1cd015a670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:49902/0 (socket says 172.21.15.45:49902) 2023-11-28T18:39:02.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.549+0000 7f1cd50ac640 1 -- 172.21.15.45:0/1909632721 learned_addr learned my addr 172.21.15.45:0/1909632721 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:02.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.553+0000 7f1cd48ab640 1 --2- 172.21.15.45:0/1909632721 >> v2:172.21.15.190:3300/0 conn(0x7f1cd013cf70 0x7f1cd006c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:02.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.553+0000 7f1cd50ac640 1 -- 172.21.15.45:0/1909632721 >> v2:172.21.15.190:3300/0 conn(0x7f1cd013cf70 msgr2=0x7f1cd006c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:02.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.553+0000 7f1cd50ac640 1 --2- 172.21.15.45:0/1909632721 >> v2:172.21.15.190:3300/0 conn(0x7f1cd013cf70 0x7f1cd006c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:02.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.553+0000 7f1cd50ac640 1 -- 172.21.15.45:0/1909632721 >> v1:172.21.15.45:6789/0 conn(0x7f1cd006c840 legacy=0x7f1cd015a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:02.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.553+0000 7f1cd50ac640 1 -- 172.21.15.45:0/1909632721 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd015b3e0 con 0x7f1cd015ad80 2023-11-28T18:39:02.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.553+0000 7f1ccf7fe640 1 -- 172.21.15.45:0/1909632721 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3326006105 0 0) 0x7f1cd015b1b0 con 0x7f1cd006c840 2023-11-28T18:39:02.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.553+0000 7f1cd50ac640 1 --2- 172.21.15.45:0/1909632721 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1cd015ad80 0x7f1cd00cd8c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f1cd006b550 tx=0x7f1cc801c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b47f25473ce0a08 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:02.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.553+0000 7f1ccf7fe640 1 -- 172.21.15.45:0/1909632721 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc80a56f0 con 0x7f1cd015ad80 2023-11-28T18:39:02.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.553+0000 7f1ccf7fe640 1 -- 172.21.15.45:0/1909632721 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cc80a5850 con 0x7f1cd015ad80 2023-11-28T18:39:02.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.553+0000 7f1ccf7fe640 1 -- 172.21.15.45:0/1909632721 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc80a5be0 con 0x7f1cd015ad80 2023-11-28T18:39:02.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.557+0000 7f1cd6b0f640 1 -- 172.21.15.45:0/1909632721 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1cd015ad80 msgr2=0x7f1cd00cd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:02.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.557+0000 7f1cd6b0f640 1 --2- 172.21.15.45:0/1909632721 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1cd015ad80 0x7f1cd00cd8c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f1cd006b550 tx=0x7f1cc801c940 comp rx=0 tx=0).stop 2023-11-28T18:39:02.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.557+0000 7f1cd6b0f640 1 -- 172.21.15.45:0/1909632721 shutdown_connections 2023-11-28T18:39:02.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.557+0000 7f1cd6b0f640 1 --2- 172.21.15.45:0/1909632721 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1cd015ad80 0x7f1cd00cd8c0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:02.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.557+0000 7f1cd6b0f640 1 --2- 172.21.15.45:0/1909632721 >> v2:172.21.15.190:3300/0 conn(0x7f1cd013cf70 0x7f1cd006c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:02.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.557+0000 7f1cd6b0f640 1 -- 172.21.15.45:0/1909632721 >> 172.21.15.45:0/1909632721 conn(0x7f1cd006a570 msgr2=0x7f1cd006a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:02.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.557+0000 7f1cd6b0f640 1 -- 172.21.15.45:0/1909632721 shutdown_connections 2023-11-28T18:39:02.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.557+0000 7f1cd6b0f640 1 -- 172.21.15.45:0/1909632721 wait complete. 2023-11-28T18:39:02.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.557+0000 7f1cd6b0f640 1 Processor -- start 2023-11-28T18:39:02.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.557+0000 7f1cd6b0f640 1 -- start start 2023-11-28T18:39:02.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.557+0000 7f1cd6b0f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1cd006c840 0x7f1cd01363e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:02.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.557+0000 7f1cd6b0f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1cd013cf70 0x7f1cd00b3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:02.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.557+0000 7f1cd6b0f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1cd015ad80 0x7f1cd0159580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:02.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.557+0000 7f1cd6b0f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd0139000 con 0x7f1cd006c840 2023-11-28T18:39:02.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.557+0000 7f1cd6b0f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd013b2b0 con 0x7f1cd015ad80 2023-11-28T18:39:02.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.557+0000 7f1cd6b0f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd013b590 con 0x7f1cd013cf70 2023-11-28T18:39:02.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.557+0000 7f1cd48ab640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1cd006c840 0x7f1cd01363e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:02.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.557+0000 7f1cd48ab640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1cd006c840 0x7f1cd01363e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53560/0 (socket says 172.21.15.45:53560) 2023-11-28T18:39:02.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.557+0000 7f1cd48ab640 1 -- 172.21.15.45:0/4062504479 learned_addr learned my addr 172.21.15.45:0/4062504479 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:02.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.557+0000 7f1cd50ac640 1 --2- 172.21.15.45:0/4062504479 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1cd015ad80 0x7f1cd0159580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:02.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.557+0000 7f1ccffff640 1 --2- 172.21.15.45:0/4062504479 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1cd013cf70 0x7f1cd00b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:02.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.557+0000 7f1cd48ab640 1 -- 172.21.15.45:0/4062504479 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1cd013cf70 msgr2=0x7f1cd00b3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:02.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.557+0000 7f1cd48ab640 1 --2- 172.21.15.45:0/4062504479 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1cd013cf70 0x7f1cd00b3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:02.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.557+0000 7f1cd48ab640 1 -- 172.21.15.45:0/4062504479 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1cd015ad80 msgr2=0x7f1cd0159580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:02.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.557+0000 7f1cd48ab640 1 --2- 172.21.15.45:0/4062504479 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1cd015ad80 0x7f1cd0159580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:02.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.557+0000 7f1cd48ab640 1 -- 172.21.15.45:0/4062504479 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc8009b30 con 0x7f1cd006c840 2023-11-28T18:39:02.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.557+0000 7f1ccffff640 1 --2- 172.21.15.45:0/4062504479 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1cd013cf70 0x7f1cd00b3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:39:02.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.557+0000 7f1cd50ac640 1 --2- 172.21.15.45:0/4062504479 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1cd015ad80 0x7f1cd0159580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:39:02.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.561+0000 7f1cd48ab640 1 --2- 172.21.15.45:0/4062504479 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1cd006c840 0x7f1cd01363e0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f1cc400d800 tx=0x7f1cc400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:02.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.561+0000 7f1ccd7fa640 1 -- 172.21.15.45:0/4062504479 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc400b6c0 con 0x7f1cd006c840 2023-11-28T18:39:02.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.561+0000 7f1ccd7fa640 1 -- 172.21.15.45:0/4062504479 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cc400b820 con 0x7f1cd006c840 2023-11-28T18:39:02.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.561+0000 7f1ccd7fa640 1 -- 172.21.15.45:0/4062504479 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc400bb90 con 0x7f1cd006c840 2023-11-28T18:39:02.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.561+0000 7f1cd6b0f640 1 -- 172.21.15.45:0/4062504479 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cd013b870 con 0x7f1cd006c840 2023-11-28T18:39:02.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.561+0000 7f1cd6b0f640 1 -- 172.21.15.45:0/4062504479 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cd013be30 con 0x7f1cd006c840 2023-11-28T18:39:02.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.561+0000 7f1cd6b0f640 1 -- 172.21.15.45:0/4062504479 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cd0069480 con 0x7f1cd006c840 2023-11-28T18:39:02.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.561+0000 7f1ccd7fa640 1 -- 172.21.15.45:0/4062504479 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f1cc400bcf0 con 0x7f1cd006c840 2023-11-28T18:39:02.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.561+0000 7f1ccd7fa640 1 --2- 172.21.15.45:0/4062504479 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1cb40668d0 0x7f1cb4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:02.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.561+0000 7f1ccd7fa640 1 -- 172.21.15.45:0/4062504479 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1cc4084a40 con 0x7f1cd006c840 2023-11-28T18:39:02.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.565+0000 7f1ccffff640 1 --2- 172.21.15.45:0/4062504479 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1cb40668d0 0x7f1cb4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:02.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.565+0000 7f1ccffff640 1 --2- 172.21.15.45:0/4062504479 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1cb40668d0 0x7f1cb4068d90 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc007fd0 tx=0x7f1cbc007c20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:02.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.569+0000 7f1ccd7fa640 1 -- 172.21.15.45:0/4062504479 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1cc4051bf0 con 0x7f1cd006c840 2023-11-28T18:39:02.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.757+0000 7f1cd6b0f640 1 -- 172.21.15.45:0/4062504479 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f1cd006d220 con 0x7f1cd006c840 2023-11-28T18:39:02.761 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-11-28T18:39:02.757+0000 7f5668eb3640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-28T18:39:02.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.761+0000 7f1ccd7fa640 1 -- 172.21.15.45:0/4062504479 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v17) v1 ==== 161+0+0 (secure 0 0 0) 0x7f1cc4011340 con 0x7f1cd006c840 2023-11-28T18:39:02.763 INFO:teuthology.orchestra.run.smithi045.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-28T18:39:02.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.761+0000 7f1cd6b0f640 1 -- 172.21.15.45:0/4062504479 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1cb40668d0 msgr2=0x7f1cb4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:02.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.761+0000 7f1cd6b0f640 1 --2- 172.21.15.45:0/4062504479 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1cb40668d0 0x7f1cb4068d90 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc007fd0 tx=0x7f1cbc007c20 comp rx=0 tx=0).stop 2023-11-28T18:39:02.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.761+0000 7f1cd6b0f640 1 -- 172.21.15.45:0/4062504479 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1cd006c840 msgr2=0x7f1cd01363e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:02.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.761+0000 7f1cd6b0f640 1 --2- 172.21.15.45:0/4062504479 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1cd006c840 0x7f1cd01363e0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f1cc400d800 tx=0x7f1cc400dcc0 comp rx=0 tx=0).stop 2023-11-28T18:39:02.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.761+0000 7f1cd6b0f640 1 -- 172.21.15.45:0/4062504479 shutdown_connections 2023-11-28T18:39:02.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.761+0000 7f1cd6b0f640 1 --2- 172.21.15.45:0/4062504479 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1cb40668d0 0x7f1cb4068d90 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:02.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.761+0000 7f1cd6b0f640 1 --2- 172.21.15.45:0/4062504479 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1cd015ad80 0x7f1cd0159580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:02.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.761+0000 7f1cd6b0f640 1 --2- 172.21.15.45:0/4062504479 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1cd013cf70 0x7f1cd00b3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:02.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.761+0000 7f1cd6b0f640 1 --2- 172.21.15.45:0/4062504479 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1cd006c840 0x7f1cd01363e0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:02.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.761+0000 7f1cd6b0f640 1 -- 172.21.15.45:0/4062504479 >> 172.21.15.45:0/4062504479 conn(0x7f1cd006a570 msgr2=0x7f1cd015b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:02.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.761+0000 7f1cd6b0f640 1 -- 172.21.15.45:0/4062504479 shutdown_connections 2023-11-28T18:39:02.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.761+0000 7f1cd6b0f640 1 -- 172.21.15.45:0/4062504479 wait complete. 2023-11-28T18:39:02.787 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 10000000001.00000000 2023-11-28T18:39:02.832 INFO:tasks.ceph.mds.a.smithi045.stdout:starting mds.a at 2023-11-28T18:39:02.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.833+0000 7ff4c8108080 1 Processor -- start 2023-11-28T18:39:02.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.833+0000 7ff4c8108080 1 -- start start 2023-11-28T18:39:02.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.833+0000 7ff4c8108080 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557c1f321620 0x557c1f351470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:02.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.833+0000 7ff4c8108080 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c1f36f510 0x557c1f355250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:02.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.833+0000 7ff4c8108080 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557c1f3f9750 0x557c1f3f0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:02.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.833+0000 7ff4c8108080 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c1f2d4b80 con 0x557c1f36f510 2023-11-28T18:39:02.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.833+0000 7ff4c8108080 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c1f2d0470 con 0x557c1f3f9750 2023-11-28T18:39:02.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.833+0000 7ff4c8108080 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x557c1f2880c0 con 0x557c1f321620 2023-11-28T18:39:02.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.833+0000 7ff4c5428640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c1f36f510 0x557c1f355250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:02.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.833+0000 7ff4c5428640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c1f36f510 0x557c1f355250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53590/0 (socket says 172.21.15.45:53590) 2023-11-28T18:39:02.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.833+0000 7ff4c5c29640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557c1f321620 0x557c1f351470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:02.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.833+0000 7ff4c5428640 1 -- 172.21.15.45:0/946477883 learned_addr learned my addr 172.21.15.45:0/946477883 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:02.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.833+0000 7ff4c642a640 1 --2- 172.21.15.45:0/946477883 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557c1f3f9750 0x557c1f3f0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:02.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.833+0000 7ff4c5428640 1 -- 172.21.15.45:0/946477883 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557c1f321620 msgr2=0x557c1f351470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:02.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.833+0000 7ff4c5428640 1 --2- 172.21.15.45:0/946477883 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557c1f321620 0x557c1f351470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:02.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.833+0000 7ff4c5428640 1 -- 172.21.15.45:0/946477883 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557c1f3f9750 msgr2=0x557c1f3f0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:02.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.833+0000 7ff4c5428640 1 --2- 172.21.15.45:0/946477883 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557c1f3f9750 0x557c1f3f0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:02.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.833+0000 7ff4c5428640 1 -- 172.21.15.45:0/946477883 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4bc005d30 con 0x557c1f36f510 2023-11-28T18:39:02.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.837+0000 7ff4c5428640 1 --2- 172.21.15.45:0/946477883 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c1f36f510 0x557c1f355250 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc0ad040 tx=0x7ff4bc003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f3fbd76c66263c2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:02.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.837+0000 7ff4b7fff640 1 -- 172.21.15.45:0/946477883 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4bc009420 con 0x557c1f36f510 2023-11-28T18:39:02.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.837+0000 7ff4b7fff640 1 -- 172.21.15.45:0/946477883 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4bc009580 con 0x557c1f36f510 2023-11-28T18:39:02.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.837+0000 7ff4b7fff640 1 -- 172.21.15.45:0/946477883 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4bc009910 con 0x557c1f36f510 2023-11-28T18:39:02.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.837+0000 7ff4c8108080 1 -- 172.21.15.45:0/946477883 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c1f36f510 msgr2=0x557c1f355250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:02.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.837+0000 7ff4c8108080 1 --2- 172.21.15.45:0/946477883 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c1f36f510 0x557c1f355250 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc0ad040 tx=0x7ff4bc003030 comp rx=0 tx=0).stop 2023-11-28T18:39:02.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.837+0000 7ff4c8108080 1 -- 172.21.15.45:0/946477883 shutdown_connections 2023-11-28T18:39:02.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.837+0000 7ff4c8108080 1 --2- 172.21.15.45:0/946477883 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557c1f3f9750 0x557c1f3f0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:02.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.837+0000 7ff4c8108080 1 --2- 172.21.15.45:0/946477883 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c1f36f510 0x557c1f355250 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:02.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.837+0000 7ff4c8108080 1 --2- 172.21.15.45:0/946477883 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557c1f321620 0x557c1f351470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:02.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.837+0000 7ff4c8108080 1 -- 172.21.15.45:0/946477883 >> 172.21.15.45:0/946477883 conn(0x557c1f351090 msgr2=0x557c1f36f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:02.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.837+0000 7ff4c8108080 1 -- 172.21.15.45:0/946477883 shutdown_connections 2023-11-28T18:39:02.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.837+0000 7ff4c8108080 1 -- 172.21.15.45:0/946477883 wait complete. 2023-11-28T18:39:02.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.837+0000 7ff4c8108080 1 Processor -- start 2023-11-28T18:39:02.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.837+0000 7ff4c8108080 1 -- start start 2023-11-28T18:39:02.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.837+0000 7ff4c8108080 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557c1f321620 0x557c1f366780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:02.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.837+0000 7ff4c8108080 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557c1f36f510 0x557c1f3f50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:02.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.837+0000 7ff4c8108080 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c1f3f9750 0x557c1f3f55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:02.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.837+0000 7ff4c8108080 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c1f287d60 con 0x557c1f3f9750 2023-11-28T18:39:02.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.837+0000 7ff4c8108080 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c1f25e2c0 con 0x557c1f321620 2023-11-28T18:39:02.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.837+0000 7ff4c8108080 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x557c1f365860 con 0x557c1f36f510 2023-11-28T18:39:02.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.837+0000 7ff4c642a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c1f3f9750 0x557c1f3f55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:02.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.837+0000 7ff4c642a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c1f3f9750 0x557c1f3f55f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53604/0 (socket says 172.21.15.45:53604) 2023-11-28T18:39:02.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.837+0000 7ff4c642a640 1 -- 172.21.15.45:0/4201898261 learned_addr learned my addr 172.21.15.45:0/4201898261 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:02.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.837+0000 7ff4c5428640 1 --2- 172.21.15.45:0/4201898261 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557c1f36f510 0x557c1f3f50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:02.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.837+0000 7ff4c5c29640 1 --2- 172.21.15.45:0/4201898261 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557c1f321620 0x557c1f366780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:02.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.837+0000 7ff4c642a640 1 -- 172.21.15.45:0/4201898261 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557c1f36f510 msgr2=0x557c1f3f50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:02.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.837+0000 7ff4c642a640 1 --2- 172.21.15.45:0/4201898261 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557c1f36f510 0x557c1f3f50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:02.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.837+0000 7ff4c642a640 1 -- 172.21.15.45:0/4201898261 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557c1f321620 msgr2=0x557c1f366780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:02.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.837+0000 7ff4c642a640 1 --2- 172.21.15.45:0/4201898261 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557c1f321620 0x557c1f366780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:02.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.837+0000 7ff4c642a640 1 -- 172.21.15.45:0/4201898261 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557c1f276420 con 0x557c1f3f9750 2023-11-28T18:39:02.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.837+0000 7ff4c642a640 1 --2- 172.21.15.45:0/4201898261 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c1f3f9750 0x557c1f3f55f0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ff4c000d190 tx=0x7ff4c000d650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:02.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.841+0000 7ff4b6ffd640 1 -- 172.21.15.45:0/4201898261 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c000de80 con 0x557c1f3f9750 2023-11-28T18:39:02.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.841+0000 7ff4b6ffd640 1 -- 172.21.15.45:0/4201898261 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4c0006240 con 0x557c1f3f9750 2023-11-28T18:39:02.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.841+0000 7ff4b6ffd640 1 -- 172.21.15.45:0/4201898261 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c0003350 con 0x557c1f3f9750 2023-11-28T18:39:02.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.841+0000 7ff4c8108080 1 -- 172.21.15.45:0/4201898261 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557c1f2695d0 con 0x557c1f3f9750 2023-11-28T18:39:02.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.841+0000 7ff4c8108080 1 -- 172.21.15.45:0/4201898261 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557c1f269030 con 0x557c1f3f9750 2023-11-28T18:39:02.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.841+0000 7ff4b6ffd640 1 -- 172.21.15.45:0/4201898261 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ff4c0001640 con 0x557c1f3f9750 2023-11-28T18:39:02.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.841+0000 7ff4b6ffd640 1 --2- 172.21.15.45:0/4201898261 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff4a80652e0 0x7ff4a80677a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:02.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.841+0000 7ff4b6ffd640 1 -- 172.21.15.45:0/4201898261 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7ff4c00825b0 con 0x557c1f3f9750 2023-11-28T18:39:02.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.841+0000 7ff4c5c29640 1 --2- 172.21.15.45:0/4201898261 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff4a80652e0 0x7ff4a80677a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:02.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.841+0000 7ff4c8108080 1 --2- 172.21.15.45:0/4201898261 >> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] conn(0x557c1f366cc0 0x557c1f3ee180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:02.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.841+0000 7ff4c8108080 1 -- 172.21.15.45:0/4201898261 --> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] -- osd_op(unknown.0.0:1 4.7 4:e2e07930:::10000000001.00000000:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x557c1f365430 con 0x557c1f366cc0 2023-11-28T18:39:02.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.841+0000 7ff4c5428640 1 --2- 172.21.15.45:0/4201898261 >> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] conn(0x557c1f366cc0 0x557c1f3ee180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:02.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.841+0000 7ff4c5c29640 1 --2- 172.21.15.45:0/4201898261 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff4a80652e0 0x7ff4a80677a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff4b8004180 tx=0x7ff4b8010040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:02.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.845+0000 7ff4c5428640 1 --2- 172.21.15.45:0/4201898261 >> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] conn(0x557c1f366cc0 0x557c1f3ee180 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:02.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.845+0000 7ff4c5428640 1 -- 172.21.15.45:0/4201898261 <== osd.1 v2:172.21.15.45:6800/2857063763 1 ==== osd_op_reply(1 10000000001.00000000 [omap-get-keys] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x7ff4bc0c4040 con 0x557c1f366cc0 2023-11-28T18:39:02.850 INFO:teuthology.orchestra.run.smithi045.stderr:error getting omap key set cephfs_metadata/10000000001.00000000: (2) No such file or directory 2023-11-28T18:39:02.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.845+0000 7ff4c8108080 1 -- 172.21.15.45:0/4201898261 >> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] conn(0x557c1f366cc0 msgr2=0x557c1f3ee180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:02.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.845+0000 7ff4c8108080 1 --2- 172.21.15.45:0/4201898261 >> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] conn(0x557c1f366cc0 0x557c1f3ee180 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:02.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.845+0000 7ff4c8108080 1 -- 172.21.15.45:0/4201898261 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff4a80652e0 msgr2=0x7ff4a80677a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:02.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.845+0000 7ff4c8108080 1 --2- 172.21.15.45:0/4201898261 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff4a80652e0 0x7ff4a80677a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff4b8004180 tx=0x7ff4b8010040 comp rx=0 tx=0).stop 2023-11-28T18:39:02.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.845+0000 7ff4c8108080 1 -- 172.21.15.45:0/4201898261 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c1f3f9750 msgr2=0x557c1f3f55f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:02.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.845+0000 7ff4c8108080 1 --2- 172.21.15.45:0/4201898261 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c1f3f9750 0x557c1f3f55f0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ff4c000d190 tx=0x7ff4c000d650 comp rx=0 tx=0).stop 2023-11-28T18:39:02.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.845+0000 7ff4c642a640 1 -- 172.21.15.45:0/4201898261 reap_dead start 2023-11-28T18:39:02.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.845+0000 7ff4c8108080 1 -- 172.21.15.45:0/4201898261 shutdown_connections 2023-11-28T18:39:02.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.845+0000 7ff4c8108080 1 -- 172.21.15.45:0/4201898261 >> 172.21.15.45:0/4201898261 conn(0x557c1f351090 msgr2=0x557c1f36f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:02.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.845+0000 7ff4c8108080 1 -- 172.21.15.45:0/4201898261 shutdown_connections 2023-11-28T18:39:02.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.845+0000 7ff4c8108080 1 -- 172.21.15.45:0/4201898261 wait complete. 2023-11-28T18:39:02.852 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T18:39:02.852 ERROR:tasks.cephfs.filesystem:Command failed on smithi045 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 10000000001.00000000' 2023-11-28T18:39:02.853 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 1.00000000 2023-11-28T18:39:02.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.941+0000 7f2117633080 1 Processor -- start 2023-11-28T18:39:02.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.941+0000 7f2117633080 1 -- start start 2023-11-28T18:39:02.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.941+0000 7f2117633080 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5599e2af7620 0x5599e2bc76d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:02.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.941+0000 7f2117633080 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5599e2b45510 0x5599e2bcab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:02.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.941+0000 7f2117633080 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5599e2bcf750 0x5599e2bcb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:02.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.941+0000 7f2117633080 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599e2aa6470 con 0x5599e2bcf750 2023-11-28T18:39:02.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.941+0000 7f2117633080 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599e2a5e0c0 con 0x5599e2b45510 2023-11-28T18:39:02.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.941+0000 7f2117633080 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x5599e2a5dd60 con 0x5599e2af7620 2023-11-28T18:39:02.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.945+0000 7f2115953640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5599e2bcf750 0x5599e2bcb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:02.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.945+0000 7f2115953640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5599e2bcf750 0x5599e2bcb040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53632/0 (socket says 172.21.15.45:53632) 2023-11-28T18:39:02.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.945+0000 7f2115953640 1 -- 172.21.15.45:0/602871886 learned_addr learned my addr 172.21.15.45:0/602871886 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:02.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.945+0000 7f2115152640 1 --2- 172.21.15.45:0/602871886 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5599e2af7620 0x5599e2bc76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:02.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.945+0000 7f2114951640 1 --2- 172.21.15.45:0/602871886 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5599e2b45510 0x5599e2bcab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:02.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.945+0000 7f2115953640 1 -- 172.21.15.45:0/602871886 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5599e2af7620 msgr2=0x5599e2bc76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:02.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.945+0000 7f2115953640 1 --2- 172.21.15.45:0/602871886 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5599e2af7620 0x5599e2bc76d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:02.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.945+0000 7f2115953640 1 -- 172.21.15.45:0/602871886 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5599e2b45510 msgr2=0x5599e2bcab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:02.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.945+0000 7f2115953640 1 --2- 172.21.15.45:0/602871886 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5599e2b45510 0x5599e2bcab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:02.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.945+0000 7f2115953640 1 -- 172.21.15.45:0/602871886 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f211000a100 con 0x5599e2bcf750 2023-11-28T18:39:02.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.945+0000 7f2115152640 1 --2- 172.21.15.45:0/602871886 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5599e2af7620 0x5599e2bc76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:39:02.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.945+0000 7f2115953640 1 --2- 172.21.15.45:0/602871886 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5599e2bcf750 0x5599e2bcb040 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f21100ae040 tx=0x7f21100033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=affabc12acba968c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:02.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.945+0000 7f21077fe640 1 -- 172.21.15.45:0/602871886 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21100ab640 con 0x5599e2bcf750 2023-11-28T18:39:02.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.945+0000 7f21077fe640 1 -- 172.21.15.45:0/602871886 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21100ab7a0 con 0x5599e2bcf750 2023-11-28T18:39:02.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.945+0000 7f21077fe640 1 -- 172.21.15.45:0/602871886 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21100abb10 con 0x5599e2bcf750 2023-11-28T18:39:02.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.945+0000 7f2117633080 1 -- 172.21.15.45:0/602871886 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5599e2bcf750 msgr2=0x5599e2bcb040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:02.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.945+0000 7f2117633080 1 --2- 172.21.15.45:0/602871886 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5599e2bcf750 0x5599e2bcb040 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f21100ae040 tx=0x7f21100033b0 comp rx=0 tx=0).stop 2023-11-28T18:39:02.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.945+0000 7f2117633080 1 -- 172.21.15.45:0/602871886 shutdown_connections 2023-11-28T18:39:02.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.945+0000 7f2117633080 1 --2- 172.21.15.45:0/602871886 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5599e2bcf750 0x5599e2bcb040 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:02.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.945+0000 7f2117633080 1 --2- 172.21.15.45:0/602871886 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5599e2b45510 0x5599e2bcab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:02.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.945+0000 7f2117633080 1 --2- 172.21.15.45:0/602871886 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5599e2af7620 0x5599e2bc76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:02.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.945+0000 7f2117633080 1 -- 172.21.15.45:0/602871886 >> 172.21.15.45:0/602871886 conn(0x5599e2b27090 msgr2=0x5599e2b40a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:02.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.945+0000 7f2117633080 1 -- 172.21.15.45:0/602871886 shutdown_connections 2023-11-28T18:39:02.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.945+0000 7f2117633080 1 -- 172.21.15.45:0/602871886 wait complete. 2023-11-28T18:39:02.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.945+0000 7f2117633080 1 Processor -- start 2023-11-28T18:39:02.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.945+0000 7f2117633080 1 -- start start 2023-11-28T18:39:02.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.945+0000 7f2117633080 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5599e2af7620 0x5599e2bc4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:02.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.945+0000 7f2117633080 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5599e2b45510 0x5599e2bc78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:02.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.945+0000 7f2117633080 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5599e2bcf750 0x5599e2bc10c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:02.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.945+0000 7f2117633080 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599e2a342c0 con 0x5599e2bcf750 2023-11-28T18:39:02.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.945+0000 7f2117633080 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599e2bc9380 con 0x5599e2af7620 2023-11-28T18:39:02.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.945+0000 7f2117633080 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x5599e2bc95b0 con 0x5599e2b45510 2023-11-28T18:39:02.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.945+0000 7f2115953640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5599e2bcf750 0x5599e2bc10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:02.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.945+0000 7f2115953640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5599e2bcf750 0x5599e2bc10c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53642/0 (socket says 172.21.15.45:53642) 2023-11-28T18:39:02.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.945+0000 7f2115953640 1 -- 172.21.15.45:0/1901233277 learned_addr learned my addr 172.21.15.45:0/1901233277 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:02.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.945+0000 7f2114951640 1 --2- 172.21.15.45:0/1901233277 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5599e2b45510 0x5599e2bc78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:02.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.945+0000 7f2115152640 1 --2- 172.21.15.45:0/1901233277 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5599e2af7620 0x5599e2bc4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:02.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.949+0000 7f2115953640 1 -- 172.21.15.45:0/1901233277 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5599e2b45510 msgr2=0x5599e2bc78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:02.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.949+0000 7f2115953640 1 --2- 172.21.15.45:0/1901233277 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5599e2b45510 0x5599e2bc78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:02.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.949+0000 7f2115953640 1 -- 172.21.15.45:0/1901233277 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5599e2af7620 msgr2=0x5599e2bc4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:02.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.949+0000 7f2115953640 1 --2- 172.21.15.45:0/1901233277 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5599e2af7620 0x5599e2bc4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:02.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.949+0000 7f2115953640 1 -- 172.21.15.45:0/1901233277 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5599e2a66410 con 0x5599e2bcf750 2023-11-28T18:39:02.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.949+0000 7f2115953640 1 --2- 172.21.15.45:0/1901233277 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5599e2bcf750 0x5599e2bc10c0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f2110018bb0 tx=0x7f2110017d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:02.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.949+0000 7f21067fc640 1 -- 172.21.15.45:0/1901233277 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21100abea0 con 0x5599e2bcf750 2023-11-28T18:39:02.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.949+0000 7f21067fc640 1 -- 172.21.15.45:0/1901233277 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21100b4840 con 0x5599e2bcf750 2023-11-28T18:39:02.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.949+0000 7f21067fc640 1 -- 172.21.15.45:0/1901233277 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21100b4bb0 con 0x5599e2bcf750 2023-11-28T18:39:02.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.949+0000 7f2117633080 1 -- 172.21.15.45:0/1901233277 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5599e2a4c420 con 0x5599e2bcf750 2023-11-28T18:39:02.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.949+0000 7f2117633080 1 -- 172.21.15.45:0/1901233277 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5599e2a3f5d0 con 0x5599e2bcf750 2023-11-28T18:39:02.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.949+0000 7f21067fc640 1 -- 172.21.15.45:0/1901233277 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f21100bb040 con 0x5599e2bcf750 2023-11-28T18:39:02.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.949+0000 7f21067fc640 1 --2- 172.21.15.45:0/1901233277 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f20f80652b0 0x7f20f8067770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:02.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.949+0000 7f21067fc640 1 -- 172.21.15.45:0/1901233277 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f211011dcb0 con 0x5599e2bcf750 2023-11-28T18:39:02.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.949+0000 7f2115152640 1 --2- 172.21.15.45:0/1901233277 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f20f80652b0 0x7f20f8067770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:02.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.949+0000 7f2117633080 1 --2- 172.21.15.45:0/1901233277 >> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] conn(0x5599e2bca230 0x5599e2bca640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:02.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.949+0000 7f2117633080 1 -- 172.21.15.45:0/1901233277 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:1 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x5599e2bcab80 con 0x5599e2bca230 2023-11-28T18:39:02.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.953+0000 7f2114951640 1 --2- 172.21.15.45:0/1901233277 >> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] conn(0x5599e2bca230 0x5599e2bca640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:02.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.953+0000 7f2115152640 1 --2- 172.21.15.45:0/1901233277 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f20f80652b0 0x7f20f8067770 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2108000c10 tx=0x7f21080017f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:02.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.953+0000 7f2114951640 1 --2- 172.21.15.45:0/1901233277 >> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] conn(0x5599e2bca230 0x5599e2bca640 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:02.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.953+0000 7f2114951640 1 -- 172.21.15.45:0/1901233277 <== osd.6 v2:172.21.15.190:6816/2317686718 1 ==== osd_op_reply(1 1.00000000 [omap-get-keys out=5b] v0'0 uv2 ondisk = 0) v8 ==== 154+0+5 (crc 0 0 0) 0x7f210c007930 con 0x5599e2bca230 2023-11-28T18:39:02.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.953+0000 7f2117633080 1 -- 172.21.15.45:0/1901233277 >> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] conn(0x5599e2bca230 msgr2=0x5599e2bca640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:02.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.953+0000 7f2117633080 1 --2- 172.21.15.45:0/1901233277 >> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] conn(0x5599e2bca230 0x5599e2bca640 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:02.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.953+0000 7f2117633080 1 -- 172.21.15.45:0/1901233277 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f20f80652b0 msgr2=0x7f20f8067770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:02.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.953+0000 7f2117633080 1 --2- 172.21.15.45:0/1901233277 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f20f80652b0 0x7f20f8067770 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2108000c10 tx=0x7f21080017f0 comp rx=0 tx=0).stop 2023-11-28T18:39:02.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.953+0000 7f2117633080 1 -- 172.21.15.45:0/1901233277 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5599e2bcf750 msgr2=0x5599e2bc10c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:02.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.953+0000 7f2117633080 1 --2- 172.21.15.45:0/1901233277 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5599e2bcf750 0x5599e2bc10c0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f2110018bb0 tx=0x7f2110017d20 comp rx=0 tx=0).stop 2023-11-28T18:39:02.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.953+0000 7f2115953640 1 -- 172.21.15.45:0/1901233277 reap_dead start 2023-11-28T18:39:02.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.957+0000 7f2117633080 1 -- 172.21.15.45:0/1901233277 shutdown_connections 2023-11-28T18:39:02.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.957+0000 7f2117633080 1 -- 172.21.15.45:0/1901233277 >> 172.21.15.45:0/1901233277 conn(0x5599e2b27090 msgr2=0x5599e2bceac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:02.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.957+0000 7f2117633080 1 -- 172.21.15.45:0/1901233277 shutdown_connections 2023-11-28T18:39:02.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:02.957+0000 7f2117633080 1 -- 172.21.15.45:0/1901233277 wait complete. 2023-11-28T18:39:02.963 DEBUG:teuthology.orchestra.run.smithi045:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 event recover_dentries list 2023-11-28T18:39:03.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.053+0000 7fd2fb1a5280 1 -- start start 2023-11-28T18:39:03.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.053+0000 7fd2fb1a5280 1 Processor -- start 2023-11-28T18:39:03.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.053+0000 7fd2fb1a5280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56394b251800 0x56394b2bc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:03.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.053+0000 7fd2fb1a5280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56394b251400 0x56394b2bcb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:03.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.053+0000 7fd2fb1a5280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56394b251000 0x56394b2bd080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:03.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.053+0000 7fd2fb1a5280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x56394b297180 con 0x56394b251000 2023-11-28T18:39:03.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.053+0000 7fd2fb1a5280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x56394b296140 con 0x56394b251800 2023-11-28T18:39:03.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.053+0000 7fd2fb1a5280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x56394b296000 con 0x56394b251400 2023-11-28T18:39:03.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.057+0000 7fd2fa165640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56394b251000 0x56394b2bd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:03.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.057+0000 7fd2fa165640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56394b251000 0x56394b2bd080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53660/0 (socket says 172.21.15.45:53660) 2023-11-28T18:39:03.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.057+0000 7fd2fa165640 1 -- 172.21.15.45:0/3878474526 learned_addr learned my addr 172.21.15.45:0/3878474526 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:03.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.057+0000 7fd2f9964640 1 --2- 172.21.15.45:0/3878474526 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56394b251800 0x56394b2bc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:03.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.057+0000 7fd2f9163640 1 --2- 172.21.15.45:0/3878474526 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56394b251400 0x56394b2bcb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:03.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.057+0000 7fd2fa165640 1 -- 172.21.15.45:0/3878474526 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56394b251400 msgr2=0x56394b2bcb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:03.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.057+0000 7fd2fa165640 1 --2- 172.21.15.45:0/3878474526 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56394b251400 0x56394b2bcb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:03.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.057+0000 7fd2fa165640 1 -- 172.21.15.45:0/3878474526 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56394b251800 msgr2=0x56394b2bc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:03.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.057+0000 7fd2fa165640 1 --2- 172.21.15.45:0/3878474526 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56394b251800 0x56394b2bc580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:03.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.057+0000 7fd2fa165640 1 -- 172.21.15.45:0/3878474526 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56394b2869c0 con 0x56394b251000 2023-11-28T18:39:03.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.057+0000 7fd2f9163640 1 --2- 172.21.15.45:0/3878474526 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56394b251400 0x56394b2bcb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:39:03.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.057+0000 7fd2fa165640 1 --2- 172.21.15.45:0/3878474526 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56394b251000 0x56394b2bd080 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x56394c0c4c90 tx=0x56394c164120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c51919b6d191556 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:03.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.057+0000 7fd2f715f640 1 -- 172.21.15.45:0/3878474526 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56394b2b11e0 con 0x56394b251000 2023-11-28T18:39:03.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.057+0000 7fd2f715f640 1 -- 172.21.15.45:0/3878474526 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56394b2ac480 con 0x56394b251000 2023-11-28T18:39:03.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.057+0000 7fd2f715f640 1 -- 172.21.15.45:0/3878474526 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56394b2b1080 con 0x56394b251000 2023-11-28T18:39:03.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.057+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/3878474526 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56394b286b60 con 0x56394b251000 2023-11-28T18:39:03.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.057+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/3878474526 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x56394b286340 con 0x56394b251000 2023-11-28T18:39:03.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.057+0000 7fd2fb1a5280 4 waiting for MDS map... 2023-11-28T18:39:03.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.057+0000 7fd2f715f640 1 -- 172.21.15.45:0/3878474526 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x56394b292c40 con 0x56394b251000 2023-11-28T18:39:03.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.057+0000 7fd2f715f640 1 -- 172.21.15.45:0/3878474526 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 17) v1 ==== 2723+0+0 (secure 0 0 0) 0x56394b29ef00 con 0x56394b251000 2023-11-28T18:39:03.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.057+0000 7fd2fb1a5280 4 Got MDS map 17 2023-11-28T18:39:03.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.057+0000 7fd2fb1a5280 10 main: JournalTool::main 2023-11-28T18:39:03.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.057+0000 7fd2fb1a5280 4 main: JournalTool: connecting to RADOS... 2023-11-28T18:39:03.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.057+0000 7fd2fb1a5280 1 Processor -- start 2023-11-28T18:39:03.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.057+0000 7fd2fb1a5280 1 -- start start 2023-11-28T18:39:03.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.057+0000 7fd2fb1a5280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56394c174c00 0x56394b2bd600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:03.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.057+0000 7fd2fb1a5280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56394c175000 0x56394b2bdb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:03.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.057+0000 7fd2fb1a5280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56394c175400 0x56394b2be100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:03.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.057+0000 7fd2fb1a5280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x56394b296a00 con 0x56394c174c00 2023-11-28T18:39:03.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.057+0000 7fd2fb1a5280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x56394b321180 con 0x56394c175000 2023-11-28T18:39:03.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.057+0000 7fd2fb1a5280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x56394b320dc0 con 0x56394c175400 2023-11-28T18:39:03.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.057+0000 7fd2f9163640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56394c174c00 0x56394b2bd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:03.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.057+0000 7fd2f9964640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56394c175000 0x56394b2bdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:03.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.057+0000 7fd2f9163640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56394c174c00 0x56394b2bd600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53670/0 (socket says 172.21.15.45:53670) 2023-11-28T18:39:03.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.057+0000 7fd2f9163640 1 -- 172.21.15.45:0/1567776608 learned_addr learned my addr 172.21.15.45:0/1567776608 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:03.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.057+0000 7fd2f9163640 1 --2- 172.21.15.45:0/1567776608 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56394c175400 0x56394b2be100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:03.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.057+0000 7fd2f9964640 1 -- 172.21.15.45:0/1567776608 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56394c175400 msgr2=0x56394b2be100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:03.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.057+0000 7fd2f9964640 1 --2- 172.21.15.45:0/1567776608 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56394c175400 0x56394b2be100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:03.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.057+0000 7fd2f9964640 1 -- 172.21.15.45:0/1567776608 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56394c174c00 msgr2=0x56394b2bd600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:03.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.057+0000 7fd2f9964640 1 --2- 172.21.15.45:0/1567776608 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56394c174c00 0x56394b2bd600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:03.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.057+0000 7fd2f9964640 1 -- 172.21.15.45:0/1567776608 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56394b286000 con 0x56394c175000 2023-11-28T18:39:03.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.061+0000 7fd2f9964640 1 --2- 172.21.15.45:0/1567776608 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56394c175000 0x56394b2bdb80 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x56394c1ce420 tx=0x56394c165f20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6fa1509dd0e3e26c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:03.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.061+0000 7fd2f515b640 1 -- 172.21.15.45:0/1567776608 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56394b2b11e0 con 0x56394c175000 2023-11-28T18:39:03.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.061+0000 7fd2f515b640 1 -- 172.21.15.45:0/1567776608 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56394b2ac900 con 0x56394c175000 2023-11-28T18:39:03.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.061+0000 7fd2f515b640 1 -- 172.21.15.45:0/1567776608 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56394b2b1080 con 0x56394c175000 2023-11-28T18:39:03.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.061+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1567776608 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56394c175000 msgr2=0x56394b2bdb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:03.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.061+0000 7fd2fb1a5280 1 --2- 172.21.15.45:0/1567776608 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56394c175000 0x56394b2bdb80 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x56394c1ce420 tx=0x56394c165f20 comp rx=0 tx=0).stop 2023-11-28T18:39:03.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.061+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1567776608 shutdown_connections 2023-11-28T18:39:03.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.061+0000 7fd2fb1a5280 1 --2- 172.21.15.45:0/1567776608 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56394c175400 0x56394b2be100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:03.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.061+0000 7fd2fb1a5280 1 --2- 172.21.15.45:0/1567776608 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56394c175000 0x56394b2bdb80 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:03.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.061+0000 7fd2fb1a5280 1 --2- 172.21.15.45:0/1567776608 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56394c174c00 0x56394b2bd600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:03.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.061+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1567776608 >> 172.21.15.45:0/1567776608 conn(0x56394b250c00 msgr2=0x56394b27f800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:03.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.061+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1567776608 shutdown_connections 2023-11-28T18:39:03.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.061+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1567776608 wait complete. 2023-11-28T18:39:03.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.061+0000 7fd2fb1a5280 1 Processor -- start 2023-11-28T18:39:03.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.061+0000 7fd2fb1a5280 1 -- start start 2023-11-28T18:39:03.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.061+0000 7fd2fb1a5280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56394c174c00 0x56394b2bf180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:03.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.061+0000 7fd2fb1a5280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56394c175000 0x56394b2bec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:03.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.061+0000 7fd2fb1a5280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56394c175400 0x56394b2be680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:03.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.061+0000 7fd2fb1a5280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x56394b320c80 con 0x56394c174c00 2023-11-28T18:39:03.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.061+0000 7fd2fb1a5280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x56394b296140 con 0x56394c175000 2023-11-28T18:39:03.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.061+0000 7fd2fb1a5280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x56394b296b40 con 0x56394c175400 2023-11-28T18:39:03.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.061+0000 7fd2f9163640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56394c174c00 0x56394b2bf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:03.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.061+0000 7fd2f9163640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56394c174c00 0x56394b2bf180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53678/0 (socket says 172.21.15.45:53678) 2023-11-28T18:39:03.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.061+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 learned_addr learned my addr 172.21.15.45:0/1087626730 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:03.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.061+0000 7fd2f9964640 1 --2- 172.21.15.45:0/1087626730 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56394c175000 0x56394b2bec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:03.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.061+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56394c175400 msgr2=0x56394b2be680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:03.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.061+0000 7fd2f9163640 1 --2- 172.21.15.45:0/1087626730 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56394c175400 0x56394b2be680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:03.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.061+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56394c175000 msgr2=0x56394b2bec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:03.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.061+0000 7fd2f9163640 1 --2- 172.21.15.45:0/1087626730 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56394c175000 0x56394b2bec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:03.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.061+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56394b2869c0 con 0x56394c174c00 2023-11-28T18:39:03.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.061+0000 7fd2f9964640 1 --2- 172.21.15.45:0/1087626730 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56394c175000 0x56394b2bec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:39:03.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.061+0000 7fd2f9163640 1 --2- 172.21.15.45:0/1087626730 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56394c174c00 0x56394b2bf180 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x56394c1cee10 tx=0x56394bfcfe00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:03.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.061+0000 7fd2f3958640 1 -- 172.21.15.45:0/1087626730 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56394b2b0f20 con 0x56394c174c00 2023-11-28T18:39:03.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.061+0000 7fd2f3958640 1 -- 172.21.15.45:0/1087626730 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56394c026300 con 0x56394c174c00 2023-11-28T18:39:03.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.061+0000 7fd2f3958640 1 -- 172.21.15.45:0/1087626730 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56394b2b11e0 con 0x56394c174c00 2023-11-28T18:39:03.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.061+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56394b286b60 con 0x56394c174c00 2023-11-28T18:39:03.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.061+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56394b286ea0 con 0x56394c174c00 2023-11-28T18:39:03.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.061+0000 7fd2fb1a5280 4 main: JournalTool: resolving pool 4 2023-11-28T18:39:03.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.065+0000 7fd2f3958640 1 -- 172.21.15.45:0/1087626730 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x56394b2df080 con 0x56394c174c00 2023-11-28T18:39:03.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.065+0000 7fd2f3958640 1 --2- 172.21.15.45:0/1087626730 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x56394c1d8c00 0x56394b2bf700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:03.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.065+0000 7fd2f3958640 1 -- 172.21.15.45:0/1087626730 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x56394b292a80 con 0x56394c174c00 2023-11-28T18:39:03.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.065+0000 7fd2fb1a5280 4 main: JournalTool: creating IoCtx.. 2023-11-28T18:39:03.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.065+0000 7fd2fb1a5280 4 main: Executing for rank 0 2023-11-28T18:39:03.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.065+0000 7fd2fb1a5280 1 --2- 172.21.15.45:0/1087626730 >> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] conn(0x56394c175800 0x56394b2be100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:03.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.065+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] -- osd_op(unknown.0.0:1 4.f 4:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b2a7880 con 0x56394c175800 2023-11-28T18:39:03.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.065+0000 7fd2f9964640 1 --2- 172.21.15.45:0/1087626730 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x56394c1d8c00 0x56394b2bf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:03.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.065+0000 7fd2f9163640 1 --2- 172.21.15.45:0/1087626730 >> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] conn(0x56394c175800 0x56394b2be100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:03.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.065+0000 7fd2f9163640 1 --2- 172.21.15.45:0/1087626730 >> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] conn(0x56394c175800 0x56394b2be100 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:03.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.065+0000 7fd2f9964640 1 --2- 172.21.15.45:0/1087626730 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x56394c1d8c00 0x56394b2bf700 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x56394c1ce420 tx=0x56394c16c060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:03.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.065+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.1 v2:172.21.15.45:6800/2857063763 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x56394c158b40 con 0x56394c175800 2023-11-28T18:39:03.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.065+0000 7fd2fb1a5280 4 Pointer 400.00000000 is readable 2023-11-28T18:39:03.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.065+0000 7fd2fb1a5280 4 JournalScanner::scan: reading header object '200.00000000' 2023-11-28T18:39:03.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.065+0000 7fd2fb1a5280 1 --2- 172.21.15.45:0/1087626730 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x56394c175c00 0x56394b2bdb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:03.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.065+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:2 4.14 4:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b2a7c00 con 0x56394c175c00 2023-11-28T18:39:03.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.065+0000 7fd2fa165640 1 --2- 172.21.15.45:0/1087626730 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x56394c175c00 0x56394b2bdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:03.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.065+0000 7fd2fa165640 1 --2- 172.21.15.45:0/1087626730 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x56394c175c00 0x56394b2bdb80 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:03.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.3 v2:172.21.15.45:6824/78541084 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv11 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x56394c158d80 con 0x56394c175c00 2023-11-28T18:39:03.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Header 0x400000 0x400000 0x401ebf 2023-11-28T18:39:03.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Starting journal scan from offset 0x400000 2023-11-28T18:39:03.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:3 4.14 4:2e2fa760:::200.00000001:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b632000 con 0x56394c175c00 2023-11-28T18:39:03.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.3 v2:172.21.15.45:6824/78541084 2 ==== osd_op_reply(3 200.00000001 [read 0~56199 out=56199b] v0'0 uv29 ondisk = 0) v8 ==== 156+0+56199 (crc 0 0 0) 0x56394c158d80 con 0x56394c175c00 2023-11-28T18:39:03.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 4 Read 0xdb87 bytes from 200.00000001 gap=0 2023-11-28T18:39:03.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Parsing data, 0xdb87 bytes available 2023-11-28T18:39:03.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Attempting decode at 0x400000 2023-11-28T18:39:03.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Consumed 0x30 bytes 2023-11-28T18:39:03.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Valid entry at 0x400000 2023-11-28T18:39:03.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Attempting decode at 0x400030 2023-11-28T18:39:03.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Consumed 0x37c bytes 2023-11-28T18:39:03.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Valid entry at 0x400030 2023-11-28T18:39:03.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Attempting decode at 0x4003ac 2023-11-28T18:39:03.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Consumed 0x1b8 bytes 2023-11-28T18:39:03.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Valid entry at 0x4003ac 2023-11-28T18:39:03.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Attempting decode at 0x400564 2023-11-28T18:39:03.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Consumed 0x32f bytes 2023-11-28T18:39:03.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Valid entry at 0x400564 2023-11-28T18:39:03.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Attempting decode at 0x400893 2023-11-28T18:39:03.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Consumed 0x6b2 bytes 2023-11-28T18:39:03.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Valid entry at 0x400893 2023-11-28T18:39:03.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Attempting decode at 0x400f45 2023-11-28T18:39:03.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Consumed 0x7ce bytes 2023-11-28T18:39:03.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Valid entry at 0x400f45 2023-11-28T18:39:03.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Attempting decode at 0x401713 2023-11-28T18:39:03.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Consumed 0x7ac bytes 2023-11-28T18:39:03.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Valid entry at 0x401713 2023-11-28T18:39:03.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Attempting decode at 0x401ebf 2023-11-28T18:39:03.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Consumed 0x7df bytes 2023-11-28T18:39:03.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Valid entry at 0x401ebf 2023-11-28T18:39:03.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Attempting decode at 0x40269e 2023-11-28T18:39:03.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Consumed 0x7a8 bytes 2023-11-28T18:39:03.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Valid entry at 0x40269e 2023-11-28T18:39:03.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Attempting decode at 0x402e46 2023-11-28T18:39:03.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Consumed 0x787 bytes 2023-11-28T18:39:03.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Valid entry at 0x402e46 2023-11-28T18:39:03.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Attempting decode at 0x4035cd 2023-11-28T18:39:03.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Consumed 0xc66 bytes 2023-11-28T18:39:03.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Valid entry at 0x4035cd 2023-11-28T18:39:03.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Attempting decode at 0x404233 2023-11-28T18:39:03.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Consumed 0x472 bytes 2023-11-28T18:39:03.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Valid entry at 0x404233 2023-11-28T18:39:03.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Attempting decode at 0x4046a5 2023-11-28T18:39:03.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Consumed 0x78b bytes 2023-11-28T18:39:03.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Valid entry at 0x4046a5 2023-11-28T18:39:03.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Attempting decode at 0x404e30 2023-11-28T18:39:03.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Consumed 0xb60 bytes 2023-11-28T18:39:03.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Valid entry at 0x404e30 2023-11-28T18:39:03.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Attempting decode at 0x405990 2023-11-28T18:39:03.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Consumed 0x7e6 bytes 2023-11-28T18:39:03.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Valid entry at 0x405990 2023-11-28T18:39:03.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Attempting decode at 0x406176 2023-11-28T18:39:03.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Consumed 0x7c0 bytes 2023-11-28T18:39:03.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Valid entry at 0x406176 2023-11-28T18:39:03.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Attempting decode at 0x406936 2023-11-28T18:39:03.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Consumed 0xb60 bytes 2023-11-28T18:39:03.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Valid entry at 0x406936 2023-11-28T18:39:03.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Attempting decode at 0x407496 2023-11-28T18:39:03.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Consumed 0xb60 bytes 2023-11-28T18:39:03.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Valid entry at 0x407496 2023-11-28T18:39:03.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Attempting decode at 0x407ff6 2023-11-28T18:39:03.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Consumed 0xb63 bytes 2023-11-28T18:39:03.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Valid entry at 0x407ff6 2023-11-28T18:39:03.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Attempting decode at 0x408b59 2023-11-28T18:39:03.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Consumed 0x7a8 bytes 2023-11-28T18:39:03.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Valid entry at 0x408b59 2023-11-28T18:39:03.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Attempting decode at 0x409301 2023-11-28T18:39:03.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Consumed 0xb6e bytes 2023-11-28T18:39:03.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Valid entry at 0x409301 2023-11-28T18:39:03.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Attempting decode at 0x409e6f 2023-11-28T18:39:03.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Consumed 0xb63 bytes 2023-11-28T18:39:03.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Valid entry at 0x409e6f 2023-11-28T18:39:03.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Attempting decode at 0x40a9d2 2023-11-28T18:39:03.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Consumed 0x681 bytes 2023-11-28T18:39:03.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Valid entry at 0x40a9d2 2023-11-28T18:39:03.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Attempting decode at 0x40b053 2023-11-28T18:39:03.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Consumed 0xa56 bytes 2023-11-28T18:39:03.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Valid entry at 0x40b053 2023-11-28T18:39:03.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Attempting decode at 0x40baa9 2023-11-28T18:39:03.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Consumed 0x8d9 bytes 2023-11-28T18:39:03.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Valid entry at 0x40baa9 2023-11-28T18:39:03.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Attempting decode at 0x40c382 2023-11-28T18:39:03.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Consumed 0x257 bytes 2023-11-28T18:39:03.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Valid entry at 0x40c382 2023-11-28T18:39:03.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Attempting decode at 0x40c5d9 2023-11-28T18:39:03.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Consumed 0x9d0 bytes 2023-11-28T18:39:03.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Valid entry at 0x40c5d9 2023-11-28T18:39:03.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Attempting decode at 0x40cfa9 2023-11-28T18:39:03.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Consumed 0xad bytes 2023-11-28T18:39:03.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Valid entry at 0x40cfa9 2023-11-28T18:39:03.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Attempting decode at 0x40d056 2023-11-28T18:39:03.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Consumed 0x4c bytes 2023-11-28T18:39:03.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Valid entry at 0x40d056 2023-11-28T18:39:03.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Attempting decode at 0x40d0a2 2023-11-28T18:39:03.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Consumed 0x673 bytes 2023-11-28T18:39:03.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Valid entry at 0x40d0a2 2023-11-28T18:39:03.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Attempting decode at 0x40d715 2023-11-28T18:39:03.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Consumed 0x472 bytes 2023-11-28T18:39:03.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 10 Valid entry at 0x40d715 2023-11-28T18:39:03.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 1 --2- 172.21.15.45:0/1087626730 >> [v2:172.21.15.190:6808/1537591987,v1:172.21.15.190:6809/1537591987] conn(0x56394c1d9000 0x56394b2bd600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:03.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.069+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6808/1537591987,v1:172.21.15.190:6809/1537591987] -- osd_op(unknown.0.0:4 4.1b 4:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b632380 con 0x56394c1d9000 2023-11-28T18:39:03.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.073+0000 7fd2f9964640 1 --2- 172.21.15.45:0/1087626730 >> [v2:172.21.15.190:6808/1537591987,v1:172.21.15.190:6809/1537591987] conn(0x56394c1d9000 0x56394b2bd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:03.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.073+0000 7fd2f9964640 1 --2- 172.21.15.45:0/1087626730 >> [v2:172.21.15.190:6808/1537591987,v1:172.21.15.190:6809/1537591987] conn(0x56394c1d9000 0x56394b2bd600 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:03.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.073+0000 7fd2f9964640 1 -- 172.21.15.45:0/1087626730 <== osd.4 v2:172.21.15.190:6808/1537591987 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x56394c158fc0 con 0x56394c1d9000 2023-11-28T18:39:03.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.073+0000 7fd2fb1a5280 4 Reached end of journal objects 2023-11-28T18:39:03.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.073+0000 7fd2fb1a5280 4 Scanned objects, 0 missing, 1 valid 2023-11-28T18:39:03.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.073+0000 7fd2fb1a5280 4 Events scanned, 0 gaps 2023-11-28T18:39:03.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.073+0000 7fd2fb1a5280 4 Found 31 valid events 2023-11-28T18:39:03.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.073+0000 7fd2fb1a5280 4 Selected 31 events events for processing 2023-11-28T18:39:03.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.073+0000 7fd2fb1a5280 4 recover_dentries: inspecting lump 1.00000000 2023-11-28T18:39:03.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.073+0000 7fd2fb1a5280 1 --2- 172.21.15.45:0/1087626730 >> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] conn(0x56394c1d9400 0x56394b662000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:03.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.073+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:5 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b632700 con 0x56394c1d9400 2023-11-28T18:39:03.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.077+0000 7fd2f9163640 1 --2- 172.21.15.45:0/1087626730 >> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] conn(0x56394c1d9400 0x56394b662000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:03.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.077+0000 7fd2f9163640 1 --2- 172.21.15.45:0/1087626730 >> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] conn(0x56394c1d9400 0x56394b662000 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:03.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.077+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 1 ==== osd_op_reply(5 1.00000000 [omap-get-header out=274b] v0'0 uv2 ondisk = 0) v8 ==== 154+0+274 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.077+0000 7fd2fb1a5280 4 recover_dentries: frag 1.00000000 fnode old v1 vs new v1 2023-11-28T18:39:03.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.077+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:6 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b632a80 con 0x56394c1d9400 2023-11-28T18:39:03.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.077+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 2 ==== osd_op_reply(6 1.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv2 ondisk = 0) v8 ==== 154+0+4 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.077+0000 7fd2fb1a5280 4 recover_dentries: inspecting lump 100.00000000 2023-11-28T18:39:03.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.077+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6808/1537591987,v1:172.21.15.190:6809/1537591987] -- osd_op(unknown.0.0:7 4.13 4:cd5a64a3:::100.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b632700 con 0x56394c1d9000 2023-11-28T18:39:03.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.077+0000 7fd2f9964640 1 -- 172.21.15.45:0/1087626730 <== osd.4 v2:172.21.15.190:6808/1537591987 2 ==== osd_op_reply(7 100.00000000 [omap-get-header out=274b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+274 (crc 0 0 0) 0x56394c158fc0 con 0x56394c1d9000 2023-11-28T18:39:03.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.077+0000 7fd2fb1a5280 4 recover_dentries: frag 100.00000000 fnode old v1 vs new v1 2023-11-28T18:39:03.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.077+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6808/1537591987,v1:172.21.15.190:6809/1537591987] -- osd_op(unknown.0.0:8 4.13 4:cd5a64a3:::100.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b632e00 con 0x56394c1d9000 2023-11-28T18:39:03.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.077+0000 7fd2f9964640 1 -- 172.21.15.45:0/1087626730 <== osd.4 v2:172.21.15.190:6808/1537591987 3 ==== osd_op_reply(8 100.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+4 (crc 0 0 0) 0x56394c158fc0 con 0x56394c1d9000 2023-11-28T18:39:03.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.077+0000 7fd2fb1a5280 4 recover_dentries: updating root 0x0x1 2023-11-28T18:39:03.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.077+0000 7fd2fb1a5280 4 recover_dentries: object id 1.00000000.inode 2023-11-28T18:39:03.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.077+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:9 4.14 4:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b633180 con 0x56394c175c00 2023-11-28T18:39:03.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.077+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.3 v2:172.21.15.45:6824/78541084 3 ==== osd_op_reply(9 1.00000000.inode [read 0~582 out=582b] v0'0 uv4 ondisk = 0) v8 ==== 160+0+582 (crc 0 0 0) 0x56394c158d80 con 0x56394c175c00 2023-11-28T18:39:03.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.077+0000 7fd2fb1a5280 4 recover_dentries: root exists, will modify (582) 2023-11-28T18:39:03.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.077+0000 7fd2fb1a5280 4 recover_dentries: magic ok 2023-11-28T18:39:03.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.077+0000 7fd2fb1a5280 4 recover_dentries: writing root ino 1.00000000.inode version 2 2023-11-28T18:39:03.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.077+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:10 4.14 4:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b633500 con 0x56394c175c00 2023-11-28T18:39:03.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.081+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.3 v2:172.21.15.45:6824/78541084 4 ==== osd_op_reply(10 1.00000000.inode [writefull 0~582] v35'30 uv30 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x56394c158d80 con 0x56394c175c00 2023-11-28T18:39:03.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.081+0000 7fd2fb1a5280 4 recover_dentries: inspecting lump 1.00000000 2023-11-28T18:39:03.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.081+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:11 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b2a7880 con 0x56394c1d9400 2023-11-28T18:39:03.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.081+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 3 ==== osd_op_reply(11 1.00000000 [omap-get-header out=274b] v0'0 uv2 ondisk = 0) v8 ==== 154+0+274 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.081+0000 7fd2fb1a5280 4 recover_dentries: frag 1.00000000 fnode old v1 vs new v3 2023-11-28T18:39:03.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.081+0000 7fd2fb1a5280 4 recover_dentries: writing fnode to omap header 2023-11-28T18:39:03.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.081+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:12 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b632000 con 0x56394c1d9400 2023-11-28T18:39:03.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.081+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 4 ==== osd_op_reply(12 1.00000000 [omap-set-header] v35'5 uv5 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.081+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:13 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=21b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b633180 con 0x56394c1d9400 2023-11-28T18:39:03.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.081+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 5 ==== osd_op_reply(13 1.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv5 ondisk = 0) v8 ==== 154+0+4 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.081+0000 7fd2fb1a5280 4 recover_dentries: inspecting fullbit 1.00000000/rootfile 2023-11-28T18:39:03.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.081+0000 7fd2fb1a5280 4 recover_dentries: dentry did not already exist, will create 2023-11-28T18:39:03.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.081+0000 7fd2fb1a5280 4 recover_dentries: writing I dentry rootfile_head into frag 1.00000000 2023-11-28T18:39:03.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.081+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:14 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-vals in=547b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b632380 con 0x56394c1d9400 2023-11-28T18:39:03.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.085+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 6 ==== osd_op_reply(14 1.00000000 [omap-set-vals] v35'6 uv6 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.085+0000 7fd2fb1a5280 4 recover_dentries: updating root 0x0x1 2023-11-28T18:39:03.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.085+0000 7fd2fb1a5280 4 recover_dentries: object id 1.00000000.inode 2023-11-28T18:39:03.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.085+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:15 4.14 4:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b632700 con 0x56394c175c00 2023-11-28T18:39:03.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.085+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.3 v2:172.21.15.45:6824/78541084 5 ==== osd_op_reply(15 1.00000000.inode [read 0~582 out=582b] v0'0 uv30 ondisk = 0) v8 ==== 160+0+582 (crc 0 0 0) 0x56394c158d80 con 0x56394c175c00 2023-11-28T18:39:03.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.085+0000 7fd2fb1a5280 4 recover_dentries: root exists, will modify (582) 2023-11-28T18:39:03.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.085+0000 7fd2fb1a5280 4 recover_dentries: magic ok 2023-11-28T18:39:03.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.085+0000 7fd2fb1a5280 4 recover_dentries: writing root ino 1.00000000.inode version 3 2023-11-28T18:39:03.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.085+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:16 4.14 4:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b633880 con 0x56394c175c00 2023-11-28T18:39:03.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.085+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.3 v2:172.21.15.45:6824/78541084 6 ==== osd_op_reply(16 1.00000000.inode [writefull 0~582] v35'31 uv31 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x56394c158d80 con 0x56394c175c00 2023-11-28T18:39:03.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.085+0000 7fd2fb1a5280 4 recover_dentries: inspecting lump 1.00000000 2023-11-28T18:39:03.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.085+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:17 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b2a7c00 con 0x56394c1d9400 2023-11-28T18:39:03.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.085+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 7 ==== osd_op_reply(17 1.00000000 [omap-get-header out=274b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+274 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.085+0000 7fd2fb1a5280 4 recover_dentries: frag 1.00000000 fnode old v3 vs new v5 2023-11-28T18:39:03.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.085+0000 7fd2fb1a5280 4 recover_dentries: writing fnode to omap header 2023-11-28T18:39:03.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.085+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:18 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b632a80 con 0x56394c1d9400 2023-11-28T18:39:03.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.089+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 8 ==== osd_op_reply(18 1.00000000 [omap-set-header] v35'7 uv7 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.089+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:19 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b632000 con 0x56394c1d9400 2023-11-28T18:39:03.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.089+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 9 ==== osd_op_reply(19 1.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv7 ondisk = 0) v8 ==== 154+0+4 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.089+0000 7fd2fb1a5280 4 recover_dentries: inspecting fullbit 1.00000000/subdir 2023-11-28T18:39:03.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.089+0000 7fd2fb1a5280 4 recover_dentries: dentry did not already exist, will create 2023-11-28T18:39:03.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.089+0000 7fd2fb1a5280 4 recover_dentries: writing I dentry subdir_head into frag 1.00000000 2023-11-28T18:39:03.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.089+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:20 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-vals in=507b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b633c00 con 0x56394c1d9400 2023-11-28T18:39:03.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.089+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 10 ==== osd_op_reply(20 1.00000000 [omap-set-vals] v35'8 uv8 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.089+0000 7fd2fb1a5280 4 recover_dentries: inspecting lump 10000000001.00000000 2023-11-28T18:39:03.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.089+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] -- osd_op(unknown.0.0:21 4.7 4:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b2a7880 con 0x56394c175800 2023-11-28T18:39:03.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.089+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.1 v2:172.21.15.45:6800/2857063763 2 ==== osd_op_reply(21 10000000001.00000000 [omap-get-header] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56394c158b40 con 0x56394c175800 2023-11-28T18:39:03.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.089+0000 7fd2fb1a5280 4 recover_dentries: failed to read OMAP header from directory fragment 10000000001.00000000 (2) No such file or directory 2023-11-28T18:39:03.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.089+0000 7fd2fb1a5280 4 recover_dentries: writing fnode to omap header 2023-11-28T18:39:03.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.089+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] -- osd_op(unknown.0.0:22 4.7 4:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b633180 con 0x56394c175800 2023-11-28T18:39:03.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.093+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.1 v2:172.21.15.45:6800/2857063763 3 ==== osd_op_reply(22 10000000001.00000000 [omap-set-header] v35'3 uv3 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x56394c158b40 con 0x56394c175800 2023-11-28T18:39:03.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.093+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] -- osd_op(unknown.0.0:23 4.7 4:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b632380 con 0x56394c175800 2023-11-28T18:39:03.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.093+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.1 v2:172.21.15.45:6800/2857063763 4 ==== osd_op_reply(23 10000000001.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x56394c158b40 con 0x56394c175800 2023-11-28T18:39:03.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.093+0000 7fd2fb1a5280 4 recover_dentries: updating root 0x0x1 2023-11-28T18:39:03.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.093+0000 7fd2fb1a5280 4 recover_dentries: object id 1.00000000.inode 2023-11-28T18:39:03.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.093+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:24 4.14 4:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b632a80 con 0x56394c175c00 2023-11-28T18:39:03.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.093+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.3 v2:172.21.15.45:6824/78541084 7 ==== osd_op_reply(24 1.00000000.inode [read 0~582 out=582b] v0'0 uv31 ondisk = 0) v8 ==== 160+0+582 (crc 0 0 0) 0x56394c158d80 con 0x56394c175c00 2023-11-28T18:39:03.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.093+0000 7fd2fb1a5280 4 recover_dentries: root exists, will modify (582) 2023-11-28T18:39:03.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.093+0000 7fd2fb1a5280 4 recover_dentries: magic ok 2023-11-28T18:39:03.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.093+0000 7fd2fb1a5280 4 recover_dentries: writing root ino 1.00000000.inode version 4 2023-11-28T18:39:03.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.093+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:25 4.14 4:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b2a7c00 con 0x56394c175c00 2023-11-28T18:39:03.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.093+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.3 v2:172.21.15.45:6824/78541084 8 ==== osd_op_reply(25 1.00000000.inode [writefull 0~582] v35'32 uv32 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x56394c158d80 con 0x56394c175c00 2023-11-28T18:39:03.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.093+0000 7fd2fb1a5280 4 recover_dentries: inspecting lump 1.00000000 2023-11-28T18:39:03.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.093+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:26 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b633500 con 0x56394c1d9400 2023-11-28T18:39:03.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.093+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 11 ==== osd_op_reply(26 1.00000000 [omap-get-header out=274b] v0'0 uv8 ondisk = 0) v8 ==== 154+0+274 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.093+0000 7fd2fb1a5280 4 recover_dentries: frag 1.00000000 fnode old v5 vs new v7 2023-11-28T18:39:03.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.093+0000 7fd2fb1a5280 4 recover_dentries: writing fnode to omap header 2023-11-28T18:39:03.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.093+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:27 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b632700 con 0x56394c1d9400 2023-11-28T18:39:03.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.097+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 12 ==== osd_op_reply(27 1.00000000 [omap-set-header] v35'9 uv9 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.097+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:28 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b633880 con 0x56394c1d9400 2023-11-28T18:39:03.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.097+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 13 ==== osd_op_reply(28 1.00000000 [omap-get-vals-by-keys out=507b] v0'0 uv9 ondisk = 0) v8 ==== 154+0+507 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.097+0000 7fd2fb1a5280 4 recover_dentries: inspecting fullbit 1.00000000/subdir 2023-11-28T18:39:03.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.097+0000 7fd2fb1a5280 4 recover_dentries: dentry subdir_head existed already 2023-11-28T18:39:03.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.097+0000 7fd2fb1a5280 4 recover_dentries: dentry exists, checking versions... 2023-11-28T18:39:03.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.097+0000 7fd2fb1a5280 4 recover_dentries: decoded embedded inode version 4 vs fullbit version 6 2023-11-28T18:39:03.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.097+0000 7fd2fb1a5280 4 recover_dentries: writing I dentry subdir_head into frag 1.00000000 2023-11-28T18:39:03.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.097+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:29 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-vals in=507b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b632a80 con 0x56394c1d9400 2023-11-28T18:39:03.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.101+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 14 ==== osd_op_reply(29 1.00000000 [omap-set-vals] v35'10 uv10 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.101+0000 7fd2fb1a5280 4 recover_dentries: inspecting lump 10000000001.00000000 2023-11-28T18:39:03.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.101+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] -- osd_op(unknown.0.0:30 4.7 4:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b632000 con 0x56394c175800 2023-11-28T18:39:03.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.101+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.1 v2:172.21.15.45:6800/2857063763 5 ==== osd_op_reply(30 10000000001.00000000 [omap-get-header out=274b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x56394c158b40 con 0x56394c175800 2023-11-28T18:39:03.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.101+0000 7fd2fb1a5280 4 recover_dentries: frag 10000000001.00000000 fnode old v1 vs new v3 2023-11-28T18:39:03.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.101+0000 7fd2fb1a5280 4 recover_dentries: writing fnode to omap header 2023-11-28T18:39:03.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.101+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] -- osd_op(unknown.0.0:31 4.7 4:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b633c00 con 0x56394c175800 2023-11-28T18:39:03.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.105+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.1 v2:172.21.15.45:6800/2857063763 6 ==== osd_op_reply(31 10000000001.00000000 [omap-set-header] v35'4 uv4 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x56394c158b40 con 0x56394c175800 2023-11-28T18:39:03.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.105+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] -- osd_op(unknown.0.0:32 4.7 4:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=23b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b633180 con 0x56394c175800 2023-11-28T18:39:03.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.105+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.1 v2:172.21.15.45:6800/2857063763 7 ==== osd_op_reply(32 10000000001.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x56394c158b40 con 0x56394c175800 2023-11-28T18:39:03.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.105+0000 7fd2fb1a5280 4 recover_dentries: inspecting fullbit 10000000001.00000000/subdirfile 2023-11-28T18:39:03.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.105+0000 7fd2fb1a5280 4 recover_dentries: dentry did not already exist, will create 2023-11-28T18:39:03.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.105+0000 7fd2fb1a5280 4 recover_dentries: writing I dentry subdirfile_head into frag 10000000001.00000000 2023-11-28T18:39:03.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.105+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] -- osd_op(unknown.0.0:33 4.7 4:e2e07930:::10000000001.00000000:head [omap-set-vals in=549b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b632380 con 0x56394c175800 2023-11-28T18:39:03.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.105+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.1 v2:172.21.15.45:6800/2857063763 8 ==== osd_op_reply(33 10000000001.00000000 [omap-set-vals] v35'5 uv5 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x56394c158b40 con 0x56394c175800 2023-11-28T18:39:03.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.105+0000 7fd2fb1a5280 4 recover_dentries: inspecting lump 1.00000000 2023-11-28T18:39:03.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.105+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:34 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b2a7880 con 0x56394c1d9400 2023-11-28T18:39:03.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.105+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 15 ==== osd_op_reply(34 1.00000000 [omap-get-header out=274b] v0'0 uv10 ondisk = 0) v8 ==== 154+0+274 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.105+0000 7fd2fb1a5280 4 recover_dentries: frag 1.00000000 fnode old v7 vs new v9 2023-11-28T18:39:03.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.105+0000 7fd2fb1a5280 4 recover_dentries: writing fnode to omap header 2023-11-28T18:39:03.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.105+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:35 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b633500 con 0x56394c1d9400 2023-11-28T18:39:03.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.109+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 16 ==== osd_op_reply(35 1.00000000 [omap-set-header] v35'11 uv11 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.109+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:36 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b632700 con 0x56394c1d9400 2023-11-28T18:39:03.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.109+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 17 ==== osd_op_reply(36 1.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv11 ondisk = 0) v8 ==== 154+0+4 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.109+0000 7fd2fb1a5280 4 recover_dentries: inspecting fullbit 1.00000000/linkdir 2023-11-28T18:39:03.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.109+0000 7fd2fb1a5280 4 recover_dentries: dentry did not already exist, will create 2023-11-28T18:39:03.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.109+0000 7fd2fb1a5280 4 recover_dentries: writing I dentry linkdir_head into frag 1.00000000 2023-11-28T18:39:03.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.109+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:37 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-vals in=508b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b633880 con 0x56394c1d9400 2023-11-28T18:39:03.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.109+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 18 ==== osd_op_reply(37 1.00000000 [omap-set-vals] v35'12 uv12 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.109+0000 7fd2fb1a5280 4 recover_dentries: inspecting lump 100000001f7.00000000 2023-11-28T18:39:03.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.109+0000 7fd2fb1a5280 1 --2- 172.21.15.45:0/1087626730 >> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] conn(0x56394c1d9800 0x56394b662580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:03.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.109+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:38 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b632a80 con 0x56394c1d9800 2023-11-28T18:39:03.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.109+0000 7fd2fa165640 1 --2- 172.21.15.45:0/1087626730 >> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] conn(0x56394c1d9800 0x56394b662580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:03.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.113+0000 7fd2fa165640 1 --2- 172.21.15.45:0/1087626730 >> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] conn(0x56394c1d9800 0x56394b662580 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:03.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.113+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.0 v2:172.21.15.45:6808/555237322 1 ==== osd_op_reply(38 100000001f7.00000000 [omap-get-header] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56394c158d80 con 0x56394c1d9800 2023-11-28T18:39:03.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.113+0000 7fd2fb1a5280 4 recover_dentries: failed to read OMAP header from directory fragment 100000001f7.00000000 (2) No such file or directory 2023-11-28T18:39:03.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.113+0000 7fd2fb1a5280 4 recover_dentries: writing fnode to omap header 2023-11-28T18:39:03.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.113+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:39 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b632000 con 0x56394c1d9800 2023-11-28T18:39:03.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.117+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.0 v2:172.21.15.45:6808/555237322 2 ==== osd_op_reply(39 100000001f7.00000000 [omap-set-header] v35'1 uv1 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x56394c158d80 con 0x56394c1d9800 2023-11-28T18:39:03.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.117+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:40 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b633c00 con 0x56394c1d9800 2023-11-28T18:39:03.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.117+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.0 v2:172.21.15.45:6808/555237322 3 ==== osd_op_reply(40 100000001f7.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x56394c158d80 con 0x56394c1d9800 2023-11-28T18:39:03.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.117+0000 7fd2fb1a5280 4 recover_dentries: updating root 0x0x1 2023-11-28T18:39:03.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.117+0000 7fd2fb1a5280 4 recover_dentries: object id 1.00000000.inode 2023-11-28T18:39:03.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.117+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:41 4.14 4:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b67a000 con 0x56394c175c00 2023-11-28T18:39:03.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.117+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.3 v2:172.21.15.45:6824/78541084 9 ==== osd_op_reply(41 1.00000000.inode [read 0~582 out=582b] v0'0 uv32 ondisk = 0) v8 ==== 160+0+582 (crc 0 0 0) 0x56394c158d80 con 0x56394c175c00 2023-11-28T18:39:03.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.117+0000 7fd2fb1a5280 4 recover_dentries: root exists, will modify (582) 2023-11-28T18:39:03.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.117+0000 7fd2fb1a5280 4 recover_dentries: magic ok 2023-11-28T18:39:03.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.117+0000 7fd2fb1a5280 4 recover_dentries: writing root ino 1.00000000.inode version 5 2023-11-28T18:39:03.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.117+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:42 4.14 4:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b67a380 con 0x56394c175c00 2023-11-28T18:39:03.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.117+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.3 v2:172.21.15.45:6824/78541084 10 ==== osd_op_reply(42 1.00000000.inode [writefull 0~582] v35'33 uv33 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x56394c158d80 con 0x56394c175c00 2023-11-28T18:39:03.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.117+0000 7fd2fb1a5280 4 recover_dentries: inspecting lump 1.00000000 2023-11-28T18:39:03.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.117+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:43 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b67a700 con 0x56394c1d9400 2023-11-28T18:39:03.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.117+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 19 ==== osd_op_reply(43 1.00000000 [omap-get-header out=274b] v0'0 uv12 ondisk = 0) v8 ==== 154+0+274 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.117+0000 7fd2fb1a5280 4 recover_dentries: frag 1.00000000 fnode old v9 vs new v11 2023-11-28T18:39:03.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.117+0000 7fd2fb1a5280 4 recover_dentries: writing fnode to omap header 2023-11-28T18:39:03.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.117+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:44 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b67aa80 con 0x56394c1d9400 2023-11-28T18:39:03.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.121+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 20 ==== osd_op_reply(44 1.00000000 [omap-set-header] v35'13 uv13 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.121+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:45 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b67ae00 con 0x56394c1d9400 2023-11-28T18:39:03.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.121+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 21 ==== osd_op_reply(45 1.00000000 [omap-get-vals-by-keys out=508b] v0'0 uv13 ondisk = 0) v8 ==== 154+0+508 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.121+0000 7fd2fb1a5280 4 recover_dentries: inspecting fullbit 1.00000000/linkdir 2023-11-28T18:39:03.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.121+0000 7fd2fb1a5280 4 recover_dentries: dentry linkdir_head existed already 2023-11-28T18:39:03.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.121+0000 7fd2fb1a5280 4 recover_dentries: dentry exists, checking versions... 2023-11-28T18:39:03.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.121+0000 7fd2fb1a5280 4 recover_dentries: decoded embedded inode version 8 vs fullbit version 10 2023-11-28T18:39:03.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.121+0000 7fd2fb1a5280 4 recover_dentries: writing I dentry linkdir_head into frag 1.00000000 2023-11-28T18:39:03.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.121+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:46 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-vals in=508b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b67b180 con 0x56394c1d9400 2023-11-28T18:39:03.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.121+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 22 ==== osd_op_reply(46 1.00000000 [omap-set-vals] v35'14 uv14 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.121+0000 7fd2fb1a5280 4 recover_dentries: inspecting lump 100000001f7.00000000 2023-11-28T18:39:03.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.121+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:47 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b67b500 con 0x56394c1d9800 2023-11-28T18:39:03.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.121+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.0 v2:172.21.15.45:6808/555237322 4 ==== osd_op_reply(47 100000001f7.00000000 [omap-get-header out=274b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x56394c158d80 con 0x56394c1d9800 2023-11-28T18:39:03.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.121+0000 7fd2fb1a5280 4 recover_dentries: frag 100000001f7.00000000 fnode old v1 vs new v3 2023-11-28T18:39:03.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.121+0000 7fd2fb1a5280 4 recover_dentries: writing fnode to omap header 2023-11-28T18:39:03.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.121+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:48 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b67b880 con 0x56394c1d9800 2023-11-28T18:39:03.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.125+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.0 v2:172.21.15.45:6808/555237322 5 ==== osd_op_reply(48 100000001f7.00000000 [omap-set-header] v35'2 uv2 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x56394c158d80 con 0x56394c1d9800 2023-11-28T18:39:03.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.125+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:49 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b67bc00 con 0x56394c1d9800 2023-11-28T18:39:03.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.125+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.0 v2:172.21.15.45:6808/555237322 6 ==== osd_op_reply(49 100000001f7.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x56394c158d80 con 0x56394c1d9800 2023-11-28T18:39:03.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.125+0000 7fd2fb1a5280 4 recover_dentries: inspecting fullbit 100000001f7.00000000/link0 2023-11-28T18:39:03.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.125+0000 7fd2fb1a5280 4 recover_dentries: dentry did not already exist, will create 2023-11-28T18:39:03.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.125+0000 7fd2fb1a5280 4 recover_dentries: writing I dentry link0_head into frag 100000001f7.00000000 2023-11-28T18:39:03.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.125+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:50 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-set-vals in=544b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b67a700 con 0x56394c1d9800 2023-11-28T18:39:03.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.125+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.0 v2:172.21.15.45:6808/555237322 7 ==== osd_op_reply(50 100000001f7.00000000 [omap-set-vals] v35'3 uv3 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x56394c158d80 con 0x56394c1d9800 2023-11-28T18:39:03.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.125+0000 7fd2fb1a5280 4 recover_dentries: inspecting lump 1.00000000 2023-11-28T18:39:03.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.125+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:51 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b67a000 con 0x56394c1d9400 2023-11-28T18:39:03.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.125+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 23 ==== osd_op_reply(51 1.00000000 [omap-get-header out=274b] v0'0 uv14 ondisk = 0) v8 ==== 154+0+274 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.125+0000 7fd2fb1a5280 4 recover_dentries: frag 1.00000000 fnode old v11 vs new v13 2023-11-28T18:39:03.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.125+0000 7fd2fb1a5280 4 recover_dentries: writing fnode to omap header 2023-11-28T18:39:03.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.125+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:52 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b633180 con 0x56394c1d9400 2023-11-28T18:39:03.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.129+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 24 ==== osd_op_reply(52 1.00000000 [omap-set-header] v35'15 uv15 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.129+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:53 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b632380 con 0x56394c1d9400 2023-11-28T18:39:03.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.129+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 25 ==== osd_op_reply(53 1.00000000 [omap-get-vals-by-keys out=508b] v0'0 uv15 ondisk = 0) v8 ==== 154+0+508 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.129+0000 7fd2fb1a5280 4 recover_dentries: inspecting fullbit 1.00000000/linkdir 2023-11-28T18:39:03.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.129+0000 7fd2fb1a5280 4 recover_dentries: dentry linkdir_head existed already 2023-11-28T18:39:03.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.129+0000 7fd2fb1a5280 4 recover_dentries: dentry exists, checking versions... 2023-11-28T18:39:03.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.129+0000 7fd2fb1a5280 4 recover_dentries: decoded embedded inode version 10 vs fullbit version 12 2023-11-28T18:39:03.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.129+0000 7fd2fb1a5280 4 recover_dentries: writing I dentry linkdir_head into frag 1.00000000 2023-11-28T18:39:03.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.129+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:54 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-vals in=508b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b633500 con 0x56394c1d9400 2023-11-28T18:39:03.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.129+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 26 ==== osd_op_reply(54 1.00000000 [omap-set-vals] v35'16 uv16 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.129+0000 7fd2fb1a5280 4 recover_dentries: inspecting lump 100000001f7.00000000 2023-11-28T18:39:03.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.129+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:55 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b632700 con 0x56394c1d9800 2023-11-28T18:39:03.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.133+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.0 v2:172.21.15.45:6808/555237322 8 ==== osd_op_reply(55 100000001f7.00000000 [omap-get-header out=274b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x56394c158d80 con 0x56394c1d9800 2023-11-28T18:39:03.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.133+0000 7fd2fb1a5280 4 recover_dentries: frag 100000001f7.00000000 fnode old v3 vs new v5 2023-11-28T18:39:03.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.133+0000 7fd2fb1a5280 4 recover_dentries: writing fnode to omap header 2023-11-28T18:39:03.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.133+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:56 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b633880 con 0x56394c1d9800 2023-11-28T18:39:03.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.133+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.0 v2:172.21.15.45:6808/555237322 9 ==== osd_op_reply(56 100000001f7.00000000 [omap-set-header] v35'4 uv4 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x56394c158d80 con 0x56394c1d9800 2023-11-28T18:39:03.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.133+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:57 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b632a80 con 0x56394c1d9800 2023-11-28T18:39:03.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.133+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.0 v2:172.21.15.45:6808/555237322 10 ==== osd_op_reply(57 100000001f7.00000000 [omap-get-vals-by-keys out=544b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+544 (crc 0 0 0) 0x56394c158d80 con 0x56394c1d9800 2023-11-28T18:39:03.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.133+0000 7fd2fb1a5280 4 recover_dentries: inspecting fullbit 100000001f7.00000000/link0 2023-11-28T18:39:03.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.133+0000 7fd2fb1a5280 4 recover_dentries: dentry link0_head existed already 2023-11-28T18:39:03.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.133+0000 7fd2fb1a5280 4 recover_dentries: dentry exists, checking versions... 2023-11-28T18:39:03.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.133+0000 7fd2fb1a5280 4 recover_dentries: decoded embedded inode version 2 vs fullbit version 4 2023-11-28T18:39:03.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.133+0000 7fd2fb1a5280 4 recover_dentries: writing I dentry link0_head into frag 100000001f7.00000000 2023-11-28T18:39:03.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.133+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:58 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-set-vals in=506b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b632000 con 0x56394c1d9800 2023-11-28T18:39:03.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.133+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.0 v2:172.21.15.45:6808/555237322 11 ==== osd_op_reply(58 100000001f7.00000000 [omap-set-vals] v35'5 uv5 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x56394c158d80 con 0x56394c1d9800 2023-11-28T18:39:03.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.133+0000 7fd2fb1a5280 4 recover_dentries: inspecting lump 1.00000000 2023-11-28T18:39:03.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.133+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:59 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b633c00 con 0x56394c1d9400 2023-11-28T18:39:03.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.137+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 27 ==== osd_op_reply(59 1.00000000 [omap-get-header out=274b] v0'0 uv16 ondisk = 0) v8 ==== 154+0+274 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.137+0000 7fd2fb1a5280 4 recover_dentries: frag 1.00000000 fnode old v13 vs new v15 2023-11-28T18:39:03.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.137+0000 7fd2fb1a5280 4 recover_dentries: writing fnode to omap header 2023-11-28T18:39:03.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.137+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:60 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b2a7880 con 0x56394c1d9400 2023-11-28T18:39:03.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.137+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 28 ==== osd_op_reply(60 1.00000000 [omap-set-header] v35'17 uv17 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.137+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:61 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b2a7c00 con 0x56394c1d9400 2023-11-28T18:39:03.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.137+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 29 ==== osd_op_reply(61 1.00000000 [omap-get-vals-by-keys out=508b] v0'0 uv17 ondisk = 0) v8 ==== 154+0+508 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.137+0000 7fd2fb1a5280 4 recover_dentries: inspecting fullbit 1.00000000/linkdir 2023-11-28T18:39:03.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.137+0000 7fd2fb1a5280 4 recover_dentries: dentry linkdir_head existed already 2023-11-28T18:39:03.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.137+0000 7fd2fb1a5280 4 recover_dentries: dentry exists, checking versions... 2023-11-28T18:39:03.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.137+0000 7fd2fb1a5280 4 recover_dentries: decoded embedded inode version 12 vs fullbit version 14 2023-11-28T18:39:03.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.137+0000 7fd2fb1a5280 4 recover_dentries: writing I dentry linkdir_head into frag 1.00000000 2023-11-28T18:39:03.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.137+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:62 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-vals in=508b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b633180 con 0x56394c1d9400 2023-11-28T18:39:03.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.141+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 30 ==== osd_op_reply(62 1.00000000 [omap-set-vals] v35'18 uv18 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.141+0000 7fd2fb1a5280 4 recover_dentries: inspecting lump 100.00000000 2023-11-28T18:39:03.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.141+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6808/1537591987,v1:172.21.15.190:6809/1537591987] -- osd_op(unknown.0.0:63 4.13 4:cd5a64a3:::100.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b632380 con 0x56394c1d9000 2023-11-28T18:39:03.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.141+0000 7fd2f9964640 1 -- 172.21.15.45:0/1087626730 <== osd.4 v2:172.21.15.190:6808/1537591987 4 ==== osd_op_reply(63 100.00000000 [omap-get-header out=274b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+274 (crc 0 0 0) 0x56394c158fc0 con 0x56394c1d9000 2023-11-28T18:39:03.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.141+0000 7fd2fb1a5280 4 recover_dentries: frag 100.00000000 fnode old v1 vs new v3 2023-11-28T18:39:03.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.141+0000 7fd2fb1a5280 4 recover_dentries: writing fnode to omap header 2023-11-28T18:39:03.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.141+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6808/1537591987,v1:172.21.15.190:6809/1537591987] -- osd_op(unknown.0.0:64 4.13 4:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b633500 con 0x56394c1d9000 2023-11-28T18:39:03.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.141+0000 7fd2f9964640 1 -- 172.21.15.45:0/1087626730 <== osd.4 v2:172.21.15.190:6808/1537591987 5 ==== osd_op_reply(64 100.00000000 [omap-set-header] v35'3 uv3 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x56394c158fc0 con 0x56394c1d9000 2023-11-28T18:39:03.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.141+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6808/1537591987,v1:172.21.15.190:6809/1537591987] -- osd_op(unknown.0.0:65 4.13 4:cd5a64a3:::100.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b633c00 con 0x56394c1d9000 2023-11-28T18:39:03.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.141+0000 7fd2f9964640 1 -- 172.21.15.45:0/1087626730 <== osd.4 v2:172.21.15.190:6808/1537591987 6 ==== osd_op_reply(65 100.00000000 [omap-get-vals-by-keys out=523b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+523 (crc 0 0 0) 0x56394c158fc0 con 0x56394c1d9000 2023-11-28T18:39:03.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.141+0000 7fd2fb1a5280 4 recover_dentries: inspecting fullbit 100.00000000/stray2 2023-11-28T18:39:03.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.141+0000 7fd2fb1a5280 4 recover_dentries: dentry stray2_head existed already 2023-11-28T18:39:03.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.141+0000 7fd2fb1a5280 4 recover_dentries: dentry exists, checking versions... 2023-11-28T18:39:03.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.141+0000 7fd2fb1a5280 4 recover_dentries: decoded embedded inode version 1 vs fullbit version 2 2023-11-28T18:39:03.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.141+0000 7fd2fb1a5280 4 recover_dentries: writing I dentry stray2_head into frag 100.00000000 2023-11-28T18:39:03.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.141+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6808/1537591987,v1:172.21.15.190:6809/1537591987] -- osd_op(unknown.0.0:66 4.13 4:cd5a64a3:::100.00000000:head [omap-set-vals in=507b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b632700 con 0x56394c1d9000 2023-11-28T18:39:03.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.145+0000 7fd2f9964640 1 -- 172.21.15.45:0/1087626730 <== osd.4 v2:172.21.15.190:6808/1537591987 7 ==== osd_op_reply(66 100.00000000 [omap-set-vals] v35'4 uv4 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x56394c158fc0 con 0x56394c1d9000 2023-11-28T18:39:03.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.145+0000 7fd2fb1a5280 4 recover_dentries: inspecting lump 602.00000000 2023-11-28T18:39:03.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.145+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:67 4.10 4:0bd6d154:::602.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b632e00 con 0x56394c175c00 2023-11-28T18:39:03.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.145+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.3 v2:172.21.15.45:6824/78541084 11 ==== osd_op_reply(67 602.00000000 [omap-get-header out=274b] v0'0 uv7 ondisk = 0) v8 ==== 156+0+274 (crc 0 0 0) 0x56394c158d80 con 0x56394c175c00 2023-11-28T18:39:03.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.145+0000 7fd2fb1a5280 4 recover_dentries: frag 602.00000000 fnode old v1 vs new v6 2023-11-28T18:39:03.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.145+0000 7fd2fb1a5280 4 recover_dentries: writing fnode to omap header 2023-11-28T18:39:03.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.145+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:68 4.10 4:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b632380 con 0x56394c175c00 2023-11-28T18:39:03.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.145+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.3 v2:172.21.15.45:6824/78541084 12 ==== osd_op_reply(68 602.00000000 [omap-set-header] v35'9 uv9 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x56394c158d80 con 0x56394c175c00 2023-11-28T18:39:03.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.145+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:69 4.10 4:0bd6d154:::602.00000000:head [omap-get-vals-by-keys in=24b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b633500 con 0x56394c175c00 2023-11-28T18:39:03.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.145+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.3 v2:172.21.15.45:6824/78541084 13 ==== osd_op_reply(69 602.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv9 ondisk = 0) v8 ==== 156+0+4 (crc 0 0 0) 0x56394c158d80 con 0x56394c175c00 2023-11-28T18:39:03.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.145+0000 7fd2fb1a5280 4 recover_dentries: inspecting fullbit 602.00000000/100000001f8 2023-11-28T18:39:03.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.145+0000 7fd2fb1a5280 4 recover_dentries: dentry did not already exist, will create 2023-11-28T18:39:03.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.145+0000 7fd2fb1a5280 4 recover_dentries: writing I dentry 100000001f8_head into frag 602.00000000 2023-11-28T18:39:03.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.145+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:70 4.10 4:0bd6d154:::602.00000000:head [omap-set-vals in=526b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b686000 con 0x56394c175c00 2023-11-28T18:39:03.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.149+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.3 v2:172.21.15.45:6824/78541084 14 ==== osd_op_reply(70 602.00000000 [omap-set-vals] v35'10 uv10 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x56394c158d80 con 0x56394c175c00 2023-11-28T18:39:03.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.149+0000 7fd2fb1a5280 4 recover_dentries: inspecting lump 100000001f7.00000000 2023-11-28T18:39:03.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.149+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:71 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b686380 con 0x56394c1d9800 2023-11-28T18:39:03.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.149+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.0 v2:172.21.15.45:6808/555237322 12 ==== osd_op_reply(71 100000001f7.00000000 [omap-get-header out=274b] v0'0 uv5 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x56394c158d80 con 0x56394c1d9800 2023-11-28T18:39:03.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.149+0000 7fd2fb1a5280 4 recover_dentries: frag 100000001f7.00000000 fnode old v5 vs new v7 2023-11-28T18:39:03.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.149+0000 7fd2fb1a5280 4 recover_dentries: writing fnode to omap header 2023-11-28T18:39:03.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.149+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:72 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b686700 con 0x56394c1d9800 2023-11-28T18:39:03.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.149+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.0 v2:172.21.15.45:6808/555237322 13 ==== osd_op_reply(72 100000001f7.00000000 [omap-set-header] v35'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x56394c158d80 con 0x56394c1d9800 2023-11-28T18:39:03.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.149+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:73 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b686a80 con 0x56394c1d9800 2023-11-28T18:39:03.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.149+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.0 v2:172.21.15.45:6808/555237322 14 ==== osd_op_reply(73 100000001f7.00000000 [omap-get-vals-by-keys out=506b] v0'0 uv6 ondisk = 0) v8 ==== 164+0+506 (crc 0 0 0) 0x56394c158d80 con 0x56394c1d9800 2023-11-28T18:39:03.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.149+0000 7fd2fb1a5280 4 recover_dentries: inspecting nullbit 100000001f7.00000000/link0 2023-11-28T18:39:03.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.149+0000 7fd2fb1a5280 4 recover_dentries: dentry exists, will remove 2023-11-28T18:39:03.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.149+0000 7fd2fb1a5280 10 recover_dentries: Existing full inode in slot to be (maybe) removed by null journal dn 'link0' with lump fnode version 7vs existing fnode version 5 2023-11-28T18:39:03.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.149+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:74 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-rm-keys in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b686e00 con 0x56394c1d9800 2023-11-28T18:39:03.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.149+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.0 v2:172.21.15.45:6808/555237322 15 ==== osd_op_reply(74 100000001f7.00000000 [omap-rm-keys] v35'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x56394c158d80 con 0x56394c1d9800 2023-11-28T18:39:03.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.149+0000 7fd2fb1a5280 4 recover_dentries: inspecting lump 1.00000000 2023-11-28T18:39:03.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.153+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:75 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b687180 con 0x56394c1d9400 2023-11-28T18:39:03.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.153+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 31 ==== osd_op_reply(75 1.00000000 [omap-get-header out=274b] v0'0 uv18 ondisk = 0) v8 ==== 154+0+274 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.153+0000 7fd2fb1a5280 4 recover_dentries: frag 1.00000000 fnode old v15 vs new v16 2023-11-28T18:39:03.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.153+0000 7fd2fb1a5280 4 recover_dentries: writing fnode to omap header 2023-11-28T18:39:03.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.153+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:76 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b687500 con 0x56394c1d9400 2023-11-28T18:39:03.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.153+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 32 ==== osd_op_reply(76 1.00000000 [omap-set-header] v35'19 uv19 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.153+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:77 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b687880 con 0x56394c1d9400 2023-11-28T18:39:03.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.153+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 33 ==== osd_op_reply(77 1.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv19 ondisk = 0) v8 ==== 154+0+4 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.153+0000 7fd2fb1a5280 4 recover_dentries: updating root 0x0x1 2023-11-28T18:39:03.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.153+0000 7fd2fb1a5280 4 recover_dentries: object id 1.00000000.inode 2023-11-28T18:39:03.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.153+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:78 4.14 4:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b687c00 con 0x56394c175c00 2023-11-28T18:39:03.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.153+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.3 v2:172.21.15.45:6824/78541084 15 ==== osd_op_reply(78 1.00000000.inode [read 0~582 out=582b] v0'0 uv33 ondisk = 0) v8 ==== 160+0+582 (crc 0 0 0) 0x56394c158d80 con 0x56394c175c00 2023-11-28T18:39:03.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.153+0000 7fd2fb1a5280 4 recover_dentries: root exists, will modify (582) 2023-11-28T18:39:03.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.153+0000 7fd2fb1a5280 4 recover_dentries: magic ok 2023-11-28T18:39:03.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.153+0000 7fd2fb1a5280 4 recover_dentries: writing root ino 1.00000000.inode version 6 2023-11-28T18:39:03.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.153+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:79 4.14 4:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b686000 con 0x56394c175c00 2023-11-28T18:39:03.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.157+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.3 v2:172.21.15.45:6824/78541084 16 ==== osd_op_reply(79 1.00000000.inode [writefull 0~582] v35'34 uv34 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x56394c158d80 con 0x56394c175c00 2023-11-28T18:39:03.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.157+0000 7fd2fb1a5280 4 recover_dentries: inspecting lump 1.00000000 2023-11-28T18:39:03.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.157+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:80 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b633880 con 0x56394c1d9400 2023-11-28T18:39:03.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.157+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 34 ==== osd_op_reply(80 1.00000000 [omap-get-header out=274b] v0'0 uv19 ondisk = 0) v8 ==== 154+0+274 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.157+0000 7fd2fb1a5280 4 recover_dentries: frag 1.00000000 fnode old v16 vs new v18 2023-11-28T18:39:03.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.157+0000 7fd2fb1a5280 4 recover_dentries: writing fnode to omap header 2023-11-28T18:39:03.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.157+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:81 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b632a80 con 0x56394c1d9400 2023-11-28T18:39:03.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.157+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 35 ==== osd_op_reply(81 1.00000000 [omap-set-header] v35'20 uv20 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.157+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:82 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b632000 con 0x56394c1d9400 2023-11-28T18:39:03.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.157+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 36 ==== osd_op_reply(82 1.00000000 [omap-get-vals-by-keys out=507b] v0'0 uv20 ondisk = 0) v8 ==== 154+0+507 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.157+0000 7fd2fb1a5280 4 recover_dentries: inspecting fullbit 1.00000000/subdir 2023-11-28T18:39:03.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.157+0000 7fd2fb1a5280 4 recover_dentries: dentry subdir_head existed already 2023-11-28T18:39:03.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.157+0000 7fd2fb1a5280 4 recover_dentries: dentry exists, checking versions... 2023-11-28T18:39:03.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.157+0000 7fd2fb1a5280 4 recover_dentries: decoded embedded inode version 6 vs fullbit version 17 2023-11-28T18:39:03.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.157+0000 7fd2fb1a5280 4 recover_dentries: writing I dentry subdir_head into frag 1.00000000 2023-11-28T18:39:03.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.157+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:83 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-vals in=507b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b632e00 con 0x56394c1d9400 2023-11-28T18:39:03.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.161+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 37 ==== osd_op_reply(83 1.00000000 [omap-set-vals] v35'21 uv21 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.161+0000 7fd2fb1a5280 4 recover_dentries: inspecting lump 10000000001.00000000 2023-11-28T18:39:03.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.161+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] -- osd_op(unknown.0.0:84 4.7 4:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b632380 con 0x56394c175800 2023-11-28T18:39:03.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.161+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.1 v2:172.21.15.45:6800/2857063763 9 ==== osd_op_reply(84 10000000001.00000000 [omap-get-header out=274b] v0'0 uv5 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x56394c158b40 con 0x56394c175800 2023-11-28T18:39:03.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.161+0000 7fd2fb1a5280 4 recover_dentries: frag 10000000001.00000000 fnode old v3 vs new v5 2023-11-28T18:39:03.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.161+0000 7fd2fb1a5280 4 recover_dentries: writing fnode to omap header 2023-11-28T18:39:03.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.161+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] -- osd_op(unknown.0.0:85 4.7 4:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b633500 con 0x56394c175800 2023-11-28T18:39:03.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.161+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.1 v2:172.21.15.45:6800/2857063763 10 ==== osd_op_reply(85 10000000001.00000000 [omap-set-header] v35'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x56394c158b40 con 0x56394c175800 2023-11-28T18:39:03.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.161+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] -- osd_op(unknown.0.0:86 4.7 4:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=23b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b633180 con 0x56394c175800 2023-11-28T18:39:03.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.161+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.1 v2:172.21.15.45:6800/2857063763 11 ==== osd_op_reply(86 10000000001.00000000 [omap-get-vals-by-keys out=549b] v0'0 uv6 ondisk = 0) v8 ==== 164+0+549 (crc 0 0 0) 0x56394c158b40 con 0x56394c175800 2023-11-28T18:39:03.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.161+0000 7fd2fb1a5280 4 recover_dentries: inspecting fullbit 10000000001.00000000/subdirfile 2023-11-28T18:39:03.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.161+0000 7fd2fb1a5280 4 recover_dentries: dentry subdirfile_head existed already 2023-11-28T18:39:03.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.161+0000 7fd2fb1a5280 4 recover_dentries: dentry exists, checking versions... 2023-11-28T18:39:03.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.161+0000 7fd2fb1a5280 4 recover_dentries: decoded embedded inode version 2 vs fullbit version 4 2023-11-28T18:39:03.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.161+0000 7fd2fb1a5280 4 recover_dentries: writing I dentry subdirfile_head into frag 10000000001.00000000 2023-11-28T18:39:03.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.161+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] -- osd_op(unknown.0.0:87 4.7 4:e2e07930:::10000000001.00000000:head [omap-set-vals in=511b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b633880 con 0x56394c175800 2023-11-28T18:39:03.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.165+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.1 v2:172.21.15.45:6800/2857063763 12 ==== osd_op_reply(87 10000000001.00000000 [omap-set-vals] v35'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x56394c158b40 con 0x56394c175800 2023-11-28T18:39:03.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.165+0000 7fd2fb1a5280 4 recover_dentries: inspecting lump 1.00000000 2023-11-28T18:39:03.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.165+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:88 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b632a80 con 0x56394c1d9400 2023-11-28T18:39:03.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.165+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 38 ==== osd_op_reply(88 1.00000000 [omap-get-header out=274b] v0'0 uv21 ondisk = 0) v8 ==== 154+0+274 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.165+0000 7fd2fb1a5280 4 recover_dentries: frag 1.00000000 fnode old v18 vs new v22 2023-11-28T18:39:03.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.165+0000 7fd2fb1a5280 4 recover_dentries: writing fnode to omap header 2023-11-28T18:39:03.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.165+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:89 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b632000 con 0x56394c1d9400 2023-11-28T18:39:03.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.165+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 39 ==== osd_op_reply(89 1.00000000 [omap-set-header] v35'22 uv22 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.165+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:90 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=35b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b687180 con 0x56394c1d9400 2023-11-28T18:39:03.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.165+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 40 ==== osd_op_reply(90 1.00000000 [omap-get-vals-by-keys out=1011b] v0'0 uv22 ondisk = 0) v8 ==== 154+0+1011 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.165+0000 7fd2fb1a5280 4 recover_dentries: inspecting fullbit 1.00000000/linkdir 2023-11-28T18:39:03.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.165+0000 7fd2fb1a5280 4 recover_dentries: dentry linkdir_head existed already 2023-11-28T18:39:03.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.165+0000 7fd2fb1a5280 4 recover_dentries: dentry exists, checking versions... 2023-11-28T18:39:03.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.165+0000 7fd2fb1a5280 4 recover_dentries: decoded embedded inode version 14 vs fullbit version 19 2023-11-28T18:39:03.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.165+0000 7fd2fb1a5280 4 recover_dentries: writing I dentry linkdir_head into frag 1.00000000 2023-11-28T18:39:03.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.165+0000 7fd2fb1a5280 4 recover_dentries: inspecting fullbit 1.00000000/subdir 2023-11-28T18:39:03.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.165+0000 7fd2fb1a5280 4 recover_dentries: dentry subdir_head existed already 2023-11-28T18:39:03.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.165+0000 7fd2fb1a5280 4 recover_dentries: dentry exists, checking versions... 2023-11-28T18:39:03.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.165+0000 7fd2fb1a5280 4 recover_dentries: decoded embedded inode version 17 vs fullbit version 21 2023-11-28T18:39:03.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.165+0000 7fd2fb1a5280 4 recover_dentries: writing I dentry subdir_head into frag 1.00000000 2023-11-28T18:39:03.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.165+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:91 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-vals in=1011b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b687500 con 0x56394c1d9400 2023-11-28T18:39:03.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.169+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 41 ==== osd_op_reply(91 1.00000000 [omap-set-vals] v35'23 uv23 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.169+0000 7fd2fb1a5280 4 recover_dentries: inspecting lump 100000001f7.00000000 2023-11-28T18:39:03.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.169+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:92 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b687880 con 0x56394c1d9800 2023-11-28T18:39:03.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.169+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.0 v2:172.21.15.45:6808/555237322 16 ==== osd_op_reply(92 100000001f7.00000000 [omap-get-header out=274b] v0'0 uv7 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x56394c158d80 con 0x56394c1d9800 2023-11-28T18:39:03.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.169+0000 7fd2fb1a5280 4 recover_dentries: frag 100000001f7.00000000 fnode old v7 vs new v9 2023-11-28T18:39:03.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.169+0000 7fd2fb1a5280 4 recover_dentries: writing fnode to omap header 2023-11-28T18:39:03.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.169+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:93 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b2a7880 con 0x56394c1d9800 2023-11-28T18:39:03.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.169+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.0 v2:172.21.15.45:6808/555237322 17 ==== osd_op_reply(93 100000001f7.00000000 [omap-set-header] v35'8 uv8 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x56394c158d80 con 0x56394c1d9800 2023-11-28T18:39:03.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.169+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:94 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b2a7c00 con 0x56394c1d9800 2023-11-28T18:39:03.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.169+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.0 v2:172.21.15.45:6808/555237322 18 ==== osd_op_reply(94 100000001f7.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv8 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x56394c158d80 con 0x56394c1d9800 2023-11-28T18:39:03.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.169+0000 7fd2fb1a5280 4 recover_dentries: inspecting remotebit 100000001f7.00000000/link0 2023-11-28T18:39:03.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.169+0000 7fd2fb1a5280 4 recover_dentries: dentry did not already exist, will create 2023-11-28T18:39:03.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.169+0000 7fd2fb1a5280 4 recover_dentries: writing L dentry link0_head into frag 100000001f7.00000000 2023-11-28T18:39:03.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.169+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:95 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-set-vals in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b2a7880 con 0x56394c1d9800 2023-11-28T18:39:03.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.173+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.0 v2:172.21.15.45:6808/555237322 19 ==== osd_op_reply(95 100000001f7.00000000 [omap-set-vals] v35'9 uv9 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x56394c158d80 con 0x56394c1d9800 2023-11-28T18:39:03.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.173+0000 7fd2fb1a5280 4 recover_dentries: inspecting lump 10000000001.00000000 2023-11-28T18:39:03.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.173+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] -- osd_op(unknown.0.0:96 4.7 4:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b686380 con 0x56394c175800 2023-11-28T18:39:03.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.173+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.1 v2:172.21.15.45:6800/2857063763 13 ==== osd_op_reply(96 10000000001.00000000 [omap-get-header out=274b] v0'0 uv7 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x56394c158b40 con 0x56394c175800 2023-11-28T18:39:03.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.173+0000 7fd2fb1a5280 4 recover_dentries: frag 10000000001.00000000 fnode old v5 vs new v7 2023-11-28T18:39:03.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.173+0000 7fd2fb1a5280 4 recover_dentries: writing fnode to omap header 2023-11-28T18:39:03.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.173+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] -- osd_op(unknown.0.0:97 4.7 4:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b686700 con 0x56394c175800 2023-11-28T18:39:03.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.173+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.1 v2:172.21.15.45:6800/2857063763 14 ==== osd_op_reply(97 10000000001.00000000 [omap-set-header] v35'8 uv8 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x56394c158b40 con 0x56394c175800 2023-11-28T18:39:03.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.173+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] -- osd_op(unknown.0.0:98 4.7 4:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=23b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b686a80 con 0x56394c175800 2023-11-28T18:39:03.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.173+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.1 v2:172.21.15.45:6800/2857063763 15 ==== osd_op_reply(98 10000000001.00000000 [omap-get-vals-by-keys out=511b] v0'0 uv8 ondisk = 0) v8 ==== 164+0+511 (crc 0 0 0) 0x56394c158b40 con 0x56394c175800 2023-11-28T18:39:03.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.173+0000 7fd2fb1a5280 4 recover_dentries: inspecting fullbit 10000000001.00000000/subdirfile 2023-11-28T18:39:03.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.173+0000 7fd2fb1a5280 4 recover_dentries: dentry subdirfile_head existed already 2023-11-28T18:39:03.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.173+0000 7fd2fb1a5280 4 recover_dentries: dentry exists, checking versions... 2023-11-28T18:39:03.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.173+0000 7fd2fb1a5280 4 recover_dentries: decoded embedded inode version 4 vs fullbit version 6 2023-11-28T18:39:03.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.173+0000 7fd2fb1a5280 4 recover_dentries: writing I dentry subdirfile_head into frag 10000000001.00000000 2023-11-28T18:39:03.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.173+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] -- osd_op(unknown.0.0:99 4.7 4:e2e07930:::10000000001.00000000:head [omap-set-vals in=589b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b686e00 con 0x56394c175800 2023-11-28T18:39:03.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.177+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.1 v2:172.21.15.45:6800/2857063763 16 ==== osd_op_reply(99 10000000001.00000000 [omap-set-vals] v35'9 uv9 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x56394c158b40 con 0x56394c175800 2023-11-28T18:39:03.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.177+0000 7fd2fb1a5280 4 recover_dentries: inspecting lump 1.00000000 2023-11-28T18:39:03.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.177+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:100 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b687c00 con 0x56394c1d9400 2023-11-28T18:39:03.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.177+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 42 ==== osd_op_reply(100 1.00000000 [omap-get-header out=274b] v0'0 uv23 ondisk = 0) v8 ==== 154+0+274 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.177+0000 7fd2fb1a5280 4 recover_dentries: frag 1.00000000 fnode old v22 vs new v24 2023-11-28T18:39:03.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.177+0000 7fd2fb1a5280 4 recover_dentries: writing fnode to omap header 2023-11-28T18:39:03.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.177+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:101 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b686000 con 0x56394c1d9400 2023-11-28T18:39:03.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.177+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 43 ==== osd_op_reply(101 1.00000000 [omap-set-header] v35'24 uv24 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.177+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:102 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b687880 con 0x56394c1d9400 2023-11-28T18:39:03.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.177+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 44 ==== osd_op_reply(102 1.00000000 [omap-get-vals-by-keys out=507b] v0'0 uv24 ondisk = 0) v8 ==== 154+0+507 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.177+0000 7fd2fb1a5280 4 recover_dentries: inspecting fullbit 1.00000000/subdir 2023-11-28T18:39:03.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.177+0000 7fd2fb1a5280 4 recover_dentries: dentry subdir_head existed already 2023-11-28T18:39:03.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.177+0000 7fd2fb1a5280 4 recover_dentries: dentry exists, checking versions... 2023-11-28T18:39:03.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.177+0000 7fd2fb1a5280 4 recover_dentries: decoded embedded inode version 21 vs fullbit version 23 2023-11-28T18:39:03.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.177+0000 7fd2fb1a5280 4 recover_dentries: writing I dentry subdir_head into frag 1.00000000 2023-11-28T18:39:03.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.177+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:103 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-vals in=507b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b687180 con 0x56394c1d9400 2023-11-28T18:39:03.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.177+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 45 ==== osd_op_reply(103 1.00000000 [omap-set-vals] v35'25 uv25 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.177+0000 7fd2fb1a5280 4 recover_dentries: inspecting lump 10000000001.00000000 2023-11-28T18:39:03.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.177+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] -- osd_op(unknown.0.0:104 4.7 4:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b687500 con 0x56394c175800 2023-11-28T18:39:03.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.181+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.1 v2:172.21.15.45:6800/2857063763 17 ==== osd_op_reply(104 10000000001.00000000 [omap-get-header out=274b] v0'0 uv9 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x56394c158b40 con 0x56394c175800 2023-11-28T18:39:03.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.181+0000 7fd2fb1a5280 4 recover_dentries: frag 10000000001.00000000 fnode old v7 vs new v9 2023-11-28T18:39:03.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.181+0000 7fd2fb1a5280 4 recover_dentries: writing fnode to omap header 2023-11-28T18:39:03.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.181+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] -- osd_op(unknown.0.0:105 4.7 4:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b686380 con 0x56394c175800 2023-11-28T18:39:03.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.181+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.1 v2:172.21.15.45:6800/2857063763 18 ==== osd_op_reply(105 10000000001.00000000 [omap-set-header] v35'10 uv10 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x56394c158b40 con 0x56394c175800 2023-11-28T18:39:03.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.181+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] -- osd_op(unknown.0.0:106 4.7 4:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=23b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b632e00 con 0x56394c175800 2023-11-28T18:39:03.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.181+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.1 v2:172.21.15.45:6800/2857063763 19 ==== osd_op_reply(106 10000000001.00000000 [omap-get-vals-by-keys out=589b] v0'0 uv10 ondisk = 0) v8 ==== 164+0+589 (crc 0 0 0) 0x56394c158b40 con 0x56394c175800 2023-11-28T18:39:03.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.181+0000 7fd2fb1a5280 4 recover_dentries: inspecting fullbit 10000000001.00000000/subdirfile 2023-11-28T18:39:03.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.181+0000 7fd2fb1a5280 4 recover_dentries: dentry subdirfile_head existed already 2023-11-28T18:39:03.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.181+0000 7fd2fb1a5280 4 recover_dentries: dentry exists, checking versions... 2023-11-28T18:39:03.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.181+0000 7fd2fb1a5280 4 recover_dentries: decoded embedded inode version 6 vs fullbit version 8 2023-11-28T18:39:03.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.181+0000 7fd2fb1a5280 4 recover_dentries: writing I dentry subdirfile_head into frag 10000000001.00000000 2023-11-28T18:39:03.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.181+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] -- osd_op(unknown.0.0:107 4.7 4:e2e07930:::10000000001.00000000:head [omap-set-vals in=627b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b632380 con 0x56394c175800 2023-11-28T18:39:03.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.181+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.1 v2:172.21.15.45:6800/2857063763 20 ==== osd_op_reply(107 10000000001.00000000 [omap-set-vals] v35'11 uv11 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x56394c158b40 con 0x56394c175800 2023-11-28T18:39:03.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.181+0000 7fd2fb1a5280 4 recover_dentries: inspecting lump 1.00000000 2023-11-28T18:39:03.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.181+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:108 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b633500 con 0x56394c1d9400 2023-11-28T18:39:03.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.181+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 46 ==== osd_op_reply(108 1.00000000 [omap-get-header out=274b] v0'0 uv25 ondisk = 0) v8 ==== 154+0+274 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.181+0000 7fd2fb1a5280 4 recover_dentries: frag 1.00000000 fnode old v24 vs new v26 2023-11-28T18:39:03.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.181+0000 7fd2fb1a5280 4 recover_dentries: writing fnode to omap header 2023-11-28T18:39:03.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.181+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:109 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b633180 con 0x56394c1d9400 2023-11-28T18:39:03.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.185+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 47 ==== osd_op_reply(109 1.00000000 [omap-set-header] v35'26 uv26 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.185+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:110 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b633880 con 0x56394c1d9400 2023-11-28T18:39:03.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.185+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 48 ==== osd_op_reply(110 1.00000000 [omap-get-vals-by-keys out=507b] v0'0 uv26 ondisk = 0) v8 ==== 154+0+507 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.185+0000 7fd2fb1a5280 4 recover_dentries: inspecting fullbit 1.00000000/subdir 2023-11-28T18:39:03.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.185+0000 7fd2fb1a5280 4 recover_dentries: dentry subdir_head existed already 2023-11-28T18:39:03.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.185+0000 7fd2fb1a5280 4 recover_dentries: dentry exists, checking versions... 2023-11-28T18:39:03.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.185+0000 7fd2fb1a5280 4 recover_dentries: decoded embedded inode version 23 vs fullbit version 25 2023-11-28T18:39:03.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.185+0000 7fd2fb1a5280 4 recover_dentries: writing I dentry subdir_head into frag 1.00000000 2023-11-28T18:39:03.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.185+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:111 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-vals in=507b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b632a80 con 0x56394c1d9400 2023-11-28T18:39:03.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.185+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 49 ==== osd_op_reply(111 1.00000000 [omap-set-vals] v35'27 uv27 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.185+0000 7fd2fb1a5280 4 recover_dentries: inspecting lump 10000000001.00000000 2023-11-28T18:39:03.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.185+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] -- osd_op(unknown.0.0:112 4.7 4:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b632000 con 0x56394c175800 2023-11-28T18:39:03.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.185+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.1 v2:172.21.15.45:6800/2857063763 21 ==== osd_op_reply(112 10000000001.00000000 [omap-get-header out=274b] v0'0 uv11 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x56394c158b40 con 0x56394c175800 2023-11-28T18:39:03.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.185+0000 7fd2fb1a5280 4 recover_dentries: frag 10000000001.00000000 fnode old v9 vs new v11 2023-11-28T18:39:03.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.185+0000 7fd2fb1a5280 4 recover_dentries: writing fnode to omap header 2023-11-28T18:39:03.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.185+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] -- osd_op(unknown.0.0:113 4.7 4:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b632e00 con 0x56394c175800 2023-11-28T18:39:03.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.189+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.1 v2:172.21.15.45:6800/2857063763 22 ==== osd_op_reply(113 10000000001.00000000 [omap-set-header] v35'12 uv12 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x56394c158b40 con 0x56394c175800 2023-11-28T18:39:03.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.189+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] -- osd_op(unknown.0.0:114 4.7 4:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=23b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b632380 con 0x56394c175800 2023-11-28T18:39:03.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.189+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.1 v2:172.21.15.45:6800/2857063763 23 ==== osd_op_reply(114 10000000001.00000000 [omap-get-vals-by-keys out=627b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+627 (crc 0 0 0) 0x56394c158b40 con 0x56394c175800 2023-11-28T18:39:03.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.189+0000 7fd2fb1a5280 4 recover_dentries: inspecting fullbit 10000000001.00000000/subdirfile 2023-11-28T18:39:03.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.189+0000 7fd2fb1a5280 4 recover_dentries: dentry subdirfile_head existed already 2023-11-28T18:39:03.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.189+0000 7fd2fb1a5280 4 recover_dentries: dentry exists, checking versions... 2023-11-28T18:39:03.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.189+0000 7fd2fb1a5280 4 recover_dentries: decoded embedded inode version 8 vs fullbit version 10 2023-11-28T18:39:03.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.189+0000 7fd2fb1a5280 4 recover_dentries: writing I dentry subdirfile_head into frag 10000000001.00000000 2023-11-28T18:39:03.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.189+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] -- osd_op(unknown.0.0:115 4.7 4:e2e07930:::10000000001.00000000:head [omap-set-vals in=589b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b686000 con 0x56394c175800 2023-11-28T18:39:03.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.189+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.1 v2:172.21.15.45:6800/2857063763 24 ==== osd_op_reply(115 10000000001.00000000 [omap-set-vals] v35'13 uv13 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x56394c158b40 con 0x56394c175800 2023-11-28T18:39:03.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.189+0000 7fd2fb1a5280 4 recover_dentries: inspecting lump 1.00000000 2023-11-28T18:39:03.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.189+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:116 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b686380 con 0x56394c1d9400 2023-11-28T18:39:03.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.189+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 50 ==== osd_op_reply(116 1.00000000 [omap-get-header out=274b] v0'0 uv27 ondisk = 0) v8 ==== 154+0+274 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.189+0000 7fd2fb1a5280 4 recover_dentries: frag 1.00000000 fnode old v26 vs new v30 2023-11-28T18:39:03.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.189+0000 7fd2fb1a5280 4 recover_dentries: writing fnode to omap header 2023-11-28T18:39:03.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.189+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:117 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b686700 con 0x56394c1d9400 2023-11-28T18:39:03.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.193+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 51 ==== osd_op_reply(117 1.00000000 [omap-set-header] v35'28 uv28 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.193+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:118 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=35b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b686a80 con 0x56394c1d9400 2023-11-28T18:39:03.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.193+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 52 ==== osd_op_reply(118 1.00000000 [omap-get-vals-by-keys out=1011b] v0'0 uv28 ondisk = 0) v8 ==== 154+0+1011 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.193+0000 7fd2fb1a5280 4 recover_dentries: inspecting fullbit 1.00000000/linkdir 2023-11-28T18:39:03.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.193+0000 7fd2fb1a5280 4 recover_dentries: dentry linkdir_head existed already 2023-11-28T18:39:03.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.193+0000 7fd2fb1a5280 4 recover_dentries: dentry exists, checking versions... 2023-11-28T18:39:03.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.193+0000 7fd2fb1a5280 4 recover_dentries: decoded embedded inode version 19 vs fullbit version 27 2023-11-28T18:39:03.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.193+0000 7fd2fb1a5280 4 recover_dentries: writing I dentry linkdir_head into frag 1.00000000 2023-11-28T18:39:03.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.193+0000 7fd2fb1a5280 4 recover_dentries: inspecting fullbit 1.00000000/subdir 2023-11-28T18:39:03.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.193+0000 7fd2fb1a5280 4 recover_dentries: dentry subdir_head existed already 2023-11-28T18:39:03.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.193+0000 7fd2fb1a5280 4 recover_dentries: dentry exists, checking versions... 2023-11-28T18:39:03.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.193+0000 7fd2fb1a5280 4 recover_dentries: decoded embedded inode version 25 vs fullbit version 29 2023-11-28T18:39:03.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.193+0000 7fd2fb1a5280 4 recover_dentries: writing I dentry subdir_head into frag 1.00000000 2023-11-28T18:39:03.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.193+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:119 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-vals in=1011b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b686e00 con 0x56394c1d9400 2023-11-28T18:39:03.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.193+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 53 ==== osd_op_reply(119 1.00000000 [omap-set-vals] v35'29 uv29 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.193+0000 7fd2fb1a5280 4 recover_dentries: inspecting lump 100000001f7.00000000 2023-11-28T18:39:03.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.193+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:120 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b687180 con 0x56394c1d9800 2023-11-28T18:39:03.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.193+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.0 v2:172.21.15.45:6808/555237322 20 ==== osd_op_reply(120 100000001f7.00000000 [omap-get-header out=274b] v0'0 uv9 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x56394c158d80 con 0x56394c1d9800 2023-11-28T18:39:03.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.193+0000 7fd2fb1a5280 4 recover_dentries: frag 100000001f7.00000000 fnode old v9 vs new v11 2023-11-28T18:39:03.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.193+0000 7fd2fb1a5280 4 recover_dentries: writing fnode to omap header 2023-11-28T18:39:03.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.193+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:121 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b687500 con 0x56394c1d9800 2023-11-28T18:39:03.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.197+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.0 v2:172.21.15.45:6808/555237322 21 ==== osd_op_reply(121 100000001f7.00000000 [omap-set-header] v35'10 uv10 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x56394c158d80 con 0x56394c1d9800 2023-11-28T18:39:03.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.197+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:122 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b687880 con 0x56394c1d9800 2023-11-28T18:39:03.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.197+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.0 v2:172.21.15.45:6808/555237322 22 ==== osd_op_reply(122 100000001f7.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv10 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x56394c158d80 con 0x56394c1d9800 2023-11-28T18:39:03.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.197+0000 7fd2fb1a5280 4 recover_dentries: inspecting remotebit 100000001f7.00000000/link1 2023-11-28T18:39:03.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.197+0000 7fd2fb1a5280 4 recover_dentries: dentry did not already exist, will create 2023-11-28T18:39:03.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.197+0000 7fd2fb1a5280 4 recover_dentries: writing L dentry link1_head into frag 100000001f7.00000000 2023-11-28T18:39:03.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.197+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:123 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-set-vals in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b687c00 con 0x56394c1d9800 2023-11-28T18:39:03.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.197+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.0 v2:172.21.15.45:6808/555237322 23 ==== osd_op_reply(123 100000001f7.00000000 [omap-set-vals] v35'11 uv11 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x56394c158d80 con 0x56394c1d9800 2023-11-28T18:39:03.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.197+0000 7fd2fb1a5280 4 recover_dentries: inspecting lump 10000000001.00000000 2023-11-28T18:39:03.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.197+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] -- osd_op(unknown.0.0:124 4.7 4:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b686000 con 0x56394c175800 2023-11-28T18:39:03.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.197+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.1 v2:172.21.15.45:6800/2857063763 25 ==== osd_op_reply(124 10000000001.00000000 [omap-get-header out=274b] v0'0 uv13 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x56394c158b40 con 0x56394c175800 2023-11-28T18:39:03.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.197+0000 7fd2fb1a5280 4 recover_dentries: frag 10000000001.00000000 fnode old v11 vs new v13 2023-11-28T18:39:03.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.197+0000 7fd2fb1a5280 4 recover_dentries: writing fnode to omap header 2023-11-28T18:39:03.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.197+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] -- osd_op(unknown.0.0:125 4.7 4:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b686380 con 0x56394c175800 2023-11-28T18:39:03.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.201+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.1 v2:172.21.15.45:6800/2857063763 26 ==== osd_op_reply(125 10000000001.00000000 [omap-set-header] v35'14 uv14 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x56394c158b40 con 0x56394c175800 2023-11-28T18:39:03.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.201+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] -- osd_op(unknown.0.0:126 4.7 4:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=23b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b686700 con 0x56394c175800 2023-11-28T18:39:03.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.201+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.1 v2:172.21.15.45:6800/2857063763 27 ==== osd_op_reply(126 10000000001.00000000 [omap-get-vals-by-keys out=589b] v0'0 uv14 ondisk = 0) v8 ==== 164+0+589 (crc 0 0 0) 0x56394c158b40 con 0x56394c175800 2023-11-28T18:39:03.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.201+0000 7fd2fb1a5280 4 recover_dentries: inspecting fullbit 10000000001.00000000/subdirfile 2023-11-28T18:39:03.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.201+0000 7fd2fb1a5280 4 recover_dentries: dentry subdirfile_head existed already 2023-11-28T18:39:03.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.201+0000 7fd2fb1a5280 4 recover_dentries: dentry exists, checking versions... 2023-11-28T18:39:03.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.201+0000 7fd2fb1a5280 4 recover_dentries: decoded embedded inode version 10 vs fullbit version 12 2023-11-28T18:39:03.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.201+0000 7fd2fb1a5280 4 recover_dentries: writing I dentry subdirfile_head into frag 10000000001.00000000 2023-11-28T18:39:03.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.201+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] -- osd_op(unknown.0.0:127 4.7 4:e2e07930:::10000000001.00000000:head [omap-set-vals in=589b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b686a80 con 0x56394c175800 2023-11-28T18:39:03.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.201+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.1 v2:172.21.15.45:6800/2857063763 28 ==== osd_op_reply(127 10000000001.00000000 [omap-set-vals] v35'15 uv15 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x56394c158b40 con 0x56394c175800 2023-11-28T18:39:03.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.201+0000 7fd2fb1a5280 4 recover_dentries: inspecting lump 1.00000000 2023-11-28T18:39:03.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.201+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:128 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b686e00 con 0x56394c1d9400 2023-11-28T18:39:03.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.201+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 54 ==== osd_op_reply(128 1.00000000 [omap-get-header out=274b] v0'0 uv29 ondisk = 0) v8 ==== 154+0+274 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.201+0000 7fd2fb1a5280 4 recover_dentries: frag 1.00000000 fnode old v30 vs new v34 2023-11-28T18:39:03.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.201+0000 7fd2fb1a5280 4 recover_dentries: writing fnode to omap header 2023-11-28T18:39:03.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.201+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:129 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b633500 con 0x56394c1d9400 2023-11-28T18:39:03.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.205+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 55 ==== osd_op_reply(129 1.00000000 [omap-set-header] v35'30 uv30 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.205+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:130 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=35b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b633180 con 0x56394c1d9400 2023-11-28T18:39:03.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.205+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 56 ==== osd_op_reply(130 1.00000000 [omap-get-vals-by-keys out=1011b] v0'0 uv30 ondisk = 0) v8 ==== 154+0+1011 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.205+0000 7fd2fb1a5280 4 recover_dentries: inspecting fullbit 1.00000000/linkdir 2023-11-28T18:39:03.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.205+0000 7fd2fb1a5280 4 recover_dentries: dentry linkdir_head existed already 2023-11-28T18:39:03.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.205+0000 7fd2fb1a5280 4 recover_dentries: dentry exists, checking versions... 2023-11-28T18:39:03.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.205+0000 7fd2fb1a5280 4 recover_dentries: decoded embedded inode version 27 vs fullbit version 31 2023-11-28T18:39:03.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.205+0000 7fd2fb1a5280 4 recover_dentries: writing I dentry linkdir_head into frag 1.00000000 2023-11-28T18:39:03.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.205+0000 7fd2fb1a5280 4 recover_dentries: inspecting fullbit 1.00000000/subdir 2023-11-28T18:39:03.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.205+0000 7fd2fb1a5280 4 recover_dentries: dentry subdir_head existed already 2023-11-28T18:39:03.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.205+0000 7fd2fb1a5280 4 recover_dentries: dentry exists, checking versions... 2023-11-28T18:39:03.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.205+0000 7fd2fb1a5280 4 recover_dentries: decoded embedded inode version 29 vs fullbit version 33 2023-11-28T18:39:03.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.205+0000 7fd2fb1a5280 4 recover_dentries: writing I dentry subdir_head into frag 1.00000000 2023-11-28T18:39:03.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.205+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:131 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-vals in=1011b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b633880 con 0x56394c1d9400 2023-11-28T18:39:03.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.205+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 57 ==== osd_op_reply(131 1.00000000 [omap-set-vals] v35'31 uv31 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.205+0000 7fd2fb1a5280 4 recover_dentries: inspecting lump 100000001f7.00000000 2023-11-28T18:39:03.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.205+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:132 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b632a80 con 0x56394c1d9800 2023-11-28T18:39:03.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.205+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.0 v2:172.21.15.45:6808/555237322 24 ==== osd_op_reply(132 100000001f7.00000000 [omap-get-header out=274b] v0'0 uv11 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x56394c158d80 con 0x56394c1d9800 2023-11-28T18:39:03.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.205+0000 7fd2fb1a5280 4 recover_dentries: frag 100000001f7.00000000 fnode old v11 vs new v13 2023-11-28T18:39:03.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.205+0000 7fd2fb1a5280 4 recover_dentries: writing fnode to omap header 2023-11-28T18:39:03.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.205+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:133 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b632000 con 0x56394c1d9800 2023-11-28T18:39:03.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.209+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.0 v2:172.21.15.45:6808/555237322 25 ==== osd_op_reply(133 100000001f7.00000000 [omap-set-header] v35'12 uv12 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x56394c158d80 con 0x56394c1d9800 2023-11-28T18:39:03.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.209+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:134 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b632e00 con 0x56394c1d9800 2023-11-28T18:39:03.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.209+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.0 v2:172.21.15.45:6808/555237322 26 ==== osd_op_reply(134 100000001f7.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x56394c158d80 con 0x56394c1d9800 2023-11-28T18:39:03.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.209+0000 7fd2fb1a5280 4 recover_dentries: inspecting remotebit 100000001f7.00000000/link2 2023-11-28T18:39:03.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.209+0000 7fd2fb1a5280 4 recover_dentries: dentry did not already exist, will create 2023-11-28T18:39:03.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.209+0000 7fd2fb1a5280 4 recover_dentries: writing L dentry link2_head into frag 100000001f7.00000000 2023-11-28T18:39:03.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.209+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:135 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-set-vals in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b632380 con 0x56394c1d9800 2023-11-28T18:39:03.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.209+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.0 v2:172.21.15.45:6808/555237322 27 ==== osd_op_reply(135 100000001f7.00000000 [omap-set-vals] v35'13 uv13 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x56394c158d80 con 0x56394c1d9800 2023-11-28T18:39:03.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.209+0000 7fd2fb1a5280 4 recover_dentries: inspecting lump 10000000001.00000000 2023-11-28T18:39:03.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.209+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] -- osd_op(unknown.0.0:136 4.7 4:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b632a80 con 0x56394c175800 2023-11-28T18:39:03.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.209+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.1 v2:172.21.15.45:6800/2857063763 29 ==== osd_op_reply(136 10000000001.00000000 [omap-get-header out=274b] v0'0 uv15 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x56394c158b40 con 0x56394c175800 2023-11-28T18:39:03.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.209+0000 7fd2fb1a5280 4 recover_dentries: frag 10000000001.00000000 fnode old v13 vs new v15 2023-11-28T18:39:03.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.209+0000 7fd2fb1a5280 4 recover_dentries: writing fnode to omap header 2023-11-28T18:39:03.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.209+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] -- osd_op(unknown.0.0:137 4.7 4:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b632000 con 0x56394c175800 2023-11-28T18:39:03.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.209+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.1 v2:172.21.15.45:6800/2857063763 30 ==== osd_op_reply(137 10000000001.00000000 [omap-set-header] v35'16 uv16 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x56394c158b40 con 0x56394c175800 2023-11-28T18:39:03.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.209+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] -- osd_op(unknown.0.0:138 4.7 4:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=23b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b632e00 con 0x56394c175800 2023-11-28T18:39:03.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.213+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.1 v2:172.21.15.45:6800/2857063763 31 ==== osd_op_reply(138 10000000001.00000000 [omap-get-vals-by-keys out=589b] v0'0 uv16 ondisk = 0) v8 ==== 164+0+589 (crc 0 0 0) 0x56394c158b40 con 0x56394c175800 2023-11-28T18:39:03.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.213+0000 7fd2fb1a5280 4 recover_dentries: inspecting fullbit 10000000001.00000000/subdirfile 2023-11-28T18:39:03.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.213+0000 7fd2fb1a5280 4 recover_dentries: dentry subdirfile_head existed already 2023-11-28T18:39:03.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.213+0000 7fd2fb1a5280 4 recover_dentries: dentry exists, checking versions... 2023-11-28T18:39:03.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.213+0000 7fd2fb1a5280 4 recover_dentries: decoded embedded inode version 12 vs fullbit version 14 2023-11-28T18:39:03.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.213+0000 7fd2fb1a5280 4 recover_dentries: writing I dentry subdirfile_head into frag 10000000001.00000000 2023-11-28T18:39:03.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.213+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] -- osd_op(unknown.0.0:139 4.7 4:e2e07930:::10000000001.00000000:head [omap-set-vals in=589b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b687180 con 0x56394c175800 2023-11-28T18:39:03.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.213+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.1 v2:172.21.15.45:6800/2857063763 32 ==== osd_op_reply(139 10000000001.00000000 [omap-set-vals] v35'17 uv17 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x56394c158b40 con 0x56394c175800 2023-11-28T18:39:03.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.213+0000 7fd2fb1a5280 4 recover_dentries: inspecting lump 1.00000000 2023-11-28T18:39:03.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.213+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:140 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b687500 con 0x56394c1d9400 2023-11-28T18:39:03.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.213+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 58 ==== osd_op_reply(140 1.00000000 [omap-get-header out=274b] v0'0 uv31 ondisk = 0) v8 ==== 154+0+274 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.213+0000 7fd2fb1a5280 4 recover_dentries: frag 1.00000000 fnode old v34 vs new v38 2023-11-28T18:39:03.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.213+0000 7fd2fb1a5280 4 recover_dentries: writing fnode to omap header 2023-11-28T18:39:03.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.213+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:141 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b687880 con 0x56394c1d9400 2023-11-28T18:39:03.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.213+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 59 ==== osd_op_reply(141 1.00000000 [omap-set-header] v35'32 uv32 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.213+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:142 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=35b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b687c00 con 0x56394c1d9400 2023-11-28T18:39:03.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.213+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 60 ==== osd_op_reply(142 1.00000000 [omap-get-vals-by-keys out=1011b] v0'0 uv32 ondisk = 0) v8 ==== 154+0+1011 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.213+0000 7fd2fb1a5280 4 recover_dentries: inspecting fullbit 1.00000000/linkdir 2023-11-28T18:39:03.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.213+0000 7fd2fb1a5280 4 recover_dentries: dentry linkdir_head existed already 2023-11-28T18:39:03.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.213+0000 7fd2fb1a5280 4 recover_dentries: dentry exists, checking versions... 2023-11-28T18:39:03.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.213+0000 7fd2fb1a5280 4 recover_dentries: decoded embedded inode version 31 vs fullbit version 35 2023-11-28T18:39:03.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.213+0000 7fd2fb1a5280 4 recover_dentries: writing I dentry linkdir_head into frag 1.00000000 2023-11-28T18:39:03.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.213+0000 7fd2fb1a5280 4 recover_dentries: inspecting fullbit 1.00000000/subdir 2023-11-28T18:39:03.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.213+0000 7fd2fb1a5280 4 recover_dentries: dentry subdir_head existed already 2023-11-28T18:39:03.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.213+0000 7fd2fb1a5280 4 recover_dentries: dentry exists, checking versions... 2023-11-28T18:39:03.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.213+0000 7fd2fb1a5280 4 recover_dentries: decoded embedded inode version 33 vs fullbit version 37 2023-11-28T18:39:03.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.213+0000 7fd2fb1a5280 4 recover_dentries: writing I dentry subdir_head into frag 1.00000000 2023-11-28T18:39:03.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.213+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:143 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-vals in=1011b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b2a7c00 con 0x56394c1d9400 2023-11-28T18:39:03.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.217+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 61 ==== osd_op_reply(143 1.00000000 [omap-set-vals] v35'33 uv33 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.217+0000 7fd2fb1a5280 4 recover_dentries: inspecting lump 10000000001.00000000 2023-11-28T18:39:03.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.217+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] -- osd_op(unknown.0.0:144 4.7 4:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b2a7880 con 0x56394c175800 2023-11-28T18:39:03.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.217+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.1 v2:172.21.15.45:6800/2857063763 33 ==== osd_op_reply(144 10000000001.00000000 [omap-get-header out=274b] v0'0 uv17 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x56394c158b40 con 0x56394c175800 2023-11-28T18:39:03.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.217+0000 7fd2fb1a5280 4 recover_dentries: frag 10000000001.00000000 fnode old v15 vs new v17 2023-11-28T18:39:03.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.217+0000 7fd2fb1a5280 4 recover_dentries: writing fnode to omap header 2023-11-28T18:39:03.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.217+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] -- osd_op(unknown.0.0:145 4.7 4:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b686000 con 0x56394c175800 2023-11-28T18:39:03.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.217+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.1 v2:172.21.15.45:6800/2857063763 34 ==== osd_op_reply(145 10000000001.00000000 [omap-set-header] v35'18 uv18 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x56394c158b40 con 0x56394c175800 2023-11-28T18:39:03.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.217+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] -- osd_op(unknown.0.0:146 4.7 4:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=23b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b686380 con 0x56394c175800 2023-11-28T18:39:03.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.217+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.1 v2:172.21.15.45:6800/2857063763 35 ==== osd_op_reply(146 10000000001.00000000 [omap-get-vals-by-keys out=589b] v0'0 uv18 ondisk = 0) v8 ==== 164+0+589 (crc 0 0 0) 0x56394c158b40 con 0x56394c175800 2023-11-28T18:39:03.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.217+0000 7fd2fb1a5280 4 recover_dentries: inspecting fullbit 10000000001.00000000/subdirfile 2023-11-28T18:39:03.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.217+0000 7fd2fb1a5280 4 recover_dentries: dentry subdirfile_head existed already 2023-11-28T18:39:03.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.217+0000 7fd2fb1a5280 4 recover_dentries: dentry exists, checking versions... 2023-11-28T18:39:03.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.217+0000 7fd2fb1a5280 4 recover_dentries: decoded embedded inode version 14 vs fullbit version 16 2023-11-28T18:39:03.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.217+0000 7fd2fb1a5280 4 recover_dentries: writing I dentry subdirfile_head into frag 10000000001.00000000 2023-11-28T18:39:03.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.217+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] -- osd_op(unknown.0.0:147 4.7 4:e2e07930:::10000000001.00000000:head [omap-set-vals in=603b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b686700 con 0x56394c175800 2023-11-28T18:39:03.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.221+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.1 v2:172.21.15.45:6800/2857063763 36 ==== osd_op_reply(147 10000000001.00000000 [omap-set-vals] v35'19 uv19 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x56394c158b40 con 0x56394c175800 2023-11-28T18:39:03.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.221+0000 7fd2fb1a5280 4 recover_dentries: inspecting lump 100000001f7.00000000 2023-11-28T18:39:03.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.221+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:148 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b686a80 con 0x56394c1d9800 2023-11-28T18:39:03.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.221+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.0 v2:172.21.15.45:6808/555237322 28 ==== osd_op_reply(148 100000001f7.00000000 [omap-get-header out=274b] v0'0 uv13 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x56394c158d80 con 0x56394c1d9800 2023-11-28T18:39:03.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.221+0000 7fd2fb1a5280 4 recover_dentries: frag 100000001f7.00000000 fnode old v13 vs new v15 2023-11-28T18:39:03.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.221+0000 7fd2fb1a5280 4 recover_dentries: writing fnode to omap header 2023-11-28T18:39:03.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.221+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:149 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b686e00 con 0x56394c1d9800 2023-11-28T18:39:03.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.221+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.0 v2:172.21.15.45:6808/555237322 29 ==== osd_op_reply(149 100000001f7.00000000 [omap-set-header] v35'14 uv14 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x56394c158d80 con 0x56394c1d9800 2023-11-28T18:39:03.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.221+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:150 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b687180 con 0x56394c1d9800 2023-11-28T18:39:03.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.221+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.0 v2:172.21.15.45:6808/555237322 30 ==== osd_op_reply(150 100000001f7.00000000 [omap-get-vals-by-keys out=40b] v0'0 uv14 ondisk = 0) v8 ==== 164+0+40 (crc 0 0 0) 0x56394c158d80 con 0x56394c1d9800 2023-11-28T18:39:03.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.221+0000 7fd2fb1a5280 4 recover_dentries: inspecting nullbit 100000001f7.00000000/link2 2023-11-28T18:39:03.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.221+0000 7fd2fb1a5280 4 recover_dentries: dentry exists, will remove 2023-11-28T18:39:03.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.221+0000 7fd2fb1a5280 10 recover_dentries: Existing hardlink inode in slot to be (maybe) removed by null journal dn 'link2' with lump fnode version 15vs existing fnode version 13 2023-11-28T18:39:03.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.221+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:151 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-rm-keys in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b687500 con 0x56394c1d9800 2023-11-28T18:39:03.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.221+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.0 v2:172.21.15.45:6808/555237322 31 ==== osd_op_reply(151 100000001f7.00000000 [omap-rm-keys] v35'15 uv15 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x56394c158d80 con 0x56394c1d9800 2023-11-28T18:39:03.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.221+0000 7fd2fb1a5280 4 recover_dentries: inspecting lump 1.00000000 2023-11-28T18:39:03.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.221+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:152 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b633500 con 0x56394c1d9400 2023-11-28T18:39:03.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.225+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 62 ==== osd_op_reply(152 1.00000000 [omap-get-header out=274b] v0'0 uv33 ondisk = 0) v8 ==== 154+0+274 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.225+0000 7fd2fb1a5280 4 recover_dentries: frag 1.00000000 fnode old v38 vs new v40 2023-11-28T18:39:03.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.225+0000 7fd2fb1a5280 4 recover_dentries: writing fnode to omap header 2023-11-28T18:39:03.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.225+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:153 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b633180 con 0x56394c1d9400 2023-11-28T18:39:03.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.225+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 63 ==== osd_op_reply(153 1.00000000 [omap-set-header] v35'34 uv34 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.225+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:154 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b633880 con 0x56394c1d9400 2023-11-28T18:39:03.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.225+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 64 ==== osd_op_reply(154 1.00000000 [omap-get-vals-by-keys out=508b] v0'0 uv34 ondisk = 0) v8 ==== 154+0+508 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.225+0000 7fd2fb1a5280 4 recover_dentries: inspecting fullbit 1.00000000/linkdir 2023-11-28T18:39:03.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.225+0000 7fd2fb1a5280 4 recover_dentries: dentry linkdir_head existed already 2023-11-28T18:39:03.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.225+0000 7fd2fb1a5280 4 recover_dentries: dentry exists, checking versions... 2023-11-28T18:39:03.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.225+0000 7fd2fb1a5280 4 recover_dentries: decoded embedded inode version 35 vs fullbit version 39 2023-11-28T18:39:03.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.225+0000 7fd2fb1a5280 4 recover_dentries: writing I dentry linkdir_head into frag 1.00000000 2023-11-28T18:39:03.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.225+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:155 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-vals in=508b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b632a80 con 0x56394c1d9400 2023-11-28T18:39:03.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.225+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 65 ==== osd_op_reply(155 1.00000000 [omap-set-vals] v35'35 uv35 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.225+0000 7fd2fb1a5280 4 recover_dentries: inspecting lump 100000001f7.00000000 2023-11-28T18:39:03.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.225+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:156 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b632000 con 0x56394c1d9800 2023-11-28T18:39:03.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.229+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.0 v2:172.21.15.45:6808/555237322 32 ==== osd_op_reply(156 100000001f7.00000000 [omap-get-header out=274b] v0'0 uv15 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x56394c158d80 con 0x56394c1d9800 2023-11-28T18:39:03.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.229+0000 7fd2fb1a5280 4 recover_dentries: frag 100000001f7.00000000 fnode old v15 vs new v17 2023-11-28T18:39:03.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.229+0000 7fd2fb1a5280 4 recover_dentries: writing fnode to omap header 2023-11-28T18:39:03.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.229+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:157 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b632e00 con 0x56394c1d9800 2023-11-28T18:39:03.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.229+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.0 v2:172.21.15.45:6808/555237322 33 ==== osd_op_reply(157 100000001f7.00000000 [omap-set-header] v35'16 uv16 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x56394c158d80 con 0x56394c1d9800 2023-11-28T18:39:03.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.229+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:158 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b6c2000 con 0x56394c1d9800 2023-11-28T18:39:03.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.229+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.0 v2:172.21.15.45:6808/555237322 34 ==== osd_op_reply(158 100000001f7.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv16 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x56394c158d80 con 0x56394c1d9800 2023-11-28T18:39:03.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.229+0000 7fd2fb1a5280 4 recover_dentries: inspecting fullbit 100000001f7.00000000/link2 2023-11-28T18:39:03.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.229+0000 7fd2fb1a5280 4 recover_dentries: dentry did not already exist, will create 2023-11-28T18:39:03.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.229+0000 7fd2fb1a5280 4 recover_dentries: writing I dentry link2_head into frag 100000001f7.00000000 2023-11-28T18:39:03.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.229+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:159 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-set-vals in=544b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b6c2380 con 0x56394c1d9800 2023-11-28T18:39:03.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.229+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.0 v2:172.21.15.45:6808/555237322 35 ==== osd_op_reply(159 100000001f7.00000000 [omap-set-vals] v35'17 uv17 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x56394c158d80 con 0x56394c1d9800 2023-11-28T18:39:03.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.229+0000 7fd2fb1a5280 4 recover_dentries: inspecting lump 1.00000000 2023-11-28T18:39:03.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.229+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:160 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b6c2700 con 0x56394c1d9400 2023-11-28T18:39:03.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.229+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 66 ==== osd_op_reply(160 1.00000000 [omap-get-header out=274b] v0'0 uv35 ondisk = 0) v8 ==== 154+0+274 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.229+0000 7fd2fb1a5280 4 recover_dentries: frag 1.00000000 fnode old v40 vs new v44 2023-11-28T18:39:03.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.229+0000 7fd2fb1a5280 4 recover_dentries: writing fnode to omap header 2023-11-28T18:39:03.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.229+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:161 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b6c2a80 con 0x56394c1d9400 2023-11-28T18:39:03.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.233+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 67 ==== osd_op_reply(161 1.00000000 [omap-set-header] v35'36 uv36 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.233+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:162 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=35b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b6c2e00 con 0x56394c1d9400 2023-11-28T18:39:03.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.233+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 68 ==== osd_op_reply(162 1.00000000 [omap-get-vals-by-keys out=1011b] v0'0 uv36 ondisk = 0) v8 ==== 154+0+1011 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.233+0000 7fd2fb1a5280 4 recover_dentries: inspecting fullbit 1.00000000/linkdir 2023-11-28T18:39:03.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.233+0000 7fd2fb1a5280 4 recover_dentries: dentry linkdir_head existed already 2023-11-28T18:39:03.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.233+0000 7fd2fb1a5280 4 recover_dentries: dentry exists, checking versions... 2023-11-28T18:39:03.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.233+0000 7fd2fb1a5280 4 recover_dentries: decoded embedded inode version 39 vs fullbit version 41 2023-11-28T18:39:03.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.233+0000 7fd2fb1a5280 4 recover_dentries: writing I dentry linkdir_head into frag 1.00000000 2023-11-28T18:39:03.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.233+0000 7fd2fb1a5280 4 recover_dentries: inspecting fullbit 1.00000000/subdir 2023-11-28T18:39:03.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.233+0000 7fd2fb1a5280 4 recover_dentries: dentry subdir_head existed already 2023-11-28T18:39:03.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.233+0000 7fd2fb1a5280 4 recover_dentries: dentry exists, checking versions... 2023-11-28T18:39:03.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.233+0000 7fd2fb1a5280 4 recover_dentries: decoded embedded inode version 37 vs fullbit version 43 2023-11-28T18:39:03.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.233+0000 7fd2fb1a5280 4 recover_dentries: writing I dentry subdir_head into frag 1.00000000 2023-11-28T18:39:03.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.233+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:163 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-vals in=1011b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b6c3180 con 0x56394c1d9400 2023-11-28T18:39:03.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.233+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 69 ==== osd_op_reply(163 1.00000000 [omap-set-vals] v35'37 uv37 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.233+0000 7fd2fb1a5280 4 recover_dentries: inspecting lump 100000001f7.00000000 2023-11-28T18:39:03.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.233+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:164 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b6c3500 con 0x56394c1d9800 2023-11-28T18:39:03.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.233+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.0 v2:172.21.15.45:6808/555237322 36 ==== osd_op_reply(164 100000001f7.00000000 [omap-get-header out=274b] v0'0 uv17 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x56394c158d80 con 0x56394c1d9800 2023-11-28T18:39:03.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.233+0000 7fd2fb1a5280 4 recover_dentries: frag 100000001f7.00000000 fnode old v17 vs new v19 2023-11-28T18:39:03.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.233+0000 7fd2fb1a5280 4 recover_dentries: writing fnode to omap header 2023-11-28T18:39:03.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.233+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:165 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b6c3880 con 0x56394c1d9800 2023-11-28T18:39:03.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.237+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.0 v2:172.21.15.45:6808/555237322 37 ==== osd_op_reply(165 100000001f7.00000000 [omap-set-header] v35'18 uv18 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x56394c158d80 con 0x56394c1d9800 2023-11-28T18:39:03.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.237+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:166 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b6c3c00 con 0x56394c1d9800 2023-11-28T18:39:03.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.237+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.0 v2:172.21.15.45:6808/555237322 38 ==== osd_op_reply(166 100000001f7.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv18 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x56394c158d80 con 0x56394c1d9800 2023-11-28T18:39:03.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.237+0000 7fd2fb1a5280 4 recover_dentries: inspecting remotebit 100000001f7.00000000/link3 2023-11-28T18:39:03.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.237+0000 7fd2fb1a5280 4 recover_dentries: dentry did not already exist, will create 2023-11-28T18:39:03.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.237+0000 7fd2fb1a5280 4 recover_dentries: writing L dentry link3_head into frag 100000001f7.00000000 2023-11-28T18:39:03.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.237+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:167 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-set-vals in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b6c2000 con 0x56394c1d9800 2023-11-28T18:39:03.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.237+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.0 v2:172.21.15.45:6808/555237322 39 ==== osd_op_reply(167 100000001f7.00000000 [omap-set-vals] v35'19 uv19 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x56394c158d80 con 0x56394c1d9800 2023-11-28T18:39:03.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.237+0000 7fd2fb1a5280 4 recover_dentries: inspecting lump 10000000001.00000000 2023-11-28T18:39:03.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.237+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] -- osd_op(unknown.0.0:168 4.7 4:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b6c2380 con 0x56394c175800 2023-11-28T18:39:03.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.237+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.1 v2:172.21.15.45:6800/2857063763 37 ==== osd_op_reply(168 10000000001.00000000 [omap-get-header out=274b] v0'0 uv19 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x56394c158b40 con 0x56394c175800 2023-11-28T18:39:03.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.237+0000 7fd2fb1a5280 4 recover_dentries: frag 10000000001.00000000 fnode old v17 vs new v19 2023-11-28T18:39:03.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.237+0000 7fd2fb1a5280 4 recover_dentries: writing fnode to omap header 2023-11-28T18:39:03.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.237+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] -- osd_op(unknown.0.0:169 4.7 4:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b6c3500 con 0x56394c175800 2023-11-28T18:39:03.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.241+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.1 v2:172.21.15.45:6800/2857063763 38 ==== osd_op_reply(169 10000000001.00000000 [omap-set-header] v35'20 uv20 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x56394c158b40 con 0x56394c175800 2023-11-28T18:39:03.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.241+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] -- osd_op(unknown.0.0:170 4.7 4:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=23b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b6c2700 con 0x56394c175800 2023-11-28T18:39:03.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.241+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.1 v2:172.21.15.45:6800/2857063763 39 ==== osd_op_reply(170 10000000001.00000000 [omap-get-vals-by-keys out=603b] v0'0 uv20 ondisk = 0) v8 ==== 164+0+603 (crc 0 0 0) 0x56394c158b40 con 0x56394c175800 2023-11-28T18:39:03.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.241+0000 7fd2fb1a5280 4 recover_dentries: inspecting fullbit 10000000001.00000000/subdirfile 2023-11-28T18:39:03.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.241+0000 7fd2fb1a5280 4 recover_dentries: dentry subdirfile_head existed already 2023-11-28T18:39:03.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.241+0000 7fd2fb1a5280 4 recover_dentries: dentry exists, checking versions... 2023-11-28T18:39:03.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.241+0000 7fd2fb1a5280 4 recover_dentries: decoded embedded inode version 16 vs fullbit version 18 2023-11-28T18:39:03.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.241+0000 7fd2fb1a5280 4 recover_dentries: writing I dentry subdirfile_head into frag 10000000001.00000000 2023-11-28T18:39:03.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.241+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] -- osd_op(unknown.0.0:171 4.7 4:e2e07930:::10000000001.00000000:head [omap-set-vals in=603b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b6c2a80 con 0x56394c175800 2023-11-28T18:39:03.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.241+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.1 v2:172.21.15.45:6800/2857063763 40 ==== osd_op_reply(171 10000000001.00000000 [omap-set-vals] v35'21 uv21 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x56394c158b40 con 0x56394c175800 2023-11-28T18:39:03.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.241+0000 7fd2fb1a5280 4 recover_dentries: inspecting lump 1.00000000 2023-11-28T18:39:03.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.241+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:172 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b6c2e00 con 0x56394c1d9400 2023-11-28T18:39:03.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.241+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 70 ==== osd_op_reply(172 1.00000000 [omap-get-header out=274b] v0'0 uv37 ondisk = 0) v8 ==== 154+0+274 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.241+0000 7fd2fb1a5280 4 recover_dentries: frag 1.00000000 fnode old v44 vs new v48 2023-11-28T18:39:03.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.241+0000 7fd2fb1a5280 4 recover_dentries: writing fnode to omap header 2023-11-28T18:39:03.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.241+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:173 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b632380 con 0x56394c1d9400 2023-11-28T18:39:03.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.245+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 71 ==== osd_op_reply(173 1.00000000 [omap-set-header] v35'38 uv38 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.245+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:174 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=35b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b632000 con 0x56394c1d9400 2023-11-28T18:39:03.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.245+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 72 ==== osd_op_reply(174 1.00000000 [omap-get-vals-by-keys out=1011b] v0'0 uv38 ondisk = 0) v8 ==== 154+0+1011 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.245+0000 7fd2fb1a5280 4 recover_dentries: inspecting fullbit 1.00000000/linkdir 2023-11-28T18:39:03.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.245+0000 7fd2fb1a5280 4 recover_dentries: dentry linkdir_head existed already 2023-11-28T18:39:03.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.245+0000 7fd2fb1a5280 4 recover_dentries: dentry exists, checking versions... 2023-11-28T18:39:03.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.245+0000 7fd2fb1a5280 4 recover_dentries: decoded embedded inode version 41 vs fullbit version 45 2023-11-28T18:39:03.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.245+0000 7fd2fb1a5280 4 recover_dentries: writing I dentry linkdir_head into frag 1.00000000 2023-11-28T18:39:03.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.245+0000 7fd2fb1a5280 4 recover_dentries: inspecting fullbit 1.00000000/subdir 2023-11-28T18:39:03.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.245+0000 7fd2fb1a5280 4 recover_dentries: dentry subdir_head existed already 2023-11-28T18:39:03.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.245+0000 7fd2fb1a5280 4 recover_dentries: dentry exists, checking versions... 2023-11-28T18:39:03.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.245+0000 7fd2fb1a5280 4 recover_dentries: decoded embedded inode version 43 vs fullbit version 47 2023-11-28T18:39:03.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.245+0000 7fd2fb1a5280 4 recover_dentries: writing I dentry subdir_head into frag 1.00000000 2023-11-28T18:39:03.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.245+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:175 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-vals in=1011b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b632e00 con 0x56394c1d9400 2023-11-28T18:39:03.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.245+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 73 ==== osd_op_reply(175 1.00000000 [omap-set-vals] v35'39 uv39 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.245+0000 7fd2fb1a5280 4 recover_dentries: inspecting lump 10000000001.00000000 2023-11-28T18:39:03.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.245+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] -- osd_op(unknown.0.0:176 4.7 4:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b633500 con 0x56394c175800 2023-11-28T18:39:03.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.245+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.1 v2:172.21.15.45:6800/2857063763 41 ==== osd_op_reply(176 10000000001.00000000 [omap-get-header out=274b] v0'0 uv21 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x56394c158b40 con 0x56394c175800 2023-11-28T18:39:03.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.245+0000 7fd2fb1a5280 4 recover_dentries: frag 10000000001.00000000 fnode old v19 vs new v21 2023-11-28T18:39:03.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.245+0000 7fd2fb1a5280 4 recover_dentries: writing fnode to omap header 2023-11-28T18:39:03.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.245+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] -- osd_op(unknown.0.0:177 4.7 4:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b633180 con 0x56394c175800 2023-11-28T18:39:03.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.249+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.1 v2:172.21.15.45:6800/2857063763 42 ==== osd_op_reply(177 10000000001.00000000 [omap-set-header] v35'22 uv22 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x56394c158b40 con 0x56394c175800 2023-11-28T18:39:03.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.249+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] -- osd_op(unknown.0.0:178 4.7 4:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=23b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b633880 con 0x56394c175800 2023-11-28T18:39:03.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.249+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.1 v2:172.21.15.45:6800/2857063763 43 ==== osd_op_reply(178 10000000001.00000000 [omap-get-vals-by-keys out=603b] v0'0 uv22 ondisk = 0) v8 ==== 164+0+603 (crc 0 0 0) 0x56394c158b40 con 0x56394c175800 2023-11-28T18:39:03.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.249+0000 7fd2fb1a5280 4 recover_dentries: inspecting fullbit 10000000001.00000000/subdirfile 2023-11-28T18:39:03.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.249+0000 7fd2fb1a5280 4 recover_dentries: dentry subdirfile_head existed already 2023-11-28T18:39:03.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.249+0000 7fd2fb1a5280 4 recover_dentries: dentry exists, checking versions... 2023-11-28T18:39:03.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.249+0000 7fd2fb1a5280 4 recover_dentries: decoded embedded inode version 18 vs fullbit version 20 2023-11-28T18:39:03.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.249+0000 7fd2fb1a5280 4 recover_dentries: writing I dentry subdirfile_head into frag 10000000001.00000000 2023-11-28T18:39:03.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.249+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] -- osd_op(unknown.0.0:179 4.7 4:e2e07930:::10000000001.00000000:head [omap-set-vals in=603b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b632a80 con 0x56394c175800 2023-11-28T18:39:03.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.249+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.1 v2:172.21.15.45:6800/2857063763 44 ==== osd_op_reply(179 10000000001.00000000 [omap-set-vals] v35'23 uv23 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x56394c158b40 con 0x56394c175800 2023-11-28T18:39:03.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.249+0000 7fd2fb1a5280 4 recover_dentries: inspecting lump 100000001f7.00000000 2023-11-28T18:39:03.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.249+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:180 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b2a7c00 con 0x56394c1d9800 2023-11-28T18:39:03.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.249+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.0 v2:172.21.15.45:6808/555237322 40 ==== osd_op_reply(180 100000001f7.00000000 [omap-get-header out=274b] v0'0 uv19 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x56394c158d80 con 0x56394c1d9800 2023-11-28T18:39:03.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.249+0000 7fd2fb1a5280 4 recover_dentries: frag 100000001f7.00000000 fnode old v19 vs new v21 2023-11-28T18:39:03.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.249+0000 7fd2fb1a5280 4 recover_dentries: writing fnode to omap header 2023-11-28T18:39:03.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.249+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:181 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b2a7880 con 0x56394c1d9800 2023-11-28T18:39:03.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.249+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.0 v2:172.21.15.45:6808/555237322 41 ==== osd_op_reply(181 100000001f7.00000000 [omap-set-header] v35'20 uv20 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x56394c158d80 con 0x56394c1d9800 2023-11-28T18:39:03.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.249+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:182 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394c0a4000 con 0x56394c1d9800 2023-11-28T18:39:03.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.249+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.0 v2:172.21.15.45:6808/555237322 42 ==== osd_op_reply(182 100000001f7.00000000 [omap-get-vals-by-keys out=40b] v0'0 uv20 ondisk = 0) v8 ==== 164+0+40 (crc 0 0 0) 0x56394c158d80 con 0x56394c1d9800 2023-11-28T18:39:03.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.249+0000 7fd2fb1a5280 4 recover_dentries: inspecting nullbit 100000001f7.00000000/link3 2023-11-28T18:39:03.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.249+0000 7fd2fb1a5280 4 recover_dentries: dentry exists, will remove 2023-11-28T18:39:03.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.249+0000 7fd2fb1a5280 10 recover_dentries: Existing hardlink inode in slot to be (maybe) removed by null journal dn 'link3' with lump fnode version 21vs existing fnode version 19 2023-11-28T18:39:03.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.249+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:183 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-rm-keys in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394c0a4380 con 0x56394c1d9800 2023-11-28T18:39:03.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.253+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.0 v2:172.21.15.45:6808/555237322 43 ==== osd_op_reply(183 100000001f7.00000000 [omap-rm-keys] v35'21 uv21 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x56394c158d80 con 0x56394c1d9800 2023-11-28T18:39:03.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.253+0000 7fd2fb1a5280 4 recover_dentries: inspecting lump 1.00000000 2023-11-28T18:39:03.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.253+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:184 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394c0a4700 con 0x56394c1d9400 2023-11-28T18:39:03.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.253+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 74 ==== osd_op_reply(184 1.00000000 [omap-get-header out=274b] v0'0 uv39 ondisk = 0) v8 ==== 154+0+274 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.253+0000 7fd2fb1a5280 4 recover_dentries: frag 1.00000000 fnode old v48 vs new v50 2023-11-28T18:39:03.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.253+0000 7fd2fb1a5280 4 recover_dentries: writing fnode to omap header 2023-11-28T18:39:03.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.253+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:185 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394c0a4a80 con 0x56394c1d9400 2023-11-28T18:39:03.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.253+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 75 ==== osd_op_reply(185 1.00000000 [omap-set-header] v35'40 uv40 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.253+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:186 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=21b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394c0a4e00 con 0x56394c1d9400 2023-11-28T18:39:03.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.253+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 76 ==== osd_op_reply(186 1.00000000 [omap-get-vals-by-keys out=547b] v0'0 uv40 ondisk = 0) v8 ==== 154+0+547 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.253+0000 7fd2fb1a5280 4 recover_dentries: inspecting fullbit 1.00000000/rootfile 2023-11-28T18:39:03.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.253+0000 7fd2fb1a5280 4 recover_dentries: dentry rootfile_head existed already 2023-11-28T18:39:03.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.253+0000 7fd2fb1a5280 4 recover_dentries: dentry exists, checking versions... 2023-11-28T18:39:03.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.253+0000 7fd2fb1a5280 4 recover_dentries: decoded embedded inode version 2 vs fullbit version 49 2023-11-28T18:39:03.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.253+0000 7fd2fb1a5280 4 recover_dentries: writing I dentry rootfile_head into frag 1.00000000 2023-11-28T18:39:03.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.253+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:187 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-vals in=509b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394c0a5180 con 0x56394c1d9400 2023-11-28T18:39:03.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.257+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 77 ==== osd_op_reply(187 1.00000000 [omap-set-vals] v35'41 uv41 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.257+0000 7fd2fb1a5280 4 recover_dentries: updating root 0x0x1 2023-11-28T18:39:03.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.257+0000 7fd2fb1a5280 4 recover_dentries: object id 1.00000000.inode 2023-11-28T18:39:03.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.257+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:188 4.14 4:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394c0a5500 con 0x56394c175c00 2023-11-28T18:39:03.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.257+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.3 v2:172.21.15.45:6824/78541084 17 ==== osd_op_reply(188 1.00000000.inode [read 0~582 out=582b] v0'0 uv34 ondisk = 0) v8 ==== 160+0+582 (crc 0 0 0) 0x56394c158d80 con 0x56394c175c00 2023-11-28T18:39:03.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.257+0000 7fd2fb1a5280 4 recover_dentries: root exists, will modify (582) 2023-11-28T18:39:03.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.257+0000 7fd2fb1a5280 4 recover_dentries: magic ok 2023-11-28T18:39:03.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.257+0000 7fd2fb1a5280 4 recover_dentries: writing root ino 1.00000000.inode version 7 2023-11-28T18:39:03.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.257+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:189 4.14 4:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394c0a5880 con 0x56394c175c00 2023-11-28T18:39:03.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.257+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.3 v2:172.21.15.45:6824/78541084 18 ==== osd_op_reply(189 1.00000000.inode [writefull 0~582] v35'35 uv35 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x56394c158d80 con 0x56394c175c00 2023-11-28T18:39:03.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.261+0000 7fd2fb1a5280 4 recover_dentries: inspecting lump 1.00000000 2023-11-28T18:39:03.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.261+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:190 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394c0a5c00 con 0x56394c1d9400 2023-11-28T18:39:03.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.261+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 78 ==== osd_op_reply(190 1.00000000 [omap-get-header out=274b] v0'0 uv41 ondisk = 0) v8 ==== 154+0+274 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.261+0000 7fd2fb1a5280 4 recover_dentries: frag 1.00000000 fnode old v50 vs new v54 2023-11-28T18:39:03.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.261+0000 7fd2fb1a5280 4 recover_dentries: writing fnode to omap header 2023-11-28T18:39:03.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.261+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:191 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394c0a4700 con 0x56394c1d9400 2023-11-28T18:39:03.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.261+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 79 ==== osd_op_reply(191 1.00000000 [omap-set-header] v35'42 uv42 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.261+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:192 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=37b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394c0a4a80 con 0x56394c1d9400 2023-11-28T18:39:03.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.261+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 80 ==== osd_op_reply(192 1.00000000 [omap-get-vals-by-keys out=1013b] v0'0 uv42 ondisk = 0) v8 ==== 154+0+1013 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.261+0000 7fd2fb1a5280 4 recover_dentries: inspecting fullbit 1.00000000/linkdir 2023-11-28T18:39:03.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.261+0000 7fd2fb1a5280 4 recover_dentries: dentry linkdir_head existed already 2023-11-28T18:39:03.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.261+0000 7fd2fb1a5280 4 recover_dentries: dentry exists, checking versions... 2023-11-28T18:39:03.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.261+0000 7fd2fb1a5280 4 recover_dentries: decoded embedded inode version 45 vs fullbit version 52 2023-11-28T18:39:03.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.261+0000 7fd2fb1a5280 4 recover_dentries: writing I dentry linkdir_head into frag 1.00000000 2023-11-28T18:39:03.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.261+0000 7fd2fb1a5280 4 recover_dentries: inspecting fullbit 1.00000000/rootfile 2023-11-28T18:39:03.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.261+0000 7fd2fb1a5280 4 recover_dentries: dentry rootfile_head existed already 2023-11-28T18:39:03.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.261+0000 7fd2fb1a5280 4 recover_dentries: dentry exists, checking versions... 2023-11-28T18:39:03.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.261+0000 7fd2fb1a5280 4 recover_dentries: decoded embedded inode version 49 vs fullbit version 51 2023-11-28T18:39:03.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.261+0000 7fd2fb1a5280 4 recover_dentries: writing I dentry rootfile_head into frag 1.00000000 2023-11-28T18:39:03.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.261+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:193 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-vals in=1091b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b632380 con 0x56394c1d9400 2023-11-28T18:39:03.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.265+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 81 ==== osd_op_reply(193 1.00000000 [omap-set-vals] v35'43 uv43 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.265+0000 7fd2fb1a5280 4 recover_dentries: inspecting lump 100000001f7.00000000 2023-11-28T18:39:03.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.265+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:194 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b632000 con 0x56394c1d9800 2023-11-28T18:39:03.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.265+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.0 v2:172.21.15.45:6808/555237322 44 ==== osd_op_reply(194 100000001f7.00000000 [omap-get-header out=274b] v0'0 uv21 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x56394c158d80 con 0x56394c1d9800 2023-11-28T18:39:03.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.265+0000 7fd2fb1a5280 4 recover_dentries: frag 100000001f7.00000000 fnode old v21 vs new v23 2023-11-28T18:39:03.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.265+0000 7fd2fb1a5280 4 recover_dentries: writing fnode to omap header 2023-11-28T18:39:03.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.265+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:195 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b632e00 con 0x56394c1d9800 2023-11-28T18:39:03.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.265+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.0 v2:172.21.15.45:6808/555237322 45 ==== osd_op_reply(195 100000001f7.00000000 [omap-set-header] v35'22 uv22 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x56394c158d80 con 0x56394c1d9800 2023-11-28T18:39:03.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.265+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:196 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b633500 con 0x56394c1d9800 2023-11-28T18:39:03.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.265+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.0 v2:172.21.15.45:6808/555237322 46 ==== osd_op_reply(196 100000001f7.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv22 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x56394c158d80 con 0x56394c1d9800 2023-11-28T18:39:03.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.265+0000 7fd2fb1a5280 4 recover_dentries: inspecting remotebit 100000001f7.00000000/link3 2023-11-28T18:39:03.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.265+0000 7fd2fb1a5280 4 recover_dentries: dentry did not already exist, will create 2023-11-28T18:39:03.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.265+0000 7fd2fb1a5280 4 recover_dentries: writing L dentry link3_head into frag 100000001f7.00000000 2023-11-28T18:39:03.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.265+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:197 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-set-vals in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b633180 con 0x56394c1d9800 2023-11-28T18:39:03.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.265+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.0 v2:172.21.15.45:6808/555237322 47 ==== osd_op_reply(197 100000001f7.00000000 [omap-set-vals] v35'23 uv23 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x56394c158d80 con 0x56394c1d9800 2023-11-28T18:39:03.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.265+0000 7fd2fb1a5280 4 recover_dentries: updating root 0x0x1 2023-11-28T18:39:03.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.265+0000 7fd2fb1a5280 4 recover_dentries: object id 1.00000000.inode 2023-11-28T18:39:03.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.269+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:198 4.14 4:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b633880 con 0x56394c175c00 2023-11-28T18:39:03.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.269+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.3 v2:172.21.15.45:6824/78541084 19 ==== osd_op_reply(198 1.00000000.inode [read 0~582 out=582b] v0'0 uv35 ondisk = 0) v8 ==== 160+0+582 (crc 0 0 0) 0x56394c158d80 con 0x56394c175c00 2023-11-28T18:39:03.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.269+0000 7fd2fb1a5280 4 recover_dentries: root exists, will modify (582) 2023-11-28T18:39:03.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.269+0000 7fd2fb1a5280 4 recover_dentries: magic ok 2023-11-28T18:39:03.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.269+0000 7fd2fb1a5280 4 recover_dentries: writing root ino 1.00000000.inode version 8 2023-11-28T18:39:03.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.269+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:199 4.14 4:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b632a80 con 0x56394c175c00 2023-11-28T18:39:03.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.269+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.3 v2:172.21.15.45:6824/78541084 20 ==== osd_op_reply(199 1.00000000.inode [writefull 0~582] v35'36 uv36 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x56394c158d80 con 0x56394c175c00 2023-11-28T18:39:03.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.269+0000 7fd2fb1a5280 4 recover_dentries: inspecting lump 1.00000000 2023-11-28T18:39:03.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.269+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:200 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b6c3180 con 0x56394c1d9400 2023-11-28T18:39:03.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.269+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 82 ==== osd_op_reply(200 1.00000000 [omap-get-header out=274b] v0'0 uv43 ondisk = 0) v8 ==== 154+0+274 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.269+0000 7fd2fb1a5280 4 recover_dentries: frag 1.00000000 fnode old v54 vs new v56 2023-11-28T18:39:03.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.269+0000 7fd2fb1a5280 4 recover_dentries: writing fnode to omap header 2023-11-28T18:39:03.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.269+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:201 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b6c2380 con 0x56394c1d9400 2023-11-28T18:39:03.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.269+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 83 ==== osd_op_reply(201 1.00000000 [omap-set-header] v35'44 uv44 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.269+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:202 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b6c3500 con 0x56394c1d9400 2023-11-28T18:39:03.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.273+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 84 ==== osd_op_reply(202 1.00000000 [omap-get-vals-by-keys out=507b] v0'0 uv44 ondisk = 0) v8 ==== 154+0+507 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.273+0000 7fd2fb1a5280 4 recover_dentries: inspecting fullbit 1.00000000/subdir 2023-11-28T18:39:03.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.273+0000 7fd2fb1a5280 4 recover_dentries: dentry subdir_head existed already 2023-11-28T18:39:03.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.273+0000 7fd2fb1a5280 4 recover_dentries: dentry exists, checking versions... 2023-11-28T18:39:03.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.273+0000 7fd2fb1a5280 4 recover_dentries: decoded embedded inode version 47 vs fullbit version 55 2023-11-28T18:39:03.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.273+0000 7fd2fb1a5280 4 recover_dentries: writing I dentry subdir_head into frag 1.00000000 2023-11-28T18:39:03.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.273+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:203 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-vals in=507b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b6c2700 con 0x56394c1d9400 2023-11-28T18:39:03.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.273+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 85 ==== osd_op_reply(203 1.00000000 [omap-set-vals] v35'45 uv45 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.273+0000 7fd2fb1a5280 4 recover_dentries: inspecting lump 10000000001.00000000 2023-11-28T18:39:03.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.273+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] -- osd_op(unknown.0.0:204 4.7 4:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b6c2a80 con 0x56394c175800 2023-11-28T18:39:03.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.273+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.1 v2:172.21.15.45:6800/2857063763 45 ==== osd_op_reply(204 10000000001.00000000 [omap-get-header out=274b] v0'0 uv23 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x56394c158b40 con 0x56394c175800 2023-11-28T18:39:03.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.273+0000 7fd2fb1a5280 4 recover_dentries: frag 10000000001.00000000 fnode old v21 vs new v23 2023-11-28T18:39:03.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.273+0000 7fd2fb1a5280 4 recover_dentries: writing fnode to omap header 2023-11-28T18:39:03.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.273+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] -- osd_op(unknown.0.0:205 4.7 4:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b6c2e00 con 0x56394c175800 2023-11-28T18:39:03.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.273+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.1 v2:172.21.15.45:6800/2857063763 46 ==== osd_op_reply(205 10000000001.00000000 [omap-set-header] v35'24 uv24 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x56394c158b40 con 0x56394c175800 2023-11-28T18:39:03.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.273+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] -- osd_op(unknown.0.0:206 4.7 4:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=22b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b632000 con 0x56394c175800 2023-11-28T18:39:03.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.273+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.1 v2:172.21.15.45:6800/2857063763 47 ==== osd_op_reply(206 10000000001.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv24 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x56394c158b40 con 0x56394c175800 2023-11-28T18:39:03.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.273+0000 7fd2fb1a5280 4 recover_dentries: inspecting fullbit 10000000001.00000000/subsubdir 2023-11-28T18:39:03.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.273+0000 7fd2fb1a5280 4 recover_dentries: dentry did not already exist, will create 2023-11-28T18:39:03.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.273+0000 7fd2fb1a5280 4 recover_dentries: writing I dentry subsubdir_head into frag 10000000001.00000000 2023-11-28T18:39:03.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.273+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] -- osd_op(unknown.0.0:207 4.7 4:e2e07930:::10000000001.00000000:head [omap-set-vals in=510b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b632e00 con 0x56394c175800 2023-11-28T18:39:03.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.277+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.1 v2:172.21.15.45:6800/2857063763 48 ==== osd_op_reply(207 10000000001.00000000 [omap-set-vals] v35'25 uv25 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x56394c158b40 con 0x56394c175800 2023-11-28T18:39:03.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.277+0000 7fd2fb1a5280 4 recover_dentries: inspecting lump 100000001fa.00000000 2023-11-28T18:39:03.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.277+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:208 4.1f 4:feb1c803:::100000001fa.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394c0a4000 con 0x56394c1d9400 2023-11-28T18:39:03.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.277+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 86 ==== osd_op_reply(208 100000001fa.00000000 [omap-get-header] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.277+0000 7fd2fb1a5280 4 recover_dentries: failed to read OMAP header from directory fragment 100000001fa.00000000 (2) No such file or directory 2023-11-28T18:39:03.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.277+0000 7fd2fb1a5280 4 recover_dentries: writing fnode to omap header 2023-11-28T18:39:03.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.277+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:209 4.1f 4:feb1c803:::100000001fa.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394c0a4380 con 0x56394c1d9400 2023-11-28T18:39:03.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.277+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 87 ==== osd_op_reply(209 100000001fa.00000000 [omap-set-header] v35'46 uv46 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.277+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:210 4.1f 4:feb1c803:::100000001fa.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394c0a5500 con 0x56394c1d9400 2023-11-28T18:39:03.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.277+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 88 ==== osd_op_reply(210 100000001fa.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv46 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.277+0000 7fd2fb1a5280 4 recover_dentries: inspecting lump 602.00000000 2023-11-28T18:39:03.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.277+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:211 4.10 4:0bd6d154:::602.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394c0a5880 con 0x56394c175c00 2023-11-28T18:39:03.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.277+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.3 v2:172.21.15.45:6824/78541084 21 ==== osd_op_reply(211 602.00000000 [omap-get-header out=274b] v0'0 uv10 ondisk = 0) v8 ==== 156+0+274 (crc 0 0 0) 0x56394c158d80 con 0x56394c175c00 2023-11-28T18:39:03.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.277+0000 7fd2fb1a5280 4 recover_dentries: frag 602.00000000 fnode old v6 vs new v8 2023-11-28T18:39:03.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.277+0000 7fd2fb1a5280 4 recover_dentries: writing fnode to omap header 2023-11-28T18:39:03.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.277+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:212 4.10 4:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b2a7c00 con 0x56394c175c00 2023-11-28T18:39:03.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.281+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.3 v2:172.21.15.45:6824/78541084 22 ==== osd_op_reply(212 602.00000000 [omap-set-header] v35'11 uv11 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x56394c158d80 con 0x56394c175c00 2023-11-28T18:39:03.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.281+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:213 4.10 4:0bd6d154:::602.00000000:head [omap-get-vals-by-keys in=24b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b2a7880 con 0x56394c175c00 2023-11-28T18:39:03.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.281+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.3 v2:172.21.15.45:6824/78541084 23 ==== osd_op_reply(213 602.00000000 [omap-get-vals-by-keys out=526b] v0'0 uv11 ondisk = 0) v8 ==== 156+0+526 (crc 0 0 0) 0x56394c158d80 con 0x56394c175c00 2023-11-28T18:39:03.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.281+0000 7fd2fb1a5280 4 recover_dentries: inspecting nullbit 602.00000000/100000001f8 2023-11-28T18:39:03.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.281+0000 7fd2fb1a5280 4 recover_dentries: dentry exists, will remove 2023-11-28T18:39:03.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.281+0000 7fd2fb1a5280 10 recover_dentries: Existing full inode in slot to be (maybe) removed by null journal dn '100000001f8' with lump fnode version 8vs existing fnode version 6 2023-11-28T18:39:03.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.281+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:214 4.10 4:0bd6d154:::602.00000000:head [omap-rm-keys in=24b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b6c3880 con 0x56394c175c00 2023-11-28T18:39:03.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.281+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.3 v2:172.21.15.45:6824/78541084 24 ==== osd_op_reply(214 602.00000000 [omap-rm-keys] v35'12 uv12 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x56394c158d80 con 0x56394c175c00 2023-11-28T18:39:03.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.281+0000 7fd2fb1a5280 4 recover_dentries: inspecting lump 1.00000000 2023-11-28T18:39:03.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.281+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:215 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b6c3c00 con 0x56394c1d9400 2023-11-28T18:39:03.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.281+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 89 ==== osd_op_reply(215 1.00000000 [omap-get-header out=274b] v0'0 uv45 ondisk = 0) v8 ==== 154+0+274 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.281+0000 7fd2fb1a5280 4 recover_dentries: frag 1.00000000 fnode old v56 vs new v58 2023-11-28T18:39:03.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.281+0000 7fd2fb1a5280 4 recover_dentries: writing fnode to omap header 2023-11-28T18:39:03.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.281+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:216 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b6c2000 con 0x56394c1d9400 2023-11-28T18:39:03.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.285+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 90 ==== osd_op_reply(216 1.00000000 [omap-set-header] v35'47 uv47 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.285+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:217 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394c0a4e00 con 0x56394c1d9400 2023-11-28T18:39:03.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.285+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 91 ==== osd_op_reply(217 1.00000000 [omap-get-vals-by-keys out=508b] v0'0 uv47 ondisk = 0) v8 ==== 154+0+508 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.285+0000 7fd2fb1a5280 4 recover_dentries: inspecting fullbit 1.00000000/linkdir 2023-11-28T18:39:03.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.285+0000 7fd2fb1a5280 4 recover_dentries: dentry linkdir_head existed already 2023-11-28T18:39:03.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.285+0000 7fd2fb1a5280 4 recover_dentries: dentry exists, checking versions... 2023-11-28T18:39:03.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.285+0000 7fd2fb1a5280 4 recover_dentries: decoded embedded inode version 52 vs fullbit version 57 2023-11-28T18:39:03.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.285+0000 7fd2fb1a5280 4 recover_dentries: writing I dentry linkdir_head into frag 1.00000000 2023-11-28T18:39:03.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.285+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:218 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-vals in=508b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394c0a5180 con 0x56394c1d9400 2023-11-28T18:39:03.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.285+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 92 ==== osd_op_reply(218 1.00000000 [omap-set-vals] v35'48 uv48 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.285+0000 7fd2fb1a5280 4 recover_dentries: inspecting lump 100000001f7.00000000 2023-11-28T18:39:03.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.285+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:219 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394c0a5c00 con 0x56394c1d9800 2023-11-28T18:39:03.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.285+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.0 v2:172.21.15.45:6808/555237322 48 ==== osd_op_reply(219 100000001f7.00000000 [omap-get-header out=274b] v0'0 uv23 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x56394c158d80 con 0x56394c1d9800 2023-11-28T18:39:03.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.285+0000 7fd2fb1a5280 4 recover_dentries: frag 100000001f7.00000000 fnode old v23 vs new v25 2023-11-28T18:39:03.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.285+0000 7fd2fb1a5280 4 recover_dentries: writing fnode to omap header 2023-11-28T18:39:03.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.285+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:220 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394c0a4700 con 0x56394c1d9800 2023-11-28T18:39:03.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.285+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.0 v2:172.21.15.45:6808/555237322 49 ==== osd_op_reply(220 100000001f7.00000000 [omap-set-header] v35'24 uv24 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x56394c158d80 con 0x56394c1d9800 2023-11-28T18:39:03.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.285+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:221 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394c0a4a80 con 0x56394c1d9800 2023-11-28T18:39:03.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.285+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.0 v2:172.21.15.45:6808/555237322 50 ==== osd_op_reply(221 100000001f7.00000000 [omap-get-vals-by-keys out=544b] v0'0 uv24 ondisk = 0) v8 ==== 164+0+544 (crc 0 0 0) 0x56394c158d80 con 0x56394c1d9800 2023-11-28T18:39:03.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.285+0000 7fd2fb1a5280 4 recover_dentries: inspecting fullbit 100000001f7.00000000/link2 2023-11-28T18:39:03.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.285+0000 7fd2fb1a5280 4 recover_dentries: dentry link2_head existed already 2023-11-28T18:39:03.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.285+0000 7fd2fb1a5280 4 recover_dentries: dentry exists, checking versions... 2023-11-28T18:39:03.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.285+0000 7fd2fb1a5280 4 recover_dentries: decoded embedded inode version 16 vs fullbit version 24 2023-11-28T18:39:03.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.285+0000 7fd2fb1a5280 4 recover_dentries: writing I dentry link2_head into frag 100000001f7.00000000 2023-11-28T18:39:03.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.285+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:222 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-set-vals in=506b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394c0a4000 con 0x56394c1d9800 2023-11-28T18:39:03.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.289+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.0 v2:172.21.15.45:6808/555237322 51 ==== osd_op_reply(222 100000001f7.00000000 [omap-set-vals] v35'25 uv25 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x56394c158d80 con 0x56394c1d9800 2023-11-28T18:39:03.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.289+0000 7fd2fb1a5280 4 recover_dentries: updating root 0x0x1 2023-11-28T18:39:03.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.289+0000 7fd2fb1a5280 4 recover_dentries: object id 1.00000000.inode 2023-11-28T18:39:03.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.289+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:223 4.14 4:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394c0a4380 con 0x56394c175c00 2023-11-28T18:39:03.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.289+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.3 v2:172.21.15.45:6824/78541084 25 ==== osd_op_reply(223 1.00000000.inode [read 0~582 out=582b] v0'0 uv36 ondisk = 0) v8 ==== 160+0+582 (crc 0 0 0) 0x56394c158d80 con 0x56394c175c00 2023-11-28T18:39:03.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.289+0000 7fd2fb1a5280 4 recover_dentries: root exists, will modify (582) 2023-11-28T18:39:03.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.289+0000 7fd2fb1a5280 4 recover_dentries: magic ok 2023-11-28T18:39:03.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.289+0000 7fd2fb1a5280 4 recover_dentries: writing root ino 1.00000000.inode version 9 2023-11-28T18:39:03.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.289+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:224 4.14 4:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b632380 con 0x56394c175c00 2023-11-28T18:39:03.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.289+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.3 v2:172.21.15.45:6824/78541084 26 ==== osd_op_reply(224 1.00000000.inode [writefull 0~582] v35'37 uv37 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x56394c158d80 con 0x56394c175c00 2023-11-28T18:39:03.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.289+0000 7fd2fb1a5280 4 recover_dentries: inspecting lump 100.00000000 2023-11-28T18:39:03.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.289+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6808/1537591987,v1:172.21.15.190:6809/1537591987] -- osd_op(unknown.0.0:225 4.13 4:cd5a64a3:::100.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b632000 con 0x56394c1d9000 2023-11-28T18:39:03.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.293+0000 7fd2f9964640 1 -- 172.21.15.45:0/1087626730 <== osd.4 v2:172.21.15.190:6808/1537591987 8 ==== osd_op_reply(225 100.00000000 [omap-get-header out=274b] v0'0 uv4 ondisk = 0) v8 ==== 156+0+274 (crc 0 0 0) 0x56394c158fc0 con 0x56394c1d9000 2023-11-28T18:39:03.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.293+0000 7fd2fb1a5280 4 recover_dentries: frag 100.00000000 fnode old v3 vs new v5 2023-11-28T18:39:03.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.293+0000 7fd2fb1a5280 4 recover_dentries: writing fnode to omap header 2023-11-28T18:39:03.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.293+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6808/1537591987,v1:172.21.15.190:6809/1537591987] -- osd_op(unknown.0.0:226 4.13 4:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b632e00 con 0x56394c1d9000 2023-11-28T18:39:03.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.293+0000 7fd2f9964640 1 -- 172.21.15.45:0/1087626730 <== osd.4 v2:172.21.15.190:6808/1537591987 9 ==== osd_op_reply(226 100.00000000 [omap-set-header] v35'5 uv5 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x56394c158fc0 con 0x56394c1d9000 2023-11-28T18:39:03.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.293+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6808/1537591987,v1:172.21.15.190:6809/1537591987] -- osd_op(unknown.0.0:227 4.13 4:cd5a64a3:::100.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b6c3180 con 0x56394c1d9000 2023-11-28T18:39:03.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.293+0000 7fd2f9964640 1 -- 172.21.15.45:0/1087626730 <== osd.4 v2:172.21.15.190:6808/1537591987 10 ==== osd_op_reply(227 100.00000000 [omap-get-vals-by-keys out=507b] v0'0 uv5 ondisk = 0) v8 ==== 156+0+507 (crc 0 0 0) 0x56394c158fc0 con 0x56394c1d9000 2023-11-28T18:39:03.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.293+0000 7fd2fb1a5280 4 recover_dentries: inspecting fullbit 100.00000000/stray2 2023-11-28T18:39:03.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.293+0000 7fd2fb1a5280 4 recover_dentries: dentry stray2_head existed already 2023-11-28T18:39:03.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.293+0000 7fd2fb1a5280 4 recover_dentries: dentry exists, checking versions... 2023-11-28T18:39:03.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.293+0000 7fd2fb1a5280 4 recover_dentries: decoded embedded inode version 2 vs fullbit version 4 2023-11-28T18:39:03.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.293+0000 7fd2fb1a5280 4 recover_dentries: writing I dentry stray2_head into frag 100.00000000 2023-11-28T18:39:03.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.293+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6808/1537591987,v1:172.21.15.190:6809/1537591987] -- osd_op(unknown.0.0:228 4.13 4:cd5a64a3:::100.00000000:head [omap-set-vals in=507b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b6c2380 con 0x56394c1d9000 2023-11-28T18:39:03.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.297+0000 7fd2f9964640 1 -- 172.21.15.45:0/1087626730 <== osd.4 v2:172.21.15.190:6808/1537591987 11 ==== osd_op_reply(228 100.00000000 [omap-set-vals] v35'6 uv6 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x56394c158fc0 con 0x56394c1d9000 2023-11-28T18:39:03.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.297+0000 7fd2fb1a5280 4 recover_dentries: updating root 0x0x100 2023-11-28T18:39:03.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.297+0000 7fd2fb1a5280 4 recover_dentries: object id 100.00000000.inode 2023-11-28T18:39:03.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.297+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:229 4.1f 4:fe07bba1:::100.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b6c3500 con 0x56394c1d9400 2023-11-28T18:39:03.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.297+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 93 ==== osd_op_reply(229 100.00000000.inode [read 0~582 out=582b] v0'0 uv3 ondisk = 0) v8 ==== 162+0+582 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.297+0000 7fd2fb1a5280 4 recover_dentries: root exists, will modify (582) 2023-11-28T18:39:03.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.297+0000 7fd2fb1a5280 4 recover_dentries: magic ok 2023-11-28T18:39:03.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.297+0000 7fd2fb1a5280 4 recover_dentries: writing root ino 100.00000000.inode version 2 2023-11-28T18:39:03.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.297+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:230 4.1f 4:fe07bba1:::100.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b6c2700 con 0x56394c1d9400 2023-11-28T18:39:03.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.297+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 94 ==== osd_op_reply(230 100.00000000.inode [writefull 0~582] v35'49 uv49 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.297+0000 7fd2fb1a5280 4 recover_dentries: inspecting lump 1.00000000 2023-11-28T18:39:03.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.297+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:231 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b6c2a80 con 0x56394c1d9400 2023-11-28T18:39:03.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.297+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 95 ==== osd_op_reply(231 1.00000000 [omap-get-header out=274b] v0'0 uv48 ondisk = 0) v8 ==== 154+0+274 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.297+0000 7fd2fb1a5280 4 recover_dentries: frag 1.00000000 fnode old v58 vs new v59 2023-11-28T18:39:03.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.297+0000 7fd2fb1a5280 4 recover_dentries: writing fnode to omap header 2023-11-28T18:39:03.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.297+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:232 4.1f 4:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394b6c2e00 con 0x56394c1d9400 2023-11-28T18:39:03.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.301+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 96 ==== osd_op_reply(232 1.00000000 [omap-set-header] v35'50 uv50 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.301+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:233 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394c0a5880 con 0x56394c1d9400 2023-11-28T18:39:03.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.301+0000 7fd2f9163640 1 -- 172.21.15.45:0/1087626730 <== osd.6 v2:172.21.15.190:6816/2317686718 97 ==== osd_op_reply(233 1.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv50 ondisk = 0) v8 ==== 154+0+4 (crc 0 0 0) 0x56394c158b40 con 0x56394c1d9400 2023-11-28T18:39:03.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.301+0000 7fd2fb1a5280 4 recover_dentries: updating root 0x0x1 2023-11-28T18:39:03.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.301+0000 7fd2fb1a5280 4 recover_dentries: object id 1.00000000.inode 2023-11-28T18:39:03.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.301+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:234 4.14 4:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394c0a5c00 con 0x56394c175c00 2023-11-28T18:39:03.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.301+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.3 v2:172.21.15.45:6824/78541084 27 ==== osd_op_reply(234 1.00000000.inode [read 0~582 out=582b] v0'0 uv37 ondisk = 0) v8 ==== 160+0+582 (crc 0 0 0) 0x56394c158d80 con 0x56394c175c00 2023-11-28T18:39:03.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.301+0000 7fd2fb1a5280 4 recover_dentries: root exists, will modify (582) 2023-11-28T18:39:03.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.301+0000 7fd2fb1a5280 4 recover_dentries: magic ok 2023-11-28T18:39:03.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.301+0000 7fd2fb1a5280 4 recover_dentries: writing root ino 1.00000000.inode version 10 2023-11-28T18:39:03.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.301+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:235 4.14 4:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394c0a4700 con 0x56394c175c00 2023-11-28T18:39:03.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.301+0000 7fd2fa165640 1 -- 172.21.15.45:0/1087626730 <== osd.3 v2:172.21.15.45:6824/78541084 28 ==== osd_op_reply(235 1.00000000.inode [writefull 0~582] v35'38 uv38 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x56394c158d80 con 0x56394c175c00 2023-11-28T18:39:03.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.301+0000 7fd2fb1a5280 4 main_event: consumed 8 inodes 2023-11-28T18:39:03.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.301+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6808/1537591987,v1:172.21.15.190:6809/1537591987] -- osd_op(unknown.0.0:236 4.13 4:c91d4a1d:::mds0_inotable:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394c0a4a80 con 0x56394c1d9000 2023-11-28T18:39:03.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.301+0000 7fd2f9964640 1 -- 172.21.15.45:0/1087626730 <== osd.4 v2:172.21.15.190:6808/1537591987 12 ==== osd_op_reply(236 mds0_inotable [read 0~34 out=34b] v0'0 uv2 ondisk = 0) v8 ==== 157+0+34 (crc 0 0 0) 0x56394c158fc0 con 0x56394c1d9000 2023-11-28T18:39:03.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.301+0000 7fd2fb1a5280 4 consume_inos: Used ino 0x0x10000000000 requires inotable update 2023-11-28T18:39:03.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.301+0000 7fd2fb1a5280 4 consume_inos: Used ino 0x0x10000000001 requires inotable update 2023-11-28T18:39:03.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.301+0000 7fd2fb1a5280 4 consume_inos: Used ino 0x0x10000000002 requires inotable update 2023-11-28T18:39:03.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.301+0000 7fd2fb1a5280 4 consume_inos: Used ino 0x0x100000001f7 requires inotable update 2023-11-28T18:39:03.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.301+0000 7fd2fb1a5280 4 consume_inos: Used ino 0x0x100000001f8 requires inotable update 2023-11-28T18:39:03.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.301+0000 7fd2fb1a5280 4 consume_inos: Used ino 0x0x100000001f9 requires inotable update 2023-11-28T18:39:03.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.301+0000 7fd2fb1a5280 4 consume_inos: Used ino 0x0x100000001fa requires inotable update 2023-11-28T18:39:03.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.301+0000 7fd2fb1a5280 4 consume_inos: writing modified inotable version 1 2023-11-28T18:39:03.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.301+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 --> [v2:172.21.15.190:6808/1537591987,v1:172.21.15.190:6809/1537591987] -- osd_op(unknown.0.0:237 4.13 4:c91d4a1d:::mds0_inotable:head [writefull 0~50 in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x56394c0a4000 con 0x56394c1d9000 2023-11-28T18:39:03.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.305+0000 7fd2f9964640 1 -- 172.21.15.45:0/1087626730 <== osd.4 v2:172.21.15.190:6808/1537591987 13 ==== osd_op_reply(237 mds0_inotable [writefull 0~50] v35'7 uv7 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x56394c158fc0 con 0x56394c1d9000 2023-11-28T18:39:03.309 INFO:teuthology.orchestra.run.smithi045.stdout:0.000000 0x400000 LID: () 2023-11-28T18:39:03.309 INFO:teuthology.orchestra.run.smithi045.stdout:2023-11-28T18:38:36.046064+0000 0x400030 SUBTREEMAP: () 2023-11-28T18:39:03.309 INFO:teuthology.orchestra.run.smithi045.stdout:2023-11-28T18:38:50.272455+0000 0x4003ac SESSION: () 2023-11-28T18:39:03.309 INFO:teuthology.orchestra.run.smithi045.stdout:2023-11-28T18:38:50.685207+0000 0x400564 UPDATE: (setattr) 2023-11-28T18:39:03.309 INFO:teuthology.orchestra.run.smithi045.stdout: / 2023-11-28T18:39:03.309 INFO:teuthology.orchestra.run.smithi045.stdout:2023-11-28T18:38:50.743282+0000 0x400893 UPDATE: (openc) 2023-11-28T18:39:03.309 INFO:teuthology.orchestra.run.smithi045.stdout: rootfile 2023-11-28T18:39:03.309 INFO:teuthology.orchestra.run.smithi045.stdout:2023-11-28T18:38:50.805200+0000 0x400f45 UPDATE: (mkdir) 2023-11-28T18:39:03.310 INFO:teuthology.orchestra.run.smithi045.stdout: subdir 2023-11-28T18:39:03.310 INFO:teuthology.orchestra.run.smithi045.stdout:2023-11-28T18:38:50.862062+0000 0x401713 UPDATE: (openc) 2023-11-28T18:39:03.310 INFO:teuthology.orchestra.run.smithi045.stdout: subdir/subdirfile 2023-11-28T18:39:03.310 INFO:teuthology.orchestra.run.smithi045.stdout:2023-11-28T18:38:50.920104+0000 0x401ebf UPDATE: (mkdir) 2023-11-28T18:39:03.310 INFO:teuthology.orchestra.run.smithi045.stdout: linkdir 2023-11-28T18:39:03.310 INFO:teuthology.orchestra.run.smithi045.stdout:2023-11-28T18:38:50.978616+0000 0x40269e UPDATE: (openc) 2023-11-28T18:39:03.310 INFO:teuthology.orchestra.run.smithi045.stdout: linkdir/link0 2023-11-28T18:39:03.310 INFO:teuthology.orchestra.run.smithi045.stdout:2023-11-28T18:38:51.043195+0000 0x402e46 UPDATE: (cap update) 2023-11-28T18:39:03.310 INFO:teuthology.orchestra.run.smithi045.stdout: linkdir/link0 2023-11-28T18:39:03.310 INFO:teuthology.orchestra.run.smithi045.stdout:2023-11-28T18:38:51.047157+0000 0x4035cd UPDATE: (unlink_local) 2023-11-28T18:39:03.310 INFO:teuthology.orchestra.run.smithi045.stdout: stray2/100000001f8 2023-11-28T18:39:03.311 INFO:teuthology.orchestra.run.smithi045.stdout: linkdir/link0 2023-11-28T18:39:03.311 INFO:teuthology.orchestra.run.smithi045.stdout:2023-11-28T18:38:51.105275+0000 0x404233 UPDATE: (scatter_writebehind) 2023-11-28T18:39:03.311 INFO:teuthology.orchestra.run.smithi045.stdout:2023-11-28T18:38:51.106614+0000 0x4046a5 UPDATE: (cap update) 2023-11-28T18:39:03.311 INFO:teuthology.orchestra.run.smithi045.stdout: subdir/subdirfile 2023-11-28T18:39:03.311 INFO:teuthology.orchestra.run.smithi045.stdout:2023-11-28T18:38:51.107446+0000 0x404e30 UPDATE: (link_local) 2023-11-28T18:39:03.311 INFO:teuthology.orchestra.run.smithi045.stdout: subdir/subdirfile 2023-11-28T18:39:03.311 INFO:teuthology.orchestra.run.smithi045.stdout: linkdir/link0 2023-11-28T18:39:03.311 INFO:teuthology.orchestra.run.smithi045.stdout:2023-11-28T18:38:51.164550+0000 0x405990 UPDATE: (cap update) 2023-11-28T18:39:03.311 INFO:teuthology.orchestra.run.smithi045.stdout: subdir/subdirfile 2023-11-28T18:39:03.311 INFO:teuthology.orchestra.run.smithi045.stdout:2023-11-28T18:38:51.164931+0000 0x406176 UPDATE: (cap update) 2023-11-28T18:39:03.311 INFO:teuthology.orchestra.run.smithi045.stdout: subdir/subdirfile 2023-11-28T18:39:03.312 INFO:teuthology.orchestra.run.smithi045.stdout:2023-11-28T18:38:51.165644+0000 0x406936 UPDATE: (link_local) 2023-11-28T18:39:03.312 INFO:teuthology.orchestra.run.smithi045.stdout: subdir/subdirfile 2023-11-28T18:39:03.312 INFO:teuthology.orchestra.run.smithi045.stdout: linkdir/link1 2023-11-28T18:39:03.312 INFO:teuthology.orchestra.run.smithi045.stdout:2023-11-28T18:38:51.224617+0000 0x407496 UPDATE: (link_local) 2023-11-28T18:39:03.312 INFO:teuthology.orchestra.run.smithi045.stdout: subdir/subdirfile 2023-11-28T18:39:03.312 INFO:teuthology.orchestra.run.smithi045.stdout: linkdir/link2 2023-11-28T18:39:03.312 INFO:teuthology.orchestra.run.smithi045.stdout:2023-11-28T18:38:51.285332+0000 0x407ff6 UPDATE: (unlink_local) 2023-11-28T18:39:03.312 INFO:teuthology.orchestra.run.smithi045.stdout: subdir/subdirfile 2023-11-28T18:39:03.312 INFO:teuthology.orchestra.run.smithi045.stdout: linkdir/link2 2023-11-28T18:39:03.312 INFO:teuthology.orchestra.run.smithi045.stdout:2023-11-28T18:38:51.343483+0000 0x408b59 UPDATE: (openc) 2023-11-28T18:39:03.312 INFO:teuthology.orchestra.run.smithi045.stdout: linkdir/link2 2023-11-28T18:39:03.312 INFO:teuthology.orchestra.run.smithi045.stdout:2023-11-28T18:38:51.400295+0000 0x409301 UPDATE: (link_local) 2023-11-28T18:39:03.313 INFO:teuthology.orchestra.run.smithi045.stdout: subdir/subdirfile 2023-11-28T18:39:03.313 INFO:teuthology.orchestra.run.smithi045.stdout: linkdir/link3 2023-11-28T18:39:03.313 INFO:teuthology.orchestra.run.smithi045.stdout:2023-11-28T18:38:51.456690+0000 0x409e6f UPDATE: (unlink_local) 2023-11-28T18:39:03.313 INFO:teuthology.orchestra.run.smithi045.stdout: subdir/subdirfile 2023-11-28T18:39:03.313 INFO:teuthology.orchestra.run.smithi045.stdout: linkdir/link3 2023-11-28T18:39:03.313 INFO:teuthology.orchestra.run.smithi045.stdout:2023-11-28T18:38:51.512098+0000 0x40a9d2 UPDATE: (cap update) 2023-11-28T18:39:03.313 INFO:teuthology.orchestra.run.smithi045.stdout: rootfile 2023-11-28T18:39:03.313 INFO:teuthology.orchestra.run.smithi045.stdout:2023-11-28T18:38:51.512534+0000 0x40b053 UPDATE: (link_local) 2023-11-28T18:39:03.313 INFO:teuthology.orchestra.run.smithi045.stdout: rootfile 2023-11-28T18:39:03.313 INFO:teuthology.orchestra.run.smithi045.stdout: linkdir/link3 2023-11-28T18:39:03.314 INFO:teuthology.orchestra.run.smithi045.stdout:2023-11-28T18:38:51.565507+0000 0x40baa9 UPDATE: (mkdir) 2023-11-28T18:39:03.314 INFO:teuthology.orchestra.run.smithi045.stdout: subdir/subsubdir 2023-11-28T18:39:03.314 INFO:teuthology.orchestra.run.smithi045.stdout:2023-11-28T18:38:53.066726+0000 0x40c382 UPDATE: (purge_stray) 2023-11-28T18:39:03.314 INFO:teuthology.orchestra.run.smithi045.stdout: 100000001f8 2023-11-28T18:39:03.314 INFO:teuthology.orchestra.run.smithi045.stdout:2023-11-28T18:38:56.235595+0000 0x40c5d9 UPDATE: (cap update) 2023-11-28T18:39:03.314 INFO:teuthology.orchestra.run.smithi045.stdout: linkdir/link2 2023-11-28T18:39:03.314 INFO:teuthology.orchestra.run.smithi045.stdout:2023-11-28T18:38:56.238575+0000 0x40cfa9 SESSION: () 2023-11-28T18:39:03.314 INFO:teuthology.orchestra.run.smithi045.stdout:0.000000 0x40d056 PURGED: () 2023-11-28T18:39:03.314 INFO:teuthology.orchestra.run.smithi045.stdout:2023-11-28T18:38:57.435998+0000 0x40d0a2 UPDATE: (scatter_writebehind) 2023-11-28T18:39:03.314 INFO:teuthology.orchestra.run.smithi045.stdout: stray2 2023-11-28T18:39:03.314 INFO:teuthology.orchestra.run.smithi045.stdout:2023-11-28T18:38:57.436128+0000 0x40d715 UPDATE: (scatter_writebehind) 2023-11-28T18:39:03.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.305+0000 7fd2fb1a5280 4 31 events 2023-11-28T18:39:03.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.305+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 >> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] conn(0x56394c1d9800 msgr2=0x56394b662580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:03.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.305+0000 7fd2fb1a5280 1 --2- 172.21.15.45:0/1087626730 >> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] conn(0x56394c1d9800 0x56394b662580 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:03.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.305+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 >> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] conn(0x56394c175800 msgr2=0x56394b2be100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:03.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.305+0000 7fd2fb1a5280 1 --2- 172.21.15.45:0/1087626730 >> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] conn(0x56394c175800 0x56394b2be100 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:03.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.305+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x56394c175c00 msgr2=0x56394b2bdb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:03.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.305+0000 7fd2fb1a5280 1 --2- 172.21.15.45:0/1087626730 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x56394c175c00 0x56394b2bdb80 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:03.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.305+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 >> [v2:172.21.15.190:6808/1537591987,v1:172.21.15.190:6809/1537591987] conn(0x56394c1d9000 msgr2=0x56394b2bd600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:03.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.305+0000 7fd2fb1a5280 1 --2- 172.21.15.45:0/1087626730 >> [v2:172.21.15.190:6808/1537591987,v1:172.21.15.190:6809/1537591987] conn(0x56394c1d9000 0x56394b2bd600 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:03.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.305+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 >> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] conn(0x56394c1d9400 msgr2=0x56394b662000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:03.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.305+0000 7fd2fb1a5280 1 --2- 172.21.15.45:0/1087626730 >> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] conn(0x56394c1d9400 0x56394b662000 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:03.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.305+0000 7fd2f9964640 1 -- 172.21.15.45:0/1087626730 reap_dead start 2023-11-28T18:39:03.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.305+0000 7fd2f9964640 1 -- 172.21.15.45:0/1087626730 reap_dead start 2023-11-28T18:39:03.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.305+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x56394c1d8c00 msgr2=0x56394b2bf700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:03.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.305+0000 7fd2fb1a5280 1 --2- 172.21.15.45:0/1087626730 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x56394c1d8c00 0x56394b2bf700 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x56394c1ce420 tx=0x56394c16c060 comp rx=0 tx=0).stop 2023-11-28T18:39:03.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.305+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56394c174c00 msgr2=0x56394b2bf180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:03.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.305+0000 7fd2fb1a5280 1 --2- 172.21.15.45:0/1087626730 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56394c174c00 0x56394b2bf180 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x56394c1cee10 tx=0x56394bfcfe00 comp rx=0 tx=0).stop 2023-11-28T18:39:03.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.305+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 shutdown_connections 2023-11-28T18:39:03.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.305+0000 7fd2fb1a5280 1 --2- 172.21.15.45:0/1087626730 >> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] conn(0x56394c1d9400 0x56394b662000 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:03.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.305+0000 7fd2fb1a5280 1 --2- 172.21.15.45:0/1087626730 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x56394c1d8c00 0x56394b2bf700 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:03.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.305+0000 7fd2fb1a5280 1 --2- 172.21.15.45:0/1087626730 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56394c174c00 0x56394b2bf180 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:03.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.305+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 >> 172.21.15.45:0/1087626730 conn(0x56394b250c00 msgr2=0x56394b27f800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:03.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.305+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 shutdown_connections 2023-11-28T18:39:03.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.305+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/1087626730 wait complete. 2023-11-28T18:39:03.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.305+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/3878474526 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56394b251000 msgr2=0x56394b2bd080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:03.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.305+0000 7fd2fb1a5280 1 --2- 172.21.15.45:0/3878474526 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56394b251000 0x56394b2bd080 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x56394c0c4c90 tx=0x56394c164120 comp rx=0 tx=0).stop 2023-11-28T18:39:03.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.305+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/3878474526 shutdown_connections 2023-11-28T18:39:03.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.305+0000 7fd2fb1a5280 1 --2- 172.21.15.45:0/3878474526 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56394b251000 0x56394b2bd080 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:03.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.305+0000 7fd2fb1a5280 1 --2- 172.21.15.45:0/3878474526 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56394b251400 0x56394b2bcb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:03.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.305+0000 7fd2fb1a5280 1 --2- 172.21.15.45:0/3878474526 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56394b251800 0x56394b2bc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:03.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.305+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/3878474526 >> 172.21.15.45:0/3878474526 conn(0x56394b251c00 msgr2=0x56394b27f000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:03.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.305+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/3878474526 shutdown_connections 2023-11-28T18:39:03.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.305+0000 7fd2fb1a5280 1 -- 172.21.15.45:0/3878474526 wait complete. 2023-11-28T18:39:03.320 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'event', 'recover_dentries', 'list'] in time 0:00:00.356755, result: 0.000000 0x400000 LID: () 2023-11-28T18:38:36.046064+0000 0x400030 SUBTREEMAP: () 2023-11-28T18:38:50.272455+0000 0x4003ac SESSION: () 2023-11-28T18:38:50.685207+0000 0x400564 UPDATE: (setattr) / 2023-11-28T18:38:50.743282+0000 0x400893 UPDATE: (openc) rootfile 2023-11-28T18:38:50.805200+0000 0x400f45 UPDATE: (mkdir) subdir 2023-11-28T18:38:50.862062+0000 0x401713 UPDATE: (openc) subdir/subdirfile 2023-11-28T18:38:50.920104+0000 0x401ebf UPDATE: (mkdir) linkdir 2023-11-28T18:38:50.978616+0000 0x40269e UPDATE: (openc) linkdir/link0 2023-11-28T18:38:51.043195+0000 0x402e46 UPDATE: (cap update) linkdir/link0 2023-11-28T18:38:51.047157+0000 0x4035cd UPDATE: (unlink_local) stray2/100000001f8 linkdir/link0 2023-11-28T18:38:51.105275+0000 0x404233 UPDATE: (scatter_writebehind) 2023-11-28T18:38:51.106614+0000 0x4046a5 UPDATE: (cap update) subdir/subdirfile 2023-11-28T18:38:51.107446+0000 0x404e30 UPDATE: (link_local) subdir/subdirfile linkdir/link0 2023-11-28T18:38:51.164550+0000 0x405990 UPDATE: (cap update) subdir/subdirfile 2023-11-28T18:38:51.164931+0000 0x406176 UPDATE: (cap update) subdir/subdirfile 2023-11-28T18:38:51.165644+0000 0x406936 UPDATE: (link_local) subdir/subdirfile linkdir/link1 2023-11-28T18:38:51.224617+0000 0x407496 UPDATE: (link_local) subdir/subdirfile linkdir/link2 2023-11-28T18:38:51.285332+0000 0x407ff6 UPDATE: (unlink_local) subdir/subdirfile linkdir/link2 2023-11-28T18:38:51.343483+0000 0x408b59 UPDATE: (openc) linkdir/link2 2023-11-28T18:38:51.400295+0000 0x409301 UPDATE: (link_local) subdir/subdirfile linkdir/link3 2023-11-28T18:38:51.456690+0000 0x409e6f UPDATE: (unlink_local) subdir/subdirfile linkdir/link3 2023-11-28T18:38:51.512098+0000 0x40a9d2 UPDATE: (cap update) rootfile 2023-11-28T18:38:51.512534+0000 0x40b053 UPDATE: (link_local) rootfile linkdir/link3 2023-11-28T18:38:51.565507+0000 0x40baa9 UPDATE: (mkdir) subdir/subsubdir 2023-11-28T18:38:53.066726+0000 0x40c382 UPDATE: (purge_stray) 100000001f8 2023-11-28T18:38:56.235595+0000 0x40c5d9 UPDATE: (cap update) linkdir/link2 2023-11-28T18:38:56.238575+0000 0x40cfa9 SESSION: () 0.000000 0x40d056 PURGED: () 2023-11-28T18:38:57.435998+0000 0x40d0a2 UPDATE: (scatter_writebehind) stray2 2023-11-28T18:38:57.436128+0000 0x40d715 UPDATE: (scatter_writebehind) 2023-11-28T18:39:03.320 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 1.00000000 2023-11-28T18:39:03.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.401+0000 7f26bc643080 1 Processor -- start 2023-11-28T18:39:03.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.401+0000 7f26bc643080 1 -- start start 2023-11-28T18:39:03.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.401+0000 7f26bc643080 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5607c87f3620 0x5607c88c3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:03.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.401+0000 7f26bc643080 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5607c8841510 0x5607c8837430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:03.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.401+0000 7f26bc643080 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5607c88cb750 0x5607c88c5e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:03.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.401+0000 7f26bc643080 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607c87a2470 con 0x5607c87f3620 2023-11-28T18:39:03.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.401+0000 7f26bc643080 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607c875a0c0 con 0x5607c88cb750 2023-11-28T18:39:03.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.401+0000 7f26bc643080 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x5607c8759d60 con 0x5607c8841510 2023-11-28T18:39:03.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.401+0000 7f26ba162640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5607c87f3620 0x5607c88c3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:03.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.401+0000 7f26ba162640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5607c87f3620 0x5607c88c3330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53690/0 (socket says 172.21.15.45:53690) 2023-11-28T18:39:03.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.401+0000 7f26ba162640 1 -- 172.21.15.45:0/491798269 learned_addr learned my addr 172.21.15.45:0/491798269 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:03.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.405+0000 7f26ba162640 1 -- 172.21.15.45:0/491798269 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5607c8841510 msgr2=0x5607c8837430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:03.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.405+0000 7f26ba162640 1 --2- 172.21.15.45:0/491798269 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5607c8841510 0x5607c8837430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:03.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.405+0000 7f26ba162640 1 -- 172.21.15.45:0/491798269 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5607c88cb750 msgr2=0x5607c88c5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:03.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.405+0000 7f26ba162640 1 --2- 172.21.15.45:0/491798269 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5607c88cb750 0x5607c88c5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:03.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.405+0000 7f26ba162640 1 -- 172.21.15.45:0/491798269 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26b0005df0 con 0x5607c87f3620 2023-11-28T18:39:03.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.405+0000 7f26ba162640 1 --2- 172.21.15.45:0/491798269 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5607c87f3620 0x5607c88c3330 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f26ac00a470 tx=0x7f26ac00a930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ae4dda763952628 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:03.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.405+0000 7f26b895f640 1 -- 172.21.15.45:0/491798269 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26ac00b930 con 0x5607c87f3620 2023-11-28T18:39:03.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.405+0000 7f26b895f640 1 -- 172.21.15.45:0/491798269 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26ac00bab0 con 0x5607c87f3620 2023-11-28T18:39:03.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.405+0000 7f26b895f640 1 -- 172.21.15.45:0/491798269 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26ac00be60 con 0x5607c87f3620 2023-11-28T18:39:03.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.405+0000 7f26bc643080 1 -- 172.21.15.45:0/491798269 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5607c87f3620 msgr2=0x5607c88c3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:03.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.405+0000 7f26bc643080 1 --2- 172.21.15.45:0/491798269 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5607c87f3620 0x5607c88c3330 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f26ac00a470 tx=0x7f26ac00a930 comp rx=0 tx=0).stop 2023-11-28T18:39:03.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.405+0000 7f26bc643080 1 -- 172.21.15.45:0/491798269 shutdown_connections 2023-11-28T18:39:03.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.405+0000 7f26bc643080 1 --2- 172.21.15.45:0/491798269 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5607c88cb750 0x5607c88c5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:03.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.405+0000 7f26bc643080 1 --2- 172.21.15.45:0/491798269 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5607c8841510 0x5607c8837430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:03.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.405+0000 7f26bc643080 1 --2- 172.21.15.45:0/491798269 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5607c87f3620 0x5607c88c3330 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:03.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.405+0000 7f26bc643080 1 -- 172.21.15.45:0/491798269 >> 172.21.15.45:0/491798269 conn(0x5607c8823090 msgr2=0x5607c8826970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:03.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.405+0000 7f26bc643080 1 -- 172.21.15.45:0/491798269 shutdown_connections 2023-11-28T18:39:03.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.405+0000 7f26bc643080 1 -- 172.21.15.45:0/491798269 wait complete. 2023-11-28T18:39:03.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.405+0000 7f26bc643080 1 Processor -- start 2023-11-28T18:39:03.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.405+0000 7f26bc643080 1 -- start start 2023-11-28T18:39:03.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.405+0000 7f26bc643080 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5607c87f3620 0x5607c88c1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:03.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.405+0000 7f26bc643080 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5607c8841510 0x5607c8967150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:03.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.405+0000 7f26bc643080 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5607c88cb750 0x5607c8967690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:03.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.405+0000 7f26bc643080 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607c87302c0 con 0x5607c88cb750 2023-11-28T18:39:03.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.405+0000 7f26bc643080 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607c8968080 con 0x5607c87f3620 2023-11-28T18:39:03.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.405+0000 7f26bc643080 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x5607c88c98f0 con 0x5607c8841510 2023-11-28T18:39:03.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.405+0000 7f26ba963640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5607c88cb750 0x5607c8967690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:03.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.405+0000 7f26ba162640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5607c87f3620 0x5607c88c1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:03.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.405+0000 7f26ba963640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5607c88cb750 0x5607c8967690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53706/0 (socket says 172.21.15.45:53706) 2023-11-28T18:39:03.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.405+0000 7f26ba963640 1 -- 172.21.15.45:0/2654050678 learned_addr learned my addr 172.21.15.45:0/2654050678 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:03.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.405+0000 7f26b9961640 1 --2- 172.21.15.45:0/2654050678 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5607c8841510 0x5607c8967150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:03.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.405+0000 7f26ba963640 1 -- 172.21.15.45:0/2654050678 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5607c8841510 msgr2=0x5607c8967150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:03.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.405+0000 7f26ba963640 1 --2- 172.21.15.45:0/2654050678 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5607c8841510 0x5607c8967150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:03.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.405+0000 7f26ba963640 1 -- 172.21.15.45:0/2654050678 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5607c87f3620 msgr2=0x5607c88c1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:03.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.405+0000 7f26ba963640 1 --2- 172.21.15.45:0/2654050678 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5607c87f3620 0x5607c88c1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:03.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.405+0000 7f26ba963640 1 -- 172.21.15.45:0/2654050678 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26ac005cd0 con 0x5607c88cb750 2023-11-28T18:39:03.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.405+0000 7f26ba963640 1 --2- 172.21.15.45:0/2654050678 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5607c88cb750 0x5607c8967690 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f26b40091f0 tx=0x7f26b40096b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:03.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.409+0000 7f26ab7fe640 1 -- 172.21.15.45:0/2654050678 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b4010800 con 0x5607c88cb750 2023-11-28T18:39:03.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.409+0000 7f26ab7fe640 1 -- 172.21.15.45:0/2654050678 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26b4010960 con 0x5607c88cb750 2023-11-28T18:39:03.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.409+0000 7f26bc643080 1 -- 172.21.15.45:0/2654050678 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5607c8748420 con 0x5607c88cb750 2023-11-28T18:39:03.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.409+0000 7f26ab7fe640 1 -- 172.21.15.45:0/2654050678 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b4010d10 con 0x5607c88cb750 2023-11-28T18:39:03.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.409+0000 7f26bc643080 1 -- 172.21.15.45:0/2654050678 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5607c873b5d0 con 0x5607c88cb750 2023-11-28T18:39:03.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.409+0000 7f26ab7fe640 1 -- 172.21.15.45:0/2654050678 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f26b4019400 con 0x5607c88cb750 2023-11-28T18:39:03.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.409+0000 7f26ab7fe640 1 --2- 172.21.15.45:0/2654050678 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f269c0652e0 0x7f269c0677a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:03.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.409+0000 7f26ab7fe640 1 -- 172.21.15.45:0/2654050678 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f26b4083300 con 0x5607c88cb750 2023-11-28T18:39:03.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.409+0000 7f26bc643080 1 --2- 172.21.15.45:0/2654050678 >> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] conn(0x5607c8965050 0x5607c8965460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:03.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.409+0000 7f26bc643080 1 -- 172.21.15.45:0/2654050678 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:1 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x5607c89659a0 con 0x5607c8965050 2023-11-28T18:39:03.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.409+0000 7f26ba162640 1 --2- 172.21.15.45:0/2654050678 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f269c0652e0 0x7f269c0677a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:03.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.409+0000 7f26b9961640 1 --2- 172.21.15.45:0/2654050678 >> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] conn(0x5607c8965050 0x5607c8965460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:03.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.409+0000 7f26ba162640 1 --2- 172.21.15.45:0/2654050678 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f269c0652e0 0x7f269c0677a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f26ac000c10 tx=0x7f26ac002000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:03.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.413+0000 7f26b9961640 1 --2- 172.21.15.45:0/2654050678 >> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] conn(0x5607c8965050 0x5607c8965460 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:03.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.413+0000 7f26b9961640 1 -- 172.21.15.45:0/2654050678 <== osd.6 v2:172.21.15.190:6816/2317686718 1 ==== osd_op_reply(1 1.00000000 [omap-get-keys out=53b] v0'0 uv50 ondisk = 0) v8 ==== 154+0+53 (crc 0 0 0) 0x7f26b00aa700 con 0x5607c8965050 2023-11-28T18:39:03.417 INFO:teuthology.orchestra.run.smithi045.stdout:linkdir_head 2023-11-28T18:39:03.418 INFO:teuthology.orchestra.run.smithi045.stdout:rootfile_head 2023-11-28T18:39:03.418 INFO:teuthology.orchestra.run.smithi045.stdout:subdir_head 2023-11-28T18:39:03.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.413+0000 7f26bc643080 1 -- 172.21.15.45:0/2654050678 >> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] conn(0x5607c8965050 msgr2=0x5607c8965460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:03.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.413+0000 7f26bc643080 1 --2- 172.21.15.45:0/2654050678 >> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] conn(0x5607c8965050 0x5607c8965460 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:03.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.413+0000 7f26bc643080 1 -- 172.21.15.45:0/2654050678 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f269c0652e0 msgr2=0x7f269c0677a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:03.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.413+0000 7f26bc643080 1 --2- 172.21.15.45:0/2654050678 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f269c0652e0 0x7f269c0677a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f26ac000c10 tx=0x7f26ac002000 comp rx=0 tx=0).stop 2023-11-28T18:39:03.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.413+0000 7f26bc643080 1 -- 172.21.15.45:0/2654050678 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5607c88cb750 msgr2=0x5607c8967690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:03.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.413+0000 7f26bc643080 1 --2- 172.21.15.45:0/2654050678 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5607c88cb750 0x5607c8967690 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f26b40091f0 tx=0x7f26b40096b0 comp rx=0 tx=0).stop 2023-11-28T18:39:03.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.413+0000 7f26ba963640 1 -- 172.21.15.45:0/2654050678 reap_dead start 2023-11-28T18:39:03.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.413+0000 7f26bc643080 1 -- 172.21.15.45:0/2654050678 shutdown_connections 2023-11-28T18:39:03.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.413+0000 7f26bc643080 1 -- 172.21.15.45:0/2654050678 >> 172.21.15.45:0/2654050678 conn(0x5607c8823090 msgr2=0x5607c8823470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:03.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.413+0000 7f26bc643080 1 -- 172.21.15.45:0/2654050678 shutdown_connections 2023-11-28T18:39:03.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.413+0000 7f26bc643080 1 -- 172.21.15.45:0/2654050678 wait complete. 2023-11-28T18:39:03.420 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 10000000001.00000000 2023-11-28T18:39:03.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.505+0000 7f0b01c94080 1 Processor -- start 2023-11-28T18:39:03.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.505+0000 7f0b01c94080 1 -- start start 2023-11-28T18:39:03.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.505+0000 7f0b01c94080 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55645401de00 0x5564540b44e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:03.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.505+0000 7f0b01c94080 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55645401e1e0 0x5564540af0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:03.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.505+0000 7f0b01c94080 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5564540b4b80 0x55645400b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:03.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.505+0000 7f0b01c94080 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x556453f8b470 con 0x5564540b4b80 2023-11-28T18:39:03.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.505+0000 7f0b01c94080 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x556453f430c0 con 0x55645401e1e0 2023-11-28T18:39:03.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.505+0000 7f0b01c94080 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x556453f42d60 con 0x55645401de00 2023-11-28T18:39:03.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.505+0000 7f0afffb6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5564540b4b80 0x55645400b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:03.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.505+0000 7f0afffb6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5564540b4b80 0x55645400b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53720/0 (socket says 172.21.15.45:53720) 2023-11-28T18:39:03.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.505+0000 7f0afffb6640 1 -- 172.21.15.45:0/589975879 learned_addr learned my addr 172.21.15.45:0/589975879 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:03.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.505+0000 7f0afefb4640 1 --2- 172.21.15.45:0/589975879 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55645401e1e0 0x5564540af0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:03.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.505+0000 7f0aff7b5640 1 --2- 172.21.15.45:0/589975879 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55645401de00 0x5564540b44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:03.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.505+0000 7f0afffb6640 1 -- 172.21.15.45:0/589975879 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55645401de00 msgr2=0x5564540b44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:03.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.505+0000 7f0afffb6640 1 --2- 172.21.15.45:0/589975879 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55645401de00 0x5564540b44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:03.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.505+0000 7f0afffb6640 1 -- 172.21.15.45:0/589975879 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55645401e1e0 msgr2=0x5564540af0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:03.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.505+0000 7f0afffb6640 1 --2- 172.21.15.45:0/589975879 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55645401e1e0 0x5564540af0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:03.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.505+0000 7f0afffb6640 1 -- 172.21.15.45:0/589975879 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af4005df0 con 0x5564540b4b80 2023-11-28T18:39:03.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.505+0000 7f0afefb4640 1 --2- 172.21.15.45:0/589975879 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55645401e1e0 0x5564540af0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:39:03.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.505+0000 7f0afffb6640 1 --2- 172.21.15.45:0/589975879 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5564540b4b80 0x55645400b330 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f0af80028d0 tx=0x7f0af8002d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7bb52a5f774a63b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:03.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.505+0000 7f0afdfb2640 1 -- 172.21.15.45:0/589975879 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af800d9c0 con 0x5564540b4b80 2023-11-28T18:39:03.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.505+0000 7f0afdfb2640 1 -- 172.21.15.45:0/589975879 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0af800db20 con 0x5564540b4b80 2023-11-28T18:39:03.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.505+0000 7f0afdfb2640 1 -- 172.21.15.45:0/589975879 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af800deb0 con 0x5564540b4b80 2023-11-28T18:39:03.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.509+0000 7f0b01c94080 1 -- 172.21.15.45:0/589975879 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5564540b4b80 msgr2=0x55645400b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:03.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.509+0000 7f0b01c94080 1 --2- 172.21.15.45:0/589975879 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5564540b4b80 0x55645400b330 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f0af80028d0 tx=0x7f0af8002d90 comp rx=0 tx=0).stop 2023-11-28T18:39:03.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.509+0000 7f0b01c94080 1 -- 172.21.15.45:0/589975879 shutdown_connections 2023-11-28T18:39:03.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.509+0000 7f0b01c94080 1 --2- 172.21.15.45:0/589975879 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5564540b4b80 0x55645400b330 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:03.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.509+0000 7f0b01c94080 1 --2- 172.21.15.45:0/589975879 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55645401e1e0 0x5564540af0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:03.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.509+0000 7f0b01c94080 1 --2- 172.21.15.45:0/589975879 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55645401de00 0x5564540b44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:03.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.509+0000 7f0b01c94080 1 -- 172.21.15.45:0/589975879 >> 172.21.15.45:0/589975879 conn(0x556454009ae0 msgr2=0x5564540b2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:03.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.509+0000 7f0b01c94080 1 -- 172.21.15.45:0/589975879 shutdown_connections 2023-11-28T18:39:03.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.509+0000 7f0b01c94080 1 -- 172.21.15.45:0/589975879 wait complete. 2023-11-28T18:39:03.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.509+0000 7f0b01c94080 1 Processor -- start 2023-11-28T18:39:03.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.509+0000 7f0b01c94080 1 -- start start 2023-11-28T18:39:03.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.509+0000 7f0b01c94080 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55645401de00 0x5564540b24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:03.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.509+0000 7f0b01c94080 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55645401e1e0 0x556454022d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:03.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.509+0000 7f0b01c94080 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5564540b4b80 0x556454023250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:03.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.509+0000 7f0b01c94080 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x556453f192c0 con 0x55645401e1e0 2023-11-28T18:39:03.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.509+0000 7f0b01c94080 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564540b10c0 con 0x55645401de00 2023-11-28T18:39:03.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.509+0000 7f0b01c94080 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x5564540b1360 con 0x5564540b4b80 2023-11-28T18:39:03.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.509+0000 7f0aff7b5640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55645401de00 0x5564540b24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:03.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.509+0000 7f0afefb4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55645401e1e0 0x556454022d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:03.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.509+0000 7f0aff7b5640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55645401de00 0x5564540b24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.45:48046/0 (socket says 172.21.15.45:48046) 2023-11-28T18:39:03.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.509+0000 7f0aff7b5640 1 -- 172.21.15.45:0/1252068268 learned_addr learned my addr 172.21.15.45:0/1252068268 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:03.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.509+0000 7f0afffb6640 1 --2- 172.21.15.45:0/1252068268 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5564540b4b80 0x556454023250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:03.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.509+0000 7f0afffb6640 1 -- 172.21.15.45:0/1252068268 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55645401de00 msgr2=0x5564540b24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:03.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.509+0000 7f0afffb6640 1 --2- 172.21.15.45:0/1252068268 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55645401de00 0x5564540b24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:03.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.509+0000 7f0afffb6640 1 -- 172.21.15.45:0/1252068268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55645401e1e0 msgr2=0x556454022d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:03.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.509+0000 7f0afffb6640 1 --2- 172.21.15.45:0/1252068268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55645401e1e0 0x556454022d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:03.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.509+0000 7f0afffb6640 1 -- 172.21.15.45:0/1252068268 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af8002520 con 0x5564540b4b80 2023-11-28T18:39:03.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.509+0000 7f0afefb4640 1 --2- 172.21.15.45:0/1252068268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55645401e1e0 0x556454022d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:39:03.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.509+0000 7f0afffb6640 1 --2- 172.21.15.45:0/1252068268 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5564540b4b80 0x556454023250 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0af8017000 tx=0x7f0af80033b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:03.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.509+0000 7f0afcfb0640 1 -- 172.21.15.45:0/1252068268 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af801b830 con 0x5564540b4b80 2023-11-28T18:39:03.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.509+0000 7f0afcfb0640 1 -- 172.21.15.45:0/1252068268 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0af801f070 con 0x5564540b4b80 2023-11-28T18:39:03.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.509+0000 7f0afcfb0640 1 -- 172.21.15.45:0/1252068268 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af801bbf0 con 0x5564540b4b80 2023-11-28T18:39:03.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.509+0000 7f0b01c94080 1 -- 172.21.15.45:0/1252068268 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556453f31420 con 0x5564540b4b80 2023-11-28T18:39:03.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.509+0000 7f0b01c94080 1 -- 172.21.15.45:0/1252068268 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556453f245d0 con 0x5564540b4b80 2023-11-28T18:39:03.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.513+0000 7f0afcfb0640 1 -- 172.21.15.45:0/1252068268 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f0af801bd50 con 0x5564540b4b80 2023-11-28T18:39:03.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.513+0000 7f0afcfb0640 1 --2- 172.21.15.45:0/1252068268 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f0aec0652e0 0x7f0aec0677a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:03.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.513+0000 7f0afcfb0640 1 -- 172.21.15.45:0/1252068268 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f0af8084d80 con 0x5564540b4b80 2023-11-28T18:39:03.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.513+0000 7f0aff7b5640 1 --2- 172.21.15.45:0/1252068268 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f0aec0652e0 0x7f0aec0677a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:03.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.513+0000 7f0b01c94080 1 --2- 172.21.15.45:0/1252068268 >> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] conn(0x55645414fbb0 0x5564540b0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:03.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.513+0000 7f0b01c94080 1 -- 172.21.15.45:0/1252068268 --> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] -- osd_op(unknown.0.0:1 4.7 4:e2e07930:::10000000001.00000000:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55645414dcc0 con 0x55645414fbb0 2023-11-28T18:39:03.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.513+0000 7f0afefb4640 1 --2- 172.21.15.45:0/1252068268 >> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] conn(0x55645414fbb0 0x5564540b0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:03.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.513+0000 7f0aff7b5640 1 --2- 172.21.15.45:0/1252068268 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f0aec0652e0 0x7f0aec0677a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0af0000c10 tx=0x7f0af0001800 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:03.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.513+0000 7f0afefb4640 1 --2- 172.21.15.45:0/1252068268 >> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] conn(0x55645414fbb0 0x5564540b0270 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:03.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.517+0000 7f0afefb4640 1 -- 172.21.15.45:0/1252068268 <== osd.1 v2:172.21.15.45:6800/2857063763 1 ==== osd_op_reply(1 10000000001.00000000 [omap-get-keys out=42b] v0'0 uv25 ondisk = 0) v8 ==== 164+0+42 (crc 0 0 0) 0x7f0af40aaac0 con 0x55645414fbb0 2023-11-28T18:39:03.523 INFO:teuthology.orchestra.run.smithi045.stdout:subdirfile_head 2023-11-28T18:39:03.523 INFO:teuthology.orchestra.run.smithi045.stdout:subsubdir_head 2023-11-28T18:39:03.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.517+0000 7f0b01c94080 1 -- 172.21.15.45:0/1252068268 >> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] conn(0x55645414fbb0 msgr2=0x5564540b0270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:03.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.517+0000 7f0b01c94080 1 --2- 172.21.15.45:0/1252068268 >> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] conn(0x55645414fbb0 0x5564540b0270 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:03.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.517+0000 7f0b01c94080 1 -- 172.21.15.45:0/1252068268 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f0aec0652e0 msgr2=0x7f0aec0677a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:03.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.517+0000 7f0b01c94080 1 --2- 172.21.15.45:0/1252068268 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f0aec0652e0 0x7f0aec0677a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0af0000c10 tx=0x7f0af0001800 comp rx=0 tx=0).stop 2023-11-28T18:39:03.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.517+0000 7f0b01c94080 1 -- 172.21.15.45:0/1252068268 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5564540b4b80 msgr2=0x556454023250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:03.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.517+0000 7f0b01c94080 1 --2- 172.21.15.45:0/1252068268 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5564540b4b80 0x556454023250 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0af8017000 tx=0x7f0af80033b0 comp rx=0 tx=0).stop 2023-11-28T18:39:03.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.517+0000 7f0afffb6640 1 -- 172.21.15.45:0/1252068268 reap_dead start 2023-11-28T18:39:03.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.517+0000 7f0b01c94080 1 -- 172.21.15.45:0/1252068268 shutdown_connections 2023-11-28T18:39:03.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.517+0000 7f0b01c94080 1 -- 172.21.15.45:0/1252068268 >> 172.21.15.45:0/1252068268 conn(0x556454009ae0 msgr2=0x556454021d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:03.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.517+0000 7f0b01c94080 1 -- 172.21.15.45:0/1252068268 shutdown_connections 2023-11-28T18:39:03.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.517+0000 7f0b01c94080 1 -- 172.21.15.45:0/1252068268 wait complete. 2023-11-28T18:39:03.526 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 100000001f7.00000000 2023-11-28T18:39:03.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.609+0000 7f3744ea8080 1 Processor -- start 2023-11-28T18:39:03.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.609+0000 7f3744ea8080 1 -- start start 2023-11-28T18:39:03.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.609+0000 7f3744ea8080 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55571ebc3620 0x55571ec98340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:03.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.609+0000 7f3744ea8080 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55571ec11510 0x55571ebf6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:03.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.609+0000 7f3744ea8080 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55571ec9b750 0x55571ebf74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:03.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.609+0000 7f3744ea8080 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55571eb76b80 con 0x55571ec9b750 2023-11-28T18:39:03.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.609+0000 7f3744ea8080 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55571eb72470 con 0x55571ebc3620 2023-11-28T18:39:03.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.609+0000 7f3744ea8080 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x55571eb2a0c0 con 0x55571ec11510 2023-11-28T18:39:03.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.609+0000 7f37431ca640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55571ec9b750 0x55571ebf74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:03.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.609+0000 7f37431ca640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55571ec9b750 0x55571ebf74f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53750/0 (socket says 172.21.15.45:53750) 2023-11-28T18:39:03.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.609+0000 7f37431ca640 1 -- 172.21.15.45:0/1213142828 learned_addr learned my addr 172.21.15.45:0/1213142828 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:03.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.609+0000 7f37421c8640 1 --2- 172.21.15.45:0/1213142828 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55571ec11510 0x55571ebf6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:03.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.609+0000 7f37429c9640 1 --2- 172.21.15.45:0/1213142828 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55571ebc3620 0x55571ec98340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:03.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.609+0000 7f37431ca640 1 -- 172.21.15.45:0/1213142828 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55571ec11510 msgr2=0x55571ebf6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:03.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.609+0000 7f37431ca640 1 --2- 172.21.15.45:0/1213142828 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55571ec11510 0x55571ebf6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:03.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.609+0000 7f37431ca640 1 -- 172.21.15.45:0/1213142828 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55571ebc3620 msgr2=0x55571ec98340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:03.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.609+0000 7f37431ca640 1 --2- 172.21.15.45:0/1213142828 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55571ebc3620 0x55571ec98340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:03.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.609+0000 7f37431ca640 1 -- 172.21.15.45:0/1213142828 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3738005d30 con 0x55571ec9b750 2023-11-28T18:39:03.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.609+0000 7f37429c9640 1 --2- 172.21.15.45:0/1213142828 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55571ebc3620 0x55571ec98340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:39:03.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.613+0000 7f37431ca640 1 --2- 172.21.15.45:0/1213142828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55571ec9b750 0x55571ebf74f0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f373c006f10 tx=0x7f373c001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd8dfd3ef3a6476e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:03.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.613+0000 7f37411c6640 1 -- 172.21.15.45:0/1213142828 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f373c004530 con 0x55571ec9b750 2023-11-28T18:39:03.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.613+0000 7f37411c6640 1 -- 172.21.15.45:0/1213142828 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f373c004690 con 0x55571ec9b750 2023-11-28T18:39:03.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.613+0000 7f37411c6640 1 -- 172.21.15.45:0/1213142828 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f373c004a40 con 0x55571ec9b750 2023-11-28T18:39:03.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.613+0000 7f3744ea8080 1 -- 172.21.15.45:0/1213142828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55571ec9b750 msgr2=0x55571ebf74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:03.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.613+0000 7f3744ea8080 1 --2- 172.21.15.45:0/1213142828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55571ec9b750 0x55571ebf74f0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f373c006f10 tx=0x7f373c001a30 comp rx=0 tx=0).stop 2023-11-28T18:39:03.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.613+0000 7f3744ea8080 1 -- 172.21.15.45:0/1213142828 shutdown_connections 2023-11-28T18:39:03.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.613+0000 7f3744ea8080 1 --2- 172.21.15.45:0/1213142828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55571ec9b750 0x55571ebf74f0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:03.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.613+0000 7f3744ea8080 1 --2- 172.21.15.45:0/1213142828 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55571ec11510 0x55571ebf6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:03.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.613+0000 7f3744ea8080 1 --2- 172.21.15.45:0/1213142828 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55571ebc3620 0x55571ec98340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:03.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.613+0000 7f3744ea8080 1 -- 172.21.15.45:0/1213142828 >> 172.21.15.45:0/1213142828 conn(0x55571ebf3090 msgr2=0x55571ec118f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:03.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.613+0000 7f3744ea8080 1 -- 172.21.15.45:0/1213142828 shutdown_connections 2023-11-28T18:39:03.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.613+0000 7f3744ea8080 1 -- 172.21.15.45:0/1213142828 wait complete. 2023-11-28T18:39:03.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.613+0000 7f3744ea8080 1 Processor -- start 2023-11-28T18:39:03.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.613+0000 7f3744ea8080 1 -- start start 2023-11-28T18:39:03.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.613+0000 7f3744ea8080 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55571ebc3620 0x55571ec8f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:03.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.613+0000 7f3744ea8080 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55571ec11510 0x55571ec97760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:03.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.613+0000 7f3744ea8080 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55571ec9b750 0x55571ebc2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:03.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.613+0000 7f3744ea8080 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55571eb29d60 con 0x55571ebc3620 2023-11-28T18:39:03.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.613+0000 7f3744ea8080 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55571eb002c0 con 0x55571ec11510 2023-11-28T18:39:03.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.613+0000 7f3744ea8080 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x55571ec08b60 con 0x55571ec9b750 2023-11-28T18:39:03.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.613+0000 7f37429c9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55571ebc3620 0x55571ec8f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:03.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.613+0000 7f37429c9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55571ebc3620 0x55571ec8f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53766/0 (socket says 172.21.15.45:53766) 2023-11-28T18:39:03.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.613+0000 7f37429c9640 1 -- 172.21.15.45:0/4001498510 learned_addr learned my addr 172.21.15.45:0/4001498510 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:03.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.613+0000 7f37431ca640 1 --2- 172.21.15.45:0/4001498510 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55571ec9b750 0x55571ebc2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:03.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.613+0000 7f37421c8640 1 --2- 172.21.15.45:0/4001498510 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55571ec11510 0x55571ec97760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:03.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.613+0000 7f37429c9640 1 -- 172.21.15.45:0/4001498510 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55571ec9b750 msgr2=0x55571ebc2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:03.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.613+0000 7f37429c9640 1 --2- 172.21.15.45:0/4001498510 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55571ec9b750 0x55571ebc2af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:03.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.613+0000 7f37429c9640 1 -- 172.21.15.45:0/4001498510 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55571ec11510 msgr2=0x55571ec97760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:03.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.613+0000 7f37429c9640 1 --2- 172.21.15.45:0/4001498510 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55571ec11510 0x55571ec97760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:03.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.613+0000 7f37429c9640 1 -- 172.21.15.45:0/4001498510 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f372c001e20 con 0x55571ebc3620 2023-11-28T18:39:03.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.613+0000 7f37429c9640 1 --2- 172.21.15.45:0/4001498510 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55571ebc3620 0x55571ec8f1c0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f373400cf60 tx=0x7f373400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:03.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.613+0000 7f372bfff640 1 -- 172.21.15.45:0/4001498510 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3734015030 con 0x55571ebc3620 2023-11-28T18:39:03.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.613+0000 7f372bfff640 1 -- 172.21.15.45:0/4001498510 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f373400f7d0 con 0x55571ebc3620 2023-11-28T18:39:03.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.613+0000 7f372bfff640 1 -- 172.21.15.45:0/4001498510 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3734008040 con 0x55571ebc3620 2023-11-28T18:39:03.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.613+0000 7f3744ea8080 1 -- 172.21.15.45:0/4001498510 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55571eb0b5d0 con 0x55571ebc3620 2023-11-28T18:39:03.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.617+0000 7f3744ea8080 1 -- 172.21.15.45:0/4001498510 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55571eb0b030 con 0x55571ebc3620 2023-11-28T18:39:03.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.617+0000 7f372bfff640 1 -- 172.21.15.45:0/4001498510 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f3734018070 con 0x55571ebc3620 2023-11-28T18:39:03.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.617+0000 7f372bfff640 1 --2- 172.21.15.45:0/4001498510 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f37300652b0 0x7f3730067770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:03.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.617+0000 7f372bfff640 1 -- 172.21.15.45:0/4001498510 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f3734016070 con 0x55571ebc3620 2023-11-28T18:39:03.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.617+0000 7f37421c8640 1 --2- 172.21.15.45:0/4001498510 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f37300652b0 0x7f3730067770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:03.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.617+0000 7f3744ea8080 1 --2- 172.21.15.45:0/4001498510 >> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] conn(0x55571ec97ca0 0x55571ec09420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:03.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.617+0000 7f3744ea8080 1 -- 172.21.15.45:0/4001498510 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:1 4.16 4:6fe38dc2:::100000001f7.00000000:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55571ec968b0 con 0x55571ec97ca0 2023-11-28T18:39:03.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.617+0000 7f37431ca640 1 --2- 172.21.15.45:0/4001498510 >> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] conn(0x55571ec97ca0 0x55571ec09420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:03.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.617+0000 7f37421c8640 1 --2- 172.21.15.45:0/4001498510 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f37300652b0 0x7f3730067770 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f37380ac000 tx=0x7f37380a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:03.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.621+0000 7f37431ca640 1 --2- 172.21.15.45:0/4001498510 >> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] conn(0x55571ec97ca0 0x55571ec09420 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:03.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.621+0000 7f37431ca640 1 -- 172.21.15.45:0/4001498510 <== osd.0 v2:172.21.15.45:6808/555237322 1 ==== osd_op_reply(1 100000001f7.00000000 [omap-get-keys out=61b] v0'0 uv25 ondisk = 0) v8 ==== 164+0+61 (crc 0 0 0) 0x7f373c004800 con 0x55571ec97ca0 2023-11-28T18:39:03.624 INFO:teuthology.orchestra.run.smithi045.stdout:link0_head 2023-11-28T18:39:03.624 INFO:teuthology.orchestra.run.smithi045.stdout:link1_head 2023-11-28T18:39:03.624 INFO:teuthology.orchestra.run.smithi045.stdout:link2_head 2023-11-28T18:39:03.624 INFO:teuthology.orchestra.run.smithi045.stdout:link3_head 2023-11-28T18:39:03.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.621+0000 7f3744ea8080 1 -- 172.21.15.45:0/4001498510 >> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] conn(0x55571ec97ca0 msgr2=0x55571ec09420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:03.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.621+0000 7f3744ea8080 1 --2- 172.21.15.45:0/4001498510 >> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] conn(0x55571ec97ca0 0x55571ec09420 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:03.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.621+0000 7f3744ea8080 1 -- 172.21.15.45:0/4001498510 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f37300652b0 msgr2=0x7f3730067770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:03.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.621+0000 7f3744ea8080 1 --2- 172.21.15.45:0/4001498510 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f37300652b0 0x7f3730067770 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f37380ac000 tx=0x7f37380a5000 comp rx=0 tx=0).stop 2023-11-28T18:39:03.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.621+0000 7f3744ea8080 1 -- 172.21.15.45:0/4001498510 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55571ebc3620 msgr2=0x55571ec8f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:03.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.621+0000 7f3744ea8080 1 --2- 172.21.15.45:0/4001498510 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55571ebc3620 0x55571ec8f1c0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f373400cf60 tx=0x7f373400cf90 comp rx=0 tx=0).stop 2023-11-28T18:39:03.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.621+0000 7f37431ca640 1 -- 172.21.15.45:0/4001498510 reap_dead start 2023-11-28T18:39:03.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.621+0000 7f3744ea8080 1 -- 172.21.15.45:0/4001498510 shutdown_connections 2023-11-28T18:39:03.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.621+0000 7f3744ea8080 1 -- 172.21.15.45:0/4001498510 >> 172.21.15.45:0/4001498510 conn(0x55571ebf3090 msgr2=0x55571ec118f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:03.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.621+0000 7f3744ea8080 1 -- 172.21.15.45:0/4001498510 shutdown_connections 2023-11-28T18:39:03.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.621+0000 7f3744ea8080 1 -- 172.21.15.45:0/4001498510 wait complete. 2023-11-28T18:39:03.627 DEBUG:teuthology.orchestra.run.smithi045:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 journal reset 2023-11-28T18:39:03.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.713+0000 7f0b3b367280 1 -- start start 2023-11-28T18:39:03.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.713+0000 7f0b3b367280 1 Processor -- start 2023-11-28T18:39:03.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.713+0000 7f0b3b367280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55be0dac9800 0x55be0db34580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:03.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.713+0000 7f0b3b367280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55be0dac9400 0x55be0db34b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:03.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.713+0000 7f0b3b367280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55be0dac9000 0x55be0db35080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:03.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.713+0000 7f0b3b367280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be0db0f180 con 0x55be0dac9000 2023-11-28T18:39:03.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.713+0000 7f0b3b367280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be0db0ea00 con 0x55be0dac9400 2023-11-28T18:39:03.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.713+0000 7f0b3b367280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x55be0db0e140 con 0x55be0dac9800 2023-11-28T18:39:03.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.713+0000 7f0b3a329640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55be0dac9000 0x55be0db35080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:03.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.713+0000 7f0b3a329640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55be0dac9000 0x55be0db35080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53772/0 (socket says 172.21.15.45:53772) 2023-11-28T18:39:03.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.713+0000 7f0b3a329640 1 -- 172.21.15.45:0/699376246 learned_addr learned my addr 172.21.15.45:0/699376246 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:03.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.713+0000 7f0b3a329640 1 -- 172.21.15.45:0/699376246 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55be0dac9800 msgr2=0x55be0db34580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:03.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.713+0000 7f0b3a329640 1 --2- 172.21.15.45:0/699376246 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55be0dac9800 0x55be0db34580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:03.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.717+0000 7f0b3a329640 1 -- 172.21.15.45:0/699376246 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55be0dac9400 msgr2=0x55be0db34b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:03.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.717+0000 7f0b3a329640 1 --2- 172.21.15.45:0/699376246 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55be0dac9400 0x55be0db34b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:03.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.717+0000 7f0b3a329640 1 -- 172.21.15.45:0/699376246 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55be0dafe9c0 con 0x55be0dac9000 2023-11-28T18:39:03.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.717+0000 7f0b3a329640 1 --2- 172.21.15.45:0/699376246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55be0dac9000 0x55be0db35080 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x55be0e940cf0 tx=0x55be0e847f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c2ed5cb5cf2b6f3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:03.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.717+0000 7f0b37323640 1 -- 172.21.15.45:0/699376246 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55be0db291e0 con 0x55be0dac9000 2023-11-28T18:39:03.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.717+0000 7f0b37323640 1 -- 172.21.15.45:0/699376246 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55be0e896300 con 0x55be0dac9000 2023-11-28T18:39:03.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.717+0000 7f0b37323640 1 -- 172.21.15.45:0/699376246 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55be0db29080 con 0x55be0dac9000 2023-11-28T18:39:03.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.717+0000 7f0b3b367280 1 -- 172.21.15.45:0/699376246 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55be0dafe1a0 con 0x55be0dac9000 2023-11-28T18:39:03.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.717+0000 7f0b3b367280 1 -- 172.21.15.45:0/699376246 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55be0dafe9c0 con 0x55be0dac9000 2023-11-28T18:39:03.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.717+0000 7f0b3b367280 4 waiting for MDS map... 2023-11-28T18:39:03.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.717+0000 7f0b37323640 1 -- 172.21.15.45:0/699376246 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x55be0db0ac40 con 0x55be0dac9000 2023-11-28T18:39:03.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.717+0000 7f0b37323640 1 -- 172.21.15.45:0/699376246 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 17) v1 ==== 2723+0+0 (secure 0 0 0) 0x55be0db16f00 con 0x55be0dac9000 2023-11-28T18:39:03.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.717+0000 7f0b3b367280 4 Got MDS map 17 2023-11-28T18:39:03.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.717+0000 7f0b3b367280 10 main: JournalTool::main 2023-11-28T18:39:03.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.717+0000 7f0b3b367280 4 main: JournalTool: connecting to RADOS... 2023-11-28T18:39:03.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.717+0000 7f0b3b367280 1 Processor -- start 2023-11-28T18:39:03.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.717+0000 7f0b3b367280 1 -- start start 2023-11-28T18:39:03.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.717+0000 7f0b3b367280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55be0e8a5800 0x55be0db35600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:03.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.717+0000 7f0b3b367280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55be0e8a5c00 0x55be0db35b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:03.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.717+0000 7f0b3b367280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55be0ea38000 0x55be0db36100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:03.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.717+0000 7f0b3b367280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be0db0e000 con 0x55be0ea38000 2023-11-28T18:39:03.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.717+0000 7f0b3b367280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be0db99180 con 0x55be0e8a5c00 2023-11-28T18:39:03.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.717+0000 7f0b3b367280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x55be0db98dc0 con 0x55be0e8a5800 2023-11-28T18:39:03.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.717+0000 7f0b39b28640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55be0e8a5c00 0x55be0db35b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:03.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.717+0000 7f0b39327640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55be0e8a5800 0x55be0db35600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:03.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.717+0000 7f0b39b28640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55be0e8a5c00 0x55be0db35b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.45:48102/0 (socket says 172.21.15.45:48102) 2023-11-28T18:39:03.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.717+0000 7f0b39b28640 1 -- 172.21.15.45:0/393359254 learned_addr learned my addr 172.21.15.45:0/393359254 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:03.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.717+0000 7f0b39327640 1 --2- 172.21.15.45:0/393359254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55be0ea38000 0x55be0db36100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:03.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.717+0000 7f0b39b28640 1 -- 172.21.15.45:0/393359254 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55be0e8a5800 msgr2=0x55be0db35600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:03.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.717+0000 7f0b39b28640 1 --2- 172.21.15.45:0/393359254 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55be0e8a5800 0x55be0db35600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:03.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.717+0000 7f0b39b28640 1 -- 172.21.15.45:0/393359254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55be0ea38000 msgr2=0x55be0db36100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:03.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.717+0000 7f0b39b28640 1 --2- 172.21.15.45:0/393359254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55be0ea38000 0x55be0db36100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:03.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.717+0000 7f0b39b28640 1 -- 172.21.15.45:0/393359254 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55be0dafe340 con 0x55be0e8a5c00 2023-11-28T18:39:03.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.717+0000 7f0b39b28640 1 --2- 172.21.15.45:0/393359254 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55be0e8a5c00 0x55be0db35b80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x55be0ea3e0c0 tx=0x55be0e9d3f20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=209509aeaf09bca9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:03.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.717+0000 7f0b3531f640 1 -- 172.21.15.45:0/393359254 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55be0db291e0 con 0x55be0e8a5c00 2023-11-28T18:39:03.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.717+0000 7f0b3531f640 1 -- 172.21.15.45:0/393359254 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55be0db24480 con 0x55be0e8a5c00 2023-11-28T18:39:03.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.717+0000 7f0b3531f640 1 -- 172.21.15.45:0/393359254 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55be0db29080 con 0x55be0e8a5c00 2023-11-28T18:39:03.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.721+0000 7f0b3b367280 1 -- 172.21.15.45:0/393359254 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55be0e8a5c00 msgr2=0x55be0db35b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:03.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.721+0000 7f0b3b367280 1 --2- 172.21.15.45:0/393359254 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55be0e8a5c00 0x55be0db35b80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x55be0ea3e0c0 tx=0x55be0e9d3f20 comp rx=0 tx=0).stop 2023-11-28T18:39:03.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.721+0000 7f0b3b367280 1 -- 172.21.15.45:0/393359254 shutdown_connections 2023-11-28T18:39:03.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.721+0000 7f0b3b367280 1 --2- 172.21.15.45:0/393359254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55be0ea38000 0x55be0db36100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:03.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.721+0000 7f0b3b367280 1 --2- 172.21.15.45:0/393359254 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55be0e8a5c00 0x55be0db35b80 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:03.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.721+0000 7f0b3b367280 1 --2- 172.21.15.45:0/393359254 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55be0e8a5800 0x55be0db35600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:03.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.721+0000 7f0b3b367280 1 -- 172.21.15.45:0/393359254 >> 172.21.15.45:0/393359254 conn(0x55be0dac8c00 msgr2=0x55be0daf7800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:03.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.721+0000 7f0b3b367280 1 -- 172.21.15.45:0/393359254 shutdown_connections 2023-11-28T18:39:03.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.721+0000 7f0b3b367280 1 -- 172.21.15.45:0/393359254 wait complete. 2023-11-28T18:39:03.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.721+0000 7f0b3b367280 1 Processor -- start 2023-11-28T18:39:03.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.721+0000 7f0b3b367280 1 -- start start 2023-11-28T18:39:03.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.721+0000 7f0b3b367280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55be0e8a5c00 0x55be0db37180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:03.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.721+0000 7f0b3b367280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55be0e8a5800 0x55be0db36c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:03.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.721+0000 7f0b3b367280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55be0ea39800 0x55be0db36680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:03.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.721+0000 7f0b3b367280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be0db0ea00 con 0x55be0e8a5800 2023-11-28T18:39:03.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.721+0000 7f0b3b367280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be0db0f180 con 0x55be0e8a5c00 2023-11-28T18:39:03.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.721+0000 7f0b3b367280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x55be0db0eb40 con 0x55be0ea39800 2023-11-28T18:39:03.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.721+0000 7f0b39b28640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55be0e8a5800 0x55be0db36c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:03.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.721+0000 7f0b39b28640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55be0e8a5800 0x55be0db36c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53800/0 (socket says 172.21.15.45:53800) 2023-11-28T18:39:03.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.721+0000 7f0b39b28640 1 -- 172.21.15.45:0/1862917057 learned_addr learned my addr 172.21.15.45:0/1862917057 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:03.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.721+0000 7f0b39b28640 1 -- 172.21.15.45:0/1862917057 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55be0ea39800 msgr2=0x55be0db36680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:03.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.721+0000 7f0b39b28640 1 --2- 172.21.15.45:0/1862917057 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55be0ea39800 0x55be0db36680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:03.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.721+0000 7f0b39b28640 1 -- 172.21.15.45:0/1862917057 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55be0e8a5c00 msgr2=0x55be0db37180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:03.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.721+0000 7f0b39b28640 1 --2- 172.21.15.45:0/1862917057 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55be0e8a5c00 0x55be0db37180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:03.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.721+0000 7f0b39b28640 1 -- 172.21.15.45:0/1862917057 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55be0dafe000 con 0x55be0e8a5800 2023-11-28T18:39:03.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.721+0000 7f0b39b28640 1 --2- 172.21.15.45:0/1862917057 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55be0e8a5800 0x55be0db36c00 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x55be0ea3f380 tx=0x55be0e851560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:03.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.721+0000 7f0b33b1c640 1 -- 172.21.15.45:0/1862917057 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55be0db28f20 con 0x55be0e8a5800 2023-11-28T18:39:03.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.721+0000 7f0b33b1c640 1 -- 172.21.15.45:0/1862917057 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55be0e897500 con 0x55be0e8a5800 2023-11-28T18:39:03.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.721+0000 7f0b33b1c640 1 -- 172.21.15.45:0/1862917057 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55be0db291e0 con 0x55be0e8a5800 2023-11-28T18:39:03.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.721+0000 7f0b3b367280 1 -- 172.21.15.45:0/1862917057 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55be0dafeea0 con 0x55be0e8a5800 2023-11-28T18:39:03.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.721+0000 7f0b3b367280 1 -- 172.21.15.45:0/1862917057 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55be0dafe340 con 0x55be0e8a5800 2023-11-28T18:39:03.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.721+0000 7f0b3b367280 4 main: JournalTool: resolving pool 4 2023-11-28T18:39:03.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.725+0000 7f0b33b1c640 1 -- 172.21.15.45:0/1862917057 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x55be0db56840 con 0x55be0e8a5800 2023-11-28T18:39:03.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.725+0000 7f0b33b1c640 1 --2- 172.21.15.45:0/1862917057 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x55be0ea3a800 0x55be0db37700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:03.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.725+0000 7f0b33b1c640 1 -- 172.21.15.45:0/1862917057 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x55be0db0aa80 con 0x55be0e8a5800 2023-11-28T18:39:03.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.725+0000 7f0b3b367280 4 main: JournalTool: creating IoCtx.. 2023-11-28T18:39:03.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.725+0000 7f0b3b367280 4 main: Executing for rank 0 2023-11-28T18:39:03.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.725+0000 7f0b39327640 1 --2- 172.21.15.45:0/1862917057 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x55be0ea3a800 0x55be0db37700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:03.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.725+0000 7f0b39327640 1 --2- 172.21.15.45:0/1862917057 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x55be0ea3a800 0x55be0db37700 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x55be0e884030 tx=0x55be0ea46240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:03.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.725+0000 7f0b3b367280 1 -- start start 2023-11-28T18:39:03.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.725+0000 7f0b3b367280 1 Processor -- start 2023-11-28T18:39:03.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.725+0000 7f0b3b367280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55be0ea39000 0x55be0db36100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:03.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.725+0000 7f0b3b367280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55be0ea38c00 0x55be0db35b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:03.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.725+0000 7f0b3b367280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55be0ea38800 0x55be0db35600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:03.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.725+0000 7f0b3b367280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be0db99180 con 0x55be0ea39000 2023-11-28T18:39:03.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.725+0000 7f0b3b367280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be0db98dc0 con 0x55be0ea38800 2023-11-28T18:39:03.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.725+0000 7f0b3b367280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x55be0db98c80 con 0x55be0ea38c00 2023-11-28T18:39:03.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.725+0000 7f0b3a329640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55be0ea39000 0x55be0db36100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:03.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.725+0000 7f0b3a329640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55be0ea39000 0x55be0db36100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53808/0 (socket says 172.21.15.45:53808) 2023-11-28T18:39:03.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.725+0000 7f0b3a329640 1 -- 172.21.15.45:0/1118956787 learned_addr learned my addr 172.21.15.45:0/1118956787 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:03.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.729+0000 7f0b39b28640 1 --2- 172.21.15.45:0/1118956787 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55be0ea38c00 0x55be0db35b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:03.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.729+0000 7f0b39327640 1 --2- 172.21.15.45:0/1118956787 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55be0ea38800 0x55be0db35600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:03.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.729+0000 7f0b3a329640 1 -- 172.21.15.45:0/1118956787 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55be0ea38c00 msgr2=0x55be0db35b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:03.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.729+0000 7f0b3a329640 1 --2- 172.21.15.45:0/1118956787 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55be0ea38c00 0x55be0db35b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:03.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.729+0000 7f0b3a329640 1 -- 172.21.15.45:0/1118956787 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55be0ea38800 msgr2=0x55be0db35600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:03.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.729+0000 7f0b3a329640 1 --2- 172.21.15.45:0/1118956787 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55be0ea38800 0x55be0db35600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:03.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.729+0000 7f0b3a329640 1 -- 172.21.15.45:0/1118956787 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55be0ddd5a00 con 0x55be0ea39000 2023-11-28T18:39:03.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.729+0000 7f0b3a329640 1 --2- 172.21.15.45:0/1118956787 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55be0ea39000 0x55be0db36100 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x55be0e941110 tx=0x55be0e847c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccad5a225f3f17e9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:03.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.729+0000 7f0b30b16640 1 -- 172.21.15.45:0/1118956787 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55be0db282c0 con 0x55be0ea39000 2023-11-28T18:39:03.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.729+0000 7f0b30b16640 1 -- 172.21.15.45:0/1118956787 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55be0e897980 con 0x55be0ea39000 2023-11-28T18:39:03.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.729+0000 7f0b30b16640 1 -- 172.21.15.45:0/1118956787 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55be0db286e0 con 0x55be0ea39000 2023-11-28T18:39:03.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.729+0000 7f0b3b367280 1 -- 172.21.15.45:0/1118956787 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55be0ddd5860 con 0x55be0ea39000 2023-11-28T18:39:03.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.729+0000 7f0b3b367280 1 -- 172.21.15.45:0/1118956787 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55be0ddd56c0 con 0x55be0ea39000 2023-11-28T18:39:03.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.729+0000 7f0b3b367280 4 waiting for MDS map... 2023-11-28T18:39:03.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.729+0000 7f0b30b16640 1 -- 172.21.15.45:0/1118956787 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x55be0db0a8c0 con 0x55be0ea39000 2023-11-28T18:39:03.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.729+0000 7f0b30b16640 1 -- 172.21.15.45:0/1118956787 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 17) v1 ==== 2723+0+0 (secure 0 0 0) 0x55be0df04000 con 0x55be0ea39000 2023-11-28T18:39:03.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.729+0000 7f0b3b367280 4 Got MDS map 17 2023-11-28T18:39:03.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.729+0000 7f0b3b367280 1 --2- 172.21.15.45:0/1118956787 >> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] conn(0x55be0ea38400 0x55be0df0e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:03.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.729+0000 7f0b3b367280 1 -- 172.21.15.45:0/1118956787 --> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] -- osd_op(unknown.0.0:1 4.f 4:f1f69726:::400.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55be0df0a380 con 0x55be0ea38400 2023-11-28T18:39:03.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.729+0000 7f0b39b28640 1 --2- 172.21.15.45:0/1118956787 >> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] conn(0x55be0ea38400 0x55be0df0e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:03.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.729+0000 7f0b39b28640 1 --2- 172.21.15.45:0/1118956787 >> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] conn(0x55be0ea38400 0x55be0df0e000 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=91ee5ce3287163d9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:03.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.729+0000 7f0b39b28640 1 -- 172.21.15.45:0/1118956787 <== osd.1 v2:172.21.15.45:6800/2857063763 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x55be0e9ceb40 con 0x55be0ea38400 2023-11-28T18:39:03.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.729+0000 7f0b3b367280 1 --2- 172.21.15.45:0/1118956787 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x55be0ea38000 0x55be0df0e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:03.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.729+0000 7f0b3b367280 1 -- 172.21.15.45:0/1118956787 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:2 4.14 4:292cf221:::200.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) v8 -- 0x55be0df0a700 con 0x55be0ea38000 2023-11-28T18:39:03.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.729+0000 7f0b39327640 1 --2- 172.21.15.45:0/1118956787 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x55be0ea38000 0x55be0df0e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:03.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.729+0000 7f0b39327640 1 --2- 172.21.15.45:0/1118956787 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x55be0ea38000 0x55be0df0e580 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=bc0e7d574656cfe2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:03.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.729+0000 7f0b39327640 1 -- 172.21.15.45:0/1118956787 <== osd.3 v2:172.21.15.45:6824/78541084 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv11 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x55be0e9ced80 con 0x55be0ea38000 2023-11-28T18:39:03.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.729+0000 7f0b2f313640 1 -- 172.21.15.45:0/1118956787 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:3 4.14 4:2e2fa760:::200.00000001:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e35) v8 -- 0x55be0df0ae00 con 0x55be0ea38000 2023-11-28T18:39:03.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.729+0000 7f0b2f313640 1 --2- 172.21.15.45:0/1118956787 >> [v2:172.21.15.190:6808/1537591987,v1:172.21.15.190:6809/1537591987] conn(0x55be0df00400 0x55be0df10680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:03.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.729+0000 7f0b2f313640 1 -- 172.21.15.45:0/1118956787 --> [v2:172.21.15.190:6808/1537591987,v1:172.21.15.190:6809/1537591987] -- osd_op(unknown.0.0:4 4.1b 4:ddb4e4d7:::200.00000002:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e35) v8 -- 0x55be0df0a700 con 0x55be0df00400 2023-11-28T18:39:03.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.733+0000 7f0b39327640 1 -- 172.21.15.45:0/1118956787 <== osd.3 v2:172.21.15.45:6824/78541084 2 ==== osd_op_reply(3 200.00000001 [stat out=16b] v0'0 uv29 ondisk = 0) v8 ==== 156+0+16 (crc 0 0 0) 0x55be0e9ced80 con 0x55be0ea38000 2023-11-28T18:39:03.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.733+0000 7f0b3a329640 1 --2- 172.21.15.45:0/1118956787 >> [v2:172.21.15.190:6808/1537591987,v1:172.21.15.190:6809/1537591987] conn(0x55be0df00400 0x55be0df10680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:03.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.733+0000 7f0b3a329640 1 --2- 172.21.15.45:0/1118956787 >> [v2:172.21.15.190:6808/1537591987,v1:172.21.15.190:6809/1537591987] conn(0x55be0df00400 0x55be0df10680 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=94682d50354fae8b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:03.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.733+0000 7f0b3a329640 1 -- 172.21.15.45:0/1118956787 <== osd.4 v2:172.21.15.190:6808/1537591987 1 ==== osd_op_reply(4 200.00000002 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55be0e9cefc0 con 0x55be0df00400 2023-11-28T18:39:03.739 INFO:teuthology.orchestra.run.smithi045.stdout:old journal was 4194304~56199 2023-11-28T18:39:03.739 INFO:teuthology.orchestra.run.smithi045.stdout:new journal start will be 8388608 (4138105 bytes past old end) 2023-11-28T18:39:03.739 INFO:teuthology.orchestra.run.smithi045.stdout:writing journal head 2023-11-28T18:39:03.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.733+0000 7f0b3b367280 1 -- 172.21.15.45:0/1118956787 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:5 4.14 4:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55be0df0aa80 con 0x55be0ea38000 2023-11-28T18:39:03.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.733+0000 7f0b39327640 1 -- 172.21.15.45:0/1118956787 <== osd.3 v2:172.21.15.45:6824/78541084 3 ==== osd_op_reply(5 200.00000000 [writefull 0~90] v35'39 uv39 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55be0e9ced80 con 0x55be0ea38000 2023-11-28T18:39:03.740 INFO:teuthology.orchestra.run.smithi045.stdout:writing EResetJournal entry 2023-11-28T18:39:03.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.733+0000 7f0b3b367280 1 -- 172.21.15.45:0/1118956787 --> [v2:172.21.15.190:6808/1537591987,v1:172.21.15.190:6809/1537591987] -- osd_op(unknown.0.0:6 4.1b 4:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55be0df0b180 con 0x55be0df00400 2023-11-28T18:39:03.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.733+0000 7f0b3b367280 1 --2- 172.21.15.45:0/1118956787 >> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] conn(0x55be0df00800 0x55be0df0eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:03.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.733+0000 7f0b3b367280 1 -- 172.21.15.45:0/1118956787 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:7 4.b 4:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55be0df0b500 con 0x55be0df00800 2023-11-28T18:39:03.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.733+0000 7f0b3b367280 1 --2- 172.21.15.45:0/1118956787 >> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] conn(0x55be0df00c00 0x55be0df0f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:03.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.733+0000 7f0b3b367280 1 -- 172.21.15.45:0/1118956787 --> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] -- osd_op(unknown.0.0:8 4.1f 4:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55be0df0b880 con 0x55be0df00c00 2023-11-28T18:39:03.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.733+0000 7f0b3b367280 1 -- 172.21.15.45:0/1118956787 --> [v2:172.21.15.190:6808/1537591987,v1:172.21.15.190:6809/1537591987] -- osd_op(unknown.0.0:9 4.1a 4:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55be0df0bc00 con 0x55be0df00400 2023-11-28T18:39:03.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.733+0000 7f0b3b367280 1 -- 172.21.15.45:0/1118956787 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:10 4.1e 4:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55be0df22000 con 0x55be0df00800 2023-11-28T18:39:03.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.733+0000 7f0b3b367280 1 -- 172.21.15.45:0/1118956787 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:11 4.1d 4:bec1251c:::200.00000007:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55be0df22380 con 0x55be0ea38000 2023-11-28T18:39:03.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.733+0000 7f0b39b28640 1 --2- 172.21.15.45:0/1118956787 >> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] conn(0x55be0df00800 0x55be0df0eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:03.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.733+0000 7f0b39327640 1 --2- 172.21.15.45:0/1118956787 >> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] conn(0x55be0df00c00 0x55be0df0f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:03.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.733+0000 7f0b39327640 1 --2- 172.21.15.45:0/1118956787 >> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] conn(0x55be0df00c00 0x55be0df0f080 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=df02f537fa59ff6e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:03.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.733+0000 7f0b39b28640 1 --2- 172.21.15.45:0/1118956787 >> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] conn(0x55be0df00800 0x55be0df0eb00 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=20814ae78eb4c20f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:03.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.737+0000 7f0b3a329640 1 -- 172.21.15.45:0/1118956787 <== osd.4 v2:172.21.15.190:6808/1537591987 2 ==== osd_op_reply(6 200.00000002 [delete] v35'2 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55be0e9cefc0 con 0x55be0df00400 2023-11-28T18:39:03.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.737+0000 7f0b39327640 1 -- 172.21.15.45:0/1118956787 <== osd.3 v2:172.21.15.45:6824/78541084 4 ==== osd_op_reply(11 200.00000007 [delete] v35'4 uv2 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55be0e9ced80 con 0x55be0ea38000 2023-11-28T18:39:03.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.737+0000 7f0b3a329640 1 -- 172.21.15.45:0/1118956787 <== osd.4 v2:172.21.15.190:6808/1537591987 3 ==== osd_op_reply(9 200.00000005 [delete] v35'2 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55be0e9cefc0 con 0x55be0df00400 2023-11-28T18:39:03.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.737+0000 7f0b39327640 1 -- 172.21.15.45:0/1118956787 <== osd.6 v2:172.21.15.190:6816/2317686718 1 ==== osd_op_reply(8 200.00000004 [delete] v35'51 uv50 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55be0e9ced80 con 0x55be0df00c00 2023-11-28T18:39:03.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.737+0000 7f0b39b28640 1 -- 172.21.15.45:0/1118956787 <== osd.0 v2:172.21.15.45:6808/555237322 1 ==== osd_op_reply(10 200.00000006 [delete] v35'2 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55be0e9ceb40 con 0x55be0df00800 2023-11-28T18:39:03.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.737+0000 7f0b39b28640 1 -- 172.21.15.45:0/1118956787 <== osd.0 v2:172.21.15.45:6808/555237322 2 ==== osd_op_reply(7 200.00000003 [delete] v35'4 uv1 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55be0e9ceb40 con 0x55be0df00800 2023-11-28T18:39:03.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.737+0000 7f0b2f313640 1 -- 172.21.15.45:0/1118956787 --> [v2:172.21.15.190:6808/1537591987,v1:172.21.15.190:6809/1537591987] -- osd_op(unknown.0.0:12 4.1b 4:ddb4e4d7:::200.00000002:head [write 0~48 in=48b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) v8 -- 0x55be0df0ae00 con 0x55be0df00400 2023-11-28T18:39:03.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.737+0000 7f0b3a329640 1 -- 172.21.15.45:0/1118956787 <== osd.4 v2:172.21.15.190:6808/1537591987 4 ==== osd_op_reply(12 200.00000002 [write 0~48] v35'3 uv3 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55be0e9cefc0 con 0x55be0df00400 2023-11-28T18:39:03.744 INFO:teuthology.orchestra.run.smithi045.stdout:done 2023-11-28T18:39:03.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.737+0000 7f0b3b367280 1 -- 172.21.15.45:0/1118956787 >> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] conn(0x55be0df00800 msgr2=0x55be0df0eb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:03.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.737+0000 7f0b3b367280 1 --2- 172.21.15.45:0/1118956787 >> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] conn(0x55be0df00800 0x55be0df0eb00 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:03.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.737+0000 7f0b3b367280 1 -- 172.21.15.45:0/1118956787 >> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] conn(0x55be0ea38400 msgr2=0x55be0df0e000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:03.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.737+0000 7f0b3b367280 1 --2- 172.21.15.45:0/1118956787 >> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] conn(0x55be0ea38400 0x55be0df0e000 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:03.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.737+0000 7f0b3b367280 1 -- 172.21.15.45:0/1118956787 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x55be0ea38000 msgr2=0x55be0df0e580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:03.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.737+0000 7f0b3b367280 1 --2- 172.21.15.45:0/1118956787 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x55be0ea38000 0x55be0df0e580 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:03.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.737+0000 7f0b3b367280 1 -- 172.21.15.45:0/1118956787 >> [v2:172.21.15.190:6808/1537591987,v1:172.21.15.190:6809/1537591987] conn(0x55be0df00400 msgr2=0x55be0df10680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:03.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.737+0000 7f0b3b367280 1 --2- 172.21.15.45:0/1118956787 >> [v2:172.21.15.190:6808/1537591987,v1:172.21.15.190:6809/1537591987] conn(0x55be0df00400 0x55be0df10680 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:03.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.737+0000 7f0b39327640 1 -- 172.21.15.45:0/1118956787 reap_dead start 2023-11-28T18:39:03.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.737+0000 7f0b3b367280 1 -- 172.21.15.45:0/1118956787 >> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] conn(0x55be0df00c00 msgr2=0x55be0df0f080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:03.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.737+0000 7f0b3b367280 1 --2- 172.21.15.45:0/1118956787 >> [v2:172.21.15.190:6816/2317686718,v1:172.21.15.190:6817/2317686718] conn(0x55be0df00c00 0x55be0df0f080 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:03.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.737+0000 7f0b3b367280 1 -- 172.21.15.45:0/1118956787 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55be0ea39000 msgr2=0x55be0db36100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:03.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.737+0000 7f0b3b367280 1 --2- 172.21.15.45:0/1118956787 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55be0ea39000 0x55be0db36100 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x55be0e941110 tx=0x55be0e847c80 comp rx=0 tx=0).stop 2023-11-28T18:39:03.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.737+0000 7f0b39327640 1 -- 172.21.15.45:0/1118956787 reap_dead start 2023-11-28T18:39:03.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.737+0000 7f0b3b367280 1 -- 172.21.15.45:0/1118956787 shutdown_connections 2023-11-28T18:39:03.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.737+0000 7f0b3b367280 1 -- 172.21.15.45:0/1118956787 >> 172.21.15.45:0/1118956787 conn(0x55be0ea39400 msgr2=0x55be0dedc000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:03.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.737+0000 7f0b3b367280 1 -- 172.21.15.45:0/1118956787 shutdown_connections 2023-11-28T18:39:03.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.737+0000 7f0b3b367280 1 -- 172.21.15.45:0/1118956787 wait complete. 2023-11-28T18:39:03.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.741+0000 7f0b3b367280 1 -- 172.21.15.45:0/1862917057 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x55be0ea3a800 msgr2=0x55be0db37700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:03.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.741+0000 7f0b3b367280 1 --2- 172.21.15.45:0/1862917057 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x55be0ea3a800 0x55be0db37700 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x55be0e884030 tx=0x55be0ea46240 comp rx=0 tx=0).stop 2023-11-28T18:39:03.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.741+0000 7f0b3b367280 1 -- 172.21.15.45:0/1862917057 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55be0e8a5800 msgr2=0x55be0db36c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:03.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.741+0000 7f0b3b367280 1 --2- 172.21.15.45:0/1862917057 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55be0e8a5800 0x55be0db36c00 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x55be0ea3f380 tx=0x55be0e851560 comp rx=0 tx=0).stop 2023-11-28T18:39:03.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.741+0000 7f0b3b367280 1 -- 172.21.15.45:0/1862917057 shutdown_connections 2023-11-28T18:39:03.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.741+0000 7f0b3b367280 1 --2- 172.21.15.45:0/1862917057 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x55be0ea3a800 0x55be0db37700 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:03.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.741+0000 7f0b3b367280 1 --2- 172.21.15.45:0/1862917057 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55be0ea39800 0x55be0db36680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:03.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.741+0000 7f0b3b367280 1 --2- 172.21.15.45:0/1862917057 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55be0e8a5800 0x55be0db36c00 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:03.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.741+0000 7f0b3b367280 1 --2- 172.21.15.45:0/1862917057 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55be0e8a5c00 0x55be0db37180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:03.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.741+0000 7f0b3b367280 1 -- 172.21.15.45:0/1862917057 >> 172.21.15.45:0/1862917057 conn(0x55be0dac8c00 msgr2=0x55be0daf7800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:03.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.741+0000 7f0b3b367280 1 -- 172.21.15.45:0/1862917057 shutdown_connections 2023-11-28T18:39:03.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.741+0000 7f0b3b367280 1 -- 172.21.15.45:0/1862917057 wait complete. 2023-11-28T18:39:03.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.741+0000 7f0b3b367280 1 -- 172.21.15.45:0/699376246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55be0dac9000 msgr2=0x55be0db35080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:03.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.741+0000 7f0b3b367280 1 --2- 172.21.15.45:0/699376246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55be0dac9000 0x55be0db35080 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x55be0e940cf0 tx=0x55be0e847f80 comp rx=0 tx=0).stop 2023-11-28T18:39:03.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.741+0000 7f0b3b367280 1 -- 172.21.15.45:0/699376246 shutdown_connections 2023-11-28T18:39:03.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.741+0000 7f0b3b367280 1 --2- 172.21.15.45:0/699376246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55be0dac9000 0x55be0db35080 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:03.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.741+0000 7f0b3b367280 1 --2- 172.21.15.45:0/699376246 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55be0dac9400 0x55be0db34b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:03.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.741+0000 7f0b3b367280 1 --2- 172.21.15.45:0/699376246 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55be0dac9800 0x55be0db34580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:03.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.741+0000 7f0b3b367280 1 -- 172.21.15.45:0/699376246 >> 172.21.15.45:0/699376246 conn(0x55be0dac9c00 msgr2=0x55be0daf7000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:03.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.741+0000 7f0b3b367280 1 -- 172.21.15.45:0/699376246 shutdown_connections 2023-11-28T18:39:03.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.741+0000 7f0b3b367280 1 -- 172.21.15.45:0/699376246 wait complete. 2023-11-28T18:39:03.752 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'journal', 'reset'] in time 0:00:00.124893, result: old journal was 4194304~56199 new journal start will be 8388608 (4138105 bytes past old end) writing journal head writing EResetJournal entry done 2023-11-28T18:39:03.752 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2023-11-28T18:39:03.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.937+0000 7f5779aea640 1 Processor -- start 2023-11-28T18:39:03.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.937+0000 7f5779aea640 1 -- start start 2023-11-28T18:39:03.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.937+0000 7f5779aea640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5774071dd0 0x7f57740721b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:03.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.937+0000 7f5779aea640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f577413d2f0 con 0x7f577415adf0 2023-11-28T18:39:03.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.937+0000 7f5779aea640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57740cddb0 con 0x7f577413f630 2023-11-28T18:39:03.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.937+0000 7f5779aea640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5774140560 con 0x7f5774071dd0 2023-11-28T18:39:03.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.937+0000 7f5772ffd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f577415adf0 0x7f577413d5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:49946/0 (socket says 172.21.15.45:49946) 2023-11-28T18:39:03.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.937+0000 7f5772ffd640 1 -- 172.21.15.45:0/14806041 learned_addr learned my addr 172.21.15.45:0/14806041 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:39:03.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.937+0000 7f57737fe640 1 --2- 172.21.15.45:0/14806041 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5774071dd0 0x7f57740721b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:03.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.937+0000 7f57727fc640 1 -- 172.21.15.45:0/14806041 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4238929667 0 0) 0x7f577413d2f0 con 0x7f577415adf0 2023-11-28T18:39:03.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.937+0000 7f57727fc640 1 -- 172.21.15.45:0/14806041 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f575c003530 con 0x7f577415adf0 2023-11-28T18:39:03.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.937+0000 7f57737fe640 1 -- 172.21.15.45:0/14806041 >> v1:172.21.15.190:6789/0 conn(0x7f577413f630 legacy=0x7f57740ce240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:03.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.937+0000 7f57727fc640 1 -- 172.21.15.45:0/14806041 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3673433897 0 0) 0x7f57740cddb0 con 0x7f577413f630 2023-11-28T18:39:03.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.937+0000 7f57737fe640 1 -- 172.21.15.45:0/14806041 >> v1:172.21.15.45:6789/0 conn(0x7f577415adf0 legacy=0x7f577413d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:03.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.937+0000 7f57737fe640 1 -- 172.21.15.45:0/14806041 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57740726f0 con 0x7f5774071dd0 2023-11-28T18:39:03.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.941+0000 7f57737fe640 1 --2- 172.21.15.45:0/14806041 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5774071dd0 0x7f57740721b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f57640097f0 tx=0x7f576401c300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9bf20c8d706674e8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:03.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.941+0000 7f57727fc640 1 -- 172.21.15.45:0/14806041 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5768001600 con 0x7f5774071dd0 2023-11-28T18:39:03.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.941+0000 7f57727fc640 1 -- 172.21.15.45:0/14806041 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57640a7050 con 0x7f5774071dd0 2023-11-28T18:39:03.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.941+0000 7f57727fc640 1 -- 172.21.15.45:0/14806041 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57640ab620 con 0x7f5774071dd0 2023-11-28T18:39:03.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.941+0000 7f5779aea640 1 -- 172.21.15.45:0/14806041 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5774071dd0 msgr2=0x7f57740721b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:03.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.941+0000 7f5779aea640 1 --2- 172.21.15.45:0/14806041 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5774071dd0 0x7f57740721b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f57640097f0 tx=0x7f576401c300 comp rx=0 tx=0).stop 2023-11-28T18:39:03.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.941+0000 7f5779aea640 1 -- 172.21.15.45:0/14806041 shutdown_connections 2023-11-28T18:39:03.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.941+0000 7f5779aea640 1 --2- 172.21.15.45:0/14806041 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5774071dd0 0x7f57740721b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:03.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.941+0000 7f5779aea640 1 -- 172.21.15.45:0/14806041 >> 172.21.15.45:0/14806041 conn(0x7f57740b0d00 msgr2=0x7f57740b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:03.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.941+0000 7f5779aea640 1 -- 172.21.15.45:0/14806041 shutdown_connections 2023-11-28T18:39:03.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.941+0000 7f5779aea640 1 -- 172.21.15.45:0/14806041 wait complete. 2023-11-28T18:39:03.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.945+0000 7f5779aea640 1 Processor -- start 2023-11-28T18:39:03.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.945+0000 7f5779aea640 1 -- start start 2023-11-28T18:39:03.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.945+0000 7f5779aea640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5774071dd0 0x7f577415e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:03.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.945+0000 7f5779aea640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f577413f630 0x7f577412ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:03.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.945+0000 7f5779aea640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f577415adf0 0x7f57740b4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:03.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.945+0000 7f5779aea640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5774141880 con 0x7f5774071dd0 2023-11-28T18:39:03.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.945+0000 7f5779aea640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5774141ad0 con 0x7f577415adf0 2023-11-28T18:39:03.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.945+0000 7f5779aea640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5774141db0 con 0x7f577413f630 2023-11-28T18:39:03.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.945+0000 7f57737fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5774071dd0 0x7f577415e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:03.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.945+0000 7f57737fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5774071dd0 0x7f577415e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53820/0 (socket says 172.21.15.45:53820) 2023-11-28T18:39:03.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.945+0000 7f57737fe640 1 -- 172.21.15.45:0/1293238845 learned_addr learned my addr 172.21.15.45:0/1293238845 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:03.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.945+0000 7f5773fff640 1 --2- 172.21.15.45:0/1293238845 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f577415adf0 0x7f57740b4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:03.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.945+0000 7f5772ffd640 1 --2- 172.21.15.45:0/1293238845 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f577413f630 0x7f577412ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:03.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.945+0000 7f57737fe640 1 -- 172.21.15.45:0/1293238845 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f577413f630 msgr2=0x7f577412ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:03.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.945+0000 7f57737fe640 1 --2- 172.21.15.45:0/1293238845 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f577413f630 0x7f577412ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:03.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.945+0000 7f57737fe640 1 -- 172.21.15.45:0/1293238845 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f577415adf0 msgr2=0x7f57740b4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:03.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.945+0000 7f57737fe640 1 --2- 172.21.15.45:0/1293238845 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f577415adf0 0x7f57740b4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:03.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.945+0000 7f57737fe640 1 -- 172.21.15.45:0/1293238845 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5764009420 con 0x7f5774071dd0 2023-11-28T18:39:03.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.945+0000 7f57737fe640 1 --2- 172.21.15.45:0/1293238845 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5774071dd0 0x7f577415e440 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f57640ae040 tx=0x7f576401ab40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:03.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.945+0000 7f575bfff640 1 -- 172.21.15.45:0/1293238845 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57640abd80 con 0x7f5774071dd0 2023-11-28T18:39:03.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.945+0000 7f575bfff640 1 -- 172.21.15.45:0/1293238845 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5764004020 con 0x7f5774071dd0 2023-11-28T18:39:03.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.945+0000 7f5779aea640 1 -- 172.21.15.45:0/1293238845 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5774142090 con 0x7f5774071dd0 2023-11-28T18:39:03.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.945+0000 7f575bfff640 1 -- 172.21.15.45:0/1293238845 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57640043d0 con 0x7f5774071dd0 2023-11-28T18:39:03.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.945+0000 7f5779aea640 1 -- 172.21.15.45:0/1293238845 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5774142650 con 0x7f5774071dd0 2023-11-28T18:39:03.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.949+0000 7f5779aea640 1 -- 172.21.15.45:0/1293238845 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f577415b230 con 0x7f5774071dd0 2023-11-28T18:39:03.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.949+0000 7f575bfff640 1 -- 172.21.15.45:0/1293238845 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f5764003620 con 0x7f5774071dd0 2023-11-28T18:39:03.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.949+0000 7f575bfff640 1 --2- 172.21.15.45:0/1293238845 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f57600668d0 0x7f5760068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:03.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.949+0000 7f575bfff640 1 -- 172.21.15.45:0/1293238845 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f57640a4e40 con 0x7f5774071dd0 2023-11-28T18:39:03.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.949+0000 7f5772ffd640 1 --2- 172.21.15.45:0/1293238845 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f57600668d0 0x7f5760068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:03.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.949+0000 7f5772ffd640 1 --2- 172.21.15.45:0/1293238845 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f57600668d0 0x7f5760068d90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f5774165b80 tx=0x7f5768001b80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:03.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:03.953+0000 7f575bfff640 1 -- 172.21.15.45:0/1293238845 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f57640ebb50 con 0x7f5774071dd0 2023-11-28T18:39:04.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:04.145+0000 7f5779aea640 1 -- 172.21.15.45:0/1293238845 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7f5774069410 con 0x7f5774071dd0 2023-11-28T18:39:05.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.133+0000 7f575bfff640 1 -- 172.21.15.45:0/1293238845 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v19) v1 ==== 162+0+0 (secure 0 0 0) 0x7f57640ef170 con 0x7f5774071dd0 2023-11-28T18:39:05.137 INFO:teuthology.orchestra.run.smithi045.stderr:cephfs marked joinable; MDS may join as newly active. 2023-11-28T18:39:05.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.137+0000 7f5779aea640 1 -- 172.21.15.45:0/1293238845 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f57600668d0 msgr2=0x7f5760068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:05.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.137+0000 7f5779aea640 1 --2- 172.21.15.45:0/1293238845 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f57600668d0 0x7f5760068d90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f5774165b80 tx=0x7f5768001b80 comp rx=0 tx=0).stop 2023-11-28T18:39:05.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.137+0000 7f5779aea640 1 -- 172.21.15.45:0/1293238845 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5774071dd0 msgr2=0x7f577415e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:05.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.137+0000 7f5779aea640 1 --2- 172.21.15.45:0/1293238845 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5774071dd0 0x7f577415e440 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f57640ae040 tx=0x7f576401ab40 comp rx=0 tx=0).stop 2023-11-28T18:39:05.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.137+0000 7f5779aea640 1 -- 172.21.15.45:0/1293238845 shutdown_connections 2023-11-28T18:39:05.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.137+0000 7f5779aea640 1 --2- 172.21.15.45:0/1293238845 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f57600668d0 0x7f5760068d90 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:05.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.137+0000 7f5779aea640 1 --2- 172.21.15.45:0/1293238845 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f577415adf0 0x7f57740b4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:05.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.137+0000 7f5779aea640 1 --2- 172.21.15.45:0/1293238845 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f577413f630 0x7f577412ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:05.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.137+0000 7f5779aea640 1 --2- 172.21.15.45:0/1293238845 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5774071dd0 0x7f577415e440 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:05.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.137+0000 7f5779aea640 1 -- 172.21.15.45:0/1293238845 >> 172.21.15.45:0/1293238845 conn(0x7f57740b0d00 msgr2=0x7f57740710f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:05.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.137+0000 7f5779aea640 1 -- 172.21.15.45:0/1293238845 shutdown_connections 2023-11-28T18:39:05.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.137+0000 7f5779aea640 1 -- 172.21.15.45:0/1293238845 wait complete. 2023-11-28T18:39:05.167 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T18:39:05.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.313+0000 7fe30749c640 1 Processor -- start 2023-11-28T18:39:05.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.313+0000 7fe30749c640 1 -- start start 2023-11-28T18:39:05.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.313+0000 7fe30749c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe300144880 0x7fe30006c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:05.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.313+0000 7fe30749c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3000721c0 0x7fe30006c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:05.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.313+0000 7fe30749c640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe300071120 con 0x7fe3000704a0 2023-11-28T18:39:05.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.313+0000 7fe30749c640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe30015f050 con 0x7fe300144880 2023-11-28T18:39:05.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.313+0000 7fe30749c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe300071400 con 0x7fe3000721c0 2023-11-28T18:39:05.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.313+0000 7fe305238640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe300144880 0x7fe30006c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:05.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.313+0000 7fe305238640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe300144880 0x7fe30006c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53834/0 (socket says 172.21.15.45:53834) 2023-11-28T18:39:05.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.317+0000 7fe305238640 1 -- 172.21.15.45:0/2106524354 learned_addr learned my addr 172.21.15.45:0/2106524354 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:05.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.317+0000 7fe305a39640 1 --1- 172.21.15.45:0/2106524354 >> v1:172.21.15.45:6789/0 conn(0x7fe3000704a0 0x7fe300070920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:49958/0 (socket says 172.21.15.45:49958) 2023-11-28T18:39:05.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.317+0000 7fe304a37640 1 --2- 172.21.15.45:0/2106524354 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3000721c0 0x7fe30006c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:05.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.317+0000 7fe305238640 1 -- 172.21.15.45:0/2106524354 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3000721c0 msgr2=0x7fe30006c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:05.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.317+0000 7fe305238640 1 --2- 172.21.15.45:0/2106524354 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3000721c0 0x7fe30006c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:05.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.317+0000 7fe305238640 1 -- 172.21.15.45:0/2106524354 >> v1:172.21.15.45:6789/0 conn(0x7fe3000704a0 legacy=0x7fe300070920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:05.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.317+0000 7fe305238640 1 -- 172.21.15.45:0/2106524354 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3000716e0 con 0x7fe300144880 2023-11-28T18:39:05.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.317+0000 7fe304a37640 1 --2- 172.21.15.45:0/2106524354 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3000721c0 0x7fe30006c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:39:05.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.317+0000 7fe305238640 1 --2- 172.21.15.45:0/2106524354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe300144880 0x7fe30006c300 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc009870 tx=0x7fe2fc01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0c2e90f359cbd6d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:05.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.317+0000 7fe2f7fff640 1 -- 172.21.15.45:0/2106524354 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc0aa670 con 0x7fe300144880 2023-11-28T18:39:05.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.317+0000 7fe2f7fff640 1 -- 172.21.15.45:0/2106524354 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2fc0aa7d0 con 0x7fe300144880 2023-11-28T18:39:05.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.317+0000 7fe2f7fff640 1 -- 172.21.15.45:0/2106524354 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc0aab60 con 0x7fe300144880 2023-11-28T18:39:05.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.317+0000 7fe30749c640 1 -- 172.21.15.45:0/2106524354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe300144880 msgr2=0x7fe30006c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:05.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.317+0000 7fe30749c640 1 --2- 172.21.15.45:0/2106524354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe300144880 0x7fe30006c300 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc009870 tx=0x7fe2fc01c510 comp rx=0 tx=0).stop 2023-11-28T18:39:05.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.321+0000 7fe30749c640 1 -- 172.21.15.45:0/2106524354 shutdown_connections 2023-11-28T18:39:05.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.321+0000 7fe30749c640 1 --2- 172.21.15.45:0/2106524354 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3000721c0 0x7fe30006c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:05.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.321+0000 7fe30749c640 1 --2- 172.21.15.45:0/2106524354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe300144880 0x7fe30006c300 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:05.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.321+0000 7fe30749c640 1 -- 172.21.15.45:0/2106524354 >> 172.21.15.45:0/2106524354 conn(0x7fe30006a570 msgr2=0x7fe30006a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:05.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.321+0000 7fe30749c640 1 -- 172.21.15.45:0/2106524354 shutdown_connections 2023-11-28T18:39:05.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.321+0000 7fe30749c640 1 -- 172.21.15.45:0/2106524354 wait complete. 2023-11-28T18:39:05.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.321+0000 7fe30749c640 1 Processor -- start 2023-11-28T18:39:05.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.321+0000 7fe30749c640 1 -- start start 2023-11-28T18:39:05.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.321+0000 7fe30749c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3000704a0 0x7fe30013a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:05.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.321+0000 7fe30749c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3000721c0 0x7fe30015a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:05.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.321+0000 7fe30749c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe300144880 0x7fe30013d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:05.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.321+0000 7fe30749c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3000b23f0 con 0x7fe300144880 2023-11-28T18:39:05.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.321+0000 7fe30749c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe30013aac0 con 0x7fe3000704a0 2023-11-28T18:39:05.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.321+0000 7fe30749c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe30013ada0 con 0x7fe3000721c0 2023-11-28T18:39:05.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.321+0000 7fe305a39640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe300144880 0x7fe30013d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:05.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.321+0000 7fe305a39640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe300144880 0x7fe30013d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53848/0 (socket says 172.21.15.45:53848) 2023-11-28T18:39:05.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.321+0000 7fe305a39640 1 -- 172.21.15.45:0/2038044164 learned_addr learned my addr 172.21.15.45:0/2038044164 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:05.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.321+0000 7fe305238640 1 --2- 172.21.15.45:0/2038044164 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3000704a0 0x7fe30013a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:05.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.321+0000 7fe304a37640 1 --2- 172.21.15.45:0/2038044164 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3000721c0 0x7fe30015a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:05.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.321+0000 7fe305a39640 1 -- 172.21.15.45:0/2038044164 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3000721c0 msgr2=0x7fe30015a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:05.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.321+0000 7fe305a39640 1 --2- 172.21.15.45:0/2038044164 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3000721c0 0x7fe30015a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:05.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.321+0000 7fe305a39640 1 -- 172.21.15.45:0/2038044164 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3000704a0 msgr2=0x7fe30013a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:05.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.321+0000 7fe305a39640 1 --2- 172.21.15.45:0/2038044164 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3000704a0 0x7fe30013a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:05.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.321+0000 7fe305a39640 1 -- 172.21.15.45:0/2038044164 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2fc0094d0 con 0x7fe300144880 2023-11-28T18:39:05.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.321+0000 7fe305238640 1 --2- 172.21.15.45:0/2038044164 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3000704a0 0x7fe30013a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:39:05.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.321+0000 7fe304a37640 1 --2- 172.21.15.45:0/2038044164 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3000721c0 0x7fe30015a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:39:05.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.321+0000 7fe305a39640 1 --2- 172.21.15.45:0/2038044164 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe300144880 0x7fe30013d7f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fe2f800c7a0 tx=0x7fe2f800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:05.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.325+0000 7fe2f5ffb640 1 -- 172.21.15.45:0/2038044164 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f800a640 con 0x7fe300144880 2023-11-28T18:39:05.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.325+0000 7fe2f5ffb640 1 -- 172.21.15.45:0/2038044164 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2f800a7a0 con 0x7fe300144880 2023-11-28T18:39:05.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.325+0000 7fe2f5ffb640 1 -- 172.21.15.45:0/2038044164 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f800ab10 con 0x7fe300144880 2023-11-28T18:39:05.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.325+0000 7fe30749c640 1 -- 172.21.15.45:0/2038044164 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe30013b080 con 0x7fe300144880 2023-11-28T18:39:05.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.325+0000 7fe30749c640 1 -- 172.21.15.45:0/2038044164 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe30015a860 con 0x7fe300144880 2023-11-28T18:39:05.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.325+0000 7fe30749c640 1 -- 172.21.15.45:0/2038044164 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3000b2560 con 0x7fe300144880 2023-11-28T18:39:05.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.325+0000 7fe2f5ffb640 1 -- 172.21.15.45:0/2038044164 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe2f800ac70 con 0x7fe300144880 2023-11-28T18:39:05.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.325+0000 7fe2f5ffb640 1 --2- 172.21.15.45:0/2038044164 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe2e4066900 0x7fe2e4068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:05.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.325+0000 7fe2f5ffb640 1 -- 172.21.15.45:0/2038044164 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fe2f8083b40 con 0x7fe300144880 2023-11-28T18:39:05.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.325+0000 7fe305238640 1 --2- 172.21.15.45:0/2038044164 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe2e4066900 0x7fe2e4068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:05.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.329+0000 7fe305238640 1 --2- 172.21.15.45:0/2038044164 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe2e4066900 0x7fe2e4068dc0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc0ae000 tx=0x7fe2fc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:05.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.329+0000 7fe2f5ffb640 1 -- 172.21.15.45:0/2038044164 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe2f8050dc0 con 0x7fe300144880 2023-11-28T18:39:05.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.517+0000 7fe30749c640 1 -- 172.21.15.45:0/2038044164 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe300069480 con 0x7fe300144880 2023-11-28T18:39:05.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.521+0000 7fe2f5ffb640 1 -- 172.21.15.45:0/2038044164 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+4917 (secure 0 0 0) 0x7fe2f8017020 con 0x7fe300144880 2023-11-28T18:39:05.523 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:39:05.523 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5188,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/270858280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":270858280},{"type":"v1","addr":"172.21.15.190:6836","nonce":270858280}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5191,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/4006352118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":4006352118},{"type":"v1","addr":"172.21.15.190:6837","nonce":4006352118}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5197,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2204012451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":2204012451},{"type":"v1","addr":"172.21.15.45:6835","nonce":2204012451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T18:38:35.406884+0000","modified":"2023-11-28T18:39:05.139515+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5571},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5571":{"gid":5571,"name":"a","rank":0,"incarnation":20,"state":"up:replay","state_seq":1,"addr":"172.21.15.45:6834/1317650999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1317650999},{"type":"v1","addr":"172.21.15.45:6834","nonce":1317650999}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-28T18:39:05.523 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 20 2023-11-28T18:39:05.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.521+0000 7fe30749c640 1 -- 172.21.15.45:0/2038044164 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe2e4066900 msgr2=0x7fe2e4068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:05.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.521+0000 7fe30749c640 1 --2- 172.21.15.45:0/2038044164 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe2e4066900 0x7fe2e4068dc0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc0ae000 tx=0x7fe2fc008040 comp rx=0 tx=0).stop 2023-11-28T18:39:05.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.521+0000 7fe30749c640 1 -- 172.21.15.45:0/2038044164 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe300144880 msgr2=0x7fe30013d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:05.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.521+0000 7fe30749c640 1 --2- 172.21.15.45:0/2038044164 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe300144880 0x7fe30013d7f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fe2f800c7a0 tx=0x7fe2f800cc60 comp rx=0 tx=0).stop 2023-11-28T18:39:05.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.521+0000 7fe30749c640 1 -- 172.21.15.45:0/2038044164 shutdown_connections 2023-11-28T18:39:05.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.521+0000 7fe30749c640 1 --2- 172.21.15.45:0/2038044164 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe2e4066900 0x7fe2e4068dc0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:05.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.521+0000 7fe30749c640 1 --2- 172.21.15.45:0/2038044164 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe300144880 0x7fe30013d7f0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:05.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.521+0000 7fe30749c640 1 --2- 172.21.15.45:0/2038044164 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3000721c0 0x7fe30015a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:05.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.521+0000 7fe30749c640 1 --2- 172.21.15.45:0/2038044164 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3000704a0 0x7fe30013a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:05.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.521+0000 7fe30749c640 1 -- 172.21.15.45:0/2038044164 >> 172.21.15.45:0/2038044164 conn(0x7fe30006a570 msgr2=0x7fe3001655f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:05.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.521+0000 7fe30749c640 1 -- 172.21.15.45:0/2038044164 shutdown_connections 2023-11-28T18:39:05.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:05.521+0000 7fe30749c640 1 -- 172.21.15.45:0/2038044164 wait complete. 2023-11-28T18:39:05.947 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 20, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-28T18:38:35.406884+0000', 'modified': '2023-11-28T18:39:05.139515+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 35, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5571}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5571': {'gid': 5571, 'name': 'a', 'rank': 0, 'incarnation': 20, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.45:6834/1317650999', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.45:6832', 'nonce': 1317650999}, {'type': 'v1', 'addr': '172.21.15.45:6834', 'nonce': 1317650999}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-28T18:39:05.947 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5571:up:replay 2023-11-28T18:39:06.948 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T18:39:07.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.101+0000 7f4a2459d640 1 Processor -- start 2023-11-28T18:39:07.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.101+0000 7f4a2459d640 1 -- start start 2023-11-28T18:39:07.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.101+0000 7f4a2459d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f4a1c0b35f0 0x7f4a1c0d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:07.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.101+0000 7f4a2459d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4a1c0b3cb0 0x7f4a1c15f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:07.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.101+0000 7f4a2459d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4a1c0cf7c0 0x7f4a1c0cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:07.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.101+0000 7f4a2459d640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a1c0d40d0 con 0x7f4a1c0b3cb0 2023-11-28T18:39:07.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.101+0000 7f4a2459d640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a1c0d0150 con 0x7f4a1c0b35f0 2023-11-28T18:39:07.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.101+0000 7f4a2459d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1c0d38c0 con 0x7f4a1c0cf7c0 2023-11-28T18:39:07.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.101+0000 7f4a21b38640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4a1c0b3cb0 0x7f4a1c15f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:07.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.101+0000 7f4a21b38640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4a1c0b3cb0 0x7f4a1c15f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53856/0 (socket says 172.21.15.45:53856) 2023-11-28T18:39:07.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.101+0000 7f4a21b38640 1 -- 172.21.15.45:0/2298624804 learned_addr learned my addr 172.21.15.45:0/2298624804 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:07.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.101+0000 7f4a22339640 1 --2- 172.21.15.45:0/2298624804 >> v2:172.21.15.190:3300/0 conn(0x7f4a1c0b35f0 0x7f4a1c0d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:07.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.101+0000 7f4a22b3a640 1 --2- 172.21.15.45:0/2298624804 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4a1c0cf7c0 0x7f4a1c0cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:07.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.101+0000 7f4a21b38640 1 -- 172.21.15.45:0/2298624804 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4a1c0cf7c0 msgr2=0x7f4a1c0cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:07.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.101+0000 7f4a21b38640 1 --2- 172.21.15.45:0/2298624804 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4a1c0cf7c0 0x7f4a1c0cfc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:07.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.101+0000 7f4a21b38640 1 -- 172.21.15.45:0/2298624804 >> v2:172.21.15.190:3300/0 conn(0x7f4a1c0b35f0 msgr2=0x7f4a1c0d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:07.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.101+0000 7f4a21b38640 1 --2- 172.21.15.45:0/2298624804 >> v2:172.21.15.190:3300/0 conn(0x7f4a1c0b35f0 0x7f4a1c0d0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:07.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.101+0000 7f4a21b38640 1 -- 172.21.15.45:0/2298624804 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a1c0cdcc0 con 0x7f4a1c0b3cb0 2023-11-28T18:39:07.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.101+0000 7f4a22b3a640 1 --2- 172.21.15.45:0/2298624804 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4a1c0cf7c0 0x7f4a1c0cfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:39:07.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.105+0000 7f4a21b38640 1 --2- 172.21.15.45:0/2298624804 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a1c0b3cb0 0x7f4a1c15f0a0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c08ca20 tx=0x7f4a0c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cfe8cfc83bc52a8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:07.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.105+0000 7f4a21337640 1 -- 172.21.15.45:0/2298624804 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0c0aa620 con 0x7f4a1c0b3cb0 2023-11-28T18:39:07.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.105+0000 7f4a21337640 1 -- 172.21.15.45:0/2298624804 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a0c0aa780 con 0x7f4a1c0b3cb0 2023-11-28T18:39:07.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.105+0000 7f4a21337640 1 -- 172.21.15.45:0/2298624804 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0c0aab10 con 0x7f4a1c0b3cb0 2023-11-28T18:39:07.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.105+0000 7f4a2459d640 1 -- 172.21.15.45:0/2298624804 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a1c0b3cb0 msgr2=0x7f4a1c15f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:07.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.105+0000 7f4a2459d640 1 --2- 172.21.15.45:0/2298624804 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a1c0b3cb0 0x7f4a1c15f0a0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c08ca20 tx=0x7f4a0c01c500 comp rx=0 tx=0).stop 2023-11-28T18:39:07.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.105+0000 7f4a2459d640 1 -- 172.21.15.45:0/2298624804 shutdown_connections 2023-11-28T18:39:07.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.105+0000 7f4a2459d640 1 --2- 172.21.15.45:0/2298624804 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4a1c0cf7c0 0x7f4a1c0cfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:07.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.105+0000 7f4a2459d640 1 --2- 172.21.15.45:0/2298624804 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a1c0b3cb0 0x7f4a1c15f0a0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:07.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.105+0000 7f4a2459d640 1 --2- 172.21.15.45:0/2298624804 >> v2:172.21.15.190:3300/0 conn(0x7f4a1c0b35f0 0x7f4a1c0d0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:07.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.105+0000 7f4a2459d640 1 -- 172.21.15.45:0/2298624804 >> 172.21.15.45:0/2298624804 conn(0x7f4a1c09c4f0 msgr2=0x7f4a1c0d31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:07.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.105+0000 7f4a2459d640 1 -- 172.21.15.45:0/2298624804 shutdown_connections 2023-11-28T18:39:07.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.105+0000 7f4a2459d640 1 -- 172.21.15.45:0/2298624804 wait complete. 2023-11-28T18:39:07.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.109+0000 7f4a2459d640 1 Processor -- start 2023-11-28T18:39:07.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.109+0000 7f4a2459d640 1 -- start start 2023-11-28T18:39:07.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.109+0000 7f4a2459d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4a1c0b35f0 0x7f4a1c151590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:07.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.109+0000 7f4a2459d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4a1c0b3cb0 0x7f4a1c154e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:07.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.109+0000 7f4a2459d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a1c0cf7c0 0x7f4a1c14f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:07.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.109+0000 7f4a2459d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1c159180 con 0x7f4a1c0cf7c0 2023-11-28T18:39:07.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.109+0000 7f4a2459d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1c15c8a0 con 0x7f4a1c0b3cb0 2023-11-28T18:39:07.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.109+0000 7f4a2459d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1c152610 con 0x7f4a1c0b35f0 2023-11-28T18:39:07.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.109+0000 7f4a22b3a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a1c0cf7c0 0x7f4a1c14f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:07.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.109+0000 7f4a22b3a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a1c0cf7c0 0x7f4a1c14f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53870/0 (socket says 172.21.15.45:53870) 2023-11-28T18:39:07.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.109+0000 7f4a22b3a640 1 -- 172.21.15.45:0/3098841878 learned_addr learned my addr 172.21.15.45:0/3098841878 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:07.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.109+0000 7f4a21b38640 1 --2- 172.21.15.45:0/3098841878 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4a1c0b3cb0 0x7f4a1c154e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:07.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.109+0000 7f4a22339640 1 --2- 172.21.15.45:0/3098841878 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4a1c0b35f0 0x7f4a1c151590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:07.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.109+0000 7f4a22b3a640 1 -- 172.21.15.45:0/3098841878 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4a1c0b35f0 msgr2=0x7f4a1c151590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:07.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.109+0000 7f4a22b3a640 1 --2- 172.21.15.45:0/3098841878 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4a1c0b35f0 0x7f4a1c151590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:07.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.109+0000 7f4a22b3a640 1 -- 172.21.15.45:0/3098841878 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4a1c0b3cb0 msgr2=0x7f4a1c154e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:07.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.109+0000 7f4a22b3a640 1 --2- 172.21.15.45:0/3098841878 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4a1c0b3cb0 0x7f4a1c154e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:07.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.109+0000 7f4a22b3a640 1 -- 172.21.15.45:0/3098841878 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a0c0094d0 con 0x7f4a1c0cf7c0 2023-11-28T18:39:07.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.109+0000 7f4a22b3a640 1 --2- 172.21.15.45:0/3098841878 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a1c0cf7c0 0x7f4a1c14f410 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f4a14007d40 tx=0x7f4a1400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:07.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.109+0000 7f4a12ffd640 1 -- 172.21.15.45:0/3098841878 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a140039a0 con 0x7f4a1c0cf7c0 2023-11-28T18:39:07.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.109+0000 7f4a12ffd640 1 -- 172.21.15.45:0/3098841878 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a1400f040 con 0x7f4a1c0cf7c0 2023-11-28T18:39:07.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.109+0000 7f4a12ffd640 1 -- 172.21.15.45:0/3098841878 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a14003d40 con 0x7f4a1c0cf7c0 2023-11-28T18:39:07.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.109+0000 7f4a2459d640 1 -- 172.21.15.45:0/3098841878 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a1c0cd230 con 0x7f4a1c0cf7c0 2023-11-28T18:39:07.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.109+0000 7f4a2459d640 1 -- 172.21.15.45:0/3098841878 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a1c158da0 con 0x7f4a1c0cf7c0 2023-11-28T18:39:07.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.113+0000 7f4a2459d640 1 -- 172.21.15.45:0/3098841878 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a1c069480 con 0x7f4a1c0cf7c0 2023-11-28T18:39:07.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.113+0000 7f4a12ffd640 1 -- 172.21.15.45:0/3098841878 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f4a14004030 con 0x7f4a1c0cf7c0 2023-11-28T18:39:07.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.113+0000 7f4a12ffd640 1 --2- 172.21.15.45:0/3098841878 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4a000668d0 0x7f4a00068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:07.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.113+0000 7f4a12ffd640 1 -- 172.21.15.45:0/3098841878 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f4a14084650 con 0x7f4a1c0cf7c0 2023-11-28T18:39:07.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.113+0000 7f4a22339640 1 --2- 172.21.15.45:0/3098841878 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4a000668d0 0x7f4a00068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:07.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.113+0000 7f4a22339640 1 --2- 172.21.15.45:0/3098841878 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4a000668d0 0x7f4a00068d90 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c15aa90 tx=0x7f4a18008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:07.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.117+0000 7f4a12ffd640 1 -- 172.21.15.45:0/3098841878 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4a140518a0 con 0x7f4a1c0cf7c0 2023-11-28T18:39:07.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.309+0000 7f4a2459d640 1 -- 172.21.15.45:0/3098841878 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4a1c0d0760 con 0x7f4a1c0cf7c0 2023-11-28T18:39:07.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.309+0000 7f4a12ffd640 1 -- 172.21.15.45:0/3098841878 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4917 (secure 0 0 0) 0x7f4a14054ec0 con 0x7f4a1c0cf7c0 2023-11-28T18:39:07.314 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:39:07.314 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5188,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/270858280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":270858280},{"type":"v1","addr":"172.21.15.190:6836","nonce":270858280}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5191,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/4006352118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":4006352118},{"type":"v1","addr":"172.21.15.190:6837","nonce":4006352118}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5197,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2204012451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":2204012451},{"type":"v1","addr":"172.21.15.45:6835","nonce":2204012451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T18:38:35.406884+0000","modified":"2023-11-28T18:39:06.149158+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5571},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5571":{"gid":5571,"name":"a","rank":0,"incarnation":20,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.45:6834/1317650999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1317650999},{"type":"v1","addr":"172.21.15.45:6834","nonce":1317650999}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-28T18:39:07.314 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 22 2023-11-28T18:39:07.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.313+0000 7f4a2459d640 1 -- 172.21.15.45:0/3098841878 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4a000668d0 msgr2=0x7f4a00068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:07.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.313+0000 7f4a2459d640 1 --2- 172.21.15.45:0/3098841878 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4a000668d0 0x7f4a00068d90 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c15aa90 tx=0x7f4a18008040 comp rx=0 tx=0).stop 2023-11-28T18:39:07.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.313+0000 7f4a2459d640 1 -- 172.21.15.45:0/3098841878 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a1c0cf7c0 msgr2=0x7f4a1c14f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:07.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.313+0000 7f4a2459d640 1 --2- 172.21.15.45:0/3098841878 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a1c0cf7c0 0x7f4a1c14f410 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f4a14007d40 tx=0x7f4a1400d4a0 comp rx=0 tx=0).stop 2023-11-28T18:39:07.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.313+0000 7f4a2459d640 1 -- 172.21.15.45:0/3098841878 shutdown_connections 2023-11-28T18:39:07.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.313+0000 7f4a2459d640 1 --2- 172.21.15.45:0/3098841878 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4a000668d0 0x7f4a00068d90 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:07.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.313+0000 7f4a2459d640 1 --2- 172.21.15.45:0/3098841878 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a1c0cf7c0 0x7f4a1c14f410 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:07.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.313+0000 7f4a2459d640 1 --2- 172.21.15.45:0/3098841878 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4a1c0b3cb0 0x7f4a1c154e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:07.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.313+0000 7f4a2459d640 1 --2- 172.21.15.45:0/3098841878 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4a1c0b35f0 0x7f4a1c151590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:07.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.313+0000 7f4a2459d640 1 -- 172.21.15.45:0/3098841878 >> 172.21.15.45:0/3098841878 conn(0x7f4a1c09c4f0 msgr2=0x7f4a1c160240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:07.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.313+0000 7f4a2459d640 1 -- 172.21.15.45:0/3098841878 shutdown_connections 2023-11-28T18:39:07.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:07.313+0000 7f4a2459d640 1 -- 172.21.15.45:0/3098841878 wait complete. 2023-11-28T18:39:07.737 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 22, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-28T18:38:35.406884+0000', 'modified': '2023-11-28T18:39:06.149158+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 35, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5571}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5571': {'gid': 5571, 'name': 'a', 'rank': 0, 'incarnation': 20, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.45:6834/1317650999', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.45:6832', 'nonce': 1317650999}, {'type': 'v1', 'addr': '172.21.15.45:6834', 'nonce': 1317650999}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-28T18:39:07.738 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5571:up:rejoin 2023-11-28T18:39:08.738 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T18:39:08.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:08.889+0000 7fa066f2a640 1 Processor -- start 2023-11-28T18:39:08.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:08.889+0000 7fa066f2a640 1 -- start start 2023-11-28T18:39:08.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:08.889+0000 7fa066f2a640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa06015d3f0 0x7fa0600ad6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:08.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:08.889+0000 7fa066f2a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa0600af8f0 0x7fa0600b3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:08.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:08.893+0000 7fa066f2a640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0600adff0 con 0x7fa060072010 2023-11-28T18:39:08.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:08.893+0000 7fa066f2a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0600aeb70 con 0x7fa0600af8f0 2023-11-28T18:39:08.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:08.893+0000 7fa066f2a640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0600ae2d0 con 0x7fa06015d3f0 2023-11-28T18:39:08.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:08.893+0000 7fa05ffff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fa060072010 0x7fa0600af1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38900/0 (socket says 172.21.15.45:38900) 2023-11-28T18:39:08.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:08.893+0000 7fa05ffff640 1 -- 172.21.15.45:0/2663885106 learned_addr learned my addr 172.21.15.45:0/2663885106 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:39:08.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:08.893+0000 7fa0654c7640 1 --2- 172.21.15.45:0/2663885106 >> v2:172.21.15.45:3300/0 conn(0x7fa0600af8f0 0x7fa0600b3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:08.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:08.893+0000 7fa064cc6640 1 --2- 172.21.15.45:0/2663885106 >> v2:172.21.15.190:3300/0 conn(0x7fa06015d3f0 0x7fa0600ad6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:08.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:08.893+0000 7fa05f7fe640 1 -- 172.21.15.45:0/2663885106 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3438236806 0 0) 0x7fa0600adff0 con 0x7fa060072010 2023-11-28T18:39:08.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:08.893+0000 7fa05f7fe640 1 -- 172.21.15.45:0/2663885106 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa050003530 con 0x7fa060072010 2023-11-28T18:39:08.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:08.893+0000 7fa0654c7640 1 -- 172.21.15.45:0/2663885106 >> v2:172.21.15.190:3300/0 conn(0x7fa06015d3f0 msgr2=0x7fa0600ad6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:08.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:08.893+0000 7fa0654c7640 1 --2- 172.21.15.45:0/2663885106 >> v2:172.21.15.190:3300/0 conn(0x7fa06015d3f0 0x7fa0600ad6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:08.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:08.893+0000 7fa0654c7640 1 -- 172.21.15.45:0/2663885106 >> v1:172.21.15.45:6789/0 conn(0x7fa060072010 legacy=0x7fa0600af1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:08.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:08.893+0000 7fa0654c7640 1 -- 172.21.15.45:0/2663885106 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0600ae5b0 con 0x7fa0600af8f0 2023-11-28T18:39:08.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:08.893+0000 7fa0654c7640 1 --2- 172.21.15.45:0/2663885106 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0600af8f0 0x7fa0600b3500 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fa06006b150 tx=0x7fa05801f0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f6def7d77562d6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:08.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:08.893+0000 7fa05f7fe640 1 -- 172.21.15.45:0/2663885106 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0580b0440 con 0x7fa0600af8f0 2023-11-28T18:39:08.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:08.893+0000 7fa05f7fe640 1 -- 172.21.15.45:0/2663885106 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0580b05a0 con 0x7fa0600af8f0 2023-11-28T18:39:08.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:08.893+0000 7fa05f7fe640 1 -- 172.21.15.45:0/2663885106 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0580b0930 con 0x7fa0600af8f0 2023-11-28T18:39:08.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:08.897+0000 7fa066f2a640 1 -- 172.21.15.45:0/2663885106 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0600af8f0 msgr2=0x7fa0600b3500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:08.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:08.897+0000 7fa066f2a640 1 --2- 172.21.15.45:0/2663885106 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0600af8f0 0x7fa0600b3500 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fa06006b150 tx=0x7fa05801f0f0 comp rx=0 tx=0).stop 2023-11-28T18:39:08.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:08.897+0000 7fa066f2a640 1 -- 172.21.15.45:0/2663885106 shutdown_connections 2023-11-28T18:39:08.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:08.897+0000 7fa066f2a640 1 --2- 172.21.15.45:0/2663885106 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0600af8f0 0x7fa0600b3500 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:08.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:08.897+0000 7fa066f2a640 1 --2- 172.21.15.45:0/2663885106 >> v2:172.21.15.190:3300/0 conn(0x7fa06015d3f0 0x7fa0600ad6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:08.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:08.897+0000 7fa066f2a640 1 -- 172.21.15.45:0/2663885106 >> 172.21.15.45:0/2663885106 conn(0x7fa06006b680 msgr2=0x7fa06006ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:08.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:08.897+0000 7fa066f2a640 1 -- 172.21.15.45:0/2663885106 shutdown_connections 2023-11-28T18:39:08.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:08.897+0000 7fa066f2a640 1 -- 172.21.15.45:0/2663885106 wait complete. 2023-11-28T18:39:08.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:08.897+0000 7fa066f2a640 1 Processor -- start 2023-11-28T18:39:08.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:08.897+0000 7fa066f2a640 1 -- start start 2023-11-28T18:39:08.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:08.897+0000 7fa066f2a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa060072010 0x7fa0601418e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:08.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:08.897+0000 7fa066f2a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa0600af8f0 0x7fa06013e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:08.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:08.897+0000 7fa066f2a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa06015d3f0 0x7fa060154de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:08.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:08.897+0000 7fa066f2a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0601f2930 con 0x7fa06015d3f0 2023-11-28T18:39:08.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:08.897+0000 7fa066f2a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa06013ea20 con 0x7fa0600af8f0 2023-11-28T18:39:08.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:08.897+0000 7fa066f2a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0600b1710 con 0x7fa060072010 2023-11-28T18:39:08.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:08.897+0000 7fa0654c7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa06015d3f0 0x7fa060154de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:08.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:08.897+0000 7fa0654c7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa06015d3f0 0x7fa060154de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42942/0 (socket says 172.21.15.45:42942) 2023-11-28T18:39:08.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:08.897+0000 7fa0654c7640 1 -- 172.21.15.45:0/3102911305 learned_addr learned my addr 172.21.15.45:0/3102911305 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:08.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:08.901+0000 7fa05ffff640 1 --2- 172.21.15.45:0/3102911305 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa0600af8f0 0x7fa06013e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:08.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:08.901+0000 7fa064cc6640 1 --2- 172.21.15.45:0/3102911305 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa060072010 0x7fa0601418e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:08.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:08.901+0000 7fa0654c7640 1 -- 172.21.15.45:0/3102911305 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa060072010 msgr2=0x7fa0601418e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:08.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:08.901+0000 7fa0654c7640 1 --2- 172.21.15.45:0/3102911305 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa060072010 0x7fa0601418e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:08.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:08.901+0000 7fa0654c7640 1 -- 172.21.15.45:0/3102911305 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa0600af8f0 msgr2=0x7fa06013e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:08.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:08.901+0000 7fa0654c7640 1 --2- 172.21.15.45:0/3102911305 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa0600af8f0 0x7fa06013e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:08.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:08.901+0000 7fa0654c7640 1 -- 172.21.15.45:0/3102911305 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa058009a70 con 0x7fa06015d3f0 2023-11-28T18:39:08.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:08.901+0000 7fa0654c7640 1 --2- 172.21.15.45:0/3102911305 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa06015d3f0 0x7fa060154de0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fa05801bd00 tx=0x7fa05801be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:08.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:08.901+0000 7fa05d7fa640 1 -- 172.21.15.45:0/3102911305 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0580b0440 con 0x7fa06015d3f0 2023-11-28T18:39:08.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:08.901+0000 7fa05d7fa640 1 -- 172.21.15.45:0/3102911305 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0580bc860 con 0x7fa06015d3f0 2023-11-28T18:39:08.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:08.901+0000 7fa05d7fa640 1 -- 172.21.15.45:0/3102911305 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0580bcc10 con 0x7fa06015d3f0 2023-11-28T18:39:08.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:08.901+0000 7fa066f2a640 1 -- 172.21.15.45:0/3102911305 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa060155320 con 0x7fa06015d3f0 2023-11-28T18:39:08.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:08.901+0000 7fa066f2a640 1 -- 172.21.15.45:0/3102911305 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0600b0de0 con 0x7fa06015d3f0 2023-11-28T18:39:08.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:08.901+0000 7fa066f2a640 1 -- 172.21.15.45:0/3102911305 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa060069480 con 0x7fa06015d3f0 2023-11-28T18:39:08.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:08.901+0000 7fa05d7fa640 1 -- 172.21.15.45:0/3102911305 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa0580c7460 con 0x7fa06015d3f0 2023-11-28T18:39:08.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:08.901+0000 7fa05d7fa640 1 --2- 172.21.15.45:0/3102911305 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa0440668d0 0x7fa044068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:08.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:08.901+0000 7fa05d7fa640 1 -- 172.21.15.45:0/3102911305 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fa0581231a0 con 0x7fa06015d3f0 2023-11-28T18:39:08.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:08.905+0000 7fa064cc6640 1 --2- 172.21.15.45:0/3102911305 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa0440668d0 0x7fa044068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:08.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:08.905+0000 7fa064cc6640 1 --2- 172.21.15.45:0/3102911305 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa0440668d0 0x7fa044068d90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa05400b930 tx=0x7fa054008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:08.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:08.905+0000 7fa05d7fa640 1 -- 172.21.15.45:0/3102911305 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa0580f3f20 con 0x7fa06015d3f0 2023-11-28T18:39:09.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.097+0000 7fa066f2a640 1 -- 172.21.15.45:0/3102911305 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa0600b1850 con 0x7fa06015d3f0 2023-11-28T18:39:09.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.097+0000 7fa05d7fa640 1 -- 172.21.15.45:0/3102911305 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4917 (secure 0 0 0) 0x7fa058009450 con 0x7fa06015d3f0 2023-11-28T18:39:09.099 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:39:09.100 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":23,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5188,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/270858280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":270858280},{"type":"v1","addr":"172.21.15.190:6836","nonce":270858280}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5191,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/4006352118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":4006352118},{"type":"v1","addr":"172.21.15.190:6837","nonce":4006352118}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5197,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2204012451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":2204012451},{"type":"v1","addr":"172.21.15.45:6835","nonce":2204012451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T18:38:35.406884+0000","modified":"2023-11-28T18:39:07.155879+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5571},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5571":{"gid":5571,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":4,"addr":"172.21.15.45:6834/1317650999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1317650999},{"type":"v1","addr":"172.21.15.45:6834","nonce":1317650999}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-28T18:39:09.100 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 23 2023-11-28T18:39:09.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.097+0000 7fa066f2a640 1 -- 172.21.15.45:0/3102911305 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa0440668d0 msgr2=0x7fa044068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:09.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.097+0000 7fa066f2a640 1 --2- 172.21.15.45:0/3102911305 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa0440668d0 0x7fa044068d90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa05400b930 tx=0x7fa054008040 comp rx=0 tx=0).stop 2023-11-28T18:39:09.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.097+0000 7fa066f2a640 1 -- 172.21.15.45:0/3102911305 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa06015d3f0 msgr2=0x7fa060154de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:09.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.097+0000 7fa066f2a640 1 --2- 172.21.15.45:0/3102911305 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa06015d3f0 0x7fa060154de0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fa05801bd00 tx=0x7fa05801be90 comp rx=0 tx=0).stop 2023-11-28T18:39:09.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.097+0000 7fa066f2a640 1 -- 172.21.15.45:0/3102911305 shutdown_connections 2023-11-28T18:39:09.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.097+0000 7fa066f2a640 1 --2- 172.21.15.45:0/3102911305 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa0440668d0 0x7fa044068d90 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:09.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.097+0000 7fa066f2a640 1 --2- 172.21.15.45:0/3102911305 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa06015d3f0 0x7fa060154de0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:09.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.097+0000 7fa066f2a640 1 --2- 172.21.15.45:0/3102911305 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa0600af8f0 0x7fa06013e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:09.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.097+0000 7fa066f2a640 1 --2- 172.21.15.45:0/3102911305 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa060072010 0x7fa0601418e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:09.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.097+0000 7fa066f2a640 1 -- 172.21.15.45:0/3102911305 >> 172.21.15.45:0/3102911305 conn(0x7fa06006b680 msgr2=0x7fa0600cf340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:09.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.097+0000 7fa066f2a640 1 -- 172.21.15.45:0/3102911305 shutdown_connections 2023-11-28T18:39:09.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.097+0000 7fa066f2a640 1 -- 172.21.15.45:0/3102911305 wait complete. 2023-11-28T18:39:09.523 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-28T18:38:35.406884+0000', 'modified': '2023-11-28T18:39:07.155879+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 35, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5571}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5571': {'gid': 5571, 'name': 'a', 'rank': 0, 'incarnation': 20, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.45:6834/1317650999', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.45:6832', 'nonce': 1317650999}, {'type': 'v1', 'addr': '172.21.15.45:6834', 'nonce': 1317650999}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-28T18:39:09.523 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-28T18:39:09.523 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-28T18:39:09.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.665+0000 7effd7079640 1 Processor -- start 2023-11-28T18:39:09.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.665+0000 7effd7079640 1 -- start start 2023-11-28T18:39:09.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.669+0000 7effd7079640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7effd006ca10 0x7effd0145290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:09.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.669+0000 7effd7079640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7effd015c0b0 0x7effd01457d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:09.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.669+0000 7effd7079640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effd0146000 con 0x7effd015bcd0 2023-11-28T18:39:09.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.669+0000 7effd7079640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effd01462e0 con 0x7effd015c0b0 2023-11-28T18:39:09.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.669+0000 7effd7079640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effd01465c0 con 0x7effd006ca10 2023-11-28T18:39:09.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.669+0000 7effd5616640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7effd015c0b0 0x7effd01457d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:09.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.669+0000 7effd5616640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7effd015c0b0 0x7effd01457d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42946/0 (socket says 172.21.15.45:42946) 2023-11-28T18:39:09.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.669+0000 7effd5616640 1 -- 172.21.15.45:0/2478379887 learned_addr learned my addr 172.21.15.45:0/2478379887 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:09.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.669+0000 7effcffff640 1 --2- 172.21.15.45:0/2478379887 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7effd006ca10 0x7effd0145290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:09.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.669+0000 7effd5616640 1 -- 172.21.15.45:0/2478379887 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7effd006ca10 msgr2=0x7effd0145290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:09.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.669+0000 7effd5616640 1 --2- 172.21.15.45:0/2478379887 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7effd006ca10 0x7effd0145290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:09.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.669+0000 7effd5616640 1 -- 172.21.15.45:0/2478379887 >> v1:172.21.15.190:6789/0 conn(0x7effd015bcd0 legacy=0x7effd006c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:09.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.669+0000 7effd5616640 1 -- 172.21.15.45:0/2478379887 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effd01468a0 con 0x7effd015c0b0 2023-11-28T18:39:09.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.673+0000 7effd5616640 1 --2- 172.21.15.45:0/2478379887 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effd015c0b0 0x7effd01457d0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7effc8009e50 tx=0x7effc801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a7279f8f98372d2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:09.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.673+0000 7effcf7fe640 1 -- 172.21.15.45:0/2478379887 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc80a57f0 con 0x7effd015c0b0 2023-11-28T18:39:09.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.673+0000 7effcf7fe640 1 -- 172.21.15.45:0/2478379887 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effc80a5950 con 0x7effd015c0b0 2023-11-28T18:39:09.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.673+0000 7effcf7fe640 1 -- 172.21.15.45:0/2478379887 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc80a5ce0 con 0x7effd015c0b0 2023-11-28T18:39:09.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.673+0000 7effd7079640 1 -- 172.21.15.45:0/2478379887 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effd015c0b0 msgr2=0x7effd01457d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:09.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.673+0000 7effd7079640 1 --2- 172.21.15.45:0/2478379887 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effd015c0b0 0x7effd01457d0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7effc8009e50 tx=0x7effc801c950 comp rx=0 tx=0).stop 2023-11-28T18:39:09.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.673+0000 7effd7079640 1 -- 172.21.15.45:0/2478379887 shutdown_connections 2023-11-28T18:39:09.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.673+0000 7effd7079640 1 --2- 172.21.15.45:0/2478379887 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effd015c0b0 0x7effd01457d0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:09.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.673+0000 7effd7079640 1 --2- 172.21.15.45:0/2478379887 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7effd006ca10 0x7effd0145290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:09.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.673+0000 7effd7079640 1 -- 172.21.15.45:0/2478379887 >> 172.21.15.45:0/2478379887 conn(0x7effd006a570 msgr2=0x7effd006a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:09.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.673+0000 7effd7079640 1 -- 172.21.15.45:0/2478379887 shutdown_connections 2023-11-28T18:39:09.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.673+0000 7effd7079640 1 -- 172.21.15.45:0/2478379887 wait complete. 2023-11-28T18:39:09.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.673+0000 7effd7079640 1 Processor -- start 2023-11-28T18:39:09.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.673+0000 7effd7079640 1 -- start start 2023-11-28T18:39:09.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.677+0000 7effd7079640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7effd006ca10 0x7effd0140d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:09.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.677+0000 7effd7079640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effd015bcd0 0x7effd0161e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:09.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.677+0000 7effd7079640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7effd015c0b0 0x7effd01580e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:09.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.677+0000 7effd7079640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd0162390 con 0x7effd015bcd0 2023-11-28T18:39:09.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.677+0000 7effd7079640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd0158620 con 0x7effd015c0b0 2023-11-28T18:39:09.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.677+0000 7effd7079640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effd013fd40 con 0x7effd006ca10 2023-11-28T18:39:09.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.677+0000 7effcffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effd015bcd0 0x7effd0161e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:09.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.677+0000 7effcffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effd015bcd0 0x7effd0161e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42954/0 (socket says 172.21.15.45:42954) 2023-11-28T18:39:09.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.677+0000 7effcffff640 1 -- 172.21.15.45:0/1035670855 learned_addr learned my addr 172.21.15.45:0/1035670855 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:09.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.677+0000 7effd4e15640 1 --2- 172.21.15.45:0/1035670855 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7effd006ca10 0x7effd0140d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:09.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.677+0000 7effd5616640 1 --2- 172.21.15.45:0/1035670855 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7effd015c0b0 0x7effd01580e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:09.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.677+0000 7effcffff640 1 -- 172.21.15.45:0/1035670855 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7effd006ca10 msgr2=0x7effd0140d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:09.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.677+0000 7effcffff640 1 --2- 172.21.15.45:0/1035670855 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7effd006ca10 0x7effd0140d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:09.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.677+0000 7effcffff640 1 -- 172.21.15.45:0/1035670855 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7effd015c0b0 msgr2=0x7effd01580e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:09.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.677+0000 7effcffff640 1 --2- 172.21.15.45:0/1035670855 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7effd015c0b0 0x7effd01580e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:09.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.677+0000 7effcffff640 1 -- 172.21.15.45:0/1035670855 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc8009b30 con 0x7effd015bcd0 2023-11-28T18:39:09.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.677+0000 7effd5616640 1 --2- 172.21.15.45:0/1035670855 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7effd015c0b0 0x7effd01580e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:39:09.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.677+0000 7effcffff640 1 --2- 172.21.15.45:0/1035670855 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effd015bcd0 0x7effd0161e50 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7effbc00d800 tx=0x7effbc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:09.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.677+0000 7effcd7fa640 1 -- 172.21.15.45:0/1035670855 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effbc00b6c0 con 0x7effd015bcd0 2023-11-28T18:39:09.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.677+0000 7effcd7fa640 1 -- 172.21.15.45:0/1035670855 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effbc00b820 con 0x7effd015bcd0 2023-11-28T18:39:09.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.677+0000 7effd7079640 1 -- 172.21.15.45:0/1035670855 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effd01408c0 con 0x7effd015bcd0 2023-11-28T18:39:09.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.677+0000 7effcd7fa640 1 -- 172.21.15.45:0/1035670855 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effbc00bb90 con 0x7effd015bcd0 2023-11-28T18:39:09.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.677+0000 7effd7079640 1 -- 172.21.15.45:0/1035670855 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effd0140270 con 0x7effd015bcd0 2023-11-28T18:39:09.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.681+0000 7effcd7fa640 1 -- 172.21.15.45:0/1035670855 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7effbc00bcf0 con 0x7effd015bcd0 2023-11-28T18:39:09.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.681+0000 7effcd7fa640 1 --2- 172.21.15.45:0/1035670855 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7effb40668d0 0x7effb4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:09.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.681+0000 7effcd7fa640 1 -- 172.21.15.45:0/1035670855 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7effbc0849c0 con 0x7effd015bcd0 2023-11-28T18:39:09.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.681+0000 7effda3e6000 1 Processor -- start 2023-11-28T18:39:09.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.681+0000 7effd4e15640 1 --2- 172.21.15.45:0/1035670855 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7effb40668d0 0x7effb4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:09.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.681+0000 7effda3e6000 1 -- start start 2023-11-28T18:39:09.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.681+0000 7effd4e15640 1 --2- 172.21.15.45:0/1035670855 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7effb40668d0 0x7effb4068d90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7effd015a5c0 tx=0x7effc4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:09.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.681+0000 7effda3e6000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563065c5fd30 0x563065c60110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:09.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.681+0000 7effda3e6000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563065c60650 0x563065c12fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:09.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.681+0000 7effda3e6000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563065c13500 0x563065c138e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:09.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.681+0000 7effda3e6000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x563065adc110 con 0x563065c13500 2023-11-28T18:39:09.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.681+0000 7effda3e6000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x563065a6c9a0 con 0x563065c60650 2023-11-28T18:39:09.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.681+0000 7effda3e6000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x563065a69ed0 con 0x563065c5fd30 2023-11-28T18:39:09.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.681+0000 7effd5616640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563065c13500 0x563065c138e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:09.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.681+0000 7effd5616640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563065c13500 0x563065c138e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42964/0 (socket says 172.21.15.45:42964) 2023-11-28T18:39:09.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.681+0000 7effd5616640 1 -- 172.21.15.45:0/1770851995 learned_addr learned my addr 172.21.15.45:0/1770851995 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:09.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.681+0000 7effcffff640 1 --2- 172.21.15.45:0/1770851995 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563065c60650 0x563065c12fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:09.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.681+0000 7effd4e15640 1 --2- 172.21.15.45:0/1770851995 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563065c5fd30 0x563065c60110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:09.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.685+0000 7effd5616640 1 -- 172.21.15.45:0/1770851995 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563065c5fd30 msgr2=0x563065c60110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:09.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.685+0000 7effd5616640 1 --2- 172.21.15.45:0/1770851995 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563065c5fd30 0x563065c60110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:09.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.685+0000 7effd5616640 1 -- 172.21.15.45:0/1770851995 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563065c60650 msgr2=0x563065c12fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:09.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.685+0000 7effd5616640 1 --2- 172.21.15.45:0/1770851995 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563065c60650 0x563065c12fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:09.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.685+0000 7effd5616640 1 -- 172.21.15.45:0/1770851995 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56306575d890 con 0x563065c13500 2023-11-28T18:39:09.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.685+0000 7effcffff640 1 --2- 172.21.15.45:0/1770851995 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563065c60650 0x563065c12fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:39:09.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.685+0000 7effd5616640 1 --2- 172.21.15.45:0/1770851995 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563065c13500 0x563065c138e0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7effc801a580 tx=0x7effc8004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1f863568ca4be3f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:09.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.685+0000 7effba7fc640 1 -- 172.21.15.45:0/1770851995 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc80a5ac0 con 0x563065c13500 2023-11-28T18:39:09.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.685+0000 7effba7fc640 1 -- 172.21.15.45:0/1770851995 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effc80a5c20 con 0x563065c13500 2023-11-28T18:39:09.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.685+0000 7effba7fc640 1 -- 172.21.15.45:0/1770851995 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc80b9470 con 0x563065c13500 2023-11-28T18:39:09.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.685+0000 7effda3e6000 1 -- 172.21.15.45:0/1770851995 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563065c13500 msgr2=0x563065c138e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:09.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.685+0000 7effda3e6000 1 --2- 172.21.15.45:0/1770851995 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563065c13500 0x563065c138e0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7effc801a580 tx=0x7effc8004ac0 comp rx=0 tx=0).stop 2023-11-28T18:39:09.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.685+0000 7effda3e6000 1 -- 172.21.15.45:0/1770851995 shutdown_connections 2023-11-28T18:39:09.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.685+0000 7effda3e6000 1 --2- 172.21.15.45:0/1770851995 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563065c13500 0x563065c138e0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:09.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.685+0000 7effda3e6000 1 --2- 172.21.15.45:0/1770851995 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563065c60650 0x563065c12fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:09.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.685+0000 7effda3e6000 1 --2- 172.21.15.45:0/1770851995 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563065c5fd30 0x563065c60110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:09.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.685+0000 7effda3e6000 1 -- 172.21.15.45:0/1770851995 >> 172.21.15.45:0/1770851995 conn(0x563065c408c0 msgr2=0x563065c42cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:09.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.685+0000 7effda3e6000 1 -- 172.21.15.45:0/1770851995 shutdown_connections 2023-11-28T18:39:09.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.685+0000 7effda3e6000 1 -- 172.21.15.45:0/1770851995 wait complete. 2023-11-28T18:39:09.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.685+0000 7effda3e6000 1 -- start start 2023-11-28T18:39:09.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.685+0000 7effda3e6000 1 Processor -- start 2023-11-28T18:39:09.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.685+0000 7effda3e6000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563065c13500 0x563065c19520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:09.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.685+0000 7effda3e6000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563065c5fd30 0x563065c19a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:09.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.685+0000 7effda3e6000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563065c60650 0x563065c19fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:09.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.685+0000 7effda3e6000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x563065a657c0 con 0x563065c13500 2023-11-28T18:39:09.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.685+0000 7effda3e6000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x563065a1dbf0 con 0x563065c5fd30 2023-11-28T18:39:09.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.685+0000 7effda3e6000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x563065a23a90 con 0x563065c60650 2023-11-28T18:39:09.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.685+0000 7effda3e6000 10 client.0 _ll_register_callbacks cb 0x563065c00e20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T18:39:09.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.685+0000 7effd4e15640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563065c13500 0x563065c19520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:09.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.685+0000 7effd4e15640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563065c13500 0x563065c19520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42970/0 (socket says 172.21.15.45:42970) 2023-11-28T18:39:09.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.685+0000 7effd4e15640 1 -- 172.21.15.45:0/1424249512 learned_addr learned my addr 172.21.15.45:0/1424249512 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:09.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.685+0000 7effd5616640 1 --2- 172.21.15.45:0/1424249512 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563065c60650 0x563065c19fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:09.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.685+0000 7effcffff640 1 --2- 172.21.15.45:0/1424249512 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563065c5fd30 0x563065c19a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:09.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.689+0000 7effd4e15640 1 -- 172.21.15.45:0/1424249512 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563065c60650 msgr2=0x563065c19fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:09.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.689+0000 7effd4e15640 1 --2- 172.21.15.45:0/1424249512 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563065c60650 0x563065c19fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:09.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.689+0000 7effd4e15640 1 -- 172.21.15.45:0/1424249512 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563065c5fd30 msgr2=0x563065c19a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:09.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.689+0000 7effd4e15640 1 --2- 172.21.15.45:0/1424249512 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563065c5fd30 0x563065c19a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:09.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.689+0000 7effd4e15640 1 -- 172.21.15.45:0/1424249512 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effd0140270 con 0x563065c13500 2023-11-28T18:39:09.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.689+0000 7effd4e15640 1 --2- 172.21.15.45:0/1424249512 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563065c13500 0x563065c19520 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7effc400ea60 tx=0x7effc4001130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db9f1a34e66a2416 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:09.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.689+0000 7effaf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-11-28T18:39:09.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.689+0000 7effaf7fe640 1 -- 172.21.15.45:0/1424249512 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc40054a0 con 0x563065c13500 2023-11-28T18:39:09.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.689+0000 7effaf7fe640 1 -- 172.21.15.45:0/1424249512 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7effc4003d90 con 0x563065c13500 2023-11-28T18:39:09.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.689+0000 7effda3e6000 1 -- 172.21.15.45:0/1424249512 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563065a27470 con 0x563065c13500 2023-11-28T18:39:09.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.689+0000 7effaf7fe640 1 -- 172.21.15.45:0/1424249512 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7effc4013420 con 0x563065c13500 2023-11-28T18:39:09.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.689+0000 7effda3e6000 10 client.5688 fetch_fsmap learned FSMap version 23 2023-11-28T18:39:09.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.689+0000 7effda3e6000 1 -- 172.21.15.45:0/1424249512 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x7effd01468a0 con 0x563065c13500 2023-11-28T18:39:09.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.689+0000 7effaf7fe640 1 -- 172.21.15.45:0/1424249512 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563065a27470 con 0x563065c13500 2023-11-28T18:39:09.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.689+0000 7effaf7fe640 1 -- 172.21.15.45:0/1424249512 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 23) v1 ==== 3294+0+0 (secure 0 0 0) 0x7effc4020070 con 0x563065c13500 2023-11-28T18:39:09.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.689+0000 7effda3e6000 10 client.5688 fetch_fsmap finished waiting for FSMap version 23 2023-11-28T18:39:09.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.689+0000 7effda3e6000 10 client.5688 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-28T18:39:09.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.689+0000 7effda3e6000 20 client.5688 populate_metadata read hostname 'smithi045' 2023-11-28T18:39:09.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.689+0000 7effda3e6000 1 --2- 172.21.15.45:0/1424249512 >> [v2:172.21.15.45:6832/1317650999,v1:172.21.15.45:6834/1317650999] conn(0x563065c1a9b0 0x563065c71ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:09.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.689+0000 7effda3e6000 4 client.5688 mds_command: new command op to 5571 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-28T18:39:09.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.689+0000 7effda3e6000 1 -- 172.21.15.45:0/1424249512 --> [v2:172.21.15.45:6832/1317650999,v1:172.21.15.45:6834/1317650999] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563065a2ab50 con 0x563065c1a9b0 2023-11-28T18:39:09.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.689+0000 7effcffff640 1 --2- 172.21.15.45:0/1424249512 >> [v2:172.21.15.45:6832/1317650999,v1:172.21.15.45:6834/1317650999] conn(0x563065c1a9b0 0x563065c71ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:09.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.689+0000 7effcffff640 1 --2- 172.21.15.45:0/1424249512 >> [v2:172.21.15.45:6832/1317650999,v1:172.21.15.45:6834/1317650999] conn(0x563065c1a9b0 0x563065c71ff0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60145ac5b056f863 server_cookie=d0b8f7897c2650d5 in_seq=0 out_seq=0 2023-11-28T18:39:09.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.689+0000 7effaf7fe640 10 client.5688 ms_handle_connect on v2:172.21.15.45:6832/1317650999 2023-11-28T18:39:09.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.689+0000 7effaf7fe640 1 -- 172.21.15.45:0/1424249512 <== mds.0 v2:172.21.15.45:6832/1317650999 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x563065a2ab50 con 0x563065c1a9b0 2023-11-28T18:39:09.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.689+0000 7effaf7fe640 10 client.5688 handle_command_reply: tid=0 2023-11-28T18:39:09.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.689+0000 7effda3e6000 1 client.5688 shutdown 2023-11-28T18:39:09.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.689+0000 7effda3e6000 1 -- 172.21.15.45:0/1424249512 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563065c13500 msgr2=0x563065c19520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:09.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.689+0000 7effda3e6000 1 --2- 172.21.15.45:0/1424249512 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563065c13500 0x563065c19520 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7effc400ea60 tx=0x7effc4001130 comp rx=0 tx=0).stop 2023-11-28T18:39:09.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.689+0000 7effda3e6000 1 -- 172.21.15.45:0/1424249512 shutdown_connections 2023-11-28T18:39:09.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.689+0000 7effda3e6000 1 --2- 172.21.15.45:0/1424249512 >> [v2:172.21.15.45:6832/1317650999,v1:172.21.15.45:6834/1317650999] conn(0x563065c1a9b0 0x563065c71ff0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:09.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.689+0000 7effda3e6000 1 --2- 172.21.15.45:0/1424249512 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563065c60650 0x563065c19fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:09.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.689+0000 7effda3e6000 1 --2- 172.21.15.45:0/1424249512 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563065c5fd30 0x563065c19a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:09.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.689+0000 7effda3e6000 1 --2- 172.21.15.45:0/1424249512 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563065c13500 0x563065c19520 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:09.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.689+0000 7effda3e6000 1 -- 172.21.15.45:0/1424249512 >> 172.21.15.45:0/1424249512 conn(0x563065c408c0 msgr2=0x563065c126b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:09.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.689+0000 7effaf7fe640 0 client.5688 ms_handle_reset on v2:172.21.15.45:6832/1317650999 2023-11-28T18:39:09.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.689+0000 7effda3e6000 1 -- 172.21.15.45:0/1424249512 shutdown_connections 2023-11-28T18:39:09.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.689+0000 7effda3e6000 1 -- 172.21.15.45:0/1424249512 wait complete. 2023-11-28T18:39:09.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.689+0000 7effda3e6000 20 client.5688 trim_cache size 0 max 16384 2023-11-28T18:39:09.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.705+0000 7effda3e6000 1 Processor -- start 2023-11-28T18:39:09.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.705+0000 7effda3e6000 1 -- start start 2023-11-28T18:39:09.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.709+0000 7effda3e6000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563065c13500 0x563065c3f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:09.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.709+0000 7effda3e6000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563065c5fd30 0x563065c3f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:09.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.709+0000 7effda3e6000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563065c60650 0x563065c71ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:09.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.709+0000 7effda3e6000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x56306571e940 con 0x563065c13500 2023-11-28T18:39:09.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.709+0000 7effda3e6000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x563065c76ce0 con 0x563065c5fd30 2023-11-28T18:39:09.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.709+0000 7effda3e6000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x563065a3ab70 con 0x563065c60650 2023-11-28T18:39:09.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.709+0000 7effd4e15640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563065c13500 0x563065c3f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:09.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.709+0000 7effd4e15640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563065c13500 0x563065c3f3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42986/0 (socket says 172.21.15.45:42986) 2023-11-28T18:39:09.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.709+0000 7effd4e15640 1 -- 172.21.15.45:0/4009882218 learned_addr learned my addr 172.21.15.45:0/4009882218 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:09.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.709+0000 7effd4e15640 1 -- 172.21.15.45:0/4009882218 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563065c60650 msgr2=0x563065c71ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:09.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.709+0000 7effd4e15640 1 --2- 172.21.15.45:0/4009882218 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563065c60650 0x563065c71ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:09.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.709+0000 7effd4e15640 1 -- 172.21.15.45:0/4009882218 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563065c5fd30 msgr2=0x563065c3f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:09.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.709+0000 7effd4e15640 1 --2- 172.21.15.45:0/4009882218 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563065c5fd30 0x563065c3f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:09.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.709+0000 7effd4e15640 1 -- 172.21.15.45:0/4009882218 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563065a26190 con 0x563065c13500 2023-11-28T18:39:09.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.709+0000 7effd4e15640 1 --2- 172.21.15.45:0/4009882218 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563065c13500 0x563065c3f3a0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7effc4005150 tx=0x7effc401d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbb321092bb2db18 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:09.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.709+0000 7effbaffd640 1 -- 172.21.15.45:0/4009882218 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc4013420 con 0x563065c13500 2023-11-28T18:39:09.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.709+0000 7effbaffd640 1 -- 172.21.15.45:0/4009882218 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effc4001c80 con 0x563065c13500 2023-11-28T18:39:09.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.709+0000 7effbaffd640 1 -- 172.21.15.45:0/4009882218 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc40039d0 con 0x563065c13500 2023-11-28T18:39:09.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.709+0000 7effda3e6000 1 -- 172.21.15.45:0/4009882218 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563065c13500 msgr2=0x563065c3f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:09.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.709+0000 7effda3e6000 1 --2- 172.21.15.45:0/4009882218 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563065c13500 0x563065c3f3a0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7effc4005150 tx=0x7effc401d000 comp rx=0 tx=0).stop 2023-11-28T18:39:09.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.709+0000 7effda3e6000 1 -- 172.21.15.45:0/4009882218 shutdown_connections 2023-11-28T18:39:09.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.709+0000 7effda3e6000 1 --2- 172.21.15.45:0/4009882218 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563065c60650 0x563065c71ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:09.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.709+0000 7effda3e6000 1 --2- 172.21.15.45:0/4009882218 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563065c5fd30 0x563065c3f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:09.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.709+0000 7effda3e6000 1 --2- 172.21.15.45:0/4009882218 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563065c13500 0x563065c3f3a0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:09.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.709+0000 7effda3e6000 1 -- 172.21.15.45:0/4009882218 >> 172.21.15.45:0/4009882218 conn(0x563065c408c0 msgr2=0x563065c11720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:09.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.709+0000 7effda3e6000 1 -- 172.21.15.45:0/4009882218 shutdown_connections 2023-11-28T18:39:09.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.709+0000 7effda3e6000 1 -- 172.21.15.45:0/4009882218 wait complete. 2023-11-28T18:39:09.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.709+0000 7effda3e6000 1 -- start start 2023-11-28T18:39:09.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.709+0000 7effda3e6000 1 Processor -- start 2023-11-28T18:39:09.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.709+0000 7effda3e6000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563065c13500 0x563065cc0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:09.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.709+0000 7effda3e6000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563065c5fd30 0x563065cc0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:09.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.709+0000 7effda3e6000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563065c60650 0x563065c7ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:09.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.709+0000 7effda3e6000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x563065a248f0 con 0x563065c13500 2023-11-28T18:39:09.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.709+0000 7effda3e6000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630659eca00 con 0x563065c5fd30 2023-11-28T18:39:09.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.709+0000 7effda3e6000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x563065c5fbe0 con 0x563065c60650 2023-11-28T18:39:09.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.713+0000 7effda3e6000 10 client.0 _ll_register_callbacks cb 0x563065adc060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T18:39:09.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.713+0000 7effd4e15640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563065c13500 0x563065cc0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:09.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.713+0000 7effd4e15640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563065c13500 0x563065cc0810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42998/0 (socket says 172.21.15.45:42998) 2023-11-28T18:39:09.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.713+0000 7effd4e15640 1 -- 172.21.15.45:0/1375534432 learned_addr learned my addr 172.21.15.45:0/1375534432 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:09.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.713+0000 7effd5616640 1 --2- 172.21.15.45:0/1375534432 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563065c60650 0x563065c7ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:09.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.713+0000 7effcffff640 1 --2- 172.21.15.45:0/1375534432 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563065c5fd30 0x563065cc0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:09.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.713+0000 7effd4e15640 1 -- 172.21.15.45:0/1375534432 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563065c60650 msgr2=0x563065c7ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:09.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.713+0000 7effd4e15640 1 --2- 172.21.15.45:0/1375534432 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563065c60650 0x563065c7ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:09.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.713+0000 7effd4e15640 1 -- 172.21.15.45:0/1375534432 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563065c5fd30 msgr2=0x563065cc0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:09.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.713+0000 7effd4e15640 1 --2- 172.21.15.45:0/1375534432 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563065c5fd30 0x563065cc0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:09.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.713+0000 7effd4e15640 1 -- 172.21.15.45:0/1375534432 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effd01468a0 con 0x563065c13500 2023-11-28T18:39:09.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.713+0000 7effcffff640 1 --2- 172.21.15.45:0/1375534432 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563065c5fd30 0x563065cc0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:39:09.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.713+0000 7effd4e15640 1 --2- 172.21.15.45:0/1375534432 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563065c13500 0x563065cc0810 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7effc4000f20 tx=0x7effc4013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a8a1f779a084009 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:09.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.713+0000 7effaf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-11-28T18:39:09.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.713+0000 7effaf7fe640 1 -- 172.21.15.45:0/1375534432 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc40039d0 con 0x563065c13500 2023-11-28T18:39:09.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.713+0000 7effaf7fe640 1 -- 172.21.15.45:0/1375534432 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7effc4003d90 con 0x563065c13500 2023-11-28T18:39:09.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.713+0000 7effda3e6000 1 -- 172.21.15.45:0/1375534432 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563065a64110 con 0x563065c13500 2023-11-28T18:39:09.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.713+0000 7effaf7fe640 1 -- 172.21.15.45:0/1375534432 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7effc4022450 con 0x563065c13500 2023-11-28T18:39:09.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.713+0000 7effda3e6000 10 client.5694 fetch_fsmap learned FSMap version 23 2023-11-28T18:39:09.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.713+0000 7effda3e6000 1 -- 172.21.15.45:0/1375534432 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x563065a0c490 con 0x563065c13500 2023-11-28T18:39:09.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.713+0000 7effaf7fe640 1 -- 172.21.15.45:0/1375534432 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563065a64110 con 0x563065c13500 2023-11-28T18:39:09.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.713+0000 7effaf7fe640 1 -- 172.21.15.45:0/1375534432 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 23) v1 ==== 3294+0+0 (secure 0 0 0) 0x7effc40225b0 con 0x563065c13500 2023-11-28T18:39:09.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.713+0000 7effda3e6000 10 client.5694 fetch_fsmap finished waiting for FSMap version 23 2023-11-28T18:39:09.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.713+0000 7effda3e6000 10 client.5694 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-28T18:39:09.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.713+0000 7effda3e6000 20 client.5694 populate_metadata read hostname 'smithi045' 2023-11-28T18:39:09.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.713+0000 7effda3e6000 1 --2- 172.21.15.45:0/1375534432 >> [v2:172.21.15.45:6832/1317650999,v1:172.21.15.45:6834/1317650999] conn(0x563065c7c430 0x563065c7c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:09.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.713+0000 7effda3e6000 4 client.5694 mds_command: new command op to 5571 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-28T18:39:09.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.713+0000 7effda3e6000 1 -- 172.21.15.45:0/1375534432 --> [v2:172.21.15.45:6832/1317650999,v1:172.21.15.45:6834/1317650999] -- command(tid 0: {"prefix": "status"}) v1 -- 0x563065a92650 con 0x563065c7c430 2023-11-28T18:39:09.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.713+0000 7effcffff640 1 --2- 172.21.15.45:0/1375534432 >> [v2:172.21.15.45:6832/1317650999,v1:172.21.15.45:6834/1317650999] conn(0x563065c7c430 0x563065c7c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:09.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.713+0000 7effcffff640 1 --2- 172.21.15.45:0/1375534432 >> [v2:172.21.15.45:6832/1317650999,v1:172.21.15.45:6834/1317650999] conn(0x563065c7c430 0x563065c7c810 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ab3334fcb10dd4b server_cookie=b7b151bd561862e4 in_seq=0 out_seq=0 2023-11-28T18:39:09.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.713+0000 7effaf7fe640 10 client.5694 ms_handle_connect on v2:172.21.15.45:6832/1317650999 2023-11-28T18:39:09.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.713+0000 7effaf7fe640 1 -- 172.21.15.45:0/1375534432 <== mds.0 v2:172.21.15.45:6832/1317650999 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x563065a92650 con 0x563065c7c430 2023-11-28T18:39:09.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.713+0000 7effaf7fe640 10 client.5694 handle_command_reply: tid=0 2023-11-28T18:39:09.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.713+0000 7effda3e6000 1 client.5694 shutdown 2023-11-28T18:39:09.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.713+0000 7effda3e6000 1 -- 172.21.15.45:0/1375534432 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563065c13500 msgr2=0x563065cc0810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:09.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.713+0000 7effda3e6000 1 --2- 172.21.15.45:0/1375534432 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563065c13500 0x563065cc0810 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7effc4000f20 tx=0x7effc4013000 comp rx=0 tx=0).stop 2023-11-28T18:39:09.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.713+0000 7effda3e6000 1 -- 172.21.15.45:0/1375534432 shutdown_connections 2023-11-28T18:39:09.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.713+0000 7effda3e6000 1 --2- 172.21.15.45:0/1375534432 >> [v2:172.21.15.45:6832/1317650999,v1:172.21.15.45:6834/1317650999] conn(0x563065c7c430 0x563065c7c810 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:09.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.713+0000 7effda3e6000 1 --2- 172.21.15.45:0/1375534432 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563065c60650 0x563065c7ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:09.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.713+0000 7effda3e6000 1 --2- 172.21.15.45:0/1375534432 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563065c5fd30 0x563065cc0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:09.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.713+0000 7effda3e6000 1 --2- 172.21.15.45:0/1375534432 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563065c13500 0x563065cc0810 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:09.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.713+0000 7effaf7fe640 0 client.5694 ms_handle_reset on v2:172.21.15.45:6832/1317650999 2023-11-28T18:39:09.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.713+0000 7effda3e6000 1 -- 172.21.15.45:0/1375534432 >> 172.21.15.45:0/1375534432 conn(0x563065c408c0 msgr2=0x563065c11fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:09.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.713+0000 7effda3e6000 1 -- 172.21.15.45:0/1375534432 shutdown_connections 2023-11-28T18:39:09.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.713+0000 7effda3e6000 1 -- 172.21.15.45:0/1375534432 wait complete. 2023-11-28T18:39:09.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.713+0000 7effda3e6000 20 client.5694 trim_cache size 0 max 16384 2023-11-28T18:39:09.725 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-11-28T18:39:09.725 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_fsid": "d10f5cd6-1d00-4019-99b6-6fa435498a15", 2023-11-28T18:39:09.725 INFO:teuthology.orchestra.run.smithi045.stdout: "whoami": 0, 2023-11-28T18:39:09.725 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 5571, 2023-11-28T18:39:09.725 INFO:teuthology.orchestra.run.smithi045.stdout: "want_state": "up:active", 2023-11-28T18:39:09.725 INFO:teuthology.orchestra.run.smithi045.stdout: "state": "up:active", 2023-11-28T18:39:09.725 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs", 2023-11-28T18:39:09.725 INFO:teuthology.orchestra.run.smithi045.stdout: "rank_uptime": 4.5750351690000004, 2023-11-28T18:39:09.725 INFO:teuthology.orchestra.run.smithi045.stdout: "mdsmap_epoch": 23, 2023-11-28T18:39:09.725 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch": 35, 2023-11-28T18:39:09.726 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch_barrier": 35, 2023-11-28T18:39:09.726 INFO:teuthology.orchestra.run.smithi045.stdout: "uptime": 6.8814145629999999 2023-11-28T18:39:09.726 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-11-28T18:39:09.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.717+0000 7effd7079640 1 -- 172.21.15.45:0/1035670855 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7effb40668d0 msgr2=0x7effb4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:09.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.717+0000 7effd7079640 1 --2- 172.21.15.45:0/1035670855 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7effb40668d0 0x7effb4068d90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7effd015a5c0 tx=0x7effc4009040 comp rx=0 tx=0).stop 2023-11-28T18:39:09.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.717+0000 7effd7079640 1 -- 172.21.15.45:0/1035670855 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effd015bcd0 msgr2=0x7effd0161e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:09.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.717+0000 7effd7079640 1 --2- 172.21.15.45:0/1035670855 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effd015bcd0 0x7effd0161e50 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7effbc00d800 tx=0x7effbc00dcc0 comp rx=0 tx=0).stop 2023-11-28T18:39:09.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.717+0000 7effd7079640 1 -- 172.21.15.45:0/1035670855 shutdown_connections 2023-11-28T18:39:09.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.717+0000 7effd7079640 1 --2- 172.21.15.45:0/1035670855 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7effb40668d0 0x7effb4068d90 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:09.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.717+0000 7effd7079640 1 --2- 172.21.15.45:0/1035670855 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7effd015c0b0 0x7effd01580e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:09.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.717+0000 7effd7079640 1 --2- 172.21.15.45:0/1035670855 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effd015bcd0 0x7effd0161e50 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:09.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.717+0000 7effd7079640 1 --2- 172.21.15.45:0/1035670855 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7effd006ca10 0x7effd0140d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:09.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.717+0000 7effd7079640 1 -- 172.21.15.45:0/1035670855 >> 172.21.15.45:0/1035670855 conn(0x7effd006a570 msgr2=0x7effd0071680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:09.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.717+0000 7effd7079640 1 -- 172.21.15.45:0/1035670855 shutdown_connections 2023-11-28T18:39:09.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.717+0000 7effd7079640 1 -- 172.21.15.45:0/1035670855 wait complete. 2023-11-28T18:39:09.738 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T18:39:09.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.877+0000 7fdac692a640 1 Processor -- start 2023-11-28T18:39:09.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.877+0000 7fdac692a640 1 -- start start 2023-11-28T18:39:09.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.881+0000 7fdac692a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdac015d3f0 0x7fdac00ad6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:09.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.881+0000 7fdac692a640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fdac0072010 0x7fdac00af1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:09.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.881+0000 7fdac692a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdac00af720 0x7fdac006d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:09.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.881+0000 7fdac692a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdac00aeb70 con 0x7fdac00af720 2023-11-28T18:39:09.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.881+0000 7fdac692a640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdac00afbb0 con 0x7fdac0072010 2023-11-28T18:39:09.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.881+0000 7fdac692a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdac00adff0 con 0x7fdac015d3f0 2023-11-28T18:39:09.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.881+0000 7fdac4ec7640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdac00af720 0x7fdac006d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:09.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.881+0000 7fdac4ec7640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdac00af720 0x7fdac006d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43000/0 (socket says 172.21.15.45:43000) 2023-11-28T18:39:09.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.881+0000 7fdac4ec7640 1 -- 172.21.15.45:0/2198515010 learned_addr learned my addr 172.21.15.45:0/2198515010 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:09.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.881+0000 7fdabf7fe640 1 --2- 172.21.15.45:0/2198515010 >> v2:172.21.15.190:3300/0 conn(0x7fdac0072010 0x7fdac00af1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:09.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.881+0000 7fdabffff640 1 --2- 172.21.15.45:0/2198515010 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdac015d3f0 0x7fdac00ad6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:09.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.881+0000 7fdac4ec7640 1 -- 172.21.15.45:0/2198515010 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdac015d3f0 msgr2=0x7fdac00ad6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:09.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.881+0000 7fdac4ec7640 1 --2- 172.21.15.45:0/2198515010 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdac015d3f0 0x7fdac00ad6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:09.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.881+0000 7fdac4ec7640 1 -- 172.21.15.45:0/2198515010 >> v2:172.21.15.190:3300/0 conn(0x7fdac0072010 msgr2=0x7fdac00af1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:09.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.881+0000 7fdac4ec7640 1 --2- 172.21.15.45:0/2198515010 >> v2:172.21.15.190:3300/0 conn(0x7fdac0072010 0x7fdac00af1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:09.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.881+0000 7fdac4ec7640 1 -- 172.21.15.45:0/2198515010 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac00ae2d0 con 0x7fdac00af720 2023-11-28T18:39:09.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.885+0000 7fdac4ec7640 1 --2- 172.21.15.45:0/2198515010 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdac00af720 0x7fdac006d530 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fdac006ca40 tx=0x7fdab801f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4504b3e8db6d4819 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:09.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.885+0000 7fdabeffd640 1 -- 172.21.15.45:0/2198515010 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab80af400 con 0x7fdac00af720 2023-11-28T18:39:09.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.885+0000 7fdabeffd640 1 -- 172.21.15.45:0/2198515010 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdab80ab050 con 0x7fdac00af720 2023-11-28T18:39:09.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.885+0000 7fdabeffd640 1 -- 172.21.15.45:0/2198515010 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab80af780 con 0x7fdac00af720 2023-11-28T18:39:09.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.885+0000 7fdac692a640 1 -- 172.21.15.45:0/2198515010 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdac00af720 msgr2=0x7fdac006d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:09.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.885+0000 7fdac692a640 1 --2- 172.21.15.45:0/2198515010 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdac00af720 0x7fdac006d530 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fdac006ca40 tx=0x7fdab801f1c0 comp rx=0 tx=0).stop 2023-11-28T18:39:09.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.885+0000 7fdac692a640 1 -- 172.21.15.45:0/2198515010 shutdown_connections 2023-11-28T18:39:09.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.885+0000 7fdac692a640 1 --2- 172.21.15.45:0/2198515010 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdac00af720 0x7fdac006d530 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:09.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.885+0000 7fdac692a640 1 --2- 172.21.15.45:0/2198515010 >> v2:172.21.15.190:3300/0 conn(0x7fdac0072010 0x7fdac00af1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:09.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.885+0000 7fdac692a640 1 --2- 172.21.15.45:0/2198515010 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdac015d3f0 0x7fdac00ad6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:09.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.885+0000 7fdac692a640 1 -- 172.21.15.45:0/2198515010 >> 172.21.15.45:0/2198515010 conn(0x7fdac006b680 msgr2=0x7fdac006ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:09.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.885+0000 7fdac692a640 1 -- 172.21.15.45:0/2198515010 shutdown_connections 2023-11-28T18:39:09.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.885+0000 7fdac692a640 1 -- 172.21.15.45:0/2198515010 wait complete. 2023-11-28T18:39:09.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.885+0000 7fdac692a640 1 Processor -- start 2023-11-28T18:39:09.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.885+0000 7fdac692a640 1 -- start start 2023-11-28T18:39:09.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.889+0000 7fdac692a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdac0072010 0x7fdac014af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:09.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.889+0000 7fdac692a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdac00af720 0x7fdac00b17a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:09.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.889+0000 7fdac692a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdac015d3f0 0x7fdac00c7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:09.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.889+0000 7fdac692a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac0147b20 con 0x7fdac00af720 2023-11-28T18:39:09.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.889+0000 7fdac692a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac0147e00 con 0x7fdac0072010 2023-11-28T18:39:09.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.889+0000 7fdac692a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdac01480e0 con 0x7fdac015d3f0 2023-11-28T18:39:09.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.889+0000 7fdabf7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdac00af720 0x7fdac00b17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:09.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.889+0000 7fdabf7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdac00af720 0x7fdac00b17a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43008/0 (socket says 172.21.15.45:43008) 2023-11-28T18:39:09.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.889+0000 7fdabf7fe640 1 -- 172.21.15.45:0/413239090 learned_addr learned my addr 172.21.15.45:0/413239090 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:09.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.889+0000 7fdac4ec7640 1 --2- 172.21.15.45:0/413239090 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdac015d3f0 0x7fdac00c7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:09.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.889+0000 7fdabffff640 1 --2- 172.21.15.45:0/413239090 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdac0072010 0x7fdac014af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:09.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.889+0000 7fdabf7fe640 1 -- 172.21.15.45:0/413239090 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdac015d3f0 msgr2=0x7fdac00c7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:09.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.889+0000 7fdabf7fe640 1 --2- 172.21.15.45:0/413239090 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdac015d3f0 0x7fdac00c7740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:09.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.889+0000 7fdabf7fe640 1 -- 172.21.15.45:0/413239090 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdac0072010 msgr2=0x7fdac014af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:09.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.889+0000 7fdabf7fe640 1 --2- 172.21.15.45:0/413239090 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdac0072010 0x7fdac014af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:09.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.889+0000 7fdabf7fe640 1 -- 172.21.15.45:0/413239090 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab8009b30 con 0x7fdac00af720 2023-11-28T18:39:09.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.889+0000 7fdabf7fe640 1 --2- 172.21.15.45:0/413239090 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdac00af720 0x7fdac00b17a0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fdab400d800 tx=0x7fdab400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:09.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.889+0000 7fdabcff9640 1 -- 172.21.15.45:0/413239090 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab40096a0 con 0x7fdac00af720 2023-11-28T18:39:09.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.889+0000 7fdabcff9640 1 -- 172.21.15.45:0/413239090 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdab4009800 con 0x7fdac00af720 2023-11-28T18:39:09.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.889+0000 7fdabcff9640 1 -- 172.21.15.45:0/413239090 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab4009b70 con 0x7fdac00af720 2023-11-28T18:39:09.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.889+0000 7fdac692a640 1 -- 172.21.15.45:0/413239090 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdac01483c0 con 0x7fdac00af720 2023-11-28T18:39:09.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.889+0000 7fdac692a640 1 -- 172.21.15.45:0/413239090 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdac00b1ce0 con 0x7fdac00af720 2023-11-28T18:39:09.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.889+0000 7fdac692a640 1 -- 172.21.15.45:0/413239090 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdac0072580 con 0x7fdac00af720 2023-11-28T18:39:09.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.889+0000 7fdabcff9640 1 -- 172.21.15.45:0/413239090 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fdab4009cd0 con 0x7fdac00af720 2023-11-28T18:39:09.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.893+0000 7fdabcff9640 1 --2- 172.21.15.45:0/413239090 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fdaac0668d0 0x7fdaac068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:09.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.893+0000 7fdabcff9640 1 -- 172.21.15.45:0/413239090 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fdab4084c10 con 0x7fdac00af720 2023-11-28T18:39:09.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.893+0000 7fdabffff640 1 --2- 172.21.15.45:0/413239090 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fdaac0668d0 0x7fdaac068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:09.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.893+0000 7fdabffff640 1 --2- 172.21.15.45:0/413239090 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fdaac0668d0 0x7fdaac068d90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fdab000b930 tx=0x7fdab0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:09.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:09.897+0000 7fdabcff9640 1 -- 172.21.15.45:0/413239090 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdab4051de0 con 0x7fdac00af720 2023-11-28T18:39:10.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:10.089+0000 7fdac692a640 1 -- 172.21.15.45:0/413239090 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fdac0069480 con 0x7fdac00af720 2023-11-28T18:39:10.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:10.089+0000 7fdabcff9640 1 -- 172.21.15.45:0/413239090 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v23) v1 ==== 53+0+73 (secure 0 0 0) 0x7fdab4055400 con 0x7fdac00af720 2023-11-28T18:39:10.092 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T18:39:10.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:10.089+0000 7fdac692a640 1 -- 172.21.15.45:0/413239090 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fdaac0668d0 msgr2=0x7fdaac068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:10.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:10.089+0000 7fdac692a640 1 --2- 172.21.15.45:0/413239090 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fdaac0668d0 0x7fdaac068d90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fdab000b930 tx=0x7fdab0008040 comp rx=0 tx=0).stop 2023-11-28T18:39:10.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:10.089+0000 7fdac692a640 1 -- 172.21.15.45:0/413239090 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdac00af720 msgr2=0x7fdac00b17a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:10.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:10.089+0000 7fdac692a640 1 --2- 172.21.15.45:0/413239090 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdac00af720 0x7fdac00b17a0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fdab400d800 tx=0x7fdab400dcc0 comp rx=0 tx=0).stop 2023-11-28T18:39:10.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:10.089+0000 7fdac692a640 1 -- 172.21.15.45:0/413239090 shutdown_connections 2023-11-28T18:39:10.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:10.089+0000 7fdac692a640 1 --2- 172.21.15.45:0/413239090 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fdaac0668d0 0x7fdaac068d90 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:10.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:10.089+0000 7fdac692a640 1 --2- 172.21.15.45:0/413239090 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdac015d3f0 0x7fdac00c7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:10.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:10.089+0000 7fdac692a640 1 --2- 172.21.15.45:0/413239090 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdac00af720 0x7fdac00b17a0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:10.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:10.089+0000 7fdac692a640 1 --2- 172.21.15.45:0/413239090 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdac0072010 0x7fdac014af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:10.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:10.089+0000 7fdac692a640 1 -- 172.21.15.45:0/413239090 >> 172.21.15.45:0/413239090 conn(0x7fdac006b680 msgr2=0x7fdac00cf340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:10.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:10.089+0000 7fdac692a640 1 -- 172.21.15.45:0/413239090 shutdown_connections 2023-11-28T18:39:10.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:10.089+0000 7fdac692a640 1 -- 172.21.15.45:0/413239090 wait complete. 2023-11-28T18:39:10.113 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-28T18:39:10.113 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T18:39:10.113 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi045.front.sepia.ceph.com 2023-11-28T18:39:10.113 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-28T18:39:10.113 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-28T18:39:10.113 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-28T18:39:10.114 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-28T18:39:10.114 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T18:39:10.114 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T18:39:10.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:39:10.114 DEBUG:teuthology.orchestra.run.smithi045:> ip addr 2023-11-28T18:39:10.124 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T18:39:10.124 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T18:39:10.125 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T18:39:10.125 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:39:10.125 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2023-11-28T18:39:10.125 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:39:10.125 INFO:teuthology.orchestra.run.smithi045.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T18:39:10.125 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a6 brd ff:ff:ff:ff:ff:ff 2023-11-28T18:39:10.125 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f0 2023-11-28T18:39:10.125 INFO:teuthology.orchestra.run.smithi045.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T18:39:10.125 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a7 brd ff:ff:ff:ff:ff:ff 2023-11-28T18:39:10.125 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f1 2023-11-28T18:39:10.125 INFO:teuthology.orchestra.run.smithi045.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T18:39:10.125 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:be brd ff:ff:ff:ff:ff:ff 2023-11-28T18:39:10.126 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f0 2023-11-28T18:39:10.126 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.21.15.45/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-11-28T18:39:10.126 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft 42308sec preferred_lft 42308sec 2023-11-28T18:39:10.126 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec4:7aff:febd:12be/64 scope link 2023-11-28T18:39:10.126 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:39:10.126 INFO:teuthology.orchestra.run.smithi045.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T18:39:10.126 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:bf brd ff:ff:ff:ff:ff:ff 2023-11-28T18:39:10.126 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f1 2023-11-28T18:39:10.126 INFO:teuthology.orchestra.run.smithi045.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T18:39:10.126 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 02:42:ab:69:35:3d brd ff:ff:ff:ff:ff:ff 2023-11-28T18:39:10.126 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T18:39:10.126 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:39:10.127 INFO:teuthology.orchestra.run.smithi045.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T18:39:10.127 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-28T18:39:10.127 INFO:teuthology.orchestra.run.smithi045.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-28T18:39:10.127 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:39:10.127 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-28T18:39:10.127 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:39:10.127 INFO:teuthology.orchestra.run.smithi045.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T18:39:10.127 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T18:39:10.127 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-28T18:39:10.127 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:39:10.127 INFO:teuthology.orchestra.run.smithi045.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T18:39:10.127 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T18:39:10.128 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-11-28T18:39:10.128 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:39:10.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:39:10.128 DEBUG:teuthology.orchestra.run.smithi045:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T18:39:10.185 INFO:teuthology.orchestra.run.smithi045.stdout:1 2023-11-28T18:39:10.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:39:10.188 DEBUG:teuthology.orchestra.run.smithi045:> route 2023-11-28T18:39:10.240 INFO:teuthology.orchestra.run.smithi045.stdout:Kernel IP routing table 2023-11-28T18:39:10.240 INFO:teuthology.orchestra.run.smithi045.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T18:39:10.240 INFO:teuthology.orchestra.run.smithi045.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-11-28T18:39:10.241 INFO:teuthology.orchestra.run.smithi045.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T18:39:10.241 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-11-28T18:39:10.241 INFO:teuthology.orchestra.run.smithi045.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T18:39:10.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:39:10.241 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-11-28T18:39:10.241 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-11-28T18:39:10.242 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-28T18:39:10.242 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-28T18:39:10.242 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-28T18:39:10.242 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-11-28T18:39:10.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:39:10.335 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-11-28T18:39:10.345 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-28T18:39:10.345 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-28T18:39:10.345 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T18:39:10.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:39:10.346 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set brx.0 up 2023-11-28T18:39:10.407 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-28T18:39:10.408 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T18:39:10.408 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-28T18:39:10.462 INFO:teuthology.orchestra.run.smithi045.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-28T18:39:10.463 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T18:39:10.463 DEBUG:teuthology.orchestra.run.smithi045:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-28T18:39:10.514 DEBUG:teuthology.orchestra.run.smithi045:> sudo modprobe fuse 2023-11-28T18:39:10.579 DEBUG:teuthology.orchestra.run.smithi045:> cat /proc/self/mounts | awk '{print $2}' 2023-11-28T18:39:10.632 INFO:teuthology.orchestra.run.smithi045.stdout:/sys 2023-11-28T18:39:10.632 INFO:teuthology.orchestra.run.smithi045.stdout:/proc 2023-11-28T18:39:10.632 INFO:teuthology.orchestra.run.smithi045.stdout:/dev 2023-11-28T18:39:10.632 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/pts 2023-11-28T18:39:10.632 INFO:teuthology.orchestra.run.smithi045.stdout:/run 2023-11-28T18:39:10.633 INFO:teuthology.orchestra.run.smithi045.stdout:/ 2023-11-28T18:39:10.633 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/security 2023-11-28T18:39:10.633 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/shm 2023-11-28T18:39:10.633 INFO:teuthology.orchestra.run.smithi045.stdout:/run/lock 2023-11-28T18:39:10.633 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/cgroup 2023-11-28T18:39:10.633 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/pstore 2023-11-28T18:39:10.633 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/bpf 2023-11-28T18:39:10.633 INFO:teuthology.orchestra.run.smithi045.stdout:/proc/sys/fs/binfmt_misc 2023-11-28T18:39:10.633 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/hugepages 2023-11-28T18:39:10.633 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/mqueue 2023-11-28T18:39:10.633 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/debug 2023-11-28T18:39:10.634 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/tracing 2023-11-28T18:39:10.634 INFO:teuthology.orchestra.run.smithi045.stdout:/proc/fs/nfsd 2023-11-28T18:39:10.634 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/fuse/connections 2023-11-28T18:39:10.634 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/config 2023-11-28T18:39:10.634 INFO:teuthology.orchestra.run.smithi045.stdout:/run/credentials/systemd-sysusers.service 2023-11-28T18:39:10.634 INFO:teuthology.orchestra.run.smithi045.stdout:/run/rpc_pipefs 2023-11-28T18:39:10.634 INFO:teuthology.orchestra.run.smithi045.stdout:/run/user/1000 2023-11-28T18:39:10.634 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph 2023-11-28T18:39:10.634 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-0 2023-11-28T18:39:10.634 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-1 2023-11-28T18:39:10.634 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-2 2023-11-28T18:39:10.635 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-3 2023-11-28T18:39:10.635 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns 2023-11-28T18:39:10.635 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T18:39:10.635 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T18:39:10.635 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T18:39:10.635 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T18:39:10.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:39:10.636 DEBUG:teuthology.orchestra.run.smithi045:> ls /sys/fs/fuse/connections 2023-11-28T18:39:10.686 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-28T18:39:10.686 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-28T18:39:10.737 DEBUG:teuthology.orchestra.run.smithi045:> sudo modprobe fuse 2023-11-28T18:39:10.760 DEBUG:teuthology.orchestra.run.smithi045:> cat /proc/self/mounts | awk '{print $2}' 2023-11-28T18:39:10.812 INFO:teuthology.orchestra.run.smithi045.stdout:/sys 2023-11-28T18:39:10.812 INFO:teuthology.orchestra.run.smithi045.stdout:/proc 2023-11-28T18:39:10.812 INFO:teuthology.orchestra.run.smithi045.stdout:/dev 2023-11-28T18:39:10.813 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/pts 2023-11-28T18:39:10.813 INFO:teuthology.orchestra.run.smithi045.stdout:/run 2023-11-28T18:39:10.813 INFO:teuthology.orchestra.run.smithi045.stdout:/ 2023-11-28T18:39:10.813 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/security 2023-11-28T18:39:10.813 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/shm 2023-11-28T18:39:10.813 INFO:teuthology.orchestra.run.smithi045.stdout:/run/lock 2023-11-28T18:39:10.813 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/cgroup 2023-11-28T18:39:10.813 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/pstore 2023-11-28T18:39:10.813 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/bpf 2023-11-28T18:39:10.814 INFO:teuthology.orchestra.run.smithi045.stdout:/proc/sys/fs/binfmt_misc 2023-11-28T18:39:10.814 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/hugepages 2023-11-28T18:39:10.814 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/mqueue 2023-11-28T18:39:10.814 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/debug 2023-11-28T18:39:10.814 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/tracing 2023-11-28T18:39:10.814 INFO:teuthology.orchestra.run.smithi045.stdout:/proc/fs/nfsd 2023-11-28T18:39:10.814 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/fuse/connections 2023-11-28T18:39:10.814 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/config 2023-11-28T18:39:10.814 INFO:teuthology.orchestra.run.smithi045.stdout:/run/credentials/systemd-sysusers.service 2023-11-28T18:39:10.814 INFO:teuthology.orchestra.run.smithi045.stdout:/run/rpc_pipefs 2023-11-28T18:39:10.814 INFO:teuthology.orchestra.run.smithi045.stdout:/run/user/1000 2023-11-28T18:39:10.814 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph 2023-11-28T18:39:10.815 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-0 2023-11-28T18:39:10.815 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-1 2023-11-28T18:39:10.815 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-2 2023-11-28T18:39:10.815 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-3 2023-11-28T18:39:10.815 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns 2023-11-28T18:39:10.815 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T18:39:10.815 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T18:39:10.815 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T18:39:10.815 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T18:39:10.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:39:10.816 DEBUG:teuthology.orchestra.run.smithi045:> ls /sys/fs/fuse/connections 2023-11-28T18:39:10.835 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:2023-11-28T18:39:10.833+0000 7f1e76331580 -1 init, newargv = 0x55d3a5543d20 newargc=15 2023-11-28T18:39:10.835 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:ceph-fuse[48331]: starting ceph client 2023-11-28T18:39:10.842 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:ceph-fuse[48331]: starting fuse 2023-11-28T18:39:10.846 INFO:teuthology.orchestra.run.smithi045.stdout:43 2023-11-28T18:39:10.846 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-11-28T18:39:10.847 DEBUG:teuthology.orchestra.run.smithi045:> sudo stdin-killer -- python3 -c ' 2023-11-28T18:39:10.847 DEBUG:teuthology.orchestra.run.smithi045:> import glob 2023-11-28T18:39:10.847 DEBUG:teuthology.orchestra.run.smithi045:> import re 2023-11-28T18:39:10.847 DEBUG:teuthology.orchestra.run.smithi045:> import os 2023-11-28T18:39:10.847 DEBUG:teuthology.orchestra.run.smithi045:> import subprocess 2023-11-28T18:39:10.847 DEBUG:teuthology.orchestra.run.smithi045:> 2023-11-28T18:39:10.847 DEBUG:teuthology.orchestra.run.smithi045:> def _find_admin_socket(client_name): 2023-11-28T18:39:10.848 DEBUG:teuthology.orchestra.run.smithi045:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-28T18:39:10.848 DEBUG:teuthology.orchestra.run.smithi045:> files = glob.glob(asok_path) 2023-11-28T18:39:10.848 DEBUG:teuthology.orchestra.run.smithi045:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-28T18:39:10.848 DEBUG:teuthology.orchestra.run.smithi045:> 2023-11-28T18:39:10.848 DEBUG:teuthology.orchestra.run.smithi045:> # Given a non-glob path, it better be there 2023-11-28T18:39:10.848 DEBUG:teuthology.orchestra.run.smithi045:> if "*" not in asok_path: 2023-11-28T18:39:10.848 DEBUG:teuthology.orchestra.run.smithi045:> assert(len(files) == 1) 2023-11-28T18:39:10.848 DEBUG:teuthology.orchestra.run.smithi045:> return files[0] 2023-11-28T18:39:10.848 DEBUG:teuthology.orchestra.run.smithi045:> 2023-11-28T18:39:10.848 DEBUG:teuthology.orchestra.run.smithi045:> for f in files: 2023-11-28T18:39:10.848 DEBUG:teuthology.orchestra.run.smithi045:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-28T18:39:10.849 DEBUG:teuthology.orchestra.run.smithi045:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-28T18:39:10.849 DEBUG:teuthology.orchestra.run.smithi045:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-28T18:39:10.849 DEBUG:teuthology.orchestra.run.smithi045:> contents = proc_f.read() 2023-11-28T18:39:10.849 DEBUG:teuthology.orchestra.run.smithi045:> if mountpoint in contents: 2023-11-28T18:39:10.849 DEBUG:teuthology.orchestra.run.smithi045:> return f 2023-11-28T18:39:10.849 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-28T18:39:10.849 DEBUG:teuthology.orchestra.run.smithi045:> 2023-11-28T18:39:10.849 DEBUG:teuthology.orchestra.run.smithi045:> print(_find_admin_socket("client.0")) 2023-11-28T18:39:10.849 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-11-28T18:39:10.975 INFO:teuthology.orchestra.run.smithi045.stdout:/var/run/ceph/ceph-client.0.48331.asok 2023-11-28T18:39:10.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-28T18:39:10.985 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.48331.asok 2023-11-28T18:39:10.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:39:10.986 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.48331.asok status 2023-11-28T18:39:11.164 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-11-28T18:39:11.164 INFO:teuthology.orchestra.run.smithi045.stdout: "metadata": { 2023-11-28T18:39:11.164 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_sha1": "47c1c547372ed5bff7984647dc200bac0e019caf", 2023-11-28T18:39:11.164 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_version": "ceph version 18.0.0-7531-g47c1c547 (47c1c547372ed5bff7984647dc200bac0e019caf) reef (dev)", 2023-11-28T18:39:11.164 INFO:teuthology.orchestra.run.smithi045.stdout: "entity_id": "0", 2023-11-28T18:39:11.164 INFO:teuthology.orchestra.run.smithi045.stdout: "hostname": "smithi045", 2023-11-28T18:39:11.165 INFO:teuthology.orchestra.run.smithi045.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-28T18:39:11.165 INFO:teuthology.orchestra.run.smithi045.stdout: "pid": "48331", 2023-11-28T18:39:11.165 INFO:teuthology.orchestra.run.smithi045.stdout: "root": "/" 2023-11-28T18:39:11.166 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:39:11.166 INFO:teuthology.orchestra.run.smithi045.stdout: "dentry_count": 0, 2023-11-28T18:39:11.166 INFO:teuthology.orchestra.run.smithi045.stdout: "dentry_pinned_count": 0, 2023-11-28T18:39:11.166 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 5709, 2023-11-28T18:39:11.166 INFO:teuthology.orchestra.run.smithi045.stdout: "inst": { 2023-11-28T18:39:11.167 INFO:teuthology.orchestra.run.smithi045.stdout: "name": { 2023-11-28T18:39:11.167 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "client", 2023-11-28T18:39:11.167 INFO:teuthology.orchestra.run.smithi045.stdout: "num": 5709 2023-11-28T18:39:11.167 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:39:11.167 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": { 2023-11-28T18:39:11.167 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-11-28T18:39:11.167 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "192.168.0.1:0", 2023-11-28T18:39:11.167 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3191135536 2023-11-28T18:39:11.167 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:39:11.167 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:39:11.168 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": { 2023-11-28T18:39:11.168 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-11-28T18:39:11.168 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "192.168.0.1:0", 2023-11-28T18:39:11.168 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3191135536 2023-11-28T18:39:11.168 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:39:11.168 INFO:teuthology.orchestra.run.smithi045.stdout: "inst_str": "client.5709 192.168.0.1:0/3191135536", 2023-11-28T18:39:11.168 INFO:teuthology.orchestra.run.smithi045.stdout: "addr_str": "192.168.0.1:0/3191135536", 2023-11-28T18:39:11.168 INFO:teuthology.orchestra.run.smithi045.stdout: "inode_count": 1, 2023-11-28T18:39:11.168 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_epoch": 23, 2023-11-28T18:39:11.168 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_epoch": 35, 2023-11-28T18:39:11.169 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_epoch_barrier": 0, 2023-11-28T18:39:11.169 INFO:teuthology.orchestra.run.smithi045.stdout: "blocklisted": false, 2023-11-28T18:39:11.169 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs" 2023-11-28T18:39:11.169 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-11-28T18:39:11.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:39:11.180 DEBUG:teuthology.orchestra.run.smithi045:> stat --file-system '--printf=%T 2023-11-28T18:39:11.180 DEBUG:teuthology.orchestra.run.smithi045:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-28T18:39:11.190 INFO:teuthology.orchestra.run.smithi045.stdout:fuseblk 2023-11-28T18:39:11.190 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-28T18:39:11.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:39:11.190 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-28T18:39:11.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:39:11.259 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls -R) 2023-11-28T18:39:11.316 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-11-28T18:39:11.313+0000 7f70c1bb9640 -1 log_channel(cluster) log [ERR] : bad backtrace on directory inode 0x100000001f7 2023-11-28T18:39:11.321 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-11-28T18:39:11.317+0000 7f70c1bb9640 -1 log_channel(cluster) log [ERR] : bad backtrace on directory inode 0x10000000001 2023-11-28T18:39:11.323 INFO:teuthology.orchestra.run.smithi045.stdout:.: 2023-11-28T18:39:11.323 INFO:teuthology.orchestra.run.smithi045.stdout:linkdir 2023-11-28T18:39:11.323 INFO:teuthology.orchestra.run.smithi045.stdout:rootfile 2023-11-28T18:39:11.323 INFO:teuthology.orchestra.run.smithi045.stdout:subdir 2023-11-28T18:39:11.324 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:39:11.324 INFO:teuthology.orchestra.run.smithi045.stdout:./linkdir: 2023-11-28T18:39:11.324 INFO:teuthology.orchestra.run.smithi045.stdout:link2 2023-11-28T18:39:11.324 INFO:teuthology.orchestra.run.smithi045.stdout:link3 2023-11-28T18:39:11.324 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:39:11.324 INFO:teuthology.orchestra.run.smithi045.stdout:./subdir: 2023-11-28T18:39:11.324 INFO:teuthology.orchestra.run.smithi045.stdout:subdirfile 2023-11-28T18:39:11.325 INFO:teuthology.orchestra.run.smithi045.stdout:subsubdir 2023-11-28T18:39:11.325 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:39:11.325 INFO:teuthology.orchestra.run.smithi045.stdout:./subdir/subsubdir: 2023-11-28T18:39:11.326 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T18:39:11.326 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T18:39:11.383 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T18:39:11.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.565+0000 7f6c5451d640 1 Processor -- start 2023-11-28T18:39:11.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.565+0000 7f6c5451d640 1 -- start start 2023-11-28T18:39:11.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.569+0000 7f6c5451d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f6c4c13cf70 0x7f6c4c06c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:11.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.569+0000 7f6c5451d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6c4c06c840 0x7f6c4c15a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:11.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.569+0000 7f6c5451d640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c4c15b3e0 con 0x7f6c4c15abb0 2023-11-28T18:39:11.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.569+0000 7f6c5451d640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c4c13d350 con 0x7f6c4c06c840 2023-11-28T18:39:11.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.569+0000 7f6c5451d640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c4c140520 con 0x7f6c4c13cf70 2023-11-28T18:39:11.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.569+0000 7f6c51ab8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6c4c06c840 0x7f6c4c15a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:11.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.569+0000 7f6c51ab8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6c4c06c840 0x7f6c4c15a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43010/0 (socket says 172.21.15.45:43010) 2023-11-28T18:39:11.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.569+0000 7f6c51ab8640 1 -- 172.21.15.45:0/3012769473 learned_addr learned my addr 172.21.15.45:0/3012769473 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:11.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.569+0000 7f6c522b9640 1 --2- 172.21.15.45:0/3012769473 >> v2:172.21.15.190:3300/0 conn(0x7f6c4c13cf70 0x7f6c4c06c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:11.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.569+0000 7f6c51ab8640 1 -- 172.21.15.45:0/3012769473 >> v2:172.21.15.190:3300/0 conn(0x7f6c4c13cf70 msgr2=0x7f6c4c06c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:11.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.569+0000 7f6c51ab8640 1 --2- 172.21.15.45:0/3012769473 >> v2:172.21.15.190:3300/0 conn(0x7f6c4c13cf70 0x7f6c4c06c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:11.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.569+0000 7f6c51ab8640 1 -- 172.21.15.45:0/3012769473 >> v1:172.21.15.190:6789/0 conn(0x7f6c4c15abb0 legacy=0x7f6c4c0715b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:11.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.569+0000 7f6c51ab8640 1 -- 172.21.15.45:0/3012769473 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c4c13f760 con 0x7f6c4c06c840 2023-11-28T18:39:11.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.573+0000 7f6c51ab8640 1 --2- 172.21.15.45:0/3012769473 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c4c06c840 0x7f6c4c15a670 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c06b550 tx=0x7f6c3c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80bfbdcb558e0d49 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:11.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.573+0000 7f6c512b7640 1 -- 172.21.15.45:0/3012769473 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c0ad660 con 0x7f6c4c06c840 2023-11-28T18:39:11.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.573+0000 7f6c512b7640 1 -- 172.21.15.45:0/3012769473 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c3c0ad7c0 con 0x7f6c4c06c840 2023-11-28T18:39:11.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.573+0000 7f6c512b7640 1 -- 172.21.15.45:0/3012769473 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c0adb50 con 0x7f6c4c06c840 2023-11-28T18:39:11.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.573+0000 7f6c5451d640 1 -- 172.21.15.45:0/3012769473 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c4c06c840 msgr2=0x7f6c4c15a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:11.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.573+0000 7f6c5451d640 1 --2- 172.21.15.45:0/3012769473 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c4c06c840 0x7f6c4c15a670 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c06b550 tx=0x7f6c3c01c470 comp rx=0 tx=0).stop 2023-11-28T18:39:11.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.573+0000 7f6c5451d640 1 -- 172.21.15.45:0/3012769473 shutdown_connections 2023-11-28T18:39:11.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.573+0000 7f6c5451d640 1 --2- 172.21.15.45:0/3012769473 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c4c06c840 0x7f6c4c15a670 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:11.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.573+0000 7f6c5451d640 1 --2- 172.21.15.45:0/3012769473 >> v2:172.21.15.190:3300/0 conn(0x7f6c4c13cf70 0x7f6c4c06c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:11.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.573+0000 7f6c5451d640 1 -- 172.21.15.45:0/3012769473 >> 172.21.15.45:0/3012769473 conn(0x7f6c4c06a570 msgr2=0x7f6c4c06a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:11.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.573+0000 7f6c5451d640 1 -- 172.21.15.45:0/3012769473 shutdown_connections 2023-11-28T18:39:11.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.573+0000 7f6c5451d640 1 -- 172.21.15.45:0/3012769473 wait complete. 2023-11-28T18:39:11.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.573+0000 7f6c5451d640 1 Processor -- start 2023-11-28T18:39:11.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.573+0000 7f6c5451d640 1 -- start start 2023-11-28T18:39:11.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.573+0000 7f6c5451d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c4c06c840 0x7f6c4c136a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:11.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.573+0000 7f6c5451d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6c4c13cf70 0x7f6c4c135d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:11.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.573+0000 7f6c5451d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6c4c15abb0 0x7f6c4c150790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:11.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.577+0000 7f6c5451d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4c067830 con 0x7f6c4c06c840 2023-11-28T18:39:11.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.577+0000 7f6c5451d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4c150cd0 con 0x7f6c4c15abb0 2023-11-28T18:39:11.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.577+0000 7f6c5451d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4c13c610 con 0x7f6c4c13cf70 2023-11-28T18:39:11.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.577+0000 7f6c522b9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c4c06c840 0x7f6c4c136a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:11.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.577+0000 7f6c522b9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c4c06c840 0x7f6c4c136a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43026/0 (socket says 172.21.15.45:43026) 2023-11-28T18:39:11.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.577+0000 7f6c522b9640 1 -- 172.21.15.45:0/169027353 learned_addr learned my addr 172.21.15.45:0/169027353 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:11.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.577+0000 7f6c52aba640 1 --2- 172.21.15.45:0/169027353 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6c4c15abb0 0x7f6c4c150790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:11.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.577+0000 7f6c522b9640 1 -- 172.21.15.45:0/169027353 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6c4c13cf70 msgr2=0x7f6c4c135d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:11.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.577+0000 7f6c522b9640 1 --2- 172.21.15.45:0/169027353 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6c4c13cf70 0x7f6c4c135d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:11.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.577+0000 7f6c522b9640 1 -- 172.21.15.45:0/169027353 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6c4c15abb0 msgr2=0x7f6c4c150790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:11.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.577+0000 7f6c522b9640 1 --2- 172.21.15.45:0/169027353 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6c4c15abb0 0x7f6c4c150790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:11.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.577+0000 7f6c522b9640 1 -- 172.21.15.45:0/169027353 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c3c0094d0 con 0x7f6c4c06c840 2023-11-28T18:39:11.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.577+0000 7f6c52aba640 1 --2- 172.21.15.45:0/169027353 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6c4c15abb0 0x7f6c4c150790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:39:11.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.577+0000 7f6c522b9640 1 --2- 172.21.15.45:0/169027353 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c4c06c840 0x7f6c4c136a90 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f6c4800e870 tx=0x7f6c4800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:11.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.577+0000 7f6c42ffd640 1 -- 172.21.15.45:0/169027353 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c48009530 con 0x7f6c4c06c840 2023-11-28T18:39:11.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.577+0000 7f6c42ffd640 1 -- 172.21.15.45:0/169027353 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c4800c940 con 0x7f6c4c06c840 2023-11-28T18:39:11.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.577+0000 7f6c42ffd640 1 -- 172.21.15.45:0/169027353 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4800ccd0 con 0x7f6c4c06c840 2023-11-28T18:39:11.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.577+0000 7f6c5451d640 1 -- 172.21.15.45:0/169027353 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c4c14fcb0 con 0x7f6c4c06c840 2023-11-28T18:39:11.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.577+0000 7f6c5451d640 1 -- 172.21.15.45:0/169027353 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c4c150270 con 0x7f6c4c06c840 2023-11-28T18:39:11.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.577+0000 7f6c5451d640 1 -- 172.21.15.45:0/169027353 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c4c069480 con 0x7f6c4c06c840 2023-11-28T18:39:11.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.577+0000 7f6c42ffd640 1 -- 172.21.15.45:0/169027353 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f6c48013470 con 0x7f6c4c06c840 2023-11-28T18:39:11.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.581+0000 7f6c42ffd640 1 --2- 172.21.15.45:0/169027353 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6c300668d0 0x7f6c30068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:11.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.581+0000 7f6c42ffd640 1 -- 172.21.15.45:0/169027353 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f6c480846f0 con 0x7f6c4c06c840 2023-11-28T18:39:11.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.581+0000 7f6c51ab8640 1 --2- 172.21.15.45:0/169027353 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6c300668d0 0x7f6c30068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:11.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.581+0000 7f6c51ab8640 1 --2- 172.21.15.45:0/169027353 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6c300668d0 0x7f6c30068d90 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c0af000 tx=0x7f6c3c004740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:11.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.585+0000 7f6c42ffd640 1 -- 172.21.15.45:0/169027353 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6c48051830 con 0x7f6c4c06c840 2023-11-28T18:39:11.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.741+0000 7f6c5451d640 1 -- 172.21.15.45:0/169027353 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6c4c06d220 con 0x7f6c4c06c840 2023-11-28T18:39:11.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.741+0000 7f6c42ffd640 1 -- 172.21.15.45:0/169027353 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16662 (secure 0 0 0) 0x7f6c48054e50 con 0x7f6c4c06c840 2023-11-28T18:39:11.745 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:39:11.745 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":35,"fsid":"d10f5cd6-1d00-4019-99b6-6fa435498a15","created":"2023-11-28T18:37:08.189030+0000","modified":"2023-11-28T18:39:02.760784+0000","last_up_change":"2023-11-28T18:37:20.196124+0000","last_in_change":"2023-11-28T18:37:10.742043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T18:37:21.293917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-28T18:38:33.254037+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-28T18:38:34.414654+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"84465384-103c-4f2c-a45a-96f5bb9c835f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6809","nonce":555237322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6811","nonce":555237322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6815","nonce":555237322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6813","nonce":555237322}]},"public_addr":"172.21.15.45:6809/555237322","cluster_addr":"172.21.15.45:6811/555237322","heartbeat_back_addr":"172.21.15.45:6815/555237322","heartbeat_front_addr":"172.21.15.45:6813/555237322","state":["exists","up"]},{"osd":1,"uuid":"7d9eed24-a58f-42c7-a787-ac06be8553fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6801","nonce":2857063763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6803","nonce":2857063763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6807","nonce":2857063763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6805","nonce":2857063763}]},"public_addr":"172.21.15.45:6801/2857063763","cluster_addr":"172.21.15.45:6803/2857063763","heartbeat_back_addr":"172.21.15.45:6807/2857063763","heartbeat_front_addr":"172.21.15.45:6805/2857063763","state":["exists","up"]},{"osd":2,"uuid":"575eeccc-4abf-45b4-9caf-f3e797859588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6817","nonce":193884539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6819","nonce":193884539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6823","nonce":193884539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6821","nonce":193884539}]},"public_addr":"172.21.15.45:6817/193884539","cluster_addr":"172.21.15.45:6819/193884539","heartbeat_back_addr":"172.21.15.45:6823/193884539","heartbeat_front_addr":"172.21.15.45:6821/193884539","state":["exists","up"]},{"osd":3,"uuid":"9b0290d6-9a52-4bc8-b2a1-7622c5dc8e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6825","nonce":78541084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6827","nonce":78541084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6831","nonce":78541084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6829","nonce":78541084}]},"public_addr":"172.21.15.45:6825/78541084","cluster_addr":"172.21.15.45:6827/78541084","heartbeat_back_addr":"172.21.15.45:6831/78541084","heartbeat_front_addr":"172.21.15.45:6829/78541084","state":["exists","up"]},{"osd":4,"uuid":"ce632829-f027-4fbf-a627-02c571aa9d53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6809","nonce":1537591987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6811","nonce":1537591987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6815","nonce":1537591987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6813","nonce":1537591987}]},"public_addr":"172.21.15.190:6809/1537591987","cluster_addr":"172.21.15.190:6811/1537591987","heartbeat_back_addr":"172.21.15.190:6815/1537591987","heartbeat_front_addr":"172.21.15.190:6813/1537591987","state":["exists","up"]},{"osd":5,"uuid":"8700b609-27be-40bd-a251-4c0ae0a29ead","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6801","nonce":3296698407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6803","nonce":3296698407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6807","nonce":3296698407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6805","nonce":3296698407}]},"public_addr":"172.21.15.190:6801/3296698407","cluster_addr":"172.21.15.190:6803/3296698407","heartbeat_back_addr":"172.21.15.190:6807/3296698407","heartbeat_front_addr":"172.21.15.190:6805/3296698407","state":["exists","up"]},{"osd":6,"uuid":"44ce4a40-e6ff-4f4d-8e8a-7341e5c91f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6817","nonce":2317686718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6819","nonce":2317686718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6823","nonce":2317686718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6821","nonce":2317686718}]},"public_addr":"172.21.15.190:6817/2317686718","cluster_addr":"172.21.15.190:6819/2317686718","heartbeat_back_addr":"172.21.15.190:6823/2317686718","heartbeat_front_addr":"172.21.15.190:6821/2317686718","state":["exists","up"]},{"osd":7,"uuid":"192238c9-1423-4b7e-ac8f-84ba32113ddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6825","nonce":2493232051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6827","nonce":2493232051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6831","nonce":2493232051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6829","nonce":2493232051}]},"public_addr":"172.21.15.190:6825/2493232051","cluster_addr":"172.21.15.190:6827/2493232051","heartbeat_back_addr":"172.21.15.190:6831/2493232051","heartbeat_front_addr":"172.21.15.190:6829/2493232051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.393552+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.385453+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.361421+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.366408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.363226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.276007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.414605+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.445885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6834/2398964901":"2023-11-29T18:39:02.760758+0000","172.21.15.45:6832/2398964901":"2023-11-29T18:39:02.760758+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T18:39:11.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.745+0000 7f6c5451d640 1 -- 172.21.15.45:0/169027353 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6c300668d0 msgr2=0x7f6c30068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:11.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.745+0000 7f6c5451d640 1 --2- 172.21.15.45:0/169027353 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6c300668d0 0x7f6c30068d90 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c0af000 tx=0x7f6c3c004740 comp rx=0 tx=0).stop 2023-11-28T18:39:11.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.745+0000 7f6c5451d640 1 -- 172.21.15.45:0/169027353 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c4c06c840 msgr2=0x7f6c4c136a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:11.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.745+0000 7f6c5451d640 1 --2- 172.21.15.45:0/169027353 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c4c06c840 0x7f6c4c136a90 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f6c4800e870 tx=0x7f6c4800ed30 comp rx=0 tx=0).stop 2023-11-28T18:39:11.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.745+0000 7f6c5451d640 1 -- 172.21.15.45:0/169027353 shutdown_connections 2023-11-28T18:39:11.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.745+0000 7f6c5451d640 1 --2- 172.21.15.45:0/169027353 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6c300668d0 0x7f6c30068d90 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:11.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.745+0000 7f6c5451d640 1 --2- 172.21.15.45:0/169027353 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6c4c15abb0 0x7f6c4c150790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:11.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.745+0000 7f6c5451d640 1 --2- 172.21.15.45:0/169027353 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6c4c13cf70 0x7f6c4c135d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:11.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.745+0000 7f6c5451d640 1 --2- 172.21.15.45:0/169027353 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c4c06c840 0x7f6c4c136a90 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:11.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.745+0000 7f6c5451d640 1 -- 172.21.15.45:0/169027353 >> 172.21.15.45:0/169027353 conn(0x7f6c4c06a570 msgr2=0x7f6c4c136380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:11.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.745+0000 7f6c5451d640 1 -- 172.21.15.45:0/169027353 shutdown_connections 2023-11-28T18:39:11.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.745+0000 7f6c5451d640 1 -- 172.21.15.45:0/169027353 wait complete. 2023-11-28T18:39:11.767 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T18:37:21.293917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T18:38:33.254037+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T18:38:34.414654+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T18:39:11.767 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T18:39:11.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.909+0000 7f52573b8640 1 Processor -- start 2023-11-28T18:39:11.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.909+0000 7f52573b8640 1 -- start start 2023-11-28T18:39:11.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.913+0000 7f52573b8640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f52501469a0 0x7f525006cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:11.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.913+0000 7f52573b8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f52500b4070 0x7f52500b44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:11.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.913+0000 7f52573b8640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52500b4a10 con 0x7f525006e8e0 2023-11-28T18:39:11.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.913+0000 7f52573b8640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f525015e940 con 0x7f52501469a0 2023-11-28T18:39:11.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.913+0000 7f52573b8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f525015dd30 con 0x7f52500b4070 2023-11-28T18:39:11.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.913+0000 7f5255154640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f52501469a0 0x7f525006cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:11.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.913+0000 7f5254953640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f52500b4070 0x7f52500b44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:11.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.913+0000 7f5254953640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f52500b4070 0x7f52500b44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.45:52080/0 (socket says 172.21.15.45:52080) 2023-11-28T18:39:11.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.913+0000 7f5254953640 1 -- 172.21.15.45:0/3774949337 learned_addr learned my addr 172.21.15.45:0/3774949337 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:11.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.913+0000 7f5255154640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f52501469a0 0x7f525006cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.45:45990/0 (socket says 172.21.15.45:45990) 2023-11-28T18:39:11.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.913+0000 7f5254953640 1 -- 172.21.15.45:0/3774949337 >> v2:172.21.15.190:3300/0 conn(0x7f52501469a0 msgr2=0x7f525006cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:11.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.913+0000 7f5254953640 1 --2- 172.21.15.45:0/3774949337 >> v2:172.21.15.190:3300/0 conn(0x7f52501469a0 0x7f525006cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:11.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.913+0000 7f5254953640 1 -- 172.21.15.45:0/3774949337 >> v1:172.21.15.190:6789/0 conn(0x7f525006e8e0 legacy=0x7f525006ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:11.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.913+0000 7f5254953640 1 -- 172.21.15.45:0/3774949337 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f525015e010 con 0x7f52500b4070 2023-11-28T18:39:11.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.917+0000 7f5254953640 1 --2- 172.21.15.45:0/3774949337 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f52500b4070 0x7f52500b44d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5240009870 tx=0x7f524001c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a68eff3d51f4b6ab server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:11.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.917+0000 7f5247fff640 1 -- 172.21.15.45:0/3774949337 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52400a7070 con 0x7f52500b4070 2023-11-28T18:39:11.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.917+0000 7f5247fff640 1 -- 172.21.15.45:0/3774949337 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52400ab430 con 0x7f52500b4070 2023-11-28T18:39:11.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.917+0000 7f5247fff640 1 -- 172.21.15.45:0/3774949337 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52400ab7c0 con 0x7f52500b4070 2023-11-28T18:39:11.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.917+0000 7f52573b8640 1 -- 172.21.15.45:0/3774949337 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f52500b4070 msgr2=0x7f52500b44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:11.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.917+0000 7f52573b8640 1 --2- 172.21.15.45:0/3774949337 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f52500b4070 0x7f52500b44d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5240009870 tx=0x7f524001c540 comp rx=0 tx=0).stop 2023-11-28T18:39:11.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.917+0000 7f52573b8640 1 -- 172.21.15.45:0/3774949337 shutdown_connections 2023-11-28T18:39:11.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.917+0000 7f52573b8640 1 --2- 172.21.15.45:0/3774949337 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f52500b4070 0x7f52500b44d0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:11.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.917+0000 7f52573b8640 1 --2- 172.21.15.45:0/3774949337 >> v2:172.21.15.190:3300/0 conn(0x7f52501469a0 0x7f525006cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:11.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.917+0000 7f52573b8640 1 -- 172.21.15.45:0/3774949337 >> 172.21.15.45:0/3774949337 conn(0x7f5250070b80 msgr2=0x7f5250066360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:11.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.917+0000 7f52573b8640 1 -- 172.21.15.45:0/3774949337 shutdown_connections 2023-11-28T18:39:11.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.917+0000 7f52573b8640 1 -- 172.21.15.45:0/3774949337 wait complete. 2023-11-28T18:39:11.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.917+0000 7f52573b8640 1 Processor -- start 2023-11-28T18:39:11.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.917+0000 7f52573b8640 1 -- start start 2023-11-28T18:39:11.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.921+0000 7f52573b8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f525006e8e0 0x7f5250167840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:11.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.921+0000 7f52573b8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f52500b4070 0x7f5250158460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:11.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.921+0000 7f52573b8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52501469a0 0x7f525013ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:11.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.921+0000 7f52573b8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5250167d80 con 0x7f52501469a0 2023-11-28T18:39:11.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.921+0000 7f52573b8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5250159470 con 0x7f525006e8e0 2023-11-28T18:39:11.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.921+0000 7f52573b8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5250158eb0 con 0x7f52500b4070 2023-11-28T18:39:11.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.921+0000 7f5255955640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52501469a0 0x7f525013ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:11.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.921+0000 7f5255154640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f525006e8e0 0x7f5250167840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:11.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.921+0000 7f5255154640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f525006e8e0 0x7f5250167840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.45:45994/0 (socket says 172.21.15.45:45994) 2023-11-28T18:39:11.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.921+0000 7f5255154640 1 -- 172.21.15.45:0/19261835 learned_addr learned my addr 172.21.15.45:0/19261835 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:11.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.921+0000 7f5254953640 1 --2- 172.21.15.45:0/19261835 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f52500b4070 0x7f5250158460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:11.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.921+0000 7f5255955640 1 -- 172.21.15.45:0/19261835 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f52500b4070 msgr2=0x7f5250158460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:11.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.921+0000 7f5255955640 1 --2- 172.21.15.45:0/19261835 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f52500b4070 0x7f5250158460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:11.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.921+0000 7f5255955640 1 -- 172.21.15.45:0/19261835 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f525006e8e0 msgr2=0x7f5250167840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:11.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.921+0000 7f5255955640 1 --2- 172.21.15.45:0/19261835 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f525006e8e0 0x7f5250167840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:11.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.921+0000 7f5255955640 1 -- 172.21.15.45:0/19261835 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52400094d0 con 0x7f52501469a0 2023-11-28T18:39:11.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.921+0000 7f5255154640 1 --2- 172.21.15.45:0/19261835 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f525006e8e0 0x7f5250167840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:39:11.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.921+0000 7f5255955640 1 --2- 172.21.15.45:0/19261835 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52501469a0 0x7f525013ddf0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f524800c700 tx=0x7f524800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:11.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.921+0000 7f5245ffb640 1 -- 172.21.15.45:0/19261835 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5248003b80 con 0x7f52501469a0 2023-11-28T18:39:11.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.921+0000 7f5245ffb640 1 -- 172.21.15.45:0/19261835 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5248003ce0 con 0x7f52501469a0 2023-11-28T18:39:11.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.921+0000 7f52573b8640 1 -- 172.21.15.45:0/19261835 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5250159190 con 0x7f52501469a0 2023-11-28T18:39:11.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.921+0000 7f5245ffb640 1 -- 172.21.15.45:0/19261835 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5248005310 con 0x7f52501469a0 2023-11-28T18:39:11.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.921+0000 7f52573b8640 1 -- 172.21.15.45:0/19261835 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f525013fd40 con 0x7f52501469a0 2023-11-28T18:39:11.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.921+0000 7f52573b8640 1 -- 172.21.15.45:0/19261835 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f525006ce20 con 0x7f52501469a0 2023-11-28T18:39:11.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.921+0000 7f5245ffb640 1 -- 172.21.15.45:0/19261835 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f5248005470 con 0x7f52501469a0 2023-11-28T18:39:11.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.925+0000 7f5245ffb640 1 --2- 172.21.15.45:0/19261835 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f5234066900 0x7f5234068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:11.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.925+0000 7f5245ffb640 1 -- 172.21.15.45:0/19261835 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f5248083fe0 con 0x7f52501469a0 2023-11-28T18:39:11.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.925+0000 7f5255154640 1 --2- 172.21.15.45:0/19261835 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f5234066900 0x7f5234068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:11.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.925+0000 7f5255154640 1 --2- 172.21.15.45:0/19261835 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f5234066900 0x7f5234068dc0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f524c011310 tx=0x7f524c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:11.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:11.929+0000 7f5245ffb640 1 -- 172.21.15.45:0/19261835 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f52480512c0 con 0x7f52501469a0 2023-11-28T18:39:12.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.089+0000 7f52573b8640 1 -- 172.21.15.45:0/19261835 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5250067710 con 0x7f52501469a0 2023-11-28T18:39:12.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.089+0000 7f5245ffb640 1 -- 172.21.15.45:0/19261835 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7f52480548e0 con 0x7f52501469a0 2023-11-28T18:39:12.092 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-11-28T18:39:12.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.089+0000 7f52573b8640 1 -- 172.21.15.45:0/19261835 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f5234066900 msgr2=0x7f5234068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:12.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.089+0000 7f52573b8640 1 --2- 172.21.15.45:0/19261835 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f5234066900 0x7f5234068dc0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f524c011310 tx=0x7f524c009190 comp rx=0 tx=0).stop 2023-11-28T18:39:12.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.089+0000 7f52573b8640 1 -- 172.21.15.45:0/19261835 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52501469a0 msgr2=0x7f525013ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:12.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.089+0000 7f52573b8640 1 --2- 172.21.15.45:0/19261835 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52501469a0 0x7f525013ddf0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f524800c700 tx=0x7f524800cbc0 comp rx=0 tx=0).stop 2023-11-28T18:39:12.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.089+0000 7f52573b8640 1 -- 172.21.15.45:0/19261835 shutdown_connections 2023-11-28T18:39:12.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.089+0000 7f52573b8640 1 --2- 172.21.15.45:0/19261835 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f5234066900 0x7f5234068dc0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:12.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.089+0000 7f52573b8640 1 --2- 172.21.15.45:0/19261835 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52501469a0 0x7f525013ddf0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:12.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.089+0000 7f52573b8640 1 --2- 172.21.15.45:0/19261835 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f52500b4070 0x7f5250158460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:12.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.089+0000 7f52573b8640 1 --2- 172.21.15.45:0/19261835 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f525006e8e0 0x7f5250167840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:12.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.089+0000 7f52573b8640 1 -- 172.21.15.45:0/19261835 >> 172.21.15.45:0/19261835 conn(0x7f5250070b80 msgr2=0x7f525006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:12.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.089+0000 7f52573b8640 1 -- 172.21.15.45:0/19261835 shutdown_connections 2023-11-28T18:39:12.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.089+0000 7f52573b8640 1 -- 172.21.15.45:0/19261835 wait complete. 2023-11-28T18:39:12.113 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T18:39:12.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.257+0000 7f8165479640 1 Processor -- start 2023-11-28T18:39:12.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.257+0000 7f8165479640 1 -- start start 2023-11-28T18:39:12.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.257+0000 7f8165479640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f816015d350 0x7f81600d1500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:12.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.257+0000 7f8165479640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f81600d3a40 0x7f81600cf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:12.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.257+0000 7f8165479640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81600d1d30 con 0x7f81600cfe50 2023-11-28T18:39:12.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.257+0000 7f8165479640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81600b30c0 con 0x7f81600d3a40 2023-11-28T18:39:12.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.257+0000 7f8165479640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f816015d730 con 0x7f816015d350 2023-11-28T18:39:12.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.257+0000 7f815f7fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f81600cfe50 0x7f81600cdbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38906/0 (socket says 172.21.15.45:38906) 2023-11-28T18:39:12.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.257+0000 7f815f7fe640 1 -- 172.21.15.45:0/2810763515 learned_addr learned my addr 172.21.15.45:0/2810763515 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:39:12.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.257+0000 7f815effd640 1 --2- 172.21.15.45:0/2810763515 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f816015d350 0x7f81600d1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:12.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.257+0000 7f8157fff640 1 --2- 172.21.15.45:0/2810763515 >> v2:172.21.15.190:3300/0 conn(0x7f81600d3a40 0x7f81600cf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:12.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.257+0000 7f815e7fc640 1 -- 172.21.15.45:0/2810763515 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 240845318 0 0) 0x7f81600d1d30 con 0x7f81600cfe50 2023-11-28T18:39:12.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.257+0000 7f815e7fc640 1 -- 172.21.15.45:0/2810763515 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f814c003530 con 0x7f81600cfe50 2023-11-28T18:39:12.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.257+0000 7f815e7fc640 1 -- 172.21.15.45:0/2810763515 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1133399685 0 0) 0x7f814c003530 con 0x7f81600cfe50 2023-11-28T18:39:12.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.257+0000 7f815e7fc640 1 -- 172.21.15.45:0/2810763515 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f816015d350 msgr2=0x7f81600d1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:12.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.257+0000 7f815e7fc640 1 --2- 172.21.15.45:0/2810763515 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f816015d350 0x7f81600d1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:12.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.257+0000 7f815e7fc640 1 -- 172.21.15.45:0/2810763515 >> v2:172.21.15.190:3300/0 conn(0x7f81600d3a40 msgr2=0x7f81600cf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:12.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.257+0000 7f815e7fc640 1 --2- 172.21.15.45:0/2810763515 >> v2:172.21.15.190:3300/0 conn(0x7f81600d3a40 0x7f81600cf910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:12.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.257+0000 7f815e7fc640 1 -- 172.21.15.45:0/2810763515 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81600d2010 con 0x7f81600cfe50 2023-11-28T18:39:12.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.257+0000 7f815e7fc640 1 -- 172.21.15.45:0/2810763515 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4084481567 0 0) 0x7f8158001a00 con 0x7f81600cfe50 2023-11-28T18:39:12.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.257+0000 7f815e7fc640 1 -- 172.21.15.45:0/2810763515 >> v1:172.21.15.45:6789/0 conn(0x7f81600cfe50 legacy=0x7f81600cdbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:12.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.257+0000 7f815e7fc640 1 --2- 172.21.15.45:0/2810763515 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f814c003980 0x7f814c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:12.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.257+0000 7f815e7fc640 1 --2- 172.21.15.45:0/2810763515 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f814c004370 0x7f814c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:12.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.257+0000 7f815e7fc640 1 --2- 172.21.15.45:0/2810763515 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f814c004ec0 0x7f814c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:12.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.257+0000 7f815e7fc640 1 -- 172.21.15.45:0/2810763515 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81600b30c0 con 0x7f814c004ec0 2023-11-28T18:39:12.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.257+0000 7f815e7fc640 1 -- 172.21.15.45:0/2810763515 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f816015d730 con 0x7f814c004370 2023-11-28T18:39:12.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.257+0000 7f815e7fc640 1 -- 172.21.15.45:0/2810763515 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f814c00bed0 con 0x7f814c003980 2023-11-28T18:39:12.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.257+0000 7f815effd640 1 --2- 172.21.15.45:0/2810763515 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f816015d350 0x7f81600d1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:39:12.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.257+0000 7f8157fff640 1 --2- 172.21.15.45:0/2810763515 >> v2:172.21.15.190:3300/0 conn(0x7f81600d3a40 0x7f81600cf910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:39:12.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.261+0000 7f815f7fe640 1 --2- 172.21.15.45:0/2810763515 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f814c004ec0 0x7f814c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:12.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.261+0000 7f8157fff640 1 --2- 172.21.15.45:0/2810763515 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f814c004370 0x7f814c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:12.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.261+0000 7f815effd640 1 --2- 172.21.15.45:0/2810763515 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f814c003980 0x7f814c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:12.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.261+0000 7f815f7fe640 1 -- 172.21.15.45:0/2810763515 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f814c003980 msgr2=0x7f814c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:12.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.261+0000 7f815f7fe640 1 --2- 172.21.15.45:0/2810763515 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f814c003980 0x7f814c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:12.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.261+0000 7f815f7fe640 1 -- 172.21.15.45:0/2810763515 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f814c004370 msgr2=0x7f814c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:12.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.261+0000 7f815f7fe640 1 --2- 172.21.15.45:0/2810763515 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f814c004370 0x7f814c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:12.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.261+0000 7f815f7fe640 1 -- 172.21.15.45:0/2810763515 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f814c003530 con 0x7f814c004ec0 2023-11-28T18:39:12.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.261+0000 7f815f7fe640 1 --2- 172.21.15.45:0/2810763515 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f814c004ec0 0x7f814c00b990 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f815800a860 tx=0x7f815801d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66368ca775c01002 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:12.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.261+0000 7f815e7fc640 1 -- 172.21.15.45:0/2810763515 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81580ad630 con 0x7f814c004ec0 2023-11-28T18:39:12.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.261+0000 7f815e7fc640 1 -- 172.21.15.45:0/2810763515 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81580a8070 con 0x7f814c004ec0 2023-11-28T18:39:12.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.261+0000 7f815e7fc640 1 -- 172.21.15.45:0/2810763515 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81580ada30 con 0x7f814c004ec0 2023-11-28T18:39:12.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.265+0000 7f8165479640 1 -- 172.21.15.45:0/2810763515 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f814c004ec0 msgr2=0x7f814c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:12.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.265+0000 7f8165479640 1 --2- 172.21.15.45:0/2810763515 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f814c004ec0 0x7f814c00b990 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f815800a860 tx=0x7f815801d360 comp rx=0 tx=0).stop 2023-11-28T18:39:12.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.265+0000 7f815f7fe640 1 -- 172.21.15.45:0/2810763515 reap_dead start 2023-11-28T18:39:12.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.265+0000 7f8165479640 1 -- 172.21.15.45:0/2810763515 shutdown_connections 2023-11-28T18:39:12.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.265+0000 7f8165479640 1 -- 172.21.15.45:0/2810763515 >> 172.21.15.45:0/2810763515 conn(0x7f81600d2f20 msgr2=0x7f81600d3330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:12.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.265+0000 7f8165479640 1 -- 172.21.15.45:0/2810763515 shutdown_connections 2023-11-28T18:39:12.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.265+0000 7f8165479640 1 -- 172.21.15.45:0/2810763515 wait complete. 2023-11-28T18:39:12.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.265+0000 7f8165479640 1 Processor -- start 2023-11-28T18:39:12.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.265+0000 7f8165479640 1 -- start start 2023-11-28T18:39:12.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.265+0000 7f8165479640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f814c004ec0 0x7f81601511d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:12.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.265+0000 7f8165479640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f81600c8560 0x7f81600b7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:12.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.265+0000 7f8165479640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81600b8120 0x7f81600b0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:12.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.265+0000 7f8165479640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81600c80d0 con 0x7f81600b8120 2023-11-28T18:39:12.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.265+0000 7f8165479640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81600c74c0 con 0x7f81600c8560 2023-11-28T18:39:12.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.265+0000 7f8165479640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81600c77a0 con 0x7f814c004ec0 2023-11-28T18:39:12.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.265+0000 7f815f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81600b8120 0x7f81600b0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:12.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.265+0000 7f815f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81600b8120 0x7f81600b0ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43066/0 (socket says 172.21.15.45:43066) 2023-11-28T18:39:12.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.265+0000 7f815f7fe640 1 -- 172.21.15.45:0/2359661787 learned_addr learned my addr 172.21.15.45:0/2359661787 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:12.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.265+0000 7f815effd640 1 --2- 172.21.15.45:0/2359661787 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f814c004ec0 0x7f81601511d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:12.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.265+0000 7f8157fff640 1 --2- 172.21.15.45:0/2359661787 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f81600c8560 0x7f81600b7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:12.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.265+0000 7f815f7fe640 1 -- 172.21.15.45:0/2359661787 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f814c004ec0 msgr2=0x7f81601511d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:12.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.265+0000 7f815f7fe640 1 --2- 172.21.15.45:0/2359661787 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f814c004ec0 0x7f81601511d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:12.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.265+0000 7f815f7fe640 1 -- 172.21.15.45:0/2359661787 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f81600c8560 msgr2=0x7f81600b7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:12.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.265+0000 7f815f7fe640 1 --2- 172.21.15.45:0/2359661787 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f81600c8560 0x7f81600b7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:12.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.265+0000 7f815f7fe640 1 -- 172.21.15.45:0/2359661787 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81600c7a80 con 0x7f81600b8120 2023-11-28T18:39:12.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.265+0000 7f8157fff640 1 --2- 172.21.15.45:0/2359661787 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f81600c8560 0x7f81600b7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:39:12.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.265+0000 7f815f7fe640 1 --2- 172.21.15.45:0/2359661787 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81600b8120 0x7f81600b0ac0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f815800a860 tx=0x7f814c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:12.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.269+0000 7f81577fe640 1 -- 172.21.15.45:0/2359661787 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8158001740 con 0x7f81600b8120 2023-11-28T18:39:12.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.269+0000 7f81577fe640 1 -- 172.21.15.45:0/2359661787 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81580018a0 con 0x7f81600b8120 2023-11-28T18:39:12.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.269+0000 7f81577fe640 1 -- 172.21.15.45:0/2359661787 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8158004d70 con 0x7f81600b8120 2023-11-28T18:39:12.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.269+0000 7f8165479640 1 -- 172.21.15.45:0/2359661787 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81600c7d60 con 0x7f81600b8120 2023-11-28T18:39:12.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.269+0000 7f8165479640 1 -- 172.21.15.45:0/2359661787 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8160151710 con 0x7f81600b8120 2023-11-28T18:39:12.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.269+0000 7f8165479640 1 -- 172.21.15.45:0/2359661787 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81600c8280 con 0x7f81600b8120 2023-11-28T18:39:12.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.269+0000 7f81577fe640 1 -- 172.21.15.45:0/2359661787 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f81580aa030 con 0x7f81600b8120 2023-11-28T18:39:12.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.269+0000 7f81577fe640 1 --2- 172.21.15.45:0/2359661787 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f8140066900 0x7f8140068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:12.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.269+0000 7f81577fe640 1 -- 172.21.15.45:0/2359661787 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f815811dcc0 con 0x7f81600b8120 2023-11-28T18:39:12.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.269+0000 7f815effd640 1 --2- 172.21.15.45:0/2359661787 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f8140066900 0x7f8140068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:12.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.273+0000 7f815effd640 1 --2- 172.21.15.45:0/2359661787 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f8140066900 0x7f8140068dc0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f816008b6b0 tx=0x7f8150008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:12.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.273+0000 7f81577fe640 1 -- 172.21.15.45:0/2359661787 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f81600c8280 con 0x7f81600b8120 2023-11-28T18:39:12.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.429+0000 7f8165479640 1 -- 172.21.15.45:0/2359661787 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f81600b44c0 con 0x7f81600b8120 2023-11-28T18:39:12.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.433+0000 7f81577fe640 1 -- 172.21.15.45:0/2359661787 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v35) v1 ==== 104+0+11 (secure 0 0 0) 0x7f81580eae00 con 0x7f81600b8120 2023-11-28T18:39:12.435 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-11-28T18:39:12.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.433+0000 7f8165479640 1 -- 172.21.15.45:0/2359661787 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f8140066900 msgr2=0x7f8140068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:12.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.433+0000 7f8165479640 1 --2- 172.21.15.45:0/2359661787 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f8140066900 0x7f8140068dc0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f816008b6b0 tx=0x7f8150008040 comp rx=0 tx=0).stop 2023-11-28T18:39:12.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.433+0000 7f8165479640 1 -- 172.21.15.45:0/2359661787 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81600b8120 msgr2=0x7f81600b0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:12.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.433+0000 7f8165479640 1 --2- 172.21.15.45:0/2359661787 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81600b8120 0x7f81600b0ac0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f815800a860 tx=0x7f814c005800 comp rx=0 tx=0).stop 2023-11-28T18:39:12.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.433+0000 7f8165479640 1 -- 172.21.15.45:0/2359661787 shutdown_connections 2023-11-28T18:39:12.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.433+0000 7f8165479640 1 --2- 172.21.15.45:0/2359661787 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f8140066900 0x7f8140068dc0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:12.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.433+0000 7f8165479640 1 --2- 172.21.15.45:0/2359661787 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81600b8120 0x7f81600b0ac0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:12.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.433+0000 7f8165479640 1 --2- 172.21.15.45:0/2359661787 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f81600c8560 0x7f81600b7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:12.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.433+0000 7f8165479640 1 --2- 172.21.15.45:0/2359661787 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f814c004ec0 0x7f81601511d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:12.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.433+0000 7f8165479640 1 -- 172.21.15.45:0/2359661787 >> 172.21.15.45:0/2359661787 conn(0x7f81600d2f20 msgr2=0x7f816006c370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:12.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.433+0000 7f8165479640 1 -- 172.21.15.45:0/2359661787 shutdown_connections 2023-11-28T18:39:12.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.433+0000 7f8165479640 1 -- 172.21.15.45:0/2359661787 wait complete. 2023-11-28T18:39:12.455 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T18:39:12.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.597+0000 7f1c1d09a640 1 Processor -- start 2023-11-28T18:39:12.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.597+0000 7f1c1d09a640 1 -- start start 2023-11-28T18:39:12.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.597+0000 7f1c1d09a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1c180cba50 0x7f1c1815be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:12.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.597+0000 7f1c1d09a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1c180b4310 0x7f1c180b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:12.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.597+0000 7f1c1d09a640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c180b4c80 con 0x7f1c18158ce0 2023-11-28T18:39:12.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.597+0000 7f1c1d09a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c1815b6b0 con 0x7f1c180b4310 2023-11-28T18:39:12.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.597+0000 7f1c1d09a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1815f450 con 0x7f1c180cba50 2023-11-28T18:39:12.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.597+0000 7f1c1759e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1c180b4310 0x7f1c180b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:12.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.601+0000 7f1c1759e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1c180b4310 0x7f1c180b4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43070/0 (socket says 172.21.15.45:43070) 2023-11-28T18:39:12.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.601+0000 7f1c1759e640 1 -- 172.21.15.45:0/528043052 learned_addr learned my addr 172.21.15.45:0/528043052 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:12.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.601+0000 7f1c0ffff640 1 --2- 172.21.15.45:0/528043052 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1c180cba50 0x7f1c1815be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:12.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.601+0000 7f1c1759e640 1 -- 172.21.15.45:0/528043052 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1c180cba50 msgr2=0x7f1c1815be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:12.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.601+0000 7f1c1759e640 1 --2- 172.21.15.45:0/528043052 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1c180cba50 0x7f1c1815be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:12.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.601+0000 7f1c1759e640 1 -- 172.21.15.45:0/528043052 >> v1:172.21.15.190:6789/0 conn(0x7f1c18158ce0 legacy=0x7f1c1815eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:12.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.601+0000 7f1c1759e640 1 -- 172.21.15.45:0/528043052 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c1815f730 con 0x7f1c180b4310 2023-11-28T18:39:12.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.601+0000 7f1c1759e640 1 --2- 172.21.15.45:0/528043052 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c180b4310 0x7f1c180b4740 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f1c18072600 tx=0x7f1c1001c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ce5886f6f2b3015 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:12.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.601+0000 7f1c1659c640 1 -- 172.21.15.45:0/528043052 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c100a5720 con 0x7f1c180b4310 2023-11-28T18:39:12.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.601+0000 7f1c1659c640 1 -- 172.21.15.45:0/528043052 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c100a5880 con 0x7f1c180b4310 2023-11-28T18:39:12.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.601+0000 7f1c1659c640 1 -- 172.21.15.45:0/528043052 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c100a5c10 con 0x7f1c180b4310 2023-11-28T18:39:12.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.601+0000 7f1c1d09a640 1 -- 172.21.15.45:0/528043052 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c180b4310 msgr2=0x7f1c180b4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:12.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.601+0000 7f1c1d09a640 1 --2- 172.21.15.45:0/528043052 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c180b4310 0x7f1c180b4740 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f1c18072600 tx=0x7f1c1001c990 comp rx=0 tx=0).stop 2023-11-28T18:39:12.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.605+0000 7f1c1d09a640 1 -- 172.21.15.45:0/528043052 shutdown_connections 2023-11-28T18:39:12.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.605+0000 7f1c1d09a640 1 --2- 172.21.15.45:0/528043052 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c180b4310 0x7f1c180b4740 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:12.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.605+0000 7f1c1d09a640 1 --2- 172.21.15.45:0/528043052 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1c180cba50 0x7f1c1815be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:12.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.605+0000 7f1c1d09a640 1 -- 172.21.15.45:0/528043052 >> 172.21.15.45:0/528043052 conn(0x7f1c180b0d00 msgr2=0x7f1c180b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:12.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.605+0000 7f1c1d09a640 1 -- 172.21.15.45:0/528043052 shutdown_connections 2023-11-28T18:39:12.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.605+0000 7f1c1d09a640 1 -- 172.21.15.45:0/528043052 wait complete. 2023-11-28T18:39:12.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.605+0000 7f1c1d09a640 1 Processor -- start 2023-11-28T18:39:12.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.605+0000 7f1c1d09a640 1 -- start start 2023-11-28T18:39:12.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.605+0000 7f1c1d09a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c180b4310 0x7f1c180b3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:12.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.605+0000 7f1c1d09a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1c180cba50 0x7f1c180c4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:12.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.605+0000 7f1c1d09a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1c18158ce0 0x7f1c180b2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:12.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.605+0000 7f1c1d09a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c181536b0 con 0x7f1c180b4310 2023-11-28T18:39:12.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.605+0000 7f1c1d09a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c180b2c70 con 0x7f1c180cba50 2023-11-28T18:39:12.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.605+0000 7f1c1d09a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c180b2f50 con 0x7f1c18158ce0 2023-11-28T18:39:12.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.605+0000 7f1c16d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c180b4310 0x7f1c180b3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:12.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.605+0000 7f1c16d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c180b4310 0x7f1c180b3d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43072/0 (socket says 172.21.15.45:43072) 2023-11-28T18:39:12.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.605+0000 7f1c16d9d640 1 -- 172.21.15.45:0/1944926028 learned_addr learned my addr 172.21.15.45:0/1944926028 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:12.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.605+0000 7f1c0ffff640 1 --2- 172.21.15.45:0/1944926028 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1c180cba50 0x7f1c180c4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:12.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.605+0000 7f1c1759e640 1 --2- 172.21.15.45:0/1944926028 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1c18158ce0 0x7f1c180b2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:12.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.605+0000 7f1c16d9d640 1 -- 172.21.15.45:0/1944926028 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1c18158ce0 msgr2=0x7f1c180b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:12.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.605+0000 7f1c16d9d640 1 --2- 172.21.15.45:0/1944926028 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1c18158ce0 0x7f1c180b2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:12.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.605+0000 7f1c16d9d640 1 -- 172.21.15.45:0/1944926028 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1c180cba50 msgr2=0x7f1c180c4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:12.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.605+0000 7f1c16d9d640 1 --2- 172.21.15.45:0/1944926028 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1c180cba50 0x7f1c180c4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:12.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.605+0000 7f1c16d9d640 1 -- 172.21.15.45:0/1944926028 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c10009b30 con 0x7f1c180b4310 2023-11-28T18:39:12.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.605+0000 7f1c0ffff640 1 --2- 172.21.15.45:0/1944926028 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1c180cba50 0x7f1c180c4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:39:12.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.609+0000 7f1c16d9d640 1 --2- 172.21.15.45:0/1944926028 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c180b4310 0x7f1c180b3d10 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f1c0800c450 tx=0x7f1c0800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:12.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.609+0000 7f1c0f7fe640 1 -- 172.21.15.45:0/1944926028 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c08012830 con 0x7f1c180b4310 2023-11-28T18:39:12.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.609+0000 7f1c0f7fe640 1 -- 172.21.15.45:0/1944926028 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c080129b0 con 0x7f1c180b4310 2023-11-28T18:39:12.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.609+0000 7f1c1d09a640 1 -- 172.21.15.45:0/1944926028 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c180b3230 con 0x7f1c180b4310 2023-11-28T18:39:12.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.609+0000 7f1c0f7fe640 1 -- 172.21.15.45:0/1944926028 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c08012d60 con 0x7f1c180b4310 2023-11-28T18:39:12.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.609+0000 7f1c1d09a640 1 -- 172.21.15.45:0/1944926028 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c180b37f0 con 0x7f1c180b4310 2023-11-28T18:39:12.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.609+0000 7f1c1d09a640 1 -- 172.21.15.45:0/1944926028 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c180b3a10 con 0x7f1c180b4310 2023-11-28T18:39:12.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.609+0000 7f1c0f7fe640 1 -- 172.21.15.45:0/1944926028 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f1c0801c460 con 0x7f1c180b4310 2023-11-28T18:39:12.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.609+0000 7f1c0f7fe640 1 --2- 172.21.15.45:0/1944926028 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1bf8066900 0x7f1bf8068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:12.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.609+0000 7f1c0f7fe640 1 -- 172.21.15.45:0/1944926028 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f1c08084460 con 0x7f1c180b4310 2023-11-28T18:39:12.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.609+0000 7f1c0ffff640 1 --2- 172.21.15.45:0/1944926028 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1bf8066900 0x7f1bf8068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:12.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.613+0000 7f1c0ffff640 1 --2- 172.21.15.45:0/1944926028 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1bf8066900 0x7f1bf8068dc0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1c18157820 tx=0x7f1c00008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:12.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.613+0000 7f1c0f7fe640 1 -- 172.21.15.45:0/1944926028 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1c08051510 con 0x7f1c180b4310 2023-11-28T18:39:12.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.769+0000 7f1c1d09a640 1 -- 172.21.15.45:0/1944926028 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1c18069410 con 0x7f1c180b4310 2023-11-28T18:39:12.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.769+0000 7f1c0f7fe640 1 -- 172.21.15.45:0/1944926028 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v35) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1c08054b30 con 0x7f1c180b4310 2023-11-28T18:39:12.773 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-11-28T18:39:12.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.773+0000 7f1c1d09a640 1 -- 172.21.15.45:0/1944926028 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1bf8066900 msgr2=0x7f1bf8068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:12.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.773+0000 7f1c1d09a640 1 --2- 172.21.15.45:0/1944926028 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1bf8066900 0x7f1bf8068dc0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1c18157820 tx=0x7f1c00008040 comp rx=0 tx=0).stop 2023-11-28T18:39:12.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.773+0000 7f1c1d09a640 1 -- 172.21.15.45:0/1944926028 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c180b4310 msgr2=0x7f1c180b3d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:12.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.773+0000 7f1c1d09a640 1 --2- 172.21.15.45:0/1944926028 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c180b4310 0x7f1c180b3d10 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f1c0800c450 tx=0x7f1c0800c910 comp rx=0 tx=0).stop 2023-11-28T18:39:12.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.773+0000 7f1c1d09a640 1 -- 172.21.15.45:0/1944926028 shutdown_connections 2023-11-28T18:39:12.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.773+0000 7f1c1d09a640 1 --2- 172.21.15.45:0/1944926028 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1bf8066900 0x7f1bf8068dc0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:12.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.773+0000 7f1c1d09a640 1 --2- 172.21.15.45:0/1944926028 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1c18158ce0 0x7f1c180b2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:12.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.773+0000 7f1c1d09a640 1 --2- 172.21.15.45:0/1944926028 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1c180cba50 0x7f1c180c4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:12.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.773+0000 7f1c1d09a640 1 --2- 172.21.15.45:0/1944926028 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c180b4310 0x7f1c180b3d10 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:12.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.773+0000 7f1c1d09a640 1 -- 172.21.15.45:0/1944926028 >> 172.21.15.45:0/1944926028 conn(0x7f1c180b0d00 msgr2=0x7f1c1815a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:12.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.773+0000 7f1c1d09a640 1 -- 172.21.15.45:0/1944926028 shutdown_connections 2023-11-28T18:39:12.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.773+0000 7f1c1d09a640 1 -- 172.21.15.45:0/1944926028 wait complete. 2023-11-28T18:39:12.795 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T18:39:12.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.937+0000 7fbcce65a640 1 Processor -- start 2023-11-28T18:39:12.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.937+0000 7fbcce65a640 1 -- start start 2023-11-28T18:39:12.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.937+0000 7fbcce65a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbcc806cdc0 0x7fbcc80aeed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:12.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.937+0000 7fbcce65a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbcc806b580 0x7fbcc806b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:12.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.937+0000 7fbcce65a640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcc806bef0 con 0x7fbcc815d1a0 2023-11-28T18:39:12.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.937+0000 7fbcce65a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcc806e050 con 0x7fbcc806cdc0 2023-11-28T18:39:12.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.937+0000 7fbcce65a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc80aeab0 con 0x7fbcc806b580 2023-11-28T18:39:12.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.937+0000 7fbcc77fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbcc806cdc0 0x7fbcc80aeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:12.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.937+0000 7fbcccbf7640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbcc806b580 0x7fbcc806b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:12.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.937+0000 7fbcc77fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbcc806cdc0 0x7fbcc80aeed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43078/0 (socket says 172.21.15.45:43078) 2023-11-28T18:39:12.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.937+0000 7fbcc7fff640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fbcc815d1a0 0x7fbcc80ad5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.45:48940/0 (socket says 172.21.15.45:48940) 2023-11-28T18:39:12.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.937+0000 7fbcc77fe640 1 -- 172.21.15.45:0/1774464857 learned_addr learned my addr 172.21.15.45:0/1774464857 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:12.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.941+0000 7fbcc77fe640 1 -- 172.21.15.45:0/1774464857 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbcc806b580 msgr2=0x7fbcc806b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:12.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.941+0000 7fbcc77fe640 1 --2- 172.21.15.45:0/1774464857 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbcc806b580 0x7fbcc806b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:12.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.941+0000 7fbcc77fe640 1 -- 172.21.15.45:0/1774464857 >> v1:172.21.15.190:6789/0 conn(0x7fbcc815d1a0 legacy=0x7fbcc80ad5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:12.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.941+0000 7fbcc6ffd640 1 -- 172.21.15.45:0/1774464857 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3560502929 0 0) 0x7fbcc806bef0 con 0x7fbcc815d1a0 2023-11-28T18:39:12.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.941+0000 7fbcc77fe640 1 -- 172.21.15.45:0/1774464857 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcc80ade30 con 0x7fbcc806cdc0 2023-11-28T18:39:12.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.941+0000 7fbcccbf7640 1 --2- 172.21.15.45:0/1774464857 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbcc806b580 0x7fbcc806b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:39:12.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.941+0000 7fbcc77fe640 1 --2- 172.21.15.45:0/1774464857 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbcc806cdc0 0x7fbcc80aeed0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc009870 tx=0x7fbcbc01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4abcc400330809a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:12.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.941+0000 7fbcc6ffd640 1 -- 172.21.15.45:0/1774464857 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcbc0ac600 con 0x7fbcc806cdc0 2023-11-28T18:39:12.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.941+0000 7fbcc6ffd640 1 -- 172.21.15.45:0/1774464857 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcbc0a8050 con 0x7fbcc806cdc0 2023-11-28T18:39:12.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.941+0000 7fbcc6ffd640 1 -- 172.21.15.45:0/1774464857 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcbc0ac980 con 0x7fbcc806cdc0 2023-11-28T18:39:12.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.945+0000 7fbcce65a640 1 -- 172.21.15.45:0/1774464857 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbcc806cdc0 msgr2=0x7fbcc80aeed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:12.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.945+0000 7fbcce65a640 1 --2- 172.21.15.45:0/1774464857 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbcc806cdc0 0x7fbcc80aeed0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc009870 tx=0x7fbcbc01c4b0 comp rx=0 tx=0).stop 2023-11-28T18:39:12.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.945+0000 7fbcce65a640 1 -- 172.21.15.45:0/1774464857 shutdown_connections 2023-11-28T18:39:12.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.945+0000 7fbcce65a640 1 --2- 172.21.15.45:0/1774464857 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbcc806b580 0x7fbcc806b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:12.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.945+0000 7fbcce65a640 1 --2- 172.21.15.45:0/1774464857 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbcc806cdc0 0x7fbcc80aeed0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:12.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.945+0000 7fbcce65a640 1 -- 172.21.15.45:0/1774464857 >> 172.21.15.45:0/1774464857 conn(0x7fbcc80b1b30 msgr2=0x7fbcc8070d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:12.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.945+0000 7fbcce65a640 1 -- 172.21.15.45:0/1774464857 shutdown_connections 2023-11-28T18:39:12.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.945+0000 7fbcce65a640 1 -- 172.21.15.45:0/1774464857 wait complete. 2023-11-28T18:39:12.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.945+0000 7fbcce65a640 1 Processor -- start 2023-11-28T18:39:12.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.945+0000 7fbcce65a640 1 -- start start 2023-11-28T18:39:12.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.945+0000 7fbcce65a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbcc806b580 0x7fbcc8158db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:12.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.945+0000 7fbcce65a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbcc806cdc0 0x7fbcc814e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:12.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.945+0000 7fbcce65a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbcc815d1a0 0x7fbcc8154bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:12.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.945+0000 7fbcce65a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc814e0e0 con 0x7fbcc815d1a0 2023-11-28T18:39:12.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.945+0000 7fbcce65a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc814d4f0 con 0x7fbcc806b580 2023-11-28T18:39:12.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.945+0000 7fbcce65a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc81584b0 con 0x7fbcc806cdc0 2023-11-28T18:39:12.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.945+0000 7fbcccbf7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbcc815d1a0 0x7fbcc8154bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:12.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.945+0000 7fbcc7fff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbcc806b580 0x7fbcc8158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:12.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.945+0000 7fbcccbf7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbcc815d1a0 0x7fbcc8154bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43084/0 (socket says 172.21.15.45:43084) 2023-11-28T18:39:12.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.945+0000 7fbcccbf7640 1 -- 172.21.15.45:0/3143092786 learned_addr learned my addr 172.21.15.45:0/3143092786 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:12.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.945+0000 7fbcc77fe640 1 --2- 172.21.15.45:0/3143092786 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbcc806cdc0 0x7fbcc814e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:12.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.945+0000 7fbcccbf7640 1 -- 172.21.15.45:0/3143092786 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbcc806cdc0 msgr2=0x7fbcc814e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:12.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.945+0000 7fbcccbf7640 1 --2- 172.21.15.45:0/3143092786 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbcc806cdc0 0x7fbcc814e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:12.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.945+0000 7fbcccbf7640 1 -- 172.21.15.45:0/3143092786 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbcc806b580 msgr2=0x7fbcc8158db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:12.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.945+0000 7fbcccbf7640 1 --2- 172.21.15.45:0/3143092786 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbcc806b580 0x7fbcc8158db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:12.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.945+0000 7fbcccbf7640 1 -- 172.21.15.45:0/3143092786 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcc0009a70 con 0x7fbcc815d1a0 2023-11-28T18:39:12.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.949+0000 7fbcccbf7640 1 --2- 172.21.15.45:0/3143092786 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbcc815d1a0 0x7fbcc8154bd0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fbcc0009f00 tx=0x7fbcc000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:12.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.949+0000 7fbcc4ff9640 1 -- 172.21.15.45:0/3143092786 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc0009d70 con 0x7fbcc815d1a0 2023-11-28T18:39:12.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.949+0000 7fbcc4ff9640 1 -- 172.21.15.45:0/3143092786 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcc000f040 con 0x7fbcc815d1a0 2023-11-28T18:39:12.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.949+0000 7fbcce65a640 1 -- 172.21.15.45:0/3143092786 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcbc0094d0 con 0x7fbcc815d1a0 2023-11-28T18:39:12.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.949+0000 7fbcc4ff9640 1 -- 172.21.15.45:0/3143092786 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc0003bc0 con 0x7fbcc815d1a0 2023-11-28T18:39:12.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.949+0000 7fbcce65a640 1 -- 172.21.15.45:0/3143092786 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcc814da20 con 0x7fbcc815d1a0 2023-11-28T18:39:12.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.949+0000 7fbcce65a640 1 -- 172.21.15.45:0/3143092786 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcc8069480 con 0x7fbcc815d1a0 2023-11-28T18:39:12.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.949+0000 7fbcc4ff9640 1 -- 172.21.15.45:0/3143092786 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fbcc0014480 con 0x7fbcc815d1a0 2023-11-28T18:39:12.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.949+0000 7fbcc4ff9640 1 --2- 172.21.15.45:0/3143092786 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbcb40668d0 0x7fbcb4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:12.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.949+0000 7fbcc4ff9640 1 -- 172.21.15.45:0/3143092786 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fbcc0084fd0 con 0x7fbcc815d1a0 2023-11-28T18:39:12.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.949+0000 7fbcc7fff640 1 --2- 172.21.15.45:0/3143092786 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbcb40668d0 0x7fbcb4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:12.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.953+0000 7fbcc7fff640 1 --2- 172.21.15.45:0/3143092786 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbcb40668d0 0x7fbcb4068d90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fbcb8000f70 tx=0x7fbcb8007df0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:12.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:12.953+0000 7fbcc4ff9640 1 -- 172.21.15.45:0/3143092786 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbcc0052250 con 0x7fbcc815d1a0 2023-11-28T18:39:13.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.125+0000 7fbcce65a640 1 -- 172.21.15.45:0/3143092786 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fbcc8071c50 con 0x7fbcc815d1a0 2023-11-28T18:39:13.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.125+0000 7fbcc4ff9640 1 -- 172.21.15.45:0/3143092786 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v35) v1 ==== 80+0+122 (secure 0 0 0) 0x7fbcc0055870 con 0x7fbcc815d1a0 2023-11-28T18:39:13.128 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:6834/2398964901 2023-11-29T18:39:02.760758+0000 2023-11-28T18:39:13.128 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:6832/2398964901 2023-11-29T18:39:02.760758+0000 2023-11-28T18:39:13.128 INFO:teuthology.orchestra.run.smithi045.stderr:listed 2 entries 2023-11-28T18:39:13.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.125+0000 7fbcce65a640 1 -- 172.21.15.45:0/3143092786 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbcb40668d0 msgr2=0x7fbcb4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:13.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.125+0000 7fbcce65a640 1 --2- 172.21.15.45:0/3143092786 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbcb40668d0 0x7fbcb4068d90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fbcb8000f70 tx=0x7fbcb8007df0 comp rx=0 tx=0).stop 2023-11-28T18:39:13.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.125+0000 7fbcce65a640 1 -- 172.21.15.45:0/3143092786 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbcc815d1a0 msgr2=0x7fbcc8154bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:13.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.125+0000 7fbcce65a640 1 --2- 172.21.15.45:0/3143092786 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbcc815d1a0 0x7fbcc8154bd0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fbcc0009f00 tx=0x7fbcc000c490 comp rx=0 tx=0).stop 2023-11-28T18:39:13.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.125+0000 7fbcce65a640 1 -- 172.21.15.45:0/3143092786 shutdown_connections 2023-11-28T18:39:13.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.125+0000 7fbcce65a640 1 --2- 172.21.15.45:0/3143092786 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbcb40668d0 0x7fbcb4068d90 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:13.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.125+0000 7fbcce65a640 1 --2- 172.21.15.45:0/3143092786 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbcc815d1a0 0x7fbcc8154bd0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:13.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.125+0000 7fbcce65a640 1 --2- 172.21.15.45:0/3143092786 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbcc806cdc0 0x7fbcc814e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:13.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.125+0000 7fbcce65a640 1 --2- 172.21.15.45:0/3143092786 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbcc806b580 0x7fbcc8158db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:13.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.125+0000 7fbcce65a640 1 -- 172.21.15.45:0/3143092786 >> 172.21.15.45:0/3143092786 conn(0x7fbcc80b1b30 msgr2=0x7fbcc8159930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:13.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.125+0000 7fbcce65a640 1 -- 172.21.15.45:0/3143092786 shutdown_connections 2023-11-28T18:39:13.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.125+0000 7fbcce65a640 1 -- 172.21.15.45:0/3143092786 wait complete. 2023-11-28T18:39:13.149 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T18:39:13.149 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T18:39:13.159 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T18:39:13.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.341+0000 7fedc6ddf640 1 Processor -- start 2023-11-28T18:39:13.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.341+0000 7fedc6ddf640 1 -- start start 2023-11-28T18:39:13.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.341+0000 7fedc6ddf640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fedc006ca10 0x7fedc015a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:13.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.341+0000 7fedc6ddf640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedc015b3e0 con 0x7fedc013cf70 2023-11-28T18:39:13.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.341+0000 7fedc6ddf640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedc013f760 con 0x7fedc015abb0 2023-11-28T18:39:13.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.341+0000 7fedc6ddf640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedc013d350 con 0x7fedc006ca10 2023-11-28T18:39:13.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.341+0000 7fedc4b7b640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fedc013cf70 0x7fedc006c300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38908/0 (socket says 172.21.15.45:38908) 2023-11-28T18:39:13.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.341+0000 7fedc4b7b640 1 -- 172.21.15.45:0/3215212957 learned_addr learned my addr 172.21.15.45:0/3215212957 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:39:13.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.345+0000 7fedbffff640 1 --2- 172.21.15.45:0/3215212957 >> v2:172.21.15.190:3300/0 conn(0x7fedc006ca10 0x7fedc015a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:13.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.345+0000 7fedbf7fe640 1 -- 172.21.15.45:0/3215212957 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2457535626 0 0) 0x7fedc015b3e0 con 0x7fedc013cf70 2023-11-28T18:39:13.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.345+0000 7fedbf7fe640 1 -- 172.21.15.45:0/3215212957 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedb0005740 con 0x7fedc013cf70 2023-11-28T18:39:13.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.345+0000 7fedbf7fe640 1 -- 172.21.15.45:0/3215212957 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2693596471 0 0) 0x7fedc013f760 con 0x7fedc015abb0 2023-11-28T18:39:13.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.345+0000 7fedbf7fe640 1 -- 172.21.15.45:0/3215212957 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedc015b3e0 con 0x7fedc015abb0 2023-11-28T18:39:13.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.345+0000 7fedbffff640 1 -- 172.21.15.45:0/3215212957 >> v1:172.21.15.190:6789/0 conn(0x7fedc015abb0 legacy=0x7fedc00cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:13.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.345+0000 7fedbffff640 1 -- 172.21.15.45:0/3215212957 >> v1:172.21.15.45:6789/0 conn(0x7fedc013cf70 legacy=0x7fedc006c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:13.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.345+0000 7fedbffff640 1 -- 172.21.15.45:0/3215212957 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc013fa40 con 0x7fedc006ca10 2023-11-28T18:39:13.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.345+0000 7fedbffff640 1 --2- 172.21.15.45:0/3215212957 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fedc006ca10 0x7fedc015a670 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fedac0097c0 tx=0x7fedac01c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41af26ec9d8d8fd6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:13.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.345+0000 7fedbf7fe640 1 -- 172.21.15.45:0/3215212957 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedac0ab600 con 0x7fedc006ca10 2023-11-28T18:39:13.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.345+0000 7fedbf7fe640 1 -- 172.21.15.45:0/3215212957 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedac0a7050 con 0x7fedc006ca10 2023-11-28T18:39:13.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.345+0000 7fedbf7fe640 1 -- 172.21.15.45:0/3215212957 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedac0ab980 con 0x7fedc006ca10 2023-11-28T18:39:13.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.349+0000 7fedc6ddf640 1 -- 172.21.15.45:0/3215212957 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fedc006ca10 msgr2=0x7fedc015a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:13.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.349+0000 7fedc6ddf640 1 --2- 172.21.15.45:0/3215212957 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fedc006ca10 0x7fedc015a670 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fedac0097c0 tx=0x7fedac01c3f0 comp rx=0 tx=0).stop 2023-11-28T18:39:13.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.349+0000 7fedc6ddf640 1 -- 172.21.15.45:0/3215212957 shutdown_connections 2023-11-28T18:39:13.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.349+0000 7fedc6ddf640 1 --2- 172.21.15.45:0/3215212957 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fedc006ca10 0x7fedc015a670 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:13.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.349+0000 7fedc6ddf640 1 -- 172.21.15.45:0/3215212957 >> 172.21.15.45:0/3215212957 conn(0x7fedc006a570 msgr2=0x7fedc006a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:13.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.349+0000 7fedc6ddf640 1 -- 172.21.15.45:0/3215212957 shutdown_connections 2023-11-28T18:39:13.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.349+0000 7fedc6ddf640 1 -- 172.21.15.45:0/3215212957 wait complete. 2023-11-28T18:39:13.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.349+0000 7fedc6ddf640 1 Processor -- start 2023-11-28T18:39:13.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.349+0000 7fedc6ddf640 1 -- start start 2023-11-28T18:39:13.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.349+0000 7fedc6ddf640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fedc006ca10 0x7fedc0153e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:13.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.349+0000 7fedc6ddf640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fedc013cf70 0x7fedc0136ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:13.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.349+0000 7fedc6ddf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fedc015abb0 0x7fedc0139c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:13.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.349+0000 7fedc6ddf640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc01543b0 con 0x7fedc015abb0 2023-11-28T18:39:13.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.349+0000 7fedc6ddf640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc0156490 con 0x7fedc006ca10 2023-11-28T18:39:13.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.349+0000 7fedc6ddf640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedc01526b0 con 0x7fedc013cf70 2023-11-28T18:39:13.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.349+0000 7fedc537c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fedc015abb0 0x7fedc0139c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:13.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.349+0000 7fedc537c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fedc015abb0 0x7fedc0139c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43090/0 (socket says 172.21.15.45:43090) 2023-11-28T18:39:13.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.349+0000 7fedc537c640 1 -- 172.21.15.45:0/3792453081 learned_addr learned my addr 172.21.15.45:0/3792453081 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:13.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.349+0000 7fedc4b7b640 1 --2- 172.21.15.45:0/3792453081 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fedc006ca10 0x7fedc0153e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:13.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.349+0000 7fedbffff640 1 --2- 172.21.15.45:0/3792453081 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fedc013cf70 0x7fedc0136ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:13.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.353+0000 7fedc537c640 1 -- 172.21.15.45:0/3792453081 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fedc013cf70 msgr2=0x7fedc0136ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:13.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.353+0000 7fedc537c640 1 --2- 172.21.15.45:0/3792453081 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fedc013cf70 0x7fedc0136ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:13.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.353+0000 7fedc537c640 1 -- 172.21.15.45:0/3792453081 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fedc006ca10 msgr2=0x7fedc0153e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:13.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.353+0000 7fedc537c640 1 --2- 172.21.15.45:0/3792453081 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fedc006ca10 0x7fedc0153e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:13.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.353+0000 7fedc537c640 1 -- 172.21.15.45:0/3792453081 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedac009420 con 0x7fedc015abb0 2023-11-28T18:39:13.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.353+0000 7fedc537c640 1 --2- 172.21.15.45:0/3792453081 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fedc015abb0 0x7fedc0139c90 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fedb800c760 tx=0x7fedb800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:13.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.353+0000 7fedbd7fa640 1 -- 172.21.15.45:0/3792453081 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb8003b80 con 0x7fedc015abb0 2023-11-28T18:39:13.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.353+0000 7fedbd7fa640 1 -- 172.21.15.45:0/3792453081 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedb8003ce0 con 0x7fedc015abb0 2023-11-28T18:39:13.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.353+0000 7fedbd7fa640 1 -- 172.21.15.45:0/3792453081 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb800aa90 con 0x7fedc015abb0 2023-11-28T18:39:13.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.353+0000 7fedc6ddf640 1 -- 172.21.15.45:0/3792453081 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedc0155e40 con 0x7fedc015abb0 2023-11-28T18:39:13.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.353+0000 7fedc6ddf640 1 -- 172.21.15.45:0/3792453081 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedc0152990 con 0x7fedc015abb0 2023-11-28T18:39:13.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.353+0000 7fedc6ddf640 1 -- 172.21.15.45:0/3792453081 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedc0069480 con 0x7fedc015abb0 2023-11-28T18:39:13.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.353+0000 7fedbd7fa640 1 -- 172.21.15.45:0/3792453081 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fedb800abf0 con 0x7fedc015abb0 2023-11-28T18:39:13.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.353+0000 7fedbd7fa640 1 --2- 172.21.15.45:0/3792453081 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7feda4066900 0x7feda4068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:13.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.353+0000 7fedbd7fa640 1 -- 172.21.15.45:0/3792453081 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fedb8084150 con 0x7fedc015abb0 2023-11-28T18:39:13.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.357+0000 7fedc4b7b640 1 --2- 172.21.15.45:0/3792453081 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7feda4066900 0x7feda4068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:13.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.357+0000 7fedc4b7b640 1 --2- 172.21.15.45:0/3792453081 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7feda4066900 0x7feda4068dc0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fedb40011f0 tx=0x7fedb4007d40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:13.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.361+0000 7fedbd7fa640 1 -- 172.21.15.45:0/3792453081 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fedb80513d0 con 0x7fedc015abb0 2023-11-28T18:39:13.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.517+0000 7fedc6ddf640 1 -- 172.21.15.45:0/3792453081 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fedc006d220 con 0x7fedc015abb0 2023-11-28T18:39:13.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.517+0000 7fedbd7fa640 1 -- 172.21.15.45:0/3792453081 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16662 (secure 0 0 0) 0x7fedb80549f0 con 0x7fedc015abb0 2023-11-28T18:39:13.520 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:39:13.520 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":35,"fsid":"d10f5cd6-1d00-4019-99b6-6fa435498a15","created":"2023-11-28T18:37:08.189030+0000","modified":"2023-11-28T18:39:02.760784+0000","last_up_change":"2023-11-28T18:37:20.196124+0000","last_in_change":"2023-11-28T18:37:10.742043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T18:37:21.293917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-28T18:38:33.254037+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-28T18:38:34.414654+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"84465384-103c-4f2c-a45a-96f5bb9c835f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6809","nonce":555237322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6811","nonce":555237322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6815","nonce":555237322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6813","nonce":555237322}]},"public_addr":"172.21.15.45:6809/555237322","cluster_addr":"172.21.15.45:6811/555237322","heartbeat_back_addr":"172.21.15.45:6815/555237322","heartbeat_front_addr":"172.21.15.45:6813/555237322","state":["exists","up"]},{"osd":1,"uuid":"7d9eed24-a58f-42c7-a787-ac06be8553fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6801","nonce":2857063763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6803","nonce":2857063763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6807","nonce":2857063763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6805","nonce":2857063763}]},"public_addr":"172.21.15.45:6801/2857063763","cluster_addr":"172.21.15.45:6803/2857063763","heartbeat_back_addr":"172.21.15.45:6807/2857063763","heartbeat_front_addr":"172.21.15.45:6805/2857063763","state":["exists","up"]},{"osd":2,"uuid":"575eeccc-4abf-45b4-9caf-f3e797859588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6817","nonce":193884539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6819","nonce":193884539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6823","nonce":193884539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6821","nonce":193884539}]},"public_addr":"172.21.15.45:6817/193884539","cluster_addr":"172.21.15.45:6819/193884539","heartbeat_back_addr":"172.21.15.45:6823/193884539","heartbeat_front_addr":"172.21.15.45:6821/193884539","state":["exists","up"]},{"osd":3,"uuid":"9b0290d6-9a52-4bc8-b2a1-7622c5dc8e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6825","nonce":78541084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6827","nonce":78541084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6831","nonce":78541084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6829","nonce":78541084}]},"public_addr":"172.21.15.45:6825/78541084","cluster_addr":"172.21.15.45:6827/78541084","heartbeat_back_addr":"172.21.15.45:6831/78541084","heartbeat_front_addr":"172.21.15.45:6829/78541084","state":["exists","up"]},{"osd":4,"uuid":"ce632829-f027-4fbf-a627-02c571aa9d53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6809","nonce":1537591987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6811","nonce":1537591987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6815","nonce":1537591987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6813","nonce":1537591987}]},"public_addr":"172.21.15.190:6809/1537591987","cluster_addr":"172.21.15.190:6811/1537591987","heartbeat_back_addr":"172.21.15.190:6815/1537591987","heartbeat_front_addr":"172.21.15.190:6813/1537591987","state":["exists","up"]},{"osd":5,"uuid":"8700b609-27be-40bd-a251-4c0ae0a29ead","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6801","nonce":3296698407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6803","nonce":3296698407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6807","nonce":3296698407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6805","nonce":3296698407}]},"public_addr":"172.21.15.190:6801/3296698407","cluster_addr":"172.21.15.190:6803/3296698407","heartbeat_back_addr":"172.21.15.190:6807/3296698407","heartbeat_front_addr":"172.21.15.190:6805/3296698407","state":["exists","up"]},{"osd":6,"uuid":"44ce4a40-e6ff-4f4d-8e8a-7341e5c91f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6817","nonce":2317686718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6819","nonce":2317686718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6823","nonce":2317686718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6821","nonce":2317686718}]},"public_addr":"172.21.15.190:6817/2317686718","cluster_addr":"172.21.15.190:6819/2317686718","heartbeat_back_addr":"172.21.15.190:6823/2317686718","heartbeat_front_addr":"172.21.15.190:6821/2317686718","state":["exists","up"]},{"osd":7,"uuid":"192238c9-1423-4b7e-ac8f-84ba32113ddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6825","nonce":2493232051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6827","nonce":2493232051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6831","nonce":2493232051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6829","nonce":2493232051}]},"public_addr":"172.21.15.190:6825/2493232051","cluster_addr":"172.21.15.190:6827/2493232051","heartbeat_back_addr":"172.21.15.190:6831/2493232051","heartbeat_front_addr":"172.21.15.190:6829/2493232051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.393552+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.385453+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.361421+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.366408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.363226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.276007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.414605+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.445885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6834/2398964901":"2023-11-29T18:39:02.760758+0000","172.21.15.45:6832/2398964901":"2023-11-29T18:39:02.760758+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T18:39:13.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.517+0000 7fedc6ddf640 1 -- 172.21.15.45:0/3792453081 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7feda4066900 msgr2=0x7feda4068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:13.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.517+0000 7fedc6ddf640 1 --2- 172.21.15.45:0/3792453081 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7feda4066900 0x7feda4068dc0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fedb40011f0 tx=0x7fedb4007d40 comp rx=0 tx=0).stop 2023-11-28T18:39:13.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.517+0000 7fedc6ddf640 1 -- 172.21.15.45:0/3792453081 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fedc015abb0 msgr2=0x7fedc0139c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:13.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.517+0000 7fedc6ddf640 1 --2- 172.21.15.45:0/3792453081 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fedc015abb0 0x7fedc0139c90 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fedb800c760 tx=0x7fedb800cc20 comp rx=0 tx=0).stop 2023-11-28T18:39:13.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.517+0000 7fedc6ddf640 1 -- 172.21.15.45:0/3792453081 shutdown_connections 2023-11-28T18:39:13.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.517+0000 7fedc6ddf640 1 --2- 172.21.15.45:0/3792453081 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7feda4066900 0x7feda4068dc0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:13.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.517+0000 7fedc6ddf640 1 --2- 172.21.15.45:0/3792453081 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fedc015abb0 0x7fedc0139c90 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:13.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.517+0000 7fedc6ddf640 1 --2- 172.21.15.45:0/3792453081 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fedc013cf70 0x7fedc0136ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:13.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.517+0000 7fedc6ddf640 1 --2- 172.21.15.45:0/3792453081 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fedc006ca10 0x7fedc0153e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:13.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.517+0000 7fedc6ddf640 1 -- 172.21.15.45:0/3792453081 >> 172.21.15.45:0/3792453081 conn(0x7fedc006a570 msgr2=0x7fedc00cd880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:13.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.517+0000 7fedc6ddf640 1 -- 172.21.15.45:0/3792453081 shutdown_connections 2023-11-28T18:39:13.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.517+0000 7fedc6ddf640 1 -- 172.21.15.45:0/3792453081 wait complete. 2023-11-28T18:39:13.542 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T18:37:21.293917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T18:38:33.254037+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T18:38:34.414654+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T18:39:13.542 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T18:39:13.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.685+0000 7f0cf29f8640 1 Processor -- start 2023-11-28T18:39:13.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.685+0000 7f0cf29f8640 1 -- start start 2023-11-28T18:39:13.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.685+0000 7f0cf29f8640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f0cec0cba50 0x7f0cec15be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:13.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.685+0000 7f0cf29f8640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cec15b6b0 con 0x7f0cec158ce0 2023-11-28T18:39:13.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.685+0000 7f0cf29f8640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cec15f450 con 0x7f0cec0b4310 2023-11-28T18:39:13.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.685+0000 7f0cf29f8640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cec15f730 con 0x7f0cec0cba50 2023-11-28T18:39:13.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.685+0000 7f0cebfff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f0cec158ce0 0x7f0cec15eb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38918/0 (socket says 172.21.15.45:38918) 2023-11-28T18:39:13.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.685+0000 7f0cebfff640 1 -- 172.21.15.45:0/3713097517 learned_addr learned my addr 172.21.15.45:0/3713097517 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:39:13.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.685+0000 7f0ceb7fe640 1 --2- 172.21.15.45:0/3713097517 >> v2:172.21.15.190:3300/0 conn(0x7f0cec0cba50 0x7f0cec15be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:13.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.689+0000 7f0ceaffd640 1 -- 172.21.15.45:0/3713097517 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3907441281 0 0) 0x7f0cec15b6b0 con 0x7f0cec158ce0 2023-11-28T18:39:13.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.689+0000 7f0ceaffd640 1 -- 172.21.15.45:0/3713097517 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0cd4003530 con 0x7f0cec158ce0 2023-11-28T18:39:13.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.689+0000 7f0ceb7fe640 1 -- 172.21.15.45:0/3713097517 >> v1:172.21.15.190:6789/0 conn(0x7f0cec0b4310 legacy=0x7f0cec070430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:13.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.689+0000 7f0ceb7fe640 1 -- 172.21.15.45:0/3713097517 >> v1:172.21.15.45:6789/0 conn(0x7f0cec158ce0 legacy=0x7f0cec15eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:13.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.689+0000 7f0ceb7fe640 1 -- 172.21.15.45:0/3713097517 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cec15b920 con 0x7f0cec0cba50 2023-11-28T18:39:13.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.689+0000 7f0ceb7fe640 1 --2- 172.21.15.45:0/3713097517 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0cec0cba50 0x7f0cec15be40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0ce00097c0 tx=0x7f0ce001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b025a6142eec483 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:13.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.689+0000 7f0ceaffd640 1 -- 172.21.15.45:0/3713097517 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce00a8050 con 0x7f0cec0cba50 2023-11-28T18:39:13.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.689+0000 7f0ceaffd640 1 -- 172.21.15.45:0/3713097517 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ce00ac5f0 con 0x7f0cec0cba50 2023-11-28T18:39:13.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.689+0000 7f0ceaffd640 1 -- 172.21.15.45:0/3713097517 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce00ac960 con 0x7f0cec0cba50 2023-11-28T18:39:13.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.693+0000 7f0cf29f8640 1 -- 172.21.15.45:0/3713097517 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0cec0cba50 msgr2=0x7f0cec15be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:13.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.693+0000 7f0cf29f8640 1 --2- 172.21.15.45:0/3713097517 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0cec0cba50 0x7f0cec15be40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0ce00097c0 tx=0x7f0ce001c480 comp rx=0 tx=0).stop 2023-11-28T18:39:13.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.693+0000 7f0cf29f8640 1 -- 172.21.15.45:0/3713097517 shutdown_connections 2023-11-28T18:39:13.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.693+0000 7f0cf29f8640 1 --2- 172.21.15.45:0/3713097517 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0cec0cba50 0x7f0cec15be40 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:13.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.693+0000 7f0cf29f8640 1 -- 172.21.15.45:0/3713097517 >> 172.21.15.45:0/3713097517 conn(0x7f0cec0b0d00 msgr2=0x7f0cec0b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:13.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.693+0000 7f0cf29f8640 1 -- 172.21.15.45:0/3713097517 shutdown_connections 2023-11-28T18:39:13.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.693+0000 7f0cf29f8640 1 -- 172.21.15.45:0/3713097517 wait complete. 2023-11-28T18:39:13.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.693+0000 7f0cf29f8640 1 Processor -- start 2023-11-28T18:39:13.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.693+0000 7f0cf29f8640 1 -- start start 2023-11-28T18:39:13.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.693+0000 7f0cf29f8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0cec0b4310 0x7f0cec146fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:13.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.693+0000 7f0cf29f8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0cec0cba50 0x7f0cec165120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:13.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.693+0000 7f0cf29f8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0cec158ce0 0x7f0cec165660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:13.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.693+0000 7f0cf29f8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cec15fd60 con 0x7f0cec0cba50 2023-11-28T18:39:13.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.693+0000 7f0cf29f8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cec160040 con 0x7f0cec0b4310 2023-11-28T18:39:13.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.693+0000 7f0cf29f8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cec160320 con 0x7f0cec158ce0 2023-11-28T18:39:13.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.693+0000 7f0ceb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0cec0cba50 0x7f0cec165120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:13.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.693+0000 7f0ceb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0cec0cba50 0x7f0cec165120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43102/0 (socket says 172.21.15.45:43102) 2023-11-28T18:39:13.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.693+0000 7f0ceb7fe640 1 -- 172.21.15.45:0/875200307 learned_addr learned my addr 172.21.15.45:0/875200307 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:13.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.693+0000 7f0cebfff640 1 --2- 172.21.15.45:0/875200307 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0cec0b4310 0x7f0cec146fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:13.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.693+0000 7f0cf0f95640 1 --2- 172.21.15.45:0/875200307 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0cec158ce0 0x7f0cec165660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:13.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.693+0000 7f0ceb7fe640 1 -- 172.21.15.45:0/875200307 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0cec158ce0 msgr2=0x7f0cec165660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:13.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.693+0000 7f0ceb7fe640 1 --2- 172.21.15.45:0/875200307 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0cec158ce0 0x7f0cec165660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:13.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.693+0000 7f0ceb7fe640 1 -- 172.21.15.45:0/875200307 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0cec0b4310 msgr2=0x7f0cec146fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:13.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.693+0000 7f0ceb7fe640 1 --2- 172.21.15.45:0/875200307 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0cec0b4310 0x7f0cec146fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:13.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.693+0000 7f0ceb7fe640 1 -- 172.21.15.45:0/875200307 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce0009420 con 0x7f0cec0cba50 2023-11-28T18:39:13.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.693+0000 7f0cf0f95640 1 --2- 172.21.15.45:0/875200307 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0cec158ce0 0x7f0cec165660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:39:13.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.693+0000 7f0cebfff640 1 --2- 172.21.15.45:0/875200307 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0cec0b4310 0x7f0cec146fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:39:13.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.697+0000 7f0ceb7fe640 1 --2- 172.21.15.45:0/875200307 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0cec0cba50 0x7f0cec165120 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f0ce001ab30 tx=0x7f0ce0019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:13.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.697+0000 7f0ce8ff9640 1 -- 172.21.15.45:0/875200307 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce0006e20 con 0x7f0cec0cba50 2023-11-28T18:39:13.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.697+0000 7f0ce8ff9640 1 -- 172.21.15.45:0/875200307 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ce0004030 con 0x7f0cec0cba50 2023-11-28T18:39:13.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.697+0000 7f0ce8ff9640 1 -- 172.21.15.45:0/875200307 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce00043a0 con 0x7f0cec0cba50 2023-11-28T18:39:13.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.697+0000 7f0cf29f8640 1 -- 172.21.15.45:0/875200307 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cec160600 con 0x7f0cec0cba50 2023-11-28T18:39:13.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.697+0000 7f0cf29f8640 1 -- 172.21.15.45:0/875200307 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cec163e00 con 0x7f0cec0cba50 2023-11-28T18:39:13.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.697+0000 7f0cf29f8640 1 -- 172.21.15.45:0/875200307 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cec069410 con 0x7f0cec0cba50 2023-11-28T18:39:13.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.697+0000 7f0ce8ff9640 1 -- 172.21.15.45:0/875200307 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f0ce00b3040 con 0x7f0cec0cba50 2023-11-28T18:39:13.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.697+0000 7f0ce8ff9640 1 --2- 172.21.15.45:0/875200307 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f0cd80668d0 0x7f0cd8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:13.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.697+0000 7f0ce8ff9640 1 -- 172.21.15.45:0/875200307 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f0ce011da00 con 0x7f0cec0cba50 2023-11-28T18:39:13.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.697+0000 7f0cebfff640 1 --2- 172.21.15.45:0/875200307 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f0cd80668d0 0x7f0cd8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:13.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.701+0000 7f0cebfff640 1 --2- 172.21.15.45:0/875200307 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f0cd80668d0 0x7f0cd8068d90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc0011f0 tx=0x7f0cdc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:13.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.701+0000 7f0ce8ff9640 1 -- 172.21.15.45:0/875200307 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0ce00eab40 con 0x7f0cec0cba50 2023-11-28T18:39:13.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.861+0000 7f0cf29f8640 1 -- 172.21.15.45:0/875200307 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0cec15fea0 con 0x7f0cec0cba50 2023-11-28T18:39:13.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.861+0000 7f0ce8ff9640 1 -- 172.21.15.45:0/875200307 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0cec15fea0 con 0x7f0cec0cba50 2023-11-28T18:39:13.865 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-11-28T18:39:13.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.865+0000 7f0cf29f8640 1 -- 172.21.15.45:0/875200307 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f0cd80668d0 msgr2=0x7f0cd8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:13.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.865+0000 7f0cf29f8640 1 --2- 172.21.15.45:0/875200307 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f0cd80668d0 0x7f0cd8068d90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc0011f0 tx=0x7f0cdc009040 comp rx=0 tx=0).stop 2023-11-28T18:39:13.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.865+0000 7f0cf29f8640 1 -- 172.21.15.45:0/875200307 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0cec0cba50 msgr2=0x7f0cec165120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:13.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.865+0000 7f0cf29f8640 1 --2- 172.21.15.45:0/875200307 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0cec0cba50 0x7f0cec165120 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f0ce001ab30 tx=0x7f0ce0019220 comp rx=0 tx=0).stop 2023-11-28T18:39:13.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.865+0000 7f0cf29f8640 1 -- 172.21.15.45:0/875200307 shutdown_connections 2023-11-28T18:39:13.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.865+0000 7f0cf29f8640 1 --2- 172.21.15.45:0/875200307 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f0cd80668d0 0x7f0cd8068d90 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:13.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.865+0000 7f0cf29f8640 1 --2- 172.21.15.45:0/875200307 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0cec158ce0 0x7f0cec165660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:13.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.865+0000 7f0cf29f8640 1 --2- 172.21.15.45:0/875200307 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0cec0cba50 0x7f0cec165120 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:13.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.865+0000 7f0cf29f8640 1 --2- 172.21.15.45:0/875200307 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0cec0b4310 0x7f0cec146fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:13.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.865+0000 7f0cf29f8640 1 -- 172.21.15.45:0/875200307 >> 172.21.15.45:0/875200307 conn(0x7f0cec0b0d00 msgr2=0x7f0cec0cbe80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:13.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.865+0000 7f0cf29f8640 1 -- 172.21.15.45:0/875200307 shutdown_connections 2023-11-28T18:39:13.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:13.865+0000 7f0cf29f8640 1 -- 172.21.15.45:0/875200307 wait complete. 2023-11-28T18:39:13.886 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T18:39:14.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.029+0000 7fb30089a640 1 Processor -- start 2023-11-28T18:39:14.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.029+0000 7fb30089a640 1 -- start start 2023-11-28T18:39:14.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.029+0000 7fb30089a640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fb2fc0ce9a0 0x7fb2fc0ae0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:14.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.029+0000 7fb30089a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb2fc0ced80 0x7fb2fc06b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:14.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.029+0000 7fb30089a640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2fc0af1c0 con 0x7fb2fc15e4d0 2023-11-28T18:39:14.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.029+0000 7fb30089a640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2fc0ae920 con 0x7fb2fc0ce9a0 2023-11-28T18:39:14.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.029+0000 7fb30089a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2fc0aec00 con 0x7fb2fc0ced80 2023-11-28T18:39:14.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.029+0000 7fb2fad9d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fb2fc15e4d0 0x7fb2fc160dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38934/0 (socket says 172.21.15.45:38934) 2023-11-28T18:39:14.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.029+0000 7fb2fad9d640 1 -- 172.21.15.45:0/3818678265 learned_addr learned my addr 172.21.15.45:0/3818678265 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:39:14.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.029+0000 7fb2fa59c640 1 --2- 172.21.15.45:0/3818678265 >> v2:172.21.15.190:3300/0 conn(0x7fb2fc0ce9a0 0x7fb2fc0ae0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:14.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.029+0000 7fb2f9d9b640 1 --2- 172.21.15.45:0/3818678265 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb2fc0ced80 0x7fb2fc06b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:14.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.029+0000 7fb2f959a640 1 -- 172.21.15.45:0/3818678265 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3096064433 0 0) 0x7fb2fc0af1c0 con 0x7fb2fc15e4d0 2023-11-28T18:39:14.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.029+0000 7fb2f959a640 1 -- 172.21.15.45:0/3818678265 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2e8003530 con 0x7fb2fc15e4d0 2023-11-28T18:39:14.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.029+0000 7fb2f959a640 1 -- 172.21.15.45:0/3818678265 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 540259314 0 0) 0x7fb2e8003530 con 0x7fb2fc15e4d0 2023-11-28T18:39:14.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.029+0000 7fb2f959a640 1 -- 172.21.15.45:0/3818678265 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb2fc0ced80 msgr2=0x7fb2fc06b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:14.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.029+0000 7fb2f959a640 1 --2- 172.21.15.45:0/3818678265 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb2fc0ced80 0x7fb2fc06b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:14.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.029+0000 7fb2f959a640 1 -- 172.21.15.45:0/3818678265 >> v2:172.21.15.190:3300/0 conn(0x7fb2fc0ce9a0 msgr2=0x7fb2fc0ae0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:14.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.029+0000 7fb2f959a640 1 --2- 172.21.15.45:0/3818678265 >> v2:172.21.15.190:3300/0 conn(0x7fb2fc0ce9a0 0x7fb2fc0ae0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:14.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.029+0000 7fb2f959a640 1 -- 172.21.15.45:0/3818678265 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2fc0aeee0 con 0x7fb2fc15e4d0 2023-11-28T18:39:14.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.029+0000 7fb2f959a640 1 -- 172.21.15.45:0/3818678265 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4084481567 0 0) 0x7fb2ec001680 con 0x7fb2fc15e4d0 2023-11-28T18:39:14.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.029+0000 7fb2fa59c640 1 --2- 172.21.15.45:0/3818678265 >> v2:172.21.15.190:3300/0 conn(0x7fb2fc0ce9a0 0x7fb2fc0ae0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:39:14.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.033+0000 7fb2f959a640 1 -- 172.21.15.45:0/3818678265 >> v1:172.21.15.45:6789/0 conn(0x7fb2fc15e4d0 legacy=0x7fb2fc160dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:14.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.033+0000 7fb2f959a640 1 --2- 172.21.15.45:0/3818678265 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb2e8003980 0x7fb2e8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:14.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.033+0000 7fb2f959a640 1 --2- 172.21.15.45:0/3818678265 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2e80047d0 0x7fb2e8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:14.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.033+0000 7fb2f959a640 1 --2- 172.21.15.45:0/3818678265 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb2fc0ced80 0x7fb2e8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:14.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.033+0000 7fb2f959a640 1 -- 172.21.15.45:0/3818678265 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2fc0ae920 con 0x7fb2e80047d0 2023-11-28T18:39:14.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.033+0000 7fb2f959a640 1 -- 172.21.15.45:0/3818678265 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2fc0aec00 con 0x7fb2e8003980 2023-11-28T18:39:14.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.033+0000 7fb2f959a640 1 -- 172.21.15.45:0/3818678265 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e800ba40 con 0x7fb2fc0ced80 2023-11-28T18:39:14.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.033+0000 7fb2f9d9b640 1 --2- 172.21.15.45:0/3818678265 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2e80047d0 0x7fb2e8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:14.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.033+0000 7fb2fa59c640 1 --2- 172.21.15.45:0/3818678265 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb2e8003980 0x7fb2e8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:14.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.033+0000 7fb2fad9d640 1 --2- 172.21.15.45:0/3818678265 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb2fc0ced80 0x7fb2e8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:14.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.033+0000 7fb2f9d9b640 1 -- 172.21.15.45:0/3818678265 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb2fc0ced80 msgr2=0x7fb2e8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:14.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.033+0000 7fb2f9d9b640 1 --2- 172.21.15.45:0/3818678265 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb2fc0ced80 0x7fb2e8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:14.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.033+0000 7fb2f9d9b640 1 -- 172.21.15.45:0/3818678265 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb2e8003980 msgr2=0x7fb2e8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:14.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.033+0000 7fb2f9d9b640 1 --2- 172.21.15.45:0/3818678265 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb2e8003980 0x7fb2e8003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:14.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.033+0000 7fb2f9d9b640 1 -- 172.21.15.45:0/3818678265 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e8003530 con 0x7fb2e80047d0 2023-11-28T18:39:14.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.033+0000 7fb2f9d9b640 1 --2- 172.21.15.45:0/3818678265 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2e80047d0 0x7fb2e8004c50 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fb2e4009ab0 tx=0x7fb2e401ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dcfa7d520e986eb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:14.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.033+0000 7fb2f959a640 1 -- 172.21.15.45:0/3818678265 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e40a5560 con 0x7fb2e80047d0 2023-11-28T18:39:14.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.033+0000 7fb2f959a640 1 -- 172.21.15.45:0/3818678265 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2e40a56c0 con 0x7fb2e80047d0 2023-11-28T18:39:14.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.033+0000 7fb2f959a640 1 -- 172.21.15.45:0/3818678265 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e40a5a70 con 0x7fb2e80047d0 2023-11-28T18:39:14.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.037+0000 7fb30089a640 1 -- 172.21.15.45:0/3818678265 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2e80047d0 msgr2=0x7fb2e8004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:14.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.037+0000 7fb30089a640 1 --2- 172.21.15.45:0/3818678265 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2e80047d0 0x7fb2e8004c50 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fb2e4009ab0 tx=0x7fb2e401ca00 comp rx=0 tx=0).stop 2023-11-28T18:39:14.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.037+0000 7fb2fad9d640 1 -- 172.21.15.45:0/3818678265 reap_dead start 2023-11-28T18:39:14.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.037+0000 7fb30089a640 1 -- 172.21.15.45:0/3818678265 shutdown_connections 2023-11-28T18:39:14.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.037+0000 7fb30089a640 1 -- 172.21.15.45:0/3818678265 >> 172.21.15.45:0/3818678265 conn(0x7fb2fc0b1b70 msgr2=0x7fb2fc070cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:14.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.037+0000 7fb30089a640 1 -- 172.21.15.45:0/3818678265 shutdown_connections 2023-11-28T18:39:14.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.037+0000 7fb30089a640 1 -- 172.21.15.45:0/3818678265 wait complete. 2023-11-28T18:39:14.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.037+0000 7fb30089a640 1 Processor -- start 2023-11-28T18:39:14.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.037+0000 7fb30089a640 1 -- start start 2023-11-28T18:39:14.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.037+0000 7fb30089a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb2e80047d0 0x7fb2fc13ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:14.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.037+0000 7fb30089a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb2fc14b150 0x7fb2fc14b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:14.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.037+0000 7fb30089a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2fc15f810 0x7fb2fc15fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:14.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.037+0000 7fb30089a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2fc1601e0 con 0x7fb2fc15f810 2023-11-28T18:39:14.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.037+0000 7fb30089a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2fc06dc60 con 0x7fb2e80047d0 2023-11-28T18:39:14.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.037+0000 7fb30089a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2fc06df40 con 0x7fb2fc14b150 2023-11-28T18:39:14.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.041+0000 7fb2fad9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2fc15f810 0x7fb2fc15fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:14.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.041+0000 7fb2fad9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2fc15f810 0x7fb2fc15fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43124/0 (socket says 172.21.15.45:43124) 2023-11-28T18:39:14.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.041+0000 7fb2fad9d640 1 -- 172.21.15.45:0/3114743878 learned_addr learned my addr 172.21.15.45:0/3114743878 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:14.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.041+0000 7fb2fa59c640 1 --2- 172.21.15.45:0/3114743878 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb2e80047d0 0x7fb2fc13ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:14.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.041+0000 7fb2f9d9b640 1 --2- 172.21.15.45:0/3114743878 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb2fc14b150 0x7fb2fc14b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:14.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.041+0000 7fb2fad9d640 1 -- 172.21.15.45:0/3114743878 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb2fc14b150 msgr2=0x7fb2fc14b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:14.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.041+0000 7fb2fad9d640 1 --2- 172.21.15.45:0/3114743878 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb2fc14b150 0x7fb2fc14b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:14.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.041+0000 7fb2fad9d640 1 -- 172.21.15.45:0/3114743878 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb2e80047d0 msgr2=0x7fb2fc13ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:14.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.041+0000 7fb2fad9d640 1 --2- 172.21.15.45:0/3114743878 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb2e80047d0 0x7fb2fc13ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:14.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.041+0000 7fb2fad9d640 1 -- 172.21.15.45:0/3114743878 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2fc06e220 con 0x7fb2fc15f810 2023-11-28T18:39:14.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.041+0000 7fb2fad9d640 1 --2- 172.21.15.45:0/3114743878 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2fc15f810 0x7fb2fc15fca0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec000c10 tx=0x7fb2ec00eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:14.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.041+0000 7fb2f2ffd640 1 -- 172.21.15.45:0/3114743878 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec00eed0 con 0x7fb2fc15f810 2023-11-28T18:39:14.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.041+0000 7fb2f2ffd640 1 -- 172.21.15.45:0/3114743878 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2ec00c690 con 0x7fb2fc15f810 2023-11-28T18:39:14.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.041+0000 7fb30089a640 1 -- 172.21.15.45:0/3114743878 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2fc06e500 con 0x7fb2fc15f810 2023-11-28T18:39:14.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.041+0000 7fb2f2ffd640 1 -- 172.21.15.45:0/3114743878 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec00ca40 con 0x7fb2fc15f810 2023-11-28T18:39:14.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.041+0000 7fb30089a640 1 -- 172.21.15.45:0/3114743878 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2fc1404a0 con 0x7fb2fc15f810 2023-11-28T18:39:14.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.041+0000 7fb30089a640 1 -- 172.21.15.45:0/3114743878 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2fc153ed0 con 0x7fb2fc15f810 2023-11-28T18:39:14.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.041+0000 7fb2f2ffd640 1 -- 172.21.15.45:0/3114743878 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fb2ec00cba0 con 0x7fb2fc15f810 2023-11-28T18:39:14.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.045+0000 7fb2f2ffd640 1 --2- 172.21.15.45:0/3114743878 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fb2dc0668d0 0x7fb2dc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:14.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.045+0000 7fb2f2ffd640 1 -- 172.21.15.45:0/3114743878 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fb2ec083fa0 con 0x7fb2fc15f810 2023-11-28T18:39:14.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.045+0000 7fb2fa59c640 1 --2- 172.21.15.45:0/3114743878 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fb2dc0668d0 0x7fb2dc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:14.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.045+0000 7fb2fa59c640 1 --2- 172.21.15.45:0/3114743878 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fb2dc0668d0 0x7fb2dc068d90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb2f4009fd0 tx=0x7fb2f400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:14.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.049+0000 7fb2f2ffd640 1 -- 172.21.15.45:0/3114743878 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb2ec051220 con 0x7fb2fc15f810 2023-11-28T18:39:14.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.205+0000 7fb30089a640 1 -- 172.21.15.45:0/3114743878 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb2fc153ed0 con 0x7fb2fc15f810 2023-11-28T18:39:14.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.205+0000 7fb2f2ffd640 1 -- 172.21.15.45:0/3114743878 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v35) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb2ec054840 con 0x7fb2fc15f810 2023-11-28T18:39:14.208 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-11-28T18:39:14.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.205+0000 7fb30089a640 1 -- 172.21.15.45:0/3114743878 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fb2dc0668d0 msgr2=0x7fb2dc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:14.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.205+0000 7fb30089a640 1 --2- 172.21.15.45:0/3114743878 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fb2dc0668d0 0x7fb2dc068d90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb2f4009fd0 tx=0x7fb2f400b040 comp rx=0 tx=0).stop 2023-11-28T18:39:14.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.205+0000 7fb30089a640 1 -- 172.21.15.45:0/3114743878 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2fc15f810 msgr2=0x7fb2fc15fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:14.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.205+0000 7fb30089a640 1 --2- 172.21.15.45:0/3114743878 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2fc15f810 0x7fb2fc15fca0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec000c10 tx=0x7fb2ec00eb90 comp rx=0 tx=0).stop 2023-11-28T18:39:14.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.205+0000 7fb30089a640 1 -- 172.21.15.45:0/3114743878 shutdown_connections 2023-11-28T18:39:14.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.205+0000 7fb30089a640 1 --2- 172.21.15.45:0/3114743878 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fb2dc0668d0 0x7fb2dc068d90 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:14.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.205+0000 7fb30089a640 1 --2- 172.21.15.45:0/3114743878 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2fc15f810 0x7fb2fc15fca0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:14.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.205+0000 7fb30089a640 1 --2- 172.21.15.45:0/3114743878 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb2fc14b150 0x7fb2fc14b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:14.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.205+0000 7fb30089a640 1 --2- 172.21.15.45:0/3114743878 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb2e80047d0 0x7fb2fc13ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:14.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.205+0000 7fb30089a640 1 -- 172.21.15.45:0/3114743878 >> 172.21.15.45:0/3114743878 conn(0x7fb2fc0b1b70 msgr2=0x7fb2fc0ad5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:14.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.205+0000 7fb30089a640 1 -- 172.21.15.45:0/3114743878 shutdown_connections 2023-11-28T18:39:14.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.205+0000 7fb30089a640 1 -- 172.21.15.45:0/3114743878 wait complete. 2023-11-28T18:39:14.229 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T18:39:14.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.373+0000 7f4b06980640 1 Processor -- start 2023-11-28T18:39:14.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.373+0000 7f4b06980640 1 -- start start 2023-11-28T18:39:14.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.373+0000 7f4b06980640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4b000cb900 0x7f4b000cbce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:14.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.373+0000 7f4b06980640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f4b000b11d0 0x7f4b0015b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:14.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.373+0000 7f4b06980640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b000cc220 con 0x7f4b0015fb70 2023-11-28T18:39:14.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.373+0000 7f4b06980640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b000b1ac0 con 0x7f4b000b11d0 2023-11-28T18:39:14.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.373+0000 7f4b06980640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b000b17e0 con 0x7f4b000cb900 2023-11-28T18:39:14.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.373+0000 7f4aff7fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f4b0015fb70 0x7f4b000b0ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38938/0 (socket says 172.21.15.45:38938) 2023-11-28T18:39:14.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.373+0000 7f4aff7fe640 1 -- 172.21.15.45:0/3059806642 learned_addr learned my addr 172.21.15.45:0/3059806642 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:39:14.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.377+0000 7f4afffff640 1 --2- 172.21.15.45:0/3059806642 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4b000cb900 0x7f4b000cbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:14.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.377+0000 7f4b04f1d640 1 --2- 172.21.15.45:0/3059806642 >> v2:172.21.15.190:3300/0 conn(0x7f4b000b11d0 0x7f4b0015b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:14.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.377+0000 7f4afeffd640 1 -- 172.21.15.45:0/3059806642 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3656807805 0 0) 0x7f4b000cc220 con 0x7f4b0015fb70 2023-11-28T18:39:14.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.377+0000 7f4afeffd640 1 -- 172.21.15.45:0/3059806642 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ae8003530 con 0x7f4b0015fb70 2023-11-28T18:39:14.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.377+0000 7f4afeffd640 1 -- 172.21.15.45:0/3059806642 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3501986049 0 0) 0x7f4ae8003530 con 0x7f4b0015fb70 2023-11-28T18:39:14.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.377+0000 7f4afeffd640 1 -- 172.21.15.45:0/3059806642 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4b000cb900 msgr2=0x7f4b000cbce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:14.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.377+0000 7f4afeffd640 1 --2- 172.21.15.45:0/3059806642 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4b000cb900 0x7f4b000cbce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:14.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.377+0000 7f4afeffd640 1 -- 172.21.15.45:0/3059806642 >> v2:172.21.15.190:3300/0 conn(0x7f4b000b11d0 msgr2=0x7f4b0015b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:14.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.377+0000 7f4afeffd640 1 --2- 172.21.15.45:0/3059806642 >> v2:172.21.15.190:3300/0 conn(0x7f4b000b11d0 0x7f4b0015b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:14.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.377+0000 7f4afeffd640 1 -- 172.21.15.45:0/3059806642 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b0015f090 con 0x7f4b0015fb70 2023-11-28T18:39:14.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.377+0000 7f4afeffd640 1 -- 172.21.15.45:0/3059806642 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4084481567 0 0) 0x7f4af4001680 con 0x7f4b0015fb70 2023-11-28T18:39:14.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.377+0000 7f4afeffd640 1 -- 172.21.15.45:0/3059806642 >> v1:172.21.15.45:6789/0 conn(0x7f4b0015fb70 legacy=0x7f4b000b0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:14.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.377+0000 7f4afeffd640 1 --2- 172.21.15.45:0/3059806642 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4ae8003980 0x7f4ae8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:14.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.377+0000 7f4afeffd640 1 --2- 172.21.15.45:0/3059806642 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4b000cb900 0x7f4ae80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:14.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.377+0000 7f4afeffd640 1 --2- 172.21.15.45:0/3059806642 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ae8004d10 0x7f4ae8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:14.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.377+0000 7f4afeffd640 1 -- 172.21.15.45:0/3059806642 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b000b17e0 con 0x7f4ae8004d10 2023-11-28T18:39:14.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.377+0000 7f4afeffd640 1 -- 172.21.15.45:0/3059806642 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae800fda0 con 0x7f4ae8003980 2023-11-28T18:39:14.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.377+0000 7f4afeffd640 1 -- 172.21.15.45:0/3059806642 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae800fee0 con 0x7f4b000cb900 2023-11-28T18:39:14.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.377+0000 7f4b04f1d640 1 --2- 172.21.15.45:0/3059806642 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ae8004d10 0x7f4ae8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:14.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.377+0000 7f4afffff640 1 --2- 172.21.15.45:0/3059806642 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4ae8003980 0x7f4ae8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:14.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.377+0000 7f4aff7fe640 1 --2- 172.21.15.45:0/3059806642 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4b000cb900 0x7f4ae80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:14.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.377+0000 7f4b04f1d640 1 -- 172.21.15.45:0/3059806642 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4b000cb900 msgr2=0x7f4ae80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:14.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.377+0000 7f4b04f1d640 1 --2- 172.21.15.45:0/3059806642 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4b000cb900 0x7f4ae80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:14.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.377+0000 7f4b04f1d640 1 -- 172.21.15.45:0/3059806642 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4ae8003980 msgr2=0x7f4ae8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:14.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.377+0000 7f4b04f1d640 1 --2- 172.21.15.45:0/3059806642 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4ae8003980 0x7f4ae8003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:14.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.377+0000 7f4b04f1d640 1 -- 172.21.15.45:0/3059806642 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ae8003530 con 0x7f4ae8004d10 2023-11-28T18:39:14.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.381+0000 7f4b04f1d640 1 --2- 172.21.15.45:0/3059806642 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ae8004d10 0x7f4ae8005190 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f4af8009fc0 tx=0x7f4af801cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a11d522093a5aff server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:14.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.381+0000 7f4afeffd640 1 -- 172.21.15.45:0/3059806642 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af80a5cb0 con 0x7f4ae8004d10 2023-11-28T18:39:14.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.381+0000 7f4afeffd640 1 -- 172.21.15.45:0/3059806642 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4af800f040 con 0x7f4ae8004d10 2023-11-28T18:39:14.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.381+0000 7f4afeffd640 1 -- 172.21.15.45:0/3059806642 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af80ad680 con 0x7f4ae8004d10 2023-11-28T18:39:14.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.381+0000 7f4b06980640 1 -- 172.21.15.45:0/3059806642 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ae8004d10 msgr2=0x7f4ae8005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:14.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.381+0000 7f4b06980640 1 --2- 172.21.15.45:0/3059806642 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ae8004d10 0x7f4ae8005190 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f4af8009fc0 tx=0x7f4af801cca0 comp rx=0 tx=0).stop 2023-11-28T18:39:14.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.381+0000 7f4b04f1d640 1 -- 172.21.15.45:0/3059806642 reap_dead start 2023-11-28T18:39:14.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.381+0000 7f4b06980640 1 -- 172.21.15.45:0/3059806642 shutdown_connections 2023-11-28T18:39:14.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.381+0000 7f4b06980640 1 -- 172.21.15.45:0/3059806642 >> 172.21.15.45:0/3059806642 conn(0x7f4b000b4650 msgr2=0x7f4b000b4a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:14.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.381+0000 7f4b06980640 1 -- 172.21.15.45:0/3059806642 shutdown_connections 2023-11-28T18:39:14.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.381+0000 7f4b06980640 1 -- 172.21.15.45:0/3059806642 wait complete. 2023-11-28T18:39:14.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.381+0000 7f4b06980640 1 Processor -- start 2023-11-28T18:39:14.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.381+0000 7f4b06980640 1 -- start start 2023-11-28T18:39:14.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.385+0000 7f4b06980640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4ae8004d10 0x7f4b00147f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:14.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.385+0000 7f4b06980640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4b001f27c0 0x7f4b0014eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:14.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.385+0000 7f4b06980640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b0014f000 0x7f4b000cd800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:14.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.385+0000 7f4b06980640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b00148480 con 0x7f4b0014f000 2023-11-28T18:39:14.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.385+0000 7f4b06980640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0014f480 con 0x7f4b001f27c0 2023-11-28T18:39:14.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.385+0000 7f4b06980640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b001516e0 con 0x7f4ae8004d10 2023-11-28T18:39:14.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.385+0000 7f4b04f1d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b0014f000 0x7f4b000cd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:14.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.385+0000 7f4b04f1d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b0014f000 0x7f4b000cd800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43146/0 (socket says 172.21.15.45:43146) 2023-11-28T18:39:14.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.385+0000 7f4b04f1d640 1 -- 172.21.15.45:0/582513845 learned_addr learned my addr 172.21.15.45:0/582513845 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:14.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.385+0000 7f4afffff640 1 --2- 172.21.15.45:0/582513845 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4ae8004d10 0x7f4b00147f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:14.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.385+0000 7f4aff7fe640 1 --2- 172.21.15.45:0/582513845 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4b001f27c0 0x7f4b0014eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:14.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.385+0000 7f4b04f1d640 1 -- 172.21.15.45:0/582513845 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4ae8004d10 msgr2=0x7f4b00147f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:14.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.385+0000 7f4b04f1d640 1 --2- 172.21.15.45:0/582513845 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4ae8004d10 0x7f4b00147f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:14.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.385+0000 7f4b04f1d640 1 -- 172.21.15.45:0/582513845 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4b001f27c0 msgr2=0x7f4b0014eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:14.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.385+0000 7f4b04f1d640 1 --2- 172.21.15.45:0/582513845 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4b001f27c0 0x7f4b0014eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:14.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.385+0000 7f4b04f1d640 1 -- 172.21.15.45:0/582513845 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b001551e0 con 0x7f4b0014f000 2023-11-28T18:39:14.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.385+0000 7f4b04f1d640 1 --2- 172.21.15.45:0/582513845 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b0014f000 0x7f4b000cd800 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f4af801c710 tx=0x7f4af8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:14.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.385+0000 7f4afcff9640 1 -- 172.21.15.45:0/582513845 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af80039a0 con 0x7f4b0014f000 2023-11-28T18:39:14.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.385+0000 7f4afcff9640 1 -- 172.21.15.45:0/582513845 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4af8003b00 con 0x7f4b0014f000 2023-11-28T18:39:14.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.385+0000 7f4b06980640 1 -- 172.21.15.45:0/582513845 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b001554c0 con 0x7f4b0014f000 2023-11-28T18:39:14.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.385+0000 7f4afcff9640 1 -- 172.21.15.45:0/582513845 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af80ae890 con 0x7f4b0014f000 2023-11-28T18:39:14.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.385+0000 7f4b06980640 1 -- 172.21.15.45:0/582513845 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b00151370 con 0x7f4b0014f000 2023-11-28T18:39:14.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.385+0000 7f4b06980640 1 -- 172.21.15.45:0/582513845 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b00069410 con 0x7f4b0014f000 2023-11-28T18:39:14.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.385+0000 7f4afcff9640 1 -- 172.21.15.45:0/582513845 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f4af80b4040 con 0x7f4b0014f000 2023-11-28T18:39:14.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.389+0000 7f4afcff9640 1 --2- 172.21.15.45:0/582513845 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4aec066900 0x7f4aec068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:14.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.389+0000 7f4afcff9640 1 -- 172.21.15.45:0/582513845 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f4af811e4e0 con 0x7f4b0014f000 2023-11-28T18:39:14.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.389+0000 7f4afffff640 1 --2- 172.21.15.45:0/582513845 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4aec066900 0x7f4aec068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:14.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.389+0000 7f4afffff640 1 --2- 172.21.15.45:0/582513845 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4aec066900 0x7f4aec068dc0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4af0009be0 tx=0x7f4af0009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:14.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.393+0000 7f4afcff9640 1 -- 172.21.15.45:0/582513845 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4af80eb6e0 con 0x7f4b0014f000 2023-11-28T18:39:14.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.549+0000 7f4b06980640 1 -- 172.21.15.45:0/582513845 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4b00151820 con 0x7f4b0014f000 2023-11-28T18:39:14.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.549+0000 7f4afcff9640 1 -- 172.21.15.45:0/582513845 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v35) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4af80eed00 con 0x7f4b0014f000 2023-11-28T18:39:14.553 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-11-28T18:39:14.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.553+0000 7f4b06980640 1 -- 172.21.15.45:0/582513845 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4aec066900 msgr2=0x7f4aec068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:14.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.553+0000 7f4b06980640 1 --2- 172.21.15.45:0/582513845 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4aec066900 0x7f4aec068dc0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4af0009be0 tx=0x7f4af0009190 comp rx=0 tx=0).stop 2023-11-28T18:39:14.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.553+0000 7f4b06980640 1 -- 172.21.15.45:0/582513845 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b0014f000 msgr2=0x7f4b000cd800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:14.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.553+0000 7f4b06980640 1 --2- 172.21.15.45:0/582513845 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b0014f000 0x7f4b000cd800 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f4af801c710 tx=0x7f4af8009750 comp rx=0 tx=0).stop 2023-11-28T18:39:14.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.553+0000 7f4b06980640 1 -- 172.21.15.45:0/582513845 shutdown_connections 2023-11-28T18:39:14.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.553+0000 7f4b06980640 1 --2- 172.21.15.45:0/582513845 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4aec066900 0x7f4aec068dc0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:14.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.553+0000 7f4b06980640 1 --2- 172.21.15.45:0/582513845 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b0014f000 0x7f4b000cd800 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:14.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.553+0000 7f4b06980640 1 --2- 172.21.15.45:0/582513845 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4b001f27c0 0x7f4b0014eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:14.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.553+0000 7f4b06980640 1 --2- 172.21.15.45:0/582513845 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4ae8004d10 0x7f4b00147f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:14.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.553+0000 7f4b06980640 1 -- 172.21.15.45:0/582513845 >> 172.21.15.45:0/582513845 conn(0x7f4b000b4650 msgr2=0x7f4b0015dcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:14.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.553+0000 7f4b06980640 1 -- 172.21.15.45:0/582513845 shutdown_connections 2023-11-28T18:39:14.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.553+0000 7f4b06980640 1 -- 172.21.15.45:0/582513845 wait complete. 2023-11-28T18:39:14.574 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T18:39:14.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.713+0000 7fe479db8640 1 Processor -- start 2023-11-28T18:39:14.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.713+0000 7fe479db8640 1 -- start start 2023-11-28T18:39:14.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.717+0000 7fe479db8640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe47413cf70 0x7fe47406c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:14.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.717+0000 7fe479db8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe47406c840 0x7fe47415a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:14.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.717+0000 7fe479db8640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe47415b3e0 con 0x7fe47415abb0 2023-11-28T18:39:14.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.717+0000 7fe479db8640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe47413d350 con 0x7fe47413cf70 2023-11-28T18:39:14.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.717+0000 7fe479db8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe474140520 con 0x7fe47406c840 2023-11-28T18:39:14.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.717+0000 7fe473fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe47415abb0 0x7fe4740715b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38952/0 (socket says 172.21.15.45:38952) 2023-11-28T18:39:14.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.717+0000 7fe473fff640 1 -- 172.21.15.45:0/2900590461 learned_addr learned my addr 172.21.15.45:0/2900590461 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:39:14.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.717+0000 7fe472ffd640 1 --2- 172.21.15.45:0/2900590461 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe47406c840 0x7fe47415a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:14.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.717+0000 7fe4737fe640 1 --2- 172.21.15.45:0/2900590461 >> v2:172.21.15.190:3300/0 conn(0x7fe47413cf70 0x7fe47406c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:14.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.717+0000 7fe4727fc640 1 -- 172.21.15.45:0/2900590461 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1069272693 0 0) 0x7fe47415b3e0 con 0x7fe47415abb0 2023-11-28T18:39:14.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.717+0000 7fe4737fe640 1 -- 172.21.15.45:0/2900590461 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe47406c840 msgr2=0x7fe47415a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:14.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.717+0000 7fe4737fe640 1 --2- 172.21.15.45:0/2900590461 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe47406c840 0x7fe47415a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:14.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.717+0000 7fe4737fe640 1 -- 172.21.15.45:0/2900590461 >> v1:172.21.15.45:6789/0 conn(0x7fe47415abb0 legacy=0x7fe4740715b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:14.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.717+0000 7fe4737fe640 1 -- 172.21.15.45:0/2900590461 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe47406cc80 con 0x7fe47413cf70 2023-11-28T18:39:14.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.721+0000 7fe4737fe640 1 --2- 172.21.15.45:0/2900590461 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe47413cf70 0x7fe47406c300 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe4640097f0 tx=0x7fe46401c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=260422621acac09f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:14.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.721+0000 7fe4727fc640 1 -- 172.21.15.45:0/2900590461 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4640ac620 con 0x7fe47413cf70 2023-11-28T18:39:14.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.721+0000 7fe4727fc640 1 -- 172.21.15.45:0/2900590461 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4640ac780 con 0x7fe47413cf70 2023-11-28T18:39:14.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.721+0000 7fe4727fc640 1 -- 172.21.15.45:0/2900590461 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4640acb10 con 0x7fe47413cf70 2023-11-28T18:39:14.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.721+0000 7fe479db8640 1 -- 172.21.15.45:0/2900590461 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe47413cf70 msgr2=0x7fe47406c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:14.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.721+0000 7fe479db8640 1 --2- 172.21.15.45:0/2900590461 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe47413cf70 0x7fe47406c300 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe4640097f0 tx=0x7fe46401c3c0 comp rx=0 tx=0).stop 2023-11-28T18:39:14.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.721+0000 7fe479db8640 1 -- 172.21.15.45:0/2900590461 shutdown_connections 2023-11-28T18:39:14.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.721+0000 7fe479db8640 1 --2- 172.21.15.45:0/2900590461 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe47406c840 0x7fe47415a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:14.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.721+0000 7fe479db8640 1 --2- 172.21.15.45:0/2900590461 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe47413cf70 0x7fe47406c300 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:14.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.721+0000 7fe479db8640 1 -- 172.21.15.45:0/2900590461 >> 172.21.15.45:0/2900590461 conn(0x7fe47406a570 msgr2=0x7fe47406a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:14.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.721+0000 7fe479db8640 1 -- 172.21.15.45:0/2900590461 shutdown_connections 2023-11-28T18:39:14.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.721+0000 7fe479db8640 1 -- 172.21.15.45:0/2900590461 wait complete. 2023-11-28T18:39:14.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.721+0000 7fe479db8640 1 Processor -- start 2023-11-28T18:39:14.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.721+0000 7fe479db8640 1 -- start start 2023-11-28T18:39:14.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.725+0000 7fe479db8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe47406c840 0x7fe4741556f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:14.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.725+0000 7fe479db8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe47413cf70 0x7fe4740b3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:14.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.725+0000 7fe479db8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe47415abb0 0x7fe474158010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:14.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.725+0000 7fe479db8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe474154700 con 0x7fe47413cf70 2023-11-28T18:39:14.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.725+0000 7fe479db8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe474155260 con 0x7fe47415abb0 2023-11-28T18:39:14.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.725+0000 7fe479db8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe474158bf0 con 0x7fe47406c840 2023-11-28T18:39:14.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.725+0000 7fe472ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe47413cf70 0x7fe4740b3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:14.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.725+0000 7fe4737fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe47406c840 0x7fe4741556f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:14.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.725+0000 7fe4737fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe47406c840 0x7fe4741556f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.45:52228/0 (socket says 172.21.15.45:52228) 2023-11-28T18:39:14.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.725+0000 7fe4737fe640 1 -- 172.21.15.45:0/561074020 learned_addr learned my addr 172.21.15.45:0/561074020 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:14.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.725+0000 7fe473fff640 1 --2- 172.21.15.45:0/561074020 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe47415abb0 0x7fe474158010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:14.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.725+0000 7fe472ffd640 1 -- 172.21.15.45:0/561074020 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe47406c840 msgr2=0x7fe4741556f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:14.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.725+0000 7fe472ffd640 1 --2- 172.21.15.45:0/561074020 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe47406c840 0x7fe4741556f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:14.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.725+0000 7fe472ffd640 1 -- 172.21.15.45:0/561074020 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe47415abb0 msgr2=0x7fe474158010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:14.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.725+0000 7fe472ffd640 1 --2- 172.21.15.45:0/561074020 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe47415abb0 0x7fe474158010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:14.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.725+0000 7fe472ffd640 1 -- 172.21.15.45:0/561074020 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe464009420 con 0x7fe47413cf70 2023-11-28T18:39:14.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.725+0000 7fe472ffd640 1 --2- 172.21.15.45:0/561074020 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe47413cf70 0x7fe4740b3010 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fe46800e870 tx=0x7fe46800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:14.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.725+0000 7fe45bfff640 1 -- 172.21.15.45:0/561074020 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46800ee60 con 0x7fe47413cf70 2023-11-28T18:39:14.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.725+0000 7fe45bfff640 1 -- 172.21.15.45:0/561074020 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe46800c940 con 0x7fe47413cf70 2023-11-28T18:39:14.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.725+0000 7fe479db8640 1 -- 172.21.15.45:0/561074020 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe474154c10 con 0x7fe47413cf70 2023-11-28T18:39:14.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.725+0000 7fe45bfff640 1 -- 172.21.15.45:0/561074020 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46800ccd0 con 0x7fe47413cf70 2023-11-28T18:39:14.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.725+0000 7fe479db8640 1 -- 172.21.15.45:0/561074020 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe474158ed0 con 0x7fe47413cf70 2023-11-28T18:39:14.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.725+0000 7fe479db8640 1 -- 172.21.15.45:0/561074020 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe474155c30 con 0x7fe47413cf70 2023-11-28T18:39:14.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.725+0000 7fe45bfff640 1 -- 172.21.15.45:0/561074020 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe468013470 con 0x7fe47413cf70 2023-11-28T18:39:14.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.729+0000 7fe45bfff640 1 --2- 172.21.15.45:0/561074020 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe4600668d0 0x7fe460068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:14.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.729+0000 7fe45bfff640 1 -- 172.21.15.45:0/561074020 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fe468084400 con 0x7fe47413cf70 2023-11-28T18:39:14.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.729+0000 7fe4737fe640 1 --2- 172.21.15.45:0/561074020 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe4600668d0 0x7fe460068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:14.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.729+0000 7fe4737fe640 1 --2- 172.21.15.45:0/561074020 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe4600668d0 0x7fe460068d90 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe464000c10 tx=0x7fe4640a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:14.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.733+0000 7fe45bfff640 1 -- 172.21.15.45:0/561074020 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe468051720 con 0x7fe47413cf70 2023-11-28T18:39:14.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.901+0000 7fe479db8640 1 -- 172.21.15.45:0/561074020 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe474069480 con 0x7fe47413cf70 2023-11-28T18:39:14.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.901+0000 7fe45bfff640 1 -- 172.21.15.45:0/561074020 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v35) v1 ==== 80+0+122 (secure 0 0 0) 0x7fe468054d40 con 0x7fe47413cf70 2023-11-28T18:39:14.905 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:6834/2398964901 2023-11-29T18:39:02.760758+0000 2023-11-28T18:39:14.905 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:6832/2398964901 2023-11-29T18:39:02.760758+0000 2023-11-28T18:39:14.905 INFO:teuthology.orchestra.run.smithi045.stderr:listed 2 entries 2023-11-28T18:39:14.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.901+0000 7fe479db8640 1 -- 172.21.15.45:0/561074020 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe4600668d0 msgr2=0x7fe460068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:14.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.901+0000 7fe479db8640 1 --2- 172.21.15.45:0/561074020 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe4600668d0 0x7fe460068d90 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe464000c10 tx=0x7fe4640a7000 comp rx=0 tx=0).stop 2023-11-28T18:39:14.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.901+0000 7fe479db8640 1 -- 172.21.15.45:0/561074020 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe47413cf70 msgr2=0x7fe4740b3010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:14.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.901+0000 7fe479db8640 1 --2- 172.21.15.45:0/561074020 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe47413cf70 0x7fe4740b3010 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fe46800e870 tx=0x7fe46800ed30 comp rx=0 tx=0).stop 2023-11-28T18:39:14.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.901+0000 7fe479db8640 1 -- 172.21.15.45:0/561074020 shutdown_connections 2023-11-28T18:39:14.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.901+0000 7fe479db8640 1 --2- 172.21.15.45:0/561074020 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe4600668d0 0x7fe460068d90 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:14.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.901+0000 7fe479db8640 1 --2- 172.21.15.45:0/561074020 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe47415abb0 0x7fe474158010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:14.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.901+0000 7fe479db8640 1 --2- 172.21.15.45:0/561074020 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe47413cf70 0x7fe4740b3010 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:14.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.901+0000 7fe479db8640 1 --2- 172.21.15.45:0/561074020 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe47406c840 0x7fe4741556f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:14.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.901+0000 7fe479db8640 1 -- 172.21.15.45:0/561074020 >> 172.21.15.45:0/561074020 conn(0x7fe47406a570 msgr2=0x7fe47415c790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:14.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.905+0000 7fe479db8640 1 -- 172.21.15.45:0/561074020 shutdown_connections 2023-11-28T18:39:14.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:14.905+0000 7fe479db8640 1 -- 172.21.15.45:0/561074020 wait complete. 2023-11-28T18:39:14.926 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi045.front.sepia.ceph.com... 2023-11-28T18:39:14.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:39:14.926 DEBUG:teuthology.orchestra.run.smithi045:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-28T18:39:14.945 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:ceph-fuse[48331]: fuse finished with error 0 and tester_r 0 2023-11-28T18:39:14.948 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T18:39:15.021 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi045.front.sepia.ceph.com 2023-11-28T18:39:15.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:39:15.022 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-28T18:39:15.032 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T18:39:15.181 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-11-28T18:39:15.177+0000 7f566b6b8640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-11-28T18:39:15.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.217+0000 7fe4115c4640 1 Processor -- start 2023-11-28T18:39:15.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.217+0000 7fe4115c4640 1 -- start start 2023-11-28T18:39:15.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.217+0000 7fe4115c4640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe40c15bcd0 0x7fe40c06c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:15.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.217+0000 7fe4115c4640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe40c15c0b0 0x7fe40c06c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:15.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.217+0000 7fe4115c4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe40c145290 0x7fe40c145740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:15.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.217+0000 7fe4115c4640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe40c146000 con 0x7fe40c15bcd0 2023-11-28T18:39:15.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.217+0000 7fe4115c4640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe40c1462e0 con 0x7fe40c15c0b0 2023-11-28T18:39:15.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.217+0000 7fe4115c4640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe40c1465c0 con 0x7fe40c145290 2023-11-28T18:39:15.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.217+0000 7fe40affd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe40c15bcd0 0x7fe40c06c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:15.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.217+0000 7fe40affd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe40c15bcd0 0x7fe40c06c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43166/0 (socket says 172.21.15.45:43166) 2023-11-28T18:39:15.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.217+0000 7fe40affd640 1 -- 172.21.15.45:0/3111492227 learned_addr learned my addr 172.21.15.45:0/3111492227 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:15.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.217+0000 7fe40b7fe640 1 --2- 172.21.15.45:0/3111492227 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe40c145290 0x7fe40c145740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:15.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.217+0000 7fe40a7fc640 1 --2- 172.21.15.45:0/3111492227 >> v2:172.21.15.190:3300/0 conn(0x7fe40c15c0b0 0x7fe40c06c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:15.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.217+0000 7fe40affd640 1 -- 172.21.15.45:0/3111492227 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe40c145290 msgr2=0x7fe40c145740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:15.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.217+0000 7fe40affd640 1 --2- 172.21.15.45:0/3111492227 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe40c145290 0x7fe40c145740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:15.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.217+0000 7fe40affd640 1 -- 172.21.15.45:0/3111492227 >> v2:172.21.15.190:3300/0 conn(0x7fe40c15c0b0 msgr2=0x7fe40c06c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:15.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.217+0000 7fe40affd640 1 --2- 172.21.15.45:0/3111492227 >> v2:172.21.15.190:3300/0 conn(0x7fe40c15c0b0 0x7fe40c06c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:15.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.217+0000 7fe40affd640 1 -- 172.21.15.45:0/3111492227 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe40c1468a0 con 0x7fe40c15bcd0 2023-11-28T18:39:15.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.221+0000 7fe40affd640 1 --2- 172.21.15.45:0/3111492227 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe40c15bcd0 0x7fe40c06c300 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc009870 tx=0x7fe3fc01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97fadc714d55beb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:15.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.221+0000 7fe409ffb640 1 -- 172.21.15.45:0/3111492227 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3fc0aa610 con 0x7fe40c15bcd0 2023-11-28T18:39:15.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.221+0000 7fe409ffb640 1 -- 172.21.15.45:0/3111492227 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3fc0a6040 con 0x7fe40c15bcd0 2023-11-28T18:39:15.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.221+0000 7fe409ffb640 1 -- 172.21.15.45:0/3111492227 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3fc0aa990 con 0x7fe40c15bcd0 2023-11-28T18:39:15.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.221+0000 7fe4115c4640 1 -- 172.21.15.45:0/3111492227 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe40c15bcd0 msgr2=0x7fe40c06c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:15.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.221+0000 7fe4115c4640 1 --2- 172.21.15.45:0/3111492227 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe40c15bcd0 0x7fe40c06c300 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc009870 tx=0x7fe3fc01c4d0 comp rx=0 tx=0).stop 2023-11-28T18:39:15.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.221+0000 7fe4115c4640 1 -- 172.21.15.45:0/3111492227 shutdown_connections 2023-11-28T18:39:15.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.221+0000 7fe4115c4640 1 --2- 172.21.15.45:0/3111492227 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe40c145290 0x7fe40c145740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:15.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.221+0000 7fe4115c4640 1 --2- 172.21.15.45:0/3111492227 >> v2:172.21.15.190:3300/0 conn(0x7fe40c15c0b0 0x7fe40c06c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:15.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.221+0000 7fe4115c4640 1 --2- 172.21.15.45:0/3111492227 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe40c15bcd0 0x7fe40c06c300 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:15.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.221+0000 7fe4115c4640 1 -- 172.21.15.45:0/3111492227 >> 172.21.15.45:0/3111492227 conn(0x7fe40c06a570 msgr2=0x7fe40c06a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:15.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.221+0000 7fe4115c4640 1 -- 172.21.15.45:0/3111492227 shutdown_connections 2023-11-28T18:39:15.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.221+0000 7fe4115c4640 1 -- 172.21.15.45:0/3111492227 wait complete. 2023-11-28T18:39:15.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.225+0000 7fe4115c4640 1 Processor -- start 2023-11-28T18:39:15.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.225+0000 7fe4115c4640 1 -- start start 2023-11-28T18:39:15.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.225+0000 7fe4115c4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe40c145290 0x7fe40c1587b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:15.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.225+0000 7fe4115c4640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe40c15bcd0 0x7fe40c144030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:15.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.225+0000 7fe4115c4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe40c15c0b0 0x7fe40c0b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:15.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.225+0000 7fe4115c4640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe40c143450 con 0x7fe40c145290 2023-11-28T18:39:15.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.225+0000 7fe4115c4640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe40c159e50 con 0x7fe40c15bcd0 2023-11-28T18:39:15.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.225+0000 7fe4115c4640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe40c143c60 con 0x7fe40c15c0b0 2023-11-28T18:39:15.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.225+0000 7fe40affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe40c145290 0x7fe40c1587b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:15.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.225+0000 7fe40affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe40c145290 0x7fe40c1587b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43170/0 (socket says 172.21.15.45:43170) 2023-11-28T18:39:15.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.225+0000 7fe40affd640 1 -- 172.21.15.45:0/763637965 learned_addr learned my addr 172.21.15.45:0/763637965 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:15.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.225+0000 7fe40a7fc640 1 --2- 172.21.15.45:0/763637965 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe40c15bcd0 0x7fe40c144030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:15.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.225+0000 7fe40affd640 1 -- 172.21.15.45:0/763637965 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe40c15c0b0 msgr2=0x7fe40c0b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:15.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.225+0000 7fe40b7fe640 1 --2- 172.21.15.45:0/763637965 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe40c15c0b0 0x7fe40c0b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:15.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.225+0000 7fe40affd640 1 --2- 172.21.15.45:0/763637965 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe40c15c0b0 0x7fe40c0b2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:15.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.225+0000 7fe40affd640 1 -- 172.21.15.45:0/763637965 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe40c15bcd0 msgr2=0x7fe40c144030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:15.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.225+0000 7fe40affd640 1 --2- 172.21.15.45:0/763637965 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe40c15bcd0 0x7fe40c144030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:15.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.225+0000 7fe40affd640 1 -- 172.21.15.45:0/763637965 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3fc0094d0 con 0x7fe40c145290 2023-11-28T18:39:15.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.225+0000 7fe40a7fc640 1 --2- 172.21.15.45:0/763637965 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe40c15bcd0 0x7fe40c144030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:39:15.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.225+0000 7fe40b7fe640 1 --2- 172.21.15.45:0/763637965 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe40c15c0b0 0x7fe40c0b2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:39:15.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.225+0000 7fe40affd640 1 --2- 172.21.15.45:0/763637965 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe40c145290 0x7fe40c1587b0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc0ac040 tx=0x7fe3fc01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:15.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.225+0000 7fe3f37fe640 1 -- 172.21.15.45:0/763637965 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3fc0bd5f0 con 0x7fe40c145290 2023-11-28T18:39:15.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.225+0000 7fe3f37fe640 1 -- 172.21.15.45:0/763637965 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3fc0bd770 con 0x7fe40c145290 2023-11-28T18:39:15.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.225+0000 7fe3f37fe640 1 -- 172.21.15.45:0/763637965 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3fc0bdb20 con 0x7fe40c145290 2023-11-28T18:39:15.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.225+0000 7fe4115c4640 1 -- 172.21.15.45:0/763637965 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe40c15a2e0 con 0x7fe40c145290 2023-11-28T18:39:15.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.225+0000 7fe4115c4640 1 -- 172.21.15.45:0/763637965 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe40c143980 con 0x7fe40c145290 2023-11-28T18:39:15.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.229+0000 7fe4115c4640 1 -- 172.21.15.45:0/763637965 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe40c069480 con 0x7fe40c145290 2023-11-28T18:39:15.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.229+0000 7fe3f37fe640 1 -- 172.21.15.45:0/763637965 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe3fc0b33f0 con 0x7fe40c145290 2023-11-28T18:39:15.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.229+0000 7fe3f37fe640 1 --2- 172.21.15.45:0/763637965 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe3f8066900 0x7fe3f8068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:15.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.229+0000 7fe3f37fe640 1 -- 172.21.15.45:0/763637965 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fe3fc11f0f0 con 0x7fe40c145290 2023-11-28T18:39:15.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.229+0000 7fe40a7fc640 1 --2- 172.21.15.45:0/763637965 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe3f8066900 0x7fe3f8068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:15.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.229+0000 7fe40a7fc640 1 --2- 172.21.15.45:0/763637965 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe3f8066900 0x7fe3f8068dc0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe40c0b01e0 tx=0x7fe400008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:15.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.233+0000 7fe3f37fe640 1 -- 172.21.15.45:0/763637965 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe3fc0ec2e0 con 0x7fe40c145290 2023-11-28T18:39:15.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.425+0000 7fe4115c4640 1 -- 172.21.15.45:0/763637965 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe40c0cea00 con 0x7fe40c145290 2023-11-28T18:39:15.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.425+0000 7fe3f37fe640 1 -- 172.21.15.45:0/763637965 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe3fc0ef900 con 0x7fe40c145290 2023-11-28T18:39:15.428 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T18:39:15.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.425+0000 7fe4115c4640 1 -- 172.21.15.45:0/763637965 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe3f8066900 msgr2=0x7fe3f8068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:15.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.425+0000 7fe4115c4640 1 --2- 172.21.15.45:0/763637965 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe3f8066900 0x7fe3f8068dc0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe40c0b01e0 tx=0x7fe400008040 comp rx=0 tx=0).stop 2023-11-28T18:39:15.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.425+0000 7fe4115c4640 1 -- 172.21.15.45:0/763637965 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe40c145290 msgr2=0x7fe40c1587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:15.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.425+0000 7fe4115c4640 1 --2- 172.21.15.45:0/763637965 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe40c145290 0x7fe40c1587b0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc0ac040 tx=0x7fe3fc01ad10 comp rx=0 tx=0).stop 2023-11-28T18:39:15.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.425+0000 7fe4115c4640 1 -- 172.21.15.45:0/763637965 shutdown_connections 2023-11-28T18:39:15.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.425+0000 7fe4115c4640 1 --2- 172.21.15.45:0/763637965 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe3f8066900 0x7fe3f8068dc0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:15.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.425+0000 7fe4115c4640 1 --2- 172.21.15.45:0/763637965 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe40c15c0b0 0x7fe40c0b2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:15.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.425+0000 7fe4115c4640 1 --2- 172.21.15.45:0/763637965 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe40c15bcd0 0x7fe40c144030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:15.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.425+0000 7fe4115c4640 1 --2- 172.21.15.45:0/763637965 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe40c145290 0x7fe40c1587b0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:15.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.425+0000 7fe4115c4640 1 -- 172.21.15.45:0/763637965 >> 172.21.15.45:0/763637965 conn(0x7fe40c06a570 msgr2=0x7fe40c0b0450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:15.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.425+0000 7fe4115c4640 1 -- 172.21.15.45:0/763637965 shutdown_connections 2023-11-28T18:39:15.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:15.425+0000 7fe4115c4640 1 -- 172.21.15.45:0/763637965 wait complete. 2023-11-28T18:39:15.449 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-28T18:39:15.450 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T18:39:15.450 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi045.front.sepia.ceph.com 2023-11-28T18:39:15.450 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-28T18:39:15.450 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-28T18:39:15.450 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-28T18:39:15.450 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-28T18:39:15.450 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T18:39:15.450 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T18:39:15.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:39:15.451 DEBUG:teuthology.orchestra.run.smithi045:> ip addr 2023-11-28T18:39:15.461 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T18:39:15.461 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T18:39:15.462 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T18:39:15.462 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:39:15.462 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2023-11-28T18:39:15.462 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:39:15.462 INFO:teuthology.orchestra.run.smithi045.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T18:39:15.462 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a6 brd ff:ff:ff:ff:ff:ff 2023-11-28T18:39:15.462 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f0 2023-11-28T18:39:15.462 INFO:teuthology.orchestra.run.smithi045.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T18:39:15.462 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a7 brd ff:ff:ff:ff:ff:ff 2023-11-28T18:39:15.462 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f1 2023-11-28T18:39:15.462 INFO:teuthology.orchestra.run.smithi045.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T18:39:15.463 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:be brd ff:ff:ff:ff:ff:ff 2023-11-28T18:39:15.463 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f0 2023-11-28T18:39:15.463 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.21.15.45/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-11-28T18:39:15.463 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft 42302sec preferred_lft 42302sec 2023-11-28T18:39:15.463 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec4:7aff:febd:12be/64 scope link 2023-11-28T18:39:15.463 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:39:15.463 INFO:teuthology.orchestra.run.smithi045.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T18:39:15.463 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:bf brd ff:ff:ff:ff:ff:ff 2023-11-28T18:39:15.463 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f1 2023-11-28T18:39:15.463 INFO:teuthology.orchestra.run.smithi045.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T18:39:15.463 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 02:42:ab:69:35:3d brd ff:ff:ff:ff:ff:ff 2023-11-28T18:39:15.463 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T18:39:15.464 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:39:15.464 INFO:teuthology.orchestra.run.smithi045.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T18:39:15.464 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-28T18:39:15.464 INFO:teuthology.orchestra.run.smithi045.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-28T18:39:15.464 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:39:15.464 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-28T18:39:15.464 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:39:15.464 INFO:teuthology.orchestra.run.smithi045.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T18:39:15.465 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T18:39:15.465 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-28T18:39:15.465 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:39:15.465 INFO:teuthology.orchestra.run.smithi045.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T18:39:15.465 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T18:39:15.465 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-11-28T18:39:15.465 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:39:15.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:39:15.465 DEBUG:teuthology.orchestra.run.smithi045:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T18:39:15.522 INFO:teuthology.orchestra.run.smithi045.stdout:1 2023-11-28T18:39:15.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:39:15.524 DEBUG:teuthology.orchestra.run.smithi045:> route 2023-11-28T18:39:15.575 INFO:teuthology.orchestra.run.smithi045.stdout:Kernel IP routing table 2023-11-28T18:39:15.576 INFO:teuthology.orchestra.run.smithi045.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T18:39:15.576 INFO:teuthology.orchestra.run.smithi045.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-11-28T18:39:15.576 INFO:teuthology.orchestra.run.smithi045.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T18:39:15.576 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-11-28T18:39:15.576 INFO:teuthology.orchestra.run.smithi045.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T18:39:15.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:39:15.576 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-11-28T18:39:15.577 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-11-28T18:39:15.577 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-28T18:39:15.577 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-28T18:39:15.577 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-28T18:39:15.577 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-11-28T18:39:15.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:39:15.671 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-11-28T18:39:15.681 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-28T18:39:15.681 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-28T18:39:15.681 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T18:39:15.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:39:15.681 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set brx.0 up 2023-11-28T18:39:15.743 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-28T18:39:15.744 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T18:39:15.744 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-28T18:39:15.799 INFO:teuthology.orchestra.run.smithi045.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-28T18:39:15.799 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T18:39:15.799 DEBUG:teuthology.orchestra.run.smithi045:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-28T18:39:15.851 DEBUG:teuthology.orchestra.run.smithi045:> sudo modprobe fuse 2023-11-28T18:39:15.916 DEBUG:teuthology.orchestra.run.smithi045:> cat /proc/self/mounts | awk '{print $2}' 2023-11-28T18:39:15.968 INFO:teuthology.orchestra.run.smithi045.stdout:/sys 2023-11-28T18:39:15.968 INFO:teuthology.orchestra.run.smithi045.stdout:/proc 2023-11-28T18:39:15.969 INFO:teuthology.orchestra.run.smithi045.stdout:/dev 2023-11-28T18:39:15.969 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/pts 2023-11-28T18:39:15.969 INFO:teuthology.orchestra.run.smithi045.stdout:/run 2023-11-28T18:39:15.969 INFO:teuthology.orchestra.run.smithi045.stdout:/ 2023-11-28T18:39:15.969 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/security 2023-11-28T18:39:15.969 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/shm 2023-11-28T18:39:15.969 INFO:teuthology.orchestra.run.smithi045.stdout:/run/lock 2023-11-28T18:39:15.969 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/cgroup 2023-11-28T18:39:15.969 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/pstore 2023-11-28T18:39:15.969 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/bpf 2023-11-28T18:39:15.969 INFO:teuthology.orchestra.run.smithi045.stdout:/proc/sys/fs/binfmt_misc 2023-11-28T18:39:15.969 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/hugepages 2023-11-28T18:39:15.970 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/mqueue 2023-11-28T18:39:15.970 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/debug 2023-11-28T18:39:15.970 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/tracing 2023-11-28T18:39:15.970 INFO:teuthology.orchestra.run.smithi045.stdout:/proc/fs/nfsd 2023-11-28T18:39:15.970 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/fuse/connections 2023-11-28T18:39:15.970 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/config 2023-11-28T18:39:15.970 INFO:teuthology.orchestra.run.smithi045.stdout:/run/credentials/systemd-sysusers.service 2023-11-28T18:39:15.970 INFO:teuthology.orchestra.run.smithi045.stdout:/run/rpc_pipefs 2023-11-28T18:39:15.970 INFO:teuthology.orchestra.run.smithi045.stdout:/run/user/1000 2023-11-28T18:39:15.970 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph 2023-11-28T18:39:15.970 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-0 2023-11-28T18:39:15.970 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-1 2023-11-28T18:39:15.971 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-2 2023-11-28T18:39:15.971 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-3 2023-11-28T18:39:15.971 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns 2023-11-28T18:39:15.971 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T18:39:15.971 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T18:39:15.971 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T18:39:15.971 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T18:39:15.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:39:15.972 DEBUG:teuthology.orchestra.run.smithi045:> ls /sys/fs/fuse/connections 2023-11-28T18:39:16.022 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-28T18:39:16.023 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-28T18:39:16.069 DEBUG:teuthology.orchestra.run.smithi045:> sudo modprobe fuse 2023-11-28T18:39:16.091 DEBUG:teuthology.orchestra.run.smithi045:> cat /proc/self/mounts | awk '{print $2}' 2023-11-28T18:39:16.144 INFO:teuthology.orchestra.run.smithi045.stdout:/sys 2023-11-28T18:39:16.144 INFO:teuthology.orchestra.run.smithi045.stdout:/proc 2023-11-28T18:39:16.145 INFO:teuthology.orchestra.run.smithi045.stdout:/dev 2023-11-28T18:39:16.145 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/pts 2023-11-28T18:39:16.145 INFO:teuthology.orchestra.run.smithi045.stdout:/run 2023-11-28T18:39:16.145 INFO:teuthology.orchestra.run.smithi045.stdout:/ 2023-11-28T18:39:16.145 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/security 2023-11-28T18:39:16.145 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/shm 2023-11-28T18:39:16.145 INFO:teuthology.orchestra.run.smithi045.stdout:/run/lock 2023-11-28T18:39:16.145 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/cgroup 2023-11-28T18:39:16.145 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/pstore 2023-11-28T18:39:16.145 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/bpf 2023-11-28T18:39:16.146 INFO:teuthology.orchestra.run.smithi045.stdout:/proc/sys/fs/binfmt_misc 2023-11-28T18:39:16.146 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/hugepages 2023-11-28T18:39:16.146 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/mqueue 2023-11-28T18:39:16.146 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/debug 2023-11-28T18:39:16.146 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/tracing 2023-11-28T18:39:16.146 INFO:teuthology.orchestra.run.smithi045.stdout:/proc/fs/nfsd 2023-11-28T18:39:16.146 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/fuse/connections 2023-11-28T18:39:16.146 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/config 2023-11-28T18:39:16.146 INFO:teuthology.orchestra.run.smithi045.stdout:/run/credentials/systemd-sysusers.service 2023-11-28T18:39:16.146 INFO:teuthology.orchestra.run.smithi045.stdout:/run/rpc_pipefs 2023-11-28T18:39:16.147 INFO:teuthology.orchestra.run.smithi045.stdout:/run/user/1000 2023-11-28T18:39:16.147 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph 2023-11-28T18:39:16.147 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-0 2023-11-28T18:39:16.147 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-1 2023-11-28T18:39:16.147 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-2 2023-11-28T18:39:16.147 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-3 2023-11-28T18:39:16.147 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns 2023-11-28T18:39:16.147 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T18:39:16.147 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T18:39:16.147 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T18:39:16.148 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T18:39:16.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:39:16.149 DEBUG:teuthology.orchestra.run.smithi045:> ls /sys/fs/fuse/connections 2023-11-28T18:39:16.167 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:2023-11-28T18:39:16.165+0000 7fddf04c3580 -1 init, newargv = 0x557adc741df0 newargc=15 2023-11-28T18:39:16.167 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:ceph-fuse[48705]: starting ceph client 2023-11-28T18:39:16.174 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:ceph-fuse[48705]: starting fuse 2023-11-28T18:39:16.177 INFO:teuthology.orchestra.run.smithi045.stdout:43 2023-11-28T18:39:16.177 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-11-28T18:39:16.177 DEBUG:teuthology.orchestra.run.smithi045:> sudo stdin-killer -- python3 -c ' 2023-11-28T18:39:16.177 DEBUG:teuthology.orchestra.run.smithi045:> import glob 2023-11-28T18:39:16.177 DEBUG:teuthology.orchestra.run.smithi045:> import re 2023-11-28T18:39:16.177 DEBUG:teuthology.orchestra.run.smithi045:> import os 2023-11-28T18:39:16.178 DEBUG:teuthology.orchestra.run.smithi045:> import subprocess 2023-11-28T18:39:16.178 DEBUG:teuthology.orchestra.run.smithi045:> 2023-11-28T18:39:16.178 DEBUG:teuthology.orchestra.run.smithi045:> def _find_admin_socket(client_name): 2023-11-28T18:39:16.178 DEBUG:teuthology.orchestra.run.smithi045:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-28T18:39:16.178 DEBUG:teuthology.orchestra.run.smithi045:> files = glob.glob(asok_path) 2023-11-28T18:39:16.178 DEBUG:teuthology.orchestra.run.smithi045:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-28T18:39:16.178 DEBUG:teuthology.orchestra.run.smithi045:> 2023-11-28T18:39:16.179 DEBUG:teuthology.orchestra.run.smithi045:> # Given a non-glob path, it better be there 2023-11-28T18:39:16.179 DEBUG:teuthology.orchestra.run.smithi045:> if "*" not in asok_path: 2023-11-28T18:39:16.179 DEBUG:teuthology.orchestra.run.smithi045:> assert(len(files) == 1) 2023-11-28T18:39:16.179 DEBUG:teuthology.orchestra.run.smithi045:> return files[0] 2023-11-28T18:39:16.179 DEBUG:teuthology.orchestra.run.smithi045:> 2023-11-28T18:39:16.179 DEBUG:teuthology.orchestra.run.smithi045:> for f in files: 2023-11-28T18:39:16.179 DEBUG:teuthology.orchestra.run.smithi045:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-28T18:39:16.180 DEBUG:teuthology.orchestra.run.smithi045:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-28T18:39:16.180 DEBUG:teuthology.orchestra.run.smithi045:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-28T18:39:16.180 DEBUG:teuthology.orchestra.run.smithi045:> contents = proc_f.read() 2023-11-28T18:39:16.180 DEBUG:teuthology.orchestra.run.smithi045:> if mountpoint in contents: 2023-11-28T18:39:16.180 DEBUG:teuthology.orchestra.run.smithi045:> return f 2023-11-28T18:39:16.181 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-28T18:39:16.181 DEBUG:teuthology.orchestra.run.smithi045:> 2023-11-28T18:39:16.181 DEBUG:teuthology.orchestra.run.smithi045:> print(_find_admin_socket("client.0")) 2023-11-28T18:39:16.181 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-11-28T18:39:16.302 INFO:teuthology.orchestra.run.smithi045.stdout:/var/run/ceph/ceph-client.0.48705.asok 2023-11-28T18:39:16.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-28T18:39:16.314 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.48705.asok 2023-11-28T18:39:16.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:39:16.314 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.48705.asok status 2023-11-28T18:39:16.491 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-11-28T18:39:16.491 INFO:teuthology.orchestra.run.smithi045.stdout: "metadata": { 2023-11-28T18:39:16.491 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_sha1": "47c1c547372ed5bff7984647dc200bac0e019caf", 2023-11-28T18:39:16.492 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_version": "ceph version 18.0.0-7531-g47c1c547 (47c1c547372ed5bff7984647dc200bac0e019caf) reef (dev)", 2023-11-28T18:39:16.492 INFO:teuthology.orchestra.run.smithi045.stdout: "entity_id": "0", 2023-11-28T18:39:16.492 INFO:teuthology.orchestra.run.smithi045.stdout: "hostname": "smithi045", 2023-11-28T18:39:16.492 INFO:teuthology.orchestra.run.smithi045.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-28T18:39:16.492 INFO:teuthology.orchestra.run.smithi045.stdout: "pid": "48705", 2023-11-28T18:39:16.492 INFO:teuthology.orchestra.run.smithi045.stdout: "root": "/" 2023-11-28T18:39:16.492 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:39:16.492 INFO:teuthology.orchestra.run.smithi045.stdout: "dentry_count": 0, 2023-11-28T18:39:16.492 INFO:teuthology.orchestra.run.smithi045.stdout: "dentry_pinned_count": 0, 2023-11-28T18:39:16.492 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 5781, 2023-11-28T18:39:16.492 INFO:teuthology.orchestra.run.smithi045.stdout: "inst": { 2023-11-28T18:39:16.492 INFO:teuthology.orchestra.run.smithi045.stdout: "name": { 2023-11-28T18:39:16.493 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "client", 2023-11-28T18:39:16.493 INFO:teuthology.orchestra.run.smithi045.stdout: "num": 5781 2023-11-28T18:39:16.493 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:39:16.493 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": { 2023-11-28T18:39:16.493 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-11-28T18:39:16.493 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "192.168.0.1:0", 2023-11-28T18:39:16.493 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3183637595 2023-11-28T18:39:16.493 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:39:16.493 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:39:16.493 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": { 2023-11-28T18:39:16.493 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-11-28T18:39:16.494 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "192.168.0.1:0", 2023-11-28T18:39:16.494 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3183637595 2023-11-28T18:39:16.494 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:39:16.494 INFO:teuthology.orchestra.run.smithi045.stdout: "inst_str": "client.5781 192.168.0.1:0/3183637595", 2023-11-28T18:39:16.494 INFO:teuthology.orchestra.run.smithi045.stdout: "addr_str": "192.168.0.1:0/3183637595", 2023-11-28T18:39:16.494 INFO:teuthology.orchestra.run.smithi045.stdout: "inode_count": 1, 2023-11-28T18:39:16.494 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_epoch": 24, 2023-11-28T18:39:16.494 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_epoch": 35, 2023-11-28T18:39:16.494 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_epoch_barrier": 0, 2023-11-28T18:39:16.494 INFO:teuthology.orchestra.run.smithi045.stdout: "blocklisted": false, 2023-11-28T18:39:16.494 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs" 2023-11-28T18:39:16.495 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-11-28T18:39:16.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:39:16.508 DEBUG:teuthology.orchestra.run.smithi045:> stat --file-system '--printf=%T 2023-11-28T18:39:16.508 DEBUG:teuthology.orchestra.run.smithi045:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-28T18:39:16.518 INFO:teuthology.orchestra.run.smithi045.stdout:fuseblk 2023-11-28T18:39:16.518 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-28T18:39:16.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:39:16.518 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-28T18:39:16.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:39:16.587 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls -R) 2023-11-28T18:39:16.652 INFO:teuthology.orchestra.run.smithi045.stdout:.: 2023-11-28T18:39:16.652 INFO:teuthology.orchestra.run.smithi045.stdout:linkdir 2023-11-28T18:39:16.652 INFO:teuthology.orchestra.run.smithi045.stdout:rootfile 2023-11-28T18:39:16.652 INFO:teuthology.orchestra.run.smithi045.stdout:subdir 2023-11-28T18:39:16.652 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:39:16.652 INFO:teuthology.orchestra.run.smithi045.stdout:./linkdir: 2023-11-28T18:39:16.652 INFO:teuthology.orchestra.run.smithi045.stdout:link0 2023-11-28T18:39:16.652 INFO:teuthology.orchestra.run.smithi045.stdout:link1 2023-11-28T18:39:16.653 INFO:teuthology.orchestra.run.smithi045.stdout:link2 2023-11-28T18:39:16.653 INFO:teuthology.orchestra.run.smithi045.stdout:link3 2023-11-28T18:39:16.653 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:39:16.653 INFO:teuthology.orchestra.run.smithi045.stdout:./subdir: 2023-11-28T18:39:16.653 INFO:teuthology.orchestra.run.smithi045.stdout:subdirfile 2023-11-28T18:39:16.653 INFO:teuthology.orchestra.run.smithi045.stdout:subsubdir 2023-11-28T18:39:16.653 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:39:16.653 INFO:teuthology.orchestra.run.smithi045.stdout:./subdir/subsubdir: 2023-11-28T18:39:16.655 DEBUG:teuthology.orchestra.run.smithi045:> stdin-killer -- python3 -c ' 2023-11-28T18:39:16.655 DEBUG:teuthology.orchestra.run.smithi045:> import os 2023-11-28T18:39:16.655 DEBUG:teuthology.orchestra.run.smithi045:> import stat 2023-11-28T18:39:16.655 DEBUG:teuthology.orchestra.run.smithi045:> 2023-11-28T18:39:16.655 DEBUG:teuthology.orchestra.run.smithi045:> print(os.stat("/home/ubuntu/cephtest/mnt.0/rootfile").st_ino) 2023-11-28T18:39:16.655 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-11-28T18:39:16.766 INFO:teuthology.orchestra.run.smithi045.stdout:1099511627776 2023-11-28T18:39:16.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-28T18:39:16.776 DEBUG:teuthology.orchestra.run.smithi045:> stdin-killer -- python3 -c ' 2023-11-28T18:39:16.776 DEBUG:teuthology.orchestra.run.smithi045:> import os 2023-11-28T18:39:16.776 DEBUG:teuthology.orchestra.run.smithi045:> import stat 2023-11-28T18:39:16.776 DEBUG:teuthology.orchestra.run.smithi045:> 2023-11-28T18:39:16.776 DEBUG:teuthology.orchestra.run.smithi045:> print(os.stat("/home/ubuntu/cephtest/mnt.0/subdir").st_ino) 2023-11-28T18:39:16.776 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-11-28T18:39:16.884 INFO:teuthology.orchestra.run.smithi045.stdout:1099511627777 2023-11-28T18:39:16.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-28T18:39:16.894 DEBUG:teuthology.orchestra.run.smithi045:> stdin-killer -- python3 -c ' 2023-11-28T18:39:16.894 DEBUG:teuthology.orchestra.run.smithi045:> import os 2023-11-28T18:39:16.894 DEBUG:teuthology.orchestra.run.smithi045:> import stat 2023-11-28T18:39:16.894 DEBUG:teuthology.orchestra.run.smithi045:> 2023-11-28T18:39:16.895 DEBUG:teuthology.orchestra.run.smithi045:> print(os.stat("/home/ubuntu/cephtest/mnt.0/subdir/subdirfile").st_ino) 2023-11-28T18:39:16.895 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-11-28T18:39:17.006 INFO:teuthology.orchestra.run.smithi045.stdout:1099511627778 2023-11-28T18:39:17.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-28T18:39:17.015 DEBUG:teuthology.orchestra.run.smithi045:> stdin-killer -- python3 -c ' 2023-11-28T18:39:17.015 DEBUG:teuthology.orchestra.run.smithi045:> import os 2023-11-28T18:39:17.015 DEBUG:teuthology.orchestra.run.smithi045:> import stat 2023-11-28T18:39:17.015 DEBUG:teuthology.orchestra.run.smithi045:> 2023-11-28T18:39:17.015 DEBUG:teuthology.orchestra.run.smithi045:> print(os.stat("/home/ubuntu/cephtest/mnt.0/subdir/subsubdir").st_ino) 2023-11-28T18:39:17.015 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-11-28T18:39:17.125 INFO:teuthology.orchestra.run.smithi045.stdout:1099511628282 2023-11-28T18:39:17.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-28T18:39:17.134 DEBUG:teuthology.orchestra.run.smithi045:> stdin-killer -- python3 -c ' 2023-11-28T18:39:17.134 DEBUG:teuthology.orchestra.run.smithi045:> import os 2023-11-28T18:39:17.134 DEBUG:teuthology.orchestra.run.smithi045:> import stat 2023-11-28T18:39:17.134 DEBUG:teuthology.orchestra.run.smithi045:> 2023-11-28T18:39:17.135 DEBUG:teuthology.orchestra.run.smithi045:> print(os.stat("/home/ubuntu/cephtest/mnt.0/linkdir/link0").st_ino) 2023-11-28T18:39:17.135 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-11-28T18:39:17.246 INFO:teuthology.orchestra.run.smithi045.stdout:1099511627778 2023-11-28T18:39:17.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-28T18:39:17.255 DEBUG:teuthology.orchestra.run.smithi045:> stdin-killer -- python3 -c ' 2023-11-28T18:39:17.255 DEBUG:teuthology.orchestra.run.smithi045:> import os 2023-11-28T18:39:17.255 DEBUG:teuthology.orchestra.run.smithi045:> import stat 2023-11-28T18:39:17.255 DEBUG:teuthology.orchestra.run.smithi045:> 2023-11-28T18:39:17.255 DEBUG:teuthology.orchestra.run.smithi045:> print(os.stat("/home/ubuntu/cephtest/mnt.0/linkdir/link1").st_ino) 2023-11-28T18:39:17.255 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-11-28T18:39:17.369 INFO:teuthology.orchestra.run.smithi045.stdout:1099511627778 2023-11-28T18:39:17.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-28T18:39:17.378 DEBUG:teuthology.orchestra.run.smithi045:> stdin-killer -- python3 -c ' 2023-11-28T18:39:17.378 DEBUG:teuthology.orchestra.run.smithi045:> import os 2023-11-28T18:39:17.378 DEBUG:teuthology.orchestra.run.smithi045:> import stat 2023-11-28T18:39:17.379 DEBUG:teuthology.orchestra.run.smithi045:> 2023-11-28T18:39:17.379 DEBUG:teuthology.orchestra.run.smithi045:> print(os.stat("/home/ubuntu/cephtest/mnt.0/linkdir/link2").st_ino) 2023-11-28T18:39:17.379 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-11-28T18:39:17.489 INFO:teuthology.orchestra.run.smithi045.stdout:1099511628281 2023-11-28T18:39:17.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-28T18:39:17.498 DEBUG:teuthology.orchestra.run.smithi045:> stdin-killer -- python3 -c ' 2023-11-28T18:39:17.498 DEBUG:teuthology.orchestra.run.smithi045:> import os 2023-11-28T18:39:17.498 DEBUG:teuthology.orchestra.run.smithi045:> import stat 2023-11-28T18:39:17.498 DEBUG:teuthology.orchestra.run.smithi045:> 2023-11-28T18:39:17.498 DEBUG:teuthology.orchestra.run.smithi045:> print(os.stat("/home/ubuntu/cephtest/mnt.0/linkdir/link3").st_ino) 2023-11-28T18:39:17.498 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-11-28T18:39:17.609 INFO:teuthology.orchestra.run.smithi045.stdout:1099511627776 2023-11-28T18:39:17.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-28T18:39:17.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:39:17.619 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch afterwards) 2023-11-28T18:39:17.677 DEBUG:teuthology.orchestra.run.smithi045:> stdin-killer -- python3 -c ' 2023-11-28T18:39:17.677 DEBUG:teuthology.orchestra.run.smithi045:> import os 2023-11-28T18:39:17.677 DEBUG:teuthology.orchestra.run.smithi045:> import stat 2023-11-28T18:39:17.677 DEBUG:teuthology.orchestra.run.smithi045:> 2023-11-28T18:39:17.677 DEBUG:teuthology.orchestra.run.smithi045:> print(os.stat("/home/ubuntu/cephtest/mnt.0/afterwards").st_ino) 2023-11-28T18:39:17.677 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-11-28T18:39:17.789 INFO:teuthology.orchestra.run.smithi045.stdout:1099521627779 2023-11-28T18:39:17.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-28T18:39:17.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:39:17.798 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch subdir/subsubdir/subsubdirfile) 2023-11-28T18:39:17.854 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-11-28T18:39:17.849+0000 7f70c1bb9640 -1 log_channel(cluster) log [ERR] : bad backtrace on directory inode 0x100000001fa 2023-11-28T18:39:17.856 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-28T18:39:17.856 DEBUG:teuthology.orchestra.run.smithi045:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T18:39:17.977 DEBUG:teuthology.orchestra.run.smithi190:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T18:39:18.064 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-28T18:39:18.064 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T18:39:18.065 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T18:39:18.074 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T18:39:18.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.257+0000 7f08e0d57640 1 Processor -- start 2023-11-28T18:39:18.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.257+0000 7f08e0d57640 1 -- start start 2023-11-28T18:39:18.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.261+0000 7f08e0d57640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f08dc06ca10 0x7f08dc0704a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:18.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.261+0000 7f08e0d57640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f08dc0721c0 0x7f08dc0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:18.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.261+0000 7f08e0d57640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08dc071120 con 0x7f08dc144880 2023-11-28T18:39:18.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.261+0000 7f08e0d57640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08dc15f050 con 0x7f08dc0721c0 2023-11-28T18:39:18.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.261+0000 7f08e0d57640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08dc070f20 con 0x7f08dc06ca10 2023-11-28T18:39:18.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.261+0000 7f08dad9d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f08dc0721c0 0x7f08dc0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:18.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.261+0000 7f08dad9d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f08dc0721c0 0x7f08dc0709e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.45:45020/0 (socket says 172.21.15.45:45020) 2023-11-28T18:39:18.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.261+0000 7f08dad9d640 1 -- 172.21.15.45:0/2381775615 learned_addr learned my addr 172.21.15.45:0/2381775615 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:18.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.261+0000 7f08d3fff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f08dc06ca10 0x7f08dc0704a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:18.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.261+0000 7f08da59c640 1 --1- 172.21.15.45:0/2381775615 >> v1:172.21.15.190:6789/0 conn(0x7f08dc144880 0x7f08dc06c300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.45:60690/0 (socket says 172.21.15.45:60690) 2023-11-28T18:39:18.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.261+0000 7f08d3fff640 1 -- 172.21.15.45:0/2381775615 >> v2:172.21.15.190:3300/0 conn(0x7f08dc0721c0 msgr2=0x7f08dc0709e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:18.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.261+0000 7f08d3fff640 1 --2- 172.21.15.45:0/2381775615 >> v2:172.21.15.190:3300/0 conn(0x7f08dc0721c0 0x7f08dc0709e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:18.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.261+0000 7f08d3fff640 1 -- 172.21.15.45:0/2381775615 >> v1:172.21.15.190:6789/0 conn(0x7f08dc144880 legacy=0x7f08dc06c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:18.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.261+0000 7f08d3fff640 1 -- 172.21.15.45:0/2381775615 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08dc071400 con 0x7f08dc06ca10 2023-11-28T18:39:18.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.261+0000 7f08d9d9b640 1 -- 172.21.15.45:0/2381775615 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3839584694 0 0) 0x7f08dc071120 con 0x7f08dc144880 2023-11-28T18:39:18.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.261+0000 7f08dad9d640 1 --2- 172.21.15.45:0/2381775615 >> v2:172.21.15.190:3300/0 conn(0x7f08dc0721c0 0x7f08dc0709e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:39:18.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.265+0000 7f08d3fff640 1 --2- 172.21.15.45:0/2381775615 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f08dc06ca10 0x7f08dc0704a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f08c40097c0 tx=0x7f08c401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=788e16560e823ac3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:18.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.265+0000 7f08d9d9b640 1 -- 172.21.15.45:0/2381775615 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c40ab650 con 0x7f08dc06ca10 2023-11-28T18:39:18.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.265+0000 7f08d9d9b640 1 -- 172.21.15.45:0/2381775615 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08c40ab7b0 con 0x7f08dc06ca10 2023-11-28T18:39:18.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.265+0000 7f08d9d9b640 1 -- 172.21.15.45:0/2381775615 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c40abb40 con 0x7f08dc06ca10 2023-11-28T18:39:18.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.265+0000 7f08e0d57640 1 -- 172.21.15.45:0/2381775615 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f08dc06ca10 msgr2=0x7f08dc0704a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:18.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.265+0000 7f08e0d57640 1 --2- 172.21.15.45:0/2381775615 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f08dc06ca10 0x7f08dc0704a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f08c40097c0 tx=0x7f08c401c450 comp rx=0 tx=0).stop 2023-11-28T18:39:18.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.265+0000 7f08e0d57640 1 -- 172.21.15.45:0/2381775615 shutdown_connections 2023-11-28T18:39:18.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.265+0000 7f08e0d57640 1 --2- 172.21.15.45:0/2381775615 >> v2:172.21.15.190:3300/0 conn(0x7f08dc0721c0 0x7f08dc0709e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:18.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.265+0000 7f08e0d57640 1 --2- 172.21.15.45:0/2381775615 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f08dc06ca10 0x7f08dc0704a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:18.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.265+0000 7f08e0d57640 1 -- 172.21.15.45:0/2381775615 >> 172.21.15.45:0/2381775615 conn(0x7f08dc06a570 msgr2=0x7f08dc06a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:18.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.265+0000 7f08e0d57640 1 -- 172.21.15.45:0/2381775615 shutdown_connections 2023-11-28T18:39:18.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.265+0000 7f08e0d57640 1 -- 172.21.15.45:0/2381775615 wait complete. 2023-11-28T18:39:18.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.265+0000 7f08e0d57640 1 Processor -- start 2023-11-28T18:39:18.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.265+0000 7f08e0d57640 1 -- start start 2023-11-28T18:39:18.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.269+0000 7f08e0d57640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f08dc06ca10 0x7f08dc12d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:18.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.269+0000 7f08e0d57640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08dc0721c0 0x7f08dc0b2450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:18.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.269+0000 7f08e0d57640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f08dc144880 0x7f08dc0b2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:18.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.269+0000 7f08e0d57640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08dc134260 con 0x7f08dc0721c0 2023-11-28T18:39:18.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.269+0000 7f08e0d57640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08dc134540 con 0x7f08dc06ca10 2023-11-28T18:39:18.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.269+0000 7f08e0d57640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08dc134820 con 0x7f08dc144880 2023-11-28T18:39:18.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.269+0000 7f08d3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08dc0721c0 0x7f08dc0b2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:18.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.269+0000 7f08d3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08dc0721c0 0x7f08dc0b2450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36548/0 (socket says 172.21.15.45:36548) 2023-11-28T18:39:18.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.269+0000 7f08d3fff640 1 -- 172.21.15.45:0/1506529462 learned_addr learned my addr 172.21.15.45:0/1506529462 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:18.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.269+0000 7f08da59c640 1 --2- 172.21.15.45:0/1506529462 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f08dc06ca10 0x7f08dc12d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:18.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.269+0000 7f08dad9d640 1 --2- 172.21.15.45:0/1506529462 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f08dc144880 0x7f08dc0b2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:18.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.269+0000 7f08d3fff640 1 -- 172.21.15.45:0/1506529462 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f08dc144880 msgr2=0x7f08dc0b2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:18.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.269+0000 7f08d3fff640 1 --2- 172.21.15.45:0/1506529462 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f08dc144880 0x7f08dc0b2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:18.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.269+0000 7f08d3fff640 1 -- 172.21.15.45:0/1506529462 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f08dc06ca10 msgr2=0x7f08dc12d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:18.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.269+0000 7f08d3fff640 1 --2- 172.21.15.45:0/1506529462 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f08dc06ca10 0x7f08dc12d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:18.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.269+0000 7f08d3fff640 1 -- 172.21.15.45:0/1506529462 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d4009b30 con 0x7f08dc0721c0 2023-11-28T18:39:18.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.269+0000 7f08dad9d640 1 --2- 172.21.15.45:0/1506529462 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f08dc144880 0x7f08dc0b2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:39:18.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.269+0000 7f08d3fff640 1 --2- 172.21.15.45:0/1506529462 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08dc0721c0 0x7f08dc0b2450 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f08c40ad040 tx=0x7f08c401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:18.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.269+0000 7f08d2ffd640 1 -- 172.21.15.45:0/1506529462 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c40bf610 con 0x7f08dc0721c0 2023-11-28T18:39:18.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.269+0000 7f08d2ffd640 1 -- 172.21.15.45:0/1506529462 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08c40bf790 con 0x7f08dc0721c0 2023-11-28T18:39:18.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.269+0000 7f08d2ffd640 1 -- 172.21.15.45:0/1506529462 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c40bfb40 con 0x7f08dc0721c0 2023-11-28T18:39:18.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.269+0000 7f08e0d57640 1 -- 172.21.15.45:0/1506529462 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08c4009420 con 0x7f08dc0721c0 2023-11-28T18:39:18.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.269+0000 7f08e0d57640 1 -- 172.21.15.45:0/1506529462 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08dc134b00 con 0x7f08dc0721c0 2023-11-28T18:39:18.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.269+0000 7f08e0d57640 1 -- 172.21.15.45:0/1506529462 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08dc134960 con 0x7f08dc0721c0 2023-11-28T18:39:18.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.269+0000 7f08d2ffd640 1 -- 172.21.15.45:0/1506529462 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f08c40b5400 con 0x7f08dc0721c0 2023-11-28T18:39:18.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.273+0000 7f08d2ffd640 1 --2- 172.21.15.45:0/1506529462 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f08bc0668d0 0x7f08bc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:18.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.273+0000 7f08d2ffd640 1 -- 172.21.15.45:0/1506529462 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f08c411f060 con 0x7f08dc0721c0 2023-11-28T18:39:18.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.273+0000 7f08da59c640 1 --2- 172.21.15.45:0/1506529462 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f08bc0668d0 0x7f08bc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:18.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.273+0000 7f08da59c640 1 --2- 172.21.15.45:0/1506529462 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f08bc0668d0 0x7f08bc068d90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f08cc000f70 tx=0x7f08cc007df0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:18.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.277+0000 7f08d2ffd640 1 -- 172.21.15.45:0/1506529462 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f08dc134960 con 0x7f08dc0721c0 2023-11-28T18:39:18.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.433+0000 7f08e0d57640 1 -- 172.21.15.45:0/1506529462 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f08dc134960 con 0x7f08dc0721c0 2023-11-28T18:39:18.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.433+0000 7f08d2ffd640 1 -- 172.21.15.45:0/1506529462 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16662 (secure 0 0 0) 0x7f08dc134960 con 0x7f08dc0721c0 2023-11-28T18:39:18.438 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:39:18.438 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":35,"fsid":"d10f5cd6-1d00-4019-99b6-6fa435498a15","created":"2023-11-28T18:37:08.189030+0000","modified":"2023-11-28T18:39:02.760784+0000","last_up_change":"2023-11-28T18:37:20.196124+0000","last_in_change":"2023-11-28T18:37:10.742043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T18:37:21.293917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-28T18:38:33.254037+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-28T18:38:34.414654+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"84465384-103c-4f2c-a45a-96f5bb9c835f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6809","nonce":555237322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6811","nonce":555237322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6815","nonce":555237322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6813","nonce":555237322}]},"public_addr":"172.21.15.45:6809/555237322","cluster_addr":"172.21.15.45:6811/555237322","heartbeat_back_addr":"172.21.15.45:6815/555237322","heartbeat_front_addr":"172.21.15.45:6813/555237322","state":["exists","up"]},{"osd":1,"uuid":"7d9eed24-a58f-42c7-a787-ac06be8553fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6801","nonce":2857063763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6803","nonce":2857063763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6807","nonce":2857063763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6805","nonce":2857063763}]},"public_addr":"172.21.15.45:6801/2857063763","cluster_addr":"172.21.15.45:6803/2857063763","heartbeat_back_addr":"172.21.15.45:6807/2857063763","heartbeat_front_addr":"172.21.15.45:6805/2857063763","state":["exists","up"]},{"osd":2,"uuid":"575eeccc-4abf-45b4-9caf-f3e797859588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6817","nonce":193884539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6819","nonce":193884539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6823","nonce":193884539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6821","nonce":193884539}]},"public_addr":"172.21.15.45:6817/193884539","cluster_addr":"172.21.15.45:6819/193884539","heartbeat_back_addr":"172.21.15.45:6823/193884539","heartbeat_front_addr":"172.21.15.45:6821/193884539","state":["exists","up"]},{"osd":3,"uuid":"9b0290d6-9a52-4bc8-b2a1-7622c5dc8e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6825","nonce":78541084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6827","nonce":78541084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6831","nonce":78541084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6829","nonce":78541084}]},"public_addr":"172.21.15.45:6825/78541084","cluster_addr":"172.21.15.45:6827/78541084","heartbeat_back_addr":"172.21.15.45:6831/78541084","heartbeat_front_addr":"172.21.15.45:6829/78541084","state":["exists","up"]},{"osd":4,"uuid":"ce632829-f027-4fbf-a627-02c571aa9d53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6809","nonce":1537591987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6811","nonce":1537591987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6815","nonce":1537591987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6813","nonce":1537591987}]},"public_addr":"172.21.15.190:6809/1537591987","cluster_addr":"172.21.15.190:6811/1537591987","heartbeat_back_addr":"172.21.15.190:6815/1537591987","heartbeat_front_addr":"172.21.15.190:6813/1537591987","state":["exists","up"]},{"osd":5,"uuid":"8700b609-27be-40bd-a251-4c0ae0a29ead","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6801","nonce":3296698407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6803","nonce":3296698407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6807","nonce":3296698407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6805","nonce":3296698407}]},"public_addr":"172.21.15.190:6801/3296698407","cluster_addr":"172.21.15.190:6803/3296698407","heartbeat_back_addr":"172.21.15.190:6807/3296698407","heartbeat_front_addr":"172.21.15.190:6805/3296698407","state":["exists","up"]},{"osd":6,"uuid":"44ce4a40-e6ff-4f4d-8e8a-7341e5c91f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6817","nonce":2317686718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6819","nonce":2317686718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6823","nonce":2317686718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6821","nonce":2317686718}]},"public_addr":"172.21.15.190:6817/2317686718","cluster_addr":"172.21.15.190:6819/2317686718","heartbeat_back_addr":"172.21.15.190:6823/2317686718","heartbeat_front_addr":"172.21.15.190:6821/2317686718","state":["exists","up"]},{"osd":7,"uuid":"192238c9-1423-4b7e-ac8f-84ba32113ddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6825","nonce":2493232051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6827","nonce":2493232051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6831","nonce":2493232051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6829","nonce":2493232051}]},"public_addr":"172.21.15.190:6825/2493232051","cluster_addr":"172.21.15.190:6827/2493232051","heartbeat_back_addr":"172.21.15.190:6831/2493232051","heartbeat_front_addr":"172.21.15.190:6829/2493232051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.393552+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.385453+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.361421+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.366408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.363226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.276007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.414605+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.445885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6834/2398964901":"2023-11-29T18:39:02.760758+0000","172.21.15.45:6832/2398964901":"2023-11-29T18:39:02.760758+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T18:39:18.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.437+0000 7f08e0d57640 1 -- 172.21.15.45:0/1506529462 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f08bc0668d0 msgr2=0x7f08bc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:18.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.437+0000 7f08e0d57640 1 --2- 172.21.15.45:0/1506529462 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f08bc0668d0 0x7f08bc068d90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f08cc000f70 tx=0x7f08cc007df0 comp rx=0 tx=0).stop 2023-11-28T18:39:18.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.437+0000 7f08e0d57640 1 -- 172.21.15.45:0/1506529462 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08dc0721c0 msgr2=0x7f08dc0b2450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:18.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.437+0000 7f08e0d57640 1 --2- 172.21.15.45:0/1506529462 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08dc0721c0 0x7f08dc0b2450 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f08c40ad040 tx=0x7f08c401ac90 comp rx=0 tx=0).stop 2023-11-28T18:39:18.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.437+0000 7f08e0d57640 1 -- 172.21.15.45:0/1506529462 shutdown_connections 2023-11-28T18:39:18.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.437+0000 7f08e0d57640 1 --2- 172.21.15.45:0/1506529462 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f08bc0668d0 0x7f08bc068d90 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:18.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.437+0000 7f08e0d57640 1 --2- 172.21.15.45:0/1506529462 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f08dc144880 0x7f08dc0b2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:18.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.437+0000 7f08e0d57640 1 --2- 172.21.15.45:0/1506529462 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08dc0721c0 0x7f08dc0b2450 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:18.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.437+0000 7f08e0d57640 1 --2- 172.21.15.45:0/1506529462 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f08dc06ca10 0x7f08dc12d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:18.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.437+0000 7f08e0d57640 1 -- 172.21.15.45:0/1506529462 >> 172.21.15.45:0/1506529462 conn(0x7f08dc06a570 msgr2=0x7f08dc13e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:18.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.437+0000 7f08e0d57640 1 -- 172.21.15.45:0/1506529462 shutdown_connections 2023-11-28T18:39:18.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.437+0000 7f08e0d57640 1 -- 172.21.15.45:0/1506529462 wait complete. 2023-11-28T18:39:18.459 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T18:37:21.293917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T18:38:33.254037+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T18:38:34.414654+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T18:39:18.460 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T18:39:18.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.601+0000 7f81270e3640 1 Processor -- start 2023-11-28T18:39:18.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.601+0000 7f81270e3640 1 -- start start 2023-11-28T18:39:18.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.605+0000 7f81270e3640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f8120158ce0 0x7f812015eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:18.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.605+0000 7f81270e3640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f812015b6b0 con 0x7f81200b4310 2023-11-28T18:39:18.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.605+0000 7f81270e3640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f812015c550 con 0x7f81200cba50 2023-11-28T18:39:18.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.605+0000 7f81270e3640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f812015f450 con 0x7f8120158ce0 2023-11-28T18:39:18.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.605+0000 7f8125680640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f81200b4310 0x7f8120070430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52964/0 (socket says 172.21.15.45:52964) 2023-11-28T18:39:18.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.605+0000 7f8125680640 1 -- 172.21.15.45:0/2636157413 learned_addr learned my addr 172.21.15.45:0/2636157413 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:39:18.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.605+0000 7f8124e7f640 1 --2- 172.21.15.45:0/2636157413 >> v2:172.21.15.190:3300/0 conn(0x7f8120158ce0 0x7f812015eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:18.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.605+0000 7f811f7fe640 1 -- 172.21.15.45:0/2636157413 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3198361748 0 0) 0x7f812015b6b0 con 0x7f81200b4310 2023-11-28T18:39:18.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.605+0000 7f811f7fe640 1 -- 172.21.15.45:0/2636157413 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8110003530 con 0x7f81200b4310 2023-11-28T18:39:18.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.605+0000 7f811f7fe640 1 -- 172.21.15.45:0/2636157413 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 206564852 0 0) 0x7f812015c550 con 0x7f81200cba50 2023-11-28T18:39:18.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.605+0000 7f811f7fe640 1 -- 172.21.15.45:0/2636157413 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f812015b6b0 con 0x7f81200cba50 2023-11-28T18:39:18.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.605+0000 7f8124e7f640 1 -- 172.21.15.45:0/2636157413 >> v1:172.21.15.190:6789/0 conn(0x7f81200cba50 legacy=0x7f812015be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:18.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.605+0000 7f8124e7f640 1 -- 172.21.15.45:0/2636157413 >> v1:172.21.15.45:6789/0 conn(0x7f81200b4310 legacy=0x7f8120070430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:18.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.605+0000 7f8124e7f640 1 -- 172.21.15.45:0/2636157413 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f812015f730 con 0x7f8120158ce0 2023-11-28T18:39:18.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.609+0000 7f8124e7f640 1 --2- 172.21.15.45:0/2636157413 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8120158ce0 0x7f812015eb90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f81140097c0 tx=0x7f811401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7cfcb70972ebd77 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:18.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.609+0000 7f811f7fe640 1 -- 172.21.15.45:0/2636157413 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81140ab670 con 0x7f8120158ce0 2023-11-28T18:39:18.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.609+0000 7f811f7fe640 1 -- 172.21.15.45:0/2636157413 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81140ab7d0 con 0x7f8120158ce0 2023-11-28T18:39:18.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.609+0000 7f811f7fe640 1 -- 172.21.15.45:0/2636157413 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81140abb60 con 0x7f8120158ce0 2023-11-28T18:39:18.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.609+0000 7f81270e3640 1 -- 172.21.15.45:0/2636157413 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8120158ce0 msgr2=0x7f812015eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:18.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.609+0000 7f81270e3640 1 --2- 172.21.15.45:0/2636157413 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8120158ce0 0x7f812015eb90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f81140097c0 tx=0x7f811401c450 comp rx=0 tx=0).stop 2023-11-28T18:39:18.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.609+0000 7f81270e3640 1 -- 172.21.15.45:0/2636157413 shutdown_connections 2023-11-28T18:39:18.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.609+0000 7f81270e3640 1 --2- 172.21.15.45:0/2636157413 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8120158ce0 0x7f812015eb90 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:18.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.609+0000 7f81270e3640 1 -- 172.21.15.45:0/2636157413 >> 172.21.15.45:0/2636157413 conn(0x7f81200b0d00 msgr2=0x7f81200b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:18.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.609+0000 7f81270e3640 1 -- 172.21.15.45:0/2636157413 shutdown_connections 2023-11-28T18:39:18.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.609+0000 7f81270e3640 1 -- 172.21.15.45:0/2636157413 wait complete. 2023-11-28T18:39:18.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.609+0000 7f81270e3640 1 Processor -- start 2023-11-28T18:39:18.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.609+0000 7f81270e3640 1 -- start start 2023-11-28T18:39:18.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.613+0000 7f81270e3640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f81200b4310 0x7f8120149eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:18.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.613+0000 7f81270e3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81200cba50 0x7f81201517a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:18.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.613+0000 7f81270e3640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8120158ce0 0x7f8120164a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:18.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.613+0000 7f81270e3640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8120164650 con 0x7f81200cba50 2023-11-28T18:39:18.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.613+0000 7f81270e3640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f812014a3f0 con 0x7f8120158ce0 2023-11-28T18:39:18.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.613+0000 7f81270e3640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8120166060 con 0x7f81200b4310 2023-11-28T18:39:18.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.613+0000 7f811ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81200cba50 0x7f81201517a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:18.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.613+0000 7f811ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81200cba50 0x7f81201517a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36558/0 (socket says 172.21.15.45:36558) 2023-11-28T18:39:18.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.613+0000 7f811ffff640 1 -- 172.21.15.45:0/2828246970 learned_addr learned my addr 172.21.15.45:0/2828246970 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:18.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.613+0000 7f8124e7f640 1 --2- 172.21.15.45:0/2828246970 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f81200b4310 0x7f8120149eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:18.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.613+0000 7f8125680640 1 --2- 172.21.15.45:0/2828246970 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8120158ce0 0x7f8120164a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:18.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.613+0000 7f811ffff640 1 -- 172.21.15.45:0/2828246970 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f81200b4310 msgr2=0x7f8120149eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:18.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.613+0000 7f811ffff640 1 --2- 172.21.15.45:0/2828246970 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f81200b4310 0x7f8120149eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:18.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.613+0000 7f811ffff640 1 -- 172.21.15.45:0/2828246970 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8120158ce0 msgr2=0x7f8120164a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:18.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.613+0000 7f811ffff640 1 --2- 172.21.15.45:0/2828246970 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8120158ce0 0x7f8120164a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:18.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.613+0000 7f811ffff640 1 -- 172.21.15.45:0/2828246970 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8114009420 con 0x7f81200cba50 2023-11-28T18:39:18.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.613+0000 7f8125680640 1 --2- 172.21.15.45:0/2828246970 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8120158ce0 0x7f8120164a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:39:18.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.613+0000 7f811ffff640 1 --2- 172.21.15.45:0/2828246970 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81200cba50 0x7f81201517a0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f810c00c500 tx=0x7f810c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:18.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.613+0000 7f811d7fa640 1 -- 172.21.15.45:0/2828246970 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810c0052d0 con 0x7f81200cba50 2023-11-28T18:39:18.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.613+0000 7f81270e3640 1 -- 172.21.15.45:0/2828246970 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81200b4cb0 con 0x7f81200cba50 2023-11-28T18:39:18.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.613+0000 7f811d7fa640 1 -- 172.21.15.45:0/2828246970 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f810c005430 con 0x7f81200cba50 2023-11-28T18:39:18.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.613+0000 7f811d7fa640 1 -- 172.21.15.45:0/2828246970 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810c003820 con 0x7f81200cba50 2023-11-28T18:39:18.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.613+0000 7f81270e3640 1 -- 172.21.15.45:0/2828246970 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8120165d80 con 0x7f81200cba50 2023-11-28T18:39:18.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.613+0000 7f81270e3640 1 -- 172.21.15.45:0/2828246970 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8120069410 con 0x7f81200cba50 2023-11-28T18:39:18.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.613+0000 7f811d7fa640 1 -- 172.21.15.45:0/2828246970 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f810c003980 con 0x7f81200cba50 2023-11-28T18:39:18.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.617+0000 7f811d7fa640 1 --2- 172.21.15.45:0/2828246970 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f81040668d0 0x7f8104068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:18.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.617+0000 7f811d7fa640 1 -- 172.21.15.45:0/2828246970 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f810c083b50 con 0x7f81200cba50 2023-11-28T18:39:18.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.617+0000 7f8124e7f640 1 --2- 172.21.15.45:0/2828246970 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f81040668d0 0x7f8104068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:18.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.617+0000 7f8124e7f640 1 --2- 172.21.15.45:0/2828246970 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f81040668d0 0x7f8104068d90 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f81140af000 tx=0x7f81140a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:18.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.621+0000 7f811d7fa640 1 -- 172.21.15.45:0/2828246970 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f810c050d50 con 0x7f81200cba50 2023-11-28T18:39:18.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.777+0000 7f81270e3640 1 -- 172.21.15.45:0/2828246970 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f81200b19d0 con 0x7f81200cba50 2023-11-28T18:39:18.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.777+0000 7f811d7fa640 1 -- 172.21.15.45:0/2828246970 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7f810c054370 con 0x7f81200cba50 2023-11-28T18:39:18.781 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-11-28T18:39:18.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.781+0000 7f81270e3640 1 -- 172.21.15.45:0/2828246970 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f81040668d0 msgr2=0x7f8104068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:18.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.781+0000 7f81270e3640 1 --2- 172.21.15.45:0/2828246970 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f81040668d0 0x7f8104068d90 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f81140af000 tx=0x7f81140a7000 comp rx=0 tx=0).stop 2023-11-28T18:39:18.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.781+0000 7f81270e3640 1 -- 172.21.15.45:0/2828246970 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81200cba50 msgr2=0x7f81201517a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:18.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.781+0000 7f81270e3640 1 --2- 172.21.15.45:0/2828246970 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81200cba50 0x7f81201517a0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f810c00c500 tx=0x7f810c00c9c0 comp rx=0 tx=0).stop 2023-11-28T18:39:18.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.781+0000 7f81270e3640 1 -- 172.21.15.45:0/2828246970 shutdown_connections 2023-11-28T18:39:18.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.781+0000 7f81270e3640 1 --2- 172.21.15.45:0/2828246970 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f81040668d0 0x7f8104068d90 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:18.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.781+0000 7f81270e3640 1 --2- 172.21.15.45:0/2828246970 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8120158ce0 0x7f8120164a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:18.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.781+0000 7f81270e3640 1 --2- 172.21.15.45:0/2828246970 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81200cba50 0x7f81201517a0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:18.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.781+0000 7f81270e3640 1 --2- 172.21.15.45:0/2828246970 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f81200b4310 0x7f8120149eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:18.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.781+0000 7f81270e3640 1 -- 172.21.15.45:0/2828246970 >> 172.21.15.45:0/2828246970 conn(0x7f81200b0d00 msgr2=0x7f81200b10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:18.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.781+0000 7f81270e3640 1 -- 172.21.15.45:0/2828246970 shutdown_connections 2023-11-28T18:39:18.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.781+0000 7f81270e3640 1 -- 172.21.15.45:0/2828246970 wait complete. 2023-11-28T18:39:18.802 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T18:39:18.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.945+0000 7f0e9485e640 1 Processor -- start 2023-11-28T18:39:18.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.945+0000 7f0e9485e640 1 -- start start 2023-11-28T18:39:18.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.945+0000 7f0e9485e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0e9015e780 0x7f0e900b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:18.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.945+0000 7f0e9485e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f0e900d02d0 0x7f0e90161030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:18.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.945+0000 7f0e9485e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e900cf450 con 0x7f0e9015ee30 2023-11-28T18:39:18.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.945+0000 7f0e9485e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e900cf7a0 con 0x7f0e9015e780 2023-11-28T18:39:18.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.945+0000 7f0e9485e640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e900ce8b0 con 0x7f0e900d02d0 2023-11-28T18:39:18.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.945+0000 7f0e8ed9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0e9015e780 0x7f0e900b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:18.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.945+0000 7f0e8e59c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f0e9015ee30 0x7f0e900cfbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52976/0 (socket says 172.21.15.45:52976) 2023-11-28T18:39:18.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.945+0000 7f0e8e59c640 1 -- 172.21.15.45:0/1135717160 learned_addr learned my addr 172.21.15.45:0/1135717160 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:39:18.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.945+0000 7f0e8f59e640 1 --2- 172.21.15.45:0/1135717160 >> v2:172.21.15.190:3300/0 conn(0x7f0e900d02d0 0x7f0e90161030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:18.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.945+0000 7f0e8ed9d640 1 -- 172.21.15.45:0/1135717160 >> v2:172.21.15.190:3300/0 conn(0x7f0e900d02d0 msgr2=0x7f0e90161030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:18.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.945+0000 7f0e8ed9d640 1 --2- 172.21.15.45:0/1135717160 >> v2:172.21.15.190:3300/0 conn(0x7f0e900d02d0 0x7f0e90161030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:18.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.945+0000 7f0e8ed9d640 1 -- 172.21.15.45:0/1135717160 >> v1:172.21.15.45:6789/0 conn(0x7f0e9015ee30 legacy=0x7f0e900cfbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:18.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.945+0000 7f0e8ed9d640 1 -- 172.21.15.45:0/1135717160 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e900ceb90 con 0x7f0e9015e780 2023-11-28T18:39:18.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.945+0000 7f0e8dd9b640 1 -- 172.21.15.45:0/1135717160 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 268722959 0 0) 0x7f0e900cf450 con 0x7f0e9015ee30 2023-11-28T18:39:18.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.949+0000 7f0e8ed9d640 1 --2- 172.21.15.45:0/1135717160 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e9015e780 0x7f0e900b1dc0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f0e900b2330 tx=0x7f0e8001c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aee3589ae427bc3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:18.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.949+0000 7f0e8dd9b640 1 -- 172.21.15.45:0/1135717160 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e800ad680 con 0x7f0e9015e780 2023-11-28T18:39:18.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.949+0000 7f0e8dd9b640 1 -- 172.21.15.45:0/1135717160 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e800ad7e0 con 0x7f0e9015e780 2023-11-28T18:39:18.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.949+0000 7f0e8dd9b640 1 -- 172.21.15.45:0/1135717160 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e800adb70 con 0x7f0e9015e780 2023-11-28T18:39:18.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.949+0000 7f0e9485e640 1 -- 172.21.15.45:0/1135717160 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e9015e780 msgr2=0x7f0e900b1dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:18.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.949+0000 7f0e9485e640 1 --2- 172.21.15.45:0/1135717160 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e9015e780 0x7f0e900b1dc0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f0e900b2330 tx=0x7f0e8001c3a0 comp rx=0 tx=0).stop 2023-11-28T18:39:18.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.949+0000 7f0e9485e640 1 -- 172.21.15.45:0/1135717160 shutdown_connections 2023-11-28T18:39:18.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.949+0000 7f0e9485e640 1 --2- 172.21.15.45:0/1135717160 >> v2:172.21.15.190:3300/0 conn(0x7f0e900d02d0 0x7f0e90161030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:18.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.949+0000 7f0e9485e640 1 --2- 172.21.15.45:0/1135717160 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e9015e780 0x7f0e900b1dc0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:18.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.949+0000 7f0e9485e640 1 -- 172.21.15.45:0/1135717160 >> 172.21.15.45:0/1135717160 conn(0x7f0e900d2fb0 msgr2=0x7f0e900d33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:18.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.949+0000 7f0e9485e640 1 -- 172.21.15.45:0/1135717160 shutdown_connections 2023-11-28T18:39:18.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.949+0000 7f0e9485e640 1 -- 172.21.15.45:0/1135717160 wait complete. 2023-11-28T18:39:18.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.953+0000 7f0e9485e640 1 Processor -- start 2023-11-28T18:39:18.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.953+0000 7f0e9485e640 1 -- start start 2023-11-28T18:39:18.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.953+0000 7f0e9485e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e900d02d0 0x7f0e90154440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:18.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.953+0000 7f0e9485e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0e9015e780 0x7f0e900ca290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:18.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.953+0000 7f0e9485e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0e9015ee30 0x7f0e900b1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:18.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.953+0000 7f0e9485e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e900cb780 con 0x7f0e900d02d0 2023-11-28T18:39:18.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.953+0000 7f0e9485e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e900cab70 con 0x7f0e9015ee30 2023-11-28T18:39:18.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.953+0000 7f0e9485e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e900cae50 con 0x7f0e9015e780 2023-11-28T18:39:18.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.953+0000 7f0e8ed9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e900d02d0 0x7f0e90154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:18.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.953+0000 7f0e8ed9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e900d02d0 0x7f0e90154440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36582/0 (socket says 172.21.15.45:36582) 2023-11-28T18:39:18.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.953+0000 7f0e8ed9d640 1 -- 172.21.15.45:0/3969887206 learned_addr learned my addr 172.21.15.45:0/3969887206 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:18.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.953+0000 7f0e8ed9d640 1 -- 172.21.15.45:0/3969887206 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0e9015e780 msgr2=0x7f0e900ca290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:18.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.953+0000 7f0e8e59c640 1 --2- 172.21.15.45:0/3969887206 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0e9015e780 0x7f0e900ca290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:18.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.953+0000 7f0e8f59e640 1 --2- 172.21.15.45:0/3969887206 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0e9015ee30 0x7f0e900b1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:18.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.953+0000 7f0e8ed9d640 1 --2- 172.21.15.45:0/3969887206 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0e9015e780 0x7f0e900ca290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:18.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.953+0000 7f0e8ed9d640 1 -- 172.21.15.45:0/3969887206 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0e9015ee30 msgr2=0x7f0e900b1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:18.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.953+0000 7f0e8ed9d640 1 --2- 172.21.15.45:0/3969887206 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0e9015ee30 0x7f0e900b1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:18.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.953+0000 7f0e8ed9d640 1 -- 172.21.15.45:0/3969887206 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e80009420 con 0x7f0e900d02d0 2023-11-28T18:39:18.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.953+0000 7f0e8e59c640 1 --2- 172.21.15.45:0/3969887206 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0e9015e780 0x7f0e900ca290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:39:18.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.953+0000 7f0e8f59e640 1 --2- 172.21.15.45:0/3969887206 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0e9015ee30 0x7f0e900b1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:39:18.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.953+0000 7f0e8ed9d640 1 --2- 172.21.15.45:0/3969887206 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e900d02d0 0x7f0e90154440 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f0e80018fb0 tx=0x7f0e80019140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:18.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.957+0000 7f0e777fe640 1 -- 172.21.15.45:0/3969887206 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e800add60 con 0x7f0e900d02d0 2023-11-28T18:39:18.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.957+0000 7f0e777fe640 1 -- 172.21.15.45:0/3969887206 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e80004030 con 0x7f0e900d02d0 2023-11-28T18:39:18.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.957+0000 7f0e9485e640 1 -- 172.21.15.45:0/3969887206 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e900cb130 con 0x7f0e900d02d0 2023-11-28T18:39:18.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.957+0000 7f0e777fe640 1 -- 172.21.15.45:0/3969887206 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e800043c0 con 0x7f0e900d02d0 2023-11-28T18:39:18.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.957+0000 7f0e9485e640 1 -- 172.21.15.45:0/3969887206 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e900ca7d0 con 0x7f0e900d02d0 2023-11-28T18:39:18.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.957+0000 7f0e9485e640 1 -- 172.21.15.45:0/3969887206 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e9015f280 con 0x7f0e900d02d0 2023-11-28T18:39:18.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.957+0000 7f0e777fe640 1 -- 172.21.15.45:0/3969887206 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f0e800b4040 con 0x7f0e900d02d0 2023-11-28T18:39:18.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.957+0000 7f0e777fe640 1 --2- 172.21.15.45:0/3969887206 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f0e7c066900 0x7f0e7c068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:18.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.957+0000 7f0e777fe640 1 -- 172.21.15.45:0/3969887206 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f0e8011dab0 con 0x7f0e900d02d0 2023-11-28T18:39:18.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.957+0000 7f0e8e59c640 1 --2- 172.21.15.45:0/3969887206 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f0e7c066900 0x7f0e7c068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:18.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.961+0000 7f0e8e59c640 1 --2- 172.21.15.45:0/3969887206 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f0e7c066900 0x7f0e7c068dc0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f0e84007fd0 tx=0x7f0e84009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:18.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:18.961+0000 7f0e777fe640 1 -- 172.21.15.45:0/3969887206 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0e9015f280 con 0x7f0e900d02d0 2023-11-28T18:39:19.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.121+0000 7f0e9485e640 1 -- 172.21.15.45:0/3969887206 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0e9015f280 con 0x7f0e900d02d0 2023-11-28T18:39:19.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.121+0000 7f0e777fe640 1 -- 172.21.15.45:0/3969887206 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v35) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0e9015f280 con 0x7f0e900d02d0 2023-11-28T18:39:19.124 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-11-28T18:39:19.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.121+0000 7f0e9485e640 1 -- 172.21.15.45:0/3969887206 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f0e7c066900 msgr2=0x7f0e7c068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:19.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.121+0000 7f0e9485e640 1 --2- 172.21.15.45:0/3969887206 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f0e7c066900 0x7f0e7c068dc0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f0e84007fd0 tx=0x7f0e84009040 comp rx=0 tx=0).stop 2023-11-28T18:39:19.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.121+0000 7f0e9485e640 1 -- 172.21.15.45:0/3969887206 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e900d02d0 msgr2=0x7f0e90154440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:19.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.121+0000 7f0e9485e640 1 --2- 172.21.15.45:0/3969887206 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e900d02d0 0x7f0e90154440 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f0e80018fb0 tx=0x7f0e80019140 comp rx=0 tx=0).stop 2023-11-28T18:39:19.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.121+0000 7f0e9485e640 1 -- 172.21.15.45:0/3969887206 shutdown_connections 2023-11-28T18:39:19.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.121+0000 7f0e9485e640 1 --2- 172.21.15.45:0/3969887206 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f0e7c066900 0x7f0e7c068dc0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:19.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.121+0000 7f0e9485e640 1 --2- 172.21.15.45:0/3969887206 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0e9015ee30 0x7f0e900b1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:19.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.121+0000 7f0e9485e640 1 --2- 172.21.15.45:0/3969887206 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0e9015e780 0x7f0e900ca290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:19.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.121+0000 7f0e9485e640 1 --2- 172.21.15.45:0/3969887206 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e900d02d0 0x7f0e90154440 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:19.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.121+0000 7f0e9485e640 1 -- 172.21.15.45:0/3969887206 >> 172.21.15.45:0/3969887206 conn(0x7f0e900d2fb0 msgr2=0x7f0e900afc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:19.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.121+0000 7f0e9485e640 1 -- 172.21.15.45:0/3969887206 shutdown_connections 2023-11-28T18:39:19.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.121+0000 7f0e9485e640 1 -- 172.21.15.45:0/3969887206 wait complete. 2023-11-28T18:39:19.145 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T18:39:19.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.289+0000 7f8fc8a6b640 1 Processor -- start 2023-11-28T18:39:19.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.289+0000 7f8fc8a6b640 1 -- start start 2023-11-28T18:39:19.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.289+0000 7f8fc8a6b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8fc40d0330 0x7f8fc4168030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:19.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.289+0000 7f8fc8a6b640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fc40aff70 con 0x7f8fc415d6d0 2023-11-28T18:39:19.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.289+0000 7f8fc8a6b640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fc40d1f00 con 0x7f8fc415d2f0 2023-11-28T18:39:19.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.289+0000 7f8fc8a6b640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fc40b0210 con 0x7f8fc40d0330 2023-11-28T18:39:19.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.289+0000 7f8fc2d9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8fc40d0330 0x7f8fc4168030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:19.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.289+0000 7f8fbbfff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f8fc415d6d0 0x7f8fc40cfc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52990/0 (socket says 172.21.15.45:52990) 2023-11-28T18:39:19.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.289+0000 7f8fbbfff640 1 -- 172.21.15.45:0/3487472622 learned_addr learned my addr 172.21.15.45:0/3487472622 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:39:19.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.289+0000 7f8fc1d9b640 1 -- 172.21.15.45:0/3487472622 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2591841766 0 0) 0x7f8fc40aff70 con 0x7f8fc415d6d0 2023-11-28T18:39:19.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.289+0000 7f8fc1d9b640 1 -- 172.21.15.45:0/3487472622 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fb0003530 con 0x7f8fc415d6d0 2023-11-28T18:39:19.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.289+0000 7f8fc2d9d640 1 -- 172.21.15.45:0/3487472622 >> v1:172.21.15.190:6789/0 conn(0x7f8fc415d2f0 legacy=0x7f8fc40d17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:19.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.289+0000 7f8fc2d9d640 1 -- 172.21.15.45:0/3487472622 >> v1:172.21.15.45:6789/0 conn(0x7f8fc415d6d0 legacy=0x7f8fc40cfc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:19.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.289+0000 7f8fc2d9d640 1 -- 172.21.15.45:0/3487472622 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc40b04f0 con 0x7f8fc40d0330 2023-11-28T18:39:19.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.293+0000 7f8fc2d9d640 1 --2- 172.21.15.45:0/3487472622 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fc40d0330 0x7f8fc4168030 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc009d90 tx=0x7f8fbc01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a48c81fe7725850b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:19.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.293+0000 7f8fc1d9b640 1 -- 172.21.15.45:0/3487472622 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fbc0a5980 con 0x7f8fc40d0330 2023-11-28T18:39:19.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.293+0000 7f8fc1d9b640 1 -- 172.21.15.45:0/3487472622 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fbc0a5ae0 con 0x7f8fc40d0330 2023-11-28T18:39:19.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.293+0000 7f8fc1d9b640 1 -- 172.21.15.45:0/3487472622 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fbc0a5e50 con 0x7f8fc40d0330 2023-11-28T18:39:19.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.293+0000 7f8fc8a6b640 1 -- 172.21.15.45:0/3487472622 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fc40d0330 msgr2=0x7f8fc4168030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:19.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.293+0000 7f8fc8a6b640 1 --2- 172.21.15.45:0/3487472622 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fc40d0330 0x7f8fc4168030 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc009d90 tx=0x7f8fbc01c920 comp rx=0 tx=0).stop 2023-11-28T18:39:19.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.293+0000 7f8fc8a6b640 1 -- 172.21.15.45:0/3487472622 shutdown_connections 2023-11-28T18:39:19.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.293+0000 7f8fc8a6b640 1 --2- 172.21.15.45:0/3487472622 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fc40d0330 0x7f8fc4168030 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:19.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.293+0000 7f8fc8a6b640 1 -- 172.21.15.45:0/3487472622 >> 172.21.15.45:0/3487472622 conn(0x7f8fc409c550 msgr2=0x7f8fc40d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:19.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.293+0000 7f8fc8a6b640 1 -- 172.21.15.45:0/3487472622 shutdown_connections 2023-11-28T18:39:19.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.293+0000 7f8fc8a6b640 1 -- 172.21.15.45:0/3487472622 wait complete. 2023-11-28T18:39:19.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.297+0000 7f8fc8a6b640 1 Processor -- start 2023-11-28T18:39:19.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.297+0000 7f8fc8a6b640 1 -- start start 2023-11-28T18:39:19.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.297+0000 7f8fc8a6b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8fc40d0330 0x7f8fc406cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:19.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.297+0000 7f8fc8a6b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fc415d2f0 0x7f8fc40cacf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:19.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.297+0000 7f8fc8a6b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8fc415d6d0 0x7f8fc4159b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:19.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.297+0000 7f8fc8a6b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc40b69c0 con 0x7f8fc415d2f0 2023-11-28T18:39:19.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.297+0000 7f8fc8a6b640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc415cc10 con 0x7f8fc40d0330 2023-11-28T18:39:19.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.297+0000 7f8fc8a6b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc40b5dd0 con 0x7f8fc415d6d0 2023-11-28T18:39:19.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.297+0000 7f8fbbfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fc415d2f0 0x7f8fc40cacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:19.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.297+0000 7f8fbbfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fc415d2f0 0x7f8fc40cacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36598/0 (socket says 172.21.15.45:36598) 2023-11-28T18:39:19.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.297+0000 7f8fbbfff640 1 -- 172.21.15.45:0/2368636185 learned_addr learned my addr 172.21.15.45:0/2368636185 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:19.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.297+0000 7f8fc259c640 1 --2- 172.21.15.45:0/2368636185 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8fc40d0330 0x7f8fc406cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:19.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.297+0000 7f8fc2d9d640 1 --2- 172.21.15.45:0/2368636185 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8fc415d6d0 0x7f8fc4159b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:19.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.297+0000 7f8fbbfff640 1 -- 172.21.15.45:0/2368636185 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8fc415d6d0 msgr2=0x7f8fc4159b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:19.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.297+0000 7f8fbbfff640 1 --2- 172.21.15.45:0/2368636185 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8fc415d6d0 0x7f8fc4159b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:19.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.297+0000 7f8fbbfff640 1 -- 172.21.15.45:0/2368636185 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8fc40d0330 msgr2=0x7f8fc406cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:19.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.297+0000 7f8fbbfff640 1 --2- 172.21.15.45:0/2368636185 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8fc40d0330 0x7f8fc406cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:19.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.297+0000 7f8fbbfff640 1 -- 172.21.15.45:0/2368636185 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fbc009a70 con 0x7f8fc415d2f0 2023-11-28T18:39:19.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.297+0000 7f8fc259c640 1 --2- 172.21.15.45:0/2368636185 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8fc40d0330 0x7f8fc406cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:39:19.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.297+0000 7f8fc2d9d640 1 --2- 172.21.15.45:0/2368636185 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8fc415d6d0 0x7f8fc4159b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:39:19.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.297+0000 7f8fbbfff640 1 --2- 172.21.15.45:0/2368636185 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fc415d2f0 0x7f8fc40cacf0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f8fac00c420 tx=0x7f8fac00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:19.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.297+0000 7f8fbaffd640 1 -- 172.21.15.45:0/2368636185 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fac005cf0 con 0x7f8fc415d2f0 2023-11-28T18:39:19.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.297+0000 7f8fbaffd640 1 -- 172.21.15.45:0/2368636185 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fac005e50 con 0x7f8fc415d2f0 2023-11-28T18:39:19.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.297+0000 7f8fbaffd640 1 -- 172.21.15.45:0/2368636185 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fac0072d0 con 0x7f8fc415d2f0 2023-11-28T18:39:19.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.297+0000 7f8fc8a6b640 1 -- 172.21.15.45:0/2368636185 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fc40b6090 con 0x7f8fc415d2f0 2023-11-28T18:39:19.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.301+0000 7f8fc8a6b640 1 -- 172.21.15.45:0/2368636185 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fc40b6650 con 0x7f8fc415d2f0 2023-11-28T18:39:19.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.301+0000 7f8fc8a6b640 1 -- 172.21.15.45:0/2368636185 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fc4067a30 con 0x7f8fc415d2f0 2023-11-28T18:39:19.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.301+0000 7f8fbaffd640 1 -- 172.21.15.45:0/2368636185 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f8fac007430 con 0x7f8fc415d2f0 2023-11-28T18:39:19.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.301+0000 7f8fbaffd640 1 --2- 172.21.15.45:0/2368636185 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f8fa40668d0 0x7f8fa4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:19.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.301+0000 7f8fbaffd640 1 -- 172.21.15.45:0/2368636185 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f8fac083a50 con 0x7f8fc415d2f0 2023-11-28T18:39:19.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.301+0000 7f8fc259c640 1 --2- 172.21.15.45:0/2368636185 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f8fa40668d0 0x7f8fa4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:19.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.305+0000 7f8fc259c640 1 --2- 172.21.15.45:0/2368636185 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f8fa40668d0 0x7f8fa4068d90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f8fb4001710 tx=0x7f8fb4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:19.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.305+0000 7f8fbaffd640 1 -- 172.21.15.45:0/2368636185 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8fac050c40 con 0x7f8fc415d2f0 2023-11-28T18:39:19.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.461+0000 7f8fc8a6b640 1 -- 172.21.15.45:0/2368636185 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8fc4069410 con 0x7f8fc415d2f0 2023-11-28T18:39:19.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.461+0000 7f8fbaffd640 1 -- 172.21.15.45:0/2368636185 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v35) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8fac017020 con 0x7f8fc415d2f0 2023-11-28T18:39:19.465 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-11-28T18:39:19.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.465+0000 7f8fc8a6b640 1 -- 172.21.15.45:0/2368636185 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f8fa40668d0 msgr2=0x7f8fa4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:19.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.465+0000 7f8fc8a6b640 1 --2- 172.21.15.45:0/2368636185 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f8fa40668d0 0x7f8fa4068d90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f8fb4001710 tx=0x7f8fb4009040 comp rx=0 tx=0).stop 2023-11-28T18:39:19.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.465+0000 7f8fc8a6b640 1 -- 172.21.15.45:0/2368636185 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fc415d2f0 msgr2=0x7f8fc40cacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:19.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.465+0000 7f8fc8a6b640 1 --2- 172.21.15.45:0/2368636185 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fc415d2f0 0x7f8fc40cacf0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f8fac00c420 tx=0x7f8fac00c8e0 comp rx=0 tx=0).stop 2023-11-28T18:39:19.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.465+0000 7f8fc8a6b640 1 -- 172.21.15.45:0/2368636185 shutdown_connections 2023-11-28T18:39:19.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.465+0000 7f8fc8a6b640 1 --2- 172.21.15.45:0/2368636185 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f8fa40668d0 0x7f8fa4068d90 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:19.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.465+0000 7f8fc8a6b640 1 --2- 172.21.15.45:0/2368636185 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8fc415d6d0 0x7f8fc4159b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:19.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.465+0000 7f8fc8a6b640 1 --2- 172.21.15.45:0/2368636185 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fc415d2f0 0x7f8fc40cacf0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:19.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.465+0000 7f8fc8a6b640 1 --2- 172.21.15.45:0/2368636185 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8fc40d0330 0x7f8fc406cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:19.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.465+0000 7f8fc8a6b640 1 -- 172.21.15.45:0/2368636185 >> 172.21.15.45:0/2368636185 conn(0x7f8fc409c550 msgr2=0x7f8fc40d33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:19.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.465+0000 7f8fc8a6b640 1 -- 172.21.15.45:0/2368636185 shutdown_connections 2023-11-28T18:39:19.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.465+0000 7f8fc8a6b640 1 -- 172.21.15.45:0/2368636185 wait complete. 2023-11-28T18:39:19.486 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T18:39:19.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.625+0000 7f16ae4fe640 1 Processor -- start 2023-11-28T18:39:19.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.625+0000 7f16ae4fe640 1 -- start start 2023-11-28T18:39:19.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.629+0000 7f16ae4fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16a8144880 0x7f16a806c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:19.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.629+0000 7f16ae4fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f16a80721c0 0x7f16a806c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:19.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.629+0000 7f16ae4fe640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16a8071120 con 0x7f16a80704a0 2023-11-28T18:39:19.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.629+0000 7f16ae4fe640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16a815f050 con 0x7f16a80721c0 2023-11-28T18:39:19.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.629+0000 7f16ae4fe640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16a8071400 con 0x7f16a8144880 2023-11-28T18:39:19.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.629+0000 7f16aca9b640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f16a80704a0 0x7f16a8070920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:53006/0 (socket says 172.21.15.45:53006) 2023-11-28T18:39:19.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.629+0000 7f16aca9b640 1 -- 172.21.15.45:0/310782443 learned_addr learned my addr 172.21.15.45:0/310782443 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:39:19.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.629+0000 7f16a77fe640 1 --2- 172.21.15.45:0/310782443 >> v2:172.21.15.45:3300/0 conn(0x7f16a80721c0 0x7f16a806c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:19.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.629+0000 7f16a7fff640 1 --2- 172.21.15.45:0/310782443 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16a8144880 0x7f16a806c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:19.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.629+0000 7f16a77fe640 1 -- 172.21.15.45:0/310782443 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16a8144880 msgr2=0x7f16a806c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:19.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.629+0000 7f16a77fe640 1 --2- 172.21.15.45:0/310782443 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16a8144880 0x7f16a806c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:19.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.629+0000 7f16a77fe640 1 -- 172.21.15.45:0/310782443 >> v1:172.21.15.45:6789/0 conn(0x7f16a80704a0 legacy=0x7f16a8070920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:19.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.629+0000 7f16a77fe640 1 -- 172.21.15.45:0/310782443 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16a80716e0 con 0x7f16a80721c0 2023-11-28T18:39:19.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.629+0000 7f16a7fff640 1 --2- 172.21.15.45:0/310782443 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16a8144880 0x7f16a806c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:39:19.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.629+0000 7f16a6ffd640 1 -- 172.21.15.45:0/310782443 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1511506666 0 0) 0x7f16a8071120 con 0x7f16a80704a0 2023-11-28T18:39:19.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.633+0000 7f16a77fe640 1 --2- 172.21.15.45:0/310782443 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16a80721c0 0x7f16a806c840 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f169c0097c0 tx=0x7f169c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bea0cdaa63bc8383 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:19.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.633+0000 7f16a6ffd640 1 -- 172.21.15.45:0/310782443 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169c0ab650 con 0x7f16a80721c0 2023-11-28T18:39:19.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.633+0000 7f16a6ffd640 1 -- 172.21.15.45:0/310782443 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f169c0ab7b0 con 0x7f16a80721c0 2023-11-28T18:39:19.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.633+0000 7f16a6ffd640 1 -- 172.21.15.45:0/310782443 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169c0abb40 con 0x7f16a80721c0 2023-11-28T18:39:19.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.633+0000 7f16ae4fe640 1 -- 172.21.15.45:0/310782443 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16a80721c0 msgr2=0x7f16a806c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:19.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.633+0000 7f16ae4fe640 1 --2- 172.21.15.45:0/310782443 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16a80721c0 0x7f16a806c840 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f169c0097c0 tx=0x7f169c01c450 comp rx=0 tx=0).stop 2023-11-28T18:39:19.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.633+0000 7f16ae4fe640 1 -- 172.21.15.45:0/310782443 shutdown_connections 2023-11-28T18:39:19.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.633+0000 7f16ae4fe640 1 --2- 172.21.15.45:0/310782443 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16a80721c0 0x7f16a806c840 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:19.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.633+0000 7f16ae4fe640 1 --2- 172.21.15.45:0/310782443 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16a8144880 0x7f16a806c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:19.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.633+0000 7f16ae4fe640 1 -- 172.21.15.45:0/310782443 >> 172.21.15.45:0/310782443 conn(0x7f16a806a570 msgr2=0x7f16a806a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:19.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.633+0000 7f16ae4fe640 1 -- 172.21.15.45:0/310782443 shutdown_connections 2023-11-28T18:39:19.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.633+0000 7f16ae4fe640 1 -- 172.21.15.45:0/310782443 wait complete. 2023-11-28T18:39:19.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.633+0000 7f16ae4fe640 1 Processor -- start 2023-11-28T18:39:19.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.633+0000 7f16ae4fe640 1 -- start start 2023-11-28T18:39:19.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.637+0000 7f16ae4fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16a80704a0 0x7f16a8138ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:19.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.637+0000 7f16ae4fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16a80721c0 0x7f16a8140670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:19.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.637+0000 7f16ae4fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16a8144880 0x7f16a8140bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:19.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.637+0000 7f16ae4fe640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a80b2230 con 0x7f16a80704a0 2023-11-28T18:39:19.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.637+0000 7f16ae4fe640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a813eba0 con 0x7f16a80721c0 2023-11-28T18:39:19.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.637+0000 7f16ae4fe640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16a813ee80 con 0x7f16a8144880 2023-11-28T18:39:19.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.637+0000 7f16a7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16a80704a0 0x7f16a8138ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:19.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.637+0000 7f16a7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16a80704a0 0x7f16a8138ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36612/0 (socket says 172.21.15.45:36612) 2023-11-28T18:39:19.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.637+0000 7f16a7fff640 1 -- 172.21.15.45:0/3096548190 learned_addr learned my addr 172.21.15.45:0/3096548190 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:19.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.637+0000 7f16a7fff640 1 -- 172.21.15.45:0/3096548190 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16a8144880 msgr2=0x7f16a8140bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:19.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.637+0000 7f16a7fff640 1 --2- 172.21.15.45:0/3096548190 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16a8144880 0x7f16a8140bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:19.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.637+0000 7f16a7fff640 1 -- 172.21.15.45:0/3096548190 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16a80721c0 msgr2=0x7f16a8140670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:19.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.637+0000 7f16a7fff640 1 --2- 172.21.15.45:0/3096548190 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16a80721c0 0x7f16a8140670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:19.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.637+0000 7f16a7fff640 1 -- 172.21.15.45:0/3096548190 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f169c009420 con 0x7f16a80704a0 2023-11-28T18:39:19.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.637+0000 7f16a7fff640 1 --2- 172.21.15.45:0/3096548190 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16a80704a0 0x7f16a8138ef0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f169800d800 tx=0x7f169800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:19.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.637+0000 7f16a4ff9640 1 -- 172.21.15.45:0/3096548190 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169800b6c0 con 0x7f16a80704a0 2023-11-28T18:39:19.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.637+0000 7f16a4ff9640 1 -- 172.21.15.45:0/3096548190 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f169800b820 con 0x7f16a80704a0 2023-11-28T18:39:19.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.637+0000 7f16a4ff9640 1 -- 172.21.15.45:0/3096548190 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169800bbd0 con 0x7f16a80704a0 2023-11-28T18:39:19.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.637+0000 7f16ae4fe640 1 -- 172.21.15.45:0/3096548190 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16a80b24d0 con 0x7f16a80704a0 2023-11-28T18:39:19.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.637+0000 7f16ae4fe640 1 -- 172.21.15.45:0/3096548190 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16a813f160 con 0x7f16a80704a0 2023-11-28T18:39:19.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.637+0000 7f16ae4fe640 1 -- 172.21.15.45:0/3096548190 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16a80cb210 con 0x7f16a80704a0 2023-11-28T18:39:19.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.641+0000 7f16a4ff9640 1 -- 172.21.15.45:0/3096548190 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f169800bd30 con 0x7f16a80704a0 2023-11-28T18:39:19.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.641+0000 7f16a4ff9640 1 --2- 172.21.15.45:0/3096548190 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f16940668d0 0x7f1694068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:19.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.641+0000 7f16a4ff9640 1 -- 172.21.15.45:0/3096548190 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f1698084a40 con 0x7f16a80704a0 2023-11-28T18:39:19.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.641+0000 7f16a77fe640 1 --2- 172.21.15.45:0/3096548190 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f16940668d0 0x7f1694068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:19.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.641+0000 7f16a77fe640 1 --2- 172.21.15.45:0/3096548190 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f16940668d0 0x7f1694068d90 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f169c0af000 tx=0x7f169c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:19.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.645+0000 7f16a4ff9640 1 -- 172.21.15.45:0/3096548190 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1698051b80 con 0x7f16a80704a0 2023-11-28T18:39:19.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.809+0000 7f16ae4fe640 1 -- 172.21.15.45:0/3096548190 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f16a8069480 con 0x7f16a80704a0 2023-11-28T18:39:19.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.813+0000 7f16a4ff9640 1 -- 172.21.15.45:0/3096548190 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v35) v1 ==== 80+0+122 (secure 0 0 0) 0x7f16980551a0 con 0x7f16a80704a0 2023-11-28T18:39:19.815 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:6834/2398964901 2023-11-29T18:39:02.760758+0000 2023-11-28T18:39:19.815 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:6832/2398964901 2023-11-29T18:39:02.760758+0000 2023-11-28T18:39:19.815 INFO:teuthology.orchestra.run.smithi045.stderr:listed 2 entries 2023-11-28T18:39:19.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.813+0000 7f16ae4fe640 1 -- 172.21.15.45:0/3096548190 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f16940668d0 msgr2=0x7f1694068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:19.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.813+0000 7f16ae4fe640 1 --2- 172.21.15.45:0/3096548190 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f16940668d0 0x7f1694068d90 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f169c0af000 tx=0x7f169c008040 comp rx=0 tx=0).stop 2023-11-28T18:39:19.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.813+0000 7f16ae4fe640 1 -- 172.21.15.45:0/3096548190 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16a80704a0 msgr2=0x7f16a8138ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:19.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.813+0000 7f16ae4fe640 1 --2- 172.21.15.45:0/3096548190 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16a80704a0 0x7f16a8138ef0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f169800d800 tx=0x7f169800dcc0 comp rx=0 tx=0).stop 2023-11-28T18:39:19.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.813+0000 7f16ae4fe640 1 -- 172.21.15.45:0/3096548190 shutdown_connections 2023-11-28T18:39:19.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.813+0000 7f16ae4fe640 1 --2- 172.21.15.45:0/3096548190 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f16940668d0 0x7f1694068d90 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:19.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.813+0000 7f16ae4fe640 1 --2- 172.21.15.45:0/3096548190 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16a8144880 0x7f16a8140bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:19.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.813+0000 7f16ae4fe640 1 --2- 172.21.15.45:0/3096548190 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16a80721c0 0x7f16a8140670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:19.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.813+0000 7f16ae4fe640 1 --2- 172.21.15.45:0/3096548190 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16a80704a0 0x7f16a8138ef0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:19.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.813+0000 7f16ae4fe640 1 -- 172.21.15.45:0/3096548190 >> 172.21.15.45:0/3096548190 conn(0x7f16a806a570 msgr2=0x7f16a806c300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:19.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.813+0000 7f16ae4fe640 1 -- 172.21.15.45:0/3096548190 shutdown_connections 2023-11-28T18:39:19.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:19.813+0000 7f16ae4fe640 1 -- 172.21.15.45:0/3096548190 wait complete. 2023-11-28T18:39:19.836 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi045.front.sepia.ceph.com... 2023-11-28T18:39:19.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:39:19.836 DEBUG:teuthology.orchestra.run.smithi045:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-28T18:39:19.856 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:ceph-fuse[48705]: fuse finished with error 0 and tester_r 0 2023-11-28T18:39:19.858 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi045.front.sepia.ceph.com 2023-11-28T18:39:19.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:39:19.858 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-28T18:39:19.953 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-28T18:39:19.953 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T18:39:19.963 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354684k,nr_inodes=4088671,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9377 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-28T18:39:19.963 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi190.front.sepia.ceph.com 2023-11-28T18:39:19.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:39:19.963 DEBUG:teuthology.orchestra.run.smithi190:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-28T18:39:20.013 INFO:teuthology.orchestra.run.smithi190.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-11-28T18:39:20.014 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T18:39:20.014 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T18:39:20.015 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T18:39:20.024 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357768k,nr_inodes=4089442,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9360 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276000k,nr_inodes=819000,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-28T18:39:20.024 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi045.front.sepia.ceph.com 2023-11-28T18:39:20.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:39:20.024 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-28T18:39:20.074 INFO:teuthology.orchestra.run.smithi045.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-28T18:39:20.075 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T18:39:20.075 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-28T18:39:20.075 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T18:39:20.085 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354684k,nr_inodes=4088671,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9377 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-28T18:39:20.085 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi190.front.sepia.ceph.com 2023-11-28T18:39:20.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:39:20.085 DEBUG:teuthology.orchestra.run.smithi190:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-28T18:39:20.137 INFO:teuthology.orchestra.run.smithi190.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-28T18:39:20.138 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T18:39:20.139 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T18:39:20.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.281+0000 7fe807009640 1 Processor -- start 2023-11-28T18:39:20.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.281+0000 7fe807009640 1 -- start start 2023-11-28T18:39:20.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.281+0000 7fe807009640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe80013cf70 0x7fe80006c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:20.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.281+0000 7fe807009640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe80006c840 0x7fe80015a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:20.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.281+0000 7fe807009640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe80015b3e0 con 0x7fe80015abb0 2023-11-28T18:39:20.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.281+0000 7fe807009640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe80013d350 con 0x7fe80013cf70 2023-11-28T18:39:20.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.281+0000 7fe807009640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe800140520 con 0x7fe80006c840 2023-11-28T18:39:20.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.285+0000 7fe7fffff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe80006c840 0x7fe80015a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:20.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.285+0000 7fe804da5640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe80013cf70 0x7fe80006c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:20.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.285+0000 7fe7fffff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe80006c840 0x7fe80015a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.45:48650/0 (socket says 172.21.15.45:48650) 2023-11-28T18:39:20.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.285+0000 7fe804da5640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe80013cf70 0x7fe80006c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.45:45076/0 (socket says 172.21.15.45:45076) 2023-11-28T18:39:20.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.285+0000 7fe7fffff640 1 -- 172.21.15.45:0/2089108828 learned_addr learned my addr 172.21.15.45:0/2089108828 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:20.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.285+0000 7fe8055a6640 1 --1- 172.21.15.45:0/2089108828 >> v1:172.21.15.190:6789/0 conn(0x7fe80015abb0 0x7fe8000715b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.45:60708/0 (socket says 172.21.15.45:60708) 2023-11-28T18:39:20.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.285+0000 7fe804da5640 1 -- 172.21.15.45:0/2089108828 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe80006c840 msgr2=0x7fe80015a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:20.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.285+0000 7fe804da5640 1 --2- 172.21.15.45:0/2089108828 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe80006c840 0x7fe80015a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:20.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.285+0000 7fe7ff7fe640 1 -- 172.21.15.45:0/2089108828 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3863129967 0 0) 0x7fe80015b3e0 con 0x7fe80015abb0 2023-11-28T18:39:20.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.285+0000 7fe804da5640 1 -- 172.21.15.45:0/2089108828 >> v1:172.21.15.190:6789/0 conn(0x7fe80015abb0 legacy=0x7fe8000715b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:20.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.285+0000 7fe804da5640 1 -- 172.21.15.45:0/2089108828 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe80006cc80 con 0x7fe80013cf70 2023-11-28T18:39:20.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.285+0000 7fe7fffff640 1 --2- 172.21.15.45:0/2089108828 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe80006c840 0x7fe80015a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:39:20.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.285+0000 7fe804da5640 1 --2- 172.21.15.45:0/2089108828 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe80013cf70 0x7fe80006c300 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe7f40097f0 tx=0x7fe7f401c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=461b062c17faa1e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:20.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.289+0000 7fe7ff7fe640 1 -- 172.21.15.45:0/2089108828 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f40ac620 con 0x7fe80013cf70 2023-11-28T18:39:20.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.289+0000 7fe7ff7fe640 1 -- 172.21.15.45:0/2089108828 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7f40ac780 con 0x7fe80013cf70 2023-11-28T18:39:20.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.289+0000 7fe7ff7fe640 1 -- 172.21.15.45:0/2089108828 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f40acb10 con 0x7fe80013cf70 2023-11-28T18:39:20.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.289+0000 7fe807009640 1 -- 172.21.15.45:0/2089108828 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe80013cf70 msgr2=0x7fe80006c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:20.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.289+0000 7fe807009640 1 --2- 172.21.15.45:0/2089108828 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe80013cf70 0x7fe80006c300 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe7f40097f0 tx=0x7fe7f401c3c0 comp rx=0 tx=0).stop 2023-11-28T18:39:20.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.289+0000 7fe807009640 1 -- 172.21.15.45:0/2089108828 shutdown_connections 2023-11-28T18:39:20.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.289+0000 7fe807009640 1 --2- 172.21.15.45:0/2089108828 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe80006c840 0x7fe80015a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:20.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.289+0000 7fe807009640 1 --2- 172.21.15.45:0/2089108828 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe80013cf70 0x7fe80006c300 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:20.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.289+0000 7fe807009640 1 -- 172.21.15.45:0/2089108828 >> 172.21.15.45:0/2089108828 conn(0x7fe80006a570 msgr2=0x7fe80006a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:20.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.289+0000 7fe807009640 1 -- 172.21.15.45:0/2089108828 shutdown_connections 2023-11-28T18:39:20.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.289+0000 7fe807009640 1 -- 172.21.15.45:0/2089108828 wait complete. 2023-11-28T18:39:20.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.289+0000 7fe807009640 1 Processor -- start 2023-11-28T18:39:20.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.289+0000 7fe807009640 1 -- start start 2023-11-28T18:39:20.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.289+0000 7fe807009640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe80006c840 0x7fe80013b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:20.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.289+0000 7fe807009640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe80013cf70 0x7fe8000adb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:20.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.289+0000 7fe807009640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe80015abb0 0x7fe80015c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:20.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.289+0000 7fe807009640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8001f7510 con 0x7fe80015abb0 2023-11-28T18:39:20.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.289+0000 7fe807009640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe80013bc70 con 0x7fe80006c840 2023-11-28T18:39:20.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.289+0000 7fe807009640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe80013b750 con 0x7fe80013cf70 2023-11-28T18:39:20.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.289+0000 7fe8055a6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe80015abb0 0x7fe80015c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:20.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.289+0000 7fe8055a6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe80015abb0 0x7fe80015c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36624/0 (socket says 172.21.15.45:36624) 2023-11-28T18:39:20.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.289+0000 7fe8055a6640 1 -- 172.21.15.45:0/4199245431 learned_addr learned my addr 172.21.15.45:0/4199245431 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:20.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.289+0000 7fe7fffff640 1 --2- 172.21.15.45:0/4199245431 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe80013cf70 0x7fe8000adb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:20.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.293+0000 7fe804da5640 1 --2- 172.21.15.45:0/4199245431 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe80006c840 0x7fe80013b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:20.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.293+0000 7fe8055a6640 1 -- 172.21.15.45:0/4199245431 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe80013cf70 msgr2=0x7fe8000adb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:20.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.293+0000 7fe8055a6640 1 --2- 172.21.15.45:0/4199245431 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe80013cf70 0x7fe8000adb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:20.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.293+0000 7fe8055a6640 1 -- 172.21.15.45:0/4199245431 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe80006c840 msgr2=0x7fe80013b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:20.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.293+0000 7fe8055a6640 1 --2- 172.21.15.45:0/4199245431 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe80006c840 0x7fe80013b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:20.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.293+0000 7fe8055a6640 1 -- 172.21.15.45:0/4199245431 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7ec0094d0 con 0x7fe80015abb0 2023-11-28T18:39:20.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.293+0000 7fe8055a6640 1 --2- 172.21.15.45:0/4199245431 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe80015abb0 0x7fe80015c630 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fe7f800c810 tx=0x7fe7f800ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:20.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.293+0000 7fe7fd7fa640 1 -- 172.21.15.45:0/4199245431 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f800a640 con 0x7fe80015abb0 2023-11-28T18:39:20.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.293+0000 7fe7fd7fa640 1 -- 172.21.15.45:0/4199245431 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7f800a7c0 con 0x7fe80015abb0 2023-11-28T18:39:20.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.293+0000 7fe7fd7fa640 1 -- 172.21.15.45:0/4199245431 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f800ab70 con 0x7fe80015abb0 2023-11-28T18:39:20.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.293+0000 7fe807009640 1 -- 172.21.15.45:0/4199245431 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7f4009420 con 0x7fe80015abb0 2023-11-28T18:39:20.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.293+0000 7fe807009640 1 -- 172.21.15.45:0/4199245431 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe800155280 con 0x7fe80015abb0 2023-11-28T18:39:20.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.293+0000 7fe807009640 1 -- 172.21.15.45:0/4199245431 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe800069480 con 0x7fe80015abb0 2023-11-28T18:39:20.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.293+0000 7fe7fd7fa640 1 -- 172.21.15.45:0/4199245431 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe7f800acd0 con 0x7fe80015abb0 2023-11-28T18:39:20.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.293+0000 7fe7fd7fa640 1 --2- 172.21.15.45:0/4199245431 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe7e40668d0 0x7fe7e4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:20.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.293+0000 7fe7fd7fa640 1 -- 172.21.15.45:0/4199245431 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fe7f8083930 con 0x7fe80015abb0 2023-11-28T18:39:20.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.297+0000 7fe804da5640 1 --2- 172.21.15.45:0/4199245431 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe7e40668d0 0x7fe7e4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:20.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.297+0000 7fe804da5640 1 --2- 172.21.15.45:0/4199245431 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe7e40668d0 0x7fe7e4068d90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe7f40ae000 tx=0x7fe7f4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:20.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.297+0000 7fe7fd7fa640 1 -- 172.21.15.45:0/4199245431 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe7f8050bb0 con 0x7fe80015abb0 2023-11-28T18:39:20.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.485+0000 7fe807009640 1 -- 172.21.15.45:0/4199245431 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe800070f10 con 0x7fe80015abb0 2023-11-28T18:39:20.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.489+0000 7fe7fd7fa640 1 -- 172.21.15.45:0/4199245431 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4917 (secure 0 0 0) 0x7fe7f8018020 con 0x7fe80015abb0 2023-11-28T18:39:20.491 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:39:20.491 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":24,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5188,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/270858280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":270858280},{"type":"v1","addr":"172.21.15.190:6836","nonce":270858280}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5191,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/4006352118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":4006352118},{"type":"v1","addr":"172.21.15.190:6837","nonce":4006352118}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5197,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2204012451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":2204012451},{"type":"v1","addr":"172.21.15.45:6835","nonce":2204012451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T18:38:35.406884+0000","modified":"2023-11-28T18:39:15.152124+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5571},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5571":{"gid":5571,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.45:6834/1317650999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1317650999},{"type":"v1","addr":"172.21.15.45:6834","nonce":1317650999}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-28T18:39:20.491 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 24 2023-11-28T18:39:20.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.489+0000 7fe807009640 1 -- 172.21.15.45:0/4199245431 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe7e40668d0 msgr2=0x7fe7e4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:20.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.489+0000 7fe807009640 1 --2- 172.21.15.45:0/4199245431 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe7e40668d0 0x7fe7e4068d90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe7f40ae000 tx=0x7fe7f4008040 comp rx=0 tx=0).stop 2023-11-28T18:39:20.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.489+0000 7fe807009640 1 -- 172.21.15.45:0/4199245431 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe80015abb0 msgr2=0x7fe80015c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:20.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.489+0000 7fe807009640 1 --2- 172.21.15.45:0/4199245431 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe80015abb0 0x7fe80015c630 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fe7f800c810 tx=0x7fe7f800ccd0 comp rx=0 tx=0).stop 2023-11-28T18:39:20.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.489+0000 7fe807009640 1 -- 172.21.15.45:0/4199245431 shutdown_connections 2023-11-28T18:39:20.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.489+0000 7fe807009640 1 --2- 172.21.15.45:0/4199245431 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe7e40668d0 0x7fe7e4068d90 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:20.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.489+0000 7fe807009640 1 --2- 172.21.15.45:0/4199245431 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe80015abb0 0x7fe80015c630 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:20.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.489+0000 7fe807009640 1 --2- 172.21.15.45:0/4199245431 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe80013cf70 0x7fe8000adb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:20.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.489+0000 7fe807009640 1 --2- 172.21.15.45:0/4199245431 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe80006c840 0x7fe80013b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:20.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.489+0000 7fe807009640 1 -- 172.21.15.45:0/4199245431 >> 172.21.15.45:0/4199245431 conn(0x7fe80006a570 msgr2=0x7fe800152200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:20.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.489+0000 7fe807009640 1 -- 172.21.15.45:0/4199245431 shutdown_connections 2023-11-28T18:39:20.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.489+0000 7fe807009640 1 -- 172.21.15.45:0/4199245431 wait complete. 2023-11-28T18:39:20.512 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T18:39:20.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.653+0000 7f7c2932a640 1 Processor -- start 2023-11-28T18:39:20.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.653+0000 7f7c2932a640 1 -- start start 2023-11-28T18:39:20.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.653+0000 7f7c2932a640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f7c2415ad80 0x7f7c24164e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:20.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.653+0000 7f7c2932a640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c2415b1b0 con 0x7f7c2406ca10 2023-11-28T18:39:20.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.653+0000 7f7c2932a640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c2415b3e0 con 0x7f7c2413cf70 2023-11-28T18:39:20.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.653+0000 7f7c2932a640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c2413d350 con 0x7f7c2415ad80 2023-11-28T18:39:20.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.653+0000 7f7c1bfff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f7c2406ca10 0x7f7c2415a670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:53018/0 (socket says 172.21.15.45:53018) 2023-11-28T18:39:20.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.653+0000 7f7c1bfff640 1 -- 172.21.15.45:0/4253062651 learned_addr learned my addr 172.21.15.45:0/4253062651 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:39:20.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.653+0000 7f7c237fe640 1 --2- 172.21.15.45:0/4253062651 >> v2:172.21.15.190:3300/0 conn(0x7f7c2415ad80 0x7f7c24164e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:20.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.653+0000 7f7c227fc640 1 -- 172.21.15.45:0/4253062651 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1112327423 0 0) 0x7f7c2415b1b0 con 0x7f7c2406ca10 2023-11-28T18:39:20.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.653+0000 7f7c227fc640 1 -- 172.21.15.45:0/4253062651 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c10003530 con 0x7f7c2406ca10 2023-11-28T18:39:20.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.653+0000 7f7c227fc640 1 -- 172.21.15.45:0/4253062651 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1779630370 0 0) 0x7f7c2415b3e0 con 0x7f7c2413cf70 2023-11-28T18:39:20.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.653+0000 7f7c237fe640 1 -- 172.21.15.45:0/4253062651 >> v1:172.21.15.190:6789/0 conn(0x7f7c2413cf70 legacy=0x7f7c2406c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:20.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.653+0000 7f7c237fe640 1 -- 172.21.15.45:0/4253062651 >> v1:172.21.15.45:6789/0 conn(0x7f7c2406ca10 legacy=0x7f7c2415a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:20.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.653+0000 7f7c237fe640 1 -- 172.21.15.45:0/4253062651 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c2413f760 con 0x7f7c2415ad80 2023-11-28T18:39:20.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.657+0000 7f7c237fe640 1 --2- 172.21.15.45:0/4253062651 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7c2415ad80 0x7f7c24164e30 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c009d90 tx=0x7f7c1c01c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=acd5bf59d6b71c7e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:20.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.657+0000 7f7c227fc640 1 -- 172.21.15.45:0/4253062651 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c0a5870 con 0x7f7c2415ad80 2023-11-28T18:39:20.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.657+0000 7f7c227fc640 1 -- 172.21.15.45:0/4253062651 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c1c0a59d0 con 0x7f7c2415ad80 2023-11-28T18:39:20.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.657+0000 7f7c227fc640 1 -- 172.21.15.45:0/4253062651 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c0a5d60 con 0x7f7c2415ad80 2023-11-28T18:39:20.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.657+0000 7f7c2932a640 1 -- 172.21.15.45:0/4253062651 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7c2415ad80 msgr2=0x7f7c24164e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:20.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.657+0000 7f7c2932a640 1 --2- 172.21.15.45:0/4253062651 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7c2415ad80 0x7f7c24164e30 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c009d90 tx=0x7f7c1c01c8c0 comp rx=0 tx=0).stop 2023-11-28T18:39:20.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.657+0000 7f7c2932a640 1 -- 172.21.15.45:0/4253062651 shutdown_connections 2023-11-28T18:39:20.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.657+0000 7f7c2932a640 1 --2- 172.21.15.45:0/4253062651 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7c2415ad80 0x7f7c24164e30 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:20.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.657+0000 7f7c2932a640 1 -- 172.21.15.45:0/4253062651 >> 172.21.15.45:0/4253062651 conn(0x7f7c2406a570 msgr2=0x7f7c2406a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:20.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.657+0000 7f7c2932a640 1 -- 172.21.15.45:0/4253062651 shutdown_connections 2023-11-28T18:39:20.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.657+0000 7f7c2932a640 1 -- 172.21.15.45:0/4253062651 wait complete. 2023-11-28T18:39:20.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.661+0000 7f7c2932a640 1 Processor -- start 2023-11-28T18:39:20.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.661+0000 7f7c2932a640 1 -- start start 2023-11-28T18:39:20.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.661+0000 7f7c2932a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c2406ca10 0x7f7c24159730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:20.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.661+0000 7f7c2932a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7c2413cf70 0x7f7c2413b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:20.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.661+0000 7f7c2932a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7c2415ad80 0x7f7c2413ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:20.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.661+0000 7f7c2932a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c24150920 con 0x7f7c2406ca10 2023-11-28T18:39:20.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.661+0000 7f7c2932a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c24138420 con 0x7f7c2415ad80 2023-11-28T18:39:20.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.661+0000 7f7c2932a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2413f410 con 0x7f7c2413cf70 2023-11-28T18:39:20.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.661+0000 7f7c22ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c2406ca10 0x7f7c24159730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:20.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.661+0000 7f7c22ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c2406ca10 0x7f7c24159730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36636/0 (socket says 172.21.15.45:36636) 2023-11-28T18:39:20.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.661+0000 7f7c22ffd640 1 -- 172.21.15.45:0/263363624 learned_addr learned my addr 172.21.15.45:0/263363624 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:20.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.661+0000 7f7c237fe640 1 --2- 172.21.15.45:0/263363624 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7c2415ad80 0x7f7c2413ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:20.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.661+0000 7f7c1bfff640 1 --2- 172.21.15.45:0/263363624 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7c2413cf70 0x7f7c2413b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:20.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.661+0000 7f7c22ffd640 1 -- 172.21.15.45:0/263363624 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7c2413cf70 msgr2=0x7f7c2413b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:20.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.661+0000 7f7c22ffd640 1 --2- 172.21.15.45:0/263363624 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7c2413cf70 0x7f7c2413b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:20.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.661+0000 7f7c22ffd640 1 -- 172.21.15.45:0/263363624 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7c2415ad80 msgr2=0x7f7c2413ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:20.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.661+0000 7f7c22ffd640 1 --2- 172.21.15.45:0/263363624 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7c2415ad80 0x7f7c2413ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:20.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.661+0000 7f7c22ffd640 1 -- 172.21.15.45:0/263363624 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c1c009a70 con 0x7f7c2406ca10 2023-11-28T18:39:20.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.661+0000 7f7c237fe640 1 --2- 172.21.15.45:0/263363624 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7c2415ad80 0x7f7c2413ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:39:20.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.661+0000 7f7c22ffd640 1 --2- 172.21.15.45:0/263363624 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c2406ca10 0x7f7c24159730 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f7c1400c4d0 tx=0x7f7c1400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:20.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.661+0000 7f7c1b7fe640 1 -- 172.21.15.45:0/263363624 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c14005480 con 0x7f7c2406ca10 2023-11-28T18:39:20.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.661+0000 7f7c1b7fe640 1 -- 172.21.15.45:0/263363624 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c14003600 con 0x7f7c2406ca10 2023-11-28T18:39:20.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.661+0000 7f7c1b7fe640 1 -- 172.21.15.45:0/263363624 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c140039b0 con 0x7f7c2406ca10 2023-11-28T18:39:20.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.661+0000 7f7c2932a640 1 -- 172.21.15.45:0/263363624 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c24137b30 con 0x7f7c2406ca10 2023-11-28T18:39:20.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.661+0000 7f7c2932a640 1 -- 172.21.15.45:0/263363624 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c241380b0 con 0x7f7c2406ca10 2023-11-28T18:39:20.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.665+0000 7f7c2932a640 1 -- 172.21.15.45:0/263363624 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c24069480 con 0x7f7c2406ca10 2023-11-28T18:39:20.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.665+0000 7f7c1b7fe640 1 -- 172.21.15.45:0/263363624 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f7c14003b10 con 0x7f7c2406ca10 2023-11-28T18:39:20.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.665+0000 7f7c1b7fe640 1 --2- 172.21.15.45:0/263363624 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f7c040668d0 0x7f7c04068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:20.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.665+0000 7f7c1b7fe640 1 -- 172.21.15.45:0/263363624 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f7c14083a90 con 0x7f7c2406ca10 2023-11-28T18:39:20.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.665+0000 7f7c1bfff640 1 --2- 172.21.15.45:0/263363624 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f7c040668d0 0x7f7c04068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:20.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.665+0000 7f7c1bfff640 1 --2- 172.21.15.45:0/263363624 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f7c040668d0 0x7f7c04068d90 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7c2406b290 tx=0x7f7c0c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:20.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.669+0000 7f7c1b7fe640 1 -- 172.21.15.45:0/263363624 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7c14050c60 con 0x7f7c2406ca10 2023-11-28T18:39:20.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.829+0000 7f7c2932a640 1 -- 172.21.15.45:0/263363624 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c24138910 con 0x7f7c2406ca10 2023-11-28T18:39:20.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.829+0000 7f7c1b7fe640 1 -- 172.21.15.45:0/263363624 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16662 (secure 0 0 0) 0x7f7c14017090 con 0x7f7c2406ca10 2023-11-28T18:39:20.833 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:39:20.834 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":35,"fsid":"d10f5cd6-1d00-4019-99b6-6fa435498a15","created":"2023-11-28T18:37:08.189030+0000","modified":"2023-11-28T18:39:02.760784+0000","last_up_change":"2023-11-28T18:37:20.196124+0000","last_in_change":"2023-11-28T18:37:10.742043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T18:37:21.293917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-28T18:38:33.254037+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-28T18:38:34.414654+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"84465384-103c-4f2c-a45a-96f5bb9c835f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6809","nonce":555237322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6811","nonce":555237322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6815","nonce":555237322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6813","nonce":555237322}]},"public_addr":"172.21.15.45:6809/555237322","cluster_addr":"172.21.15.45:6811/555237322","heartbeat_back_addr":"172.21.15.45:6815/555237322","heartbeat_front_addr":"172.21.15.45:6813/555237322","state":["exists","up"]},{"osd":1,"uuid":"7d9eed24-a58f-42c7-a787-ac06be8553fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6801","nonce":2857063763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6803","nonce":2857063763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6807","nonce":2857063763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6805","nonce":2857063763}]},"public_addr":"172.21.15.45:6801/2857063763","cluster_addr":"172.21.15.45:6803/2857063763","heartbeat_back_addr":"172.21.15.45:6807/2857063763","heartbeat_front_addr":"172.21.15.45:6805/2857063763","state":["exists","up"]},{"osd":2,"uuid":"575eeccc-4abf-45b4-9caf-f3e797859588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6817","nonce":193884539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6819","nonce":193884539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6823","nonce":193884539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6821","nonce":193884539}]},"public_addr":"172.21.15.45:6817/193884539","cluster_addr":"172.21.15.45:6819/193884539","heartbeat_back_addr":"172.21.15.45:6823/193884539","heartbeat_front_addr":"172.21.15.45:6821/193884539","state":["exists","up"]},{"osd":3,"uuid":"9b0290d6-9a52-4bc8-b2a1-7622c5dc8e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6825","nonce":78541084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6827","nonce":78541084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6831","nonce":78541084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6829","nonce":78541084}]},"public_addr":"172.21.15.45:6825/78541084","cluster_addr":"172.21.15.45:6827/78541084","heartbeat_back_addr":"172.21.15.45:6831/78541084","heartbeat_front_addr":"172.21.15.45:6829/78541084","state":["exists","up"]},{"osd":4,"uuid":"ce632829-f027-4fbf-a627-02c571aa9d53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6809","nonce":1537591987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6811","nonce":1537591987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6815","nonce":1537591987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6813","nonce":1537591987}]},"public_addr":"172.21.15.190:6809/1537591987","cluster_addr":"172.21.15.190:6811/1537591987","heartbeat_back_addr":"172.21.15.190:6815/1537591987","heartbeat_front_addr":"172.21.15.190:6813/1537591987","state":["exists","up"]},{"osd":5,"uuid":"8700b609-27be-40bd-a251-4c0ae0a29ead","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6801","nonce":3296698407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6803","nonce":3296698407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6807","nonce":3296698407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6805","nonce":3296698407}]},"public_addr":"172.21.15.190:6801/3296698407","cluster_addr":"172.21.15.190:6803/3296698407","heartbeat_back_addr":"172.21.15.190:6807/3296698407","heartbeat_front_addr":"172.21.15.190:6805/3296698407","state":["exists","up"]},{"osd":6,"uuid":"44ce4a40-e6ff-4f4d-8e8a-7341e5c91f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6817","nonce":2317686718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6819","nonce":2317686718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6823","nonce":2317686718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6821","nonce":2317686718}]},"public_addr":"172.21.15.190:6817/2317686718","cluster_addr":"172.21.15.190:6819/2317686718","heartbeat_back_addr":"172.21.15.190:6823/2317686718","heartbeat_front_addr":"172.21.15.190:6821/2317686718","state":["exists","up"]},{"osd":7,"uuid":"192238c9-1423-4b7e-ac8f-84ba32113ddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6825","nonce":2493232051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6827","nonce":2493232051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6831","nonce":2493232051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6829","nonce":2493232051}]},"public_addr":"172.21.15.190:6825/2493232051","cluster_addr":"172.21.15.190:6827/2493232051","heartbeat_back_addr":"172.21.15.190:6831/2493232051","heartbeat_front_addr":"172.21.15.190:6829/2493232051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.393552+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.385453+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.361421+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.366408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.363226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.276007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.414605+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.445885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6834/2398964901":"2023-11-29T18:39:02.760758+0000","172.21.15.45:6832/2398964901":"2023-11-29T18:39:02.760758+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T18:39:20.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.833+0000 7f7c2932a640 1 -- 172.21.15.45:0/263363624 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f7c040668d0 msgr2=0x7f7c04068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:20.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.833+0000 7f7c2932a640 1 --2- 172.21.15.45:0/263363624 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f7c040668d0 0x7f7c04068d90 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7c2406b290 tx=0x7f7c0c009040 comp rx=0 tx=0).stop 2023-11-28T18:39:20.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.833+0000 7f7c2932a640 1 -- 172.21.15.45:0/263363624 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c2406ca10 msgr2=0x7f7c24159730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:20.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.833+0000 7f7c2932a640 1 --2- 172.21.15.45:0/263363624 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c2406ca10 0x7f7c24159730 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f7c1400c4d0 tx=0x7f7c1400c990 comp rx=0 tx=0).stop 2023-11-28T18:39:20.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.833+0000 7f7c2932a640 1 -- 172.21.15.45:0/263363624 shutdown_connections 2023-11-28T18:39:20.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.833+0000 7f7c2932a640 1 --2- 172.21.15.45:0/263363624 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f7c040668d0 0x7f7c04068d90 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:20.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.833+0000 7f7c2932a640 1 --2- 172.21.15.45:0/263363624 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7c2415ad80 0x7f7c2413ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:20.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.833+0000 7f7c2932a640 1 --2- 172.21.15.45:0/263363624 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7c2413cf70 0x7f7c2413b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:20.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.833+0000 7f7c2932a640 1 --2- 172.21.15.45:0/263363624 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c2406ca10 0x7f7c24159730 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:20.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.833+0000 7f7c2932a640 1 -- 172.21.15.45:0/263363624 >> 172.21.15.45:0/263363624 conn(0x7f7c2406a570 msgr2=0x7f7c24150b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:20.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.833+0000 7f7c2932a640 1 -- 172.21.15.45:0/263363624 shutdown_connections 2023-11-28T18:39:20.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.833+0000 7f7c2932a640 1 -- 172.21.15.45:0/263363624 wait complete. 2023-11-28T18:39:20.855 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T18:37:21.293917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T18:38:33.254037+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T18:38:34.414654+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T18:39:20.855 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T18:39:21.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.997+0000 7ff01e0c9640 1 Processor -- start 2023-11-28T18:39:21.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:20.997+0000 7ff01e0c9640 1 -- start start 2023-11-28T18:39:21.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.001+0000 7ff01e0c9640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff01806bc90 0x7ff018168150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:21.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.001+0000 7ff01e0c9640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0180af1c0 con 0x7ff0180ce9a0 2023-11-28T18:39:21.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.001+0000 7ff01e0c9640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0180ae920 con 0x7ff0180ced80 2023-11-28T18:39:21.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.001+0000 7ff01e0c9640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0180aec00 con 0x7ff01806bc90 2023-11-28T18:39:21.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.001+0000 7ff0177fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff0180ce9a0 0x7ff0180ae0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:53032/0 (socket says 172.21.15.45:53032) 2023-11-28T18:39:21.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.001+0000 7ff0177fe640 1 -- 172.21.15.45:0/3822502792 learned_addr learned my addr 172.21.15.45:0/3822502792 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:39:21.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.001+0000 7ff017fff640 1 --2- 172.21.15.45:0/3822502792 >> v2:172.21.15.190:3300/0 conn(0x7ff01806bc90 0x7ff018168150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:21.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.001+0000 7ff0167fc640 1 -- 172.21.15.45:0/3822502792 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1263498796 0 0) 0x7ff0180af1c0 con 0x7ff0180ce9a0 2023-11-28T18:39:21.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.001+0000 7ff0167fc640 1 -- 172.21.15.45:0/3822502792 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff000003530 con 0x7ff0180ce9a0 2023-11-28T18:39:21.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.001+0000 7ff017fff640 1 -- 172.21.15.45:0/3822502792 >> v1:172.21.15.190:6789/0 conn(0x7ff0180ced80 legacy=0x7ff01806b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:21.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.001+0000 7ff017fff640 1 -- 172.21.15.45:0/3822502792 >> v1:172.21.15.45:6789/0 conn(0x7ff0180ce9a0 legacy=0x7ff0180ae0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:21.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.001+0000 7ff017fff640 1 -- 172.21.15.45:0/3822502792 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0180aeee0 con 0x7ff01806bc90 2023-11-28T18:39:21.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.005+0000 7ff017fff640 1 --2- 172.21.15.45:0/3822502792 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff01806bc90 0x7ff018168150 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff010009d90 tx=0x7ff01001c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a134035636c0ab67 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:21.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.005+0000 7ff0167fc640 1 -- 172.21.15.45:0/3822502792 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0100a58e0 con 0x7ff01806bc90 2023-11-28T18:39:21.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.005+0000 7ff0167fc640 1 -- 172.21.15.45:0/3822502792 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0100a5a40 con 0x7ff01806bc90 2023-11-28T18:39:21.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.005+0000 7ff0167fc640 1 -- 172.21.15.45:0/3822502792 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0100a5dd0 con 0x7ff01806bc90 2023-11-28T18:39:21.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.005+0000 7ff01e0c9640 1 -- 172.21.15.45:0/3822502792 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff01806bc90 msgr2=0x7ff018168150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:21.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.005+0000 7ff01e0c9640 1 --2- 172.21.15.45:0/3822502792 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff01806bc90 0x7ff018168150 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff010009d90 tx=0x7ff01001c800 comp rx=0 tx=0).stop 2023-11-28T18:39:21.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.005+0000 7ff01e0c9640 1 -- 172.21.15.45:0/3822502792 shutdown_connections 2023-11-28T18:39:21.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.005+0000 7ff01e0c9640 1 --2- 172.21.15.45:0/3822502792 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff01806bc90 0x7ff018168150 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:21.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.005+0000 7ff01e0c9640 1 -- 172.21.15.45:0/3822502792 >> 172.21.15.45:0/3822502792 conn(0x7ff0180b1b70 msgr2=0x7ff018070cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:21.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.005+0000 7ff01e0c9640 1 -- 172.21.15.45:0/3822502792 shutdown_connections 2023-11-28T18:39:21.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.005+0000 7ff01e0c9640 1 -- 172.21.15.45:0/3822502792 wait complete. 2023-11-28T18:39:21.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.005+0000 7ff01e0c9640 1 Processor -- start 2023-11-28T18:39:21.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.005+0000 7ff01e0c9640 1 -- start start 2023-11-28T18:39:21.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.005+0000 7ff01e0c9640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff01806bc90 0x7ff018154a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:21.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.005+0000 7ff01e0c9640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff0180ce9a0 0x7ff018157470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:21.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.005+0000 7ff01e0c9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0180ced80 0x7ff018143ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:21.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.005+0000 7ff01e0c9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff01814ba50 con 0x7ff0180ced80 2023-11-28T18:39:21.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.005+0000 7ff01e0c9640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff01814dc40 con 0x7ff01806bc90 2023-11-28T18:39:21.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.005+0000 7ff01e0c9640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff01814df20 con 0x7ff0180ce9a0 2023-11-28T18:39:21.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.009+0000 7ff017fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0180ced80 0x7ff018143ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:21.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.009+0000 7ff017fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0180ced80 0x7ff018143ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36640/0 (socket says 172.21.15.45:36640) 2023-11-28T18:39:21.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.009+0000 7ff017fff640 1 -- 172.21.15.45:0/1360869182 learned_addr learned my addr 172.21.15.45:0/1360869182 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:21.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.009+0000 7ff0177fe640 1 --2- 172.21.15.45:0/1360869182 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff01806bc90 0x7ff018154a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:21.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.009+0000 7ff016ffd640 1 --2- 172.21.15.45:0/1360869182 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff0180ce9a0 0x7ff018157470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:21.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.009+0000 7ff017fff640 1 -- 172.21.15.45:0/1360869182 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff0180ce9a0 msgr2=0x7ff018157470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:21.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.009+0000 7ff017fff640 1 --2- 172.21.15.45:0/1360869182 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff0180ce9a0 0x7ff018157470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:21.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.009+0000 7ff017fff640 1 -- 172.21.15.45:0/1360869182 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff01806bc90 msgr2=0x7ff018154a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:21.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.009+0000 7ff017fff640 1 --2- 172.21.15.45:0/1360869182 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff01806bc90 0x7ff018154a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:21.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.009+0000 7ff017fff640 1 -- 172.21.15.45:0/1360869182 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff010009a70 con 0x7ff0180ced80 2023-11-28T18:39:21.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.009+0000 7ff016ffd640 1 --2- 172.21.15.45:0/1360869182 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff0180ce9a0 0x7ff018157470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:39:21.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.009+0000 7ff017fff640 1 --2- 172.21.15.45:0/1360869182 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0180ced80 0x7ff018143ed0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7ff01001a430 tx=0x7ff0100195a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:21.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.009+0000 7feffffff640 1 -- 172.21.15.45:0/1360869182 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0100b9860 con 0x7ff0180ced80 2023-11-28T18:39:21.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.009+0000 7feffffff640 1 -- 172.21.15.45:0/1360869182 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0100b99c0 con 0x7ff0180ced80 2023-11-28T18:39:21.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.009+0000 7feffffff640 1 -- 172.21.15.45:0/1360869182 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0100b9d30 con 0x7ff0180ced80 2023-11-28T18:39:21.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.009+0000 7ff01e0c9640 1 -- 172.21.15.45:0/1360869182 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff01814e200 con 0x7ff0180ced80 2023-11-28T18:39:21.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.009+0000 7ff01e0c9640 1 -- 172.21.15.45:0/1360869182 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff01814e7c0 con 0x7ff0180ced80 2023-11-28T18:39:21.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.009+0000 7ff01e0c9640 1 -- 172.21.15.45:0/1360869182 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff018069410 con 0x7ff0180ced80 2023-11-28T18:39:21.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.009+0000 7feffffff640 1 -- 172.21.15.45:0/1360869182 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ff0180b3fa0 con 0x7ff0180ced80 2023-11-28T18:39:21.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.013+0000 7feffffff640 1 --2- 172.21.15.45:0/1360869182 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff004066900 0x7ff004068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:21.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.013+0000 7feffffff640 1 -- 172.21.15.45:0/1360869182 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7ff01011eeb0 con 0x7ff0180ced80 2023-11-28T18:39:21.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.013+0000 7ff0177fe640 1 --2- 172.21.15.45:0/1360869182 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff004066900 0x7ff004068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:21.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.013+0000 7ff0177fe640 1 --2- 172.21.15.45:0/1360869182 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff004066900 0x7ff004068dc0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff0080011f0 tx=0x7ff008007d40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:21.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.013+0000 7feffffff640 1 -- 172.21.15.45:0/1360869182 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff0100ebff0 con 0x7ff0180ced80 2023-11-28T18:39:21.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.173+0000 7ff01e0c9640 1 -- 172.21.15.45:0/1360869182 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff018071fa0 con 0x7ff0180ced80 2023-11-28T18:39:21.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.173+0000 7feffffff640 1 -- 172.21.15.45:0/1360869182 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff0100ef610 con 0x7ff0180ced80 2023-11-28T18:39:21.176 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-11-28T18:39:21.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.173+0000 7ff01e0c9640 1 -- 172.21.15.45:0/1360869182 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff004066900 msgr2=0x7ff004068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:21.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.173+0000 7ff01e0c9640 1 --2- 172.21.15.45:0/1360869182 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff004066900 0x7ff004068dc0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff0080011f0 tx=0x7ff008007d40 comp rx=0 tx=0).stop 2023-11-28T18:39:21.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.173+0000 7ff01e0c9640 1 -- 172.21.15.45:0/1360869182 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0180ced80 msgr2=0x7ff018143ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:21.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.173+0000 7ff01e0c9640 1 --2- 172.21.15.45:0/1360869182 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0180ced80 0x7ff018143ed0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7ff01001a430 tx=0x7ff0100195a0 comp rx=0 tx=0).stop 2023-11-28T18:39:21.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.173+0000 7ff01e0c9640 1 -- 172.21.15.45:0/1360869182 shutdown_connections 2023-11-28T18:39:21.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.173+0000 7ff01e0c9640 1 --2- 172.21.15.45:0/1360869182 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff004066900 0x7ff004068dc0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:21.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.173+0000 7ff01e0c9640 1 --2- 172.21.15.45:0/1360869182 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0180ced80 0x7ff018143ed0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:21.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.173+0000 7ff01e0c9640 1 --2- 172.21.15.45:0/1360869182 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff0180ce9a0 0x7ff018157470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:21.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.173+0000 7ff01e0c9640 1 --2- 172.21.15.45:0/1360869182 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff01806bc90 0x7ff018154a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:21.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.173+0000 7ff01e0c9640 1 -- 172.21.15.45:0/1360869182 >> 172.21.15.45:0/1360869182 conn(0x7ff0180b1b70 msgr2=0x7ff018160d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:21.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.173+0000 7ff01e0c9640 1 -- 172.21.15.45:0/1360869182 shutdown_connections 2023-11-28T18:39:21.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.173+0000 7ff01e0c9640 1 -- 172.21.15.45:0/1360869182 wait complete. 2023-11-28T18:39:21.197 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T18:39:21.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.341+0000 7f68f2bd1640 1 Processor -- start 2023-11-28T18:39:21.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.341+0000 7f68f2bd1640 1 -- start start 2023-11-28T18:39:21.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.341+0000 7f68f2bd1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f68ec13f630 0x7f68ec0ce240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:21.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.341+0000 7f68f2bd1640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68ec13d2f0 con 0x7f68ec071dd0 2023-11-28T18:39:21.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.341+0000 7f68f2bd1640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68ec0cddb0 con 0x7f68ec15adf0 2023-11-28T18:39:21.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.341+0000 7f68f2bd1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68ec140560 con 0x7f68ec13f630 2023-11-28T18:39:21.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.341+0000 7f68f096d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f68ec071dd0 0x7f68ec0721b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:53040/0 (socket says 172.21.15.45:53040) 2023-11-28T18:39:21.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.341+0000 7f68f096d640 1 -- 172.21.15.45:0/1827885176 learned_addr learned my addr 172.21.15.45:0/1827885176 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:39:21.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.341+0000 7f68f116e640 1 --2- 172.21.15.45:0/1827885176 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f68ec13f630 0x7f68ec0ce240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:21.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.341+0000 7f68eb7fe640 1 -- 172.21.15.45:0/1827885176 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 919873291 0 0) 0x7f68ec13d2f0 con 0x7f68ec071dd0 2023-11-28T18:39:21.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.341+0000 7f68eb7fe640 1 -- 172.21.15.45:0/1827885176 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68dc003530 con 0x7f68ec071dd0 2023-11-28T18:39:21.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.341+0000 7f68eb7fe640 1 -- 172.21.15.45:0/1827885176 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1370792076 0 0) 0x7f68dc003530 con 0x7f68ec071dd0 2023-11-28T18:39:21.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.341+0000 7f68eb7fe640 1 -- 172.21.15.45:0/1827885176 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f68ec13f630 msgr2=0x7f68ec0ce240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:21.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.341+0000 7f68eb7fe640 1 --2- 172.21.15.45:0/1827885176 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f68ec13f630 0x7f68ec0ce240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:21.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.341+0000 7f68eb7fe640 1 -- 172.21.15.45:0/1827885176 >> v1:172.21.15.190:6789/0 conn(0x7f68ec15adf0 legacy=0x7f68ec13d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:21.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.345+0000 7f68eb7fe640 1 -- 172.21.15.45:0/1827885176 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68ec13ffa0 con 0x7f68ec071dd0 2023-11-28T18:39:21.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.345+0000 7f68eb7fe640 1 -- 172.21.15.45:0/1827885176 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4084481567 0 0) 0x7f68e0001680 con 0x7f68ec071dd0 2023-11-28T18:39:21.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.345+0000 7f68eb7fe640 1 -- 172.21.15.45:0/1827885176 >> v1:172.21.15.45:6789/0 conn(0x7f68ec071dd0 legacy=0x7f68ec0721b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:21.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.345+0000 7f68eb7fe640 1 --2- 172.21.15.45:0/1827885176 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f68dc0039b0 0x7f68dc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:21.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.345+0000 7f68eb7fe640 1 --2- 172.21.15.45:0/1827885176 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f68ec13f630 0x7f68dc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:21.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.345+0000 7f68eb7fe640 1 --2- 172.21.15.45:0/1827885176 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68dc004d10 0x7f68dc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:21.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.345+0000 7f68eb7fe640 1 -- 172.21.15.45:0/1827885176 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68ec140560 con 0x7f68dc004d10 2023-11-28T18:39:21.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.345+0000 7f68eb7fe640 1 -- 172.21.15.45:0/1827885176 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68dc00ba40 con 0x7f68dc0039b0 2023-11-28T18:39:21.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.345+0000 7f68eb7fe640 1 -- 172.21.15.45:0/1827885176 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68dc00bbb0 con 0x7f68ec13f630 2023-11-28T18:39:21.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.345+0000 7f68f116e640 1 --2- 172.21.15.45:0/1827885176 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68dc004d10 0x7f68dc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:21.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.345+0000 7f68f096d640 1 --2- 172.21.15.45:0/1827885176 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f68dc0039b0 0x7f68dc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:21.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.345+0000 7f68ebfff640 1 --2- 172.21.15.45:0/1827885176 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f68ec13f630 0x7f68dc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:21.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.345+0000 7f68f116e640 1 -- 172.21.15.45:0/1827885176 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f68ec13f630 msgr2=0x7f68dc0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:21.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.345+0000 7f68f116e640 1 --2- 172.21.15.45:0/1827885176 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f68ec13f630 0x7f68dc0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:21.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.345+0000 7f68f116e640 1 -- 172.21.15.45:0/1827885176 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f68dc0039b0 msgr2=0x7f68dc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:21.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.345+0000 7f68f116e640 1 --2- 172.21.15.45:0/1827885176 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f68dc0039b0 0x7f68dc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:21.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.345+0000 7f68f116e640 1 -- 172.21.15.45:0/1827885176 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68dc003530 con 0x7f68dc004d10 2023-11-28T18:39:21.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.345+0000 7f68f116e640 1 --2- 172.21.15.45:0/1827885176 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68dc004d10 0x7f68dc005190 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f68e4009fa0 tx=0x7f68e401cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd193675902aef45 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:21.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.345+0000 7f68eb7fe640 1 -- 172.21.15.45:0/1827885176 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e40a5cf0 con 0x7f68dc004d10 2023-11-28T18:39:21.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.345+0000 7f68eb7fe640 1 -- 172.21.15.45:0/1827885176 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68e400f040 con 0x7f68dc004d10 2023-11-28T18:39:21.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.345+0000 7f68eb7fe640 1 -- 172.21.15.45:0/1827885176 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e40ad660 con 0x7f68dc004d10 2023-11-28T18:39:21.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.349+0000 7f68f2bd1640 1 -- 172.21.15.45:0/1827885176 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68dc004d10 msgr2=0x7f68dc005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:21.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.349+0000 7f68f2bd1640 1 --2- 172.21.15.45:0/1827885176 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68dc004d10 0x7f68dc005190 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f68e4009fa0 tx=0x7f68e401cc20 comp rx=0 tx=0).stop 2023-11-28T18:39:21.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.349+0000 7f68f116e640 1 -- 172.21.15.45:0/1827885176 reap_dead start 2023-11-28T18:39:21.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.349+0000 7f68f2bd1640 1 -- 172.21.15.45:0/1827885176 shutdown_connections 2023-11-28T18:39:21.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.349+0000 7f68f2bd1640 1 -- 172.21.15.45:0/1827885176 >> 172.21.15.45:0/1827885176 conn(0x7f68ec0b0d00 msgr2=0x7f68ec0b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:21.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.349+0000 7f68f2bd1640 1 -- 172.21.15.45:0/1827885176 shutdown_connections 2023-11-28T18:39:21.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.349+0000 7f68f2bd1640 1 -- 172.21.15.45:0/1827885176 wait complete. 2023-11-28T18:39:21.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.349+0000 7f68f2bd1640 1 Processor -- start 2023-11-28T18:39:21.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.349+0000 7f68f2bd1640 1 -- start start 2023-11-28T18:39:21.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.349+0000 7f68f2bd1640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f68dc004d10 0x7f68ec1f2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:21.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.349+0000 7f68f2bd1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f68ec1515d0 0x7f68ec151a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:21.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.349+0000 7f68f2bd1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68ec0ad880 0x7f68ec0add00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:21.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.349+0000 7f68f2bd1640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68ec151f90 con 0x7f68ec0ad880 2023-11-28T18:39:21.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.349+0000 7f68f2bd1640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68ec0ae240 con 0x7f68dc004d10 2023-11-28T18:39:21.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.349+0000 7f68f2bd1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68ec0b28e0 con 0x7f68ec1515d0 2023-11-28T18:39:21.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.349+0000 7f68f116e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68ec0ad880 0x7f68ec0add00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:21.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.349+0000 7f68f116e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68ec0ad880 0x7f68ec0add00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36656/0 (socket says 172.21.15.45:36656) 2023-11-28T18:39:21.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.349+0000 7f68f116e640 1 -- 172.21.15.45:0/1794854761 learned_addr learned my addr 172.21.15.45:0/1794854761 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:21.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.349+0000 7f68ebfff640 1 --2- 172.21.15.45:0/1794854761 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f68ec1515d0 0x7f68ec151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:21.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.349+0000 7f68f096d640 1 --2- 172.21.15.45:0/1794854761 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f68dc004d10 0x7f68ec1f2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:21.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.353+0000 7f68f116e640 1 -- 172.21.15.45:0/1794854761 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f68ec1515d0 msgr2=0x7f68ec151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:21.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.353+0000 7f68f116e640 1 --2- 172.21.15.45:0/1794854761 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f68ec1515d0 0x7f68ec151a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:21.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.353+0000 7f68f116e640 1 -- 172.21.15.45:0/1794854761 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f68dc004d10 msgr2=0x7f68ec1f2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:21.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.353+0000 7f68f116e640 1 --2- 172.21.15.45:0/1794854761 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f68dc004d10 0x7f68ec1f2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:21.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.353+0000 7f68f116e640 1 -- 172.21.15.45:0/1794854761 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68ec0b2b10 con 0x7f68ec0ad880 2023-11-28T18:39:21.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.353+0000 7f68f096d640 1 --2- 172.21.15.45:0/1794854761 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f68dc004d10 0x7f68ec1f2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:39:21.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.353+0000 7f68f116e640 1 --2- 172.21.15.45:0/1794854761 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68ec0ad880 0x7f68ec0add00 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f68e40b0040 tx=0x7f68e4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:21.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.353+0000 7f68e97fa640 1 -- 172.21.15.45:0/1794854761 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e40be070 con 0x7f68ec0ad880 2023-11-28T18:39:21.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.353+0000 7f68e97fa640 1 -- 172.21.15.45:0/1794854761 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68e40ad650 con 0x7f68ec0ad880 2023-11-28T18:39:21.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.353+0000 7f68f2bd1640 1 -- 172.21.15.45:0/1794854761 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68ec0b2df0 con 0x7f68ec0ad880 2023-11-28T18:39:21.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.353+0000 7f68e97fa640 1 -- 172.21.15.45:0/1794854761 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e40ad7e0 con 0x7f68ec0ad880 2023-11-28T18:39:21.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.353+0000 7f68f2bd1640 1 -- 172.21.15.45:0/1794854761 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68ec0b33b0 con 0x7f68ec0ad880 2023-11-28T18:39:21.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.353+0000 7f68f2bd1640 1 -- 172.21.15.45:0/1794854761 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68ec069410 con 0x7f68ec0ad880 2023-11-28T18:39:21.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.353+0000 7f68e97fa640 1 -- 172.21.15.45:0/1794854761 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f68e40b4040 con 0x7f68ec0ad880 2023-11-28T18:39:21.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.353+0000 7f68e97fa640 1 --2- 172.21.15.45:0/1794854761 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f68d0066900 0x7f68d0068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:21.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.353+0000 7f68e97fa640 1 -- 172.21.15.45:0/1794854761 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f68e411e440 con 0x7f68ec0ad880 2023-11-28T18:39:21.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.357+0000 7f68f096d640 1 --2- 172.21.15.45:0/1794854761 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f68d0066900 0x7f68d0068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:21.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.357+0000 7f68f096d640 1 --2- 172.21.15.45:0/1794854761 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f68d0066900 0x7f68d0068dc0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f68e00078f0 tx=0x7f68e0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:21.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.361+0000 7f68e97fa640 1 -- 172.21.15.45:0/1794854761 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f68e40eb630 con 0x7f68ec0ad880 2023-11-28T18:39:21.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.517+0000 7f68f2bd1640 1 -- 172.21.15.45:0/1794854761 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f68ec13cd80 con 0x7f68ec0ad880 2023-11-28T18:39:21.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.517+0000 7f68e97fa640 1 -- 172.21.15.45:0/1794854761 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v35) v1 ==== 104+0+11 (secure 0 0 0) 0x7f68e40eec50 con 0x7f68ec0ad880 2023-11-28T18:39:21.521 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-11-28T18:39:21.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.521+0000 7f68f2bd1640 1 -- 172.21.15.45:0/1794854761 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f68d0066900 msgr2=0x7f68d0068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:21.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.521+0000 7f68f2bd1640 1 --2- 172.21.15.45:0/1794854761 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f68d0066900 0x7f68d0068dc0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f68e00078f0 tx=0x7f68e0009040 comp rx=0 tx=0).stop 2023-11-28T18:39:21.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.521+0000 7f68f2bd1640 1 -- 172.21.15.45:0/1794854761 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68ec0ad880 msgr2=0x7f68ec0add00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:21.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.521+0000 7f68f2bd1640 1 --2- 172.21.15.45:0/1794854761 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68ec0ad880 0x7f68ec0add00 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f68e40b0040 tx=0x7f68e4009750 comp rx=0 tx=0).stop 2023-11-28T18:39:21.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.521+0000 7f68f2bd1640 1 -- 172.21.15.45:0/1794854761 shutdown_connections 2023-11-28T18:39:21.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.521+0000 7f68f2bd1640 1 --2- 172.21.15.45:0/1794854761 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f68d0066900 0x7f68d0068dc0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:21.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.521+0000 7f68f2bd1640 1 --2- 172.21.15.45:0/1794854761 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68ec0ad880 0x7f68ec0add00 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:21.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.521+0000 7f68f2bd1640 1 --2- 172.21.15.45:0/1794854761 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f68ec1515d0 0x7f68ec151a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:21.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.521+0000 7f68f2bd1640 1 --2- 172.21.15.45:0/1794854761 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f68dc004d10 0x7f68ec1f2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:21.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.521+0000 7f68f2bd1640 1 -- 172.21.15.45:0/1794854761 >> 172.21.15.45:0/1794854761 conn(0x7f68ec0b0d00 msgr2=0x7f68ec0ce140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:21.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.521+0000 7f68f2bd1640 1 -- 172.21.15.45:0/1794854761 shutdown_connections 2023-11-28T18:39:21.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.521+0000 7f68f2bd1640 1 -- 172.21.15.45:0/1794854761 wait complete. 2023-11-28T18:39:21.542 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T18:39:21.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.685+0000 7f25fac32640 1 Processor -- start 2023-11-28T18:39:21.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.685+0000 7f25fac32640 1 -- start start 2023-11-28T18:39:21.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.685+0000 7f25fac32640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f25f41401f0 0x7f25f4161730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:21.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.685+0000 7f25fac32640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25f4141220 con 0x7f25f41409a0 2023-11-28T18:39:21.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.685+0000 7f25fac32640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25f40ad5e0 con 0x7f25f4140e10 2023-11-28T18:39:21.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.685+0000 7f25fac32640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25f40ad880 con 0x7f25f41401f0 2023-11-28T18:39:21.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.685+0000 7f25f3fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f25f41409a0 0x7f25f40ae920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:53050/0 (socket says 172.21.15.45:53050) 2023-11-28T18:39:21.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.685+0000 7f25f3fff640 1 -- 172.21.15.45:0/3568246173 learned_addr learned my addr 172.21.15.45:0/3568246173 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:39:21.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.685+0000 7f25f89ce640 1 --2- 172.21.15.45:0/3568246173 >> v2:172.21.15.190:3300/0 conn(0x7f25f41401f0 0x7f25f4161730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:21.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.685+0000 7f25f37fe640 1 -- 172.21.15.45:0/3568246173 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2140842830 0 0) 0x7f25f4141220 con 0x7f25f41409a0 2023-11-28T18:39:21.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.685+0000 7f25f37fe640 1 -- 172.21.15.45:0/3568246173 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25e4003530 con 0x7f25f41409a0 2023-11-28T18:39:21.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.685+0000 7f25f37fe640 1 -- 172.21.15.45:0/3568246173 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 207748610 0 0) 0x7f25f40ad5e0 con 0x7f25f4140e10 2023-11-28T18:39:21.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.685+0000 7f25f37fe640 1 -- 172.21.15.45:0/3568246173 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25f4141220 con 0x7f25f4140e10 2023-11-28T18:39:21.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.685+0000 7f25f89ce640 1 -- 172.21.15.45:0/3568246173 >> v1:172.21.15.190:6789/0 conn(0x7f25f4140e10 legacy=0x7f25f406b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:21.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.685+0000 7f25f89ce640 1 -- 172.21.15.45:0/3568246173 >> v1:172.21.15.45:6789/0 conn(0x7f25f41409a0 legacy=0x7f25f40ae920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:21.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.685+0000 7f25f89ce640 1 -- 172.21.15.45:0/3568246173 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f40adb60 con 0x7f25f41401f0 2023-11-28T18:39:21.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.689+0000 7f25f89ce640 1 --2- 172.21.15.45:0/3568246173 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f25f41401f0 0x7f25f4161730 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f25e80097c0 tx=0x7f25e801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1cea7d2459d2395d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:21.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.689+0000 7f25f37fe640 1 -- 172.21.15.45:0/3568246173 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e80ab650 con 0x7f25f41401f0 2023-11-28T18:39:21.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.689+0000 7f25f37fe640 1 -- 172.21.15.45:0/3568246173 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25e80ab7b0 con 0x7f25f41401f0 2023-11-28T18:39:21.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.689+0000 7f25f37fe640 1 -- 172.21.15.45:0/3568246173 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e80abb40 con 0x7f25f41401f0 2023-11-28T18:39:21.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.689+0000 7f25fac32640 1 -- 172.21.15.45:0/3568246173 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f25f41401f0 msgr2=0x7f25f4161730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:21.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.689+0000 7f25fac32640 1 --2- 172.21.15.45:0/3568246173 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f25f41401f0 0x7f25f4161730 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f25e80097c0 tx=0x7f25e801c450 comp rx=0 tx=0).stop 2023-11-28T18:39:21.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.689+0000 7f25fac32640 1 -- 172.21.15.45:0/3568246173 shutdown_connections 2023-11-28T18:39:21.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.689+0000 7f25fac32640 1 --2- 172.21.15.45:0/3568246173 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f25f41401f0 0x7f25f4161730 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:21.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.689+0000 7f25fac32640 1 -- 172.21.15.45:0/3568246173 >> 172.21.15.45:0/3568246173 conn(0x7f25f40b1b70 msgr2=0x7f25f4070cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:21.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.689+0000 7f25fac32640 1 -- 172.21.15.45:0/3568246173 shutdown_connections 2023-11-28T18:39:21.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.689+0000 7f25fac32640 1 -- 172.21.15.45:0/3568246173 wait complete. 2023-11-28T18:39:21.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.693+0000 7f25fac32640 1 Processor -- start 2023-11-28T18:39:21.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.693+0000 7f25fac32640 1 -- start start 2023-11-28T18:39:21.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.693+0000 7f25fac32640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25f41401f0 0x7f25f415cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:21.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.693+0000 7f25fac32640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f25f41409a0 0x7f25f415d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:21.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.693+0000 7f25fac32640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f25f4140e10 0x7f25f4155b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:21.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.693+0000 7f25fac32640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f415df10 con 0x7f25f41401f0 2023-11-28T18:39:21.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.693+0000 7f25fac32640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f413d980 con 0x7f25f41409a0 2023-11-28T18:39:21.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.693+0000 7f25fac32640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25f4156650 con 0x7f25f4140e10 2023-11-28T18:39:21.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.693+0000 7f25f89ce640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25f41401f0 0x7f25f415cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:21.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.693+0000 7f25f89ce640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25f41401f0 0x7f25f415cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36662/0 (socket says 172.21.15.45:36662) 2023-11-28T18:39:21.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.693+0000 7f25f89ce640 1 -- 172.21.15.45:0/2156603345 learned_addr learned my addr 172.21.15.45:0/2156603345 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:21.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.693+0000 7f25f3fff640 1 --2- 172.21.15.45:0/2156603345 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f25f41409a0 0x7f25f415d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:21.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.693+0000 7f25f91cf640 1 --2- 172.21.15.45:0/2156603345 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f25f4140e10 0x7f25f4155b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:21.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.693+0000 7f25f89ce640 1 -- 172.21.15.45:0/2156603345 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f25f4140e10 msgr2=0x7f25f4155b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:21.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.693+0000 7f25f89ce640 1 --2- 172.21.15.45:0/2156603345 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f25f4140e10 0x7f25f4155b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:21.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.693+0000 7f25f89ce640 1 -- 172.21.15.45:0/2156603345 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f25f41409a0 msgr2=0x7f25f415d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:21.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.693+0000 7f25f89ce640 1 --2- 172.21.15.45:0/2156603345 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f25f41409a0 0x7f25f415d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:21.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.693+0000 7f25f89ce640 1 -- 172.21.15.45:0/2156603345 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25e8009420 con 0x7f25f41401f0 2023-11-28T18:39:21.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.693+0000 7f25f91cf640 1 --2- 172.21.15.45:0/2156603345 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f25f4140e10 0x7f25f4155b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:39:21.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.693+0000 7f25f89ce640 1 --2- 172.21.15.45:0/2156603345 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25f41401f0 0x7f25f415cdf0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f25e80ad040 tx=0x7f25e801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:21.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.693+0000 7f25f17fa640 1 -- 172.21.15.45:0/2156603345 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e80bf610 con 0x7f25f41401f0 2023-11-28T18:39:21.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.693+0000 7f25f17fa640 1 -- 172.21.15.45:0/2156603345 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25e80bf790 con 0x7f25f41401f0 2023-11-28T18:39:21.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.693+0000 7f25f17fa640 1 -- 172.21.15.45:0/2156603345 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e80bfb40 con 0x7f25f41401f0 2023-11-28T18:39:21.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.693+0000 7f25fac32640 1 -- 172.21.15.45:0/2156603345 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25f415e3c0 con 0x7f25f41401f0 2023-11-28T18:39:21.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.697+0000 7f25fac32640 1 -- 172.21.15.45:0/2156603345 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25f41560a0 con 0x7f25f41401f0 2023-11-28T18:39:21.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.697+0000 7f25fac32640 1 -- 172.21.15.45:0/2156603345 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25f4161bf0 con 0x7f25f41401f0 2023-11-28T18:39:21.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.697+0000 7f25f17fa640 1 -- 172.21.15.45:0/2156603345 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f25e80b5400 con 0x7f25f41401f0 2023-11-28T18:39:21.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.697+0000 7f25f17fa640 1 --2- 172.21.15.45:0/2156603345 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f25d80668d0 0x7f25d8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:21.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.697+0000 7f25f17fa640 1 -- 172.21.15.45:0/2156603345 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f25e811f3f0 con 0x7f25f41401f0 2023-11-28T18:39:21.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.697+0000 7f25f3fff640 1 --2- 172.21.15.45:0/2156603345 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f25d80668d0 0x7f25d8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:21.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.701+0000 7f25f3fff640 1 --2- 172.21.15.45:0/2156603345 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f25d80668d0 0x7f25d8068d90 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f25f4169160 tx=0x7f25e0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:21.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.701+0000 7f25f17fa640 1 -- 172.21.15.45:0/2156603345 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f25e80ec660 con 0x7f25f41401f0 2023-11-28T18:39:21.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.857+0000 7f25fac32640 1 -- 172.21.15.45:0/2156603345 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f25f4069410 con 0x7f25f41401f0 2023-11-28T18:39:21.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.857+0000 7f25f17fa640 1 -- 172.21.15.45:0/2156603345 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v35) v1 ==== 100+0+11 (secure 0 0 0) 0x7f25e80efc80 con 0x7f25f41401f0 2023-11-28T18:39:21.861 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-11-28T18:39:21.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.861+0000 7f25fac32640 1 -- 172.21.15.45:0/2156603345 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f25d80668d0 msgr2=0x7f25d8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:21.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.861+0000 7f25fac32640 1 --2- 172.21.15.45:0/2156603345 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f25d80668d0 0x7f25d8068d90 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f25f4169160 tx=0x7f25e0009040 comp rx=0 tx=0).stop 2023-11-28T18:39:21.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.861+0000 7f25fac32640 1 -- 172.21.15.45:0/2156603345 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25f41401f0 msgr2=0x7f25f415cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:21.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.861+0000 7f25fac32640 1 --2- 172.21.15.45:0/2156603345 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25f41401f0 0x7f25f415cdf0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f25e80ad040 tx=0x7f25e801ac90 comp rx=0 tx=0).stop 2023-11-28T18:39:21.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.861+0000 7f25fac32640 1 -- 172.21.15.45:0/2156603345 shutdown_connections 2023-11-28T18:39:21.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.861+0000 7f25fac32640 1 --2- 172.21.15.45:0/2156603345 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f25d80668d0 0x7f25d8068d90 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:21.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.861+0000 7f25fac32640 1 --2- 172.21.15.45:0/2156603345 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f25f4140e10 0x7f25f4155b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:21.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.861+0000 7f25fac32640 1 --2- 172.21.15.45:0/2156603345 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f25f41409a0 0x7f25f415d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:21.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.861+0000 7f25fac32640 1 --2- 172.21.15.45:0/2156603345 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25f41401f0 0x7f25f415cdf0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:21.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.861+0000 7f25fac32640 1 -- 172.21.15.45:0/2156603345 >> 172.21.15.45:0/2156603345 conn(0x7f25f40b1b70 msgr2=0x7f25f40af330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:21.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.861+0000 7f25fac32640 1 -- 172.21.15.45:0/2156603345 shutdown_connections 2023-11-28T18:39:21.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:21.861+0000 7f25fac32640 1 -- 172.21.15.45:0/2156603345 wait complete. 2023-11-28T18:39:21.884 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T18:39:22.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.025+0000 7fa44d017640 1 Processor -- start 2023-11-28T18:39:22.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.025+0000 7fa44d017640 1 -- start start 2023-11-28T18:39:22.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.025+0000 7fa44d017640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa4480d0440 0x7fa448161250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:22.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.025+0000 7fa44d017640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa448161790 0x7fa448161be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:22.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.025+0000 7fa44d017640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4480c7000 con 0x7fa4480cf950 2023-11-28T18:39:22.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.025+0000 7fa44d017640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4480cf0a0 con 0x7fa448161790 2023-11-28T18:39:22.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.025+0000 7fa44d017640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa448162120 con 0x7fa4480d0440 2023-11-28T18:39:22.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.025+0000 7fa44c816640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa448161790 0x7fa448161be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:22.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.025+0000 7fa447fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fa4480cf950 0x7fa4480cfd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:53052/0 (socket says 172.21.15.45:53052) 2023-11-28T18:39:22.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.025+0000 7fa447fff640 1 -- 172.21.15.45:0/3311460652 learned_addr learned my addr 172.21.15.45:0/3311460652 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:39:22.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.025+0000 7fa4477fe640 1 --2- 172.21.15.45:0/3311460652 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa4480d0440 0x7fa448161250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:22.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.025+0000 7fa44c816640 1 -- 172.21.15.45:0/3311460652 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa4480d0440 msgr2=0x7fa448161250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:22.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.025+0000 7fa44c816640 1 --2- 172.21.15.45:0/3311460652 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa4480d0440 0x7fa448161250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:22.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.025+0000 7fa44c816640 1 -- 172.21.15.45:0/3311460652 >> v1:172.21.15.45:6789/0 conn(0x7fa4480cf950 legacy=0x7fa4480cfd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:22.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.025+0000 7fa44c816640 1 -- 172.21.15.45:0/3311460652 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4480ceae0 con 0x7fa448161790 2023-11-28T18:39:22.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.025+0000 7fa446ffd640 1 -- 172.21.15.45:0/3311460652 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3378894136 0 0) 0x7fa4480c7000 con 0x7fa4480cf950 2023-11-28T18:39:22.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.029+0000 7fa44c816640 1 --2- 172.21.15.45:0/3311460652 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa448161790 0x7fa448161be0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fa440009d90 tx=0x7fa44001c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e732ceb5d47a6040 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:22.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.029+0000 7fa446ffd640 1 -- 172.21.15.45:0/3311460652 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4400a5950 con 0x7fa448161790 2023-11-28T18:39:22.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.029+0000 7fa446ffd640 1 -- 172.21.15.45:0/3311460652 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4400a5ab0 con 0x7fa448161790 2023-11-28T18:39:22.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.029+0000 7fa446ffd640 1 -- 172.21.15.45:0/3311460652 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4400a5e40 con 0x7fa448161790 2023-11-28T18:39:22.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.029+0000 7fa44d017640 1 -- 172.21.15.45:0/3311460652 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa448161790 msgr2=0x7fa448161be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:22.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.029+0000 7fa44d017640 1 --2- 172.21.15.45:0/3311460652 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa448161790 0x7fa448161be0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fa440009d90 tx=0x7fa44001c890 comp rx=0 tx=0).stop 2023-11-28T18:39:22.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.029+0000 7fa44d017640 1 -- 172.21.15.45:0/3311460652 shutdown_connections 2023-11-28T18:39:22.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.029+0000 7fa44d017640 1 --2- 172.21.15.45:0/3311460652 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa448161790 0x7fa448161be0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:22.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.029+0000 7fa44d017640 1 --2- 172.21.15.45:0/3311460652 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa4480d0440 0x7fa448161250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:22.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.029+0000 7fa44d017640 1 -- 172.21.15.45:0/3311460652 >> 172.21.15.45:0/3311460652 conn(0x7fa4480d2fa0 msgr2=0x7fa4480d3380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:22.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.029+0000 7fa44d017640 1 -- 172.21.15.45:0/3311460652 shutdown_connections 2023-11-28T18:39:22.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.029+0000 7fa44d017640 1 -- 172.21.15.45:0/3311460652 wait complete. 2023-11-28T18:39:22.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.029+0000 7fa44d017640 1 Processor -- start 2023-11-28T18:39:22.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.033+0000 7fa44d017640 1 -- start start 2023-11-28T18:39:22.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.033+0000 7fa44d017640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa4480cf950 0x7fa4480b5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:22.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.033+0000 7fa44d017640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4480d0440 0x7fa448152970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:22.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.033+0000 7fa44d017640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa448161790 0x7fa44815d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:22.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.033+0000 7fa44d017640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa44815f670 con 0x7fa4480d0440 2023-11-28T18:39:22.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.033+0000 7fa44d017640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4480b6100 con 0x7fa4480cf950 2023-11-28T18:39:22.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.033+0000 7fa44d017640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa448153510 con 0x7fa448161790 2023-11-28T18:39:22.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.033+0000 7fa4477fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4480d0440 0x7fa448152970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:22.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.033+0000 7fa4477fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4480d0440 0x7fa448152970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36674/0 (socket says 172.21.15.45:36674) 2023-11-28T18:39:22.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.033+0000 7fa4477fe640 1 -- 172.21.15.45:0/1339640749 learned_addr learned my addr 172.21.15.45:0/1339640749 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:22.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.033+0000 7fa447fff640 1 --2- 172.21.15.45:0/1339640749 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa4480cf950 0x7fa4480b5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:22.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.033+0000 7fa44c816640 1 --2- 172.21.15.45:0/1339640749 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa448161790 0x7fa44815d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:22.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.033+0000 7fa4477fe640 1 -- 172.21.15.45:0/1339640749 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa448161790 msgr2=0x7fa44815d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:22.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.033+0000 7fa4477fe640 1 --2- 172.21.15.45:0/1339640749 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa448161790 0x7fa44815d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:22.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.033+0000 7fa4477fe640 1 -- 172.21.15.45:0/1339640749 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa4480cf950 msgr2=0x7fa4480b5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:22.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.033+0000 7fa4477fe640 1 --2- 172.21.15.45:0/1339640749 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa4480cf950 0x7fa4480b5bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:22.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.033+0000 7fa4477fe640 1 -- 172.21.15.45:0/1339640749 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa440009a70 con 0x7fa4480d0440 2023-11-28T18:39:22.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.033+0000 7fa447fff640 1 --2- 172.21.15.45:0/1339640749 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa4480cf950 0x7fa4480b5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:39:22.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.033+0000 7fa4477fe640 1 --2- 172.21.15.45:0/1339640749 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4480d0440 0x7fa448152970 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fa43c00e930 tx=0x7fa43c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:22.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.033+0000 7fa444ff9640 1 -- 172.21.15.45:0/1339640749 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43c009690 con 0x7fa4480d0440 2023-11-28T18:39:22.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.033+0000 7fa444ff9640 1 -- 172.21.15.45:0/1339640749 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa43c00ca00 con 0x7fa4480d0440 2023-11-28T18:39:22.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.033+0000 7fa444ff9640 1 -- 172.21.15.45:0/1339640749 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43c00cd70 con 0x7fa4480d0440 2023-11-28T18:39:22.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.033+0000 7fa44d017640 1 -- 172.21.15.45:0/1339640749 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa44815ea60 con 0x7fa4480d0440 2023-11-28T18:39:22.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.033+0000 7fa44d017640 1 -- 172.21.15.45:0/1339640749 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa44815f020 con 0x7fa4480d0440 2023-11-28T18:39:22.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.033+0000 7fa44d017640 1 -- 172.21.15.45:0/1339640749 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa44815f7e0 con 0x7fa4480d0440 2023-11-28T18:39:22.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.037+0000 7fa444ff9640 1 -- 172.21.15.45:0/1339640749 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa43c013470 con 0x7fa4480d0440 2023-11-28T18:39:22.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.037+0000 7fa444ff9640 1 --2- 172.21.15.45:0/1339640749 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa434066900 0x7fa434068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:22.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.037+0000 7fa444ff9640 1 -- 172.21.15.45:0/1339640749 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fa43c084770 con 0x7fa4480d0440 2023-11-28T18:39:22.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.037+0000 7fa447fff640 1 --2- 172.21.15.45:0/1339640749 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa434066900 0x7fa434068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:22.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.037+0000 7fa447fff640 1 --2- 172.21.15.45:0/1339640749 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa434066900 0x7fa434068dc0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa438000f70 tx=0x7fa438007c40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:22.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.041+0000 7fa444ff9640 1 -- 172.21.15.45:0/1339640749 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa43c051970 con 0x7fa4480d0440 2023-11-28T18:39:22.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.229+0000 7fa44d017640 1 -- 172.21.15.45:0/1339640749 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa4480a0f70 con 0x7fa4480d0440 2023-11-28T18:39:22.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.229+0000 7fa444ff9640 1 -- 172.21.15.45:0/1339640749 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4917 (secure 0 0 0) 0x7fa43c054f90 con 0x7fa4480d0440 2023-11-28T18:39:22.232 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:39:22.232 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":24,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5188,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/270858280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":270858280},{"type":"v1","addr":"172.21.15.190:6836","nonce":270858280}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5191,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/4006352118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":4006352118},{"type":"v1","addr":"172.21.15.190:6837","nonce":4006352118}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5197,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2204012451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":2204012451},{"type":"v1","addr":"172.21.15.45:6835","nonce":2204012451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T18:38:35.406884+0000","modified":"2023-11-28T18:39:15.152124+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5571},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5571":{"gid":5571,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.45:6834/1317650999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1317650999},{"type":"v1","addr":"172.21.15.45:6834","nonce":1317650999}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-28T18:39:22.234 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 24 2023-11-28T18:39:22.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.229+0000 7fa44d017640 1 -- 172.21.15.45:0/1339640749 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa434066900 msgr2=0x7fa434068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:22.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.229+0000 7fa44d017640 1 --2- 172.21.15.45:0/1339640749 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa434066900 0x7fa434068dc0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa438000f70 tx=0x7fa438007c40 comp rx=0 tx=0).stop 2023-11-28T18:39:22.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.229+0000 7fa44d017640 1 -- 172.21.15.45:0/1339640749 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4480d0440 msgr2=0x7fa448152970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:22.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.229+0000 7fa44d017640 1 --2- 172.21.15.45:0/1339640749 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4480d0440 0x7fa448152970 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fa43c00e930 tx=0x7fa43c00edf0 comp rx=0 tx=0).stop 2023-11-28T18:39:22.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.229+0000 7fa44d017640 1 -- 172.21.15.45:0/1339640749 shutdown_connections 2023-11-28T18:39:22.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.229+0000 7fa44d017640 1 --2- 172.21.15.45:0/1339640749 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa434066900 0x7fa434068dc0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:22.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.229+0000 7fa44d017640 1 --2- 172.21.15.45:0/1339640749 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa448161790 0x7fa44815d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:22.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.229+0000 7fa44d017640 1 --2- 172.21.15.45:0/1339640749 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4480d0440 0x7fa448152970 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:22.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.229+0000 7fa44d017640 1 --2- 172.21.15.45:0/1339640749 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa4480cf950 0x7fa4480b5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:22.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.229+0000 7fa44d017640 1 -- 172.21.15.45:0/1339640749 >> 172.21.15.45:0/1339640749 conn(0x7fa4480d2fa0 msgr2=0x7fa44806b850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:22.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.229+0000 7fa44d017640 1 -- 172.21.15.45:0/1339640749 shutdown_connections 2023-11-28T18:39:22.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.229+0000 7fa44d017640 1 -- 172.21.15.45:0/1339640749 wait complete. 2023-11-28T18:39:22.254 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T18:39:22.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.393+0000 7f8930632640 1 Processor -- start 2023-11-28T18:39:22.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.393+0000 7f8930632640 1 -- start start 2023-11-28T18:39:22.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.393+0000 7f8930632640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f892806ca10 0x7f89280704a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:22.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.393+0000 7f8930632640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8928071120 con 0x7f8928144880 2023-11-28T18:39:22.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.393+0000 7f8930632640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8928071400 con 0x7f89280721c0 2023-11-28T18:39:22.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.393+0000 7f8930632640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f892815f050 con 0x7f892806ca10 2023-11-28T18:39:22.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.393+0000 7f892e3ce640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f8928144880 0x7f892806c300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:53068/0 (socket says 172.21.15.45:53068) 2023-11-28T18:39:22.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.393+0000 7f892e3ce640 1 -- 172.21.15.45:0/2266237439 learned_addr learned my addr 172.21.15.45:0/2266237439 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:39:22.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.393+0000 7f892dbcd640 1 --2- 172.21.15.45:0/2266237439 >> v2:172.21.15.45:3300/0 conn(0x7f892806ca10 0x7f89280704a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:22.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.397+0000 7f892d3cc640 1 -- 172.21.15.45:0/2266237439 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 853210403 0 0) 0x7f8928071120 con 0x7f8928144880 2023-11-28T18:39:22.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.397+0000 7f892d3cc640 1 -- 172.21.15.45:0/2266237439 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8914003530 con 0x7f8928144880 2023-11-28T18:39:22.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.397+0000 7f892dbcd640 1 -- 172.21.15.45:0/2266237439 >> v1:172.21.15.190:6789/0 conn(0x7f89280721c0 legacy=0x7f892815b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:22.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.397+0000 7f892dbcd640 1 -- 172.21.15.45:0/2266237439 >> v1:172.21.15.45:6789/0 conn(0x7f8928144880 legacy=0x7f892806c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:22.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.397+0000 7f892dbcd640 1 -- 172.21.15.45:0/2266237439 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89280716e0 con 0x7f892806ca10 2023-11-28T18:39:22.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.397+0000 7f892dbcd640 1 --2- 172.21.15.45:0/2266237439 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f892806ca10 0x7f89280704a0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f89180097c0 tx=0x7f891801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f7c0414aff1e96 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:22.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.397+0000 7f892d3cc640 1 -- 172.21.15.45:0/2266237439 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89180ab650 con 0x7f892806ca10 2023-11-28T18:39:22.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.397+0000 7f892d3cc640 1 -- 172.21.15.45:0/2266237439 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89180ab7b0 con 0x7f892806ca10 2023-11-28T18:39:22.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.397+0000 7f892d3cc640 1 -- 172.21.15.45:0/2266237439 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89180abb40 con 0x7f892806ca10 2023-11-28T18:39:22.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.397+0000 7f8930632640 1 -- 172.21.15.45:0/2266237439 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f892806ca10 msgr2=0x7f89280704a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:22.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.397+0000 7f8930632640 1 --2- 172.21.15.45:0/2266237439 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f892806ca10 0x7f89280704a0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f89180097c0 tx=0x7f891801c450 comp rx=0 tx=0).stop 2023-11-28T18:39:22.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.401+0000 7f8930632640 1 -- 172.21.15.45:0/2266237439 shutdown_connections 2023-11-28T18:39:22.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.401+0000 7f8930632640 1 --2- 172.21.15.45:0/2266237439 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f892806ca10 0x7f89280704a0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:22.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.401+0000 7f8930632640 1 -- 172.21.15.45:0/2266237439 >> 172.21.15.45:0/2266237439 conn(0x7f892806a570 msgr2=0x7f892806a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:22.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.401+0000 7f8930632640 1 -- 172.21.15.45:0/2266237439 shutdown_connections 2023-11-28T18:39:22.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.401+0000 7f8930632640 1 -- 172.21.15.45:0/2266237439 wait complete. 2023-11-28T18:39:22.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.401+0000 7f8930632640 1 Processor -- start 2023-11-28T18:39:22.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.401+0000 7f8930632640 1 -- start start 2023-11-28T18:39:22.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.401+0000 7f8930632640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f892806ca10 0x7f89280c4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:22.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.401+0000 7f8930632640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89280721c0 0x7f89281423f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:22.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.401+0000 7f8930632640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8928144880 0x7f892813f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:22.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.401+0000 7f8930632640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89280c88d0 con 0x7f89280721c0 2023-11-28T18:39:22.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.401+0000 7f8930632640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8928142930 con 0x7f8928144880 2023-11-28T18:39:22.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.401+0000 7f8930632640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f892813f920 con 0x7f892806ca10 2023-11-28T18:39:22.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.401+0000 7f892dbcd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89280721c0 0x7f89281423f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:22.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.401+0000 7f892dbcd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89280721c0 0x7f89281423f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36690/0 (socket says 172.21.15.45:36690) 2023-11-28T18:39:22.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.401+0000 7f892dbcd640 1 -- 172.21.15.45:0/1794479756 learned_addr learned my addr 172.21.15.45:0/1794479756 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:22.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.401+0000 7f892e3ce640 1 --2- 172.21.15.45:0/1794479756 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f892806ca10 0x7f89280c4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:22.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.401+0000 7f892ebcf640 1 --2- 172.21.15.45:0/1794479756 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8928144880 0x7f892813f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:22.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.401+0000 7f892dbcd640 1 -- 172.21.15.45:0/1794479756 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f892806ca10 msgr2=0x7f89280c4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:22.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.401+0000 7f892dbcd640 1 --2- 172.21.15.45:0/1794479756 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f892806ca10 0x7f89280c4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:22.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.401+0000 7f892dbcd640 1 -- 172.21.15.45:0/1794479756 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8928144880 msgr2=0x7f892813f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:22.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.401+0000 7f892dbcd640 1 --2- 172.21.15.45:0/1794479756 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8928144880 0x7f892813f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:22.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.401+0000 7f892dbcd640 1 -- 172.21.15.45:0/1794479756 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8918009420 con 0x7f89280721c0 2023-11-28T18:39:22.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.401+0000 7f892e3ce640 1 --2- 172.21.15.45:0/1794479756 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f892806ca10 0x7f89280c4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:39:22.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.401+0000 7f892ebcf640 1 --2- 172.21.15.45:0/1794479756 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8928144880 0x7f892813f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:39:22.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.401+0000 7f892dbcd640 1 --2- 172.21.15.45:0/1794479756 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89280721c0 0x7f89281423f0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f89180ad040 tx=0x7f891801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:22.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.405+0000 7f891effd640 1 -- 172.21.15.45:0/1794479756 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89180bf610 con 0x7f89280721c0 2023-11-28T18:39:22.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.405+0000 7f891effd640 1 -- 172.21.15.45:0/1794479756 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89180bf790 con 0x7f89280721c0 2023-11-28T18:39:22.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.405+0000 7f891effd640 1 -- 172.21.15.45:0/1794479756 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89180bfb40 con 0x7f89280721c0 2023-11-28T18:39:22.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.405+0000 7f8930632640 1 -- 172.21.15.45:0/1794479756 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89280c5c00 con 0x7f89280721c0 2023-11-28T18:39:22.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.405+0000 7f8930632640 1 -- 172.21.15.45:0/1794479756 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89280c5360 con 0x7f89280721c0 2023-11-28T18:39:22.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.405+0000 7f8930632640 1 -- 172.21.15.45:0/1794479756 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89280b1f20 con 0x7f89280721c0 2023-11-28T18:39:22.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.405+0000 7f891effd640 1 -- 172.21.15.45:0/1794479756 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f89180b5400 con 0x7f89280721c0 2023-11-28T18:39:22.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.405+0000 7f891effd640 1 --2- 172.21.15.45:0/1794479756 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f890c0668d0 0x7f890c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:22.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.405+0000 7f891effd640 1 -- 172.21.15.45:0/1794479756 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f891811f0c0 con 0x7f89280721c0 2023-11-28T18:39:22.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.405+0000 7f892e3ce640 1 --2- 172.21.15.45:0/1794479756 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f890c0668d0 0x7f890c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:22.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.409+0000 7f892e3ce640 1 --2- 172.21.15.45:0/1794479756 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f890c0668d0 0x7f890c068d90 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f89240011f0 tx=0x7f8924009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:22.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.409+0000 7f891effd640 1 -- 172.21.15.45:0/1794479756 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f89180ec3b0 con 0x7f89280721c0 2023-11-28T18:39:22.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.569+0000 7f8930632640 1 -- 172.21.15.45:0/1794479756 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f892815c570 con 0x7f89280721c0 2023-11-28T18:39:22.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.569+0000 7f891effd640 1 -- 172.21.15.45:0/1794479756 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16662 (secure 0 0 0) 0x7f892815c570 con 0x7f89280721c0 2023-11-28T18:39:22.573 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:39:22.574 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":35,"fsid":"d10f5cd6-1d00-4019-99b6-6fa435498a15","created":"2023-11-28T18:37:08.189030+0000","modified":"2023-11-28T18:39:02.760784+0000","last_up_change":"2023-11-28T18:37:20.196124+0000","last_in_change":"2023-11-28T18:37:10.742043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T18:37:21.293917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-28T18:38:33.254037+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-28T18:38:34.414654+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"84465384-103c-4f2c-a45a-96f5bb9c835f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6809","nonce":555237322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6811","nonce":555237322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6815","nonce":555237322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6813","nonce":555237322}]},"public_addr":"172.21.15.45:6809/555237322","cluster_addr":"172.21.15.45:6811/555237322","heartbeat_back_addr":"172.21.15.45:6815/555237322","heartbeat_front_addr":"172.21.15.45:6813/555237322","state":["exists","up"]},{"osd":1,"uuid":"7d9eed24-a58f-42c7-a787-ac06be8553fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6801","nonce":2857063763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6803","nonce":2857063763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6807","nonce":2857063763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6805","nonce":2857063763}]},"public_addr":"172.21.15.45:6801/2857063763","cluster_addr":"172.21.15.45:6803/2857063763","heartbeat_back_addr":"172.21.15.45:6807/2857063763","heartbeat_front_addr":"172.21.15.45:6805/2857063763","state":["exists","up"]},{"osd":2,"uuid":"575eeccc-4abf-45b4-9caf-f3e797859588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6817","nonce":193884539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6819","nonce":193884539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6823","nonce":193884539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6821","nonce":193884539}]},"public_addr":"172.21.15.45:6817/193884539","cluster_addr":"172.21.15.45:6819/193884539","heartbeat_back_addr":"172.21.15.45:6823/193884539","heartbeat_front_addr":"172.21.15.45:6821/193884539","state":["exists","up"]},{"osd":3,"uuid":"9b0290d6-9a52-4bc8-b2a1-7622c5dc8e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6825","nonce":78541084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6827","nonce":78541084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6831","nonce":78541084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6829","nonce":78541084}]},"public_addr":"172.21.15.45:6825/78541084","cluster_addr":"172.21.15.45:6827/78541084","heartbeat_back_addr":"172.21.15.45:6831/78541084","heartbeat_front_addr":"172.21.15.45:6829/78541084","state":["exists","up"]},{"osd":4,"uuid":"ce632829-f027-4fbf-a627-02c571aa9d53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6809","nonce":1537591987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6811","nonce":1537591987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6815","nonce":1537591987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6813","nonce":1537591987}]},"public_addr":"172.21.15.190:6809/1537591987","cluster_addr":"172.21.15.190:6811/1537591987","heartbeat_back_addr":"172.21.15.190:6815/1537591987","heartbeat_front_addr":"172.21.15.190:6813/1537591987","state":["exists","up"]},{"osd":5,"uuid":"8700b609-27be-40bd-a251-4c0ae0a29ead","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6801","nonce":3296698407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6803","nonce":3296698407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6807","nonce":3296698407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6805","nonce":3296698407}]},"public_addr":"172.21.15.190:6801/3296698407","cluster_addr":"172.21.15.190:6803/3296698407","heartbeat_back_addr":"172.21.15.190:6807/3296698407","heartbeat_front_addr":"172.21.15.190:6805/3296698407","state":["exists","up"]},{"osd":6,"uuid":"44ce4a40-e6ff-4f4d-8e8a-7341e5c91f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6817","nonce":2317686718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6819","nonce":2317686718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6823","nonce":2317686718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6821","nonce":2317686718}]},"public_addr":"172.21.15.190:6817/2317686718","cluster_addr":"172.21.15.190:6819/2317686718","heartbeat_back_addr":"172.21.15.190:6823/2317686718","heartbeat_front_addr":"172.21.15.190:6821/2317686718","state":["exists","up"]},{"osd":7,"uuid":"192238c9-1423-4b7e-ac8f-84ba32113ddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6825","nonce":2493232051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6827","nonce":2493232051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6831","nonce":2493232051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6829","nonce":2493232051}]},"public_addr":"172.21.15.190:6825/2493232051","cluster_addr":"172.21.15.190:6827/2493232051","heartbeat_back_addr":"172.21.15.190:6831/2493232051","heartbeat_front_addr":"172.21.15.190:6829/2493232051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.393552+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.385453+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.361421+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.366408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.363226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.276007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.414605+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.445885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6834/2398964901":"2023-11-29T18:39:02.760758+0000","172.21.15.45:6832/2398964901":"2023-11-29T18:39:02.760758+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T18:39:22.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.573+0000 7f8930632640 1 -- 172.21.15.45:0/1794479756 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f890c0668d0 msgr2=0x7f890c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:22.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.573+0000 7f8930632640 1 --2- 172.21.15.45:0/1794479756 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f890c0668d0 0x7f890c068d90 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f89240011f0 tx=0x7f8924009040 comp rx=0 tx=0).stop 2023-11-28T18:39:22.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.573+0000 7f8930632640 1 -- 172.21.15.45:0/1794479756 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89280721c0 msgr2=0x7f89281423f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:22.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.573+0000 7f8930632640 1 --2- 172.21.15.45:0/1794479756 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89280721c0 0x7f89281423f0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f89180ad040 tx=0x7f891801ac90 comp rx=0 tx=0).stop 2023-11-28T18:39:22.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.573+0000 7f8930632640 1 -- 172.21.15.45:0/1794479756 shutdown_connections 2023-11-28T18:39:22.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.573+0000 7f8930632640 1 --2- 172.21.15.45:0/1794479756 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f890c0668d0 0x7f890c068d90 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:22.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.573+0000 7f8930632640 1 --2- 172.21.15.45:0/1794479756 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8928144880 0x7f892813f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:22.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.573+0000 7f8930632640 1 --2- 172.21.15.45:0/1794479756 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89280721c0 0x7f89281423f0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:22.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.573+0000 7f8930632640 1 --2- 172.21.15.45:0/1794479756 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f892806ca10 0x7f89280c4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:22.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.573+0000 7f8930632640 1 -- 172.21.15.45:0/1794479756 >> 172.21.15.45:0/1794479756 conn(0x7f892806a570 msgr2=0x7f892806c300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:22.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.573+0000 7f8930632640 1 -- 172.21.15.45:0/1794479756 shutdown_connections 2023-11-28T18:39:22.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.573+0000 7f8930632640 1 -- 172.21.15.45:0/1794479756 wait complete. 2023-11-28T18:39:22.595 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-28T18:39:22.595 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T18:39:22.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.737+0000 7f8ddb79d640 1 Processor -- start 2023-11-28T18:39:22.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.737+0000 7f8ddb79d640 1 -- start start 2023-11-28T18:39:22.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.737+0000 7f8ddb79d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8dd40cfed0 0x7f8dd40d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:22.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.737+0000 7f8ddb79d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8dd40b3cb0 0x7f8dd415f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:22.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.737+0000 7f8ddb79d640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dd40d38c0 con 0x7f8dd40b35f0 2023-11-28T18:39:22.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.737+0000 7f8ddb79d640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dd40d40d0 con 0x7f8dd40cfed0 2023-11-28T18:39:22.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.737+0000 7f8ddb79d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd40cdcc0 con 0x7f8dd40b3cb0 2023-11-28T18:39:22.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.737+0000 7f8dd8d38640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8dd40cfed0 0x7f8dd40d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:22.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.737+0000 7f8dd8d38640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8dd40cfed0 0x7f8dd40d0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36692/0 (socket says 172.21.15.45:36692) 2023-11-28T18:39:22.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.737+0000 7f8dd8d38640 1 -- 172.21.15.45:0/2649182387 learned_addr learned my addr 172.21.15.45:0/2649182387 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:22.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.737+0000 7f8dd9d3a640 1 --2- 172.21.15.45:0/2649182387 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8dd40b3cb0 0x7f8dd415f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:22.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.737+0000 7f8dd8d38640 1 -- 172.21.15.45:0/2649182387 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8dd40b3cb0 msgr2=0x7f8dd415f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:22.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.737+0000 7f8dd8d38640 1 --2- 172.21.15.45:0/2649182387 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8dd40b3cb0 0x7f8dd415f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:22.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.737+0000 7f8dd8d38640 1 -- 172.21.15.45:0/2649182387 >> v1:172.21.15.190:6789/0 conn(0x7f8dd40b35f0 legacy=0x7f8dd40cf7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:22.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.737+0000 7f8dd8d38640 1 -- 172.21.15.45:0/2649182387 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dd40d3b10 con 0x7f8dd40cfed0 2023-11-28T18:39:22.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.741+0000 7f8dd8d38640 1 --2- 172.21.15.45:0/2649182387 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8dd40cfed0 0x7f8dd40d0f90 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f8dc4009870 tx=0x7f8dc401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41519712a1e56c72 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:22.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.741+0000 7f8dcbfff640 1 -- 172.21.15.45:0/2649182387 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc40a9400 con 0x7f8dd40cfed0 2023-11-28T18:39:22.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.741+0000 7f8dcbfff640 1 -- 172.21.15.45:0/2649182387 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dc40a9560 con 0x7f8dd40cfed0 2023-11-28T18:39:22.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.741+0000 7f8dcbfff640 1 -- 172.21.15.45:0/2649182387 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc40a98f0 con 0x7f8dd40cfed0 2023-11-28T18:39:22.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.741+0000 7f8ddb79d640 1 -- 172.21.15.45:0/2649182387 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8dd40cfed0 msgr2=0x7f8dd40d0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:22.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.741+0000 7f8ddb79d640 1 --2- 172.21.15.45:0/2649182387 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8dd40cfed0 0x7f8dd40d0f90 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f8dc4009870 tx=0x7f8dc401c540 comp rx=0 tx=0).stop 2023-11-28T18:39:22.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.741+0000 7f8ddb79d640 1 -- 172.21.15.45:0/2649182387 shutdown_connections 2023-11-28T18:39:22.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.741+0000 7f8ddb79d640 1 --2- 172.21.15.45:0/2649182387 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8dd40b3cb0 0x7f8dd415f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:22.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.741+0000 7f8ddb79d640 1 --2- 172.21.15.45:0/2649182387 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8dd40cfed0 0x7f8dd40d0f90 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:22.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.741+0000 7f8ddb79d640 1 -- 172.21.15.45:0/2649182387 >> 172.21.15.45:0/2649182387 conn(0x7f8dd409c4f0 msgr2=0x7f8dd40d31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:22.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.741+0000 7f8ddb79d640 1 -- 172.21.15.45:0/2649182387 shutdown_connections 2023-11-28T18:39:22.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.741+0000 7f8ddb79d640 1 -- 172.21.15.45:0/2649182387 wait complete. 2023-11-28T18:39:22.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.745+0000 7f8ddb79d640 1 Processor -- start 2023-11-28T18:39:22.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.745+0000 7f8ddb79d640 1 -- start start 2023-11-28T18:39:22.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.745+0000 7f8ddb79d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8dd40b35f0 0x7f8dd415d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:22.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.745+0000 7f8ddb79d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8dd40b3cb0 0x7f8dd40ca280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:22.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.745+0000 7f8ddb79d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8dd40cfed0 0x7f8dd40b7f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:22.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.745+0000 7f8ddb79d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd40b6e60 con 0x7f8dd40b3cb0 2023-11-28T18:39:22.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.745+0000 7f8ddb79d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd40b7140 con 0x7f8dd40cfed0 2023-11-28T18:39:22.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.745+0000 7f8ddb79d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd40b7420 con 0x7f8dd40b35f0 2023-11-28T18:39:22.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.745+0000 7f8dd8d38640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8dd40b3cb0 0x7f8dd40ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:22.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.745+0000 7f8dd8d38640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8dd40b3cb0 0x7f8dd40ca280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36700/0 (socket says 172.21.15.45:36700) 2023-11-28T18:39:22.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.745+0000 7f8dd8d38640 1 -- 172.21.15.45:0/1703609419 learned_addr learned my addr 172.21.15.45:0/1703609419 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:22.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.745+0000 7f8dd9539640 1 --2- 172.21.15.45:0/1703609419 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8dd40b35f0 0x7f8dd415d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:22.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.745+0000 7f8dd9d3a640 1 --2- 172.21.15.45:0/1703609419 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8dd40cfed0 0x7f8dd40b7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:22.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.745+0000 7f8dd8d38640 1 -- 172.21.15.45:0/1703609419 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8dd40b35f0 msgr2=0x7f8dd415d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:22.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.745+0000 7f8dd8d38640 1 --2- 172.21.15.45:0/1703609419 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8dd40b35f0 0x7f8dd415d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:22.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.745+0000 7f8dd8d38640 1 -- 172.21.15.45:0/1703609419 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8dd40cfed0 msgr2=0x7f8dd40b7f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:22.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.745+0000 7f8dd8d38640 1 --2- 172.21.15.45:0/1703609419 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8dd40cfed0 0x7f8dd40b7f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:22.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.745+0000 7f8dd8d38640 1 -- 172.21.15.45:0/1703609419 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dc40094d0 con 0x7f8dd40b3cb0 2023-11-28T18:39:22.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.745+0000 7f8dd8d38640 1 --2- 172.21.15.45:0/1703609419 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8dd40b3cb0 0x7f8dd40ca280 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f8dc401abf0 tx=0x7f8dc40192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:22.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.745+0000 7f8dc9ffb640 1 -- 172.21.15.45:0/1703609419 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc40a9400 con 0x7f8dd40b3cb0 2023-11-28T18:39:22.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.745+0000 7f8dc9ffb640 1 -- 172.21.15.45:0/1703609419 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dc40a9e90 con 0x7f8dd40b3cb0 2023-11-28T18:39:22.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.745+0000 7f8dc9ffb640 1 -- 172.21.15.45:0/1703609419 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc40b1a00 con 0x7f8dd40b3cb0 2023-11-28T18:39:22.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.745+0000 7f8ddb79d640 1 -- 172.21.15.45:0/1703609419 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dd40b7700 con 0x7f8dd40b3cb0 2023-11-28T18:39:22.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.745+0000 7f8ddb79d640 1 -- 172.21.15.45:0/1703609419 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dd415dc50 con 0x7f8dd40b3cb0 2023-11-28T18:39:22.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.749+0000 7f8ddb79d640 1 -- 172.21.15.45:0/1703609419 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dd415de40 con 0x7f8dd40b3cb0 2023-11-28T18:39:22.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.749+0000 7f8dc9ffb640 1 -- 172.21.15.45:0/1703609419 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f8dc40b1b60 con 0x7f8dd40b3cb0 2023-11-28T18:39:22.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.749+0000 7f8dc9ffb640 1 --2- 172.21.15.45:0/1703609419 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f8db80668d0 0x7f8db8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:22.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.749+0000 7f8dc9ffb640 1 -- 172.21.15.45:0/1703609419 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f8dc411e6f0 con 0x7f8dd40b3cb0 2023-11-28T18:39:22.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.749+0000 7f8dd9539640 1 --2- 172.21.15.45:0/1703609419 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f8db80668d0 0x7f8db8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:22.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.749+0000 7f8dd9539640 1 --2- 172.21.15.45:0/1703609419 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f8db80668d0 0x7f8db8068d90 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8dd0007fd0 tx=0x7f8dd0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:22.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.753+0000 7f8dc9ffb640 1 -- 172.21.15.45:0/1703609419 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8dd415de40 con 0x7f8dd40b3cb0 2023-11-28T18:39:22.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.949+0000 7f8ddb79d640 1 -- 172.21.15.45:0/1703609419 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8dd415de40 con 0x7f8dd40b3cb0 2023-11-28T18:39:22.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.949+0000 7f8dc9ffb640 1 -- 172.21.15.45:0/1703609419 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4917 (secure 0 0 0) 0x7f8dd415de40 con 0x7f8dd40b3cb0 2023-11-28T18:39:22.952 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:39:22.952 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":24,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5188,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/270858280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":270858280},{"type":"v1","addr":"172.21.15.190:6836","nonce":270858280}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5191,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/4006352118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":4006352118},{"type":"v1","addr":"172.21.15.190:6837","nonce":4006352118}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5197,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2204012451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":2204012451},{"type":"v1","addr":"172.21.15.45:6835","nonce":2204012451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T18:38:35.406884+0000","modified":"2023-11-28T18:39:15.152124+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5571},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5571":{"gid":5571,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.45:6834/1317650999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1317650999},{"type":"v1","addr":"172.21.15.45:6834","nonce":1317650999}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-28T18:39:22.953 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 24 2023-11-28T18:39:22.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.949+0000 7f8ddb79d640 1 -- 172.21.15.45:0/1703609419 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f8db80668d0 msgr2=0x7f8db8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:22.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.949+0000 7f8ddb79d640 1 --2- 172.21.15.45:0/1703609419 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f8db80668d0 0x7f8db8068d90 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8dd0007fd0 tx=0x7f8dd0009040 comp rx=0 tx=0).stop 2023-11-28T18:39:22.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.949+0000 7f8ddb79d640 1 -- 172.21.15.45:0/1703609419 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8dd40b3cb0 msgr2=0x7f8dd40ca280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:22.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.949+0000 7f8ddb79d640 1 --2- 172.21.15.45:0/1703609419 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8dd40b3cb0 0x7f8dd40ca280 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f8dc401abf0 tx=0x7f8dc40192e0 comp rx=0 tx=0).stop 2023-11-28T18:39:22.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.949+0000 7f8ddb79d640 1 -- 172.21.15.45:0/1703609419 shutdown_connections 2023-11-28T18:39:22.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.949+0000 7f8ddb79d640 1 --2- 172.21.15.45:0/1703609419 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f8db80668d0 0x7f8db8068d90 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:22.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.949+0000 7f8ddb79d640 1 --2- 172.21.15.45:0/1703609419 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8dd40cfed0 0x7f8dd40b7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:22.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.949+0000 7f8ddb79d640 1 --2- 172.21.15.45:0/1703609419 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8dd40b3cb0 0x7f8dd40ca280 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:22.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.949+0000 7f8ddb79d640 1 --2- 172.21.15.45:0/1703609419 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8dd40b35f0 0x7f8dd415d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:22.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.949+0000 7f8ddb79d640 1 -- 172.21.15.45:0/1703609419 >> 172.21.15.45:0/1703609419 conn(0x7f8dd409c4f0 msgr2=0x7f8dd415b110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:22.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.949+0000 7f8ddb79d640 1 -- 172.21.15.45:0/1703609419 shutdown_connections 2023-11-28T18:39:22.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:22.949+0000 7f8ddb79d640 1 -- 172.21.15.45:0/1703609419 wait complete. 2023-11-28T18:39:22.974 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T18:39:23.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.117+0000 7f8fe932a640 1 Processor -- start 2023-11-28T18:39:23.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.117+0000 7f8fe932a640 1 -- start start 2023-11-28T18:39:23.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.117+0000 7f8fe932a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8fe40d2be0 0x7f8fe40cde30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:23.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.117+0000 7f8fe932a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8fe40ce370 0x7f8fe40b61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:23.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.117+0000 7f8fe932a640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fe40b2a30 con 0x7f8fe415d240 2023-11-28T18:39:23.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.117+0000 7f8fe932a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fe40d3020 con 0x7f8fe40d2be0 2023-11-28T18:39:23.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.117+0000 7f8fe932a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe40d18b0 con 0x7f8fe40ce370 2023-11-28T18:39:23.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.117+0000 7f8fe27fc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8fe40d2be0 0x7f8fe40cde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:23.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.117+0000 7f8fe27fc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8fe40d2be0 0x7f8fe40cde30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36712/0 (socket says 172.21.15.45:36712) 2023-11-28T18:39:23.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.117+0000 7f8fe27fc640 1 -- 172.21.15.45:0/2973488468 learned_addr learned my addr 172.21.15.45:0/2973488468 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:23.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.117+0000 7f8fe37fe640 1 --2- 172.21.15.45:0/2973488468 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8fe40ce370 0x7f8fe40b61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:23.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.117+0000 7f8fe27fc640 1 -- 172.21.15.45:0/2973488468 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8fe40ce370 msgr2=0x7f8fe40b61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:23.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.117+0000 7f8fe27fc640 1 --2- 172.21.15.45:0/2973488468 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8fe40ce370 0x7f8fe40b61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:23.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.117+0000 7f8fe27fc640 1 -- 172.21.15.45:0/2973488468 >> v1:172.21.15.190:6789/0 conn(0x7f8fe415d240 legacy=0x7f8fe40d11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:23.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.117+0000 7f8fe27fc640 1 -- 172.21.15.45:0/2973488468 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fe40d1b40 con 0x7f8fe40d2be0 2023-11-28T18:39:23.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.121+0000 7f8fe27fc640 1 --2- 172.21.15.45:0/2973488468 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fe40d2be0 0x7f8fe40cde30 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f8fd8009870 tx=0x7f8fd801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45578c27d80807a4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:23.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.121+0000 7f8fe1ffb640 1 -- 172.21.15.45:0/2973488468 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd80a89b0 con 0x7f8fe40d2be0 2023-11-28T18:39:23.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.121+0000 7f8fe1ffb640 1 -- 172.21.15.45:0/2973488468 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fd80a8b10 con 0x7f8fe40d2be0 2023-11-28T18:39:23.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.121+0000 7f8fe1ffb640 1 -- 172.21.15.45:0/2973488468 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd80a8ea0 con 0x7f8fe40d2be0 2023-11-28T18:39:23.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.121+0000 7f8fe932a640 1 -- 172.21.15.45:0/2973488468 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fe40d2be0 msgr2=0x7f8fe40cde30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:23.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.121+0000 7f8fe932a640 1 --2- 172.21.15.45:0/2973488468 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fe40d2be0 0x7f8fe40cde30 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f8fd8009870 tx=0x7f8fd801ecf0 comp rx=0 tx=0).stop 2023-11-28T18:39:23.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.121+0000 7f8fe932a640 1 -- 172.21.15.45:0/2973488468 shutdown_connections 2023-11-28T18:39:23.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.121+0000 7f8fe932a640 1 --2- 172.21.15.45:0/2973488468 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8fe40ce370 0x7f8fe40b61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:23.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.121+0000 7f8fe932a640 1 --2- 172.21.15.45:0/2973488468 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fe40d2be0 0x7f8fe40cde30 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:23.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.121+0000 7f8fe932a640 1 -- 172.21.15.45:0/2973488468 >> 172.21.15.45:0/2973488468 conn(0x7f8fe40722a0 msgr2=0x7f8fe40cfbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:23.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.121+0000 7f8fe932a640 1 -- 172.21.15.45:0/2973488468 shutdown_connections 2023-11-28T18:39:23.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.121+0000 7f8fe932a640 1 -- 172.21.15.45:0/2973488468 wait complete. 2023-11-28T18:39:23.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.121+0000 7f8fe932a640 1 Processor -- start 2023-11-28T18:39:23.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.125+0000 7f8fe932a640 1 -- start start 2023-11-28T18:39:23.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.125+0000 7f8fe932a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8fe40ce370 0x7f8fe41e5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:23.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.125+0000 7f8fe932a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8fe40d2be0 0x7f8fe40cc080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:23.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.125+0000 7f8fe932a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fe415d240 0x7f8fe415c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:23.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.125+0000 7f8fe932a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe41f3e80 con 0x7f8fe415d240 2023-11-28T18:39:23.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.125+0000 7f8fe932a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe41e6130 con 0x7f8fe40ce370 2023-11-28T18:39:23.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.125+0000 7f8fe932a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe41f3300 con 0x7f8fe40d2be0 2023-11-28T18:39:23.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.125+0000 7f8fe37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fe415d240 0x7f8fe415c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:23.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.125+0000 7f8fe37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fe415d240 0x7f8fe415c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36726/0 (socket says 172.21.15.45:36726) 2023-11-28T18:39:23.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.125+0000 7f8fe37fe640 1 -- 172.21.15.45:0/848567657 learned_addr learned my addr 172.21.15.45:0/848567657 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:23.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.125+0000 7f8fe27fc640 1 --2- 172.21.15.45:0/848567657 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8fe40d2be0 0x7f8fe40cc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:23.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.125+0000 7f8fe2ffd640 1 --2- 172.21.15.45:0/848567657 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8fe40ce370 0x7f8fe41e5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:23.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.125+0000 7f8fe37fe640 1 -- 172.21.15.45:0/848567657 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8fe40d2be0 msgr2=0x7f8fe40cc080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:23.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.125+0000 7f8fe37fe640 1 --2- 172.21.15.45:0/848567657 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8fe40d2be0 0x7f8fe40cc080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:23.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.125+0000 7f8fe37fe640 1 -- 172.21.15.45:0/848567657 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8fe40ce370 msgr2=0x7f8fe41e5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:23.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.125+0000 7f8fe37fe640 1 --2- 172.21.15.45:0/848567657 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8fe40ce370 0x7f8fe41e5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:23.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.125+0000 7f8fe37fe640 1 -- 172.21.15.45:0/848567657 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fd80094d0 con 0x7f8fe415d240 2023-11-28T18:39:23.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.125+0000 7f8fe2ffd640 1 --2- 172.21.15.45:0/848567657 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8fe40ce370 0x7f8fe41e5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:39:23.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.125+0000 7f8fe37fe640 1 --2- 172.21.15.45:0/848567657 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fe415d240 0x7f8fe415c1d0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc007e40 tx=0x7f8fdc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:23.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.125+0000 7f8fcb7fe640 1 -- 172.21.15.45:0/848567657 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc014620 con 0x7f8fe415d240 2023-11-28T18:39:23.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.125+0000 7f8fcb7fe640 1 -- 172.21.15.45:0/848567657 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fdc00ee90 con 0x7f8fe415d240 2023-11-28T18:39:23.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.125+0000 7f8fcb7fe640 1 -- 172.21.15.45:0/848567657 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc0149e0 con 0x7f8fe415d240 2023-11-28T18:39:23.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.125+0000 7f8fe932a640 1 -- 172.21.15.45:0/848567657 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fe41f35e0 con 0x7f8fe415d240 2023-11-28T18:39:23.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.125+0000 7f8fe932a640 1 -- 172.21.15.45:0/848567657 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fe41f3ba0 con 0x7f8fe415d240 2023-11-28T18:39:23.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.125+0000 7f8fe932a640 1 -- 172.21.15.45:0/848567657 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fe415ea40 con 0x7f8fe415d240 2023-11-28T18:39:23.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.129+0000 7f8fcb7fe640 1 -- 172.21.15.45:0/848567657 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f8fdc014b40 con 0x7f8fe415d240 2023-11-28T18:39:23.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.129+0000 7f8fcb7fe640 1 --2- 172.21.15.45:0/848567657 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f8fd00668d0 0x7f8fd0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:23.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.129+0000 7f8fcb7fe640 1 -- 172.21.15.45:0/848567657 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f8fdc084d30 con 0x7f8fe415d240 2023-11-28T18:39:23.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.129+0000 7f8fe2ffd640 1 --2- 172.21.15.45:0/848567657 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f8fd00668d0 0x7f8fd0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:23.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.129+0000 7f8fe2ffd640 1 --2- 172.21.15.45:0/848567657 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f8fd00668d0 0x7f8fd0068d90 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8fd40098b0 tx=0x7f8fd4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:23.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.133+0000 7f8fcb7fe640 1 -- 172.21.15.45:0/848567657 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8fdc051fa0 con 0x7f8fe415d240 2023-11-28T18:39:23.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.329+0000 7f8fe932a640 1 -- 172.21.15.45:0/848567657 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8fe4069480 con 0x7f8fe415d240 2023-11-28T18:39:23.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.329+0000 7f8fcb7fe640 1 -- 172.21.15.45:0/848567657 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4917 (secure 0 0 0) 0x7f8fdc0555c0 con 0x7f8fe415d240 2023-11-28T18:39:23.332 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:39:23.333 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":24,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5188,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/270858280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":270858280},{"type":"v1","addr":"172.21.15.190:6836","nonce":270858280}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5191,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/4006352118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":4006352118},{"type":"v1","addr":"172.21.15.190:6837","nonce":4006352118}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5197,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2204012451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":2204012451},{"type":"v1","addr":"172.21.15.45:6835","nonce":2204012451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T18:38:35.406884+0000","modified":"2023-11-28T18:39:15.152124+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5571},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5571":{"gid":5571,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.45:6834/1317650999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1317650999},{"type":"v1","addr":"172.21.15.45:6834","nonce":1317650999}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-28T18:39:23.333 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 24 2023-11-28T18:39:23.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.329+0000 7f8fe932a640 1 -- 172.21.15.45:0/848567657 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f8fd00668d0 msgr2=0x7f8fd0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:23.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.329+0000 7f8fe932a640 1 --2- 172.21.15.45:0/848567657 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f8fd00668d0 0x7f8fd0068d90 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8fd40098b0 tx=0x7f8fd4008040 comp rx=0 tx=0).stop 2023-11-28T18:39:23.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.329+0000 7f8fe932a640 1 -- 172.21.15.45:0/848567657 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fe415d240 msgr2=0x7f8fe415c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:23.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.329+0000 7f8fe932a640 1 --2- 172.21.15.45:0/848567657 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fe415d240 0x7f8fe415c1d0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc007e40 tx=0x7f8fdc00e4b0 comp rx=0 tx=0).stop 2023-11-28T18:39:23.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.333+0000 7f8fe932a640 1 -- 172.21.15.45:0/848567657 shutdown_connections 2023-11-28T18:39:23.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.333+0000 7f8fe932a640 1 --2- 172.21.15.45:0/848567657 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f8fd00668d0 0x7f8fd0068d90 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:23.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.333+0000 7f8fe932a640 1 --2- 172.21.15.45:0/848567657 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fe415d240 0x7f8fe415c1d0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:23.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.333+0000 7f8fe932a640 1 --2- 172.21.15.45:0/848567657 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8fe40d2be0 0x7f8fe40cc080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:23.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.333+0000 7f8fe932a640 1 --2- 172.21.15.45:0/848567657 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8fe40ce370 0x7f8fe41e5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:23.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.333+0000 7f8fe932a640 1 -- 172.21.15.45:0/848567657 >> 172.21.15.45:0/848567657 conn(0x7f8fe40722a0 msgr2=0x7f8fe40b6570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:23.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.333+0000 7f8fe932a640 1 -- 172.21.15.45:0/848567657 shutdown_connections 2023-11-28T18:39:23.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.333+0000 7f8fe932a640 1 -- 172.21.15.45:0/848567657 wait complete. 2023-11-28T18:39:23.354 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T18:39:23.401 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:39:23.409 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:39:23.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.493+0000 7f8cf6d6f640 1 Processor -- start 2023-11-28T18:39:23.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.497+0000 7f8cf6d6f640 1 -- start start 2023-11-28T18:39:23.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.497+0000 7f8cf6d6f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8cf00cf250 0x7f8cf00b2700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:23.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.497+0000 7f8cf6d6f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8cf00b2eb0 0x7f8cf00b32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:23.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.497+0000 7f8cf6d6f640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f8cf00cc7e0 0x7f8cf00ccc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:23.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.497+0000 7f8cf6d6f640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cf00cd1b0 con 0x7f8cf00cf250 2023-11-28T18:39:23.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.497+0000 7f8cf6d6f640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cf00b3830 con 0x7f8cf00cc7e0 2023-11-28T18:39:23.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.497+0000 7f8cf6d6f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf0161c80 con 0x7f8cf00b2eb0 2023-11-28T18:39:23.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.497+0000 7f8cf5d6d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8cf00cf250 0x7f8cf00b2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:23.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.497+0000 7f8cf5d6d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8cf00cf250 0x7f8cf00b2700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36736/0 (socket says 172.21.15.45:36736) 2023-11-28T18:39:23.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.497+0000 7f8cf5d6d640 1 -- 172.21.15.45:0/4189033415 learned_addr learned my addr 172.21.15.45:0/4189033415 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:23.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.497+0000 7f8cf556c640 1 --2- 172.21.15.45:0/4189033415 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8cf00b2eb0 0x7f8cf00b32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:23.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.497+0000 7f8cf656e640 1 --2- 172.21.15.45:0/4189033415 >> v2:172.21.15.190:3300/0 conn(0x7f8cf00cc7e0 0x7f8cf00ccc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:23.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.497+0000 7f8cf5d6d640 1 -- 172.21.15.45:0/4189033415 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8cf00b2eb0 msgr2=0x7f8cf00b32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:23.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.497+0000 7f8cf5d6d640 1 --2- 172.21.15.45:0/4189033415 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8cf00b2eb0 0x7f8cf00b32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:23.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.497+0000 7f8cf5d6d640 1 -- 172.21.15.45:0/4189033415 >> v2:172.21.15.190:3300/0 conn(0x7f8cf00cc7e0 msgr2=0x7f8cf00ccc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:23.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.497+0000 7f8cf5d6d640 1 --2- 172.21.15.45:0/4189033415 >> v2:172.21.15.190:3300/0 conn(0x7f8cf00cc7e0 0x7f8cf00ccc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:23.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.497+0000 7f8cf5d6d640 1 -- 172.21.15.45:0/4189033415 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cf00b2c40 con 0x7f8cf00cf250 2023-11-28T18:39:23.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.501+0000 7f8cf5d6d640 1 --2- 172.21.15.45:0/4189033415 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cf00cf250 0x7f8cf00b2700 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f8cf006ff70 tx=0x7f8cec01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8aae74f75c7e9ce server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:23.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.501+0000 7f8cf4d6b640 1 -- 172.21.15.45:0/4189033415 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cec0ac410 con 0x7f8cf00cf250 2023-11-28T18:39:23.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.501+0000 7f8cf4d6b640 1 -- 172.21.15.45:0/4189033415 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cec0ac570 con 0x7f8cf00cf250 2023-11-28T18:39:23.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.501+0000 7f8cf4d6b640 1 -- 172.21.15.45:0/4189033415 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cec0ac900 con 0x7f8cf00cf250 2023-11-28T18:39:23.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.501+0000 7f8cf6d6f640 1 -- 172.21.15.45:0/4189033415 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cf00cf250 msgr2=0x7f8cf00b2700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:23.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.501+0000 7f8cf6d6f640 1 --2- 172.21.15.45:0/4189033415 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cf00cf250 0x7f8cf00b2700 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f8cf006ff70 tx=0x7f8cec01c500 comp rx=0 tx=0).stop 2023-11-28T18:39:23.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.501+0000 7f8cf6d6f640 1 -- 172.21.15.45:0/4189033415 shutdown_connections 2023-11-28T18:39:23.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.501+0000 7f8cf6d6f640 1 --2- 172.21.15.45:0/4189033415 >> v2:172.21.15.190:3300/0 conn(0x7f8cf00cc7e0 0x7f8cf00ccc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:23.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.501+0000 7f8cf6d6f640 1 --2- 172.21.15.45:0/4189033415 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8cf00b2eb0 0x7f8cf00b32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:23.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.501+0000 7f8cf6d6f640 1 --2- 172.21.15.45:0/4189033415 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cf00cf250 0x7f8cf00b2700 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:23.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.501+0000 7f8cf6d6f640 1 -- 172.21.15.45:0/4189033415 >> 172.21.15.45:0/4189033415 conn(0x7f8cf00b0960 msgr2=0x7f8cf00b0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:23.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.501+0000 7f8cf6d6f640 1 -- 172.21.15.45:0/4189033415 shutdown_connections 2023-11-28T18:39:23.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.501+0000 7f8cf6d6f640 1 -- 172.21.15.45:0/4189033415 wait complete. 2023-11-28T18:39:23.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.501+0000 7f8cf6d6f640 1 Processor -- start 2023-11-28T18:39:23.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.501+0000 7f8cf6d6f640 1 -- start start 2023-11-28T18:39:23.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.505+0000 7f8cf6d6f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8cf00b2eb0 0x7f8cf0158fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:23.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.505+0000 7f8cf6d6f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cf00cc7e0 0x7f8cf00cb330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:23.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.505+0000 7f8cf6d6f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8cf00cf250 0x7f8cf00cb870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:23.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.505+0000 7f8cf6d6f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf0159b90 con 0x7f8cf00cc7e0 2023-11-28T18:39:23.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.505+0000 7f8cf6d6f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf015e220 con 0x7f8cf00b2eb0 2023-11-28T18:39:23.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.505+0000 7f8cf6d6f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf015d980 con 0x7f8cf00cf250 2023-11-28T18:39:23.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.505+0000 7f8cf556c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cf00cc7e0 0x7f8cf00cb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:23.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.505+0000 7f8cf556c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cf00cc7e0 0x7f8cf00cb330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36744/0 (socket says 172.21.15.45:36744) 2023-11-28T18:39:23.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.505+0000 7f8cf556c640 1 -- 172.21.15.45:0/4064661505 learned_addr learned my addr 172.21.15.45:0/4064661505 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:23.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.505+0000 7f8cf5d6d640 1 --2- 172.21.15.45:0/4064661505 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8cf00b2eb0 0x7f8cf0158fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:23.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.505+0000 7f8cf656e640 1 --2- 172.21.15.45:0/4064661505 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8cf00cf250 0x7f8cf00cb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:23.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.505+0000 7f8cf556c640 1 -- 172.21.15.45:0/4064661505 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8cf00cf250 msgr2=0x7f8cf00cb870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:23.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.505+0000 7f8cf556c640 1 --2- 172.21.15.45:0/4064661505 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8cf00cf250 0x7f8cf00cb870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:23.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.505+0000 7f8cf556c640 1 -- 172.21.15.45:0/4064661505 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8cf00b2eb0 msgr2=0x7f8cf0158fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:23.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.505+0000 7f8cf556c640 1 --2- 172.21.15.45:0/4064661505 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8cf00b2eb0 0x7f8cf0158fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:23.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.505+0000 7f8cf556c640 1 -- 172.21.15.45:0/4064661505 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cec0094d0 con 0x7f8cf00cc7e0 2023-11-28T18:39:23.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.505+0000 7f8cf556c640 1 --2- 172.21.15.45:0/4064661505 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cf00cc7e0 0x7f8cf00cb330 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f8ce000d5f0 tx=0x7f8ce000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:23.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.505+0000 7f8ce67fc640 1 -- 172.21.15.45:0/4064661505 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce00125f0 con 0x7f8cf00cc7e0 2023-11-28T18:39:23.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.505+0000 7f8ce67fc640 1 -- 172.21.15.45:0/4064661505 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ce0012750 con 0x7f8cf00cc7e0 2023-11-28T18:39:23.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.505+0000 7f8ce67fc640 1 -- 172.21.15.45:0/4064661505 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce0012ae0 con 0x7f8cf00cc7e0 2023-11-28T18:39:23.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.505+0000 7f8cf6d6f640 1 -- 172.21.15.45:0/4064661505 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cf015dc60 con 0x7f8cf00cc7e0 2023-11-28T18:39:23.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.505+0000 7f8cf6d6f640 1 -- 172.21.15.45:0/4064661505 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cf00abe70 con 0x7f8cf00cc7e0 2023-11-28T18:39:23.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.505+0000 7f8cf6d6f640 1 -- 172.21.15.45:0/4064661505 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cf00ac030 con 0x7f8cf00cc7e0 2023-11-28T18:39:23.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.509+0000 7f8ce67fc640 1 -- 172.21.15.45:0/4064661505 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f8ce0012c40 con 0x7f8cf00cc7e0 2023-11-28T18:39:23.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.509+0000 7f8ce67fc640 1 --2- 172.21.15.45:0/4064661505 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f8cd40668d0 0x7f8cd4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:23.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.509+0000 7f8ce67fc640 1 -- 172.21.15.45:0/4064661505 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f8ce0084840 con 0x7f8cf00cc7e0 2023-11-28T18:39:23.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.509+0000 7f8cf5d6d640 1 --2- 172.21.15.45:0/4064661505 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f8cd40668d0 0x7f8cd4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:23.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.509+0000 7f8cf5d6d640 1 --2- 172.21.15.45:0/4064661505 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f8cd40668d0 0x7f8cd4068d90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8cec0ae000 tx=0x7f8cec008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:23.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.513+0000 7f8ce67fc640 1 -- 172.21.15.45:0/4064661505 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8ce0051ac0 con 0x7f8cf00cc7e0 2023-11-28T18:39:23.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.669+0000 7f8cf6d6f640 1 -- 172.21.15.45:0/4064661505 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8cf00aff10 con 0x7f8cf00cc7e0 2023-11-28T18:39:23.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.673+0000 7f8ce67fc640 1 -- 172.21.15.45:0/4064661505 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16662 (secure 0 0 0) 0x7f8ce0007380 con 0x7f8cf00cc7e0 2023-11-28T18:39:23.675 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:39:23.675 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":35,"fsid":"d10f5cd6-1d00-4019-99b6-6fa435498a15","created":"2023-11-28T18:37:08.189030+0000","modified":"2023-11-28T18:39:02.760784+0000","last_up_change":"2023-11-28T18:37:20.196124+0000","last_in_change":"2023-11-28T18:37:10.742043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T18:37:21.293917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-28T18:38:33.254037+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-28T18:38:34.414654+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"84465384-103c-4f2c-a45a-96f5bb9c835f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6809","nonce":555237322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6811","nonce":555237322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6815","nonce":555237322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6813","nonce":555237322}]},"public_addr":"172.21.15.45:6809/555237322","cluster_addr":"172.21.15.45:6811/555237322","heartbeat_back_addr":"172.21.15.45:6815/555237322","heartbeat_front_addr":"172.21.15.45:6813/555237322","state":["exists","up"]},{"osd":1,"uuid":"7d9eed24-a58f-42c7-a787-ac06be8553fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6801","nonce":2857063763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6803","nonce":2857063763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6807","nonce":2857063763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6805","nonce":2857063763}]},"public_addr":"172.21.15.45:6801/2857063763","cluster_addr":"172.21.15.45:6803/2857063763","heartbeat_back_addr":"172.21.15.45:6807/2857063763","heartbeat_front_addr":"172.21.15.45:6805/2857063763","state":["exists","up"]},{"osd":2,"uuid":"575eeccc-4abf-45b4-9caf-f3e797859588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6817","nonce":193884539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6819","nonce":193884539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6823","nonce":193884539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6821","nonce":193884539}]},"public_addr":"172.21.15.45:6817/193884539","cluster_addr":"172.21.15.45:6819/193884539","heartbeat_back_addr":"172.21.15.45:6823/193884539","heartbeat_front_addr":"172.21.15.45:6821/193884539","state":["exists","up"]},{"osd":3,"uuid":"9b0290d6-9a52-4bc8-b2a1-7622c5dc8e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6825","nonce":78541084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6827","nonce":78541084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6831","nonce":78541084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6829","nonce":78541084}]},"public_addr":"172.21.15.45:6825/78541084","cluster_addr":"172.21.15.45:6827/78541084","heartbeat_back_addr":"172.21.15.45:6831/78541084","heartbeat_front_addr":"172.21.15.45:6829/78541084","state":["exists","up"]},{"osd":4,"uuid":"ce632829-f027-4fbf-a627-02c571aa9d53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6809","nonce":1537591987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6811","nonce":1537591987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6815","nonce":1537591987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6813","nonce":1537591987}]},"public_addr":"172.21.15.190:6809/1537591987","cluster_addr":"172.21.15.190:6811/1537591987","heartbeat_back_addr":"172.21.15.190:6815/1537591987","heartbeat_front_addr":"172.21.15.190:6813/1537591987","state":["exists","up"]},{"osd":5,"uuid":"8700b609-27be-40bd-a251-4c0ae0a29ead","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6801","nonce":3296698407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6803","nonce":3296698407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6807","nonce":3296698407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6805","nonce":3296698407}]},"public_addr":"172.21.15.190:6801/3296698407","cluster_addr":"172.21.15.190:6803/3296698407","heartbeat_back_addr":"172.21.15.190:6807/3296698407","heartbeat_front_addr":"172.21.15.190:6805/3296698407","state":["exists","up"]},{"osd":6,"uuid":"44ce4a40-e6ff-4f4d-8e8a-7341e5c91f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6817","nonce":2317686718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6819","nonce":2317686718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6823","nonce":2317686718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6821","nonce":2317686718}]},"public_addr":"172.21.15.190:6817/2317686718","cluster_addr":"172.21.15.190:6819/2317686718","heartbeat_back_addr":"172.21.15.190:6823/2317686718","heartbeat_front_addr":"172.21.15.190:6821/2317686718","state":["exists","up"]},{"osd":7,"uuid":"192238c9-1423-4b7e-ac8f-84ba32113ddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6825","nonce":2493232051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6827","nonce":2493232051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6831","nonce":2493232051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6829","nonce":2493232051}]},"public_addr":"172.21.15.190:6825/2493232051","cluster_addr":"172.21.15.190:6827/2493232051","heartbeat_back_addr":"172.21.15.190:6831/2493232051","heartbeat_front_addr":"172.21.15.190:6829/2493232051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.393552+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.385453+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.361421+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.366408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.363226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.276007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.414605+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.445885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6834/2398964901":"2023-11-29T18:39:02.760758+0000","172.21.15.45:6832/2398964901":"2023-11-29T18:39:02.760758+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T18:39:23.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.673+0000 7f8cf6d6f640 1 -- 172.21.15.45:0/4064661505 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f8cd40668d0 msgr2=0x7f8cd4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:23.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.673+0000 7f8cf6d6f640 1 --2- 172.21.15.45:0/4064661505 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f8cd40668d0 0x7f8cd4068d90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8cec0ae000 tx=0x7f8cec008040 comp rx=0 tx=0).stop 2023-11-28T18:39:23.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.673+0000 7f8cf6d6f640 1 -- 172.21.15.45:0/4064661505 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cf00cc7e0 msgr2=0x7f8cf00cb330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:23.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.673+0000 7f8cf6d6f640 1 --2- 172.21.15.45:0/4064661505 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cf00cc7e0 0x7f8cf00cb330 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f8ce000d5f0 tx=0x7f8ce000dab0 comp rx=0 tx=0).stop 2023-11-28T18:39:23.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.673+0000 7f8cf6d6f640 1 -- 172.21.15.45:0/4064661505 shutdown_connections 2023-11-28T18:39:23.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.673+0000 7f8cf6d6f640 1 --2- 172.21.15.45:0/4064661505 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f8cd40668d0 0x7f8cd4068d90 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:23.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.673+0000 7f8cf6d6f640 1 --2- 172.21.15.45:0/4064661505 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8cf00cf250 0x7f8cf00cb870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:23.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.673+0000 7f8cf6d6f640 1 --2- 172.21.15.45:0/4064661505 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cf00cc7e0 0x7f8cf00cb330 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:23.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.673+0000 7f8cf6d6f640 1 --2- 172.21.15.45:0/4064661505 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8cf00b2eb0 0x7f8cf0158fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:23.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.673+0000 7f8cf6d6f640 1 -- 172.21.15.45:0/4064661505 >> 172.21.15.45:0/4064661505 conn(0x7f8cf00b0960 msgr2=0x7f8cf00b0130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:23.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.673+0000 7f8cf6d6f640 1 -- 172.21.15.45:0/4064661505 shutdown_connections 2023-11-28T18:39:23.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.673+0000 7f8cf6d6f640 1 -- 172.21.15.45:0/4064661505 wait complete. 2023-11-28T18:39:23.697 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-28T18:39:23.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.837+0000 7f7ebf596640 1 Processor -- start 2023-11-28T18:39:23.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.837+0000 7f7ebf596640 1 -- start start 2023-11-28T18:39:23.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.841+0000 7f7ebf596640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7eb806ca10 0x7f7eb815a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:23.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.841+0000 7f7ebf596640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7eb815b3e0 con 0x7f7eb813cf70 2023-11-28T18:39:23.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.841+0000 7f7ebf596640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7eb813f760 con 0x7f7eb815abb0 2023-11-28T18:39:23.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.841+0000 7f7ebf596640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb813d350 con 0x7f7eb806ca10 2023-11-28T18:39:23.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.841+0000 7f7ebd332640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f7eb813cf70 0x7f7eb806c300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:53078/0 (socket says 172.21.15.45:53078) 2023-11-28T18:39:23.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.841+0000 7f7ebd332640 1 -- 172.21.15.45:0/1759546922 learned_addr learned my addr 172.21.15.45:0/1759546922 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:39:23.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.841+0000 7f7ebcb31640 1 --2- 172.21.15.45:0/1759546922 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7eb806ca10 0x7f7eb815a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:23.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.841+0000 7f7eaffff640 1 -- 172.21.15.45:0/1759546922 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2410775882 0 0) 0x7f7eb815b3e0 con 0x7f7eb813cf70 2023-11-28T18:39:23.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.841+0000 7f7eaffff640 1 -- 172.21.15.45:0/1759546922 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ea4003530 con 0x7f7eb813cf70 2023-11-28T18:39:23.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.841+0000 7f7eaffff640 1 -- 172.21.15.45:0/1759546922 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1152293537 0 0) 0x7f7ea4003530 con 0x7f7eb813cf70 2023-11-28T18:39:23.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.841+0000 7f7eaffff640 1 -- 172.21.15.45:0/1759546922 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7eb806ca10 msgr2=0x7f7eb815a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:23.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.841+0000 7f7eaffff640 1 --2- 172.21.15.45:0/1759546922 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7eb806ca10 0x7f7eb815a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:23.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.841+0000 7f7eaffff640 1 -- 172.21.15.45:0/1759546922 >> v1:172.21.15.190:6789/0 conn(0x7f7eb815abb0 legacy=0x7f7eb80cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:23.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.841+0000 7f7eaffff640 1 -- 172.21.15.45:0/1759546922 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb813fa40 con 0x7f7eb813cf70 2023-11-28T18:39:23.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.841+0000 7f7eaffff640 1 -- 172.21.15.45:0/1759546922 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4084481567 0 0) 0x7f7eb4001680 con 0x7f7eb813cf70 2023-11-28T18:39:23.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.841+0000 7f7eaffff640 1 -- 172.21.15.45:0/1759546922 >> v1:172.21.15.45:6789/0 conn(0x7f7eb813cf70 legacy=0x7f7eb806c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:23.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.841+0000 7f7eaffff640 1 --2- 172.21.15.45:0/1759546922 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7ea40039b0 0x7f7ea4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:23.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.841+0000 7f7eaffff640 1 --2- 172.21.15.45:0/1759546922 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ea40047d0 0x7f7ea4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:23.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.841+0000 7f7eaffff640 1 --2- 172.21.15.45:0/1759546922 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7eb806ca10 0x7f7ea40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:23.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.841+0000 7f7eaffff640 1 -- 172.21.15.45:0/1759546922 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea400ba90 con 0x7f7ea40047d0 2023-11-28T18:39:23.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.841+0000 7f7eaffff640 1 -- 172.21.15.45:0/1759546922 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea400bc00 con 0x7f7ea40039b0 2023-11-28T18:39:23.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.841+0000 7f7eaffff640 1 -- 172.21.15.45:0/1759546922 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea400bdc0 con 0x7f7eb806ca10 2023-11-28T18:39:23.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.841+0000 7f7ebcb31640 1 --2- 172.21.15.45:0/1759546922 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ea40047d0 0x7f7ea4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:23.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.841+0000 7f7ebd332640 1 --2- 172.21.15.45:0/1759546922 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7ea40039b0 0x7f7ea4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:23.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.841+0000 7f7ebdb33640 1 --2- 172.21.15.45:0/1759546922 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7eb806ca10 0x7f7ea40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:23.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.841+0000 7f7ebcb31640 1 -- 172.21.15.45:0/1759546922 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7eb806ca10 msgr2=0x7f7ea40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:23.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.841+0000 7f7ebcb31640 1 --2- 172.21.15.45:0/1759546922 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7eb806ca10 0x7f7ea40051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:23.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.841+0000 7f7ebcb31640 1 -- 172.21.15.45:0/1759546922 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7ea40039b0 msgr2=0x7f7ea4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:23.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.841+0000 7f7ebcb31640 1 --2- 172.21.15.45:0/1759546922 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7ea40039b0 0x7f7ea4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:23.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.841+0000 7f7ebcb31640 1 -- 172.21.15.45:0/1759546922 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ea4003530 con 0x7f7ea40047d0 2023-11-28T18:39:23.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.841+0000 7f7ebd332640 1 --2- 172.21.15.45:0/1759546922 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7ea40039b0 0x7f7ea4003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:39:23.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.845+0000 7f7ebcb31640 1 --2- 172.21.15.45:0/1759546922 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ea40047d0 0x7f7ea4004c50 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f7ea8009ae0 tx=0x7f7ea801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=919683fd1b0eff03 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:23.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.845+0000 7f7eaffff640 1 -- 172.21.15.45:0/1759546922 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea80a6430 con 0x7f7ea40047d0 2023-11-28T18:39:23.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.845+0000 7f7eaffff640 1 -- 172.21.15.45:0/1759546922 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ea80a6590 con 0x7f7ea40047d0 2023-11-28T18:39:23.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.845+0000 7f7eaffff640 1 -- 172.21.15.45:0/1759546922 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea80a6940 con 0x7f7ea40047d0 2023-11-28T18:39:23.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.845+0000 7f7ebf596640 1 -- 172.21.15.45:0/1759546922 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ea40047d0 msgr2=0x7f7ea4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:23.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.845+0000 7f7ebf596640 1 --2- 172.21.15.45:0/1759546922 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ea40047d0 0x7f7ea4004c50 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f7ea8009ae0 tx=0x7f7ea801ca50 comp rx=0 tx=0).stop 2023-11-28T18:39:23.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.845+0000 7f7ebdb33640 1 -- 172.21.15.45:0/1759546922 reap_dead start 2023-11-28T18:39:23.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.845+0000 7f7ebf596640 1 -- 172.21.15.45:0/1759546922 shutdown_connections 2023-11-28T18:39:23.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.845+0000 7f7ebf596640 1 -- 172.21.15.45:0/1759546922 >> 172.21.15.45:0/1759546922 conn(0x7f7eb806a570 msgr2=0x7f7eb806a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:23.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.845+0000 7f7ebf596640 1 -- 172.21.15.45:0/1759546922 shutdown_connections 2023-11-28T18:39:23.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.845+0000 7f7ebf596640 1 -- 172.21.15.45:0/1759546922 wait complete. 2023-11-28T18:39:23.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.849+0000 7f7ebf596640 1 Processor -- start 2023-11-28T18:39:23.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.849+0000 7f7ebf596640 1 -- start start 2023-11-28T18:39:23.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.849+0000 7f7ebf596640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7ea40047d0 0x7f7eb8138370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:23.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.849+0000 7f7ebf596640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7eb815cf30 0x7f7eb813d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:23.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.849+0000 7f7ebf596640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7eb813eaf0 0x7f7eb8152c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:23.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.849+0000 7f7ebf596640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb8152600 con 0x7f7eb813eaf0 2023-11-28T18:39:23.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.849+0000 7f7ebf596640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb8160a10 con 0x7f7ea40047d0 2023-11-28T18:39:23.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.849+0000 7f7ebf596640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb813e660 con 0x7f7eb815cf30 2023-11-28T18:39:23.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.849+0000 7f7ebdb33640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7eb813eaf0 0x7f7eb8152c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:23.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.849+0000 7f7ebdb33640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7eb813eaf0 0x7f7eb8152c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36766/0 (socket says 172.21.15.45:36766) 2023-11-28T18:39:23.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.849+0000 7f7ebdb33640 1 -- 172.21.15.45:0/804453082 learned_addr learned my addr 172.21.15.45:0/804453082 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:23.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.849+0000 7f7ebd332640 1 --2- 172.21.15.45:0/804453082 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7ea40047d0 0x7f7eb8138370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:23.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.849+0000 7f7ebcb31640 1 --2- 172.21.15.45:0/804453082 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7eb815cf30 0x7f7eb813d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:23.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.849+0000 7f7ebdb33640 1 -- 172.21.15.45:0/804453082 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7eb815cf30 msgr2=0x7f7eb813d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:23.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.849+0000 7f7ebdb33640 1 --2- 172.21.15.45:0/804453082 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7eb815cf30 0x7f7eb813d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:23.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.849+0000 7f7ebdb33640 1 -- 172.21.15.45:0/804453082 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7ea40047d0 msgr2=0x7f7eb8138370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:23.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.849+0000 7f7ebdb33640 1 --2- 172.21.15.45:0/804453082 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7ea40047d0 0x7f7eb8138370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:23.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.849+0000 7f7ebdb33640 1 -- 172.21.15.45:0/804453082 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb813da50 con 0x7f7eb813eaf0 2023-11-28T18:39:23.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.849+0000 7f7ebdb33640 1 --2- 172.21.15.45:0/804453082 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7eb813eaf0 0x7f7eb8152c20 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f7eb000e700 tx=0x7f7eb000ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:23.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.849+0000 7f7eadffb640 1 -- 172.21.15.45:0/804453082 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb0003980 con 0x7f7eb813eaf0 2023-11-28T18:39:23.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.849+0000 7f7eadffb640 1 -- 172.21.15.45:0/804453082 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eb0003ae0 con 0x7f7eb813eaf0 2023-11-28T18:39:23.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.849+0000 7f7ebf596640 1 -- 172.21.15.45:0/804453082 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7eb813dd30 con 0x7f7eb813eaf0 2023-11-28T18:39:23.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.849+0000 7f7eadffb640 1 -- 172.21.15.45:0/804453082 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb0003e90 con 0x7f7eb813eaf0 2023-11-28T18:39:23.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.849+0000 7f7ebf596640 1 -- 172.21.15.45:0/804453082 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7eb813e2f0 con 0x7f7eb813eaf0 2023-11-28T18:39:23.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.849+0000 7f7ebf596640 1 -- 172.21.15.45:0/804453082 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7eb813e4b0 con 0x7f7eb813eaf0 2023-11-28T18:39:23.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.853+0000 7f7eadffb640 1 -- 172.21.15.45:0/804453082 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f7eb00050d0 con 0x7f7eb813eaf0 2023-11-28T18:39:23.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.853+0000 7f7eadffb640 1 --2- 172.21.15.45:0/804453082 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f7e9c0668d0 0x7f7e9c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:23.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.853+0000 7f7eadffb640 1 -- 172.21.15.45:0/804453082 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f7eb00840e0 con 0x7f7eb813eaf0 2023-11-28T18:39:23.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.853+0000 7f7ebd332640 1 --2- 172.21.15.45:0/804453082 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f7e9c0668d0 0x7f7e9c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:23.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.853+0000 7f7ebd332640 1 --2- 172.21.15.45:0/804453082 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f7e9c0668d0 0x7f7e9c068d90 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7eb4000c10 tx=0x7f7eb4007040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:23.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:23.857+0000 7f7eadffb640 1 -- 172.21.15.45:0/804453082 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7eb00512d0 con 0x7f7eb813eaf0 2023-11-28T18:39:24.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:24.053+0000 7f7ebf596640 1 -- 172.21.15.45:0/804453082 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f7eb8069480 con 0x7f7eb813eaf0 2023-11-28T18:39:24.058 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-11-28T18:39:24.053+0000 7f5668eb3640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-28T18:39:24.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:24.057+0000 7f7eadffb640 1 -- 172.21.15.45:0/804453082 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v25) v1 ==== 161+0+0 (secure 0 0 0) 0x7f7eb00548f0 con 0x7f7eb813eaf0 2023-11-28T18:39:24.061 INFO:teuthology.orchestra.run.smithi045.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-28T18:39:24.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:24.061+0000 7f7ebf596640 1 -- 172.21.15.45:0/804453082 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f7e9c0668d0 msgr2=0x7f7e9c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:24.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:24.061+0000 7f7ebf596640 1 --2- 172.21.15.45:0/804453082 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f7e9c0668d0 0x7f7e9c068d90 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7eb4000c10 tx=0x7f7eb4007040 comp rx=0 tx=0).stop 2023-11-28T18:39:24.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:24.061+0000 7f7ebf596640 1 -- 172.21.15.45:0/804453082 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7eb813eaf0 msgr2=0x7f7eb8152c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:24.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:24.061+0000 7f7ebf596640 1 --2- 172.21.15.45:0/804453082 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7eb813eaf0 0x7f7eb8152c20 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f7eb000e700 tx=0x7f7eb000ebc0 comp rx=0 tx=0).stop 2023-11-28T18:39:24.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:24.061+0000 7f7ebf596640 1 -- 172.21.15.45:0/804453082 shutdown_connections 2023-11-28T18:39:24.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:24.061+0000 7f7ebf596640 1 --2- 172.21.15.45:0/804453082 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f7e9c0668d0 0x7f7e9c068d90 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:24.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:24.061+0000 7f7ebf596640 1 --2- 172.21.15.45:0/804453082 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7eb813eaf0 0x7f7eb8152c20 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:24.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:24.061+0000 7f7ebf596640 1 --2- 172.21.15.45:0/804453082 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7eb815cf30 0x7f7eb813d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:24.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:24.061+0000 7f7ebf596640 1 --2- 172.21.15.45:0/804453082 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7ea40047d0 0x7f7eb8138370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:24.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:24.061+0000 7f7ebf596640 1 -- 172.21.15.45:0/804453082 >> 172.21.15.45:0/804453082 conn(0x7f7eb806a570 msgr2=0x7f7eb815b590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:24.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:24.061+0000 7f7ebf596640 1 -- 172.21.15.45:0/804453082 shutdown_connections 2023-11-28T18:39:24.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:24.061+0000 7f7ebf596640 1 -- 172.21.15.45:0/804453082 wait complete. 2023-11-28T18:39:24.073 INFO:tasks.ceph.mds.a.smithi045.stderr: -4081> 2023-11-28T18:39:11.313+0000 7f70c1bb9640 -1 log_channel(cluster) log [ERR] : bad backtrace on directory inode 0x100000001f7 2023-11-28T18:39:24.074 INFO:tasks.ceph.mds.a.smithi045.stderr: -3653> 2023-11-28T18:39:11.317+0000 7f70c1bb9640 -1 log_channel(cluster) log [ERR] : bad backtrace on directory inode 0x10000000001 2023-11-28T18:39:24.078 INFO:tasks.ceph.mds.a.smithi045.stderr: -1776> 2023-11-28T18:39:17.849+0000 7f70c1bb9640 -1 log_channel(cluster) log [ERR] : bad backtrace on directory inode 0x100000001fa 2023-11-28T18:39:24.084 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-28T18:39:24.124 INFO:tasks.ceph.mds.a.smithi045.stdout:starting mds.a at 2023-11-28T18:39:24.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:24.229+0000 7fe1b14e3640 1 Processor -- start 2023-11-28T18:39:24.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:24.229+0000 7fe1b14e3640 1 -- start start 2023-11-28T18:39:24.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:24.233+0000 7fe1b14e3640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1ac1469a0 0x7fe1ac06cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:24.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:24.233+0000 7fe1b14e3640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe1ac15fde0 0x7fe1ac0b44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:24.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:24.233+0000 7fe1b14e3640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1ac0b4a10 con 0x7fe1ac0b4070 2023-11-28T18:39:24.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:24.233+0000 7fe1b14e3640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1ac15e940 con 0x7fe1ac15fde0 2023-11-28T18:39:24.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:24.233+0000 7fe1b14e3640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac15dd30 con 0x7fe1ac1469a0 2023-11-28T18:39:24.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:24.233+0000 7fe1ab7fe640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe1ac15fde0 0x7fe1ac0b44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:24.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:24.233+0000 7fe1aaffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1ac1469a0 0x7fe1ac06cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:24.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:24.233+0000 7fe1ab7fe640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe1ac15fde0 0x7fe1ac0b44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.45:45264/0 (socket says 172.21.15.45:45264) 2023-11-28T18:39:24.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:24.233+0000 7fe1ab7fe640 1 -- 172.21.15.45:0/2817859487 learned_addr learned my addr 172.21.15.45:0/2817859487 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:24.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:24.233+0000 7fe1ab7fe640 1 -- 172.21.15.45:0/2817859487 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1ac1469a0 msgr2=0x7fe1ac06cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:24.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:24.233+0000 7fe1ab7fe640 1 --2- 172.21.15.45:0/2817859487 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1ac1469a0 0x7fe1ac06cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:24.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:24.233+0000 7fe1ab7fe640 1 -- 172.21.15.45:0/2817859487 >> v1:172.21.15.190:6789/0 conn(0x7fe1ac0b4070 legacy=0x7fe1ac06e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:24.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:24.233+0000 7fe1ab7fe640 1 -- 172.21.15.45:0/2817859487 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1ac15e010 con 0x7fe1ac15fde0 2023-11-28T18:39:24.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:24.237+0000 7fe1ab7fe640 1 --2- 172.21.15.45:0/2817859487 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe1ac15fde0 0x7fe1ac0b44d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe1a4009e50 tx=0x7fe1a401ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b0d3a29f698a851 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:24.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:24.237+0000 7fe1aa7fc640 1 -- 172.21.15.45:0/2817859487 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a40a56e0 con 0x7fe1ac15fde0 2023-11-28T18:39:24.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:24.237+0000 7fe1aa7fc640 1 -- 172.21.15.45:0/2817859487 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a40a5840 con 0x7fe1ac15fde0 2023-11-28T18:39:24.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:24.237+0000 7fe1aa7fc640 1 -- 172.21.15.45:0/2817859487 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a40a5bd0 con 0x7fe1ac15fde0 2023-11-28T18:39:24.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:24.237+0000 7fe1b14e3640 1 -- 172.21.15.45:0/2817859487 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe1ac15fde0 msgr2=0x7fe1ac0b44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:24.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:24.237+0000 7fe1b14e3640 1 --2- 172.21.15.45:0/2817859487 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe1ac15fde0 0x7fe1ac0b44d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe1a4009e50 tx=0x7fe1a401ca10 comp rx=0 tx=0).stop 2023-11-28T18:39:24.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:24.237+0000 7fe1b14e3640 1 -- 172.21.15.45:0/2817859487 shutdown_connections 2023-11-28T18:39:24.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:24.237+0000 7fe1b14e3640 1 --2- 172.21.15.45:0/2817859487 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe1ac15fde0 0x7fe1ac0b44d0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:24.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:24.237+0000 7fe1b14e3640 1 --2- 172.21.15.45:0/2817859487 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1ac1469a0 0x7fe1ac06cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:24.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:24.237+0000 7fe1b14e3640 1 -- 172.21.15.45:0/2817859487 >> 172.21.15.45:0/2817859487 conn(0x7fe1ac070b80 msgr2=0x7fe1ac066360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:24.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:24.237+0000 7fe1b14e3640 1 -- 172.21.15.45:0/2817859487 shutdown_connections 2023-11-28T18:39:24.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:24.237+0000 7fe1b14e3640 1 -- 172.21.15.45:0/2817859487 wait complete. 2023-11-28T18:39:24.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:24.237+0000 7fe1b14e3640 1 Processor -- start 2023-11-28T18:39:24.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:24.237+0000 7fe1b14e3640 1 -- start start 2023-11-28T18:39:24.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:24.241+0000 7fe1b14e3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1ac0b4070 0x7fe1ac1666e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:24.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:24.241+0000 7fe1b14e3640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe1ac1469a0 0x7fe1ac163cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:24.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:24.241+0000 7fe1b14e3640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1ac15fde0 0x7fe1ac1641f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:24.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:24.241+0000 7fe1b14e3640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac162170 con 0x7fe1ac0b4070 2023-11-28T18:39:24.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:24.241+0000 7fe1b14e3640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac1f5a80 con 0x7fe1ac1469a0 2023-11-28T18:39:24.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:24.241+0000 7fe1b14e3640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac164890 con 0x7fe1ac15fde0 2023-11-28T18:39:24.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:24.241+0000 7fe1aaffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1ac0b4070 0x7fe1ac1666e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:24.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:24.241+0000 7fe1aaffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1ac0b4070 0x7fe1ac1666e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36776/0 (socket says 172.21.15.45:36776) 2023-11-28T18:39:24.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:24.241+0000 7fe1aaffd640 1 -- 172.21.15.45:0/40614985 learned_addr learned my addr 172.21.15.45:0/40614985 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:24.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:24.241+0000 7fe1ab7fe640 1 --2- 172.21.15.45:0/40614985 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1ac15fde0 0x7fe1ac1641f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:24.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:24.241+0000 7fe1a3fff640 1 --2- 172.21.15.45:0/40614985 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe1ac1469a0 0x7fe1ac163cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:24.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:24.241+0000 7fe1aaffd640 1 -- 172.21.15.45:0/40614985 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1ac15fde0 msgr2=0x7fe1ac1641f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:24.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:24.241+0000 7fe1aaffd640 1 --2- 172.21.15.45:0/40614985 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1ac15fde0 0x7fe1ac1641f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:24.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:24.241+0000 7fe1aaffd640 1 -- 172.21.15.45:0/40614985 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe1ac1469a0 msgr2=0x7fe1ac163cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:24.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:24.241+0000 7fe1aaffd640 1 --2- 172.21.15.45:0/40614985 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe1ac1469a0 0x7fe1ac163cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:24.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:24.241+0000 7fe1aaffd640 1 -- 172.21.15.45:0/40614985 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a4009b30 con 0x7fe1ac0b4070 2023-11-28T18:39:24.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:24.241+0000 7fe1aaffd640 1 --2- 172.21.15.45:0/40614985 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1ac0b4070 0x7fe1ac1666e0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fe19c00e930 tx=0x7fe19c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:24.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:24.241+0000 7fe1a37fe640 1 -- 172.21.15.45:0/40614985 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe19c009690 con 0x7fe1ac0b4070 2023-11-28T18:39:24.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:24.241+0000 7fe1a37fe640 1 -- 172.21.15.45:0/40614985 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe19c00ca00 con 0x7fe1ac0b4070 2023-11-28T18:39:24.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:24.241+0000 7fe1a37fe640 1 -- 172.21.15.45:0/40614985 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe19c00cd70 con 0x7fe1ac0b4070 2023-11-28T18:39:24.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:24.241+0000 7fe1b14e3640 1 -- 172.21.15.45:0/40614985 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1ac164b70 con 0x7fe1ac0b4070 2023-11-28T18:39:24.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:24.241+0000 7fe1b14e3640 1 -- 172.21.15.45:0/40614985 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1ac164e50 con 0x7fe1ac0b4070 2023-11-28T18:39:24.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:24.241+0000 7fe1b14e3640 1 -- 172.21.15.45:0/40614985 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1ac069410 con 0x7fe1ac0b4070 2023-11-28T18:39:24.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:24.241+0000 7fe1a37fe640 1 -- 172.21.15.45:0/40614985 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe19c013470 con 0x7fe1ac0b4070 2023-11-28T18:39:24.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:24.245+0000 7fe1a37fe640 1 --2- 172.21.15.45:0/40614985 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe18c0668d0 0x7fe18c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:24.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:24.245+0000 7fe1a37fe640 1 -- 172.21.15.45:0/40614985 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5881+0+0 (secure 0 0 0) 0x7fe19c0846a0 con 0x7fe1ac0b4070 2023-11-28T18:39:24.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:24.245+0000 7fe1a3fff640 1 --2- 172.21.15.45:0/40614985 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe18c0668d0 0x7fe18c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:24.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:24.245+0000 7fe1a3fff640 1 --2- 172.21.15.45:0/40614985 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe18c0668d0 0x7fe18c068d90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac1602c0 tx=0x7fe194009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:24.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:24.249+0000 7fe1a37fe640 1 -- 172.21.15.45:0/40614985 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe19c051990 con 0x7fe1ac0b4070 2023-11-28T18:39:24.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:24.437+0000 7fe1b14e3640 1 -- 172.21.15.45:0/40614985 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe1ac1435c0 con 0x7fe1ac0b4070 2023-11-28T18:39:25.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.061+0000 7fe1a37fe640 1 -- 172.21.15.45:0/40614985 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v26) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe19c054fb0 con 0x7fe1ac0b4070 2023-11-28T18:39:25.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.061+0000 7fe1b14e3640 1 -- 172.21.15.45:0/40614985 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe18c0668d0 msgr2=0x7fe18c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:25.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.061+0000 7fe1b14e3640 1 --2- 172.21.15.45:0/40614985 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe18c0668d0 0x7fe18c068d90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac1602c0 tx=0x7fe194009040 comp rx=0 tx=0).stop 2023-11-28T18:39:25.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.061+0000 7fe1b14e3640 1 -- 172.21.15.45:0/40614985 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1ac0b4070 msgr2=0x7fe1ac1666e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:25.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.061+0000 7fe1b14e3640 1 --2- 172.21.15.45:0/40614985 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1ac0b4070 0x7fe1ac1666e0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fe19c00e930 tx=0x7fe19c00edf0 comp rx=0 tx=0).stop 2023-11-28T18:39:25.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.061+0000 7fe1b14e3640 1 -- 172.21.15.45:0/40614985 shutdown_connections 2023-11-28T18:39:25.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.061+0000 7fe1b14e3640 1 --2- 172.21.15.45:0/40614985 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe18c0668d0 0x7fe18c068d90 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:25.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.061+0000 7fe1b14e3640 1 --2- 172.21.15.45:0/40614985 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1ac15fde0 0x7fe1ac1641f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:25.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.061+0000 7fe1b14e3640 1 --2- 172.21.15.45:0/40614985 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe1ac1469a0 0x7fe1ac163cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:25.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.061+0000 7fe1b14e3640 1 --2- 172.21.15.45:0/40614985 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1ac0b4070 0x7fe1ac1666e0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:25.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.061+0000 7fe1b14e3640 1 -- 172.21.15.45:0/40614985 >> 172.21.15.45:0/40614985 conn(0x7fe1ac070b80 msgr2=0x7fe1ac06e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:25.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.061+0000 7fe1b14e3640 1 -- 172.21.15.45:0/40614985 shutdown_connections 2023-11-28T18:39:25.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.061+0000 7fe1b14e3640 1 -- 172.21.15.45:0/40614985 wait complete. 2023-11-28T18:39:25.091 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-28T18:39:25.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.289+0000 7f10c1ae3640 1 Processor -- start 2023-11-28T18:39:25.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.293+0000 7f10c1ae3640 1 -- start start 2023-11-28T18:39:25.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.293+0000 7f10c1ae3640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10bc0cded0 0x7f10bc0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:25.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.293+0000 7f10c1ae3640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10bc0d3b80 con 0x7f10bc1609d0 2023-11-28T18:39:25.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.293+0000 7f10c1ae3640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10bc0b64a0 con 0x7f10bc0cda40 2023-11-28T18:39:25.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.293+0000 7f10c1ae3640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10bc0d32e0 con 0x7f10bc0cded0 2023-11-28T18:39:25.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.293+0000 7f10bb7fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f10bc1609d0 0x7f10bc0d2840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:53086/0 (socket says 172.21.15.45:53086) 2023-11-28T18:39:25.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.293+0000 7f10bb7fe640 1 -- 172.21.15.45:0/3364085449 learned_addr learned my addr 172.21.15.45:0/3364085449 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:39:25.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.293+0000 7f10bbfff640 1 --2- 172.21.15.45:0/3364085449 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10bc0cded0 0x7f10bc0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:25.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.293+0000 7f10ba7fc640 1 -- 172.21.15.45:0/3364085449 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 72827449 0 0) 0x7f10bc0d3b80 con 0x7f10bc1609d0 2023-11-28T18:39:25.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.293+0000 7f10ba7fc640 1 -- 172.21.15.45:0/3364085449 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10a4003530 con 0x7f10bc1609d0 2023-11-28T18:39:25.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.293+0000 7f10ba7fc640 1 -- 172.21.15.45:0/3364085449 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2015508890 0 0) 0x7f10a4003530 con 0x7f10bc1609d0 2023-11-28T18:39:25.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.293+0000 7f10ba7fc640 1 -- 172.21.15.45:0/3364085449 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10bc0cded0 msgr2=0x7f10bc0b7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:25.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.293+0000 7f10ba7fc640 1 --2- 172.21.15.45:0/3364085449 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10bc0cded0 0x7f10bc0b7040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:25.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.293+0000 7f10ba7fc640 1 -- 172.21.15.45:0/3364085449 >> v1:172.21.15.190:6789/0 conn(0x7f10bc0cda40 legacy=0x7f10bc0b6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:25.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.293+0000 7f10ba7fc640 1 -- 172.21.15.45:0/3364085449 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10bc0d35c0 con 0x7f10bc1609d0 2023-11-28T18:39:25.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.293+0000 7f10ba7fc640 1 -- 172.21.15.45:0/3364085449 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4084481567 0 0) 0x7f10ac001680 con 0x7f10bc1609d0 2023-11-28T18:39:25.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.293+0000 7f10ba7fc640 1 -- 172.21.15.45:0/3364085449 >> v1:172.21.15.45:6789/0 conn(0x7f10bc1609d0 legacy=0x7f10bc0d2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:25.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.293+0000 7f10ba7fc640 1 --2- 172.21.15.45:0/3364085449 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10bc0cded0 0x7f10a40039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:25.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.293+0000 7f10ba7fc640 1 --2- 172.21.15.45:0/3364085449 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f10a4003ef0 0x7f10a40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:25.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.293+0000 7f10ba7fc640 1 --2- 172.21.15.45:0/3364085449 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10a4004d10 0x7f10a4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:25.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.293+0000 7f10ba7fc640 1 -- 172.21.15.45:0/3364085449 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10bc0d32e0 con 0x7f10a4004d10 2023-11-28T18:39:25.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.293+0000 7f10ba7fc640 1 -- 172.21.15.45:0/3364085449 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a400b9f0 con 0x7f10a4003ef0 2023-11-28T18:39:25.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.293+0000 7f10ba7fc640 1 -- 172.21.15.45:0/3364085449 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10a400bbb0 con 0x7f10bc0cded0 2023-11-28T18:39:25.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.293+0000 7f10bb7fe640 1 --2- 172.21.15.45:0/3364085449 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10bc0cded0 0x7f10a40039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:25.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.293+0000 7f10bbfff640 1 --2- 172.21.15.45:0/3364085449 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10a4004d10 0x7f10a4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:25.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.293+0000 7f10baffd640 1 --2- 172.21.15.45:0/3364085449 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f10a4003ef0 0x7f10a40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:25.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.293+0000 7f10bbfff640 1 -- 172.21.15.45:0/3364085449 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10bc0cded0 msgr2=0x7f10a40039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:25.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.293+0000 7f10bbfff640 1 --2- 172.21.15.45:0/3364085449 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10bc0cded0 0x7f10a40039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:25.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.293+0000 7f10bbfff640 1 -- 172.21.15.45:0/3364085449 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f10a4003ef0 msgr2=0x7f10a40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:25.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.293+0000 7f10bbfff640 1 --2- 172.21.15.45:0/3364085449 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f10a4003ef0 0x7f10a40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:25.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.293+0000 7f10bbfff640 1 -- 172.21.15.45:0/3364085449 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10a4003530 con 0x7f10a4004d10 2023-11-28T18:39:25.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.297+0000 7f10bbfff640 1 --2- 172.21.15.45:0/3364085449 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10a4004d10 0x7f10a4005190 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f10b4009fc0 tx=0x7f10b401cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a47936a39228615 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:25.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.297+0000 7f10ba7fc640 1 -- 172.21.15.45:0/3364085449 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b40a5b60 con 0x7f10a4004d10 2023-11-28T18:39:25.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.297+0000 7f10ba7fc640 1 -- 172.21.15.45:0/3364085449 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10b400f040 con 0x7f10a4004d10 2023-11-28T18:39:25.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.297+0000 7f10ba7fc640 1 -- 172.21.15.45:0/3364085449 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b40ad440 con 0x7f10a4004d10 2023-11-28T18:39:25.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.297+0000 7f10c1ae3640 1 -- 172.21.15.45:0/3364085449 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10a4004d10 msgr2=0x7f10a4005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:25.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.297+0000 7f10c1ae3640 1 --2- 172.21.15.45:0/3364085449 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10a4004d10 0x7f10a4005190 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f10b4009fc0 tx=0x7f10b401cc60 comp rx=0 tx=0).stop 2023-11-28T18:39:25.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.297+0000 7f10bbfff640 1 -- 172.21.15.45:0/3364085449 reap_dead start 2023-11-28T18:39:25.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.297+0000 7f10c1ae3640 1 -- 172.21.15.45:0/3364085449 shutdown_connections 2023-11-28T18:39:25.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.297+0000 7f10c1ae3640 1 -- 172.21.15.45:0/3364085449 >> 172.21.15.45:0/3364085449 conn(0x7f10bc0720a0 msgr2=0x7f10bc0724b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:25.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.297+0000 7f10c1ae3640 1 -- 172.21.15.45:0/3364085449 shutdown_connections 2023-11-28T18:39:25.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.297+0000 7f10c1ae3640 1 -- 172.21.15.45:0/3364085449 wait complete. 2023-11-28T18:39:25.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.301+0000 7f10c1ae3640 1 Processor -- start 2023-11-28T18:39:25.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.301+0000 7f10c1ae3640 1 -- start start 2023-11-28T18:39:25.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.301+0000 7f10c1ae3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10a4004d10 0x7f10bc1486c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:25.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.301+0000 7f10c1ae3640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f10bc1558f0 0x7f10bc155d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:25.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.301+0000 7f10c1ae3640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10bc0ca560 0x7f10bc0ca9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:25.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.301+0000 7f10c1ae3640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10bc14fa20 con 0x7f10a4004d10 2023-11-28T18:39:25.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.301+0000 7f10c1ae3640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10bc1562b0 con 0x7f10bc1558f0 2023-11-28T18:39:25.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.301+0000 7f10c1ae3640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10bc0cb330 con 0x7f10bc0ca560 2023-11-28T18:39:25.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.301+0000 7f10bb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10a4004d10 0x7f10bc1486c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:25.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.301+0000 7f10bb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10a4004d10 0x7f10bc1486c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36784/0 (socket says 172.21.15.45:36784) 2023-11-28T18:39:25.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.301+0000 7f10bb7fe640 1 -- 172.21.15.45:0/2682611210 learned_addr learned my addr 172.21.15.45:0/2682611210 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:25.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.301+0000 7f10bbfff640 1 --2- 172.21.15.45:0/2682611210 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10bc0ca560 0x7f10bc0ca9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:25.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.301+0000 7f10baffd640 1 --2- 172.21.15.45:0/2682611210 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f10bc1558f0 0x7f10bc155d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:25.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.301+0000 7f10bb7fe640 1 -- 172.21.15.45:0/2682611210 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10bc0ca560 msgr2=0x7f10bc0ca9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:25.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.301+0000 7f10bb7fe640 1 --2- 172.21.15.45:0/2682611210 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10bc0ca560 0x7f10bc0ca9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:25.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.301+0000 7f10bb7fe640 1 -- 172.21.15.45:0/2682611210 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f10bc1558f0 msgr2=0x7f10bc155d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:25.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.301+0000 7f10bb7fe640 1 --2- 172.21.15.45:0/2682611210 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f10bc1558f0 0x7f10bc155d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:25.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.301+0000 7f10bb7fe640 1 -- 172.21.15.45:0/2682611210 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10bc0cb610 con 0x7f10a4004d10 2023-11-28T18:39:25.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.301+0000 7f10bb7fe640 1 --2- 172.21.15.45:0/2682611210 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10a4004d10 0x7f10bc1486c0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f10ac0124a0 tx=0x7f10ac012960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:25.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.301+0000 7f10a3fff640 1 -- 172.21.15.45:0/2682611210 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ac014810 con 0x7f10a4004d10 2023-11-28T18:39:25.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.301+0000 7f10a3fff640 1 -- 172.21.15.45:0/2682611210 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10ac014970 con 0x7f10a4004d10 2023-11-28T18:39:25.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.301+0000 7f10a3fff640 1 -- 172.21.15.45:0/2682611210 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ac014ce0 con 0x7f10a4004d10 2023-11-28T18:39:25.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.301+0000 7f10c1ae3640 1 -- 172.21.15.45:0/2682611210 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10bc0cb8f0 con 0x7f10a4004d10 2023-11-28T18:39:25.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.301+0000 7f10c1ae3640 1 -- 172.21.15.45:0/2682611210 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10bc0caf20 con 0x7f10a4004d10 2023-11-28T18:39:25.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.305+0000 7f10c1ae3640 1 -- 172.21.15.45:0/2682611210 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10bc069410 con 0x7f10a4004d10 2023-11-28T18:39:25.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.305+0000 7f10a3fff640 1 -- 172.21.15.45:0/2682611210 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f10ac0153e0 con 0x7f10a4004d10 2023-11-28T18:39:25.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.305+0000 7f10a3fff640 1 --2- 172.21.15.45:0/2682611210 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f10a80668d0 0x7f10a8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:25.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.305+0000 7f10a3fff640 1 -- 172.21.15.45:0/2682611210 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f10ac086f10 con 0x7f10a4004d10 2023-11-28T18:39:25.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.305+0000 7f10baffd640 1 --2- 172.21.15.45:0/2682611210 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f10a80668d0 0x7f10a8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:25.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.305+0000 7f10baffd640 1 --2- 172.21.15.45:0/2682611210 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f10a80668d0 0x7f10a8068d90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f10bc160260 tx=0x7f10b0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:25.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.309+0000 7f10a3fff640 1 -- 172.21.15.45:0/2682611210 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f10ac054000 con 0x7f10a4004d10 2023-11-28T18:39:25.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:25.465+0000 7f10c1ae3640 1 -- 172.21.15.45:0/2682611210 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f10bc0d1660 con 0x7f10a4004d10 2023-11-28T18:39:26.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:26.225+0000 7f10a3fff640 1 -- 172.21.15.45:0/2682611210 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v37) v1 ==== 181+0+0 (secure 0 0 0) 0x7f10ac01c0d0 con 0x7f10a4004d10 2023-11-28T18:39:26.227 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' removed 2023-11-28T18:39:26.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:26.225+0000 7f10c1ae3640 1 -- 172.21.15.45:0/2682611210 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f10a80668d0 msgr2=0x7f10a8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:26.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:26.225+0000 7f10c1ae3640 1 --2- 172.21.15.45:0/2682611210 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f10a80668d0 0x7f10a8068d90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f10bc160260 tx=0x7f10b0009040 comp rx=0 tx=0).stop 2023-11-28T18:39:26.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:26.225+0000 7f10c1ae3640 1 -- 172.21.15.45:0/2682611210 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10a4004d10 msgr2=0x7f10bc1486c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:26.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:26.225+0000 7f10c1ae3640 1 --2- 172.21.15.45:0/2682611210 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10a4004d10 0x7f10bc1486c0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f10ac0124a0 tx=0x7f10ac012960 comp rx=0 tx=0).stop 2023-11-28T18:39:26.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:26.225+0000 7f10c1ae3640 1 -- 172.21.15.45:0/2682611210 shutdown_connections 2023-11-28T18:39:26.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:26.225+0000 7f10c1ae3640 1 --2- 172.21.15.45:0/2682611210 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f10a80668d0 0x7f10a8068d90 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:26.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:26.225+0000 7f10c1ae3640 1 --2- 172.21.15.45:0/2682611210 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10bc0ca560 0x7f10bc0ca9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:26.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:26.225+0000 7f10c1ae3640 1 --2- 172.21.15.45:0/2682611210 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f10bc1558f0 0x7f10bc155d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:26.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:26.225+0000 7f10c1ae3640 1 --2- 172.21.15.45:0/2682611210 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10a4004d10 0x7f10bc1486c0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:26.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:26.225+0000 7f10c1ae3640 1 -- 172.21.15.45:0/2682611210 >> 172.21.15.45:0/2682611210 conn(0x7f10bc0720a0 msgr2=0x7f10bc0cfba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:26.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:26.229+0000 7f10c1ae3640 1 -- 172.21.15.45:0/2682611210 shutdown_connections 2023-11-28T18:39:26.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:26.229+0000 7f10c1ae3640 1 -- 172.21.15.45:0/2682611210 wait complete. 2023-11-28T18:39:26.253 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-28T18:39:26.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:26.397+0000 7fdba029a640 1 Processor -- start 2023-11-28T18:39:26.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:26.397+0000 7fdba029a640 1 -- start start 2023-11-28T18:39:26.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:26.401+0000 7fdba029a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdb980ccea0 0x7fdb980cd280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:26.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:26.401+0000 7fdba029a640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb9815b720 con 0x7fdb980ce3d0 2023-11-28T18:39:26.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:26.401+0000 7fdba029a640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb980ce880 con 0x7fdb980cdf70 2023-11-28T18:39:26.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:26.401+0000 7fdba029a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb980cd7c0 con 0x7fdb980ccea0 2023-11-28T18:39:26.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:26.401+0000 7fdb9e036640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdb980ccea0 0x7fdb980cd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:26.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:26.401+0000 7fdb9e837640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fdb980ce3d0 0x7fdb9806ce30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:53098/0 (socket says 172.21.15.45:53098) 2023-11-28T18:39:26.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:26.401+0000 7fdb9e837640 1 -- 172.21.15.45:0/1482230959 learned_addr learned my addr 172.21.15.45:0/1482230959 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:39:26.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:26.401+0000 7fdb9e036640 1 -- 172.21.15.45:0/1482230959 >> v1:172.21.15.190:6789/0 conn(0x7fdb980cdf70 legacy=0x7fdb9806c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:26.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:26.401+0000 7fdb9e036640 1 -- 172.21.15.45:0/1482230959 >> v1:172.21.15.45:6789/0 conn(0x7fdb980ce3d0 legacy=0x7fdb9806ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:26.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:26.401+0000 7fdb9e036640 1 -- 172.21.15.45:0/1482230959 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb980cb590 con 0x7fdb980ccea0 2023-11-28T18:39:26.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:26.401+0000 7fdb9d034640 1 -- 172.21.15.45:0/1482230959 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2029560321 0 0) 0x7fdb9815b720 con 0x7fdb980ce3d0 2023-11-28T18:39:26.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:26.405+0000 7fdb9e036640 1 --2- 172.21.15.45:0/1482230959 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb980ccea0 0x7fdb980cd280 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fdb940097c0 tx=0x7fdb9401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d98f456b33f3833a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:26.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:26.405+0000 7fdb9d034640 1 -- 172.21.15.45:0/1482230959 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb940ab610 con 0x7fdb980ccea0 2023-11-28T18:39:26.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:26.405+0000 7fdb9d034640 1 -- 172.21.15.45:0/1482230959 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb940ab770 con 0x7fdb980ccea0 2023-11-28T18:39:26.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:26.405+0000 7fdb9d034640 1 -- 172.21.15.45:0/1482230959 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb940abb00 con 0x7fdb980ccea0 2023-11-28T18:39:26.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:26.405+0000 7fdba029a640 1 -- 172.21.15.45:0/1482230959 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb980ccea0 msgr2=0x7fdb980cd280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:26.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:26.405+0000 7fdba029a640 1 --2- 172.21.15.45:0/1482230959 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb980ccea0 0x7fdb980cd280 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fdb940097c0 tx=0x7fdb9401c410 comp rx=0 tx=0).stop 2023-11-28T18:39:26.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:26.405+0000 7fdba029a640 1 -- 172.21.15.45:0/1482230959 shutdown_connections 2023-11-28T18:39:26.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:26.405+0000 7fdba029a640 1 --2- 172.21.15.45:0/1482230959 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb980ccea0 0x7fdb980cd280 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:26.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:26.405+0000 7fdba029a640 1 -- 172.21.15.45:0/1482230959 >> 172.21.15.45:0/1482230959 conn(0x7fdb980b0c90 msgr2=0x7fdb980b10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:26.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:26.405+0000 7fdba029a640 1 -- 172.21.15.45:0/1482230959 shutdown_connections 2023-11-28T18:39:26.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:26.405+0000 7fdba029a640 1 -- 172.21.15.45:0/1482230959 wait complete. 2023-11-28T18:39:26.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:26.405+0000 7fdba029a640 1 Processor -- start 2023-11-28T18:39:26.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:26.405+0000 7fdba029a640 1 -- start start 2023-11-28T18:39:26.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:26.409+0000 7fdba029a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb980ccea0 0x7fdb9815ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:26.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:26.409+0000 7fdba029a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdb980cdf70 0x7fdb980c3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:26.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:26.409+0000 7fdba029a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdb980ce3d0 0x7fdb98158b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:26.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:26.409+0000 7fdba029a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9815b0d0 con 0x7fdb980ccea0 2023-11-28T18:39:26.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:26.409+0000 7fdba029a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9809c440 con 0x7fdb980cdf70 2023-11-28T18:39:26.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:26.409+0000 7fdba029a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb981576a0 con 0x7fdb980ce3d0 2023-11-28T18:39:26.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:26.409+0000 7fdb9e036640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb980ccea0 0x7fdb9815ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:26.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:26.409+0000 7fdb9e036640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb980ccea0 0x7fdb9815ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36810/0 (socket says 172.21.15.45:36810) 2023-11-28T18:39:26.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:26.409+0000 7fdb9e036640 1 -- 172.21.15.45:0/1212515390 learned_addr learned my addr 172.21.15.45:0/1212515390 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:26.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:26.409+0000 7fdb9e036640 1 -- 172.21.15.45:0/1212515390 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdb980ce3d0 msgr2=0x7fdb98158b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:26.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:26.409+0000 7fdb9e036640 1 --2- 172.21.15.45:0/1212515390 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdb980ce3d0 0x7fdb98158b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:26.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:26.409+0000 7fdb9e036640 1 -- 172.21.15.45:0/1212515390 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdb980cdf70 msgr2=0x7fdb980c3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:26.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:26.409+0000 7fdb9e036640 1 --2- 172.21.15.45:0/1212515390 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdb980cdf70 0x7fdb980c3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:26.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:26.409+0000 7fdb9e036640 1 -- 172.21.15.45:0/1212515390 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb94009420 con 0x7fdb980ccea0 2023-11-28T18:39:26.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:26.409+0000 7fdb9e036640 1 --2- 172.21.15.45:0/1212515390 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb980ccea0 0x7fdb9815ab90 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fdb9401a040 tx=0x7fdb9401ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:26.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:26.409+0000 7fdb8effd640 1 -- 172.21.15.45:0/1212515390 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb940b5810 con 0x7fdb980ccea0 2023-11-28T18:39:26.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:26.409+0000 7fdb8effd640 1 -- 172.21.15.45:0/1212515390 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb940b59b0 con 0x7fdb980ccea0 2023-11-28T18:39:26.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:26.409+0000 7fdb8effd640 1 -- 172.21.15.45:0/1212515390 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb940b5d60 con 0x7fdb980ccea0 2023-11-28T18:39:26.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:26.409+0000 7fdba029a640 1 -- 172.21.15.45:0/1212515390 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb9815b2b0 con 0x7fdb980ccea0 2023-11-28T18:39:26.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:26.409+0000 7fdba029a640 1 -- 172.21.15.45:0/1212515390 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb9809be80 con 0x7fdb980ccea0 2023-11-28T18:39:26.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:26.409+0000 7fdba029a640 1 -- 172.21.15.45:0/1212515390 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb9804e890 con 0x7fdb980ccea0 2023-11-28T18:39:26.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:26.409+0000 7fdb8effd640 1 -- 172.21.15.45:0/1212515390 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fdb940b4390 con 0x7fdb980ccea0 2023-11-28T18:39:26.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:26.413+0000 7fdb8effd640 1 --2- 172.21.15.45:0/1212515390 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fdb7c066900 0x7fdb7c068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:26.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:26.413+0000 7fdb8effd640 1 -- 172.21.15.45:0/1212515390 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5443+0+0 (secure 0 0 0) 0x7fdb9411ecd0 con 0x7fdb980ccea0 2023-11-28T18:39:26.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:26.413+0000 7fdb9d835640 1 --2- 172.21.15.45:0/1212515390 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fdb7c066900 0x7fdb7c068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:26.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:26.413+0000 7fdb9d835640 1 --2- 172.21.15.45:0/1212515390 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fdb7c066900 0x7fdb7c068dc0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fdb88007fd0 tx=0x7fdb880079a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:26.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:26.417+0000 7fdb8effd640 1 -- 172.21.15.45:0/1212515390 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdb940ec110 con 0x7fdb980ccea0 2023-11-28T18:39:26.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:26.573+0000 7fdba029a640 1 -- 172.21.15.45:0/1212515390 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fdb9806e680 con 0x7fdb980ccea0 2023-11-28T18:39:27.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.233+0000 7fdb8effd640 1 -- 172.21.15.45:0/1212515390 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v38) v1 ==== 169+0+0 (secure 0 0 0) 0x7fdb940ef730 con 0x7fdb980ccea0 2023-11-28T18:39:27.235 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' removed 2023-11-28T18:39:27.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.237+0000 7fdba029a640 1 -- 172.21.15.45:0/1212515390 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fdb7c066900 msgr2=0x7fdb7c068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:27.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.237+0000 7fdba029a640 1 --2- 172.21.15.45:0/1212515390 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fdb7c066900 0x7fdb7c068dc0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fdb88007fd0 tx=0x7fdb880079a0 comp rx=0 tx=0).stop 2023-11-28T18:39:27.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.237+0000 7fdba029a640 1 -- 172.21.15.45:0/1212515390 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb980ccea0 msgr2=0x7fdb9815ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:27.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.237+0000 7fdba029a640 1 --2- 172.21.15.45:0/1212515390 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb980ccea0 0x7fdb9815ab90 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fdb9401a040 tx=0x7fdb9401ac50 comp rx=0 tx=0).stop 2023-11-28T18:39:27.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.237+0000 7fdba029a640 1 -- 172.21.15.45:0/1212515390 shutdown_connections 2023-11-28T18:39:27.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.237+0000 7fdba029a640 1 --2- 172.21.15.45:0/1212515390 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fdb7c066900 0x7fdb7c068dc0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:27.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.237+0000 7fdba029a640 1 --2- 172.21.15.45:0/1212515390 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdb980ce3d0 0x7fdb98158b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:27.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.237+0000 7fdba029a640 1 --2- 172.21.15.45:0/1212515390 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdb980cdf70 0x7fdb980c3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:27.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.237+0000 7fdba029a640 1 --2- 172.21.15.45:0/1212515390 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb980ccea0 0x7fdb9815ab90 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:27.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.237+0000 7fdba029a640 1 -- 172.21.15.45:0/1212515390 >> 172.21.15.45:0/1212515390 conn(0x7fdb980b0c90 msgr2=0x7fdb981535b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:27.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.237+0000 7fdba029a640 1 -- 172.21.15.45:0/1212515390 shutdown_connections 2023-11-28T18:39:27.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.237+0000 7fdba029a640 1 -- 172.21.15.45:0/1212515390 wait complete. 2023-11-28T18:39:27.265 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-28T18:39:27.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.409+0000 7f1d0d4c9640 1 Processor -- start 2023-11-28T18:39:27.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.409+0000 7f1d0d4c9640 1 -- start start 2023-11-28T18:39:27.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.413+0000 7f1d0d4c9640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1d0815d2f0 0x7f1d080d17f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:27.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.413+0000 7f1d0d4c9640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f1d080d1d30 0x7f1d080cfc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:27.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.413+0000 7f1d0d4c9640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1d0815d6d0 0x7f1d080d0160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:27.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.413+0000 7f1d0d4c9640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d080aff70 con 0x7f1d0815d6d0 2023-11-28T18:39:27.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.413+0000 7f1d0d4c9640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d080b0210 con 0x7f1d080d1d30 2023-11-28T18:39:27.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.413+0000 7f1d0d4c9640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d080b04f0 con 0x7f1d0815d2f0 2023-11-28T18:39:27.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.413+0000 7f1d077fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1d0815d6d0 0x7f1d080d0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:27.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.413+0000 7f1d077fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1d0815d6d0 0x7f1d080d0160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36822/0 (socket says 172.21.15.45:36822) 2023-11-28T18:39:27.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.413+0000 7f1d067fc640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f1d080d1d30 0x7f1d080cfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:27.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.413+0000 7f1d06ffd640 1 --2- 172.21.15.45:0/2868486970 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1d0815d2f0 0x7f1d080d17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:27.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.413+0000 7f1d077fe640 1 -- 172.21.15.45:0/2868486970 learned_addr learned my addr 172.21.15.45:0/2868486970 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:27.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.413+0000 7f1d06ffd640 1 -- 172.21.15.45:0/2868486970 >> v2:172.21.15.190:3300/0 conn(0x7f1d080d1d30 msgr2=0x7f1d080cfc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:27.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.413+0000 7f1d06ffd640 1 --2- 172.21.15.45:0/2868486970 >> v2:172.21.15.190:3300/0 conn(0x7f1d080d1d30 0x7f1d080cfc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:27.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.413+0000 7f1d06ffd640 1 -- 172.21.15.45:0/2868486970 >> v2:172.21.15.45:3300/0 conn(0x7f1d0815d6d0 msgr2=0x7f1d080d0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:27.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.413+0000 7f1d06ffd640 1 --2- 172.21.15.45:0/2868486970 >> v2:172.21.15.45:3300/0 conn(0x7f1d0815d6d0 0x7f1d080d0160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:27.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.413+0000 7f1d06ffd640 1 -- 172.21.15.45:0/2868486970 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d080b07d0 con 0x7f1d0815d2f0 2023-11-28T18:39:27.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.417+0000 7f1d06ffd640 1 --2- 172.21.15.45:0/2868486970 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1d0815d2f0 0x7f1d080d17f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1d080b5e00 tx=0x7f1cf801c460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8eb2e14dc9026877 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:27.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.417+0000 7f1d05ffb640 1 -- 172.21.15.45:0/2868486970 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf80ab600 con 0x7f1d0815d2f0 2023-11-28T18:39:27.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.421+0000 7f1d05ffb640 1 -- 172.21.15.45:0/2868486970 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cf80a7050 con 0x7f1d0815d2f0 2023-11-28T18:39:27.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.421+0000 7f1d05ffb640 1 -- 172.21.15.45:0/2868486970 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf80ab980 con 0x7f1d0815d2f0 2023-11-28T18:39:27.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.421+0000 7f1d0d4c9640 1 -- 172.21.15.45:0/2868486970 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1d0815d2f0 msgr2=0x7f1d080d17f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:27.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.421+0000 7f1d0d4c9640 1 --2- 172.21.15.45:0/2868486970 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1d0815d2f0 0x7f1d080d17f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1d080b5e00 tx=0x7f1cf801c460 comp rx=0 tx=0).stop 2023-11-28T18:39:27.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.421+0000 7f1d0d4c9640 1 -- 172.21.15.45:0/2868486970 shutdown_connections 2023-11-28T18:39:27.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.421+0000 7f1d0d4c9640 1 --2- 172.21.15.45:0/2868486970 >> v2:172.21.15.45:3300/0 conn(0x7f1d0815d6d0 0x7f1d080d0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:27.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.421+0000 7f1d0d4c9640 1 --2- 172.21.15.45:0/2868486970 >> v2:172.21.15.190:3300/0 conn(0x7f1d080d1d30 0x7f1d080cfc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:27.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.421+0000 7f1d0d4c9640 1 --2- 172.21.15.45:0/2868486970 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1d0815d2f0 0x7f1d080d17f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:27.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.421+0000 7f1d0d4c9640 1 -- 172.21.15.45:0/2868486970 >> 172.21.15.45:0/2868486970 conn(0x7f1d0809c550 msgr2=0x7f1d080d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:27.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.421+0000 7f1d0d4c9640 1 -- 172.21.15.45:0/2868486970 shutdown_connections 2023-11-28T18:39:27.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.421+0000 7f1d0d4c9640 1 -- 172.21.15.45:0/2868486970 wait complete. 2023-11-28T18:39:27.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.421+0000 7f1d0d4c9640 1 Processor -- start 2023-11-28T18:39:27.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.421+0000 7f1d0d4c9640 1 -- start start 2023-11-28T18:39:27.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.425+0000 7f1d0d4c9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d080d1d30 0x7f1d08153660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:27.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.425+0000 7f1d0d4c9640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1d0815d2f0 0x7f1d0815de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:27.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.425+0000 7f1d0d4c9640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1d0815d6d0 0x7f1d080c9530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:27.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.425+0000 7f1d0d4c9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d081555c0 con 0x7f1d080d1d30 2023-11-28T18:39:27.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.425+0000 7f1d0d4c9640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d080c7650 con 0x7f1d0815d2f0 2023-11-28T18:39:27.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.425+0000 7f1d0d4c9640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d08153ca0 con 0x7f1d0815d6d0 2023-11-28T18:39:27.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.425+0000 7f1d06ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d080d1d30 0x7f1d08153660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:27.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.425+0000 7f1d06ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d080d1d30 0x7f1d08153660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36838/0 (socket says 172.21.15.45:36838) 2023-11-28T18:39:27.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.425+0000 7f1d06ffd640 1 -- 172.21.15.45:0/2483958530 learned_addr learned my addr 172.21.15.45:0/2483958530 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:27.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.425+0000 7f1d067fc640 1 --2- 172.21.15.45:0/2483958530 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1d0815d2f0 0x7f1d0815de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:27.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.425+0000 7f1d077fe640 1 --2- 172.21.15.45:0/2483958530 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1d0815d6d0 0x7f1d080c9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:27.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.425+0000 7f1d06ffd640 1 -- 172.21.15.45:0/2483958530 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1d0815d6d0 msgr2=0x7f1d080c9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:27.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.425+0000 7f1d06ffd640 1 --2- 172.21.15.45:0/2483958530 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1d0815d6d0 0x7f1d080c9530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:27.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.425+0000 7f1d06ffd640 1 -- 172.21.15.45:0/2483958530 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1d0815d2f0 msgr2=0x7f1d0815de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:27.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.425+0000 7f1d06ffd640 1 --2- 172.21.15.45:0/2483958530 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1d0815d2f0 0x7f1d0815de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:27.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.425+0000 7f1d06ffd640 1 -- 172.21.15.45:0/2483958530 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf8009420 con 0x7f1d080d1d30 2023-11-28T18:39:27.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.425+0000 7f1d06ffd640 1 --2- 172.21.15.45:0/2483958530 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d080d1d30 0x7f1d08153660 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f1cf80ae040 tx=0x7f1cf8019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:27.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.425+0000 7f1cef7fe640 1 -- 172.21.15.45:0/2483958530 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf80b4410 con 0x7f1d080d1d30 2023-11-28T18:39:27.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.425+0000 7f1cef7fe640 1 -- 172.21.15.45:0/2483958530 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cf80b4570 con 0x7f1d080d1d30 2023-11-28T18:39:27.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.425+0000 7f1cef7fe640 1 -- 172.21.15.45:0/2483958530 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf80b4920 con 0x7f1d080d1d30 2023-11-28T18:39:27.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.425+0000 7f1d0d4c9640 1 -- 172.21.15.45:0/2483958530 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d080c7090 con 0x7f1d080d1d30 2023-11-28T18:39:27.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.425+0000 7f1d0d4c9640 1 -- 172.21.15.45:0/2483958530 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d08153eb0 con 0x7f1d080d1d30 2023-11-28T18:39:27.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.425+0000 7f1d0d4c9640 1 -- 172.21.15.45:0/2483958530 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d08067a30 con 0x7f1d080d1d30 2023-11-28T18:39:27.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.429+0000 7f1cef7fe640 1 -- 172.21.15.45:0/2483958530 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f1cf80b2040 con 0x7f1d080d1d30 2023-11-28T18:39:27.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.429+0000 7f1cef7fe640 1 --2- 172.21.15.45:0/2483958530 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1cf40668d0 0x7f1cf4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:27.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.429+0000 7f1cef7fe640 1 -- 172.21.15.45:0/2483958530 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f1cf811df60 con 0x7f1d080d1d30 2023-11-28T18:39:27.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.429+0000 7f1d067fc640 1 --2- 172.21.15.45:0/2483958530 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1cf40668d0 0x7f1cf4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:27.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.429+0000 7f1d067fc640 1 --2- 172.21.15.45:0/2483958530 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1cf40668d0 0x7f1cf4068d90 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1d0806d090 tx=0x7f1cfc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:27.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.433+0000 7f1cef7fe640 1 -- 172.21.15.45:0/2483958530 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1cf80eb610 con 0x7f1d080d1d30 2023-11-28T18:39:27.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.589+0000 7f1d0d4c9640 1 -- 172.21.15.45:0/2483958530 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f1d08069410 con 0x7f1d080d1d30 2023-11-28T18:39:27.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.593+0000 7f1cef7fe640 1 -- 172.21.15.45:0/2483958530 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1cf80b0020 con 0x7f1d080d1d30 2023-11-28T18:39:27.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.593+0000 7f1d0d4c9640 1 -- 172.21.15.45:0/2483958530 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1cf40668d0 msgr2=0x7f1cf4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:27.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.593+0000 7f1d0d4c9640 1 --2- 172.21.15.45:0/2483958530 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1cf40668d0 0x7f1cf4068d90 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1d0806d090 tx=0x7f1cfc008040 comp rx=0 tx=0).stop 2023-11-28T18:39:27.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.593+0000 7f1d0d4c9640 1 -- 172.21.15.45:0/2483958530 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d080d1d30 msgr2=0x7f1d08153660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:27.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.593+0000 7f1d0d4c9640 1 --2- 172.21.15.45:0/2483958530 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d080d1d30 0x7f1d08153660 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f1cf80ae040 tx=0x7f1cf8019200 comp rx=0 tx=0).stop 2023-11-28T18:39:27.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.593+0000 7f1d0d4c9640 1 -- 172.21.15.45:0/2483958530 shutdown_connections 2023-11-28T18:39:27.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.593+0000 7f1d0d4c9640 1 --2- 172.21.15.45:0/2483958530 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1cf40668d0 0x7f1cf4068d90 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:27.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.593+0000 7f1d0d4c9640 1 --2- 172.21.15.45:0/2483958530 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1d0815d6d0 0x7f1d080c9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:27.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.593+0000 7f1d0d4c9640 1 --2- 172.21.15.45:0/2483958530 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1d0815d2f0 0x7f1d0815de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:27.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.593+0000 7f1d0d4c9640 1 --2- 172.21.15.45:0/2483958530 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d080d1d30 0x7f1d08153660 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:27.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.593+0000 7f1d0d4c9640 1 -- 172.21.15.45:0/2483958530 >> 172.21.15.45:0/2483958530 conn(0x7f1d0809c550 msgr2=0x7f1d080b3d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:27.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.593+0000 7f1d0d4c9640 1 -- 172.21.15.45:0/2483958530 shutdown_connections 2023-11-28T18:39:27.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.597+0000 7f1d0d4c9640 1 -- 172.21.15.45:0/2483958530 wait complete. 2023-11-28T18:39:27.618 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_journal_repair.TestJournalRepair.test_inject_to_empty' 2023-11-28T18:39:27.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.757+0000 7f9f25d72640 1 Processor -- start 2023-11-28T18:39:27.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.757+0000 7f9f25d72640 1 -- start start 2023-11-28T18:39:27.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.757+0000 7f9f25d72640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9f200b3f20 0x7f9f200b2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:27.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.757+0000 7f9f25d72640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f9f200b30f0 0x7f9f200cf020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:27.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.757+0000 7f9f25d72640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f200d0670 con 0x7f9f201449a0 2023-11-28T18:39:27.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.757+0000 7f9f25d72640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f200cbd20 con 0x7f9f200b3f20 2023-11-28T18:39:27.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.757+0000 7f9f25d72640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f200b3510 con 0x7f9f200b30f0 2023-11-28T18:39:27.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.757+0000 7f9f1effd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9f200b3f20 0x7f9f200b2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:27.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.761+0000 7f9f1effd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9f200b3f20 0x7f9f200b2bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36844/0 (socket says 172.21.15.45:36844) 2023-11-28T18:39:27.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.761+0000 7f9f1effd640 1 -- 172.21.15.45:0/3413648031 learned_addr learned my addr 172.21.15.45:0/3413648031 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:27.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.761+0000 7f9f1ffff640 1 --2- 172.21.15.45:0/3413648031 >> v2:172.21.15.190:3300/0 conn(0x7f9f200b30f0 0x7f9f200cf020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:27.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.761+0000 7f9f1effd640 1 -- 172.21.15.45:0/3413648031 >> v2:172.21.15.190:3300/0 conn(0x7f9f200b30f0 msgr2=0x7f9f200cf020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:27.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.761+0000 7f9f1effd640 1 --2- 172.21.15.45:0/3413648031 >> v2:172.21.15.190:3300/0 conn(0x7f9f200b30f0 0x7f9f200cf020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:27.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.761+0000 7f9f1effd640 1 -- 172.21.15.45:0/3413648031 >> v1:172.21.15.190:6789/0 conn(0x7f9f201449a0 legacy=0x7f9f2006f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:27.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.761+0000 7f9f1effd640 1 -- 172.21.15.45:0/3413648031 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f200cb760 con 0x7f9f200b3f20 2023-11-28T18:39:27.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.761+0000 7f9f1effd640 1 --2- 172.21.15.45:0/3413648031 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f200b3f20 0x7f9f200b2bb0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f9f200d0f10 tx=0x7f9f1401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c01edfd955a30fe server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:27.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.761+0000 7f9f1e7fc640 1 -- 172.21.15.45:0/3413648031 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f140aa430 con 0x7f9f200b3f20 2023-11-28T18:39:27.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.761+0000 7f9f1e7fc640 1 -- 172.21.15.45:0/3413648031 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f140aa590 con 0x7f9f200b3f20 2023-11-28T18:39:27.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.761+0000 7f9f1e7fc640 1 -- 172.21.15.45:0/3413648031 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f140aa920 con 0x7f9f200b3f20 2023-11-28T18:39:27.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.765+0000 7f9f25d72640 1 -- 172.21.15.45:0/3413648031 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f200b3f20 msgr2=0x7f9f200b2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:27.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.765+0000 7f9f25d72640 1 --2- 172.21.15.45:0/3413648031 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f200b3f20 0x7f9f200b2bb0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f9f200d0f10 tx=0x7f9f1401c4d0 comp rx=0 tx=0).stop 2023-11-28T18:39:27.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.765+0000 7f9f25d72640 1 -- 172.21.15.45:0/3413648031 shutdown_connections 2023-11-28T18:39:27.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.765+0000 7f9f25d72640 1 --2- 172.21.15.45:0/3413648031 >> v2:172.21.15.190:3300/0 conn(0x7f9f200b30f0 0x7f9f200cf020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:27.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.765+0000 7f9f25d72640 1 --2- 172.21.15.45:0/3413648031 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f200b3f20 0x7f9f200b2bb0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:27.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.765+0000 7f9f25d72640 1 -- 172.21.15.45:0/3413648031 >> 172.21.15.45:0/3413648031 conn(0x7f9f2006a570 msgr2=0x7f9f2006a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:27.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.765+0000 7f9f25d72640 1 -- 172.21.15.45:0/3413648031 shutdown_connections 2023-11-28T18:39:27.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.765+0000 7f9f25d72640 1 -- 172.21.15.45:0/3413648031 wait complete. 2023-11-28T18:39:27.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.765+0000 7f9f25d72640 1 Processor -- start 2023-11-28T18:39:27.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.765+0000 7f9f25d72640 1 -- start start 2023-11-28T18:39:27.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.765+0000 7f9f25d72640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9f200b30f0 0x7f9f2013ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:27.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.765+0000 7f9f25d72640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f200b3f20 0x7f9f2015e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:27.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.765+0000 7f9f25d72640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f201449a0 0x7f9f200b5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:27.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.765+0000 7f9f25d72640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2013b180 con 0x7f9f201449a0 2023-11-28T18:39:27.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.765+0000 7f9f25d72640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2013c800 con 0x7f9f200b30f0 2023-11-28T18:39:27.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.765+0000 7f9f25d72640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2015e6f0 con 0x7f9f200b3f20 2023-11-28T18:39:27.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.765+0000 7f9f1ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f201449a0 0x7f9f200b5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:27.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.765+0000 7f9f1ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f201449a0 0x7f9f200b5370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36852/0 (socket says 172.21.15.45:36852) 2023-11-28T18:39:27.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.765+0000 7f9f1ffff640 1 -- 172.21.15.45:0/1601424223 learned_addr learned my addr 172.21.15.45:0/1601424223 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:27.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.765+0000 7f9f1f7fe640 1 --2- 172.21.15.45:0/1601424223 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9f200b30f0 0x7f9f2013ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:27.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.765+0000 7f9f1effd640 1 --2- 172.21.15.45:0/1601424223 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f200b3f20 0x7f9f2015e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:27.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.769+0000 7f9f1ffff640 1 -- 172.21.15.45:0/1601424223 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f200b3f20 msgr2=0x7f9f2015e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:27.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.769+0000 7f9f1ffff640 1 --2- 172.21.15.45:0/1601424223 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f200b3f20 0x7f9f2015e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:27.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.769+0000 7f9f1ffff640 1 -- 172.21.15.45:0/1601424223 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9f200b30f0 msgr2=0x7f9f2013ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:27.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.769+0000 7f9f1ffff640 1 --2- 172.21.15.45:0/1601424223 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9f200b30f0 0x7f9f2013ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:27.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.769+0000 7f9f1ffff640 1 -- 172.21.15.45:0/1601424223 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f140094d0 con 0x7f9f201449a0 2023-11-28T18:39:27.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.769+0000 7f9f1ffff640 1 --2- 172.21.15.45:0/1601424223 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f201449a0 0x7f9f200b5370 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f9f18009d30 tx=0x7f9f1800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:27.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.769+0000 7f9f07fff640 1 -- 172.21.15.45:0/1601424223 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f18009ba0 con 0x7f9f201449a0 2023-11-28T18:39:27.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.769+0000 7f9f07fff640 1 -- 172.21.15.45:0/1601424223 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f1800f040 con 0x7f9f201449a0 2023-11-28T18:39:27.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.769+0000 7f9f07fff640 1 -- 172.21.15.45:0/1601424223 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f180146c0 con 0x7f9f201449a0 2023-11-28T18:39:27.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.769+0000 7f9f25d72640 1 -- 172.21.15.45:0/1601424223 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f2013dc30 con 0x7f9f201449a0 2023-11-28T18:39:27.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.769+0000 7f9f25d72640 1 -- 172.21.15.45:0/1601424223 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f2013d020 con 0x7f9f201449a0 2023-11-28T18:39:27.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.769+0000 7f9f25d72640 1 -- 172.21.15.45:0/1601424223 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f2013ddc0 con 0x7f9f201449a0 2023-11-28T18:39:27.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.769+0000 7f9f07fff640 1 -- 172.21.15.45:0/1601424223 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f9f18014820 con 0x7f9f201449a0 2023-11-28T18:39:27.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.769+0000 7f9f07fff640 1 --2- 172.21.15.45:0/1601424223 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9f0c0668d0 0x7f9f0c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:27.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.769+0000 7f9f07fff640 1 -- 172.21.15.45:0/1601424223 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f9f18084f40 con 0x7f9f201449a0 2023-11-28T18:39:27.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.773+0000 7f9f1f7fe640 1 --2- 172.21.15.45:0/1601424223 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9f0c0668d0 0x7f9f0c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:27.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.773+0000 7f9f1f7fe640 1 --2- 172.21.15.45:0/1601424223 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9f0c0668d0 0x7f9f0c068d90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9f200b6b50 tx=0x7f9f10009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:27.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.773+0000 7f9f07fff640 1 -- 172.21.15.45:0/1601424223 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9f18052410 con 0x7f9f201449a0 2023-11-28T18:39:27.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:27.985+0000 7f9f25d72640 1 -- 172.21.15.45:0/1601424223 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_journal_repair.TestJournalRepair.test_inject_to_empty"]} v 0) v1 -- 0x7f9f20069480 con 0x7f9f201449a0 2023-11-28T18:39:28.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.237+0000 7f9f07fff640 1 -- 172.21.15.45:0/1601424223 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_journal_repair.TestJournalRepair.test_inject_to_empty"]}]=0 v127) v1 ==== 150+0+0 (secure 0 0 0) 0x7f9f18055a30 con 0x7f9f201449a0 2023-11-28T18:39:28.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.241+0000 7f9f25d72640 1 -- 172.21.15.45:0/1601424223 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9f0c0668d0 msgr2=0x7f9f0c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:28.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.241+0000 7f9f25d72640 1 --2- 172.21.15.45:0/1601424223 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9f0c0668d0 0x7f9f0c068d90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9f200b6b50 tx=0x7f9f10009040 comp rx=0 tx=0).stop 2023-11-28T18:39:28.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.241+0000 7f9f25d72640 1 -- 172.21.15.45:0/1601424223 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f201449a0 msgr2=0x7f9f200b5370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:28.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.241+0000 7f9f25d72640 1 --2- 172.21.15.45:0/1601424223 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f201449a0 0x7f9f200b5370 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f9f18009d30 tx=0x7f9f1800c490 comp rx=0 tx=0).stop 2023-11-28T18:39:28.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.241+0000 7f9f25d72640 1 -- 172.21.15.45:0/1601424223 shutdown_connections 2023-11-28T18:39:28.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.241+0000 7f9f25d72640 1 --2- 172.21.15.45:0/1601424223 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9f0c0668d0 0x7f9f0c068d90 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:28.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.241+0000 7f9f25d72640 1 --2- 172.21.15.45:0/1601424223 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f201449a0 0x7f9f200b5370 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:28.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.241+0000 7f9f25d72640 1 --2- 172.21.15.45:0/1601424223 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f200b3f20 0x7f9f2015e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:28.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.241+0000 7f9f25d72640 1 --2- 172.21.15.45:0/1601424223 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9f200b30f0 0x7f9f2013ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:28.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.241+0000 7f9f25d72640 1 -- 172.21.15.45:0/1601424223 >> 172.21.15.45:0/1601424223 conn(0x7f9f2006a570 msgr2=0x7f9f20141fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:28.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.241+0000 7f9f25d72640 1 -- 172.21.15.45:0/1601424223 shutdown_connections 2023-11-28T18:39:28.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.241+0000 7f9f25d72640 1 -- 172.21.15.45:0/1601424223 wait complete. 2023-11-28T18:39:28.264 INFO:tasks.cephfs_test_runner:That when some dentries in the journal but nothing is in ... ok 2023-11-28T18:39:28.264 INFO:tasks.cephfs_test_runner:Starting test: test_journal_smoke (tasks.cephfs.test_journal_repair.TestJournalRepair) 2023-11-28T18:39:28.264 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T18:39:28.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.405+0000 7fbbcf49a640 1 Processor -- start 2023-11-28T18:39:28.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.405+0000 7fbbcf49a640 1 -- start start 2023-11-28T18:39:28.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.405+0000 7fbbcf49a640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fbbc8144880 0x7fbbc806c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:28.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.405+0000 7fbbcf49a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbbc8070bb0 0x7fbbc806c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:28.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.405+0000 7fbbcf49a640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbc8071120 con 0x7fbbc80721c0 2023-11-28T18:39:28.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.405+0000 7fbbcf49a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbc815f050 con 0x7fbbc8070bb0 2023-11-28T18:39:28.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.405+0000 7fbbcf49a640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbc8071400 con 0x7fbbc8144880 2023-11-28T18:39:28.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.405+0000 7fbbcda37640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbbc8070bb0 0x7fbbc806c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:28.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.405+0000 7fbbcda37640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbbc8070bb0 0x7fbbc806c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58970/0 (socket says 172.21.15.45:58970) 2023-11-28T18:39:28.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.405+0000 7fbbcda37640 1 -- 172.21.15.45:0/1826853831 learned_addr learned my addr 172.21.15.45:0/1826853831 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:28.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.405+0000 7fbbcd236640 1 --2- 172.21.15.45:0/1826853831 >> v2:172.21.15.190:3300/0 conn(0x7fbbc8144880 0x7fbbc806c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:28.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.405+0000 7fbbcda37640 1 -- 172.21.15.45:0/1826853831 >> v2:172.21.15.190:3300/0 conn(0x7fbbc8144880 msgr2=0x7fbbc806c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:28.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.405+0000 7fbbcda37640 1 --2- 172.21.15.45:0/1826853831 >> v2:172.21.15.190:3300/0 conn(0x7fbbc8144880 0x7fbbc806c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:28.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.405+0000 7fbbcda37640 1 -- 172.21.15.45:0/1826853831 >> v1:172.21.15.190:6789/0 conn(0x7fbbc80721c0 legacy=0x7fbbc80704a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:28.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.405+0000 7fbbcda37640 1 -- 172.21.15.45:0/1826853831 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc80716e0 con 0x7fbbc8070bb0 2023-11-28T18:39:28.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.409+0000 7fbbcda37640 1 --2- 172.21.15.45:0/1826853831 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbc8070bb0 0x7fbbc806c840 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fbbc8068060 tx=0x7fbbc001c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a874df5e803d529 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:28.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.409+0000 7fbbbffff640 1 -- 172.21.15.45:0/1826853831 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc00a5820 con 0x7fbbc8070bb0 2023-11-28T18:39:28.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.409+0000 7fbbbffff640 1 -- 172.21.15.45:0/1826853831 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbc00a5980 con 0x7fbbc8070bb0 2023-11-28T18:39:28.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.409+0000 7fbbbffff640 1 -- 172.21.15.45:0/1826853831 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc00a5d10 con 0x7fbbc8070bb0 2023-11-28T18:39:28.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.409+0000 7fbbcf49a640 1 -- 172.21.15.45:0/1826853831 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbc8070bb0 msgr2=0x7fbbc806c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:28.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.409+0000 7fbbcf49a640 1 --2- 172.21.15.45:0/1826853831 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbc8070bb0 0x7fbbc806c840 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fbbc8068060 tx=0x7fbbc001c960 comp rx=0 tx=0).stop 2023-11-28T18:39:28.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.409+0000 7fbbcf49a640 1 -- 172.21.15.45:0/1826853831 shutdown_connections 2023-11-28T18:39:28.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.409+0000 7fbbcf49a640 1 --2- 172.21.15.45:0/1826853831 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbc8070bb0 0x7fbbc806c840 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:28.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.409+0000 7fbbcf49a640 1 --2- 172.21.15.45:0/1826853831 >> v2:172.21.15.190:3300/0 conn(0x7fbbc8144880 0x7fbbc806c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:28.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.409+0000 7fbbcf49a640 1 -- 172.21.15.45:0/1826853831 >> 172.21.15.45:0/1826853831 conn(0x7fbbc806a570 msgr2=0x7fbbc806a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:28.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.409+0000 7fbbcf49a640 1 -- 172.21.15.45:0/1826853831 shutdown_connections 2023-11-28T18:39:28.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.409+0000 7fbbcf49a640 1 -- 172.21.15.45:0/1826853831 wait complete. 2023-11-28T18:39:28.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.413+0000 7fbbcf49a640 1 Processor -- start 2023-11-28T18:39:28.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.413+0000 7fbbcf49a640 1 -- start start 2023-11-28T18:39:28.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.413+0000 7fbbcf49a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbbc8070bb0 0x7fbbc813b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:28.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.413+0000 7fbbcf49a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbc80721c0 0x7fbbc813c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:28.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.413+0000 7fbbcf49a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbbc8144880 0x7fbbc813dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:28.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.413+0000 7fbbcf49a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc813b910 con 0x7fbbc80721c0 2023-11-28T18:39:28.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.413+0000 7fbbcf49a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc813bbf0 con 0x7fbbc8144880 2023-11-28T18:39:28.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.413+0000 7fbbcf49a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc813bed0 con 0x7fbbc8070bb0 2023-11-28T18:39:28.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.413+0000 7fbbcca35640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbc80721c0 0x7fbbc813c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:28.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.413+0000 7fbbcca35640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbc80721c0 0x7fbbc813c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58976/0 (socket says 172.21.15.45:58976) 2023-11-28T18:39:28.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.413+0000 7fbbcca35640 1 -- 172.21.15.45:0/4289622789 learned_addr learned my addr 172.21.15.45:0/4289622789 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:28.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.413+0000 7fbbcd236640 1 --2- 172.21.15.45:0/4289622789 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbbc8070bb0 0x7fbbc813b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:28.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.413+0000 7fbbcda37640 1 --2- 172.21.15.45:0/4289622789 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbbc8144880 0x7fbbc813dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:28.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.413+0000 7fbbcca35640 1 -- 172.21.15.45:0/4289622789 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbbc8070bb0 msgr2=0x7fbbc813b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:28.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.413+0000 7fbbcca35640 1 --2- 172.21.15.45:0/4289622789 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbbc8070bb0 0x7fbbc813b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:28.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.413+0000 7fbbcca35640 1 -- 172.21.15.45:0/4289622789 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbbc8144880 msgr2=0x7fbbc813dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:28.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.413+0000 7fbbcca35640 1 --2- 172.21.15.45:0/4289622789 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbbc8144880 0x7fbbc813dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:28.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.413+0000 7fbbcca35640 1 -- 172.21.15.45:0/4289622789 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc0009b30 con 0x7fbbc80721c0 2023-11-28T18:39:28.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.413+0000 7fbbcda37640 1 --2- 172.21.15.45:0/4289622789 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbbc8144880 0x7fbbc813dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:39:28.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.413+0000 7fbbcd236640 1 --2- 172.21.15.45:0/4289622789 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbbc8070bb0 0x7fbbc813b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:39:28.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.413+0000 7fbbcca35640 1 --2- 172.21.15.45:0/4289622789 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbc80721c0 0x7fbbc813c9b0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fbbb800c410 tx=0x7fbbb800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:28.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.413+0000 7fbbbdffb640 1 -- 172.21.15.45:0/4289622789 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb8011790 con 0x7fbbc80721c0 2023-11-28T18:39:28.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.413+0000 7fbbbdffb640 1 -- 172.21.15.45:0/4289622789 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbb80118f0 con 0x7fbbc80721c0 2023-11-28T18:39:28.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.413+0000 7fbbbdffb640 1 -- 172.21.15.45:0/4289622789 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb8011ce0 con 0x7fbbc80721c0 2023-11-28T18:39:28.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.413+0000 7fbbcf49a640 1 -- 172.21.15.45:0/4289622789 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbc813c1b0 con 0x7fbbc80721c0 2023-11-28T18:39:28.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.413+0000 7fbbcf49a640 1 -- 172.21.15.45:0/4289622789 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbc8141850 con 0x7fbbc80721c0 2023-11-28T18:39:28.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.417+0000 7fbbcf49a640 1 -- 172.21.15.45:0/4289622789 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbc8069480 con 0x7fbbc80721c0 2023-11-28T18:39:28.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.417+0000 7fbbbdffb640 1 -- 172.21.15.45:0/4289622789 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fbbb801c460 con 0x7fbbc80721c0 2023-11-28T18:39:28.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.417+0000 7fbbbdffb640 1 --2- 172.21.15.45:0/4289622789 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbbac0668d0 0x7fbbac068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:28.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.417+0000 7fbbbdffb640 1 -- 172.21.15.45:0/4289622789 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fbbb8083ee0 con 0x7fbbc80721c0 2023-11-28T18:39:28.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.417+0000 7fbbcd236640 1 --2- 172.21.15.45:0/4289622789 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbbac0668d0 0x7fbbac068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:28.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.417+0000 7fbbcd236640 1 --2- 172.21.15.45:0/4289622789 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbbac0668d0 0x7fbbac068d90 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fbbc8142870 tx=0x7fbbc4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:28.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.421+0000 7fbbbdffb640 1 -- 172.21.15.45:0/4289622789 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbbb80513c0 con 0x7fbbc80721c0 2023-11-28T18:39:28.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.581+0000 7fbbcf49a640 1 -- 172.21.15.45:0/4289622789 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbbc813c660 con 0x7fbbc80721c0 2023-11-28T18:39:28.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.585+0000 7fbbbdffb640 1 -- 172.21.15.45:0/4289622789 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+13080 (secure 0 0 0) 0x7fbbb80549e0 con 0x7fbbc80721c0 2023-11-28T18:39:28.587 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:39:28.587 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":38,"fsid":"d10f5cd6-1d00-4019-99b6-6fa435498a15","created":"2023-11-28T18:37:08.189030+0000","modified":"2023-11-28T18:39:27.227256+0000","last_up_change":"2023-11-28T18:37:20.196124+0000","last_in_change":"2023-11-28T18:37:10.742043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T18:37:21.293917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"84465384-103c-4f2c-a45a-96f5bb9c835f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6809","nonce":555237322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6811","nonce":555237322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6815","nonce":555237322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6813","nonce":555237322}]},"public_addr":"172.21.15.45:6809/555237322","cluster_addr":"172.21.15.45:6811/555237322","heartbeat_back_addr":"172.21.15.45:6815/555237322","heartbeat_front_addr":"172.21.15.45:6813/555237322","state":["exists","up"]},{"osd":1,"uuid":"7d9eed24-a58f-42c7-a787-ac06be8553fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6801","nonce":2857063763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6803","nonce":2857063763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6807","nonce":2857063763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6805","nonce":2857063763}]},"public_addr":"172.21.15.45:6801/2857063763","cluster_addr":"172.21.15.45:6803/2857063763","heartbeat_back_addr":"172.21.15.45:6807/2857063763","heartbeat_front_addr":"172.21.15.45:6805/2857063763","state":["exists","up"]},{"osd":2,"uuid":"575eeccc-4abf-45b4-9caf-f3e797859588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6817","nonce":193884539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6819","nonce":193884539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6823","nonce":193884539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6821","nonce":193884539}]},"public_addr":"172.21.15.45:6817/193884539","cluster_addr":"172.21.15.45:6819/193884539","heartbeat_back_addr":"172.21.15.45:6823/193884539","heartbeat_front_addr":"172.21.15.45:6821/193884539","state":["exists","up"]},{"osd":3,"uuid":"9b0290d6-9a52-4bc8-b2a1-7622c5dc8e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6825","nonce":78541084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6827","nonce":78541084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6831","nonce":78541084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6829","nonce":78541084}]},"public_addr":"172.21.15.45:6825/78541084","cluster_addr":"172.21.15.45:6827/78541084","heartbeat_back_addr":"172.21.15.45:6831/78541084","heartbeat_front_addr":"172.21.15.45:6829/78541084","state":["exists","up"]},{"osd":4,"uuid":"ce632829-f027-4fbf-a627-02c571aa9d53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6809","nonce":1537591987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6811","nonce":1537591987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6815","nonce":1537591987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6813","nonce":1537591987}]},"public_addr":"172.21.15.190:6809/1537591987","cluster_addr":"172.21.15.190:6811/1537591987","heartbeat_back_addr":"172.21.15.190:6815/1537591987","heartbeat_front_addr":"172.21.15.190:6813/1537591987","state":["exists","up"]},{"osd":5,"uuid":"8700b609-27be-40bd-a251-4c0ae0a29ead","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6801","nonce":3296698407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6803","nonce":3296698407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6807","nonce":3296698407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6805","nonce":3296698407}]},"public_addr":"172.21.15.190:6801/3296698407","cluster_addr":"172.21.15.190:6803/3296698407","heartbeat_back_addr":"172.21.15.190:6807/3296698407","heartbeat_front_addr":"172.21.15.190:6805/3296698407","state":["exists","up"]},{"osd":6,"uuid":"44ce4a40-e6ff-4f4d-8e8a-7341e5c91f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6817","nonce":2317686718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6819","nonce":2317686718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6823","nonce":2317686718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6821","nonce":2317686718}]},"public_addr":"172.21.15.190:6817/2317686718","cluster_addr":"172.21.15.190:6819/2317686718","heartbeat_back_addr":"172.21.15.190:6823/2317686718","heartbeat_front_addr":"172.21.15.190:6821/2317686718","state":["exists","up"]},{"osd":7,"uuid":"192238c9-1423-4b7e-ac8f-84ba32113ddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6825","nonce":2493232051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6827","nonce":2493232051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6831","nonce":2493232051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6829","nonce":2493232051}]},"public_addr":"172.21.15.190:6825/2493232051","cluster_addr":"172.21.15.190:6827/2493232051","heartbeat_back_addr":"172.21.15.190:6831/2493232051","heartbeat_front_addr":"172.21.15.190:6829/2493232051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.393552+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.385453+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.361421+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.366408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.363226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.276007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.414605+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.445885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6834/1317650999":"2023-11-29T18:39:24.057567+0000","172.21.15.45:6832/1317650999":"2023-11-29T18:39:24.057567+0000","172.21.15.45:6834/2398964901":"2023-11-29T18:39:02.760758+0000","172.21.15.45:6832/2398964901":"2023-11-29T18:39:02.760758+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T18:39:28.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.585+0000 7fbbcf49a640 1 -- 172.21.15.45:0/4289622789 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbbac0668d0 msgr2=0x7fbbac068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:28.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.585+0000 7fbbcf49a640 1 --2- 172.21.15.45:0/4289622789 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbbac0668d0 0x7fbbac068d90 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fbbc8142870 tx=0x7fbbc4008040 comp rx=0 tx=0).stop 2023-11-28T18:39:28.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.585+0000 7fbbcf49a640 1 -- 172.21.15.45:0/4289622789 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbc80721c0 msgr2=0x7fbbc813c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:28.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.585+0000 7fbbcf49a640 1 --2- 172.21.15.45:0/4289622789 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbc80721c0 0x7fbbc813c9b0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fbbb800c410 tx=0x7fbbb800c8d0 comp rx=0 tx=0).stop 2023-11-28T18:39:28.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.585+0000 7fbbcf49a640 1 -- 172.21.15.45:0/4289622789 shutdown_connections 2023-11-28T18:39:28.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.585+0000 7fbbcf49a640 1 --2- 172.21.15.45:0/4289622789 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbbac0668d0 0x7fbbac068d90 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:28.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.585+0000 7fbbcf49a640 1 --2- 172.21.15.45:0/4289622789 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbbc8144880 0x7fbbc813dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:28.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.585+0000 7fbbcf49a640 1 --2- 172.21.15.45:0/4289622789 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbc80721c0 0x7fbbc813c9b0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:28.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.585+0000 7fbbcf49a640 1 --2- 172.21.15.45:0/4289622789 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbbc8070bb0 0x7fbbc813b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:28.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.585+0000 7fbbcf49a640 1 -- 172.21.15.45:0/4289622789 >> 172.21.15.45:0/4289622789 conn(0x7fbbc806a570 msgr2=0x7fbbc81655c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:28.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.585+0000 7fbbcf49a640 1 -- 172.21.15.45:0/4289622789 shutdown_connections 2023-11-28T18:39:28.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.585+0000 7fbbcf49a640 1 -- 172.21.15.45:0/4289622789 wait complete. 2023-11-28T18:39:28.609 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T18:37:21.293917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T18:39:28.610 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T18:39:28.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.753+0000 7f919fbf8640 1 Processor -- start 2023-11-28T18:39:28.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.753+0000 7f919fbf8640 1 -- start start 2023-11-28T18:39:28.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.753+0000 7f919fbf8640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f91980cfed0 0x7f91980d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:28.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.753+0000 7f919fbf8640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91980d38c0 con 0x7f91980b35f0 2023-11-28T18:39:28.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.753+0000 7f919fbf8640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91980cdcc0 con 0x7f91980b3cb0 2023-11-28T18:39:28.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.753+0000 7f919fbf8640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91980d40d0 con 0x7f91980cfed0 2023-11-28T18:39:28.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.753+0000 7f919d994640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f91980b35f0 0x7f91980cf7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:34428/0 (socket says 172.21.15.45:34428) 2023-11-28T18:39:28.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.753+0000 7f919d994640 1 -- 172.21.15.45:0/1472545578 learned_addr learned my addr 172.21.15.45:0/1472545578 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:39:28.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.753+0000 7f919d193640 1 --2- 172.21.15.45:0/1472545578 >> v2:172.21.15.190:3300/0 conn(0x7f91980cfed0 0x7f91980d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:28.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.753+0000 7f919c992640 1 -- 172.21.15.45:0/1472545578 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1131721755 0 0) 0x7f91980d38c0 con 0x7f91980b35f0 2023-11-28T18:39:28.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.753+0000 7f919c992640 1 -- 172.21.15.45:0/1472545578 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9184003530 con 0x7f91980b35f0 2023-11-28T18:39:28.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.753+0000 7f919c992640 1 -- 172.21.15.45:0/1472545578 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3090105381 0 0) 0x7f91980cdcc0 con 0x7f91980b3cb0 2023-11-28T18:39:28.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.753+0000 7f919c992640 1 -- 172.21.15.45:0/1472545578 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91980d38c0 con 0x7f91980b3cb0 2023-11-28T18:39:28.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.757+0000 7f919d193640 1 -- 172.21.15.45:0/1472545578 >> v1:172.21.15.190:6789/0 conn(0x7f91980b3cb0 legacy=0x7f91980ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:28.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.757+0000 7f919d193640 1 -- 172.21.15.45:0/1472545578 >> v1:172.21.15.45:6789/0 conn(0x7f91980b35f0 legacy=0x7f91980cf7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:28.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.757+0000 7f919d193640 1 -- 172.21.15.45:0/1472545578 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91980d3b10 con 0x7f91980cfed0 2023-11-28T18:39:28.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.757+0000 7f919d193640 1 --2- 172.21.15.45:0/1472545578 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91980cfed0 0x7f91980d0f90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f91880097c0 tx=0x7f918801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26eb77ebbe6ed7cb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:28.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.757+0000 7f919c992640 1 -- 172.21.15.45:0/1472545578 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91880ab650 con 0x7f91980cfed0 2023-11-28T18:39:28.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.757+0000 7f919c992640 1 -- 172.21.15.45:0/1472545578 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91880ab7b0 con 0x7f91980cfed0 2023-11-28T18:39:28.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.757+0000 7f919c992640 1 -- 172.21.15.45:0/1472545578 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91880abb40 con 0x7f91980cfed0 2023-11-28T18:39:28.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.757+0000 7f919fbf8640 1 -- 172.21.15.45:0/1472545578 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91980cfed0 msgr2=0x7f91980d0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:28.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.757+0000 7f919fbf8640 1 --2- 172.21.15.45:0/1472545578 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91980cfed0 0x7f91980d0f90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f91880097c0 tx=0x7f918801c450 comp rx=0 tx=0).stop 2023-11-28T18:39:28.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.757+0000 7f919fbf8640 1 -- 172.21.15.45:0/1472545578 shutdown_connections 2023-11-28T18:39:28.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.757+0000 7f919fbf8640 1 --2- 172.21.15.45:0/1472545578 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91980cfed0 0x7f91980d0f90 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:28.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.757+0000 7f919fbf8640 1 -- 172.21.15.45:0/1472545578 >> 172.21.15.45:0/1472545578 conn(0x7f919809c4f0 msgr2=0x7f91980d31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:28.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.761+0000 7f919fbf8640 1 -- 172.21.15.45:0/1472545578 shutdown_connections 2023-11-28T18:39:28.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.761+0000 7f919fbf8640 1 -- 172.21.15.45:0/1472545578 wait complete. 2023-11-28T18:39:28.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.761+0000 7f919fbf8640 1 Processor -- start 2023-11-28T18:39:28.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.761+0000 7f919fbf8640 1 -- start start 2023-11-28T18:39:28.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.761+0000 7f919fbf8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f91980b35f0 0x7f919814f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:28.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.761+0000 7f919fbf8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91980b3cb0 0x7f9198158da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:28.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.761+0000 7f919fbf8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91980cfed0 0x7f91981592e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:28.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.761+0000 7f919fbf8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91980cb530 con 0x7f91980b3cb0 2023-11-28T18:39:28.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.761+0000 7f919fbf8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91980cac40 con 0x7f91980cfed0 2023-11-28T18:39:28.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.761+0000 7f919fbf8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91980cca90 con 0x7f91980b35f0 2023-11-28T18:39:28.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.761+0000 7f919d193640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91980b3cb0 0x7f9198158da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:28.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.761+0000 7f919d193640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91980b3cb0 0x7f9198158da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58978/0 (socket says 172.21.15.45:58978) 2023-11-28T18:39:28.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.761+0000 7f919d193640 1 -- 172.21.15.45:0/1490624970 learned_addr learned my addr 172.21.15.45:0/1490624970 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:28.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.761+0000 7f919d994640 1 --2- 172.21.15.45:0/1490624970 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f91980b35f0 0x7f919814f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:28.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.761+0000 7f919e195640 1 --2- 172.21.15.45:0/1490624970 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91980cfed0 0x7f91981592e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:28.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.761+0000 7f919d193640 1 -- 172.21.15.45:0/1490624970 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f91980b35f0 msgr2=0x7f919814f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:28.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.761+0000 7f919d193640 1 --2- 172.21.15.45:0/1490624970 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f91980b35f0 0x7f919814f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:28.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.761+0000 7f919d193640 1 -- 172.21.15.45:0/1490624970 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91980cfed0 msgr2=0x7f91981592e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:28.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.761+0000 7f919d193640 1 --2- 172.21.15.45:0/1490624970 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91980cfed0 0x7f91981592e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:28.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.761+0000 7f919d193640 1 -- 172.21.15.45:0/1490624970 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9188009420 con 0x7f91980b3cb0 2023-11-28T18:39:28.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.765+0000 7f919d193640 1 --2- 172.21.15.45:0/1490624970 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91980b3cb0 0x7f9198158da0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f9188019060 tx=0x7f918801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:28.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.765+0000 7f918e7fc640 1 -- 172.21.15.45:0/1490624970 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91880bf610 con 0x7f91980b3cb0 2023-11-28T18:39:28.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.765+0000 7f918e7fc640 1 -- 172.21.15.45:0/1490624970 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91880bf790 con 0x7f91980b3cb0 2023-11-28T18:39:28.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.765+0000 7f919fbf8640 1 -- 172.21.15.45:0/1490624970 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91980cae70 con 0x7f91980b3cb0 2023-11-28T18:39:28.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.765+0000 7f918e7fc640 1 -- 172.21.15.45:0/1490624970 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91880bfb40 con 0x7f91980b3cb0 2023-11-28T18:39:28.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.765+0000 7f919fbf8640 1 -- 172.21.15.45:0/1490624970 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f919814fed0 con 0x7f91980b3cb0 2023-11-28T18:39:28.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.765+0000 7f919fbf8640 1 -- 172.21.15.45:0/1490624970 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9198069410 con 0x7f91980b3cb0 2023-11-28T18:39:28.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.765+0000 7f918e7fc640 1 -- 172.21.15.45:0/1490624970 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f91880bfca0 con 0x7f91980b3cb0 2023-11-28T18:39:28.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.765+0000 7f918e7fc640 1 --2- 172.21.15.45:0/1490624970 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f917c0668d0 0x7f917c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:28.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.765+0000 7f918e7fc640 1 -- 172.21.15.45:0/1490624970 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f918811ee90 con 0x7f91980b3cb0 2023-11-28T18:39:28.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.769+0000 7f919d994640 1 --2- 172.21.15.45:0/1490624970 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f917c0668d0 0x7f917c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:28.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.769+0000 7f919d994640 1 --2- 172.21.15.45:0/1490624970 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f917c0668d0 0x7f917c068d90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f9194007fd0 tx=0x7f9194007d80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:28.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.769+0000 7f918e7fc640 1 -- 172.21.15.45:0/1490624970 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f91880ec410 con 0x7f91980b3cb0 2023-11-28T18:39:28.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.929+0000 7f919fbf8640 1 -- 172.21.15.45:0/1490624970 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9198067750 con 0x7f91980b3cb0 2023-11-28T18:39:28.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.929+0000 7f918e7fc640 1 -- 172.21.15.45:0/1490624970 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) v1 ==== 93+0+10 (secure 0 0 0) 0x7f91881200a0 con 0x7f91980b3cb0 2023-11-28T18:39:28.932 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-11-28T18:39:28.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.929+0000 7f919fbf8640 1 -- 172.21.15.45:0/1490624970 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f917c0668d0 msgr2=0x7f917c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:28.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.929+0000 7f919fbf8640 1 --2- 172.21.15.45:0/1490624970 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f917c0668d0 0x7f917c068d90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f9194007fd0 tx=0x7f9194007d80 comp rx=0 tx=0).stop 2023-11-28T18:39:28.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.929+0000 7f919fbf8640 1 -- 172.21.15.45:0/1490624970 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91980b3cb0 msgr2=0x7f9198158da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:28.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.929+0000 7f919fbf8640 1 --2- 172.21.15.45:0/1490624970 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91980b3cb0 0x7f9198158da0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f9188019060 tx=0x7f918801ac90 comp rx=0 tx=0).stop 2023-11-28T18:39:28.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.929+0000 7f919fbf8640 1 -- 172.21.15.45:0/1490624970 shutdown_connections 2023-11-28T18:39:28.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.929+0000 7f919fbf8640 1 --2- 172.21.15.45:0/1490624970 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f917c0668d0 0x7f917c068d90 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:28.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.929+0000 7f919fbf8640 1 --2- 172.21.15.45:0/1490624970 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91980cfed0 0x7f91981592e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:28.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.929+0000 7f919fbf8640 1 --2- 172.21.15.45:0/1490624970 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91980b3cb0 0x7f9198158da0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:28.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.929+0000 7f919fbf8640 1 --2- 172.21.15.45:0/1490624970 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f91980b35f0 0x7f919814f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:28.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.929+0000 7f919fbf8640 1 -- 172.21.15.45:0/1490624970 >> 172.21.15.45:0/1490624970 conn(0x7f919809c4f0 msgr2=0x7f91980d31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:28.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.929+0000 7f919fbf8640 1 -- 172.21.15.45:0/1490624970 shutdown_connections 2023-11-28T18:39:28.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:28.929+0000 7f919fbf8640 1 -- 172.21.15.45:0/1490624970 wait complete. 2023-11-28T18:39:28.954 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_journal_repair.TestJournalRepair.test_journal_smoke' 2023-11-28T18:39:29.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:29.093+0000 7f72d2ebb640 1 Processor -- start 2023-11-28T18:39:29.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:29.093+0000 7f72d2ebb640 1 -- start start 2023-11-28T18:39:29.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:29.097+0000 7f72d2ebb640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f72cc15d240 0x7f72cc0d2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:29.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:29.097+0000 7f72d2ebb640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72cc0b2a30 con 0x7f72cc0d11a0 2023-11-28T18:39:29.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:29.097+0000 7f72d2ebb640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72cc0d1b40 con 0x7f72cc0d15e0 2023-11-28T18:39:29.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:29.097+0000 7f72d2ebb640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72cc0d1e20 con 0x7f72cc15d240 2023-11-28T18:39:29.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:29.097+0000 7f72cbfff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f72cc0d11a0 0x7f72cc0cde30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:34444/0 (socket says 172.21.15.45:34444) 2023-11-28T18:39:29.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:29.097+0000 7f72cbfff640 1 -- 172.21.15.45:0/1799735979 learned_addr learned my addr 172.21.15.45:0/1799735979 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:39:29.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:29.097+0000 7f72d0c57640 1 --2- 172.21.15.45:0/1799735979 >> v2:172.21.15.190:3300/0 conn(0x7f72cc15d240 0x7f72cc0d2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:29.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:29.097+0000 7f72cb7fe640 1 -- 172.21.15.45:0/1799735979 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3298611254 0 0) 0x7f72cc0b2a30 con 0x7f72cc0d11a0 2023-11-28T18:39:29.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:29.097+0000 7f72cb7fe640 1 -- 172.21.15.45:0/1799735979 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72bc003530 con 0x7f72cc0d11a0 2023-11-28T18:39:29.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:29.097+0000 7f72d0c57640 1 -- 172.21.15.45:0/1799735979 >> v1:172.21.15.190:6789/0 conn(0x7f72cc0d15e0 legacy=0x7f72cc0b61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:29.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:29.097+0000 7f72d0c57640 1 -- 172.21.15.45:0/1799735979 >> v1:172.21.15.45:6789/0 conn(0x7f72cc0d11a0 legacy=0x7f72cc0cde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:29.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:29.097+0000 7f72cb7fe640 1 -- 172.21.15.45:0/1799735979 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1898532691 0 0) 0x7f72bc003530 con 0x7f72cc0d11a0 2023-11-28T18:39:29.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:29.097+0000 7f72d0c57640 1 -- 172.21.15.45:0/1799735979 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72cc0d2100 con 0x7f72cc15d240 2023-11-28T18:39:29.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:29.101+0000 7f72d0c57640 1 --2- 172.21.15.45:0/1799735979 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f72cc15d240 0x7f72cc0d2be0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f72c00097c0 tx=0x7f72c001eb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5a12279b53bd0e3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:29.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:29.101+0000 7f72cb7fe640 1 -- 172.21.15.45:0/1799735979 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b8001680 con 0x7f72cc15d240 2023-11-28T18:39:29.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:29.101+0000 7f72cb7fe640 1 -- 172.21.15.45:0/1799735979 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72c00a8610 con 0x7f72cc15d240 2023-11-28T18:39:29.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:29.101+0000 7f72cb7fe640 1 -- 172.21.15.45:0/1799735979 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c00a8980 con 0x7f72cc15d240 2023-11-28T18:39:29.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:29.101+0000 7f72d2ebb640 1 -- 172.21.15.45:0/1799735979 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f72cc15d240 msgr2=0x7f72cc0d2be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:29.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:29.101+0000 7f72d2ebb640 1 --2- 172.21.15.45:0/1799735979 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f72cc15d240 0x7f72cc0d2be0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f72c00097c0 tx=0x7f72c001eb90 comp rx=0 tx=0).stop 2023-11-28T18:39:29.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:29.101+0000 7f72d2ebb640 1 -- 172.21.15.45:0/1799735979 shutdown_connections 2023-11-28T18:39:29.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:29.101+0000 7f72d2ebb640 1 --2- 172.21.15.45:0/1799735979 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f72cc15d240 0x7f72cc0d2be0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:29.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:29.101+0000 7f72d2ebb640 1 -- 172.21.15.45:0/1799735979 >> 172.21.15.45:0/1799735979 conn(0x7f72cc0722a0 msgr2=0x7f72cc0cfbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:29.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:29.101+0000 7f72d2ebb640 1 -- 172.21.15.45:0/1799735979 shutdown_connections 2023-11-28T18:39:29.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:29.101+0000 7f72d2ebb640 1 -- 172.21.15.45:0/1799735979 wait complete. 2023-11-28T18:39:29.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:29.101+0000 7f72d2ebb640 1 Processor -- start 2023-11-28T18:39:29.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:29.101+0000 7f72d2ebb640 1 -- start start 2023-11-28T18:39:29.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:29.105+0000 7f72d2ebb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72cc0d11a0 0x7f72cc15d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:29.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:29.105+0000 7f72d2ebb640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f72cc0d15e0 0x7f72cc151d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:29.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:29.105+0000 7f72d2ebb640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f72cc15d240 0x7f72cc0c8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:29.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:29.105+0000 7f72d2ebb640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72cc152920 con 0x7f72cc0d11a0 2023-11-28T18:39:29.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:29.105+0000 7f72d2ebb640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72cc15ddf0 con 0x7f72cc0d15e0 2023-11-28T18:39:29.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:29.105+0000 7f72d2ebb640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72cc0c7990 con 0x7f72cc15d240 2023-11-28T18:39:29.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:29.105+0000 7f72d0c57640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72cc0d11a0 0x7f72cc15d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:29.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:29.105+0000 7f72d0c57640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72cc0d11a0 0x7f72cc15d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58992/0 (socket says 172.21.15.45:58992) 2023-11-28T18:39:29.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:29.105+0000 7f72d0c57640 1 -- 172.21.15.45:0/3301930765 learned_addr learned my addr 172.21.15.45:0/3301930765 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:29.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:29.105+0000 7f72d0c57640 1 -- 172.21.15.45:0/3301930765 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f72cc15d240 msgr2=0x7f72cc0c8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:29.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:29.105+0000 7f72d0c57640 1 --2- 172.21.15.45:0/3301930765 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f72cc15d240 0x7f72cc0c8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:29.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:29.105+0000 7f72d0c57640 1 -- 172.21.15.45:0/3301930765 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f72cc0d15e0 msgr2=0x7f72cc151d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:29.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:29.105+0000 7f72d0c57640 1 --2- 172.21.15.45:0/3301930765 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f72cc0d15e0 0x7f72cc151d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:29.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:29.105+0000 7f72d0c57640 1 -- 172.21.15.45:0/3301930765 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c0009420 con 0x7f72cc0d11a0 2023-11-28T18:39:29.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:29.105+0000 7f72d0c57640 1 --2- 172.21.15.45:0/3301930765 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72cc0d11a0 0x7f72cc15d7a0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f72c001b7a0 tx=0x7f72c001b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:29.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:29.105+0000 7f72c97fa640 1 -- 172.21.15.45:0/3301930765 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c00b0850 con 0x7f72cc0d11a0 2023-11-28T18:39:29.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:29.105+0000 7f72c97fa640 1 -- 172.21.15.45:0/3301930765 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72c00b09b0 con 0x7f72cc0d11a0 2023-11-28T18:39:29.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:29.105+0000 7f72d2ebb640 1 -- 172.21.15.45:0/3301930765 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72cc0c7c70 con 0x7f72cc0d11a0 2023-11-28T18:39:29.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:29.105+0000 7f72c97fa640 1 -- 172.21.15.45:0/3301930765 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c00b0d20 con 0x7f72cc0d11a0 2023-11-28T18:39:29.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:29.105+0000 7f72d2ebb640 1 -- 172.21.15.45:0/3301930765 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72cc0c8230 con 0x7f72cc0d11a0 2023-11-28T18:39:29.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:29.105+0000 7f72d2ebb640 1 -- 172.21.15.45:0/3301930765 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72cc069480 con 0x7f72cc0d11a0 2023-11-28T18:39:29.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:29.105+0000 7f72c97fa640 1 -- 172.21.15.45:0/3301930765 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f72c00b7040 con 0x7f72cc0d11a0 2023-11-28T18:39:29.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:29.109+0000 7f72c97fa640 1 --2- 172.21.15.45:0/3301930765 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f72b0066920 0x7f72b0068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:29.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:29.109+0000 7f72c97fa640 1 -- 172.21.15.45:0/3301930765 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f72c0121810 con 0x7f72cc0d11a0 2023-11-28T18:39:29.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:29.109+0000 7f72cbfff640 1 --2- 172.21.15.45:0/3301930765 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f72b0066920 0x7f72b0068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:29.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:29.109+0000 7f72cbfff640 1 --2- 172.21.15.45:0/3301930765 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f72b0066920 0x7f72b0068de0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f72b8000c10 tx=0x7f72b80011b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:29.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:29.113+0000 7f72c97fa640 1 -- 172.21.15.45:0/3301930765 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f72c00eecd0 con 0x7f72cc0d11a0 2023-11-28T18:39:29.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:29.325+0000 7f72d2ebb640 1 -- 172.21.15.45:0/3301930765 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_journal_repair.TestJournalRepair.test_journal_smoke"]} v 0) v1 -- 0x7f72cc0ce7a0 con 0x7f72cc0d11a0 2023-11-28T18:39:30.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.245+0000 7f72c97fa640 1 -- 172.21.15.45:0/3301930765 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_journal_repair.TestJournalRepair.test_journal_smoke"]}]=0 v129) v1 ==== 151+0+0 (secure 0 0 0) 0x7f72c00b5020 con 0x7f72cc0d11a0 2023-11-28T18:39:30.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.249+0000 7f72d2ebb640 1 -- 172.21.15.45:0/3301930765 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f72b0066920 msgr2=0x7f72b0068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:30.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.249+0000 7f72d2ebb640 1 --2- 172.21.15.45:0/3301930765 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f72b0066920 0x7f72b0068de0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f72b8000c10 tx=0x7f72b80011b0 comp rx=0 tx=0).stop 2023-11-28T18:39:30.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.249+0000 7f72d2ebb640 1 -- 172.21.15.45:0/3301930765 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72cc0d11a0 msgr2=0x7f72cc15d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:30.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.249+0000 7f72d2ebb640 1 --2- 172.21.15.45:0/3301930765 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72cc0d11a0 0x7f72cc15d7a0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f72c001b7a0 tx=0x7f72c001b930 comp rx=0 tx=0).stop 2023-11-28T18:39:30.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.249+0000 7f72d2ebb640 1 -- 172.21.15.45:0/3301930765 shutdown_connections 2023-11-28T18:39:30.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.249+0000 7f72d2ebb640 1 --2- 172.21.15.45:0/3301930765 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f72b0066920 0x7f72b0068de0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:30.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.249+0000 7f72d2ebb640 1 --2- 172.21.15.45:0/3301930765 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f72cc15d240 0x7f72cc0c8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:30.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.249+0000 7f72d2ebb640 1 --2- 172.21.15.45:0/3301930765 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f72cc0d15e0 0x7f72cc151d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:30.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.249+0000 7f72d2ebb640 1 --2- 172.21.15.45:0/3301930765 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72cc0d11a0 0x7f72cc15d7a0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:30.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.249+0000 7f72d2ebb640 1 -- 172.21.15.45:0/3301930765 >> 172.21.15.45:0/3301930765 conn(0x7f72cc0722a0 msgr2=0x7f72cc0d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:30.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.249+0000 7f72d2ebb640 1 -- 172.21.15.45:0/3301930765 shutdown_connections 2023-11-28T18:39:30.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.249+0000 7f72d2ebb640 1 -- 172.21.15.45:0/3301930765 wait complete. 2023-11-28T18:39:30.277 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-28T18:39:30.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.425+0000 7fc8efe9a640 1 Processor -- start 2023-11-28T18:39:30.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.425+0000 7fc8efe9a640 1 -- start start 2023-11-28T18:39:30.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.425+0000 7fc8efe9a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc8e80b4310 0x7fc8e80b4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:30.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.425+0000 7fc8efe9a640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8e80b4ca0 con 0x7fc8e8158ce0 2023-11-28T18:39:30.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.425+0000 7fc8efe9a640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8e815b6b0 con 0x7fc8e80cba50 2023-11-28T18:39:30.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.425+0000 7fc8efe9a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8e815c550 con 0x7fc8e80b4310 2023-11-28T18:39:30.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.425+0000 7fc8edc36640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fc8e8158ce0 0x7fc8e815eb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:34450/0 (socket says 172.21.15.45:34450) 2023-11-28T18:39:30.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.425+0000 7fc8edc36640 1 -- 172.21.15.45:0/3720861127 learned_addr learned my addr 172.21.15.45:0/3720861127 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:39:30.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.425+0000 7fc8ee437640 1 --2- 172.21.15.45:0/3720861127 >> v2:172.21.15.45:3300/0 conn(0x7fc8e80b4310 0x7fc8e80b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:30.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.425+0000 7fc8ecc34640 1 -- 172.21.15.45:0/3720861127 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1364327859 0 0) 0x7fc8e4001120 con 0x7fc8e8158ce0 2023-11-28T18:39:30.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.425+0000 7fc8ecc34640 1 -- 172.21.15.45:0/3720861127 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8d4003530 con 0x7fc8e8158ce0 2023-11-28T18:39:30.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.425+0000 7fc8ee437640 1 -- 172.21.15.45:0/3720861127 >> v1:172.21.15.190:6789/0 conn(0x7fc8e80cba50 legacy=0x7fc8e815be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:30.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.425+0000 7fc8ee437640 1 -- 172.21.15.45:0/3720861127 >> v1:172.21.15.45:6789/0 conn(0x7fc8e8158ce0 legacy=0x7fc8e815eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:30.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.425+0000 7fc8ee437640 1 -- 172.21.15.45:0/3720861127 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8e815f450 con 0x7fc8e80b4310 2023-11-28T18:39:30.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.429+0000 7fc8ee437640 1 --2- 172.21.15.45:0/3720861127 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8e80b4310 0x7fc8e80b4760 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fc8e0009d90 tx=0x7fc8e001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fc935c166ac5329 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:30.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.429+0000 7fc8ecc34640 1 -- 172.21.15.45:0/3720861127 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e00a5900 con 0x7fc8e80b4310 2023-11-28T18:39:30.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.429+0000 7fc8ecc34640 1 -- 172.21.15.45:0/3720861127 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8e00a5a60 con 0x7fc8e80b4310 2023-11-28T18:39:30.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.429+0000 7fc8ecc34640 1 -- 172.21.15.45:0/3720861127 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e00a5df0 con 0x7fc8e80b4310 2023-11-28T18:39:30.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.429+0000 7fc8efe9a640 1 -- 172.21.15.45:0/3720861127 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8e80b4310 msgr2=0x7fc8e80b4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:30.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.429+0000 7fc8efe9a640 1 --2- 172.21.15.45:0/3720861127 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8e80b4310 0x7fc8e80b4760 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fc8e0009d90 tx=0x7fc8e001c950 comp rx=0 tx=0).stop 2023-11-28T18:39:30.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.429+0000 7fc8efe9a640 1 -- 172.21.15.45:0/3720861127 shutdown_connections 2023-11-28T18:39:30.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.429+0000 7fc8efe9a640 1 --2- 172.21.15.45:0/3720861127 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8e80b4310 0x7fc8e80b4760 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:30.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.429+0000 7fc8efe9a640 1 -- 172.21.15.45:0/3720861127 >> 172.21.15.45:0/3720861127 conn(0x7fc8e80b0d00 msgr2=0x7fc8e80b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:30.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.429+0000 7fc8efe9a640 1 -- 172.21.15.45:0/3720861127 shutdown_connections 2023-11-28T18:39:30.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.429+0000 7fc8efe9a640 1 -- 172.21.15.45:0/3720861127 wait complete. 2023-11-28T18:39:30.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.433+0000 7fc8efe9a640 1 Processor -- start 2023-11-28T18:39:30.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.433+0000 7fc8efe9a640 1 -- start start 2023-11-28T18:39:30.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.433+0000 7fc8efe9a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc8e80b4310 0x7fc8e80c4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:30.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.433+0000 7fc8efe9a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc8e80cba50 0x7fc8e8165120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:30.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.433+0000 7fc8efe9a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8e8158ce0 0x7fc8e81541e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:30.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.433+0000 7fc8efe9a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e80c5be0 con 0x7fc8e8158ce0 2023-11-28T18:39:30.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.433+0000 7fc8efe9a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e8165660 con 0x7fc8e80b4310 2023-11-28T18:39:30.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.433+0000 7fc8efe9a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e80c4f60 con 0x7fc8e80cba50 2023-11-28T18:39:30.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.433+0000 7fc8ee437640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8e8158ce0 0x7fc8e81541e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:30.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.433+0000 7fc8ee437640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8e8158ce0 0x7fc8e81541e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59014/0 (socket says 172.21.15.45:59014) 2023-11-28T18:39:30.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.433+0000 7fc8ee437640 1 -- 172.21.15.45:0/1777727380 learned_addr learned my addr 172.21.15.45:0/1777727380 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:30.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.433+0000 7fc8edc36640 1 --2- 172.21.15.45:0/1777727380 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc8e80b4310 0x7fc8e80c4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:30.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.433+0000 7fc8ed435640 1 --2- 172.21.15.45:0/1777727380 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc8e80cba50 0x7fc8e8165120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:30.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.433+0000 7fc8ee437640 1 -- 172.21.15.45:0/1777727380 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc8e80cba50 msgr2=0x7fc8e8165120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:30.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.433+0000 7fc8ee437640 1 --2- 172.21.15.45:0/1777727380 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc8e80cba50 0x7fc8e8165120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:30.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.433+0000 7fc8ee437640 1 -- 172.21.15.45:0/1777727380 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc8e80b4310 msgr2=0x7fc8e80c4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:30.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.433+0000 7fc8ee437640 1 --2- 172.21.15.45:0/1777727380 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc8e80b4310 0x7fc8e80c4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:30.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.433+0000 7fc8ee437640 1 -- 172.21.15.45:0/1777727380 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8e0009a70 con 0x7fc8e8158ce0 2023-11-28T18:39:30.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.433+0000 7fc8ed435640 1 --2- 172.21.15.45:0/1777727380 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc8e80cba50 0x7fc8e8165120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:39:30.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.433+0000 7fc8ee437640 1 --2- 172.21.15.45:0/1777727380 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8e8158ce0 0x7fc8e81541e0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fc8e001a580 tx=0x7fc8e00196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:30.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.433+0000 7fc8de7fc640 1 -- 172.21.15.45:0/1777727380 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e00b9860 con 0x7fc8e8158ce0 2023-11-28T18:39:30.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.433+0000 7fc8de7fc640 1 -- 172.21.15.45:0/1777727380 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8e00a58f0 con 0x7fc8e8158ce0 2023-11-28T18:39:30.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.433+0000 7fc8de7fc640 1 -- 172.21.15.45:0/1777727380 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e00b9bc0 con 0x7fc8e8158ce0 2023-11-28T18:39:30.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.433+0000 7fc8efe9a640 1 -- 172.21.15.45:0/1777727380 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8e80c5240 con 0x7fc8e8158ce0 2023-11-28T18:39:30.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.433+0000 7fc8efe9a640 1 -- 172.21.15.45:0/1777727380 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8e80c5800 con 0x7fc8e8158ce0 2023-11-28T18:39:30.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.437+0000 7fc8efe9a640 1 -- 172.21.15.45:0/1777727380 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8e8069410 con 0x7fc8e8158ce0 2023-11-28T18:39:30.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.437+0000 7fc8de7fc640 1 -- 172.21.15.45:0/1777727380 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fc8e00b9d20 con 0x7fc8e8158ce0 2023-11-28T18:39:30.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.437+0000 7fc8de7fc640 1 --2- 172.21.15.45:0/1777727380 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fc8cc0668d0 0x7fc8cc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:30.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.437+0000 7fc8de7fc640 1 -- 172.21.15.45:0/1777727380 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fc8e011f470 con 0x7fc8e8158ce0 2023-11-28T18:39:30.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.437+0000 7fc8edc36640 1 --2- 172.21.15.45:0/1777727380 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fc8cc0668d0 0x7fc8cc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:30.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.437+0000 7fc8edc36640 1 --2- 172.21.15.45:0/1777727380 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fc8cc0668d0 0x7fc8cc068d90 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc8e4001280 tx=0x7fc8e4007bc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:30.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.441+0000 7fc8de7fc640 1 -- 172.21.15.45:0/1777727380 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc8e00ec940 con 0x7fc8e8158ce0 2023-11-28T18:39:30.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.597+0000 7fc8efe9a640 1 -- 172.21.15.45:0/1777727380 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fc8e80b19d0 con 0x7fc8e8158ce0 2023-11-28T18:39:30.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.601+0000 7fc8de7fc640 1 -- 172.21.15.45:0/1777727380 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc8e00eff60 con 0x7fc8e8158ce0 2023-11-28T18:39:30.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.605+0000 7fc8efe9a640 1 -- 172.21.15.45:0/1777727380 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fc8cc0668d0 msgr2=0x7fc8cc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:30.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.605+0000 7fc8efe9a640 1 --2- 172.21.15.45:0/1777727380 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fc8cc0668d0 0x7fc8cc068d90 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc8e4001280 tx=0x7fc8e4007bc0 comp rx=0 tx=0).stop 2023-11-28T18:39:30.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.605+0000 7fc8efe9a640 1 -- 172.21.15.45:0/1777727380 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8e8158ce0 msgr2=0x7fc8e81541e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:30.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.605+0000 7fc8efe9a640 1 --2- 172.21.15.45:0/1777727380 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8e8158ce0 0x7fc8e81541e0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fc8e001a580 tx=0x7fc8e00196f0 comp rx=0 tx=0).stop 2023-11-28T18:39:30.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.605+0000 7fc8efe9a640 1 -- 172.21.15.45:0/1777727380 shutdown_connections 2023-11-28T18:39:30.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.605+0000 7fc8efe9a640 1 --2- 172.21.15.45:0/1777727380 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fc8cc0668d0 0x7fc8cc068d90 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:30.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.605+0000 7fc8efe9a640 1 --2- 172.21.15.45:0/1777727380 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8e8158ce0 0x7fc8e81541e0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:30.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.605+0000 7fc8efe9a640 1 --2- 172.21.15.45:0/1777727380 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc8e80cba50 0x7fc8e8165120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:30.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.605+0000 7fc8efe9a640 1 --2- 172.21.15.45:0/1777727380 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc8e80b4310 0x7fc8e80c4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:30.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.605+0000 7fc8efe9a640 1 -- 172.21.15.45:0/1777727380 >> 172.21.15.45:0/1777727380 conn(0x7fc8e80b0d00 msgr2=0x7fc8e81590c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:30.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.605+0000 7fc8efe9a640 1 -- 172.21.15.45:0/1777727380 shutdown_connections 2023-11-28T18:39:30.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:30.605+0000 7fc8efe9a640 1 -- 172.21.15.45:0/1777727380 wait complete. 2023-11-28T18:39:30.627 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-28T18:39:30.627 DEBUG:teuthology.orchestra.run.smithi045:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T18:39:30.720 DEBUG:teuthology.orchestra.run.smithi190:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T18:39:30.824 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-28T18:39:30.824 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T18:39:30.824 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T18:39:30.834 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357768k,nr_inodes=4089442,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9360 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276000k,nr_inodes=819000,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-28T18:39:30.834 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-28T18:39:30.834 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T18:39:30.844 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354684k,nr_inodes=4088671,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9377 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-28T18:39:30.844 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T18:39:30.844 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T18:39:30.886 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357768k,nr_inodes=4089442,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9360 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276000k,nr_inodes=819000,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-28T18:39:30.886 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-28T18:39:30.886 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T18:39:30.897 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354684k,nr_inodes=4088671,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9377 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-28T18:39:30.897 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-28T18:39:30.897 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T18:39:31.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.073+0000 7f50e0f57640 1 Processor -- start 2023-11-28T18:39:31.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.073+0000 7f50e0f57640 1 -- start start 2023-11-28T18:39:31.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.073+0000 7f50e0f57640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f50dc06c300 0x7f50dc06cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:31.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.073+0000 7f50e0f57640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50dc0704a0 con 0x7f50dc06c6e0 2023-11-28T18:39:31.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.073+0000 7f50e0f57640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50dc15ab60 con 0x7f50dc1509a0 2023-11-28T18:39:31.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.073+0000 7f50e0f57640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50dc0706d0 con 0x7f50dc06c300 2023-11-28T18:39:31.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.073+0000 7f50da59c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f50dc06c300 0x7f50dc06cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:31.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.073+0000 7f50da59c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f50dc06c300 0x7f50dc06cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59024/0 (socket says 172.21.15.45:59024) 2023-11-28T18:39:31.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.073+0000 7f50d3fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f50dc06c6e0 0x7f50dc150290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:34462/0 (socket says 172.21.15.45:34462) 2023-11-28T18:39:31.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.073+0000 7f50da59c640 1 -- 172.21.15.45:0/225553074 learned_addr learned my addr 172.21.15.45:0/225553074 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:31.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.077+0000 7f50da59c640 1 -- 172.21.15.45:0/225553074 >> v1:172.21.15.190:6789/0 conn(0x7f50dc1509a0 legacy=0x7f50dc159de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:31.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.077+0000 7f50da59c640 1 -- 172.21.15.45:0/225553074 >> v1:172.21.15.45:6789/0 conn(0x7f50dc06c6e0 legacy=0x7f50dc150290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:31.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.077+0000 7f50da59c640 1 -- 172.21.15.45:0/225553074 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50dc0709b0 con 0x7f50dc06c300 2023-11-28T18:39:31.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.077+0000 7f50da59c640 1 --2- 172.21.15.45:0/225553074 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50dc06c300 0x7f50dc06cdf0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f50cc009870 tx=0x7f50cc01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a61ee01bd1b35e3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:31.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.077+0000 7f50d9d9b640 1 -- 172.21.15.45:0/225553074 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50cc0ab600 con 0x7f50dc06c300 2023-11-28T18:39:31.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.077+0000 7f50d9d9b640 1 -- 172.21.15.45:0/225553074 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50cc0a7050 con 0x7f50dc06c300 2023-11-28T18:39:31.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.077+0000 7f50d9d9b640 1 -- 172.21.15.45:0/225553074 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50cc0ab980 con 0x7f50dc06c300 2023-11-28T18:39:31.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.077+0000 7f50e0f57640 1 -- 172.21.15.45:0/225553074 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50dc06c300 msgr2=0x7f50dc06cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:31.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.077+0000 7f50e0f57640 1 --2- 172.21.15.45:0/225553074 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50dc06c300 0x7f50dc06cdf0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f50cc009870 tx=0x7f50cc01c500 comp rx=0 tx=0).stop 2023-11-28T18:39:31.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.081+0000 7f50e0f57640 1 -- 172.21.15.45:0/225553074 shutdown_connections 2023-11-28T18:39:31.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.081+0000 7f50e0f57640 1 --2- 172.21.15.45:0/225553074 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50dc06c300 0x7f50dc06cdf0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:31.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.081+0000 7f50e0f57640 1 -- 172.21.15.45:0/225553074 >> 172.21.15.45:0/225553074 conn(0x7f50dc06a570 msgr2=0x7f50dc06a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:31.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.081+0000 7f50e0f57640 1 -- 172.21.15.45:0/225553074 shutdown_connections 2023-11-28T18:39:31.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.081+0000 7f50e0f57640 1 -- 172.21.15.45:0/225553074 wait complete. 2023-11-28T18:39:31.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.081+0000 7f50e0f57640 1 Processor -- start 2023-11-28T18:39:31.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.081+0000 7f50e0f57640 1 -- start start 2023-11-28T18:39:31.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.081+0000 7f50e0f57640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50dc06c300 0x7f50dc153890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:31.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.081+0000 7f50e0f57640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50dc06c6e0 0x7f50dc14d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:31.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.081+0000 7f50e0f57640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50dc1509a0 0x7f50dc14fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:31.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.081+0000 7f50e0f57640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50dc151120 con 0x7f50dc06c6e0 2023-11-28T18:39:31.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.081+0000 7f50e0f57640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50dc151400 con 0x7f50dc06c300 2023-11-28T18:39:31.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.081+0000 7f50e0f57640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50dc1516e0 con 0x7f50dc1509a0 2023-11-28T18:39:31.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.081+0000 7f50d3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50dc06c6e0 0x7f50dc14d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:31.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.081+0000 7f50d3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50dc06c6e0 0x7f50dc14d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59036/0 (socket says 172.21.15.45:59036) 2023-11-28T18:39:31.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.081+0000 7f50d3fff640 1 -- 172.21.15.45:0/706481295 learned_addr learned my addr 172.21.15.45:0/706481295 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:31.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.081+0000 7f50da59c640 1 --2- 172.21.15.45:0/706481295 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50dc06c300 0x7f50dc153890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:31.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.081+0000 7f50dad9d640 1 --2- 172.21.15.45:0/706481295 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50dc1509a0 0x7f50dc14fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:31.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.081+0000 7f50d3fff640 1 -- 172.21.15.45:0/706481295 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50dc1509a0 msgr2=0x7f50dc14fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:31.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.081+0000 7f50d3fff640 1 --2- 172.21.15.45:0/706481295 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50dc1509a0 0x7f50dc14fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:31.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.081+0000 7f50d3fff640 1 -- 172.21.15.45:0/706481295 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50dc06c300 msgr2=0x7f50dc153890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:31.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.081+0000 7f50d3fff640 1 --2- 172.21.15.45:0/706481295 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50dc06c300 0x7f50dc153890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:31.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.081+0000 7f50d3fff640 1 -- 172.21.15.45:0/706481295 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50cc0094d0 con 0x7f50dc06c6e0 2023-11-28T18:39:31.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.081+0000 7f50dad9d640 1 --2- 172.21.15.45:0/706481295 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50dc1509a0 0x7f50dc14fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:39:31.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.085+0000 7f50d3fff640 1 --2- 172.21.15.45:0/706481295 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50dc06c6e0 0x7f50dc14d050 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f50c400c420 tx=0x7f50c400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:31.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.085+0000 7f50d2ffd640 1 -- 172.21.15.45:0/706481295 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c40074e0 con 0x7f50dc06c6e0 2023-11-28T18:39:31.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.085+0000 7f50d2ffd640 1 -- 172.21.15.45:0/706481295 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50c4007640 con 0x7f50dc06c6e0 2023-11-28T18:39:31.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.085+0000 7f50d2ffd640 1 -- 172.21.15.45:0/706481295 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c4004a30 con 0x7f50dc06c6e0 2023-11-28T18:39:31.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.085+0000 7f50e0f57640 1 -- 172.21.15.45:0/706481295 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50dc1519c0 con 0x7f50dc06c6e0 2023-11-28T18:39:31.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.085+0000 7f50e0f57640 1 -- 172.21.15.45:0/706481295 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50dc150db0 con 0x7f50dc06c6e0 2023-11-28T18:39:31.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.085+0000 7f50e0f57640 1 -- 172.21.15.45:0/706481295 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50dc06af20 con 0x7f50dc06c6e0 2023-11-28T18:39:31.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.085+0000 7f50d2ffd640 1 -- 172.21.15.45:0/706481295 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f50c4004b90 con 0x7f50dc06c6e0 2023-11-28T18:39:31.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.085+0000 7f50d2ffd640 1 --2- 172.21.15.45:0/706481295 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f50bc0668d0 0x7f50bc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:31.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.085+0000 7f50d2ffd640 1 -- 172.21.15.45:0/706481295 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f50c4083b70 con 0x7f50dc06c6e0 2023-11-28T18:39:31.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.085+0000 7f50da59c640 1 --2- 172.21.15.45:0/706481295 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f50bc0668d0 0x7f50bc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:31.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.089+0000 7f50da59c640 1 --2- 172.21.15.45:0/706481295 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f50bc0668d0 0x7f50bc068d90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f50cc0ad000 tx=0x7f50cc0a4f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:31.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.089+0000 7f50d2ffd640 1 -- 172.21.15.45:0/706481295 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f50c4051030 con 0x7f50dc06c6e0 2023-11-28T18:39:31.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.277+0000 7f50e0f57640 1 -- 172.21.15.45:0/706481295 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f50dc069480 con 0x7f50dc06c6e0 2023-11-28T18:39:31.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.281+0000 7f50d2ffd640 1 -- 172.21.15.45:0/706481295 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+3702 (secure 0 0 0) 0x7f50c4054650 con 0x7f50dc06c6e0 2023-11-28T18:39:31.283 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:39:31.283 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":26,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5188,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/270858280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":270858280},{"type":"v1","addr":"172.21.15.190:6836","nonce":270858280}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5191,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/4006352118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":4006352118},{"type":"v1","addr":"172.21.15.190:6837","nonce":4006352118}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5197,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2204012451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":2204012451},{"type":"v1","addr":"172.21.15.45:6835","nonce":2204012451}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5895,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/4008052795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":4008052795},{"type":"v1","addr":"172.21.15.45:6834","nonce":4008052795}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26}],"filesystems":[]} 2023-11-28T18:39:31.283 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 26 2023-11-28T18:39:31.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.281+0000 7f50e0f57640 1 -- 172.21.15.45:0/706481295 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f50bc0668d0 msgr2=0x7f50bc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:31.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.281+0000 7f50e0f57640 1 --2- 172.21.15.45:0/706481295 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f50bc0668d0 0x7f50bc068d90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f50cc0ad000 tx=0x7f50cc0a4f90 comp rx=0 tx=0).stop 2023-11-28T18:39:31.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.281+0000 7f50e0f57640 1 -- 172.21.15.45:0/706481295 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50dc06c6e0 msgr2=0x7f50dc14d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:31.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.281+0000 7f50e0f57640 1 --2- 172.21.15.45:0/706481295 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50dc06c6e0 0x7f50dc14d050 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f50c400c420 tx=0x7f50c400c8e0 comp rx=0 tx=0).stop 2023-11-28T18:39:31.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.281+0000 7f50e0f57640 1 -- 172.21.15.45:0/706481295 shutdown_connections 2023-11-28T18:39:31.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.281+0000 7f50e0f57640 1 --2- 172.21.15.45:0/706481295 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f50bc0668d0 0x7f50bc068d90 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:31.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.281+0000 7f50e0f57640 1 --2- 172.21.15.45:0/706481295 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50dc1509a0 0x7f50dc14fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:31.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.281+0000 7f50e0f57640 1 --2- 172.21.15.45:0/706481295 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50dc06c6e0 0x7f50dc14d050 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:31.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.281+0000 7f50e0f57640 1 --2- 172.21.15.45:0/706481295 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50dc06c300 0x7f50dc153890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:31.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.281+0000 7f50e0f57640 1 -- 172.21.15.45:0/706481295 >> 172.21.15.45:0/706481295 conn(0x7f50dc06a570 msgr2=0x7f50dc168cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:31.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.281+0000 7f50e0f57640 1 -- 172.21.15.45:0/706481295 shutdown_connections 2023-11-28T18:39:31.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.281+0000 7f50e0f57640 1 -- 172.21.15.45:0/706481295 wait complete. 2023-11-28T18:39:31.304 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-28T18:39:31.304 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-28T18:39:31.305 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-28T18:39:31.305 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T18:39:31.305 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-28T18:39:31.305 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-28T18:39:31.305 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-28T18:39:31.305 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T18:39:31.306 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-28T18:39:31.306 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-28T18:39:31.306 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-28T18:39:31.306 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T18:39:31.306 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-28T18:39:31.306 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-28T18:39:31.307 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-28T18:39:31.307 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T18:39:31.317 INFO:tasks.ceph.mds.c:Stopped 2023-11-28T18:39:31.318 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-28T18:39:31.318 INFO:tasks.ceph.mds.a:Stopped 2023-11-28T18:39:31.319 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-28T18:39:31.323 INFO:tasks.ceph.mds.b:Stopped 2023-11-28T18:39:31.324 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-28T18:39:31.324 INFO:tasks.ceph.mds.d:Stopped 2023-11-28T18:39:31.325 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-28T18:39:31.365 INFO:tasks.ceph.mds.c:Started 2023-11-28T18:39:31.366 DEBUG:teuthology.parallel:result is None 2023-11-28T18:39:31.367 INFO:tasks.ceph.mds.a:Started 2023-11-28T18:39:31.368 DEBUG:teuthology.parallel:result is None 2023-11-28T18:39:31.372 INFO:tasks.ceph.mds.b:Started 2023-11-28T18:39:31.372 DEBUG:teuthology.parallel:result is None 2023-11-28T18:39:31.374 INFO:tasks.ceph.mds.d:Started 2023-11-28T18:39:31.374 DEBUG:teuthology.parallel:result is None 2023-11-28T18:39:31.375 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-28T18:39:31.453 INFO:tasks.ceph.mds.c.smithi045.stdout:starting mds.c at 2023-11-28T18:39:31.453 INFO:tasks.ceph.mds.a.smithi045.stdout:starting mds.a at 2023-11-28T18:39:31.466 INFO:tasks.ceph.mds.d.smithi190.stdout:starting mds.d at 2023-11-28T18:39:31.467 INFO:tasks.ceph.mds.b.smithi190.stdout:starting mds.b at 2023-11-28T18:39:31.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.521+0000 7ff5c153e640 1 Processor -- start 2023-11-28T18:39:31.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.521+0000 7ff5c153e640 1 -- start start 2023-11-28T18:39:31.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.521+0000 7ff5c153e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff5bc146c00 0x7ff5bc15e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:31.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.521+0000 7ff5c153e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff5bc06e8f0 0x7ff5bc06ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:31.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.521+0000 7ff5c153e640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5bc146fe0 con 0x7ff5bc0b2bb0 2023-11-28T18:39:31.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.521+0000 7ff5c153e640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5bc15e970 con 0x7ff5bc06e8f0 2023-11-28T18:39:31.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.521+0000 7ff5c153e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5bc06f390 con 0x7ff5bc146c00 2023-11-28T18:39:31.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.521+0000 7ff5b3fff640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff5bc06e8f0 0x7ff5bc06ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:31.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.521+0000 7ff5baffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff5bc146c00 0x7ff5bc15e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:31.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.521+0000 7ff5baffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff5bc146c00 0x7ff5bc15e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.45:57076/0 (socket says 172.21.15.45:57076) 2023-11-28T18:39:31.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.521+0000 7ff5bb7fe640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7ff5bc0b2bb0 0x7ff5bc160f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.45:39420/0 (socket says 172.21.15.45:39420) 2023-11-28T18:39:31.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.521+0000 7ff5b3fff640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff5bc06e8f0 0x7ff5bc06ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.45:37478/0 (socket says 172.21.15.45:37478) 2023-11-28T18:39:31.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.521+0000 7ff5baffd640 1 -- 172.21.15.45:0/1716670531 learned_addr learned my addr 172.21.15.45:0/1716670531 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:31.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.525+0000 7ff5baffd640 1 -- 172.21.15.45:0/1716670531 >> v2:172.21.15.190:3300/0 conn(0x7ff5bc06e8f0 msgr2=0x7ff5bc06ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:31.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.525+0000 7ff5baffd640 1 --2- 172.21.15.45:0/1716670531 >> v2:172.21.15.190:3300/0 conn(0x7ff5bc06e8f0 0x7ff5bc06ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:31.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.525+0000 7ff5baffd640 1 -- 172.21.15.45:0/1716670531 >> v1:172.21.15.190:6789/0 conn(0x7ff5bc0b2bb0 legacy=0x7ff5bc160f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:31.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.525+0000 7ff5baffd640 1 -- 172.21.15.45:0/1716670531 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5bc06f670 con 0x7ff5bc146c00 2023-11-28T18:39:31.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.525+0000 7ff5b3fff640 1 --2- 172.21.15.45:0/1716670531 >> v2:172.21.15.190:3300/0 conn(0x7ff5bc06e8f0 0x7ff5bc06ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:39:31.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.525+0000 7ff5baffd640 1 --2- 172.21.15.45:0/1716670531 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff5bc146c00 0x7ff5bc15e430 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac009870 tx=0x7ff5ac01c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=426a6cc5a86dcc50 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:31.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.525+0000 7ff5ba7fc640 1 -- 172.21.15.45:0/1716670531 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac0aa670 con 0x7ff5bc146c00 2023-11-28T18:39:31.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.525+0000 7ff5ba7fc640 1 -- 172.21.15.45:0/1716670531 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5ac0aa7d0 con 0x7ff5bc146c00 2023-11-28T18:39:31.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.525+0000 7ff5ba7fc640 1 -- 172.21.15.45:0/1716670531 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac0aab60 con 0x7ff5bc146c00 2023-11-28T18:39:31.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.525+0000 7ff5c153e640 1 -- 172.21.15.45:0/1716670531 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff5bc146c00 msgr2=0x7ff5bc15e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:31.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.525+0000 7ff5c153e640 1 --2- 172.21.15.45:0/1716670531 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff5bc146c00 0x7ff5bc15e430 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac009870 tx=0x7ff5ac01c510 comp rx=0 tx=0).stop 2023-11-28T18:39:31.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.525+0000 7ff5c153e640 1 -- 172.21.15.45:0/1716670531 shutdown_connections 2023-11-28T18:39:31.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.525+0000 7ff5c153e640 1 --2- 172.21.15.45:0/1716670531 >> v2:172.21.15.190:3300/0 conn(0x7ff5bc06e8f0 0x7ff5bc06ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:31.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.525+0000 7ff5c153e640 1 --2- 172.21.15.45:0/1716670531 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff5bc146c00 0x7ff5bc15e430 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:31.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.525+0000 7ff5c153e640 1 -- 172.21.15.45:0/1716670531 >> 172.21.15.45:0/1716670531 conn(0x7ff5bc06a570 msgr2=0x7ff5bc06a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:31.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.529+0000 7ff5c153e640 1 -- 172.21.15.45:0/1716670531 shutdown_connections 2023-11-28T18:39:31.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.529+0000 7ff5c153e640 1 -- 172.21.15.45:0/1716670531 wait complete. 2023-11-28T18:39:31.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.529+0000 7ff5c153e640 1 Processor -- start 2023-11-28T18:39:31.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.529+0000 7ff5c153e640 1 -- start start 2023-11-28T18:39:31.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.529+0000 7ff5c153e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff5bc06e8f0 0x7ff5bc13ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:31.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.529+0000 7ff5c153e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff5bc0b2bb0 0x7ff5bc15c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:31.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.529+0000 7ff5c153e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5bc146c00 0x7ff5bc142260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:31.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.529+0000 7ff5c153e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5bc140f30 con 0x7ff5bc146c00 2023-11-28T18:39:31.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.529+0000 7ff5c153e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5bc141210 con 0x7ff5bc06e8f0 2023-11-28T18:39:31.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.529+0000 7ff5c153e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5bc1414f0 con 0x7ff5bc0b2bb0 2023-11-28T18:39:31.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.529+0000 7ff5b3fff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff5bc0b2bb0 0x7ff5bc15c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:31.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.529+0000 7ff5baffd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff5bc06e8f0 0x7ff5bc13ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:31.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.529+0000 7ff5b3fff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff5bc0b2bb0 0x7ff5bc15c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.45:57082/0 (socket says 172.21.15.45:57082) 2023-11-28T18:39:31.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.529+0000 7ff5bb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5bc146c00 0x7ff5bc142260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:31.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.529+0000 7ff5b3fff640 1 -- 172.21.15.45:0/2507752235 learned_addr learned my addr 172.21.15.45:0/2507752235 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:31.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.529+0000 7ff5baffd640 1 -- 172.21.15.45:0/2507752235 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff5bc0b2bb0 msgr2=0x7ff5bc15c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:31.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.529+0000 7ff5baffd640 1 --2- 172.21.15.45:0/2507752235 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff5bc0b2bb0 0x7ff5bc15c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:31.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.529+0000 7ff5baffd640 1 -- 172.21.15.45:0/2507752235 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5bc146c00 msgr2=0x7ff5bc142260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:31.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.529+0000 7ff5baffd640 1 --2- 172.21.15.45:0/2507752235 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5bc146c00 0x7ff5bc142260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:31.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.529+0000 7ff5baffd640 1 -- 172.21.15.45:0/2507752235 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a4009420 con 0x7ff5bc06e8f0 2023-11-28T18:39:31.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.529+0000 7ff5baffd640 1 --2- 172.21.15.45:0/2507752235 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff5bc06e8f0 0x7ff5bc13ea40 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac0ab000 tx=0x7ff5ac01ad50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:31.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.533+0000 7ff5b37fe640 1 -- 172.21.15.45:0/2507752235 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac0b3800 con 0x7ff5bc06e8f0 2023-11-28T18:39:31.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.533+0000 7ff5b37fe640 1 -- 172.21.15.45:0/2507752235 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5ac0b3980 con 0x7ff5bc06e8f0 2023-11-28T18:39:31.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.533+0000 7ff5b37fe640 1 -- 172.21.15.45:0/2507752235 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac0b3d30 con 0x7ff5bc06e8f0 2023-11-28T18:39:31.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.533+0000 7ff5c153e640 1 -- 172.21.15.45:0/2507752235 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5ac0094d0 con 0x7ff5bc06e8f0 2023-11-28T18:39:31.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.533+0000 7ff5c153e640 1 -- 172.21.15.45:0/2507752235 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5bc0b3550 con 0x7ff5bc06e8f0 2023-11-28T18:39:31.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.533+0000 7ff5c153e640 1 -- 172.21.15.45:0/2507752235 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5bc141a10 con 0x7ff5bc06e8f0 2023-11-28T18:39:31.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.533+0000 7ff5b37fe640 1 -- 172.21.15.45:0/2507752235 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ff5ac0059a0 con 0x7ff5bc06e8f0 2023-11-28T18:39:31.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.533+0000 7ff5b37fe640 1 --2- 172.21.15.45:0/2507752235 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff59c0668d0 0x7ff59c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:31.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.533+0000 7ff5b37fe640 1 -- 172.21.15.45:0/2507752235 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5029+0+0 (secure 0 0 0) 0x7ff5ac11e9a0 con 0x7ff5bc06e8f0 2023-11-28T18:39:31.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.533+0000 7ff5b3fff640 1 --2- 172.21.15.45:0/2507752235 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff59c0668d0 0x7ff59c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:31.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.537+0000 7ff5b3fff640 1 --2- 172.21.15.45:0/2507752235 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff59c0668d0 0x7ff59c068d90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc1f9ca0 tx=0x7ff5a4009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:31.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.537+0000 7ff5b37fe640 1 -- 172.21.15.45:0/2507752235 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff5ac0ebfa0 con 0x7ff5bc06e8f0 2023-11-28T18:39:31.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:31.713+0000 7ff5c153e640 1 -- 172.21.15.45:0/2507752235 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7ff5bc141630 con 0x7ff5bc06e8f0 2023-11-28T18:39:32.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.273+0000 7ff5b37fe640 1 -- 172.21.15.45:0/2507752235 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v40) v1 ==== 97+0+0 (secure 0 0 0) 0x7ff5bc141630 con 0x7ff5bc06e8f0 2023-11-28T18:39:32.277 INFO:teuthology.orchestra.run.smithi045.stderr: removed all blocklist entries 2023-11-28T18:39:32.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.277+0000 7ff5c153e640 1 -- 172.21.15.45:0/2507752235 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff59c0668d0 msgr2=0x7ff59c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:32.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.277+0000 7ff5c153e640 1 --2- 172.21.15.45:0/2507752235 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff59c0668d0 0x7ff59c068d90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc1f9ca0 tx=0x7ff5a4009190 comp rx=0 tx=0).stop 2023-11-28T18:39:32.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.277+0000 7ff5c153e640 1 -- 172.21.15.45:0/2507752235 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff5bc06e8f0 msgr2=0x7ff5bc13ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:32.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.277+0000 7ff5c153e640 1 --2- 172.21.15.45:0/2507752235 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff5bc06e8f0 0x7ff5bc13ea40 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac0ab000 tx=0x7ff5ac01ad50 comp rx=0 tx=0).stop 2023-11-28T18:39:32.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.277+0000 7ff5c153e640 1 -- 172.21.15.45:0/2507752235 shutdown_connections 2023-11-28T18:39:32.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.277+0000 7ff5c153e640 1 --2- 172.21.15.45:0/2507752235 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff59c0668d0 0x7ff59c068d90 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:32.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.277+0000 7ff5c153e640 1 --2- 172.21.15.45:0/2507752235 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5bc146c00 0x7ff5bc142260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:32.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.277+0000 7ff5c153e640 1 --2- 172.21.15.45:0/2507752235 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff5bc0b2bb0 0x7ff5bc15c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:32.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.277+0000 7ff5c153e640 1 --2- 172.21.15.45:0/2507752235 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff5bc06e8f0 0x7ff5bc13ea40 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:32.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.277+0000 7ff5c153e640 1 -- 172.21.15.45:0/2507752235 >> 172.21.15.45:0/2507752235 conn(0x7ff5bc06a570 msgr2=0x7ff5bc0734a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:32.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.277+0000 7ff5c153e640 1 -- 172.21.15.45:0/2507752235 shutdown_connections 2023-11-28T18:39:32.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.277+0000 7ff5c153e640 1 -- 172.21.15.45:0/2507752235 wait complete. 2023-11-28T18:39:32.304 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-28T18:39:32.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.449+0000 7fd2456dd640 1 Processor -- start 2023-11-28T18:39:32.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.449+0000 7fd2456dd640 1 -- start start 2023-11-28T18:39:32.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.449+0000 7fd2456dd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd2400b3cb0 0x7fd2400d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:32.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.449+0000 7fd2456dd640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2400d38c0 con 0x7fd2400b35f0 2023-11-28T18:39:32.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.449+0000 7fd2456dd640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2400cdcc0 con 0x7fd2400cfed0 2023-11-28T18:39:32.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.449+0000 7fd2456dd640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2400d40d0 con 0x7fd2400b3cb0 2023-11-28T18:39:32.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.449+0000 7fd23effd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd2400b35f0 0x7fd2400cf7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:34498/0 (socket says 172.21.15.45:34498) 2023-11-28T18:39:32.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.449+0000 7fd23effd640 1 -- 172.21.15.45:0/3591472034 learned_addr learned my addr 172.21.15.45:0/3591472034 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:39:32.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.449+0000 7fd23f7fe640 1 --2- 172.21.15.45:0/3591472034 >> v2:172.21.15.190:3300/0 conn(0x7fd2400b3cb0 0x7fd2400d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:32.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.449+0000 7fd23e7fc640 1 -- 172.21.15.45:0/3591472034 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 756623933 0 0) 0x7fd2400d38c0 con 0x7fd2400b35f0 2023-11-28T18:39:32.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.449+0000 7fd23e7fc640 1 -- 172.21.15.45:0/3591472034 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd22c003530 con 0x7fd2400b35f0 2023-11-28T18:39:32.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.449+0000 7fd23e7fc640 1 -- 172.21.15.45:0/3591472034 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 73821203 0 0) 0x7fd2400cdcc0 con 0x7fd2400cfed0 2023-11-28T18:39:32.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.449+0000 7fd23e7fc640 1 -- 172.21.15.45:0/3591472034 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2400d38c0 con 0x7fd2400cfed0 2023-11-28T18:39:32.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.449+0000 7fd23f7fe640 1 -- 172.21.15.45:0/3591472034 >> v1:172.21.15.190:6789/0 conn(0x7fd2400cfed0 legacy=0x7fd2400ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:32.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.449+0000 7fd23f7fe640 1 -- 172.21.15.45:0/3591472034 >> v1:172.21.15.45:6789/0 conn(0x7fd2400b35f0 legacy=0x7fd2400cf7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:32.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.449+0000 7fd23f7fe640 1 -- 172.21.15.45:0/3591472034 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2400d3b10 con 0x7fd2400b3cb0 2023-11-28T18:39:32.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.453+0000 7fd23f7fe640 1 --2- 172.21.15.45:0/3591472034 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd2400b3cb0 0x7fd2400d0f90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd2380097c0 tx=0x7fd23801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bbccfe60af6ff8de server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:32.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.453+0000 7fd23e7fc640 1 -- 172.21.15.45:0/3591472034 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2380ab650 con 0x7fd2400b3cb0 2023-11-28T18:39:32.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.453+0000 7fd23e7fc640 1 -- 172.21.15.45:0/3591472034 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2380ab7b0 con 0x7fd2400b3cb0 2023-11-28T18:39:32.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.453+0000 7fd23e7fc640 1 -- 172.21.15.45:0/3591472034 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2380abb40 con 0x7fd2400b3cb0 2023-11-28T18:39:32.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.453+0000 7fd2456dd640 1 -- 172.21.15.45:0/3591472034 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd2400b3cb0 msgr2=0x7fd2400d0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:32.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.453+0000 7fd2456dd640 1 --2- 172.21.15.45:0/3591472034 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd2400b3cb0 0x7fd2400d0f90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd2380097c0 tx=0x7fd23801c450 comp rx=0 tx=0).stop 2023-11-28T18:39:32.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.453+0000 7fd2456dd640 1 -- 172.21.15.45:0/3591472034 shutdown_connections 2023-11-28T18:39:32.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.453+0000 7fd2456dd640 1 --2- 172.21.15.45:0/3591472034 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd2400b3cb0 0x7fd2400d0f90 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:32.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.453+0000 7fd2456dd640 1 -- 172.21.15.45:0/3591472034 >> 172.21.15.45:0/3591472034 conn(0x7fd24009c4f0 msgr2=0x7fd2400d31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:32.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.453+0000 7fd2456dd640 1 -- 172.21.15.45:0/3591472034 shutdown_connections 2023-11-28T18:39:32.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.453+0000 7fd2456dd640 1 -- 172.21.15.45:0/3591472034 wait complete. 2023-11-28T18:39:32.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.457+0000 7fd2456dd640 1 Processor -- start 2023-11-28T18:39:32.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.457+0000 7fd2456dd640 1 -- start start 2023-11-28T18:39:32.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.457+0000 7fd2456dd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd2400b35f0 0x7fd24014fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:32.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.457+0000 7fd2456dd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2400b3cb0 0x7fd240150c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:32.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.457+0000 7fd2456dd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd2400cfed0 0x7fd24006c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:32.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.457+0000 7fd2456dd640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd240150090 con 0x7fd2400b3cb0 2023-11-28T18:39:32.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.457+0000 7fd2456dd640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd240151480 con 0x7fd2400cfed0 2023-11-28T18:39:32.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.457+0000 7fd2456dd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd240151760 con 0x7fd2400b35f0 2023-11-28T18:39:32.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.457+0000 7fd2367fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2400b3cb0 0x7fd240150c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:32.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.457+0000 7fd2367fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2400b3cb0 0x7fd240150c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59092/0 (socket says 172.21.15.45:59092) 2023-11-28T18:39:32.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.457+0000 7fd2367fc640 1 -- 172.21.15.45:0/200495055 learned_addr learned my addr 172.21.15.45:0/200495055 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:32.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.457+0000 7fd23effd640 1 --2- 172.21.15.45:0/200495055 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd2400b35f0 0x7fd24014fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:32.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.457+0000 7fd23f7fe640 1 --2- 172.21.15.45:0/200495055 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd2400cfed0 0x7fd24006c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:32.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.457+0000 7fd2367fc640 1 -- 172.21.15.45:0/200495055 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd2400b35f0 msgr2=0x7fd24014fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:32.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.457+0000 7fd2367fc640 1 --2- 172.21.15.45:0/200495055 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd2400b35f0 0x7fd24014fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:32.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.457+0000 7fd2367fc640 1 -- 172.21.15.45:0/200495055 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd2400cfed0 msgr2=0x7fd24006c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:32.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.457+0000 7fd2367fc640 1 --2- 172.21.15.45:0/200495055 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd2400cfed0 0x7fd24006c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:32.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.457+0000 7fd2367fc640 1 -- 172.21.15.45:0/200495055 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd238009420 con 0x7fd2400b3cb0 2023-11-28T18:39:32.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.457+0000 7fd23f7fe640 1 --2- 172.21.15.45:0/200495055 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd2400cfed0 0x7fd24006c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:39:32.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.457+0000 7fd23effd640 1 --2- 172.21.15.45:0/200495055 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd2400b35f0 0x7fd24014fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:39:32.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.457+0000 7fd2367fc640 1 --2- 172.21.15.45:0/200495055 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2400b3cb0 0x7fd240150c50 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fd22800c770 tx=0x7fd22800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:32.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.457+0000 7fd237fff640 1 -- 172.21.15.45:0/200495055 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd228003b80 con 0x7fd2400b3cb0 2023-11-28T18:39:32.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.457+0000 7fd237fff640 1 -- 172.21.15.45:0/200495055 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd228003ce0 con 0x7fd2400b3cb0 2023-11-28T18:39:32.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.457+0000 7fd237fff640 1 -- 172.21.15.45:0/200495055 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22800aa90 con 0x7fd2400b3cb0 2023-11-28T18:39:32.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.457+0000 7fd2456dd640 1 -- 172.21.15.45:0/200495055 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd240151a40 con 0x7fd2400b3cb0 2023-11-28T18:39:32.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.457+0000 7fd2456dd640 1 -- 172.21.15.45:0/200495055 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd240152000 con 0x7fd2400b3cb0 2023-11-28T18:39:32.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.461+0000 7fd2456dd640 1 -- 172.21.15.45:0/200495055 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2400d18b0 con 0x7fd2400b3cb0 2023-11-28T18:39:32.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.461+0000 7fd237fff640 1 -- 172.21.15.45:0/200495055 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fd22800abf0 con 0x7fd2400b3cb0 2023-11-28T18:39:32.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.461+0000 7fd237fff640 1 --2- 172.21.15.45:0/200495055 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fd2200668d0 0x7fd220068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:32.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.461+0000 7fd237fff640 1 -- 172.21.15.45:0/200495055 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd228083fe0 con 0x7fd2400b3cb0 2023-11-28T18:39:32.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.461+0000 7fd23effd640 1 --2- 172.21.15.45:0/200495055 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fd2200668d0 0x7fd220068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:32.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.461+0000 7fd23effd640 1 --2- 172.21.15.45:0/200495055 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fd2200668d0 0x7fd220068d90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd2300011f0 tx=0x7fd230009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:32.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.465+0000 7fd237fff640 1 -- 172.21.15.45:0/200495055 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd2280515a0 con 0x7fd2400b3cb0 2023-11-28T18:39:32.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.681+0000 7fd2456dd640 1 -- 172.21.15.45:0/200495055 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fd2401521f0 con 0x7fd2400b3cb0 2023-11-28T18:39:32.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.681+0000 7fd237fff640 1 -- 172.21.15.45:0/200495055 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fd228054bc0 con 0x7fd2400b3cb0 2023-11-28T18:39:32.686 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:39:32.686 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-11-28T18:39:32.686 INFO:teuthology.orchestra.run.smithi045.stdout: "auth_dump": [ 2023-11-28T18:39:32.686 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T18:39:32.686 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.a", 2023-11-28T18:39:32.686 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQApM2ZlwyjdFxAAPGPzbFeQHiSnfmd6fx12HA==", 2023-11-28T18:39:32.686 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T18:39:32.686 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-11-28T18:39:32.687 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-11-28T18:39:32.687 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-11-28T18:39:32.687 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T18:39:32.687 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:39:32.687 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:39:32.687 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T18:39:32.687 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.b", 2023-11-28T18:39:32.687 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQApM2ZlrJe9JBAAV2uXCF1nOYAUZf9Vm6BIWQ==", 2023-11-28T18:39:32.687 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T18:39:32.687 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-11-28T18:39:32.687 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-11-28T18:39:32.687 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-11-28T18:39:32.688 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T18:39:32.688 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:39:32.688 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:39:32.688 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T18:39:32.688 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.c", 2023-11-28T18:39:32.688 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQApM2Zl7guBHxAA42VxKvKwW30qtt+nyQZ4Aw==", 2023-11-28T18:39:32.688 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T18:39:32.688 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-11-28T18:39:32.688 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-11-28T18:39:32.688 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-11-28T18:39:32.689 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T18:39:32.689 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:39:32.689 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:39:32.689 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T18:39:32.689 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.d", 2023-11-28T18:39:32.689 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQApM2Zl1xU7LBAAHQ+Co90EW5qv+8793OyE/A==", 2023-11-28T18:39:32.689 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T18:39:32.689 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-11-28T18:39:32.689 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-11-28T18:39:32.689 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-11-28T18:39:32.689 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T18:39:32.689 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:39:32.690 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:39:32.690 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T18:39:32.690 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.0", 2023-11-28T18:39:32.690 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQArM2ZluGYOEhAAOKSw2u1izQOjdoRctC8s7g==", 2023-11-28T18:39:32.690 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T18:39:32.690 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-11-28T18:39:32.690 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-11-28T18:39:32.690 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T18:39:32.690 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:39:32.690 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:39:32.690 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T18:39:32.690 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.1", 2023-11-28T18:39:32.691 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAuM2ZlIFuuGRAAK+YCnRUy8yKlojp9gukUYw==", 2023-11-28T18:39:32.691 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T18:39:32.691 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-11-28T18:39:32.691 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-11-28T18:39:32.691 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T18:39:32.691 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:39:32.691 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:39:32.691 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T18:39:32.691 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.2", 2023-11-28T18:39:32.691 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAxM2ZlOytnHxAAxXh2AsKCqrG5iYdmnF9+Qg==", 2023-11-28T18:39:32.691 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T18:39:32.691 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-11-28T18:39:32.692 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-11-28T18:39:32.692 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T18:39:32.692 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:39:32.692 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:39:32.692 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T18:39:32.692 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.3", 2023-11-28T18:39:32.692 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQA0M2Zl2fnBJxAAv68KZJFnQWwyUupB+whAEg==", 2023-11-28T18:39:32.692 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T18:39:32.692 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-11-28T18:39:32.692 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-11-28T18:39:32.692 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T18:39:32.693 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:39:32.693 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:39:32.693 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T18:39:32.693 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.4", 2023-11-28T18:39:32.693 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQA6M2ZllZg1MBAAzvMRW0IZnwwqfzhJ7wWjjQ==", 2023-11-28T18:39:32.693 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T18:39:32.693 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-11-28T18:39:32.693 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-11-28T18:39:32.693 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T18:39:32.693 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:39:32.693 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:39:32.693 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T18:39:32.694 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.5", 2023-11-28T18:39:32.694 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQA9M2Zlq0KjNxAAXOkL+JS09zzWRoPlgPGx+A==", 2023-11-28T18:39:32.694 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T18:39:32.694 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-11-28T18:39:32.694 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-11-28T18:39:32.694 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T18:39:32.694 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:39:32.694 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:39:32.694 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T18:39:32.694 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.6", 2023-11-28T18:39:32.694 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBBM2ZlVUVPAhAAurFCH6ubc+fXb8cUcg2nIg==", 2023-11-28T18:39:32.694 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T18:39:32.695 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-11-28T18:39:32.695 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-11-28T18:39:32.695 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T18:39:32.695 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:39:32.695 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:39:32.695 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T18:39:32.695 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.7", 2023-11-28T18:39:32.695 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBEM2ZlD846CRAA7GWGdOzRdv8vN7YbQyU4NQ==", 2023-11-28T18:39:32.695 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T18:39:32.695 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-11-28T18:39:32.695 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-11-28T18:39:32.695 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T18:39:32.696 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:39:32.696 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:39:32.696 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T18:39:32.696 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.0", 2023-11-28T18:39:32.696 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQApM2ZlTJxNMBAAwJAMWm1Y180iNJmgHnWFnw==", 2023-11-28T18:39:32.696 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T18:39:32.696 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-11-28T18:39:32.696 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow r", 2023-11-28T18:39:32.696 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-28T18:39:32.696 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:39:32.696 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:39:32.696 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T18:39:32.696 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.1", 2023-11-28T18:39:32.697 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQApM2Zl7yM7OhAA+Nu2Ay/zIVuRsCk90QGWbg==", 2023-11-28T18:39:32.697 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T18:39:32.697 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-11-28T18:39:32.697 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-11-28T18:39:32.697 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-11-28T18:39:32.697 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-11-28T18:39:32.697 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:39:32.697 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:39:32.697 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T18:39:32.697 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.2", 2023-11-28T18:39:32.697 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQApM2ZlhvR6NhAAbs7Rqb1gatb4fymZ2IHy5w==", 2023-11-28T18:39:32.698 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T18:39:32.698 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-11-28T18:39:32.698 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-11-28T18:39:32.698 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-11-28T18:39:32.698 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-11-28T18:39:32.698 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:39:32.698 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:39:32.698 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T18:39:32.698 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.3", 2023-11-28T18:39:32.698 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqM2ZlsarFBBAA1avYCNMV4t4UGM00iN6XiQ==", 2023-11-28T18:39:32.698 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T18:39:32.699 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-11-28T18:39:32.699 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-11-28T18:39:32.699 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-11-28T18:39:32.699 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-11-28T18:39:32.699 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:39:32.699 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:39:32.699 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T18:39:32.699 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.admin", 2023-11-28T18:39:32.699 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAoM2Zlhs1lNhAAsjadFkCQjkeqhuBhlHrHfQ==", 2023-11-28T18:39:32.699 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T18:39:32.699 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-11-28T18:39:32.699 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-11-28T18:39:32.700 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-11-28T18:39:32.700 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T18:39:32.700 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:39:32.700 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:39:32.700 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T18:39:32.700 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mgr.x", 2023-11-28T18:39:32.700 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQApM2ZlVReeExAAlYEJ4EwbGHtSUIkimoiJ2Q==", 2023-11-28T18:39:32.700 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T18:39:32.700 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-11-28T18:39:32.700 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile mgr", 2023-11-28T18:39:32.700 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T18:39:32.700 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:39:32.701 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:39:32.701 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T18:39:32.701 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mgr.y", 2023-11-28T18:39:32.701 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQApM2ZlnK1sDxAAfGqLMBH8IHZdQ7he/TVa6w==", 2023-11-28T18:39:32.701 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T18:39:32.701 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-11-28T18:39:32.701 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile mgr", 2023-11-28T18:39:32.701 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T18:39:32.701 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:39:32.701 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:39:32.701 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-11-28T18:39:32.701 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-11-28T18:39:32.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.685+0000 7fd2456dd640 1 -- 172.21.15.45:0/200495055 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fd2200668d0 msgr2=0x7fd220068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:32.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.685+0000 7fd2456dd640 1 --2- 172.21.15.45:0/200495055 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fd2200668d0 0x7fd220068d90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd2300011f0 tx=0x7fd230009040 comp rx=0 tx=0).stop 2023-11-28T18:39:32.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.685+0000 7fd2456dd640 1 -- 172.21.15.45:0/200495055 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2400b3cb0 msgr2=0x7fd240150c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:32.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.685+0000 7fd2456dd640 1 --2- 172.21.15.45:0/200495055 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2400b3cb0 0x7fd240150c50 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fd22800c770 tx=0x7fd22800cc30 comp rx=0 tx=0).stop 2023-11-28T18:39:32.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.685+0000 7fd2456dd640 1 -- 172.21.15.45:0/200495055 shutdown_connections 2023-11-28T18:39:32.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.685+0000 7fd2456dd640 1 --2- 172.21.15.45:0/200495055 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fd2200668d0 0x7fd220068d90 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:32.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.685+0000 7fd2456dd640 1 --2- 172.21.15.45:0/200495055 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd2400cfed0 0x7fd24006c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:32.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.685+0000 7fd2456dd640 1 --2- 172.21.15.45:0/200495055 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2400b3cb0 0x7fd240150c50 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:32.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.685+0000 7fd2456dd640 1 --2- 172.21.15.45:0/200495055 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd2400b35f0 0x7fd24014fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:32.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.685+0000 7fd2456dd640 1 -- 172.21.15.45:0/200495055 >> 172.21.15.45:0/200495055 conn(0x7fd24009c4f0 msgr2=0x7fd2400d31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:32.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.685+0000 7fd2456dd640 1 -- 172.21.15.45:0/200495055 shutdown_connections 2023-11-28T18:39:32.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.685+0000 7fd2456dd640 1 -- 172.21.15.45:0/200495055 wait complete. 2023-11-28T18:39:32.708 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T18:39:32.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.849+0000 7f4bfefc4640 1 Processor -- start 2023-11-28T18:39:32.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.849+0000 7f4bfefc4640 1 -- start start 2023-11-28T18:39:32.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.849+0000 7f4bfefc4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4bf80b35f0 0x7f4bf80d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:32.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.849+0000 7f4bfefc4640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bf80d38c0 con 0x7f4bf80b3cb0 2023-11-28T18:39:32.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.849+0000 7f4bfefc4640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bf80cdcc0 con 0x7f4bf80cfed0 2023-11-28T18:39:32.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.849+0000 7f4bfefc4640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf80d40d0 con 0x7f4bf80b35f0 2023-11-28T18:39:32.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.849+0000 7f4bf7fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f4bf80b3cb0 0x7f4bf80cf7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:34500/0 (socket says 172.21.15.45:34500) 2023-11-28T18:39:32.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.849+0000 7f4bf7fff640 1 -- 172.21.15.45:0/3640239477 learned_addr learned my addr 172.21.15.45:0/3640239477 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:39:32.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.849+0000 7f4bf77fe640 1 -- 172.21.15.45:0/3640239477 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1748644103 0 0) 0x7f4bf80d38c0 con 0x7f4bf80b3cb0 2023-11-28T18:39:32.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.849+0000 7f4bfcd60640 1 --2- 172.21.15.45:0/3640239477 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4bf80b35f0 0x7f4bf80d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:32.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.849+0000 7f4bf77fe640 1 -- 172.21.15.45:0/3640239477 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4be8003530 con 0x7f4bf80b3cb0 2023-11-28T18:39:32.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.849+0000 7f4bf77fe640 1 -- 172.21.15.45:0/3640239477 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2835239187 0 0) 0x7f4be8003530 con 0x7f4bf80b3cb0 2023-11-28T18:39:32.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.849+0000 7f4bf77fe640 1 -- 172.21.15.45:0/3640239477 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4bf80b35f0 msgr2=0x7f4bf80d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:32.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.849+0000 7f4bf77fe640 1 --2- 172.21.15.45:0/3640239477 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4bf80b35f0 0x7f4bf80d0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:32.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.849+0000 7f4bf77fe640 1 -- 172.21.15.45:0/3640239477 >> v1:172.21.15.190:6789/0 conn(0x7f4bf80cfed0 legacy=0x7f4bf80ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:32.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.849+0000 7f4bf77fe640 1 -- 172.21.15.45:0/3640239477 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bf80d3b10 con 0x7f4bf80b3cb0 2023-11-28T18:39:32.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.849+0000 7f4bf77fe640 1 -- 172.21.15.45:0/3640239477 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4084481567 0 0) 0x7f4be4001680 con 0x7f4bf80b3cb0 2023-11-28T18:39:32.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.849+0000 7f4bf77fe640 1 -- 172.21.15.45:0/3640239477 >> v1:172.21.15.45:6789/0 conn(0x7f4bf80b3cb0 legacy=0x7f4bf80cf7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:32.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.849+0000 7f4bf77fe640 1 --2- 172.21.15.45:0/3640239477 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4be80039b0 0x7f4be8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:32.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.849+0000 7f4bf77fe640 1 --2- 172.21.15.45:0/3640239477 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4bf80b35f0 0x7f4be80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:32.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.849+0000 7f4bf77fe640 1 --2- 172.21.15.45:0/3640239477 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4be8004d10 0x7f4be8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:32.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.849+0000 7f4bf77fe640 1 -- 172.21.15.45:0/3640239477 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf80d40d0 con 0x7f4be80039b0 2023-11-28T18:39:32.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.849+0000 7f4bf77fe640 1 -- 172.21.15.45:0/3640239477 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be800ba40 con 0x7f4be8004d10 2023-11-28T18:39:32.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.849+0000 7f4bf77fe640 1 -- 172.21.15.45:0/3640239477 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4be800bc00 con 0x7f4bf80b35f0 2023-11-28T18:39:32.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.849+0000 7f4bfcd60640 1 --2- 172.21.15.45:0/3640239477 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4be80039b0 0x7f4be8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:32.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.849+0000 7f4bf7fff640 1 --2- 172.21.15.45:0/3640239477 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4bf80b35f0 0x7f4be80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:32.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.849+0000 7f4bfd561640 1 --2- 172.21.15.45:0/3640239477 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4be8004d10 0x7f4be8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:32.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.853+0000 7f4bfcd60640 1 -- 172.21.15.45:0/3640239477 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4bf80b35f0 msgr2=0x7f4be80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:32.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.853+0000 7f4bfcd60640 1 --2- 172.21.15.45:0/3640239477 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4bf80b35f0 0x7f4be80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:32.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.853+0000 7f4bfcd60640 1 -- 172.21.15.45:0/3640239477 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4be8004d10 msgr2=0x7f4be8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:32.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.853+0000 7f4bfcd60640 1 --2- 172.21.15.45:0/3640239477 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4be8004d10 0x7f4be8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:32.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.853+0000 7f4bfcd60640 1 -- 172.21.15.45:0/3640239477 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4be8003530 con 0x7f4be80039b0 2023-11-28T18:39:32.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.853+0000 7f4bfcd60640 1 --2- 172.21.15.45:0/3640239477 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4be80039b0 0x7f4be8003dd0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f4bec009ab0 tx=0x7f4bec01ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90ae3fd57d0b142a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:32.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.853+0000 7f4bf77fe640 1 -- 172.21.15.45:0/3640239477 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bec0a64f0 con 0x7f4be80039b0 2023-11-28T18:39:32.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.853+0000 7f4bf77fe640 1 -- 172.21.15.45:0/3640239477 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bec0a6650 con 0x7f4be80039b0 2023-11-28T18:39:32.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.853+0000 7f4bf77fe640 1 -- 172.21.15.45:0/3640239477 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bec0a6a00 con 0x7f4be80039b0 2023-11-28T18:39:32.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.853+0000 7f4bfefc4640 1 -- 172.21.15.45:0/3640239477 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4be80039b0 msgr2=0x7f4be8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:32.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.853+0000 7f4bfefc4640 1 --2- 172.21.15.45:0/3640239477 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4be80039b0 0x7f4be8003dd0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f4bec009ab0 tx=0x7f4bec01ca00 comp rx=0 tx=0).stop 2023-11-28T18:39:32.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.853+0000 7f4bfd561640 1 -- 172.21.15.45:0/3640239477 reap_dead start 2023-11-28T18:39:32.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.853+0000 7f4bfefc4640 1 -- 172.21.15.45:0/3640239477 shutdown_connections 2023-11-28T18:39:32.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.853+0000 7f4bfefc4640 1 -- 172.21.15.45:0/3640239477 >> 172.21.15.45:0/3640239477 conn(0x7f4bf809c4f0 msgr2=0x7f4bf80d31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:32.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.853+0000 7f4bfefc4640 1 -- 172.21.15.45:0/3640239477 shutdown_connections 2023-11-28T18:39:32.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.853+0000 7f4bfefc4640 1 -- 172.21.15.45:0/3640239477 wait complete. 2023-11-28T18:39:32.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.857+0000 7f4bfefc4640 1 Processor -- start 2023-11-28T18:39:32.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.857+0000 7f4bfefc4640 1 -- start start 2023-11-28T18:39:32.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.857+0000 7f4bfefc4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4be80039b0 0x7f4bf815a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:32.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.857+0000 7f4bfefc4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4bf815acc0 0x7f4bf815b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:32.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.857+0000 7f4bfefc4640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4bf80cc450 0x7f4bf80cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:32.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.857+0000 7f4bfefc4640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf80cce10 con 0x7f4be80039b0 2023-11-28T18:39:32.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.857+0000 7f4bfefc4640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf80b6ab0 con 0x7f4bf80cc450 2023-11-28T18:39:32.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.857+0000 7f4bfefc4640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf80b2f60 con 0x7f4bf815acc0 2023-11-28T18:39:32.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.857+0000 7f4bfcd60640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4be80039b0 0x7f4bf815a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:32.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.857+0000 7f4bfcd60640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4be80039b0 0x7f4bf815a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59106/0 (socket says 172.21.15.45:59106) 2023-11-28T18:39:32.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.857+0000 7f4bfcd60640 1 -- 172.21.15.45:0/2763388127 learned_addr learned my addr 172.21.15.45:0/2763388127 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:32.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.857+0000 7f4bf7fff640 1 --2- 172.21.15.45:0/2763388127 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4bf815acc0 0x7f4bf815b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:32.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.857+0000 7f4bfd561640 1 --2- 172.21.15.45:0/2763388127 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4bf80cc450 0x7f4bf80cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:32.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.857+0000 7f4bfcd60640 1 -- 172.21.15.45:0/2763388127 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4bf815acc0 msgr2=0x7f4bf815b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:32.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.857+0000 7f4bfcd60640 1 --2- 172.21.15.45:0/2763388127 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4bf815acc0 0x7f4bf815b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:32.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.857+0000 7f4bfcd60640 1 -- 172.21.15.45:0/2763388127 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4bf80cc450 msgr2=0x7f4bf80cc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:32.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.857+0000 7f4bfcd60640 1 --2- 172.21.15.45:0/2763388127 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4bf80cc450 0x7f4bf80cc8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:32.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.857+0000 7f4bfcd60640 1 -- 172.21.15.45:0/2763388127 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bf80b67d0 con 0x7f4be80039b0 2023-11-28T18:39:32.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.857+0000 7f4bfcd60640 1 --2- 172.21.15.45:0/2763388127 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4be80039b0 0x7f4bf815a480 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f4bec0b0040 tx=0x7f4be8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:32.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.861+0000 7f4bf57fa640 1 -- 172.21.15.45:0/2763388127 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bec00f0c0 con 0x7f4be80039b0 2023-11-28T18:39:32.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.861+0000 7f4bf57fa640 1 -- 172.21.15.45:0/2763388127 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bec0a67c0 con 0x7f4be80039b0 2023-11-28T18:39:32.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.861+0000 7f4bf57fa640 1 -- 172.21.15.45:0/2763388127 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bec0a6b70 con 0x7f4be80039b0 2023-11-28T18:39:32.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.861+0000 7f4bfefc4640 1 -- 172.21.15.45:0/2763388127 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bf80b29a0 con 0x7f4be80039b0 2023-11-28T18:39:32.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.861+0000 7f4bfefc4640 1 -- 172.21.15.45:0/2763388127 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bf815a9c0 con 0x7f4be80039b0 2023-11-28T18:39:32.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.861+0000 7f4bfefc4640 1 -- 172.21.15.45:0/2763388127 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bf8069480 con 0x7f4be80039b0 2023-11-28T18:39:32.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.861+0000 7f4bf57fa640 1 -- 172.21.15.45:0/2763388127 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f4bec0a6cd0 con 0x7f4be80039b0 2023-11-28T18:39:32.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.861+0000 7f4bf57fa640 1 --2- 172.21.15.45:0/2763388127 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4bdc0668d0 0x7f4bdc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:32.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.861+0000 7f4bf57fa640 1 -- 172.21.15.45:0/2763388127 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4bec0aa070 con 0x7f4be80039b0 2023-11-28T18:39:32.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.861+0000 7f4bf7fff640 1 --2- 172.21.15.45:0/2763388127 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4bdc0668d0 0x7f4bdc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:32.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.865+0000 7f4bf7fff640 1 --2- 172.21.15.45:0/2763388127 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4bdc0668d0 0x7f4bdc068d90 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8161fe0 tx=0x7f4be4000f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:32.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:32.865+0000 7f4bf57fa640 1 -- 172.21.15.45:0/2763388127 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4bec0ec150 con 0x7f4be80039b0 2023-11-28T18:39:33.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.025+0000 7f4bfefc4640 1 -- 172.21.15.45:0/2763388127 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4bf80d0760 con 0x7f4be80039b0 2023-11-28T18:39:33.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.025+0000 7f4bf57fa640 1 -- 172.21.15.45:0/2763388127 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+12821 (secure 0 0 0) 0x7f4bec0ef770 con 0x7f4be80039b0 2023-11-28T18:39:33.028 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:39:33.029 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":42,"fsid":"d10f5cd6-1d00-4019-99b6-6fa435498a15","created":"2023-11-28T18:37:08.189030+0000","modified":"2023-11-28T18:39:32.283876+0000","last_up_change":"2023-11-28T18:37:20.196124+0000","last_in_change":"2023-11-28T18:37:10.742043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T18:37:21.293917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"84465384-103c-4f2c-a45a-96f5bb9c835f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6809","nonce":555237322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6811","nonce":555237322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6815","nonce":555237322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6813","nonce":555237322}]},"public_addr":"172.21.15.45:6809/555237322","cluster_addr":"172.21.15.45:6811/555237322","heartbeat_back_addr":"172.21.15.45:6815/555237322","heartbeat_front_addr":"172.21.15.45:6813/555237322","state":["exists","up"]},{"osd":1,"uuid":"7d9eed24-a58f-42c7-a787-ac06be8553fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6801","nonce":2857063763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6803","nonce":2857063763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6807","nonce":2857063763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6805","nonce":2857063763}]},"public_addr":"172.21.15.45:6801/2857063763","cluster_addr":"172.21.15.45:6803/2857063763","heartbeat_back_addr":"172.21.15.45:6807/2857063763","heartbeat_front_addr":"172.21.15.45:6805/2857063763","state":["exists","up"]},{"osd":2,"uuid":"575eeccc-4abf-45b4-9caf-f3e797859588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6817","nonce":193884539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6819","nonce":193884539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6823","nonce":193884539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6821","nonce":193884539}]},"public_addr":"172.21.15.45:6817/193884539","cluster_addr":"172.21.15.45:6819/193884539","heartbeat_back_addr":"172.21.15.45:6823/193884539","heartbeat_front_addr":"172.21.15.45:6821/193884539","state":["exists","up"]},{"osd":3,"uuid":"9b0290d6-9a52-4bc8-b2a1-7622c5dc8e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6825","nonce":78541084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6827","nonce":78541084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6831","nonce":78541084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6829","nonce":78541084}]},"public_addr":"172.21.15.45:6825/78541084","cluster_addr":"172.21.15.45:6827/78541084","heartbeat_back_addr":"172.21.15.45:6831/78541084","heartbeat_front_addr":"172.21.15.45:6829/78541084","state":["exists","up"]},{"osd":4,"uuid":"ce632829-f027-4fbf-a627-02c571aa9d53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6809","nonce":1537591987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6811","nonce":1537591987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6815","nonce":1537591987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6813","nonce":1537591987}]},"public_addr":"172.21.15.190:6809/1537591987","cluster_addr":"172.21.15.190:6811/1537591987","heartbeat_back_addr":"172.21.15.190:6815/1537591987","heartbeat_front_addr":"172.21.15.190:6813/1537591987","state":["exists","up"]},{"osd":5,"uuid":"8700b609-27be-40bd-a251-4c0ae0a29ead","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6801","nonce":3296698407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6803","nonce":3296698407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6807","nonce":3296698407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6805","nonce":3296698407}]},"public_addr":"172.21.15.190:6801/3296698407","cluster_addr":"172.21.15.190:6803/3296698407","heartbeat_back_addr":"172.21.15.190:6807/3296698407","heartbeat_front_addr":"172.21.15.190:6805/3296698407","state":["exists","up"]},{"osd":6,"uuid":"44ce4a40-e6ff-4f4d-8e8a-7341e5c91f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6817","nonce":2317686718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6819","nonce":2317686718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6823","nonce":2317686718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6821","nonce":2317686718}]},"public_addr":"172.21.15.190:6817/2317686718","cluster_addr":"172.21.15.190:6819/2317686718","heartbeat_back_addr":"172.21.15.190:6823/2317686718","heartbeat_front_addr":"172.21.15.190:6821/2317686718","state":["exists","up"]},{"osd":7,"uuid":"192238c9-1423-4b7e-ac8f-84ba32113ddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6825","nonce":2493232051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6827","nonce":2493232051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6831","nonce":2493232051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6829","nonce":2493232051}]},"public_addr":"172.21.15.190:6825/2493232051","cluster_addr":"172.21.15.190:6827/2493232051","heartbeat_back_addr":"172.21.15.190:6831/2493232051","heartbeat_front_addr":"172.21.15.190:6829/2493232051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.393552+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.385453+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.361421+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.366408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.363226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.276007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.414605+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.445885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T18:39:33.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.029+0000 7f4bfefc4640 1 -- 172.21.15.45:0/2763388127 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4bdc0668d0 msgr2=0x7f4bdc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:33.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.029+0000 7f4bfefc4640 1 --2- 172.21.15.45:0/2763388127 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4bdc0668d0 0x7f4bdc068d90 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8161fe0 tx=0x7f4be4000f90 comp rx=0 tx=0).stop 2023-11-28T18:39:33.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.029+0000 7f4bfefc4640 1 -- 172.21.15.45:0/2763388127 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4be80039b0 msgr2=0x7f4bf815a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:33.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.029+0000 7f4bfefc4640 1 --2- 172.21.15.45:0/2763388127 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4be80039b0 0x7f4bf815a480 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f4bec0b0040 tx=0x7f4be8005800 comp rx=0 tx=0).stop 2023-11-28T18:39:33.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.029+0000 7f4bfefc4640 1 -- 172.21.15.45:0/2763388127 shutdown_connections 2023-11-28T18:39:33.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.029+0000 7f4bfefc4640 1 --2- 172.21.15.45:0/2763388127 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4bdc0668d0 0x7f4bdc068d90 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:33.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.029+0000 7f4bfefc4640 1 --2- 172.21.15.45:0/2763388127 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4bf80cc450 0x7f4bf80cc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:33.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.029+0000 7f4bfefc4640 1 --2- 172.21.15.45:0/2763388127 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4bf815acc0 0x7f4bf815b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:33.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.029+0000 7f4bfefc4640 1 --2- 172.21.15.45:0/2763388127 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4be80039b0 0x7f4bf815a480 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:33.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.029+0000 7f4bfefc4640 1 -- 172.21.15.45:0/2763388127 >> 172.21.15.45:0/2763388127 conn(0x7f4bf809c4f0 msgr2=0x7f4bf806b350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:33.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.029+0000 7f4bfefc4640 1 -- 172.21.15.45:0/2763388127 shutdown_connections 2023-11-28T18:39:33.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.029+0000 7f4bfefc4640 1 -- 172.21.15.45:0/2763388127 wait complete. 2023-11-28T18:39:33.050 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T18:37:21.293917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T18:39:33.050 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T18:39:33.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.193+0000 7f139472a640 1 Processor -- start 2023-11-28T18:39:33.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.193+0000 7f139472a640 1 -- start start 2023-11-28T18:39:33.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.193+0000 7f139472a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f138c158ce0 0x7f138c15eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:33.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.193+0000 7f139472a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f138c0b4310 0x7f138c0b4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:33.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.193+0000 7f139472a640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f138c0b4ca0 con 0x7f138c0cba50 2023-11-28T18:39:33.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.193+0000 7f139472a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f138c15b6b0 con 0x7f138c158ce0 2023-11-28T18:39:33.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.193+0000 7f139472a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f138c15c550 con 0x7f138c0b4310 2023-11-28T18:39:33.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.197+0000 7f13924c6640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f138c158ce0 0x7f138c15eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:33.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.197+0000 7f1391cc5640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f138c0cba50 0x7f138c15be40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:34506/0 (socket says 172.21.15.45:34506) 2023-11-28T18:39:33.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.197+0000 7f1391cc5640 1 -- 172.21.15.45:0/2754727741 learned_addr learned my addr 172.21.15.45:0/2754727741 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:39:33.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.197+0000 7f1392cc7640 1 --2- 172.21.15.45:0/2754727741 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f138c0b4310 0x7f138c0b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:33.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.197+0000 7f13924c6640 1 -- 172.21.15.45:0/2754727741 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f138c0b4310 msgr2=0x7f138c0b4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:33.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.197+0000 7f13924c6640 1 --2- 172.21.15.45:0/2754727741 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f138c0b4310 0x7f138c0b4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:33.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.197+0000 7f13924c6640 1 -- 172.21.15.45:0/2754727741 >> v1:172.21.15.45:6789/0 conn(0x7f138c0cba50 legacy=0x7f138c15be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:33.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.197+0000 7f13914c4640 1 -- 172.21.15.45:0/2754727741 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2203972735 0 0) 0x7f137c001120 con 0x7f138c0cba50 2023-11-28T18:39:33.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.197+0000 7f13924c6640 1 -- 172.21.15.45:0/2754727741 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f138c15f450 con 0x7f138c158ce0 2023-11-28T18:39:33.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.197+0000 7f1392cc7640 1 --2- 172.21.15.45:0/2754727741 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f138c0b4310 0x7f138c0b4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:39:33.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.197+0000 7f13924c6640 1 --2- 172.21.15.45:0/2754727741 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f138c158ce0 0x7f138c15eb90 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f13880097c0 tx=0x7f138801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=620ad9e9e4a726ce server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:33.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.197+0000 7f13914c4640 1 -- 172.21.15.45:0/2754727741 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13880ab650 con 0x7f138c158ce0 2023-11-28T18:39:33.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.197+0000 7f13914c4640 1 -- 172.21.15.45:0/2754727741 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13880ab7b0 con 0x7f138c158ce0 2023-11-28T18:39:33.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.197+0000 7f13914c4640 1 -- 172.21.15.45:0/2754727741 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13880abb40 con 0x7f138c158ce0 2023-11-28T18:39:33.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.201+0000 7f139472a640 1 -- 172.21.15.45:0/2754727741 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f138c158ce0 msgr2=0x7f138c15eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:33.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.201+0000 7f139472a640 1 --2- 172.21.15.45:0/2754727741 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f138c158ce0 0x7f138c15eb90 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f13880097c0 tx=0x7f138801c450 comp rx=0 tx=0).stop 2023-11-28T18:39:33.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.201+0000 7f139472a640 1 -- 172.21.15.45:0/2754727741 shutdown_connections 2023-11-28T18:39:33.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.201+0000 7f139472a640 1 --2- 172.21.15.45:0/2754727741 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f138c0b4310 0x7f138c0b4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:33.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.201+0000 7f139472a640 1 --2- 172.21.15.45:0/2754727741 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f138c158ce0 0x7f138c15eb90 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:33.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.201+0000 7f139472a640 1 -- 172.21.15.45:0/2754727741 >> 172.21.15.45:0/2754727741 conn(0x7f138c0b0d00 msgr2=0x7f138c0b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:33.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.201+0000 7f139472a640 1 -- 172.21.15.45:0/2754727741 shutdown_connections 2023-11-28T18:39:33.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.201+0000 7f139472a640 1 -- 172.21.15.45:0/2754727741 wait complete. 2023-11-28T18:39:33.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.201+0000 7f139472a640 1 Processor -- start 2023-11-28T18:39:33.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.201+0000 7f139472a640 1 -- start start 2023-11-28T18:39:33.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.201+0000 7f139472a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f138c0b4310 0x7f138c1351e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:33.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.201+0000 7f139472a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f138c0cba50 0x7f138c144b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:33.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.201+0000 7f139472a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f138c158ce0 0x7f138c14d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:33.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.201+0000 7f139472a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f138c135720 con 0x7f138c158ce0 2023-11-28T18:39:33.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.201+0000 7f139472a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f138c0b2470 con 0x7f138c0b4310 2023-11-28T18:39:33.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.201+0000 7f139472a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f138c0b2750 con 0x7f138c0cba50 2023-11-28T18:39:33.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.201+0000 7f1392cc7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f138c158ce0 0x7f138c14d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:33.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.201+0000 7f1392cc7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f138c158ce0 0x7f138c14d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59120/0 (socket says 172.21.15.45:59120) 2023-11-28T18:39:33.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.201+0000 7f1392cc7640 1 -- 172.21.15.45:0/2214238347 learned_addr learned my addr 172.21.15.45:0/2214238347 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:33.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.201+0000 7f1391cc5640 1 --2- 172.21.15.45:0/2214238347 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f138c0cba50 0x7f138c144b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:33.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.201+0000 7f13924c6640 1 --2- 172.21.15.45:0/2214238347 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f138c0b4310 0x7f138c1351e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:33.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.201+0000 7f1392cc7640 1 -- 172.21.15.45:0/2214238347 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f138c0cba50 msgr2=0x7f138c144b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:33.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.201+0000 7f1392cc7640 1 --2- 172.21.15.45:0/2214238347 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f138c0cba50 0x7f138c144b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:33.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.201+0000 7f1392cc7640 1 -- 172.21.15.45:0/2214238347 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f138c0b4310 msgr2=0x7f138c1351e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:33.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.201+0000 7f1392cc7640 1 --2- 172.21.15.45:0/2214238347 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f138c0b4310 0x7f138c1351e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:33.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.201+0000 7f1392cc7640 1 -- 172.21.15.45:0/2214238347 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1388009420 con 0x7f138c158ce0 2023-11-28T18:39:33.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.201+0000 7f1392cc7640 1 --2- 172.21.15.45:0/2214238347 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f138c158ce0 0x7f138c14d5a0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f138400cd50 tx=0x7f138400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:33.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.205+0000 7f1382ffd640 1 -- 172.21.15.45:0/2214238347 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f138400f680 con 0x7f138c158ce0 2023-11-28T18:39:33.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.205+0000 7f1382ffd640 1 -- 172.21.15.45:0/2214238347 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f138400f800 con 0x7f138c158ce0 2023-11-28T18:39:33.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.205+0000 7f1382ffd640 1 -- 172.21.15.45:0/2214238347 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f138400fbb0 con 0x7f138c158ce0 2023-11-28T18:39:33.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.205+0000 7f139472a640 1 -- 172.21.15.45:0/2214238347 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f138c0b2a30 con 0x7f138c158ce0 2023-11-28T18:39:33.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.205+0000 7f139472a640 1 -- 172.21.15.45:0/2214238347 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f138c0b2ff0 con 0x7f138c158ce0 2023-11-28T18:39:33.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.205+0000 7f139472a640 1 -- 172.21.15.45:0/2214238347 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f138c1591f0 con 0x7f138c158ce0 2023-11-28T18:39:33.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.205+0000 7f1382ffd640 1 -- 172.21.15.45:0/2214238347 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f138400b040 con 0x7f138c158ce0 2023-11-28T18:39:33.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.205+0000 7f1382ffd640 1 --2- 172.21.15.45:0/2214238347 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f13700668d0 0x7f1370068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:33.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.205+0000 7f1382ffd640 1 -- 172.21.15.45:0/2214238347 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1384084b30 con 0x7f138c158ce0 2023-11-28T18:39:33.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.205+0000 7f13924c6640 1 --2- 172.21.15.45:0/2214238347 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f13700668d0 0x7f1370068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:33.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.209+0000 7f13924c6640 1 --2- 172.21.15.45:0/2214238347 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f13700668d0 0x7f1370068d90 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f13880af000 tx=0x7f13880a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:33.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.209+0000 7f1382ffd640 1 -- 172.21.15.45:0/2214238347 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1384052030 con 0x7f138c158ce0 2023-11-28T18:39:33.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.369+0000 7f139472a640 1 -- 172.21.15.45:0/2214238347 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f138c069410 con 0x7f138c158ce0 2023-11-28T18:39:33.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.373+0000 7f1382ffd640 1 -- 172.21.15.45:0/2214238347 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v42) v1 ==== 93+0+10 (secure 0 0 0) 0x7f138401d070 con 0x7f138c158ce0 2023-11-28T18:39:33.374 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-11-28T18:39:33.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.373+0000 7f139472a640 1 -- 172.21.15.45:0/2214238347 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f13700668d0 msgr2=0x7f1370068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:33.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.373+0000 7f139472a640 1 --2- 172.21.15.45:0/2214238347 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f13700668d0 0x7f1370068d90 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f13880af000 tx=0x7f13880a7000 comp rx=0 tx=0).stop 2023-11-28T18:39:33.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.373+0000 7f139472a640 1 -- 172.21.15.45:0/2214238347 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f138c158ce0 msgr2=0x7f138c14d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:33.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.373+0000 7f139472a640 1 --2- 172.21.15.45:0/2214238347 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f138c158ce0 0x7f138c14d5a0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f138400cd50 tx=0x7f138400a650 comp rx=0 tx=0).stop 2023-11-28T18:39:33.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.373+0000 7f139472a640 1 -- 172.21.15.45:0/2214238347 shutdown_connections 2023-11-28T18:39:33.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.373+0000 7f139472a640 1 --2- 172.21.15.45:0/2214238347 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f13700668d0 0x7f1370068d90 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:33.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.373+0000 7f139472a640 1 --2- 172.21.15.45:0/2214238347 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f138c158ce0 0x7f138c14d5a0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:33.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.373+0000 7f139472a640 1 --2- 172.21.15.45:0/2214238347 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f138c0cba50 0x7f138c144b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:33.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.373+0000 7f139472a640 1 --2- 172.21.15.45:0/2214238347 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f138c0b4310 0x7f138c1351e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:33.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.373+0000 7f139472a640 1 -- 172.21.15.45:0/2214238347 >> 172.21.15.45:0/2214238347 conn(0x7f138c0b0d00 msgr2=0x7f138c1593c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:33.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.373+0000 7f139472a640 1 -- 172.21.15.45:0/2214238347 shutdown_connections 2023-11-28T18:39:33.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.373+0000 7f139472a640 1 -- 172.21.15.45:0/2214238347 wait complete. 2023-11-28T18:39:33.395 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-28T18:39:33.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.537+0000 7f0c9c8fe640 1 Processor -- start 2023-11-28T18:39:33.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.537+0000 7f0c9c8fe640 1 -- start start 2023-11-28T18:39:33.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.537+0000 7f0c9c8fe640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f0c9815ad80 0x7f0c98164e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:33.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.537+0000 7f0c9c8fe640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c9815b1b0 con 0x7f0c9806ca10 2023-11-28T18:39:33.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.537+0000 7f0c9c8fe640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c9815b3e0 con 0x7f0c9813cf70 2023-11-28T18:39:33.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.537+0000 7f0c9c8fe640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c9813d350 con 0x7f0c9815ad80 2023-11-28T18:39:33.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.537+0000 7f0c95d9b640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f0c9806ca10 0x7f0c9815a670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:34520/0 (socket says 172.21.15.45:34520) 2023-11-28T18:39:33.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.537+0000 7f0c95d9b640 1 -- 172.21.15.45:0/3939480766 learned_addr learned my addr 172.21.15.45:0/3939480766 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:39:33.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.537+0000 7f0c96d9d640 1 --2- 172.21.15.45:0/3939480766 >> v2:172.21.15.190:3300/0 conn(0x7f0c9815ad80 0x7f0c98164e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:33.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.537+0000 7f0c9559a640 1 -- 172.21.15.45:0/3939480766 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4024194496 0 0) 0x7f0c9815b1b0 con 0x7f0c9806ca10 2023-11-28T18:39:33.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.537+0000 7f0c9559a640 1 -- 172.21.15.45:0/3939480766 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c80003530 con 0x7f0c9806ca10 2023-11-28T18:39:33.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.537+0000 7f0c9559a640 1 -- 172.21.15.45:0/3939480766 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 42336836 0 0) 0x7f0c80003530 con 0x7f0c9806ca10 2023-11-28T18:39:33.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.537+0000 7f0c9559a640 1 -- 172.21.15.45:0/3939480766 >> v2:172.21.15.190:3300/0 conn(0x7f0c9815ad80 msgr2=0x7f0c98164e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:33.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.537+0000 7f0c9559a640 1 --2- 172.21.15.45:0/3939480766 >> v2:172.21.15.190:3300/0 conn(0x7f0c9815ad80 0x7f0c98164e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:33.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.537+0000 7f0c9559a640 1 -- 172.21.15.45:0/3939480766 >> v1:172.21.15.190:6789/0 conn(0x7f0c9813cf70 legacy=0x7f0c9806c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:33.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.537+0000 7f0c9559a640 1 -- 172.21.15.45:0/3939480766 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c9813f760 con 0x7f0c9806ca10 2023-11-28T18:39:33.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.537+0000 7f0c9559a640 1 -- 172.21.15.45:0/3939480766 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4084481567 0 0) 0x7f0c8c001680 con 0x7f0c9806ca10 2023-11-28T18:39:33.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.537+0000 7f0c9559a640 1 -- 172.21.15.45:0/3939480766 >> v1:172.21.15.45:6789/0 conn(0x7f0c9806ca10 legacy=0x7f0c9815a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:33.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.537+0000 7f0c9559a640 1 --2- 172.21.15.45:0/3939480766 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0c80003980 0x7f0c80003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:33.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.537+0000 7f0c9559a640 1 --2- 172.21.15.45:0/3939480766 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0c800047d0 0x7f0c80004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:33.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.537+0000 7f0c9559a640 1 --2- 172.21.15.45:0/3939480766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c80005190 0x7f0c8000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:33.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.537+0000 7f0c9559a640 1 -- 172.21.15.45:0/3939480766 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8000c100 con 0x7f0c80005190 2023-11-28T18:39:33.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.537+0000 7f0c9559a640 1 -- 172.21.15.45:0/3939480766 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8000c270 con 0x7f0c80003980 2023-11-28T18:39:33.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.537+0000 7f0c9559a640 1 -- 172.21.15.45:0/3939480766 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8000c430 con 0x7f0c800047d0 2023-11-28T18:39:33.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.537+0000 7f0c96d9d640 1 --2- 172.21.15.45:0/3939480766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c80005190 0x7f0c8000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:33.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.537+0000 7f0c9659c640 1 --2- 172.21.15.45:0/3939480766 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0c80003980 0x7f0c80003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:33.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.537+0000 7f0c95d9b640 1 --2- 172.21.15.45:0/3939480766 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0c800047d0 0x7f0c80004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:33.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.541+0000 7f0c96d9d640 1 -- 172.21.15.45:0/3939480766 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0c800047d0 msgr2=0x7f0c80004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:33.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.541+0000 7f0c96d9d640 1 --2- 172.21.15.45:0/3939480766 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0c800047d0 0x7f0c80004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:33.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.541+0000 7f0c96d9d640 1 -- 172.21.15.45:0/3939480766 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0c80003980 msgr2=0x7f0c80003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:33.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.541+0000 7f0c96d9d640 1 --2- 172.21.15.45:0/3939480766 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0c80003980 0x7f0c80003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:33.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.541+0000 7f0c96d9d640 1 -- 172.21.15.45:0/3939480766 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c80003530 con 0x7f0c80005190 2023-11-28T18:39:33.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.541+0000 7f0c96d9d640 1 -- 172.21.15.45:0/3939480766 reap_dead start 2023-11-28T18:39:33.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.541+0000 7f0c96d9d640 1 --2- 172.21.15.45:0/3939480766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c80005190 0x7f0c8000b990 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f0c90009fc0 tx=0x7f0c9001cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1d1bbe319c93263 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:33.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.541+0000 7f0c9559a640 1 -- 172.21.15.45:0/3939480766 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c900a5bb0 con 0x7f0c80005190 2023-11-28T18:39:33.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.541+0000 7f0c9559a640 1 -- 172.21.15.45:0/3939480766 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c9000f040 con 0x7f0c80005190 2023-11-28T18:39:33.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.541+0000 7f0c9559a640 1 -- 172.21.15.45:0/3939480766 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c900039a0 con 0x7f0c80005190 2023-11-28T18:39:33.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.541+0000 7f0c9c8fe640 1 -- 172.21.15.45:0/3939480766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c80005190 msgr2=0x7f0c8000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:33.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.541+0000 7f0c9c8fe640 1 --2- 172.21.15.45:0/3939480766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c80005190 0x7f0c8000b990 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f0c90009fc0 tx=0x7f0c9001cca0 comp rx=0 tx=0).stop 2023-11-28T18:39:33.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.541+0000 7f0c9c8fe640 1 -- 172.21.15.45:0/3939480766 shutdown_connections 2023-11-28T18:39:33.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.541+0000 7f0c9c8fe640 1 --2- 172.21.15.45:0/3939480766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c80005190 0x7f0c8000b990 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:33.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.541+0000 7f0c9c8fe640 1 -- 172.21.15.45:0/3939480766 >> 172.21.15.45:0/3939480766 conn(0x7f0c9806a570 msgr2=0x7f0c9806a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:33.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.541+0000 7f0c9c8fe640 1 -- 172.21.15.45:0/3939480766 shutdown_connections 2023-11-28T18:39:33.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.541+0000 7f0c9c8fe640 1 -- 172.21.15.45:0/3939480766 wait complete. 2023-11-28T18:39:33.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.545+0000 7f0c9c8fe640 1 Processor -- start 2023-11-28T18:39:33.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.545+0000 7f0c9c8fe640 1 -- start start 2023-11-28T18:39:33.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.545+0000 7f0c9c8fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0c80005190 0x7f0c98138850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:33.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.545+0000 7f0c9c8fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c980b0930 0x7f0c98139de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:33.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.545+0000 7f0c9c8fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0c980b0db0 0x7f0c9813a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:33.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.545+0000 7f0c9c8fe640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c98138d90 con 0x7f0c980b0930 2023-11-28T18:39:33.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.545+0000 7f0c9c8fe640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c980aec70 con 0x7f0c980b0db0 2023-11-28T18:39:33.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.545+0000 7f0c9c8fe640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c980b1310 con 0x7f0c80005190 2023-11-28T18:39:33.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.545+0000 7f0c95d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c980b0930 0x7f0c98139de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:33.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.545+0000 7f0c95d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c980b0930 0x7f0c98139de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59150/0 (socket says 172.21.15.45:59150) 2023-11-28T18:39:33.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.545+0000 7f0c95d9b640 1 -- 172.21.15.45:0/2497325402 learned_addr learned my addr 172.21.15.45:0/2497325402 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:33.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.545+0000 7f0c9659c640 1 --2- 172.21.15.45:0/2497325402 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0c80005190 0x7f0c98138850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:33.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.545+0000 7f0c96d9d640 1 --2- 172.21.15.45:0/2497325402 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0c980b0db0 0x7f0c9813a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:33.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.545+0000 7f0c95d9b640 1 -- 172.21.15.45:0/2497325402 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0c80005190 msgr2=0x7f0c98138850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:33.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.545+0000 7f0c95d9b640 1 --2- 172.21.15.45:0/2497325402 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0c80005190 0x7f0c98138850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:33.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.545+0000 7f0c95d9b640 1 -- 172.21.15.45:0/2497325402 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0c980b0db0 msgr2=0x7f0c9813a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:33.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.545+0000 7f0c95d9b640 1 --2- 172.21.15.45:0/2497325402 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0c980b0db0 0x7f0c9813a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:33.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.545+0000 7f0c95d9b640 1 -- 172.21.15.45:0/2497325402 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c980aeec0 con 0x7f0c980b0930 2023-11-28T18:39:33.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.545+0000 7f0c95d9b640 1 --2- 172.21.15.45:0/2497325402 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c980b0930 0x7f0c98139de0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c012490 tx=0x7f0c8c012950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:33.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.549+0000 7f0c86ffd640 1 -- 172.21.15.45:0/2497325402 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c8c014750 con 0x7f0c980b0930 2023-11-28T18:39:33.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.549+0000 7f0c86ffd640 1 -- 172.21.15.45:0/2497325402 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c8c0148d0 con 0x7f0c980b0930 2023-11-28T18:39:33.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.549+0000 7f0c86ffd640 1 -- 172.21.15.45:0/2497325402 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c8c014c80 con 0x7f0c980b0930 2023-11-28T18:39:33.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.549+0000 7f0c9c8fe640 1 -- 172.21.15.45:0/2497325402 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c980af1a0 con 0x7f0c980b0930 2023-11-28T18:39:33.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.549+0000 7f0c9c8fe640 1 -- 172.21.15.45:0/2497325402 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c9814f650 con 0x7f0c980b0930 2023-11-28T18:39:33.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.549+0000 7f0c9c8fe640 1 -- 172.21.15.45:0/2497325402 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c98069480 con 0x7f0c980b0930 2023-11-28T18:39:33.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.549+0000 7f0c86ffd640 1 -- 172.21.15.45:0/2497325402 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f0c8c0153e0 con 0x7f0c980b0930 2023-11-28T18:39:33.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.549+0000 7f0c86ffd640 1 --2- 172.21.15.45:0/2497325402 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f0c780668f0 0x7f0c78068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:33.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.549+0000 7f0c86ffd640 1 -- 172.21.15.45:0/2497325402 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0c8c086990 con 0x7f0c980b0930 2023-11-28T18:39:33.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.549+0000 7f0c9659c640 1 --2- 172.21.15.45:0/2497325402 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f0c780668f0 0x7f0c78068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:33.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.553+0000 7f0c9659c640 1 --2- 172.21.15.45:0/2497325402 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f0c780668f0 0x7f0c78068db0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0c88007fd0 tx=0x7f0c88009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:33.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.553+0000 7f0c86ffd640 1 -- 172.21.15.45:0/2497325402 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0c8c053fd0 con 0x7f0c980b0930 2023-11-28T18:39:33.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.713+0000 7f0c9c8fe640 1 -- 172.21.15.45:0/2497325402 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f0c9806d220 con 0x7f0c980b0930 2023-11-28T18:39:33.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.713+0000 7f0c86ffd640 1 -- 172.21.15.45:0/2497325402 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v42) v1 ==== 84+0+65 (secure 0 0 0) 0x7f0c8c01c070 con 0x7f0c980b0930 2023-11-28T18:39:33.716 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:39:33.717 INFO:teuthology.orchestra.run.smithi045.stdout:[ 2023-11-28T18:39:33.717 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T18:39:33.717 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 1, 2023-11-28T18:39:33.717 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": ".mgr" 2023-11-28T18:39:33.717 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:39:33.717 INFO:teuthology.orchestra.run.smithi045.stdout:] 2023-11-28T18:39:33.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.717+0000 7f0c9c8fe640 1 -- 172.21.15.45:0/2497325402 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f0c780668f0 msgr2=0x7f0c78068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:33.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.717+0000 7f0c9c8fe640 1 --2- 172.21.15.45:0/2497325402 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f0c780668f0 0x7f0c78068db0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0c88007fd0 tx=0x7f0c88009040 comp rx=0 tx=0).stop 2023-11-28T18:39:33.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.717+0000 7f0c9c8fe640 1 -- 172.21.15.45:0/2497325402 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c980b0930 msgr2=0x7f0c98139de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:33.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.717+0000 7f0c9c8fe640 1 --2- 172.21.15.45:0/2497325402 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c980b0930 0x7f0c98139de0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c012490 tx=0x7f0c8c012950 comp rx=0 tx=0).stop 2023-11-28T18:39:33.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.717+0000 7f0c9c8fe640 1 -- 172.21.15.45:0/2497325402 shutdown_connections 2023-11-28T18:39:33.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.717+0000 7f0c9c8fe640 1 --2- 172.21.15.45:0/2497325402 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f0c780668f0 0x7f0c78068db0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:33.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.717+0000 7f0c9c8fe640 1 --2- 172.21.15.45:0/2497325402 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0c980b0db0 0x7f0c9813a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:33.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.717+0000 7f0c9c8fe640 1 --2- 172.21.15.45:0/2497325402 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c980b0930 0x7f0c98139de0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:33.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.717+0000 7f0c9c8fe640 1 --2- 172.21.15.45:0/2497325402 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0c80005190 0x7f0c98138850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:33.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.717+0000 7f0c9c8fe640 1 -- 172.21.15.45:0/2497325402 >> 172.21.15.45:0/2497325402 conn(0x7f0c9806a570 msgr2=0x7f0c980ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:33.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.717+0000 7f0c9c8fe640 1 -- 172.21.15.45:0/2497325402 shutdown_connections 2023-11-28T18:39:33.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.717+0000 7f0c9c8fe640 1 -- 172.21.15.45:0/2497325402 wait complete. 2023-11-28T18:39:33.738 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-28T18:39:33.738 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-28T18:39:33.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.881+0000 7efc31b80640 1 Processor -- start 2023-11-28T18:39:33.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.881+0000 7efc31b80640 1 -- start start 2023-11-28T18:39:33.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.885+0000 7efc31b80640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7efc2c06d730 0x7efc2c0cdf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:33.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.885+0000 7efc31b80640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efc2c0ce4b0 0x7efc2c164e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:33.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.885+0000 7efc31b80640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc2c15b720 con 0x7efc2c0ccea0 2023-11-28T18:39:33.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.885+0000 7efc31b80640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc2c0cb590 con 0x7efc2c06d730 2023-11-28T18:39:33.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.885+0000 7efc31b80640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc2c0cb870 con 0x7efc2c0ce4b0 2023-11-28T18:39:33.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.885+0000 7efc2b7fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7efc2c0ccea0 0x7efc2c0cd280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:34526/0 (socket says 172.21.15.45:34526) 2023-11-28T18:39:33.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.885+0000 7efc2b7fe640 1 -- 172.21.15.45:0/620191578 learned_addr learned my addr 172.21.15.45:0/620191578 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:39:33.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.885+0000 7efc2bfff640 1 --2- 172.21.15.45:0/620191578 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efc2c0ce4b0 0x7efc2c164e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:33.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.885+0000 7efc2affd640 1 --2- 172.21.15.45:0/620191578 >> v2:172.21.15.190:3300/0 conn(0x7efc2c06d730 0x7efc2c0cdf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:33.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.885+0000 7efc2a7fc640 1 -- 172.21.15.45:0/620191578 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 277535354 0 0) 0x7efc2c15b720 con 0x7efc2c0ccea0 2023-11-28T18:39:33.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.885+0000 7efc2a7fc640 1 -- 172.21.15.45:0/620191578 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc14003530 con 0x7efc2c0ccea0 2023-11-28T18:39:33.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.885+0000 7efc2bfff640 1 -- 172.21.15.45:0/620191578 >> v2:172.21.15.190:3300/0 conn(0x7efc2c06d730 msgr2=0x7efc2c0cdf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:33.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.885+0000 7efc2bfff640 1 --2- 172.21.15.45:0/620191578 >> v2:172.21.15.190:3300/0 conn(0x7efc2c06d730 0x7efc2c0cdf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:33.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.885+0000 7efc2bfff640 1 -- 172.21.15.45:0/620191578 >> v1:172.21.15.45:6789/0 conn(0x7efc2c0ccea0 legacy=0x7efc2c0cd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:33.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.885+0000 7efc2bfff640 1 -- 172.21.15.45:0/620191578 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc2c0cbb50 con 0x7efc2c0ce4b0 2023-11-28T18:39:33.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.889+0000 7efc2bfff640 1 --2- 172.21.15.45:0/620191578 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efc2c0ce4b0 0x7efc2c164e80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7efc24009d90 tx=0x7efc2401c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43b3fa7eab36701c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:33.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.889+0000 7efc2a7fc640 1 -- 172.21.15.45:0/620191578 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc240a5900 con 0x7efc2c0ce4b0 2023-11-28T18:39:33.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.889+0000 7efc2a7fc640 1 -- 172.21.15.45:0/620191578 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc240a5a60 con 0x7efc2c0ce4b0 2023-11-28T18:39:33.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.889+0000 7efc2a7fc640 1 -- 172.21.15.45:0/620191578 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc240a5df0 con 0x7efc2c0ce4b0 2023-11-28T18:39:33.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.889+0000 7efc31b80640 1 -- 172.21.15.45:0/620191578 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efc2c0ce4b0 msgr2=0x7efc2c164e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:33.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.889+0000 7efc31b80640 1 --2- 172.21.15.45:0/620191578 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efc2c0ce4b0 0x7efc2c164e80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7efc24009d90 tx=0x7efc2401c950 comp rx=0 tx=0).stop 2023-11-28T18:39:33.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.889+0000 7efc31b80640 1 -- 172.21.15.45:0/620191578 shutdown_connections 2023-11-28T18:39:33.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.889+0000 7efc31b80640 1 --2- 172.21.15.45:0/620191578 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efc2c0ce4b0 0x7efc2c164e80 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:33.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.889+0000 7efc31b80640 1 --2- 172.21.15.45:0/620191578 >> v2:172.21.15.190:3300/0 conn(0x7efc2c06d730 0x7efc2c0cdf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:33.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.889+0000 7efc31b80640 1 -- 172.21.15.45:0/620191578 >> 172.21.15.45:0/620191578 conn(0x7efc2c0b0c90 msgr2=0x7efc2c0b10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:33.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.889+0000 7efc31b80640 1 -- 172.21.15.45:0/620191578 shutdown_connections 2023-11-28T18:39:33.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.889+0000 7efc31b80640 1 -- 172.21.15.45:0/620191578 wait complete. 2023-11-28T18:39:33.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.889+0000 7efc31b80640 1 Processor -- start 2023-11-28T18:39:33.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.889+0000 7efc31b80640 1 -- start start 2023-11-28T18:39:33.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.889+0000 7efc31b80640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efc2c06d730 0x7efc2c14a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:33.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.889+0000 7efc31b80640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc2c0ccea0 0x7efc2c0abf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:33.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.889+0000 7efc31b80640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efc2c0ce4b0 0x7efc2c149aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:33.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.889+0000 7efc31b80640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc2c0b06e0 con 0x7efc2c0ccea0 2023-11-28T18:39:33.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.889+0000 7efc31b80640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc2c14af50 con 0x7efc2c0ce4b0 2023-11-28T18:39:33.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.889+0000 7efc31b80640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc2c1583d0 con 0x7efc2c06d730 2023-11-28T18:39:33.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.893+0000 7efc2affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc2c0ccea0 0x7efc2c0abf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:33.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.893+0000 7efc2affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc2c0ccea0 0x7efc2c0abf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59164/0 (socket says 172.21.15.45:59164) 2023-11-28T18:39:33.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.893+0000 7efc2affd640 1 -- 172.21.15.45:0/3449128122 learned_addr learned my addr 172.21.15.45:0/3449128122 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:33.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.893+0000 7efc2bfff640 1 --2- 172.21.15.45:0/3449128122 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efc2c0ce4b0 0x7efc2c149aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:33.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.893+0000 7efc2b7fe640 1 --2- 172.21.15.45:0/3449128122 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efc2c06d730 0x7efc2c14a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:33.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.893+0000 7efc2affd640 1 -- 172.21.15.45:0/3449128122 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efc2c06d730 msgr2=0x7efc2c14a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:33.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.893+0000 7efc2affd640 1 --2- 172.21.15.45:0/3449128122 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efc2c06d730 0x7efc2c14a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:33.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.893+0000 7efc2affd640 1 -- 172.21.15.45:0/3449128122 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efc2c0ce4b0 msgr2=0x7efc2c149aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:33.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.893+0000 7efc2affd640 1 --2- 172.21.15.45:0/3449128122 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efc2c0ce4b0 0x7efc2c149aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:33.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.893+0000 7efc2affd640 1 -- 172.21.15.45:0/3449128122 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc24009a70 con 0x7efc2c0ccea0 2023-11-28T18:39:33.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.893+0000 7efc2affd640 1 --2- 172.21.15.45:0/3449128122 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc2c0ccea0 0x7efc2c0abf70 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7efc2000e840 tx=0x7efc2000ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:33.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.893+0000 7efc13fff640 1 -- 172.21.15.45:0/3449128122 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc20009510 con 0x7efc2c0ccea0 2023-11-28T18:39:33.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.893+0000 7efc13fff640 1 -- 172.21.15.45:0/3449128122 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc2000ee90 con 0x7efc2c0ccea0 2023-11-28T18:39:33.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.893+0000 7efc31b80640 1 -- 172.21.15.45:0/3449128122 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc2c0ac4b0 con 0x7efc2c0ccea0 2023-11-28T18:39:33.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.893+0000 7efc13fff640 1 -- 172.21.15.45:0/3449128122 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc2000cb60 con 0x7efc2c0ccea0 2023-11-28T18:39:33.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.893+0000 7efc31b80640 1 -- 172.21.15.45:0/3449128122 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc2c0b3a90 con 0x7efc2c0ccea0 2023-11-28T18:39:33.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.893+0000 7efc31b80640 1 -- 172.21.15.45:0/3449128122 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc2c04e890 con 0x7efc2c0ccea0 2023-11-28T18:39:33.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.893+0000 7efc13fff640 1 -- 172.21.15.45:0/3449128122 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7efc2000ccc0 con 0x7efc2c0ccea0 2023-11-28T18:39:33.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.893+0000 7efc13fff640 1 --2- 172.21.15.45:0/3449128122 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7efc180668d0 0x7efc18068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:33.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.897+0000 7efc13fff640 1 -- 172.21.15.45:0/3449128122 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4857+0+0 (secure 0 0 0) 0x7efc200840e0 con 0x7efc2c0ccea0 2023-11-28T18:39:33.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.897+0000 7efc2b7fe640 1 --2- 172.21.15.45:0/3449128122 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7efc180668d0 0x7efc18068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:33.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.897+0000 7efc2b7fe640 1 --2- 172.21.15.45:0/3449128122 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7efc180668d0 0x7efc18068d90 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7efc1c0011f0 tx=0x7efc1c007d40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:33.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:33.901+0000 7efc13fff640 1 -- 172.21.15.45:0/3449128122 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efc20051700 con 0x7efc2c0ccea0 2023-11-28T18:39:34.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:34.057+0000 7efc31b80640 1 -- 172.21.15.45:0/3449128122 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7efc2c0ca0c0 con 0x7efc2c0ccea0 2023-11-28T18:39:35.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:35.017+0000 7efc13fff640 1 -- 172.21.15.45:0/3449128122 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v43) v1 ==== 138+0+0 (secure 0 0 0) 0x7efc20054d20 con 0x7efc2c0ccea0 2023-11-28T18:39:35.021 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' created 2023-11-28T18:39:35.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:35.021+0000 7efc31b80640 1 -- 172.21.15.45:0/3449128122 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7efc180668d0 msgr2=0x7efc18068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:35.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:35.021+0000 7efc31b80640 1 --2- 172.21.15.45:0/3449128122 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7efc180668d0 0x7efc18068d90 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7efc1c0011f0 tx=0x7efc1c007d40 comp rx=0 tx=0).stop 2023-11-28T18:39:35.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:35.021+0000 7efc31b80640 1 -- 172.21.15.45:0/3449128122 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc2c0ccea0 msgr2=0x7efc2c0abf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:35.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:35.021+0000 7efc31b80640 1 --2- 172.21.15.45:0/3449128122 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc2c0ccea0 0x7efc2c0abf70 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7efc2000e840 tx=0x7efc2000ec40 comp rx=0 tx=0).stop 2023-11-28T18:39:35.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:35.021+0000 7efc31b80640 1 -- 172.21.15.45:0/3449128122 shutdown_connections 2023-11-28T18:39:35.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:35.021+0000 7efc31b80640 1 --2- 172.21.15.45:0/3449128122 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7efc180668d0 0x7efc18068d90 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:35.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:35.021+0000 7efc31b80640 1 --2- 172.21.15.45:0/3449128122 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efc2c0ce4b0 0x7efc2c149aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:35.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:35.021+0000 7efc31b80640 1 --2- 172.21.15.45:0/3449128122 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc2c0ccea0 0x7efc2c0abf70 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:35.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:35.021+0000 7efc31b80640 1 --2- 172.21.15.45:0/3449128122 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efc2c06d730 0x7efc2c14a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:35.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:35.021+0000 7efc31b80640 1 -- 172.21.15.45:0/3449128122 >> 172.21.15.45:0/3449128122 conn(0x7efc2c0b0c90 msgr2=0x7efc2c0cd280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:35.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:35.021+0000 7efc31b80640 1 -- 172.21.15.45:0/3449128122 shutdown_connections 2023-11-28T18:39:35.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:35.021+0000 7efc31b80640 1 -- 172.21.15.45:0/3449128122 wait complete. 2023-11-28T18:39:35.052 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-28T18:39:35.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:35.201+0000 7f6ce4017640 1 Processor -- start 2023-11-28T18:39:35.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:35.205+0000 7f6ce4017640 1 -- start start 2023-11-28T18:39:35.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:35.205+0000 7f6ce4017640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6cdc143d50 0x7f6cdc15f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:35.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:35.205+0000 7f6ce4017640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6cdc0b4310 0x7f6cdc0b47a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:35.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:35.205+0000 7f6ce4017640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cdc144730 con 0x7f6cdc0704c0 2023-11-28T18:39:35.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:35.205+0000 7f6ce4017640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cdc0715d0 con 0x7f6cdc0b4310 2023-11-28T18:39:35.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:35.205+0000 7f6ce4017640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cdc15bd30 con 0x7f6cdc143d50 2023-11-28T18:39:35.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:35.205+0000 7f6ce25b4640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6cdc0b4310 0x7f6cdc0b47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:35.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:35.205+0000 7f6ce25b4640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6cdc0b4310 0x7f6cdc0b47a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59174/0 (socket says 172.21.15.45:59174) 2023-11-28T18:39:35.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:35.205+0000 7f6ce25b4640 1 -- 172.21.15.45:0/1654793009 learned_addr learned my addr 172.21.15.45:0/1654793009 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:35.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:35.205+0000 7f6ce1db3640 1 --2- 172.21.15.45:0/1654793009 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6cdc143d50 0x7f6cdc15f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:35.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:35.205+0000 7f6ce25b4640 1 -- 172.21.15.45:0/1654793009 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6cdc143d50 msgr2=0x7f6cdc15f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:35.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:35.205+0000 7f6ce25b4640 1 --2- 172.21.15.45:0/1654793009 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6cdc143d50 0x7f6cdc15f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:35.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:35.205+0000 7f6ce25b4640 1 -- 172.21.15.45:0/1654793009 >> v1:172.21.15.190:6789/0 conn(0x7f6cdc0704c0 legacy=0x7f6cdc15b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:35.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:35.205+0000 7f6ce25b4640 1 -- 172.21.15.45:0/1654793009 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cdc070950 con 0x7f6cdc0b4310 2023-11-28T18:39:35.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:35.209+0000 7f6ce25b4640 1 --2- 172.21.15.45:0/1654793009 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6cdc0b4310 0x7f6cdc0b47a0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f6cd4009e50 tx=0x7f6cd401c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46a6df28506f48a1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:35.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:35.209+0000 7f6ce0db1640 1 -- 172.21.15.45:0/1654793009 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd40a5730 con 0x7f6cdc0b4310 2023-11-28T18:39:35.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:35.209+0000 7f6ce0db1640 1 -- 172.21.15.45:0/1654793009 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cd40a5890 con 0x7f6cdc0b4310 2023-11-28T18:39:35.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:35.209+0000 7f6ce0db1640 1 -- 172.21.15.45:0/1654793009 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd40a5c20 con 0x7f6cdc0b4310 2023-11-28T18:39:35.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:35.209+0000 7f6ce4017640 1 -- 172.21.15.45:0/1654793009 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6cdc0b4310 msgr2=0x7f6cdc0b47a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:35.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:35.209+0000 7f6ce4017640 1 --2- 172.21.15.45:0/1654793009 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6cdc0b4310 0x7f6cdc0b47a0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f6cd4009e50 tx=0x7f6cd401c980 comp rx=0 tx=0).stop 2023-11-28T18:39:35.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:35.209+0000 7f6ce4017640 1 -- 172.21.15.45:0/1654793009 shutdown_connections 2023-11-28T18:39:35.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:35.209+0000 7f6ce4017640 1 --2- 172.21.15.45:0/1654793009 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6cdc0b4310 0x7f6cdc0b47a0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:35.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:35.209+0000 7f6ce4017640 1 --2- 172.21.15.45:0/1654793009 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6cdc143d50 0x7f6cdc15f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:35.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:35.209+0000 7f6ce4017640 1 -- 172.21.15.45:0/1654793009 >> 172.21.15.45:0/1654793009 conn(0x7f6cdc0b0d00 msgr2=0x7f6cdc0b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:35.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:35.209+0000 7f6ce4017640 1 -- 172.21.15.45:0/1654793009 shutdown_connections 2023-11-28T18:39:35.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:35.209+0000 7f6ce4017640 1 -- 172.21.15.45:0/1654793009 wait complete. 2023-11-28T18:39:35.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:35.209+0000 7f6ce4017640 1 Processor -- start 2023-11-28T18:39:35.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:35.209+0000 7f6ce4017640 1 -- start start 2023-11-28T18:39:35.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:35.213+0000 7f6ce4017640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6cdc0b4310 0x7f6cdc139150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:35.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:35.213+0000 7f6ce4017640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6cdc143d50 0x7f6cdc13ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:35.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:35.213+0000 7f6ce4017640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6cdc13a000 0x7f6cdc13b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:35.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:35.213+0000 7f6ce4017640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cdc13b110 con 0x7f6cdc13a000 2023-11-28T18:39:35.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:35.213+0000 7f6ce4017640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cdc13a500 con 0x7f6cdc0b4310 2023-11-28T18:39:35.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:35.213+0000 7f6ce4017640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cdc13a7e0 con 0x7f6cdc143d50 2023-11-28T18:39:35.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:35.213+0000 7f6ce25b4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6cdc13a000 0x7f6cdc13b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:35.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:35.213+0000 7f6ce25b4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6cdc13a000 0x7f6cdc13b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59180/0 (socket says 172.21.15.45:59180) 2023-11-28T18:39:35.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:35.213+0000 7f6ce25b4640 1 -- 172.21.15.45:0/473139771 learned_addr learned my addr 172.21.15.45:0/473139771 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:35.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:35.213+0000 7f6ce15b2640 1 --2- 172.21.15.45:0/473139771 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6cdc143d50 0x7f6cdc13ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:35.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:35.213+0000 7f6ce1db3640 1 --2- 172.21.15.45:0/473139771 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6cdc0b4310 0x7f6cdc139150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:35.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:35.213+0000 7f6ce25b4640 1 -- 172.21.15.45:0/473139771 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6cdc143d50 msgr2=0x7f6cdc13ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:35.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:35.213+0000 7f6ce25b4640 1 --2- 172.21.15.45:0/473139771 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6cdc143d50 0x7f6cdc13ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:35.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:35.213+0000 7f6ce25b4640 1 -- 172.21.15.45:0/473139771 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6cdc0b4310 msgr2=0x7f6cdc139150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:35.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:35.213+0000 7f6ce25b4640 1 --2- 172.21.15.45:0/473139771 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6cdc0b4310 0x7f6cdc139150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:35.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:35.213+0000 7f6ce25b4640 1 -- 172.21.15.45:0/473139771 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd4009b30 con 0x7f6cdc13a000 2023-11-28T18:39:35.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:35.213+0000 7f6ce25b4640 1 --2- 172.21.15.45:0/473139771 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6cdc13a000 0x7f6cdc13b5a0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f6cd40af040 tx=0x7f6cd4019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:35.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:35.213+0000 7f6cd27fc640 1 -- 172.21.15.45:0/473139771 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd40b8670 con 0x7f6cdc13a000 2023-11-28T18:39:35.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:35.213+0000 7f6cd27fc640 1 -- 172.21.15.45:0/473139771 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cd40b87d0 con 0x7f6cdc13a000 2023-11-28T18:39:35.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:35.213+0000 7f6ce4017640 1 -- 172.21.15.45:0/473139771 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cdc13aac0 con 0x7f6cdc13a000 2023-11-28T18:39:35.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:35.213+0000 7f6cd27fc640 1 -- 172.21.15.45:0/473139771 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd40b8b80 con 0x7f6cdc13a000 2023-11-28T18:39:35.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:35.213+0000 7f6ce4017640 1 -- 172.21.15.45:0/473139771 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cdc13f230 con 0x7f6cdc13a000 2023-11-28T18:39:35.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:35.213+0000 7f6ce4017640 1 -- 172.21.15.45:0/473139771 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cdc13b280 con 0x7f6cdc13a000 2023-11-28T18:39:35.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:35.217+0000 7f6cd27fc640 1 -- 172.21.15.45:0/473139771 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f6cd40b8ce0 con 0x7f6cdc13a000 2023-11-28T18:39:35.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:35.217+0000 7f6cd27fc640 1 --2- 172.21.15.45:0/473139771 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6cc0066900 0x7f6cc0068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:35.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:35.217+0000 7f6cd27fc640 1 -- 172.21.15.45:0/473139771 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f6cd411fd10 con 0x7f6cdc13a000 2023-11-28T18:39:35.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:35.217+0000 7f6ce1db3640 1 --2- 172.21.15.45:0/473139771 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6cc0066900 0x7f6cc0068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:35.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:35.217+0000 7f6ce1db3640 1 --2- 172.21.15.45:0/473139771 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6cc0066900 0x7f6cc0068dc0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6cd8009b60 tx=0x7f6cd8009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:35.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:35.221+0000 7f6cd27fc640 1 -- 172.21.15.45:0/473139771 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6cd40ed2e0 con 0x7f6cdc13a000 2023-11-28T18:39:35.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:35.377+0000 7f6ce4017640 1 -- 172.21.15.45:0/473139771 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f6cdc069480 con 0x7f6cdc13a000 2023-11-28T18:39:36.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.025+0000 7f6cd27fc640 1 -- 172.21.15.45:0/473139771 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v44) v1 ==== 170+0+0 (secure 0 0 0) 0x7f6cd4009510 con 0x7f6cdc13a000 2023-11-28T18:39:36.028 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' created 2023-11-28T18:39:36.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.025+0000 7f6ce4017640 1 -- 172.21.15.45:0/473139771 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6cc0066900 msgr2=0x7f6cc0068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:36.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.025+0000 7f6ce4017640 1 --2- 172.21.15.45:0/473139771 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6cc0066900 0x7f6cc0068dc0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6cd8009b60 tx=0x7f6cd8009190 comp rx=0 tx=0).stop 2023-11-28T18:39:36.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.025+0000 7f6ce4017640 1 -- 172.21.15.45:0/473139771 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6cdc13a000 msgr2=0x7f6cdc13b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:36.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.025+0000 7f6ce4017640 1 --2- 172.21.15.45:0/473139771 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6cdc13a000 0x7f6cdc13b5a0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f6cd40af040 tx=0x7f6cd4019720 comp rx=0 tx=0).stop 2023-11-28T18:39:36.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.025+0000 7f6ce4017640 1 -- 172.21.15.45:0/473139771 shutdown_connections 2023-11-28T18:39:36.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.025+0000 7f6ce4017640 1 --2- 172.21.15.45:0/473139771 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6cc0066900 0x7f6cc0068dc0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:36.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.025+0000 7f6ce4017640 1 --2- 172.21.15.45:0/473139771 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6cdc13a000 0x7f6cdc13b5a0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:36.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.025+0000 7f6ce4017640 1 --2- 172.21.15.45:0/473139771 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6cdc143d50 0x7f6cdc13ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:36.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.025+0000 7f6ce4017640 1 --2- 172.21.15.45:0/473139771 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6cdc0b4310 0x7f6cdc139150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:36.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.025+0000 7f6ce4017640 1 -- 172.21.15.45:0/473139771 >> 172.21.15.45:0/473139771 conn(0x7f6cdc0b0d00 msgr2=0x7f6cdc15be70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:36.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.029+0000 7f6ce4017640 1 -- 172.21.15.45:0/473139771 shutdown_connections 2023-11-28T18:39:36.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.029+0000 7f6ce4017640 1 -- 172.21.15.45:0/473139771 wait complete. 2023-11-28T18:39:36.070 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-28T18:39:36.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.213+0000 7f05ea654640 1 Processor -- start 2023-11-28T18:39:36.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.213+0000 7f05ea654640 1 -- start start 2023-11-28T18:39:36.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.213+0000 7f05ea654640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f05e40aee10 0x7f05e415dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:36.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.213+0000 7f05ea654640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f05e415a890 0x7f05e40b41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:36.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.213+0000 7f05ea654640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f05e4071400 0x7f05e4071890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:36.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.213+0000 7f05ea654640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05e4159be0 con 0x7f05e4071400 2023-11-28T18:39:36.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.213+0000 7f05ea654640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05e4071dd0 con 0x7f05e415a890 2023-11-28T18:39:36.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.213+0000 7f05ea654640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05e40af1f0 con 0x7f05e40aee10 2023-11-28T18:39:36.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.213+0000 7f05e8bf1640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f05e4071400 0x7f05e4071890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:36.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.213+0000 7f05e8bf1640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f05e4071400 0x7f05e4071890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59190/0 (socket says 172.21.15.45:59190) 2023-11-28T18:39:36.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.213+0000 7f05e8bf1640 1 -- 172.21.15.45:0/2840861818 learned_addr learned my addr 172.21.15.45:0/2840861818 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:36.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.213+0000 7f05e37fe640 1 --2- 172.21.15.45:0/2840861818 >> v2:172.21.15.190:3300/0 conn(0x7f05e415a890 0x7f05e40b41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:36.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.213+0000 7f05e3fff640 1 --2- 172.21.15.45:0/2840861818 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f05e40aee10 0x7f05e415dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:36.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.217+0000 7f05e8bf1640 1 -- 172.21.15.45:0/2840861818 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f05e40aee10 msgr2=0x7f05e415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:36.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.217+0000 7f05e8bf1640 1 --2- 172.21.15.45:0/2840861818 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f05e40aee10 0x7f05e415dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:36.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.217+0000 7f05e8bf1640 1 -- 172.21.15.45:0/2840861818 >> v2:172.21.15.190:3300/0 conn(0x7f05e415a890 msgr2=0x7f05e40b41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:36.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.217+0000 7f05e8bf1640 1 --2- 172.21.15.45:0/2840861818 >> v2:172.21.15.190:3300/0 conn(0x7f05e415a890 0x7f05e40b41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:36.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.217+0000 7f05e8bf1640 1 -- 172.21.15.45:0/2840861818 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05e40b4700 con 0x7f05e4071400 2023-11-28T18:39:36.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.217+0000 7f05e8bf1640 1 --2- 172.21.15.45:0/2840861818 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05e4071400 0x7f05e4071890 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f05e4071ff0 tx=0x7f05dc01da40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4a4b2c6ff1b4f9a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:36.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.217+0000 7f05e2ffd640 1 -- 172.21.15.45:0/2840861818 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05dc00a2d0 con 0x7f05e4071400 2023-11-28T18:39:36.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.217+0000 7f05e2ffd640 1 -- 172.21.15.45:0/2840861818 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05dc0a6730 con 0x7f05e4071400 2023-11-28T18:39:36.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.217+0000 7f05e2ffd640 1 -- 172.21.15.45:0/2840861818 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05dc0a6ac0 con 0x7f05e4071400 2023-11-28T18:39:36.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.217+0000 7f05ea654640 1 -- 172.21.15.45:0/2840861818 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05e4071400 msgr2=0x7f05e4071890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:36.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.217+0000 7f05ea654640 1 --2- 172.21.15.45:0/2840861818 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05e4071400 0x7f05e4071890 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f05e4071ff0 tx=0x7f05dc01da40 comp rx=0 tx=0).stop 2023-11-28T18:39:36.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.217+0000 7f05ea654640 1 -- 172.21.15.45:0/2840861818 shutdown_connections 2023-11-28T18:39:36.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.217+0000 7f05ea654640 1 --2- 172.21.15.45:0/2840861818 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05e4071400 0x7f05e4071890 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:36.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.217+0000 7f05ea654640 1 --2- 172.21.15.45:0/2840861818 >> v2:172.21.15.190:3300/0 conn(0x7f05e415a890 0x7f05e40b41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:36.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.217+0000 7f05ea654640 1 --2- 172.21.15.45:0/2840861818 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f05e40aee10 0x7f05e415dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:36.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.217+0000 7f05ea654640 1 -- 172.21.15.45:0/2840861818 >> 172.21.15.45:0/2840861818 conn(0x7f05e40b1b70 msgr2=0x7f05e4070cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:36.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.217+0000 7f05ea654640 1 -- 172.21.15.45:0/2840861818 shutdown_connections 2023-11-28T18:39:36.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.217+0000 7f05ea654640 1 -- 172.21.15.45:0/2840861818 wait complete. 2023-11-28T18:39:36.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.221+0000 7f05ea654640 1 Processor -- start 2023-11-28T18:39:36.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.221+0000 7f05ea654640 1 -- start start 2023-11-28T18:39:36.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.221+0000 7f05ea654640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f05e4071400 0x7f05e41514d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:36.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.221+0000 7f05ea654640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f05e40aee10 0x7f05e414f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:36.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.221+0000 7f05ea654640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05e415a890 0x7f05e415beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:36.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.221+0000 7f05ea654640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e415ca30 con 0x7f05e415a890 2023-11-28T18:39:36.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.221+0000 7f05ea654640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e4157d30 con 0x7f05e40aee10 2023-11-28T18:39:36.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.221+0000 7f05ea654640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05e4157ff0 con 0x7f05e4071400 2023-11-28T18:39:36.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.221+0000 7f05e8bf1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05e415a890 0x7f05e415beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:36.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.221+0000 7f05e8bf1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05e415a890 0x7f05e415beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59194/0 (socket says 172.21.15.45:59194) 2023-11-28T18:39:36.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.221+0000 7f05e8bf1640 1 -- 172.21.15.45:0/2221876524 learned_addr learned my addr 172.21.15.45:0/2221876524 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:36.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.221+0000 7f05e37fe640 1 --2- 172.21.15.45:0/2221876524 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f05e40aee10 0x7f05e414f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:36.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.221+0000 7f05e3fff640 1 --2- 172.21.15.45:0/2221876524 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f05e4071400 0x7f05e41514d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:36.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.221+0000 7f05e8bf1640 1 -- 172.21.15.45:0/2221876524 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f05e4071400 msgr2=0x7f05e41514d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:36.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.221+0000 7f05e8bf1640 1 --2- 172.21.15.45:0/2221876524 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f05e4071400 0x7f05e41514d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:36.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.221+0000 7f05e8bf1640 1 -- 172.21.15.45:0/2221876524 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f05e40aee10 msgr2=0x7f05e414f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:36.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.221+0000 7f05e8bf1640 1 --2- 172.21.15.45:0/2221876524 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f05e40aee10 0x7f05e414f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:36.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.221+0000 7f05e8bf1640 1 -- 172.21.15.45:0/2221876524 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05dc00ac40 con 0x7f05e415a890 2023-11-28T18:39:36.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.221+0000 7f05e8bf1640 1 --2- 172.21.15.45:0/2221876524 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05e415a890 0x7f05e415beb0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f05dc01c0f0 tx=0x7f05dc01a7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:36.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.221+0000 7f05e0ff9640 1 -- 172.21.15.45:0/2221876524 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05dc0bc070 con 0x7f05e415a890 2023-11-28T18:39:36.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.221+0000 7f05e0ff9640 1 -- 172.21.15.45:0/2221876524 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05dc0a6bb0 con 0x7f05e415a890 2023-11-28T18:39:36.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.221+0000 7f05e0ff9640 1 -- 172.21.15.45:0/2221876524 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05dc008500 con 0x7f05e415a890 2023-11-28T18:39:36.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.221+0000 7f05ea654640 1 -- 172.21.15.45:0/2221876524 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05e41582d0 con 0x7f05e415a890 2023-11-28T18:39:36.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.225+0000 7f05ea654640 1 -- 172.21.15.45:0/2221876524 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05e41585b0 con 0x7f05e415a890 2023-11-28T18:39:36.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.225+0000 7f05ea654640 1 -- 172.21.15.45:0/2221876524 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05e40742e0 con 0x7f05e415a890 2023-11-28T18:39:36.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.225+0000 7f05e0ff9640 1 -- 172.21.15.45:0/2221876524 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f05dc008660 con 0x7f05e415a890 2023-11-28T18:39:36.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.225+0000 7f05e0ff9640 1 --2- 172.21.15.45:0/2221876524 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f05d00668d0 0x7f05d0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:36.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.225+0000 7f05e0ff9640 1 -- 172.21.15.45:0/2221876524 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f05dc11ed20 con 0x7f05e415a890 2023-11-28T18:39:36.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.225+0000 7f05e3fff640 1 --2- 172.21.15.45:0/2221876524 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f05d00668d0 0x7f05d0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:36.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.229+0000 7f05e3fff640 1 --2- 172.21.15.45:0/2221876524 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f05d00668d0 0x7f05d0068d90 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f05d4009ae0 tx=0x7f05d4009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:36.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.229+0000 7f05e0ff9640 1 -- 172.21.15.45:0/2221876524 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f05dc0ec120 con 0x7f05e415a890 2023-11-28T18:39:36.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:36.421+0000 7f05ea654640 1 -- 172.21.15.45:0/2221876524 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f05e4069410 con 0x7f05e415a890 2023-11-28T18:39:37.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.033+0000 7f05e0ff9640 1 -- 172.21.15.45:0/2221876524 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v29) v1 ==== 172+0+0 (secure 0 0 0) 0x7f05dc0ef740 con 0x7f05e415a890 2023-11-28T18:39:37.047 INFO:teuthology.orchestra.run.smithi045.stderr:new fs with metadata pool 6 and data pool 7 2023-11-28T18:39:37.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.057+0000 7f05ea654640 1 -- 172.21.15.45:0/2221876524 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f05d00668d0 msgr2=0x7f05d0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:37.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.057+0000 7f05ea654640 1 --2- 172.21.15.45:0/2221876524 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f05d00668d0 0x7f05d0068d90 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f05d4009ae0 tx=0x7f05d4009190 comp rx=0 tx=0).stop 2023-11-28T18:39:37.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.057+0000 7f05ea654640 1 -- 172.21.15.45:0/2221876524 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05e415a890 msgr2=0x7f05e415beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:37.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.057+0000 7f05ea654640 1 --2- 172.21.15.45:0/2221876524 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05e415a890 0x7f05e415beb0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f05dc01c0f0 tx=0x7f05dc01a7e0 comp rx=0 tx=0).stop 2023-11-28T18:39:37.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.057+0000 7f05ea654640 1 -- 172.21.15.45:0/2221876524 shutdown_connections 2023-11-28T18:39:37.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.057+0000 7f05ea654640 1 --2- 172.21.15.45:0/2221876524 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f05d00668d0 0x7f05d0068d90 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:37.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.057+0000 7f05ea654640 1 --2- 172.21.15.45:0/2221876524 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05e415a890 0x7f05e415beb0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:37.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.057+0000 7f05ea654640 1 --2- 172.21.15.45:0/2221876524 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f05e40aee10 0x7f05e414f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:37.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.057+0000 7f05ea654640 1 --2- 172.21.15.45:0/2221876524 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f05e4071400 0x7f05e41514d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:37.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.057+0000 7f05ea654640 1 -- 172.21.15.45:0/2221876524 >> 172.21.15.45:0/2221876524 conn(0x7f05e40b1b70 msgr2=0x7f05e40cec20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:37.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.057+0000 7f05ea654640 1 -- 172.21.15.45:0/2221876524 shutdown_connections 2023-11-28T18:39:37.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.057+0000 7f05ea654640 1 -- 172.21.15.45:0/2221876524 wait complete. 2023-11-28T18:39:37.091 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T18:39:37.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.233+0000 7f3b5dc5f640 1 Processor -- start 2023-11-28T18:39:37.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.233+0000 7f3b5dc5f640 1 -- start start 2023-11-28T18:39:37.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.233+0000 7f3b5dc5f640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f3b580b35f0 0x7f3b580d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:37.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.233+0000 7f3b5dc5f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3b580b3cb0 0x7f3b5815f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:37.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.233+0000 7f3b5dc5f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3b580cf7c0 0x7f3b580cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:37.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.233+0000 7f3b5dc5f640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b580d40d0 con 0x7f3b580b3cb0 2023-11-28T18:39:37.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.233+0000 7f3b5dc5f640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b580d0150 con 0x7f3b580b35f0 2023-11-28T18:39:37.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.233+0000 7f3b5dc5f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b580d38c0 con 0x7f3b580cf7c0 2023-11-28T18:39:37.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.233+0000 7f3b56ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3b580b3cb0 0x7f3b5815f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:37.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.233+0000 7f3b56ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3b580b3cb0 0x7f3b5815f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59204/0 (socket says 172.21.15.45:59204) 2023-11-28T18:39:37.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.233+0000 7f3b56ffd640 1 -- 172.21.15.45:0/1553241405 learned_addr learned my addr 172.21.15.45:0/1553241405 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:37.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.233+0000 7f3b577fe640 1 --2- 172.21.15.45:0/1553241405 >> v2:172.21.15.190:3300/0 conn(0x7f3b580b35f0 0x7f3b580d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:37.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.233+0000 7f3b56ffd640 1 -- 172.21.15.45:0/1553241405 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3b580cf7c0 msgr2=0x7f3b580cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:37.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.233+0000 7f3b57fff640 1 --2- 172.21.15.45:0/1553241405 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3b580cf7c0 0x7f3b580cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:37.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.233+0000 7f3b56ffd640 1 --2- 172.21.15.45:0/1553241405 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3b580cf7c0 0x7f3b580cfc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:37.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.233+0000 7f3b56ffd640 1 -- 172.21.15.45:0/1553241405 >> v2:172.21.15.190:3300/0 conn(0x7f3b580b35f0 msgr2=0x7f3b580d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:37.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.233+0000 7f3b56ffd640 1 --2- 172.21.15.45:0/1553241405 >> v2:172.21.15.190:3300/0 conn(0x7f3b580b35f0 0x7f3b580d0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:37.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.233+0000 7f3b56ffd640 1 -- 172.21.15.45:0/1553241405 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b580cdcc0 con 0x7f3b580b3cb0 2023-11-28T18:39:37.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.233+0000 7f3b57fff640 1 --2- 172.21.15.45:0/1553241405 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3b580cf7c0 0x7f3b580cfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:39:37.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.233+0000 7f3b577fe640 1 --2- 172.21.15.45:0/1553241405 >> v2:172.21.15.190:3300/0 conn(0x7f3b580b35f0 0x7f3b580d0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:39:37.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.237+0000 7f3b56ffd640 1 --2- 172.21.15.45:0/1553241405 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b580b3cb0 0x7f3b5815f0a0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f3b5808ca20 tx=0x7f3b4c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd2c643ca623a3fe server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:37.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.237+0000 7f3b567fc640 1 -- 172.21.15.45:0/1553241405 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c0aa620 con 0x7f3b580b3cb0 2023-11-28T18:39:37.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.237+0000 7f3b567fc640 1 -- 172.21.15.45:0/1553241405 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b4c0aa780 con 0x7f3b580b3cb0 2023-11-28T18:39:37.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.237+0000 7f3b567fc640 1 -- 172.21.15.45:0/1553241405 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c0aab10 con 0x7f3b580b3cb0 2023-11-28T18:39:37.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.237+0000 7f3b5dc5f640 1 -- 172.21.15.45:0/1553241405 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b580b3cb0 msgr2=0x7f3b5815f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:37.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.237+0000 7f3b5dc5f640 1 --2- 172.21.15.45:0/1553241405 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b580b3cb0 0x7f3b5815f0a0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f3b5808ca20 tx=0x7f3b4c01c500 comp rx=0 tx=0).stop 2023-11-28T18:39:37.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.237+0000 7f3b5dc5f640 1 -- 172.21.15.45:0/1553241405 shutdown_connections 2023-11-28T18:39:37.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.237+0000 7f3b5dc5f640 1 --2- 172.21.15.45:0/1553241405 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3b580cf7c0 0x7f3b580cfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:37.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.237+0000 7f3b5dc5f640 1 --2- 172.21.15.45:0/1553241405 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b580b3cb0 0x7f3b5815f0a0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:37.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.237+0000 7f3b5dc5f640 1 --2- 172.21.15.45:0/1553241405 >> v2:172.21.15.190:3300/0 conn(0x7f3b580b35f0 0x7f3b580d0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:37.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.237+0000 7f3b5dc5f640 1 -- 172.21.15.45:0/1553241405 >> 172.21.15.45:0/1553241405 conn(0x7f3b5809c4f0 msgr2=0x7f3b580d31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:37.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.237+0000 7f3b5dc5f640 1 -- 172.21.15.45:0/1553241405 shutdown_connections 2023-11-28T18:39:37.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.237+0000 7f3b5dc5f640 1 -- 172.21.15.45:0/1553241405 wait complete. 2023-11-28T18:39:37.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.241+0000 7f3b5dc5f640 1 Processor -- start 2023-11-28T18:39:37.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.241+0000 7f3b5dc5f640 1 -- start start 2023-11-28T18:39:37.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.241+0000 7f3b5dc5f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3b580b35f0 0x7f3b58151480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:37.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.241+0000 7f3b5dc5f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b580b3cb0 0x7f3b580b2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:37.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.241+0000 7f3b5dc5f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3b580cf7c0 0x7f3b580b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:37.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.241+0000 7f3b5dc5f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b580c9910 con 0x7f3b580b3cb0 2023-11-28T18:39:37.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.241+0000 7f3b5dc5f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b580c9bf0 con 0x7f3b580cf7c0 2023-11-28T18:39:37.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.241+0000 7f3b5dc5f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b58152d50 con 0x7f3b580b35f0 2023-11-28T18:39:37.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.241+0000 7f3b56ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b580b3cb0 0x7f3b580b2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:37.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.241+0000 7f3b56ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b580b3cb0 0x7f3b580b2510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59208/0 (socket says 172.21.15.45:59208) 2023-11-28T18:39:37.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.241+0000 7f3b56ffd640 1 -- 172.21.15.45:0/2532834265 learned_addr learned my addr 172.21.15.45:0/2532834265 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:37.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.241+0000 7f3b577fe640 1 --2- 172.21.15.45:0/2532834265 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3b580b35f0 0x7f3b58151480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:37.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.241+0000 7f3b57fff640 1 --2- 172.21.15.45:0/2532834265 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3b580cf7c0 0x7f3b580b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:37.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.241+0000 7f3b56ffd640 1 -- 172.21.15.45:0/2532834265 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3b580b35f0 msgr2=0x7f3b58151480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:37.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.241+0000 7f3b56ffd640 1 --2- 172.21.15.45:0/2532834265 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3b580b35f0 0x7f3b58151480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:37.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.241+0000 7f3b56ffd640 1 -- 172.21.15.45:0/2532834265 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3b580cf7c0 msgr2=0x7f3b580b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:37.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.241+0000 7f3b56ffd640 1 --2- 172.21.15.45:0/2532834265 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3b580cf7c0 0x7f3b580b2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:37.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.241+0000 7f3b56ffd640 1 -- 172.21.15.45:0/2532834265 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b4c0094d0 con 0x7f3b580b3cb0 2023-11-28T18:39:37.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.241+0000 7f3b56ffd640 1 --2- 172.21.15.45:0/2532834265 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b580b3cb0 0x7f3b580b2510 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c01abb0 tx=0x7f3b4c01ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:37.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.241+0000 7f3b3ffff640 1 -- 172.21.15.45:0/2532834265 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c0bd5f0 con 0x7f3b580b3cb0 2023-11-28T18:39:37.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.241+0000 7f3b3ffff640 1 -- 172.21.15.45:0/2532834265 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b4c0bd770 con 0x7f3b580b3cb0 2023-11-28T18:39:37.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.241+0000 7f3b5dc5f640 1 -- 172.21.15.45:0/2532834265 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b58153030 con 0x7f3b580b3cb0 2023-11-28T18:39:37.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.241+0000 7f3b3ffff640 1 -- 172.21.15.45:0/2532834265 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c0bdb20 con 0x7f3b580b3cb0 2023-11-28T18:39:37.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.241+0000 7f3b5dc5f640 1 -- 172.21.15.45:0/2532834265 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b58152380 con 0x7f3b580b3cb0 2023-11-28T18:39:37.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.241+0000 7f3b5dc5f640 1 -- 172.21.15.45:0/2532834265 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b58152570 con 0x7f3b580b3cb0 2023-11-28T18:39:37.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.245+0000 7f3b3ffff640 1 -- 172.21.15.45:0/2532834265 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f3b4c0b33f0 con 0x7f3b580b3cb0 2023-11-28T18:39:37.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.245+0000 7f3b3ffff640 1 --2- 172.21.15.45:0/2532834265 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f3b440668d0 0x7f3b44068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:37.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.245+0000 7f3b3ffff640 1 -- 172.21.15.45:0/2532834265 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3b4c11f180 con 0x7f3b580b3cb0 2023-11-28T18:39:37.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.245+0000 7f3b577fe640 1 --2- 172.21.15.45:0/2532834265 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f3b440668d0 0x7f3b44068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:37.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.245+0000 7f3b577fe640 1 --2- 172.21.15.45:0/2532834265 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f3b440668d0 0x7f3b44068d90 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3b48006b20 tx=0x7f3b48008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:37.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.249+0000 7f3b3ffff640 1 -- 172.21.15.45:0/2532834265 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3b58152570 con 0x7f3b580b3cb0 2023-11-28T18:39:37.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.409+0000 7f3b5dc5f640 1 -- 172.21.15.45:0/2532834265 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3b58152bb0 con 0x7f3b580b3cb0 2023-11-28T18:39:37.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.409+0000 7f3b3ffff640 1 -- 172.21.15.45:0/2532834265 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+16490 (secure 0 0 0) 0x7f3b58152bb0 con 0x7f3b580b3cb0 2023-11-28T18:39:37.412 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:39:37.412 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":45,"fsid":"d10f5cd6-1d00-4019-99b6-6fa435498a15","created":"2023-11-28T18:37:08.189030+0000","modified":"2023-11-28T18:39:36.424215+0000","last_up_change":"2023-11-28T18:37:20.196124+0000","last_in_change":"2023-11-28T18:37:10.742043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T18:37:21.293917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-28T18:39:34.106789+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-28T18:39:35.426601+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"84465384-103c-4f2c-a45a-96f5bb9c835f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6809","nonce":555237322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6811","nonce":555237322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6815","nonce":555237322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6813","nonce":555237322}]},"public_addr":"172.21.15.45:6809/555237322","cluster_addr":"172.21.15.45:6811/555237322","heartbeat_back_addr":"172.21.15.45:6815/555237322","heartbeat_front_addr":"172.21.15.45:6813/555237322","state":["exists","up"]},{"osd":1,"uuid":"7d9eed24-a58f-42c7-a787-ac06be8553fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6801","nonce":2857063763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6803","nonce":2857063763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6807","nonce":2857063763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6805","nonce":2857063763}]},"public_addr":"172.21.15.45:6801/2857063763","cluster_addr":"172.21.15.45:6803/2857063763","heartbeat_back_addr":"172.21.15.45:6807/2857063763","heartbeat_front_addr":"172.21.15.45:6805/2857063763","state":["exists","up"]},{"osd":2,"uuid":"575eeccc-4abf-45b4-9caf-f3e797859588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6817","nonce":193884539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6819","nonce":193884539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6823","nonce":193884539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6821","nonce":193884539}]},"public_addr":"172.21.15.45:6817/193884539","cluster_addr":"172.21.15.45:6819/193884539","heartbeat_back_addr":"172.21.15.45:6823/193884539","heartbeat_front_addr":"172.21.15.45:6821/193884539","state":["exists","up"]},{"osd":3,"uuid":"9b0290d6-9a52-4bc8-b2a1-7622c5dc8e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6825","nonce":78541084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6827","nonce":78541084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6831","nonce":78541084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6829","nonce":78541084}]},"public_addr":"172.21.15.45:6825/78541084","cluster_addr":"172.21.15.45:6827/78541084","heartbeat_back_addr":"172.21.15.45:6831/78541084","heartbeat_front_addr":"172.21.15.45:6829/78541084","state":["exists","up"]},{"osd":4,"uuid":"ce632829-f027-4fbf-a627-02c571aa9d53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6809","nonce":1537591987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6811","nonce":1537591987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6815","nonce":1537591987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6813","nonce":1537591987}]},"public_addr":"172.21.15.190:6809/1537591987","cluster_addr":"172.21.15.190:6811/1537591987","heartbeat_back_addr":"172.21.15.190:6815/1537591987","heartbeat_front_addr":"172.21.15.190:6813/1537591987","state":["exists","up"]},{"osd":5,"uuid":"8700b609-27be-40bd-a251-4c0ae0a29ead","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6801","nonce":3296698407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6803","nonce":3296698407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6807","nonce":3296698407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6805","nonce":3296698407}]},"public_addr":"172.21.15.190:6801/3296698407","cluster_addr":"172.21.15.190:6803/3296698407","heartbeat_back_addr":"172.21.15.190:6807/3296698407","heartbeat_front_addr":"172.21.15.190:6805/3296698407","state":["exists","up"]},{"osd":6,"uuid":"44ce4a40-e6ff-4f4d-8e8a-7341e5c91f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6817","nonce":2317686718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6819","nonce":2317686718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6823","nonce":2317686718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6821","nonce":2317686718}]},"public_addr":"172.21.15.190:6817/2317686718","cluster_addr":"172.21.15.190:6819/2317686718","heartbeat_back_addr":"172.21.15.190:6823/2317686718","heartbeat_front_addr":"172.21.15.190:6821/2317686718","state":["exists","up"]},{"osd":7,"uuid":"192238c9-1423-4b7e-ac8f-84ba32113ddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6825","nonce":2493232051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6827","nonce":2493232051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6831","nonce":2493232051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6829","nonce":2493232051}]},"public_addr":"172.21.15.190:6825/2493232051","cluster_addr":"172.21.15.190:6827/2493232051","heartbeat_back_addr":"172.21.15.190:6831/2493232051","heartbeat_front_addr":"172.21.15.190:6829/2493232051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.393552+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.385453+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.361421+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.366408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.363226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.276007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.414605+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.445885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T18:39:37.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.409+0000 7f3b5dc5f640 1 -- 172.21.15.45:0/2532834265 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f3b440668d0 msgr2=0x7f3b44068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:37.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.409+0000 7f3b5dc5f640 1 --2- 172.21.15.45:0/2532834265 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f3b440668d0 0x7f3b44068d90 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3b48006b20 tx=0x7f3b48008040 comp rx=0 tx=0).stop 2023-11-28T18:39:37.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.409+0000 7f3b5dc5f640 1 -- 172.21.15.45:0/2532834265 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b580b3cb0 msgr2=0x7f3b580b2510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:37.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.409+0000 7f3b5dc5f640 1 --2- 172.21.15.45:0/2532834265 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b580b3cb0 0x7f3b580b2510 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c01abb0 tx=0x7f3b4c01ad40 comp rx=0 tx=0).stop 2023-11-28T18:39:37.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.409+0000 7f3b5dc5f640 1 -- 172.21.15.45:0/2532834265 shutdown_connections 2023-11-28T18:39:37.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.409+0000 7f3b5dc5f640 1 --2- 172.21.15.45:0/2532834265 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f3b440668d0 0x7f3b44068d90 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:37.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.409+0000 7f3b5dc5f640 1 --2- 172.21.15.45:0/2532834265 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3b580cf7c0 0x7f3b580b2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:37.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.409+0000 7f3b5dc5f640 1 --2- 172.21.15.45:0/2532834265 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b580b3cb0 0x7f3b580b2510 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:37.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.409+0000 7f3b5dc5f640 1 --2- 172.21.15.45:0/2532834265 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3b580b35f0 0x7f3b58151480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:37.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.409+0000 7f3b5dc5f640 1 -- 172.21.15.45:0/2532834265 >> 172.21.15.45:0/2532834265 conn(0x7f3b5809c4f0 msgr2=0x7f3b580d2540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:37.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.409+0000 7f3b5dc5f640 1 -- 172.21.15.45:0/2532834265 shutdown_connections 2023-11-28T18:39:37.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.409+0000 7f3b5dc5f640 1 -- 172.21.15.45:0/2532834265 wait complete. 2023-11-28T18:39:37.433 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T18:39:37.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.573+0000 7f96489f8640 1 Processor -- start 2023-11-28T18:39:37.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.573+0000 7f96489f8640 1 -- start start 2023-11-28T18:39:37.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.577+0000 7f96489f8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f96440b32c0 0x7f9644160f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:37.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.577+0000 7f96489f8640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9644146fe0 con 0x7f9644146c00 2023-11-28T18:39:37.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.577+0000 7f96489f8640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f964415e8b0 con 0x7f964415e430 2023-11-28T18:39:37.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.577+0000 7f96489f8640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f964406f390 con 0x7f96440b32c0 2023-11-28T18:39:37.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.577+0000 7f964259c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f9644146c00 0x7f964406e8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:34534/0 (socket says 172.21.15.45:34534) 2023-11-28T18:39:37.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.577+0000 7f964259c640 1 -- 172.21.15.45:0/3915105829 learned_addr learned my addr 172.21.15.45:0/3915105829 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:39:37.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.577+0000 7f9642d9d640 1 --2- 172.21.15.45:0/3915105829 >> v2:172.21.15.45:3300/0 conn(0x7f96440b32c0 0x7f9644160f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:37.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.577+0000 7f9641d9b640 1 -- 172.21.15.45:0/3915105829 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1718221419 0 0) 0x7f9644146fe0 con 0x7f9644146c00 2023-11-28T18:39:37.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.577+0000 7f9641d9b640 1 -- 172.21.15.45:0/3915105829 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9630003530 con 0x7f9644146c00 2023-11-28T18:39:37.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.577+0000 7f9642d9d640 1 -- 172.21.15.45:0/3915105829 >> v1:172.21.15.190:6789/0 conn(0x7f964415e430 legacy=0x7f96440b2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:37.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.577+0000 7f9641d9b640 1 -- 172.21.15.45:0/3915105829 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3770998916 0 0) 0x7f964415e8b0 con 0x7f964415e430 2023-11-28T18:39:37.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.577+0000 7f9642d9d640 1 -- 172.21.15.45:0/3915105829 >> v1:172.21.15.45:6789/0 conn(0x7f9644146c00 legacy=0x7f964406e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:37.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.577+0000 7f9642d9d640 1 -- 172.21.15.45:0/3915105829 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f964406f670 con 0x7f96440b32c0 2023-11-28T18:39:37.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.581+0000 7f9642d9d640 1 --2- 172.21.15.45:0/3915105829 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96440b32c0 0x7f9644160f10 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f963c009d90 tx=0x7f963c01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3154997d0d000b08 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:37.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.581+0000 7f9641d9b640 1 -- 172.21.15.45:0/3915105829 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f963c0a5900 con 0x7f96440b32c0 2023-11-28T18:39:37.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.581+0000 7f9641d9b640 1 -- 172.21.15.45:0/3915105829 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f963c0a5a60 con 0x7f96440b32c0 2023-11-28T18:39:37.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.581+0000 7f9641d9b640 1 -- 172.21.15.45:0/3915105829 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f963c0a5df0 con 0x7f96440b32c0 2023-11-28T18:39:37.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.581+0000 7f96489f8640 1 -- 172.21.15.45:0/3915105829 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96440b32c0 msgr2=0x7f9644160f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:37.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.581+0000 7f96489f8640 1 --2- 172.21.15.45:0/3915105829 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96440b32c0 0x7f9644160f10 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f963c009d90 tx=0x7f963c01c920 comp rx=0 tx=0).stop 2023-11-28T18:39:37.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.581+0000 7f96489f8640 1 -- 172.21.15.45:0/3915105829 shutdown_connections 2023-11-28T18:39:37.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.581+0000 7f96489f8640 1 --2- 172.21.15.45:0/3915105829 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96440b32c0 0x7f9644160f10 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:37.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.581+0000 7f96489f8640 1 -- 172.21.15.45:0/3915105829 >> 172.21.15.45:0/3915105829 conn(0x7f964406a570 msgr2=0x7f964406a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:37.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.581+0000 7f96489f8640 1 -- 172.21.15.45:0/3915105829 shutdown_connections 2023-11-28T18:39:37.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.581+0000 7f96489f8640 1 -- 172.21.15.45:0/3915105829 wait complete. 2023-11-28T18:39:37.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.581+0000 7f96489f8640 1 Processor -- start 2023-11-28T18:39:37.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.581+0000 7f96489f8640 1 -- start start 2023-11-28T18:39:37.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.581+0000 7f96489f8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f96440b32c0 0x7f96440cc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:37.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.581+0000 7f96489f8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9644146c00 0x7f964415a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:37.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.585+0000 7f96489f8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f964415e430 0x7f9644142ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:37.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.585+0000 7f96489f8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9644141670 con 0x7f964415e430 2023-11-28T18:39:37.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.585+0000 7f96489f8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9644142a60 con 0x7f96440b32c0 2023-11-28T18:39:37.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.585+0000 7f96489f8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9644141b70 con 0x7f9644146c00 2023-11-28T18:39:37.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.585+0000 7f9642d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f964415e430 0x7f9644142ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:37.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.585+0000 7f9642d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f964415e430 0x7f9644142ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59220/0 (socket says 172.21.15.45:59220) 2023-11-28T18:39:37.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.585+0000 7f9642d9d640 1 -- 172.21.15.45:0/2179948949 learned_addr learned my addr 172.21.15.45:0/2179948949 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:37.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.585+0000 7f964259c640 1 --2- 172.21.15.45:0/2179948949 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f96440b32c0 0x7f96440cc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:37.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.585+0000 7f963bfff640 1 --2- 172.21.15.45:0/2179948949 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9644146c00 0x7f964415a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:37.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.585+0000 7f9642d9d640 1 -- 172.21.15.45:0/2179948949 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9644146c00 msgr2=0x7f964415a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:37.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.585+0000 7f9642d9d640 1 --2- 172.21.15.45:0/2179948949 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9644146c00 0x7f964415a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:37.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.585+0000 7f9642d9d640 1 -- 172.21.15.45:0/2179948949 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f96440b32c0 msgr2=0x7f96440cc3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:37.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.585+0000 7f9642d9d640 1 --2- 172.21.15.45:0/2179948949 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f96440b32c0 0x7f96440cc3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:37.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.585+0000 7f9642d9d640 1 -- 172.21.15.45:0/2179948949 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f963c009a70 con 0x7f964415e430 2023-11-28T18:39:37.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.585+0000 7f964259c640 1 --2- 172.21.15.45:0/2179948949 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f96440b32c0 0x7f96440cc3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:39:37.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.585+0000 7f9642d9d640 1 --2- 172.21.15.45:0/2179948949 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f964415e430 0x7f9644142ef0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f963c009d90 tx=0x7f963c0196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:37.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.585+0000 7f963affd640 1 -- 172.21.15.45:0/2179948949 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f963c003ba0 con 0x7f964415e430 2023-11-28T18:39:37.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.585+0000 7f963affd640 1 -- 172.21.15.45:0/2179948949 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f963c003d00 con 0x7f964415e430 2023-11-28T18:39:37.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.585+0000 7f963affd640 1 -- 172.21.15.45:0/2179948949 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f963c0b9860 con 0x7f964415e430 2023-11-28T18:39:37.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.585+0000 7f96489f8640 1 -- 172.21.15.45:0/2179948949 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9644141e50 con 0x7f964415e430 2023-11-28T18:39:37.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.585+0000 7f96489f8640 1 -- 172.21.15.45:0/2179948949 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9644142410 con 0x7f964415e430 2023-11-28T18:39:37.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.585+0000 7f96489f8640 1 -- 172.21.15.45:0/2179948949 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9644142c10 con 0x7f964415e430 2023-11-28T18:39:37.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.585+0000 7f963affd640 1 -- 172.21.15.45:0/2179948949 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f963c0b99c0 con 0x7f964415e430 2023-11-28T18:39:37.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.589+0000 7f963affd640 1 --2- 172.21.15.45:0/2179948949 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f96240668d0 0x7f9624068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:37.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.589+0000 7f963affd640 1 -- 172.21.15.45:0/2179948949 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f963c11ee40 con 0x7f964415e430 2023-11-28T18:39:37.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.589+0000 7f964259c640 1 --2- 172.21.15.45:0/2179948949 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f96240668d0 0x7f9624068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:37.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.589+0000 7f964259c640 1 --2- 172.21.15.45:0/2179948949 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f96240668d0 0x7f9624068d90 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f9634005890 tx=0x7f9634009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:37.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.593+0000 7f963affd640 1 -- 172.21.15.45:0/2179948949 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9644142c10 con 0x7f964415e430 2023-11-28T18:39:37.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.749+0000 7f96489f8640 1 -- 172.21.15.45:0/2179948949 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9644142c10 con 0x7f964415e430 2023-11-28T18:39:37.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.749+0000 7f963affd640 1 -- 172.21.15.45:0/2179948949 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+16490 (secure 0 0 0) 0x7f9644142c10 con 0x7f964415e430 2023-11-28T18:39:37.753 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:39:37.753 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":45,"fsid":"d10f5cd6-1d00-4019-99b6-6fa435498a15","created":"2023-11-28T18:37:08.189030+0000","modified":"2023-11-28T18:39:36.424215+0000","last_up_change":"2023-11-28T18:37:20.196124+0000","last_in_change":"2023-11-28T18:37:10.742043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T18:37:21.293917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-28T18:39:34.106789+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-28T18:39:35.426601+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"84465384-103c-4f2c-a45a-96f5bb9c835f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6809","nonce":555237322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6811","nonce":555237322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6815","nonce":555237322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6813","nonce":555237322}]},"public_addr":"172.21.15.45:6809/555237322","cluster_addr":"172.21.15.45:6811/555237322","heartbeat_back_addr":"172.21.15.45:6815/555237322","heartbeat_front_addr":"172.21.15.45:6813/555237322","state":["exists","up"]},{"osd":1,"uuid":"7d9eed24-a58f-42c7-a787-ac06be8553fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6801","nonce":2857063763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6803","nonce":2857063763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6807","nonce":2857063763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6805","nonce":2857063763}]},"public_addr":"172.21.15.45:6801/2857063763","cluster_addr":"172.21.15.45:6803/2857063763","heartbeat_back_addr":"172.21.15.45:6807/2857063763","heartbeat_front_addr":"172.21.15.45:6805/2857063763","state":["exists","up"]},{"osd":2,"uuid":"575eeccc-4abf-45b4-9caf-f3e797859588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6817","nonce":193884539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6819","nonce":193884539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6823","nonce":193884539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6821","nonce":193884539}]},"public_addr":"172.21.15.45:6817/193884539","cluster_addr":"172.21.15.45:6819/193884539","heartbeat_back_addr":"172.21.15.45:6823/193884539","heartbeat_front_addr":"172.21.15.45:6821/193884539","state":["exists","up"]},{"osd":3,"uuid":"9b0290d6-9a52-4bc8-b2a1-7622c5dc8e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6825","nonce":78541084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6827","nonce":78541084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6831","nonce":78541084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6829","nonce":78541084}]},"public_addr":"172.21.15.45:6825/78541084","cluster_addr":"172.21.15.45:6827/78541084","heartbeat_back_addr":"172.21.15.45:6831/78541084","heartbeat_front_addr":"172.21.15.45:6829/78541084","state":["exists","up"]},{"osd":4,"uuid":"ce632829-f027-4fbf-a627-02c571aa9d53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6809","nonce":1537591987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6811","nonce":1537591987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6815","nonce":1537591987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6813","nonce":1537591987}]},"public_addr":"172.21.15.190:6809/1537591987","cluster_addr":"172.21.15.190:6811/1537591987","heartbeat_back_addr":"172.21.15.190:6815/1537591987","heartbeat_front_addr":"172.21.15.190:6813/1537591987","state":["exists","up"]},{"osd":5,"uuid":"8700b609-27be-40bd-a251-4c0ae0a29ead","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6801","nonce":3296698407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6803","nonce":3296698407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6807","nonce":3296698407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6805","nonce":3296698407}]},"public_addr":"172.21.15.190:6801/3296698407","cluster_addr":"172.21.15.190:6803/3296698407","heartbeat_back_addr":"172.21.15.190:6807/3296698407","heartbeat_front_addr":"172.21.15.190:6805/3296698407","state":["exists","up"]},{"osd":6,"uuid":"44ce4a40-e6ff-4f4d-8e8a-7341e5c91f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6817","nonce":2317686718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6819","nonce":2317686718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6823","nonce":2317686718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6821","nonce":2317686718}]},"public_addr":"172.21.15.190:6817/2317686718","cluster_addr":"172.21.15.190:6819/2317686718","heartbeat_back_addr":"172.21.15.190:6823/2317686718","heartbeat_front_addr":"172.21.15.190:6821/2317686718","state":["exists","up"]},{"osd":7,"uuid":"192238c9-1423-4b7e-ac8f-84ba32113ddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6825","nonce":2493232051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6827","nonce":2493232051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6831","nonce":2493232051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6829","nonce":2493232051}]},"public_addr":"172.21.15.190:6825/2493232051","cluster_addr":"172.21.15.190:6827/2493232051","heartbeat_back_addr":"172.21.15.190:6831/2493232051","heartbeat_front_addr":"172.21.15.190:6829/2493232051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.393552+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.385453+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.361421+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.366408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.363226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.276007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.414605+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.445885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T18:39:37.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.753+0000 7f96489f8640 1 -- 172.21.15.45:0/2179948949 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f96240668d0 msgr2=0x7f9624068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:37.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.753+0000 7f96489f8640 1 --2- 172.21.15.45:0/2179948949 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f96240668d0 0x7f9624068d90 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f9634005890 tx=0x7f9634009040 comp rx=0 tx=0).stop 2023-11-28T18:39:37.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.753+0000 7f96489f8640 1 -- 172.21.15.45:0/2179948949 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f964415e430 msgr2=0x7f9644142ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:37.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.753+0000 7f96489f8640 1 --2- 172.21.15.45:0/2179948949 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f964415e430 0x7f9644142ef0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f963c009d90 tx=0x7f963c0196c0 comp rx=0 tx=0).stop 2023-11-28T18:39:37.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.753+0000 7f96489f8640 1 -- 172.21.15.45:0/2179948949 shutdown_connections 2023-11-28T18:39:37.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.753+0000 7f96489f8640 1 --2- 172.21.15.45:0/2179948949 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f96240668d0 0x7f9624068d90 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:37.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.753+0000 7f96489f8640 1 --2- 172.21.15.45:0/2179948949 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f964415e430 0x7f9644142ef0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:37.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.753+0000 7f96489f8640 1 --2- 172.21.15.45:0/2179948949 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9644146c00 0x7f964415a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:37.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.753+0000 7f96489f8640 1 --2- 172.21.15.45:0/2179948949 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f96440b32c0 0x7f96440cc3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:37.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.753+0000 7f96489f8640 1 -- 172.21.15.45:0/2179948949 >> 172.21.15.45:0/2179948949 conn(0x7f964406a570 msgr2=0x7f964406e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:37.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.753+0000 7f96489f8640 1 -- 172.21.15.45:0/2179948949 shutdown_connections 2023-11-28T18:39:37.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.753+0000 7f96489f8640 1 -- 172.21.15.45:0/2179948949 wait complete. 2023-11-28T18:39:37.774 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-28T18:39:37.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.921+0000 7f36d5e6b640 1 Processor -- start 2023-11-28T18:39:37.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.921+0000 7f36d5e6b640 1 -- start start 2023-11-28T18:39:37.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.921+0000 7f36d5e6b640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f36d015d350 0x7f36d00ac110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:37.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.921+0000 7f36d5e6b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f36d00afe30 0x7f36d00b0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:37.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.921+0000 7f36d5e6b640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36d0161340 con 0x7f36d015e4a0 2023-11-28T18:39:37.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.921+0000 7f36d5e6b640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36d0161620 con 0x7f36d015d350 2023-11-28T18:39:37.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.921+0000 7f36d5e6b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36d0161900 con 0x7f36d00afe30 2023-11-28T18:39:37.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.921+0000 7f36c7fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f36d015e4a0 0x7f36d00af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38802/0 (socket says 172.21.15.45:38802) 2023-11-28T18:39:37.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.921+0000 7f36c7fff640 1 -- 172.21.15.45:0/3172770790 learned_addr learned my addr 172.21.15.45:0/3172770790 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:39:37.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.921+0000 7f36cffff640 1 --2- 172.21.15.45:0/3172770790 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f36d00afe30 0x7f36d00b0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:37.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.921+0000 7f36cf7fe640 1 --2- 172.21.15.45:0/3172770790 >> v2:172.21.15.190:3300/0 conn(0x7f36d015d350 0x7f36d00ac110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:37.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.921+0000 7f36ceffd640 1 -- 172.21.15.45:0/3172770790 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2242710868 0 0) 0x7f36d0161340 con 0x7f36d015e4a0 2023-11-28T18:39:37.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.921+0000 7f36ceffd640 1 -- 172.21.15.45:0/3172770790 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36bc003530 con 0x7f36d015e4a0 2023-11-28T18:39:37.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.921+0000 7f36ceffd640 1 -- 172.21.15.45:0/3172770790 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2632239508 0 0) 0x7f36bc003530 con 0x7f36d015e4a0 2023-11-28T18:39:37.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.921+0000 7f36ceffd640 1 -- 172.21.15.45:0/3172770790 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f36d00afe30 msgr2=0x7f36d00b0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:37.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.921+0000 7f36ceffd640 1 --2- 172.21.15.45:0/3172770790 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f36d00afe30 0x7f36d00b0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:37.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.921+0000 7f36ceffd640 1 -- 172.21.15.45:0/3172770790 >> v2:172.21.15.190:3300/0 conn(0x7f36d015d350 msgr2=0x7f36d00ac110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:37.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.921+0000 7f36ceffd640 1 --2- 172.21.15.45:0/3172770790 >> v2:172.21.15.190:3300/0 conn(0x7f36d015d350 0x7f36d00ac110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:37.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.921+0000 7f36ceffd640 1 -- 172.21.15.45:0/3172770790 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36d0161be0 con 0x7f36d015e4a0 2023-11-28T18:39:37.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.921+0000 7f36ceffd640 1 -- 172.21.15.45:0/3172770790 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4084481567 0 0) 0x7f36b8001680 con 0x7f36d015e4a0 2023-11-28T18:39:37.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.921+0000 7f36ceffd640 1 -- 172.21.15.45:0/3172770790 >> v1:172.21.15.45:6789/0 conn(0x7f36d015e4a0 legacy=0x7f36d00af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:37.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.921+0000 7f36ceffd640 1 --2- 172.21.15.45:0/3172770790 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36bc003980 0x7f36bc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:37.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.921+0000 7f36ceffd640 1 --2- 172.21.15.45:0/3172770790 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36bc0047d0 0x7f36bc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:37.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.921+0000 7f36ceffd640 1 --2- 172.21.15.45:0/3172770790 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f36d00afe30 0x7f36bc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:37.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.921+0000 7f36ceffd640 1 -- 172.21.15.45:0/3172770790 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d0161620 con 0x7f36bc003980 2023-11-28T18:39:37.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.921+0000 7f36ceffd640 1 -- 172.21.15.45:0/3172770790 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d0161900 con 0x7f36bc0047d0 2023-11-28T18:39:37.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.921+0000 7f36ceffd640 1 -- 172.21.15.45:0/3172770790 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36bc00b990 con 0x7f36d00afe30 2023-11-28T18:39:37.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.921+0000 7f36cf7fe640 1 --2- 172.21.15.45:0/3172770790 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36bc003980 0x7f36bc003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:37.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.921+0000 7f36c7fff640 1 --2- 172.21.15.45:0/3172770790 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36bc0047d0 0x7f36bc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:37.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.921+0000 7f36cffff640 1 --2- 172.21.15.45:0/3172770790 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f36d00afe30 0x7f36bc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:37.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.921+0000 7f36cf7fe640 1 -- 172.21.15.45:0/3172770790 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f36d00afe30 msgr2=0x7f36bc005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:37.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.921+0000 7f36cf7fe640 1 --2- 172.21.15.45:0/3172770790 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f36d00afe30 0x7f36bc005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:37.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.921+0000 7f36cf7fe640 1 -- 172.21.15.45:0/3172770790 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36bc0047d0 msgr2=0x7f36bc004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:37.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.921+0000 7f36cf7fe640 1 --2- 172.21.15.45:0/3172770790 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36bc0047d0 0x7f36bc004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:37.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.921+0000 7f36cf7fe640 1 -- 172.21.15.45:0/3172770790 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36bc003530 con 0x7f36bc003980 2023-11-28T18:39:37.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.921+0000 7f36c7fff640 1 --2- 172.21.15.45:0/3172770790 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36bc0047d0 0x7f36bc004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:39:37.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.925+0000 7f36cf7fe640 1 --2- 172.21.15.45:0/3172770790 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36bc003980 0x7f36bc003da0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f36c0009ae0 tx=0x7f36c001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65e88698f218e401 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:37.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.925+0000 7f36ceffd640 1 -- 172.21.15.45:0/3172770790 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c00a64d0 con 0x7f36bc003980 2023-11-28T18:39:37.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.925+0000 7f36ceffd640 1 -- 172.21.15.45:0/3172770790 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36c00a6630 con 0x7f36bc003980 2023-11-28T18:39:37.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.925+0000 7f36ceffd640 1 -- 172.21.15.45:0/3172770790 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c00a69e0 con 0x7f36bc003980 2023-11-28T18:39:37.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.925+0000 7f36d5e6b640 1 -- 172.21.15.45:0/3172770790 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36bc003980 msgr2=0x7f36bc003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:37.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.925+0000 7f36d5e6b640 1 --2- 172.21.15.45:0/3172770790 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36bc003980 0x7f36bc003da0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f36c0009ae0 tx=0x7f36c001ca30 comp rx=0 tx=0).stop 2023-11-28T18:39:37.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.925+0000 7f36cffff640 1 -- 172.21.15.45:0/3172770790 reap_dead start 2023-11-28T18:39:37.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.925+0000 7f36d5e6b640 1 -- 172.21.15.45:0/3172770790 shutdown_connections 2023-11-28T18:39:37.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.925+0000 7f36d5e6b640 1 -- 172.21.15.45:0/3172770790 >> 172.21.15.45:0/3172770790 conn(0x7f36d00b4650 msgr2=0x7f36d00b4a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:37.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.925+0000 7f36d5e6b640 1 -- 172.21.15.45:0/3172770790 shutdown_connections 2023-11-28T18:39:37.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.925+0000 7f36d5e6b640 1 -- 172.21.15.45:0/3172770790 wait complete. 2023-11-28T18:39:37.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.929+0000 7f36d5e6b640 1 Processor -- start 2023-11-28T18:39:37.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.929+0000 7f36d5e6b640 1 -- start start 2023-11-28T18:39:37.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.929+0000 7f36d5e6b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36bc003980 0x7f36d0159540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:37.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.929+0000 7f36d5e6b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36d00b21c0 0x7f36d0159a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:37.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.929+0000 7f36d5e6b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f36d00c98d0 0x7f36d00c9d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:37.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.929+0000 7f36d5e6b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d00b2730 con 0x7f36bc003980 2023-11-28T18:39:37.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.929+0000 7f36d5e6b640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d00b2a10 con 0x7f36d00b21c0 2023-11-28T18:39:37.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.929+0000 7f36d5e6b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36d00b2cf0 con 0x7f36d00c98d0 2023-11-28T18:39:37.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.929+0000 7f36cf7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36bc003980 0x7f36d0159540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:37.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.929+0000 7f36cf7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36bc003980 0x7f36d0159540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38182/0 (socket says 172.21.15.45:38182) 2023-11-28T18:39:37.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.929+0000 7f36cf7fe640 1 -- 172.21.15.45:0/3163000509 learned_addr learned my addr 172.21.15.45:0/3163000509 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:37.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.929+0000 7f36c7fff640 1 --2- 172.21.15.45:0/3163000509 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36d00b21c0 0x7f36d0159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:37.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.929+0000 7f36cffff640 1 --2- 172.21.15.45:0/3163000509 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f36d00c98d0 0x7f36d00c9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:37.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.929+0000 7f36cf7fe640 1 -- 172.21.15.45:0/3163000509 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f36d00c98d0 msgr2=0x7f36d00c9d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:37.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.929+0000 7f36cf7fe640 1 --2- 172.21.15.45:0/3163000509 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f36d00c98d0 0x7f36d00c9d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:37.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.929+0000 7f36cf7fe640 1 -- 172.21.15.45:0/3163000509 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36d00b21c0 msgr2=0x7f36d0159a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:37.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.929+0000 7f36cf7fe640 1 --2- 172.21.15.45:0/3163000509 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36d00b21c0 0x7f36d0159a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:37.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.929+0000 7f36cf7fe640 1 -- 172.21.15.45:0/3163000509 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36d00b2fd0 con 0x7f36bc003980 2023-11-28T18:39:37.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.929+0000 7f36cf7fe640 1 --2- 172.21.15.45:0/3163000509 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36bc003980 0x7f36d0159540 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f36c001c860 tx=0x7f36bc005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:37.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.929+0000 7f36ccff9640 1 -- 172.21.15.45:0/3163000509 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c00a69a0 con 0x7f36bc003980 2023-11-28T18:39:37.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.929+0000 7f36ccff9640 1 -- 172.21.15.45:0/3163000509 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36c00a6b20 con 0x7f36bc003980 2023-11-28T18:39:37.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.929+0000 7f36ccff9640 1 -- 172.21.15.45:0/3163000509 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c000f0c0 con 0x7f36bc003980 2023-11-28T18:39:37.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.929+0000 7f36d5e6b640 1 -- 172.21.15.45:0/3163000509 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36d00c9380 con 0x7f36bc003980 2023-11-28T18:39:37.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.933+0000 7f36d5e6b640 1 -- 172.21.15.45:0/3163000509 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36d00ca460 con 0x7f36bc003980 2023-11-28T18:39:37.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.933+0000 7f36d5e6b640 1 -- 172.21.15.45:0/3163000509 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36d00c9570 con 0x7f36bc003980 2023-11-28T18:39:37.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.933+0000 7f36ccff9640 1 -- 172.21.15.45:0/3163000509 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f36c0006040 con 0x7f36bc003980 2023-11-28T18:39:37.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.933+0000 7f36ccff9640 1 --2- 172.21.15.45:0/3163000509 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f36b00668d0 0x7f36b0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:37.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.933+0000 7f36ccff9640 1 -- 172.21.15.45:0/3163000509 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f36c00aa070 con 0x7f36bc003980 2023-11-28T18:39:37.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.933+0000 7f36c7fff640 1 --2- 172.21.15.45:0/3163000509 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f36b00668d0 0x7f36b0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:37.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.933+0000 7f36c7fff640 1 --2- 172.21.15.45:0/3163000509 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f36b00668d0 0x7f36b0068d90 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f36b8001000 tx=0x7f36b8007040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:37.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:37.937+0000 7f36ccff9640 1 -- 172.21.15.45:0/3163000509 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f36c00ec450 con 0x7f36bc003980 2023-11-28T18:39:38.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:38.141+0000 7f36d5e6b640 1 -- 172.21.15.45:0/3163000509 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f36d0069410 con 0x7f36bc003980 2023-11-28T18:39:38.277 INFO:tasks.ceph.mds.c.smithi045.stderr:2023-11-28T18:39:38.273+0000 7f6f887fb640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T18:39:39.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:39.045+0000 7f36ccff9640 1 -- 172.21.15.45:0/3163000509 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v31) v1 ==== 118+0+0 (secure 0 0 0) 0x7f36c00efa70 con 0x7f36bc003980 2023-11-28T18:39:39.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:39.045+0000 7f36d5e6b640 1 -- 172.21.15.45:0/3163000509 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f36b00668d0 msgr2=0x7f36b0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:39.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:39.045+0000 7f36d5e6b640 1 --2- 172.21.15.45:0/3163000509 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f36b00668d0 0x7f36b0068d90 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f36b8001000 tx=0x7f36b8007040 comp rx=0 tx=0).stop 2023-11-28T18:39:39.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:39.045+0000 7f36d5e6b640 1 -- 172.21.15.45:0/3163000509 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36bc003980 msgr2=0x7f36d0159540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:39.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:39.045+0000 7f36d5e6b640 1 --2- 172.21.15.45:0/3163000509 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36bc003980 0x7f36d0159540 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f36c001c860 tx=0x7f36bc005800 comp rx=0 tx=0).stop 2023-11-28T18:39:39.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:39.045+0000 7f36d5e6b640 1 -- 172.21.15.45:0/3163000509 shutdown_connections 2023-11-28T18:39:39.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:39.045+0000 7f36d5e6b640 1 --2- 172.21.15.45:0/3163000509 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f36b00668d0 0x7f36b0068d90 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:39.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:39.045+0000 7f36d5e6b640 1 --2- 172.21.15.45:0/3163000509 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f36d00c98d0 0x7f36d00c9d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:39.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:39.049+0000 7f36d5e6b640 1 --2- 172.21.15.45:0/3163000509 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36d00b21c0 0x7f36d0159a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:39.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:39.049+0000 7f36d5e6b640 1 --2- 172.21.15.45:0/3163000509 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36bc003980 0x7f36d0159540 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:39.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:39.049+0000 7f36d5e6b640 1 -- 172.21.15.45:0/3163000509 >> 172.21.15.45:0/3163000509 conn(0x7f36d00b4650 msgr2=0x7f36d00af160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:39.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:39.049+0000 7f36d5e6b640 1 -- 172.21.15.45:0/3163000509 shutdown_connections 2023-11-28T18:39:39.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:39.049+0000 7f36d5e6b640 1 -- 172.21.15.45:0/3163000509 wait complete. 2023-11-28T18:39:39.074 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-28T18:39:39.074 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-28T18:39:39.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:39.221+0000 7f46a405a640 1 Processor -- start 2023-11-28T18:39:39.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:39.221+0000 7f46a405a640 1 -- start start 2023-11-28T18:39:39.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:39.225+0000 7f46a405a640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f469c14ac20 0x7f469c165a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:39.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:39.225+0000 7f46a405a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f469c14b220 0x7f469c0b3e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:39.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:39.225+0000 7f46a405a640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f469c0b2000 con 0x7f469c0b4390 2023-11-28T18:39:39.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:39.225+0000 7f46a405a640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f469c0b4820 con 0x7f469c14ac20 2023-11-28T18:39:39.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:39.225+0000 7f46a405a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f469c0b22a0 con 0x7f469c14b220 2023-11-28T18:39:39.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:39.225+0000 7f46a15f5640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f469c14b220 0x7f469c0b3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:39.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:39.225+0000 7f46a1df6640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f469c14ac20 0x7f469c165a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:39.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:39.225+0000 7f46a25f7640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f469c0b4390 0x7f469c161b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.45:38034/0 (socket says 172.21.15.45:38034) 2023-11-28T18:39:39.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:39.225+0000 7f46a25f7640 1 -- 172.21.15.45:0/4232924567 learned_addr learned my addr 172.21.15.45:0/4232924567 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:39:39.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:39.225+0000 7f46a15f5640 1 -- 172.21.15.45:0/4232924567 >> v2:172.21.15.190:3300/0 conn(0x7f469c14ac20 msgr2=0x7f469c165a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:39.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:39.225+0000 7f46a15f5640 1 --2- 172.21.15.45:0/4232924567 >> v2:172.21.15.190:3300/0 conn(0x7f469c14ac20 0x7f469c165a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:39.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:39.225+0000 7f46a15f5640 1 -- 172.21.15.45:0/4232924567 >> v1:172.21.15.190:6789/0 conn(0x7f469c0b4390 legacy=0x7f469c161b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:39.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:39.225+0000 7f46a15f5640 1 -- 172.21.15.45:0/4232924567 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f469c0b2580 con 0x7f469c14b220 2023-11-28T18:39:39.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:39.225+0000 7f46a1df6640 1 --2- 172.21.15.45:0/4232924567 >> v2:172.21.15.190:3300/0 conn(0x7f469c14ac20 0x7f469c165a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:39:39.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:39.229+0000 7f46a15f5640 1 --2- 172.21.15.45:0/4232924567 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f469c14b220 0x7f469c0b3e50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f468c0097c0 tx=0x7f468c01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41a364cb15d04d9b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:39.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:39.229+0000 7f46a0df4640 1 -- 172.21.15.45:0/4232924567 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468c0ab650 con 0x7f469c14b220 2023-11-28T18:39:39.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:39.229+0000 7f46a0df4640 1 -- 172.21.15.45:0/4232924567 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f468c0ab7b0 con 0x7f469c14b220 2023-11-28T18:39:39.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:39.229+0000 7f46a0df4640 1 -- 172.21.15.45:0/4232924567 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468c0abb40 con 0x7f469c14b220 2023-11-28T18:39:39.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:39.229+0000 7f46a405a640 1 -- 172.21.15.45:0/4232924567 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f469c14b220 msgr2=0x7f469c0b3e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:39.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:39.229+0000 7f46a405a640 1 --2- 172.21.15.45:0/4232924567 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f469c14b220 0x7f469c0b3e50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f468c0097c0 tx=0x7f468c01c450 comp rx=0 tx=0).stop 2023-11-28T18:39:39.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:39.229+0000 7f46a405a640 1 -- 172.21.15.45:0/4232924567 shutdown_connections 2023-11-28T18:39:39.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:39.229+0000 7f46a405a640 1 --2- 172.21.15.45:0/4232924567 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f469c14b220 0x7f469c0b3e50 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:39.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:39.229+0000 7f46a405a640 1 --2- 172.21.15.45:0/4232924567 >> v2:172.21.15.190:3300/0 conn(0x7f469c14ac20 0x7f469c165a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:39.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:39.229+0000 7f46a405a640 1 -- 172.21.15.45:0/4232924567 >> 172.21.15.45:0/4232924567 conn(0x7f469c0b0d00 msgr2=0x7f469c0b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:39.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:39.229+0000 7f46a405a640 1 -- 172.21.15.45:0/4232924567 shutdown_connections 2023-11-28T18:39:39.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:39.229+0000 7f46a405a640 1 -- 172.21.15.45:0/4232924567 wait complete. 2023-11-28T18:39:39.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:39.233+0000 7f46a405a640 1 Processor -- start 2023-11-28T18:39:39.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:39.233+0000 7f46a405a640 1 -- start start 2023-11-28T18:39:39.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:39.233+0000 7f46a405a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f469c0b4390 0x7f469c15f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:39.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:39.233+0000 7f46a405a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f469c14ac20 0x7f469c1662f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:39.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:39.233+0000 7f46a405a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f469c161370 0x7f469c1606f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:39.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:39.233+0000 7f46a405a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f469c16a830 con 0x7f469c0b4390 2023-11-28T18:39:39.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:39.233+0000 7f46a405a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f469c16aad0 con 0x7f469c161370 2023-11-28T18:39:39.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:39.233+0000 7f46a405a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f469c16adb0 con 0x7f469c14ac20 2023-11-28T18:39:39.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:39.233+0000 7f46a1df6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f469c0b4390 0x7f469c15f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:39.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:39.233+0000 7f46a1df6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f469c0b4390 0x7f469c15f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38196/0 (socket says 172.21.15.45:38196) 2023-11-28T18:39:39.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:39.233+0000 7f46a1df6640 1 -- 172.21.15.45:0/398618840 learned_addr learned my addr 172.21.15.45:0/398618840 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:39.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:39.233+0000 7f46a15f5640 1 --2- 172.21.15.45:0/398618840 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f469c14ac20 0x7f469c1662f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:39.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:39.233+0000 7f46a25f7640 1 --2- 172.21.15.45:0/398618840 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f469c161370 0x7f469c1606f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:39.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:39.233+0000 7f46a1df6640 1 -- 172.21.15.45:0/398618840 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f469c14ac20 msgr2=0x7f469c1662f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:39.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:39.233+0000 7f46a1df6640 1 --2- 172.21.15.45:0/398618840 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f469c14ac20 0x7f469c1662f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:39.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:39.233+0000 7f46a1df6640 1 -- 172.21.15.45:0/398618840 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f469c161370 msgr2=0x7f469c1606f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:39.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:39.233+0000 7f46a1df6640 1 --2- 172.21.15.45:0/398618840 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f469c161370 0x7f469c1606f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:39.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:39.233+0000 7f46a1df6640 1 -- 172.21.15.45:0/398618840 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4698009420 con 0x7f469c0b4390 2023-11-28T18:39:39.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:39.233+0000 7f46a1df6640 1 --2- 172.21.15.45:0/398618840 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f469c0b4390 0x7f469c15f540 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f469800ebe0 tx=0x7f469800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:39.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:39.233+0000 7f46927fc640 1 -- 172.21.15.45:0/398618840 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469800eee0 con 0x7f469c0b4390 2023-11-28T18:39:39.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:39.233+0000 7f46927fc640 1 -- 172.21.15.45:0/398618840 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f469800cc30 con 0x7f469c0b4390 2023-11-28T18:39:39.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:39.233+0000 7f46a405a640 1 -- 172.21.15.45:0/398618840 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f468c009420 con 0x7f469c0b4390 2023-11-28T18:39:39.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:39.233+0000 7f46927fc640 1 -- 172.21.15.45:0/398618840 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4698013470 con 0x7f469c0b4390 2023-11-28T18:39:39.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:39.233+0000 7f46a405a640 1 -- 172.21.15.45:0/398618840 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f469c16b370 con 0x7f469c0b4390 2023-11-28T18:39:39.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:39.233+0000 7f46a405a640 1 -- 172.21.15.45:0/398618840 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f469c069410 con 0x7f469c0b4390 2023-11-28T18:39:39.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:39.237+0000 7f46927fc640 1 -- 172.21.15.45:0/398618840 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f46980135d0 con 0x7f469c0b4390 2023-11-28T18:39:39.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:39.237+0000 7f46927fc640 1 --2- 172.21.15.45:0/398618840 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f46800668d0 0x7f4680068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:39.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:39.237+0000 7f46927fc640 1 -- 172.21.15.45:0/398618840 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4698084730 con 0x7f469c0b4390 2023-11-28T18:39:39.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:39.237+0000 7f46a15f5640 1 --2- 172.21.15.45:0/398618840 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f46800668d0 0x7f4680068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:39.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:39.237+0000 7f46a15f5640 1 --2- 172.21.15.45:0/398618840 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f46800668d0 0x7f4680068d90 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f468c0af000 tx=0x7f468c0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:39.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:39.241+0000 7f46927fc640 1 -- 172.21.15.45:0/398618840 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4698051980 con 0x7f469c0b4390 2023-11-28T18:39:39.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:39.433+0000 7f46a405a640 1 -- 172.21.15.45:0/398618840 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f469c06e750 con 0x7f469c0b4390 2023-11-28T18:39:40.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.053+0000 7f46927fc640 1 -- 172.21.15.45:0/398618840 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v32) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4698054fa0 con 0x7f469c0b4390 2023-11-28T18:39:40.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.053+0000 7f46a405a640 1 -- 172.21.15.45:0/398618840 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f46800668d0 msgr2=0x7f4680068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:40.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.053+0000 7f46a405a640 1 --2- 172.21.15.45:0/398618840 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f46800668d0 0x7f4680068d90 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f468c0af000 tx=0x7f468c0a7000 comp rx=0 tx=0).stop 2023-11-28T18:39:40.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.053+0000 7f46a405a640 1 -- 172.21.15.45:0/398618840 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f469c0b4390 msgr2=0x7f469c15f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:40.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.053+0000 7f46a405a640 1 --2- 172.21.15.45:0/398618840 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f469c0b4390 0x7f469c15f540 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f469800ebe0 tx=0x7f469800c520 comp rx=0 tx=0).stop 2023-11-28T18:39:40.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.053+0000 7f46a405a640 1 -- 172.21.15.45:0/398618840 shutdown_connections 2023-11-28T18:39:40.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.053+0000 7f46a405a640 1 --2- 172.21.15.45:0/398618840 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f46800668d0 0x7f4680068d90 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:40.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.053+0000 7f46a405a640 1 --2- 172.21.15.45:0/398618840 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f469c161370 0x7f469c1606f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:40.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.053+0000 7f46a405a640 1 --2- 172.21.15.45:0/398618840 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f469c14ac20 0x7f469c1662f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:40.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.053+0000 7f46a405a640 1 --2- 172.21.15.45:0/398618840 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f469c0b4390 0x7f469c15f540 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:40.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.053+0000 7f46a405a640 1 -- 172.21.15.45:0/398618840 >> 172.21.15.45:0/398618840 conn(0x7f469c0b0d00 msgr2=0x7f469c1645d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:40.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.053+0000 7f46a405a640 1 -- 172.21.15.45:0/398618840 shutdown_connections 2023-11-28T18:39:40.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.057+0000 7f46a405a640 1 -- 172.21.15.45:0/398618840 wait complete. 2023-11-28T18:39:40.081 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-28T18:39:40.081 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T18:39:40.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.225+0000 7f58ad854640 1 Processor -- start 2023-11-28T18:39:40.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.225+0000 7f58ad854640 1 -- start start 2023-11-28T18:39:40.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.229+0000 7f58ad854640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f58a81449a0 0x7f58a806f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:40.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.229+0000 7f58ad854640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f58a80b32c0 0x7f58a80cf020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:40.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.229+0000 7f58ad854640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58a80d0670 con 0x7f58a80b3f20 2023-11-28T18:39:40.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.229+0000 7f58ad854640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58a80cbd20 con 0x7f58a80b32c0 2023-11-28T18:39:40.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.229+0000 7f58ad854640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58a80cb760 con 0x7f58a81449a0 2023-11-28T18:39:40.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.229+0000 7f58a77fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f58a80b32c0 0x7f58a80cf020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:40.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.229+0000 7f58a77fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f58a80b32c0 0x7f58a80cf020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38198/0 (socket says 172.21.15.45:38198) 2023-11-28T18:39:40.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.229+0000 7f58a77fe640 1 -- 172.21.15.45:0/1065191925 learned_addr learned my addr 172.21.15.45:0/1065191925 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:40.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.229+0000 7f58a6ffd640 1 --2- 172.21.15.45:0/1065191925 >> v2:172.21.15.190:3300/0 conn(0x7f58a81449a0 0x7f58a806f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:40.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.229+0000 7f58a77fe640 1 -- 172.21.15.45:0/1065191925 >> v2:172.21.15.190:3300/0 conn(0x7f58a81449a0 msgr2=0x7f58a806f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:40.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.229+0000 7f58a77fe640 1 --2- 172.21.15.45:0/1065191925 >> v2:172.21.15.190:3300/0 conn(0x7f58a81449a0 0x7f58a806f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:40.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.229+0000 7f58a77fe640 1 -- 172.21.15.45:0/1065191925 >> v1:172.21.15.190:6789/0 conn(0x7f58a80b3f20 legacy=0x7f58a80b2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:40.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.229+0000 7f58a77fe640 1 -- 172.21.15.45:0/1065191925 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a80cba40 con 0x7f58a80b32c0 2023-11-28T18:39:40.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.229+0000 7f58a6ffd640 1 --2- 172.21.15.45:0/1065191925 >> v2:172.21.15.190:3300/0 conn(0x7f58a81449a0 0x7f58a806f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:39:40.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.233+0000 7f58a77fe640 1 --2- 172.21.15.45:0/1065191925 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58a80b32c0 0x7f58a80cf020 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f58a80cd950 tx=0x7f58a001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f3ba885ae7cc16e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:40.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.233+0000 7f58a5ffb640 1 -- 172.21.15.45:0/1065191925 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a00a5860 con 0x7f58a80b32c0 2023-11-28T18:39:40.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.233+0000 7f58a5ffb640 1 -- 172.21.15.45:0/1065191925 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58a00a59c0 con 0x7f58a80b32c0 2023-11-28T18:39:40.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.233+0000 7f58a5ffb640 1 -- 172.21.15.45:0/1065191925 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a00a5d50 con 0x7f58a80b32c0 2023-11-28T18:39:40.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.233+0000 7f58ad854640 1 -- 172.21.15.45:0/1065191925 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58a80b32c0 msgr2=0x7f58a80cf020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:40.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.233+0000 7f58ad854640 1 --2- 172.21.15.45:0/1065191925 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58a80b32c0 0x7f58a80cf020 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f58a80cd950 tx=0x7f58a001c9a0 comp rx=0 tx=0).stop 2023-11-28T18:39:40.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.233+0000 7f58ad854640 1 -- 172.21.15.45:0/1065191925 shutdown_connections 2023-11-28T18:39:40.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.233+0000 7f58ad854640 1 --2- 172.21.15.45:0/1065191925 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58a80b32c0 0x7f58a80cf020 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:40.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.233+0000 7f58ad854640 1 --2- 172.21.15.45:0/1065191925 >> v2:172.21.15.190:3300/0 conn(0x7f58a81449a0 0x7f58a806f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:40.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.233+0000 7f58ad854640 1 -- 172.21.15.45:0/1065191925 >> 172.21.15.45:0/1065191925 conn(0x7f58a806a570 msgr2=0x7f58a806a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:40.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.233+0000 7f58ad854640 1 -- 172.21.15.45:0/1065191925 shutdown_connections 2023-11-28T18:39:40.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.233+0000 7f58ad854640 1 -- 172.21.15.45:0/1065191925 wait complete. 2023-11-28T18:39:40.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.233+0000 7f58ad854640 1 Processor -- start 2023-11-28T18:39:40.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.233+0000 7f58ad854640 1 -- start start 2023-11-28T18:39:40.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.237+0000 7f58ad854640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f58a80b32c0 0x7f58a8157a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:40.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.237+0000 7f58ad854640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f58a80b3f20 0x7f58a81559f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:40.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.237+0000 7f58ad854640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58a81449a0 0x7f58a81f7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:40.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.237+0000 7f58ad854640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a813ab50 con 0x7f58a81449a0 2023-11-28T18:39:40.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.237+0000 7f58ad854640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a81539e0 con 0x7f58a80b3f20 2023-11-28T18:39:40.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.237+0000 7f58ad854640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58a813adc0 con 0x7f58a80b32c0 2023-11-28T18:39:40.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.237+0000 7f58a6ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f58a80b32c0 0x7f58a8157a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:40.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.237+0000 7f58a77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58a81449a0 0x7f58a81f7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:40.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.237+0000 7f58a6ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f58a80b32c0 0x7f58a8157a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.45:55358/0 (socket says 172.21.15.45:55358) 2023-11-28T18:39:40.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.237+0000 7f58a6ffd640 1 -- 172.21.15.45:0/382170539 learned_addr learned my addr 172.21.15.45:0/382170539 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:40.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.237+0000 7f58a67fc640 1 --2- 172.21.15.45:0/382170539 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f58a80b3f20 0x7f58a81559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:40.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.237+0000 7f58a77fe640 1 -- 172.21.15.45:0/382170539 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f58a80b32c0 msgr2=0x7f58a8157a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:40.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.237+0000 7f58a77fe640 1 --2- 172.21.15.45:0/382170539 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f58a80b32c0 0x7f58a8157a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:40.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.237+0000 7f58a77fe640 1 -- 172.21.15.45:0/382170539 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f58a80b3f20 msgr2=0x7f58a81559f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:40.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.237+0000 7f58a77fe640 1 --2- 172.21.15.45:0/382170539 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f58a80b3f20 0x7f58a81559f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:40.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.237+0000 7f58a77fe640 1 -- 172.21.15.45:0/382170539 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a0009b30 con 0x7f58a81449a0 2023-11-28T18:39:40.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.237+0000 7f58a77fe640 1 --2- 172.21.15.45:0/382170539 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58a81449a0 0x7f58a81f7380 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f58a00ab000 tx=0x7f58a0019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:40.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.237+0000 7f588ffff640 1 -- 172.21.15.45:0/382170539 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a00bd070 con 0x7f58a81449a0 2023-11-28T18:39:40.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.237+0000 7f588ffff640 1 -- 172.21.15.45:0/382170539 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58a00b8470 con 0x7f58a81449a0 2023-11-28T18:39:40.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.237+0000 7f58ad854640 1 -- 172.21.15.45:0/382170539 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58a8152c20 con 0x7f58a81449a0 2023-11-28T18:39:40.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.237+0000 7f588ffff640 1 -- 172.21.15.45:0/382170539 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a00b8860 con 0x7f58a81449a0 2023-11-28T18:39:40.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.237+0000 7f58ad854640 1 -- 172.21.15.45:0/382170539 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58a81531e0 con 0x7f58a81449a0 2023-11-28T18:39:40.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.237+0000 7f58ad854640 1 -- 172.21.15.45:0/382170539 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58a8069480 con 0x7f58a81449a0 2023-11-28T18:39:40.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.241+0000 7f588ffff640 1 -- 172.21.15.45:0/382170539 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f58a00b89c0 con 0x7f58a81449a0 2023-11-28T18:39:40.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.241+0000 7f588ffff640 1 --2- 172.21.15.45:0/382170539 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f58940668d0 0x7f5894068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:40.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.241+0000 7f588ffff640 1 -- 172.21.15.45:0/382170539 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f58a011f200 con 0x7f58a81449a0 2023-11-28T18:39:40.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.241+0000 7f58a6ffd640 1 --2- 172.21.15.45:0/382170539 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f58940668d0 0x7f5894068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:40.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.241+0000 7f58a6ffd640 1 --2- 172.21.15.45:0/382170539 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f58940668d0 0x7f5894068d90 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5898009a10 tx=0x7f5898008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:40.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.245+0000 7f588ffff640 1 -- 172.21.15.45:0/382170539 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f58a00ec450 con 0x7f58a81449a0 2023-11-28T18:39:40.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.433+0000 7f58ad854640 1 -- 172.21.15.45:0/382170539 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f58a806ef00 con 0x7f58a81449a0 2023-11-28T18:39:40.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.433+0000 7f588ffff640 1 -- 172.21.15.45:0/382170539 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4910 (secure 0 0 0) 0x7f58a00efa70 con 0x7f58a81449a0 2023-11-28T18:39:40.439 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:39:40.439 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":32,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5414,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/114066704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":114066704},{"type":"v1","addr":"172.21.15.190:6836","nonce":114066704}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5417,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/27225494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":27225494},{"type":"v1","addr":"172.21.15.190:6837","nonce":27225494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5973,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1061201705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":1061201705},{"type":"v1","addr":"172.21.15.45:6835","nonce":1061201705}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T18:39:36.424552+0000","modified":"2023-11-28T18:39:39.436358+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5976},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5976":{"gid":5976,"name":"c","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6834/2737877840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2737877840},{"type":"v1","addr":"172.21.15.45:6834","nonce":2737877840}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-28T18:39:40.440 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 32 2023-11-28T18:39:40.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.437+0000 7f58ad854640 1 -- 172.21.15.45:0/382170539 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f58940668d0 msgr2=0x7f5894068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:40.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.437+0000 7f58ad854640 1 --2- 172.21.15.45:0/382170539 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f58940668d0 0x7f5894068d90 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5898009a10 tx=0x7f5898008040 comp rx=0 tx=0).stop 2023-11-28T18:39:40.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.437+0000 7f58ad854640 1 -- 172.21.15.45:0/382170539 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58a81449a0 msgr2=0x7f58a81f7380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:40.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.437+0000 7f58ad854640 1 --2- 172.21.15.45:0/382170539 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58a81449a0 0x7f58a81f7380 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f58a00ab000 tx=0x7f58a0019740 comp rx=0 tx=0).stop 2023-11-28T18:39:40.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.437+0000 7f58ad854640 1 -- 172.21.15.45:0/382170539 shutdown_connections 2023-11-28T18:39:40.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.437+0000 7f58ad854640 1 --2- 172.21.15.45:0/382170539 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f58940668d0 0x7f5894068d90 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:40.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.437+0000 7f58ad854640 1 --2- 172.21.15.45:0/382170539 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58a81449a0 0x7f58a81f7380 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:40.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.437+0000 7f58ad854640 1 --2- 172.21.15.45:0/382170539 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f58a80b3f20 0x7f58a81559f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:40.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.437+0000 7f58ad854640 1 --2- 172.21.15.45:0/382170539 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f58a80b32c0 0x7f58a8157a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:40.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.437+0000 7f58ad854640 1 -- 172.21.15.45:0/382170539 >> 172.21.15.45:0/382170539 conn(0x7f58a806a570 msgr2=0x7f58a80cd700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:40.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.437+0000 7f58ad854640 1 -- 172.21.15.45:0/382170539 shutdown_connections 2023-11-28T18:39:40.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.437+0000 7f58ad854640 1 -- 172.21.15.45:0/382170539 wait complete. 2023-11-28T18:39:40.459 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T18:39:40.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.597+0000 7fce6ff80640 1 Processor -- start 2023-11-28T18:39:40.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.597+0000 7fce6ff80640 1 -- start start 2023-11-28T18:39:40.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.601+0000 7fce6ff80640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fce6806ca10 0x7fce68145290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:40.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.601+0000 7fce6ff80640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce68146000 con 0x7fce6815c0b0 2023-11-28T18:39:40.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.601+0000 7fce6ff80640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce681462e0 con 0x7fce6815bcd0 2023-11-28T18:39:40.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.601+0000 7fce6ff80640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce681465c0 con 0x7fce6806ca10 2023-11-28T18:39:40.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.601+0000 7fce6e51d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fce6815c0b0 0x7fce681457d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38810/0 (socket says 172.21.15.45:38810) 2023-11-28T18:39:40.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.601+0000 7fce6e51d640 1 -- 172.21.15.45:0/2367093739 learned_addr learned my addr 172.21.15.45:0/2367093739 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:39:40.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.601+0000 7fce6d51b640 1 --2- 172.21.15.45:0/2367093739 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fce6806ca10 0x7fce68145290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:40.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.601+0000 7fce6cd1a640 1 -- 172.21.15.45:0/2367093739 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4008195371 0 0) 0x7fce68146000 con 0x7fce6815c0b0 2023-11-28T18:39:40.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.601+0000 7fce6cd1a640 1 -- 172.21.15.45:0/2367093739 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce54003530 con 0x7fce6815c0b0 2023-11-28T18:39:40.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.601+0000 7fce6cd1a640 1 -- 172.21.15.45:0/2367093739 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2527528613 0 0) 0x7fce681462e0 con 0x7fce6815bcd0 2023-11-28T18:39:40.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.601+0000 7fce6cd1a640 1 -- 172.21.15.45:0/2367093739 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce68146000 con 0x7fce6815bcd0 2023-11-28T18:39:40.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.601+0000 7fce6d51b640 1 -- 172.21.15.45:0/2367093739 >> v1:172.21.15.190:6789/0 conn(0x7fce6815bcd0 legacy=0x7fce6806c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:40.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.601+0000 7fce6cd1a640 1 -- 172.21.15.45:0/2367093739 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1730321945 0 0) 0x7fce54003530 con 0x7fce6815c0b0 2023-11-28T18:39:40.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.601+0000 7fce6d51b640 1 -- 172.21.15.45:0/2367093739 >> v1:172.21.15.45:6789/0 conn(0x7fce6815c0b0 legacy=0x7fce681457d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:40.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.601+0000 7fce6d51b640 1 -- 172.21.15.45:0/2367093739 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce681468a0 con 0x7fce6806ca10 2023-11-28T18:39:40.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.605+0000 7fce6d51b640 1 --2- 172.21.15.45:0/2367093739 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fce6806ca10 0x7fce68145290 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fce580097f0 tx=0x7fce5801c3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbbc9ca868b2e3ae server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:40.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.605+0000 7fce6cd1a640 1 -- 172.21.15.45:0/2367093739 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce60001a00 con 0x7fce6806ca10 2023-11-28T18:39:40.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.605+0000 7fce6cd1a640 1 -- 172.21.15.45:0/2367093739 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce580a7050 con 0x7fce6806ca10 2023-11-28T18:39:40.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.605+0000 7fce6cd1a640 1 -- 172.21.15.45:0/2367093739 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce58004250 con 0x7fce6806ca10 2023-11-28T18:39:40.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.605+0000 7fce6ff80640 1 -- 172.21.15.45:0/2367093739 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fce6806ca10 msgr2=0x7fce68145290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:40.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.605+0000 7fce6ff80640 1 --2- 172.21.15.45:0/2367093739 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fce6806ca10 0x7fce68145290 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fce580097f0 tx=0x7fce5801c3b0 comp rx=0 tx=0).stop 2023-11-28T18:39:40.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.605+0000 7fce6ff80640 1 -- 172.21.15.45:0/2367093739 shutdown_connections 2023-11-28T18:39:40.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.605+0000 7fce6ff80640 1 --2- 172.21.15.45:0/2367093739 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fce6806ca10 0x7fce68145290 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:40.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.605+0000 7fce6ff80640 1 -- 172.21.15.45:0/2367093739 >> 172.21.15.45:0/2367093739 conn(0x7fce6806a570 msgr2=0x7fce6806a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:40.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.605+0000 7fce6ff80640 1 -- 172.21.15.45:0/2367093739 shutdown_connections 2023-11-28T18:39:40.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.605+0000 7fce6ff80640 1 -- 172.21.15.45:0/2367093739 wait complete. 2023-11-28T18:39:40.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.609+0000 7fce6ff80640 1 Processor -- start 2023-11-28T18:39:40.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.609+0000 7fce6ff80640 1 -- start start 2023-11-28T18:39:40.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.609+0000 7fce6ff80640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fce6806ca10 0x7fce681437e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:40.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.609+0000 7fce6ff80640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fce6815bcd0 0x7fce68145410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:40.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.609+0000 7fce6ff80640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce6815c0b0 0x7fce68157940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:40.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.609+0000 7fce6ff80640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce681643f0 con 0x7fce6815c0b0 2023-11-28T18:39:40.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.609+0000 7fce6ff80640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce681646d0 con 0x7fce6815bcd0 2023-11-28T18:39:40.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.609+0000 7fce6ff80640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce681649b0 con 0x7fce6806ca10 2023-11-28T18:39:40.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.609+0000 7fce6e51d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce6815c0b0 0x7fce68157940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:40.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.609+0000 7fce6e51d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce6815c0b0 0x7fce68157940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38226/0 (socket says 172.21.15.45:38226) 2023-11-28T18:39:40.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.609+0000 7fce6e51d640 1 -- 172.21.15.45:0/3890661076 learned_addr learned my addr 172.21.15.45:0/3890661076 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:40.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.609+0000 7fce6d51b640 1 --2- 172.21.15.45:0/3890661076 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fce6815bcd0 0x7fce68145410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:40.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.609+0000 7fce6dd1c640 1 --2- 172.21.15.45:0/3890661076 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fce6806ca10 0x7fce681437e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:40.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.609+0000 7fce6e51d640 1 -- 172.21.15.45:0/3890661076 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fce6806ca10 msgr2=0x7fce681437e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:40.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.609+0000 7fce6e51d640 1 --2- 172.21.15.45:0/3890661076 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fce6806ca10 0x7fce681437e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:40.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.609+0000 7fce6e51d640 1 -- 172.21.15.45:0/3890661076 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fce6815bcd0 msgr2=0x7fce68145410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:40.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.609+0000 7fce6e51d640 1 --2- 172.21.15.45:0/3890661076 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fce6815bcd0 0x7fce68145410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:40.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.609+0000 7fce6e51d640 1 -- 172.21.15.45:0/3890661076 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce58009420 con 0x7fce6815c0b0 2023-11-28T18:39:40.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.609+0000 7fce6e51d640 1 --2- 172.21.15.45:0/3890661076 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce6815c0b0 0x7fce68157940 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fce6000cc80 tx=0x7fce6000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:40.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.609+0000 7fce5e7fc640 1 -- 172.21.15.45:0/3890661076 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6000ce90 con 0x7fce6815c0b0 2023-11-28T18:39:40.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.609+0000 7fce5e7fc640 1 -- 172.21.15.45:0/3890661076 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce60012400 con 0x7fce6815c0b0 2023-11-28T18:39:40.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.609+0000 7fce5e7fc640 1 -- 172.21.15.45:0/3890661076 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce600127f0 con 0x7fce6815c0b0 2023-11-28T18:39:40.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.609+0000 7fce6ff80640 1 -- 172.21.15.45:0/3890661076 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce68164c90 con 0x7fce6815c0b0 2023-11-28T18:39:40.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.609+0000 7fce6ff80640 1 -- 172.21.15.45:0/3890661076 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce68143ef0 con 0x7fce6815c0b0 2023-11-28T18:39:40.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.609+0000 7fce6ff80640 1 -- 172.21.15.45:0/3890661076 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce68164250 con 0x7fce6815c0b0 2023-11-28T18:39:40.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.613+0000 7fce5e7fc640 1 -- 172.21.15.45:0/3890661076 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fce60012950 con 0x7fce6815c0b0 2023-11-28T18:39:40.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.613+0000 7fce5e7fc640 1 --2- 172.21.15.45:0/3890661076 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fce4c0668d0 0x7fce4c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:40.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.613+0000 7fce5e7fc640 1 -- 172.21.15.45:0/3890661076 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fce60084a40 con 0x7fce6815c0b0 2023-11-28T18:39:40.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.613+0000 7fce6dd1c640 1 --2- 172.21.15.45:0/3890661076 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fce4c0668d0 0x7fce4c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:40.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.613+0000 7fce6dd1c640 1 --2- 172.21.15.45:0/3890661076 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fce4c0668d0 0x7fce4c068d90 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fce640011f0 tx=0x7fce64009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:40.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.617+0000 7fce5e7fc640 1 -- 172.21.15.45:0/3890661076 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fce68164250 con 0x7fce6815c0b0 2023-11-28T18:39:40.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.773+0000 7fce6ff80640 1 -- 172.21.15.45:0/3890661076 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fce68164250 con 0x7fce6815c0b0 2023-11-28T18:39:40.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.777+0000 7fce5e7fc640 1 -- 172.21.15.45:0/3890661076 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+16477 (secure 0 0 0) 0x7fce68164250 con 0x7fce6815c0b0 2023-11-28T18:39:40.778 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:39:40.778 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":46,"fsid":"d10f5cd6-1d00-4019-99b6-6fa435498a15","created":"2023-11-28T18:37:08.189030+0000","modified":"2023-11-28T18:39:38.037576+0000","last_up_change":"2023-11-28T18:37:20.196124+0000","last_in_change":"2023-11-28T18:37:10.742043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T18:37:21.293917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-28T18:39:34.106789+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-28T18:39:35.426601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"84465384-103c-4f2c-a45a-96f5bb9c835f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6809","nonce":555237322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6811","nonce":555237322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6815","nonce":555237322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6813","nonce":555237322}]},"public_addr":"172.21.15.45:6809/555237322","cluster_addr":"172.21.15.45:6811/555237322","heartbeat_back_addr":"172.21.15.45:6815/555237322","heartbeat_front_addr":"172.21.15.45:6813/555237322","state":["exists","up"]},{"osd":1,"uuid":"7d9eed24-a58f-42c7-a787-ac06be8553fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6801","nonce":2857063763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6803","nonce":2857063763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6807","nonce":2857063763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6805","nonce":2857063763}]},"public_addr":"172.21.15.45:6801/2857063763","cluster_addr":"172.21.15.45:6803/2857063763","heartbeat_back_addr":"172.21.15.45:6807/2857063763","heartbeat_front_addr":"172.21.15.45:6805/2857063763","state":["exists","up"]},{"osd":2,"uuid":"575eeccc-4abf-45b4-9caf-f3e797859588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6817","nonce":193884539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6819","nonce":193884539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6823","nonce":193884539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6821","nonce":193884539}]},"public_addr":"172.21.15.45:6817/193884539","cluster_addr":"172.21.15.45:6819/193884539","heartbeat_back_addr":"172.21.15.45:6823/193884539","heartbeat_front_addr":"172.21.15.45:6821/193884539","state":["exists","up"]},{"osd":3,"uuid":"9b0290d6-9a52-4bc8-b2a1-7622c5dc8e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6825","nonce":78541084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6827","nonce":78541084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6831","nonce":78541084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6829","nonce":78541084}]},"public_addr":"172.21.15.45:6825/78541084","cluster_addr":"172.21.15.45:6827/78541084","heartbeat_back_addr":"172.21.15.45:6831/78541084","heartbeat_front_addr":"172.21.15.45:6829/78541084","state":["exists","up"]},{"osd":4,"uuid":"ce632829-f027-4fbf-a627-02c571aa9d53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6809","nonce":1537591987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6811","nonce":1537591987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6815","nonce":1537591987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6813","nonce":1537591987}]},"public_addr":"172.21.15.190:6809/1537591987","cluster_addr":"172.21.15.190:6811/1537591987","heartbeat_back_addr":"172.21.15.190:6815/1537591987","heartbeat_front_addr":"172.21.15.190:6813/1537591987","state":["exists","up"]},{"osd":5,"uuid":"8700b609-27be-40bd-a251-4c0ae0a29ead","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6801","nonce":3296698407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6803","nonce":3296698407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6807","nonce":3296698407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6805","nonce":3296698407}]},"public_addr":"172.21.15.190:6801/3296698407","cluster_addr":"172.21.15.190:6803/3296698407","heartbeat_back_addr":"172.21.15.190:6807/3296698407","heartbeat_front_addr":"172.21.15.190:6805/3296698407","state":["exists","up"]},{"osd":6,"uuid":"44ce4a40-e6ff-4f4d-8e8a-7341e5c91f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6817","nonce":2317686718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6819","nonce":2317686718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6823","nonce":2317686718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6821","nonce":2317686718}]},"public_addr":"172.21.15.190:6817/2317686718","cluster_addr":"172.21.15.190:6819/2317686718","heartbeat_back_addr":"172.21.15.190:6823/2317686718","heartbeat_front_addr":"172.21.15.190:6821/2317686718","state":["exists","up"]},{"osd":7,"uuid":"192238c9-1423-4b7e-ac8f-84ba32113ddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6825","nonce":2493232051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6827","nonce":2493232051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6831","nonce":2493232051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6829","nonce":2493232051}]},"public_addr":"172.21.15.190:6825/2493232051","cluster_addr":"172.21.15.190:6827/2493232051","heartbeat_back_addr":"172.21.15.190:6831/2493232051","heartbeat_front_addr":"172.21.15.190:6829/2493232051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.393552+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.385453+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.361421+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.366408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.363226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.276007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.414605+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.445885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T18:39:40.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.777+0000 7fce6ff80640 1 -- 172.21.15.45:0/3890661076 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fce4c0668d0 msgr2=0x7fce4c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:40.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.777+0000 7fce6ff80640 1 --2- 172.21.15.45:0/3890661076 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fce4c0668d0 0x7fce4c068d90 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fce640011f0 tx=0x7fce64009040 comp rx=0 tx=0).stop 2023-11-28T18:39:40.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.777+0000 7fce6ff80640 1 -- 172.21.15.45:0/3890661076 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce6815c0b0 msgr2=0x7fce68157940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:40.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.777+0000 7fce6ff80640 1 --2- 172.21.15.45:0/3890661076 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce6815c0b0 0x7fce68157940 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fce6000cc80 tx=0x7fce6000a430 comp rx=0 tx=0).stop 2023-11-28T18:39:40.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.777+0000 7fce6ff80640 1 -- 172.21.15.45:0/3890661076 shutdown_connections 2023-11-28T18:39:40.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.777+0000 7fce6ff80640 1 --2- 172.21.15.45:0/3890661076 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fce4c0668d0 0x7fce4c068d90 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:40.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.777+0000 7fce6ff80640 1 --2- 172.21.15.45:0/3890661076 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce6815c0b0 0x7fce68157940 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:40.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.777+0000 7fce6ff80640 1 --2- 172.21.15.45:0/3890661076 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fce6815bcd0 0x7fce68145410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:40.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.777+0000 7fce6ff80640 1 --2- 172.21.15.45:0/3890661076 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fce6806ca10 0x7fce681437e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:40.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.777+0000 7fce6ff80640 1 -- 172.21.15.45:0/3890661076 >> 172.21.15.45:0/3890661076 conn(0x7fce6806a570 msgr2=0x7fce6806c300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:40.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.777+0000 7fce6ff80640 1 -- 172.21.15.45:0/3890661076 shutdown_connections 2023-11-28T18:39:40.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.777+0000 7fce6ff80640 1 -- 172.21.15.45:0/3890661076 wait complete. 2023-11-28T18:39:40.800 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-28T18:39:40.800 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T18:39:40.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.941+0000 7f331b832640 1 Processor -- start 2023-11-28T18:39:40.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.941+0000 7f331b832640 1 -- start start 2023-11-28T18:39:40.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.941+0000 7f331b832640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f33140b3cb0 0x7f33140d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:40.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.941+0000 7f331b832640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33140d38c0 con 0x7f33140cfed0 2023-11-28T18:39:40.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.941+0000 7f331b832640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33140cdcc0 con 0x7f33140b35f0 2023-11-28T18:39:40.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.941+0000 7f331b832640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33140d40d0 con 0x7f33140b3cb0 2023-11-28T18:39:40.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.941+0000 7f3318dcd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f33140cfed0 0x7f33140ce480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38822/0 (socket says 172.21.15.45:38822) 2023-11-28T18:39:40.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.941+0000 7f3318dcd640 1 -- 172.21.15.45:0/824672872 learned_addr learned my addr 172.21.15.45:0/824672872 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:39:40.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.941+0000 7f3319dcf640 1 --2- 172.21.15.45:0/824672872 >> v2:172.21.15.190:3300/0 conn(0x7f33140b3cb0 0x7f33140d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:40.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.941+0000 7f330bfff640 1 -- 172.21.15.45:0/824672872 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3230827405 0 0) 0x7f33140d38c0 con 0x7f33140cfed0 2023-11-28T18:39:40.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.941+0000 7f330bfff640 1 -- 172.21.15.45:0/824672872 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3300003530 con 0x7f33140cfed0 2023-11-28T18:39:40.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.941+0000 7f3319dcf640 1 -- 172.21.15.45:0/824672872 >> v1:172.21.15.190:6789/0 conn(0x7f33140b35f0 legacy=0x7f33140cf7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:40.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.941+0000 7f3319dcf640 1 -- 172.21.15.45:0/824672872 >> v1:172.21.15.45:6789/0 conn(0x7f33140cfed0 legacy=0x7f33140ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:40.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.941+0000 7f3319dcf640 1 -- 172.21.15.45:0/824672872 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33140d3b10 con 0x7f33140b3cb0 2023-11-28T18:39:40.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.945+0000 7f3319dcf640 1 --2- 172.21.15.45:0/824672872 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f33140b3cb0 0x7f33140d0f90 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f330c009d90 tx=0x7f330c01c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ffbec3f28b831e9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:40.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.945+0000 7f330bfff640 1 -- 172.21.15.45:0/824672872 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330c0a59e0 con 0x7f33140b3cb0 2023-11-28T18:39:40.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.945+0000 7f330bfff640 1 -- 172.21.15.45:0/824672872 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f330c0a5b40 con 0x7f33140b3cb0 2023-11-28T18:39:40.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.945+0000 7f330bfff640 1 -- 172.21.15.45:0/824672872 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330c0ad440 con 0x7f33140b3cb0 2023-11-28T18:39:40.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.945+0000 7f331b832640 1 -- 172.21.15.45:0/824672872 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f33140b3cb0 msgr2=0x7f33140d0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:40.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.945+0000 7f331b832640 1 --2- 172.21.15.45:0/824672872 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f33140b3cb0 0x7f33140d0f90 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f330c009d90 tx=0x7f330c01c920 comp rx=0 tx=0).stop 2023-11-28T18:39:40.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.945+0000 7f331b832640 1 -- 172.21.15.45:0/824672872 shutdown_connections 2023-11-28T18:39:40.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.945+0000 7f331b832640 1 --2- 172.21.15.45:0/824672872 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f33140b3cb0 0x7f33140d0f90 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:40.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.945+0000 7f331b832640 1 -- 172.21.15.45:0/824672872 >> 172.21.15.45:0/824672872 conn(0x7f331409c4f0 msgr2=0x7f33140d31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:40.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.945+0000 7f331b832640 1 -- 172.21.15.45:0/824672872 shutdown_connections 2023-11-28T18:39:40.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.945+0000 7f331b832640 1 -- 172.21.15.45:0/824672872 wait complete. 2023-11-28T18:39:40.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.949+0000 7f331b832640 1 Processor -- start 2023-11-28T18:39:40.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.949+0000 7f331b832640 1 -- start start 2023-11-28T18:39:40.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.949+0000 7f331b832640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f33140b35f0 0x7f33141465d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:40.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.949+0000 7f331b832640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f33140b3cb0 0x7f33141442e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:40.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.949+0000 7f331b832640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33140cfed0 0x7f3314144820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:40.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.949+0000 7f331b832640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3314145bb0 con 0x7f33140cfed0 2023-11-28T18:39:40.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.949+0000 7f331b832640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3314144f30 con 0x7f33140b3cb0 2023-11-28T18:39:40.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.949+0000 7f331b832640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3314145210 con 0x7f33140b35f0 2023-11-28T18:39:40.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.949+0000 7f3319dcf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33140cfed0 0x7f3314144820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:40.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.949+0000 7f3319dcf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33140cfed0 0x7f3314144820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38238/0 (socket says 172.21.15.45:38238) 2023-11-28T18:39:40.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.949+0000 7f3319dcf640 1 -- 172.21.15.45:0/805385375 learned_addr learned my addr 172.21.15.45:0/805385375 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:40.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.949+0000 7f3319dcf640 1 -- 172.21.15.45:0/805385375 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f33140b35f0 msgr2=0x7f33141465d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:40.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.949+0000 7f3319dcf640 1 --2- 172.21.15.45:0/805385375 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f33140b35f0 0x7f33141465d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:40.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.949+0000 7f3319dcf640 1 -- 172.21.15.45:0/805385375 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f33140b3cb0 msgr2=0x7f33141442e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:40.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.949+0000 7f3319dcf640 1 --2- 172.21.15.45:0/805385375 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f33140b3cb0 0x7f33141442e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:40.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.949+0000 7f3319dcf640 1 -- 172.21.15.45:0/805385375 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f330c009a70 con 0x7f33140cfed0 2023-11-28T18:39:40.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.949+0000 7f3319dcf640 1 --2- 172.21.15.45:0/805385375 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33140cfed0 0x7f3314144820 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f330c019530 tx=0x7f330c0196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:40.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.949+0000 7f3309ffb640 1 -- 172.21.15.45:0/805385375 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330c0aecd0 con 0x7f33140cfed0 2023-11-28T18:39:40.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.949+0000 7f3309ffb640 1 -- 172.21.15.45:0/805385375 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f330c0aee30 con 0x7f33140cfed0 2023-11-28T18:39:40.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.949+0000 7f3309ffb640 1 -- 172.21.15.45:0/805385375 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330c0b7610 con 0x7f33140cfed0 2023-11-28T18:39:40.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.949+0000 7f331b832640 1 -- 172.21.15.45:0/805385375 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33141454f0 con 0x7f33140cfed0 2023-11-28T18:39:40.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.949+0000 7f331b832640 1 -- 172.21.15.45:0/805385375 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3314145fd0 con 0x7f33140cfed0 2023-11-28T18:39:40.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.953+0000 7f331b832640 1 -- 172.21.15.45:0/805385375 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3314145cf0 con 0x7f33140cfed0 2023-11-28T18:39:40.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.953+0000 7f3309ffb640 1 -- 172.21.15.45:0/805385375 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f330c0b4050 con 0x7f33140cfed0 2023-11-28T18:39:40.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.953+0000 7f3309ffb640 1 --2- 172.21.15.45:0/805385375 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f32f80668d0 0x7f32f8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:40.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.953+0000 7f3309ffb640 1 -- 172.21.15.45:0/805385375 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f330c11f2e0 con 0x7f33140cfed0 2023-11-28T18:39:40.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.953+0000 7f33195ce640 1 --2- 172.21.15.45:0/805385375 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f32f80668d0 0x7f32f8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:40.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.953+0000 7f33195ce640 1 --2- 172.21.15.45:0/805385375 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f32f80668d0 0x7f32f8068d90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f3310000f70 tx=0x7f33100079e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:40.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:40.957+0000 7f3309ffb640 1 -- 172.21.15.45:0/805385375 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f330c0ec5b0 con 0x7f33140cfed0 2023-11-28T18:39:41.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.113+0000 7f331b832640 1 -- 172.21.15.45:0/805385375 --> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f33140b39d0 con 0x7f32f80668d0 2023-11-28T18:39:41.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.125+0000 7f3309ffb640 1 -- 172.21.15.45:0/805385375 <== mgr.4100 v2:172.21.15.190:6832/645101166 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+277185 (secure 0 0 0) 0x7f3310005080 con 0x7f32f80668d0 2023-11-28T18:39:41.129 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:39:41.130 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-11-28T18:39:41.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.125+0000 7f331b832640 1 -- 172.21.15.45:0/805385375 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f32f80668d0 msgr2=0x7f32f8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:41.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.125+0000 7f331b832640 1 --2- 172.21.15.45:0/805385375 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f32f80668d0 0x7f32f8068d90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f3310000f70 tx=0x7f33100079e0 comp rx=0 tx=0).stop 2023-11-28T18:39:41.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.125+0000 7f331b832640 1 -- 172.21.15.45:0/805385375 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33140cfed0 msgr2=0x7f3314144820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:41.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.125+0000 7f331b832640 1 --2- 172.21.15.45:0/805385375 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33140cfed0 0x7f3314144820 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f330c019530 tx=0x7f330c0196c0 comp rx=0 tx=0).stop 2023-11-28T18:39:41.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.125+0000 7f331b832640 1 -- 172.21.15.45:0/805385375 shutdown_connections 2023-11-28T18:39:41.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.125+0000 7f331b832640 1 --2- 172.21.15.45:0/805385375 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f32f80668d0 0x7f32f8068d90 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:41.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.125+0000 7f331b832640 1 --2- 172.21.15.45:0/805385375 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33140cfed0 0x7f3314144820 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:41.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.125+0000 7f331b832640 1 --2- 172.21.15.45:0/805385375 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f33140b3cb0 0x7f33141442e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:41.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.125+0000 7f331b832640 1 --2- 172.21.15.45:0/805385375 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f33140b35f0 0x7f33141465d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:41.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.125+0000 7f331b832640 1 -- 172.21.15.45:0/805385375 >> 172.21.15.45:0/805385375 conn(0x7f331409c4f0 msgr2=0x7f33140afde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:41.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.125+0000 7f331b832640 1 -- 172.21.15.45:0/805385375 shutdown_connections 2023-11-28T18:39:41.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.125+0000 7f331b832640 1 -- 172.21.15.45:0/805385375 wait complete. 2023-11-28T18:39:41.149 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":109,"stamp":"2023-11-28T18:39:39.262759+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":237856,"kb_used_data":5012,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736864,"statfs":{"total":773094113280,"available":772850548736,"internally_reserved":0,"allocated":5132288,"data_stored":2756993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.240104"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T18:39:36.021059+0000","last_change":"2023-11-28T18:39:36.021059+0000","last_active":"2023-11-28T18:39:36.021059+0000","last_peered":"2023-11-28T18:39:36.021059+0000","last_clean":"2023-11-28T18:39:36.021059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:36.021059+0000","last_undegraded":"2023-11-28T18:39:36.021059+0000","last_fullsized":"2023-11-28T18:39:36.021059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T18:39:36.021059+0000","last_change":"2023-11-28T18:39:36.021059+0000","last_active":"2023-11-28T18:39:36.021059+0000","last_peered":"2023-11-28T18:39:36.021059+0000","last_clean":"2023-11-28T18:39:36.021059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:36.021059+0000","last_undegraded":"2023-11-28T18:39:36.021059+0000","last_fullsized":"2023-11-28T18:39:36.021059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T18:39:36.021059+0000","last_change":"2023-11-28T18:39:36.021059+0000","last_active":"2023-11-28T18:39:36.021059+0000","last_peered":"2023-11-28T18:39:36.021059+0000","last_clean":"2023-11-28T18:39:36.021059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:36.021059+0000","last_undegraded":"2023-11-28T18:39:36.021059+0000","last_fullsized":"2023-11-28T18:39:36.021059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T18:39:36.021059+0000","last_change":"2023-11-28T18:39:36.021059+0000","last_active":"2023-11-28T18:39:36.021059+0000","last_peered":"2023-11-28T18:39:36.021059+0000","last_clean":"2023-11-28T18:39:36.021059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:36.021059+0000","last_undegraded":"2023-11-28T18:39:36.021059+0000","last_fullsized":"2023-11-28T18:39:36.021059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T18:39:36.021059+0000","last_change":"2023-11-28T18:39:36.021059+0000","last_active":"2023-11-28T18:39:36.021059+0000","last_peered":"2023-11-28T18:39:36.021059+0000","last_clean":"2023-11-28T18:39:36.021059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:36.021059+0000","last_undegraded":"2023-11-28T18:39:36.021059+0000","last_fullsized":"2023-11-28T18:39:36.021059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T18:39:36.021059+0000","last_change":"2023-11-28T18:39:36.021059+0000","last_active":"2023-11-28T18:39:36.021059+0000","last_peered":"2023-11-28T18:39:36.021059+0000","last_clean":"2023-11-28T18:39:36.021059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:36.021059+0000","last_undegraded":"2023-11-28T18:39:36.021059+0000","last_fullsized":"2023-11-28T18:39:36.021059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T18:39:36.021059+0000","last_change":"2023-11-28T18:39:36.021059+0000","last_active":"2023-11-28T18:39:36.021059+0000","last_peered":"2023-11-28T18:39:36.021059+0000","last_clean":"2023-11-28T18:39:36.021059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:36.021059+0000","last_undegraded":"2023-11-28T18:39:36.021059+0000","last_fullsized":"2023-11-28T18:39:36.021059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T18:39:36.021059+0000","last_change":"2023-11-28T18:39:36.021059+0000","last_active":"2023-11-28T18:39:36.021059+0000","last_peered":"2023-11-28T18:39:36.021059+0000","last_clean":"2023-11-28T18:39:36.021059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:36.021059+0000","last_undegraded":"2023-11-28T18:39:36.021059+0000","last_fullsized":"2023-11-28T18:39:36.021059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T18:39:36.021059+0000","last_change":"2023-11-28T18:39:36.021059+0000","last_active":"2023-11-28T18:39:36.021059+0000","last_peered":"2023-11-28T18:39:36.021059+0000","last_clean":"2023-11-28T18:39:36.021059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:36.021059+0000","last_undegraded":"2023-11-28T18:39:36.021059+0000","last_fullsized":"2023-11-28T18:39:36.021059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T18:39:36.021059+0000","last_change":"2023-11-28T18:39:36.021059+0000","last_active":"2023-11-28T18:39:36.021059+0000","last_peered":"2023-11-28T18:39:36.021059+0000","last_clean":"2023-11-28T18:39:36.021059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:36.021059+0000","last_undegraded":"2023-11-28T18:39:36.021059+0000","last_fullsized":"2023-11-28T18:39:36.021059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T18:39:36.021059+0000","last_change":"2023-11-28T18:39:36.021059+0000","last_active":"2023-11-28T18:39:36.021059+0000","last_peered":"2023-11-28T18:39:36.021059+0000","last_clean":"2023-11-28T18:39:36.021059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:36.021059+0000","last_undegraded":"2023-11-28T18:39:36.021059+0000","last_fullsized":"2023-11-28T18:39:36.021059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T18:39:36.021059+0000","last_change":"2023-11-28T18:39:36.021059+0000","last_active":"2023-11-28T18:39:36.021059+0000","last_peered":"2023-11-28T18:39:36.021059+0000","last_clean":"2023-11-28T18:39:36.021059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:36.021059+0000","last_undegraded":"2023-11-28T18:39:36.021059+0000","last_fullsized":"2023-11-28T18:39:36.021059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T18:39:36.021059+0000","last_change":"2023-11-28T18:39:36.021059+0000","last_active":"2023-11-28T18:39:36.021059+0000","last_peered":"2023-11-28T18:39:36.021059+0000","last_clean":"2023-11-28T18:39:36.021059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:36.021059+0000","last_undegraded":"2023-11-28T18:39:36.021059+0000","last_fullsized":"2023-11-28T18:39:36.021059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T18:39:36.021059+0000","last_change":"2023-11-28T18:39:36.021059+0000","last_active":"2023-11-28T18:39:36.021059+0000","last_peered":"2023-11-28T18:39:36.021059+0000","last_clean":"2023-11-28T18:39:36.021059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:36.021059+0000","last_undegraded":"2023-11-28T18:39:36.021059+0000","last_fullsized":"2023-11-28T18:39:36.021059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T18:39:36.021059+0000","last_change":"2023-11-28T18:39:36.021059+0000","last_active":"2023-11-28T18:39:36.021059+0000","last_peered":"2023-11-28T18:39:36.021059+0000","last_clean":"2023-11-28T18:39:36.021059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:36.021059+0000","last_undegraded":"2023-11-28T18:39:36.021059+0000","last_fullsized":"2023-11-28T18:39:36.021059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T18:39:36.021059+0000","last_change":"2023-11-28T18:39:36.021059+0000","last_active":"2023-11-28T18:39:36.021059+0000","last_peered":"2023-11-28T18:39:36.021059+0000","last_clean":"2023-11-28T18:39:36.021059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:36.021059+0000","last_undegraded":"2023-11-28T18:39:36.021059+0000","last_fullsized":"2023-11-28T18:39:36.021059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T18:39:36.021059+0000","last_change":"2023-11-28T18:39:36.021059+0000","last_active":"2023-11-28T18:39:36.021059+0000","last_peered":"2023-11-28T18:39:36.021059+0000","last_clean":"2023-11-28T18:39:36.021059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:36.021059+0000","last_undegraded":"2023-11-28T18:39:36.021059+0000","last_fullsized":"2023-11-28T18:39:36.021059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T18:39:36.021059+0000","last_change":"2023-11-28T18:39:36.021059+0000","last_active":"2023-11-28T18:39:36.021059+0000","last_peered":"2023-11-28T18:39:36.021059+0000","last_clean":"2023-11-28T18:39:36.021059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:36.021059+0000","last_undegraded":"2023-11-28T18:39:36.021059+0000","last_fullsized":"2023-11-28T18:39:36.021059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T18:39:36.021059+0000","last_change":"2023-11-28T18:39:36.021059+0000","last_active":"2023-11-28T18:39:36.021059+0000","last_peered":"2023-11-28T18:39:36.021059+0000","last_clean":"2023-11-28T18:39:36.021059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:36.021059+0000","last_undegraded":"2023-11-28T18:39:36.021059+0000","last_fullsized":"2023-11-28T18:39:36.021059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T18:39:36.021059+0000","last_change":"2023-11-28T18:39:36.021059+0000","last_active":"2023-11-28T18:39:36.021059+0000","last_peered":"2023-11-28T18:39:36.021059+0000","last_clean":"2023-11-28T18:39:36.021059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:36.021059+0000","last_undegraded":"2023-11-28T18:39:36.021059+0000","last_fullsized":"2023-11-28T18:39:36.021059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T18:39:36.021059+0000","last_change":"2023-11-28T18:39:36.021059+0000","last_active":"2023-11-28T18:39:36.021059+0000","last_peered":"2023-11-28T18:39:36.021059+0000","last_clean":"2023-11-28T18:39:36.021059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:36.021059+0000","last_undegraded":"2023-11-28T18:39:36.021059+0000","last_fullsized":"2023-11-28T18:39:36.021059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T18:39:36.021059+0000","last_change":"2023-11-28T18:39:36.021059+0000","last_active":"2023-11-28T18:39:36.021059+0000","last_peered":"2023-11-28T18:39:36.021059+0000","last_clean":"2023-11-28T18:39:36.021059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:36.021059+0000","last_undegraded":"2023-11-28T18:39:36.021059+0000","last_fullsized":"2023-11-28T18:39:36.021059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T18:39:36.021059+0000","last_change":"2023-11-28T18:39:36.021059+0000","last_active":"2023-11-28T18:39:36.021059+0000","last_peered":"2023-11-28T18:39:36.021059+0000","last_clean":"2023-11-28T18:39:36.021059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:36.021059+0000","last_undegraded":"2023-11-28T18:39:36.021059+0000","last_fullsized":"2023-11-28T18:39:36.021059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T18:39:36.021059+0000","last_change":"2023-11-28T18:39:36.021059+0000","last_active":"2023-11-28T18:39:36.021059+0000","last_peered":"2023-11-28T18:39:36.021059+0000","last_clean":"2023-11-28T18:39:36.021059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:36.021059+0000","last_undegraded":"2023-11-28T18:39:36.021059+0000","last_fullsized":"2023-11-28T18:39:36.021059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T18:39:36.021059+0000","last_change":"2023-11-28T18:39:36.021059+0000","last_active":"2023-11-28T18:39:36.021059+0000","last_peered":"2023-11-28T18:39:36.021059+0000","last_clean":"2023-11-28T18:39:36.021059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:36.021059+0000","last_undegraded":"2023-11-28T18:39:36.021059+0000","last_fullsized":"2023-11-28T18:39:36.021059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T18:39:36.021059+0000","last_change":"2023-11-28T18:39:36.021059+0000","last_active":"2023-11-28T18:39:36.021059+0000","last_peered":"2023-11-28T18:39:36.021059+0000","last_clean":"2023-11-28T18:39:36.021059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:36.021059+0000","last_undegraded":"2023-11-28T18:39:36.021059+0000","last_fullsized":"2023-11-28T18:39:36.021059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T18:39:36.021059+0000","last_change":"2023-11-28T18:39:36.021059+0000","last_active":"2023-11-28T18:39:36.021059+0000","last_peered":"2023-11-28T18:39:36.021059+0000","last_clean":"2023-11-28T18:39:36.021059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:36.021059+0000","last_undegraded":"2023-11-28T18:39:36.021059+0000","last_fullsized":"2023-11-28T18:39:36.021059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T18:39:36.021059+0000","last_change":"2023-11-28T18:39:36.021059+0000","last_active":"2023-11-28T18:39:36.021059+0000","last_peered":"2023-11-28T18:39:36.021059+0000","last_clean":"2023-11-28T18:39:36.021059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:36.021059+0000","last_undegraded":"2023-11-28T18:39:36.021059+0000","last_fullsized":"2023-11-28T18:39:36.021059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T18:39:36.021059+0000","last_change":"2023-11-28T18:39:36.021059+0000","last_active":"2023-11-28T18:39:36.021059+0000","last_peered":"2023-11-28T18:39:36.021059+0000","last_clean":"2023-11-28T18:39:36.021059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:36.021059+0000","last_undegraded":"2023-11-28T18:39:36.021059+0000","last_fullsized":"2023-11-28T18:39:36.021059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T18:39:36.021059+0000","last_change":"2023-11-28T18:39:36.021059+0000","last_active":"2023-11-28T18:39:36.021059+0000","last_peered":"2023-11-28T18:39:36.021059+0000","last_clean":"2023-11-28T18:39:36.021059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:36.021059+0000","last_undegraded":"2023-11-28T18:39:36.021059+0000","last_fullsized":"2023-11-28T18:39:36.021059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T18:39:36.021059+0000","last_change":"2023-11-28T18:39:36.021059+0000","last_active":"2023-11-28T18:39:36.021059+0000","last_peered":"2023-11-28T18:39:36.021059+0000","last_clean":"2023-11-28T18:39:36.021059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:36.021059+0000","last_undegraded":"2023-11-28T18:39:36.021059+0000","last_fullsized":"2023-11-28T18:39:36.021059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T18:39:36.021059+0000","last_change":"2023-11-28T18:39:36.021059+0000","last_active":"2023-11-28T18:39:36.021059+0000","last_peered":"2023-11-28T18:39:36.021059+0000","last_clean":"2023-11-28T18:39:36.021059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:36.021059+0000","last_undegraded":"2023-11-28T18:39:36.021059+0000","last_fullsized":"2023-11-28T18:39:36.021059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T18:39:36.021059+0000","last_change":"2023-11-28T18:39:36.021059+0000","last_active":"2023-11-28T18:39:36.021059+0000","last_peered":"2023-11-28T18:39:36.021059+0000","last_clean":"2023-11-28T18:39:36.021059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:36.021059+0000","last_undegraded":"2023-11-28T18:39:36.021059+0000","last_fullsized":"2023-11-28T18:39:36.021059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2023-11-28T18:39:35.028059+0000","last_change":"2023-11-28T18:39:35.028059+0000","last_active":"2023-11-28T18:39:35.017177+0000","last_peered":"2023-11-28T18:39:35.017177+0000","last_clean":"2023-11-28T18:39:35.017177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:35.028059+0000","last_undegraded":"2023-11-28T18:39:35.028059+0000","last_fullsized":"2023-11-28T18:39:35.028059+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_clean_scrub_stamp":"2023-11-28T18:39:35.017177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T18:39:36.021059+0000","last_change":"2023-11-28T18:39:36.021059+0000","last_active":"2023-11-28T18:39:36.021059+0000","last_peered":"2023-11-28T18:39:36.021059+0000","last_clean":"2023-11-28T18:39:36.021059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:36.021059+0000","last_undegraded":"2023-11-28T18:39:36.021059+0000","last_fullsized":"2023-11-28T18:39:36.021059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2023-11-28T18:39:35.025811+0000","last_change":"2023-11-28T18:39:35.025811+0000","last_active":"2023-11-28T18:39:35.017177+0000","last_peered":"2023-11-28T18:39:35.017177+0000","last_clean":"2023-11-28T18:39:35.017177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:35.025811+0000","last_undegraded":"2023-11-28T18:39:35.025811+0000","last_fullsized":"2023-11-28T18:39:35.025811+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_clean_scrub_stamp":"2023-11-28T18:39:35.017177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T18:39:36.021059+0000","last_change":"2023-11-28T18:39:36.021059+0000","last_active":"2023-11-28T18:39:36.021059+0000","last_peered":"2023-11-28T18:39:36.021059+0000","last_clean":"2023-11-28T18:39:36.021059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:36.021059+0000","last_undegraded":"2023-11-28T18:39:36.021059+0000","last_fullsized":"2023-11-28T18:39:36.021059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2023-11-28T18:39:35.029440+0000","last_change":"2023-11-28T18:39:35.029440+0000","last_active":"2023-11-28T18:39:35.017177+0000","last_peered":"2023-11-28T18:39:35.017177+0000","last_clean":"2023-11-28T18:39:35.017177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:35.029440+0000","last_undegraded":"2023-11-28T18:39:35.029440+0000","last_fullsized":"2023-11-28T18:39:35.029440+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_clean_scrub_stamp":"2023-11-28T18:39:35.017177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T18:39:36.021059+0000","last_change":"2023-11-28T18:39:36.021059+0000","last_active":"2023-11-28T18:39:36.021059+0000","last_peered":"2023-11-28T18:39:36.021059+0000","last_clean":"2023-11-28T18:39:36.021059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:36.021059+0000","last_undegraded":"2023-11-28T18:39:36.021059+0000","last_fullsized":"2023-11-28T18:39:36.021059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2023-11-28T18:39:35.031512+0000","last_change":"2023-11-28T18:39:35.031512+0000","last_active":"2023-11-28T18:39:35.017177+0000","last_peered":"2023-11-28T18:39:35.017177+0000","last_clean":"2023-11-28T18:39:35.017177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:35.031512+0000","last_undegraded":"2023-11-28T18:39:35.031512+0000","last_fullsized":"2023-11-28T18:39:35.031512+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_clean_scrub_stamp":"2023-11-28T18:39:35.017177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T18:39:36.021059+0000","last_change":"2023-11-28T18:39:36.021059+0000","last_active":"2023-11-28T18:39:36.021059+0000","last_peered":"2023-11-28T18:39:36.021059+0000","last_clean":"2023-11-28T18:39:36.021059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:36.021059+0000","last_undegraded":"2023-11-28T18:39:36.021059+0000","last_fullsized":"2023-11-28T18:39:36.021059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2023-11-28T18:39:35.029679+0000","last_change":"2023-11-28T18:39:35.029679+0000","last_active":"2023-11-28T18:39:35.017177+0000","last_peered":"2023-11-28T18:39:35.017177+0000","last_clean":"2023-11-28T18:39:35.017177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:35.029679+0000","last_undegraded":"2023-11-28T18:39:35.029679+0000","last_fullsized":"2023-11-28T18:39:35.029679+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_clean_scrub_stamp":"2023-11-28T18:39:35.017177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T18:39:36.021059+0000","last_change":"2023-11-28T18:39:36.021059+0000","last_active":"2023-11-28T18:39:36.021059+0000","last_peered":"2023-11-28T18:39:36.021059+0000","last_clean":"2023-11-28T18:39:36.021059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:36.021059+0000","last_undegraded":"2023-11-28T18:39:36.021059+0000","last_fullsized":"2023-11-28T18:39:36.021059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2023-11-28T18:39:35.026170+0000","last_change":"2023-11-28T18:39:35.026170+0000","last_active":"2023-11-28T18:39:35.017177+0000","last_peered":"2023-11-28T18:39:35.017177+0000","last_clean":"2023-11-28T18:39:35.017177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:35.026170+0000","last_undegraded":"2023-11-28T18:39:35.026170+0000","last_fullsized":"2023-11-28T18:39:35.026170+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_clean_scrub_stamp":"2023-11-28T18:39:35.017177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T18:39:36.021059+0000","last_change":"2023-11-28T18:39:36.021059+0000","last_active":"2023-11-28T18:39:36.021059+0000","last_peered":"2023-11-28T18:39:36.021059+0000","last_clean":"2023-11-28T18:39:36.021059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:36.021059+0000","last_undegraded":"2023-11-28T18:39:36.021059+0000","last_fullsized":"2023-11-28T18:39:36.021059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2023-11-28T18:39:35.025180+0000","last_change":"2023-11-28T18:39:35.025180+0000","last_active":"2023-11-28T18:39:35.017177+0000","last_peered":"2023-11-28T18:39:35.017177+0000","last_clean":"2023-11-28T18:39:35.017177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:35.025180+0000","last_undegraded":"2023-11-28T18:39:35.025180+0000","last_fullsized":"2023-11-28T18:39:35.025180+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_clean_scrub_stamp":"2023-11-28T18:39:35.017177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T18:39:36.021059+0000","last_change":"2023-11-28T18:39:36.021059+0000","last_active":"2023-11-28T18:39:36.021059+0000","last_peered":"2023-11-28T18:39:36.021059+0000","last_clean":"2023-11-28T18:39:36.021059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:36.021059+0000","last_undegraded":"2023-11-28T18:39:36.021059+0000","last_fullsized":"2023-11-28T18:39:36.021059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2023-11-28T18:39:35.032626+0000","last_change":"2023-11-28T18:39:35.032626+0000","last_active":"2023-11-28T18:39:35.017177+0000","last_peered":"2023-11-28T18:39:35.017177+0000","last_clean":"2023-11-28T18:39:35.017177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:35.032626+0000","last_undegraded":"2023-11-28T18:39:35.032626+0000","last_fullsized":"2023-11-28T18:39:35.032626+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_clean_scrub_stamp":"2023-11-28T18:39:35.017177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T18:39:36.021059+0000","last_change":"2023-11-28T18:39:36.021059+0000","last_active":"2023-11-28T18:39:36.021059+0000","last_peered":"2023-11-28T18:39:36.021059+0000","last_clean":"2023-11-28T18:39:36.021059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:36.021059+0000","last_undegraded":"2023-11-28T18:39:36.021059+0000","last_fullsized":"2023-11-28T18:39:36.021059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2023-11-28T18:39:35.025177+0000","last_change":"2023-11-28T18:39:35.025177+0000","last_active":"2023-11-28T18:39:35.017177+0000","last_peered":"2023-11-28T18:39:35.017177+0000","last_clean":"2023-11-28T18:39:35.017177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:35.025177+0000","last_undegraded":"2023-11-28T18:39:35.025177+0000","last_fullsized":"2023-11-28T18:39:35.025177+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_clean_scrub_stamp":"2023-11-28T18:39:35.017177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T18:39:36.021059+0000","last_change":"2023-11-28T18:39:36.021059+0000","last_active":"2023-11-28T18:39:36.021059+0000","last_peered":"2023-11-28T18:39:36.021059+0000","last_clean":"2023-11-28T18:39:36.021059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:36.021059+0000","last_undegraded":"2023-11-28T18:39:36.021059+0000","last_fullsized":"2023-11-28T18:39:36.021059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2023-11-28T18:39:35.031818+0000","last_change":"2023-11-28T18:39:35.031818+0000","last_active":"2023-11-28T18:39:35.017177+0000","last_peered":"2023-11-28T18:39:35.017177+0000","last_clean":"2023-11-28T18:39:35.017177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:35.031818+0000","last_undegraded":"2023-11-28T18:39:35.031818+0000","last_fullsized":"2023-11-28T18:39:35.031818+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_clean_scrub_stamp":"2023-11-28T18:39:35.017177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T18:39:36.021059+0000","last_change":"2023-11-28T18:39:36.021059+0000","last_active":"2023-11-28T18:39:36.021059+0000","last_peered":"2023-11-28T18:39:36.021059+0000","last_clean":"2023-11-28T18:39:36.021059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:36.021059+0000","last_undegraded":"2023-11-28T18:39:36.021059+0000","last_fullsized":"2023-11-28T18:39:36.021059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2023-11-28T18:39:35.032269+0000","last_change":"2023-11-28T18:39:35.032269+0000","last_active":"2023-11-28T18:39:35.017177+0000","last_peered":"2023-11-28T18:39:35.017177+0000","last_clean":"2023-11-28T18:39:35.017177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:35.032269+0000","last_undegraded":"2023-11-28T18:39:35.032269+0000","last_fullsized":"2023-11-28T18:39:35.032269+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_clean_scrub_stamp":"2023-11-28T18:39:35.017177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T18:39:36.021059+0000","last_change":"2023-11-28T18:39:36.021059+0000","last_active":"2023-11-28T18:39:36.021059+0000","last_peered":"2023-11-28T18:39:36.021059+0000","last_clean":"2023-11-28T18:39:36.021059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:36.021059+0000","last_undegraded":"2023-11-28T18:39:36.021059+0000","last_fullsized":"2023-11-28T18:39:36.021059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2023-11-28T18:39:35.025378+0000","last_change":"2023-11-28T18:39:35.025378+0000","last_active":"2023-11-28T18:39:35.017177+0000","last_peered":"2023-11-28T18:39:35.017177+0000","last_clean":"2023-11-28T18:39:35.017177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:35.025378+0000","last_undegraded":"2023-11-28T18:39:35.025378+0000","last_fullsized":"2023-11-28T18:39:35.025378+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_clean_scrub_stamp":"2023-11-28T18:39:35.017177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T18:39:36.021059+0000","last_change":"2023-11-28T18:39:36.021059+0000","last_active":"2023-11-28T18:39:36.021059+0000","last_peered":"2023-11-28T18:39:36.021059+0000","last_clean":"2023-11-28T18:39:36.021059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:36.021059+0000","last_undegraded":"2023-11-28T18:39:36.021059+0000","last_fullsized":"2023-11-28T18:39:36.021059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2023-11-28T18:39:35.029073+0000","last_change":"2023-11-28T18:39:35.029073+0000","last_active":"2023-11-28T18:39:35.017177+0000","last_peered":"2023-11-28T18:39:35.017177+0000","last_clean":"2023-11-28T18:39:35.017177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:35.029073+0000","last_undegraded":"2023-11-28T18:39:35.029073+0000","last_fullsized":"2023-11-28T18:39:35.029073+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_clean_scrub_stamp":"2023-11-28T18:39:35.017177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T18:39:36.021059+0000","last_change":"2023-11-28T18:39:36.021059+0000","last_active":"2023-11-28T18:39:36.021059+0000","last_peered":"2023-11-28T18:39:36.021059+0000","last_clean":"2023-11-28T18:39:36.021059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:36.021059+0000","last_undegraded":"2023-11-28T18:39:36.021059+0000","last_fullsized":"2023-11-28T18:39:36.021059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2023-11-28T18:39:35.031538+0000","last_change":"2023-11-28T18:39:35.031538+0000","last_active":"2023-11-28T18:39:35.017177+0000","last_peered":"2023-11-28T18:39:35.017177+0000","last_clean":"2023-11-28T18:39:35.017177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:35.031538+0000","last_undegraded":"2023-11-28T18:39:35.031538+0000","last_fullsized":"2023-11-28T18:39:35.031538+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_clean_scrub_stamp":"2023-11-28T18:39:35.017177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T18:39:36.021059+0000","last_change":"2023-11-28T18:39:36.021059+0000","last_active":"2023-11-28T18:39:36.021059+0000","last_peered":"2023-11-28T18:39:36.021059+0000","last_clean":"2023-11-28T18:39:36.021059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:36.021059+0000","last_undegraded":"2023-11-28T18:39:36.021059+0000","last_fullsized":"2023-11-28T18:39:36.021059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2023-11-28T18:39:35.027822+0000","last_change":"2023-11-28T18:39:35.027822+0000","last_active":"2023-11-28T18:39:35.017177+0000","last_peered":"2023-11-28T18:39:35.017177+0000","last_clean":"2023-11-28T18:39:35.017177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:35.027822+0000","last_undegraded":"2023-11-28T18:39:35.027822+0000","last_fullsized":"2023-11-28T18:39:35.027822+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_clean_scrub_stamp":"2023-11-28T18:39:35.017177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T18:39:36.021059+0000","last_change":"2023-11-28T18:39:36.021059+0000","last_active":"2023-11-28T18:39:36.021059+0000","last_peered":"2023-11-28T18:39:36.021059+0000","last_clean":"2023-11-28T18:39:36.021059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:36.021059+0000","last_undegraded":"2023-11-28T18:39:36.021059+0000","last_fullsized":"2023-11-28T18:39:36.021059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2023-11-28T18:39:35.032087+0000","last_change":"2023-11-28T18:39:35.032087+0000","last_active":"2023-11-28T18:39:35.017177+0000","last_peered":"2023-11-28T18:39:35.017177+0000","last_clean":"2023-11-28T18:39:35.017177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:35.032087+0000","last_undegraded":"2023-11-28T18:39:35.032087+0000","last_fullsized":"2023-11-28T18:39:35.032087+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_clean_scrub_stamp":"2023-11-28T18:39:35.017177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T18:39:36.021059+0000","last_change":"2023-11-28T18:39:36.021059+0000","last_active":"2023-11-28T18:39:36.021059+0000","last_peered":"2023-11-28T18:39:36.021059+0000","last_clean":"2023-11-28T18:39:36.021059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:36.021059+0000","last_undegraded":"2023-11-28T18:39:36.021059+0000","last_fullsized":"2023-11-28T18:39:36.021059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2023-11-28T18:39:35.025391+0000","last_change":"2023-11-28T18:39:35.025391+0000","last_active":"2023-11-28T18:39:35.017177+0000","last_peered":"2023-11-28T18:39:35.017177+0000","last_clean":"2023-11-28T18:39:35.017177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:35.025391+0000","last_undegraded":"2023-11-28T18:39:35.025391+0000","last_fullsized":"2023-11-28T18:39:35.025391+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_clean_scrub_stamp":"2023-11-28T18:39:35.017177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T18:39:36.021059+0000","last_change":"2023-11-28T18:39:36.021059+0000","last_active":"2023-11-28T18:39:36.021059+0000","last_peered":"2023-11-28T18:39:36.021059+0000","last_clean":"2023-11-28T18:39:36.021059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:36.021059+0000","last_undegraded":"2023-11-28T18:39:36.021059+0000","last_fullsized":"2023-11-28T18:39:36.021059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2023-11-28T18:39:35.025143+0000","last_change":"2023-11-28T18:39:35.025143+0000","last_active":"2023-11-28T18:39:35.017177+0000","last_peered":"2023-11-28T18:39:35.017177+0000","last_clean":"2023-11-28T18:39:35.017177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:35.025143+0000","last_undegraded":"2023-11-28T18:39:35.025143+0000","last_fullsized":"2023-11-28T18:39:35.025143+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_clean_scrub_stamp":"2023-11-28T18:39:35.017177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T18:39:36.021059+0000","last_change":"2023-11-28T18:39:36.021059+0000","last_active":"2023-11-28T18:39:36.021059+0000","last_peered":"2023-11-28T18:39:36.021059+0000","last_clean":"2023-11-28T18:39:36.021059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:36.021059+0000","last_undegraded":"2023-11-28T18:39:36.021059+0000","last_fullsized":"2023-11-28T18:39:36.021059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2023-11-28T18:39:35.025623+0000","last_change":"2023-11-28T18:39:35.025623+0000","last_active":"2023-11-28T18:39:35.017177+0000","last_peered":"2023-11-28T18:39:35.017177+0000","last_clean":"2023-11-28T18:39:35.017177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:35.025623+0000","last_undegraded":"2023-11-28T18:39:35.025623+0000","last_fullsized":"2023-11-28T18:39:35.025623+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_clean_scrub_stamp":"2023-11-28T18:39:35.017177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T18:39:36.021059+0000","last_change":"2023-11-28T18:39:36.021059+0000","last_active":"2023-11-28T18:39:36.021059+0000","last_peered":"2023-11-28T18:39:36.021059+0000","last_clean":"2023-11-28T18:39:36.021059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:36.021059+0000","last_undegraded":"2023-11-28T18:39:36.021059+0000","last_fullsized":"2023-11-28T18:39:36.021059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2023-11-28T18:39:35.027859+0000","last_change":"2023-11-28T18:39:35.027859+0000","last_active":"2023-11-28T18:39:35.017177+0000","last_peered":"2023-11-28T18:39:35.017177+0000","last_clean":"2023-11-28T18:39:35.017177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:35.027859+0000","last_undegraded":"2023-11-28T18:39:35.027859+0000","last_fullsized":"2023-11-28T18:39:35.027859+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_clean_scrub_stamp":"2023-11-28T18:39:35.017177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T18:39:36.021059+0000","last_change":"2023-11-28T18:39:36.021059+0000","last_active":"2023-11-28T18:39:36.021059+0000","last_peered":"2023-11-28T18:39:36.021059+0000","last_clean":"2023-11-28T18:39:36.021059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:36.021059+0000","last_undegraded":"2023-11-28T18:39:36.021059+0000","last_fullsized":"2023-11-28T18:39:36.021059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2023-11-28T18:39:35.028037+0000","last_change":"2023-11-28T18:39:35.028037+0000","last_active":"2023-11-28T18:39:35.017177+0000","last_peered":"2023-11-28T18:39:35.017177+0000","last_clean":"2023-11-28T18:39:35.017177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:35.028037+0000","last_undegraded":"2023-11-28T18:39:35.028037+0000","last_fullsized":"2023-11-28T18:39:35.028037+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_clean_scrub_stamp":"2023-11-28T18:39:35.017177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T18:39:36.021059+0000","last_change":"2023-11-28T18:39:36.021059+0000","last_active":"2023-11-28T18:39:36.021059+0000","last_peered":"2023-11-28T18:39:36.021059+0000","last_clean":"2023-11-28T18:39:36.021059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:36.021059+0000","last_undegraded":"2023-11-28T18:39:36.021059+0000","last_fullsized":"2023-11-28T18:39:36.021059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2023-11-28T18:39:35.025143+0000","last_change":"2023-11-28T18:39:35.025143+0000","last_active":"2023-11-28T18:39:35.017177+0000","last_peered":"2023-11-28T18:39:35.017177+0000","last_clean":"2023-11-28T18:39:35.017177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:35.025143+0000","last_undegraded":"2023-11-28T18:39:35.025143+0000","last_fullsized":"2023-11-28T18:39:35.025143+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_clean_scrub_stamp":"2023-11-28T18:39:35.017177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T18:39:36.021059+0000","last_change":"2023-11-28T18:39:36.021059+0000","last_active":"2023-11-28T18:39:36.021059+0000","last_peered":"2023-11-28T18:39:36.021059+0000","last_clean":"2023-11-28T18:39:36.021059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:36.021059+0000","last_undegraded":"2023-11-28T18:39:36.021059+0000","last_fullsized":"2023-11-28T18:39:36.021059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2023-11-28T18:39:35.031965+0000","last_change":"2023-11-28T18:39:35.031965+0000","last_active":"2023-11-28T18:39:35.017177+0000","last_peered":"2023-11-28T18:39:35.017177+0000","last_clean":"2023-11-28T18:39:35.017177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:35.031965+0000","last_undegraded":"2023-11-28T18:39:35.031965+0000","last_fullsized":"2023-11-28T18:39:35.031965+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_clean_scrub_stamp":"2023-11-28T18:39:35.017177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T18:39:36.021059+0000","last_change":"2023-11-28T18:39:36.021059+0000","last_active":"2023-11-28T18:39:36.021059+0000","last_peered":"2023-11-28T18:39:36.021059+0000","last_clean":"2023-11-28T18:39:36.021059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:36.021059+0000","last_undegraded":"2023-11-28T18:39:36.021059+0000","last_fullsized":"2023-11-28T18:39:36.021059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2023-11-28T18:39:35.031562+0000","last_change":"2023-11-28T18:39:35.031562+0000","last_active":"2023-11-28T18:39:35.017177+0000","last_peered":"2023-11-28T18:39:35.017177+0000","last_clean":"2023-11-28T18:39:35.017177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:35.031562+0000","last_undegraded":"2023-11-28T18:39:35.031562+0000","last_fullsized":"2023-11-28T18:39:35.031562+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_clean_scrub_stamp":"2023-11-28T18:39:35.017177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T18:39:36.021059+0000","last_change":"2023-11-28T18:39:36.021059+0000","last_active":"2023-11-28T18:39:36.021059+0000","last_peered":"2023-11-28T18:39:36.021059+0000","last_clean":"2023-11-28T18:39:36.021059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:36.021059+0000","last_undegraded":"2023-11-28T18:39:36.021059+0000","last_fullsized":"2023-11-28T18:39:36.021059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2023-11-28T18:39:35.027893+0000","last_change":"2023-11-28T18:39:35.027893+0000","last_active":"2023-11-28T18:39:35.017177+0000","last_peered":"2023-11-28T18:39:35.017177+0000","last_clean":"2023-11-28T18:39:35.017177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:35.027893+0000","last_undegraded":"2023-11-28T18:39:35.027893+0000","last_fullsized":"2023-11-28T18:39:35.027893+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_clean_scrub_stamp":"2023-11-28T18:39:35.017177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T18:39:36.021059+0000","last_change":"2023-11-28T18:39:36.021059+0000","last_active":"2023-11-28T18:39:36.021059+0000","last_peered":"2023-11-28T18:39:36.021059+0000","last_clean":"2023-11-28T18:39:36.021059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:36.021059+0000","last_undegraded":"2023-11-28T18:39:36.021059+0000","last_fullsized":"2023-11-28T18:39:36.021059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2023-11-28T18:39:35.031554+0000","last_change":"2023-11-28T18:39:35.031554+0000","last_active":"2023-11-28T18:39:35.017177+0000","last_peered":"2023-11-28T18:39:35.017177+0000","last_clean":"2023-11-28T18:39:35.017177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:35.031554+0000","last_undegraded":"2023-11-28T18:39:35.031554+0000","last_fullsized":"2023-11-28T18:39:35.031554+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_clean_scrub_stamp":"2023-11-28T18:39:35.017177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T18:39:36.021059+0000","last_change":"2023-11-28T18:39:36.021059+0000","last_active":"2023-11-28T18:39:36.021059+0000","last_peered":"2023-11-28T18:39:36.021059+0000","last_clean":"2023-11-28T18:39:36.021059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:36.021059+0000","last_undegraded":"2023-11-28T18:39:36.021059+0000","last_fullsized":"2023-11-28T18:39:36.021059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2023-11-28T18:39:35.028931+0000","last_change":"2023-11-28T18:39:35.028931+0000","last_active":"2023-11-28T18:39:35.017177+0000","last_peered":"2023-11-28T18:39:35.017177+0000","last_clean":"2023-11-28T18:39:35.017177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:35.028931+0000","last_undegraded":"2023-11-28T18:39:35.028931+0000","last_fullsized":"2023-11-28T18:39:35.028931+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_clean_scrub_stamp":"2023-11-28T18:39:35.017177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T18:39:36.021059+0000","last_change":"2023-11-28T18:39:36.021059+0000","last_active":"2023-11-28T18:39:36.021059+0000","last_peered":"2023-11-28T18:39:36.021059+0000","last_clean":"2023-11-28T18:39:36.021059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:36.021059+0000","last_undegraded":"2023-11-28T18:39:36.021059+0000","last_fullsized":"2023-11-28T18:39:36.021059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2023-11-28T18:39:35.031573+0000","last_change":"2023-11-28T18:39:35.031573+0000","last_active":"2023-11-28T18:39:35.017177+0000","last_peered":"2023-11-28T18:39:35.017177+0000","last_clean":"2023-11-28T18:39:35.017177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:35.031573+0000","last_undegraded":"2023-11-28T18:39:35.031573+0000","last_fullsized":"2023-11-28T18:39:35.031573+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_clean_scrub_stamp":"2023-11-28T18:39:35.017177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T18:39:36.021059+0000","last_change":"2023-11-28T18:39:36.021059+0000","last_active":"2023-11-28T18:39:36.021059+0000","last_peered":"2023-11-28T18:39:36.021059+0000","last_clean":"2023-11-28T18:39:36.021059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:36.021059+0000","last_undegraded":"2023-11-28T18:39:36.021059+0000","last_fullsized":"2023-11-28T18:39:36.021059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2023-11-28T18:39:35.025579+0000","last_change":"2023-11-28T18:39:35.025579+0000","last_active":"2023-11-28T18:39:35.017177+0000","last_peered":"2023-11-28T18:39:35.017177+0000","last_clean":"2023-11-28T18:39:35.017177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:35.025579+0000","last_undegraded":"2023-11-28T18:39:35.025579+0000","last_fullsized":"2023-11-28T18:39:35.025579+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_clean_scrub_stamp":"2023-11-28T18:39:35.017177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T18:39:36.021059+0000","last_change":"2023-11-28T18:39:36.021059+0000","last_active":"2023-11-28T18:39:36.021059+0000","last_peered":"2023-11-28T18:39:36.021059+0000","last_clean":"2023-11-28T18:39:36.021059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:36.021059+0000","last_undegraded":"2023-11-28T18:39:36.021059+0000","last_fullsized":"2023-11-28T18:39:36.021059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2023-11-28T18:39:35.028924+0000","last_change":"2023-11-28T18:39:35.028924+0000","last_active":"2023-11-28T18:39:35.017177+0000","last_peered":"2023-11-28T18:39:35.017177+0000","last_clean":"2023-11-28T18:39:35.017177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:35.028924+0000","last_undegraded":"2023-11-28T18:39:35.028924+0000","last_fullsized":"2023-11-28T18:39:35.028924+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_clean_scrub_stamp":"2023-11-28T18:39:35.017177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T18:39:36.021059+0000","last_change":"2023-11-28T18:39:36.021059+0000","last_active":"2023-11-28T18:39:36.021059+0000","last_peered":"2023-11-28T18:39:36.021059+0000","last_clean":"2023-11-28T18:39:36.021059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:36.021059+0000","last_undegraded":"2023-11-28T18:39:36.021059+0000","last_fullsized":"2023-11-28T18:39:36.021059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2023-11-28T18:39:35.031530+0000","last_change":"2023-11-28T18:39:35.031530+0000","last_active":"2023-11-28T18:39:35.017177+0000","last_peered":"2023-11-28T18:39:35.017177+0000","last_clean":"2023-11-28T18:39:35.017177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:35.031530+0000","last_undegraded":"2023-11-28T18:39:35.031530+0000","last_fullsized":"2023-11-28T18:39:35.031530+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_clean_scrub_stamp":"2023-11-28T18:39:35.017177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T18:39:36.021059+0000","last_change":"2023-11-28T18:39:36.021059+0000","last_active":"2023-11-28T18:39:36.021059+0000","last_peered":"2023-11-28T18:39:36.021059+0000","last_clean":"2023-11-28T18:39:36.021059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:36.021059+0000","last_undegraded":"2023-11-28T18:39:36.021059+0000","last_fullsized":"2023-11-28T18:39:36.021059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2023-11-28T18:39:35.025150+0000","last_change":"2023-11-28T18:39:35.025150+0000","last_active":"2023-11-28T18:39:35.017177+0000","last_peered":"2023-11-28T18:39:35.017177+0000","last_clean":"2023-11-28T18:39:35.017177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T18:39:35.025150+0000","last_undegraded":"2023-11-28T18:39:35.025150+0000","last_fullsized":"2023-11-28T18:39:35.025150+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_clean_scrub_stamp":"2023-11-28T18:39:35.017177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":183,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-28T18:39:32.489829+0000","last_change":"2023-11-28T18:37:22.369132+0000","last_active":"2023-11-28T18:39:32.489829+0000","last_peered":"2023-11-28T18:39:32.489829+0000","last_clean":"2023-11-28T18:39:32.489829+0000","last_became_active":"2023-11-28T18:37:22.368142+0000","last_became_peered":"2023-11-28T18:37:22.368142+0000","last_unstale":"2023-11-28T18:39:32.489829+0000","last_undegraded":"2023-11-28T18:39:32.489829+0000","last_fullsized":"2023-11-28T18:39:32.489829+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:21.313053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:21.313053+0000","last_clean_scrub_stamp":"2023-11-28T18:37:21.313053+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:55:01.432028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574878,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28084,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343756,"statfs":{"total":96636764160,"available":96608006144,"internally_reserved":0,"allocated":1085440,"data_stored":786673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 18:39:23 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.83999999999999997,"15min":0.86899999999999999},"min":{"1min":0.45800000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.0509999999999999,"5min":4.8559999999999999,"15min":4.8559999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.81899999999999995,"15min":0.84599999999999997},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.90900000000000003,"5min":4.8319999999999999,"15min":4.8319999999999999},"last":0.81799999999999995}]},{"osd":1,"last update":"Tue Nov 28 18:39:23 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.84099999999999997,"15min":0.86299999999999999},"min":{"1min":0.50900000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.93400000000000005,"5min":4.8109999999999999,"15min":4.8109999999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.88800000000000001,"15min":0.91800000000000004},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.997,"5min":4.8700000000000001,"15min":4.8700000000000001},"last":0.97899999999999998}]},{"osd":2,"last update":"Tue Nov 28 18:39:23 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.73599999999999999,"15min":0.73999999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.032,"5min":1.151,"15min":1.151},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.752,"15min":0.751},"min":{"1min":0.55900000000000005,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.113,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.94999999999999996}]},{"osd":3,"last update":"Tue Nov 28 18:39:23 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.88900000000000001,"15min":0.92100000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.97499999999999998,"5min":4.7619999999999996,"15min":4.7619999999999996},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.75800000000000001,"15min":0.76200000000000001},"min":{"1min":0.59299999999999997,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.93400000000000005,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.85299999999999998}]},{"osd":4,"last update":"Tue Nov 28 18:39:23 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.64700000000000002,"15min":0.65300000000000002},"min":{"1min":0.46700000000000003,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.877,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":1.032},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.68899999999999995,"15min":0.69699999999999995},"min":{"1min":0.48099999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.872,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.96599999999999997}]},{"osd":5,"last update":"Tue Nov 28 18:39:23 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.69299999999999995,"15min":0.70299999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.94099999999999995,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.73999999999999999,"15min":0.753},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.88300000000000001,"5min":1.032,"15min":1.032},"last":1.079}]},{"osd":6,"last update":"Tue Nov 28 18:39:23 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.80900000000000005,"15min":0.82499999999999996},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.93600000000000005,"5min":1.484,"15min":1.484},"last":1.107},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.77800000000000002,"15min":0.79300000000000004},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.96899999999999997,"5min":1.169,"15min":1.169},"last":1.046}]}]},{"osd":6,"up_from":13,"seq":55834574880,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27504,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":491520,"data_stored":196305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 18:39:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.63200000000000001,"15min":0.628},"min":{"1min":0.443,"5min":0.376,"15min":0.376},"max":{"1min":0.85099999999999998,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.63600000000000001,"15min":0.63},"min":{"1min":0.46999999999999997,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.71399999999999997}]},{"osd":1,"last update":"Tue Nov 28 18:39:28 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.67400000000000004,"15min":0.66600000000000004},"min":{"1min":0.499,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.746,"5min":0.74099999999999999,"15min":0.73999999999999999},"min":{"1min":0.58499999999999996,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.92000000000000004,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.76500000000000001}]},{"osd":2,"last update":"Tue Nov 28 18:39:28 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.64900000000000002,"15min":0.65300000000000002},"min":{"1min":0.46300000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.93200000000000005,"5min":1.01,"15min":1.01},"last":0.62},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.69199999999999995,"15min":0.68999999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.96899999999999997,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.64300000000000002}]},{"osd":3,"last update":"Tue Nov 28 18:39:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.96299999999999997,"5min":1.097,"15min":1.097},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.69399999999999995,"15min":0.69899999999999995},"min":{"1min":0.53200000000000003,"5min":0.44,"15min":0.44},"max":{"1min":0.873,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.54500000000000004}]},{"osd":4,"last update":"Tue Nov 28 18:39:28 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.64400000000000002,"15min":0.66200000000000003},"min":{"1min":0.39600000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.79000000000000004,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.66900000000000004,"15min":0.67700000000000005},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.80300000000000005,"5min":1.163,"15min":1.163},"last":0.47799999999999998}]},{"osd":5,"last update":"Tue Nov 28 18:39:28 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.67300000000000004,"15min":0.68700000000000006},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.80300000000000005,"5min":1.052,"15min":1.052},"last":0.746},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.78300000000000003,"15min":0.79700000000000004},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.96999999999999997,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.78700000000000003}]},{"osd":7,"last update":"Tue Nov 28 18:39:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.76000000000000001,"15min":0.77100000000000002},"min":{"1min":0.51000000000000001,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.85399999999999998,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.75600000000000001,"15min":0.76800000000000002},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.80100000000000005,"5min":1.131,"15min":1.131},"last":0.69399999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27512,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":491520,"data_stored":196305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 18:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.63200000000000001,"15min":0.626},"min":{"1min":0.438,"5min":0.375,"15min":0.375},"max":{"1min":0.84499999999999997,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.67900000000000005,"15min":0.68100000000000005},"min":{"1min":0.57199999999999995,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.91000000000000003,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.71399999999999997}]},{"osd":1,"last update":"Tue Nov 28 18:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.73699999999999999,"15min":0.73599999999999999},"min":{"1min":0.53800000000000003,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.97199999999999998,"5min":1.073,"15min":1.073},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.72799999999999998,"15min":0.73199999999999998},"min":{"1min":0.48399999999999999,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.86099999999999999,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.83299999999999996}]},{"osd":2,"last update":"Tue Nov 28 18:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.45800000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.94699999999999995,"5min":1.022,"15min":1.022},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.73699999999999999,"15min":0.74299999999999999},"min":{"1min":0.54400000000000004,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.82799999999999996,"5min":1.002,"15min":1.002},"last":0.81399999999999995}]},{"osd":3,"last update":"Tue Nov 28 18:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.72299999999999998,"15min":0.72899999999999998},"min":{"1min":0.51200000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.89400000000000002,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.77600000000000002,"15min":0.77800000000000002},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":0.94099999999999995,"5min":1.147,"15min":1.147},"last":0.72699999999999998}]},{"osd":4,"last update":"Tue Nov 28 18:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.622,"15min":0.622},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67800000000000005,"15min":0.68000000000000005},"min":{"1min":0.45800000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.86799999999999999,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.58899999999999997}]},{"osd":6,"last update":"Tue Nov 28 18:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.67500000000000004,"15min":0.68300000000000005},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.72399999999999998,"15min":0.73299999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.97699999999999998,"5min":1.048,"15min":1.048},"last":0.78400000000000003}]},{"osd":7,"last update":"Tue Nov 28 18:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.751,"15min":0.75800000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.91500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.79800000000000004,"15min":0.81000000000000005},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.98399999999999999,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.755}]}]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27508,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344332,"statfs":{"total":96636764160,"available":96608595968,"internally_reserved":0,"allocated":491520,"data_stored":196305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 18:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.63400000000000001,"15min":0.624},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.81200000000000006,"15min":0.83799999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.01,"5min":3.5179999999999998,"15min":3.5179999999999998},"last":0.70999999999999996}]},{"osd":1,"last update":"Tue Nov 28 18:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.83099999999999996,"15min":0.85099999999999998},"min":{"1min":0.47199999999999998,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.94399999999999995,"5min":3.5019999999999998,"15min":3.5019999999999998},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.83999999999999997,"15min":0.86199999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.0640000000000001,"5min":3.5630000000000002,"15min":3.5630000000000002},"last":0.88800000000000001}]},{"osd":2,"last update":"Tue Nov 28 18:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.82699999999999996,"15min":0.84899999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.998,"5min":3.6709999999999998,"15min":3.6709999999999998},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.84999999999999998,"15min":0.87},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.018,"5min":3.4849999999999999,"15min":3.4849999999999999},"last":0.92100000000000004}]},{"osd":3,"last update":"Tue Nov 28 18:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.86799999999999999,"15min":0.89800000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.002,"5min":3.7130000000000001,"15min":3.7130000000000001},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.75700000000000001,"15min":0.75900000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.96499999999999997,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.58899999999999997}]},{"osd":5,"last update":"Tue Nov 28 18:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.66800000000000004,"15min":0.67400000000000004},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.69699999999999995,"15min":0.70599999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.91900000000000004,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.64900000000000002}]},{"osd":6,"last update":"Tue Nov 28 18:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.77900000000000003,"15min":0.80300000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.83799999999999997,"5min":1.718,"15min":1.718},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.75900000000000001,"15min":0.77400000000000002},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.143,"5min":1.304,"15min":1.304},"last":0.94799999999999995}]},{"osd":7,"last update":"Tue Nov 28 18:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.74099999999999999,"15min":0.754},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.88600000000000001,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.81699999999999995,"15min":0.83399999999999996},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.018,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.86599999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31672,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340168,"statfs":{"total":96636764160,"available":96604332032,"internally_reserved":0,"allocated":491520,"data_stored":196305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 18:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.44800000000000001,"15min":0.42999999999999999},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":2.4940000000000002,"5min":2.4940000000000002,"15min":2.4940000000000002},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.46700000000000003,"15min":0.47099999999999997},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.495}]},{"osd":1,"last update":"Tue Nov 28 18:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.46200000000000002,"15min":0.45600000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53600000000000003,"15min":0.53700000000000003},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.45700000000000002}]},{"osd":2,"last update":"Tue Nov 28 18:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.51600000000000001,"15min":0.50800000000000001},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.41399999999999998}]},{"osd":4,"last update":"Tue Nov 28 18:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.76700000000000002,"15min":0.77300000000000002},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.018,"5min":1.069,"15min":1.069},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.79000000000000004,"15min":0.80000000000000004},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.246,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.75700000000000001}]},{"osd":5,"last update":"Tue Nov 28 18:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.81299999999999994,"15min":0.82299999999999995},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.071,"5min":1.26,"15min":1.26},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.82399999999999995,"15min":0.83399999999999996},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.1339999999999999,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.58499999999999996}]},{"osd":6,"last update":"Tue Nov 28 18:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.80300000000000005,"15min":0.81299999999999994},"min":{"1min":0.55000000000000004,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.3580000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.80800000000000005,"15min":0.81599999999999995},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.109,"5min":1.377,"15min":1.377},"last":0.62}]},{"osd":7,"last update":"Tue Nov 28 18:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.81999999999999995,"15min":0.82899999999999996},"min":{"1min":0.57099999999999995,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.0249999999999999,"5min":1.169,"15min":1.169},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.85299999999999998,"15min":0.85999999999999999},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.80400000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31664,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340176,"statfs":{"total":96636764160,"available":96604340224,"internally_reserved":0,"allocated":491520,"data_stored":196305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 18:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.42199999999999999,"15min":0.42499999999999999},"min":{"1min":0.28199999999999997,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.56699999999999995,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.24099999999999999},{"interface":"front","average":{"1min":0.443,"5min":0.49399999999999999,"15min":0.502},"min":{"1min":0.308,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.70599999999999996,"5min":1.589,"15min":1.589},"last":0.33400000000000002}]},{"osd":1,"last update":"Tue Nov 28 18:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.46300000000000002,"15min":0.47199999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.60199999999999998,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.51400000000000001,"15min":0.51700000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.69599999999999995,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.28599999999999998}]},{"osd":3,"last update":"Tue Nov 28 18:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.55100000000000005,"15min":0.56100000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.747,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.371},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.56599999999999995,"15min":0.57299999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.71499999999999997,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.39300000000000002}]},{"osd":4,"last update":"Tue Nov 28 18:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.748,"15min":0.746},"min":{"1min":0.51300000000000001,"5min":0.505,"15min":0.505},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.74299999999999999,"15min":0.746},"min":{"1min":0.54900000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0009999999999999,"5min":1.665,"15min":1.665},"last":0.65200000000000002}]},{"osd":5,"last update":"Tue Nov 28 18:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.77400000000000002,"15min":0.78000000000000003},"min":{"1min":0.56200000000000006,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.92400000000000004,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.79200000000000004,"15min":0.79700000000000004},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.0489999999999999,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.78700000000000003}]},{"osd":6,"last update":"Tue Nov 28 18:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.80500000000000005,"15min":0.81100000000000005},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.089,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.754,"5min":0.77500000000000002,"15min":0.77900000000000003},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.117,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.83499999999999996}]},{"osd":7,"last update":"Tue Nov 28 18:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.77600000000000002,"15min":0.78400000000000003},"min":{"1min":0.51900000000000002,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.89800000000000002,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":0.755},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.80800000000000005,"15min":0.81399999999999995},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.1679999999999999,"5min":1.341,"15min":1.341},"last":0.81000000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31660,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340180,"statfs":{"total":96636764160,"available":96604344320,"internally_reserved":0,"allocated":491520,"data_stored":196305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 18:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.57199999999999995,"15min":0.59899999999999998},"min":{"1min":0.311,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.55900000000000005,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.69699999999999995,"15min":0.74099999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.67100000000000004,"5min":4.0899999999999999,"15min":4.0899999999999999},"last":0.35799999999999998}]},{"osd":2,"last update":"Tue Nov 28 18:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.61799999999999999,"15min":0.65000000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.59799999999999998,"5min":3.8620000000000001,"15min":3.8620000000000001},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.69699999999999995,"15min":0.73499999999999999},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.66400000000000003,"5min":2.823,"15min":2.823},"last":0.63200000000000001}]},{"osd":3,"last update":"Tue Nov 28 18:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.71699999999999997,"15min":0.751},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.73699999999999999,"5min":4.0739999999999998,"15min":4.0739999999999998},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.82199999999999995,"15min":0.86399999999999999},"min":{"1min":0.47699999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.79600000000000004,"5min":3.6659999999999999,"15min":3.6659999999999999},"last":0.68500000000000005}]},{"osd":4,"last update":"Tue Nov 28 18:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.97599999999999998,"15min":1.03},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.81499999999999995,"5min":5.3540000000000001,"15min":5.3540000000000001},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.92200000000000004,"15min":0.96599999999999997},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.80800000000000005,"5min":5.5,"15min":5.5},"last":0.56699999999999995}]},{"osd":5,"last update":"Tue Nov 28 18:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":1.014,"15min":1.0700000000000001},"min":{"1min":0.58999999999999997,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.85999999999999999,"5min":5.4379999999999997,"15min":5.4379999999999997},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.75700000000000001,"5min":1.054,"15min":1.1040000000000001},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":0.91500000000000004,"5min":3.4500000000000002,"15min":3.4500000000000002},"last":0.71499999999999997}]},{"osd":6,"last update":"Tue Nov 28 18:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.99099999999999999,"15min":1.03},"min":{"1min":0.58799999999999997,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.0089999999999999,"5min":3.0369999999999999,"15min":3.0369999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":1.018,"15min":1.0669999999999999},"min":{"1min":0.59499999999999997,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":0.89700000000000002,"5min":5.4000000000000004,"15min":5.4000000000000004},"last":0.61899999999999999}]},{"osd":7,"last update":"Tue Nov 28 18:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.997,"15min":1.046},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.94599999999999995,"5min":5.5369999999999999,"15min":5.5369999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.78100000000000003,"5min":1.0429999999999999,"15min":1.087},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.96299999999999997,"5min":3.2480000000000002,"15min":3.2480000000000002},"last":0.752}]}]},{"osd":0,"up_from":13,"seq":55834574879,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32252,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339588,"statfs":{"total":96636764160,"available":96603738112,"internally_reserved":0,"allocated":1097728,"data_stored":792490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 18:39:23 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.40000000000000002,"15min":0.39800000000000002},"min":{"1min":0.27200000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.432},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.311}]},{"osd":2,"last update":"Tue Nov 28 18:39:23 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.48099999999999998,"15min":0.47899999999999998},"min":{"1min":0.35899999999999999,"5min":0.308,"15min":0.308},"max":{"1min":0.65400000000000003,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.498,"5min":0.502,"15min":0.502},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.66800000000000004,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.39300000000000002}]},{"osd":3,"last update":"Tue Nov 28 18:39:23 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.47899999999999998,"15min":0.47299999999999998},"min":{"1min":0.38100000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.70299999999999996,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.54500000000000004,"15min":0.54600000000000004},"min":{"1min":0.443,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.68100000000000005,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.40699999999999997}]},{"osd":4,"last update":"Tue Nov 28 18:39:23 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.74299999999999999,"15min":0.73899999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.75700000000000001,"15min":0.753},"min":{"1min":0.56999999999999995,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.63900000000000001}]},{"osd":5,"last update":"Tue Nov 28 18:39:23 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.74299999999999999,"15min":0.745},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.99299999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.628},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.72199999999999998,"15min":0.72399999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.97699999999999998,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.58099999999999996}]},{"osd":6,"last update":"Tue Nov 28 18:39:23 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.76400000000000001,"15min":0.76600000000000001},"min":{"1min":0.60499999999999998,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.93200000000000005,"5min":1,"15min":1},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.75900000000000001,"15min":0.76200000000000001},"min":{"1min":0.54400000000000004,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.95799999999999996,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.54600000000000004}]},{"osd":7,"last update":"Tue Nov 28 18:39:23 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.80700000000000005,"15min":0.81100000000000005},"min":{"1min":0.57799999999999996,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.0169999999999999,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.78500000000000003,"15min":0.79200000000000004},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.99099999999999999,"5min":1.079,"15min":1.079},"last":0.61499999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T18:39:41.155 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T18:39:41.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.329+0000 7f343991d640 1 Processor -- start 2023-11-28T18:39:41.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.329+0000 7f343991d640 1 -- start start 2023-11-28T18:39:41.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.329+0000 7f343991d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f34341608b0 0x7f34340d2b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:41.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.329+0000 7f343991d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f34340cdb60 0x7f34340b6270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:41.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.329+0000 7f343991d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f34340b51e0 0x7f34340b5650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:41.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.329+0000 7f343991d640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3434160c90 con 0x7f34340b51e0 2023-11-28T18:39:41.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.329+0000 7f343991d640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34340b5b90 con 0x7f34341608b0 2023-11-28T18:39:41.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.329+0000 7f343991d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34340d0db0 con 0x7f34340cdb60 2023-11-28T18:39:41.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.333+0000 7f34337fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f34340b51e0 0x7f34340b5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:41.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.333+0000 7f34337fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f34340b51e0 0x7f34340b5650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38240/0 (socket says 172.21.15.45:38240) 2023-11-28T18:39:41.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.333+0000 7f34337fe640 1 -- 172.21.15.45:0/193409235 learned_addr learned my addr 172.21.15.45:0/193409235 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:41.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.333+0000 7f3432ffd640 1 --2- 172.21.15.45:0/193409235 >> v2:172.21.15.190:3300/0 conn(0x7f34341608b0 0x7f34340d2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:41.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.333+0000 7f342bfff640 1 --2- 172.21.15.45:0/193409235 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f34340cdb60 0x7f34340b6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:41.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.333+0000 7f34337fe640 1 -- 172.21.15.45:0/193409235 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f34340cdb60 msgr2=0x7f34340b6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:41.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.333+0000 7f34337fe640 1 --2- 172.21.15.45:0/193409235 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f34340cdb60 0x7f34340b6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:41.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.333+0000 7f34337fe640 1 -- 172.21.15.45:0/193409235 >> v2:172.21.15.190:3300/0 conn(0x7f34341608b0 msgr2=0x7f34340d2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:41.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.333+0000 7f34337fe640 1 --2- 172.21.15.45:0/193409235 >> v2:172.21.15.190:3300/0 conn(0x7f34341608b0 0x7f34340d2b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:41.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.333+0000 7f34337fe640 1 -- 172.21.15.45:0/193409235 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34340ce320 con 0x7f34340b51e0 2023-11-28T18:39:41.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.333+0000 7f34337fe640 1 --2- 172.21.15.45:0/193409235 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f34340b51e0 0x7f34340b5650 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f34340b6100 tx=0x7f342c01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cad867ee5fc07700 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:41.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.333+0000 7f34327fc640 1 -- 172.21.15.45:0/193409235 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342c0a5740 con 0x7f34340b51e0 2023-11-28T18:39:41.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.333+0000 7f34327fc640 1 -- 172.21.15.45:0/193409235 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f342c0a58a0 con 0x7f34340b51e0 2023-11-28T18:39:41.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.333+0000 7f34327fc640 1 -- 172.21.15.45:0/193409235 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342c0a5c30 con 0x7f34340b51e0 2023-11-28T18:39:41.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.337+0000 7f343991d640 1 -- 172.21.15.45:0/193409235 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f34340b51e0 msgr2=0x7f34340b5650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:41.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.337+0000 7f343991d640 1 --2- 172.21.15.45:0/193409235 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f34340b51e0 0x7f34340b5650 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f34340b6100 tx=0x7f342c01c9d0 comp rx=0 tx=0).stop 2023-11-28T18:39:41.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.337+0000 7f343991d640 1 -- 172.21.15.45:0/193409235 shutdown_connections 2023-11-28T18:39:41.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.337+0000 7f343991d640 1 --2- 172.21.15.45:0/193409235 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f34340b51e0 0x7f34340b5650 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:41.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.337+0000 7f343991d640 1 --2- 172.21.15.45:0/193409235 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f34340cdb60 0x7f34340b6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:41.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.337+0000 7f343991d640 1 --2- 172.21.15.45:0/193409235 >> v2:172.21.15.190:3300/0 conn(0x7f34341608b0 0x7f34340d2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:41.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.337+0000 7f343991d640 1 -- 172.21.15.45:0/193409235 >> 172.21.15.45:0/193409235 conn(0x7f34340720a0 msgr2=0x7f34340724b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:41.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.337+0000 7f343991d640 1 -- 172.21.15.45:0/193409235 shutdown_connections 2023-11-28T18:39:41.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.337+0000 7f343991d640 1 -- 172.21.15.45:0/193409235 wait complete. 2023-11-28T18:39:41.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.337+0000 7f343991d640 1 Processor -- start 2023-11-28T18:39:41.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.337+0000 7f343991d640 1 -- start start 2023-11-28T18:39:41.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.337+0000 7f343991d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f34340b51e0 0x7f343415e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:41.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.337+0000 7f343991d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f34340cdb60 0x7f34340c7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:41.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.337+0000 7f343991d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f34341608b0 0x7f34340b2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:41.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.337+0000 7f343991d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f343415af00 con 0x7f34341608b0 2023-11-28T18:39:41.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.337+0000 7f343991d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f343414cc90 con 0x7f34340b51e0 2023-11-28T18:39:41.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.337+0000 7f343991d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f343415a8b0 con 0x7f34340cdb60 2023-11-28T18:39:41.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.337+0000 7f34337fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f34341608b0 0x7f34340b2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:41.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.337+0000 7f34337fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f34341608b0 0x7f34340b2ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38250/0 (socket says 172.21.15.45:38250) 2023-11-28T18:39:41.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.337+0000 7f34337fe640 1 -- 172.21.15.45:0/1340776285 learned_addr learned my addr 172.21.15.45:0/1340776285 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:41.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.337+0000 7f3432ffd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f34340b51e0 0x7f343415e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:41.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.337+0000 7f342bfff640 1 --2- 172.21.15.45:0/1340776285 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f34340cdb60 0x7f34340c7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:41.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.337+0000 7f34337fe640 1 -- 172.21.15.45:0/1340776285 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f34340cdb60 msgr2=0x7f34340c7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:41.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.337+0000 7f34337fe640 1 --2- 172.21.15.45:0/1340776285 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f34340cdb60 0x7f34340c7330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:41.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.337+0000 7f34337fe640 1 -- 172.21.15.45:0/1340776285 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f34340b51e0 msgr2=0x7f343415e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:41.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.337+0000 7f34337fe640 1 --2- 172.21.15.45:0/1340776285 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f34340b51e0 0x7f343415e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:41.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.337+0000 7f34337fe640 1 -- 172.21.15.45:0/1340776285 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f342c009b30 con 0x7f34341608b0 2023-11-28T18:39:41.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.337+0000 7f342bfff640 1 --2- 172.21.15.45:0/1340776285 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f34340cdb60 0x7f34340c7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:39:41.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.341+0000 7f34337fe640 1 --2- 172.21.15.45:0/1340776285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f34341608b0 0x7f34340b2ee0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f342c0af040 tx=0x7f342c019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:41.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.341+0000 7f3430ff9640 1 -- 172.21.15.45:0/1340776285 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342c0b8670 con 0x7f34341608b0 2023-11-28T18:39:41.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.341+0000 7f3430ff9640 1 -- 172.21.15.45:0/1340776285 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f342c0b87d0 con 0x7f34341608b0 2023-11-28T18:39:41.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.341+0000 7f3430ff9640 1 -- 172.21.15.45:0/1340776285 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342c0b8b80 con 0x7f34341608b0 2023-11-28T18:39:41.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.341+0000 7f343991d640 1 -- 172.21.15.45:0/1340776285 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f343415ab90 con 0x7f34341608b0 2023-11-28T18:39:41.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.341+0000 7f343991d640 1 -- 172.21.15.45:0/1340776285 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f343415a4d0 con 0x7f34341608b0 2023-11-28T18:39:41.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.341+0000 7f343991d640 1 -- 172.21.15.45:0/1340776285 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f343415ad20 con 0x7f34341608b0 2023-11-28T18:39:41.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.341+0000 7f3430ff9640 1 -- 172.21.15.45:0/1340776285 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f342c0b8ce0 con 0x7f34341608b0 2023-11-28T18:39:41.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.341+0000 7f3430ff9640 1 --2- 172.21.15.45:0/1340776285 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f3414066900 0x7f3414068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:41.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.341+0000 7f3430ff9640 1 -- 172.21.15.45:0/1340776285 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f342c11f870 con 0x7f34341608b0 2023-11-28T18:39:41.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.341+0000 7f3432ffd640 1 --2- 172.21.15.45:0/1340776285 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f3414066900 0x7f3414068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:41.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.345+0000 7f3432ffd640 1 --2- 172.21.15.45:0/1340776285 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f3414066900 0x7f3414068dc0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f3424009ac0 tx=0x7f3424009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:41.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.345+0000 7f3430ff9640 1 -- 172.21.15.45:0/1340776285 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f342c0ecbf0 con 0x7f34341608b0 2023-11-28T18:39:41.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.501+0000 7f343991d640 1 -- 172.21.15.45:0/1340776285 --> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f34340b67b0 con 0x7f3414066900 2023-11-28T18:39:41.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.509+0000 7f3430ff9640 1 -- 172.21.15.45:0/1340776285 <== mgr.4100 v2:172.21.15.190:6832/645101166 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289325 (secure 0 0 0) 0x7f34240119e0 con 0x7f3414066900 2023-11-28T18:39:41.515 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:39:41.517 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-11-28T18:39:41.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.513+0000 7f343991d640 1 -- 172.21.15.45:0/1340776285 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f3414066900 msgr2=0x7f3414068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:41.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.513+0000 7f343991d640 1 --2- 172.21.15.45:0/1340776285 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f3414066900 0x7f3414068dc0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f3424009ac0 tx=0x7f3424009190 comp rx=0 tx=0).stop 2023-11-28T18:39:41.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.513+0000 7f343991d640 1 -- 172.21.15.45:0/1340776285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f34341608b0 msgr2=0x7f34340b2ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:41.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.513+0000 7f343991d640 1 --2- 172.21.15.45:0/1340776285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f34341608b0 0x7f34340b2ee0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f342c0af040 tx=0x7f342c019770 comp rx=0 tx=0).stop 2023-11-28T18:39:41.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.513+0000 7f343991d640 1 -- 172.21.15.45:0/1340776285 shutdown_connections 2023-11-28T18:39:41.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.513+0000 7f343991d640 1 --2- 172.21.15.45:0/1340776285 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f3414066900 0x7f3414068dc0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:41.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.513+0000 7f343991d640 1 --2- 172.21.15.45:0/1340776285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f34341608b0 0x7f34340b2ee0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:41.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.513+0000 7f343991d640 1 --2- 172.21.15.45:0/1340776285 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f34340cdb60 0x7f34340c7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:41.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.513+0000 7f343991d640 1 --2- 172.21.15.45:0/1340776285 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f34340b51e0 0x7f343415e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:41.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.513+0000 7f343991d640 1 -- 172.21.15.45:0/1340776285 >> 172.21.15.45:0/1340776285 conn(0x7f34340720a0 msgr2=0x7f34340b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:41.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.513+0000 7f343991d640 1 -- 172.21.15.45:0/1340776285 shutdown_connections 2023-11-28T18:39:41.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.513+0000 7f343991d640 1 -- 172.21.15.45:0/1340776285 wait complete. 2023-11-28T18:39:41.536 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":110,"stamp":"2023-11-28T18:39:41.263286+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":156,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":246604,"kb_used_data":5448,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754728116,"statfs":{"total":773094113280,"available":772841590784,"internally_reserved":0,"allocated":5578752,"data_stored":2957268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":246795825},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001235"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T18:39:38.053454+0000","last_change":"2023-11-28T18:39:37.050278+0000","last_active":"2023-11-28T18:39:38.053454+0000","last_peered":"2023-11-28T18:39:38.053454+0000","last_clean":"2023-11-28T18:39:38.053454+0000","last_became_active":"2023-11-28T18:39:37.049410+0000","last_became_peered":"2023-11-28T18:39:37.049410+0000","last_unstale":"2023-11-28T18:39:38.053454+0000","last_undegraded":"2023-11-28T18:39:38.053454+0000","last_fullsized":"2023-11-28T18:39:38.053454+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:03:37.982845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T18:39:38.054319+0000","last_change":"2023-11-28T18:39:37.059009+0000","last_active":"2023-11-28T18:39:38.054319+0000","last_peered":"2023-11-28T18:39:38.054319+0000","last_clean":"2023-11-28T18:39:38.054319+0000","last_became_active":"2023-11-28T18:39:37.058753+0000","last_became_peered":"2023-11-28T18:39:37.058753+0000","last_unstale":"2023-11-28T18:39:38.054319+0000","last_undegraded":"2023-11-28T18:39:38.054319+0000","last_fullsized":"2023-11-28T18:39:38.054319+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:35:30.517631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T18:39:38.198309+0000","last_change":"2023-11-28T18:39:37.042647+0000","last_active":"2023-11-28T18:39:38.198309+0000","last_peered":"2023-11-28T18:39:38.198309+0000","last_clean":"2023-11-28T18:39:38.198309+0000","last_became_active":"2023-11-28T18:39:37.042324+0000","last_became_peered":"2023-11-28T18:39:37.042324+0000","last_unstale":"2023-11-28T18:39:38.198309+0000","last_undegraded":"2023-11-28T18:39:38.198309+0000","last_fullsized":"2023-11-28T18:39:38.198309+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:23:32.885836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T18:39:38.197942+0000","last_change":"2023-11-28T18:39:37.053687+0000","last_active":"2023-11-28T18:39:38.197942+0000","last_peered":"2023-11-28T18:39:38.197942+0000","last_clean":"2023-11-28T18:39:38.197942+0000","last_became_active":"2023-11-28T18:39:37.053382+0000","last_became_peered":"2023-11-28T18:39:37.053382+0000","last_unstale":"2023-11-28T18:39:38.197942+0000","last_undegraded":"2023-11-28T18:39:38.197942+0000","last_fullsized":"2023-11-28T18:39:38.197942+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:00:54.561236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T18:39:38.054067+0000","last_change":"2023-11-28T18:39:37.055305+0000","last_active":"2023-11-28T18:39:38.054067+0000","last_peered":"2023-11-28T18:39:38.054067+0000","last_clean":"2023-11-28T18:39:38.054067+0000","last_became_active":"2023-11-28T18:39:37.055055+0000","last_became_peered":"2023-11-28T18:39:37.055055+0000","last_unstale":"2023-11-28T18:39:38.054067+0000","last_undegraded":"2023-11-28T18:39:38.054067+0000","last_fullsized":"2023-11-28T18:39:38.054067+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:01:42.894438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T18:39:38.198257+0000","last_change":"2023-11-28T18:39:37.045825+0000","last_active":"2023-11-28T18:39:38.198257+0000","last_peered":"2023-11-28T18:39:38.198257+0000","last_clean":"2023-11-28T18:39:38.198257+0000","last_became_active":"2023-11-28T18:39:37.045528+0000","last_became_peered":"2023-11-28T18:39:37.045528+0000","last_unstale":"2023-11-28T18:39:38.198257+0000","last_undegraded":"2023-11-28T18:39:38.198257+0000","last_fullsized":"2023-11-28T18:39:38.198257+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:29:08.557475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T18:39:38.053895+0000","last_change":"2023-11-28T18:39:37.056225+0000","last_active":"2023-11-28T18:39:38.053895+0000","last_peered":"2023-11-28T18:39:38.053895+0000","last_clean":"2023-11-28T18:39:38.053895+0000","last_became_active":"2023-11-28T18:39:37.055905+0000","last_became_peered":"2023-11-28T18:39:37.055905+0000","last_unstale":"2023-11-28T18:39:38.053895+0000","last_undegraded":"2023-11-28T18:39:38.053895+0000","last_fullsized":"2023-11-28T18:39:38.053895+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:55:16.924157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T18:39:38.197460+0000","last_change":"2023-11-28T18:39:37.054348+0000","last_active":"2023-11-28T18:39:38.197460+0000","last_peered":"2023-11-28T18:39:38.197460+0000","last_clean":"2023-11-28T18:39:38.197460+0000","last_became_active":"2023-11-28T18:39:37.053873+0000","last_became_peered":"2023-11-28T18:39:37.053873+0000","last_unstale":"2023-11-28T18:39:38.197460+0000","last_undegraded":"2023-11-28T18:39:38.197460+0000","last_fullsized":"2023-11-28T18:39:38.197460+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:38:44.085307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T18:39:38.197820+0000","last_change":"2023-11-28T18:39:37.058938+0000","last_active":"2023-11-28T18:39:38.197820+0000","last_peered":"2023-11-28T18:39:38.197820+0000","last_clean":"2023-11-28T18:39:38.197820+0000","last_became_active":"2023-11-28T18:39:37.058598+0000","last_became_peered":"2023-11-28T18:39:37.058598+0000","last_unstale":"2023-11-28T18:39:38.197820+0000","last_undegraded":"2023-11-28T18:39:38.197820+0000","last_fullsized":"2023-11-28T18:39:38.197820+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:05:06.478533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T18:39:38.198387+0000","last_change":"2023-11-28T18:39:37.055756+0000","last_active":"2023-11-28T18:39:38.198387+0000","last_peered":"2023-11-28T18:39:38.198387+0000","last_clean":"2023-11-28T18:39:38.198387+0000","last_became_active":"2023-11-28T18:39:37.055257+0000","last_became_peered":"2023-11-28T18:39:37.055257+0000","last_unstale":"2023-11-28T18:39:38.198387+0000","last_undegraded":"2023-11-28T18:39:38.198387+0000","last_fullsized":"2023-11-28T18:39:38.198387+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:45:01.572949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T18:39:38.198749+0000","last_change":"2023-11-28T18:39:37.058293+0000","last_active":"2023-11-28T18:39:38.198749+0000","last_peered":"2023-11-28T18:39:38.198749+0000","last_clean":"2023-11-28T18:39:38.198749+0000","last_became_active":"2023-11-28T18:39:37.057993+0000","last_became_peered":"2023-11-28T18:39:37.057993+0000","last_unstale":"2023-11-28T18:39:38.198749+0000","last_undegraded":"2023-11-28T18:39:38.198749+0000","last_fullsized":"2023-11-28T18:39:38.198749+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:11:37.606932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T18:39:38.054176+0000","last_change":"2023-11-28T18:39:37.043338+0000","last_active":"2023-11-28T18:39:38.054176+0000","last_peered":"2023-11-28T18:39:38.054176+0000","last_clean":"2023-11-28T18:39:38.054176+0000","last_became_active":"2023-11-28T18:39:37.043113+0000","last_became_peered":"2023-11-28T18:39:37.043113+0000","last_unstale":"2023-11-28T18:39:38.054176+0000","last_undegraded":"2023-11-28T18:39:38.054176+0000","last_fullsized":"2023-11-28T18:39:38.054176+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:45:01.572949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T18:39:38.198135+0000","last_change":"2023-11-28T18:39:37.043248+0000","last_active":"2023-11-28T18:39:38.198135+0000","last_peered":"2023-11-28T18:39:38.198135+0000","last_clean":"2023-11-28T18:39:38.198135+0000","last_became_active":"2023-11-28T18:39:37.042917+0000","last_became_peered":"2023-11-28T18:39:37.042917+0000","last_unstale":"2023-11-28T18:39:38.198135+0000","last_undegraded":"2023-11-28T18:39:38.198135+0000","last_fullsized":"2023-11-28T18:39:38.198135+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:49:30.733533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T18:39:38.197328+0000","last_change":"2023-11-28T18:39:37.067129+0000","last_active":"2023-11-28T18:39:38.197328+0000","last_peered":"2023-11-28T18:39:38.197328+0000","last_clean":"2023-11-28T18:39:38.197328+0000","last_became_active":"2023-11-28T18:39:37.060158+0000","last_became_peered":"2023-11-28T18:39:37.060158+0000","last_unstale":"2023-11-28T18:39:38.197328+0000","last_undegraded":"2023-11-28T18:39:38.197328+0000","last_fullsized":"2023-11-28T18:39:38.197328+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:54:54.980924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T18:39:38.197929+0000","last_change":"2023-11-28T18:39:37.042164+0000","last_active":"2023-11-28T18:39:38.197929+0000","last_peered":"2023-11-28T18:39:38.197929+0000","last_clean":"2023-11-28T18:39:38.197929+0000","last_became_active":"2023-11-28T18:39:37.041867+0000","last_became_peered":"2023-11-28T18:39:37.041867+0000","last_unstale":"2023-11-28T18:39:38.197929+0000","last_undegraded":"2023-11-28T18:39:38.197929+0000","last_fullsized":"2023-11-28T18:39:38.197929+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:12:13.512949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T18:39:38.198213+0000","last_change":"2023-11-28T18:39:37.061332+0000","last_active":"2023-11-28T18:39:38.198213+0000","last_peered":"2023-11-28T18:39:38.198213+0000","last_clean":"2023-11-28T18:39:38.198213+0000","last_became_active":"2023-11-28T18:39:37.061005+0000","last_became_peered":"2023-11-28T18:39:37.061005+0000","last_unstale":"2023-11-28T18:39:38.198213+0000","last_undegraded":"2023-11-28T18:39:38.198213+0000","last_fullsized":"2023-11-28T18:39:38.198213+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:28:20.199213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T18:39:38.199015+0000","last_change":"2023-11-28T18:39:37.039607+0000","last_active":"2023-11-28T18:39:38.199015+0000","last_peered":"2023-11-28T18:39:38.199015+0000","last_clean":"2023-11-28T18:39:38.199015+0000","last_became_active":"2023-11-28T18:39:37.039301+0000","last_became_peered":"2023-11-28T18:39:37.039301+0000","last_unstale":"2023-11-28T18:39:38.199015+0000","last_undegraded":"2023-11-28T18:39:38.199015+0000","last_fullsized":"2023-11-28T18:39:38.199015+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:54:54.980924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T18:39:38.198511+0000","last_change":"2023-11-28T18:39:37.060852+0000","last_active":"2023-11-28T18:39:38.198511+0000","last_peered":"2023-11-28T18:39:38.198511+0000","last_clean":"2023-11-28T18:39:38.198511+0000","last_became_active":"2023-11-28T18:39:37.060433+0000","last_became_peered":"2023-11-28T18:39:37.060433+0000","last_unstale":"2023-11-28T18:39:38.198511+0000","last_undegraded":"2023-11-28T18:39:38.198511+0000","last_fullsized":"2023-11-28T18:39:38.198511+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:24:56.852168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T18:39:38.198918+0000","last_change":"2023-11-28T18:39:37.059174+0000","last_active":"2023-11-28T18:39:38.198918+0000","last_peered":"2023-11-28T18:39:38.198918+0000","last_clean":"2023-11-28T18:39:38.198918+0000","last_became_active":"2023-11-28T18:39:37.058878+0000","last_became_peered":"2023-11-28T18:39:37.058878+0000","last_unstale":"2023-11-28T18:39:38.198918+0000","last_undegraded":"2023-11-28T18:39:38.198918+0000","last_fullsized":"2023-11-28T18:39:38.198918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:37:58.255992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T18:39:38.198520+0000","last_change":"2023-11-28T18:39:37.055406+0000","last_active":"2023-11-28T18:39:38.198520+0000","last_peered":"2023-11-28T18:39:38.198520+0000","last_clean":"2023-11-28T18:39:38.198520+0000","last_became_active":"2023-11-28T18:39:37.055070+0000","last_became_peered":"2023-11-28T18:39:37.055070+0000","last_unstale":"2023-11-28T18:39:38.198520+0000","last_undegraded":"2023-11-28T18:39:38.198520+0000","last_fullsized":"2023-11-28T18:39:38.198520+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:56:25.922500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T18:39:38.197719+0000","last_change":"2023-11-28T18:39:37.052937+0000","last_active":"2023-11-28T18:39:38.197719+0000","last_peered":"2023-11-28T18:39:38.197719+0000","last_clean":"2023-11-28T18:39:38.197719+0000","last_became_active":"2023-11-28T18:39:37.052655+0000","last_became_peered":"2023-11-28T18:39:37.052655+0000","last_unstale":"2023-11-28T18:39:38.197719+0000","last_undegraded":"2023-11-28T18:39:38.197719+0000","last_fullsized":"2023-11-28T18:39:38.197719+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:06:26.095584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T18:39:38.197452+0000","last_change":"2023-11-28T18:39:37.062611+0000","last_active":"2023-11-28T18:39:38.197452+0000","last_peered":"2023-11-28T18:39:38.197452+0000","last_clean":"2023-11-28T18:39:38.197452+0000","last_became_active":"2023-11-28T18:39:37.059806+0000","last_became_peered":"2023-11-28T18:39:37.059806+0000","last_unstale":"2023-11-28T18:39:38.197452+0000","last_undegraded":"2023-11-28T18:39:38.197452+0000","last_fullsized":"2023-11-28T18:39:38.197452+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:27:05.754564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T18:39:38.198300+0000","last_change":"2023-11-28T18:39:37.047802+0000","last_active":"2023-11-28T18:39:38.198300+0000","last_peered":"2023-11-28T18:39:38.198300+0000","last_clean":"2023-11-28T18:39:38.198300+0000","last_became_active":"2023-11-28T18:39:37.047476+0000","last_became_peered":"2023-11-28T18:39:37.047476+0000","last_unstale":"2023-11-28T18:39:38.198300+0000","last_undegraded":"2023-11-28T18:39:38.198300+0000","last_fullsized":"2023-11-28T18:39:38.198300+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:42:32.526163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T18:39:38.198351+0000","last_change":"2023-11-28T18:39:37.052190+0000","last_active":"2023-11-28T18:39:38.198351+0000","last_peered":"2023-11-28T18:39:38.198351+0000","last_clean":"2023-11-28T18:39:38.198351+0000","last_became_active":"2023-11-28T18:39:37.051754+0000","last_became_peered":"2023-11-28T18:39:37.051754+0000","last_unstale":"2023-11-28T18:39:38.198351+0000","last_undegraded":"2023-11-28T18:39:38.198351+0000","last_fullsized":"2023-11-28T18:39:38.198351+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:57:23.144395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T18:39:38.198804+0000","last_change":"2023-11-28T18:39:37.060491+0000","last_active":"2023-11-28T18:39:38.198804+0000","last_peered":"2023-11-28T18:39:38.198804+0000","last_clean":"2023-11-28T18:39:38.198804+0000","last_became_active":"2023-11-28T18:39:37.060245+0000","last_became_peered":"2023-11-28T18:39:37.060245+0000","last_unstale":"2023-11-28T18:39:38.198804+0000","last_undegraded":"2023-11-28T18:39:38.198804+0000","last_fullsized":"2023-11-28T18:39:38.198804+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:01:29.456434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T18:39:38.197746+0000","last_change":"2023-11-28T18:39:37.041544+0000","last_active":"2023-11-28T18:39:38.197746+0000","last_peered":"2023-11-28T18:39:38.197746+0000","last_clean":"2023-11-28T18:39:38.197746+0000","last_became_active":"2023-11-28T18:39:37.041218+0000","last_became_peered":"2023-11-28T18:39:37.041218+0000","last_unstale":"2023-11-28T18:39:38.197746+0000","last_undegraded":"2023-11-28T18:39:38.197746+0000","last_fullsized":"2023-11-28T18:39:38.197746+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:23:43.032792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T18:39:38.198469+0000","last_change":"2023-11-28T18:39:37.040825+0000","last_active":"2023-11-28T18:39:38.198469+0000","last_peered":"2023-11-28T18:39:38.198469+0000","last_clean":"2023-11-28T18:39:38.198469+0000","last_became_active":"2023-11-28T18:39:37.038340+0000","last_became_peered":"2023-11-28T18:39:37.038340+0000","last_unstale":"2023-11-28T18:39:38.198469+0000","last_undegraded":"2023-11-28T18:39:38.198469+0000","last_fullsized":"2023-11-28T18:39:38.198469+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:32:00.518209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T18:39:38.054322+0000","last_change":"2023-11-28T18:39:37.039607+0000","last_active":"2023-11-28T18:39:38.054322+0000","last_peered":"2023-11-28T18:39:38.054322+0000","last_clean":"2023-11-28T18:39:38.054322+0000","last_became_active":"2023-11-28T18:39:37.038878+0000","last_became_peered":"2023-11-28T18:39:37.038878+0000","last_unstale":"2023-11-28T18:39:38.054322+0000","last_undegraded":"2023-11-28T18:39:38.054322+0000","last_fullsized":"2023-11-28T18:39:38.054322+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:48:46.613706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T18:39:38.198481+0000","last_change":"2023-11-28T18:39:37.062750+0000","last_active":"2023-11-28T18:39:38.198481+0000","last_peered":"2023-11-28T18:39:38.198481+0000","last_clean":"2023-11-28T18:39:38.198481+0000","last_became_active":"2023-11-28T18:39:37.062451+0000","last_became_peered":"2023-11-28T18:39:37.062451+0000","last_unstale":"2023-11-28T18:39:38.198481+0000","last_undegraded":"2023-11-28T18:39:38.198481+0000","last_fullsized":"2023-11-28T18:39:38.198481+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:56:20.563921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T18:39:38.198376+0000","last_change":"2023-11-28T18:39:37.046194+0000","last_active":"2023-11-28T18:39:38.198376+0000","last_peered":"2023-11-28T18:39:38.198376+0000","last_clean":"2023-11-28T18:39:38.198376+0000","last_became_active":"2023-11-28T18:39:37.045876+0000","last_became_peered":"2023-11-28T18:39:37.045876+0000","last_unstale":"2023-11-28T18:39:38.198376+0000","last_undegraded":"2023-11-28T18:39:38.198376+0000","last_fullsized":"2023-11-28T18:39:38.198376+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:27:25.445602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T18:39:38.198061+0000","last_change":"2023-11-28T18:39:37.046441+0000","last_active":"2023-11-28T18:39:38.198061+0000","last_peered":"2023-11-28T18:39:38.198061+0000","last_clean":"2023-11-28T18:39:38.198061+0000","last_became_active":"2023-11-28T18:39:37.046168+0000","last_became_peered":"2023-11-28T18:39:37.046168+0000","last_unstale":"2023-11-28T18:39:38.198061+0000","last_undegraded":"2023-11-28T18:39:38.198061+0000","last_fullsized":"2023-11-28T18:39:38.198061+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:04:48.330518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T18:39:38.197257+0000","last_change":"2023-11-28T18:39:37.046662+0000","last_active":"2023-11-28T18:39:38.197257+0000","last_peered":"2023-11-28T18:39:38.197257+0000","last_clean":"2023-11-28T18:39:38.197257+0000","last_became_active":"2023-11-28T18:39:37.046361+0000","last_became_peered":"2023-11-28T18:39:37.046361+0000","last_unstale":"2023-11-28T18:39:38.197257+0000","last_undegraded":"2023-11-28T18:39:38.197257+0000","last_fullsized":"2023-11-28T18:39:38.197257+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:36:12.436984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T18:39:38.048471+0000","last_change":"2023-11-28T18:39:37.049561+0000","last_active":"2023-11-28T18:39:38.048471+0000","last_peered":"2023-11-28T18:39:38.048471+0000","last_clean":"2023-11-28T18:39:38.048471+0000","last_became_active":"2023-11-28T18:39:37.048757+0000","last_became_peered":"2023-11-28T18:39:37.048757+0000","last_unstale":"2023-11-28T18:39:38.048471+0000","last_undegraded":"2023-11-28T18:39:38.048471+0000","last_fullsized":"2023-11-28T18:39:38.048471+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:37:58.255992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"45'4","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-28T18:39:37.077082+0000","last_change":"2023-11-28T18:39:36.051919+0000","last_active":"2023-11-28T18:39:37.077082+0000","last_peered":"2023-11-28T18:39:37.077082+0000","last_clean":"2023-11-28T18:39:37.077082+0000","last_became_active":"2023-11-28T18:39:36.051657+0000","last_became_peered":"2023-11-28T18:39:36.051657+0000","last_unstale":"2023-11-28T18:39:37.077082+0000","last_undegraded":"2023-11-28T18:39:37.077082+0000","last_fullsized":"2023-11-28T18:39:37.077082+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_clean_scrub_stamp":"2023-11-28T18:39:35.017177+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:55:15.920274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T18:39:38.198945+0000","last_change":"2023-11-28T18:39:37.051802+0000","last_active":"2023-11-28T18:39:38.198945+0000","last_peered":"2023-11-28T18:39:38.198945+0000","last_clean":"2023-11-28T18:39:38.198945+0000","last_became_active":"2023-11-28T18:39:37.051459+0000","last_became_peered":"2023-11-28T18:39:37.051459+0000","last_unstale":"2023-11-28T18:39:38.198945+0000","last_undegraded":"2023-11-28T18:39:38.198945+0000","last_fullsized":"2023-11-28T18:39:38.198945+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:35:23.260427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"45'1","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-28T18:39:37.065395+0000","last_change":"2023-11-28T18:39:36.053896+0000","last_active":"2023-11-28T18:39:37.065395+0000","last_peered":"2023-11-28T18:39:37.065395+0000","last_clean":"2023-11-28T18:39:37.065395+0000","last_became_active":"2023-11-28T18:39:36.053644+0000","last_became_peered":"2023-11-28T18:39:36.053644+0000","last_unstale":"2023-11-28T18:39:37.065395+0000","last_undegraded":"2023-11-28T18:39:37.065395+0000","last_fullsized":"2023-11-28T18:39:37.065395+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_clean_scrub_stamp":"2023-11-28T18:39:35.017177+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:34:38.170614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T18:39:38.054323+0000","last_change":"2023-11-28T18:39:37.050291+0000","last_active":"2023-11-28T18:39:38.054323+0000","last_peered":"2023-11-28T18:39:38.054323+0000","last_clean":"2023-11-28T18:39:38.054323+0000","last_became_active":"2023-11-28T18:39:37.049981+0000","last_became_peered":"2023-11-28T18:39:37.049981+0000","last_unstale":"2023-11-28T18:39:38.054323+0000","last_undegraded":"2023-11-28T18:39:38.054323+0000","last_fullsized":"2023-11-28T18:39:38.054323+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:11:37.606932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"45'2","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-28T18:39:37.071242+0000","last_change":"2023-11-28T18:39:36.052375+0000","last_active":"2023-11-28T18:39:37.071242+0000","last_peered":"2023-11-28T18:39:37.071242+0000","last_clean":"2023-11-28T18:39:37.071242+0000","last_became_active":"2023-11-28T18:39:36.052096+0000","last_became_peered":"2023-11-28T18:39:36.052096+0000","last_unstale":"2023-11-28T18:39:37.071242+0000","last_undegraded":"2023-11-28T18:39:37.071242+0000","last_fullsized":"2023-11-28T18:39:37.071242+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_clean_scrub_stamp":"2023-11-28T18:39:35.017177+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:24:36.006600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T18:39:38.048427+0000","last_change":"2023-11-28T18:39:37.053480+0000","last_active":"2023-11-28T18:39:38.048427+0000","last_peered":"2023-11-28T18:39:38.048427+0000","last_clean":"2023-11-28T18:39:38.048427+0000","last_became_active":"2023-11-28T18:39:37.053219+0000","last_became_peered":"2023-11-28T18:39:37.053219+0000","last_unstale":"2023-11-28T18:39:38.048427+0000","last_undegraded":"2023-11-28T18:39:38.048427+0000","last_fullsized":"2023-11-28T18:39:38.048427+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:01:29.456434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"45'2","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-28T18:39:37.064457+0000","last_change":"2023-11-28T18:39:36.045335+0000","last_active":"2023-11-28T18:39:37.064457+0000","last_peered":"2023-11-28T18:39:37.064457+0000","last_clean":"2023-11-28T18:39:37.064457+0000","last_became_active":"2023-11-28T18:39:36.044008+0000","last_became_peered":"2023-11-28T18:39:36.044008+0000","last_unstale":"2023-11-28T18:39:37.064457+0000","last_undegraded":"2023-11-28T18:39:37.064457+0000","last_fullsized":"2023-11-28T18:39:37.064457+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_clean_scrub_stamp":"2023-11-28T18:39:35.017177+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:52:19.415190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T18:39:38.198533+0000","last_change":"2023-11-28T18:39:37.051287+0000","last_active":"2023-11-28T18:39:38.198533+0000","last_peered":"2023-11-28T18:39:38.198533+0000","last_clean":"2023-11-28T18:39:38.198533+0000","last_became_active":"2023-11-28T18:39:37.050991+0000","last_became_peered":"2023-11-28T18:39:37.050991+0000","last_unstale":"2023-11-28T18:39:38.198533+0000","last_undegraded":"2023-11-28T18:39:38.198533+0000","last_fullsized":"2023-11-28T18:39:38.198533+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:36:14.063484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"45'1","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-28T18:39:37.076270+0000","last_change":"2023-11-28T18:39:36.050282+0000","last_active":"2023-11-28T18:39:37.076270+0000","last_peered":"2023-11-28T18:39:37.076270+0000","last_clean":"2023-11-28T18:39:37.076270+0000","last_became_active":"2023-11-28T18:39:36.049982+0000","last_became_peered":"2023-11-28T18:39:36.049982+0000","last_unstale":"2023-11-28T18:39:37.076270+0000","last_undegraded":"2023-11-28T18:39:37.076270+0000","last_fullsized":"2023-11-28T18:39:37.076270+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_clean_scrub_stamp":"2023-11-28T18:39:35.017177+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:35:29.513749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T18:39:38.197236+0000","last_change":"2023-11-28T18:39:37.063369+0000","last_active":"2023-11-28T18:39:38.197236+0000","last_peered":"2023-11-28T18:39:38.197236+0000","last_clean":"2023-11-28T18:39:38.197236+0000","last_became_active":"2023-11-28T18:39:37.063049+0000","last_became_peered":"2023-11-28T18:39:37.063049+0000","last_unstale":"2023-11-28T18:39:38.197236+0000","last_undegraded":"2023-11-28T18:39:38.197236+0000","last_fullsized":"2023-11-28T18:39:38.197236+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:36:14.063484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"45'1","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-28T18:39:37.064847+0000","last_change":"2023-11-28T18:39:36.045067+0000","last_active":"2023-11-28T18:39:37.064847+0000","last_peered":"2023-11-28T18:39:37.064847+0000","last_clean":"2023-11-28T18:39:37.064847+0000","last_became_active":"2023-11-28T18:39:36.043690+0000","last_became_peered":"2023-11-28T18:39:36.043690+0000","last_unstale":"2023-11-28T18:39:37.064847+0000","last_undegraded":"2023-11-28T18:39:37.064847+0000","last_fullsized":"2023-11-28T18:39:37.064847+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_clean_scrub_stamp":"2023-11-28T18:39:35.017177+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:42:31.522281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T18:39:38.197201+0000","last_change":"2023-11-28T18:39:37.054174+0000","last_active":"2023-11-28T18:39:38.197201+0000","last_peered":"2023-11-28T18:39:38.197201+0000","last_clean":"2023-11-28T18:39:38.197201+0000","last_became_active":"2023-11-28T18:39:37.053579+0000","last_became_peered":"2023-11-28T18:39:37.053579+0000","last_unstale":"2023-11-28T18:39:38.197201+0000","last_undegraded":"2023-11-28T18:39:38.197201+0000","last_fullsized":"2023-11-28T18:39:38.197201+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:24:56.852168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-28T18:39:37.032000+0000","last_change":"2023-11-28T18:39:36.053025+0000","last_active":"2023-11-28T18:39:37.032000+0000","last_peered":"2023-11-28T18:39:37.032000+0000","last_clean":"2023-11-28T18:39:37.032000+0000","last_became_active":"2023-11-28T18:39:36.052503+0000","last_became_peered":"2023-11-28T18:39:36.052503+0000","last_unstale":"2023-11-28T18:39:37.032000+0000","last_undegraded":"2023-11-28T18:39:37.032000+0000","last_fullsized":"2023-11-28T18:39:37.032000+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_clean_scrub_stamp":"2023-11-28T18:39:35.017177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:38:43.081424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T18:39:38.198513+0000","last_change":"2023-11-28T18:39:37.051165+0000","last_active":"2023-11-28T18:39:38.198513+0000","last_peered":"2023-11-28T18:39:38.198513+0000","last_clean":"2023-11-28T18:39:38.198513+0000","last_became_active":"2023-11-28T18:39:37.050868+0000","last_became_peered":"2023-11-28T18:39:37.050868+0000","last_unstale":"2023-11-28T18:39:38.198513+0000","last_undegraded":"2023-11-28T18:39:38.198513+0000","last_fullsized":"2023-11-28T18:39:38.198513+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:31:36.396972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-28T18:39:37.035468+0000","last_change":"2023-11-28T18:39:36.054917+0000","last_active":"2023-11-28T18:39:37.035468+0000","last_peered":"2023-11-28T18:39:37.035468+0000","last_clean":"2023-11-28T18:39:37.035468+0000","last_became_active":"2023-11-28T18:39:36.054678+0000","last_became_peered":"2023-11-28T18:39:36.054678+0000","last_unstale":"2023-11-28T18:39:37.035468+0000","last_undegraded":"2023-11-28T18:39:37.035468+0000","last_fullsized":"2023-11-28T18:39:37.035468+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_clean_scrub_stamp":"2023-11-28T18:39:35.017177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:56:19.560039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T18:39:38.198651+0000","last_change":"2023-11-28T18:39:37.060685+0000","last_active":"2023-11-28T18:39:38.198651+0000","last_peered":"2023-11-28T18:39:38.198651+0000","last_clean":"2023-11-28T18:39:38.198651+0000","last_became_active":"2023-11-28T18:39:37.060131+0000","last_became_peered":"2023-11-28T18:39:37.060131+0000","last_unstale":"2023-11-28T18:39:38.198651+0000","last_undegraded":"2023-11-28T18:39:38.198651+0000","last_fullsized":"2023-11-28T18:39:38.198651+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:15:26.568176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-28T18:39:37.031920+0000","last_change":"2023-11-28T18:39:36.056339+0000","last_active":"2023-11-28T18:39:37.031920+0000","last_peered":"2023-11-28T18:39:37.031920+0000","last_clean":"2023-11-28T18:39:37.031920+0000","last_became_active":"2023-11-28T18:39:36.055809+0000","last_became_peered":"2023-11-28T18:39:36.055809+0000","last_unstale":"2023-11-28T18:39:37.031920+0000","last_undegraded":"2023-11-28T18:39:37.031920+0000","last_fullsized":"2023-11-28T18:39:37.031920+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_clean_scrub_stamp":"2023-11-28T18:39:35.017177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:01:28.452551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T18:39:38.054230+0000","last_change":"2023-11-28T18:39:37.053142+0000","last_active":"2023-11-28T18:39:38.054230+0000","last_peered":"2023-11-28T18:39:38.054230+0000","last_clean":"2023-11-28T18:39:38.054230+0000","last_became_active":"2023-11-28T18:39:37.052389+0000","last_became_peered":"2023-11-28T18:39:37.052389+0000","last_unstale":"2023-11-28T18:39:38.054230+0000","last_undegraded":"2023-11-28T18:39:38.054230+0000","last_fullsized":"2023-11-28T18:39:38.054230+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:50:20.077574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-28T18:39:37.039511+0000","last_change":"2023-11-28T18:39:36.052233+0000","last_active":"2023-11-28T18:39:37.039511+0000","last_peered":"2023-11-28T18:39:37.039511+0000","last_clean":"2023-11-28T18:39:37.039511+0000","last_became_active":"2023-11-28T18:39:36.051982+0000","last_became_peered":"2023-11-28T18:39:36.051982+0000","last_unstale":"2023-11-28T18:39:37.039511+0000","last_undegraded":"2023-11-28T18:39:37.039511+0000","last_fullsized":"2023-11-28T18:39:37.039511+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_clean_scrub_stamp":"2023-11-28T18:39:35.017177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:23:31.881954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T18:39:38.197696+0000","last_change":"2023-11-28T18:39:37.057570+0000","last_active":"2023-11-28T18:39:38.197696+0000","last_peered":"2023-11-28T18:39:38.197696+0000","last_clean":"2023-11-28T18:39:38.197696+0000","last_became_active":"2023-11-28T18:39:37.057164+0000","last_became_peered":"2023-11-28T18:39:37.057164+0000","last_unstale":"2023-11-28T18:39:38.197696+0000","last_undegraded":"2023-11-28T18:39:38.197696+0000","last_fullsized":"2023-11-28T18:39:38.197696+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:50:20.077574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"45'3","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-28T18:39:37.067709+0000","last_change":"2023-11-28T18:39:36.052821+0000","last_active":"2023-11-28T18:39:37.067709+0000","last_peered":"2023-11-28T18:39:37.067709+0000","last_clean":"2023-11-28T18:39:37.067709+0000","last_became_active":"2023-11-28T18:39:36.052491+0000","last_became_peered":"2023-11-28T18:39:36.052491+0000","last_unstale":"2023-11-28T18:39:37.067709+0000","last_undegraded":"2023-11-28T18:39:37.067709+0000","last_fullsized":"2023-11-28T18:39:37.067709+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_clean_scrub_stamp":"2023-11-28T18:39:35.017177+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:01:41.890556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T18:39:38.054024+0000","last_change":"2023-11-28T18:39:37.061685+0000","last_active":"2023-11-28T18:39:38.054024+0000","last_peered":"2023-11-28T18:39:38.054024+0000","last_clean":"2023-11-28T18:39:38.054024+0000","last_became_active":"2023-11-28T18:39:37.061391+0000","last_became_peered":"2023-11-28T18:39:37.061391+0000","last_unstale":"2023-11-28T18:39:38.054024+0000","last_undegraded":"2023-11-28T18:39:38.054024+0000","last_fullsized":"2023-11-28T18:39:38.054024+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:54:15.334722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"45'6","reported_seq":18,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-28T18:39:37.078188+0000","last_change":"2023-11-28T18:39:36.049485+0000","last_active":"2023-11-28T18:39:37.078188+0000","last_peered":"2023-11-28T18:39:37.078188+0000","last_clean":"2023-11-28T18:39:37.078188+0000","last_became_active":"2023-11-28T18:39:36.049238+0000","last_became_peered":"2023-11-28T18:39:36.049238+0000","last_unstale":"2023-11-28T18:39:37.078188+0000","last_undegraded":"2023-11-28T18:39:37.078188+0000","last_fullsized":"2023-11-28T18:39:37.078188+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_clean_scrub_stamp":"2023-11-28T18:39:35.017177+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:23:01.067164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T18:39:38.198719+0000","last_change":"2023-11-28T18:39:37.067108+0000","last_active":"2023-11-28T18:39:38.198719+0000","last_peered":"2023-11-28T18:39:38.198719+0000","last_clean":"2023-11-28T18:39:38.198719+0000","last_became_active":"2023-11-28T18:39:37.066801+0000","last_became_peered":"2023-11-28T18:39:37.066801+0000","last_unstale":"2023-11-28T18:39:38.198719+0000","last_undegraded":"2023-11-28T18:39:38.198719+0000","last_fullsized":"2023-11-28T18:39:38.198719+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:34:39.174496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"45'2","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-28T18:39:37.077059+0000","last_change":"2023-11-28T18:39:36.055908+0000","last_active":"2023-11-28T18:39:37.077059+0000","last_peered":"2023-11-28T18:39:37.077059+0000","last_clean":"2023-11-28T18:39:37.077059+0000","last_became_active":"2023-11-28T18:39:36.055620+0000","last_became_peered":"2023-11-28T18:39:36.055620+0000","last_unstale":"2023-11-28T18:39:37.077059+0000","last_undegraded":"2023-11-28T18:39:37.077059+0000","last_fullsized":"2023-11-28T18:39:37.077059+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_clean_scrub_stamp":"2023-11-28T18:39:35.017177+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:48:45.609823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T18:39:38.197364+0000","last_change":"2023-11-28T18:39:37.052403+0000","last_active":"2023-11-28T18:39:38.197364+0000","last_peered":"2023-11-28T18:39:38.197364+0000","last_clean":"2023-11-28T18:39:38.197364+0000","last_became_active":"2023-11-28T18:39:37.052103+0000","last_became_peered":"2023-11-28T18:39:37.052103+0000","last_unstale":"2023-11-28T18:39:38.197364+0000","last_undegraded":"2023-11-28T18:39:38.197364+0000","last_fullsized":"2023-11-28T18:39:38.197364+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:41:09.817997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-28T18:39:37.038899+0000","last_change":"2023-11-28T18:39:36.045662+0000","last_active":"2023-11-28T18:39:37.038899+0000","last_peered":"2023-11-28T18:39:37.038899+0000","last_clean":"2023-11-28T18:39:37.038899+0000","last_became_active":"2023-11-28T18:39:36.045384+0000","last_became_peered":"2023-11-28T18:39:36.045384+0000","last_unstale":"2023-11-28T18:39:37.038899+0000","last_undegraded":"2023-11-28T18:39:37.038899+0000","last_fullsized":"2023-11-28T18:39:37.038899+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_clean_scrub_stamp":"2023-11-28T18:39:35.017177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:38:43.081424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T18:39:38.197483+0000","last_change":"2023-11-28T18:39:37.054948+0000","last_active":"2023-11-28T18:39:38.197483+0000","last_peered":"2023-11-28T18:39:38.197483+0000","last_clean":"2023-11-28T18:39:38.197483+0000","last_became_active":"2023-11-28T18:39:37.054687+0000","last_became_peered":"2023-11-28T18:39:37.054687+0000","last_unstale":"2023-11-28T18:39:38.197483+0000","last_undegraded":"2023-11-28T18:39:38.197483+0000","last_fullsized":"2023-11-28T18:39:38.197483+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:54:15.334722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-28T18:39:37.043498+0000","last_change":"2023-11-28T18:39:36.056455+0000","last_active":"2023-11-28T18:39:37.043498+0000","last_peered":"2023-11-28T18:39:37.043498+0000","last_clean":"2023-11-28T18:39:37.043498+0000","last_became_active":"2023-11-28T18:39:36.056178+0000","last_became_peered":"2023-11-28T18:39:36.056178+0000","last_unstale":"2023-11-28T18:39:37.043498+0000","last_undegraded":"2023-11-28T18:39:37.043498+0000","last_fullsized":"2023-11-28T18:39:37.043498+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_clean_scrub_stamp":"2023-11-28T18:39:35.017177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:11:36.603050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T18:39:38.053897+0000","last_change":"2023-11-28T18:39:37.052330+0000","last_active":"2023-11-28T18:39:38.053897+0000","last_peered":"2023-11-28T18:39:38.053897+0000","last_clean":"2023-11-28T18:39:38.053897+0000","last_became_active":"2023-11-28T18:39:37.051960+0000","last_became_peered":"2023-11-28T18:39:37.051960+0000","last_unstale":"2023-11-28T18:39:38.053897+0000","last_undegraded":"2023-11-28T18:39:38.053897+0000","last_fullsized":"2023-11-28T18:39:38.053897+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:21:25.106162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"45'8","reported_seq":20,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-28T18:39:37.070361+0000","last_change":"2023-11-28T18:39:36.048316+0000","last_active":"2023-11-28T18:39:37.070361+0000","last_peered":"2023-11-28T18:39:37.070361+0000","last_clean":"2023-11-28T18:39:37.070361+0000","last_became_active":"2023-11-28T18:39:36.047878+0000","last_became_peered":"2023-11-28T18:39:36.047878+0000","last_unstale":"2023-11-28T18:39:37.070361+0000","last_undegraded":"2023-11-28T18:39:37.070361+0000","last_fullsized":"2023-11-28T18:39:37.070361+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_clean_scrub_stamp":"2023-11-28T18:39:35.017177+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:24:36.006600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T18:39:38.197866+0000","last_change":"2023-11-28T18:39:37.037410+0000","last_active":"2023-11-28T18:39:38.197866+0000","last_peered":"2023-11-28T18:39:38.197866+0000","last_clean":"2023-11-28T18:39:38.197866+0000","last_became_active":"2023-11-28T18:39:37.037092+0000","last_became_peered":"2023-11-28T18:39:37.037092+0000","last_unstale":"2023-11-28T18:39:38.197866+0000","last_undegraded":"2023-11-28T18:39:38.197866+0000","last_fullsized":"2023-11-28T18:39:38.197866+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:24:19.293085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"45'1","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-28T18:39:37.064482+0000","last_change":"2023-11-28T18:39:36.046541+0000","last_active":"2023-11-28T18:39:37.064482+0000","last_peered":"2023-11-28T18:39:37.064482+0000","last_clean":"2023-11-28T18:39:37.064482+0000","last_became_active":"2023-11-28T18:39:36.042497+0000","last_became_peered":"2023-11-28T18:39:36.042497+0000","last_unstale":"2023-11-28T18:39:37.064482+0000","last_undegraded":"2023-11-28T18:39:37.064482+0000","last_fullsized":"2023-11-28T18:39:37.064482+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_clean_scrub_stamp":"2023-11-28T18:39:35.017177+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:13:23.823829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T18:39:38.198021+0000","last_change":"2023-11-28T18:39:37.056471+0000","last_active":"2023-11-28T18:39:38.198021+0000","last_peered":"2023-11-28T18:39:38.198021+0000","last_clean":"2023-11-28T18:39:38.198021+0000","last_became_active":"2023-11-28T18:39:37.056174+0000","last_became_peered":"2023-11-28T18:39:37.056174+0000","last_unstale":"2023-11-28T18:39:38.198021+0000","last_undegraded":"2023-11-28T18:39:38.198021+0000","last_fullsized":"2023-11-28T18:39:38.198021+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:50:47.245625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"45'2","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-28T18:39:37.066100+0000","last_change":"2023-11-28T18:39:36.052363+0000","last_active":"2023-11-28T18:39:37.066100+0000","last_peered":"2023-11-28T18:39:37.066100+0000","last_clean":"2023-11-28T18:39:37.066100+0000","last_became_active":"2023-11-28T18:39:36.052086+0000","last_became_peered":"2023-11-28T18:39:36.052086+0000","last_unstale":"2023-11-28T18:39:37.066100+0000","last_undegraded":"2023-11-28T18:39:37.066100+0000","last_fullsized":"2023-11-28T18:39:37.066100+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_clean_scrub_stamp":"2023-11-28T18:39:35.017177+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:18:41.000582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T18:39:38.198741+0000","last_change":"2023-11-28T18:39:37.049886+0000","last_active":"2023-11-28T18:39:38.198741+0000","last_peered":"2023-11-28T18:39:38.198741+0000","last_clean":"2023-11-28T18:39:38.198741+0000","last_became_active":"2023-11-28T18:39:37.049635+0000","last_became_peered":"2023-11-28T18:39:37.049635+0000","last_unstale":"2023-11-28T18:39:38.198741+0000","last_undegraded":"2023-11-28T18:39:38.198741+0000","last_fullsized":"2023-11-28T18:39:38.198741+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:24:37.010482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"45'1","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-28T18:39:37.067493+0000","last_change":"2023-11-28T18:39:36.049524+0000","last_active":"2023-11-28T18:39:37.067493+0000","last_peered":"2023-11-28T18:39:37.067493+0000","last_clean":"2023-11-28T18:39:37.067493+0000","last_became_active":"2023-11-28T18:39:36.049212+0000","last_became_peered":"2023-11-28T18:39:36.049212+0000","last_unstale":"2023-11-28T18:39:37.067493+0000","last_undegraded":"2023-11-28T18:39:37.067493+0000","last_fullsized":"2023-11-28T18:39:37.067493+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_clean_scrub_stamp":"2023-11-28T18:39:35.017177+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:05:05.474651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T18:39:38.198771+0000","last_change":"2023-11-28T18:39:37.060768+0000","last_active":"2023-11-28T18:39:38.198771+0000","last_peered":"2023-11-28T18:39:38.198771+0000","last_clean":"2023-11-28T18:39:38.198771+0000","last_became_active":"2023-11-28T18:39:37.060499+0000","last_became_peered":"2023-11-28T18:39:37.060499+0000","last_unstale":"2023-11-28T18:39:38.198771+0000","last_undegraded":"2023-11-28T18:39:38.198771+0000","last_fullsized":"2023-11-28T18:39:38.198771+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:18:42.004465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-28T18:39:37.045391+0000","last_change":"2023-11-28T18:39:36.053055+0000","last_active":"2023-11-28T18:39:37.045391+0000","last_peered":"2023-11-28T18:39:37.045391+0000","last_clean":"2023-11-28T18:39:37.045391+0000","last_became_active":"2023-11-28T18:39:36.052793+0000","last_became_peered":"2023-11-28T18:39:36.052793+0000","last_unstale":"2023-11-28T18:39:37.045391+0000","last_undegraded":"2023-11-28T18:39:37.045391+0000","last_fullsized":"2023-11-28T18:39:37.045391+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_clean_scrub_stamp":"2023-11-28T18:39:35.017177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:37:29.787978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T18:39:38.198379+0000","last_change":"2023-11-28T18:39:37.053573+0000","last_active":"2023-11-28T18:39:38.198379+0000","last_peered":"2023-11-28T18:39:38.198379+0000","last_clean":"2023-11-28T18:39:38.198379+0000","last_became_active":"2023-11-28T18:39:37.053234+0000","last_became_peered":"2023-11-28T18:39:37.053234+0000","last_unstale":"2023-11-28T18:39:38.198379+0000","last_undegraded":"2023-11-28T18:39:38.198379+0000","last_fullsized":"2023-11-28T18:39:38.198379+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:30:02.209672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"45'2","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-28T18:39:37.076382+0000","last_change":"2023-11-28T18:39:36.049459+0000","last_active":"2023-11-28T18:39:37.076382+0000","last_peered":"2023-11-28T18:39:37.076382+0000","last_clean":"2023-11-28T18:39:37.076382+0000","last_became_active":"2023-11-28T18:39:36.049099+0000","last_became_peered":"2023-11-28T18:39:36.049099+0000","last_unstale":"2023-11-28T18:39:37.076382+0000","last_undegraded":"2023-11-28T18:39:37.076382+0000","last_fullsized":"2023-11-28T18:39:37.076382+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_clean_scrub_stamp":"2023-11-28T18:39:35.017177+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:52:19.415190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T18:39:38.048263+0000","last_change":"2023-11-28T18:39:37.048212+0000","last_active":"2023-11-28T18:39:38.048263+0000","last_peered":"2023-11-28T18:39:38.048263+0000","last_clean":"2023-11-28T18:39:38.048263+0000","last_became_active":"2023-11-28T18:39:37.047933+0000","last_became_peered":"2023-11-28T18:39:37.047933+0000","last_unstale":"2023-11-28T18:39:38.048263+0000","last_undegraded":"2023-11-28T18:39:38.048263+0000","last_fullsized":"2023-11-28T18:39:38.048263+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:18:42.004465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-28T18:39:37.029988+0000","last_change":"2023-11-28T18:39:36.051563+0000","last_active":"2023-11-28T18:39:37.029988+0000","last_peered":"2023-11-28T18:39:37.029988+0000","last_clean":"2023-11-28T18:39:37.029988+0000","last_became_active":"2023-11-28T18:39:36.051183+0000","last_became_peered":"2023-11-28T18:39:36.051183+0000","last_unstale":"2023-11-28T18:39:37.029988+0000","last_undegraded":"2023-11-28T18:39:37.029988+0000","last_fullsized":"2023-11-28T18:39:37.029988+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_clean_scrub_stamp":"2023-11-28T18:39:35.017177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:24:55.848286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T18:39:38.198312+0000","last_change":"2023-11-28T18:39:37.044571+0000","last_active":"2023-11-28T18:39:38.198312+0000","last_peered":"2023-11-28T18:39:38.198312+0000","last_clean":"2023-11-28T18:39:38.198312+0000","last_became_active":"2023-11-28T18:39:37.044237+0000","last_became_peered":"2023-11-28T18:39:37.044237+0000","last_unstale":"2023-11-28T18:39:38.198312+0000","last_undegraded":"2023-11-28T18:39:38.198312+0000","last_fullsized":"2023-11-28T18:39:38.198312+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:43:21.061815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-28T18:39:37.036772+0000","last_change":"2023-11-28T18:39:36.050898+0000","last_active":"2023-11-28T18:39:37.036772+0000","last_peered":"2023-11-28T18:39:37.036772+0000","last_clean":"2023-11-28T18:39:37.036772+0000","last_became_active":"2023-11-28T18:39:36.050615+0000","last_became_peered":"2023-11-28T18:39:36.050615+0000","last_unstale":"2023-11-28T18:39:37.036772+0000","last_undegraded":"2023-11-28T18:39:37.036772+0000","last_fullsized":"2023-11-28T18:39:37.036772+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_clean_scrub_stamp":"2023-11-28T18:39:35.017177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:37:57.252110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T18:39:38.197270+0000","last_change":"2023-11-28T18:39:37.057720+0000","last_active":"2023-11-28T18:39:38.197270+0000","last_peered":"2023-11-28T18:39:38.197270+0000","last_clean":"2023-11-28T18:39:38.197270+0000","last_became_active":"2023-11-28T18:39:37.057441+0000","last_became_peered":"2023-11-28T18:39:37.057441+0000","last_unstale":"2023-11-28T18:39:38.197270+0000","last_undegraded":"2023-11-28T18:39:38.197270+0000","last_fullsized":"2023-11-28T18:39:38.197270+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:15:26.568176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-28T18:39:37.040960+0000","last_change":"2023-11-28T18:39:36.047063+0000","last_active":"2023-11-28T18:39:37.040960+0000","last_peered":"2023-11-28T18:39:37.040960+0000","last_clean":"2023-11-28T18:39:37.040960+0000","last_became_active":"2023-11-28T18:39:36.046680+0000","last_became_peered":"2023-11-28T18:39:36.046680+0000","last_unstale":"2023-11-28T18:39:37.040960+0000","last_undegraded":"2023-11-28T18:39:37.040960+0000","last_fullsized":"2023-11-28T18:39:37.040960+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_clean_scrub_stamp":"2023-11-28T18:39:35.017177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:48:45.609823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T18:39:38.198996+0000","last_change":"2023-11-28T18:39:37.075764+0000","last_active":"2023-11-28T18:39:38.198996+0000","last_peered":"2023-11-28T18:39:38.198996+0000","last_clean":"2023-11-28T18:39:38.198996+0000","last_became_active":"2023-11-28T18:39:37.075458+0000","last_became_peered":"2023-11-28T18:39:37.075458+0000","last_unstale":"2023-11-28T18:39:38.198996+0000","last_undegraded":"2023-11-28T18:39:38.198996+0000","last_fullsized":"2023-11-28T18:39:38.198996+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:57:24.717802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-28T18:39:37.045369+0000","last_change":"2023-11-28T18:39:36.052880+0000","last_active":"2023-11-28T18:39:37.045369+0000","last_peered":"2023-11-28T18:39:37.045369+0000","last_clean":"2023-11-28T18:39:37.045369+0000","last_became_active":"2023-11-28T18:39:36.052577+0000","last_became_peered":"2023-11-28T18:39:36.052577+0000","last_unstale":"2023-11-28T18:39:37.045369+0000","last_undegraded":"2023-11-28T18:39:37.045369+0000","last_fullsized":"2023-11-28T18:39:37.045369+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_clean_scrub_stamp":"2023-11-28T18:39:35.017177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:03:36.978963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T18:39:38.198058+0000","last_change":"2023-11-28T18:39:37.052973+0000","last_active":"2023-11-28T18:39:38.198058+0000","last_peered":"2023-11-28T18:39:38.198058+0000","last_clean":"2023-11-28T18:39:38.198058+0000","last_became_active":"2023-11-28T18:39:37.052619+0000","last_became_peered":"2023-11-28T18:39:37.052619+0000","last_unstale":"2023-11-28T18:39:38.198058+0000","last_undegraded":"2023-11-28T18:39:38.198058+0000","last_fullsized":"2023-11-28T18:39:38.198058+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:01:42.894438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-28T18:39:37.040050+0000","last_change":"2023-11-28T18:39:36.053904+0000","last_active":"2023-11-28T18:39:37.040050+0000","last_peered":"2023-11-28T18:39:37.040050+0000","last_clean":"2023-11-28T18:39:37.040050+0000","last_became_active":"2023-11-28T18:39:36.053620+0000","last_became_peered":"2023-11-28T18:39:36.053620+0000","last_unstale":"2023-11-28T18:39:37.040050+0000","last_undegraded":"2023-11-28T18:39:37.040050+0000","last_fullsized":"2023-11-28T18:39:37.040050+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_clean_scrub_stamp":"2023-11-28T18:39:35.017177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:35:29.513749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T18:39:38.053637+0000","last_change":"2023-11-28T18:39:37.057662+0000","last_active":"2023-11-28T18:39:38.053637+0000","last_peered":"2023-11-28T18:39:38.053637+0000","last_clean":"2023-11-28T18:39:38.053637+0000","last_became_active":"2023-11-28T18:39:37.057351+0000","last_became_peered":"2023-11-28T18:39:37.057351+0000","last_unstale":"2023-11-28T18:39:38.053637+0000","last_undegraded":"2023-11-28T18:39:38.053637+0000","last_fullsized":"2023-11-28T18:39:38.053637+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:37:30.791860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-28T18:39:37.034748+0000","last_change":"2023-11-28T18:39:36.053051+0000","last_active":"2023-11-28T18:39:37.034748+0000","last_peered":"2023-11-28T18:39:37.034748+0000","last_clean":"2023-11-28T18:39:37.034748+0000","last_became_active":"2023-11-28T18:39:36.052683+0000","last_became_peered":"2023-11-28T18:39:36.052683+0000","last_unstale":"2023-11-28T18:39:37.034748+0000","last_undegraded":"2023-11-28T18:39:37.034748+0000","last_fullsized":"2023-11-28T18:39:37.034748+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_clean_scrub_stamp":"2023-11-28T18:39:35.017177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:42:31.522281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T18:39:38.198463+0000","last_change":"2023-11-28T18:39:37.051574+0000","last_active":"2023-11-28T18:39:38.198463+0000","last_peered":"2023-11-28T18:39:38.198463+0000","last_clean":"2023-11-28T18:39:38.198463+0000","last_became_active":"2023-11-28T18:39:37.051301+0000","last_became_peered":"2023-11-28T18:39:37.051301+0000","last_unstale":"2023-11-28T18:39:38.198463+0000","last_undegraded":"2023-11-28T18:39:38.198463+0000","last_fullsized":"2023-11-28T18:39:38.198463+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:48:45.195295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-28T18:39:37.039204+0000","last_change":"2023-11-28T18:39:36.053996+0000","last_active":"2023-11-28T18:39:37.039204+0000","last_peered":"2023-11-28T18:39:37.039204+0000","last_clean":"2023-11-28T18:39:37.039204+0000","last_became_active":"2023-11-28T18:39:36.053688+0000","last_became_peered":"2023-11-28T18:39:36.053688+0000","last_unstale":"2023-11-28T18:39:37.039204+0000","last_undegraded":"2023-11-28T18:39:37.039204+0000","last_fullsized":"2023-11-28T18:39:37.039204+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_clean_scrub_stamp":"2023-11-28T18:39:35.017177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:05:05.474651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T18:39:38.197836+0000","last_change":"2023-11-28T18:39:37.056824+0000","last_active":"2023-11-28T18:39:38.197836+0000","last_peered":"2023-11-28T18:39:38.197836+0000","last_clean":"2023-11-28T18:39:38.197836+0000","last_became_active":"2023-11-28T18:39:37.056313+0000","last_became_peered":"2023-11-28T18:39:37.056313+0000","last_unstale":"2023-11-28T18:39:38.197836+0000","last_undegraded":"2023-11-28T18:39:38.197836+0000","last_fullsized":"2023-11-28T18:39:38.197836+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:33:21.318107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-28T18:39:37.031046+0000","last_change":"2023-11-28T18:39:36.047527+0000","last_active":"2023-11-28T18:39:37.031046+0000","last_peered":"2023-11-28T18:39:37.031046+0000","last_clean":"2023-11-28T18:39:37.031046+0000","last_became_active":"2023-11-28T18:39:36.046661+0000","last_became_peered":"2023-11-28T18:39:36.046661+0000","last_unstale":"2023-11-28T18:39:37.031046+0000","last_undegraded":"2023-11-28T18:39:37.031046+0000","last_fullsized":"2023-11-28T18:39:37.031046+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_clean_scrub_stamp":"2023-11-28T18:39:35.017177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:56:19.560039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T18:39:38.053432+0000","last_change":"2023-11-28T18:39:37.046512+0000","last_active":"2023-11-28T18:39:38.053432+0000","last_peered":"2023-11-28T18:39:38.053432+0000","last_clean":"2023-11-28T18:39:38.053432+0000","last_became_active":"2023-11-28T18:39:37.046194+0000","last_became_peered":"2023-11-28T18:39:37.046194+0000","last_unstale":"2023-11-28T18:39:38.053432+0000","last_undegraded":"2023-11-28T18:39:38.053432+0000","last_fullsized":"2023-11-28T18:39:38.053432+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:50:47.245625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-28T18:39:37.035810+0000","last_change":"2023-11-28T18:39:36.052437+0000","last_active":"2023-11-28T18:39:37.035810+0000","last_peered":"2023-11-28T18:39:37.035810+0000","last_clean":"2023-11-28T18:39:37.035810+0000","last_became_active":"2023-11-28T18:39:36.052119+0000","last_became_peered":"2023-11-28T18:39:36.052119+0000","last_unstale":"2023-11-28T18:39:37.035810+0000","last_undegraded":"2023-11-28T18:39:37.035810+0000","last_fullsized":"2023-11-28T18:39:37.035810+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_clean_scrub_stamp":"2023-11-28T18:39:35.017177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:34:38.170614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T18:39:38.198273+0000","last_change":"2023-11-28T18:39:37.043652+0000","last_active":"2023-11-28T18:39:38.198273+0000","last_peered":"2023-11-28T18:39:38.198273+0000","last_clean":"2023-11-28T18:39:38.198273+0000","last_became_active":"2023-11-28T18:39:37.041795+0000","last_became_peered":"2023-11-28T18:39:37.041795+0000","last_unstale":"2023-11-28T18:39:38.198273+0000","last_undegraded":"2023-11-28T18:39:38.198273+0000","last_fullsized":"2023-11-28T18:39:38.198273+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:57:24.717802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-28T18:39:37.035709+0000","last_change":"2023-11-28T18:39:36.048143+0000","last_active":"2023-11-28T18:39:37.035709+0000","last_peered":"2023-11-28T18:39:37.035709+0000","last_clean":"2023-11-28T18:39:37.035709+0000","last_became_active":"2023-11-28T18:39:36.047589+0000","last_became_peered":"2023-11-28T18:39:36.047589+0000","last_unstale":"2023-11-28T18:39:37.035709+0000","last_undegraded":"2023-11-28T18:39:37.035709+0000","last_fullsized":"2023-11-28T18:39:37.035709+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_clean_scrub_stamp":"2023-11-28T18:39:35.017177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:18:41.000582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T18:39:38.198503+0000","last_change":"2023-11-28T18:39:37.055580+0000","last_active":"2023-11-28T18:39:38.198503+0000","last_peered":"2023-11-28T18:39:38.198503+0000","last_clean":"2023-11-28T18:39:38.198503+0000","last_became_active":"2023-11-28T18:39:37.055215+0000","last_became_peered":"2023-11-28T18:39:37.055215+0000","last_unstale":"2023-11-28T18:39:38.198503+0000","last_undegraded":"2023-11-28T18:39:38.198503+0000","last_fullsized":"2023-11-28T18:39:38.198503+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:36.021059+0000","last_clean_scrub_stamp":"2023-11-28T18:39:36.021059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:35:30.517631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"45'2","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-28T18:39:37.065908+0000","last_change":"2023-11-28T18:39:36.042686+0000","last_active":"2023-11-28T18:39:37.065908+0000","last_peered":"2023-11-28T18:39:37.065908+0000","last_clean":"2023-11-28T18:39:37.065908+0000","last_became_active":"2023-11-28T18:39:36.042413+0000","last_became_peered":"2023-11-28T18:39:36.042413+0000","last_unstale":"2023-11-28T18:39:37.065908+0000","last_undegraded":"2023-11-28T18:39:37.065908+0000","last_fullsized":"2023-11-28T18:39:37.065908+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:39:35.017177+0000","last_clean_scrub_stamp":"2023-11-28T18:39:35.017177+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:00:53.557354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":186,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-28T18:39:37.041047+0000","last_change":"2023-11-28T18:37:22.369132+0000","last_active":"2023-11-28T18:39:37.041047+0000","last_peered":"2023-11-28T18:39:37.041047+0000","last_clean":"2023-11-28T18:39:37.041047+0000","last_became_active":"2023-11-28T18:37:22.368142+0000","last_became_peered":"2023-11-28T18:37:22.368142+0000","last_unstale":"2023-11-28T18:39:37.041047+0000","last_undegraded":"2023-11-28T18:39:37.041047+0000","last_fullsized":"2023-11-28T18:39:37.041047+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:21.313053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:21.313053+0000","last_clean_scrub_stamp":"2023-11-28T18:37:21.313053+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:55:01.432028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574879,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32300,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339540,"statfs":{"total":96636764160,"available":96603688960,"internally_reserved":0,"allocated":1138688,"data_stored":811922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 18:39:23 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.83999999999999997,"15min":0.86899999999999999},"min":{"1min":0.45800000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.0509999999999999,"5min":4.8559999999999999,"15min":4.8559999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.81899999999999995,"15min":0.84599999999999997},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.90900000000000003,"5min":4.8319999999999999,"15min":4.8319999999999999},"last":0.79800000000000004}]},{"osd":1,"last update":"Tue Nov 28 18:39:23 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.84099999999999997,"15min":0.86299999999999999},"min":{"1min":0.50900000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.93400000000000005,"5min":4.8109999999999999,"15min":4.8109999999999999},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.88800000000000001,"15min":0.91800000000000004},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.997,"5min":4.8700000000000001,"15min":4.8700000000000001},"last":0.71599999999999997}]},{"osd":2,"last update":"Tue Nov 28 18:39:23 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.73599999999999999,"15min":0.73999999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.032,"5min":1.151,"15min":1.151},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.752,"15min":0.751},"min":{"1min":0.55900000000000005,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.113,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.875}]},{"osd":3,"last update":"Tue Nov 28 18:39:23 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.88900000000000001,"15min":0.92100000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.97499999999999998,"5min":4.7619999999999996,"15min":4.7619999999999996},"last":0.748},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.75800000000000001,"15min":0.76200000000000001},"min":{"1min":0.59299999999999997,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.93400000000000005,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.82299999999999995}]},{"osd":4,"last update":"Tue Nov 28 18:39:23 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.64700000000000002,"15min":0.65300000000000002},"min":{"1min":0.46700000000000003,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.877,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.68899999999999995,"15min":0.69699999999999995},"min":{"1min":0.48099999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.872,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.67400000000000004}]},{"osd":5,"last update":"Tue Nov 28 18:39:23 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.69299999999999995,"15min":0.70299999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.94099999999999995,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.73999999999999999,"15min":0.753},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.88300000000000001,"5min":1.032,"15min":1.032},"last":0.56000000000000005}]},{"osd":6,"last update":"Tue Nov 28 18:39:23 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.80900000000000005,"15min":0.82499999999999996},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.93600000000000005,"5min":1.484,"15min":1.484},"last":0.621},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.77800000000000002,"15min":0.79300000000000004},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.96899999999999997,"5min":1.169,"15min":1.169},"last":0.629}]}]},{"osd":6,"up_from":13,"seq":55834574881,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":548864,"data_stored":222136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 18:39:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.63200000000000001,"15min":0.628},"min":{"1min":0.443,"5min":0.376,"15min":0.376},"max":{"1min":0.85099999999999998,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.63600000000000001,"15min":0.63},"min":{"1min":0.46999999999999997,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.52300000000000002}]},{"osd":1,"last update":"Tue Nov 28 18:39:28 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.67400000000000004,"15min":0.66600000000000004},"min":{"1min":0.499,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.746,"5min":0.74099999999999999,"15min":0.73999999999999999},"min":{"1min":0.58499999999999996,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.92000000000000004,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.65600000000000003}]},{"osd":2,"last update":"Tue Nov 28 18:39:28 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.64900000000000002,"15min":0.65300000000000002},"min":{"1min":0.46300000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.93200000000000005,"5min":1.01,"15min":1.01},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.69199999999999995,"15min":0.68999999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.96899999999999997,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.74199999999999999}]},{"osd":3,"last update":"Tue Nov 28 18:39:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.96299999999999997,"5min":1.097,"15min":1.097},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.69399999999999995,"15min":0.69899999999999995},"min":{"1min":0.53200000000000003,"5min":0.44,"15min":0.44},"max":{"1min":0.873,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.498}]},{"osd":4,"last update":"Tue Nov 28 18:39:28 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.64400000000000002,"15min":0.66200000000000003},"min":{"1min":0.39600000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.79000000000000004,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.66900000000000004,"15min":0.67700000000000005},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.80300000000000005,"5min":1.163,"15min":1.163},"last":0.46800000000000003}]},{"osd":5,"last update":"Tue Nov 28 18:39:28 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.67300000000000004,"15min":0.68700000000000006},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.80300000000000005,"5min":1.052,"15min":1.052},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.78300000000000003,"15min":0.79700000000000004},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.96999999999999997,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.67700000000000005}]},{"osd":7,"last update":"Tue Nov 28 18:39:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.76000000000000001,"15min":0.77100000000000002},"min":{"1min":0.51000000000000001,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.85399999999999998,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.75600000000000001,"15min":0.76800000000000002},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.80100000000000005,"5min":1.131,"15min":1.131},"last":0.58999999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31716,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340124,"statfs":{"total":96636764160,"available":96604286976,"internally_reserved":0,"allocated":544768,"data_stored":221534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 18:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.63200000000000001,"15min":0.626},"min":{"1min":0.438,"5min":0.375,"15min":0.375},"max":{"1min":0.84499999999999997,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.67900000000000005,"15min":0.68100000000000005},"min":{"1min":0.57199999999999995,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.91000000000000003,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.91300000000000003}]},{"osd":1,"last update":"Tue Nov 28 18:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.73699999999999999,"15min":0.73599999999999999},"min":{"1min":0.53800000000000003,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.97199999999999998,"5min":1.073,"15min":1.073},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.72799999999999998,"15min":0.73199999999999998},"min":{"1min":0.48399999999999999,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.86099999999999999,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.64500000000000002}]},{"osd":2,"last update":"Tue Nov 28 18:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.45800000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.94699999999999995,"5min":1.022,"15min":1.022},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.73699999999999999,"15min":0.74299999999999999},"min":{"1min":0.54400000000000004,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.82799999999999996,"5min":1.002,"15min":1.002},"last":0.98899999999999999}]},{"osd":3,"last update":"Tue Nov 28 18:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.72299999999999998,"15min":0.72899999999999998},"min":{"1min":0.51200000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.89400000000000002,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.77600000000000002,"15min":0.77800000000000002},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":0.94099999999999995,"5min":1.147,"15min":1.147},"last":0.746}]},{"osd":4,"last update":"Tue Nov 28 18:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.622,"15min":0.622},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67800000000000005,"15min":0.68000000000000005},"min":{"1min":0.45800000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.86799999999999999,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.81999999999999995}]},{"osd":6,"last update":"Tue Nov 28 18:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.67500000000000004,"15min":0.68300000000000005},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.72399999999999998,"15min":0.73299999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.97699999999999998,"5min":1.048,"15min":1.048},"last":0.72899999999999998}]},{"osd":7,"last update":"Tue Nov 28 18:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.751,"15min":0.75800000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.91500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.79800000000000004,"15min":0.81000000000000005},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.98399999999999999,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":1.0389999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574879,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27564,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344276,"statfs":{"total":96636764160,"available":96608538624,"internally_reserved":0,"allocated":552960,"data_stored":223076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 18:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.63400000000000001,"15min":0.624},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.81200000000000006,"15min":0.83799999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.01,"5min":3.5179999999999998,"15min":3.5179999999999998},"last":0.73699999999999999}]},{"osd":1,"last update":"Tue Nov 28 18:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.83099999999999996,"15min":0.85099999999999998},"min":{"1min":0.47199999999999998,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.94399999999999995,"5min":3.5019999999999998,"15min":3.5019999999999998},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.83999999999999997,"15min":0.86199999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.0640000000000001,"5min":3.5630000000000002,"15min":3.5630000000000002},"last":0.82199999999999995}]},{"osd":2,"last update":"Tue Nov 28 18:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.82699999999999996,"15min":0.84899999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.998,"5min":3.6709999999999998,"15min":3.6709999999999998},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.84999999999999998,"15min":0.87},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.018,"5min":3.4849999999999999,"15min":3.4849999999999999},"last":0.84999999999999998}]},{"osd":3,"last update":"Tue Nov 28 18:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.86799999999999999,"15min":0.89800000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.002,"5min":3.7130000000000001,"15min":3.7130000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.75700000000000001,"15min":0.75900000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.96499999999999997,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.83399999999999996}]},{"osd":5,"last update":"Tue Nov 28 18:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.66800000000000004,"15min":0.67400000000000004},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.69699999999999995,"15min":0.70599999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.91900000000000004,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.56299999999999994}]},{"osd":6,"last update":"Tue Nov 28 18:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.77900000000000003,"15min":0.80300000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.83799999999999997,"5min":1.718,"15min":1.718},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.75900000000000001,"15min":0.77400000000000002},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.143,"5min":1.304,"15min":1.304},"last":0.70999999999999996}]},{"osd":7,"last update":"Tue Nov 28 18:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.74099999999999999,"15min":0.754},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.88600000000000001,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.81699999999999995,"15min":0.83399999999999996},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.018,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.86099999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574879,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31724,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340116,"statfs":{"total":96636764160,"available":96604278784,"internally_reserved":0,"allocated":552960,"data_stored":222102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 18:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.44800000000000001,"15min":0.42999999999999999},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":2.4940000000000002,"5min":2.4940000000000002,"15min":2.4940000000000002},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.46700000000000003,"15min":0.47099999999999997},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.65100000000000002}]},{"osd":1,"last update":"Tue Nov 28 18:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.46200000000000002,"15min":0.45600000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53600000000000003,"15min":0.53700000000000003},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.54500000000000004}]},{"osd":2,"last update":"Tue Nov 28 18:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.51600000000000001,"15min":0.50800000000000001},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.61399999999999999}]},{"osd":4,"last update":"Tue Nov 28 18:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.76700000000000002,"15min":0.77300000000000002},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.018,"5min":1.069,"15min":1.069},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.79000000000000004,"15min":0.80000000000000004},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.246,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.68200000000000005}]},{"osd":5,"last update":"Tue Nov 28 18:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.81299999999999994,"15min":0.82299999999999995},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.071,"5min":1.26,"15min":1.26},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.82399999999999995,"15min":0.83399999999999996},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.1339999999999999,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.67400000000000004}]},{"osd":6,"last update":"Tue Nov 28 18:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.80300000000000005,"15min":0.81299999999999994},"min":{"1min":0.55000000000000004,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.3580000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.80800000000000005,"15min":0.81599999999999995},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.109,"5min":1.377,"15min":1.377},"last":0.76200000000000001}]},{"osd":7,"last update":"Tue Nov 28 18:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.81999999999999995,"15min":0.82899999999999996},"min":{"1min":0.57099999999999995,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.0249999999999999,"5min":1.169,"15min":1.169},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.85299999999999998,"15min":0.85999999999999999},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.74399999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574879,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31728,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340112,"statfs":{"total":96636764160,"available":96604274688,"internally_reserved":0,"allocated":557056,"data_stored":223098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 18:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.42199999999999999,"15min":0.42499999999999999},"min":{"1min":0.28199999999999997,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.56699999999999995,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.24099999999999999},{"interface":"front","average":{"1min":0.443,"5min":0.49399999999999999,"15min":0.502},"min":{"1min":0.308,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.70599999999999996,"5min":1.589,"15min":1.589},"last":0.33400000000000002}]},{"osd":1,"last update":"Tue Nov 28 18:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.46300000000000002,"15min":0.47199999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.60199999999999998,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.51400000000000001,"15min":0.51700000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.69599999999999995,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.28599999999999998}]},{"osd":3,"last update":"Tue Nov 28 18:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.55100000000000005,"15min":0.56100000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.747,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.371},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.56599999999999995,"15min":0.57299999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.71499999999999997,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.39300000000000002}]},{"osd":4,"last update":"Tue Nov 28 18:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.748,"15min":0.746},"min":{"1min":0.51300000000000001,"5min":0.505,"15min":0.505},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.74299999999999999,"15min":0.746},"min":{"1min":0.54900000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0009999999999999,"5min":1.665,"15min":1.665},"last":0.65200000000000002}]},{"osd":5,"last update":"Tue Nov 28 18:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.77400000000000002,"15min":0.78000000000000003},"min":{"1min":0.56200000000000006,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.92400000000000004,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.79200000000000004,"15min":0.79700000000000004},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.0489999999999999,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.78700000000000003}]},{"osd":6,"last update":"Tue Nov 28 18:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.80500000000000005,"15min":0.81100000000000005},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.089,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.754,"5min":0.77500000000000002,"15min":0.77900000000000003},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.117,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.83499999999999996}]},{"osd":7,"last update":"Tue Nov 28 18:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.77600000000000002,"15min":0.78400000000000003},"min":{"1min":0.51900000000000002,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.89800000000000002,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":0.755},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.80800000000000005,"15min":0.81399999999999995},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.1679999999999999,"5min":1.341,"15min":1.341},"last":0.81000000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574879,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31716,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340124,"statfs":{"total":96636764160,"available":96604286976,"internally_reserved":0,"allocated":544768,"data_stored":221534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 18:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.57199999999999995,"15min":0.59899999999999998},"min":{"1min":0.311,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.55900000000000005,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.69699999999999995,"15min":0.74099999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.67100000000000004,"5min":4.0899999999999999,"15min":4.0899999999999999},"last":0.45100000000000001}]},{"osd":2,"last update":"Tue Nov 28 18:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.61799999999999999,"15min":0.65000000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.59799999999999998,"5min":3.8620000000000001,"15min":3.8620000000000001},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.69699999999999995,"15min":0.73499999999999999},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.66400000000000003,"5min":2.823,"15min":2.823},"last":0.40300000000000002}]},{"osd":3,"last update":"Tue Nov 28 18:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.71699999999999997,"15min":0.751},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.73699999999999999,"5min":4.0739999999999998,"15min":4.0739999999999998},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.82199999999999995,"15min":0.86399999999999999},"min":{"1min":0.47699999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.79600000000000004,"5min":3.6659999999999999,"15min":3.6659999999999999},"last":0.56299999999999994}]},{"osd":4,"last update":"Tue Nov 28 18:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.97599999999999998,"15min":1.03},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.81499999999999995,"5min":5.3540000000000001,"15min":5.3540000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.92200000000000004,"15min":0.96599999999999997},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.80800000000000005,"5min":5.5,"15min":5.5},"last":0.53000000000000003}]},{"osd":5,"last update":"Tue Nov 28 18:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":1.014,"15min":1.0700000000000001},"min":{"1min":0.58999999999999997,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.85999999999999999,"5min":5.4379999999999997,"15min":5.4379999999999997},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.75700000000000001,"5min":1.054,"15min":1.1040000000000001},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":0.91500000000000004,"5min":3.4500000000000002,"15min":3.4500000000000002},"last":0.748}]},{"osd":6,"last update":"Tue Nov 28 18:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.99099999999999999,"15min":1.03},"min":{"1min":0.58799999999999997,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.0089999999999999,"5min":3.0369999999999999,"15min":3.0369999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.72599999999999998,"5min":1.018,"15min":1.0669999999999999},"min":{"1min":0.59499999999999997,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":0.89700000000000002,"5min":5.4000000000000004,"15min":5.4000000000000004},"last":0.54200000000000004}]},{"osd":7,"last update":"Tue Nov 28 18:39:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.997,"15min":1.046},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.94599999999999995,"5min":5.5369999999999999,"15min":5.5369999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.78100000000000003,"5min":1.0429999999999999,"15min":1.087},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.96299999999999997,"5min":3.2480000000000002,"15min":3.2480000000000002},"last":0.77800000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574880,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32296,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339544,"statfs":{"total":96636764160,"available":96603693056,"internally_reserved":0,"allocated":1138688,"data_stored":811866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 18:39:23 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.40000000000000002,"15min":0.39800000000000002},"min":{"1min":0.27200000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.46000000000000002}]},{"osd":2,"last update":"Tue Nov 28 18:39:23 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.48099999999999998,"15min":0.47899999999999998},"min":{"1min":0.35899999999999999,"5min":0.308,"15min":0.308},"max":{"1min":0.65400000000000003,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.502,"15min":0.502},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.66800000000000004,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.499}]},{"osd":3,"last update":"Tue Nov 28 18:39:23 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.47899999999999998,"15min":0.47299999999999998},"min":{"1min":0.38100000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.70299999999999996,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.54500000000000004,"15min":0.54600000000000004},"min":{"1min":0.443,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.68100000000000005,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.434}]},{"osd":4,"last update":"Tue Nov 28 18:39:23 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.74299999999999999,"15min":0.73899999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.75700000000000001,"15min":0.753},"min":{"1min":0.56999999999999995,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.66700000000000004}]},{"osd":5,"last update":"Tue Nov 28 18:39:23 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.74299999999999999,"15min":0.745},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.99299999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.72199999999999998,"15min":0.72399999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.97699999999999998,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.68000000000000005}]},{"osd":6,"last update":"Tue Nov 28 18:39:23 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.76400000000000001,"15min":0.76600000000000001},"min":{"1min":0.60499999999999998,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.93200000000000005,"5min":1,"15min":1},"last":0.63},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.75900000000000001,"15min":0.76200000000000001},"min":{"1min":0.54400000000000004,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.95799999999999996,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.65900000000000003}]},{"osd":7,"last update":"Tue Nov 28 18:39:23 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.80700000000000005,"15min":0.81100000000000005},"min":{"1min":0.57799999999999996,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.0169999999999999,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.78500000000000003,"15min":0.79200000000000004},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.99099999999999999,"5min":1.079,"15min":1.079},"last":0.59999999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T18:39:41.540 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-28T18:39:41.541 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-28T18:39:41.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.725+0000 7f9200ed6640 1 Processor -- start 2023-11-28T18:39:41.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.725+0000 7f9200ed6640 1 -- start start 2023-11-28T18:39:41.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.725+0000 7f9200ed6640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f91fc0ce410 0x7f91fc164bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:41.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.725+0000 7f9200ed6640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91fc0ced50 con 0x7f91fc13d0e0 2023-11-28T18:39:41.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.725+0000 7f9200ed6640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91fc0cea70 con 0x7f91fc072570 2023-11-28T18:39:41.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.725+0000 7f9200ed6640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91fc13d4c0 con 0x7f91fc0ce410 2023-11-28T18:39:41.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.725+0000 7f91fa59c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f91fc13d0e0 0x7f91fc071e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38834/0 (socket says 172.21.15.45:38834) 2023-11-28T18:39:41.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.725+0000 7f91fa59c640 1 -- 172.21.15.45:0/39166104 learned_addr learned my addr 172.21.15.45:0/39166104 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:39:41.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.725+0000 7f91fad9d640 1 --2- 172.21.15.45:0/39166104 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f91fc0ce410 0x7f91fc164bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:41.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.725+0000 7f91f9d9b640 1 -- 172.21.15.45:0/39166104 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 662197996 0 0) 0x7f91fc0ced50 con 0x7f91fc13d0e0 2023-11-28T18:39:41.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.725+0000 7f91f9d9b640 1 -- 172.21.15.45:0/39166104 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91e8005740 con 0x7f91fc13d0e0 2023-11-28T18:39:41.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.725+0000 7f91f9d9b640 1 -- 172.21.15.45:0/39166104 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1678668443 0 0) 0x7f91e8005740 con 0x7f91fc13d0e0 2023-11-28T18:39:41.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.725+0000 7f91f9d9b640 1 -- 172.21.15.45:0/39166104 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f91fc0ce410 msgr2=0x7f91fc164bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:41.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.725+0000 7f91f9d9b640 1 --2- 172.21.15.45:0/39166104 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f91fc0ce410 0x7f91fc164bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:41.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.725+0000 7f91f9d9b640 1 -- 172.21.15.45:0/39166104 >> v1:172.21.15.190:6789/0 conn(0x7f91fc072570 legacy=0x7f91fc0cdd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:41.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.725+0000 7f91f9d9b640 1 -- 172.21.15.45:0/39166104 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91fc13d840 con 0x7f91fc13d0e0 2023-11-28T18:39:41.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.725+0000 7f91f9d9b640 1 -- 172.21.15.45:0/39166104 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4084481567 0 0) 0x7f91ec001680 con 0x7f91fc13d0e0 2023-11-28T18:39:41.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.725+0000 7f91f9d9b640 1 -- 172.21.15.45:0/39166104 >> v1:172.21.15.45:6789/0 conn(0x7f91fc13d0e0 legacy=0x7f91fc071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:41.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.725+0000 7f91f9d9b640 1 --2- 172.21.15.45:0/39166104 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91e8005bc0 0x7f91e8005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:41.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.725+0000 7f91f9d9b640 1 --2- 172.21.15.45:0/39166104 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f91fc0ce410 0x7f91e80069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:41.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.725+0000 7f91f9d9b640 1 --2- 172.21.15.45:0/39166104 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91e8006f20 0x7f91e80073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:41.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.725+0000 7f91f9d9b640 1 -- 172.21.15.45:0/39166104 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e800dd30 con 0x7f91e8006f20 2023-11-28T18:39:41.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.725+0000 7f91f9d9b640 1 -- 172.21.15.45:0/39166104 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e800de70 con 0x7f91e8005bc0 2023-11-28T18:39:41.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.725+0000 7f91f9d9b640 1 -- 172.21.15.45:0/39166104 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91e800e030 con 0x7f91fc0ce410 2023-11-28T18:39:41.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.725+0000 7f91fad9d640 1 --2- 172.21.15.45:0/39166104 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91e8006f20 0x7f91e80073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:41.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.725+0000 7f91fa59c640 1 --2- 172.21.15.45:0/39166104 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91e8005bc0 0x7f91e8005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:41.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.725+0000 7f91f3fff640 1 --2- 172.21.15.45:0/39166104 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f91fc0ce410 0x7f91e80069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:41.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.729+0000 7f91fad9d640 1 -- 172.21.15.45:0/39166104 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f91fc0ce410 msgr2=0x7f91e80069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:41.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.729+0000 7f91fad9d640 1 --2- 172.21.15.45:0/39166104 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f91fc0ce410 0x7f91e80069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:41.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.729+0000 7f91fad9d640 1 -- 172.21.15.45:0/39166104 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91e8005bc0 msgr2=0x7f91e8005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:41.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.729+0000 7f91fad9d640 1 --2- 172.21.15.45:0/39166104 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91e8005bc0 0x7f91e8005fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:41.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.729+0000 7f91fad9d640 1 -- 172.21.15.45:0/39166104 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e8005740 con 0x7f91e8006f20 2023-11-28T18:39:41.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.729+0000 7f91fad9d640 1 --2- 172.21.15.45:0/39166104 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91e8006f20 0x7f91e80073a0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f91f4009fc0 tx=0x7f91f401cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba3c84674d4208a4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:41.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.729+0000 7f91f9d9b640 1 -- 172.21.15.45:0/39166104 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f40a5c70 con 0x7f91e8006f20 2023-11-28T18:39:41.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.729+0000 7f91f9d9b640 1 -- 172.21.15.45:0/39166104 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91f400f040 con 0x7f91e8006f20 2023-11-28T18:39:41.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.729+0000 7f91f9d9b640 1 -- 172.21.15.45:0/39166104 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f40ad440 con 0x7f91e8006f20 2023-11-28T18:39:41.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.729+0000 7f9200ed6640 1 -- 172.21.15.45:0/39166104 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91e8006f20 msgr2=0x7f91e80073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:41.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.729+0000 7f9200ed6640 1 --2- 172.21.15.45:0/39166104 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91e8006f20 0x7f91e80073a0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f91f4009fc0 tx=0x7f91f401cc60 comp rx=0 tx=0).stop 2023-11-28T18:39:41.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.729+0000 7f91fad9d640 1 -- 172.21.15.45:0/39166104 reap_dead start 2023-11-28T18:39:41.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.729+0000 7f9200ed6640 1 -- 172.21.15.45:0/39166104 shutdown_connections 2023-11-28T18:39:41.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.729+0000 7f9200ed6640 1 -- 172.21.15.45:0/39166104 >> 172.21.15.45:0/39166104 conn(0x7f91fc0b0d00 msgr2=0x7f91fc0b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:41.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.733+0000 7f9200ed6640 1 -- 172.21.15.45:0/39166104 shutdown_connections 2023-11-28T18:39:41.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.733+0000 7f9200ed6640 1 -- 172.21.15.45:0/39166104 wait complete. 2023-11-28T18:39:41.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.733+0000 7f9200ed6640 1 Processor -- start 2023-11-28T18:39:41.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.733+0000 7f9200ed6640 1 -- start start 2023-11-28T18:39:41.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.733+0000 7f9200ed6640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f91e8006f20 0x7f91fc0b4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:41.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.733+0000 7f9200ed6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91fc0af430 0x7f91fc138da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:41.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.733+0000 7f9200ed6640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91fc139b10 0x7f91fc15c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:41.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.733+0000 7f9200ed6640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91fc0b3e70 con 0x7f91fc0af430 2023-11-28T18:39:41.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.733+0000 7f9200ed6640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91fc0b47d0 con 0x7f91fc139b10 2023-11-28T18:39:41.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.733+0000 7f9200ed6640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91fc0afba0 con 0x7f91e8006f20 2023-11-28T18:39:41.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.733+0000 7f91f3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91fc0af430 0x7f91fc138da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:41.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.733+0000 7f91f3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91fc0af430 0x7f91fc138da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38264/0 (socket says 172.21.15.45:38264) 2023-11-28T18:39:41.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.733+0000 7f91f3fff640 1 -- 172.21.15.45:0/3885173723 learned_addr learned my addr 172.21.15.45:0/3885173723 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:41.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.733+0000 7f91fad9d640 1 --2- 172.21.15.45:0/3885173723 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91fc139b10 0x7f91fc15c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:41.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.733+0000 7f91fa59c640 1 --2- 172.21.15.45:0/3885173723 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f91e8006f20 0x7f91fc0b4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:41.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.733+0000 7f91f3fff640 1 -- 172.21.15.45:0/3885173723 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f91e8006f20 msgr2=0x7f91fc0b4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:41.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.733+0000 7f91f3fff640 1 --2- 172.21.15.45:0/3885173723 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f91e8006f20 0x7f91fc0b4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:41.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.733+0000 7f91f3fff640 1 -- 172.21.15.45:0/3885173723 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91fc139b10 msgr2=0x7f91fc15c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:41.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.733+0000 7f91f3fff640 1 --2- 172.21.15.45:0/3885173723 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91fc139b10 0x7f91fc15c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:41.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.733+0000 7f91f3fff640 1 -- 172.21.15.45:0/3885173723 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91fc0af8c0 con 0x7f91fc0af430 2023-11-28T18:39:41.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.733+0000 7f91f3fff640 1 --2- 172.21.15.45:0/3885173723 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91fc0af430 0x7f91fc138da0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f91e400f520 tx=0x7f91e400f9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:41.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.737+0000 7f91f2ffd640 1 -- 172.21.15.45:0/3885173723 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e4017070 con 0x7f91fc0af430 2023-11-28T18:39:41.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.737+0000 7f91f2ffd640 1 -- 172.21.15.45:0/3885173723 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91e40052e0 con 0x7f91fc0af430 2023-11-28T18:39:41.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.737+0000 7f91f2ffd640 1 -- 172.21.15.45:0/3885173723 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e4005490 con 0x7f91fc0af430 2023-11-28T18:39:41.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.737+0000 7f9200ed6640 1 -- 172.21.15.45:0/3885173723 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91fc0b37b0 con 0x7f91fc0af430 2023-11-28T18:39:41.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.737+0000 7f9200ed6640 1 -- 172.21.15.45:0/3885173723 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91fc1392e0 con 0x7f91fc0af430 2023-11-28T18:39:41.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.737+0000 7f9200ed6640 1 -- 172.21.15.45:0/3885173723 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91fc069480 con 0x7f91fc0af430 2023-11-28T18:39:41.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.737+0000 7f91f2ffd640 1 -- 172.21.15.45:0/3885173723 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f91e4007020 con 0x7f91fc0af430 2023-11-28T18:39:41.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.737+0000 7f91f2ffd640 1 --2- 172.21.15.45:0/3885173723 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f91dc066900 0x7f91dc068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:41.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.737+0000 7f91f2ffd640 1 -- 172.21.15.45:0/3885173723 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f91e4083b40 con 0x7f91fc0af430 2023-11-28T18:39:41.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.737+0000 7f91fa59c640 1 --2- 172.21.15.45:0/3885173723 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f91dc066900 0x7f91dc068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:41.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.741+0000 7f91fa59c640 1 --2- 172.21.15.45:0/3885173723 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f91dc066900 0x7f91dc068dc0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f91ec001ec0 tx=0x7f91ec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:41.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.741+0000 7f91f2ffd640 1 -- 172.21.15.45:0/3885173723 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f91e4050da0 con 0x7f91fc0af430 2023-11-28T18:39:41.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.957+0000 7f9200ed6640 1 -- 172.21.15.45:0/3885173723 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f91fc0cd5d0 con 0x7f91fc0af430 2023-11-28T18:39:41.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.961+0000 7f91f2ffd640 1 -- 172.21.15.45:0/3885173723 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) v1 ==== 190+0+147 (secure 0 0 0) 0x7f91e40543c0 con 0x7f91fc0af430 2023-11-28T18:39:41.963 INFO:teuthology.orchestra.run.smithi045.stdout:[client.0] 2023-11-28T18:39:41.963 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQApM2ZlTJxNMBAAwJAMWm1Y180iNJmgHnWFnw== 2023-11-28T18:39:41.963 INFO:teuthology.orchestra.run.smithi045.stdout: caps mds = "allow" 2023-11-28T18:39:41.963 INFO:teuthology.orchestra.run.smithi045.stdout: caps mon = "allow r" 2023-11-28T18:39:41.963 INFO:teuthology.orchestra.run.smithi045.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-28T18:39:41.963 INFO:teuthology.orchestra.run.smithi045.stderr:updated caps for client.0 2023-11-28T18:39:41.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.961+0000 7f9200ed6640 1 -- 172.21.15.45:0/3885173723 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f91dc066900 msgr2=0x7f91dc068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:41.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.961+0000 7f9200ed6640 1 --2- 172.21.15.45:0/3885173723 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f91dc066900 0x7f91dc068dc0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f91ec001ec0 tx=0x7f91ec009040 comp rx=0 tx=0).stop 2023-11-28T18:39:41.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.961+0000 7f9200ed6640 1 -- 172.21.15.45:0/3885173723 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91fc0af430 msgr2=0x7f91fc138da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:41.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.961+0000 7f9200ed6640 1 --2- 172.21.15.45:0/3885173723 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91fc0af430 0x7f91fc138da0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f91e400f520 tx=0x7f91e400f9e0 comp rx=0 tx=0).stop 2023-11-28T18:39:41.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.961+0000 7f9200ed6640 1 -- 172.21.15.45:0/3885173723 shutdown_connections 2023-11-28T18:39:41.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.961+0000 7f9200ed6640 1 --2- 172.21.15.45:0/3885173723 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f91dc066900 0x7f91dc068dc0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:41.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.961+0000 7f9200ed6640 1 --2- 172.21.15.45:0/3885173723 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91fc139b10 0x7f91fc15c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:41.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.961+0000 7f9200ed6640 1 --2- 172.21.15.45:0/3885173723 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91fc0af430 0x7f91fc138da0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:41.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.961+0000 7f9200ed6640 1 --2- 172.21.15.45:0/3885173723 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f91e8006f20 0x7f91fc0b4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:41.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.961+0000 7f9200ed6640 1 -- 172.21.15.45:0/3885173723 >> 172.21.15.45:0/3885173723 conn(0x7f91fc0b0d00 msgr2=0x7f91fc13b810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:41.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.961+0000 7f9200ed6640 1 -- 172.21.15.45:0/3885173723 shutdown_connections 2023-11-28T18:39:41.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:41.961+0000 7f9200ed6640 1 -- 172.21.15.45:0/3885173723 wait complete. 2023-11-28T18:39:41.984 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T18:39:42.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.125+0000 7f644725a640 1 Processor -- start 2023-11-28T18:39:42.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.125+0000 7f644725a640 1 -- start start 2023-11-28T18:39:42.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.129+0000 7f644725a640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f644013cf70 0x7f644006c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:42.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.129+0000 7f644725a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f644006c840 0x7f644015a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:42.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.129+0000 7f644725a640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f644015b3e0 con 0x7f644015abb0 2023-11-28T18:39:42.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.129+0000 7f644725a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f644013d350 con 0x7f644006c840 2023-11-28T18:39:42.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.129+0000 7f644725a640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6440140520 con 0x7f644013cf70 2023-11-28T18:39:42.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.129+0000 7f643ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f644006c840 0x7f644015a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:42.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.129+0000 7f643ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f644006c840 0x7f644015a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38276/0 (socket says 172.21.15.45:38276) 2023-11-28T18:39:42.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.129+0000 7f643ffff640 1 -- 172.21.15.45:0/1653864857 learned_addr learned my addr 172.21.15.45:0/1653864857 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:42.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.129+0000 7f643ffff640 1 -- 172.21.15.45:0/1653864857 >> v2:172.21.15.190:3300/0 conn(0x7f644013cf70 msgr2=0x7f644006c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:42.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.129+0000 7f6444ff6640 1 --2- 172.21.15.45:0/1653864857 >> v2:172.21.15.190:3300/0 conn(0x7f644013cf70 0x7f644006c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:42.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.129+0000 7f643ffff640 1 --2- 172.21.15.45:0/1653864857 >> v2:172.21.15.190:3300/0 conn(0x7f644013cf70 0x7f644006c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:42.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.129+0000 7f643ffff640 1 -- 172.21.15.45:0/1653864857 >> v1:172.21.15.190:6789/0 conn(0x7f644015abb0 legacy=0x7f64400715b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:42.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.129+0000 7f643ffff640 1 -- 172.21.15.45:0/1653864857 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f644013f760 con 0x7f644006c840 2023-11-28T18:39:42.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.129+0000 7f6444ff6640 1 --2- 172.21.15.45:0/1653864857 >> v2:172.21.15.190:3300/0 conn(0x7f644013cf70 0x7f644006c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:39:42.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.133+0000 7f643ffff640 1 --2- 172.21.15.45:0/1653864857 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f644006c840 0x7f644015a670 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f644006b550 tx=0x7f642c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cd0be2685a7069d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:42.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.133+0000 7f643f7fe640 1 -- 172.21.15.45:0/1653864857 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642c0ab600 con 0x7f644006c840 2023-11-28T18:39:42.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.133+0000 7f643f7fe640 1 -- 172.21.15.45:0/1653864857 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f642c0a7050 con 0x7f644006c840 2023-11-28T18:39:42.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.133+0000 7f643f7fe640 1 -- 172.21.15.45:0/1653864857 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642c0ab980 con 0x7f644006c840 2023-11-28T18:39:42.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.133+0000 7f644725a640 1 -- 172.21.15.45:0/1653864857 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f644006c840 msgr2=0x7f644015a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:42.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.133+0000 7f644725a640 1 --2- 172.21.15.45:0/1653864857 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f644006c840 0x7f644015a670 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f644006b550 tx=0x7f642c01c430 comp rx=0 tx=0).stop 2023-11-28T18:39:42.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.133+0000 7f644725a640 1 -- 172.21.15.45:0/1653864857 shutdown_connections 2023-11-28T18:39:42.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.133+0000 7f644725a640 1 --2- 172.21.15.45:0/1653864857 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f644006c840 0x7f644015a670 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:42.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.133+0000 7f644725a640 1 --2- 172.21.15.45:0/1653864857 >> v2:172.21.15.190:3300/0 conn(0x7f644013cf70 0x7f644006c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:42.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.133+0000 7f644725a640 1 -- 172.21.15.45:0/1653864857 >> 172.21.15.45:0/1653864857 conn(0x7f644006a570 msgr2=0x7f644006a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:42.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.133+0000 7f644725a640 1 -- 172.21.15.45:0/1653864857 shutdown_connections 2023-11-28T18:39:42.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.133+0000 7f644725a640 1 -- 172.21.15.45:0/1653864857 wait complete. 2023-11-28T18:39:42.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.133+0000 7f644725a640 1 Processor -- start 2023-11-28T18:39:42.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.133+0000 7f644725a640 1 -- start start 2023-11-28T18:39:42.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.137+0000 7f644725a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f644006c840 0x7f64401f9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:42.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.137+0000 7f644725a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f644013cf70 0x7f6440135e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:42.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.137+0000 7f644725a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f644015abb0 0x7f644015c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:42.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.137+0000 7f644725a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64401fa140 con 0x7f644006c840 2023-11-28T18:39:42.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.137+0000 7f644725a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6440155340 con 0x7f644013cf70 2023-11-28T18:39:42.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.137+0000 7f644725a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6440155be0 con 0x7f644015abb0 2023-11-28T18:39:42.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.137+0000 7f6444ff6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f644006c840 0x7f64401f9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:42.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.137+0000 7f6444ff6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f644006c840 0x7f64401f9c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38286/0 (socket says 172.21.15.45:38286) 2023-11-28T18:39:42.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.137+0000 7f6444ff6640 1 -- 172.21.15.45:0/826614213 learned_addr learned my addr 172.21.15.45:0/826614213 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:42.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.137+0000 7f6444ff6640 1 -- 172.21.15.45:0/826614213 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f644015abb0 msgr2=0x7f644015c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:42.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.137+0000 7f64457f7640 1 --2- 172.21.15.45:0/826614213 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f644015abb0 0x7f644015c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:42.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.137+0000 7f643ffff640 1 --2- 172.21.15.45:0/826614213 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f644013cf70 0x7f6440135e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:42.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.137+0000 7f6444ff6640 1 --2- 172.21.15.45:0/826614213 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f644015abb0 0x7f644015c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:42.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.137+0000 7f6444ff6640 1 -- 172.21.15.45:0/826614213 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f644013cf70 msgr2=0x7f6440135e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:42.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.137+0000 7f6444ff6640 1 --2- 172.21.15.45:0/826614213 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f644013cf70 0x7f6440135e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:42.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.137+0000 7f6444ff6640 1 -- 172.21.15.45:0/826614213 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f642c0094d0 con 0x7f644006c840 2023-11-28T18:39:42.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.137+0000 7f643ffff640 1 --2- 172.21.15.45:0/826614213 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f644013cf70 0x7f6440135e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:39:42.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.137+0000 7f64457f7640 1 --2- 172.21.15.45:0/826614213 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f644015abb0 0x7f644015c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:39:42.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.137+0000 7f6444ff6640 1 --2- 172.21.15.45:0/826614213 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f644006c840 0x7f64401f9c00 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f643400c820 tx=0x7f643400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:42.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.137+0000 7f643d7fa640 1 -- 172.21.15.45:0/826614213 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6434007a30 con 0x7f644006c840 2023-11-28T18:39:42.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.137+0000 7f643d7fa640 1 -- 172.21.15.45:0/826614213 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6434007b90 con 0x7f644006c840 2023-11-28T18:39:42.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.137+0000 7f643d7fa640 1 -- 172.21.15.45:0/826614213 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643400ce10 con 0x7f644006c840 2023-11-28T18:39:42.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.137+0000 7f644725a640 1 -- 172.21.15.45:0/826614213 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6440158c20 con 0x7f644006c840 2023-11-28T18:39:42.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.137+0000 7f644725a640 1 -- 172.21.15.45:0/826614213 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6440155870 con 0x7f644006c840 2023-11-28T18:39:42.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.137+0000 7f644725a640 1 -- 172.21.15.45:0/826614213 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6440069480 con 0x7f644006c840 2023-11-28T18:39:42.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.137+0000 7f643d7fa640 1 -- 172.21.15.45:0/826614213 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f64340113f0 con 0x7f644006c840 2023-11-28T18:39:42.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.141+0000 7f643d7fa640 1 --2- 172.21.15.45:0/826614213 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f64240668d0 0x7f6424068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:42.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.141+0000 7f643d7fa640 1 -- 172.21.15.45:0/826614213 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6434084510 con 0x7f644006c840 2023-11-28T18:39:42.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.141+0000 7f643ffff640 1 --2- 172.21.15.45:0/826614213 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f64240668d0 0x7f6424068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:42.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.141+0000 7f643ffff640 1 --2- 172.21.15.45:0/826614213 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f64240668d0 0x7f6424068d90 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f642c0ad000 tx=0x7f642c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:42.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.145+0000 7f643d7fa640 1 -- 172.21.15.45:0/826614213 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6434051740 con 0x7f644006c840 2023-11-28T18:39:42.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.337+0000 7f644725a640 1 -- 172.21.15.45:0/826614213 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f644006d220 con 0x7f644006c840 2023-11-28T18:39:42.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.337+0000 7f643d7fa640 1 -- 172.21.15.45:0/826614213 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4910 (secure 0 0 0) 0x7f6434054d60 con 0x7f644006c840 2023-11-28T18:39:42.339 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:39:42.339 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":32,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5414,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/114066704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":114066704},{"type":"v1","addr":"172.21.15.190:6836","nonce":114066704}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5417,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/27225494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":27225494},{"type":"v1","addr":"172.21.15.190:6837","nonce":27225494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5973,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1061201705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":1061201705},{"type":"v1","addr":"172.21.15.45:6835","nonce":1061201705}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T18:39:36.424552+0000","modified":"2023-11-28T18:39:39.436358+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5976},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5976":{"gid":5976,"name":"c","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6834/2737877840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2737877840},{"type":"v1","addr":"172.21.15.45:6834","nonce":2737877840}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-28T18:39:42.340 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 32 2023-11-28T18:39:42.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.337+0000 7f644725a640 1 -- 172.21.15.45:0/826614213 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f64240668d0 msgr2=0x7f6424068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:42.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.337+0000 7f644725a640 1 --2- 172.21.15.45:0/826614213 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f64240668d0 0x7f6424068d90 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f642c0ad000 tx=0x7f642c008040 comp rx=0 tx=0).stop 2023-11-28T18:39:42.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.337+0000 7f644725a640 1 -- 172.21.15.45:0/826614213 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f644006c840 msgr2=0x7f64401f9c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:42.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.337+0000 7f644725a640 1 --2- 172.21.15.45:0/826614213 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f644006c840 0x7f64401f9c00 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f643400c820 tx=0x7f643400cce0 comp rx=0 tx=0).stop 2023-11-28T18:39:42.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.337+0000 7f644725a640 1 -- 172.21.15.45:0/826614213 shutdown_connections 2023-11-28T18:39:42.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.337+0000 7f644725a640 1 --2- 172.21.15.45:0/826614213 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f64240668d0 0x7f6424068d90 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:42.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.337+0000 7f644725a640 1 --2- 172.21.15.45:0/826614213 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f644015abb0 0x7f644015c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:42.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.337+0000 7f644725a640 1 --2- 172.21.15.45:0/826614213 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f644013cf70 0x7f6440135e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:42.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.337+0000 7f644725a640 1 --2- 172.21.15.45:0/826614213 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f644006c840 0x7f64401f9c00 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:42.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.337+0000 7f644725a640 1 -- 172.21.15.45:0/826614213 >> 172.21.15.45:0/826614213 conn(0x7f644006a570 msgr2=0x7f6440071450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:42.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.337+0000 7f644725a640 1 -- 172.21.15.45:0/826614213 shutdown_connections 2023-11-28T18:39:42.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.337+0000 7f644725a640 1 -- 172.21.15.45:0/826614213 wait complete. 2023-11-28T18:39:42.762 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 32, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-28T18:39:36.424552+0000', 'modified': '2023-11-28T18:39:39.436358+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5976}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5976': {'gid': 5976, 'name': 'c', 'rank': 0, 'incarnation': 29, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.45:6834/2737877840', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.45:6832', 'nonce': 2737877840}, {'type': 'v1', 'addr': '172.21.15.45:6834', 'nonce': 2737877840}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-28T18:39:42.763 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-28T18:39:42.763 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-28T18:39:42.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.905+0000 7f89cc032640 1 Processor -- start 2023-11-28T18:39:42.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.905+0000 7f89cc032640 1 -- start start 2023-11-28T18:39:42.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.909+0000 7f89cc032640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f89c406ca10 0x7f89c415a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:42.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.909+0000 7f89cc032640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f89c415abb0 0x7f89c40cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:42.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.909+0000 7f89cc032640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89c415b3e0 con 0x7f89c413cf70 2023-11-28T18:39:42.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.909+0000 7f89cc032640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89c413d350 con 0x7f89c406ca10 2023-11-28T18:39:42.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.909+0000 7f89cc032640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89c4140520 con 0x7f89c415abb0 2023-11-28T18:39:42.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.909+0000 7f89c95cd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f89c406ca10 0x7f89c415a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:42.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.909+0000 7f89ca5cf640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f89c415abb0 0x7f89c40cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:42.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.909+0000 7f89c95cd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f89c406ca10 0x7f89c415a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.45:55610/0 (socket says 172.21.15.45:55610) 2023-11-28T18:39:42.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.909+0000 7f89c95cd640 1 -- 172.21.15.45:0/3576602973 learned_addr learned my addr 172.21.15.45:0/3576602973 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:42.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.909+0000 7f89c95cd640 1 -- 172.21.15.45:0/3576602973 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f89c415abb0 msgr2=0x7f89c40cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:42.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.909+0000 7f89c95cd640 1 --2- 172.21.15.45:0/3576602973 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f89c415abb0 0x7f89c40cd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:42.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.909+0000 7f89c95cd640 1 -- 172.21.15.45:0/3576602973 >> v1:172.21.15.190:6789/0 conn(0x7f89c413cf70 legacy=0x7f89c406c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:42.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.909+0000 7f89c95cd640 1 -- 172.21.15.45:0/3576602973 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89c413f760 con 0x7f89c406ca10 2023-11-28T18:39:42.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.913+0000 7f89c95cd640 1 --2- 172.21.15.45:0/3576602973 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f89c406ca10 0x7f89c415a670 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f89b40098a0 tx=0x7f89b401c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8942b31fcef33df1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:42.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.913+0000 7f89c8dcc640 1 -- 172.21.15.45:0/3576602973 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b40ab660 con 0x7f89c406ca10 2023-11-28T18:39:42.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.913+0000 7f89c8dcc640 1 -- 172.21.15.45:0/3576602973 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89b40ab7c0 con 0x7f89c406ca10 2023-11-28T18:39:42.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.913+0000 7f89c8dcc640 1 -- 172.21.15.45:0/3576602973 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b40abb50 con 0x7f89c406ca10 2023-11-28T18:39:42.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.913+0000 7f89cc032640 1 -- 172.21.15.45:0/3576602973 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f89c406ca10 msgr2=0x7f89c415a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:42.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.913+0000 7f89cc032640 1 --2- 172.21.15.45:0/3576602973 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f89c406ca10 0x7f89c415a670 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f89b40098a0 tx=0x7f89b401c460 comp rx=0 tx=0).stop 2023-11-28T18:39:42.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.913+0000 7f89cc032640 1 -- 172.21.15.45:0/3576602973 shutdown_connections 2023-11-28T18:39:42.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.913+0000 7f89cc032640 1 --2- 172.21.15.45:0/3576602973 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f89c415abb0 0x7f89c40cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:42.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.913+0000 7f89cc032640 1 --2- 172.21.15.45:0/3576602973 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f89c406ca10 0x7f89c415a670 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:42.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.913+0000 7f89cc032640 1 -- 172.21.15.45:0/3576602973 >> 172.21.15.45:0/3576602973 conn(0x7f89c406a570 msgr2=0x7f89c406a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:42.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.913+0000 7f89cc032640 1 -- 172.21.15.45:0/3576602973 shutdown_connections 2023-11-28T18:39:42.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.913+0000 7f89cc032640 1 -- 172.21.15.45:0/3576602973 wait complete. 2023-11-28T18:39:42.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.913+0000 7f89cc032640 1 Processor -- start 2023-11-28T18:39:42.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.913+0000 7f89cc032640 1 -- start start 2023-11-28T18:39:42.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.917+0000 7f89cc032640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f89c406ca10 0x7f89c4156540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:42.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.917+0000 7f89cc032640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f89c413cf70 0x7f89c413b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:42.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.917+0000 7f89cc032640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89c415abb0 0x7f89c413bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:42.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.917+0000 7f89cc032640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c41369c0 con 0x7f89c415abb0 2023-11-28T18:39:42.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.917+0000 7f89cc032640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c4155130 con 0x7f89c406ca10 2023-11-28T18:39:42.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.917+0000 7f89cc032640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89c4167360 con 0x7f89c413cf70 2023-11-28T18:39:42.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.917+0000 7f89ca5cf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89c415abb0 0x7f89c413bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:42.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.917+0000 7f89ca5cf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89c415abb0 0x7f89c413bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38296/0 (socket says 172.21.15.45:38296) 2023-11-28T18:39:42.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.917+0000 7f89ca5cf640 1 -- 172.21.15.45:0/3099460773 learned_addr learned my addr 172.21.15.45:0/3099460773 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:42.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.917+0000 7f89c9dce640 1 --2- 172.21.15.45:0/3099460773 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f89c406ca10 0x7f89c4156540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:42.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.917+0000 7f89c95cd640 1 --2- 172.21.15.45:0/3099460773 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f89c413cf70 0x7f89c413b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:42.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.917+0000 7f89ca5cf640 1 -- 172.21.15.45:0/3099460773 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f89c413cf70 msgr2=0x7f89c413b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:42.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.917+0000 7f89ca5cf640 1 --2- 172.21.15.45:0/3099460773 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f89c413cf70 0x7f89c413b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:42.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.917+0000 7f89ca5cf640 1 -- 172.21.15.45:0/3099460773 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f89c406ca10 msgr2=0x7f89c4156540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:42.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.917+0000 7f89ca5cf640 1 --2- 172.21.15.45:0/3099460773 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f89c406ca10 0x7f89c4156540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:42.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.917+0000 7f89ca5cf640 1 -- 172.21.15.45:0/3099460773 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89b40094d0 con 0x7f89c415abb0 2023-11-28T18:39:42.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.917+0000 7f89ca5cf640 1 --2- 172.21.15.45:0/3099460773 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89c415abb0 0x7f89c413bb00 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f89bc00efc0 tx=0x7f89bc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:42.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.917+0000 7f89ba7fc640 1 -- 172.21.15.45:0/3099460773 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89bc009ba0 con 0x7f89c415abb0 2023-11-28T18:39:42.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.917+0000 7f89ba7fc640 1 -- 172.21.15.45:0/3099460773 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89bc00f040 con 0x7f89c415abb0 2023-11-28T18:39:42.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.917+0000 7f89cc032640 1 -- 172.21.15.45:0/3099460773 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89c4165e40 con 0x7f89c415abb0 2023-11-28T18:39:42.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.917+0000 7f89ba7fc640 1 -- 172.21.15.45:0/3099460773 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89bc0146c0 con 0x7f89c415abb0 2023-11-28T18:39:42.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.917+0000 7f89cc032640 1 -- 172.21.15.45:0/3099460773 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89c41675b0 con 0x7f89c415abb0 2023-11-28T18:39:42.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.917+0000 7f89ba7fc640 1 -- 172.21.15.45:0/3099460773 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f89bc014820 con 0x7f89c415abb0 2023-11-28T18:39:42.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.921+0000 7f89ba7fc640 1 --2- 172.21.15.45:0/3099460773 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f89a80668d0 0x7f89a8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:42.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.921+0000 7f89ba7fc640 1 -- 172.21.15.45:0/3099460773 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f89bc085130 con 0x7f89c415abb0 2023-11-28T18:39:42.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.921+0000 7f89cf39f000 1 Processor -- start 2023-11-28T18:39:42.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.921+0000 7f89c9dce640 1 --2- 172.21.15.45:0/3099460773 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f89a80668d0 0x7f89a8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:42.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.921+0000 7f89cf39f000 1 -- start start 2023-11-28T18:39:42.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.921+0000 7f89c9dce640 1 --2- 172.21.15.45:0/3099460773 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f89a80668d0 0x7f89a8068d90 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f89c40cee70 tx=0x7f89c0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:42.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.921+0000 7f89cf39f000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cb3b58ad30 0x55cb3b58b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:42.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.921+0000 7f89cf39f000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cb3b58b650 0x55cb3b53dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:42.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.921+0000 7f89cf39f000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cb3b53e500 0x55cb3b53e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:42.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.921+0000 7f89cf39f000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb3b407110 con 0x55cb3b58ad30 2023-11-28T18:39:42.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.921+0000 7f89cf39f000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb3b3979a0 con 0x55cb3b58b650 2023-11-28T18:39:42.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.921+0000 7f89cf39f000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cb3b394ed0 con 0x55cb3b53e500 2023-11-28T18:39:42.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.921+0000 7f89c9dce640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cb3b58ad30 0x55cb3b58b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:42.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.921+0000 7f89c9dce640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cb3b58ad30 0x55cb3b58b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38300/0 (socket says 172.21.15.45:38300) 2023-11-28T18:39:42.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.921+0000 7f89c9dce640 1 -- 172.21.15.45:0/2411061220 learned_addr learned my addr 172.21.15.45:0/2411061220 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:42.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.921+0000 7f89ca5cf640 1 --2- 172.21.15.45:0/2411061220 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cb3b53e500 0x55cb3b53e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:42.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.921+0000 7f89c95cd640 1 --2- 172.21.15.45:0/2411061220 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cb3b58b650 0x55cb3b53dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:42.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.921+0000 7f89c9dce640 1 -- 172.21.15.45:0/2411061220 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cb3b53e500 msgr2=0x55cb3b53e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:42.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.921+0000 7f89c9dce640 1 --2- 172.21.15.45:0/2411061220 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cb3b53e500 0x55cb3b53e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:42.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.921+0000 7f89c9dce640 1 -- 172.21.15.45:0/2411061220 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cb3b58b650 msgr2=0x55cb3b53dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:42.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.921+0000 7f89c9dce640 1 --2- 172.21.15.45:0/2411061220 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cb3b58b650 0x55cb3b53dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:42.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.921+0000 7f89c9dce640 1 -- 172.21.15.45:0/2411061220 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cb3b088890 con 0x55cb3b58ad30 2023-11-28T18:39:42.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.921+0000 7f89ca5cf640 1 --2- 172.21.15.45:0/2411061220 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cb3b53e500 0x55cb3b53e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:39:42.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.921+0000 7f89c95cd640 1 --2- 172.21.15.45:0/2411061220 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cb3b58b650 0x55cb3b53dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:39:42.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.921+0000 7f89c9dce640 1 --2- 172.21.15.45:0/2411061220 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cb3b58ad30 0x55cb3b58b110 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f89c000f8a0 tx=0x7f89c0012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4692d6358a37d73 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:42.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.921+0000 7f89a77fe640 1 -- 172.21.15.45:0/2411061220 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c00149d0 con 0x55cb3b58ad30 2023-11-28T18:39:42.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.921+0000 7f89a77fe640 1 -- 172.21.15.45:0/2411061220 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89c0014b30 con 0x55cb3b58ad30 2023-11-28T18:39:42.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.921+0000 7f89a77fe640 1 -- 172.21.15.45:0/2411061220 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c0014ea0 con 0x55cb3b58ad30 2023-11-28T18:39:42.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.925+0000 7f89cf39f000 1 -- 172.21.15.45:0/2411061220 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cb3b58ad30 msgr2=0x55cb3b58b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:42.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.925+0000 7f89cf39f000 1 --2- 172.21.15.45:0/2411061220 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cb3b58ad30 0x55cb3b58b110 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f89c000f8a0 tx=0x7f89c0012000 comp rx=0 tx=0).stop 2023-11-28T18:39:42.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.925+0000 7f89cf39f000 1 -- 172.21.15.45:0/2411061220 shutdown_connections 2023-11-28T18:39:42.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.925+0000 7f89cf39f000 1 --2- 172.21.15.45:0/2411061220 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cb3b53e500 0x55cb3b53e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:42.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.925+0000 7f89cf39f000 1 --2- 172.21.15.45:0/2411061220 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cb3b58b650 0x55cb3b53dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:42.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.925+0000 7f89cf39f000 1 --2- 172.21.15.45:0/2411061220 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cb3b58ad30 0x55cb3b58b110 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:42.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.925+0000 7f89cf39f000 1 -- 172.21.15.45:0/2411061220 >> 172.21.15.45:0/2411061220 conn(0x55cb3b56b8c0 msgr2=0x55cb3b56dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:42.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.925+0000 7f89cf39f000 1 -- 172.21.15.45:0/2411061220 shutdown_connections 2023-11-28T18:39:42.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.925+0000 7f89cf39f000 1 -- 172.21.15.45:0/2411061220 wait complete. 2023-11-28T18:39:42.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.925+0000 7f89cf39f000 1 -- start start 2023-11-28T18:39:42.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.925+0000 7f89cf39f000 1 Processor -- start 2023-11-28T18:39:42.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.925+0000 7f89cf39f000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cb3b53e500 0x55cb3b5444e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:42.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.925+0000 7f89cf39f000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cb3b58ad30 0x55cb3b544a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:42.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.925+0000 7f89cf39f000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cb3b58b650 0x55cb3b544f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:42.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.925+0000 7f89cf39f000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb3b3907c0 con 0x55cb3b53e500 2023-11-28T18:39:42.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.925+0000 7f89cf39f000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb3b348bf0 con 0x55cb3b58ad30 2023-11-28T18:39:42.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.925+0000 7f89cf39f000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cb3b34ea90 con 0x55cb3b58b650 2023-11-28T18:39:42.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.925+0000 7f89cf39f000 10 client.0 _ll_register_callbacks cb 0x55cb3b52be20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T18:39:42.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.925+0000 7f89c9dce640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cb3b53e500 0x55cb3b5444e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:42.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.925+0000 7f89c9dce640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cb3b53e500 0x55cb3b5444e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38302/0 (socket says 172.21.15.45:38302) 2023-11-28T18:39:42.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.925+0000 7f89c9dce640 1 -- 172.21.15.45:0/3657667013 learned_addr learned my addr 172.21.15.45:0/3657667013 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:42.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.925+0000 7f89c95cd640 1 --2- 172.21.15.45:0/3657667013 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cb3b58ad30 0x55cb3b544a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:42.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.925+0000 7f89ca5cf640 1 --2- 172.21.15.45:0/3657667013 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cb3b58b650 0x55cb3b544f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:42.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.925+0000 7f89c9dce640 1 -- 172.21.15.45:0/3657667013 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cb3b58b650 msgr2=0x55cb3b544f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:42.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.925+0000 7f89c9dce640 1 --2- 172.21.15.45:0/3657667013 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cb3b58b650 0x55cb3b544f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:42.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.925+0000 7f89c9dce640 1 -- 172.21.15.45:0/3657667013 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cb3b58ad30 msgr2=0x55cb3b544a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:42.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.925+0000 7f89c9dce640 1 --2- 172.21.15.45:0/3657667013 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cb3b58ad30 0x55cb3b544a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:42.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.925+0000 7f89c9dce640 1 -- 172.21.15.45:0/3657667013 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89c415b3e0 con 0x55cb3b53e500 2023-11-28T18:39:42.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.925+0000 7f89c95cd640 1 --2- 172.21.15.45:0/3657667013 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cb3b58ad30 0x55cb3b544a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:39:42.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.925+0000 7f89c9dce640 1 --2- 172.21.15.45:0/3657667013 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cb3b53e500 0x55cb3b5444e0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f89c0000f70 tx=0x7f89c0001130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b3efe555c5d0be1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:42.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.925+0000 7f89a4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-11-28T18:39:42.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.925+0000 7f89a4ff9640 1 -- 172.21.15.45:0/3657667013 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c0020a50 con 0x55cb3b53e500 2023-11-28T18:39:42.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.925+0000 7f89cf39f000 1 -- 172.21.15.45:0/3657667013 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cb3b352470 con 0x55cb3b53e500 2023-11-28T18:39:42.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.925+0000 7f89a4ff9640 1 -- 172.21.15.45:0/3657667013 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f89c001c040 con 0x55cb3b53e500 2023-11-28T18:39:42.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.925+0000 7f89a4ff9640 1 -- 172.21.15.45:0/3657667013 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f89c0020bb0 con 0x55cb3b53e500 2023-11-28T18:39:42.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.925+0000 7f89cf39f000 10 client.6108 fetch_fsmap learned FSMap version 32 2023-11-28T18:39:42.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.925+0000 7f89cf39f000 1 -- 172.21.15.45:0/3657667013 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x55cb3b351190 con 0x55cb3b53e500 2023-11-28T18:39:42.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.929+0000 7f89a4ff9640 1 -- 172.21.15.45:0/3657667013 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cb3b352470 con 0x55cb3b53e500 2023-11-28T18:39:42.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.929+0000 7f89a4ff9640 1 -- 172.21.15.45:0/3657667013 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 32) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f89c0012070 con 0x55cb3b53e500 2023-11-28T18:39:42.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.929+0000 7f89cf39f000 10 client.6108 fetch_fsmap finished waiting for FSMap version 32 2023-11-28T18:39:42.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.929+0000 7f89cf39f000 10 client.6108 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-28T18:39:42.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.929+0000 7f89cf39f000 20 client.6108 populate_metadata read hostname 'smithi045' 2023-11-28T18:39:42.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.929+0000 7f89cf39f000 1 --2- 172.21.15.45:0/3657667013 >> [v2:172.21.15.45:6832/2737877840,v1:172.21.15.45:6834/2737877840] conn(0x55cb3b545970 0x55cb3b59cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:42.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.929+0000 7f89cf39f000 4 client.6108 mds_command: new command op to 5976 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-28T18:39:42.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.929+0000 7f89cf39f000 1 -- 172.21.15.45:0/3657667013 --> [v2:172.21.15.45:6832/2737877840,v1:172.21.15.45:6834/2737877840] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cb3b355b50 con 0x55cb3b545970 2023-11-28T18:39:42.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.929+0000 7f89c95cd640 1 --2- 172.21.15.45:0/3657667013 >> [v2:172.21.15.45:6832/2737877840,v1:172.21.15.45:6834/2737877840] conn(0x55cb3b545970 0x55cb3b59cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:42.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.929+0000 7f89a4ff9640 10 client.6108 ms_handle_connect on v2:172.21.15.45:6832/2737877840 2023-11-28T18:39:42.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.929+0000 7f89c95cd640 1 --2- 172.21.15.45:0/3657667013 >> [v2:172.21.15.45:6832/2737877840,v1:172.21.15.45:6834/2737877840] conn(0x55cb3b545970 0x55cb3b59cff0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d87b2431972825e server_cookie=12eb8989ff77b4f3 in_seq=0 out_seq=0 2023-11-28T18:39:42.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.929+0000 7f89a4ff9640 1 -- 172.21.15.45:0/3657667013 <== mds.0 v2:172.21.15.45:6832/2737877840 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55cb3b355b50 con 0x55cb3b545970 2023-11-28T18:39:42.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.929+0000 7f89a4ff9640 10 client.6108 handle_command_reply: tid=0 2023-11-28T18:39:42.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.929+0000 7f89cf39f000 1 client.6108 shutdown 2023-11-28T18:39:42.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.929+0000 7f89cf39f000 1 -- 172.21.15.45:0/3657667013 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cb3b53e500 msgr2=0x55cb3b5444e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:42.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.929+0000 7f89cf39f000 1 --2- 172.21.15.45:0/3657667013 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cb3b53e500 0x55cb3b5444e0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f89c0000f70 tx=0x7f89c0001130 comp rx=0 tx=0).stop 2023-11-28T18:39:42.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.929+0000 7f89cf39f000 1 -- 172.21.15.45:0/3657667013 shutdown_connections 2023-11-28T18:39:42.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.929+0000 7f89cf39f000 1 --2- 172.21.15.45:0/3657667013 >> [v2:172.21.15.45:6832/2737877840,v1:172.21.15.45:6834/2737877840] conn(0x55cb3b545970 0x55cb3b59cff0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:42.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.929+0000 7f89cf39f000 1 --2- 172.21.15.45:0/3657667013 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cb3b58b650 0x55cb3b544f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:42.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.929+0000 7f89cf39f000 1 --2- 172.21.15.45:0/3657667013 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cb3b58ad30 0x55cb3b544a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:42.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.929+0000 7f89cf39f000 1 --2- 172.21.15.45:0/3657667013 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cb3b53e500 0x55cb3b5444e0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:42.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.929+0000 7f89a4ff9640 0 client.6108 ms_handle_reset on v2:172.21.15.45:6832/2737877840 2023-11-28T18:39:42.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.929+0000 7f89cf39f000 1 -- 172.21.15.45:0/3657667013 >> 172.21.15.45:0/3657667013 conn(0x55cb3b56b8c0 msgr2=0x55cb3b53d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:42.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.929+0000 7f89cf39f000 1 -- 172.21.15.45:0/3657667013 shutdown_connections 2023-11-28T18:39:42.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.929+0000 7f89cf39f000 1 -- 172.21.15.45:0/3657667013 wait complete. 2023-11-28T18:39:42.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.929+0000 7f89cf39f000 20 client.6108 trim_cache size 0 max 16384 2023-11-28T18:39:42.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.945+0000 7f89cf39f000 1 Processor -- start 2023-11-28T18:39:42.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.945+0000 7f89cf39f000 1 -- start start 2023-11-28T18:39:42.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.945+0000 7f89cf39f000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cb3b53e500 0x55cb3b56a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:42.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.945+0000 7f89cf39f000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cb3b58ad30 0x55cb3b56a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:42.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.945+0000 7f89cf39f000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cb3b58b650 0x55cb3b59cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:42.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.945+0000 7f89cf39f000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb3b049940 con 0x55cb3b53e500 2023-11-28T18:39:42.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.945+0000 7f89cf39f000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb3b365b70 con 0x55cb3b58ad30 2023-11-28T18:39:42.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.945+0000 7f89cf39f000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cb3b538430 con 0x55cb3b58b650 2023-11-28T18:39:42.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.945+0000 7f89c9dce640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cb3b53e500 0x55cb3b56a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:42.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.945+0000 7f89c9dce640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cb3b53e500 0x55cb3b56a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38308/0 (socket says 172.21.15.45:38308) 2023-11-28T18:39:42.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.945+0000 7f89c9dce640 1 -- 172.21.15.45:0/925328209 learned_addr learned my addr 172.21.15.45:0/925328209 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:42.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.945+0000 7f89c95cd640 1 --2- 172.21.15.45:0/925328209 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cb3b58ad30 0x55cb3b56a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:42.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.945+0000 7f89ca5cf640 1 --2- 172.21.15.45:0/925328209 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cb3b58b650 0x55cb3b59cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:42.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.945+0000 7f89c9dce640 1 -- 172.21.15.45:0/925328209 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cb3b58b650 msgr2=0x55cb3b59cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:42.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.945+0000 7f89c9dce640 1 --2- 172.21.15.45:0/925328209 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cb3b58b650 0x55cb3b59cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:42.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.945+0000 7f89c9dce640 1 -- 172.21.15.45:0/925328209 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cb3b58ad30 msgr2=0x55cb3b56a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:42.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.945+0000 7f89c9dce640 1 --2- 172.21.15.45:0/925328209 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cb3b58ad30 0x55cb3b56a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:42.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.945+0000 7f89c9dce640 1 -- 172.21.15.45:0/925328209 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cb3b53e370 con 0x55cb3b53e500 2023-11-28T18:39:42.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.949+0000 7f89c9dce640 1 --2- 172.21.15.45:0/925328209 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cb3b53e500 0x55cb3b56a3a0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f89c0001660 tx=0x7f89c002a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=997e5dc40884cfa5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:42.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.949+0000 7f89a7fff640 1 -- 172.21.15.45:0/925328209 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c0020620 con 0x55cb3b53e500 2023-11-28T18:39:42.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.949+0000 7f89a7fff640 1 -- 172.21.15.45:0/925328209 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89c0020a50 con 0x55cb3b53e500 2023-11-28T18:39:42.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.949+0000 7f89a7fff640 1 -- 172.21.15.45:0/925328209 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c002a610 con 0x55cb3b53e500 2023-11-28T18:39:42.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.949+0000 7f89cf39f000 1 -- 172.21.15.45:0/925328209 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cb3b53e500 msgr2=0x55cb3b56a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:42.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.949+0000 7f89cf39f000 1 --2- 172.21.15.45:0/925328209 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cb3b53e500 0x55cb3b56a3a0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f89c0001660 tx=0x7f89c002a000 comp rx=0 tx=0).stop 2023-11-28T18:39:42.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.949+0000 7f89cf39f000 1 -- 172.21.15.45:0/925328209 shutdown_connections 2023-11-28T18:39:42.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.949+0000 7f89cf39f000 1 --2- 172.21.15.45:0/925328209 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cb3b58b650 0x55cb3b59cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:42.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.949+0000 7f89cf39f000 1 --2- 172.21.15.45:0/925328209 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cb3b58ad30 0x55cb3b56a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:42.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.949+0000 7f89cf39f000 1 --2- 172.21.15.45:0/925328209 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cb3b53e500 0x55cb3b56a3a0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:42.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.949+0000 7f89cf39f000 1 -- 172.21.15.45:0/925328209 >> 172.21.15.45:0/925328209 conn(0x55cb3b56b8c0 msgr2=0x55cb3b53c720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:42.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.949+0000 7f89cf39f000 1 -- 172.21.15.45:0/925328209 shutdown_connections 2023-11-28T18:39:42.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.949+0000 7f89cf39f000 1 -- 172.21.15.45:0/925328209 wait complete. 2023-11-28T18:39:42.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.949+0000 7f89cf39f000 1 -- start start 2023-11-28T18:39:42.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.949+0000 7f89cf39f000 1 Processor -- start 2023-11-28T18:39:42.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.949+0000 7f89cf39f000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cb3b53e500 0x55cb3b5eb810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:42.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.949+0000 7f89cf39f000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cb3b58ad30 0x55cb3b5ebd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:42.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.949+0000 7f89cf39f000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cb3b58b650 0x55cb3b5a6a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:42.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.949+0000 7f89cf39f000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb3b359910 con 0x55cb3b53e500 2023-11-28T18:39:42.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.949+0000 7f89cf39f000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb3b32b8a0 con 0x55cb3b58ad30 2023-11-28T18:39:42.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.949+0000 7f89cf39f000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cb3b0891b0 con 0x55cb3b58b650 2023-11-28T18:39:42.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.949+0000 7f89cf39f000 10 client.0 _ll_register_callbacks cb 0x55cb3b407060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T18:39:42.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.949+0000 7f89c9dce640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cb3b53e500 0x55cb3b5eb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:42.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.949+0000 7f89c9dce640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cb3b53e500 0x55cb3b5eb810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38324/0 (socket says 172.21.15.45:38324) 2023-11-28T18:39:42.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.949+0000 7f89c9dce640 1 -- 172.21.15.45:0/3613154668 learned_addr learned my addr 172.21.15.45:0/3613154668 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:42.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.949+0000 7f89c95cd640 1 --2- 172.21.15.45:0/3613154668 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cb3b58ad30 0x55cb3b5ebd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:42.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.949+0000 7f89ca5cf640 1 --2- 172.21.15.45:0/3613154668 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cb3b58b650 0x55cb3b5a6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:42.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.949+0000 7f89c9dce640 1 -- 172.21.15.45:0/3613154668 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cb3b58b650 msgr2=0x55cb3b5a6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:42.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.953+0000 7f89c9dce640 1 --2- 172.21.15.45:0/3613154668 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cb3b58b650 0x55cb3b5a6a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:42.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.953+0000 7f89c9dce640 1 -- 172.21.15.45:0/3613154668 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cb3b58ad30 msgr2=0x55cb3b5ebd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:42.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.953+0000 7f89c9dce640 1 --2- 172.21.15.45:0/3613154668 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cb3b58ad30 0x55cb3b5ebd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:42.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.953+0000 7f89c9dce640 1 -- 172.21.15.45:0/3613154668 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cb3b351190 con 0x55cb3b53e500 2023-11-28T18:39:42.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.953+0000 7f89c95cd640 1 --2- 172.21.15.45:0/3613154668 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cb3b58ad30 0x55cb3b5ebd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:39:42.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.953+0000 7f89c9dce640 1 --2- 172.21.15.45:0/3613154668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cb3b53e500 0x55cb3b5eb810 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f89c0007f20 tx=0x7f89c000a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cde03a6140bb14e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:42.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.953+0000 7f89a4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-11-28T18:39:42.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.953+0000 7f89a4ff9640 1 -- 172.21.15.45:0/3613154668 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c004b070 con 0x55cb3b53e500 2023-11-28T18:39:42.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.953+0000 7f89a4ff9640 1 -- 172.21.15.45:0/3613154668 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f89c0034ac0 con 0x55cb3b53e500 2023-11-28T18:39:42.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.953+0000 7f89cf39f000 1 -- 172.21.15.45:0/3613154668 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cb3b38f110 con 0x55cb3b53e500 2023-11-28T18:39:42.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.953+0000 7f89a4ff9640 1 -- 172.21.15.45:0/3613154668 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f89c0020bc0 con 0x55cb3b53e500 2023-11-28T18:39:42.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.953+0000 7f89cf39f000 10 client.6114 fetch_fsmap learned FSMap version 32 2023-11-28T18:39:42.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.953+0000 7f89cf39f000 1 -- 172.21.15.45:0/3613154668 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x55cb3b337490 con 0x55cb3b53e500 2023-11-28T18:39:42.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.953+0000 7f89a4ff9640 1 -- 172.21.15.45:0/3613154668 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cb3b38f110 con 0x55cb3b53e500 2023-11-28T18:39:42.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.953+0000 7f89a4ff9640 1 -- 172.21.15.45:0/3613154668 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 32) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f89c004e020 con 0x55cb3b53e500 2023-11-28T18:39:42.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.953+0000 7f89cf39f000 10 client.6114 fetch_fsmap finished waiting for FSMap version 32 2023-11-28T18:39:42.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.953+0000 7f89cf39f000 10 client.6114 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-28T18:39:42.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.953+0000 7f89cf39f000 20 client.6114 populate_metadata read hostname 'smithi045' 2023-11-28T18:39:42.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.953+0000 7f89cf39f000 1 --2- 172.21.15.45:0/3613154668 >> [v2:172.21.15.45:6832/2737877840,v1:172.21.15.45:6834/2737877840] conn(0x55cb3b5a7430 0x55cb3b5a7810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:42.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.953+0000 7f89cf39f000 4 client.6114 mds_command: new command op to 5976 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-28T18:39:42.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.953+0000 7f89cf39f000 1 -- 172.21.15.45:0/3613154668 --> [v2:172.21.15.45:6832/2737877840,v1:172.21.15.45:6834/2737877840] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55cb3b3bd650 con 0x55cb3b5a7430 2023-11-28T18:39:42.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.953+0000 7f89c95cd640 1 --2- 172.21.15.45:0/3613154668 >> [v2:172.21.15.45:6832/2737877840,v1:172.21.15.45:6834/2737877840] conn(0x55cb3b5a7430 0x55cb3b5a7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:42.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.953+0000 7f89c95cd640 1 --2- 172.21.15.45:0/3613154668 >> [v2:172.21.15.45:6832/2737877840,v1:172.21.15.45:6834/2737877840] conn(0x55cb3b5a7430 0x55cb3b5a7810 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81b7cff98e911b39 server_cookie=5a5df1d6b1ea5071 in_seq=0 out_seq=0 2023-11-28T18:39:42.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.953+0000 7f89a4ff9640 10 client.6114 ms_handle_connect on v2:172.21.15.45:6832/2737877840 2023-11-28T18:39:42.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.953+0000 7f89a4ff9640 1 -- 172.21.15.45:0/3613154668 <== mds.0 v2:172.21.15.45:6832/2737877840 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55cb3b3bd650 con 0x55cb3b5a7430 2023-11-28T18:39:42.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.953+0000 7f89a4ff9640 10 client.6114 handle_command_reply: tid=0 2023-11-28T18:39:42.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.953+0000 7f89cf39f000 1 client.6114 shutdown 2023-11-28T18:39:42.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.953+0000 7f89cf39f000 1 -- 172.21.15.45:0/3613154668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cb3b53e500 msgr2=0x55cb3b5eb810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:42.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.953+0000 7f89cf39f000 1 --2- 172.21.15.45:0/3613154668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cb3b53e500 0x55cb3b5eb810 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f89c0007f20 tx=0x7f89c000a000 comp rx=0 tx=0).stop 2023-11-28T18:39:42.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.953+0000 7f89cf39f000 1 -- 172.21.15.45:0/3613154668 shutdown_connections 2023-11-28T18:39:42.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.953+0000 7f89cf39f000 1 --2- 172.21.15.45:0/3613154668 >> [v2:172.21.15.45:6832/2737877840,v1:172.21.15.45:6834/2737877840] conn(0x55cb3b5a7430 0x55cb3b5a7810 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:42.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.953+0000 7f89cf39f000 1 --2- 172.21.15.45:0/3613154668 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cb3b58b650 0x55cb3b5a6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:42.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.953+0000 7f89cf39f000 1 --2- 172.21.15.45:0/3613154668 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cb3b58ad30 0x55cb3b5ebd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:42.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.953+0000 7f89cf39f000 1 --2- 172.21.15.45:0/3613154668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cb3b53e500 0x55cb3b5eb810 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:42.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.953+0000 7f89a4ff9640 0 client.6114 ms_handle_reset on v2:172.21.15.45:6832/2737877840 2023-11-28T18:39:42.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.953+0000 7f89cf39f000 1 -- 172.21.15.45:0/3613154668 >> 172.21.15.45:0/3613154668 conn(0x55cb3b56b8c0 msgr2=0x55cb3b53cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:42.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.953+0000 7f89cf39f000 1 -- 172.21.15.45:0/3613154668 shutdown_connections 2023-11-28T18:39:42.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.953+0000 7f89cf39f000 1 -- 172.21.15.45:0/3613154668 wait complete. 2023-11-28T18:39:42.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.953+0000 7f89cf39f000 20 client.6114 trim_cache size 0 max 16384 2023-11-28T18:39:42.968 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-11-28T18:39:42.969 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_fsid": "d10f5cd6-1d00-4019-99b6-6fa435498a15", 2023-11-28T18:39:42.969 INFO:teuthology.orchestra.run.smithi045.stdout: "whoami": 0, 2023-11-28T18:39:42.969 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 5976, 2023-11-28T18:39:42.969 INFO:teuthology.orchestra.run.smithi045.stdout: "want_state": "up:active", 2023-11-28T18:39:42.969 INFO:teuthology.orchestra.run.smithi045.stdout: "state": "up:active", 2023-11-28T18:39:42.970 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs", 2023-11-28T18:39:42.970 INFO:teuthology.orchestra.run.smithi045.stdout: "rank_uptime": 5.9177997769999999, 2023-11-28T18:39:42.970 INFO:teuthology.orchestra.run.smithi045.stdout: "mdsmap_epoch": 32, 2023-11-28T18:39:42.970 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch": 46, 2023-11-28T18:39:42.970 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch_barrier": 46, 2023-11-28T18:39:42.971 INFO:teuthology.orchestra.run.smithi045.stdout: "uptime": 11.499647537 2023-11-28T18:39:42.971 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-11-28T18:39:42.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.953+0000 7f89cc032640 1 -- 172.21.15.45:0/3099460773 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f89a80668d0 msgr2=0x7f89a8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:42.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.953+0000 7f89cc032640 1 --2- 172.21.15.45:0/3099460773 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f89a80668d0 0x7f89a8068d90 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f89c40cee70 tx=0x7f89c0009040 comp rx=0 tx=0).stop 2023-11-28T18:39:42.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.953+0000 7f89cc032640 1 -- 172.21.15.45:0/3099460773 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89c415abb0 msgr2=0x7f89c413bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:42.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.953+0000 7f89cc032640 1 --2- 172.21.15.45:0/3099460773 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89c415abb0 0x7f89c413bb00 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f89bc00efc0 tx=0x7f89bc00c490 comp rx=0 tx=0).stop 2023-11-28T18:39:42.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.953+0000 7f89cc032640 1 -- 172.21.15.45:0/3099460773 shutdown_connections 2023-11-28T18:39:42.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.953+0000 7f89cc032640 1 --2- 172.21.15.45:0/3099460773 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f89a80668d0 0x7f89a8068d90 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:42.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.953+0000 7f89cc032640 1 --2- 172.21.15.45:0/3099460773 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89c415abb0 0x7f89c413bb00 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:42.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.953+0000 7f89cc032640 1 --2- 172.21.15.45:0/3099460773 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f89c413cf70 0x7f89c413b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:42.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.953+0000 7f89cc032640 1 --2- 172.21.15.45:0/3099460773 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f89c406ca10 0x7f89c4156540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:42.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.953+0000 7f89cc032640 1 -- 172.21.15.45:0/3099460773 >> 172.21.15.45:0/3099460773 conn(0x7f89c406a570 msgr2=0x7f89c415c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:42.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.953+0000 7f89cc032640 1 -- 172.21.15.45:0/3099460773 shutdown_connections 2023-11-28T18:39:42.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:42.957+0000 7f89cc032640 1 -- 172.21.15.45:0/3099460773 wait complete. 2023-11-28T18:39:42.977 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T18:39:43.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.121+0000 7f791d2fe640 1 Processor -- start 2023-11-28T18:39:43.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.121+0000 7f791d2fe640 1 -- start start 2023-11-28T18:39:43.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.121+0000 7f791d2fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f79180b1fa0 0x7f79180b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:43.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.121+0000 7f791d2fe640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79180afb30 con 0x7f791815d360 2023-11-28T18:39:43.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.121+0000 7f791d2fe640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79180ce940 con 0x7f79180d1b50 2023-11-28T18:39:43.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.121+0000 7f791d2fe640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79180cec00 con 0x7f79180b1fa0 2023-11-28T18:39:43.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.121+0000 7f7916ffd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f791815d360 0x7f79180d1440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38846/0 (socket says 172.21.15.45:38846) 2023-11-28T18:39:43.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.121+0000 7f7916ffd640 1 -- 172.21.15.45:0/3003553941 learned_addr learned my addr 172.21.15.45:0/3003553941 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:39:43.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.121+0000 7f79177fe640 1 --2- 172.21.15.45:0/3003553941 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f79180b1fa0 0x7f79180b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:43.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.121+0000 7f7915ffb640 1 -- 172.21.15.45:0/3003553941 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 266469784 0 0) 0x7f79180afb30 con 0x7f791815d360 2023-11-28T18:39:43.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.121+0000 7f7915ffb640 1 -- 172.21.15.45:0/3003553941 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7900003530 con 0x7f791815d360 2023-11-28T18:39:43.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.121+0000 7f7915ffb640 1 -- 172.21.15.45:0/3003553941 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3234414754 0 0) 0x7f79180ce940 con 0x7f79180d1b50 2023-11-28T18:39:43.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.121+0000 7f7915ffb640 1 -- 172.21.15.45:0/3003553941 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79180afb30 con 0x7f79180d1b50 2023-11-28T18:39:43.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.121+0000 7f7915ffb640 1 -- 172.21.15.45:0/3003553941 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4154568501 0 0) 0x7f7900003530 con 0x7f791815d360 2023-11-28T18:39:43.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.121+0000 7f7915ffb640 1 -- 172.21.15.45:0/3003553941 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f79180b1fa0 msgr2=0x7f79180b06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:43.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.121+0000 7f7915ffb640 1 --2- 172.21.15.45:0/3003553941 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f79180b1fa0 0x7f79180b06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:43.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.121+0000 7f7915ffb640 1 -- 172.21.15.45:0/3003553941 >> v1:172.21.15.190:6789/0 conn(0x7f79180d1b50 legacy=0x7f79180affc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:43.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.121+0000 7f7915ffb640 1 -- 172.21.15.45:0/3003553941 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79180ceee0 con 0x7f791815d360 2023-11-28T18:39:43.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.121+0000 7f7915ffb640 1 -- 172.21.15.45:0/3003553941 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4084481567 0 0) 0x7f7908001680 con 0x7f791815d360 2023-11-28T18:39:43.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.121+0000 7f7915ffb640 1 -- 172.21.15.45:0/3003553941 >> v1:172.21.15.45:6789/0 conn(0x7f791815d360 legacy=0x7f79180d1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:43.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.121+0000 7f7915ffb640 1 --2- 172.21.15.45:0/3003553941 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7900003b40 0x7f7900003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:43.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.121+0000 7f7915ffb640 1 --2- 172.21.15.45:0/3003553941 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f79180b1fa0 0x7f79000047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:43.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.121+0000 7f7915ffb640 1 --2- 172.21.15.45:0/3003553941 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7900004d10 0x7f7900005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:43.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.121+0000 7f7915ffb640 1 -- 172.21.15.45:0/3003553941 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79180cec00 con 0x7f7900003b40 2023-11-28T18:39:43.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.121+0000 7f7915ffb640 1 -- 172.21.15.45:0/3003553941 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f790000ba90 con 0x7f7900004d10 2023-11-28T18:39:43.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.121+0000 7f7915ffb640 1 -- 172.21.15.45:0/3003553941 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f790000bc50 con 0x7f79180b1fa0 2023-11-28T18:39:43.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.121+0000 7f7916ffd640 1 --2- 172.21.15.45:0/3003553941 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7900003b40 0x7f7900003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:43.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.121+0000 7f79167fc640 1 --2- 172.21.15.45:0/3003553941 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f79180b1fa0 0x7f79000047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:43.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.121+0000 7f79177fe640 1 --2- 172.21.15.45:0/3003553941 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7900004d10 0x7f7900005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:43.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.121+0000 7f7916ffd640 1 -- 172.21.15.45:0/3003553941 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f79180b1fa0 msgr2=0x7f79000047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:43.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.121+0000 7f7916ffd640 1 --2- 172.21.15.45:0/3003553941 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f79180b1fa0 0x7f79000047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:43.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.121+0000 7f7916ffd640 1 -- 172.21.15.45:0/3003553941 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7900004d10 msgr2=0x7f7900005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:39:43.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.121+0000 7f7916ffd640 1 --2- 172.21.15.45:0/3003553941 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7900004d10 0x7f7900005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:43.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.121+0000 7f7916ffd640 1 -- 172.21.15.45:0/3003553941 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7900003530 con 0x7f7900003b40 2023-11-28T18:39:43.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.125+0000 7f7916ffd640 1 --2- 172.21.15.45:0/3003553941 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7900003b40 0x7f7900003f40 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f790800c160 tx=0x7f790801cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=337125d34510e1b4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:43.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.125+0000 7f7915ffb640 1 -- 172.21.15.45:0/3003553941 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79080058e0 con 0x7f7900003b40 2023-11-28T18:39:43.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.125+0000 7f7915ffb640 1 -- 172.21.15.45:0/3003553941 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7908005a40 con 0x7f7900003b40 2023-11-28T18:39:43.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.125+0000 7f7915ffb640 1 -- 172.21.15.45:0/3003553941 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7908005e10 con 0x7f7900003b40 2023-11-28T18:39:43.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.125+0000 7f791d2fe640 1 -- 172.21.15.45:0/3003553941 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7900003b40 msgr2=0x7f7900003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:43.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.125+0000 7f791d2fe640 1 --2- 172.21.15.45:0/3003553941 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7900003b40 0x7f7900003f40 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f790800c160 tx=0x7f790801cbc0 comp rx=0 tx=0).stop 2023-11-28T18:39:43.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.125+0000 7f79177fe640 1 -- 172.21.15.45:0/3003553941 reap_dead start 2023-11-28T18:39:43.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.125+0000 7f791d2fe640 1 -- 172.21.15.45:0/3003553941 shutdown_connections 2023-11-28T18:39:43.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.125+0000 7f791d2fe640 1 -- 172.21.15.45:0/3003553941 >> 172.21.15.45:0/3003553941 conn(0x7f79180d2f60 msgr2=0x7f79180d3370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:43.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.125+0000 7f791d2fe640 1 -- 172.21.15.45:0/3003553941 shutdown_connections 2023-11-28T18:39:43.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.125+0000 7f791d2fe640 1 -- 172.21.15.45:0/3003553941 wait complete. 2023-11-28T18:39:43.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.129+0000 7f791d2fe640 1 Processor -- start 2023-11-28T18:39:43.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.129+0000 7f791d2fe640 1 -- start start 2023-11-28T18:39:43.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.129+0000 7f791d2fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7900003b40 0x7f7918156fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:43.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.129+0000 7f791d2fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f791815d950 0x7f791815ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:43.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.129+0000 7f791d2fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7918155bc0 0x7f7918156070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:43.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.129+0000 7f791d2fe640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79181565b0 con 0x7f7918155bc0 2023-11-28T18:39:43.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.129+0000 7f791d2fe640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7918156a60 con 0x7f791815d950 2023-11-28T18:39:43.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.129+0000 7f791d2fe640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f791815e4c0 con 0x7f7900003b40 2023-11-28T18:39:43.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.129+0000 7f79177fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7918155bc0 0x7f7918156070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:43.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.129+0000 7f79177fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7918155bc0 0x7f7918156070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38340/0 (socket says 172.21.15.45:38340) 2023-11-28T18:39:43.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.129+0000 7f79177fe640 1 -- 172.21.15.45:0/589751076 learned_addr learned my addr 172.21.15.45:0/589751076 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:39:43.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.129+0000 7f7916ffd640 1 --2- 172.21.15.45:0/589751076 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7900003b40 0x7f7918156fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:43.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.129+0000 7f79167fc640 1 --2- 172.21.15.45:0/589751076 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f791815d950 0x7f791815ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:43.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.129+0000 7f79177fe640 1 -- 172.21.15.45:0/589751076 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7900003b40 msgr2=0x7f7918156fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:43.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.129+0000 7f79177fe640 1 --2- 172.21.15.45:0/589751076 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7900003b40 0x7f7918156fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:43.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.129+0000 7f79177fe640 1 -- 172.21.15.45:0/589751076 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f791815d950 msgr2=0x7f791815ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:43.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.129+0000 7f79177fe640 1 --2- 172.21.15.45:0/589751076 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f791815d950 0x7f791815ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:43.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.129+0000 7f79177fe640 1 -- 172.21.15.45:0/589751076 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f791815e7a0 con 0x7f7918155bc0 2023-11-28T18:39:43.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.129+0000 7f79177fe640 1 --2- 172.21.15.45:0/589751076 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7918155bc0 0x7f7918156070 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f79180b9010 tx=0x7f791000f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:43.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.129+0000 7f78ff7fe640 1 -- 172.21.15.45:0/589751076 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791000e040 con 0x7f7918155bc0 2023-11-28T18:39:43.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.129+0000 7f78ff7fe640 1 -- 172.21.15.45:0/589751076 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f791000f040 con 0x7f7918155bc0 2023-11-28T18:39:43.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.129+0000 7f78ff7fe640 1 -- 172.21.15.45:0/589751076 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7910015430 con 0x7f7918155bc0 2023-11-28T18:39:43.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.129+0000 7f791d2fe640 1 -- 172.21.15.45:0/589751076 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f791815ea80 con 0x7f7918155bc0 2023-11-28T18:39:43.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.129+0000 7f791d2fe640 1 -- 172.21.15.45:0/589751076 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f791815f040 con 0x7f7918155bc0 2023-11-28T18:39:43.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.133+0000 7f791d2fe640 1 -- 172.21.15.45:0/589751076 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7918069410 con 0x7f7918155bc0 2023-11-28T18:39:43.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.133+0000 7f78ff7fe640 1 -- 172.21.15.45:0/589751076 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f7910015590 con 0x7f7918155bc0 2023-11-28T18:39:43.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.133+0000 7f78ff7fe640 1 --2- 172.21.15.45:0/589751076 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f7904066900 0x7f7904068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:39:43.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.133+0000 7f78ff7fe640 1 -- 172.21.15.45:0/589751076 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7910084b10 con 0x7f7918155bc0 2023-11-28T18:39:43.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.133+0000 7f7916ffd640 1 --2- 172.21.15.45:0/589751076 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f7904066900 0x7f7904068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:39:43.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.133+0000 7f7916ffd640 1 --2- 172.21.15.45:0/589751076 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f7904066900 0x7f7904068dc0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f79080aa000 tx=0x7f7908001a00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:39:43.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.137+0000 7f78ff7fe640 1 -- 172.21.15.45:0/589751076 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7910051cb0 con 0x7f7918155bc0 2023-11-28T18:39:43.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.329+0000 7f791d2fe640 1 -- 172.21.15.45:0/589751076 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f79180b1460 con 0x7f7918155bc0 2023-11-28T18:39:43.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.329+0000 7f78ff7fe640 1 -- 172.21.15.45:0/589751076 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v32) v1 ==== 53+0+73 (secure 0 0 0) 0x7f79100552d0 con 0x7f7918155bc0 2023-11-28T18:39:43.331 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T18:39:43.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.329+0000 7f791d2fe640 1 -- 172.21.15.45:0/589751076 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f7904066900 msgr2=0x7f7904068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:43.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.329+0000 7f791d2fe640 1 --2- 172.21.15.45:0/589751076 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f7904066900 0x7f7904068dc0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f79080aa000 tx=0x7f7908001a00 comp rx=0 tx=0).stop 2023-11-28T18:39:43.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.329+0000 7f791d2fe640 1 -- 172.21.15.45:0/589751076 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7918155bc0 msgr2=0x7f7918156070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:39:43.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.329+0000 7f791d2fe640 1 --2- 172.21.15.45:0/589751076 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7918155bc0 0x7f7918156070 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f79180b9010 tx=0x7f791000f1b0 comp rx=0 tx=0).stop 2023-11-28T18:39:43.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.329+0000 7f791d2fe640 1 -- 172.21.15.45:0/589751076 shutdown_connections 2023-11-28T18:39:43.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.329+0000 7f791d2fe640 1 --2- 172.21.15.45:0/589751076 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f7904066900 0x7f7904068dc0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:43.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.329+0000 7f791d2fe640 1 --2- 172.21.15.45:0/589751076 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7918155bc0 0x7f7918156070 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:43.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.329+0000 7f791d2fe640 1 --2- 172.21.15.45:0/589751076 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f791815d950 0x7f791815ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:43.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.329+0000 7f791d2fe640 1 --2- 172.21.15.45:0/589751076 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7900003b40 0x7f7918156fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:39:43.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.329+0000 7f791d2fe640 1 -- 172.21.15.45:0/589751076 >> 172.21.15.45:0/589751076 conn(0x7f79180d2f60 msgr2=0x7f791806c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:39:43.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.329+0000 7f791d2fe640 1 -- 172.21.15.45:0/589751076 shutdown_connections 2023-11-28T18:39:43.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:43.329+0000 7f791d2fe640 1 -- 172.21.15.45:0/589751076 wait complete. 2023-11-28T18:39:43.352 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-28T18:39:43.352 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T18:39:43.352 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi045.front.sepia.ceph.com 2023-11-28T18:39:43.352 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-28T18:39:43.352 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-28T18:39:43.352 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-28T18:39:43.352 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-28T18:39:43.352 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T18:39:43.352 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T18:39:43.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:39:43.353 DEBUG:teuthology.orchestra.run.smithi045:> ip addr 2023-11-28T18:39:43.363 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T18:39:43.364 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T18:39:43.364 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T18:39:43.364 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:39:43.364 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2023-11-28T18:39:43.364 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:39:43.364 INFO:teuthology.orchestra.run.smithi045.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T18:39:43.364 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a6 brd ff:ff:ff:ff:ff:ff 2023-11-28T18:39:43.364 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f0 2023-11-28T18:39:43.365 INFO:teuthology.orchestra.run.smithi045.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T18:39:43.365 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a7 brd ff:ff:ff:ff:ff:ff 2023-11-28T18:39:43.365 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f1 2023-11-28T18:39:43.365 INFO:teuthology.orchestra.run.smithi045.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T18:39:43.365 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:be brd ff:ff:ff:ff:ff:ff 2023-11-28T18:39:43.365 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f0 2023-11-28T18:39:43.365 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.21.15.45/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-11-28T18:39:43.365 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft 42274sec preferred_lft 42274sec 2023-11-28T18:39:43.365 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec4:7aff:febd:12be/64 scope link 2023-11-28T18:39:43.365 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:39:43.365 INFO:teuthology.orchestra.run.smithi045.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T18:39:43.365 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:bf brd ff:ff:ff:ff:ff:ff 2023-11-28T18:39:43.366 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f1 2023-11-28T18:39:43.366 INFO:teuthology.orchestra.run.smithi045.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T18:39:43.366 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 02:42:ab:69:35:3d brd ff:ff:ff:ff:ff:ff 2023-11-28T18:39:43.366 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T18:39:43.366 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:39:43.366 INFO:teuthology.orchestra.run.smithi045.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T18:39:43.366 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-28T18:39:43.366 INFO:teuthology.orchestra.run.smithi045.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-28T18:39:43.366 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:39:43.366 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-28T18:39:43.366 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:39:43.367 INFO:teuthology.orchestra.run.smithi045.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T18:39:43.367 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T18:39:43.367 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-28T18:39:43.367 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:39:43.367 INFO:teuthology.orchestra.run.smithi045.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T18:39:43.367 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T18:39:43.367 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-11-28T18:39:43.367 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:39:43.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:39:43.368 DEBUG:teuthology.orchestra.run.smithi045:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T18:39:43.428 INFO:teuthology.orchestra.run.smithi045.stdout:1 2023-11-28T18:39:43.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:39:43.431 DEBUG:teuthology.orchestra.run.smithi045:> route 2023-11-28T18:39:43.484 INFO:teuthology.orchestra.run.smithi045.stdout:Kernel IP routing table 2023-11-28T18:39:43.484 INFO:teuthology.orchestra.run.smithi045.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T18:39:43.484 INFO:teuthology.orchestra.run.smithi045.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-11-28T18:39:43.484 INFO:teuthology.orchestra.run.smithi045.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T18:39:43.484 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-11-28T18:39:43.484 INFO:teuthology.orchestra.run.smithi045.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T18:39:43.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:39:43.485 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-11-28T18:39:43.485 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-11-28T18:39:43.485 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-28T18:39:43.485 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-28T18:39:43.485 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-28T18:39:43.485 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-11-28T18:39:43.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:39:43.583 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-11-28T18:39:43.592 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-28T18:39:43.593 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-28T18:39:43.593 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T18:39:43.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:39:43.593 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set brx.0 up 2023-11-28T18:39:43.655 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-28T18:39:43.655 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T18:39:43.655 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-28T18:39:43.706 INFO:teuthology.orchestra.run.smithi045.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-28T18:39:43.707 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T18:39:43.707 DEBUG:teuthology.orchestra.run.smithi045:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-28T18:39:43.758 DEBUG:teuthology.orchestra.run.smithi045:> sudo modprobe fuse 2023-11-28T18:39:43.824 DEBUG:teuthology.orchestra.run.smithi045:> cat /proc/self/mounts | awk '{print $2}' 2023-11-28T18:39:43.876 INFO:teuthology.orchestra.run.smithi045.stdout:/sys 2023-11-28T18:39:43.876 INFO:teuthology.orchestra.run.smithi045.stdout:/proc 2023-11-28T18:39:43.876 INFO:teuthology.orchestra.run.smithi045.stdout:/dev 2023-11-28T18:39:43.876 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/pts 2023-11-28T18:39:43.876 INFO:teuthology.orchestra.run.smithi045.stdout:/run 2023-11-28T18:39:43.876 INFO:teuthology.orchestra.run.smithi045.stdout:/ 2023-11-28T18:39:43.877 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/security 2023-11-28T18:39:43.877 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/shm 2023-11-28T18:39:43.877 INFO:teuthology.orchestra.run.smithi045.stdout:/run/lock 2023-11-28T18:39:43.877 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/cgroup 2023-11-28T18:39:43.877 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/pstore 2023-11-28T18:39:43.877 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/bpf 2023-11-28T18:39:43.877 INFO:teuthology.orchestra.run.smithi045.stdout:/proc/sys/fs/binfmt_misc 2023-11-28T18:39:43.877 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/hugepages 2023-11-28T18:39:43.877 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/mqueue 2023-11-28T18:39:43.877 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/debug 2023-11-28T18:39:43.877 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/tracing 2023-11-28T18:39:43.877 INFO:teuthology.orchestra.run.smithi045.stdout:/proc/fs/nfsd 2023-11-28T18:39:43.878 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/fuse/connections 2023-11-28T18:39:43.878 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/config 2023-11-28T18:39:43.878 INFO:teuthology.orchestra.run.smithi045.stdout:/run/credentials/systemd-sysusers.service 2023-11-28T18:39:43.878 INFO:teuthology.orchestra.run.smithi045.stdout:/run/rpc_pipefs 2023-11-28T18:39:43.878 INFO:teuthology.orchestra.run.smithi045.stdout:/run/user/1000 2023-11-28T18:39:43.878 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph 2023-11-28T18:39:43.878 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-0 2023-11-28T18:39:43.878 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-1 2023-11-28T18:39:43.878 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-2 2023-11-28T18:39:43.878 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-3 2023-11-28T18:39:43.878 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns 2023-11-28T18:39:43.878 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T18:39:43.879 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T18:39:43.879 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T18:39:43.879 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T18:39:43.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:39:43.880 DEBUG:teuthology.orchestra.run.smithi045:> ls /sys/fs/fuse/connections 2023-11-28T18:39:43.931 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-28T18:39:43.932 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-28T18:39:43.981 DEBUG:teuthology.orchestra.run.smithi045:> sudo modprobe fuse 2023-11-28T18:39:44.003 DEBUG:teuthology.orchestra.run.smithi045:> cat /proc/self/mounts | awk '{print $2}' 2023-11-28T18:39:44.058 INFO:teuthology.orchestra.run.smithi045.stdout:/sys 2023-11-28T18:39:44.058 INFO:teuthology.orchestra.run.smithi045.stdout:/proc 2023-11-28T18:39:44.058 INFO:teuthology.orchestra.run.smithi045.stdout:/dev 2023-11-28T18:39:44.058 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/pts 2023-11-28T18:39:44.058 INFO:teuthology.orchestra.run.smithi045.stdout:/run 2023-11-28T18:39:44.058 INFO:teuthology.orchestra.run.smithi045.stdout:/ 2023-11-28T18:39:44.058 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/security 2023-11-28T18:39:44.059 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/shm 2023-11-28T18:39:44.059 INFO:teuthology.orchestra.run.smithi045.stdout:/run/lock 2023-11-28T18:39:44.059 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/cgroup 2023-11-28T18:39:44.059 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/pstore 2023-11-28T18:39:44.059 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/bpf 2023-11-28T18:39:44.059 INFO:teuthology.orchestra.run.smithi045.stdout:/proc/sys/fs/binfmt_misc 2023-11-28T18:39:44.059 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/hugepages 2023-11-28T18:39:44.059 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/mqueue 2023-11-28T18:39:44.060 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/debug 2023-11-28T18:39:44.060 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/tracing 2023-11-28T18:39:44.060 INFO:teuthology.orchestra.run.smithi045.stdout:/proc/fs/nfsd 2023-11-28T18:39:44.060 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/fuse/connections 2023-11-28T18:39:44.060 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/config 2023-11-28T18:39:44.060 INFO:teuthology.orchestra.run.smithi045.stdout:/run/credentials/systemd-sysusers.service 2023-11-28T18:39:44.060 INFO:teuthology.orchestra.run.smithi045.stdout:/run/rpc_pipefs 2023-11-28T18:39:44.060 INFO:teuthology.orchestra.run.smithi045.stdout:/run/user/1000 2023-11-28T18:39:44.060 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph 2023-11-28T18:39:44.060 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-0 2023-11-28T18:39:44.060 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-1 2023-11-28T18:39:44.060 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-2 2023-11-28T18:39:44.060 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-3 2023-11-28T18:39:44.061 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns 2023-11-28T18:39:44.061 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T18:39:44.061 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T18:39:44.061 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T18:39:44.061 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T18:39:44.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:39:44.062 DEBUG:teuthology.orchestra.run.smithi045:> ls /sys/fs/fuse/connections 2023-11-28T18:39:44.082 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:2023-11-28T18:39:44.077+0000 7f936a049580 -1 init, newargv = 0x556b00179e40 newargc=15 2023-11-28T18:39:44.082 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:ceph-fuse[50128]: starting ceph client 2023-11-28T18:39:44.089 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:ceph-fuse[50128]: starting fuse 2023-11-28T18:39:44.091 INFO:teuthology.orchestra.run.smithi045.stdout:43 2023-11-28T18:39:44.091 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-11-28T18:39:44.091 DEBUG:teuthology.orchestra.run.smithi045:> sudo stdin-killer -- python3 -c ' 2023-11-28T18:39:44.092 DEBUG:teuthology.orchestra.run.smithi045:> import glob 2023-11-28T18:39:44.092 DEBUG:teuthology.orchestra.run.smithi045:> import re 2023-11-28T18:39:44.092 DEBUG:teuthology.orchestra.run.smithi045:> import os 2023-11-28T18:39:44.092 DEBUG:teuthology.orchestra.run.smithi045:> import subprocess 2023-11-28T18:39:44.092 DEBUG:teuthology.orchestra.run.smithi045:> 2023-11-28T18:39:44.092 DEBUG:teuthology.orchestra.run.smithi045:> def _find_admin_socket(client_name): 2023-11-28T18:39:44.092 DEBUG:teuthology.orchestra.run.smithi045:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-28T18:39:44.092 DEBUG:teuthology.orchestra.run.smithi045:> files = glob.glob(asok_path) 2023-11-28T18:39:44.092 DEBUG:teuthology.orchestra.run.smithi045:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-28T18:39:44.092 DEBUG:teuthology.orchestra.run.smithi045:> 2023-11-28T18:39:44.092 DEBUG:teuthology.orchestra.run.smithi045:> # Given a non-glob path, it better be there 2023-11-28T18:39:44.093 DEBUG:teuthology.orchestra.run.smithi045:> if "*" not in asok_path: 2023-11-28T18:39:44.093 DEBUG:teuthology.orchestra.run.smithi045:> assert(len(files) == 1) 2023-11-28T18:39:44.093 DEBUG:teuthology.orchestra.run.smithi045:> return files[0] 2023-11-28T18:39:44.093 DEBUG:teuthology.orchestra.run.smithi045:> 2023-11-28T18:39:44.093 DEBUG:teuthology.orchestra.run.smithi045:> for f in files: 2023-11-28T18:39:44.093 DEBUG:teuthology.orchestra.run.smithi045:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-28T18:39:44.093 DEBUG:teuthology.orchestra.run.smithi045:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-28T18:39:44.093 DEBUG:teuthology.orchestra.run.smithi045:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-28T18:39:44.093 DEBUG:teuthology.orchestra.run.smithi045:> contents = proc_f.read() 2023-11-28T18:39:44.093 DEBUG:teuthology.orchestra.run.smithi045:> if mountpoint in contents: 2023-11-28T18:39:44.093 DEBUG:teuthology.orchestra.run.smithi045:> return f 2023-11-28T18:39:44.094 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-28T18:39:44.094 DEBUG:teuthology.orchestra.run.smithi045:> 2023-11-28T18:39:44.094 DEBUG:teuthology.orchestra.run.smithi045:> print(_find_admin_socket("client.0")) 2023-11-28T18:39:44.094 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-11-28T18:39:44.222 INFO:teuthology.orchestra.run.smithi045.stdout:/var/run/ceph/ceph-client.0.50128.asok 2023-11-28T18:39:44.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:39:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-28T18:39:44.233 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.50128.asok 2023-11-28T18:39:44.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:39:44.234 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.50128.asok status 2023-11-28T18:39:44.412 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-11-28T18:39:44.413 INFO:teuthology.orchestra.run.smithi045.stdout: "metadata": { 2023-11-28T18:39:44.413 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_sha1": "47c1c547372ed5bff7984647dc200bac0e019caf", 2023-11-28T18:39:44.413 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_version": "ceph version 18.0.0-7531-g47c1c547 (47c1c547372ed5bff7984647dc200bac0e019caf) reef (dev)", 2023-11-28T18:39:44.413 INFO:teuthology.orchestra.run.smithi045.stdout: "entity_id": "0", 2023-11-28T18:39:44.413 INFO:teuthology.orchestra.run.smithi045.stdout: "hostname": "smithi045", 2023-11-28T18:39:44.413 INFO:teuthology.orchestra.run.smithi045.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-28T18:39:44.414 INFO:teuthology.orchestra.run.smithi045.stdout: "pid": "50128", 2023-11-28T18:39:44.414 INFO:teuthology.orchestra.run.smithi045.stdout: "root": "/" 2023-11-28T18:39:44.414 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:39:44.414 INFO:teuthology.orchestra.run.smithi045.stdout: "dentry_count": 0, 2023-11-28T18:39:44.414 INFO:teuthology.orchestra.run.smithi045.stdout: "dentry_pinned_count": 0, 2023-11-28T18:39:44.414 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 6126, 2023-11-28T18:39:44.415 INFO:teuthology.orchestra.run.smithi045.stdout: "inst": { 2023-11-28T18:39:44.415 INFO:teuthology.orchestra.run.smithi045.stdout: "name": { 2023-11-28T18:39:44.415 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "client", 2023-11-28T18:39:44.415 INFO:teuthology.orchestra.run.smithi045.stdout: "num": 6126 2023-11-28T18:39:44.415 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:39:44.415 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": { 2023-11-28T18:39:44.416 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-11-28T18:39:44.416 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "192.168.0.1:0", 2023-11-28T18:39:44.416 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1726672068 2023-11-28T18:39:44.416 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:39:44.416 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:39:44.416 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": { 2023-11-28T18:39:44.416 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-11-28T18:39:44.417 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "192.168.0.1:0", 2023-11-28T18:39:44.417 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1726672068 2023-11-28T18:39:44.417 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:39:44.417 INFO:teuthology.orchestra.run.smithi045.stdout: "inst_str": "client.6126 192.168.0.1:0/1726672068", 2023-11-28T18:39:44.417 INFO:teuthology.orchestra.run.smithi045.stdout: "addr_str": "192.168.0.1:0/1726672068", 2023-11-28T18:39:44.417 INFO:teuthology.orchestra.run.smithi045.stdout: "inode_count": 1, 2023-11-28T18:39:44.417 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_epoch": 32, 2023-11-28T18:39:44.418 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_epoch": 46, 2023-11-28T18:39:44.418 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_epoch_barrier": 0, 2023-11-28T18:39:44.418 INFO:teuthology.orchestra.run.smithi045.stdout: "blocklisted": false, 2023-11-28T18:39:44.418 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs" 2023-11-28T18:39:44.418 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-11-28T18:39:44.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:39:44.428 DEBUG:teuthology.orchestra.run.smithi045:> stat --file-system '--printf=%T 2023-11-28T18:39:44.428 DEBUG:teuthology.orchestra.run.smithi045:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-28T18:39:44.439 INFO:teuthology.orchestra.run.smithi045.stdout:fuseblk 2023-11-28T18:39:44.439 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-28T18:39:44.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:39:44.439 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-28T18:39:44.503 INFO:tasks.workunit:Pulling workunits from ref 47c1c547372ed5bff7984647dc200bac0e019caf 2023-11-28T18:39:44.504 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-11-28T18:39:44.504 DEBUG:teuthology.orchestra.run.smithi045:> stat -- /home/ubuntu/cephtest/mnt.0 2023-11-28T18:39:44.555 INFO:teuthology.orchestra.run.smithi045.stdout: File: /home/ubuntu/cephtest/mnt.0 2023-11-28T18:39:44.556 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2023-11-28T18:39:44.556 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 2bh/43d Inode: 1 Links: 2 2023-11-28T18:39:44.556 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T18:39:44.556 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-11-28T18:39:44.556 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2023-11-28 18:39:37.040757230 +0000 2023-11-28T18:39:44.556 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2023-11-28 18:39:44.501178096 +0000 2023-11-28T18:39:44.556 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: - 2023-11-28T18:39:44.556 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2023-11-28T18:39:44.556 DEBUG:teuthology.orchestra.run.smithi045:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2023-11-28T18:39:44.626 INFO:tasks.workunit:timeout=1h 2023-11-28T18:39:44.627 INFO:tasks.workunit:cleanup=True 2023-11-28T18:39:44.627 DEBUG:teuthology.orchestra.run.smithi045:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 47c1c547372ed5bff7984647dc200bac0e019caf 2023-11-28T18:39:44.680 INFO:tasks.workunit.client.0.smithi045.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-11-28T18:39:53.466 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:39:53.471 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:40:23.721 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:40:23.726 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:40:53.811 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:40:53.816 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:40:56.690 INFO:tasks.workunit.client.0.smithi045.stderr:Updating files: 64% (7875/12117) Updating files: 65% (7877/12117) Updating files: 66% (7998/12117) Updating files: 67% (8119/12117) Updating files: 68% (8240/12117) Updating files: 69% (8361/12117) Updating files: 70% (8482/12117) Updating files: 71% (8604/12117) Updating files: 72% (8725/12117) Updating files: 73% (8846/12117) Updating files: 74% (8967/12117) Updating files: 75% (9088/12117) Updating files: 76% (9209/12117) Updating files: 77% (9331/12117) Updating files: 78% (9452/12117) Updating files: 79% (9573/12117) Updating files: 80% (9694/12117) Updating files: 81% (9815/12117) Updating files: 82% (9936/12117) Updating files: 83% (10058/12117) Updating files: 84% (10179/12117) Updating files: 85% (10300/12117) Updating files: 86% (10421/12117) Updating files: 87% (10542/12117) Updating files: 88% (10663/12117) Updating files: 89% (10785/12117) Updating files: 90% (10906/12117) Updating files: 91% (11027/12117) Updating files: 92% (11148/12117) Updating files: 93% (11269/12117) Updating files: 94% (11390/12117) Updating files: 95% (11512/12117) Updating files: 96% (11633/12117) Updating files: 97% (11754/12117) Updating files: 98% (11875/12117) Updating files: 99% (11996/12117) Updating files: 100% (12117/12117) Updating files: 100% (12117/12117), done. 2023-11-28T18:40:57.229 INFO:tasks.workunit.client.0.smithi045.stderr:Note: switching to '47c1c547372ed5bff7984647dc200bac0e019caf'. 2023-11-28T18:40:57.229 INFO:tasks.workunit.client.0.smithi045.stderr: 2023-11-28T18:40:57.229 INFO:tasks.workunit.client.0.smithi045.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-11-28T18:40:57.229 INFO:tasks.workunit.client.0.smithi045.stderr:changes and commit them, and you can discard any commits you make in this 2023-11-28T18:40:57.229 INFO:tasks.workunit.client.0.smithi045.stderr:state without impacting any branches by switching back to a branch. 2023-11-28T18:40:57.229 INFO:tasks.workunit.client.0.smithi045.stderr: 2023-11-28T18:40:57.230 INFO:tasks.workunit.client.0.smithi045.stderr:If you want to create a new branch to retain commits you create, you may 2023-11-28T18:40:57.230 INFO:tasks.workunit.client.0.smithi045.stderr:do so (now or later) by using -c with the switch command. Example: 2023-11-28T18:40:57.230 INFO:tasks.workunit.client.0.smithi045.stderr: 2023-11-28T18:40:57.230 INFO:tasks.workunit.client.0.smithi045.stderr: git switch -c 2023-11-28T18:40:57.230 INFO:tasks.workunit.client.0.smithi045.stderr: 2023-11-28T18:40:57.230 INFO:tasks.workunit.client.0.smithi045.stderr:Or undo this operation with: 2023-11-28T18:40:57.230 INFO:tasks.workunit.client.0.smithi045.stderr: 2023-11-28T18:40:57.230 INFO:tasks.workunit.client.0.smithi045.stderr: git switch - 2023-11-28T18:40:57.230 INFO:tasks.workunit.client.0.smithi045.stderr: 2023-11-28T18:40:57.230 INFO:tasks.workunit.client.0.smithi045.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-11-28T18:40:57.230 INFO:tasks.workunit.client.0.smithi045.stderr: 2023-11-28T18:40:57.230 INFO:tasks.workunit.client.0.smithi045.stderr:HEAD is now at 47c1c547372 Merge PR #51931 into wip-vshankar-testing-20231127.102654 2023-11-28T18:40:57.233 DEBUG:teuthology.orchestra.run.smithi045:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-11-28T18:40:57.243 INFO:tasks.workunit.client.0.smithi045.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-11-28T18:40:57.246 INFO:tasks.workunit.client.0.smithi045.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-11-28T18:40:57.246 INFO:tasks.workunit.client.0.smithi045.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-11-28T18:40:58.030 INFO:tasks.workunit.client.0.smithi045.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-11-28T18:40:58.120 INFO:tasks.workunit.client.0.smithi045.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-11-28T18:40:58.178 INFO:tasks.workunit.client.0.smithi045.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-11-28T18:40:58.180 INFO:tasks.workunit.client.0.smithi045.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-11-28T18:40:58.181 INFO:tasks.workunit.client.0.smithi045.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-11-28T18:40:58.236 INFO:tasks.workunit.client.0.smithi045.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-11-28T18:40:58.242 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T18:40:58.242 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-11-28T18:40:58.294 INFO:tasks.workunit:Running workunits matching fs/misc/trivial_sync.sh on client.0... 2023-11-28T18:40:58.296 INFO:tasks.workunit:Running workunit fs/misc/trivial_sync.sh... 2023-11-28T18:40:58.296 DEBUG:teuthology.orchestra.run.smithi045:workunit test fs/misc/trivial_sync.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=47c1c547372ed5bff7984647dc200bac0e019caf TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 1h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/trivial_sync.sh 2023-11-28T18:41:00.011 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-11-28T18:41:00.011 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-11-28T18:41:00.058 INFO:tasks.workunit:Stopping ['fs/misc/trivial_sync.sh'] on client.0... 2023-11-28T18:41:00.059 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-11-28T18:41:00.931 DEBUG:teuthology.parallel:result is None 2023-11-28T18:41:00.932 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2023-11-28T18:41:00.960 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2023-11-28T18:41:00.961 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T18:41:00.961 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T18:41:01.011 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T18:41:01.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.196+0000 7fb08d548640 1 Processor -- start 2023-11-28T18:41:01.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.196+0000 7fb08d548640 1 -- start start 2023-11-28T18:41:01.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.196+0000 7fb08d548640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fb0880cf950 0x7fb0880cfd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:41:01.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.196+0000 7fb08d548640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb0880d0700 0x7fb0880d1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:41:01.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.196+0000 7fb08d548640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0880c7000 con 0x7fb0880d0270 2023-11-28T18:41:01.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.196+0000 7fb08d548640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0880cf0a0 con 0x7fb0880d0700 2023-11-28T18:41:01.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.196+0000 7fb08d548640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0880ceae0 con 0x7fb0880cf950 2023-11-28T18:41:01.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.196+0000 7fb08cd47640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb0880d0700 0x7fb0880d1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:41:01.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.196+0000 7fb08cd47640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb0880d0700 0x7fb0880d1490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46422/0 (socket says 172.21.15.45:46422) 2023-11-28T18:41:01.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.196+0000 7fb08cd47640 1 -- 172.21.15.45:0/2602768321 learned_addr learned my addr 172.21.15.45:0/2602768321 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:41:01.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.196+0000 7fb087fff640 1 --2- 172.21.15.45:0/2602768321 >> v2:172.21.15.190:3300/0 conn(0x7fb0880cf950 0x7fb0880cfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:41:01.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.196+0000 7fb08cd47640 1 -- 172.21.15.45:0/2602768321 >> v2:172.21.15.190:3300/0 conn(0x7fb0880cf950 msgr2=0x7fb0880cfd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:41:01.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.196+0000 7fb08cd47640 1 --2- 172.21.15.45:0/2602768321 >> v2:172.21.15.190:3300/0 conn(0x7fb0880cf950 0x7fb0880cfd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:01.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.196+0000 7fb08cd47640 1 -- 172.21.15.45:0/2602768321 >> v1:172.21.15.190:6789/0 conn(0x7fb0880d0270 legacy=0x7fb0880d0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:41:01.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.196+0000 7fb08cd47640 1 -- 172.21.15.45:0/2602768321 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0880cedc0 con 0x7fb0880d0700 2023-11-28T18:41:01.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.200+0000 7fb08cd47640 1 --2- 172.21.15.45:0/2602768321 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0880d0700 0x7fb0880d1490 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fb080009e80 tx=0x7fb08001c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d601c4d8c452cde server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:41:01.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.200+0000 7fb086ffd640 1 -- 172.21.15.45:0/2602768321 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0800a5710 con 0x7fb0880d0700 2023-11-28T18:41:01.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.200+0000 7fb086ffd640 1 -- 172.21.15.45:0/2602768321 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0800a5870 con 0x7fb0880d0700 2023-11-28T18:41:01.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.200+0000 7fb086ffd640 1 -- 172.21.15.45:0/2602768321 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0800a5c00 con 0x7fb0880d0700 2023-11-28T18:41:01.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.200+0000 7fb08d548640 1 -- 172.21.15.45:0/2602768321 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0880d0700 msgr2=0x7fb0880d1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:41:01.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.200+0000 7fb08d548640 1 --2- 172.21.15.45:0/2602768321 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0880d0700 0x7fb0880d1490 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fb080009e80 tx=0x7fb08001c8f0 comp rx=0 tx=0).stop 2023-11-28T18:41:01.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.200+0000 7fb08d548640 1 -- 172.21.15.45:0/2602768321 shutdown_connections 2023-11-28T18:41:01.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.200+0000 7fb08d548640 1 --2- 172.21.15.45:0/2602768321 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0880d0700 0x7fb0880d1490 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:01.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.200+0000 7fb08d548640 1 --2- 172.21.15.45:0/2602768321 >> v2:172.21.15.190:3300/0 conn(0x7fb0880cf950 0x7fb0880cfd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:01.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.200+0000 7fb08d548640 1 -- 172.21.15.45:0/2602768321 >> 172.21.15.45:0/2602768321 conn(0x7fb0880d2fa0 msgr2=0x7fb0880d3380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:41:01.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.200+0000 7fb08d548640 1 -- 172.21.15.45:0/2602768321 shutdown_connections 2023-11-28T18:41:01.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.200+0000 7fb08d548640 1 -- 172.21.15.45:0/2602768321 wait complete. 2023-11-28T18:41:01.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.200+0000 7fb08d548640 1 Processor -- start 2023-11-28T18:41:01.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.200+0000 7fb08d548640 1 -- start start 2023-11-28T18:41:01.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.204+0000 7fb08d548640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0880cf950 0x7fb08815a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:41:01.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.204+0000 7fb08d548640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb0880d0270 0x7fb0880cbad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:41:01.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.204+0000 7fb08d548640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb0880d0700 0x7fb088158cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:41:01.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.204+0000 7fb08d548640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0880afc60 con 0x7fb0880cf950 2023-11-28T18:41:01.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.204+0000 7fb08d548640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0880cc010 con 0x7fb0880d0270 2023-11-28T18:41:01.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.204+0000 7fb08d548640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0880cc290 con 0x7fb0880d0700 2023-11-28T18:41:01.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.204+0000 7fb087fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0880cf950 0x7fb08815a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:41:01.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.204+0000 7fb087fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0880cf950 0x7fb08815a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46424/0 (socket says 172.21.15.45:46424) 2023-11-28T18:41:01.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.204+0000 7fb087fff640 1 -- 172.21.15.45:0/3267213196 learned_addr learned my addr 172.21.15.45:0/3267213196 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:41:01.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.204+0000 7fb08cd47640 1 --2- 172.21.15.45:0/3267213196 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb0880d0700 0x7fb088158cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:41:01.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.204+0000 7fb0877fe640 1 --2- 172.21.15.45:0/3267213196 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb0880d0270 0x7fb0880cbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:41:01.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.204+0000 7fb087fff640 1 -- 172.21.15.45:0/3267213196 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb0880d0700 msgr2=0x7fb088158cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:41:01.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.204+0000 7fb087fff640 1 --2- 172.21.15.45:0/3267213196 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb0880d0700 0x7fb088158cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:01.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.204+0000 7fb087fff640 1 -- 172.21.15.45:0/3267213196 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb0880d0270 msgr2=0x7fb0880cbad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:41:01.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.204+0000 7fb087fff640 1 --2- 172.21.15.45:0/3267213196 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb0880d0270 0x7fb0880cbad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:01.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.204+0000 7fb087fff640 1 -- 172.21.15.45:0/3267213196 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb080009b30 con 0x7fb0880cf950 2023-11-28T18:41:01.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.204+0000 7fb087fff640 1 --2- 172.21.15.45:0/3267213196 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0880cf950 0x7fb08815a1f0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fb07800d830 tx=0x7fb07800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:41:01.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.204+0000 7fb084ff9640 1 -- 172.21.15.45:0/3267213196 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07800b6c0 con 0x7fb0880cf950 2023-11-28T18:41:01.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.204+0000 7fb084ff9640 1 -- 172.21.15.45:0/3267213196 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb07800b820 con 0x7fb0880cf950 2023-11-28T18:41:01.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.204+0000 7fb08d548640 1 -- 172.21.15.45:0/3267213196 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0880cc570 con 0x7fb0880cf950 2023-11-28T18:41:01.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.204+0000 7fb084ff9640 1 -- 172.21.15.45:0/3267213196 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07800bb90 con 0x7fb0880cf950 2023-11-28T18:41:01.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.204+0000 7fb08d548640 1 -- 172.21.15.45:0/3267213196 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0880ccb30 con 0x7fb0880cf950 2023-11-28T18:41:01.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.204+0000 7fb08d548640 1 -- 172.21.15.45:0/3267213196 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0880afed0 con 0x7fb0880cf950 2023-11-28T18:41:01.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.208+0000 7fb084ff9640 1 -- 172.21.15.45:0/3267213196 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fb07801e460 con 0x7fb0880cf950 2023-11-28T18:41:01.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.208+0000 7fb084ff9640 1 --2- 172.21.15.45:0/3267213196 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fb0740668d0 0x7fb074068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:41:01.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.208+0000 7fb084ff9640 1 -- 172.21.15.45:0/3267213196 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fb078084b20 con 0x7fb0880cf950 2023-11-28T18:41:01.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.208+0000 7fb0877fe640 1 --2- 172.21.15.45:0/3267213196 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fb0740668d0 0x7fb074068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:41:01.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.208+0000 7fb0877fe640 1 --2- 172.21.15.45:0/3267213196 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fb0740668d0 0x7fb074068d90 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb07c007fd0 tx=0x7fb07c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:41:01.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.212+0000 7fb084ff9640 1 -- 172.21.15.45:0/3267213196 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb078051dc0 con 0x7fb0880cf950 2023-11-28T18:41:01.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.372+0000 7fb08d548640 1 -- 172.21.15.45:0/3267213196 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb0880a0f70 con 0x7fb0880cf950 2023-11-28T18:41:01.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.372+0000 7fb084ff9640 1 -- 172.21.15.45:0/3267213196 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+16573 (secure 0 0 0) 0x7fb0780553e0 con 0x7fb0880cf950 2023-11-28T18:41:01.377 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:41:01.377 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":48,"fsid":"d10f5cd6-1d00-4019-99b6-6fa435498a15","created":"2023-11-28T18:37:08.189030+0000","modified":"2023-11-28T18:40:16.149007+0000","last_up_change":"2023-11-28T18:37:20.196124+0000","last_in_change":"2023-11-28T18:37:10.742043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T18:37:21.293917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-28T18:39:34.106789+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-28T18:39:35.426601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"84465384-103c-4f2c-a45a-96f5bb9c835f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6809","nonce":555237322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6811","nonce":555237322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6815","nonce":555237322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6813","nonce":555237322}]},"public_addr":"172.21.15.45:6809/555237322","cluster_addr":"172.21.15.45:6811/555237322","heartbeat_back_addr":"172.21.15.45:6815/555237322","heartbeat_front_addr":"172.21.15.45:6813/555237322","state":["exists","up"]},{"osd":1,"uuid":"7d9eed24-a58f-42c7-a787-ac06be8553fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6801","nonce":2857063763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6803","nonce":2857063763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6807","nonce":2857063763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6805","nonce":2857063763}]},"public_addr":"172.21.15.45:6801/2857063763","cluster_addr":"172.21.15.45:6803/2857063763","heartbeat_back_addr":"172.21.15.45:6807/2857063763","heartbeat_front_addr":"172.21.15.45:6805/2857063763","state":["exists","up"]},{"osd":2,"uuid":"575eeccc-4abf-45b4-9caf-f3e797859588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6817","nonce":193884539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6819","nonce":193884539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6823","nonce":193884539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6821","nonce":193884539}]},"public_addr":"172.21.15.45:6817/193884539","cluster_addr":"172.21.15.45:6819/193884539","heartbeat_back_addr":"172.21.15.45:6823/193884539","heartbeat_front_addr":"172.21.15.45:6821/193884539","state":["exists","up"]},{"osd":3,"uuid":"9b0290d6-9a52-4bc8-b2a1-7622c5dc8e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6825","nonce":78541084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6827","nonce":78541084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6831","nonce":78541084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6829","nonce":78541084}]},"public_addr":"172.21.15.45:6825/78541084","cluster_addr":"172.21.15.45:6827/78541084","heartbeat_back_addr":"172.21.15.45:6831/78541084","heartbeat_front_addr":"172.21.15.45:6829/78541084","state":["exists","up"]},{"osd":4,"uuid":"ce632829-f027-4fbf-a627-02c571aa9d53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6809","nonce":1537591987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6811","nonce":1537591987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6815","nonce":1537591987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6813","nonce":1537591987}]},"public_addr":"172.21.15.190:6809/1537591987","cluster_addr":"172.21.15.190:6811/1537591987","heartbeat_back_addr":"172.21.15.190:6815/1537591987","heartbeat_front_addr":"172.21.15.190:6813/1537591987","state":["exists","up"]},{"osd":5,"uuid":"8700b609-27be-40bd-a251-4c0ae0a29ead","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6801","nonce":3296698407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6803","nonce":3296698407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6807","nonce":3296698407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6805","nonce":3296698407}]},"public_addr":"172.21.15.190:6801/3296698407","cluster_addr":"172.21.15.190:6803/3296698407","heartbeat_back_addr":"172.21.15.190:6807/3296698407","heartbeat_front_addr":"172.21.15.190:6805/3296698407","state":["exists","up"]},{"osd":6,"uuid":"44ce4a40-e6ff-4f4d-8e8a-7341e5c91f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6817","nonce":2317686718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6819","nonce":2317686718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6823","nonce":2317686718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6821","nonce":2317686718}]},"public_addr":"172.21.15.190:6817/2317686718","cluster_addr":"172.21.15.190:6819/2317686718","heartbeat_back_addr":"172.21.15.190:6823/2317686718","heartbeat_front_addr":"172.21.15.190:6821/2317686718","state":["exists","up"]},{"osd":7,"uuid":"192238c9-1423-4b7e-ac8f-84ba32113ddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6825","nonce":2493232051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6827","nonce":2493232051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6831","nonce":2493232051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6829","nonce":2493232051}]},"public_addr":"172.21.15.190:6825/2493232051","cluster_addr":"172.21.15.190:6827/2493232051","heartbeat_back_addr":"172.21.15.190:6831/2493232051","heartbeat_front_addr":"172.21.15.190:6829/2493232051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.393552+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.385453+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.361421+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.366408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.363226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.276007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.414605+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.445885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.2d","mappings":[{"from":0,"to":4}]},{"pgid":"7.3e","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T18:41:01.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.376+0000 7fb08d548640 1 -- 172.21.15.45:0/3267213196 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fb0740668d0 msgr2=0x7fb074068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:41:01.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.376+0000 7fb08d548640 1 --2- 172.21.15.45:0/3267213196 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fb0740668d0 0x7fb074068d90 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb07c007fd0 tx=0x7fb07c009040 comp rx=0 tx=0).stop 2023-11-28T18:41:01.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.376+0000 7fb08d548640 1 -- 172.21.15.45:0/3267213196 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0880cf950 msgr2=0x7fb08815a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:41:01.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.376+0000 7fb08d548640 1 --2- 172.21.15.45:0/3267213196 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0880cf950 0x7fb08815a1f0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fb07800d830 tx=0x7fb07800dcf0 comp rx=0 tx=0).stop 2023-11-28T18:41:01.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.376+0000 7fb08d548640 1 -- 172.21.15.45:0/3267213196 shutdown_connections 2023-11-28T18:41:01.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.376+0000 7fb08d548640 1 --2- 172.21.15.45:0/3267213196 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fb0740668d0 0x7fb074068d90 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:01.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.376+0000 7fb08d548640 1 --2- 172.21.15.45:0/3267213196 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb0880d0700 0x7fb088158cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:01.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.376+0000 7fb08d548640 1 --2- 172.21.15.45:0/3267213196 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb0880d0270 0x7fb0880cbad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:01.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.376+0000 7fb08d548640 1 --2- 172.21.15.45:0/3267213196 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0880cf950 0x7fb08815a1f0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:01.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.376+0000 7fb08d548640 1 -- 172.21.15.45:0/3267213196 >> 172.21.15.45:0/3267213196 conn(0x7fb0880d2fa0 msgr2=0x7fb08815d560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:41:01.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.376+0000 7fb08d548640 1 -- 172.21.15.45:0/3267213196 shutdown_connections 2023-11-28T18:41:01.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.376+0000 7fb08d548640 1 -- 172.21.15.45:0/3267213196 wait complete. 2023-11-28T18:41:01.399 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T18:37:21.293917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T18:39:34.106789+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T18:39:35.426601+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T18:41:01.400 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T18:41:01.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.544+0000 7f1da1432640 1 Processor -- start 2023-11-28T18:41:01.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.544+0000 7f1da1432640 1 -- start start 2023-11-28T18:41:01.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.544+0000 7f1da1432640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1d9c0ae870 0x7f1d9c15d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:41:01.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.544+0000 7f1da1432640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1d9c15d750 0x7f1d9c0cd030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:41:01.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.544+0000 7f1da1432640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d9c1575f0 con 0x7f1d9c157210 2023-11-28T18:41:01.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.544+0000 7f1da1432640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d9c15dbe0 con 0x7f1d9c15d750 2023-11-28T18:41:01.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.544+0000 7f1da1432640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9c0713d0 con 0x7f1d9c0ae870 2023-11-28T18:41:01.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.544+0000 7f1d9affd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f1d9c157210 0x7f1d9c070cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44204/0 (socket says 172.21.15.45:44204) 2023-11-28T18:41:01.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.544+0000 7f1d9affd640 1 -- 172.21.15.45:0/2927997093 learned_addr learned my addr 172.21.15.45:0/2927997093 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:41:01.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.544+0000 7f1d9b7fe640 1 --2- 172.21.15.45:0/2927997093 >> v2:172.21.15.45:3300/0 conn(0x7f1d9c15d750 0x7f1d9c0cd030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:41:01.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.544+0000 7f1d93fff640 1 --2- 172.21.15.45:0/2927997093 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1d9c0ae870 0x7f1d9c15d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:41:01.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.544+0000 7f1d9b7fe640 1 -- 172.21.15.45:0/2927997093 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1d9c0ae870 msgr2=0x7f1d9c15d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:41:01.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.544+0000 7f1d9b7fe640 1 --2- 172.21.15.45:0/2927997093 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1d9c0ae870 0x7f1d9c15d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:01.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.544+0000 7f1d9b7fe640 1 -- 172.21.15.45:0/2927997093 >> v1:172.21.15.45:6789/0 conn(0x7f1d9c157210 legacy=0x7f1d9c070cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:41:01.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.544+0000 7f1d9b7fe640 1 -- 172.21.15.45:0/2927997093 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d9c071640 con 0x7f1d9c15d750 2023-11-28T18:41:01.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.548+0000 7f1d9b7fe640 1 --2- 172.21.15.45:0/2927997093 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d9c15d750 0x7f1d9c0cd030 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f1d94009d90 tx=0x7f1d9401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c0202c64001d644 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:41:01.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.548+0000 7f1d9a7fc640 1 -- 172.21.15.45:0/2927997093 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d940a5990 con 0x7f1d9c15d750 2023-11-28T18:41:01.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.548+0000 7f1d9a7fc640 1 -- 172.21.15.45:0/2927997093 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d940a5af0 con 0x7f1d9c15d750 2023-11-28T18:41:01.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.548+0000 7f1d9a7fc640 1 -- 172.21.15.45:0/2927997093 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d940a5e80 con 0x7f1d9c15d750 2023-11-28T18:41:01.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.548+0000 7f1da1432640 1 -- 172.21.15.45:0/2927997093 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d9c15d750 msgr2=0x7f1d9c0cd030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:41:01.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.548+0000 7f1da1432640 1 --2- 172.21.15.45:0/2927997093 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d9c15d750 0x7f1d9c0cd030 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f1d94009d90 tx=0x7f1d9401c950 comp rx=0 tx=0).stop 2023-11-28T18:41:01.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.548+0000 7f1da1432640 1 -- 172.21.15.45:0/2927997093 shutdown_connections 2023-11-28T18:41:01.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.548+0000 7f1da1432640 1 --2- 172.21.15.45:0/2927997093 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d9c15d750 0x7f1d9c0cd030 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:01.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.548+0000 7f1da1432640 1 --2- 172.21.15.45:0/2927997093 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1d9c0ae870 0x7f1d9c15d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:01.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.548+0000 7f1da1432640 1 -- 172.21.15.45:0/2927997093 >> 172.21.15.45:0/2927997093 conn(0x7f1d9c0b0d00 msgr2=0x7f1d9c0b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:41:01.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.548+0000 7f1da1432640 1 -- 172.21.15.45:0/2927997093 shutdown_connections 2023-11-28T18:41:01.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.548+0000 7f1da1432640 1 -- 172.21.15.45:0/2927997093 wait complete. 2023-11-28T18:41:01.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.552+0000 7f1da1432640 1 Processor -- start 2023-11-28T18:41:01.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.552+0000 7f1da1432640 1 -- start start 2023-11-28T18:41:01.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.552+0000 7f1da1432640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1d9c0ae870 0x7f1d9c158380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:41:01.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.552+0000 7f1da1432640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1d9c157210 0x7f1d9c1f86a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:41:01.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.552+0000 7f1da1432640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d9c15d750 0x7f1d9c1f8be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:41:01.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.552+0000 7f1da1432640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9c0b3aa0 con 0x7f1d9c15d750 2023-11-28T18:41:01.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.552+0000 7f1da1432640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9c0b3d80 con 0x7f1d9c0ae870 2023-11-28T18:41:01.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.552+0000 7f1da1432640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9c0b4060 con 0x7f1d9c157210 2023-11-28T18:41:01.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.552+0000 7f1d9b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d9c15d750 0x7f1d9c1f8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:41:01.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.552+0000 7f1d9affd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1d9c0ae870 0x7f1d9c158380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:41:01.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.552+0000 7f1d9b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d9c15d750 0x7f1d9c1f8be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46438/0 (socket says 172.21.15.45:46438) 2023-11-28T18:41:01.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.552+0000 7f1d9b7fe640 1 -- 172.21.15.45:0/3281425267 learned_addr learned my addr 172.21.15.45:0/3281425267 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:41:01.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.552+0000 7f1d93fff640 1 --2- 172.21.15.45:0/3281425267 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1d9c157210 0x7f1d9c1f86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:41:01.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.552+0000 7f1d9b7fe640 1 -- 172.21.15.45:0/3281425267 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1d9c157210 msgr2=0x7f1d9c1f86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:41:01.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.552+0000 7f1d9b7fe640 1 --2- 172.21.15.45:0/3281425267 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1d9c157210 0x7f1d9c1f86a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:01.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.552+0000 7f1d9b7fe640 1 -- 172.21.15.45:0/3281425267 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1d9c0ae870 msgr2=0x7f1d9c158380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:41:01.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.552+0000 7f1d9b7fe640 1 --2- 172.21.15.45:0/3281425267 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1d9c0ae870 0x7f1d9c158380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:01.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.552+0000 7f1d9b7fe640 1 -- 172.21.15.45:0/3281425267 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d94009a70 con 0x7f1d9c15d750 2023-11-28T18:41:01.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.552+0000 7f1d9b7fe640 1 --2- 172.21.15.45:0/3281425267 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d9c15d750 0x7f1d9c1f8be0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f1d940b0040 tx=0x7f1d940196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:41:01.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.552+0000 7f1d937fe640 1 -- 172.21.15.45:0/3281425267 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d940ade40 con 0x7f1d9c15d750 2023-11-28T18:41:01.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.552+0000 7f1d937fe640 1 -- 172.21.15.45:0/3281425267 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d94009450 con 0x7f1d9c15d750 2023-11-28T18:41:01.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.552+0000 7f1da1432640 1 -- 172.21.15.45:0/3281425267 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d9c0b4340 con 0x7f1d9c15d750 2023-11-28T18:41:01.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.552+0000 7f1d937fe640 1 -- 172.21.15.45:0/3281425267 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d940b9690 con 0x7f1d9c15d750 2023-11-28T18:41:01.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.552+0000 7f1da1432640 1 -- 172.21.15.45:0/3281425267 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d9c1588c0 con 0x7f1d9c15d750 2023-11-28T18:41:01.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.556+0000 7f1da1432640 1 -- 172.21.15.45:0/3281425267 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d9c158ab0 con 0x7f1d9c15d750 2023-11-28T18:41:01.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.556+0000 7f1d937fe640 1 -- 172.21.15.45:0/3281425267 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f1d940b97f0 con 0x7f1d9c15d750 2023-11-28T18:41:01.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.556+0000 7f1d937fe640 1 --2- 172.21.15.45:0/3281425267 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1d7c0668d0 0x7f1d7c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:41:01.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.556+0000 7f1d937fe640 1 -- 172.21.15.45:0/3281425267 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f1d9411fa40 con 0x7f1d9c15d750 2023-11-28T18:41:01.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.556+0000 7f1d9affd640 1 --2- 172.21.15.45:0/3281425267 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1d7c0668d0 0x7f1d7c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:41:01.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.556+0000 7f1d9affd640 1 --2- 172.21.15.45:0/3281425267 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1d7c0668d0 0x7f1d7c068d90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c005890 tx=0x7f1d8c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:41:01.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.560+0000 7f1d937fe640 1 -- 172.21.15.45:0/3281425267 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1d9c158ab0 con 0x7f1d9c15d750 2023-11-28T18:41:01.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.716+0000 7f1da1432640 1 -- 172.21.15.45:0/3281425267 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1d9c158ab0 con 0x7f1d9c15d750 2023-11-28T18:41:01.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.716+0000 7f1d937fe640 1 -- 172.21.15.45:0/3281425267 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v48) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1d9c158ab0 con 0x7f1d9c15d750 2023-11-28T18:41:01.721 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-11-28T18:41:01.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.720+0000 7f1da1432640 1 -- 172.21.15.45:0/3281425267 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1d7c0668d0 msgr2=0x7f1d7c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:41:01.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.720+0000 7f1da1432640 1 --2- 172.21.15.45:0/3281425267 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1d7c0668d0 0x7f1d7c068d90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c005890 tx=0x7f1d8c009040 comp rx=0 tx=0).stop 2023-11-28T18:41:01.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.720+0000 7f1da1432640 1 -- 172.21.15.45:0/3281425267 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d9c15d750 msgr2=0x7f1d9c1f8be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:41:01.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.720+0000 7f1da1432640 1 --2- 172.21.15.45:0/3281425267 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d9c15d750 0x7f1d9c1f8be0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f1d940b0040 tx=0x7f1d940196f0 comp rx=0 tx=0).stop 2023-11-28T18:41:01.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.720+0000 7f1da1432640 1 -- 172.21.15.45:0/3281425267 shutdown_connections 2023-11-28T18:41:01.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.720+0000 7f1da1432640 1 --2- 172.21.15.45:0/3281425267 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1d7c0668d0 0x7f1d7c068d90 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:01.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.720+0000 7f1da1432640 1 --2- 172.21.15.45:0/3281425267 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d9c15d750 0x7f1d9c1f8be0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:01.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.720+0000 7f1da1432640 1 --2- 172.21.15.45:0/3281425267 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1d9c157210 0x7f1d9c1f86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:01.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.720+0000 7f1da1432640 1 --2- 172.21.15.45:0/3281425267 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1d9c0ae870 0x7f1d9c158380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:01.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.720+0000 7f1da1432640 1 -- 172.21.15.45:0/3281425267 >> 172.21.15.45:0/3281425267 conn(0x7f1d9c0b0d00 msgr2=0x7f1d9c1560a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:41:01.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.720+0000 7f1da1432640 1 -- 172.21.15.45:0/3281425267 shutdown_connections 2023-11-28T18:41:01.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.720+0000 7f1da1432640 1 -- 172.21.15.45:0/3281425267 wait complete. 2023-11-28T18:41:01.743 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T18:41:01.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.884+0000 7f3c132dd640 1 Processor -- start 2023-11-28T18:41:01.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.884+0000 7f3c132dd640 1 -- start start 2023-11-28T18:41:01.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.888+0000 7f3c132dd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f3c0c071dd0 0x7f3c0c0721b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:41:01.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.888+0000 7f3c132dd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3c0c13f630 0x7f3c0c0ce240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:41:01.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.888+0000 7f3c132dd640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c0c13d2f0 con 0x7f3c0c15adf0 2023-11-28T18:41:01.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.888+0000 7f3c132dd640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c0c140560 con 0x7f3c0c071dd0 2023-11-28T18:41:01.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.888+0000 7f3c132dd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0c0cd830 con 0x7f3c0c13f630 2023-11-28T18:41:01.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.888+0000 7f3c10878640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f3c0c15adf0 0x7f3c0c13d5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44212/0 (socket says 172.21.15.45:44212) 2023-11-28T18:41:01.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.888+0000 7f3c10878640 1 -- 172.21.15.45:0/3236353704 learned_addr learned my addr 172.21.15.45:0/3236353704 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:41:01.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.888+0000 7f3c1187a640 1 --2- 172.21.15.45:0/3236353704 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3c0c13f630 0x7f3c0c0ce240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:41:01.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.888+0000 7f3c11079640 1 --2- 172.21.15.45:0/3236353704 >> v2:172.21.15.190:3300/0 conn(0x7f3c0c071dd0 0x7f3c0c0721b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:41:01.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.888+0000 7f3c03fff640 1 -- 172.21.15.45:0/3236353704 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1966897813 0 0) 0x7f3c0c13d2f0 con 0x7f3c0c15adf0 2023-11-28T18:41:01.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.888+0000 7f3c03fff640 1 -- 172.21.15.45:0/3236353704 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bf8003530 con 0x7f3c0c15adf0 2023-11-28T18:41:01.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.888+0000 7f3c1187a640 1 -- 172.21.15.45:0/3236353704 >> v2:172.21.15.190:3300/0 conn(0x7f3c0c071dd0 msgr2=0x7f3c0c0721b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:41:01.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.888+0000 7f3c1187a640 1 --2- 172.21.15.45:0/3236353704 >> v2:172.21.15.190:3300/0 conn(0x7f3c0c071dd0 0x7f3c0c0721b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:01.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.888+0000 7f3c1187a640 1 -- 172.21.15.45:0/3236353704 >> v1:172.21.15.45:6789/0 conn(0x7f3c0c15adf0 legacy=0x7f3c0c13d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:41:01.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.888+0000 7f3c1187a640 1 -- 172.21.15.45:0/3236353704 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c0c0cddb0 con 0x7f3c0c13f630 2023-11-28T18:41:01.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.888+0000 7f3c11079640 1 --2- 172.21.15.45:0/3236353704 >> v2:172.21.15.190:3300/0 conn(0x7f3c0c071dd0 0x7f3c0c0721b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:41:01.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.892+0000 7f3c1187a640 1 --2- 172.21.15.45:0/3236353704 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3c0c13f630 0x7f3c0c0ce240 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3c04009d90 tx=0x7f3c0401c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71dd6e563979e58c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:41:01.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.892+0000 7f3c03fff640 1 -- 172.21.15.45:0/3236353704 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c040a5a10 con 0x7f3c0c13f630 2023-11-28T18:41:01.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.892+0000 7f3c03fff640 1 -- 172.21.15.45:0/3236353704 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c040a5b70 con 0x7f3c0c13f630 2023-11-28T18:41:01.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.892+0000 7f3c03fff640 1 -- 172.21.15.45:0/3236353704 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c040ad440 con 0x7f3c0c13f630 2023-11-28T18:41:01.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.892+0000 7f3c132dd640 1 -- 172.21.15.45:0/3236353704 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3c0c13f630 msgr2=0x7f3c0c0ce240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:41:01.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.892+0000 7f3c132dd640 1 --2- 172.21.15.45:0/3236353704 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3c0c13f630 0x7f3c0c0ce240 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3c04009d90 tx=0x7f3c0401c950 comp rx=0 tx=0).stop 2023-11-28T18:41:01.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.892+0000 7f3c132dd640 1 -- 172.21.15.45:0/3236353704 shutdown_connections 2023-11-28T18:41:01.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.892+0000 7f3c132dd640 1 --2- 172.21.15.45:0/3236353704 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3c0c13f630 0x7f3c0c0ce240 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:01.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.892+0000 7f3c132dd640 1 --2- 172.21.15.45:0/3236353704 >> v2:172.21.15.190:3300/0 conn(0x7f3c0c071dd0 0x7f3c0c0721b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:01.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.892+0000 7f3c132dd640 1 -- 172.21.15.45:0/3236353704 >> 172.21.15.45:0/3236353704 conn(0x7f3c0c0b0d00 msgr2=0x7f3c0c0b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:41:01.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.892+0000 7f3c132dd640 1 -- 172.21.15.45:0/3236353704 shutdown_connections 2023-11-28T18:41:01.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.892+0000 7f3c132dd640 1 -- 172.21.15.45:0/3236353704 wait complete. 2023-11-28T18:41:01.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.892+0000 7f3c132dd640 1 Processor -- start 2023-11-28T18:41:01.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.892+0000 7f3c132dd640 1 -- start start 2023-11-28T18:41:01.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.896+0000 7f3c132dd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c0c071dd0 0x7f3c0c134430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:41:01.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.896+0000 7f3c132dd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3c0c13f630 0x7f3c0c0b1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:41:01.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.896+0000 7f3c132dd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3c0c15adf0 0x7f3c0c138510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:41:01.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.896+0000 7f3c132dd640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0c0b4a80 con 0x7f3c0c071dd0 2023-11-28T18:41:01.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.896+0000 7f3c132dd640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0c0ad330 con 0x7f3c0c13f630 2023-11-28T18:41:01.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.896+0000 7f3c132dd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0c0ad610 con 0x7f3c0c15adf0 2023-11-28T18:41:01.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.896+0000 7f3c11079640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c0c071dd0 0x7f3c0c134430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:41:01.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.896+0000 7f3c11079640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c0c071dd0 0x7f3c0c134430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46450/0 (socket says 172.21.15.45:46450) 2023-11-28T18:41:01.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.896+0000 7f3c11079640 1 -- 172.21.15.45:0/2583780643 learned_addr learned my addr 172.21.15.45:0/2583780643 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:41:01.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.896+0000 7f3c11079640 1 -- 172.21.15.45:0/2583780643 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3c0c15adf0 msgr2=0x7f3c0c138510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:41:01.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.896+0000 7f3c11079640 1 --2- 172.21.15.45:0/2583780643 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3c0c15adf0 0x7f3c0c138510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:01.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.896+0000 7f3c11079640 1 -- 172.21.15.45:0/2583780643 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3c0c13f630 msgr2=0x7f3c0c0b1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:41:01.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.896+0000 7f3c11079640 1 --2- 172.21.15.45:0/2583780643 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3c0c13f630 0x7f3c0c0b1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:01.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.896+0000 7f3c11079640 1 -- 172.21.15.45:0/2583780643 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c08009420 con 0x7f3c0c071dd0 2023-11-28T18:41:01.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.896+0000 7f3c11079640 1 --2- 172.21.15.45:0/2583780643 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c0c071dd0 0x7f3c0c134430 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f3c0800ebe0 tx=0x7f3c0800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:41:01.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.896+0000 7f3c01ffb640 1 -- 172.21.15.45:0/2583780643 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c0800eee0 con 0x7f3c0c071dd0 2023-11-28T18:41:01.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.896+0000 7f3c01ffb640 1 -- 172.21.15.45:0/2583780643 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c0800cc30 con 0x7f3c0c071dd0 2023-11-28T18:41:01.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.896+0000 7f3c132dd640 1 -- 172.21.15.45:0/2583780643 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c04009a70 con 0x7f3c0c071dd0 2023-11-28T18:41:01.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.896+0000 7f3c01ffb640 1 -- 172.21.15.45:0/2583780643 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c08013470 con 0x7f3c0c071dd0 2023-11-28T18:41:01.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.896+0000 7f3c132dd640 1 -- 172.21.15.45:0/2583780643 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c0c0b4d60 con 0x7f3c0c071dd0 2023-11-28T18:41:01.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.896+0000 7f3c132dd640 1 -- 172.21.15.45:0/2583780643 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c0c069410 con 0x7f3c0c071dd0 2023-11-28T18:41:01.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.896+0000 7f3c01ffb640 1 -- 172.21.15.45:0/2583780643 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f3c080135d0 con 0x7f3c0c071dd0 2023-11-28T18:41:01.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.900+0000 7f3c01ffb640 1 --2- 172.21.15.45:0/2583780643 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f3bf00668d0 0x7f3bf0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:41:01.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.900+0000 7f3c01ffb640 1 -- 172.21.15.45:0/2583780643 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f3c080847f0 con 0x7f3c0c071dd0 2023-11-28T18:41:01.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.900+0000 7f3c10878640 1 --2- 172.21.15.45:0/2583780643 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f3bf00668d0 0x7f3bf0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:41:01.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.900+0000 7f3c10878640 1 --2- 172.21.15.45:0/2583780643 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f3bf00668d0 0x7f3bf0068d90 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc007fd0 tx=0x7f3bfc007900 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:41:01.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:01.904+0000 7f3c01ffb640 1 -- 172.21.15.45:0/2583780643 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3c08051960 con 0x7f3c0c071dd0 2023-11-28T18:41:02.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.056+0000 7f3c132dd640 1 -- 172.21.15.45:0/2583780643 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3c0c06e750 con 0x7f3c0c071dd0 2023-11-28T18:41:02.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.056+0000 7f3c01ffb640 1 -- 172.21.15.45:0/2583780643 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v48) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3c08054f80 con 0x7f3c0c071dd0 2023-11-28T18:41:02.062 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-11-28T18:41:02.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.060+0000 7f3c132dd640 1 -- 172.21.15.45:0/2583780643 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f3bf00668d0 msgr2=0x7f3bf0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:41:02.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.060+0000 7f3c132dd640 1 --2- 172.21.15.45:0/2583780643 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f3bf00668d0 0x7f3bf0068d90 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc007fd0 tx=0x7f3bfc007900 comp rx=0 tx=0).stop 2023-11-28T18:41:02.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.060+0000 7f3c132dd640 1 -- 172.21.15.45:0/2583780643 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c0c071dd0 msgr2=0x7f3c0c134430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:41:02.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.060+0000 7f3c132dd640 1 --2- 172.21.15.45:0/2583780643 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c0c071dd0 0x7f3c0c134430 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f3c0800ebe0 tx=0x7f3c0800c520 comp rx=0 tx=0).stop 2023-11-28T18:41:02.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.060+0000 7f3c132dd640 1 -- 172.21.15.45:0/2583780643 shutdown_connections 2023-11-28T18:41:02.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.060+0000 7f3c132dd640 1 --2- 172.21.15.45:0/2583780643 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f3bf00668d0 0x7f3bf0068d90 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:02.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.060+0000 7f3c132dd640 1 --2- 172.21.15.45:0/2583780643 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3c0c15adf0 0x7f3c0c138510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:02.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.060+0000 7f3c132dd640 1 --2- 172.21.15.45:0/2583780643 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3c0c13f630 0x7f3c0c0b1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:02.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.060+0000 7f3c132dd640 1 --2- 172.21.15.45:0/2583780643 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c0c071dd0 0x7f3c0c134430 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:02.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.060+0000 7f3c132dd640 1 -- 172.21.15.45:0/2583780643 >> 172.21.15.45:0/2583780643 conn(0x7f3c0c0b0d00 msgr2=0x7f3c0c13e960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:41:02.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.060+0000 7f3c132dd640 1 -- 172.21.15.45:0/2583780643 shutdown_connections 2023-11-28T18:41:02.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.060+0000 7f3c132dd640 1 -- 172.21.15.45:0/2583780643 wait complete. 2023-11-28T18:41:02.083 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T18:41:02.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.224+0000 7f9c7d3b8640 1 Processor -- start 2023-11-28T18:41:02.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.228+0000 7f9c7d3b8640 1 -- start start 2023-11-28T18:41:02.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.228+0000 7f9c7d3b8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9c780b4310 0x7f9c780b4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:41:02.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.228+0000 7f9c7d3b8640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c780b4ca0 con 0x7f9c780cba50 2023-11-28T18:41:02.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.228+0000 7f9c7d3b8640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c7815b6b0 con 0x7f9c78158ce0 2023-11-28T18:41:02.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.228+0000 7f9c7d3b8640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c7815c550 con 0x7f9c780b4310 2023-11-28T18:41:02.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.228+0000 7f9c6e7fc640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f9c780cba50 0x7f9c7815be40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44222/0 (socket says 172.21.15.45:44222) 2023-11-28T18:41:02.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.228+0000 7f9c6e7fc640 1 -- 172.21.15.45:0/4226708398 learned_addr learned my addr 172.21.15.45:0/4226708398 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:41:02.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.228+0000 7f9c777fe640 1 --2- 172.21.15.45:0/4226708398 >> v2:172.21.15.45:3300/0 conn(0x7f9c780b4310 0x7f9c780b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:41:02.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.228+0000 7f9c767fc640 1 -- 172.21.15.45:0/4226708398 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2729594405 0 0) 0x7f9c60001120 con 0x7f9c780cba50 2023-11-28T18:41:02.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.228+0000 7f9c767fc640 1 -- 172.21.15.45:0/4226708398 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c64003530 con 0x7f9c780cba50 2023-11-28T18:41:02.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.228+0000 7f9c777fe640 1 -- 172.21.15.45:0/4226708398 >> v1:172.21.15.190:6789/0 conn(0x7f9c78158ce0 legacy=0x7f9c7815eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:41:02.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.228+0000 7f9c777fe640 1 -- 172.21.15.45:0/4226708398 >> v1:172.21.15.45:6789/0 conn(0x7f9c780cba50 legacy=0x7f9c7815be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:41:02.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.228+0000 7f9c777fe640 1 -- 172.21.15.45:0/4226708398 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c7815f450 con 0x7f9c780b4310 2023-11-28T18:41:02.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.232+0000 7f9c777fe640 1 --2- 172.21.15.45:0/4226708398 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c780b4310 0x7f9c780b4760 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f9c700097c0 tx=0x7f9c7001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb224a2ba3e0c1dd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:41:02.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.232+0000 7f9c767fc640 1 -- 172.21.15.45:0/4226708398 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c700ab600 con 0x7f9c780b4310 2023-11-28T18:41:02.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.232+0000 7f9c767fc640 1 -- 172.21.15.45:0/4226708398 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c700a7050 con 0x7f9c780b4310 2023-11-28T18:41:02.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.232+0000 7f9c767fc640 1 -- 172.21.15.45:0/4226708398 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c700ab960 con 0x7f9c780b4310 2023-11-28T18:41:02.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.232+0000 7f9c7d3b8640 1 -- 172.21.15.45:0/4226708398 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c780b4310 msgr2=0x7f9c780b4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:41:02.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.232+0000 7f9c7d3b8640 1 --2- 172.21.15.45:0/4226708398 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c780b4310 0x7f9c780b4760 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f9c700097c0 tx=0x7f9c7001c480 comp rx=0 tx=0).stop 2023-11-28T18:41:02.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.232+0000 7f9c7d3b8640 1 -- 172.21.15.45:0/4226708398 shutdown_connections 2023-11-28T18:41:02.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.232+0000 7f9c7d3b8640 1 --2- 172.21.15.45:0/4226708398 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c780b4310 0x7f9c780b4760 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:02.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.232+0000 7f9c7d3b8640 1 -- 172.21.15.45:0/4226708398 >> 172.21.15.45:0/4226708398 conn(0x7f9c780b0d00 msgr2=0x7f9c780b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:41:02.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.232+0000 7f9c7d3b8640 1 -- 172.21.15.45:0/4226708398 shutdown_connections 2023-11-28T18:41:02.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.232+0000 7f9c7d3b8640 1 -- 172.21.15.45:0/4226708398 wait complete. 2023-11-28T18:41:02.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.232+0000 7f9c7d3b8640 1 Processor -- start 2023-11-28T18:41:02.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.232+0000 7f9c7d3b8640 1 -- start start 2023-11-28T18:41:02.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.236+0000 7f9c7d3b8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c780b4310 0x7f9c7815e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:41:02.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.236+0000 7f9c7d3b8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c780cba50 0x7f9c78164090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:41:02.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.236+0000 7f9c7d3b8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c78158ce0 0x7f9c78142b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:41:02.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.236+0000 7f9c7d3b8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c78154ab0 con 0x7f9c780cba50 2023-11-28T18:41:02.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.236+0000 7f9c7d3b8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c781430c0 con 0x7f9c780b4310 2023-11-28T18:41:02.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.236+0000 7f9c7d3b8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c78164770 con 0x7f9c78158ce0 2023-11-28T18:41:02.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.236+0000 7f9c6e7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c780cba50 0x7f9c78164090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:41:02.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.236+0000 7f9c6e7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c780cba50 0x7f9c78164090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46470/0 (socket says 172.21.15.45:46470) 2023-11-28T18:41:02.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.236+0000 7f9c6e7fc640 1 -- 172.21.15.45:0/2042200519 learned_addr learned my addr 172.21.15.45:0/2042200519 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:41:02.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.236+0000 7f9c777fe640 1 --2- 172.21.15.45:0/2042200519 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c78158ce0 0x7f9c78142b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:41:02.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.236+0000 7f9c76ffd640 1 --2- 172.21.15.45:0/2042200519 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c780b4310 0x7f9c7815e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:41:02.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.236+0000 7f9c6e7fc640 1 -- 172.21.15.45:0/2042200519 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c78158ce0 msgr2=0x7f9c78142b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:41:02.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.236+0000 7f9c6e7fc640 1 --2- 172.21.15.45:0/2042200519 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c78158ce0 0x7f9c78142b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:02.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.236+0000 7f9c6e7fc640 1 -- 172.21.15.45:0/2042200519 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c780b4310 msgr2=0x7f9c7815e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:41:02.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.236+0000 7f9c6e7fc640 1 --2- 172.21.15.45:0/2042200519 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c780b4310 0x7f9c7815e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:02.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.236+0000 7f9c6e7fc640 1 -- 172.21.15.45:0/2042200519 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c70009420 con 0x7f9c780cba50 2023-11-28T18:41:02.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.236+0000 7f9c6e7fc640 1 --2- 172.21.15.45:0/2042200519 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c780cba50 0x7f9c78164090 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f9c6000c730 tx=0x7f9c6000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:41:02.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.236+0000 7f9c6ffff640 1 -- 172.21.15.45:0/2042200519 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c60005ac0 con 0x7f9c780cba50 2023-11-28T18:41:02.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.236+0000 7f9c6ffff640 1 -- 172.21.15.45:0/2042200519 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c60005c20 con 0x7f9c780cba50 2023-11-28T18:41:02.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.236+0000 7f9c7d3b8640 1 -- 172.21.15.45:0/2042200519 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c78164a50 con 0x7f9c780cba50 2023-11-28T18:41:02.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.236+0000 7f9c6ffff640 1 -- 172.21.15.45:0/2042200519 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c60007070 con 0x7f9c780cba50 2023-11-28T18:41:02.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.236+0000 7f9c7d3b8640 1 -- 172.21.15.45:0/2042200519 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c78165010 con 0x7f9c780cba50 2023-11-28T18:41:02.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.236+0000 7f9c7d3b8640 1 -- 172.21.15.45:0/2042200519 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c78069410 con 0x7f9c780cba50 2023-11-28T18:41:02.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.236+0000 7f9c6ffff640 1 -- 172.21.15.45:0/2042200519 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f9c600071d0 con 0x7f9c780cba50 2023-11-28T18:41:02.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.240+0000 7f9c6ffff640 1 --2- 172.21.15.45:0/2042200519 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9c580668d0 0x7f9c58068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:41:02.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.240+0000 7f9c6ffff640 1 -- 172.21.15.45:0/2042200519 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f9c60083830 con 0x7f9c780cba50 2023-11-28T18:41:02.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.240+0000 7f9c76ffd640 1 --2- 172.21.15.45:0/2042200519 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9c580668d0 0x7f9c58068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:41:02.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.240+0000 7f9c76ffd640 1 --2- 172.21.15.45:0/2042200519 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9c580668d0 0x7f9c58068d90 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9c781f9540 tx=0x7f9c68009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:41:02.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.244+0000 7f9c6ffff640 1 -- 172.21.15.45:0/2042200519 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9c60050a40 con 0x7f9c780cba50 2023-11-28T18:41:02.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.400+0000 7f9c7d3b8640 1 -- 172.21.15.45:0/2042200519 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9c780b4ca0 con 0x7f9c780cba50 2023-11-28T18:41:02.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.400+0000 7f9c6ffff640 1 -- 172.21.15.45:0/2042200519 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v48) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9c780b4ca0 con 0x7f9c780cba50 2023-11-28T18:41:02.404 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-11-28T18:41:02.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.404+0000 7f9c7d3b8640 1 -- 172.21.15.45:0/2042200519 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9c580668d0 msgr2=0x7f9c58068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:41:02.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.404+0000 7f9c7d3b8640 1 --2- 172.21.15.45:0/2042200519 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9c580668d0 0x7f9c58068d90 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9c781f9540 tx=0x7f9c68009040 comp rx=0 tx=0).stop 2023-11-28T18:41:02.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.404+0000 7f9c7d3b8640 1 -- 172.21.15.45:0/2042200519 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c780cba50 msgr2=0x7f9c78164090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:41:02.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.404+0000 7f9c7d3b8640 1 --2- 172.21.15.45:0/2042200519 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c780cba50 0x7f9c78164090 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f9c6000c730 tx=0x7f9c6000cbf0 comp rx=0 tx=0).stop 2023-11-28T18:41:02.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.404+0000 7f9c7d3b8640 1 -- 172.21.15.45:0/2042200519 shutdown_connections 2023-11-28T18:41:02.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.404+0000 7f9c7d3b8640 1 --2- 172.21.15.45:0/2042200519 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9c580668d0 0x7f9c58068d90 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:02.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.404+0000 7f9c7d3b8640 1 --2- 172.21.15.45:0/2042200519 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c78158ce0 0x7f9c78142b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:02.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.404+0000 7f9c7d3b8640 1 --2- 172.21.15.45:0/2042200519 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c780cba50 0x7f9c78164090 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:02.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.404+0000 7f9c7d3b8640 1 --2- 172.21.15.45:0/2042200519 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c780b4310 0x7f9c7815e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:02.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.404+0000 7f9c7d3b8640 1 -- 172.21.15.45:0/2042200519 >> 172.21.15.45:0/2042200519 conn(0x7f9c780b0d00 msgr2=0x7f9c780cc250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:41:02.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.404+0000 7f9c7d3b8640 1 -- 172.21.15.45:0/2042200519 shutdown_connections 2023-11-28T18:41:02.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.404+0000 7f9c7d3b8640 1 -- 172.21.15.45:0/2042200519 wait complete. 2023-11-28T18:41:02.426 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T18:41:02.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.568+0000 7fa001609640 1 Processor -- start 2023-11-28T18:41:02.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.568+0000 7fa001609640 1 -- start start 2023-11-28T18:41:02.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.568+0000 7fa001609640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ffc0d17f0 0x7f9ffc142c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:41:02.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.568+0000 7fa001609640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f9ffc0b4b80 0x7f9ffc143180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:41:02.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.568+0000 7fa001609640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ffc15d800 con 0x7f9ffc0b47a0 2023-11-28T18:41:02.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.568+0000 7fa001609640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ffc161e00 con 0x7f9ffc0b4b80 2023-11-28T18:41:02.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.568+0000 7fa001609640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ffc140970 con 0x7f9ffc0d17f0 2023-11-28T18:41:02.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.568+0000 7f9ffb7fe640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f9ffc0b4b80 0x7f9ffc143180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:41:02.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.568+0000 7f9ffaffd640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f9ffc0b47a0 0x7f9ffc0d10e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.45:34354/0 (socket says 172.21.15.45:34354) 2023-11-28T18:41:02.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.568+0000 7f9ffaffd640 1 -- 172.21.15.45:0/2145008713 learned_addr learned my addr 172.21.15.45:0/2145008713 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:41:02.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.568+0000 7f9ff3fff640 1 --2- 172.21.15.45:0/2145008713 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ffc0d17f0 0x7f9ffc142c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:41:02.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.568+0000 7f9ffb7fe640 1 -- 172.21.15.45:0/2145008713 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ffc0d17f0 msgr2=0x7f9ffc142c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:41:02.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.568+0000 7f9ffb7fe640 1 --2- 172.21.15.45:0/2145008713 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ffc0d17f0 0x7f9ffc142c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:02.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.568+0000 7f9ffb7fe640 1 -- 172.21.15.45:0/2145008713 >> v1:172.21.15.190:6789/0 conn(0x7f9ffc0b47a0 legacy=0x7f9ffc0d10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:41:02.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.568+0000 7f9ffb7fe640 1 -- 172.21.15.45:0/2145008713 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ffc15da50 con 0x7f9ffc0b4b80 2023-11-28T18:41:02.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.572+0000 7f9ffb7fe640 1 --2- 172.21.15.45:0/2145008713 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ffc0b4b80 0x7f9ffc143180 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9ff4009d90 tx=0x7f9ff401c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26b864608cab1069 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:41:02.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.572+0000 7f9ffa7fc640 1 -- 172.21.15.45:0/2145008713 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff40a5810 con 0x7f9ffc0b4b80 2023-11-28T18:41:02.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.572+0000 7f9ffa7fc640 1 -- 172.21.15.45:0/2145008713 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ff40a5970 con 0x7f9ffc0b4b80 2023-11-28T18:41:02.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.572+0000 7f9ffa7fc640 1 -- 172.21.15.45:0/2145008713 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff40a5d00 con 0x7f9ffc0b4b80 2023-11-28T18:41:02.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.572+0000 7fa001609640 1 -- 172.21.15.45:0/2145008713 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ffc0b4b80 msgr2=0x7f9ffc143180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:41:02.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.572+0000 7fa001609640 1 --2- 172.21.15.45:0/2145008713 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ffc0b4b80 0x7f9ffc143180 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9ff4009d90 tx=0x7f9ff401c950 comp rx=0 tx=0).stop 2023-11-28T18:41:02.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.572+0000 7fa001609640 1 -- 172.21.15.45:0/2145008713 shutdown_connections 2023-11-28T18:41:02.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.572+0000 7fa001609640 1 --2- 172.21.15.45:0/2145008713 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ffc0b4b80 0x7f9ffc143180 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:02.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.572+0000 7fa001609640 1 --2- 172.21.15.45:0/2145008713 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ffc0d17f0 0x7f9ffc142c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:02.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.572+0000 7fa001609640 1 -- 172.21.15.45:0/2145008713 >> 172.21.15.45:0/2145008713 conn(0x7f9ffc06a570 msgr2=0x7f9ffc06a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:41:02.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.572+0000 7fa001609640 1 -- 172.21.15.45:0/2145008713 shutdown_connections 2023-11-28T18:41:02.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.572+0000 7fa001609640 1 -- 172.21.15.45:0/2145008713 wait complete. 2023-11-28T18:41:02.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.576+0000 7fa001609640 1 Processor -- start 2023-11-28T18:41:02.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.576+0000 7fa001609640 1 -- start start 2023-11-28T18:41:02.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.576+0000 7fa001609640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ffc0b47a0 0x7f9ffc162950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:41:02.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.576+0000 7fa001609640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ffc0b4b80 0x7f9ffc156dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:41:02.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.576+0000 7fa001609640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ffc0d17f0 0x7f9ffc1639a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:41:02.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.576+0000 7fa001609640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ffc157300 con 0x7f9ffc0d17f0 2023-11-28T18:41:02.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.576+0000 7fa001609640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ffc162fe0 con 0x7f9ffc0b4b80 2023-11-28T18:41:02.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.576+0000 7fa001609640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ffc15a9a0 con 0x7f9ffc0b47a0 2023-11-28T18:41:02.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.576+0000 7f9ffb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ffc0d17f0 0x7f9ffc1639a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:41:02.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.576+0000 7f9ffb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ffc0d17f0 0x7f9ffc1639a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46482/0 (socket says 172.21.15.45:46482) 2023-11-28T18:41:02.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.576+0000 7f9ffb7fe640 1 -- 172.21.15.45:0/2547576859 learned_addr learned my addr 172.21.15.45:0/2547576859 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:41:02.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.576+0000 7f9ffaffd640 1 --2- 172.21.15.45:0/2547576859 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ffc0b47a0 0x7f9ffc162950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:41:02.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.576+0000 7f9ff3fff640 1 --2- 172.21.15.45:0/2547576859 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ffc0b4b80 0x7f9ffc156dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:41:02.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.576+0000 7f9ffb7fe640 1 -- 172.21.15.45:0/2547576859 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ffc0b47a0 msgr2=0x7f9ffc162950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:41:02.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.576+0000 7f9ffb7fe640 1 --2- 172.21.15.45:0/2547576859 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ffc0b47a0 0x7f9ffc162950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:02.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.576+0000 7f9ffb7fe640 1 -- 172.21.15.45:0/2547576859 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ffc0b4b80 msgr2=0x7f9ffc156dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:41:02.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.576+0000 7f9ffb7fe640 1 --2- 172.21.15.45:0/2547576859 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ffc0b4b80 0x7f9ffc156dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:02.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.576+0000 7f9ffb7fe640 1 -- 172.21.15.45:0/2547576859 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff4009a70 con 0x7f9ffc0d17f0 2023-11-28T18:41:02.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.576+0000 7f9ffb7fe640 1 --2- 172.21.15.45:0/2547576859 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ffc0d17f0 0x7f9ffc1639a0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f9ff401b000 tx=0x7f9ff40196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:41:02.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.576+0000 7f9ff37fe640 1 -- 172.21.15.45:0/2547576859 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff40b9650 con 0x7f9ffc0d17f0 2023-11-28T18:41:02.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.576+0000 7f9ff37fe640 1 -- 172.21.15.45:0/2547576859 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ff40b97b0 con 0x7f9ffc0d17f0 2023-11-28T18:41:02.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.576+0000 7f9ff37fe640 1 -- 172.21.15.45:0/2547576859 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff40b9b20 con 0x7f9ffc0d17f0 2023-11-28T18:41:02.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.576+0000 7fa001609640 1 -- 172.21.15.45:0/2547576859 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ffc15a070 con 0x7f9ffc0d17f0 2023-11-28T18:41:02.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.576+0000 7fa001609640 1 -- 172.21.15.45:0/2547576859 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ffc15a630 con 0x7f9ffc0d17f0 2023-11-28T18:41:02.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.580+0000 7fa001609640 1 -- 172.21.15.45:0/2547576859 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ffc15ab10 con 0x7f9ffc0d17f0 2023-11-28T18:41:02.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.580+0000 7f9ff37fe640 1 -- 172.21.15.45:0/2547576859 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f9ff40b9c80 con 0x7f9ffc0d17f0 2023-11-28T18:41:02.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.580+0000 7f9ff37fe640 1 --2- 172.21.15.45:0/2547576859 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9fdc0668d0 0x7f9fdc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:41:02.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.580+0000 7f9ff37fe640 1 -- 172.21.15.45:0/2547576859 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f9ff411f800 con 0x7f9ffc0d17f0 2023-11-28T18:41:02.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.580+0000 7f9ffaffd640 1 --2- 172.21.15.45:0/2547576859 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9fdc0668d0 0x7f9fdc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:41:02.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.580+0000 7f9ffaffd640 1 --2- 172.21.15.45:0/2547576859 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9fdc0668d0 0x7f9fdc068d90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9fec005890 tx=0x7f9fec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:41:02.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.584+0000 7f9ff37fe640 1 -- 172.21.15.45:0/2547576859 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9ff40eca10 con 0x7f9ffc0d17f0 2023-11-28T18:41:02.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.756+0000 7fa001609640 1 -- 172.21.15.45:0/2547576859 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9ffc143640 con 0x7f9ffc0d17f0 2023-11-28T18:41:02.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.756+0000 7f9ff37fe640 1 -- 172.21.15.45:0/2547576859 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v48) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9ff40f0030 con 0x7f9ffc0d17f0 2023-11-28T18:41:02.758 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-11-28T18:41:02.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.756+0000 7fa001609640 1 -- 172.21.15.45:0/2547576859 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9fdc0668d0 msgr2=0x7f9fdc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:41:02.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.756+0000 7fa001609640 1 --2- 172.21.15.45:0/2547576859 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9fdc0668d0 0x7f9fdc068d90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9fec005890 tx=0x7f9fec009040 comp rx=0 tx=0).stop 2023-11-28T18:41:02.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.756+0000 7fa001609640 1 -- 172.21.15.45:0/2547576859 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ffc0d17f0 msgr2=0x7f9ffc1639a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:41:02.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.756+0000 7fa001609640 1 --2- 172.21.15.45:0/2547576859 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ffc0d17f0 0x7f9ffc1639a0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f9ff401b000 tx=0x7f9ff40196f0 comp rx=0 tx=0).stop 2023-11-28T18:41:02.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.756+0000 7fa001609640 1 -- 172.21.15.45:0/2547576859 shutdown_connections 2023-11-28T18:41:02.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.756+0000 7fa001609640 1 --2- 172.21.15.45:0/2547576859 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9fdc0668d0 0x7f9fdc068d90 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:02.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.756+0000 7fa001609640 1 --2- 172.21.15.45:0/2547576859 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ffc0d17f0 0x7f9ffc1639a0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:02.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.756+0000 7fa001609640 1 --2- 172.21.15.45:0/2547576859 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ffc0b4b80 0x7f9ffc156dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:02.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.756+0000 7fa001609640 1 --2- 172.21.15.45:0/2547576859 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ffc0b47a0 0x7f9ffc162950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:02.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.756+0000 7fa001609640 1 -- 172.21.15.45:0/2547576859 >> 172.21.15.45:0/2547576859 conn(0x7f9ffc06a570 msgr2=0x7f9ffc06d020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:41:02.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.756+0000 7fa001609640 1 -- 172.21.15.45:0/2547576859 shutdown_connections 2023-11-28T18:41:02.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.756+0000 7fa001609640 1 -- 172.21.15.45:0/2547576859 wait complete. 2023-11-28T18:41:02.780 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T18:41:02.780 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T18:41:02.789 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T18:41:02.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.976+0000 7f8545632640 1 Processor -- start 2023-11-28T18:41:02.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.976+0000 7f8545632640 1 -- start start 2023-11-28T18:41:02.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.976+0000 7f8545632640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f85400b35f0 0x7f85400d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:41:02.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.976+0000 7f8545632640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f85400cfed0 0x7f854015f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:41:02.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.976+0000 7f8545632640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85400d38c0 con 0x7f85400b3cb0 2023-11-28T18:41:02.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.976+0000 7f8545632640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85400d40d0 con 0x7f85400cfed0 2023-11-28T18:41:02.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.976+0000 7f8545632640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85400cdcc0 con 0x7f85400b35f0 2023-11-28T18:41:02.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.976+0000 7f853f7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f85400cfed0 0x7f854015f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:41:02.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.976+0000 7f8537fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f85400b3cb0 0x7f85400cf7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44232/0 (socket says 172.21.15.45:44232) 2023-11-28T18:41:02.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.976+0000 7f8537fff640 1 -- 172.21.15.45:0/3570279098 learned_addr learned my addr 172.21.15.45:0/3570279098 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:41:02.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.976+0000 7f853effd640 1 --2- 172.21.15.45:0/3570279098 >> v2:172.21.15.190:3300/0 conn(0x7f85400b35f0 0x7f85400d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:41:02.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.976+0000 7f853f7fe640 1 -- 172.21.15.45:0/3570279098 >> v2:172.21.15.190:3300/0 conn(0x7f85400b35f0 msgr2=0x7f85400d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:41:02.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.976+0000 7f853f7fe640 1 --2- 172.21.15.45:0/3570279098 >> v2:172.21.15.190:3300/0 conn(0x7f85400b35f0 0x7f85400d0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:02.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.976+0000 7f853f7fe640 1 -- 172.21.15.45:0/3570279098 >> v1:172.21.15.45:6789/0 conn(0x7f85400b3cb0 legacy=0x7f85400cf7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:41:02.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.976+0000 7f853f7fe640 1 -- 172.21.15.45:0/3570279098 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85400d3b10 con 0x7f85400cfed0 2023-11-28T18:41:02.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.980+0000 7f853f7fe640 1 --2- 172.21.15.45:0/3570279098 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85400cfed0 0x7f854015f0a0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f854008ca20 tx=0x7f853801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11cc94afd5395ec9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:41:02.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.980+0000 7f853e7fc640 1 -- 172.21.15.45:0/3570279098 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85380a59d0 con 0x7f85400cfed0 2023-11-28T18:41:02.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.980+0000 7f853e7fc640 1 -- 172.21.15.45:0/3570279098 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85380a5b30 con 0x7f85400cfed0 2023-11-28T18:41:02.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.980+0000 7f853e7fc640 1 -- 172.21.15.45:0/3570279098 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85380ad440 con 0x7f85400cfed0 2023-11-28T18:41:02.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.980+0000 7f8545632640 1 -- 172.21.15.45:0/3570279098 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85400cfed0 msgr2=0x7f854015f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:41:02.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.980+0000 7f8545632640 1 --2- 172.21.15.45:0/3570279098 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85400cfed0 0x7f854015f0a0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f854008ca20 tx=0x7f853801c910 comp rx=0 tx=0).stop 2023-11-28T18:41:02.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.980+0000 7f8545632640 1 -- 172.21.15.45:0/3570279098 shutdown_connections 2023-11-28T18:41:02.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.980+0000 7f8545632640 1 --2- 172.21.15.45:0/3570279098 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85400cfed0 0x7f854015f0a0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:02.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.980+0000 7f8545632640 1 --2- 172.21.15.45:0/3570279098 >> v2:172.21.15.190:3300/0 conn(0x7f85400b35f0 0x7f85400d0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:02.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.980+0000 7f8545632640 1 -- 172.21.15.45:0/3570279098 >> 172.21.15.45:0/3570279098 conn(0x7f854009c4f0 msgr2=0x7f85400d31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:41:02.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.980+0000 7f8545632640 1 -- 172.21.15.45:0/3570279098 shutdown_connections 2023-11-28T18:41:02.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.980+0000 7f8545632640 1 -- 172.21.15.45:0/3570279098 wait complete. 2023-11-28T18:41:02.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.984+0000 7f8545632640 1 Processor -- start 2023-11-28T18:41:02.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.984+0000 7f8545632640 1 -- start start 2023-11-28T18:41:02.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.984+0000 7f8545632640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f85400b35f0 0x7f854009cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:41:02.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.984+0000 7f8545632640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85400b3cb0 0x7f8540159680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:41:02.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.984+0000 7f8545632640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85400cfed0 0x7f85401f63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:41:02.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.984+0000 7f8545632640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f854009ff60 con 0x7f85400b3cb0 2023-11-28T18:41:02.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.984+0000 7f8545632640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f854009d5f0 con 0x7f85400b35f0 2023-11-28T18:41:02.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.984+0000 7f8545632640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f854009d8d0 con 0x7f85400cfed0 2023-11-28T18:41:02.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.984+0000 7f8537fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85400b3cb0 0x7f8540159680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:41:02.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.984+0000 7f8537fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85400b3cb0 0x7f8540159680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46490/0 (socket says 172.21.15.45:46490) 2023-11-28T18:41:02.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.984+0000 7f8537fff640 1 -- 172.21.15.45:0/3943644948 learned_addr learned my addr 172.21.15.45:0/3943644948 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:41:02.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.984+0000 7f853effd640 1 --2- 172.21.15.45:0/3943644948 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f85400b35f0 0x7f854009cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:41:02.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.984+0000 7f853f7fe640 1 --2- 172.21.15.45:0/3943644948 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85400cfed0 0x7f85401f63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:41:02.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.984+0000 7f8537fff640 1 -- 172.21.15.45:0/3943644948 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85400cfed0 msgr2=0x7f85401f63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:41:02.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.984+0000 7f8537fff640 1 --2- 172.21.15.45:0/3943644948 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85400cfed0 0x7f85401f63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:02.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.984+0000 7f8537fff640 1 -- 172.21.15.45:0/3943644948 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f85400b35f0 msgr2=0x7f854009cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:41:02.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.984+0000 7f8537fff640 1 --2- 172.21.15.45:0/3943644948 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f85400b35f0 0x7f854009cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:02.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.984+0000 7f8537fff640 1 -- 172.21.15.45:0/3943644948 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8538009a70 con 0x7f85400b3cb0 2023-11-28T18:41:02.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.984+0000 7f8537fff640 1 --2- 172.21.15.45:0/3943644948 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85400b3cb0 0x7f8540159680 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f852800c500 tx=0x7f852800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:41:02.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.984+0000 7f85377fe640 1 -- 172.21.15.45:0/3943644948 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8528005cf0 con 0x7f85400b3cb0 2023-11-28T18:41:02.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.984+0000 7f85377fe640 1 -- 172.21.15.45:0/3943644948 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8528005e50 con 0x7f85400b3cb0 2023-11-28T18:41:02.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.984+0000 7f85377fe640 1 -- 172.21.15.45:0/3943644948 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85280072f0 con 0x7f85400b3cb0 2023-11-28T18:41:02.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.984+0000 7f8545632640 1 -- 172.21.15.45:0/3943644948 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f854009dbb0 con 0x7f85400b3cb0 2023-11-28T18:41:02.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.984+0000 7f8545632640 1 -- 172.21.15.45:0/3943644948 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f854009e170 con 0x7f85400b3cb0 2023-11-28T18:41:02.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.988+0000 7f8545632640 1 -- 172.21.15.45:0/3943644948 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8540069480 con 0x7f85400b3cb0 2023-11-28T18:41:02.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.988+0000 7f85377fe640 1 -- 172.21.15.45:0/3943644948 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f8528007450 con 0x7f85400b3cb0 2023-11-28T18:41:02.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.988+0000 7f85377fe640 1 --2- 172.21.15.45:0/3943644948 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f85200668d0 0x7f8520068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:41:02.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.988+0000 7f85377fe640 1 -- 172.21.15.45:0/3943644948 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f85280838b0 con 0x7f85400b3cb0 2023-11-28T18:41:02.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.988+0000 7f853effd640 1 --2- 172.21.15.45:0/3943644948 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f85200668d0 0x7f8520068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:41:02.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.988+0000 7f853effd640 1 --2- 172.21.15.45:0/3943644948 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f85200668d0 0x7f8520068d90 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8530009b60 tx=0x7f8530009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:41:02.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:02.992+0000 7f85377fe640 1 -- 172.21.15.45:0/3943644948 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8528050bd0 con 0x7f85400b3cb0 2023-11-28T18:41:03.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.152+0000 7f8545632640 1 -- 172.21.15.45:0/3943644948 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f854009ca30 con 0x7f85400b3cb0 2023-11-28T18:41:03.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.156+0000 7f85377fe640 1 -- 172.21.15.45:0/3943644948 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+16573 (secure 0 0 0) 0x7f8528017020 con 0x7f85400b3cb0 2023-11-28T18:41:03.158 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:41:03.158 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":48,"fsid":"d10f5cd6-1d00-4019-99b6-6fa435498a15","created":"2023-11-28T18:37:08.189030+0000","modified":"2023-11-28T18:40:16.149007+0000","last_up_change":"2023-11-28T18:37:20.196124+0000","last_in_change":"2023-11-28T18:37:10.742043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T18:37:21.293917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-28T18:39:34.106789+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-28T18:39:35.426601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"84465384-103c-4f2c-a45a-96f5bb9c835f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6809","nonce":555237322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6811","nonce":555237322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6815","nonce":555237322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6813","nonce":555237322}]},"public_addr":"172.21.15.45:6809/555237322","cluster_addr":"172.21.15.45:6811/555237322","heartbeat_back_addr":"172.21.15.45:6815/555237322","heartbeat_front_addr":"172.21.15.45:6813/555237322","state":["exists","up"]},{"osd":1,"uuid":"7d9eed24-a58f-42c7-a787-ac06be8553fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6801","nonce":2857063763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6803","nonce":2857063763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6807","nonce":2857063763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6805","nonce":2857063763}]},"public_addr":"172.21.15.45:6801/2857063763","cluster_addr":"172.21.15.45:6803/2857063763","heartbeat_back_addr":"172.21.15.45:6807/2857063763","heartbeat_front_addr":"172.21.15.45:6805/2857063763","state":["exists","up"]},{"osd":2,"uuid":"575eeccc-4abf-45b4-9caf-f3e797859588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6817","nonce":193884539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6819","nonce":193884539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6823","nonce":193884539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6821","nonce":193884539}]},"public_addr":"172.21.15.45:6817/193884539","cluster_addr":"172.21.15.45:6819/193884539","heartbeat_back_addr":"172.21.15.45:6823/193884539","heartbeat_front_addr":"172.21.15.45:6821/193884539","state":["exists","up"]},{"osd":3,"uuid":"9b0290d6-9a52-4bc8-b2a1-7622c5dc8e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6825","nonce":78541084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6827","nonce":78541084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6831","nonce":78541084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6829","nonce":78541084}]},"public_addr":"172.21.15.45:6825/78541084","cluster_addr":"172.21.15.45:6827/78541084","heartbeat_back_addr":"172.21.15.45:6831/78541084","heartbeat_front_addr":"172.21.15.45:6829/78541084","state":["exists","up"]},{"osd":4,"uuid":"ce632829-f027-4fbf-a627-02c571aa9d53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6809","nonce":1537591987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6811","nonce":1537591987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6815","nonce":1537591987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6813","nonce":1537591987}]},"public_addr":"172.21.15.190:6809/1537591987","cluster_addr":"172.21.15.190:6811/1537591987","heartbeat_back_addr":"172.21.15.190:6815/1537591987","heartbeat_front_addr":"172.21.15.190:6813/1537591987","state":["exists","up"]},{"osd":5,"uuid":"8700b609-27be-40bd-a251-4c0ae0a29ead","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6801","nonce":3296698407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6803","nonce":3296698407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6807","nonce":3296698407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6805","nonce":3296698407}]},"public_addr":"172.21.15.190:6801/3296698407","cluster_addr":"172.21.15.190:6803/3296698407","heartbeat_back_addr":"172.21.15.190:6807/3296698407","heartbeat_front_addr":"172.21.15.190:6805/3296698407","state":["exists","up"]},{"osd":6,"uuid":"44ce4a40-e6ff-4f4d-8e8a-7341e5c91f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6817","nonce":2317686718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6819","nonce":2317686718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6823","nonce":2317686718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6821","nonce":2317686718}]},"public_addr":"172.21.15.190:6817/2317686718","cluster_addr":"172.21.15.190:6819/2317686718","heartbeat_back_addr":"172.21.15.190:6823/2317686718","heartbeat_front_addr":"172.21.15.190:6821/2317686718","state":["exists","up"]},{"osd":7,"uuid":"192238c9-1423-4b7e-ac8f-84ba32113ddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6825","nonce":2493232051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6827","nonce":2493232051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6831","nonce":2493232051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6829","nonce":2493232051}]},"public_addr":"172.21.15.190:6825/2493232051","cluster_addr":"172.21.15.190:6827/2493232051","heartbeat_back_addr":"172.21.15.190:6831/2493232051","heartbeat_front_addr":"172.21.15.190:6829/2493232051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.393552+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.385453+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.361421+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.366408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.363226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.276007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.414605+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.445885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.2d","mappings":[{"from":0,"to":4}]},{"pgid":"7.3e","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T18:41:03.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.156+0000 7f8545632640 1 -- 172.21.15.45:0/3943644948 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f85200668d0 msgr2=0x7f8520068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:41:03.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.156+0000 7f8545632640 1 --2- 172.21.15.45:0/3943644948 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f85200668d0 0x7f8520068d90 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8530009b60 tx=0x7f8530009190 comp rx=0 tx=0).stop 2023-11-28T18:41:03.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.156+0000 7f8545632640 1 -- 172.21.15.45:0/3943644948 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85400b3cb0 msgr2=0x7f8540159680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:41:03.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.156+0000 7f8545632640 1 --2- 172.21.15.45:0/3943644948 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85400b3cb0 0x7f8540159680 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f852800c500 tx=0x7f852800c9c0 comp rx=0 tx=0).stop 2023-11-28T18:41:03.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.156+0000 7f8545632640 1 -- 172.21.15.45:0/3943644948 shutdown_connections 2023-11-28T18:41:03.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.156+0000 7f8545632640 1 --2- 172.21.15.45:0/3943644948 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f85200668d0 0x7f8520068d90 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:03.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.156+0000 7f8545632640 1 --2- 172.21.15.45:0/3943644948 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85400cfed0 0x7f85401f63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:03.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.156+0000 7f8545632640 1 --2- 172.21.15.45:0/3943644948 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85400b3cb0 0x7f8540159680 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:03.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.156+0000 7f8545632640 1 --2- 172.21.15.45:0/3943644948 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f85400b35f0 0x7f854009cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:03.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.156+0000 7f8545632640 1 -- 172.21.15.45:0/3943644948 >> 172.21.15.45:0/3943644948 conn(0x7f854009c4f0 msgr2=0x7f85400cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:41:03.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.156+0000 7f8545632640 1 -- 172.21.15.45:0/3943644948 shutdown_connections 2023-11-28T18:41:03.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.156+0000 7f8545632640 1 -- 172.21.15.45:0/3943644948 wait complete. 2023-11-28T18:41:03.180 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T18:37:21.293917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T18:39:34.106789+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T18:39:35.426601+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T18:41:03.180 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T18:41:03.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.324+0000 7f829b965640 1 Processor -- start 2023-11-28T18:41:03.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.324+0000 7f829b965640 1 -- start start 2023-11-28T18:41:03.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.324+0000 7f829b965640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f829414ac20 0x7f8294165a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:41:03.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.324+0000 7f829b965640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82940b2000 con 0x7f829414b220 2023-11-28T18:41:03.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.324+0000 7f829b965640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82940b22a0 con 0x7f82940b4560 2023-11-28T18:41:03.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.324+0000 7f829b965640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82940b2580 con 0x7f829414ac20 2023-11-28T18:41:03.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.328+0000 7f8298f00640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f829414b220 0x7f82940b3e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44238/0 (socket says 172.21.15.45:44238) 2023-11-28T18:41:03.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.328+0000 7f8298f00640 1 -- 172.21.15.45:0/1596053906 learned_addr learned my addr 172.21.15.45:0/1596053906 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:41:03.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.328+0000 7f8299701640 1 --2- 172.21.15.45:0/1596053906 >> v2:172.21.15.190:3300/0 conn(0x7f829414ac20 0x7f8294165a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:41:03.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.328+0000 7f828bfff640 1 -- 172.21.15.45:0/1596053906 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3434548870 0 0) 0x7f82940b2000 con 0x7f829414b220 2023-11-28T18:41:03.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.328+0000 7f828bfff640 1 -- 172.21.15.45:0/1596053906 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8280003530 con 0x7f829414b220 2023-11-28T18:41:03.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.328+0000 7f828bfff640 1 -- 172.21.15.45:0/1596053906 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3242638217 0 0) 0x7f82940b22a0 con 0x7f82940b4560 2023-11-28T18:41:03.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.328+0000 7f828bfff640 1 -- 172.21.15.45:0/1596053906 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82940b2000 con 0x7f82940b4560 2023-11-28T18:41:03.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.328+0000 7f828bfff640 1 -- 172.21.15.45:0/1596053906 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4166629742 0 0) 0x7f8280003530 con 0x7f829414b220 2023-11-28T18:41:03.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.328+0000 7f828bfff640 1 -- 172.21.15.45:0/1596053906 >> v2:172.21.15.190:3300/0 conn(0x7f829414ac20 msgr2=0x7f8294165a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:41:03.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.328+0000 7f828bfff640 1 --2- 172.21.15.45:0/1596053906 >> v2:172.21.15.190:3300/0 conn(0x7f829414ac20 0x7f8294165a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:03.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.328+0000 7f828bfff640 1 -- 172.21.15.45:0/1596053906 >> v1:172.21.15.190:6789/0 conn(0x7f82940b4560 legacy=0x7f8294070430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:41:03.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.328+0000 7f828bfff640 1 -- 172.21.15.45:0/1596053906 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82940b2860 con 0x7f829414b220 2023-11-28T18:41:03.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.328+0000 7f828bfff640 1 -- 172.21.15.45:0/1596053906 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4084481567 0 0) 0x7f8284001680 con 0x7f829414b220 2023-11-28T18:41:03.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.328+0000 7f828bfff640 1 -- 172.21.15.45:0/1596053906 >> v1:172.21.15.45:6789/0 conn(0x7f829414b220 legacy=0x7f82940b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:41:03.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.328+0000 7f828bfff640 1 --2- 172.21.15.45:0/1596053906 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8280003b10 0x7f8280003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:41:03.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.328+0000 7f828bfff640 1 --2- 172.21.15.45:0/1596053906 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82800047d0 0x7f8280004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:41:03.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.328+0000 7f828bfff640 1 --2- 172.21.15.45:0/1596053906 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8280005190 0x7f828000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:41:03.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.328+0000 7f828bfff640 1 -- 172.21.15.45:0/1596053906 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82940b2580 con 0x7f82800047d0 2023-11-28T18:41:03.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.328+0000 7f828bfff640 1 -- 172.21.15.45:0/1596053906 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f828000c010 con 0x7f8280003b10 2023-11-28T18:41:03.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.328+0000 7f828bfff640 1 -- 172.21.15.45:0/1596053906 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f828000c1d0 con 0x7f8280005190 2023-11-28T18:41:03.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.328+0000 7f8298f00640 1 --2- 172.21.15.45:0/1596053906 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82800047d0 0x7f8280004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:41:03.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.328+0000 7f8299701640 1 --2- 172.21.15.45:0/1596053906 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8280003b10 0x7f8280003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:41:03.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.328+0000 7f8299f02640 1 --2- 172.21.15.45:0/1596053906 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8280005190 0x7f828000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:41:03.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.328+0000 7f8298f00640 1 -- 172.21.15.45:0/1596053906 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8280005190 msgr2=0x7f828000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:41:03.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.328+0000 7f8298f00640 1 --2- 172.21.15.45:0/1596053906 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8280005190 0x7f828000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:03.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.328+0000 7f8298f00640 1 -- 172.21.15.45:0/1596053906 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8280003b10 msgr2=0x7f8280003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:41:03.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.328+0000 7f8298f00640 1 --2- 172.21.15.45:0/1596053906 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8280003b10 0x7f8280003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:03.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.328+0000 7f8298f00640 1 -- 172.21.15.45:0/1596053906 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8280003530 con 0x7f82800047d0 2023-11-28T18:41:03.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.328+0000 7f8299f02640 1 -- 172.21.15.45:0/1596053906 reap_dead start 2023-11-28T18:41:03.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.332+0000 7f8298f00640 1 --2- 172.21.15.45:0/1596053906 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82800047d0 0x7f8280004c50 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f828400c160 tx=0x7f828401cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60f9fd0874bfe807 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:41:03.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.332+0000 7f828bfff640 1 -- 172.21.15.45:0/1596053906 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82840058e0 con 0x7f82800047d0 2023-11-28T18:41:03.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.332+0000 7f828bfff640 1 -- 172.21.15.45:0/1596053906 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8284005a60 con 0x7f82800047d0 2023-11-28T18:41:03.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.332+0000 7f828bfff640 1 -- 172.21.15.45:0/1596053906 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8284005e50 con 0x7f82800047d0 2023-11-28T18:41:03.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.332+0000 7f829b965640 1 -- 172.21.15.45:0/1596053906 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82800047d0 msgr2=0x7f8280004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:41:03.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.332+0000 7f829b965640 1 --2- 172.21.15.45:0/1596053906 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82800047d0 0x7f8280004c50 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f828400c160 tx=0x7f828401cba0 comp rx=0 tx=0).stop 2023-11-28T18:41:03.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.332+0000 7f829b965640 1 -- 172.21.15.45:0/1596053906 shutdown_connections 2023-11-28T18:41:03.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.332+0000 7f829b965640 1 --2- 172.21.15.45:0/1596053906 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82800047d0 0x7f8280004c50 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:03.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.332+0000 7f829b965640 1 -- 172.21.15.45:0/1596053906 >> 172.21.15.45:0/1596053906 conn(0x7f82940b0d00 msgr2=0x7f82940b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:41:03.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.332+0000 7f829b965640 1 -- 172.21.15.45:0/1596053906 shutdown_connections 2023-11-28T18:41:03.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.332+0000 7f829b965640 1 -- 172.21.15.45:0/1596053906 wait complete. 2023-11-28T18:41:03.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.332+0000 7f829b965640 1 Processor -- start 2023-11-28T18:41:03.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.332+0000 7f829b965640 1 -- start start 2023-11-28T18:41:03.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.336+0000 7f829b965640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f82800047d0 0x7f8294161080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:41:03.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.336+0000 7f829b965640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f82940c8400 0x7f82940a8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:41:03.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.336+0000 7f829b965640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82940c8880 0x7f82940a89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:41:03.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.336+0000 7f829b965640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82941615c0 con 0x7f82940c8880 2023-11-28T18:41:03.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.336+0000 7f829b965640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f829413cb90 con 0x7f82940c8400 2023-11-28T18:41:03.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.336+0000 7f829b965640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f829413ce70 con 0x7f82800047d0 2023-11-28T18:41:03.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.336+0000 7f8299f02640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82940c8880 0x7f82940a89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:41:03.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.336+0000 7f8299f02640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82940c8880 0x7f82940a89b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46508/0 (socket says 172.21.15.45:46508) 2023-11-28T18:41:03.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.336+0000 7f8299f02640 1 -- 172.21.15.45:0/1324901452 learned_addr learned my addr 172.21.15.45:0/1324901452 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:41:03.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.336+0000 7f8298f00640 1 --2- 172.21.15.45:0/1324901452 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f82940c8400 0x7f82940a8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:41:03.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.336+0000 7f8299701640 1 --2- 172.21.15.45:0/1324901452 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f82800047d0 0x7f8294161080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:41:03.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.336+0000 7f8299f02640 1 -- 172.21.15.45:0/1324901452 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f82800047d0 msgr2=0x7f8294161080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:41:03.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.336+0000 7f8299f02640 1 --2- 172.21.15.45:0/1324901452 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f82800047d0 0x7f8294161080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:03.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.336+0000 7f8299f02640 1 -- 172.21.15.45:0/1324901452 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f82940c8400 msgr2=0x7f82940a8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:41:03.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.336+0000 7f8299f02640 1 --2- 172.21.15.45:0/1324901452 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f82940c8400 0x7f82940a8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:03.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.336+0000 7f8299f02640 1 -- 172.21.15.45:0/1324901452 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f829413d150 con 0x7f82940c8880 2023-11-28T18:41:03.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.336+0000 7f8299f02640 1 --2- 172.21.15.45:0/1324901452 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82940c8880 0x7f82940a89b0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f82940b1dc0 tx=0x7f828c011f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:41:03.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.336+0000 7f8289ffb640 1 -- 172.21.15.45:0/1324901452 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c00fc30 con 0x7f82940c8880 2023-11-28T18:41:03.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.336+0000 7f8289ffb640 1 -- 172.21.15.45:0/1324901452 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f828c00fdb0 con 0x7f82940c8880 2023-11-28T18:41:03.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.336+0000 7f8289ffb640 1 -- 172.21.15.45:0/1324901452 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c015650 con 0x7f82940c8880 2023-11-28T18:41:03.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.336+0000 7f829b965640 1 -- 172.21.15.45:0/1324901452 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f829413d430 con 0x7f82940c8880 2023-11-28T18:41:03.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.336+0000 7f829b965640 1 -- 172.21.15.45:0/1324901452 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f829413dc30 con 0x7f82940c8880 2023-11-28T18:41:03.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.336+0000 7f829b965640 1 -- 172.21.15.45:0/1324901452 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8294069410 con 0x7f82940c8880 2023-11-28T18:41:03.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.340+0000 7f8289ffb640 1 -- 172.21.15.45:0/1324901452 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f828c0157b0 con 0x7f82940c8880 2023-11-28T18:41:03.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.340+0000 7f8289ffb640 1 --2- 172.21.15.45:0/1324901452 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f8278066900 0x7f8278068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:41:03.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.340+0000 7f8289ffb640 1 -- 172.21.15.45:0/1324901452 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f828c087790 con 0x7f82940c8880 2023-11-28T18:41:03.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.340+0000 7f8299701640 1 --2- 172.21.15.45:0/1324901452 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f8278066900 0x7f8278068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:41:03.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.340+0000 7f8299701640 1 --2- 172.21.15.45:0/1324901452 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f8278066900 0x7f8278068dc0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f8290009b80 tx=0x7f8290009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:41:03.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.344+0000 7f8289ffb640 1 -- 172.21.15.45:0/1324901452 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f828c0548f0 con 0x7f82940c8880 2023-11-28T18:41:03.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.504+0000 7f829b965640 1 -- 172.21.15.45:0/1324901452 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f82940738c0 con 0x7f82940c8880 2023-11-28T18:41:03.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.504+0000 7f8289ffb640 1 -- 172.21.15.45:0/1324901452 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v48) v1 ==== 93+0+10 (secure 0 0 0) 0x7f828c057f10 con 0x7f82940c8880 2023-11-28T18:41:03.507 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-11-28T18:41:03.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.504+0000 7f829b965640 1 -- 172.21.15.45:0/1324901452 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f8278066900 msgr2=0x7f8278068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:41:03.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.504+0000 7f829b965640 1 --2- 172.21.15.45:0/1324901452 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f8278066900 0x7f8278068dc0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f8290009b80 tx=0x7f8290009190 comp rx=0 tx=0).stop 2023-11-28T18:41:03.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.504+0000 7f829b965640 1 -- 172.21.15.45:0/1324901452 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82940c8880 msgr2=0x7f82940a89b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:41:03.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.504+0000 7f829b965640 1 --2- 172.21.15.45:0/1324901452 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82940c8880 0x7f82940a89b0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f82940b1dc0 tx=0x7f828c011f20 comp rx=0 tx=0).stop 2023-11-28T18:41:03.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.504+0000 7f829b965640 1 -- 172.21.15.45:0/1324901452 shutdown_connections 2023-11-28T18:41:03.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.504+0000 7f829b965640 1 --2- 172.21.15.45:0/1324901452 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f8278066900 0x7f8278068dc0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:03.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.504+0000 7f829b965640 1 --2- 172.21.15.45:0/1324901452 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82940c8880 0x7f82940a89b0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:03.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.504+0000 7f829b965640 1 --2- 172.21.15.45:0/1324901452 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f82940c8400 0x7f82940a8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:03.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.504+0000 7f829b965640 1 --2- 172.21.15.45:0/1324901452 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f82800047d0 0x7f8294161080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:03.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.504+0000 7f829b965640 1 -- 172.21.15.45:0/1324901452 >> 172.21.15.45:0/1324901452 conn(0x7f82940b0d00 msgr2=0x7f829414a100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:41:03.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.504+0000 7f829b965640 1 -- 172.21.15.45:0/1324901452 shutdown_connections 2023-11-28T18:41:03.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.504+0000 7f829b965640 1 -- 172.21.15.45:0/1324901452 wait complete. 2023-11-28T18:41:03.528 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T18:41:03.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.672+0000 7f6a42c79640 1 Processor -- start 2023-11-28T18:41:03.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.672+0000 7f6a42c79640 1 -- start start 2023-11-28T18:41:03.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.672+0000 7f6a42c79640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6a3c0ce9a0 0x7f6a3c0ae0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:41:03.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.672+0000 7f6a42c79640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a3c0af1c0 con 0x7f6a3c06bc90 2023-11-28T18:41:03.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.672+0000 7f6a42c79640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a3c0ae920 con 0x7f6a3c0ced80 2023-11-28T18:41:03.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.672+0000 7f6a42c79640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a3c0aec00 con 0x7f6a3c0ce9a0 2023-11-28T18:41:03.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.672+0000 7f6a40a15640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6a3c0ce9a0 0x7f6a3c0ae0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:41:03.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.672+0000 7f6a40a15640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6a3c0ce9a0 0x7f6a3c0ae0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46514/0 (socket says 172.21.15.45:46514) 2023-11-28T18:41:03.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.672+0000 7f6a41216640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f6a3c06bc90 0x7f6a3c0b2d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44254/0 (socket says 172.21.15.45:44254) 2023-11-28T18:41:03.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.672+0000 7f6a40a15640 1 -- 172.21.15.45:0/3658893162 learned_addr learned my addr 172.21.15.45:0/3658893162 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:41:03.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.672+0000 7f6a40a15640 1 -- 172.21.15.45:0/3658893162 >> v1:172.21.15.190:6789/0 conn(0x7f6a3c0ced80 legacy=0x7f6a3c06b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:41:03.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.672+0000 7f6a40a15640 1 -- 172.21.15.45:0/3658893162 >> v1:172.21.15.45:6789/0 conn(0x7f6a3c06bc90 legacy=0x7f6a3c0b2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:41:03.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.672+0000 7f6a40a15640 1 -- 172.21.15.45:0/3658893162 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a3c0aeee0 con 0x7f6a3c0ce9a0 2023-11-28T18:41:03.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.676+0000 7f6a40a15640 1 --2- 172.21.15.45:0/3658893162 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a3c0ce9a0 0x7f6a3c0ae0a0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f6a30009870 tx=0x7f6a3001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6be5dc0d500df9ad server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:41:03.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.676+0000 7f6a3b7fe640 1 -- 172.21.15.45:0/3658893162 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a300ad680 con 0x7f6a3c0ce9a0 2023-11-28T18:41:03.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.676+0000 7f6a3b7fe640 1 -- 172.21.15.45:0/3658893162 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a300ad7e0 con 0x7f6a3c0ce9a0 2023-11-28T18:41:03.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.676+0000 7f6a3b7fe640 1 -- 172.21.15.45:0/3658893162 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a300adb70 con 0x7f6a3c0ce9a0 2023-11-28T18:41:03.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.676+0000 7f6a42c79640 1 -- 172.21.15.45:0/3658893162 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a3c0ce9a0 msgr2=0x7f6a3c0ae0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:41:03.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.676+0000 7f6a42c79640 1 --2- 172.21.15.45:0/3658893162 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a3c0ce9a0 0x7f6a3c0ae0a0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f6a30009870 tx=0x7f6a3001c3f0 comp rx=0 tx=0).stop 2023-11-28T18:41:03.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.676+0000 7f6a42c79640 1 -- 172.21.15.45:0/3658893162 shutdown_connections 2023-11-28T18:41:03.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.676+0000 7f6a42c79640 1 --2- 172.21.15.45:0/3658893162 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a3c0ce9a0 0x7f6a3c0ae0a0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:03.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.676+0000 7f6a42c79640 1 -- 172.21.15.45:0/3658893162 >> 172.21.15.45:0/3658893162 conn(0x7f6a3c0b1b70 msgr2=0x7f6a3c070cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:41:03.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.676+0000 7f6a42c79640 1 -- 172.21.15.45:0/3658893162 shutdown_connections 2023-11-28T18:41:03.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.676+0000 7f6a42c79640 1 -- 172.21.15.45:0/3658893162 wait complete. 2023-11-28T18:41:03.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.680+0000 7f6a42c79640 1 Processor -- start 2023-11-28T18:41:03.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.680+0000 7f6a42c79640 1 -- start start 2023-11-28T18:41:03.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.680+0000 7f6a42c79640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a3c06bc90 0x7f6a3c06e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:41:03.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.680+0000 7f6a42c79640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6a3c0ce9a0 0x7f6a3c137e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:41:03.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.680+0000 7f6a42c79640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6a3c0ced80 0x7f6a3c14fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:41:03.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.680+0000 7f6a42c79640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3c1383b0 con 0x7f6a3c06bc90 2023-11-28T18:41:03.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.680+0000 7f6a42c79640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3c154fc0 con 0x7f6a3c0ce9a0 2023-11-28T18:41:03.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.680+0000 7f6a42c79640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3c06d690 con 0x7f6a3c0ced80 2023-11-28T18:41:03.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.680+0000 7f6a40a15640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a3c06bc90 0x7f6a3c06e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:41:03.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.680+0000 7f6a40a15640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a3c06bc90 0x7f6a3c06e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46526/0 (socket says 172.21.15.45:46526) 2023-11-28T18:41:03.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.680+0000 7f6a40a15640 1 -- 172.21.15.45:0/2707926738 learned_addr learned my addr 172.21.15.45:0/2707926738 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:41:03.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.680+0000 7f6a41216640 1 --2- 172.21.15.45:0/2707926738 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6a3c0ced80 0x7f6a3c14fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:41:03.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.680+0000 7f6a3bfff640 1 --2- 172.21.15.45:0/2707926738 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6a3c0ce9a0 0x7f6a3c137e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:41:03.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.680+0000 7f6a40a15640 1 -- 172.21.15.45:0/2707926738 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6a3c0ced80 msgr2=0x7f6a3c14fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:41:03.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.680+0000 7f6a40a15640 1 --2- 172.21.15.45:0/2707926738 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6a3c0ced80 0x7f6a3c14fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:03.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.680+0000 7f6a40a15640 1 -- 172.21.15.45:0/2707926738 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6a3c0ce9a0 msgr2=0x7f6a3c137e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:41:03.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.680+0000 7f6a40a15640 1 --2- 172.21.15.45:0/2707926738 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6a3c0ce9a0 0x7f6a3c137e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:03.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.680+0000 7f6a40a15640 1 -- 172.21.15.45:0/2707926738 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a300094d0 con 0x7f6a3c06bc90 2023-11-28T18:41:03.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.680+0000 7f6a40a15640 1 --2- 172.21.15.45:0/2707926738 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a3c06bc90 0x7f6a3c06e730 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f6a3001a020 tx=0x7f6a3001ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:41:03.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.680+0000 7f6a397fa640 1 -- 172.21.15.45:0/2707926738 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a300b8620 con 0x7f6a3c06bc90 2023-11-28T18:41:03.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.680+0000 7f6a397fa640 1 -- 172.21.15.45:0/2707926738 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a300b8780 con 0x7f6a3c06bc90 2023-11-28T18:41:03.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.680+0000 7f6a397fa640 1 -- 172.21.15.45:0/2707926738 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a300b8b30 con 0x7f6a3c06bc90 2023-11-28T18:41:03.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.680+0000 7f6a42c79640 1 -- 172.21.15.45:0/2707926738 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a3c06b0d0 con 0x7f6a3c06bc90 2023-11-28T18:41:03.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.680+0000 7f6a42c79640 1 -- 172.21.15.45:0/2707926738 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a3c154a00 con 0x7f6a3c06bc90 2023-11-28T18:41:03.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.680+0000 7f6a42c79640 1 -- 172.21.15.45:0/2707926738 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a3c069410 con 0x7f6a3c06bc90 2023-11-28T18:41:03.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.684+0000 7f6a397fa640 1 -- 172.21.15.45:0/2707926738 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f6a300b4040 con 0x7f6a3c06bc90 2023-11-28T18:41:03.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.684+0000 7f6a397fa640 1 --2- 172.21.15.45:0/2707926738 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6a200668d0 0x7f6a20068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:41:03.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.684+0000 7f6a397fa640 1 -- 172.21.15.45:0/2707926738 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f6a3011eb10 con 0x7f6a3c06bc90 2023-11-28T18:41:03.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.684+0000 7f6a3bfff640 1 --2- 172.21.15.45:0/2707926738 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6a200668d0 0x7f6a20068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:41:03.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.684+0000 7f6a3bfff640 1 --2- 172.21.15.45:0/2707926738 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6a200668d0 0x7f6a20068d90 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c0afd30 tx=0x7f6a28009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:41:03.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.688+0000 7f6a397fa640 1 -- 172.21.15.45:0/2707926738 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6a300ebc70 con 0x7f6a3c06bc90 2023-11-28T18:41:03.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.844+0000 7f6a42c79640 1 -- 172.21.15.45:0/2707926738 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6a3c071fa0 con 0x7f6a3c06bc90 2023-11-28T18:41:03.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.844+0000 7f6a397fa640 1 -- 172.21.15.45:0/2707926738 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v48) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6a300ef290 con 0x7f6a3c06bc90 2023-11-28T18:41:03.850 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-11-28T18:41:03.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.848+0000 7f6a42c79640 1 -- 172.21.15.45:0/2707926738 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6a200668d0 msgr2=0x7f6a20068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:41:03.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.848+0000 7f6a42c79640 1 --2- 172.21.15.45:0/2707926738 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6a200668d0 0x7f6a20068d90 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c0afd30 tx=0x7f6a28009040 comp rx=0 tx=0).stop 2023-11-28T18:41:03.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.848+0000 7f6a42c79640 1 -- 172.21.15.45:0/2707926738 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a3c06bc90 msgr2=0x7f6a3c06e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:41:03.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.848+0000 7f6a42c79640 1 --2- 172.21.15.45:0/2707926738 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a3c06bc90 0x7f6a3c06e730 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f6a3001a020 tx=0x7f6a3001ac30 comp rx=0 tx=0).stop 2023-11-28T18:41:03.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.848+0000 7f6a42c79640 1 -- 172.21.15.45:0/2707926738 shutdown_connections 2023-11-28T18:41:03.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.848+0000 7f6a42c79640 1 --2- 172.21.15.45:0/2707926738 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6a200668d0 0x7f6a20068d90 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:03.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.848+0000 7f6a42c79640 1 --2- 172.21.15.45:0/2707926738 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6a3c0ced80 0x7f6a3c14fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:03.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.848+0000 7f6a42c79640 1 --2- 172.21.15.45:0/2707926738 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6a3c0ce9a0 0x7f6a3c137e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:03.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.848+0000 7f6a42c79640 1 --2- 172.21.15.45:0/2707926738 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a3c06bc90 0x7f6a3c06e730 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:03.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.848+0000 7f6a42c79640 1 -- 172.21.15.45:0/2707926738 >> 172.21.15.45:0/2707926738 conn(0x7f6a3c0b1b70 msgr2=0x7f6a3c0afef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:41:03.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.848+0000 7f6a42c79640 1 -- 172.21.15.45:0/2707926738 shutdown_connections 2023-11-28T18:41:03.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:03.848+0000 7f6a42c79640 1 -- 172.21.15.45:0/2707926738 wait complete. 2023-11-28T18:41:03.871 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T18:41:04.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.012+0000 7fb62c9a7640 1 Processor -- start 2023-11-28T18:41:04.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.012+0000 7fb62c9a7640 1 -- start start 2023-11-28T18:41:04.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.016+0000 7fb62c9a7640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb62815e5d0 0x7fb6280ce5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:41:04.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.016+0000 7fb62c9a7640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fb6280ae050 0x7fb62806c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:41:04.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.016+0000 7fb62c9a7640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6280ce370 con 0x7fb6280b3b00 2023-11-28T18:41:04.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.016+0000 7fb62c9a7640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb62815e9b0 con 0x7fb6280ae050 2023-11-28T18:41:04.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.016+0000 7fb62c9a7640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6280b2ce0 con 0x7fb62815e5d0 2023-11-28T18:41:04.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.016+0000 7fb627fff640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fb6280ae050 0x7fb62806c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:41:04.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.016+0000 7fb6277fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb62815e5d0 0x7fb6280ce5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:41:04.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.016+0000 7fb627fff640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fb6280ae050 0x7fb62806c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.45:42432/0 (socket says 172.21.15.45:42432) 2023-11-28T18:41:04.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.016+0000 7fb627fff640 1 -- 172.21.15.45:0/2712703233 learned_addr learned my addr 172.21.15.45:0/2712703233 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:41:04.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.016+0000 7fb6277fe640 1 -- 172.21.15.45:0/2712703233 >> v2:172.21.15.190:3300/0 conn(0x7fb6280ae050 msgr2=0x7fb62806c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:41:04.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.016+0000 7fb6277fe640 1 --2- 172.21.15.45:0/2712703233 >> v2:172.21.15.190:3300/0 conn(0x7fb6280ae050 0x7fb62806c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:04.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.016+0000 7fb6277fe640 1 -- 172.21.15.45:0/2712703233 >> v1:172.21.15.190:6789/0 conn(0x7fb6280b3b00 legacy=0x7fb6280ad940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:41:04.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.016+0000 7fb6277fe640 1 -- 172.21.15.45:0/2712703233 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6280b40c0 con 0x7fb62815e5d0 2023-11-28T18:41:04.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.020+0000 7fb6277fe640 1 --2- 172.21.15.45:0/2712703233 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb62815e5d0 0x7fb6280ce5e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb6180097c0 tx=0x7fb61801c360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=972b0c9339e383be server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:41:04.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.020+0000 7fb6267fc640 1 -- 172.21.15.45:0/2712703233 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6180ab600 con 0x7fb62815e5d0 2023-11-28T18:41:04.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.020+0000 7fb6267fc640 1 -- 172.21.15.45:0/2712703233 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6180a7050 con 0x7fb62815e5d0 2023-11-28T18:41:04.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.020+0000 7fb6267fc640 1 -- 172.21.15.45:0/2712703233 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6180ab980 con 0x7fb62815e5d0 2023-11-28T18:41:04.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.020+0000 7fb62c9a7640 1 -- 172.21.15.45:0/2712703233 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb62815e5d0 msgr2=0x7fb6280ce5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:41:04.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.020+0000 7fb62c9a7640 1 --2- 172.21.15.45:0/2712703233 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb62815e5d0 0x7fb6280ce5e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb6180097c0 tx=0x7fb61801c360 comp rx=0 tx=0).stop 2023-11-28T18:41:04.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.020+0000 7fb62c9a7640 1 -- 172.21.15.45:0/2712703233 shutdown_connections 2023-11-28T18:41:04.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.020+0000 7fb62c9a7640 1 --2- 172.21.15.45:0/2712703233 >> v2:172.21.15.190:3300/0 conn(0x7fb6280ae050 0x7fb62806c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:04.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.020+0000 7fb62c9a7640 1 --2- 172.21.15.45:0/2712703233 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb62815e5d0 0x7fb6280ce5e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:04.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.020+0000 7fb62c9a7640 1 -- 172.21.15.45:0/2712703233 >> 172.21.15.45:0/2712703233 conn(0x7fb6280b0960 msgr2=0x7fb6280b0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:41:04.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.020+0000 7fb62c9a7640 1 -- 172.21.15.45:0/2712703233 shutdown_connections 2023-11-28T18:41:04.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.020+0000 7fb62c9a7640 1 -- 172.21.15.45:0/2712703233 wait complete. 2023-11-28T18:41:04.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.020+0000 7fb62c9a7640 1 Processor -- start 2023-11-28T18:41:04.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.020+0000 7fb62c9a7640 1 -- start start 2023-11-28T18:41:04.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.024+0000 7fb62c9a7640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb6280ae050 0x7fb6280719b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:41:04.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.024+0000 7fb62c9a7640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb6280b3b00 0x7fb628147350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:41:04.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.024+0000 7fb62c9a7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb62815e5d0 0x7fb628147890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:41:04.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.024+0000 7fb62c9a7640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb628164dc0 con 0x7fb62815e5d0 2023-11-28T18:41:04.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.024+0000 7fb62c9a7640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb628165010 con 0x7fb6280ae050 2023-11-28T18:41:04.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.024+0000 7fb62c9a7640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6281652f0 con 0x7fb6280b3b00 2023-11-28T18:41:04.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.024+0000 7fb627fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb62815e5d0 0x7fb628147890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:41:04.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.024+0000 7fb627fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb62815e5d0 0x7fb628147890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46528/0 (socket says 172.21.15.45:46528) 2023-11-28T18:41:04.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.024+0000 7fb627fff640 1 -- 172.21.15.45:0/1204893586 learned_addr learned my addr 172.21.15.45:0/1204893586 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:41:04.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.024+0000 7fb6277fe640 1 --2- 172.21.15.45:0/1204893586 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb6280ae050 0x7fb6280719b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:41:04.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.024+0000 7fb626ffd640 1 --2- 172.21.15.45:0/1204893586 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb6280b3b00 0x7fb628147350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:41:04.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.024+0000 7fb627fff640 1 -- 172.21.15.45:0/1204893586 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb6280b3b00 msgr2=0x7fb628147350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:41:04.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.024+0000 7fb627fff640 1 --2- 172.21.15.45:0/1204893586 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb6280b3b00 0x7fb628147350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:04.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.024+0000 7fb627fff640 1 -- 172.21.15.45:0/1204893586 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb6280ae050 msgr2=0x7fb6280719b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:41:04.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.024+0000 7fb627fff640 1 --2- 172.21.15.45:0/1204893586 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb6280ae050 0x7fb6280719b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:04.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.024+0000 7fb627fff640 1 -- 172.21.15.45:0/1204893586 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb618009420 con 0x7fb62815e5d0 2023-11-28T18:41:04.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.024+0000 7fb627fff640 1 --2- 172.21.15.45:0/1204893586 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb62815e5d0 0x7fb628147890 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fb62000efc0 tx=0x7fb62000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:41:04.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.024+0000 7fb60ffff640 1 -- 172.21.15.45:0/1204893586 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb620009b60 con 0x7fb62815e5d0 2023-11-28T18:41:04.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.024+0000 7fb60ffff640 1 -- 172.21.15.45:0/1204893586 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb62000f040 con 0x7fb62815e5d0 2023-11-28T18:41:04.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.024+0000 7fb60ffff640 1 -- 172.21.15.45:0/1204893586 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6200039a0 con 0x7fb62815e5d0 2023-11-28T18:41:04.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.024+0000 7fb62c9a7640 1 -- 172.21.15.45:0/1204893586 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb62814b620 con 0x7fb62815e5d0 2023-11-28T18:41:04.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.024+0000 7fb62c9a7640 1 -- 172.21.15.45:0/1204893586 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb628159e30 con 0x7fb62815e5d0 2023-11-28T18:41:04.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.024+0000 7fb62c9a7640 1 -- 172.21.15.45:0/1204893586 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb62814b480 con 0x7fb62815e5d0 2023-11-28T18:41:04.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.028+0000 7fb60ffff640 1 -- 172.21.15.45:0/1204893586 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fb620003b00 con 0x7fb62815e5d0 2023-11-28T18:41:04.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.028+0000 7fb60ffff640 1 --2- 172.21.15.45:0/1204893586 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fb6140668d0 0x7fb614068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:41:04.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.028+0000 7fb60ffff640 1 -- 172.21.15.45:0/1204893586 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fb6200848d0 con 0x7fb62815e5d0 2023-11-28T18:41:04.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.028+0000 7fb6277fe640 1 --2- 172.21.15.45:0/1204893586 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fb6140668d0 0x7fb614068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:41:04.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.028+0000 7fb6277fe640 1 --2- 172.21.15.45:0/1204893586 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fb6140668d0 0x7fb614068d90 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb6180ad000 tx=0x7fb6180a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:41:04.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.032+0000 7fb60ffff640 1 -- 172.21.15.45:0/1204893586 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb62814b480 con 0x7fb62815e5d0 2023-11-28T18:41:04.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.188+0000 7fb62c9a7640 1 -- 172.21.15.45:0/1204893586 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb62814b480 con 0x7fb62815e5d0 2023-11-28T18:41:04.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.188+0000 7fb60ffff640 1 -- 172.21.15.45:0/1204893586 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v48) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb62814b480 con 0x7fb62815e5d0 2023-11-28T18:41:04.193 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-11-28T18:41:04.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.192+0000 7fb62c9a7640 1 -- 172.21.15.45:0/1204893586 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fb6140668d0 msgr2=0x7fb614068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:41:04.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.192+0000 7fb62c9a7640 1 --2- 172.21.15.45:0/1204893586 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fb6140668d0 0x7fb614068d90 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb6180ad000 tx=0x7fb6180a6000 comp rx=0 tx=0).stop 2023-11-28T18:41:04.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.192+0000 7fb62c9a7640 1 -- 172.21.15.45:0/1204893586 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb62815e5d0 msgr2=0x7fb628147890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:41:04.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.192+0000 7fb62c9a7640 1 --2- 172.21.15.45:0/1204893586 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb62815e5d0 0x7fb628147890 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fb62000efc0 tx=0x7fb62000c490 comp rx=0 tx=0).stop 2023-11-28T18:41:04.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.192+0000 7fb62c9a7640 1 -- 172.21.15.45:0/1204893586 shutdown_connections 2023-11-28T18:41:04.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.192+0000 7fb62c9a7640 1 --2- 172.21.15.45:0/1204893586 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fb6140668d0 0x7fb614068d90 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:04.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.192+0000 7fb62c9a7640 1 --2- 172.21.15.45:0/1204893586 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb62815e5d0 0x7fb628147890 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:04.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.192+0000 7fb62c9a7640 1 --2- 172.21.15.45:0/1204893586 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb6280b3b00 0x7fb628147350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:04.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.192+0000 7fb62c9a7640 1 --2- 172.21.15.45:0/1204893586 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb6280ae050 0x7fb6280719b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:04.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.192+0000 7fb62c9a7640 1 -- 172.21.15.45:0/1204893586 >> 172.21.15.45:0/1204893586 conn(0x7fb6280b0960 msgr2=0x7fb628150750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:41:04.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.192+0000 7fb62c9a7640 1 -- 172.21.15.45:0/1204893586 shutdown_connections 2023-11-28T18:41:04.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.192+0000 7fb62c9a7640 1 -- 172.21.15.45:0/1204893586 wait complete. 2023-11-28T18:41:04.215 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T18:41:04.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.356+0000 7f02b56d6640 1 Processor -- start 2023-11-28T18:41:04.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.356+0000 7f02b56d6640 1 -- start start 2023-11-28T18:41:04.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.356+0000 7f02b56d6640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f02b0144880 0x7f02b006c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:41:04.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.356+0000 7f02b56d6640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f02b0070bb0 0x7f02b006c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:41:04.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.356+0000 7f02b56d6640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02b0071120 con 0x7f02b00721c0 2023-11-28T18:41:04.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.360+0000 7f02b56d6640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02b015f050 con 0x7f02b0144880 2023-11-28T18:41:04.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.360+0000 7f02b56d6640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02b0071400 con 0x7f02b0070bb0 2023-11-28T18:41:04.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.360+0000 7f02aeffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f02b0144880 0x7f02b006c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:41:04.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.360+0000 7f02aeffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f02b0144880 0x7f02b006c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46544/0 (socket says 172.21.15.45:46544) 2023-11-28T18:41:04.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.360+0000 7f02aeffd640 1 -- 172.21.15.45:0/2653539238 learned_addr learned my addr 172.21.15.45:0/2653539238 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:41:04.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.360+0000 7f02aeffd640 1 -- 172.21.15.45:0/2653539238 >> v2:172.21.15.190:3300/0 conn(0x7f02b0070bb0 msgr2=0x7f02b006c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:41:04.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.360+0000 7f02aeffd640 1 --2- 172.21.15.45:0/2653539238 >> v2:172.21.15.190:3300/0 conn(0x7f02b0070bb0 0x7f02b006c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:04.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.360+0000 7f02aeffd640 1 -- 172.21.15.45:0/2653539238 >> v1:172.21.15.190:6789/0 conn(0x7f02b00721c0 legacy=0x7f02b00704a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:41:04.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.360+0000 7f02aeffd640 1 -- 172.21.15.45:0/2653539238 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02b00716e0 con 0x7f02b0144880 2023-11-28T18:41:04.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.360+0000 7f02aeffd640 1 --2- 172.21.15.45:0/2653539238 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02b0144880 0x7f02b006c300 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f02b00b20b0 tx=0x7f02a0024bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29deb0980ebd822f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:41:04.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.364+0000 7f02ae7fc640 1 -- 172.21.15.45:0/2653539238 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a000d2d0 con 0x7f02b0144880 2023-11-28T18:41:04.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.364+0000 7f02ae7fc640 1 -- 172.21.15.45:0/2653539238 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02a00ad990 con 0x7f02b0144880 2023-11-28T18:41:04.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.364+0000 7f02ae7fc640 1 -- 172.21.15.45:0/2653539238 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a00add20 con 0x7f02b0144880 2023-11-28T18:41:04.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.364+0000 7f02b56d6640 1 -- 172.21.15.45:0/2653539238 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02b0144880 msgr2=0x7f02b006c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:41:04.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.364+0000 7f02b56d6640 1 --2- 172.21.15.45:0/2653539238 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02b0144880 0x7f02b006c300 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f02b00b20b0 tx=0x7f02a0024bb0 comp rx=0 tx=0).stop 2023-11-28T18:41:04.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.364+0000 7f02b56d6640 1 -- 172.21.15.45:0/2653539238 shutdown_connections 2023-11-28T18:41:04.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.364+0000 7f02b56d6640 1 --2- 172.21.15.45:0/2653539238 >> v2:172.21.15.190:3300/0 conn(0x7f02b0070bb0 0x7f02b006c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:04.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.364+0000 7f02b56d6640 1 --2- 172.21.15.45:0/2653539238 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02b0144880 0x7f02b006c300 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:04.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.364+0000 7f02b56d6640 1 -- 172.21.15.45:0/2653539238 >> 172.21.15.45:0/2653539238 conn(0x7f02b006a570 msgr2=0x7f02b006a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:41:04.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.364+0000 7f02b56d6640 1 -- 172.21.15.45:0/2653539238 shutdown_connections 2023-11-28T18:41:04.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.364+0000 7f02b56d6640 1 -- 172.21.15.45:0/2653539238 wait complete. 2023-11-28T18:41:04.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.364+0000 7f02b56d6640 1 Processor -- start 2023-11-28T18:41:04.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.364+0000 7f02b56d6640 1 -- start start 2023-11-28T18:41:04.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.364+0000 7f02b56d6640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f02b0070bb0 0x7f02b00c8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:41:04.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.364+0000 7f02b56d6640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f02b00721c0 0x7f02b00c4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:41:04.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.364+0000 7f02b56d6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02b0144880 0x7f02b00c9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:41:04.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.364+0000 7f02b56d6640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b00c8e00 con 0x7f02b0144880 2023-11-28T18:41:04.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.364+0000 7f02b56d6640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b00c90e0 con 0x7f02b0070bb0 2023-11-28T18:41:04.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.364+0000 7f02b56d6640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02b00c93c0 con 0x7f02b00721c0 2023-11-28T18:41:04.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.368+0000 7f02af7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02b0144880 0x7f02b00c9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:41:04.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.368+0000 7f02af7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02b0144880 0x7f02b00c9ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46558/0 (socket says 172.21.15.45:46558) 2023-11-28T18:41:04.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.368+0000 7f02af7fe640 1 -- 172.21.15.45:0/3585818398 learned_addr learned my addr 172.21.15.45:0/3585818398 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:41:04.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.368+0000 7f02aeffd640 1 --2- 172.21.15.45:0/3585818398 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f02b0070bb0 0x7f02b00c8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:41:04.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.368+0000 7f02a7fff640 1 --2- 172.21.15.45:0/3585818398 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f02b00721c0 0x7f02b00c4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:41:04.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.368+0000 7f02af7fe640 1 -- 172.21.15.45:0/3585818398 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f02b00721c0 msgr2=0x7f02b00c4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:41:04.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.368+0000 7f02af7fe640 1 --2- 172.21.15.45:0/3585818398 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f02b00721c0 0x7f02b00c4ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:04.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.368+0000 7f02af7fe640 1 -- 172.21.15.45:0/3585818398 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f02b0070bb0 msgr2=0x7f02b00c8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:41:04.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.368+0000 7f02af7fe640 1 --2- 172.21.15.45:0/3585818398 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f02b0070bb0 0x7f02b00c8590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:04.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.368+0000 7f02af7fe640 1 -- 172.21.15.45:0/3585818398 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02a000d970 con 0x7f02b0144880 2023-11-28T18:41:04.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.368+0000 7f02af7fe640 1 --2- 172.21.15.45:0/3585818398 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02b0144880 0x7f02b00c9ea0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f02a800b970 tx=0x7f02a800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:41:04.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.368+0000 7f02a77fe640 1 -- 172.21.15.45:0/3585818398 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a800cb40 con 0x7f02b0144880 2023-11-28T18:41:04.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.368+0000 7f02a77fe640 1 -- 172.21.15.45:0/3585818398 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02a800ccc0 con 0x7f02b0144880 2023-11-28T18:41:04.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.368+0000 7f02a77fe640 1 -- 172.21.15.45:0/3585818398 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a8014680 con 0x7f02b0144880 2023-11-28T18:41:04.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.368+0000 7f02b56d6640 1 -- 172.21.15.45:0/3585818398 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02b00c96a0 con 0x7f02b0144880 2023-11-28T18:41:04.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.368+0000 7f02b56d6640 1 -- 172.21.15.45:0/3585818398 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02b00c8ad0 con 0x7f02b0144880 2023-11-28T18:41:04.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.368+0000 7f02b56d6640 1 -- 172.21.15.45:0/3585818398 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02b00c9bc0 con 0x7f02b0144880 2023-11-28T18:41:04.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.368+0000 7f02a77fe640 1 -- 172.21.15.45:0/3585818398 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f02a801d3b0 con 0x7f02b0144880 2023-11-28T18:41:04.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.372+0000 7f02a77fe640 1 --2- 172.21.15.45:0/3585818398 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f02900668d0 0x7f0290068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:41:04.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.372+0000 7f02a77fe640 1 -- 172.21.15.45:0/3585818398 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f02a8084360 con 0x7f02b0144880 2023-11-28T18:41:04.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.372+0000 7f02aeffd640 1 --2- 172.21.15.45:0/3585818398 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f02900668d0 0x7f0290068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:41:04.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.372+0000 7f02aeffd640 1 --2- 172.21.15.45:0/3585818398 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f02900668d0 0x7f0290068d90 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f02a00b6000 tx=0x7f02a00af070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:41:04.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.376+0000 7f02a77fe640 1 -- 172.21.15.45:0/3585818398 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f02a8051610 con 0x7f02b0144880 2023-11-28T18:41:04.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.544+0000 7f02b56d6640 1 -- 172.21.15.45:0/3585818398 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f02b0069480 con 0x7f02b0144880 2023-11-28T18:41:04.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.548+0000 7f02a77fe640 1 -- 172.21.15.45:0/3585818398 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v48) v1 ==== 80+0+0 (secure 0 0 0) 0x7f02a8054c30 con 0x7f02b0144880 2023-11-28T18:41:04.550 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-11-28T18:41:04.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.548+0000 7f02b56d6640 1 -- 172.21.15.45:0/3585818398 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f02900668d0 msgr2=0x7f0290068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:41:04.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.548+0000 7f02b56d6640 1 --2- 172.21.15.45:0/3585818398 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f02900668d0 0x7f0290068d90 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f02a00b6000 tx=0x7f02a00af070 comp rx=0 tx=0).stop 2023-11-28T18:41:04.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.548+0000 7f02b56d6640 1 -- 172.21.15.45:0/3585818398 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02b0144880 msgr2=0x7f02b00c9ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:41:04.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.548+0000 7f02b56d6640 1 --2- 172.21.15.45:0/3585818398 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02b0144880 0x7f02b00c9ea0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f02a800b970 tx=0x7f02a800be30 comp rx=0 tx=0).stop 2023-11-28T18:41:04.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.548+0000 7f02b56d6640 1 -- 172.21.15.45:0/3585818398 shutdown_connections 2023-11-28T18:41:04.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.548+0000 7f02b56d6640 1 --2- 172.21.15.45:0/3585818398 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f02900668d0 0x7f0290068d90 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:04.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.548+0000 7f02b56d6640 1 --2- 172.21.15.45:0/3585818398 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02b0144880 0x7f02b00c9ea0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:04.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.548+0000 7f02b56d6640 1 --2- 172.21.15.45:0/3585818398 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f02b00721c0 0x7f02b00c4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:04.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.548+0000 7f02b56d6640 1 --2- 172.21.15.45:0/3585818398 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f02b0070bb0 0x7f02b00c8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:04.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.548+0000 7f02b56d6640 1 -- 172.21.15.45:0/3585818398 >> 172.21.15.45:0/3585818398 conn(0x7f02b006a570 msgr2=0x7f02b00c3f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:41:04.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.548+0000 7f02b56d6640 1 -- 172.21.15.45:0/3585818398 shutdown_connections 2023-11-28T18:41:04.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:04.548+0000 7f02b56d6640 1 -- 172.21.15.45:0/3585818398 wait complete. 2023-11-28T18:41:04.571 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi045.front.sepia.ceph.com... 2023-11-28T18:41:04.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:41:04.572 DEBUG:teuthology.orchestra.run.smithi045:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-28T18:41:04.591 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:ceph-fuse[50128]: fuse finished with error 0 and tester_r 0 2023-11-28T18:41:04.594 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T18:41:10.696 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi045.front.sepia.ceph.com 2023-11-28T18:41:10.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:41:10.696 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-28T18:41:10.708 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-28T18:41:10.708 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T18:41:10.718 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354684k,nr_inodes=4088671,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9377 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-28T18:41:10.718 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.1 is not mounted at ubuntu@smithi190.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1 2023-11-28T18:41:10.718 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi190.front.sepia.ceph.com 2023-11-28T18:41:10.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:41:10.718 DEBUG:teuthology.orchestra.run.smithi190:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-28T18:41:10.773 INFO:teuthology.orchestra.run.smithi190.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-11-28T18:41:10.774 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T18:41:10.774 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T18:41:10.774 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T18:41:10.784 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357768k,nr_inodes=4089442,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9360 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276000k,nr_inodes=819000,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-28T18:41:10.784 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.2 is not mounted at ubuntu@smithi045.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.2 2023-11-28T18:41:10.784 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi045.front.sepia.ceph.com 2023-11-28T18:41:10.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:41:10.785 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-28T18:41:10.839 INFO:teuthology.orchestra.run.smithi045.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-28T18:41:10.839 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T18:41:10.840 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-28T18:41:10.840 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T18:41:10.849 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354684k,nr_inodes=4088671,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9377 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-28T18:41:10.849 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.3 is not mounted at ubuntu@smithi190.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.3 2023-11-28T18:41:10.850 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi190.front.sepia.ceph.com 2023-11-28T18:41:10.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:41:10.850 DEBUG:teuthology.orchestra.run.smithi190:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-28T18:41:10.901 INFO:teuthology.orchestra.run.smithi190.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-28T18:41:10.902 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T18:41:10.902 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-28T18:41:11.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:11.056+0000 7f6f6bb0f640 1 Processor -- start 2023-11-28T18:41:11.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:11.056+0000 7f6f6bb0f640 1 -- start start 2023-11-28T18:41:11.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:11.056+0000 7f6f6bb0f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6f6415bcd0 0x7f6f6406c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:41:11.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:11.056+0000 7f6f6bb0f640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f6f6415c0b0 0x7f6f6406c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:41:11.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:11.056+0000 7f6f6bb0f640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f64146000 con 0x7f6f64145290 2023-11-28T18:41:11.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:11.056+0000 7f6f6bb0f640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f641462e0 con 0x7f6f6415bcd0 2023-11-28T18:41:11.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:11.056+0000 7f6f6bb0f640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f641465c0 con 0x7f6f6415c0b0 2023-11-28T18:41:11.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:11.056+0000 7f6f698ab640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6f6415bcd0 0x7f6f6406c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:41:11.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:11.056+0000 7f6f6a0ac640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f6f64145290 0x7f6f64145740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51976/0 (socket says 172.21.15.45:51976) 2023-11-28T18:41:11.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:11.056+0000 7f6f6a0ac640 1 -- 172.21.15.45:0/80712855 learned_addr learned my addr 172.21.15.45:0/80712855 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:41:11.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:11.056+0000 7f6f690aa640 1 --2- 172.21.15.45:0/80712855 >> v2:172.21.15.190:3300/0 conn(0x7f6f6415c0b0 0x7f6f6406c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:41:11.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:11.056+0000 7f6f698ab640 1 -- 172.21.15.45:0/80712855 >> v2:172.21.15.190:3300/0 conn(0x7f6f6415c0b0 msgr2=0x7f6f6406c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:41:11.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:11.056+0000 7f6f698ab640 1 --2- 172.21.15.45:0/80712855 >> v2:172.21.15.190:3300/0 conn(0x7f6f6415c0b0 0x7f6f6406c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:11.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:11.056+0000 7f6f698ab640 1 -- 172.21.15.45:0/80712855 >> v1:172.21.15.45:6789/0 conn(0x7f6f64145290 legacy=0x7f6f64145740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:41:11.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:11.056+0000 7f6f698ab640 1 -- 172.21.15.45:0/80712855 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f641468a0 con 0x7f6f6415bcd0 2023-11-28T18:41:11.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:11.056+0000 7f6f688a9640 1 -- 172.21.15.45:0/80712855 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2834784500 0 0) 0x7f6f64146000 con 0x7f6f64145290 2023-11-28T18:41:11.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:11.060+0000 7f6f698ab640 1 --2- 172.21.15.45:0/80712855 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f6415bcd0 0x7f6f6406c300 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f6f600097c0 tx=0x7f6f6001c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffdf176e9f7e6baf server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:41:11.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:11.060+0000 7f6f688a9640 1 -- 172.21.15.45:0/80712855 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f600ab600 con 0x7f6f6415bcd0 2023-11-28T18:41:11.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:11.060+0000 7f6f688a9640 1 -- 172.21.15.45:0/80712855 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f600a7050 con 0x7f6f6415bcd0 2023-11-28T18:41:11.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:11.060+0000 7f6f688a9640 1 -- 172.21.15.45:0/80712855 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f600ab980 con 0x7f6f6415bcd0 2023-11-28T18:41:11.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:11.060+0000 7f6f6bb0f640 1 -- 172.21.15.45:0/80712855 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f6415bcd0 msgr2=0x7f6f6406c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:41:11.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:11.060+0000 7f6f6bb0f640 1 --2- 172.21.15.45:0/80712855 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f6415bcd0 0x7f6f6406c300 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f6f600097c0 tx=0x7f6f6001c3b0 comp rx=0 tx=0).stop 2023-11-28T18:41:11.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:11.060+0000 7f6f6bb0f640 1 -- 172.21.15.45:0/80712855 shutdown_connections 2023-11-28T18:41:11.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:11.060+0000 7f6f6bb0f640 1 --2- 172.21.15.45:0/80712855 >> v2:172.21.15.190:3300/0 conn(0x7f6f6415c0b0 0x7f6f6406c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:11.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:11.060+0000 7f6f6bb0f640 1 --2- 172.21.15.45:0/80712855 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f6415bcd0 0x7f6f6406c300 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:11.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:11.060+0000 7f6f6bb0f640 1 -- 172.21.15.45:0/80712855 >> 172.21.15.45:0/80712855 conn(0x7f6f6406a570 msgr2=0x7f6f6406a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:41:11.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:11.060+0000 7f6f6bb0f640 1 -- 172.21.15.45:0/80712855 shutdown_connections 2023-11-28T18:41:11.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:11.060+0000 7f6f6bb0f640 1 -- 172.21.15.45:0/80712855 wait complete. 2023-11-28T18:41:11.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:11.064+0000 7f6f6bb0f640 1 Processor -- start 2023-11-28T18:41:11.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:11.064+0000 7f6f6bb0f640 1 -- start start 2023-11-28T18:41:11.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:11.064+0000 7f6f6bb0f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f64145290 0x7f6f64157a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:41:11.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:11.064+0000 7f6f6bb0f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f6415bcd0 0x7f6f64141a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:41:11.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:11.064+0000 7f6f6bb0f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6f6415c0b0 0x7f6f64141f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:41:11.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:11.064+0000 7f6f6bb0f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f64164920 con 0x7f6f64145290 2023-11-28T18:41:11.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:11.064+0000 7f6f6bb0f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f64142630 con 0x7f6f6415bcd0 2023-11-28T18:41:11.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:11.064+0000 7f6f6bb0f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f64142910 con 0x7f6f6415c0b0 2023-11-28T18:41:11.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:11.064+0000 7f6f698ab640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f64145290 0x7f6f64157a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:41:11.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:11.064+0000 7f6f698ab640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f64145290 0x7f6f64157a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44180/0 (socket says 172.21.15.45:44180) 2023-11-28T18:41:11.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:11.064+0000 7f6f698ab640 1 -- 172.21.15.45:0/2210897526 learned_addr learned my addr 172.21.15.45:0/2210897526 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:41:11.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:11.064+0000 7f6f698ab640 1 -- 172.21.15.45:0/2210897526 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6f6415c0b0 msgr2=0x7f6f64141f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:41:11.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:11.064+0000 7f6f698ab640 1 --2- 172.21.15.45:0/2210897526 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6f6415c0b0 0x7f6f64141f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:11.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:11.064+0000 7f6f698ab640 1 -- 172.21.15.45:0/2210897526 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f6415bcd0 msgr2=0x7f6f64141a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:41:11.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:11.064+0000 7f6f690aa640 1 --2- 172.21.15.45:0/2210897526 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f6415bcd0 0x7f6f64141a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:41:11.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:11.064+0000 7f6f698ab640 1 --2- 172.21.15.45:0/2210897526 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f6415bcd0 0x7f6f64141a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:11.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:11.064+0000 7f6f698ab640 1 -- 172.21.15.45:0/2210897526 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f60009420 con 0x7f6f64145290 2023-11-28T18:41:11.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:11.064+0000 7f6f690aa640 1 --2- 172.21.15.45:0/2210897526 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f6415bcd0 0x7f6f64141a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:41:11.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:11.064+0000 7f6f698ab640 1 --2- 172.21.15.45:0/2210897526 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f64145290 0x7f6f64157a00 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f6f600ae040 tx=0x7f6f6001abf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:41:11.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:11.064+0000 7f6f5a7fc640 1 -- 172.21.15.45:0/2210897526 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f600b7650 con 0x7f6f64145290 2023-11-28T18:41:11.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:11.064+0000 7f6f5a7fc640 1 -- 172.21.15.45:0/2210897526 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f600b77d0 con 0x7f6f64145290 2023-11-28T18:41:11.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:11.064+0000 7f6f6bb0f640 1 -- 172.21.15.45:0/2210897526 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f64142bf0 con 0x7f6f64145290 2023-11-28T18:41:11.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:11.064+0000 7f6f5a7fc640 1 -- 172.21.15.45:0/2210897526 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f600b7b80 con 0x7f6f64145290 2023-11-28T18:41:11.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:11.064+0000 7f6f6bb0f640 1 -- 172.21.15.45:0/2210897526 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f64153920 con 0x7f6f64145290 2023-11-28T18:41:11.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:11.064+0000 7f6f6bb0f640 1 -- 172.21.15.45:0/2210897526 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f64069480 con 0x7f6f64145290 2023-11-28T18:41:11.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:11.068+0000 7f6f5a7fc640 1 -- 172.21.15.45:0/2210897526 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f6f600b7ce0 con 0x7f6f64145290 2023-11-28T18:41:11.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:11.068+0000 7f6f5a7fc640 1 --2- 172.21.15.45:0/2210897526 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6f480668d0 0x7f6f48068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:41:11.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:11.068+0000 7f6f5a7fc640 1 -- 172.21.15.45:0/2210897526 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f6f6011ef20 con 0x7f6f64145290 2023-11-28T18:41:11.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:11.068+0000 7f6f690aa640 1 --2- 172.21.15.45:0/2210897526 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6f480668d0 0x7f6f48068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:41:11.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:11.068+0000 7f6f690aa640 1 --2- 172.21.15.45:0/2210897526 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6f480668d0 0x7f6f48068d90 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f6f64143e00 tx=0x7f6f54008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:41:11.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:11.072+0000 7f6f5a7fc640 1 -- 172.21.15.45:0/2210897526 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6f600ec1a0 con 0x7f6f64145290 2023-11-28T18:41:11.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:11.264+0000 7f6f6bb0f640 1 -- 172.21.15.45:0/2210897526 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f6f64153b10 con 0x7f6f64145290 2023-11-28T18:41:11.270 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-11-28T18:41:11.268+0000 7f5668eb3640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-28T18:41:11.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:11.268+0000 7f6f5a7fc640 1 -- 172.21.15.45:0/2210897526 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v33) v1 ==== 161+0+0 (secure 0 0 0) 0x7f6f600bb090 con 0x7f6f64145290 2023-11-28T18:41:11.272 INFO:teuthology.orchestra.run.smithi045.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-28T18:41:11.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:11.272+0000 7f6f6bb0f640 1 -- 172.21.15.45:0/2210897526 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6f480668d0 msgr2=0x7f6f48068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:41:11.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:11.272+0000 7f6f6bb0f640 1 --2- 172.21.15.45:0/2210897526 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6f480668d0 0x7f6f48068d90 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f6f64143e00 tx=0x7f6f54008040 comp rx=0 tx=0).stop 2023-11-28T18:41:11.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:11.272+0000 7f6f6bb0f640 1 -- 172.21.15.45:0/2210897526 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f64145290 msgr2=0x7f6f64157a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:41:11.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:11.272+0000 7f6f6bb0f640 1 --2- 172.21.15.45:0/2210897526 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f64145290 0x7f6f64157a00 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f6f600ae040 tx=0x7f6f6001abf0 comp rx=0 tx=0).stop 2023-11-28T18:41:11.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:11.272+0000 7f6f6bb0f640 1 -- 172.21.15.45:0/2210897526 shutdown_connections 2023-11-28T18:41:11.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:11.272+0000 7f6f6bb0f640 1 --2- 172.21.15.45:0/2210897526 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6f480668d0 0x7f6f48068d90 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:11.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:11.272+0000 7f6f6bb0f640 1 --2- 172.21.15.45:0/2210897526 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6f6415c0b0 0x7f6f64141f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:11.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:11.272+0000 7f6f6bb0f640 1 --2- 172.21.15.45:0/2210897526 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f6415bcd0 0x7f6f64141a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:41:11.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:11.272+0000 7f6f6bb0f640 1 --2- 172.21.15.45:0/2210897526 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f64145290 0x7f6f64157a00 secure :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f6f600ae040 tx=0x7f6f6001abf0 comp rx=0 tx=0).stop 2023-11-28T18:41:11.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:11.272+0000 7f6f6bb0f640 1 -- 172.21.15.45:0/2210897526 >> 172.21.15.45:0/2210897526 conn(0x7f6f6406a570 msgr2=0x7f6f64071e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:41:11.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:11.272+0000 7f6f6bb0f640 1 -- 172.21.15.45:0/2210897526 shutdown_connections 2023-11-28T18:41:11.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:41:11.272+0000 7f6f6bb0f640 1 -- 172.21.15.45:0/2210897526 wait complete. 2023-11-28T18:41:11.286 INFO:tasks.ceph.mds.c.smithi045.stderr: -9334> 2023-11-28T18:39:38.273+0000 7f6f887fb640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T18:41:11.296 INFO:tasks.workunit:Pulling workunits from ref 47c1c547372ed5bff7984647dc200bac0e019caf 2023-11-28T18:41:11.297 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-11-28T18:41:11.297 DEBUG:teuthology.orchestra.run.smithi045:> stat -- /home/ubuntu/cephtest/mnt.0 2023-11-28T18:41:11.307 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T18:41:11.307 INFO:teuthology.orchestra.run.smithi045.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-11-28T18:41:11.307 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -- /home/ubuntu/cephtest/mnt.0 2023-11-28T18:41:11.341 INFO:tasks.ceph.mds.c.smithi045.stdout:starting mds.c at 2023-11-28T18:41:11.350 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2023-11-28T18:41:11.350 DEBUG:teuthology.orchestra.run.smithi045:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2023-11-28T18:41:11.402 INFO:tasks.workunit:timeout=1h 2023-11-28T18:41:11.403 INFO:tasks.workunit:cleanup=True 2023-11-28T18:41:11.403 DEBUG:teuthology.orchestra.run.smithi045:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 47c1c547372ed5bff7984647dc200bac0e019caf 2023-11-28T18:41:11.455 INFO:tasks.workunit.client.0.smithi045.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-11-28T18:41:23.865 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:41:23.869 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:41:53.940 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:41:53.947 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:42:20.749 INFO:tasks.workunit.client.0.smithi045.stderr:Updating files: 65% (7948/12117) Updating files: 66% (7998/12117) Updating files: 67% (8119/12117) Updating files: 68% (8240/12117) Updating files: 69% (8361/12117) Updating files: 70% (8482/12117) Updating files: 71% (8604/12117) Updating files: 72% (8725/12117) Updating files: 73% (8846/12117) Updating files: 74% (8967/12117) Updating files: 75% (9088/12117) Updating files: 76% (9209/12117) Updating files: 77% (9331/12117) Updating files: 78% (9452/12117) Updating files: 79% (9573/12117) Updating files: 80% (9694/12117) Updating files: 81% (9815/12117) Updating files: 82% (9936/12117) Updating files: 83% (10058/12117) Updating files: 84% (10179/12117) Updating files: 85% (10300/12117) Updating files: 86% (10421/12117) Updating files: 87% (10542/12117) Updating files: 88% (10663/12117) Updating files: 89% (10785/12117) Updating files: 90% (10906/12117) Updating files: 91% (11027/12117) Updating files: 92% (11148/12117) Updating files: 93% (11269/12117) Updating files: 94% (11390/12117) Updating files: 95% (11512/12117) Updating files: 96% (11633/12117) Updating files: 97% (11754/12117) Updating files: 98% (11875/12117) Updating files: 99% (11996/12117) Updating files: 100% (12117/12117) Updating files: 100% (12117/12117), done. 2023-11-28T18:42:21.303 INFO:tasks.workunit.client.0.smithi045.stderr:Note: switching to '47c1c547372ed5bff7984647dc200bac0e019caf'. 2023-11-28T18:42:21.304 INFO:tasks.workunit.client.0.smithi045.stderr: 2023-11-28T18:42:21.304 INFO:tasks.workunit.client.0.smithi045.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-11-28T18:42:21.304 INFO:tasks.workunit.client.0.smithi045.stderr:changes and commit them, and you can discard any commits you make in this 2023-11-28T18:42:21.304 INFO:tasks.workunit.client.0.smithi045.stderr:state without impacting any branches by switching back to a branch. 2023-11-28T18:42:21.304 INFO:tasks.workunit.client.0.smithi045.stderr: 2023-11-28T18:42:21.304 INFO:tasks.workunit.client.0.smithi045.stderr:If you want to create a new branch to retain commits you create, you may 2023-11-28T18:42:21.304 INFO:tasks.workunit.client.0.smithi045.stderr:do so (now or later) by using -c with the switch command. Example: 2023-11-28T18:42:21.305 INFO:tasks.workunit.client.0.smithi045.stderr: 2023-11-28T18:42:21.305 INFO:tasks.workunit.client.0.smithi045.stderr: git switch -c 2023-11-28T18:42:21.305 INFO:tasks.workunit.client.0.smithi045.stderr: 2023-11-28T18:42:21.305 INFO:tasks.workunit.client.0.smithi045.stderr:Or undo this operation with: 2023-11-28T18:42:21.305 INFO:tasks.workunit.client.0.smithi045.stderr: 2023-11-28T18:42:21.305 INFO:tasks.workunit.client.0.smithi045.stderr: git switch - 2023-11-28T18:42:21.306 INFO:tasks.workunit.client.0.smithi045.stderr: 2023-11-28T18:42:21.306 INFO:tasks.workunit.client.0.smithi045.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-11-28T18:42:21.306 INFO:tasks.workunit.client.0.smithi045.stderr: 2023-11-28T18:42:21.306 INFO:tasks.workunit.client.0.smithi045.stderr:HEAD is now at 47c1c547372 Merge PR #51931 into wip-vshankar-testing-20231127.102654 2023-11-28T18:42:21.308 DEBUG:teuthology.orchestra.run.smithi045:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-11-28T18:42:21.317 INFO:tasks.workunit.client.0.smithi045.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-11-28T18:42:21.320 INFO:tasks.workunit.client.0.smithi045.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-11-28T18:42:21.320 INFO:tasks.workunit.client.0.smithi045.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-11-28T18:42:21.387 INFO:tasks.workunit.client.0.smithi045.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-11-28T18:42:21.455 INFO:tasks.workunit.client.0.smithi045.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-11-28T18:42:21.511 INFO:tasks.workunit.client.0.smithi045.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-11-28T18:42:21.513 INFO:tasks.workunit.client.0.smithi045.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-11-28T18:42:21.513 INFO:tasks.workunit.client.0.smithi045.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-11-28T18:42:21.569 INFO:tasks.workunit.client.0.smithi045.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-11-28T18:42:21.575 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T18:42:21.575 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-11-28T18:42:21.630 INFO:tasks.workunit:Running workunits matching suites/cephfs_journal_tool_smoke.sh on client.0... 2023-11-28T18:42:21.631 INFO:tasks.workunit:Running workunit suites/cephfs_journal_tool_smoke.sh... 2023-11-28T18:42:21.631 DEBUG:teuthology.orchestra.run.smithi045:workunit test suites/cephfs_journal_tool_smoke.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=47c1c547372ed5bff7984647dc200bac0e019caf TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 1h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/cephfs_journal_tool_smoke.sh 2023-11-28T18:42:21.694 INFO:tasks.workunit.client.0.smithi045.stderr:+ export 'BIN=cephfs-journal-tool --rank=cephfs:0' 2023-11-28T18:42:21.694 INFO:tasks.workunit.client.0.smithi045.stderr:+ BIN='cephfs-journal-tool --rank=cephfs:0' 2023-11-28T18:42:21.694 INFO:tasks.workunit.client.0.smithi045.stderr:+ export JOURNAL_FILE=/tmp/journal.bin 2023-11-28T18:42:21.694 INFO:tasks.workunit.client.0.smithi045.stderr:+ JOURNAL_FILE=/tmp/journal.bin 2023-11-28T18:42:21.695 INFO:tasks.workunit.client.0.smithi045.stderr:+ export JSON_OUTPUT=/tmp/json.tmp 2023-11-28T18:42:21.695 INFO:tasks.workunit.client.0.smithi045.stderr:+ JSON_OUTPUT=/tmp/json.tmp 2023-11-28T18:42:21.695 INFO:tasks.workunit.client.0.smithi045.stderr:+ export BINARY_OUTPUT=/tmp/binary.tmp 2023-11-28T18:42:21.695 INFO:tasks.workunit.client.0.smithi045.stderr:+ BINARY_OUTPUT=/tmp/binary.tmp 2023-11-28T18:42:21.695 INFO:tasks.workunit.client.0.smithi045.stderr:+ '[' -d /tmp/binary.tmp ']' 2023-11-28T18:42:21.695 INFO:tasks.workunit.client.0.smithi045.stderr:+ echo 'Testing that export/import cycle preserves state' 2023-11-28T18:42:21.695 INFO:tasks.workunit.client.0.smithi045.stdout:Testing that export/import cycle preserves state 2023-11-28T18:42:21.695 INFO:tasks.workunit.client.0.smithi045.stderr:++ cephfs-journal-tool --rank=cephfs:0 header get 2023-11-28T18:42:21.734 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.731+0000 7fd78cb67280 1 -- start start 2023-11-28T18:42:21.734 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.731+0000 7fd78cb67280 1 Processor -- start 2023-11-28T18:42:21.736 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.731+0000 7fd78cb67280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5625e95b5800 0x5625e9620580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:21.736 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.731+0000 7fd78cb67280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5625e95b5400 0x5625e9620b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:21.736 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.731+0000 7fd78cb67280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5625e95b5000 0x5625e9621080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:21.736 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.731+0000 7fd78cb67280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625e95fb180 con 0x5625e95b5000 2023-11-28T18:42:21.737 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.731+0000 7fd78cb67280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625e95fa140 con 0x5625e95b5800 2023-11-28T18:42:21.737 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.731+0000 7fd78cb67280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x5625e95fa000 con 0x5625e95b5400 2023-11-28T18:42:21.737 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.731+0000 7fd78bb27640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5625e95b5000 0x5625e9621080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:21.737 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.731+0000 7fd78bb27640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5625e95b5000 0x5625e9621080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57068/0 (socket says 172.21.15.45:57068) 2023-11-28T18:42:21.737 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.731+0000 7fd78bb27640 1 -- 172.21.15.45:0/238172194 learned_addr learned my addr 172.21.15.45:0/238172194 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:21.737 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.731+0000 7fd78b326640 1 --2- 172.21.15.45:0/238172194 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5625e95b5800 0x5625e9620580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:21.737 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.731+0000 7fd78ab25640 1 --2- 172.21.15.45:0/238172194 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5625e95b5400 0x5625e9620b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:21.737 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.731+0000 7fd78bb27640 1 -- 172.21.15.45:0/238172194 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5625e95b5400 msgr2=0x5625e9620b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:21.737 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.731+0000 7fd78bb27640 1 --2- 172.21.15.45:0/238172194 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5625e95b5400 0x5625e9620b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.737 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.731+0000 7fd78bb27640 1 -- 172.21.15.45:0/238172194 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5625e95b5800 msgr2=0x5625e9620580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:21.737 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.731+0000 7fd78bb27640 1 --2- 172.21.15.45:0/238172194 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5625e95b5800 0x5625e9620580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.737 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.731+0000 7fd78bb27640 1 -- 172.21.15.45:0/238172194 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5625e95ea9c0 con 0x5625e95b5000 2023-11-28T18:42:21.738 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.731+0000 7fd78bb27640 1 --2- 172.21.15.45:0/238172194 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5625e95b5000 0x5625e9621080 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x5625ea370e10 tx=0x5625ea33d080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ae0e03ff7c61a9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:21.738 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.731+0000 7fd788b21640 1 -- 172.21.15.45:0/238172194 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5625e96151e0 con 0x5625e95b5000 2023-11-28T18:42:21.738 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.731+0000 7fd788b21640 1 -- 172.21.15.45:0/238172194 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5625e9610900 con 0x5625e95b5000 2023-11-28T18:42:21.738 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.731+0000 7fd788b21640 1 -- 172.21.15.45:0/238172194 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5625e9615080 con 0x5625e95b5000 2023-11-28T18:42:21.738 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.731+0000 7fd78cb67280 1 -- 172.21.15.45:0/238172194 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5625e95eab60 con 0x5625e95b5000 2023-11-28T18:42:21.738 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.731+0000 7fd78cb67280 1 -- 172.21.15.45:0/238172194 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x5625e95ea340 con 0x5625e95b5000 2023-11-28T18:42:21.738 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.731+0000 7fd788b21640 1 -- 172.21.15.45:0/238172194 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x5625e95f6c40 con 0x5625e95b5000 2023-11-28T18:42:21.738 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.731+0000 7fd788b21640 1 -- 172.21.15.45:0/238172194 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 34) v1 ==== 3298+0+0 (secure 0 0 0) 0x5625e9602f00 con 0x5625e95b5000 2023-11-28T18:42:21.741 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.735+0000 7fd78cb67280 1 Processor -- start 2023-11-28T18:42:21.741 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.735+0000 7fd78cb67280 1 -- start start 2023-11-28T18:42:21.741 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.735+0000 7fd78cb67280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5625ea4d8c00 0x5625e9621600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:21.741 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.735+0000 7fd78cb67280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5625ea4d9000 0x5625e9621b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:21.741 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.735+0000 7fd78cb67280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5625ea4d9400 0x5625e9622100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:21.741 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.735+0000 7fd78cb67280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625e95faa00 con 0x5625ea4d9000 2023-11-28T18:42:21.741 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.735+0000 7fd78cb67280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625e9685180 con 0x5625ea4d9400 2023-11-28T18:42:21.741 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.735+0000 7fd78cb67280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x5625e9684dc0 con 0x5625ea4d8c00 2023-11-28T18:42:21.741 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.735+0000 7fd78b326640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5625ea4d9000 0x5625e9621b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:21.742 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.735+0000 7fd78b326640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5625ea4d9000 0x5625e9621b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57078/0 (socket says 172.21.15.45:57078) 2023-11-28T18:42:21.742 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.735+0000 7fd78b326640 1 -- 172.21.15.45:0/1732575744 learned_addr learned my addr 172.21.15.45:0/1732575744 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:21.742 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.735+0000 7fd78ab25640 1 --2- 172.21.15.45:0/1732575744 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5625ea4d8c00 0x5625e9621600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:21.742 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.735+0000 7fd78ab25640 1 --2- 172.21.15.45:0/1732575744 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5625ea4d9400 0x5625e9622100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:21.742 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.735+0000 7fd78b326640 1 -- 172.21.15.45:0/1732575744 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5625ea4d8c00 msgr2=0x5625e9621600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:21.742 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.735+0000 7fd78b326640 1 --2- 172.21.15.45:0/1732575744 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5625ea4d8c00 0x5625e9621600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.742 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.735+0000 7fd78b326640 1 -- 172.21.15.45:0/1732575744 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5625ea4d9400 msgr2=0x5625e9622100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:21.742 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.735+0000 7fd78b326640 1 --2- 172.21.15.45:0/1732575744 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5625ea4d9400 0x5625e9622100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.742 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.735+0000 7fd78b326640 1 -- 172.21.15.45:0/1732575744 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5625e95ea000 con 0x5625ea4d9000 2023-11-28T18:42:21.742 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.735+0000 7fd78b326640 1 --2- 172.21.15.45:0/1732575744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5625ea4d9000 0x5625e9621b80 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x5625ea3703c0 tx=0x5625ea378000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41610e81107b7df3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:21.742 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.735+0000 7fd786b1d640 1 -- 172.21.15.45:0/1732575744 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5625e9614f20 con 0x5625ea4d9000 2023-11-28T18:42:21.743 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.735+0000 7fd786b1d640 1 -- 172.21.15.45:0/1732575744 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5625e9610900 con 0x5625ea4d9000 2023-11-28T18:42:21.743 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.735+0000 7fd786b1d640 1 -- 172.21.15.45:0/1732575744 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5625e96151e0 con 0x5625ea4d9000 2023-11-28T18:42:21.743 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.735+0000 7fd78cb67280 1 -- 172.21.15.45:0/1732575744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5625ea4d9000 msgr2=0x5625e9621b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:21.743 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.735+0000 7fd78cb67280 1 --2- 172.21.15.45:0/1732575744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5625ea4d9000 0x5625e9621b80 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x5625ea3703c0 tx=0x5625ea378000 comp rx=0 tx=0).stop 2023-11-28T18:42:21.743 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.735+0000 7fd78cb67280 1 -- 172.21.15.45:0/1732575744 shutdown_connections 2023-11-28T18:42:21.743 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.735+0000 7fd78cb67280 1 --2- 172.21.15.45:0/1732575744 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5625ea4d9400 0x5625e9622100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.743 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.735+0000 7fd78cb67280 1 --2- 172.21.15.45:0/1732575744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5625ea4d9000 0x5625e9621b80 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.743 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.735+0000 7fd78cb67280 1 --2- 172.21.15.45:0/1732575744 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5625ea4d8c00 0x5625e9621600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.743 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.735+0000 7fd78cb67280 1 -- 172.21.15.45:0/1732575744 >> 172.21.15.45:0/1732575744 conn(0x5625e95b4c00 msgr2=0x5625e95e3800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:21.743 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.735+0000 7fd78cb67280 1 -- 172.21.15.45:0/1732575744 shutdown_connections 2023-11-28T18:42:21.743 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.735+0000 7fd78cb67280 1 -- 172.21.15.45:0/1732575744 wait complete. 2023-11-28T18:42:21.743 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.735+0000 7fd78cb67280 1 Processor -- start 2023-11-28T18:42:21.744 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.735+0000 7fd78cb67280 1 -- start start 2023-11-28T18:42:21.748 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.739+0000 7fd78cb67280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5625ea4d8c00 0x5625e9621600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:21.748 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.739+0000 7fd78cb67280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5625ea4d9400 0x5625e9622100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:21.748 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.739+0000 7fd78cb67280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5625ea4d9800 0x5625e9622680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:21.748 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.739+0000 7fd78cb67280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625e9684c80 con 0x5625ea4d8c00 2023-11-28T18:42:21.748 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.739+0000 7fd78cb67280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625e95fa140 con 0x5625ea4d9400 2023-11-28T18:42:21.748 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.739+0000 7fd78cb67280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x5625e95fab40 con 0x5625ea4d9800 2023-11-28T18:42:21.748 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.739+0000 7fd78ab25640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5625ea4d8c00 0x5625e9621600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:21.748 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.739+0000 7fd78ab25640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5625ea4d8c00 0x5625e9621600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57088/0 (socket says 172.21.15.45:57088) 2023-11-28T18:42:21.749 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.739+0000 7fd78ab25640 1 -- 172.21.15.45:0/3734017673 learned_addr learned my addr 172.21.15.45:0/3734017673 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:21.749 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.739+0000 7fd78b326640 1 --2- 172.21.15.45:0/3734017673 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5625ea4d9400 0x5625e9622100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:21.749 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.739+0000 7fd78ab25640 1 -- 172.21.15.45:0/3734017673 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5625ea4d9800 msgr2=0x5625e9622680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:21.749 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.739+0000 7fd78ab25640 1 --2- 172.21.15.45:0/3734017673 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5625ea4d9800 0x5625e9622680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.749 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.739+0000 7fd78ab25640 1 -- 172.21.15.45:0/3734017673 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5625ea4d9400 msgr2=0x5625e9622100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:21.749 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.739+0000 7fd78ab25640 1 --2- 172.21.15.45:0/3734017673 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5625ea4d9400 0x5625e9622100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.749 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.739+0000 7fd78ab25640 1 -- 172.21.15.45:0/3734017673 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5625e95ea1a0 con 0x5625ea4d8c00 2023-11-28T18:42:21.749 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.739+0000 7fd78ab25640 1 --2- 172.21.15.45:0/3734017673 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5625ea4d8c00 0x5625e9621600 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x5625e9891590 tx=0x5625e9636f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:21.749 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.739+0000 7fd78531a640 1 -- 172.21.15.45:0/3734017673 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5625e9614f20 con 0x5625ea4d8c00 2023-11-28T18:42:21.750 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.739+0000 7fd78531a640 1 -- 172.21.15.45:0/3734017673 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5625ea387500 con 0x5625ea4d8c00 2023-11-28T18:42:21.750 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.739+0000 7fd78cb67280 1 -- 172.21.15.45:0/3734017673 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5625e95ea000 con 0x5625ea4d8c00 2023-11-28T18:42:21.750 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.739+0000 7fd78531a640 1 -- 172.21.15.45:0/3734017673 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5625e96151e0 con 0x5625ea4d8c00 2023-11-28T18:42:21.750 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.739+0000 7fd78cb67280 1 -- 172.21.15.45:0/3734017673 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5625e95ea9c0 con 0x5625ea4d8c00 2023-11-28T18:42:21.750 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.739+0000 7fd78531a640 1 -- 172.21.15.45:0/3734017673 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x5625e9642840 con 0x5625ea4d8c00 2023-11-28T18:42:21.750 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.739+0000 7fd78531a640 1 --2- 172.21.15.45:0/3734017673 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x5625ea4d9000 0x5625e9623700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:21.750 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.739+0000 7fd78531a640 1 -- 172.21.15.45:0/3734017673 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x5625e95f6a80 con 0x5625ea4d8c00 2023-11-28T18:42:21.750 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.739+0000 7fd78cb67280 1 --2- 172.21.15.45:0/3734017673 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x5625ea4d9c00 0x5625e9622c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:21.750 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.739+0000 7fd78cb67280 1 -- 172.21.15.45:0/3734017673 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x5625e960b880 con 0x5625ea4d9c00 2023-11-28T18:42:21.750 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.739+0000 7fd78b326640 1 --2- 172.21.15.45:0/3734017673 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x5625ea4d9000 0x5625e9623700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:21.750 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.739+0000 7fd78ab25640 1 --2- 172.21.15.45:0/3734017673 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x5625ea4d9c00 0x5625e9622c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:21.751 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.743+0000 7fd78ab25640 1 --2- 172.21.15.45:0/3734017673 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x5625ea4d9c00 0x5625e9622c00 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:21.751 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.743+0000 7fd78b326640 1 --2- 172.21.15.45:0/3734017673 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x5625ea4d9000 0x5625e9623700 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x5625e9891020 tx=0x5625ea378360 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:21.751 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.743+0000 7fd78ab25640 1 -- 172.21.15.45:0/3734017673 <== osd.2 v2:172.21.15.45:6816/193884539 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x5625ea4bab40 con 0x5625ea4d9c00 2023-11-28T18:42:21.751 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.743+0000 7fd78cb67280 1 -- 172.21.15.45:0/3734017673 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x5625e960bc00 con 0x5625ea4d9c00 2023-11-28T18:42:21.751 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.743+0000 7fd78ab25640 1 -- 172.21.15.45:0/3734017673 <== osd.2 v2:172.21.15.45:6816/193884539 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv11 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x5625ea4bab40 con 0x5625ea4d9c00 2023-11-28T18:42:21.751 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.743+0000 7fd78cb67280 1 -- 172.21.15.45:0/3734017673 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x5625ea4d9c00 msgr2=0x5625e9622c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:21.751 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.743+0000 7fd78cb67280 1 --2- 172.21.15.45:0/3734017673 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x5625ea4d9c00 0x5625e9622c00 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.751 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.743+0000 7fd78cb67280 1 -- 172.21.15.45:0/3734017673 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x5625ea4d9000 msgr2=0x5625e9623700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:21.751 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.743+0000 7fd78cb67280 1 --2- 172.21.15.45:0/3734017673 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x5625ea4d9000 0x5625e9623700 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x5625e9891020 tx=0x5625ea378360 comp rx=0 tx=0).stop 2023-11-28T18:42:21.751 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.743+0000 7fd78cb67280 1 -- 172.21.15.45:0/3734017673 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5625ea4d8c00 msgr2=0x5625e9621600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:21.751 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.743+0000 7fd78cb67280 1 --2- 172.21.15.45:0/3734017673 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5625ea4d8c00 0x5625e9621600 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x5625e9891590 tx=0x5625e9636f00 comp rx=0 tx=0).stop 2023-11-28T18:42:21.751 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.743+0000 7fd78b326640 1 -- 172.21.15.45:0/3734017673 reap_dead start 2023-11-28T18:42:21.752 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.743+0000 7fd78cb67280 1 -- 172.21.15.45:0/3734017673 shutdown_connections 2023-11-28T18:42:21.752 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.743+0000 7fd78cb67280 1 -- 172.21.15.45:0/3734017673 >> 172.21.15.45:0/3734017673 conn(0x5625e95b4c00 msgr2=0x5625e95e3800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:21.752 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.743+0000 7fd78cb67280 1 -- 172.21.15.45:0/3734017673 shutdown_connections 2023-11-28T18:42:21.752 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.743+0000 7fd78cb67280 1 -- 172.21.15.45:0/3734017673 wait complete. 2023-11-28T18:42:21.752 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.743+0000 7fd78cb67280 1 -- 172.21.15.45:0/238172194 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5625e95b5000 msgr2=0x5625e9621080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:21.752 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.743+0000 7fd78cb67280 1 --2- 172.21.15.45:0/238172194 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5625e95b5000 0x5625e9621080 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x5625ea370e10 tx=0x5625ea33d080 comp rx=0 tx=0).stop 2023-11-28T18:42:21.752 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.743+0000 7fd78cb67280 1 -- 172.21.15.45:0/238172194 shutdown_connections 2023-11-28T18:42:21.752 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.743+0000 7fd78cb67280 1 --2- 172.21.15.45:0/238172194 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5625e95b5000 0x5625e9621080 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.752 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.743+0000 7fd78cb67280 1 --2- 172.21.15.45:0/238172194 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5625e95b5400 0x5625e9620b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.752 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.743+0000 7fd78cb67280 1 --2- 172.21.15.45:0/238172194 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5625e95b5800 0x5625e9620580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.752 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.743+0000 7fd78cb67280 1 -- 172.21.15.45:0/238172194 >> 172.21.15.45:0/238172194 conn(0x5625e95b5c00 msgr2=0x5625e95e3000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:21.752 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.743+0000 7fd78cb67280 1 -- 172.21.15.45:0/238172194 shutdown_connections 2023-11-28T18:42:21.753 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.743+0000 7fd78cb67280 1 -- 172.21.15.45:0/238172194 wait complete. 2023-11-28T18:42:21.753 INFO:tasks.workunit.client.0.smithi045.stderr:+ HEADER_STATE='{ 2023-11-28T18:42:21.753 INFO:tasks.workunit.client.0.smithi045.stderr: "magic": "ceph fs volume v011", 2023-11-28T18:42:21.753 INFO:tasks.workunit.client.0.smithi045.stderr: "write_pos": 4200184, 2023-11-28T18:42:21.753 INFO:tasks.workunit.client.0.smithi045.stderr: "expire_pos": 4194304, 2023-11-28T18:42:21.754 INFO:tasks.workunit.client.0.smithi045.stderr: "trimmed_pos": 4194304, 2023-11-28T18:42:21.754 INFO:tasks.workunit.client.0.smithi045.stderr: "stream_format": 1, 2023-11-28T18:42:21.754 INFO:tasks.workunit.client.0.smithi045.stderr: "layout": { 2023-11-28T18:42:21.754 INFO:tasks.workunit.client.0.smithi045.stderr: "stripe_unit": 4194304, 2023-11-28T18:42:21.754 INFO:tasks.workunit.client.0.smithi045.stderr: "stripe_count": 1, 2023-11-28T18:42:21.754 INFO:tasks.workunit.client.0.smithi045.stderr: "object_size": 4194304, 2023-11-28T18:42:21.754 INFO:tasks.workunit.client.0.smithi045.stderr: "pool_id": 6, 2023-11-28T18:42:21.754 INFO:tasks.workunit.client.0.smithi045.stderr: "pool_ns": "" 2023-11-28T18:42:21.754 INFO:tasks.workunit.client.0.smithi045.stderr: } 2023-11-28T18:42:21.754 INFO:tasks.workunit.client.0.smithi045.stderr:}' 2023-11-28T18:42:21.754 INFO:tasks.workunit.client.0.smithi045.stderr:++ cephfs-journal-tool --rank=cephfs:0 event get list 2023-11-28T18:42:21.793 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.787+0000 7f6a52647280 1 -- start start 2023-11-28T18:42:21.793 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.791+0000 7f6a52647280 1 Processor -- start 2023-11-28T18:42:21.795 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.791+0000 7f6a52647280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5630e8b0c800 0x5630e7dabb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:21.795 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.791+0000 7f6a52647280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5630e7d3fc00 0x5630e7daab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:21.795 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.791+0000 7f6a52647280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5630e7d3f800 0x5630e7dab600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:21.796 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.791+0000 7f6a52647280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630e7d84140 con 0x5630e7d3f800 2023-11-28T18:42:21.796 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.791+0000 7f6a52647280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630e7d85180 con 0x5630e7d3fc00 2023-11-28T18:42:21.796 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.791+0000 7f6a52647280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x5630e7e0edc0 con 0x5630e8b0c800 2023-11-28T18:42:21.796 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.791+0000 7f6a50a60640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5630e7d3f800 0x5630e7dab600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:21.796 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.791+0000 7f6a50a60640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5630e7d3f800 0x5630e7dab600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57112/0 (socket says 172.21.15.45:57112) 2023-11-28T18:42:21.796 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.791+0000 7f6a50a60640 1 -- 172.21.15.45:0/2256252891 learned_addr learned my addr 172.21.15.45:0/2256252891 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:21.796 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.791+0000 7f6a5025f640 1 --2- 172.21.15.45:0/2256252891 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5630e8b0c800 0x5630e7dabb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:21.796 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.791+0000 7f6a4fa5e640 1 --2- 172.21.15.45:0/2256252891 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5630e7d3fc00 0x5630e7daab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:21.796 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.791+0000 7f6a50a60640 1 -- 172.21.15.45:0/2256252891 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5630e8b0c800 msgr2=0x5630e7dabb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:21.796 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.791+0000 7f6a50a60640 1 --2- 172.21.15.45:0/2256252891 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5630e8b0c800 0x5630e7dabb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.796 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.791+0000 7f6a50a60640 1 -- 172.21.15.45:0/2256252891 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5630e7d3fc00 msgr2=0x5630e7daab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:21.796 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.791+0000 7f6a50a60640 1 --2- 172.21.15.45:0/2256252891 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5630e7d3fc00 0x5630e7daab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.797 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.791+0000 7f6a50a60640 1 -- 172.21.15.45:0/2256252891 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5630e7d74000 con 0x5630e7d3f800 2023-11-28T18:42:21.797 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.791+0000 7f6a50a60640 1 --2- 172.21.15.45:0/2256252891 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5630e7d3f800 0x5630e7dab600 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x5630e7da3a40 tx=0x5630e8b0a120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cd0c7a72a84cc21 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:21.797 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.791+0000 7f6a4da5a640 1 -- 172.21.15.45:0/2256252891 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5630e7d9edc0 con 0x5630e7d3f800 2023-11-28T18:42:21.797 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.791+0000 7f6a4da5a640 1 -- 172.21.15.45:0/2256252891 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5630e8c58000 con 0x5630e7d3f800 2023-11-28T18:42:21.797 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.791+0000 7f6a4da5a640 1 -- 172.21.15.45:0/2256252891 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5630e7d9ef20 con 0x5630e7d3f800 2023-11-28T18:42:21.797 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.791+0000 7f6a52647280 1 -- 172.21.15.45:0/2256252891 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5630e7d74340 con 0x5630e7d3f800 2023-11-28T18:42:21.797 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.791+0000 7f6a52647280 1 -- 172.21.15.45:0/2256252891 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x5630e7d744e0 con 0x5630e7d3f800 2023-11-28T18:42:21.797 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.791+0000 7f6a4da5a640 1 -- 172.21.15.45:0/2256252891 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x5630e7d80c40 con 0x5630e7d3f800 2023-11-28T18:42:21.797 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.791+0000 7f6a4da5a640 1 -- 172.21.15.45:0/2256252891 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 34) v1 ==== 3298+0+0 (secure 0 0 0) 0x5630e7d8cf00 con 0x5630e7d3f800 2023-11-28T18:42:21.807 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.791+0000 7f6a52647280 1 Processor -- start 2023-11-28T18:42:21.807 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.791+0000 7f6a52647280 1 -- start start 2023-11-28T18:42:21.807 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.795+0000 7f6a52647280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5630e8b0c400 0x5630e7dab080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:21.807 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.795+0000 7f6a52647280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5630e8b0c000 0x5630e7dac100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:21.807 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.795+0000 7f6a52647280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5630e7d3f400 0x5630e7dac680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:21.807 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.795+0000 7f6a52647280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630e7e0f180 con 0x5630e8b0c000 2023-11-28T18:42:21.807 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.795+0000 7f6a52647280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630e7e0ec80 con 0x5630e7d3f400 2023-11-28T18:42:21.807 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.795+0000 7f6a52647280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x5630e7d84b40 con 0x5630e8b0c400 2023-11-28T18:42:21.808 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.795+0000 7f6a5025f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5630e8b0c000 0x5630e7dac100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:21.808 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.795+0000 7f6a5025f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5630e8b0c000 0x5630e7dac100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57116/0 (socket says 172.21.15.45:57116) 2023-11-28T18:42:21.808 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.795+0000 7f6a5025f640 1 -- 172.21.15.45:0/217920120 learned_addr learned my addr 172.21.15.45:0/217920120 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:21.808 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.795+0000 7f6a4fa5e640 1 --2- 172.21.15.45:0/217920120 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5630e8b0c400 0x5630e7dab080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:21.808 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.795+0000 7f6a4fa5e640 1 --2- 172.21.15.45:0/217920120 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5630e7d3f400 0x5630e7dac680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:21.808 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.795+0000 7f6a5025f640 1 -- 172.21.15.45:0/217920120 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5630e8b0c400 msgr2=0x5630e7dab080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:21.809 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.795+0000 7f6a5025f640 1 --2- 172.21.15.45:0/217920120 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5630e8b0c400 0x5630e7dab080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.809 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.795+0000 7f6a5025f640 1 -- 172.21.15.45:0/217920120 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5630e7d3f400 msgr2=0x5630e7dac680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:21.809 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.795+0000 7f6a5025f640 1 --2- 172.21.15.45:0/217920120 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5630e7d3f400 0x5630e7dac680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.809 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.795+0000 7f6a5025f640 1 -- 172.21.15.45:0/217920120 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5630e7d74000 con 0x5630e8b0c000 2023-11-28T18:42:21.809 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.795+0000 7f6a5025f640 1 --2- 172.21.15.45:0/217920120 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5630e8b0c000 0x5630e7dac100 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x5630e8cc2090 tx=0x5630e801c120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6117fd1b57a82b7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:21.809 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.795+0000 7f6a4ba56640 1 -- 172.21.15.45:0/217920120 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5630e7d9edc0 con 0x5630e8b0c000 2023-11-28T18:42:21.809 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.795+0000 7f6a4ba56640 1 -- 172.21.15.45:0/217920120 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5630e8c58300 con 0x5630e8b0c000 2023-11-28T18:42:21.809 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.795+0000 7f6a4ba56640 1 -- 172.21.15.45:0/217920120 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5630e7d9ef20 con 0x5630e8b0c000 2023-11-28T18:42:21.810 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.795+0000 7f6a52647280 1 -- 172.21.15.45:0/217920120 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5630e8b0c000 msgr2=0x5630e7dac100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:21.810 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.795+0000 7f6a52647280 1 --2- 172.21.15.45:0/217920120 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5630e8b0c000 0x5630e7dac100 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x5630e8cc2090 tx=0x5630e801c120 comp rx=0 tx=0).stop 2023-11-28T18:42:21.810 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.795+0000 7f6a52647280 1 -- 172.21.15.45:0/217920120 shutdown_connections 2023-11-28T18:42:21.810 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.795+0000 7f6a52647280 1 --2- 172.21.15.45:0/217920120 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5630e7d3f400 0x5630e7dac680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.810 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.795+0000 7f6a52647280 1 --2- 172.21.15.45:0/217920120 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5630e8b0c000 0x5630e7dac100 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.810 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.795+0000 7f6a52647280 1 --2- 172.21.15.45:0/217920120 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5630e8b0c400 0x5630e7dab080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.810 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.795+0000 7f6a52647280 1 -- 172.21.15.45:0/217920120 >> 172.21.15.45:0/217920120 conn(0x5630e8b0dc00 msgr2=0x5630e8cb6000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:21.810 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.795+0000 7f6a52647280 1 -- 172.21.15.45:0/217920120 shutdown_connections 2023-11-28T18:42:21.810 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.795+0000 7f6a52647280 1 -- 172.21.15.45:0/217920120 wait complete. 2023-11-28T18:42:21.810 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.795+0000 7f6a52647280 1 Processor -- start 2023-11-28T18:42:21.810 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.795+0000 7f6a52647280 1 -- start start 2023-11-28T18:42:21.810 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.795+0000 7f6a52647280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5630e7d3f400 0x5630e7dad700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:21.811 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.795+0000 7f6a52647280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5630e8b0c000 0x5630e7dad180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:21.811 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.795+0000 7f6a52647280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5630e8b0c400 0x5630e7dacc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:21.811 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.795+0000 7f6a52647280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630e7e0ec80 con 0x5630e7d3f400 2023-11-28T18:42:21.811 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.795+0000 7f6a52647280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630e7e0f180 con 0x5630e8b0c000 2023-11-28T18:42:21.811 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.795+0000 7f6a52647280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x5630e7e0edc0 con 0x5630e8b0c400 2023-11-28T18:42:21.811 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.795+0000 7f6a4fa5e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5630e7d3f400 0x5630e7dad700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:21.811 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.795+0000 7f6a4fa5e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5630e7d3f400 0x5630e7dad700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57120/0 (socket says 172.21.15.45:57120) 2023-11-28T18:42:21.811 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.795+0000 7f6a4fa5e640 1 -- 172.21.15.45:0/522684498 learned_addr learned my addr 172.21.15.45:0/522684498 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:21.811 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.795+0000 7f6a5025f640 1 --2- 172.21.15.45:0/522684498 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5630e8b0c000 0x5630e7dad180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:21.811 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.795+0000 7f6a4fa5e640 1 --2- 172.21.15.45:0/522684498 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5630e8b0c400 0x5630e7dacc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:21.812 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.795+0000 7f6a4fa5e640 1 -- 172.21.15.45:0/522684498 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5630e8b0c400 msgr2=0x5630e7dacc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:21.812 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.795+0000 7f6a4fa5e640 1 --2- 172.21.15.45:0/522684498 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5630e8b0c400 0x5630e7dacc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.812 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.795+0000 7f6a4fa5e640 1 -- 172.21.15.45:0/522684498 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5630e8b0c000 msgr2=0x5630e7dad180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:21.812 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.795+0000 7f6a4fa5e640 1 --2- 172.21.15.45:0/522684498 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5630e8b0c000 0x5630e7dad180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.812 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.795+0000 7f6a4fa5e640 1 -- 172.21.15.45:0/522684498 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5630e7d74ea0 con 0x5630e7d3f400 2023-11-28T18:42:21.812 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.799+0000 7f6a4fa5e640 1 --2- 172.21.15.45:0/522684498 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5630e7d3f400 0x5630e7dad700 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x5630e8cc2d80 tx=0x5630e801c060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:21.812 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.799+0000 7f6a4a253640 1 -- 172.21.15.45:0/522684498 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5630e7d9edc0 con 0x5630e7d3f400 2023-11-28T18:42:21.813 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.799+0000 7f6a4a253640 1 -- 172.21.15.45:0/522684498 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5630e7d9a900 con 0x5630e7d3f400 2023-11-28T18:42:21.813 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.799+0000 7f6a52647280 1 -- 172.21.15.45:0/522684498 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5630e802e000 con 0x5630e7d3f400 2023-11-28T18:42:21.813 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.799+0000 7f6a4a253640 1 -- 172.21.15.45:0/522684498 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5630e7d9ef20 con 0x5630e7d3f400 2023-11-28T18:42:21.813 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.799+0000 7f6a52647280 1 -- 172.21.15.45:0/522684498 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5630e802e1a0 con 0x5630e7d3f400 2023-11-28T18:42:21.813 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.799+0000 7f6a4a253640 1 -- 172.21.15.45:0/522684498 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x5630e7dccb00 con 0x5630e7d3f400 2023-11-28T18:42:21.813 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.799+0000 7f6a4a253640 1 --2- 172.21.15.45:0/522684498 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x5630e8023c00 0x5630e8112000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:21.814 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.799+0000 7f6a4a253640 1 -- 172.21.15.45:0/522684498 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x5630e7d80a80 con 0x5630e7d3f400 2023-11-28T18:42:21.814 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.799+0000 7f6a52647280 1 --2- 172.21.15.45:0/522684498 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x5630e811c000 0x5630e7dab080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:21.814 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.799+0000 7f6a52647280 1 -- 172.21.15.45:0/522684498 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x5630e7d95880 con 0x5630e811c000 2023-11-28T18:42:21.814 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.799+0000 7f6a5025f640 1 --2- 172.21.15.45:0/522684498 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x5630e8023c00 0x5630e8112000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:21.814 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.799+0000 7f6a4fa5e640 1 --2- 172.21.15.45:0/522684498 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x5630e811c000 0x5630e7dab080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:21.814 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.799+0000 7f6a4fa5e640 1 --2- 172.21.15.45:0/522684498 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x5630e811c000 0x5630e7dab080 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:21.814 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.799+0000 7f6a5025f640 1 --2- 172.21.15.45:0/522684498 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x5630e8023c00 0x5630e8112000 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x5630e8cc2090 tx=0x5630e8b0a180 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:21.815 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.803+0000 7f6a4fa5e640 1 -- 172.21.15.45:0/522684498 <== osd.2 v2:172.21.15.45:6816/193884539 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x5630e8c46b40 con 0x5630e811c000 2023-11-28T18:42:21.815 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.803+0000 7f6a52647280 1 -- 172.21.15.45:0/522684498 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x5630e7d95c00 con 0x5630e811c000 2023-11-28T18:42:21.815 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.803+0000 7f6a4fa5e640 1 -- 172.21.15.45:0/522684498 <== osd.2 v2:172.21.15.45:6816/193884539 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv11 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x5630e8c46b40 con 0x5630e811c000 2023-11-28T18:42:21.815 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.803+0000 7f6a52647280 1 -- 172.21.15.45:0/522684498 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:3 6.14 6:2e2fa760:::200.00000001:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x5630e7d95880 con 0x5630e811c000 2023-11-28T18:42:21.815 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.803+0000 7f6a4fa5e640 1 -- 172.21.15.45:0/522684498 <== osd.2 v2:172.21.15.45:6816/193884539 3 ==== osd_op_reply(3 200.00000001 [read 0~34160 out=34160b] v0'0 uv21 ondisk = 0) v8 ==== 156+0+34160 (crc 0 0 0) 0x5630e8c46b40 con 0x5630e811c000 2023-11-28T18:42:21.815 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.803+0000 7f6a52647280 1 --2- 172.21.15.45:0/522684498 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x5630e811c400 0x5630e7dac100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:21.815 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.803+0000 7f6a52647280 1 -- 172.21.15.45:0/522684498 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:4 6.1b 6:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x5630e7d95c00 con 0x5630e811c400 2023-11-28T18:42:21.815 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.803+0000 7f6a50a60640 1 --2- 172.21.15.45:0/522684498 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x5630e811c400 0x5630e7dac100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:21.817 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.803+0000 7f6a50a60640 1 --2- 172.21.15.45:0/522684498 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x5630e811c400 0x5630e7dac100 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:21.817 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.803+0000 7f6a50a60640 1 -- 172.21.15.45:0/522684498 <== osd.3 v2:172.21.15.45:6824/78541084 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x5630e8c46d80 con 0x5630e811c400 2023-11-28T18:42:21.817 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.803+0000 7f6a52647280 1 -- 172.21.15.45:0/522684498 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x5630e811c000 msgr2=0x5630e7dab080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:21.817 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.803+0000 7f6a52647280 1 --2- 172.21.15.45:0/522684498 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x5630e811c000 0x5630e7dab080 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.817 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.803+0000 7f6a52647280 1 -- 172.21.15.45:0/522684498 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x5630e811c400 msgr2=0x5630e7dac100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:21.817 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.803+0000 7f6a52647280 1 --2- 172.21.15.45:0/522684498 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x5630e811c400 0x5630e7dac100 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.818 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.803+0000 7f6a52647280 1 -- 172.21.15.45:0/522684498 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x5630e8023c00 msgr2=0x5630e8112000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:21.818 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.803+0000 7f6a52647280 1 --2- 172.21.15.45:0/522684498 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x5630e8023c00 0x5630e8112000 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x5630e8cc2090 tx=0x5630e8b0a180 comp rx=0 tx=0).stop 2023-11-28T18:42:21.818 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.803+0000 7f6a52647280 1 -- 172.21.15.45:0/522684498 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5630e7d3f400 msgr2=0x5630e7dad700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:21.818 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.803+0000 7f6a52647280 1 --2- 172.21.15.45:0/522684498 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5630e7d3f400 0x5630e7dad700 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x5630e8cc2d80 tx=0x5630e801c060 comp rx=0 tx=0).stop 2023-11-28T18:42:21.818 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.803+0000 7f6a5025f640 1 -- 172.21.15.45:0/522684498 reap_dead start 2023-11-28T18:42:21.818 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.803+0000 7f6a52647280 1 -- 172.21.15.45:0/522684498 shutdown_connections 2023-11-28T18:42:21.818 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.803+0000 7f6a52647280 1 --2- 172.21.15.45:0/522684498 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5630e7d3f400 0x5630e7dad700 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.818 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.803+0000 7f6a52647280 1 -- 172.21.15.45:0/522684498 >> 172.21.15.45:0/522684498 conn(0x5630e8b0dc00 msgr2=0x5630e8cb6000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:21.818 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.803+0000 7f6a52647280 1 -- 172.21.15.45:0/522684498 shutdown_connections 2023-11-28T18:42:21.818 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.803+0000 7f6a52647280 1 -- 172.21.15.45:0/522684498 wait complete. 2023-11-28T18:42:21.818 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.803+0000 7f6a52647280 1 -- 172.21.15.45:0/2256252891 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5630e7d3f800 msgr2=0x5630e7dab600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:21.819 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.803+0000 7f6a52647280 1 --2- 172.21.15.45:0/2256252891 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5630e7d3f800 0x5630e7dab600 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x5630e7da3a40 tx=0x5630e8b0a120 comp rx=0 tx=0).stop 2023-11-28T18:42:21.819 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.803+0000 7f6a52647280 1 -- 172.21.15.45:0/2256252891 shutdown_connections 2023-11-28T18:42:21.819 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.803+0000 7f6a52647280 1 --2- 172.21.15.45:0/2256252891 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5630e7d3f800 0x5630e7dab600 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.819 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.803+0000 7f6a52647280 1 --2- 172.21.15.45:0/2256252891 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5630e7d3fc00 0x5630e7daab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.819 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.803+0000 7f6a52647280 1 --2- 172.21.15.45:0/2256252891 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5630e8b0c800 0x5630e7dabb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.819 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.803+0000 7f6a52647280 1 -- 172.21.15.45:0/2256252891 >> 172.21.15.45:0/2256252891 conn(0x5630e7d3ec00 msgr2=0x5630e7d6c800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:21.819 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.803+0000 7f6a52647280 1 -- 172.21.15.45:0/2256252891 shutdown_connections 2023-11-28T18:42:21.819 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.803+0000 7f6a52647280 1 -- 172.21.15.45:0/2256252891 wait complete. 2023-11-28T18:42:21.819 INFO:tasks.workunit.client.0.smithi045.stderr:+ EVENT_LIST='0.000000 0x400000 LID: () 2023-11-28T18:42:21.819 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:39:37.048149+0000 0x400030 SUBTREEMAP: () 2023-11-28T18:42:21.819 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:39:44.085815+0000 0x4003ac SESSION: () 2023-11-28T18:42:21.819 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:39:44.501575+0000 0x400564 UPDATE: (setattr) 2023-11-28T18:42:21.820 INFO:tasks.workunit.client.0.smithi045.stderr: / 2023-11-28T18:42:21.820 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:39:44.620894+0000 0x400893 UPDATE: (mkdir) 2023-11-28T18:42:21.820 INFO:tasks.workunit.client.0.smithi045.stderr: client.0 2023-11-28T18:42:21.820 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:39:50.086407+0000 0x401073 UPDATE: (cap update) 2023-11-28T18:42:21.820 INFO:tasks.workunit.client.0.smithi045.stderr: client.0 2023-11-28T18:42:21.820 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:40:58.348779+0000 0x4016f8 UPDATE: (mkdir) 2023-11-28T18:42:21.820 INFO:tasks.workunit.client.0.smithi045.stderr: client.0/tmp 2023-11-28T18:42:21.820 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:40:58.364472+0000 0x402216 UPDATE: (mkdir) 2023-11-28T18:42:21.820 INFO:tasks.workunit.client.0.smithi045.stderr: tmp/foo 2023-11-28T18:42:21.820 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:40:58.370000+0000 0x402ae6 UPDATE: (openc) 2023-11-28T18:42:21.820 INFO:tasks.workunit.client.0.smithi045.stderr: tmp/bar 2023-11-28T18:42:21.820 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:41:00.046962+0000 0x403288 UPDATE: (unlink_local) 2023-11-28T18:42:21.820 INFO:tasks.workunit.client.0.smithi045.stderr: stray2/10000000002 2023-11-28T18:42:21.821 INFO:tasks.workunit.client.0.smithi045.stderr: client.0/tmp/foo 2023-11-28T18:42:21.821 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:41:00.049371+0000 0x40448b UPDATE: (cap update) 2023-11-28T18:42:21.821 INFO:tasks.workunit.client.0.smithi045.stderr: tmp/bar 2023-11-28T18:42:21.821 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:41:00.051848+0000 0x404c0c UPDATE: (unlink_local) 2023-11-28T18:42:21.821 INFO:tasks.workunit.client.0.smithi045.stderr: stray2/10000000003 2023-11-28T18:42:21.821 INFO:tasks.workunit.client.0.smithi045.stderr: tmp/bar 2023-11-28T18:42:21.821 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:41:00.056493+0000 0x40586f UPDATE: (unlink_local) 2023-11-28T18:42:21.821 INFO:tasks.workunit.client.0.smithi045.stderr: stray2/10000000001 2023-11-28T18:42:21.821 INFO:tasks.workunit.client.0.smithi045.stderr: client.0/tmp 2023-11-28T18:42:21.821 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:41:00.958687+0000 0x4064d7 UPDATE: (unlink_local) 2023-11-28T18:42:21.821 INFO:tasks.workunit.client.0.smithi045.stderr: client.0 2023-11-28T18:42:21.821 INFO:tasks.workunit.client.0.smithi045.stderr: stray2/10000000000 2023-11-28T18:42:21.822 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:41:01.129537+0000 0x407036 UPDATE: (purge_stray) 2023-11-28T18:42:21.822 INFO:tasks.workunit.client.0.smithi045.stderr: 10000000002 2023-11-28T18:42:21.822 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:41:01.129593+0000 0x40728d UPDATE: (purge_stray) 2023-11-28T18:42:21.822 INFO:tasks.workunit.client.0.smithi045.stderr: 10000000003 2023-11-28T18:42:21.822 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:41:01.465349+0000 0x4074e4 UPDATE: (scatter_writebehind) 2023-11-28T18:42:21.822 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:41:02.129108+0000 0x407956 UPDATE: (purge_stray) 2023-11-28T18:42:21.823 INFO:tasks.workunit.client.0.smithi045.stderr: 10000000001 2023-11-28T18:42:21.823 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:41:03.129943+0000 0x407bad UPDATE: (purge_stray) 2023-11-28T18:42:21.823 INFO:tasks.workunit.client.0.smithi045.stderr: 10000000000 2023-11-28T18:42:21.823 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:41:04.592398+0000 0x407e04 SESSION: () 2023-11-28T18:42:21.823 INFO:tasks.workunit.client.0.smithi045.stderr:0.000000 0x407eb1 PURGED: () 2023-11-28T18:42:21.823 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:41:06.462759+0000 0x407efd UPDATE: (scatter_writebehind) 2023-11-28T18:42:21.823 INFO:tasks.workunit.client.0.smithi045.stderr: stray2' 2023-11-28T18:42:21.823 INFO:tasks.workunit.client.0.smithi045.stderr:+ cephfs-journal-tool --rank=cephfs:0 journal export /tmp/journal.bin 2023-11-28T18:42:21.853 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.847+0000 7f6041469280 1 -- start start 2023-11-28T18:42:21.853 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.847+0000 7f6041469280 1 Processor -- start 2023-11-28T18:42:21.855 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.851+0000 7f6041469280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5588c0815800 0x5588c0880580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:21.855 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.851+0000 7f6041469280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5588c0815400 0x5588c0880b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:21.855 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.851+0000 7f6041469280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5588c0815000 0x5588c0881080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:21.855 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.851+0000 7f6041469280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588c085b180 con 0x5588c0815000 2023-11-28T18:42:21.855 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.851+0000 7f6041469280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588c085a140 con 0x5588c0815400 2023-11-28T18:42:21.855 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.851+0000 7f6041469280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x5588c085a000 con 0x5588c0815800 2023-11-28T18:42:21.855 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.851+0000 7f604042b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5588c0815000 0x5588c0881080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:21.855 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.851+0000 7f604042b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5588c0815000 0x5588c0881080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57134/0 (socket says 172.21.15.45:57134) 2023-11-28T18:42:21.855 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.851+0000 7f604042b640 1 -- 172.21.15.45:0/3777495397 learned_addr learned my addr 172.21.15.45:0/3777495397 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:21.856 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.851+0000 7f604042b640 1 -- 172.21.15.45:0/3777495397 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5588c0815800 msgr2=0x5588c0880580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:21.856 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.851+0000 7f604042b640 1 --2- 172.21.15.45:0/3777495397 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5588c0815800 0x5588c0880580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.856 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.851+0000 7f604042b640 1 -- 172.21.15.45:0/3777495397 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5588c0815400 msgr2=0x5588c0880b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:21.856 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.851+0000 7f604042b640 1 --2- 172.21.15.45:0/3777495397 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5588c0815400 0x5588c0880b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.856 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.851+0000 7f604042b640 1 -- 172.21.15.45:0/3777495397 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5588c084a9c0 con 0x5588c0815000 2023-11-28T18:42:21.856 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.851+0000 7f604042b640 1 --2- 172.21.15.45:0/3777495397 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5588c0815000 0x5588c0881080 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x5588c1694cc0 tx=0x5588c08d8840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a011863dbcc4f7a8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:21.856 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.851+0000 7f603d425640 1 -- 172.21.15.45:0/3777495397 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5588c08751e0 con 0x5588c0815000 2023-11-28T18:42:21.856 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.851+0000 7f603d425640 1 -- 172.21.15.45:0/3777495397 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5588c0870900 con 0x5588c0815000 2023-11-28T18:42:21.856 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.851+0000 7f603d425640 1 -- 172.21.15.45:0/3777495397 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5588c0875080 con 0x5588c0815000 2023-11-28T18:42:21.856 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.851+0000 7f6041469280 1 -- 172.21.15.45:0/3777495397 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5588c084ab60 con 0x5588c0815000 2023-11-28T18:42:21.856 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.851+0000 7f6041469280 1 -- 172.21.15.45:0/3777495397 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x5588c084a340 con 0x5588c0815000 2023-11-28T18:42:21.859 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.851+0000 7f603d425640 1 -- 172.21.15.45:0/3777495397 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x5588c0856c40 con 0x5588c0815000 2023-11-28T18:42:21.859 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.851+0000 7f603d425640 1 -- 172.21.15.45:0/3777495397 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 34) v1 ==== 3298+0+0 (secure 0 0 0) 0x5588c0862f00 con 0x5588c0815000 2023-11-28T18:42:21.860 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.851+0000 7f6041469280 1 Processor -- start 2023-11-28T18:42:21.860 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.851+0000 7f6041469280 1 -- start start 2023-11-28T18:42:21.860 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.851+0000 7f6041469280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5588c171cc00 0x5588c0881600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:21.860 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.855+0000 7f6041469280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5588c171d000 0x5588c0881b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:21.860 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.855+0000 7f6041469280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5588c171d400 0x5588c0882100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:21.860 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.855+0000 7f6041469280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588c085aa00 con 0x5588c171cc00 2023-11-28T18:42:21.860 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.855+0000 7f6041469280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588c08e5180 con 0x5588c171d400 2023-11-28T18:42:21.860 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.855+0000 7f6041469280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x5588c08e4dc0 con 0x5588c171d000 2023-11-28T18:42:21.860 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.855+0000 7f603f429640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5588c171cc00 0x5588c0881600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:21.860 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.855+0000 7f603f429640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5588c171cc00 0x5588c0881600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57142/0 (socket says 172.21.15.45:57142) 2023-11-28T18:42:21.860 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.855+0000 7f603f429640 1 -- 172.21.15.45:0/539453692 learned_addr learned my addr 172.21.15.45:0/539453692 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:21.860 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.855+0000 7f603f429640 1 -- 172.21.15.45:0/539453692 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5588c171d000 msgr2=0x5588c0881b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:21.861 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.855+0000 7f603f429640 1 --2- 172.21.15.45:0/539453692 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5588c171d000 0x5588c0881b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.861 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.855+0000 7f603f429640 1 -- 172.21.15.45:0/539453692 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5588c171d400 msgr2=0x5588c0882100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:21.861 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.855+0000 7f603f429640 1 --2- 172.21.15.45:0/539453692 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5588c171d400 0x5588c0882100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.861 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.855+0000 7f603f429640 1 -- 172.21.15.45:0/539453692 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5588c084a000 con 0x5588c171cc00 2023-11-28T18:42:21.861 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.855+0000 7f603f429640 1 --2- 172.21.15.45:0/539453692 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5588c171cc00 0x5588c0881600 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x5588c1790060 tx=0x5588c15e4000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b55b291c128bf15 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:21.861 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.855+0000 7f603b421640 1 -- 172.21.15.45:0/539453692 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5588c0874f20 con 0x5588c171cc00 2023-11-28T18:42:21.861 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.855+0000 7f603b421640 1 -- 172.21.15.45:0/539453692 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5588c15f6f00 con 0x5588c171cc00 2023-11-28T18:42:21.861 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.855+0000 7f603b421640 1 -- 172.21.15.45:0/539453692 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5588c08751e0 con 0x5588c171cc00 2023-11-28T18:42:21.861 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.855+0000 7f6041469280 1 -- 172.21.15.45:0/539453692 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5588c171cc00 msgr2=0x5588c0881600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:21.861 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.855+0000 7f6041469280 1 --2- 172.21.15.45:0/539453692 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5588c171cc00 0x5588c0881600 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x5588c1790060 tx=0x5588c15e4000 comp rx=0 tx=0).stop 2023-11-28T18:42:21.861 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.855+0000 7f6041469280 1 -- 172.21.15.45:0/539453692 shutdown_connections 2023-11-28T18:42:21.861 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.855+0000 7f6041469280 1 --2- 172.21.15.45:0/539453692 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5588c171d400 0x5588c0882100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.862 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.855+0000 7f6041469280 1 --2- 172.21.15.45:0/539453692 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5588c171d000 0x5588c0881b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.862 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.855+0000 7f6041469280 1 --2- 172.21.15.45:0/539453692 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5588c171cc00 0x5588c0881600 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.862 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.855+0000 7f6041469280 1 -- 172.21.15.45:0/539453692 >> 172.21.15.45:0/539453692 conn(0x5588c0814c00 msgr2=0x5588c0843800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:21.862 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.855+0000 7f6041469280 1 -- 172.21.15.45:0/539453692 shutdown_connections 2023-11-28T18:42:21.862 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.855+0000 7f6041469280 1 -- 172.21.15.45:0/539453692 wait complete. 2023-11-28T18:42:21.862 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.855+0000 7f6041469280 1 Processor -- start 2023-11-28T18:42:21.864 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.855+0000 7f6041469280 1 -- start start 2023-11-28T18:42:21.865 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.855+0000 7f6041469280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5588c171cc00 0x5588c0883180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:21.865 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.855+0000 7f6041469280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5588c171d000 0x5588c0882c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:21.865 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.855+0000 7f6041469280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5588c171d400 0x5588c0882680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:21.865 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.855+0000 7f6041469280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588c08e4c80 con 0x5588c171d000 2023-11-28T18:42:21.865 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.855+0000 7f6041469280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588c085a140 con 0x5588c171cc00 2023-11-28T18:42:21.865 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.855+0000 7f6041469280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x5588c085ab40 con 0x5588c171d400 2023-11-28T18:42:21.865 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.855+0000 7f603fc2a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5588c171d000 0x5588c0882c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:21.865 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.855+0000 7f603fc2a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5588c171d000 0x5588c0882c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57154/0 (socket says 172.21.15.45:57154) 2023-11-28T18:42:21.865 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.855+0000 7f603fc2a640 1 -- 172.21.15.45:0/2045504635 learned_addr learned my addr 172.21.15.45:0/2045504635 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:21.865 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.855+0000 7f603f429640 1 --2- 172.21.15.45:0/2045504635 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5588c171d400 0x5588c0882680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:21.865 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.859+0000 7f603f429640 1 --2- 172.21.15.45:0/2045504635 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5588c171cc00 0x5588c0883180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:21.866 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.859+0000 7f603fc2a640 1 -- 172.21.15.45:0/2045504635 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5588c171d400 msgr2=0x5588c0882680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:21.866 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.859+0000 7f603fc2a640 1 --2- 172.21.15.45:0/2045504635 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5588c171d400 0x5588c0882680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.866 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.859+0000 7f603fc2a640 1 -- 172.21.15.45:0/2045504635 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5588c171cc00 msgr2=0x5588c0883180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:21.866 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.859+0000 7f603fc2a640 1 --2- 172.21.15.45:0/2045504635 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5588c171cc00 0x5588c0883180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.866 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.859+0000 7f603fc2a640 1 -- 172.21.15.45:0/2045504635 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5588c084a1a0 con 0x5588c171d000 2023-11-28T18:42:21.866 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.859+0000 7f603f429640 1 --2- 172.21.15.45:0/2045504635 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5588c171cc00 0x5588c0883180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:42:21.866 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.859+0000 7f603fc2a640 1 --2- 172.21.15.45:0/2045504635 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5588c171d000 0x5588c0882c00 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x5588c1790e70 tx=0x5588c1798120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:21.866 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.859+0000 7f6039c1e640 1 -- 172.21.15.45:0/2045504635 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5588c0874f20 con 0x5588c171d000 2023-11-28T18:42:21.866 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.859+0000 7f6039c1e640 1 -- 172.21.15.45:0/2045504635 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5588c15f7800 con 0x5588c171d000 2023-11-28T18:42:21.866 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.859+0000 7f6039c1e640 1 -- 172.21.15.45:0/2045504635 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5588c08751e0 con 0x5588c171d000 2023-11-28T18:42:21.866 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.859+0000 7f6041469280 1 -- 172.21.15.45:0/2045504635 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5588c084a000 con 0x5588c171d000 2023-11-28T18:42:21.866 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.859+0000 7f6041469280 1 -- 172.21.15.45:0/2045504635 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5588c084a9c0 con 0x5588c171d000 2023-11-28T18:42:21.867 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.859+0000 7f6039c1e640 1 -- 172.21.15.45:0/2045504635 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x5588c08a2840 con 0x5588c171d000 2023-11-28T18:42:21.867 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.859+0000 7f6039c1e640 1 --2- 172.21.15.45:0/2045504635 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x5588c0af5000 0x5588c0883700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:21.867 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.859+0000 7f6039c1e640 1 -- 172.21.15.45:0/2045504635 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x5588c0856a80 con 0x5588c171d000 2023-11-28T18:42:21.867 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.859+0000 7f6041469280 1 --2- 172.21.15.45:0/2045504635 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x5588c171d800 0x5588c0882100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:21.867 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.859+0000 7f6041469280 1 -- 172.21.15.45:0/2045504635 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x5588c086b880 con 0x5588c171d800 2023-11-28T18:42:21.867 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.859+0000 7f603f429640 1 --2- 172.21.15.45:0/2045504635 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x5588c0af5000 0x5588c0883700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:21.867 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.859+0000 7f603f429640 1 --2- 172.21.15.45:0/2045504635 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x5588c171d800 0x5588c0882100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:21.869 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.859+0000 7f603f429640 1 --2- 172.21.15.45:0/2045504635 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x5588c171d800 0x5588c0882100 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:21.869 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.863+0000 7f603f429640 1 --2- 172.21.15.45:0/2045504635 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x5588c0af5000 0x5588c0883700 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x5588c1790270 tx=0x5588c15e40c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:21.869 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.863+0000 7f603f429640 1 -- 172.21.15.45:0/2045504635 <== osd.2 v2:172.21.15.45:6816/193884539 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x5588c156eb40 con 0x5588c171d800 2023-11-28T18:42:21.869 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.863+0000 7f6041469280 1 -- 172.21.15.45:0/2045504635 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x5588c086bc00 con 0x5588c171d800 2023-11-28T18:42:21.869 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.863+0000 7f603f429640 1 -- 172.21.15.45:0/2045504635 <== osd.2 v2:172.21.15.45:6816/193884539 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv11 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x5588c156eb40 con 0x5588c171d800 2023-11-28T18:42:21.869 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.863+0000 7f6041469280 1 -- 172.21.15.45:0/2045504635 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:3 6.14 6:2e2fa760:::200.00000001:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x5588c086b880 con 0x5588c171d800 2023-11-28T18:42:21.869 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.863+0000 7f603f429640 1 -- 172.21.15.45:0/2045504635 <== osd.2 v2:172.21.15.45:6816/193884539 3 ==== osd_op_reply(3 200.00000001 [read 0~34160 out=34160b] v0'0 uv21 ondisk = 0) v8 ==== 156+0+34160 (crc 0 0 0) 0x5588c156eb40 con 0x5588c171d800 2023-11-28T18:42:21.869 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.863+0000 7f6041469280 1 --2- 172.21.15.45:0/2045504635 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x5588c171dc00 0x5588c0881b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:21.869 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.863+0000 7f6041469280 1 -- 172.21.15.45:0/2045504635 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:4 6.1b 6:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x5588c086bc00 con 0x5588c171dc00 2023-11-28T18:42:21.869 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.863+0000 7f604042b640 1 --2- 172.21.15.45:0/2045504635 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x5588c171dc00 0x5588c0881b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:21.869 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.863+0000 7f604042b640 1 --2- 172.21.15.45:0/2045504635 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x5588c171dc00 0x5588c0881b80 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:21.870 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.863+0000 7f604042b640 1 -- 172.21.15.45:0/2045504635 <== osd.3 v2:172.21.15.45:6824/78541084 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x5588c156ed80 con 0x5588c171dc00 2023-11-28T18:42:21.870 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.863+0000 7f6041469280 1 -- start start 2023-11-28T18:42:21.870 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.863+0000 7f6041469280 1 Processor -- start 2023-11-28T18:42:21.872 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.867+0000 7f6041469280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5588c0af5800 0x5588c0881600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:21.873 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.867+0000 7f6041469280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5588c0af5c00 0x5588c0c60000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:21.873 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.867+0000 7f6041469280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5588c0c64000 0x5588c0c60580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:21.873 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.867+0000 7f6041469280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588c08e4dc0 con 0x5588c0af5c00 2023-11-28T18:42:21.873 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.867+0000 7f6041469280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588c08e5180 con 0x5588c0c64000 2023-11-28T18:42:21.873 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.867+0000 7f6041469280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x5588c08e4b40 con 0x5588c0af5800 2023-11-28T18:42:21.873 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.867+0000 7f604042b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5588c0af5c00 0x5588c0c60000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:21.873 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.867+0000 7f604042b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5588c0af5c00 0x5588c0c60000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57162/0 (socket says 172.21.15.45:57162) 2023-11-28T18:42:21.873 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.867+0000 7f604042b640 1 -- 172.21.15.45:0/3202696105 learned_addr learned my addr 172.21.15.45:0/3202696105 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:21.874 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.867+0000 7f603f429640 1 --2- 172.21.15.45:0/3202696105 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5588c0af5800 0x5588c0881600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:21.874 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.867+0000 7f603fc2a640 1 --2- 172.21.15.45:0/3202696105 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5588c0c64000 0x5588c0c60580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:21.874 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.867+0000 7f604042b640 1 -- 172.21.15.45:0/3202696105 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5588c0af5800 msgr2=0x5588c0881600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:21.874 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.867+0000 7f604042b640 1 --2- 172.21.15.45:0/3202696105 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5588c0af5800 0x5588c0881600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.874 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.867+0000 7f604042b640 1 -- 172.21.15.45:0/3202696105 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5588c0c64000 msgr2=0x5588c0c60580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:21.874 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.867+0000 7f604042b640 1 --2- 172.21.15.45:0/3202696105 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5588c0c64000 0x5588c0c60580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.874 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.867+0000 7f604042b640 1 -- 172.21.15.45:0/3202696105 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5588c0b2b6c0 con 0x5588c0af5c00 2023-11-28T18:42:21.874 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.867+0000 7f604042b640 1 --2- 172.21.15.45:0/3202696105 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5588c0af5c00 0x5588c0c60000 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x5588c1791530 tx=0x5588c08d89c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f275364e10b8e46 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:21.874 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.867+0000 7f6036c18640 1 -- 172.21.15.45:0/3202696105 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5588c0874dc0 con 0x5588c0af5c00 2023-11-28T18:42:21.874 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.867+0000 7f6036c18640 1 -- 172.21.15.45:0/3202696105 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5588c15f6c00 con 0x5588c0af5c00 2023-11-28T18:42:21.874 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.867+0000 7f6036c18640 1 -- 172.21.15.45:0/3202696105 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5588c08758c0 con 0x5588c0af5c00 2023-11-28T18:42:21.874 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.867+0000 7f6041469280 1 -- 172.21.15.45:0/3202696105 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5588c0b2b520 con 0x5588c0af5c00 2023-11-28T18:42:21.875 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.867+0000 7f6041469280 1 -- 172.21.15.45:0/3202696105 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x5588c0b2b380 con 0x5588c0af5c00 2023-11-28T18:42:21.875 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.867+0000 7f6036c18640 1 -- 172.21.15.45:0/3202696105 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x5588c08568c0 con 0x5588c0af5c00 2023-11-28T18:42:21.875 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.867+0000 7f6036c18640 1 -- 172.21.15.45:0/3202696105 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 34) v1 ==== 3298+0+0 (secure 0 0 0) 0x5588c0c74000 con 0x5588c0af5c00 2023-11-28T18:42:21.875 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.867+0000 7f6041469280 1 --2- 172.21.15.45:0/3202696105 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x5588c0c64400 0x5588c0c60b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:21.875 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.867+0000 7f6041469280 1 -- 172.21.15.45:0/3202696105 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x5588c0c7e380 con 0x5588c0c64400 2023-11-28T18:42:21.875 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.867+0000 7f603f429640 1 --2- 172.21.15.45:0/3202696105 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x5588c0c64400 0x5588c0c60b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:21.875 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.867+0000 7f603f429640 1 --2- 172.21.15.45:0/3202696105 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x5588c0c64400 0x5588c0c60b00 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=adde7eed1d46b70b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:21.875 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.867+0000 7f603f429640 1 -- 172.21.15.45:0/3202696105 <== osd.2 v2:172.21.15.45:6816/193884539 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x5588c156eb40 con 0x5588c0c64400 2023-11-28T18:42:21.875 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.867+0000 7f6041469280 1 -- 172.21.15.45:0/3202696105 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x5588c0c7e700 con 0x5588c0c64400 2023-11-28T18:42:21.875 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.867+0000 7f603f429640 1 -- 172.21.15.45:0/3202696105 <== osd.2 v2:172.21.15.45:6816/193884539 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv11 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x5588c156eb40 con 0x5588c0c64400 2023-11-28T18:42:21.875 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.867+0000 7f6035415640 1 -- 172.21.15.45:0/3202696105 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:3 6.14 6:2e2fa760:::200.00000001:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e49) v8 -- 0x5588c086b880 con 0x5588c0c64400 2023-11-28T18:42:21.875 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.867+0000 7f6035415640 1 --2- 172.21.15.45:0/3202696105 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x5588c0c6b000 0x5588c0c62680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:21.876 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.867+0000 7f6035415640 1 -- 172.21.15.45:0/3202696105 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:4 6.1b 6:ddb4e4d7:::200.00000002:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e49) v8 -- 0x5588c0c7e380 con 0x5588c0c6b000 2023-11-28T18:42:21.876 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.867+0000 7f603fc2a640 1 --2- 172.21.15.45:0/3202696105 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x5588c0c6b000 0x5588c0c62680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:21.876 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.867+0000 7f603f429640 1 -- 172.21.15.45:0/3202696105 <== osd.2 v2:172.21.15.45:6816/193884539 3 ==== osd_op_reply(3 200.00000001 [stat out=16b] v0'0 uv21 ondisk = 0) v8 ==== 156+0+16 (crc 0 0 0) 0x5588c156eb40 con 0x5588c0c64400 2023-11-28T18:42:21.876 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.867+0000 7f603fc2a640 1 --2- 172.21.15.45:0/3202696105 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x5588c0c6b000 0x5588c0c62680 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=66ce5f8d528e7774 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:21.876 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.871+0000 7f603fc2a640 1 -- 172.21.15.45:0/3202696105 <== osd.3 v2:172.21.15.45:6824/78541084 1 ==== osd_op_reply(4 200.00000002 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x5588c156f440 con 0x5588c0c6b000 2023-11-28T18:42:21.877 INFO:tasks.workunit.client.0.smithi045.stdout:journal is 4194304~34160 2023-11-28T18:42:21.877 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.871+0000 7f6041469280 1 -- 172.21.15.45:0/3202696105 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:5 6.14 6:2e2fa760:::200.00000001:head [read 0~34160] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x5588c0c7ea80 con 0x5588c0c64400 2023-11-28T18:42:21.877 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.871+0000 7f603f429640 1 -- 172.21.15.45:0/3202696105 <== osd.2 v2:172.21.15.45:6816/193884539 4 ==== osd_op_reply(5 200.00000001 [read 0~34160 out=34160b] v0'0 uv21 ondisk = 0) v8 ==== 156+0+34160 (crc 0 0 0) 0x5588c156eb40 con 0x5588c0c64400 2023-11-28T18:42:21.877 INFO:tasks.workunit.client.0.smithi045.stdout:wrote 34160 bytes at offset 4194304 to /tmp/journal.bin 2023-11-28T18:42:21.877 INFO:tasks.workunit.client.0.smithi045.stdout:NOTE: this is a _sparse_ file; you can 2023-11-28T18:42:21.878 INFO:tasks.workunit.client.0.smithi045.stdout: $ tar cSzf /tmp/journal.bin.tgz /tmp/journal.bin 2023-11-28T18:42:21.878 INFO:tasks.workunit.client.0.smithi045.stdout: to efficiently compress it while preserving sparseness. 2023-11-28T18:42:21.880 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.871+0000 7f6041469280 1 -- 172.21.15.45:0/3202696105 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x5588c0c64400 msgr2=0x5588c0c60b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:21.880 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.871+0000 7f6041469280 1 --2- 172.21.15.45:0/3202696105 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x5588c0c64400 0x5588c0c60b00 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.880 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.871+0000 7f6041469280 1 -- 172.21.15.45:0/3202696105 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x5588c0c6b000 msgr2=0x5588c0c62680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:21.880 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.871+0000 7f6041469280 1 --2- 172.21.15.45:0/3202696105 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x5588c0c6b000 0x5588c0c62680 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.880 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.871+0000 7f6041469280 1 -- 172.21.15.45:0/3202696105 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5588c0af5c00 msgr2=0x5588c0c60000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:21.880 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.871+0000 7f6041469280 1 --2- 172.21.15.45:0/3202696105 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5588c0af5c00 0x5588c0c60000 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x5588c1791530 tx=0x5588c08d89c0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.880 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.871+0000 7f603fc2a640 1 -- 172.21.15.45:0/3202696105 reap_dead start 2023-11-28T18:42:21.880 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.871+0000 7f6041469280 1 -- 172.21.15.45:0/3202696105 shutdown_connections 2023-11-28T18:42:21.880 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.871+0000 7f6041469280 1 -- 172.21.15.45:0/3202696105 >> 172.21.15.45:0/3202696105 conn(0x5588c0af5400 msgr2=0x5588c0c48000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:21.881 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.871+0000 7f6041469280 1 -- 172.21.15.45:0/3202696105 shutdown_connections 2023-11-28T18:42:21.881 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.871+0000 7f6041469280 1 -- 172.21.15.45:0/3202696105 wait complete. 2023-11-28T18:42:21.881 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.871+0000 7f6041469280 1 -- 172.21.15.45:0/2045504635 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x5588c171d800 msgr2=0x5588c0882100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:21.881 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.871+0000 7f6041469280 1 --2- 172.21.15.45:0/2045504635 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x5588c171d800 0x5588c0882100 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.881 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.871+0000 7f6041469280 1 -- 172.21.15.45:0/2045504635 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x5588c171dc00 msgr2=0x5588c0881b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:21.881 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.871+0000 7f6041469280 1 --2- 172.21.15.45:0/2045504635 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x5588c171dc00 0x5588c0881b80 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.881 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.871+0000 7f6041469280 1 -- 172.21.15.45:0/2045504635 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x5588c0af5000 msgr2=0x5588c0883700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:21.881 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.871+0000 7f6041469280 1 --2- 172.21.15.45:0/2045504635 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x5588c0af5000 0x5588c0883700 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x5588c1790270 tx=0x5588c15e40c0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.881 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.871+0000 7f6041469280 1 -- 172.21.15.45:0/2045504635 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5588c171d000 msgr2=0x5588c0882c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:21.881 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.871+0000 7f6041469280 1 --2- 172.21.15.45:0/2045504635 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5588c171d000 0x5588c0882c00 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x5588c1790e70 tx=0x5588c1798120 comp rx=0 tx=0).stop 2023-11-28T18:42:21.881 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.871+0000 7f603fc2a640 1 -- 172.21.15.45:0/2045504635 reap_dead start 2023-11-28T18:42:21.881 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.871+0000 7f6041469280 1 -- 172.21.15.45:0/2045504635 shutdown_connections 2023-11-28T18:42:21.881 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.871+0000 7f6041469280 1 --2- 172.21.15.45:0/2045504635 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5588c171d000 0x5588c0882c00 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.882 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.871+0000 7f6041469280 1 -- 172.21.15.45:0/2045504635 >> 172.21.15.45:0/2045504635 conn(0x5588c0814c00 msgr2=0x5588c0843800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:21.882 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.871+0000 7f6041469280 1 -- 172.21.15.45:0/2045504635 shutdown_connections 2023-11-28T18:42:21.882 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.871+0000 7f6041469280 1 -- 172.21.15.45:0/2045504635 wait complete. 2023-11-28T18:42:21.882 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.871+0000 7f6041469280 1 -- 172.21.15.45:0/3777495397 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5588c0815000 msgr2=0x5588c0881080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:21.882 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.871+0000 7f6041469280 1 --2- 172.21.15.45:0/3777495397 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5588c0815000 0x5588c0881080 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x5588c1694cc0 tx=0x5588c08d8840 comp rx=0 tx=0).stop 2023-11-28T18:42:21.882 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.871+0000 7f6041469280 1 -- 172.21.15.45:0/3777495397 shutdown_connections 2023-11-28T18:42:21.882 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.871+0000 7f6041469280 1 --2- 172.21.15.45:0/3777495397 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5588c0815000 0x5588c0881080 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.882 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.871+0000 7f6041469280 1 --2- 172.21.15.45:0/3777495397 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5588c0815400 0x5588c0880b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.882 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.871+0000 7f6041469280 1 --2- 172.21.15.45:0/3777495397 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5588c0815800 0x5588c0880580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.882 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.871+0000 7f6041469280 1 -- 172.21.15.45:0/3777495397 >> 172.21.15.45:0/3777495397 conn(0x5588c0815c00 msgr2=0x5588c0843000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:21.882 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.871+0000 7f6041469280 1 -- 172.21.15.45:0/3777495397 shutdown_connections 2023-11-28T18:42:21.882 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.871+0000 7f6041469280 1 -- 172.21.15.45:0/3777495397 wait complete. 2023-11-28T18:42:21.883 INFO:tasks.workunit.client.0.smithi045.stderr:+ cephfs-journal-tool --rank=cephfs:0 journal import /tmp/journal.bin 2023-11-28T18:42:21.921 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.915+0000 7faf533db280 1 -- start start 2023-11-28T18:42:21.921 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.915+0000 7faf533db280 1 Processor -- start 2023-11-28T18:42:21.922 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.919+0000 7faf533db280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5607036cd800 0x560703738580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:21.922 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.919+0000 7faf533db280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5607036cd400 0x560703738b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:21.922 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.919+0000 7faf533db280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5607036cd000 0x560703739080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:21.923 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.919+0000 7faf533db280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x560703713180 con 0x5607036cd000 2023-11-28T18:42:21.923 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.919+0000 7faf533db280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x560703712140 con 0x5607036cd400 2023-11-28T18:42:21.923 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.919+0000 7faf533db280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x560703712000 con 0x5607036cd800 2023-11-28T18:42:21.923 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.919+0000 7faf5239b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5607036cd000 0x560703739080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:21.923 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.919+0000 7faf5239b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5607036cd000 0x560703739080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57186/0 (socket says 172.21.15.45:57186) 2023-11-28T18:42:21.923 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.919+0000 7faf5239b640 1 -- 172.21.15.45:0/1485496509 learned_addr learned my addr 172.21.15.45:0/1485496509 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:21.923 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.919+0000 7faf51b9a640 1 --2- 172.21.15.45:0/1485496509 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5607036cd800 0x560703738580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:21.924 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.919+0000 7faf51399640 1 --2- 172.21.15.45:0/1485496509 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5607036cd400 0x560703738b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:21.927 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.919+0000 7faf5239b640 1 -- 172.21.15.45:0/1485496509 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5607036cd800 msgr2=0x560703738580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:21.927 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.919+0000 7faf5239b640 1 --2- 172.21.15.45:0/1485496509 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5607036cd800 0x560703738580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.927 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.919+0000 7faf5239b640 1 -- 172.21.15.45:0/1485496509 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5607036cd400 msgr2=0x560703738b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:21.927 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.919+0000 7faf5239b640 1 --2- 172.21.15.45:0/1485496509 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5607036cd400 0x560703738b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.928 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.919+0000 7faf5239b640 1 -- 172.21.15.45:0/1485496509 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5607037029c0 con 0x5607036cd000 2023-11-28T18:42:21.928 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.919+0000 7faf5239b640 1 --2- 172.21.15.45:0/1485496509 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5607036cd000 0x560703739080 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x560704548cf0 tx=0x56070374f140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76c7ada283941a8e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:21.928 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.919+0000 7faf4f395640 1 -- 172.21.15.45:0/1485496509 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56070372d1e0 con 0x5607036cd000 2023-11-28T18:42:21.928 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.919+0000 7faf4f395640 1 -- 172.21.15.45:0/1485496509 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560703728180 con 0x5607036cd000 2023-11-28T18:42:21.928 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.919+0000 7faf4f395640 1 -- 172.21.15.45:0/1485496509 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56070372d080 con 0x5607036cd000 2023-11-28T18:42:21.928 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.919+0000 7faf533db280 1 -- 172.21.15.45:0/1485496509 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560703702b60 con 0x5607036cd000 2023-11-28T18:42:21.928 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.919+0000 7faf533db280 1 -- 172.21.15.45:0/1485496509 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x560703702340 con 0x5607036cd000 2023-11-28T18:42:21.929 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.919+0000 7faf4f395640 1 -- 172.21.15.45:0/1485496509 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x56070370ec40 con 0x5607036cd000 2023-11-28T18:42:21.929 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.919+0000 7faf4f395640 1 -- 172.21.15.45:0/1485496509 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 34) v1 ==== 3298+0+0 (secure 0 0 0) 0x56070371af00 con 0x5607036cd000 2023-11-28T18:42:21.929 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.919+0000 7faf533db280 1 Processor -- start 2023-11-28T18:42:21.929 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.919+0000 7faf533db280 1 -- start start 2023-11-28T18:42:21.929 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.923+0000 7faf533db280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5607045d4c00 0x560703739600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:21.929 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.923+0000 7faf533db280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5607045d5000 0x560703739b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:21.929 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.923+0000 7faf533db280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5607045d5400 0x56070373a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:21.929 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.923+0000 7faf533db280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x560703712a00 con 0x5607045d5000 2023-11-28T18:42:21.930 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.923+0000 7faf533db280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x56070379d180 con 0x5607045d4c00 2023-11-28T18:42:21.930 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.923+0000 7faf533db280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x56070379cdc0 con 0x5607045d5400 2023-11-28T18:42:21.930 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.923+0000 7faf51b9a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5607045d5000 0x560703739b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:21.930 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.923+0000 7faf51b9a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5607045d5000 0x560703739b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57196/0 (socket says 172.21.15.45:57196) 2023-11-28T18:42:21.930 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.923+0000 7faf51b9a640 1 -- 172.21.15.45:0/2127906187 learned_addr learned my addr 172.21.15.45:0/2127906187 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:21.930 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.923+0000 7faf51399640 1 --2- 172.21.15.45:0/2127906187 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5607045d4c00 0x560703739600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:21.930 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.923+0000 7faf51399640 1 --2- 172.21.15.45:0/2127906187 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5607045d5400 0x56070373a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:21.930 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.923+0000 7faf51b9a640 1 -- 172.21.15.45:0/2127906187 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5607045d5400 msgr2=0x56070373a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:21.931 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.923+0000 7faf51b9a640 1 --2- 172.21.15.45:0/2127906187 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5607045d5400 0x56070373a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.931 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.923+0000 7faf51b9a640 1 -- 172.21.15.45:0/2127906187 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5607045d4c00 msgr2=0x560703739600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:21.931 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.923+0000 7faf51b9a640 1 --2- 172.21.15.45:0/2127906187 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5607045d4c00 0x560703739600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.931 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.923+0000 7faf51b9a640 1 -- 172.21.15.45:0/2127906187 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560703702000 con 0x5607045d5000 2023-11-28T18:42:21.931 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.923+0000 7faf51b9a640 1 --2- 172.21.15.45:0/2127906187 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5607045d5000 0x560703739b80 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x5607046480c0 tx=0x560704654000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f08871335961590 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:21.931 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.923+0000 7faf4d391640 1 -- 172.21.15.45:0/2127906187 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56070372d1e0 con 0x5607045d5000 2023-11-28T18:42:21.931 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.923+0000 7faf4d391640 1 -- 172.21.15.45:0/2127906187 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5607044a6f00 con 0x5607045d5000 2023-11-28T18:42:21.932 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.923+0000 7faf4d391640 1 -- 172.21.15.45:0/2127906187 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56070372d080 con 0x5607045d5000 2023-11-28T18:42:21.932 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.923+0000 7faf533db280 1 -- 172.21.15.45:0/2127906187 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5607045d5000 msgr2=0x560703739b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:21.932 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.923+0000 7faf533db280 1 --2- 172.21.15.45:0/2127906187 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5607045d5000 0x560703739b80 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x5607046480c0 tx=0x560704654000 comp rx=0 tx=0).stop 2023-11-28T18:42:21.932 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.923+0000 7faf533db280 1 -- 172.21.15.45:0/2127906187 shutdown_connections 2023-11-28T18:42:21.932 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.923+0000 7faf533db280 1 --2- 172.21.15.45:0/2127906187 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5607045d5400 0x56070373a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.932 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.923+0000 7faf533db280 1 --2- 172.21.15.45:0/2127906187 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5607045d5000 0x560703739b80 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.932 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.923+0000 7faf533db280 1 --2- 172.21.15.45:0/2127906187 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5607045d4c00 0x560703739600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.932 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.923+0000 7faf533db280 1 -- 172.21.15.45:0/2127906187 >> 172.21.15.45:0/2127906187 conn(0x5607036ccc00 msgr2=0x5607036fb800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:21.933 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.923+0000 7faf533db280 1 -- 172.21.15.45:0/2127906187 shutdown_connections 2023-11-28T18:42:21.933 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.923+0000 7faf533db280 1 -- 172.21.15.45:0/2127906187 wait complete. 2023-11-28T18:42:21.937 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.923+0000 7faf533db280 1 Processor -- start 2023-11-28T18:42:21.937 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.923+0000 7faf533db280 1 -- start start 2023-11-28T18:42:21.937 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.923+0000 7faf533db280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5607045d4c00 0x56070373b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:21.938 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.923+0000 7faf533db280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5607045d5000 0x56070373ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:21.938 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.923+0000 7faf533db280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5607045d5400 0x56070373a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:21.938 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.923+0000 7faf533db280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x56070379cc80 con 0x5607045d5400 2023-11-28T18:42:21.938 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.923+0000 7faf533db280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x560703712140 con 0x5607045d4c00 2023-11-28T18:42:21.938 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.923+0000 7faf533db280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x560703712b40 con 0x5607045d5000 2023-11-28T18:42:21.938 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.923+0000 7faf51399640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5607045d5400 0x56070373a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:21.938 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.923+0000 7faf51399640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5607045d5400 0x56070373a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57208/0 (socket says 172.21.15.45:57208) 2023-11-28T18:42:21.938 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.923+0000 7faf51399640 1 -- 172.21.15.45:0/3211148821 learned_addr learned my addr 172.21.15.45:0/3211148821 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:21.939 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.923+0000 7faf51399640 1 --2- 172.21.15.45:0/3211148821 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5607045d4c00 0x56070373b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:21.939 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.923+0000 7faf51b9a640 1 --2- 172.21.15.45:0/3211148821 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5607045d5000 0x56070373ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:21.939 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.927+0000 7faf51399640 1 -- 172.21.15.45:0/3211148821 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5607045d5000 msgr2=0x56070373ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:21.939 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.927+0000 7faf51399640 1 --2- 172.21.15.45:0/3211148821 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5607045d5000 0x56070373ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.939 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.927+0000 7faf51399640 1 -- 172.21.15.45:0/3211148821 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5607045d4c00 msgr2=0x56070373b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:21.939 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.927+0000 7faf51399640 1 --2- 172.21.15.45:0/3211148821 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5607045d4c00 0x56070373b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.940 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.927+0000 7faf51399640 1 -- 172.21.15.45:0/3211148821 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5607037029c0 con 0x5607045d5400 2023-11-28T18:42:21.940 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.927+0000 7faf51399640 1 --2- 172.21.15.45:0/3211148821 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5607045d5400 0x56070373a680 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x560704648d50 tx=0x56070449c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:21.940 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.927+0000 7faf4bb8e640 1 -- 172.21.15.45:0/3211148821 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56070372cf20 con 0x5607045d5400 2023-11-28T18:42:21.940 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.927+0000 7faf4bb8e640 1 -- 172.21.15.45:0/3211148821 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5607044a6300 con 0x5607045d5400 2023-11-28T18:42:21.940 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.927+0000 7faf4bb8e640 1 -- 172.21.15.45:0/3211148821 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56070372d1e0 con 0x5607045d5400 2023-11-28T18:42:21.940 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.927+0000 7faf533db280 1 -- 172.21.15.45:0/3211148821 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560703702b60 con 0x5607045d5400 2023-11-28T18:42:21.940 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.927+0000 7faf533db280 1 -- 172.21.15.45:0/3211148821 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560703702340 con 0x5607045d5400 2023-11-28T18:42:21.940 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.927+0000 7faf4bb8e640 1 -- 172.21.15.45:0/3211148821 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x56070375b080 con 0x5607045d5400 2023-11-28T18:42:21.940 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.927+0000 7faf4bb8e640 1 --2- 172.21.15.45:0/3211148821 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x560704653000 0x56070373b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:21.940 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.927+0000 7faf4bb8e640 1 -- 172.21.15.45:0/3211148821 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x56070370ea80 con 0x5607045d5400 2023-11-28T18:42:21.940 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.927+0000 7faf51b9a640 1 --2- 172.21.15.45:0/3211148821 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x560704653000 0x56070373b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:21.940 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.927+0000 7faf51b9a640 1 --2- 172.21.15.45:0/3211148821 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x560704653000 0x56070373b700 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x5607046480c0 tx=0x56070449c1e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:21.941 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.927+0000 7faf533db280 1 -- start start 2023-11-28T18:42:21.941 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.927+0000 7faf533db280 1 Processor -- start 2023-11-28T18:42:21.941 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.931+0000 7faf533db280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5607045d5c00 0x56070373a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:21.941 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.931+0000 7faf533db280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560704653400 0x560703739b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:21.941 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.931+0000 7faf533db280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560704653800 0x560703739600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:21.941 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.931+0000 7faf533db280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x56070379cc80 con 0x560704653800 2023-11-28T18:42:21.941 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.931+0000 7faf533db280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x56070379cdc0 con 0x560704653400 2023-11-28T18:42:21.941 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.931+0000 7faf533db280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x56070379d180 con 0x5607045d5c00 2023-11-28T18:42:21.941 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.931+0000 7faf51399640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560704653800 0x560703739600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:21.941 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.931+0000 7faf51399640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560704653800 0x560703739600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57214/0 (socket says 172.21.15.45:57214) 2023-11-28T18:42:21.941 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.931+0000 7faf51399640 1 -- 172.21.15.45:0/4239721459 learned_addr learned my addr 172.21.15.45:0/4239721459 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:21.942 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.931+0000 7faf5239b640 1 --2- 172.21.15.45:0/4239721459 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5607045d5c00 0x56070373a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:21.942 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.931+0000 7faf51b9a640 1 --2- 172.21.15.45:0/4239721459 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560704653400 0x560703739b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:21.942 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.931+0000 7faf51399640 1 -- 172.21.15.45:0/4239721459 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5607045d5c00 msgr2=0x56070373a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:21.942 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.931+0000 7faf51399640 1 --2- 172.21.15.45:0/4239721459 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5607045d5c00 0x56070373a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.942 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.931+0000 7faf51399640 1 -- 172.21.15.45:0/4239721459 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560704653400 msgr2=0x560703739b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:21.942 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.931+0000 7faf51399640 1 --2- 172.21.15.45:0/4239721459 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560704653400 0x560703739b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.942 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.931+0000 7faf51399640 1 -- 172.21.15.45:0/4239721459 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5607039e96c0 con 0x560704653800 2023-11-28T18:42:21.942 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.931+0000 7faf51399640 1 --2- 172.21.15.45:0/4239721459 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560704653800 0x560703739600 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x560703a0ac60 tx=0x5607046547e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=252ef108c4e9af65 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:21.942 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.931+0000 7faf48b88640 1 -- 172.21.15.45:0/4239721459 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56070372d080 con 0x560704653800 2023-11-28T18:42:21.942 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.931+0000 7faf48b88640 1 -- 172.21.15.45:0/4239721459 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5607044a7c80 con 0x560704653800 2023-11-28T18:42:21.942 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.931+0000 7faf533db280 1 -- 172.21.15.45:0/4239721459 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5607039e9520 con 0x560704653800 2023-11-28T18:42:21.942 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.931+0000 7faf533db280 1 -- 172.21.15.45:0/4239721459 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x5607039e9380 con 0x560704653800 2023-11-28T18:42:21.943 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.931+0000 7faf48b88640 1 -- 172.21.15.45:0/4239721459 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56070372c2c0 con 0x560704653800 2023-11-28T18:42:21.943 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.931+0000 7faf48b88640 1 -- 172.21.15.45:0/4239721459 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x56070370e8c0 con 0x560704653800 2023-11-28T18:42:21.943 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.931+0000 7faf48b88640 1 -- 172.21.15.45:0/4239721459 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 34) v1 ==== 3298+0+0 (secure 0 0 0) 0x560704528900 con 0x560704653800 2023-11-28T18:42:21.943 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.931+0000 7faf533db280 1 --2- 172.21.15.45:0/4239721459 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x560704653c00 0x560703b0c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:21.943 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.931+0000 7faf533db280 1 -- 172.21.15.45:0/4239721459 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x560703b10000 con 0x560704653c00 2023-11-28T18:42:21.943 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.931+0000 7faf5239b640 1 --2- 172.21.15.45:0/4239721459 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x560704653c00 0x560703b0c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:21.943 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.931+0000 7faf5239b640 1 --2- 172.21.15.45:0/4239721459 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x560704653c00 0x560703b0c000 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=8dbe35414e3e465f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:21.943 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.931+0000 7faf5239b640 1 -- 172.21.15.45:0/4239721459 <== osd.2 v2:172.21.15.45:6816/193884539 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x5607045d0b40 con 0x560704653c00 2023-11-28T18:42:21.943 INFO:tasks.workunit.client.0.smithi045.stdout:undump /tmp/journal.bin 2023-11-28T18:42:21.944 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.931+0000 7faf533db280 1 -- 172.21.15.45:0/4239721459 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x560703b10380 con 0x560704653c00 2023-11-28T18:42:21.945 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.935+0000 7faf5239b640 1 -- 172.21.15.45:0/4239721459 <== osd.2 v2:172.21.15.45:6816/193884539 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv11 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x5607045d0b40 con 0x560704653c00 2023-11-28T18:42:21.945 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.935+0000 7faf47385640 1 -- 172.21.15.45:0/4239721459 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:3 6.14 6:2e2fa760:::200.00000001:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e49) v8 -- 0x560703b10a80 con 0x560704653c00 2023-11-28T18:42:21.945 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.935+0000 7faf47385640 1 --2- 172.21.15.45:0/4239721459 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x560703aff000 0x560703b0e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:21.945 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.935+0000 7faf47385640 1 -- 172.21.15.45:0/4239721459 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:4 6.1b 6:ddb4e4d7:::200.00000002:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e49) v8 -- 0x560703b10e00 con 0x560703aff000 2023-11-28T18:42:21.945 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.935+0000 7faf51b9a640 1 --2- 172.21.15.45:0/4239721459 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x560703aff000 0x560703b0e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:21.945 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.935+0000 7faf5239b640 1 -- 172.21.15.45:0/4239721459 <== osd.2 v2:172.21.15.45:6816/193884539 3 ==== osd_op_reply(3 200.00000001 [stat out=16b] v0'0 uv21 ondisk = 0) v8 ==== 156+0+16 (crc 0 0 0) 0x5607045d0b40 con 0x560704653c00 2023-11-28T18:42:21.945 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.935+0000 7faf51b9a640 1 --2- 172.21.15.45:0/4239721459 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x560703aff000 0x560703b0e680 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=5a34b2aa0aaa0644 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:21.945 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.935+0000 7faf51b9a640 1 -- 172.21.15.45:0/4239721459 <== osd.3 v2:172.21.15.45:6824/78541084 1 ==== osd_op_reply(4 200.00000002 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x5607045d0d80 con 0x560703aff000 2023-11-28T18:42:21.945 INFO:tasks.workunit.client.0.smithi045.stdout:start 4194304 len 34160 write_pos 4200184 format 1 trimmed_pos 4194304 stripe_unit 4194304 stripe_count 1 object_size 4194304 2023-11-28T18:42:21.946 INFO:tasks.workunit.client.0.smithi045.stdout:writing header 200.00000000 2023-11-28T18:42:21.946 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.935+0000 7faf533db280 1 -- 172.21.15.45:0/4239721459 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:5 6.14 6:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x560703b10700 con 0x560704653c00 2023-11-28T18:42:21.946 INFO:tasks.workunit.client.0.smithi045.stdout:Purging 2 objects from 1 2023-11-28T18:42:21.947 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.935+0000 7faf5239b640 1 -- 172.21.15.45:0/4239721459 <== osd.2 v2:172.21.15.45:6816/193884539 4 ==== osd_op_reply(5 200.00000000 [writefull 0~90] v49'22 uv22 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x5607045d0b40 con 0x560704653c00 2023-11-28T18:42:21.947 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.935+0000 7faf533db280 1 -- 172.21.15.45:0/4239721459 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:6 6.14 6:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x560703b10000 con 0x560704653c00 2023-11-28T18:42:21.947 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.935+0000 7faf533db280 1 -- 172.21.15.45:0/4239721459 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:7 6.1b 6:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x560703b10380 con 0x560703aff000 2023-11-28T18:42:21.947 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.939+0000 7faf51b9a640 1 -- 172.21.15.45:0/4239721459 <== osd.3 v2:172.21.15.45:6824/78541084 2 ==== osd_op_reply(7 200.00000002 [delete] v49'2 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x5607045d0d80 con 0x560703aff000 2023-11-28T18:42:21.947 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.939+0000 7faf5239b640 1 -- 172.21.15.45:0/4239721459 <== osd.2 v2:172.21.15.45:6816/193884539 5 ==== osd_op_reply(6 200.00000001 [delete] v49'23 uv23 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x5607045d0b40 con 0x560704653c00 2023-11-28T18:42:21.947 INFO:tasks.workunit.client.0.smithi045.stdout: writing 4194304~34160 2023-11-28T18:42:21.948 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.939+0000 7faf533db280 1 -- 172.21.15.45:0/4239721459 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:8 6.14 6:2e2fa760:::200.00000001:head [write 0~34160 in=34160b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x560703b10a80 con 0x560704653c00 2023-11-28T18:42:21.948 INFO:tasks.workunit.client.0.smithi045.stdout:done. 2023-11-28T18:42:21.950 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.939+0000 7faf5239b640 1 -- 172.21.15.45:0/4239721459 <== osd.2 v2:172.21.15.45:6816/193884539 6 ==== osd_op_reply(8 200.00000001 [write 0~34160] v49'24 uv24 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x5607045d0b40 con 0x560704653c00 2023-11-28T18:42:21.950 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.939+0000 7faf533db280 1 -- 172.21.15.45:0/4239721459 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x560704653c00 msgr2=0x560703b0c000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:21.950 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.939+0000 7faf533db280 1 --2- 172.21.15.45:0/4239721459 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x560704653c00 0x560703b0c000 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.950 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.939+0000 7faf533db280 1 -- 172.21.15.45:0/4239721459 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x560703aff000 msgr2=0x560703b0e680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:21.950 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.939+0000 7faf533db280 1 --2- 172.21.15.45:0/4239721459 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x560703aff000 0x560703b0e680 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.950 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.939+0000 7faf533db280 1 -- 172.21.15.45:0/4239721459 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560704653800 msgr2=0x560703739600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:21.950 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.939+0000 7faf533db280 1 --2- 172.21.15.45:0/4239721459 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560704653800 0x560703739600 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x560703a0ac60 tx=0x5607046547e0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.951 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.939+0000 7faf51399640 1 -- 172.21.15.45:0/4239721459 reap_dead start 2023-11-28T18:42:21.951 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.939+0000 7faf533db280 1 -- 172.21.15.45:0/4239721459 shutdown_connections 2023-11-28T18:42:21.951 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.939+0000 7faf533db280 1 -- 172.21.15.45:0/4239721459 >> 172.21.15.45:0/4239721459 conn(0x5607045d5800 msgr2=0x560703ae8000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:21.951 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.939+0000 7faf533db280 1 -- 172.21.15.45:0/4239721459 shutdown_connections 2023-11-28T18:42:21.951 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.939+0000 7faf533db280 1 -- 172.21.15.45:0/4239721459 wait complete. 2023-11-28T18:42:21.951 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.939+0000 7faf533db280 1 -- 172.21.15.45:0/3211148821 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x560704653000 msgr2=0x56070373b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:21.951 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.939+0000 7faf533db280 1 --2- 172.21.15.45:0/3211148821 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x560704653000 0x56070373b700 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x5607046480c0 tx=0x56070449c1e0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.951 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.939+0000 7faf533db280 1 -- 172.21.15.45:0/3211148821 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5607045d5400 msgr2=0x56070373a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:21.951 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.939+0000 7faf533db280 1 --2- 172.21.15.45:0/3211148821 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5607045d5400 0x56070373a680 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x560704648d50 tx=0x56070449c3c0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.951 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.939+0000 7faf533db280 1 -- 172.21.15.45:0/3211148821 shutdown_connections 2023-11-28T18:42:21.951 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.939+0000 7faf533db280 1 --2- 172.21.15.45:0/3211148821 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x560704653000 0x56070373b700 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.951 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.939+0000 7faf533db280 1 --2- 172.21.15.45:0/3211148821 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5607045d5400 0x56070373a680 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.952 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.939+0000 7faf533db280 1 --2- 172.21.15.45:0/3211148821 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5607045d5000 0x56070373ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.952 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.939+0000 7faf533db280 1 --2- 172.21.15.45:0/3211148821 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5607045d4c00 0x56070373b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.952 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.939+0000 7faf533db280 1 -- 172.21.15.45:0/3211148821 >> 172.21.15.45:0/3211148821 conn(0x5607036ccc00 msgr2=0x5607036fb800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:21.952 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.939+0000 7faf533db280 1 -- 172.21.15.45:0/3211148821 shutdown_connections 2023-11-28T18:42:21.952 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.939+0000 7faf533db280 1 -- 172.21.15.45:0/3211148821 wait complete. 2023-11-28T18:42:21.952 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.943+0000 7faf533db280 1 -- 172.21.15.45:0/1485496509 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5607036cd000 msgr2=0x560703739080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:21.952 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.943+0000 7faf533db280 1 --2- 172.21.15.45:0/1485496509 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5607036cd000 0x560703739080 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x560704548cf0 tx=0x56070374f140 comp rx=0 tx=0).stop 2023-11-28T18:42:21.952 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.943+0000 7faf533db280 1 -- 172.21.15.45:0/1485496509 shutdown_connections 2023-11-28T18:42:21.952 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.943+0000 7faf533db280 1 --2- 172.21.15.45:0/1485496509 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5607036cd000 0x560703739080 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.952 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.943+0000 7faf533db280 1 --2- 172.21.15.45:0/1485496509 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5607036cd400 0x560703738b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.952 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.943+0000 7faf533db280 1 --2- 172.21.15.45:0/1485496509 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5607036cd800 0x560703738580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.952 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.943+0000 7faf533db280 1 -- 172.21.15.45:0/1485496509 >> 172.21.15.45:0/1485496509 conn(0x5607036cdc00 msgr2=0x5607036fb000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:21.953 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.943+0000 7faf533db280 1 -- 172.21.15.45:0/1485496509 shutdown_connections 2023-11-28T18:42:21.953 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.943+0000 7faf533db280 1 -- 172.21.15.45:0/1485496509 wait complete. 2023-11-28T18:42:21.953 INFO:tasks.workunit.client.0.smithi045.stderr:++ cephfs-journal-tool --rank=cephfs:0 header get 2023-11-28T18:42:21.990 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.987+0000 7f5a2c238280 1 -- start start 2023-11-28T18:42:21.990 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.987+0000 7f5a2c238280 1 Processor -- start 2023-11-28T18:42:21.992 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.987+0000 7f5a2c238280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564ca0f51800 0x564ca0fbc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:21.992 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.987+0000 7f5a2c238280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ca0f51400 0x564ca0fbcb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:21.992 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.987+0000 7f5a2c238280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564ca0f51000 0x564ca0fbd080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:21.992 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.987+0000 7f5a2c238280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ca0f97180 con 0x564ca0f51400 2023-11-28T18:42:21.992 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.987+0000 7f5a2c238280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ca1021180 con 0x564ca0f51000 2023-11-28T18:42:21.992 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.987+0000 7f5a2c238280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x564ca0f96140 con 0x564ca0f51800 2023-11-28T18:42:21.992 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.987+0000 7f5a2a1f6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ca0f51400 0x564ca0fbcb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:21.993 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.987+0000 7f5a2a1f6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ca0f51400 0x564ca0fbcb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57218/0 (socket says 172.21.15.45:57218) 2023-11-28T18:42:21.993 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.987+0000 7f5a2a1f6640 1 -- 172.21.15.45:0/3351754728 learned_addr learned my addr 172.21.15.45:0/3351754728 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:21.993 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.987+0000 7f5a2a9f7640 1 --2- 172.21.15.45:0/3351754728 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564ca0f51800 0x564ca0fbc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:21.993 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.987+0000 7f5a2b1f8640 1 --2- 172.21.15.45:0/3351754728 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564ca0f51000 0x564ca0fbd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:21.993 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.987+0000 7f5a2a1f6640 1 -- 172.21.15.45:0/3351754728 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564ca0f51800 msgr2=0x564ca0fbc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:21.993 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.987+0000 7f5a2a1f6640 1 --2- 172.21.15.45:0/3351754728 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564ca0f51800 0x564ca0fbc580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.993 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.987+0000 7f5a2a1f6640 1 -- 172.21.15.45:0/3351754728 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564ca0f51000 msgr2=0x564ca0fbd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:21.993 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.987+0000 7f5a2a1f6640 1 --2- 172.21.15.45:0/3351754728 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564ca0f51000 0x564ca0fbd080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.993 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.987+0000 7f5a2a1f6640 1 -- 172.21.15.45:0/3351754728 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564ca0f86b60 con 0x564ca0f51400 2023-11-28T18:42:21.993 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.987+0000 7f5a2a1f6640 1 --2- 172.21.15.45:0/3351754728 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ca0f51400 0x564ca0fbcb00 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x564ca1dc0cf0 tx=0x564ca1d1a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=effe29996ec55b2e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:21.993 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.987+0000 7f5a281f2640 1 -- 172.21.15.45:0/3351754728 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x564ca0fb11e0 con 0x564ca0f51400 2023-11-28T18:42:21.994 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.987+0000 7f5a281f2640 1 -- 172.21.15.45:0/3351754728 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564ca1d1c000 con 0x564ca0f51400 2023-11-28T18:42:21.994 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.987+0000 7f5a281f2640 1 -- 172.21.15.45:0/3351754728 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x564ca0fb1080 con 0x564ca0f51400 2023-11-28T18:42:21.994 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.987+0000 7f5a2c238280 1 -- 172.21.15.45:0/3351754728 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564ca0f861a0 con 0x564ca0f51400 2023-11-28T18:42:21.994 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.987+0000 7f5a2c238280 1 -- 172.21.15.45:0/3351754728 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x564ca0f86b60 con 0x564ca0f51400 2023-11-28T18:42:21.994 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.987+0000 7f5a281f2640 1 -- 172.21.15.45:0/3351754728 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x564ca0f92c40 con 0x564ca0f51400 2023-11-28T18:42:21.994 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.987+0000 7f5a281f2640 1 -- 172.21.15.45:0/3351754728 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 34) v1 ==== 3298+0+0 (secure 0 0 0) 0x564ca0f9ef00 con 0x564ca0f51400 2023-11-28T18:42:21.996 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.987+0000 7f5a2c238280 1 Processor -- start 2023-11-28T18:42:21.996 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.991+0000 7f5a2c238280 1 -- start start 2023-11-28T18:42:21.997 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.991+0000 7f5a2c238280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ca1d21800 0x564ca0fbd600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:21.997 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.991+0000 7f5a2c238280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564ca1d21c00 0x564ca0fbdb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:21.997 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.991+0000 7f5a2c238280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564ca1eba000 0x564ca0fbe100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:21.997 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.991+0000 7f5a2c238280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ca0f96a00 con 0x564ca1d21800 2023-11-28T18:42:21.997 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.991+0000 7f5a2c238280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ca0f96b40 con 0x564ca1d21c00 2023-11-28T18:42:21.997 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.991+0000 7f5a2c238280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x564ca1020dc0 con 0x564ca1eba000 2023-11-28T18:42:21.997 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.991+0000 7f5a2b1f8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ca1d21800 0x564ca0fbd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:21.997 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.991+0000 7f5a2b1f8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ca1d21800 0x564ca0fbd600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57232/0 (socket says 172.21.15.45:57232) 2023-11-28T18:42:21.997 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.991+0000 7f5a2b1f8640 1 -- 172.21.15.45:0/266982431 learned_addr learned my addr 172.21.15.45:0/266982431 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:21.997 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.991+0000 7f5a2a9f7640 1 --2- 172.21.15.45:0/266982431 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564ca1d21c00 0x564ca0fbdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:21.998 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.991+0000 7f5a2a1f6640 1 --2- 172.21.15.45:0/266982431 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564ca1eba000 0x564ca0fbe100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:21.998 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.991+0000 7f5a2b1f8640 1 -- 172.21.15.45:0/266982431 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564ca1eba000 msgr2=0x564ca0fbe100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:21.998 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.991+0000 7f5a2b1f8640 1 --2- 172.21.15.45:0/266982431 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564ca1eba000 0x564ca0fbe100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.998 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.991+0000 7f5a2b1f8640 1 -- 172.21.15.45:0/266982431 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564ca1d21c00 msgr2=0x564ca0fbdb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:21.998 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.991+0000 7f5a2b1f8640 1 --2- 172.21.15.45:0/266982431 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564ca1d21c00 0x564ca0fbdb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.998 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.991+0000 7f5a2b1f8640 1 -- 172.21.15.45:0/266982431 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564ca0f86340 con 0x564ca1d21800 2023-11-28T18:42:21.998 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.991+0000 7f5a2a1f6640 1 --2- 172.21.15.45:0/266982431 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564ca1eba000 0x564ca0fbe100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:42:21.998 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.991+0000 7f5a2b1f8640 1 --2- 172.21.15.45:0/266982431 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ca1d21800 0x564ca0fbd600 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x564ca1ec00f0 tx=0x564ca1ec6000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6beffa6700ad1dc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:21.998 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.991+0000 7f5a261ee640 1 -- 172.21.15.45:0/266982431 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x564ca0fb11e0 con 0x564ca1d21800 2023-11-28T18:42:21.998 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.991+0000 7f5a261ee640 1 -- 172.21.15.45:0/266982431 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564ca1d1cf00 con 0x564ca1d21800 2023-11-28T18:42:21.998 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.991+0000 7f5a261ee640 1 -- 172.21.15.45:0/266982431 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x564ca0fb1080 con 0x564ca1d21800 2023-11-28T18:42:21.998 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.991+0000 7f5a2c238280 1 -- 172.21.15.45:0/266982431 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ca1d21800 msgr2=0x564ca0fbd600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:21.999 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.991+0000 7f5a2c238280 1 --2- 172.21.15.45:0/266982431 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ca1d21800 0x564ca0fbd600 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x564ca1ec00f0 tx=0x564ca1ec6000 comp rx=0 tx=0).stop 2023-11-28T18:42:21.999 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.991+0000 7f5a2c238280 1 -- 172.21.15.45:0/266982431 shutdown_connections 2023-11-28T18:42:21.999 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.991+0000 7f5a2c238280 1 --2- 172.21.15.45:0/266982431 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564ca1eba000 0x564ca0fbe100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.999 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.991+0000 7f5a2c238280 1 --2- 172.21.15.45:0/266982431 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564ca1d21c00 0x564ca0fbdb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.999 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.991+0000 7f5a2c238280 1 --2- 172.21.15.45:0/266982431 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ca1d21800 0x564ca0fbd600 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:21.999 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.991+0000 7f5a2c238280 1 -- 172.21.15.45:0/266982431 >> 172.21.15.45:0/266982431 conn(0x564ca0f50c00 msgr2=0x564ca0f7d000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:21.999 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.991+0000 7f5a2c238280 1 -- 172.21.15.45:0/266982431 shutdown_connections 2023-11-28T18:42:21.999 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.991+0000 7f5a2c238280 1 -- 172.21.15.45:0/266982431 wait complete. 2023-11-28T18:42:21.999 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.991+0000 7f5a2c238280 1 Processor -- start 2023-11-28T18:42:21.999 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.991+0000 7f5a2c238280 1 -- start start 2023-11-28T18:42:22.003 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.995+0000 7f5a2c238280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564ca1d21c00 0x564ca0fbf180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.003 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.995+0000 7f5a2c238280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564ca1d21800 0x564ca0fbec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.003 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.995+0000 7f5a2c238280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ca1ebb800 0x564ca0fbe680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.003 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.995+0000 7f5a2c238280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ca1020c80 con 0x564ca1ebb800 2023-11-28T18:42:22.004 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.995+0000 7f5a2c238280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ca1020b40 con 0x564ca1d21800 2023-11-28T18:42:22.004 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.995+0000 7f5a2c238280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x564ca1020a00 con 0x564ca1d21c00 2023-11-28T18:42:22.004 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.995+0000 7f5a2a1f6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ca1ebb800 0x564ca0fbe680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.004 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.995+0000 7f5a2a1f6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ca1ebb800 0x564ca0fbe680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57240/0 (socket says 172.21.15.45:57240) 2023-11-28T18:42:22.004 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.995+0000 7f5a2a1f6640 1 -- 172.21.15.45:0/2711276059 learned_addr learned my addr 172.21.15.45:0/2711276059 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:22.004 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.995+0000 7f5a2a9f7640 1 --2- 172.21.15.45:0/2711276059 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564ca1d21800 0x564ca0fbec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.004 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.995+0000 7f5a2b1f8640 1 --2- 172.21.15.45:0/2711276059 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564ca1d21c00 0x564ca0fbf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.004 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.995+0000 7f5a2a1f6640 1 -- 172.21.15.45:0/2711276059 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564ca1d21c00 msgr2=0x564ca0fbf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.004 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.995+0000 7f5a2a1f6640 1 --2- 172.21.15.45:0/2711276059 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564ca1d21c00 0x564ca0fbf180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.004 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.995+0000 7f5a2a1f6640 1 -- 172.21.15.45:0/2711276059 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564ca1d21800 msgr2=0x564ca0fbec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.004 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.995+0000 7f5a2a1f6640 1 --2- 172.21.15.45:0/2711276059 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564ca1d21800 0x564ca0fbec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.005 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.995+0000 7f5a2a1f6640 1 -- 172.21.15.45:0/2711276059 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564ca0f86000 con 0x564ca1ebb800 2023-11-28T18:42:22.005 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.995+0000 7f5a2a1f6640 1 --2- 172.21.15.45:0/2711276059 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ca1ebb800 0x564ca0fbe680 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x564ca1dc1170 tx=0x564ca1d1a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.005 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.995+0000 7f5a249eb640 1 -- 172.21.15.45:0/2711276059 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x564ca0fb11e0 con 0x564ca1ebb800 2023-11-28T18:42:22.005 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.995+0000 7f5a249eb640 1 -- 172.21.15.45:0/2711276059 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564ca1d1cc00 con 0x564ca1ebb800 2023-11-28T18:42:22.005 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.995+0000 7f5a249eb640 1 -- 172.21.15.45:0/2711276059 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x564ca0fb1080 con 0x564ca1ebb800 2023-11-28T18:42:22.005 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.995+0000 7f5a2c238280 1 -- 172.21.15.45:0/2711276059 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564ca0f86ea0 con 0x564ca1ebb800 2023-11-28T18:42:22.005 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.995+0000 7f5a2c238280 1 -- 172.21.15.45:0/2711276059 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564ca0f861a0 con 0x564ca1ebb800 2023-11-28T18:42:22.005 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.995+0000 7f5a249eb640 1 -- 172.21.15.45:0/2711276059 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x564ca0fdf080 con 0x564ca1ebb800 2023-11-28T18:42:22.005 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.995+0000 7f5a249eb640 1 --2- 172.21.15.45:0/2711276059 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x564ca1ec9c00 0x564ca0fbf700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.005 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.995+0000 7f5a249eb640 1 -- 172.21.15.45:0/2711276059 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x564ca0f92a80 con 0x564ca1ebb800 2023-11-28T18:42:22.005 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.995+0000 7f5a2c238280 1 --2- 172.21.15.45:0/2711276059 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x564ca1ebb400 0x564ca0fbe100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.006 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.995+0000 7f5a2c238280 1 -- 172.21.15.45:0/2711276059 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x564ca0fa7880 con 0x564ca1ebb400 2023-11-28T18:42:22.006 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.995+0000 7f5a2b1f8640 1 --2- 172.21.15.45:0/2711276059 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x564ca1ec9c00 0x564ca0fbf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.006 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.995+0000 7f5a2a9f7640 1 --2- 172.21.15.45:0/2711276059 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x564ca1ebb400 0x564ca0fbe100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.006 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.999+0000 7f5a2a9f7640 1 --2- 172.21.15.45:0/2711276059 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x564ca1ebb400 0x564ca0fbe100 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.006 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.999+0000 7f5a2b1f8640 1 --2- 172.21.15.45:0/2711276059 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x564ca1ec9c00 0x564ca0fbf700 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x564ca1ec00f0 tx=0x564ca1cced80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.006 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.999+0000 7f5a2a9f7640 1 -- 172.21.15.45:0/2711276059 <== osd.2 v2:172.21.15.45:6816/193884539 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x564ca1e4eb40 con 0x564ca1ebb400 2023-11-28T18:42:22.006 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.999+0000 7f5a2c238280 1 -- 172.21.15.45:0/2711276059 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x564ca0fa7c00 con 0x564ca1ebb400 2023-11-28T18:42:22.006 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.999+0000 7f5a2a9f7640 1 -- 172.21.15.45:0/2711276059 <== osd.2 v2:172.21.15.45:6816/193884539 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv22 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x564ca1e4eb40 con 0x564ca1ebb400 2023-11-28T18:42:22.006 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.999+0000 7f5a2c238280 1 -- 172.21.15.45:0/2711276059 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x564ca1ebb400 msgr2=0x564ca0fbe100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.006 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.999+0000 7f5a2c238280 1 --2- 172.21.15.45:0/2711276059 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x564ca1ebb400 0x564ca0fbe100 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.006 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.999+0000 7f5a2c238280 1 -- 172.21.15.45:0/2711276059 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x564ca1ec9c00 msgr2=0x564ca0fbf700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.007 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.999+0000 7f5a2c238280 1 --2- 172.21.15.45:0/2711276059 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x564ca1ec9c00 0x564ca0fbf700 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x564ca1ec00f0 tx=0x564ca1cced80 comp rx=0 tx=0).stop 2023-11-28T18:42:22.007 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.999+0000 7f5a2c238280 1 -- 172.21.15.45:0/2711276059 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ca1ebb800 msgr2=0x564ca0fbe680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.007 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.999+0000 7f5a2c238280 1 --2- 172.21.15.45:0/2711276059 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ca1ebb800 0x564ca0fbe680 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x564ca1dc1170 tx=0x564ca1d1a300 comp rx=0 tx=0).stop 2023-11-28T18:42:22.007 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.999+0000 7f5a2a9f7640 1 -- 172.21.15.45:0/2711276059 reap_dead start 2023-11-28T18:42:22.007 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.999+0000 7f5a2c238280 1 -- 172.21.15.45:0/2711276059 shutdown_connections 2023-11-28T18:42:22.007 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.999+0000 7f5a2c238280 1 -- 172.21.15.45:0/2711276059 >> 172.21.15.45:0/2711276059 conn(0x564ca0f50c00 msgr2=0x564ca0f7d000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:22.007 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.999+0000 7f5a2c238280 1 -- 172.21.15.45:0/2711276059 shutdown_connections 2023-11-28T18:42:22.007 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.999+0000 7f5a2c238280 1 -- 172.21.15.45:0/2711276059 wait complete. 2023-11-28T18:42:22.007 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.999+0000 7f5a2c238280 1 -- 172.21.15.45:0/3351754728 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ca0f51400 msgr2=0x564ca0fbcb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.007 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.999+0000 7f5a2c238280 1 --2- 172.21.15.45:0/3351754728 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ca0f51400 0x564ca0fbcb00 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x564ca1dc0cf0 tx=0x564ca1d1a000 comp rx=0 tx=0).stop 2023-11-28T18:42:22.007 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.999+0000 7f5a2c238280 1 -- 172.21.15.45:0/3351754728 shutdown_connections 2023-11-28T18:42:22.007 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.999+0000 7f5a2c238280 1 --2- 172.21.15.45:0/3351754728 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564ca0f51000 0x564ca0fbd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.008 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.999+0000 7f5a2c238280 1 --2- 172.21.15.45:0/3351754728 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ca0f51400 0x564ca0fbcb00 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.008 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.999+0000 7f5a2c238280 1 --2- 172.21.15.45:0/3351754728 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564ca0f51800 0x564ca0fbc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.008 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.999+0000 7f5a2c238280 1 -- 172.21.15.45:0/3351754728 >> 172.21.15.45:0/3351754728 conn(0x564ca0f51c00 msgr2=0x564ca0f7d800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:22.008 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.999+0000 7f5a2c238280 1 -- 172.21.15.45:0/3351754728 shutdown_connections 2023-11-28T18:42:22.008 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:21.999+0000 7f5a2c238280 1 -- 172.21.15.45:0/3351754728 wait complete. 2023-11-28T18:42:22.008 INFO:tasks.workunit.client.0.smithi045.stderr:+ NEW_HEADER_STATE='{ 2023-11-28T18:42:22.009 INFO:tasks.workunit.client.0.smithi045.stderr: "magic": "ceph fs volume v011", 2023-11-28T18:42:22.009 INFO:tasks.workunit.client.0.smithi045.stderr: "write_pos": 4200184, 2023-11-28T18:42:22.009 INFO:tasks.workunit.client.0.smithi045.stderr: "expire_pos": 4194304, 2023-11-28T18:42:22.009 INFO:tasks.workunit.client.0.smithi045.stderr: "trimmed_pos": 4194304, 2023-11-28T18:42:22.009 INFO:tasks.workunit.client.0.smithi045.stderr: "stream_format": 1, 2023-11-28T18:42:22.009 INFO:tasks.workunit.client.0.smithi045.stderr: "layout": { 2023-11-28T18:42:22.009 INFO:tasks.workunit.client.0.smithi045.stderr: "stripe_unit": 4194304, 2023-11-28T18:42:22.009 INFO:tasks.workunit.client.0.smithi045.stderr: "stripe_count": 1, 2023-11-28T18:42:22.009 INFO:tasks.workunit.client.0.smithi045.stderr: "object_size": 4194304, 2023-11-28T18:42:22.009 INFO:tasks.workunit.client.0.smithi045.stderr: "pool_id": 6, 2023-11-28T18:42:22.009 INFO:tasks.workunit.client.0.smithi045.stderr: "pool_ns": "" 2023-11-28T18:42:22.010 INFO:tasks.workunit.client.0.smithi045.stderr: } 2023-11-28T18:42:22.010 INFO:tasks.workunit.client.0.smithi045.stderr:}' 2023-11-28T18:42:22.010 INFO:tasks.workunit.client.0.smithi045.stderr:++ cephfs-journal-tool --rank=cephfs:0 event get list 2023-11-28T18:42:22.048 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.043+0000 7fbf2902d280 1 -- start start 2023-11-28T18:42:22.048 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.043+0000 7fbf2902d280 1 Processor -- start 2023-11-28T18:42:22.050 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.043+0000 7fbf2902d280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5614e23ab800 0x5614e2416580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.050 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.043+0000 7fbf2902d280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5614e23ab400 0x5614e2416b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.050 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.043+0000 7fbf2902d280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5614e23ab000 0x5614e2417080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.050 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.043+0000 7fbf2902d280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614e23f1180 con 0x5614e23ab000 2023-11-28T18:42:22.050 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.043+0000 7fbf2902d280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614e23f0140 con 0x5614e23ab400 2023-11-28T18:42:22.050 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.043+0000 7fbf2902d280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x5614e23f0000 con 0x5614e23ab800 2023-11-28T18:42:22.050 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.043+0000 7fbf27fed640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5614e23ab000 0x5614e2417080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.050 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.043+0000 7fbf27fed640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5614e23ab000 0x5614e2417080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57256/0 (socket says 172.21.15.45:57256) 2023-11-28T18:42:22.051 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.043+0000 7fbf27fed640 1 -- 172.21.15.45:0/1494907034 learned_addr learned my addr 172.21.15.45:0/1494907034 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:22.051 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.043+0000 7fbf26feb640 1 --2- 172.21.15.45:0/1494907034 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5614e23ab400 0x5614e2416b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.051 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.043+0000 7fbf277ec640 1 --2- 172.21.15.45:0/1494907034 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5614e23ab800 0x5614e2416580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.051 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.047+0000 7fbf27fed640 1 -- 172.21.15.45:0/1494907034 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5614e23ab800 msgr2=0x5614e2416580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:22.051 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.047+0000 7fbf27fed640 1 --2- 172.21.15.45:0/1494907034 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5614e23ab800 0x5614e2416580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.051 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.047+0000 7fbf27fed640 1 -- 172.21.15.45:0/1494907034 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5614e23ab400 msgr2=0x5614e2416b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:22.051 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.047+0000 7fbf27fed640 1 --2- 172.21.15.45:0/1494907034 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5614e23ab400 0x5614e2416b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.051 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.047+0000 7fbf27fed640 1 -- 172.21.15.45:0/1494907034 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5614e23e09c0 con 0x5614e23ab000 2023-11-28T18:42:22.051 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.047+0000 7fbf277ec640 1 --2- 172.21.15.45:0/1494907034 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5614e23ab800 0x5614e2416580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:42:22.051 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.047+0000 7fbf27fed640 1 --2- 172.21.15.45:0/1494907034 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5614e23ab000 0x5614e2417080 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x5614e3220cc0 tx=0x5614e3133320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=febe15c26818a929 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.051 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.047+0000 7fbf24fe7640 1 -- 172.21.15.45:0/1494907034 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5614e240b1e0 con 0x5614e23ab000 2023-11-28T18:42:22.052 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.047+0000 7fbf24fe7640 1 -- 172.21.15.45:0/1494907034 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5614e2406900 con 0x5614e23ab000 2023-11-28T18:42:22.052 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.047+0000 7fbf24fe7640 1 -- 172.21.15.45:0/1494907034 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5614e240b080 con 0x5614e23ab000 2023-11-28T18:42:22.052 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.047+0000 7fbf2902d280 1 -- 172.21.15.45:0/1494907034 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5614e23e0b60 con 0x5614e23ab000 2023-11-28T18:42:22.052 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.047+0000 7fbf2902d280 1 -- 172.21.15.45:0/1494907034 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x5614e23e0340 con 0x5614e23ab000 2023-11-28T18:42:22.052 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.047+0000 7fbf24fe7640 1 -- 172.21.15.45:0/1494907034 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x5614e23ecc40 con 0x5614e23ab000 2023-11-28T18:42:22.052 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.047+0000 7fbf24fe7640 1 -- 172.21.15.45:0/1494907034 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 34) v1 ==== 3298+0+0 (secure 0 0 0) 0x5614e23f8f00 con 0x5614e23ab000 2023-11-28T18:42:22.057 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.047+0000 7fbf2902d280 1 Processor -- start 2023-11-28T18:42:22.057 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.047+0000 7fbf2902d280 1 -- start start 2023-11-28T18:42:22.057 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.047+0000 7fbf2902d280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5614e32c4c00 0x5614e2417600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.057 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.047+0000 7fbf2902d280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5614e32c5000 0x5614e2417b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.057 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.047+0000 7fbf2902d280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5614e32c5400 0x5614e2418100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.057 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.047+0000 7fbf2902d280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614e23f0a00 con 0x5614e32c5000 2023-11-28T18:42:22.058 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.047+0000 7fbf2902d280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614e247b180 con 0x5614e32c4c00 2023-11-28T18:42:22.058 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.047+0000 7fbf2902d280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x5614e247adc0 con 0x5614e32c5400 2023-11-28T18:42:22.058 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.047+0000 7fbf277ec640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5614e32c5000 0x5614e2417b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.058 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.047+0000 7fbf277ec640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5614e32c5000 0x5614e2417b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57268/0 (socket says 172.21.15.45:57268) 2023-11-28T18:42:22.058 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.047+0000 7fbf277ec640 1 -- 172.21.15.45:0/201644448 learned_addr learned my addr 172.21.15.45:0/201644448 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:22.058 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.047+0000 7fbf26feb640 1 --2- 172.21.15.45:0/201644448 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5614e32c5400 0x5614e2418100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.058 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.047+0000 7fbf26feb640 1 --2- 172.21.15.45:0/201644448 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5614e32c4c00 0x5614e2417600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.058 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.047+0000 7fbf277ec640 1 -- 172.21.15.45:0/201644448 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5614e32c5400 msgr2=0x5614e2418100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:22.059 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.047+0000 7fbf277ec640 1 --2- 172.21.15.45:0/201644448 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5614e32c5400 0x5614e2418100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.059 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.047+0000 7fbf277ec640 1 -- 172.21.15.45:0/201644448 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5614e32c4c00 msgr2=0x5614e2417600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:22.059 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.047+0000 7fbf277ec640 1 --2- 172.21.15.45:0/201644448 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5614e32c4c00 0x5614e2417600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.059 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.047+0000 7fbf277ec640 1 -- 172.21.15.45:0/201644448 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5614e23e0000 con 0x5614e32c5000 2023-11-28T18:42:22.059 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.047+0000 7fbf26feb640 1 --2- 172.21.15.45:0/201644448 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5614e32c4c00 0x5614e2417600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:42:22.059 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.047+0000 7fbf277ec640 1 --2- 172.21.15.45:0/201644448 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5614e32c5000 0x5614e2417b80 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x5614e33200f0 tx=0x5614e3330000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e585f5f3e5b39f3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.059 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.047+0000 7fbf22fe3640 1 -- 172.21.15.45:0/201644448 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5614e240b1e0 con 0x5614e32c5000 2023-11-28T18:42:22.059 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.047+0000 7fbf22fe3640 1 -- 172.21.15.45:0/201644448 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5614e3183080 con 0x5614e32c5000 2023-11-28T18:42:22.059 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.047+0000 7fbf22fe3640 1 -- 172.21.15.45:0/201644448 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5614e240b080 con 0x5614e32c5000 2023-11-28T18:42:22.059 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.051+0000 7fbf2902d280 1 -- 172.21.15.45:0/201644448 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5614e32c5000 msgr2=0x5614e2417b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.059 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.051+0000 7fbf2902d280 1 --2- 172.21.15.45:0/201644448 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5614e32c5000 0x5614e2417b80 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x5614e33200f0 tx=0x5614e3330000 comp rx=0 tx=0).stop 2023-11-28T18:42:22.059 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.051+0000 7fbf2902d280 1 -- 172.21.15.45:0/201644448 shutdown_connections 2023-11-28T18:42:22.060 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.051+0000 7fbf2902d280 1 --2- 172.21.15.45:0/201644448 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5614e32c5400 0x5614e2418100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.060 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.051+0000 7fbf2902d280 1 --2- 172.21.15.45:0/201644448 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5614e32c5000 0x5614e2417b80 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.060 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.051+0000 7fbf2902d280 1 --2- 172.21.15.45:0/201644448 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5614e32c4c00 0x5614e2417600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.060 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.051+0000 7fbf2902d280 1 -- 172.21.15.45:0/201644448 >> 172.21.15.45:0/201644448 conn(0x5614e23aac00 msgr2=0x5614e23d9800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:22.060 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.051+0000 7fbf2902d280 1 -- 172.21.15.45:0/201644448 shutdown_connections 2023-11-28T18:42:22.060 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.051+0000 7fbf2902d280 1 -- 172.21.15.45:0/201644448 wait complete. 2023-11-28T18:42:22.060 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.051+0000 7fbf2902d280 1 Processor -- start 2023-11-28T18:42:22.060 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.051+0000 7fbf2902d280 1 -- start start 2023-11-28T18:42:22.060 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.051+0000 7fbf2902d280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5614e32c4c00 0x5614e2419180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.060 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.051+0000 7fbf2902d280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5614e32c5000 0x5614e2418c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.060 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.051+0000 7fbf2902d280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5614e32c5400 0x5614e2418680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.060 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.051+0000 7fbf2902d280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614e247ac80 con 0x5614e32c4c00 2023-11-28T18:42:22.061 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.051+0000 7fbf2902d280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614e23f0140 con 0x5614e32c5400 2023-11-28T18:42:22.061 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.051+0000 7fbf2902d280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x5614e23f0b40 con 0x5614e32c5000 2023-11-28T18:42:22.061 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.051+0000 7fbf26feb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5614e32c4c00 0x5614e2419180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.061 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.051+0000 7fbf26feb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5614e32c4c00 0x5614e2419180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57280/0 (socket says 172.21.15.45:57280) 2023-11-28T18:42:22.061 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.051+0000 7fbf26feb640 1 -- 172.21.15.45:0/2886807095 learned_addr learned my addr 172.21.15.45:0/2886807095 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:22.061 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.051+0000 7fbf277ec640 1 --2- 172.21.15.45:0/2886807095 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5614e32c5000 0x5614e2418c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.061 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.051+0000 7fbf26feb640 1 --2- 172.21.15.45:0/2886807095 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5614e32c5400 0x5614e2418680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.061 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.051+0000 7fbf26feb640 1 -- 172.21.15.45:0/2886807095 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5614e32c5000 msgr2=0x5614e2418c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.061 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.051+0000 7fbf26feb640 1 --2- 172.21.15.45:0/2886807095 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5614e32c5000 0x5614e2418c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.061 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.051+0000 7fbf26feb640 1 -- 172.21.15.45:0/2886807095 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5614e32c5400 msgr2=0x5614e2418680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.061 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.051+0000 7fbf26feb640 1 --2- 172.21.15.45:0/2886807095 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5614e32c5400 0x5614e2418680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.062 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.051+0000 7fbf26feb640 1 -- 172.21.15.45:0/2886807095 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5614e23e09c0 con 0x5614e32c4c00 2023-11-28T18:42:22.062 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.051+0000 7fbf26feb640 1 --2- 172.21.15.45:0/2886807095 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5614e32c4c00 0x5614e2419180 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x5614e3320d20 tx=0x5614e3170300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.062 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.051+0000 7fbf217e0640 1 -- 172.21.15.45:0/2886807095 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5614e240af20 con 0x5614e32c4c00 2023-11-28T18:42:22.062 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.051+0000 7fbf217e0640 1 -- 172.21.15.45:0/2886807095 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5614e3182300 con 0x5614e32c4c00 2023-11-28T18:42:22.062 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.051+0000 7fbf2902d280 1 -- 172.21.15.45:0/2886807095 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5614e23e0b60 con 0x5614e32c4c00 2023-11-28T18:42:22.062 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.051+0000 7fbf217e0640 1 -- 172.21.15.45:0/2886807095 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5614e240b1e0 con 0x5614e32c4c00 2023-11-28T18:42:22.062 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.051+0000 7fbf2902d280 1 -- 172.21.15.45:0/2886807095 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5614e23e0ea0 con 0x5614e32c4c00 2023-11-28T18:42:22.065 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.055+0000 7fbf217e0640 1 -- 172.21.15.45:0/2886807095 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x5614e2439080 con 0x5614e32c4c00 2023-11-28T18:42:22.065 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.055+0000 7fbf217e0640 1 --2- 172.21.15.45:0/2886807095 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x5614e332f000 0x5614e2419700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.065 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.055+0000 7fbf217e0640 1 -- 172.21.15.45:0/2886807095 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x5614e23eca80 con 0x5614e32c4c00 2023-11-28T18:42:22.066 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.055+0000 7fbf2902d280 1 --2- 172.21.15.45:0/2886807095 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x5614e32c5800 0x5614e2418100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.066 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.055+0000 7fbf2902d280 1 -- 172.21.15.45:0/2886807095 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x5614e2401880 con 0x5614e32c5800 2023-11-28T18:42:22.066 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.055+0000 7fbf277ec640 1 --2- 172.21.15.45:0/2886807095 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x5614e332f000 0x5614e2419700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.066 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.055+0000 7fbf26feb640 1 --2- 172.21.15.45:0/2886807095 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x5614e32c5800 0x5614e2418100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.066 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.055+0000 7fbf26feb640 1 --2- 172.21.15.45:0/2886807095 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x5614e32c5800 0x5614e2418100 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.066 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.055+0000 7fbf277ec640 1 --2- 172.21.15.45:0/2886807095 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x5614e332f000 0x5614e2419700 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x5614e33200f0 tx=0x5614e3128d20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.066 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.055+0000 7fbf26feb640 1 -- 172.21.15.45:0/2886807095 <== osd.2 v2:172.21.15.45:6816/193884539 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x5614e32acb40 con 0x5614e32c5800 2023-11-28T18:42:22.066 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.055+0000 7fbf2902d280 1 -- 172.21.15.45:0/2886807095 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x5614e2401c00 con 0x5614e32c5800 2023-11-28T18:42:22.066 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.055+0000 7fbf26feb640 1 -- 172.21.15.45:0/2886807095 <== osd.2 v2:172.21.15.45:6816/193884539 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv22 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x5614e32acb40 con 0x5614e32c5800 2023-11-28T18:42:22.066 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.055+0000 7fbf2902d280 1 -- 172.21.15.45:0/2886807095 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:3 6.14 6:2e2fa760:::200.00000001:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x5614e2401880 con 0x5614e32c5800 2023-11-28T18:42:22.066 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.055+0000 7fbf26feb640 1 -- 172.21.15.45:0/2886807095 <== osd.2 v2:172.21.15.45:6816/193884539 3 ==== osd_op_reply(3 200.00000001 [read 0~34160 out=34160b] v0'0 uv24 ondisk = 0) v8 ==== 156+0+34160 (crc 0 0 0) 0x5614e32acb40 con 0x5614e32c5800 2023-11-28T18:42:22.067 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.055+0000 7fbf2902d280 1 --2- 172.21.15.45:0/2886807095 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x5614e32c5c00 0x5614e2417b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.067 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.055+0000 7fbf2902d280 1 -- 172.21.15.45:0/2886807095 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:4 6.1b 6:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x5614e2401c00 con 0x5614e32c5c00 2023-11-28T18:42:22.067 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.059+0000 7fbf27fed640 1 --2- 172.21.15.45:0/2886807095 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x5614e32c5c00 0x5614e2417b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.067 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.059+0000 7fbf27fed640 1 --2- 172.21.15.45:0/2886807095 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x5614e32c5c00 0x5614e2417b80 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.067 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.059+0000 7fbf27fed640 1 -- 172.21.15.45:0/2886807095 <== osd.3 v2:172.21.15.45:6824/78541084 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x5614e32acd80 con 0x5614e32c5c00 2023-11-28T18:42:22.067 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.059+0000 7fbf2902d280 1 -- 172.21.15.45:0/2886807095 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x5614e32c5800 msgr2=0x5614e2418100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.067 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.059+0000 7fbf2902d280 1 --2- 172.21.15.45:0/2886807095 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x5614e32c5800 0x5614e2418100 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.067 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.059+0000 7fbf2902d280 1 -- 172.21.15.45:0/2886807095 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x5614e32c5c00 msgr2=0x5614e2417b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.067 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.059+0000 7fbf2902d280 1 --2- 172.21.15.45:0/2886807095 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x5614e32c5c00 0x5614e2417b80 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.067 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.059+0000 7fbf2902d280 1 -- 172.21.15.45:0/2886807095 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x5614e332f000 msgr2=0x5614e2419700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.067 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.059+0000 7fbf2902d280 1 --2- 172.21.15.45:0/2886807095 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x5614e332f000 0x5614e2419700 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x5614e33200f0 tx=0x5614e3128d20 comp rx=0 tx=0).stop 2023-11-28T18:42:22.067 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.059+0000 7fbf2902d280 1 -- 172.21.15.45:0/2886807095 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5614e32c4c00 msgr2=0x5614e2419180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.068 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.059+0000 7fbf2902d280 1 --2- 172.21.15.45:0/2886807095 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5614e32c4c00 0x5614e2419180 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x5614e3320d20 tx=0x5614e3170300 comp rx=0 tx=0).stop 2023-11-28T18:42:22.068 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.059+0000 7fbf277ec640 1 -- 172.21.15.45:0/2886807095 reap_dead start 2023-11-28T18:42:22.068 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.059+0000 7fbf277ec640 1 -- 172.21.15.45:0/2886807095 reap_dead start 2023-11-28T18:42:22.068 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.059+0000 7fbf2902d280 1 -- 172.21.15.45:0/2886807095 shutdown_connections 2023-11-28T18:42:22.068 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.059+0000 7fbf2902d280 1 -- 172.21.15.45:0/2886807095 >> 172.21.15.45:0/2886807095 conn(0x5614e23aac00 msgr2=0x5614e23d9800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:22.068 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.059+0000 7fbf2902d280 1 -- 172.21.15.45:0/2886807095 shutdown_connections 2023-11-28T18:42:22.068 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.059+0000 7fbf2902d280 1 -- 172.21.15.45:0/2886807095 wait complete. 2023-11-28T18:42:22.068 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.059+0000 7fbf2902d280 1 -- 172.21.15.45:0/1494907034 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5614e23ab000 msgr2=0x5614e2417080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.068 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.059+0000 7fbf2902d280 1 --2- 172.21.15.45:0/1494907034 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5614e23ab000 0x5614e2417080 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x5614e3220cc0 tx=0x5614e3133320 comp rx=0 tx=0).stop 2023-11-28T18:42:22.068 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.059+0000 7fbf2902d280 1 -- 172.21.15.45:0/1494907034 shutdown_connections 2023-11-28T18:42:22.068 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.059+0000 7fbf2902d280 1 --2- 172.21.15.45:0/1494907034 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5614e23ab000 0x5614e2417080 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.068 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.059+0000 7fbf2902d280 1 --2- 172.21.15.45:0/1494907034 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5614e23ab400 0x5614e2416b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.069 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.059+0000 7fbf2902d280 1 --2- 172.21.15.45:0/1494907034 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5614e23ab800 0x5614e2416580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.069 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.059+0000 7fbf2902d280 1 -- 172.21.15.45:0/1494907034 >> 172.21.15.45:0/1494907034 conn(0x5614e23abc00 msgr2=0x5614e23d9000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:22.069 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.059+0000 7fbf2902d280 1 -- 172.21.15.45:0/1494907034 shutdown_connections 2023-11-28T18:42:22.069 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.059+0000 7fbf2902d280 1 -- 172.21.15.45:0/1494907034 wait complete. 2023-11-28T18:42:22.069 INFO:tasks.workunit.client.0.smithi045.stderr:+ NEW_EVENT_LIST='0.000000 0x400000 LID: () 2023-11-28T18:42:22.070 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:39:37.048149+0000 0x400030 SUBTREEMAP: () 2023-11-28T18:42:22.070 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:39:44.085815+0000 0x4003ac SESSION: () 2023-11-28T18:42:22.070 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:39:44.501575+0000 0x400564 UPDATE: (setattr) 2023-11-28T18:42:22.070 INFO:tasks.workunit.client.0.smithi045.stderr: / 2023-11-28T18:42:22.070 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:39:44.620894+0000 0x400893 UPDATE: (mkdir) 2023-11-28T18:42:22.070 INFO:tasks.workunit.client.0.smithi045.stderr: client.0 2023-11-28T18:42:22.070 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:39:50.086407+0000 0x401073 UPDATE: (cap update) 2023-11-28T18:42:22.070 INFO:tasks.workunit.client.0.smithi045.stderr: client.0 2023-11-28T18:42:22.070 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:40:58.348779+0000 0x4016f8 UPDATE: (mkdir) 2023-11-28T18:42:22.070 INFO:tasks.workunit.client.0.smithi045.stderr: client.0/tmp 2023-11-28T18:42:22.070 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:40:58.364472+0000 0x402216 UPDATE: (mkdir) 2023-11-28T18:42:22.071 INFO:tasks.workunit.client.0.smithi045.stderr: tmp/foo 2023-11-28T18:42:22.071 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:40:58.370000+0000 0x402ae6 UPDATE: (openc) 2023-11-28T18:42:22.071 INFO:tasks.workunit.client.0.smithi045.stderr: tmp/bar 2023-11-28T18:42:22.071 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:41:00.046962+0000 0x403288 UPDATE: (unlink_local) 2023-11-28T18:42:22.071 INFO:tasks.workunit.client.0.smithi045.stderr: stray2/10000000002 2023-11-28T18:42:22.071 INFO:tasks.workunit.client.0.smithi045.stderr: client.0/tmp/foo 2023-11-28T18:42:22.071 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:41:00.049371+0000 0x40448b UPDATE: (cap update) 2023-11-28T18:42:22.071 INFO:tasks.workunit.client.0.smithi045.stderr: tmp/bar 2023-11-28T18:42:22.071 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:41:00.051848+0000 0x404c0c UPDATE: (unlink_local) 2023-11-28T18:42:22.071 INFO:tasks.workunit.client.0.smithi045.stderr: stray2/10000000003 2023-11-28T18:42:22.071 INFO:tasks.workunit.client.0.smithi045.stderr: tmp/bar 2023-11-28T18:42:22.071 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:41:00.056493+0000 0x40586f UPDATE: (unlink_local) 2023-11-28T18:42:22.072 INFO:tasks.workunit.client.0.smithi045.stderr: stray2/10000000001 2023-11-28T18:42:22.072 INFO:tasks.workunit.client.0.smithi045.stderr: client.0/tmp 2023-11-28T18:42:22.072 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:41:00.958687+0000 0x4064d7 UPDATE: (unlink_local) 2023-11-28T18:42:22.072 INFO:tasks.workunit.client.0.smithi045.stderr: client.0 2023-11-28T18:42:22.072 INFO:tasks.workunit.client.0.smithi045.stderr: stray2/10000000000 2023-11-28T18:42:22.072 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:41:01.129537+0000 0x407036 UPDATE: (purge_stray) 2023-11-28T18:42:22.072 INFO:tasks.workunit.client.0.smithi045.stderr: 10000000002 2023-11-28T18:42:22.072 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:41:01.129593+0000 0x40728d UPDATE: (purge_stray) 2023-11-28T18:42:22.072 INFO:tasks.workunit.client.0.smithi045.stderr: 10000000003 2023-11-28T18:42:22.072 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:41:01.465349+0000 0x4074e4 UPDATE: (scatter_writebehind) 2023-11-28T18:42:22.072 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:41:02.129108+0000 0x407956 UPDATE: (purge_stray) 2023-11-28T18:42:22.072 INFO:tasks.workunit.client.0.smithi045.stderr: 10000000001 2023-11-28T18:42:22.073 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:41:03.129943+0000 0x407bad UPDATE: (purge_stray) 2023-11-28T18:42:22.073 INFO:tasks.workunit.client.0.smithi045.stderr: 10000000000 2023-11-28T18:42:22.073 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:41:04.592398+0000 0x407e04 SESSION: () 2023-11-28T18:42:22.073 INFO:tasks.workunit.client.0.smithi045.stderr:0.000000 0x407eb1 PURGED: () 2023-11-28T18:42:22.073 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:41:06.462759+0000 0x407efd UPDATE: (scatter_writebehind) 2023-11-28T18:42:22.073 INFO:tasks.workunit.client.0.smithi045.stderr: stray2' 2023-11-28T18:42:22.073 INFO:tasks.workunit.client.0.smithi045.stderr:+ '[' '!' '{ 2023-11-28T18:42:22.073 INFO:tasks.workunit.client.0.smithi045.stderr: "magic": "ceph fs volume v011", 2023-11-28T18:42:22.073 INFO:tasks.workunit.client.0.smithi045.stderr: "write_pos": 4200184, 2023-11-28T18:42:22.073 INFO:tasks.workunit.client.0.smithi045.stderr: "expire_pos": 4194304, 2023-11-28T18:42:22.073 INFO:tasks.workunit.client.0.smithi045.stderr: "trimmed_pos": 4194304, 2023-11-28T18:42:22.073 INFO:tasks.workunit.client.0.smithi045.stderr: "stream_format": 1, 2023-11-28T18:42:22.074 INFO:tasks.workunit.client.0.smithi045.stderr: "layout": { 2023-11-28T18:42:22.074 INFO:tasks.workunit.client.0.smithi045.stderr: "stripe_unit": 4194304, 2023-11-28T18:42:22.074 INFO:tasks.workunit.client.0.smithi045.stderr: "stripe_count": 1, 2023-11-28T18:42:22.074 INFO:tasks.workunit.client.0.smithi045.stderr: "object_size": 4194304, 2023-11-28T18:42:22.074 INFO:tasks.workunit.client.0.smithi045.stderr: "pool_id": 6, 2023-11-28T18:42:22.074 INFO:tasks.workunit.client.0.smithi045.stderr: "pool_ns": "" 2023-11-28T18:42:22.074 INFO:tasks.workunit.client.0.smithi045.stderr: } 2023-11-28T18:42:22.074 INFO:tasks.workunit.client.0.smithi045.stderr:}' = '{ 2023-11-28T18:42:22.074 INFO:tasks.workunit.client.0.smithi045.stderr: "magic": "ceph fs volume v011", 2023-11-28T18:42:22.074 INFO:tasks.workunit.client.0.smithi045.stderr: "write_pos": 4200184, 2023-11-28T18:42:22.074 INFO:tasks.workunit.client.0.smithi045.stderr: "expire_pos": 4194304, 2023-11-28T18:42:22.074 INFO:tasks.workunit.client.0.smithi045.stderr: "trimmed_pos": 4194304, 2023-11-28T18:42:22.074 INFO:tasks.workunit.client.0.smithi045.stderr: "stream_format": 1, 2023-11-28T18:42:22.075 INFO:tasks.workunit.client.0.smithi045.stderr: "layout": { 2023-11-28T18:42:22.075 INFO:tasks.workunit.client.0.smithi045.stderr: "stripe_unit": 4194304, 2023-11-28T18:42:22.075 INFO:tasks.workunit.client.0.smithi045.stderr: "stripe_count": 1, 2023-11-28T18:42:22.075 INFO:tasks.workunit.client.0.smithi045.stderr: "object_size": 4194304, 2023-11-28T18:42:22.075 INFO:tasks.workunit.client.0.smithi045.stderr: "pool_id": 6, 2023-11-28T18:42:22.075 INFO:tasks.workunit.client.0.smithi045.stderr: "pool_ns": "" 2023-11-28T18:42:22.075 INFO:tasks.workunit.client.0.smithi045.stderr: } 2023-11-28T18:42:22.077 INFO:tasks.workunit.client.0.smithi045.stderr:}' ']' 2023-11-28T18:42:22.077 INFO:tasks.workunit.client.0.smithi045.stderr:+ '[' '!' '0.000000 0x400000 LID: () 2023-11-28T18:42:22.077 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:39:37.048149+0000 0x400030 SUBTREEMAP: () 2023-11-28T18:42:22.077 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:39:44.085815+0000 0x4003ac SESSION: () 2023-11-28T18:42:22.077 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:39:44.501575+0000 0x400564 UPDATE: (setattr) 2023-11-28T18:42:22.077 INFO:tasks.workunit.client.0.smithi045.stderr: / 2023-11-28T18:42:22.078 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:39:44.620894+0000 0x400893 UPDATE: (mkdir) 2023-11-28T18:42:22.078 INFO:tasks.workunit.client.0.smithi045.stderr: client.0 2023-11-28T18:42:22.078 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:39:50.086407+0000 0x401073 UPDATE: (cap update) 2023-11-28T18:42:22.078 INFO:tasks.workunit.client.0.smithi045.stderr: client.0 2023-11-28T18:42:22.078 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:40:58.348779+0000 0x4016f8 UPDATE: (mkdir) 2023-11-28T18:42:22.078 INFO:tasks.workunit.client.0.smithi045.stderr: client.0/tmp 2023-11-28T18:42:22.078 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:40:58.364472+0000 0x402216 UPDATE: (mkdir) 2023-11-28T18:42:22.078 INFO:tasks.workunit.client.0.smithi045.stderr: tmp/foo 2023-11-28T18:42:22.078 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:40:58.370000+0000 0x402ae6 UPDATE: (openc) 2023-11-28T18:42:22.078 INFO:tasks.workunit.client.0.smithi045.stderr: tmp/bar 2023-11-28T18:42:22.078 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:41:00.046962+0000 0x403288 UPDATE: (unlink_local) 2023-11-28T18:42:22.078 INFO:tasks.workunit.client.0.smithi045.stderr: stray2/10000000002 2023-11-28T18:42:22.078 INFO:tasks.workunit.client.0.smithi045.stderr: client.0/tmp/foo 2023-11-28T18:42:22.079 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:41:00.049371+0000 0x40448b UPDATE: (cap update) 2023-11-28T18:42:22.079 INFO:tasks.workunit.client.0.smithi045.stderr: tmp/bar 2023-11-28T18:42:22.079 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:41:00.051848+0000 0x404c0c UPDATE: (unlink_local) 2023-11-28T18:42:22.079 INFO:tasks.workunit.client.0.smithi045.stderr: stray2/10000000003 2023-11-28T18:42:22.079 INFO:tasks.workunit.client.0.smithi045.stderr: tmp/bar 2023-11-28T18:42:22.079 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:41:00.056493+0000 0x40586f UPDATE: (unlink_local) 2023-11-28T18:42:22.079 INFO:tasks.workunit.client.0.smithi045.stderr: stray2/10000000001 2023-11-28T18:42:22.079 INFO:tasks.workunit.client.0.smithi045.stderr: client.0/tmp 2023-11-28T18:42:22.079 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:41:00.958687+0000 0x4064d7 UPDATE: (unlink_local) 2023-11-28T18:42:22.079 INFO:tasks.workunit.client.0.smithi045.stderr: client.0 2023-11-28T18:42:22.079 INFO:tasks.workunit.client.0.smithi045.stderr: stray2/10000000000 2023-11-28T18:42:22.079 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:41:01.129537+0000 0x407036 UPDATE: (purge_stray) 2023-11-28T18:42:22.080 INFO:tasks.workunit.client.0.smithi045.stderr: 10000000002 2023-11-28T18:42:22.080 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:41:01.129593+0000 0x40728d UPDATE: (purge_stray) 2023-11-28T18:42:22.080 INFO:tasks.workunit.client.0.smithi045.stderr: 10000000003 2023-11-28T18:42:22.080 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:41:01.465349+0000 0x4074e4 UPDATE: (scatter_writebehind) 2023-11-28T18:42:22.080 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:41:02.129108+0000 0x407956 UPDATE: (purge_stray) 2023-11-28T18:42:22.080 INFO:tasks.workunit.client.0.smithi045.stderr: 10000000001 2023-11-28T18:42:22.080 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:41:03.129943+0000 0x407bad UPDATE: (purge_stray) 2023-11-28T18:42:22.080 INFO:tasks.workunit.client.0.smithi045.stderr: 10000000000 2023-11-28T18:42:22.080 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:41:04.592398+0000 0x407e04 SESSION: () 2023-11-28T18:42:22.080 INFO:tasks.workunit.client.0.smithi045.stderr:0.000000 0x407eb1 PURGED: () 2023-11-28T18:42:22.080 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:41:06.462759+0000 0x407efd UPDATE: (scatter_writebehind) 2023-11-28T18:42:22.081 INFO:tasks.workunit.client.0.smithi045.stderr: stray2' = '0.000000 0x400000 LID: () 2023-11-28T18:42:22.081 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:39:37.048149+0000 0x400030 SUBTREEMAP: () 2023-11-28T18:42:22.081 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:39:44.085815+0000 0x4003ac SESSION: () 2023-11-28T18:42:22.082 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:39:44.501575+0000 0x400564 UPDATE: (setattr) 2023-11-28T18:42:22.082 INFO:tasks.workunit.client.0.smithi045.stderr: / 2023-11-28T18:42:22.082 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:39:44.620894+0000 0x400893 UPDATE: (mkdir) 2023-11-28T18:42:22.082 INFO:tasks.workunit.client.0.smithi045.stderr: client.0 2023-11-28T18:42:22.082 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:39:50.086407+0000 0x401073 UPDATE: (cap update) 2023-11-28T18:42:22.082 INFO:tasks.workunit.client.0.smithi045.stderr: client.0 2023-11-28T18:42:22.082 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:40:58.348779+0000 0x4016f8 UPDATE: (mkdir) 2023-11-28T18:42:22.082 INFO:tasks.workunit.client.0.smithi045.stderr: client.0/tmp 2023-11-28T18:42:22.082 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:40:58.364472+0000 0x402216 UPDATE: (mkdir) 2023-11-28T18:42:22.082 INFO:tasks.workunit.client.0.smithi045.stderr: tmp/foo 2023-11-28T18:42:22.082 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:40:58.370000+0000 0x402ae6 UPDATE: (openc) 2023-11-28T18:42:22.082 INFO:tasks.workunit.client.0.smithi045.stderr: tmp/bar 2023-11-28T18:42:22.083 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:41:00.046962+0000 0x403288 UPDATE: (unlink_local) 2023-11-28T18:42:22.083 INFO:tasks.workunit.client.0.smithi045.stderr: stray2/10000000002 2023-11-28T18:42:22.083 INFO:tasks.workunit.client.0.smithi045.stderr: client.0/tmp/foo 2023-11-28T18:42:22.083 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:41:00.049371+0000 0x40448b UPDATE: (cap update) 2023-11-28T18:42:22.083 INFO:tasks.workunit.client.0.smithi045.stderr: tmp/bar 2023-11-28T18:42:22.083 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:41:00.051848+0000 0x404c0c UPDATE: (unlink_local) 2023-11-28T18:42:22.083 INFO:tasks.workunit.client.0.smithi045.stderr: stray2/10000000003 2023-11-28T18:42:22.083 INFO:tasks.workunit.client.0.smithi045.stderr: tmp/bar 2023-11-28T18:42:22.083 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:41:00.056493+0000 0x40586f UPDATE: (unlink_local) 2023-11-28T18:42:22.083 INFO:tasks.workunit.client.0.smithi045.stderr: stray2/10000000001 2023-11-28T18:42:22.083 INFO:tasks.workunit.client.0.smithi045.stderr: client.0/tmp 2023-11-28T18:42:22.083 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:41:00.958687+0000 0x4064d7 UPDATE: (unlink_local) 2023-11-28T18:42:22.083 INFO:tasks.workunit.client.0.smithi045.stderr: client.0 2023-11-28T18:42:22.084 INFO:tasks.workunit.client.0.smithi045.stderr: stray2/10000000000 2023-11-28T18:42:22.084 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:41:01.129537+0000 0x407036 UPDATE: (purge_stray) 2023-11-28T18:42:22.084 INFO:tasks.workunit.client.0.smithi045.stderr: 10000000002 2023-11-28T18:42:22.084 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:41:01.129593+0000 0x40728d UPDATE: (purge_stray) 2023-11-28T18:42:22.084 INFO:tasks.workunit.client.0.smithi045.stderr: 10000000003 2023-11-28T18:42:22.084 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:41:01.465349+0000 0x4074e4 UPDATE: (scatter_writebehind) 2023-11-28T18:42:22.084 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:41:02.129108+0000 0x407956 UPDATE: (purge_stray) 2023-11-28T18:42:22.084 INFO:tasks.workunit.client.0.smithi045.stderr: 10000000001 2023-11-28T18:42:22.084 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:41:03.129943+0000 0x407bad UPDATE: (purge_stray) 2023-11-28T18:42:22.084 INFO:tasks.workunit.client.0.smithi045.stderr: 10000000000 2023-11-28T18:42:22.084 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:41:04.592398+0000 0x407e04 SESSION: () 2023-11-28T18:42:22.084 INFO:tasks.workunit.client.0.smithi045.stderr:0.000000 0x407eb1 PURGED: () 2023-11-28T18:42:22.085 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:41:06.462759+0000 0x407efd UPDATE: (scatter_writebehind) 2023-11-28T18:42:22.085 INFO:tasks.workunit.client.0.smithi045.stderr: stray2' ']' 2023-11-28T18:42:22.085 INFO:tasks.workunit.client.0.smithi045.stdout:Testing 'journal' commands... 2023-11-28T18:42:22.085 INFO:tasks.workunit.client.0.smithi045.stderr:+ echo 'Testing '\''journal'\'' commands...' 2023-11-28T18:42:22.085 INFO:tasks.workunit.client.0.smithi045.stderr:+ cephfs-journal-tool --rank=cephfs:0 journal inspect 2023-11-28T18:42:22.108 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.103+0000 7f2eb8e4b280 1 -- start start 2023-11-28T18:42:22.108 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.103+0000 7f2eb8e4b280 1 Processor -- start 2023-11-28T18:42:22.123 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.103+0000 7f2eb8e4b280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563cec2c7800 0x563cec332580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.123 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.103+0000 7f2eb8e4b280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563cec2c7400 0x563cec332b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.123 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.103+0000 7f2eb8e4b280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563cec2c7000 0x563cec333080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.123 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.103+0000 7f2eb8e4b280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cec30d180 con 0x563cec2c7400 2023-11-28T18:42:22.124 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.103+0000 7f2eb8e4b280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cec30ca00 con 0x563cec2c7800 2023-11-28T18:42:22.124 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.103+0000 7f2eb8e4b280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x563cec30c000 con 0x563cec2c7000 2023-11-28T18:42:22.124 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.103+0000 7f2eb6260640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563cec2c7400 0x563cec332b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.124 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.103+0000 7f2eb6260640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563cec2c7400 0x563cec332b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57292/0 (socket says 172.21.15.45:57292) 2023-11-28T18:42:22.124 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.103+0000 7f2eb6260640 1 -- 172.21.15.45:0/3595960032 learned_addr learned my addr 172.21.15.45:0/3595960032 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:22.124 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.103+0000 7f2eb7262640 1 --2- 172.21.15.45:0/3595960032 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563cec2c7000 0x563cec333080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.125 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.107+0000 7f2eb6a61640 1 --2- 172.21.15.45:0/3595960032 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563cec2c7800 0x563cec332580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.125 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.107+0000 7f2eb6260640 1 -- 172.21.15.45:0/3595960032 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563cec2c7000 msgr2=0x563cec333080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:22.125 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.107+0000 7f2eb6260640 1 --2- 172.21.15.45:0/3595960032 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563cec2c7000 0x563cec333080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.125 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.107+0000 7f2eb6260640 1 -- 172.21.15.45:0/3595960032 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563cec2c7800 msgr2=0x563cec332580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:22.125 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.107+0000 7f2eb6260640 1 --2- 172.21.15.45:0/3595960032 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563cec2c7800 0x563cec332580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.125 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.107+0000 7f2eb6260640 1 -- 172.21.15.45:0/3595960032 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563cec2fc9c0 con 0x563cec2c7400 2023-11-28T18:42:22.125 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.107+0000 7f2eb6260640 1 --2- 172.21.15.45:0/3595960032 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563cec2c7400 0x563cec332b00 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x563ced140db0 tx=0x563ced04f080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66a14a9133c9726e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.125 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.107+0000 7f2eb425c640 1 -- 172.21.15.45:0/3595960032 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x563cec3271e0 con 0x563cec2c7400 2023-11-28T18:42:22.126 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.107+0000 7f2eb425c640 1 -- 172.21.15.45:0/3595960032 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563cec322900 con 0x563cec2c7400 2023-11-28T18:42:22.126 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.107+0000 7f2eb425c640 1 -- 172.21.15.45:0/3595960032 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x563cec327080 con 0x563cec2c7400 2023-11-28T18:42:22.126 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.107+0000 7f2eb8e4b280 1 -- 172.21.15.45:0/3595960032 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563cec2fc340 con 0x563cec2c7400 2023-11-28T18:42:22.126 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.107+0000 7f2eb8e4b280 1 -- 172.21.15.45:0/3595960032 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x563cec2fc000 con 0x563cec2c7400 2023-11-28T18:42:22.126 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.107+0000 7f2eb425c640 1 -- 172.21.15.45:0/3595960032 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x563cec308c40 con 0x563cec2c7400 2023-11-28T18:42:22.126 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.107+0000 7f2eb425c640 1 -- 172.21.15.45:0/3595960032 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 34) v1 ==== 3298+0+0 (secure 0 0 0) 0x563cec314f00 con 0x563cec2c7400 2023-11-28T18:42:22.127 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.107+0000 7f2eb8e4b280 1 Processor -- start 2023-11-28T18:42:22.127 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.107+0000 7f2eb8e4b280 1 -- start start 2023-11-28T18:42:22.127 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.107+0000 7f2eb8e4b280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563ced1eac00 0x563cec333600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.127 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.107+0000 7f2eb8e4b280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ced1eb000 0x563cec333b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.127 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.107+0000 7f2eb8e4b280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563ced1eb400 0x563cec334100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.127 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.107+0000 7f2eb8e4b280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cec30c140 con 0x563ced1eb000 2023-11-28T18:42:22.127 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.107+0000 7f2eb8e4b280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cec397180 con 0x563ced1eb400 2023-11-28T18:42:22.128 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.107+0000 7f2eb8e4b280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x563cec396dc0 con 0x563ced1eac00 2023-11-28T18:42:22.128 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.107+0000 7f2eb6a61640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ced1eb000 0x563cec333b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.128 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.107+0000 7f2eb6a61640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ced1eb000 0x563cec333b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57306/0 (socket says 172.21.15.45:57306) 2023-11-28T18:42:22.128 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.107+0000 7f2eb6a61640 1 -- 172.21.15.45:0/1197008901 learned_addr learned my addr 172.21.15.45:0/1197008901 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:22.128 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.107+0000 7f2eb7262640 1 --2- 172.21.15.45:0/1197008901 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563ced1eac00 0x563cec333600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.128 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.107+0000 7f2eb6260640 1 --2- 172.21.15.45:0/1197008901 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563ced1eb400 0x563cec334100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.128 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.107+0000 7f2eb6a61640 1 -- 172.21.15.45:0/1197008901 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563ced1eac00 msgr2=0x563cec333600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:22.128 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.107+0000 7f2eb6a61640 1 --2- 172.21.15.45:0/1197008901 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563ced1eac00 0x563cec333600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.128 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.107+0000 7f2eb6a61640 1 -- 172.21.15.45:0/1197008901 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563ced1eb400 msgr2=0x563cec334100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:22.128 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.107+0000 7f2eb6a61640 1 --2- 172.21.15.45:0/1197008901 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563ced1eb400 0x563cec334100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.128 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.107+0000 7f2eb6a61640 1 -- 172.21.15.45:0/1197008901 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563cec2fcea0 con 0x563ced1eb000 2023-11-28T18:42:22.129 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.107+0000 7f2eb7262640 1 --2- 172.21.15.45:0/1197008901 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563ced1eac00 0x563cec333600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:42:22.129 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.107+0000 7f2eb6260640 1 --2- 172.21.15.45:0/1197008901 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563ced1eb400 0x563cec334100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:42:22.129 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.107+0000 7f2eb6a61640 1 --2- 172.21.15.45:0/1197008901 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ced1eb000 0x563cec333b80 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x563ced24c1b0 tx=0x563cec5aa000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=815b74f4b14b3c68 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.129 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.107+0000 7f2eb2258640 1 -- 172.21.15.45:0/1197008901 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x563cec3271e0 con 0x563ced1eb000 2023-11-28T18:42:22.129 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.107+0000 7f2eb2258640 1 -- 172.21.15.45:0/1197008901 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563ced096d80 con 0x563ced1eb000 2023-11-28T18:42:22.129 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.107+0000 7f2eb2258640 1 -- 172.21.15.45:0/1197008901 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x563cec327080 con 0x563ced1eb000 2023-11-28T18:42:22.129 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.111+0000 7f2eb8e4b280 1 -- 172.21.15.45:0/1197008901 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ced1eb000 msgr2=0x563cec333b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.130 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.111+0000 7f2eb8e4b280 1 --2- 172.21.15.45:0/1197008901 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ced1eb000 0x563cec333b80 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x563ced24c1b0 tx=0x563cec5aa000 comp rx=0 tx=0).stop 2023-11-28T18:42:22.130 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.111+0000 7f2eb8e4b280 1 -- 172.21.15.45:0/1197008901 shutdown_connections 2023-11-28T18:42:22.130 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.111+0000 7f2eb8e4b280 1 --2- 172.21.15.45:0/1197008901 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563ced1eb400 0x563cec334100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.130 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.111+0000 7f2eb8e4b280 1 --2- 172.21.15.45:0/1197008901 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ced1eb000 0x563cec333b80 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.130 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.111+0000 7f2eb8e4b280 1 --2- 172.21.15.45:0/1197008901 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563ced1eac00 0x563cec333600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.130 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.111+0000 7f2eb8e4b280 1 -- 172.21.15.45:0/1197008901 >> 172.21.15.45:0/1197008901 conn(0x563cec2c6c00 msgr2=0x563cec2f5800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:22.130 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.111+0000 7f2eb8e4b280 1 -- 172.21.15.45:0/1197008901 shutdown_connections 2023-11-28T18:42:22.130 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.111+0000 7f2eb8e4b280 1 -- 172.21.15.45:0/1197008901 wait complete. 2023-11-28T18:42:22.130 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.111+0000 7f2eb8e4b280 1 Processor -- start 2023-11-28T18:42:22.130 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.111+0000 7f2eb8e4b280 1 -- start start 2023-11-28T18:42:22.130 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.111+0000 7f2eb8e4b280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ced1eac00 0x563cec335180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.131 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.111+0000 7f2eb8e4b280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563ced1eb000 0x563cec334c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.131 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.111+0000 7f2eb8e4b280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563ced1eb400 0x563cec334680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.131 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.111+0000 7f2eb8e4b280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cec396c80 con 0x563ced1eac00 2023-11-28T18:42:22.131 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.111+0000 7f2eb8e4b280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cec30ca00 con 0x563ced1eb000 2023-11-28T18:42:22.131 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.111+0000 7f2eb8e4b280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x563cec30cb40 con 0x563ced1eb400 2023-11-28T18:42:22.131 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.111+0000 7f2eb7262640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ced1eac00 0x563cec335180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.131 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.111+0000 7f2eb7262640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ced1eac00 0x563cec335180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57322/0 (socket says 172.21.15.45:57322) 2023-11-28T18:42:22.131 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.111+0000 7f2eb7262640 1 -- 172.21.15.45:0/3863789071 learned_addr learned my addr 172.21.15.45:0/3863789071 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:22.131 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.111+0000 7f2eb6260640 1 --2- 172.21.15.45:0/3863789071 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563ced1eb400 0x563cec334680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.132 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.111+0000 7f2eb6a61640 1 --2- 172.21.15.45:0/3863789071 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563ced1eb000 0x563cec334c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.132 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.111+0000 7f2eb7262640 1 -- 172.21.15.45:0/3863789071 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563ced1eb400 msgr2=0x563cec334680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.132 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.111+0000 7f2eb7262640 1 --2- 172.21.15.45:0/3863789071 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563ced1eb400 0x563cec334680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.132 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.111+0000 7f2eb7262640 1 -- 172.21.15.45:0/3863789071 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563ced1eb000 msgr2=0x563cec334c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.132 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.111+0000 7f2eb7262640 1 --2- 172.21.15.45:0/3863789071 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563ced1eb000 0x563cec334c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.132 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.111+0000 7f2eb7262640 1 -- 172.21.15.45:0/3863789071 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563cec2fc9c0 con 0x563ced1eac00 2023-11-28T18:42:22.132 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.111+0000 7f2eb7262640 1 --2- 172.21.15.45:0/3863789071 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ced1eac00 0x563cec335180 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x563ced24ce40 tx=0x563ced090000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.132 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.111+0000 7f2eb0a55640 1 -- 172.21.15.45:0/3863789071 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x563cec3271e0 con 0x563ced1eac00 2023-11-28T18:42:22.132 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.111+0000 7f2eb0a55640 1 -- 172.21.15.45:0/3863789071 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563ced096300 con 0x563ced1eac00 2023-11-28T18:42:22.132 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.111+0000 7f2eb8e4b280 1 -- 172.21.15.45:0/3863789071 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563cec2fc340 con 0x563ced1eac00 2023-11-28T18:42:22.133 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.111+0000 7f2eb0a55640 1 -- 172.21.15.45:0/3863789071 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x563cec327080 con 0x563ced1eac00 2023-11-28T18:42:22.133 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.111+0000 7f2eb8e4b280 1 -- 172.21.15.45:0/3863789071 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563cec2fc1a0 con 0x563ced1eac00 2023-11-28T18:42:22.133 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.115+0000 7f2eb0a55640 1 -- 172.21.15.45:0/3863789071 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x563cec355080 con 0x563ced1eac00 2023-11-28T18:42:22.133 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.115+0000 7f2eb0a55640 1 --2- 172.21.15.45:0/3863789071 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x563ced24f000 0x563cec335700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.133 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.115+0000 7f2eb0a55640 1 -- 172.21.15.45:0/3863789071 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x563cec308a80 con 0x563ced1eac00 2023-11-28T18:42:22.133 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.115+0000 7f2eb8e4b280 1 --2- 172.21.15.45:0/3863789071 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x563ced1eb800 0x563cec334100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.133 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.115+0000 7f2eb8e4b280 1 -- 172.21.15.45:0/3863789071 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x563cec31d880 con 0x563ced1eb800 2023-11-28T18:42:22.133 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.115+0000 7f2eb6a61640 1 --2- 172.21.15.45:0/3863789071 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x563ced24f000 0x563cec335700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.133 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.115+0000 7f2eb6260640 1 --2- 172.21.15.45:0/3863789071 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x563ced1eb800 0x563cec334100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.133 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.115+0000 7f2eb6260640 1 --2- 172.21.15.45:0/3863789071 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x563ced1eb800 0x563cec334100 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.133 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.115+0000 7f2eb6a61640 1 --2- 172.21.15.45:0/3863789071 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x563ced24f000 0x563cec335700 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x563ced24c1b0 tx=0x563ced044d20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.134 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.115+0000 7f2eb6260640 1 -- 172.21.15.45:0/3863789071 <== osd.2 v2:172.21.15.45:6816/193884539 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x563ced1deb40 con 0x563ced1eb800 2023-11-28T18:42:22.134 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.115+0000 7f2eb8e4b280 1 -- 172.21.15.45:0/3863789071 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x563cec31dc00 con 0x563ced1eb800 2023-11-28T18:42:22.134 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.115+0000 7f2eb6260640 1 -- 172.21.15.45:0/3863789071 <== osd.2 v2:172.21.15.45:6816/193884539 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv22 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x563ced1deb40 con 0x563ced1eb800 2023-11-28T18:42:22.134 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.115+0000 7f2eb8e4b280 1 -- 172.21.15.45:0/3863789071 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:3 6.14 6:2e2fa760:::200.00000001:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x563cec6a4000 con 0x563ced1eb800 2023-11-28T18:42:22.134 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.115+0000 7f2eb6260640 1 -- 172.21.15.45:0/3863789071 <== osd.2 v2:172.21.15.45:6816/193884539 3 ==== osd_op_reply(3 200.00000001 [read 0~34160 out=34160b] v0'0 uv24 ondisk = 0) v8 ==== 156+0+34160 (crc 0 0 0) 0x563ced1deb40 con 0x563ced1eb800 2023-11-28T18:42:22.135 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.115+0000 7f2eb8e4b280 1 --2- 172.21.15.45:0/3863789071 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x563ced1ebc00 0x563cec333b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.135 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.115+0000 7f2eb8e4b280 1 -- 172.21.15.45:0/3863789071 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:4 6.1b 6:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x563cec6a4380 con 0x563ced1ebc00 2023-11-28T18:42:22.135 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.119+0000 7f2eb7262640 1 --2- 172.21.15.45:0/3863789071 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x563ced1ebc00 0x563cec333b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.135 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.119+0000 7f2eb7262640 1 --2- 172.21.15.45:0/3863789071 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x563ced1ebc00 0x563cec333b80 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.135 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.119+0000 7f2eb7262640 1 -- 172.21.15.45:0/3863789071 <== osd.3 v2:172.21.15.45:6824/78541084 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x563ced1ded80 con 0x563ced1ebc00 2023-11-28T18:42:22.135 INFO:tasks.workunit.client.0.smithi045.stdout:Overall journal integrity: OK 2023-11-28T18:42:22.137 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.119+0000 7f2eb8e4b280 1 -- 172.21.15.45:0/3863789071 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x563ced1eb800 msgr2=0x563cec334100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.137 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.119+0000 7f2eb8e4b280 1 --2- 172.21.15.45:0/3863789071 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x563ced1eb800 0x563cec334100 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.137 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.119+0000 7f2eb8e4b280 1 -- 172.21.15.45:0/3863789071 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x563ced1ebc00 msgr2=0x563cec333b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.137 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.119+0000 7f2eb8e4b280 1 --2- 172.21.15.45:0/3863789071 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x563ced1ebc00 0x563cec333b80 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.137 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.119+0000 7f2eb8e4b280 1 -- 172.21.15.45:0/3863789071 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x563ced24f000 msgr2=0x563cec335700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.137 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.119+0000 7f2eb8e4b280 1 --2- 172.21.15.45:0/3863789071 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x563ced24f000 0x563cec335700 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x563ced24c1b0 tx=0x563ced044d20 comp rx=0 tx=0).stop 2023-11-28T18:42:22.137 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.119+0000 7f2eb8e4b280 1 -- 172.21.15.45:0/3863789071 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ced1eac00 msgr2=0x563cec335180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.137 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.119+0000 7f2eb8e4b280 1 --2- 172.21.15.45:0/3863789071 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ced1eac00 0x563cec335180 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x563ced24ce40 tx=0x563ced090000 comp rx=0 tx=0).stop 2023-11-28T18:42:22.137 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.119+0000 7f2eb6a61640 1 -- 172.21.15.45:0/3863789071 reap_dead start 2023-11-28T18:42:22.137 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.119+0000 7f2eb6a61640 1 -- 172.21.15.45:0/3863789071 reap_dead start 2023-11-28T18:42:22.138 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.119+0000 7f2eb8e4b280 1 -- 172.21.15.45:0/3863789071 shutdown_connections 2023-11-28T18:42:22.138 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.119+0000 7f2eb8e4b280 1 -- 172.21.15.45:0/3863789071 >> 172.21.15.45:0/3863789071 conn(0x563cec2c6c00 msgr2=0x563cec2f5800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:22.138 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.119+0000 7f2eb8e4b280 1 -- 172.21.15.45:0/3863789071 shutdown_connections 2023-11-28T18:42:22.138 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.119+0000 7f2eb8e4b280 1 -- 172.21.15.45:0/3863789071 wait complete. 2023-11-28T18:42:22.138 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.119+0000 7f2eb8e4b280 1 -- 172.21.15.45:0/3595960032 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563cec2c7400 msgr2=0x563cec332b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.138 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.119+0000 7f2eb8e4b280 1 --2- 172.21.15.45:0/3595960032 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563cec2c7400 0x563cec332b00 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x563ced140db0 tx=0x563ced04f080 comp rx=0 tx=0).stop 2023-11-28T18:42:22.138 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.119+0000 7f2eb8e4b280 1 -- 172.21.15.45:0/3595960032 shutdown_connections 2023-11-28T18:42:22.138 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.119+0000 7f2eb8e4b280 1 --2- 172.21.15.45:0/3595960032 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563cec2c7000 0x563cec333080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.138 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.119+0000 7f2eb8e4b280 1 --2- 172.21.15.45:0/3595960032 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563cec2c7400 0x563cec332b00 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.138 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.119+0000 7f2eb8e4b280 1 --2- 172.21.15.45:0/3595960032 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563cec2c7800 0x563cec332580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.138 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.119+0000 7f2eb8e4b280 1 -- 172.21.15.45:0/3595960032 >> 172.21.15.45:0/3595960032 conn(0x563cec2c7c00 msgr2=0x563cec2f5000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:22.138 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.119+0000 7f2eb8e4b280 1 -- 172.21.15.45:0/3595960032 shutdown_connections 2023-11-28T18:42:22.139 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.119+0000 7f2eb8e4b280 1 -- 172.21.15.45:0/3595960032 wait complete. 2023-11-28T18:42:22.139 INFO:tasks.workunit.client.0.smithi045.stderr:+ cephfs-journal-tool --rank=cephfs:0 header get 2023-11-28T18:42:22.167 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.163+0000 7f98f19c2280 1 -- start start 2023-11-28T18:42:22.167 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.163+0000 7f98f19c2280 1 Processor -- start 2023-11-28T18:42:22.170 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.163+0000 7f98f19c2280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562c25b3b800 0x562c25ba6580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.170 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.163+0000 7f98f19c2280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562c25b3b400 0x562c25ba6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.170 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.163+0000 7f98f19c2280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562c25b3b000 0x562c25ba7080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.170 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.163+0000 7f98f19c2280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c25b81180 con 0x562c25b3b000 2023-11-28T18:42:22.170 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.163+0000 7f98f19c2280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c25c0b180 con 0x562c25b3b800 2023-11-28T18:42:22.170 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.163+0000 7f98f19c2280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x562c25b80140 con 0x562c25b3b400 2023-11-28T18:42:22.170 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.163+0000 7f98f0982640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562c25b3b000 0x562c25ba7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.170 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.163+0000 7f98f0982640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562c25b3b000 0x562c25ba7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57324/0 (socket says 172.21.15.45:57324) 2023-11-28T18:42:22.171 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.163+0000 7f98f0982640 1 -- 172.21.15.45:0/2036966108 learned_addr learned my addr 172.21.15.45:0/2036966108 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:22.171 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.163+0000 7f98ef980640 1 --2- 172.21.15.45:0/2036966108 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562c25b3b400 0x562c25ba6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.171 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.163+0000 7f98f0181640 1 --2- 172.21.15.45:0/2036966108 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562c25b3b800 0x562c25ba6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.171 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.163+0000 7f98f0982640 1 -- 172.21.15.45:0/2036966108 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562c25b3b400 msgr2=0x562c25ba6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:22.171 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.163+0000 7f98f0982640 1 --2- 172.21.15.45:0/2036966108 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562c25b3b400 0x562c25ba6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.171 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.163+0000 7f98f0982640 1 -- 172.21.15.45:0/2036966108 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562c25b3b800 msgr2=0x562c25ba6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:22.172 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.163+0000 7f98f0982640 1 --2- 172.21.15.45:0/2036966108 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562c25b3b800 0x562c25ba6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.174 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.163+0000 7f98f0982640 1 -- 172.21.15.45:0/2036966108 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562c25b709c0 con 0x562c25b3b000 2023-11-28T18:42:22.174 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.163+0000 7f98f0982640 1 --2- 172.21.15.45:0/2036966108 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562c25b3b000 0x562c25ba7080 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x562c269b0cf0 tx=0x562c268c3080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8fe9c0103710a5c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.174 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.163+0000 7f98ed97c640 1 -- 172.21.15.45:0/2036966108 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x562c25b9b1e0 con 0x562c25b3b000 2023-11-28T18:42:22.174 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.163+0000 7f98ed97c640 1 -- 172.21.15.45:0/2036966108 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562c25b96900 con 0x562c25b3b000 2023-11-28T18:42:22.174 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.163+0000 7f98ed97c640 1 -- 172.21.15.45:0/2036966108 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x562c25b9b080 con 0x562c25b3b000 2023-11-28T18:42:22.174 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.163+0000 7f98f19c2280 1 -- 172.21.15.45:0/2036966108 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562c25b70b60 con 0x562c25b3b000 2023-11-28T18:42:22.174 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.163+0000 7f98f19c2280 1 -- 172.21.15.45:0/2036966108 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x562c25b70340 con 0x562c25b3b000 2023-11-28T18:42:22.175 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.163+0000 7f98ed97c640 1 -- 172.21.15.45:0/2036966108 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x562c25b7cc40 con 0x562c25b3b000 2023-11-28T18:42:22.175 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.163+0000 7f98ed97c640 1 -- 172.21.15.45:0/2036966108 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 34) v1 ==== 3298+0+0 (secure 0 0 0) 0x562c25b89200 con 0x562c25b3b000 2023-11-28T18:42:22.175 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.167+0000 7f98f19c2280 1 Processor -- start 2023-11-28T18:42:22.175 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.167+0000 7f98f19c2280 1 -- start start 2023-11-28T18:42:22.181 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.167+0000 7f98f19c2280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562c26a5ac00 0x562c25ba7600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.181 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.167+0000 7f98f19c2280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562c26a5b000 0x562c25ba7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.181 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.167+0000 7f98f19c2280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562c26a5b400 0x562c25ba8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.181 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.167+0000 7f98f19c2280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c25b80a00 con 0x562c26a5b000 2023-11-28T18:42:22.181 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.167+0000 7f98f19c2280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c25b80b40 con 0x562c26a5b400 2023-11-28T18:42:22.181 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.167+0000 7f98f19c2280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x562c25c0b180 con 0x562c26a5ac00 2023-11-28T18:42:22.181 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.167+0000 7f98f0181640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562c26a5b000 0x562c25ba7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.181 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.167+0000 7f98f0181640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562c26a5b000 0x562c25ba7b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57340/0 (socket says 172.21.15.45:57340) 2023-11-28T18:42:22.181 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.167+0000 7f98f0181640 1 -- 172.21.15.45:0/4286042042 learned_addr learned my addr 172.21.15.45:0/4286042042 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:22.181 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.167+0000 7f98ef980640 1 --2- 172.21.15.45:0/4286042042 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562c26a5b400 0x562c25ba8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.182 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.167+0000 7f98ef980640 1 --2- 172.21.15.45:0/4286042042 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562c26a5ac00 0x562c25ba7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.182 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.167+0000 7f98f0181640 1 -- 172.21.15.45:0/4286042042 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562c26a5ac00 msgr2=0x562c25ba7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:22.182 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.167+0000 7f98f0181640 1 --2- 172.21.15.45:0/4286042042 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562c26a5ac00 0x562c25ba7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.182 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.167+0000 7f98f0181640 1 -- 172.21.15.45:0/4286042042 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562c26a5b400 msgr2=0x562c25ba8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:22.182 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.167+0000 7f98f0181640 1 --2- 172.21.15.45:0/4286042042 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562c26a5b400 0x562c25ba8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.182 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.167+0000 7f98f0181640 1 -- 172.21.15.45:0/4286042042 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562c25b70000 con 0x562c26a5b000 2023-11-28T18:42:22.182 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.167+0000 7f98ef980640 1 --2- 172.21.15.45:0/4286042042 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562c26a5b400 0x562c25ba8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:42:22.182 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.167+0000 7f98f0181640 1 --2- 172.21.15.45:0/4286042042 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562c26a5b000 0x562c25ba7b80 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x562c26ab20f0 tx=0x562c25e18000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65e562db55e65511 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.182 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.167+0000 7f98eb978640 1 -- 172.21.15.45:0/4286042042 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x562c25b9b1e0 con 0x562c26a5b000 2023-11-28T18:42:22.182 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.167+0000 7f98eb978640 1 -- 172.21.15.45:0/4286042042 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562c269b3800 con 0x562c26a5b000 2023-11-28T18:42:22.183 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.167+0000 7f98eb978640 1 -- 172.21.15.45:0/4286042042 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x562c25b9b080 con 0x562c26a5b000 2023-11-28T18:42:22.183 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.167+0000 7f98f19c2280 1 -- 172.21.15.45:0/4286042042 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562c26a5b000 msgr2=0x562c25ba7b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.183 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.167+0000 7f98f19c2280 1 --2- 172.21.15.45:0/4286042042 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562c26a5b000 0x562c25ba7b80 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x562c26ab20f0 tx=0x562c25e18000 comp rx=0 tx=0).stop 2023-11-28T18:42:22.183 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.167+0000 7f98f19c2280 1 -- 172.21.15.45:0/4286042042 shutdown_connections 2023-11-28T18:42:22.183 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.167+0000 7f98f19c2280 1 --2- 172.21.15.45:0/4286042042 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562c26a5b400 0x562c25ba8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.183 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.167+0000 7f98f19c2280 1 --2- 172.21.15.45:0/4286042042 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562c26a5b000 0x562c25ba7b80 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.183 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.167+0000 7f98f19c2280 1 --2- 172.21.15.45:0/4286042042 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562c26a5ac00 0x562c25ba7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.183 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.167+0000 7f98f19c2280 1 -- 172.21.15.45:0/4286042042 >> 172.21.15.45:0/4286042042 conn(0x562c25b3ac00 msgr2=0x562c25b67000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:22.183 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.167+0000 7f98f19c2280 1 -- 172.21.15.45:0/4286042042 shutdown_connections 2023-11-28T18:42:22.183 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.167+0000 7f98f19c2280 1 -- 172.21.15.45:0/4286042042 wait complete. 2023-11-28T18:42:22.183 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.167+0000 7f98f19c2280 1 Processor -- start 2023-11-28T18:42:22.183 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.171+0000 7f98f19c2280 1 -- start start 2023-11-28T18:42:22.184 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.171+0000 7f98f19c2280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562c26a5ac00 0x562c25ba9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.184 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.171+0000 7f98f19c2280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562c26a5b000 0x562c25ba8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.184 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.171+0000 7f98f19c2280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562c26a5b400 0x562c25ba8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.184 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.171+0000 7f98f19c2280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c25c0adc0 con 0x562c26a5b400 2023-11-28T18:42:22.184 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.171+0000 7f98f19c2280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c25c0ac80 con 0x562c26a5ac00 2023-11-28T18:42:22.184 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.171+0000 7f98f19c2280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x562c25c0ab40 con 0x562c26a5b000 2023-11-28T18:42:22.184 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.171+0000 7f98ef980640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562c26a5b400 0x562c25ba8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.184 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.171+0000 7f98f0181640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562c26a5b000 0x562c25ba8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.184 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.171+0000 7f98f0181640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562c26a5b000 0x562c25ba8c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.45:42312/0 (socket says 172.21.15.45:42312) 2023-11-28T18:42:22.184 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.171+0000 7f98f0181640 1 -- 172.21.15.45:0/3908532272 learned_addr learned my addr 172.21.15.45:0/3908532272 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:22.185 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.171+0000 7f98ef980640 1 --2- 172.21.15.45:0/3908532272 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562c26a5ac00 0x562c25ba9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.185 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.171+0000 7f98ef980640 1 -- 172.21.15.45:0/3908532272 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562c26a5b000 msgr2=0x562c25ba8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.185 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.171+0000 7f98ef980640 1 --2- 172.21.15.45:0/3908532272 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562c26a5b000 0x562c25ba8c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.185 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.171+0000 7f98ef980640 1 -- 172.21.15.45:0/3908532272 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562c26a5ac00 msgr2=0x562c25ba9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.186 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.171+0000 7f98ef980640 1 --2- 172.21.15.45:0/3908532272 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562c26a5ac00 0x562c25ba9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.186 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.171+0000 7f98ef980640 1 -- 172.21.15.45:0/3908532272 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562c25b709c0 con 0x562c26a5b400 2023-11-28T18:42:22.186 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.171+0000 7f98ef980640 1 --2- 172.21.15.45:0/3908532272 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562c26a5b400 0x562c25ba8680 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x562c269b0300 tx=0x562c2690a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.186 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.171+0000 7f98ea175640 1 -- 172.21.15.45:0/3908532272 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x562c25b9af20 con 0x562c26a5b400 2023-11-28T18:42:22.187 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.171+0000 7f98ea175640 1 -- 172.21.15.45:0/3908532272 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562c269b2180 con 0x562c26a5b400 2023-11-28T18:42:22.187 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.171+0000 7f98ea175640 1 -- 172.21.15.45:0/3908532272 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x562c25b9b1e0 con 0x562c26a5b400 2023-11-28T18:42:22.187 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.171+0000 7f98f19c2280 1 -- 172.21.15.45:0/3908532272 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562c25b70b60 con 0x562c26a5b400 2023-11-28T18:42:22.187 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.171+0000 7f98f19c2280 1 -- 172.21.15.45:0/3908532272 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562c25b70ea0 con 0x562c26a5b400 2023-11-28T18:42:22.187 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.171+0000 7f98ea175640 1 -- 172.21.15.45:0/3908532272 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x562c25bc9080 con 0x562c26a5b400 2023-11-28T18:42:22.187 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.175+0000 7f98ea175640 1 --2- 172.21.15.45:0/3908532272 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x562c25e17000 0x562c25ba9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.188 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.175+0000 7f98ea175640 1 -- 172.21.15.45:0/3908532272 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x562c25b7ca80 con 0x562c26a5b400 2023-11-28T18:42:22.188 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.175+0000 7f98f19c2280 1 --2- 172.21.15.45:0/3908532272 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x562c26a5b800 0x562c25ba8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.188 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.175+0000 7f98f19c2280 1 -- 172.21.15.45:0/3908532272 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x562c25b91880 con 0x562c26a5b800 2023-11-28T18:42:22.188 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.175+0000 7f98f0181640 1 --2- 172.21.15.45:0/3908532272 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x562c25e17000 0x562c25ba9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.188 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.175+0000 7f98ef980640 1 --2- 172.21.15.45:0/3908532272 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x562c26a5b800 0x562c25ba8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.188 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.175+0000 7f98ef980640 1 --2- 172.21.15.45:0/3908532272 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x562c26a5b800 0x562c25ba8100 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.188 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.175+0000 7f98f0181640 1 --2- 172.21.15.45:0/3908532272 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x562c25e17000 0x562c25ba9700 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x562c26ab2d50 tx=0x562c25bfeb40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.188 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.175+0000 7f98ef980640 1 -- 172.21.15.45:0/3908532272 <== osd.2 v2:172.21.15.45:6816/193884539 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x562c26a3cb40 con 0x562c26a5b800 2023-11-28T18:42:22.189 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.175+0000 7f98f19c2280 1 -- 172.21.15.45:0/3908532272 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x562c25b91c00 con 0x562c26a5b800 2023-11-28T18:42:22.189 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.175+0000 7f98ef980640 1 -- 172.21.15.45:0/3908532272 <== osd.2 v2:172.21.15.45:6816/193884539 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv22 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x562c26a3cb40 con 0x562c26a5b800 2023-11-28T18:42:22.189 INFO:tasks.workunit.client.0.smithi045.stdout:{ 2023-11-28T18:42:22.189 INFO:tasks.workunit.client.0.smithi045.stdout: "magic": "ceph fs volume v011", 2023-11-28T18:42:22.189 INFO:tasks.workunit.client.0.smithi045.stdout: "write_pos": 4200184, 2023-11-28T18:42:22.189 INFO:tasks.workunit.client.0.smithi045.stdout: "expire_pos": 4194304, 2023-11-28T18:42:22.189 INFO:tasks.workunit.client.0.smithi045.stdout: "trimmed_pos": 4194304, 2023-11-28T18:42:22.189 INFO:tasks.workunit.client.0.smithi045.stdout: "stream_format": 1, 2023-11-28T18:42:22.190 INFO:tasks.workunit.client.0.smithi045.stdout: "layout": { 2023-11-28T18:42:22.190 INFO:tasks.workunit.client.0.smithi045.stdout: "stripe_unit": 4194304, 2023-11-28T18:42:22.190 INFO:tasks.workunit.client.0.smithi045.stdout: "stripe_count": 1, 2023-11-28T18:42:22.190 INFO:tasks.workunit.client.0.smithi045.stdout: "object_size": 4194304, 2023-11-28T18:42:22.190 INFO:tasks.workunit.client.0.smithi045.stdout: "pool_id": 6, 2023-11-28T18:42:22.190 INFO:tasks.workunit.client.0.smithi045.stdout: "pool_ns": "" 2023-11-28T18:42:22.190 INFO:tasks.workunit.client.0.smithi045.stdout: } 2023-11-28T18:42:22.190 INFO:tasks.workunit.client.0.smithi045.stdout:} 2023-11-28T18:42:22.190 INFO:tasks.workunit.client.0.smithi045.stdout: 2023-11-28T18:42:22.192 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.175+0000 7f98f19c2280 1 -- 172.21.15.45:0/3908532272 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x562c26a5b800 msgr2=0x562c25ba8100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.193 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.175+0000 7f98f19c2280 1 --2- 172.21.15.45:0/3908532272 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x562c26a5b800 0x562c25ba8100 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.193 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.175+0000 7f98f19c2280 1 -- 172.21.15.45:0/3908532272 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x562c25e17000 msgr2=0x562c25ba9700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.193 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.175+0000 7f98f19c2280 1 --2- 172.21.15.45:0/3908532272 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x562c25e17000 0x562c25ba9700 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x562c26ab2d50 tx=0x562c25bfeb40 comp rx=0 tx=0).stop 2023-11-28T18:42:22.193 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.175+0000 7f98f19c2280 1 -- 172.21.15.45:0/3908532272 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562c26a5b400 msgr2=0x562c25ba8680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.193 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.175+0000 7f98f19c2280 1 --2- 172.21.15.45:0/3908532272 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562c26a5b400 0x562c25ba8680 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x562c269b0300 tx=0x562c2690a300 comp rx=0 tx=0).stop 2023-11-28T18:42:22.193 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.175+0000 7f98f0181640 1 -- 172.21.15.45:0/3908532272 reap_dead start 2023-11-28T18:42:22.193 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.175+0000 7f98f19c2280 1 -- 172.21.15.45:0/3908532272 shutdown_connections 2023-11-28T18:42:22.193 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.175+0000 7f98f19c2280 1 -- 172.21.15.45:0/3908532272 >> 172.21.15.45:0/3908532272 conn(0x562c25b3ac00 msgr2=0x562c25b67000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:22.193 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.175+0000 7f98f19c2280 1 -- 172.21.15.45:0/3908532272 shutdown_connections 2023-11-28T18:42:22.193 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.175+0000 7f98f19c2280 1 -- 172.21.15.45:0/3908532272 wait complete. 2023-11-28T18:42:22.194 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.175+0000 7f98f19c2280 1 -- 172.21.15.45:0/2036966108 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562c25b3b000 msgr2=0x562c25ba7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.194 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.175+0000 7f98f19c2280 1 --2- 172.21.15.45:0/2036966108 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562c25b3b000 0x562c25ba7080 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x562c269b0cf0 tx=0x562c268c3080 comp rx=0 tx=0).stop 2023-11-28T18:42:22.194 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.175+0000 7f98f19c2280 1 -- 172.21.15.45:0/2036966108 shutdown_connections 2023-11-28T18:42:22.194 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.175+0000 7f98f19c2280 1 --2- 172.21.15.45:0/2036966108 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562c25b3b000 0x562c25ba7080 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.194 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.175+0000 7f98f19c2280 1 --2- 172.21.15.45:0/2036966108 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562c25b3b400 0x562c25ba6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.194 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.175+0000 7f98f19c2280 1 --2- 172.21.15.45:0/2036966108 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562c25b3b800 0x562c25ba6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.194 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.175+0000 7f98f19c2280 1 -- 172.21.15.45:0/2036966108 >> 172.21.15.45:0/2036966108 conn(0x562c25b3bc00 msgr2=0x562c25b67800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:22.194 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.175+0000 7f98f19c2280 1 -- 172.21.15.45:0/2036966108 shutdown_connections 2023-11-28T18:42:22.194 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.175+0000 7f98f19c2280 1 -- 172.21.15.45:0/2036966108 wait complete. 2023-11-28T18:42:22.194 INFO:tasks.workunit.client.0.smithi045.stderr:+ cephfs-journal-tool --rank=cephfs:0 journal export /tmp/journal.bin 2023-11-28T18:42:22.226 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.223+0000 7f930262b280 1 -- start start 2023-11-28T18:42:22.226 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.223+0000 7f930262b280 1 Processor -- start 2023-11-28T18:42:22.228 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.223+0000 7f930262b280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560d430b9800 0x560d43124580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.228 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.223+0000 7f930262b280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560d430b9400 0x560d43124b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.228 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.223+0000 7f930262b280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560d430b9000 0x560d43125080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.228 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.223+0000 7f930262b280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d430ff180 con 0x560d430b9000 2023-11-28T18:42:22.228 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.223+0000 7f930262b280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d43189180 con 0x560d430b9400 2023-11-28T18:42:22.228 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.223+0000 7f930262b280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x560d430fe140 con 0x560d430b9800 2023-11-28T18:42:22.228 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.223+0000 7f9300520640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560d430b9000 0x560d43125080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.228 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.223+0000 7f92ffd1f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560d430b9800 0x560d43124580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.229 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.223+0000 7f92ffd1f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560d430b9800 0x560d43124580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.45:42326/0 (socket says 172.21.15.45:42326) 2023-11-28T18:42:22.229 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.223+0000 7f9300520640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560d430b9000 0x560d43125080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57354/0 (socket says 172.21.15.45:57354) 2023-11-28T18:42:22.229 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.223+0000 7f92ffd1f640 1 -- 172.21.15.45:0/4292323961 learned_addr learned my addr 172.21.15.45:0/4292323961 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:22.229 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.223+0000 7f92ff51e640 1 --2- 172.21.15.45:0/4292323961 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560d430b9400 0x560d43124b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.229 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.223+0000 7f9300520640 1 -- 172.21.15.45:0/4292323961 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560d430b9800 msgr2=0x560d43124580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:22.229 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.223+0000 7f9300520640 1 --2- 172.21.15.45:0/4292323961 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560d430b9800 0x560d43124580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.229 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.223+0000 7f9300520640 1 -- 172.21.15.45:0/4292323961 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560d430b9400 msgr2=0x560d43124b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:22.230 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.223+0000 7f9300520640 1 --2- 172.21.15.45:0/4292323961 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560d430b9400 0x560d43124b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.231 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.223+0000 7f9300520640 1 -- 172.21.15.45:0/4292323961 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560d430ee9c0 con 0x560d430b9000 2023-11-28T18:42:22.231 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.223+0000 7f92ffd1f640 1 --2- 172.21.15.45:0/4292323961 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560d430b9800 0x560d43124580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:42:22.231 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.223+0000 7f92ff51e640 1 --2- 172.21.15.45:0/4292323961 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560d430b9400 0x560d43124b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:42:22.231 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.223+0000 7f9300520640 1 --2- 172.21.15.45:0/4292323961 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560d430b9000 0x560d43125080 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x560d43f34330 tx=0x560d43e8c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acfd2ab68e0c7ae3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.231 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.223+0000 7f92fd51a640 1 -- 172.21.15.45:0/4292323961 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x560d43118f20 con 0x560d430b9000 2023-11-28T18:42:22.231 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.223+0000 7f92fd51a640 1 -- 172.21.15.45:0/4292323961 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560d43114900 con 0x560d430b9000 2023-11-28T18:42:22.231 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.223+0000 7f92fd51a640 1 -- 172.21.15.45:0/4292323961 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x560d431191e0 con 0x560d430b9000 2023-11-28T18:42:22.231 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.223+0000 7f930262b280 1 -- 172.21.15.45:0/4292323961 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560d430ee1a0 con 0x560d430b9000 2023-11-28T18:42:22.231 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.223+0000 7f930262b280 1 -- 172.21.15.45:0/4292323961 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x560d430ee9c0 con 0x560d430b9000 2023-11-28T18:42:22.236 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.223+0000 7f92fd51a640 1 -- 172.21.15.45:0/4292323961 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x560d430fac40 con 0x560d430b9000 2023-11-28T18:42:22.236 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.223+0000 7f92fd51a640 1 -- 172.21.15.45:0/4292323961 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 34) v1 ==== 3298+0+0 (secure 0 0 0) 0x560d43106f00 con 0x560d430b9000 2023-11-28T18:42:22.236 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.227+0000 7f930262b280 1 Processor -- start 2023-11-28T18:42:22.236 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.227+0000 7f930262b280 1 -- start start 2023-11-28T18:42:22.236 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.227+0000 7f930262b280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560d44028000 0x560d43125600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.236 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.227+0000 7f930262b280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560d44028400 0x560d43125b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.236 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.227+0000 7f930262b280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560d44028800 0x560d43126100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.236 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.227+0000 7f930262b280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d430fea00 con 0x560d44028400 2023-11-28T18:42:22.237 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.227+0000 7f930262b280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d430feb40 con 0x560d44028000 2023-11-28T18:42:22.237 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.227+0000 7f930262b280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x560d43188dc0 con 0x560d44028800 2023-11-28T18:42:22.237 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.227+0000 7f92ffd1f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560d44028400 0x560d43125b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.237 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.227+0000 7f92ff51e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560d44028000 0x560d43125600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.237 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.227+0000 7f92ffd1f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560d44028400 0x560d43125b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57362/0 (socket says 172.21.15.45:57362) 2023-11-28T18:42:22.237 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.227+0000 7f92ffd1f640 1 -- 172.21.15.45:0/2636313165 learned_addr learned my addr 172.21.15.45:0/2636313165 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:22.237 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.227+0000 7f92ff51e640 1 --2- 172.21.15.45:0/2636313165 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560d44028800 0x560d43126100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.237 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.227+0000 7f92ffd1f640 1 -- 172.21.15.45:0/2636313165 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560d44028800 msgr2=0x560d43126100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:22.237 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.227+0000 7f92ffd1f640 1 --2- 172.21.15.45:0/2636313165 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560d44028800 0x560d43126100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.237 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.227+0000 7f92ffd1f640 1 -- 172.21.15.45:0/2636313165 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560d44028000 msgr2=0x560d43125600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:22.237 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.227+0000 7f92ffd1f640 1 --2- 172.21.15.45:0/2636313165 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560d44028000 0x560d43125600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.238 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.227+0000 7f92ffd1f640 1 -- 172.21.15.45:0/2636313165 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560d430eeb60 con 0x560d44028400 2023-11-28T18:42:22.238 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.227+0000 7f92ffd1f640 1 --2- 172.21.15.45:0/2636313165 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560d44028400 0x560d43125b80 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x560d4402e180 tx=0x560d44040120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fe7db999e660d5e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.238 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.227+0000 7f92fb516640 1 -- 172.21.15.45:0/2636313165 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x560d43118f20 con 0x560d44028400 2023-11-28T18:42:22.238 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.227+0000 7f92fb516640 1 -- 172.21.15.45:0/2636313165 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560d43114900 con 0x560d44028400 2023-11-28T18:42:22.238 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.227+0000 7f92fb516640 1 -- 172.21.15.45:0/2636313165 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x560d431191e0 con 0x560d44028400 2023-11-28T18:42:22.238 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.227+0000 7f930262b280 1 -- 172.21.15.45:0/2636313165 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560d44028400 msgr2=0x560d43125b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.238 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.227+0000 7f930262b280 1 --2- 172.21.15.45:0/2636313165 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560d44028400 0x560d43125b80 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x560d4402e180 tx=0x560d44040120 comp rx=0 tx=0).stop 2023-11-28T18:42:22.238 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.227+0000 7f930262b280 1 -- 172.21.15.45:0/2636313165 shutdown_connections 2023-11-28T18:42:22.239 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.227+0000 7f930262b280 1 --2- 172.21.15.45:0/2636313165 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560d44028800 0x560d43126100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.239 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.227+0000 7f930262b280 1 --2- 172.21.15.45:0/2636313165 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560d44028400 0x560d43125b80 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.239 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.227+0000 7f930262b280 1 --2- 172.21.15.45:0/2636313165 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560d44028000 0x560d43125600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.239 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.227+0000 7f930262b280 1 -- 172.21.15.45:0/2636313165 >> 172.21.15.45:0/2636313165 conn(0x560d430b8c00 msgr2=0x560d430e5000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:22.239 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.227+0000 7f930262b280 1 -- 172.21.15.45:0/2636313165 shutdown_connections 2023-11-28T18:42:22.239 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.227+0000 7f930262b280 1 -- 172.21.15.45:0/2636313165 wait complete. 2023-11-28T18:42:22.239 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.227+0000 7f930262b280 1 Processor -- start 2023-11-28T18:42:22.239 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.227+0000 7f930262b280 1 -- start start 2023-11-28T18:42:22.239 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.231+0000 7f930262b280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560d44028000 0x560d43127180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.239 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.231+0000 7f930262b280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560d44028400 0x560d43126c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.240 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.231+0000 7f930262b280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560d44028800 0x560d43126680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.240 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.231+0000 7f930262b280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d43188c80 con 0x560d44028800 2023-11-28T18:42:22.240 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.231+0000 7f930262b280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d43188b40 con 0x560d44028400 2023-11-28T18:42:22.240 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.231+0000 7f930262b280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x560d43188a00 con 0x560d44028000 2023-11-28T18:42:22.240 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.231+0000 7f92ff51e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560d44028800 0x560d43126680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.240 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.231+0000 7f92ffd1f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560d44028400 0x560d43126c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.240 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.231+0000 7f92ff51e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560d44028800 0x560d43126680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57374/0 (socket says 172.21.15.45:57374) 2023-11-28T18:42:22.240 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.231+0000 7f92ff51e640 1 -- 172.21.15.45:0/4038222265 learned_addr learned my addr 172.21.15.45:0/4038222265 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:22.240 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.231+0000 7f92ff51e640 1 --2- 172.21.15.45:0/4038222265 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560d44028000 0x560d43127180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.240 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.231+0000 7f92ff51e640 1 -- 172.21.15.45:0/4038222265 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560d44028000 msgr2=0x560d43127180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.241 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.231+0000 7f92ff51e640 1 --2- 172.21.15.45:0/4038222265 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560d44028000 0x560d43127180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.241 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.231+0000 7f92ff51e640 1 -- 172.21.15.45:0/4038222265 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560d44028400 msgr2=0x560d43126c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.241 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.231+0000 7f92ff51e640 1 --2- 172.21.15.45:0/4038222265 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560d44028400 0x560d43126c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.241 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.231+0000 7f92ff51e640 1 -- 172.21.15.45:0/4038222265 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560d430ee340 con 0x560d44028800 2023-11-28T18:42:22.241 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.231+0000 7f92ffd1f640 1 --2- 172.21.15.45:0/4038222265 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560d44028400 0x560d43126c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:42:22.241 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.231+0000 7f92ff51e640 1 --2- 172.21.15.45:0/4038222265 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560d44028800 0x560d43126680 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x560d4402f4a0 tx=0x560d43e36c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.241 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.231+0000 7f92f9d13640 1 -- 172.21.15.45:0/4038222265 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x560d43118f20 con 0x560d44028800 2023-11-28T18:42:22.241 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.231+0000 7f92f9d13640 1 -- 172.21.15.45:0/4038222265 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560d43e84000 con 0x560d44028800 2023-11-28T18:42:22.241 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.231+0000 7f92f9d13640 1 -- 172.21.15.45:0/4038222265 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x560d431191e0 con 0x560d44028800 2023-11-28T18:42:22.241 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.231+0000 7f930262b280 1 -- 172.21.15.45:0/4038222265 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560d430ee000 con 0x560d44028800 2023-11-28T18:42:22.241 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.231+0000 7f930262b280 1 -- 172.21.15.45:0/4038222265 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560d430eeea0 con 0x560d44028800 2023-11-28T18:42:22.241 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.231+0000 7f92f9d13640 1 -- 172.21.15.45:0/4038222265 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x560d43146840 con 0x560d44028800 2023-11-28T18:42:22.246 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.231+0000 7f92f9d13640 1 --2- 172.21.15.45:0/4038222265 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x560d433ad800 0x560d43127700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.246 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.231+0000 7f92f9d13640 1 -- 172.21.15.45:0/4038222265 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x560d430faa80 con 0x560d44028800 2023-11-28T18:42:22.246 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.231+0000 7f930262b280 1 --2- 172.21.15.45:0/4038222265 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x560d44028c00 0x560d43126100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.246 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.231+0000 7f930262b280 1 -- 172.21.15.45:0/4038222265 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x560d4310f880 con 0x560d44028c00 2023-11-28T18:42:22.246 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.231+0000 7f92ffd1f640 1 --2- 172.21.15.45:0/4038222265 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x560d433ad800 0x560d43127700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.247 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.235+0000 7f92ff51e640 1 --2- 172.21.15.45:0/4038222265 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x560d44028c00 0x560d43126100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.247 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.235+0000 7f92ff51e640 1 --2- 172.21.15.45:0/4038222265 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x560d44028c00 0x560d43126100 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.247 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.235+0000 7f92ffd1f640 1 --2- 172.21.15.45:0/4038222265 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x560d433ad800 0x560d43127700 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x560d4402e180 tx=0x560d4313af00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.247 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.235+0000 7f92ff51e640 1 -- 172.21.15.45:0/4038222265 <== osd.2 v2:172.21.15.45:6816/193884539 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x560d43fc0b40 con 0x560d44028c00 2023-11-28T18:42:22.247 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.235+0000 7f930262b280 1 -- 172.21.15.45:0/4038222265 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x560d4310fc00 con 0x560d44028c00 2023-11-28T18:42:22.247 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.235+0000 7f92ff51e640 1 -- 172.21.15.45:0/4038222265 <== osd.2 v2:172.21.15.45:6816/193884539 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv22 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x560d43fc0b40 con 0x560d44028c00 2023-11-28T18:42:22.247 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.235+0000 7f930262b280 1 -- 172.21.15.45:0/4038222265 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:3 6.14 6:2e2fa760:::200.00000001:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x560d4310f880 con 0x560d44028c00 2023-11-28T18:42:22.247 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.235+0000 7f92ff51e640 1 -- 172.21.15.45:0/4038222265 <== osd.2 v2:172.21.15.45:6816/193884539 3 ==== osd_op_reply(3 200.00000001 [read 0~34160 out=34160b] v0'0 uv24 ondisk = 0) v8 ==== 156+0+34160 (crc 0 0 0) 0x560d43fc0b40 con 0x560d44028c00 2023-11-28T18:42:22.247 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.235+0000 7f930262b280 1 --2- 172.21.15.45:0/4038222265 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x560d44029000 0x560d43125b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.247 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.235+0000 7f930262b280 1 -- 172.21.15.45:0/4038222265 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:4 6.1b 6:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x560d4310fc00 con 0x560d44029000 2023-11-28T18:42:22.247 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.235+0000 7f9300520640 1 --2- 172.21.15.45:0/4038222265 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x560d44029000 0x560d43125b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.248 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.235+0000 7f9300520640 1 --2- 172.21.15.45:0/4038222265 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x560d44029000 0x560d43125b80 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.248 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.235+0000 7f9300520640 1 -- 172.21.15.45:0/4038222265 <== osd.3 v2:172.21.15.45:6824/78541084 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x560d43fc0d80 con 0x560d44029000 2023-11-28T18:42:22.248 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.235+0000 7f930262b280 1 -- start start 2023-11-28T18:42:22.248 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.235+0000 7f930262b280 1 Processor -- start 2023-11-28T18:42:22.248 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.239+0000 7f930262b280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560d43500000 0x560d43125600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.248 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.239+0000 7f930262b280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560d43500400 0x560d43506000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.248 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.239+0000 7f930262b280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560d43500800 0x560d43506580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.248 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.239+0000 7f930262b280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d430fe140 con 0x560d43500800 2023-11-28T18:42:22.248 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.239+0000 7f930262b280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d43188a00 con 0x560d43500000 2023-11-28T18:42:22.248 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.239+0000 7f930262b280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x560d43188b40 con 0x560d43500400 2023-11-28T18:42:22.249 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.239+0000 7f92ff51e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560d43500000 0x560d43125600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.249 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.239+0000 7f92ffd1f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560d43500800 0x560d43506580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.249 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.239+0000 7f9300520640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560d43500400 0x560d43506000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.249 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.239+0000 7f92ff51e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560d43500000 0x560d43125600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.45:37976/0 (socket says 172.21.15.45:37976) 2023-11-28T18:42:22.249 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.239+0000 7f92ff51e640 1 -- 172.21.15.45:0/133159754 learned_addr learned my addr 172.21.15.45:0/133159754 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:22.249 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.239+0000 7f9300520640 1 -- 172.21.15.45:0/133159754 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560d43500000 msgr2=0x560d43125600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:22.249 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.239+0000 7f9300520640 1 --2- 172.21.15.45:0/133159754 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560d43500000 0x560d43125600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.249 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.239+0000 7f9300520640 1 -- 172.21.15.45:0/133159754 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560d43500800 msgr2=0x560d43506580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:22.249 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.239+0000 7f9300520640 1 --2- 172.21.15.45:0/133159754 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560d43500800 0x560d43506580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.249 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.239+0000 7f9300520640 1 -- 172.21.15.45:0/133159754 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560d433e36c0 con 0x560d43500400 2023-11-28T18:42:22.249 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.239+0000 7f92ff51e640 1 --2- 172.21.15.45:0/133159754 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560d43500000 0x560d43125600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:42:22.250 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.239+0000 7f9300520640 1 --2- 172.21.15.45:0/133159754 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560d43500400 0x560d43506000 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x560d43f34390 tx=0x560d43e8c300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=886bd7941e7f6442 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.250 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.239+0000 7f92f6d0d640 1 -- 172.21.15.45:0/133159754 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x560d43119080 con 0x560d43500400 2023-11-28T18:42:22.250 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.239+0000 7f92f6d0d640 1 -- 172.21.15.45:0/133159754 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560d43e85380 con 0x560d43500400 2023-11-28T18:42:22.250 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.239+0000 7f92f6d0d640 1 -- 172.21.15.45:0/133159754 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x560d43118dc0 con 0x560d43500400 2023-11-28T18:42:22.250 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.239+0000 7f930262b280 1 -- 172.21.15.45:0/133159754 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560d433e1a00 con 0x560d43500400 2023-11-28T18:42:22.250 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.239+0000 7f930262b280 1 -- 172.21.15.45:0/133159754 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({fsmap=0}) v3 -- 0x560d433e1860 con 0x560d43500400 2023-11-28T18:42:22.250 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.239+0000 7f92f6d0d640 1 -- 172.21.15.45:0/133159754 <== mon.2 v2:172.21.15.190:3301/0 4 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x560d430fa8c0 con 0x560d43500400 2023-11-28T18:42:22.250 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.239+0000 7f92f6d0d640 1 -- 172.21.15.45:0/133159754 <== mon.2 v2:172.21.15.190:3301/0 5 ==== fsmap(e 34) v1 ==== 3298+0+0 (secure 0 0 0) 0x560d43518900 con 0x560d43500400 2023-11-28T18:42:22.250 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.239+0000 7f930262b280 1 --2- 172.21.15.45:0/133159754 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x560d43500c00 0x560d43506b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.250 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.239+0000 7f930262b280 1 -- 172.21.15.45:0/133159754 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x560d43528380 con 0x560d43500c00 2023-11-28T18:42:22.250 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.239+0000 7f92ff51e640 1 --2- 172.21.15.45:0/133159754 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x560d43500c00 0x560d43506b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.250 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.239+0000 7f92ff51e640 1 --2- 172.21.15.45:0/133159754 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x560d43500c00 0x560d43506b00 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=fd9f9f367ea0bf8b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.251 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.239+0000 7f92ff51e640 1 -- 172.21.15.45:0/133159754 <== osd.2 v2:172.21.15.45:6816/193884539 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x560d43fc0b40 con 0x560d43500c00 2023-11-28T18:42:22.251 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.239+0000 7f930262b280 1 -- 172.21.15.45:0/133159754 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x560d43528700 con 0x560d43500c00 2023-11-28T18:42:22.251 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.239+0000 7f92ff51e640 1 -- 172.21.15.45:0/133159754 <== osd.2 v2:172.21.15.45:6816/193884539 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv22 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x560d43fc0b40 con 0x560d43500c00 2023-11-28T18:42:22.251 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.239+0000 7f92f550a640 1 -- 172.21.15.45:0/133159754 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:3 6.14 6:2e2fa760:::200.00000001:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e49) v8 -- 0x560d4310f880 con 0x560d43500c00 2023-11-28T18:42:22.251 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.239+0000 7f92f550a640 1 --2- 172.21.15.45:0/133159754 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x560d43513400 0x560d43508680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.251 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.239+0000 7f92f550a640 1 -- 172.21.15.45:0/133159754 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:4 6.1b 6:ddb4e4d7:::200.00000002:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e49) v8 -- 0x560d43528380 con 0x560d43513400 2023-11-28T18:42:22.251 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.243+0000 7f92ffd1f640 1 --2- 172.21.15.45:0/133159754 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x560d43513400 0x560d43508680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.251 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.243+0000 7f92ff51e640 1 -- 172.21.15.45:0/133159754 <== osd.2 v2:172.21.15.45:6816/193884539 3 ==== osd_op_reply(3 200.00000001 [stat out=16b] v0'0 uv24 ondisk = 0) v8 ==== 156+0+16 (crc 0 0 0) 0x560d43fc0b40 con 0x560d43500c00 2023-11-28T18:42:22.251 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.243+0000 7f92ffd1f640 1 --2- 172.21.15.45:0/133159754 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x560d43513400 0x560d43508680 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=4416267e841b2881 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.251 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.243+0000 7f92ffd1f640 1 -- 172.21.15.45:0/133159754 <== osd.3 v2:172.21.15.45:6824/78541084 1 ==== osd_op_reply(4 200.00000002 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x560d43fc1440 con 0x560d43513400 2023-11-28T18:42:22.252 INFO:tasks.workunit.client.0.smithi045.stdout:journal is 4194304~34160 2023-11-28T18:42:22.252 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.243+0000 7f930262b280 1 -- 172.21.15.45:0/133159754 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:5 6.14 6:2e2fa760:::200.00000001:head [read 0~34160] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x560d43528a80 con 0x560d43500c00 2023-11-28T18:42:22.252 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.243+0000 7f92ff51e640 1 -- 172.21.15.45:0/133159754 <== osd.2 v2:172.21.15.45:6816/193884539 4 ==== osd_op_reply(5 200.00000001 [read 0~34160 out=34160b] v0'0 uv24 ondisk = 0) v8 ==== 156+0+34160 (crc 0 0 0) 0x560d43fc0b40 con 0x560d43500c00 2023-11-28T18:42:22.252 INFO:tasks.workunit.client.0.smithi045.stdout:wrote 34160 bytes at offset 4194304 to /tmp/journal.bin 2023-11-28T18:42:22.252 INFO:tasks.workunit.client.0.smithi045.stdout:NOTE: this is a _sparse_ file; you can 2023-11-28T18:42:22.253 INFO:tasks.workunit.client.0.smithi045.stdout: $ tar cSzf /tmp/journal.bin.tgz /tmp/journal.bin 2023-11-28T18:42:22.253 INFO:tasks.workunit.client.0.smithi045.stdout: to efficiently compress it while preserving sparseness. 2023-11-28T18:42:22.255 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.243+0000 7f930262b280 1 -- 172.21.15.45:0/133159754 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x560d43500c00 msgr2=0x560d43506b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.255 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.243+0000 7f930262b280 1 --2- 172.21.15.45:0/133159754 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x560d43500c00 0x560d43506b00 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.255 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.243+0000 7f930262b280 1 -- 172.21.15.45:0/133159754 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x560d43513400 msgr2=0x560d43508680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.255 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.243+0000 7f930262b280 1 --2- 172.21.15.45:0/133159754 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x560d43513400 0x560d43508680 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.255 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.243+0000 7f930262b280 1 -- 172.21.15.45:0/133159754 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560d43500400 msgr2=0x560d43506000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.255 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.243+0000 7f930262b280 1 --2- 172.21.15.45:0/133159754 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560d43500400 0x560d43506000 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x560d43f34390 tx=0x560d43e8c300 comp rx=0 tx=0).stop 2023-11-28T18:42:22.255 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.243+0000 7f92ffd1f640 1 -- 172.21.15.45:0/133159754 reap_dead start 2023-11-28T18:42:22.255 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.243+0000 7f930262b280 1 -- 172.21.15.45:0/133159754 shutdown_connections 2023-11-28T18:42:22.255 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.243+0000 7f930262b280 1 -- 172.21.15.45:0/133159754 >> 172.21.15.45:0/133159754 conn(0x560d44029400 msgr2=0x560d430e4800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:22.255 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.243+0000 7f930262b280 1 -- 172.21.15.45:0/133159754 shutdown_connections 2023-11-28T18:42:22.255 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.243+0000 7f930262b280 1 -- 172.21.15.45:0/133159754 wait complete. 2023-11-28T18:42:22.256 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.243+0000 7f930262b280 1 -- 172.21.15.45:0/4038222265 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x560d44028c00 msgr2=0x560d43126100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.256 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.243+0000 7f930262b280 1 --2- 172.21.15.45:0/4038222265 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x560d44028c00 0x560d43126100 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.256 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.243+0000 7f930262b280 1 -- 172.21.15.45:0/4038222265 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x560d44029000 msgr2=0x560d43125b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.256 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.243+0000 7f930262b280 1 --2- 172.21.15.45:0/4038222265 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x560d44029000 0x560d43125b80 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.256 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.243+0000 7f930262b280 1 -- 172.21.15.45:0/4038222265 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x560d433ad800 msgr2=0x560d43127700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.256 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.243+0000 7f930262b280 1 --2- 172.21.15.45:0/4038222265 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x560d433ad800 0x560d43127700 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x560d4402e180 tx=0x560d4313af00 comp rx=0 tx=0).stop 2023-11-28T18:42:22.256 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.243+0000 7f930262b280 1 -- 172.21.15.45:0/4038222265 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560d44028800 msgr2=0x560d43126680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.256 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.243+0000 7f930262b280 1 --2- 172.21.15.45:0/4038222265 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560d44028800 0x560d43126680 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x560d4402f4a0 tx=0x560d43e36c60 comp rx=0 tx=0).stop 2023-11-28T18:42:22.256 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.243+0000 7f92ffd1f640 1 -- 172.21.15.45:0/4038222265 reap_dead start 2023-11-28T18:42:22.256 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.243+0000 7f92ffd1f640 1 -- 172.21.15.45:0/4038222265 reap_dead start 2023-11-28T18:42:22.256 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.243+0000 7f930262b280 1 -- 172.21.15.45:0/4038222265 shutdown_connections 2023-11-28T18:42:22.256 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.243+0000 7f930262b280 1 -- 172.21.15.45:0/4038222265 >> 172.21.15.45:0/4038222265 conn(0x560d430b8c00 msgr2=0x560d430e5000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:22.257 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.243+0000 7f930262b280 1 -- 172.21.15.45:0/4038222265 shutdown_connections 2023-11-28T18:42:22.257 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.243+0000 7f930262b280 1 -- 172.21.15.45:0/4038222265 wait complete. 2023-11-28T18:42:22.257 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.243+0000 7f930262b280 1 -- 172.21.15.45:0/4292323961 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560d430b9000 msgr2=0x560d43125080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.257 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.243+0000 7f930262b280 1 --2- 172.21.15.45:0/4292323961 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560d430b9000 0x560d43125080 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x560d43f34330 tx=0x560d43e8c000 comp rx=0 tx=0).stop 2023-11-28T18:42:22.257 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.243+0000 7f930262b280 1 -- 172.21.15.45:0/4292323961 shutdown_connections 2023-11-28T18:42:22.257 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.243+0000 7f930262b280 1 --2- 172.21.15.45:0/4292323961 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560d430b9000 0x560d43125080 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.257 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.243+0000 7f930262b280 1 --2- 172.21.15.45:0/4292323961 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560d430b9400 0x560d43124b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.257 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.243+0000 7f930262b280 1 --2- 172.21.15.45:0/4292323961 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560d430b9800 0x560d43124580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.257 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.243+0000 7f930262b280 1 -- 172.21.15.45:0/4292323961 >> 172.21.15.45:0/4292323961 conn(0x560d430b9c00 msgr2=0x560d430e5800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:22.257 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.243+0000 7f930262b280 1 -- 172.21.15.45:0/4292323961 shutdown_connections 2023-11-28T18:42:22.257 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.243+0000 7f930262b280 1 -- 172.21.15.45:0/4292323961 wait complete. 2023-11-28T18:42:22.257 INFO:tasks.workunit.client.0.smithi045.stderr:+ '[' '!' -s /tmp/journal.bin ']' 2023-11-28T18:42:22.257 INFO:tasks.workunit.client.0.smithi045.stderr:+ cephfs-journal-tool --rank=cephfs:0 journal reset 2023-11-28T18:42:22.294 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.291+0000 7f8a16b7c280 1 -- start start 2023-11-28T18:42:22.294 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.291+0000 7f8a16b7c280 1 Processor -- start 2023-11-28T18:42:22.296 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.291+0000 7f8a16b7c280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5641a2c6d800 0x5641a2cd8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.296 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.291+0000 7f8a16b7c280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5641a2c6d400 0x5641a2cd8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.297 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.291+0000 7f8a16b7c280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5641a2c6d000 0x5641a2cd9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.297 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.291+0000 7f8a16b7c280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641a2cb3180 con 0x5641a2c6d400 2023-11-28T18:42:22.297 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.291+0000 7f8a16b7c280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641a2cb2000 con 0x5641a2c6d800 2023-11-28T18:42:22.297 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.291+0000 7f8a16b7c280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x5641a2cb2140 con 0x5641a2c6d000 2023-11-28T18:42:22.297 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.291+0000 7f8a14b3a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5641a2c6d400 0x5641a2cd8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.297 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.291+0000 7f8a14b3a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5641a2c6d400 0x5641a2cd8b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57390/0 (socket says 172.21.15.45:57390) 2023-11-28T18:42:22.297 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.291+0000 7f8a14b3a640 1 -- 172.21.15.45:0/185843049 learned_addr learned my addr 172.21.15.45:0/185843049 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:22.297 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.291+0000 7f8a15b3c640 1 --2- 172.21.15.45:0/185843049 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5641a2c6d000 0x5641a2cd9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.297 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.291+0000 7f8a1533b640 1 --2- 172.21.15.45:0/185843049 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5641a2c6d800 0x5641a2cd8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.297 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.291+0000 7f8a14b3a640 1 -- 172.21.15.45:0/185843049 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5641a2c6d000 msgr2=0x5641a2cd9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:22.297 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.291+0000 7f8a14b3a640 1 --2- 172.21.15.45:0/185843049 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5641a2c6d000 0x5641a2cd9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.297 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.291+0000 7f8a14b3a640 1 -- 172.21.15.45:0/185843049 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5641a2c6d800 msgr2=0x5641a2cd8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:22.298 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.291+0000 7f8a14b3a640 1 --2- 172.21.15.45:0/185843049 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5641a2c6d800 0x5641a2cd8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.298 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.291+0000 7f8a14b3a640 1 -- 172.21.15.45:0/185843049 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5641a2ca29c0 con 0x5641a2c6d400 2023-11-28T18:42:22.298 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.291+0000 7f8a15b3c640 1 --2- 172.21.15.45:0/185843049 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5641a2c6d000 0x5641a2cd9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:42:22.298 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.291+0000 7f8a1533b640 1 --2- 172.21.15.45:0/185843049 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5641a2c6d800 0x5641a2cd8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:42:22.298 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.291+0000 7f8a14b3a640 1 --2- 172.21.15.45:0/185843049 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5641a2c6d400 0x5641a2cd8b00 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x5641a3a2af00 tx=0x5641a39eaf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fadd3249b4d6708 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.298 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.291+0000 7f8a12b36640 1 -- 172.21.15.45:0/185843049 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5641a2ccd1e0 con 0x5641a2c6d400 2023-11-28T18:42:22.298 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.291+0000 7f8a12b36640 1 -- 172.21.15.45:0/185843049 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5641a2cc8900 con 0x5641a2c6d400 2023-11-28T18:42:22.298 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.291+0000 7f8a12b36640 1 -- 172.21.15.45:0/185843049 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5641a2ccd080 con 0x5641a2c6d400 2023-11-28T18:42:22.298 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.291+0000 7f8a16b7c280 1 -- 172.21.15.45:0/185843049 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5641a2ca2b60 con 0x5641a2c6d400 2023-11-28T18:42:22.298 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.291+0000 7f8a16b7c280 1 -- 172.21.15.45:0/185843049 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x5641a2ca2340 con 0x5641a2c6d400 2023-11-28T18:42:22.299 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.291+0000 7f8a12b36640 1 -- 172.21.15.45:0/185843049 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x5641a2caec40 con 0x5641a2c6d400 2023-11-28T18:42:22.299 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.291+0000 7f8a12b36640 1 -- 172.21.15.45:0/185843049 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 34) v1 ==== 3298+0+0 (secure 0 0 0) 0x5641a2cbaf00 con 0x5641a2c6d400 2023-11-28T18:42:22.303 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.295+0000 7f8a16b7c280 1 Processor -- start 2023-11-28T18:42:22.303 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.295+0000 7f8a16b7c280 1 -- start start 2023-11-28T18:42:22.303 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.295+0000 7f8a16b7c280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5641a3b8cc00 0x5641a2cd9600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.303 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.295+0000 7f8a16b7c280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5641a3b8d000 0x5641a2cd9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.303 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.295+0000 7f8a16b7c280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5641a3b8d400 0x5641a2cda100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.303 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.295+0000 7f8a16b7c280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641a2cb2a00 con 0x5641a3b8d400 2023-11-28T18:42:22.303 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.295+0000 7f8a16b7c280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641a2d3d180 con 0x5641a3b8d000 2023-11-28T18:42:22.303 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.295+0000 7f8a16b7c280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x5641a2d3cdc0 con 0x5641a3b8cc00 2023-11-28T18:42:22.303 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.295+0000 7f8a14b3a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5641a3b8d400 0x5641a2cda100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.304 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.295+0000 7f8a15b3c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5641a3b8cc00 0x5641a2cd9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.304 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.295+0000 7f8a15b3c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5641a3b8cc00 0x5641a2cd9600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.45:42392/0 (socket says 172.21.15.45:42392) 2023-11-28T18:42:22.304 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.295+0000 7f8a15b3c640 1 -- 172.21.15.45:0/1312930651 learned_addr learned my addr 172.21.15.45:0/1312930651 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:22.304 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.295+0000 7f8a14b3a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5641a3b8d400 0x5641a2cda100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57392/0 (socket says 172.21.15.45:57392) 2023-11-28T18:42:22.304 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.295+0000 7f8a1533b640 1 --2- 172.21.15.45:0/1312930651 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5641a3b8d000 0x5641a2cd9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.304 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.295+0000 7f8a14b3a640 1 -- 172.21.15.45:0/1312930651 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5641a3b8cc00 msgr2=0x5641a2cd9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:22.304 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.295+0000 7f8a14b3a640 1 --2- 172.21.15.45:0/1312930651 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5641a3b8cc00 0x5641a2cd9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.304 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.295+0000 7f8a14b3a640 1 -- 172.21.15.45:0/1312930651 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5641a3b8d000 msgr2=0x5641a2cd9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:22.304 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.295+0000 7f8a14b3a640 1 --2- 172.21.15.45:0/1312930651 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5641a3b8d000 0x5641a2cd9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.304 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.295+0000 7f8a14b3a640 1 -- 172.21.15.45:0/1312930651 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5641a2ca2000 con 0x5641a3b8d400 2023-11-28T18:42:22.304 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.295+0000 7f8a14b3a640 1 --2- 172.21.15.45:0/1312930651 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5641a3b8d400 0x5641a2cda100 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x5641a3bf2060 tx=0x5641a39eaea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=898707e3da144c85 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.304 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.295+0000 7f8a10b32640 1 -- 172.21.15.45:0/1312930651 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5641a2cccdc0 con 0x5641a3b8d400 2023-11-28T18:42:22.305 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.295+0000 7f8a10b32640 1 -- 172.21.15.45:0/1312930651 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5641a3a53500 con 0x5641a3b8d400 2023-11-28T18:42:22.305 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.295+0000 7f8a10b32640 1 -- 172.21.15.45:0/1312930651 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5641a2ccd1e0 con 0x5641a3b8d400 2023-11-28T18:42:22.305 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.295+0000 7f8a16b7c280 1 -- 172.21.15.45:0/1312930651 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5641a3b8d400 msgr2=0x5641a2cda100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.305 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.295+0000 7f8a16b7c280 1 --2- 172.21.15.45:0/1312930651 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5641a3b8d400 0x5641a2cda100 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x5641a3bf2060 tx=0x5641a39eaea0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.305 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.295+0000 7f8a16b7c280 1 -- 172.21.15.45:0/1312930651 shutdown_connections 2023-11-28T18:42:22.305 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.295+0000 7f8a16b7c280 1 --2- 172.21.15.45:0/1312930651 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5641a3b8d400 0x5641a2cda100 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.305 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.295+0000 7f8a16b7c280 1 --2- 172.21.15.45:0/1312930651 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5641a3b8d000 0x5641a2cd9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.305 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.295+0000 7f8a16b7c280 1 --2- 172.21.15.45:0/1312930651 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5641a3b8cc00 0x5641a2cd9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.305 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.295+0000 7f8a16b7c280 1 -- 172.21.15.45:0/1312930651 >> 172.21.15.45:0/1312930651 conn(0x5641a2c6cc00 msgr2=0x5641a2c9b800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:22.305 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.295+0000 7f8a16b7c280 1 -- 172.21.15.45:0/1312930651 shutdown_connections 2023-11-28T18:42:22.305 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.295+0000 7f8a16b7c280 1 -- 172.21.15.45:0/1312930651 wait complete. 2023-11-28T18:42:22.305 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.295+0000 7f8a16b7c280 1 Processor -- start 2023-11-28T18:42:22.306 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.295+0000 7f8a16b7c280 1 -- start start 2023-11-28T18:42:22.306 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.299+0000 7f8a16b7c280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5641a3b8cc00 0x5641a2cdb180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.306 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.299+0000 7f8a16b7c280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5641a3b8d000 0x5641a2cdac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.306 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.299+0000 7f8a16b7c280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5641a3b8d400 0x5641a2cda680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.306 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.299+0000 7f8a16b7c280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641a2d3cc80 con 0x5641a3b8d400 2023-11-28T18:42:22.306 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.299+0000 7f8a16b7c280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641a2cb2000 con 0x5641a3b8cc00 2023-11-28T18:42:22.306 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.299+0000 7f8a16b7c280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x5641a2cb2b40 con 0x5641a3b8d000 2023-11-28T18:42:22.306 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.299+0000 7f8a14b3a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5641a3b8d400 0x5641a2cda680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.306 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.299+0000 7f8a14b3a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5641a3b8d400 0x5641a2cda680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57406/0 (socket says 172.21.15.45:57406) 2023-11-28T18:42:22.306 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.299+0000 7f8a14b3a640 1 -- 172.21.15.45:0/3797055657 learned_addr learned my addr 172.21.15.45:0/3797055657 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:22.307 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.299+0000 7f8a15b3c640 1 --2- 172.21.15.45:0/3797055657 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5641a3b8cc00 0x5641a2cdb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.307 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.299+0000 7f8a1533b640 1 --2- 172.21.15.45:0/3797055657 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5641a3b8d000 0x5641a2cdac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.307 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.299+0000 7f8a14b3a640 1 -- 172.21.15.45:0/3797055657 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5641a3b8d000 msgr2=0x5641a2cdac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.308 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.299+0000 7f8a14b3a640 1 --2- 172.21.15.45:0/3797055657 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5641a3b8d000 0x5641a2cdac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.308 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.299+0000 7f8a14b3a640 1 -- 172.21.15.45:0/3797055657 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5641a3b8cc00 msgr2=0x5641a2cdb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.308 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.299+0000 7f8a14b3a640 1 --2- 172.21.15.45:0/3797055657 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5641a3b8cc00 0x5641a2cdb180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.308 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.299+0000 7f8a14b3a640 1 -- 172.21.15.45:0/3797055657 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5641a2ca29c0 con 0x5641a3b8d400 2023-11-28T18:42:22.308 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.299+0000 7f8a14b3a640 1 --2- 172.21.15.45:0/3797055657 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5641a3b8d400 0x5641a2cda680 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x5641a3bf3410 tx=0x5641a3bf40c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.308 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.299+0000 7f8a0f32f640 1 -- 172.21.15.45:0/3797055657 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5641a2ccd080 con 0x5641a3b8d400 2023-11-28T18:42:22.308 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.299+0000 7f8a0f32f640 1 -- 172.21.15.45:0/3797055657 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5641a3a52d80 con 0x5641a3b8d400 2023-11-28T18:42:22.308 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.299+0000 7f8a0f32f640 1 -- 172.21.15.45:0/3797055657 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5641a2ccc420 con 0x5641a3b8d400 2023-11-28T18:42:22.308 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.299+0000 7f8a16b7c280 1 -- 172.21.15.45:0/3797055657 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5641a2ca2b60 con 0x5641a3b8d400 2023-11-28T18:42:22.309 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.299+0000 7f8a16b7c280 1 -- 172.21.15.45:0/3797055657 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5641a2ca2ea0 con 0x5641a3b8d400 2023-11-28T18:42:22.313 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.299+0000 7f8a0f32f640 1 -- 172.21.15.45:0/3797055657 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x5641a2cfa840 con 0x5641a3b8d400 2023-11-28T18:42:22.313 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.299+0000 7f8a0f32f640 1 --2- 172.21.15.45:0/3797055657 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x5641a2f57400 0x5641a2cdb700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.313 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.299+0000 7f8a0f32f640 1 -- 172.21.15.45:0/3797055657 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x5641a2caea80 con 0x5641a3b8d400 2023-11-28T18:42:22.313 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.303+0000 7f8a15b3c640 1 --2- 172.21.15.45:0/3797055657 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x5641a2f57400 0x5641a2cdb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.313 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.303+0000 7f8a15b3c640 1 --2- 172.21.15.45:0/3797055657 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x5641a2f57400 0x5641a2cdb700 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x5641a3bf2240 tx=0x5641a303cc00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.313 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.303+0000 7f8a16b7c280 1 -- start start 2023-11-28T18:42:22.313 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.303+0000 7f8a16b7c280 1 Processor -- start 2023-11-28T18:42:22.314 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.303+0000 7f8a16b7c280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5641a3b8dc00 0x5641a2cda100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.314 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.303+0000 7f8a16b7c280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5641a3098000 0x5641a2cd9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.314 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.303+0000 7f8a16b7c280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5641a3098400 0x5641a2cd9600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.314 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.303+0000 7f8a16b7c280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641a2d3cc80 con 0x5641a3098000 2023-11-28T18:42:22.314 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.303+0000 7f8a16b7c280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641a2d3cdc0 con 0x5641a3b8dc00 2023-11-28T18:42:22.314 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.303+0000 7f8a16b7c280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x5641a2d3d180 con 0x5641a3098400 2023-11-28T18:42:22.314 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.303+0000 7f8a1533b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5641a3098000 0x5641a2cd9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.315 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.303+0000 7f8a1533b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5641a3098000 0x5641a2cd9b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57408/0 (socket says 172.21.15.45:57408) 2023-11-28T18:42:22.315 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.303+0000 7f8a1533b640 1 -- 172.21.15.45:0/4167041719 learned_addr learned my addr 172.21.15.45:0/4167041719 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:22.315 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.303+0000 7f8a15b3c640 1 --2- 172.21.15.45:0/4167041719 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5641a3b8dc00 0x5641a2cda100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.315 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.303+0000 7f8a14b3a640 1 --2- 172.21.15.45:0/4167041719 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5641a3098400 0x5641a2cd9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.315 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.303+0000 7f8a1533b640 1 -- 172.21.15.45:0/4167041719 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5641a3098400 msgr2=0x5641a2cd9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:22.315 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.303+0000 7f8a1533b640 1 --2- 172.21.15.45:0/4167041719 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5641a3098400 0x5641a2cd9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.315 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.303+0000 7f8a1533b640 1 -- 172.21.15.45:0/4167041719 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5641a3b8dc00 msgr2=0x5641a2cda100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:22.315 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.303+0000 7f8a1533b640 1 --2- 172.21.15.45:0/4167041719 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5641a3b8dc00 0x5641a2cda100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.315 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.303+0000 7f8a1533b640 1 -- 172.21.15.45:0/4167041719 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5641a2f87380 con 0x5641a3098000 2023-11-28T18:42:22.315 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.303+0000 7f8a15b3c640 1 --2- 172.21.15.45:0/4167041719 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5641a3b8dc00 0x5641a2cda100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:42:22.315 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.303+0000 7f8a1533b640 1 --2- 172.21.15.45:0/4167041719 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5641a3098000 0x5641a2cd9b80 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x5641a3a2a3f0 tx=0x5641a3a3a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=946fa5d58a249404 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.315 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.303+0000 7f8a0c329640 1 -- 172.21.15.45:0/4167041719 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5641a2cccf20 con 0x5641a3098000 2023-11-28T18:42:22.316 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.303+0000 7f8a0c329640 1 -- 172.21.15.45:0/4167041719 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5641a3a52480 con 0x5641a3098000 2023-11-28T18:42:22.316 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.303+0000 7f8a0c329640 1 -- 172.21.15.45:0/4167041719 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5641a2ccd1e0 con 0x5641a3098000 2023-11-28T18:42:22.316 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.303+0000 7f8a16b7c280 1 -- 172.21.15.45:0/4167041719 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5641a2f871e0 con 0x5641a3098000 2023-11-28T18:42:22.316 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.303+0000 7f8a16b7c280 1 -- 172.21.15.45:0/4167041719 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x5641a2f87040 con 0x5641a3098000 2023-11-28T18:42:22.316 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.303+0000 7f8a0c329640 1 -- 172.21.15.45:0/4167041719 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x5641a2cae700 con 0x5641a3098000 2023-11-28T18:42:22.316 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.303+0000 7f8a0c329640 1 -- 172.21.15.45:0/4167041719 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 34) v1 ==== 3298+0+0 (secure 0 0 0) 0x5641a30a8000 con 0x5641a3098000 2023-11-28T18:42:22.316 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.303+0000 7f8a16b7c280 1 --2- 172.21.15.45:0/4167041719 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x5641a3098800 0x5641a30b8000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.316 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.303+0000 7f8a16b7c280 1 -- 172.21.15.45:0/4167041719 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x5641a30bc000 con 0x5641a3098800 2023-11-28T18:42:22.316 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.303+0000 7f8a15b3c640 1 --2- 172.21.15.45:0/4167041719 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x5641a3098800 0x5641a30b8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.317 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.307+0000 7f8a15b3c640 1 --2- 172.21.15.45:0/4167041719 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x5641a3098800 0x5641a30b8000 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=18219584a938a1da server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.317 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.307+0000 7f8a15b3c640 1 -- 172.21.15.45:0/4167041719 <== osd.2 v2:172.21.15.45:6816/193884539 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x5641a3a38b40 con 0x5641a3098800 2023-11-28T18:42:22.317 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.307+0000 7f8a16b7c280 1 -- 172.21.15.45:0/4167041719 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x5641a30bc380 con 0x5641a3098800 2023-11-28T18:42:22.317 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.307+0000 7f8a15b3c640 1 -- 172.21.15.45:0/4167041719 <== osd.2 v2:172.21.15.45:6816/193884539 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv22 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x5641a3a38b40 con 0x5641a3098800 2023-11-28T18:42:22.318 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.307+0000 7f8a0ab26640 1 -- 172.21.15.45:0/4167041719 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:3 6.14 6:2e2fa760:::200.00000001:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e49) v8 -- 0x5641a30bc000 con 0x5641a3098800 2023-11-28T18:42:22.318 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.307+0000 7f8a0ab26640 1 --2- 172.21.15.45:0/4167041719 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x5641a30c0000 0x5641a30ba680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.318 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.307+0000 7f8a0ab26640 1 -- 172.21.15.45:0/4167041719 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:4 6.1b 6:ddb4e4d7:::200.00000002:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e49) v8 -- 0x5641a30bc380 con 0x5641a30c0000 2023-11-28T18:42:22.318 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.307+0000 7f8a15b3c640 1 -- 172.21.15.45:0/4167041719 <== osd.2 v2:172.21.15.45:6816/193884539 3 ==== osd_op_reply(3 200.00000001 [stat out=16b] v0'0 uv24 ondisk = 0) v8 ==== 156+0+16 (crc 0 0 0) 0x5641a3a38b40 con 0x5641a3098800 2023-11-28T18:42:22.318 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.307+0000 7f8a14b3a640 1 --2- 172.21.15.45:0/4167041719 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x5641a30c0000 0x5641a30ba680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.318 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.307+0000 7f8a14b3a640 1 --2- 172.21.15.45:0/4167041719 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x5641a30c0000 0x5641a30ba680 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=c7011d9d987d84a5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.319 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.307+0000 7f8a14b3a640 1 -- 172.21.15.45:0/4167041719 <== osd.3 v2:172.21.15.45:6824/78541084 1 ==== osd_op_reply(4 200.00000002 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x5641a3a38d80 con 0x5641a30c0000 2023-11-28T18:42:22.319 INFO:tasks.workunit.client.0.smithi045.stdout:old journal was 4194304~34160 2023-11-28T18:42:22.319 INFO:tasks.workunit.client.0.smithi045.stdout:new journal start will be 8388608 (4160144 bytes past old end) 2023-11-28T18:42:22.319 INFO:tasks.workunit.client.0.smithi045.stdout:writing journal head 2023-11-28T18:42:22.320 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.307+0000 7f8a16b7c280 1 -- 172.21.15.45:0/4167041719 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:5 6.14 6:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x5641a30bc700 con 0x5641a3098800 2023-11-28T18:42:22.320 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.311+0000 7f8a15b3c640 1 -- 172.21.15.45:0/4167041719 <== osd.2 v2:172.21.15.45:6816/193884539 4 ==== osd_op_reply(5 200.00000000 [writefull 0~90] v49'25 uv25 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x5641a3a38b40 con 0x5641a3098800 2023-11-28T18:42:22.320 INFO:tasks.workunit.client.0.smithi045.stdout:writing EResetJournal entry 2023-11-28T18:42:22.323 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.311+0000 7f8a16b7c280 1 -- 172.21.15.45:0/4167041719 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:6 6.1b 6:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x5641a30bce00 con 0x5641a30c0000 2023-11-28T18:42:22.323 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.311+0000 7f8a16b7c280 1 -- 172.21.15.45:0/4167041719 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:7 6.b 6:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x5641a30bd180 con 0x5641a30c0000 2023-11-28T18:42:22.323 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.311+0000 7f8a16b7c280 1 -- 172.21.15.45:0/4167041719 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:8 6.1f 6:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x5641a30bd500 con 0x5641a30c0000 2023-11-28T18:42:22.323 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.311+0000 7f8a16b7c280 1 --2- 172.21.15.45:0/4167041719 >> [v2:172.21.15.190:6808/1537591987,v1:172.21.15.190:6809/1537591987] conn(0x5641a3098c00 0x5641a30b8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.323 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.311+0000 7f8a16b7c280 1 -- 172.21.15.45:0/4167041719 --> [v2:172.21.15.190:6808/1537591987,v1:172.21.15.190:6809/1537591987] -- osd_op(unknown.0.0:9 6.1a 6:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x5641a30bd880 con 0x5641a3098c00 2023-11-28T18:42:22.323 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.311+0000 7f8a16b7c280 1 -- 172.21.15.45:0/4167041719 --> [v2:172.21.15.190:6808/1537591987,v1:172.21.15.190:6809/1537591987] -- osd_op(unknown.0.0:10 6.1e 6:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x5641a30bc380 con 0x5641a3098c00 2023-11-28T18:42:22.323 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.311+0000 7f8a16b7c280 1 --2- 172.21.15.45:0/4167041719 >> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] conn(0x5641a3099000 0x5641a30b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.324 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.311+0000 7f8a16b7c280 1 -- 172.21.15.45:0/4167041719 --> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] -- osd_op(unknown.0.0:11 6.1d 6:bec1251c:::200.00000007:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x5641a30bce00 con 0x5641a3099000 2023-11-28T18:42:22.324 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.311+0000 7f8a1533b640 1 --2- 172.21.15.45:0/4167041719 >> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] conn(0x5641a3099000 0x5641a30b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.324 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.311+0000 7f8a15b3c640 1 --2- 172.21.15.45:0/4167041719 >> [v2:172.21.15.190:6808/1537591987,v1:172.21.15.190:6809/1537591987] conn(0x5641a3098c00 0x5641a30b8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.324 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.311+0000 7f8a1533b640 1 --2- 172.21.15.45:0/4167041719 >> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] conn(0x5641a3099000 0x5641a30b8b00 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=74591d61bbcd63eb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.324 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.311+0000 7f8a15b3c640 1 --2- 172.21.15.45:0/4167041719 >> [v2:172.21.15.190:6808/1537591987,v1:172.21.15.190:6809/1537591987] conn(0x5641a3098c00 0x5641a30b8580 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=c997c0e0ed944350 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.324 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.311+0000 7f8a14b3a640 1 -- 172.21.15.45:0/4167041719 <== osd.3 v2:172.21.15.45:6824/78541084 2 ==== osd_op_reply(6 200.00000002 [delete] v49'3 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x5641a3a38d80 con 0x5641a30c0000 2023-11-28T18:42:22.324 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.311+0000 7f8a14b3a640 1 -- 172.21.15.45:0/4167041719 <== osd.3 v2:172.21.15.45:6824/78541084 3 ==== osd_op_reply(8 200.00000004 [delete] v49'5 uv3 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x5641a3a38d80 con 0x5641a30c0000 2023-11-28T18:42:22.324 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.311+0000 7f8a14b3a640 1 -- 172.21.15.45:0/4167041719 <== osd.3 v2:172.21.15.45:6824/78541084 4 ==== osd_op_reply(7 200.00000003 [delete] v49'4 uv1 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x5641a3a38d80 con 0x5641a30c0000 2023-11-28T18:42:22.324 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.311+0000 7f8a0ab26640 1 -- 172.21.15.45:0/4167041719 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:12 6.1b 6:ddb4e4d7:::200.00000002:head [write 0~48 in=48b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x5641a30bca80 con 0x5641a30c0000 2023-11-28T18:42:22.324 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.311+0000 7f8a1533b640 1 -- 172.21.15.45:0/4167041719 <== osd.1 v2:172.21.15.45:6800/2857063763 1 ==== osd_op_reply(11 200.00000007 [delete] v49'4 uv2 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x5641a3a39440 con 0x5641a3099000 2023-11-28T18:42:22.325 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.311+0000 7f8a15b3c640 1 -- 172.21.15.45:0/4167041719 <== osd.4 v2:172.21.15.190:6808/1537591987 1 ==== osd_op_reply(10 200.00000006 [delete] v49'2 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x5641a3a38b40 con 0x5641a3098c00 2023-11-28T18:42:22.325 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.311+0000 7f8a15b3c640 1 -- 172.21.15.45:0/4167041719 <== osd.4 v2:172.21.15.190:6808/1537591987 2 ==== osd_op_reply(9 200.00000005 [delete] v49'2 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x5641a3a38b40 con 0x5641a3098c00 2023-11-28T18:42:22.325 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.315+0000 7f8a14b3a640 1 -- 172.21.15.45:0/4167041719 <== osd.3 v2:172.21.15.45:6824/78541084 5 ==== osd_op_reply(12 200.00000002 [write 0~48] v49'4 uv4 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x5641a3a38d80 con 0x5641a30c0000 2023-11-28T18:42:22.325 INFO:tasks.workunit.client.0.smithi045.stdout:done 2023-11-28T18:42:22.327 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.315+0000 7f8a16b7c280 1 -- 172.21.15.45:0/4167041719 >> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] conn(0x5641a3099000 msgr2=0x5641a30b8b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.327 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.315+0000 7f8a16b7c280 1 --2- 172.21.15.45:0/4167041719 >> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] conn(0x5641a3099000 0x5641a30b8b00 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.327 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.315+0000 7f8a16b7c280 1 -- 172.21.15.45:0/4167041719 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x5641a3098800 msgr2=0x5641a30b8000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.328 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.315+0000 7f8a16b7c280 1 --2- 172.21.15.45:0/4167041719 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x5641a3098800 0x5641a30b8000 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.328 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.315+0000 7f8a16b7c280 1 -- 172.21.15.45:0/4167041719 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x5641a30c0000 msgr2=0x5641a30ba680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.328 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.315+0000 7f8a16b7c280 1 --2- 172.21.15.45:0/4167041719 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x5641a30c0000 0x5641a30ba680 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.328 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.315+0000 7f8a16b7c280 1 -- 172.21.15.45:0/4167041719 >> [v2:172.21.15.190:6808/1537591987,v1:172.21.15.190:6809/1537591987] conn(0x5641a3098c00 msgr2=0x5641a30b8580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.328 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.315+0000 7f8a16b7c280 1 --2- 172.21.15.45:0/4167041719 >> [v2:172.21.15.190:6808/1537591987,v1:172.21.15.190:6809/1537591987] conn(0x5641a3098c00 0x5641a30b8580 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.328 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.315+0000 7f8a1533b640 1 -- 172.21.15.45:0/4167041719 reap_dead start 2023-11-28T18:42:22.328 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.315+0000 7f8a16b7c280 1 -- 172.21.15.45:0/4167041719 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5641a3098000 msgr2=0x5641a2cd9b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.328 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.315+0000 7f8a16b7c280 1 --2- 172.21.15.45:0/4167041719 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5641a3098000 0x5641a2cd9b80 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x5641a3a2a3f0 tx=0x5641a3a3a480 comp rx=0 tx=0).stop 2023-11-28T18:42:22.328 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.315+0000 7f8a16b7c280 1 -- 172.21.15.45:0/4167041719 shutdown_connections 2023-11-28T18:42:22.328 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.315+0000 7f8a16b7c280 1 --2- 172.21.15.45:0/4167041719 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5641a3098000 0x5641a2cd9b80 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.328 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.315+0000 7f8a16b7c280 1 -- 172.21.15.45:0/4167041719 >> 172.21.15.45:0/4167041719 conn(0x5641a3b8d800 msgr2=0x5641a3084000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:22.328 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.315+0000 7f8a16b7c280 1 -- 172.21.15.45:0/4167041719 shutdown_connections 2023-11-28T18:42:22.329 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.315+0000 7f8a16b7c280 1 -- 172.21.15.45:0/4167041719 wait complete. 2023-11-28T18:42:22.329 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.315+0000 7f8a16b7c280 1 -- 172.21.15.45:0/3797055657 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x5641a2f57400 msgr2=0x5641a2cdb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.329 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.315+0000 7f8a16b7c280 1 --2- 172.21.15.45:0/3797055657 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x5641a2f57400 0x5641a2cdb700 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x5641a3bf2240 tx=0x5641a303cc00 comp rx=0 tx=0).stop 2023-11-28T18:42:22.329 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.315+0000 7f8a16b7c280 1 -- 172.21.15.45:0/3797055657 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5641a3b8d400 msgr2=0x5641a2cda680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.329 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.315+0000 7f8a16b7c280 1 --2- 172.21.15.45:0/3797055657 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5641a3b8d400 0x5641a2cda680 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x5641a3bf3410 tx=0x5641a3bf40c0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.329 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.315+0000 7f8a16b7c280 1 -- 172.21.15.45:0/3797055657 shutdown_connections 2023-11-28T18:42:22.329 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.315+0000 7f8a16b7c280 1 --2- 172.21.15.45:0/3797055657 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x5641a2f57400 0x5641a2cdb700 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.329 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.315+0000 7f8a16b7c280 1 --2- 172.21.15.45:0/3797055657 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5641a3b8d400 0x5641a2cda680 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.329 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.315+0000 7f8a16b7c280 1 --2- 172.21.15.45:0/3797055657 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5641a3b8d000 0x5641a2cdac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.329 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.315+0000 7f8a16b7c280 1 --2- 172.21.15.45:0/3797055657 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5641a3b8cc00 0x5641a2cdb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.329 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.315+0000 7f8a16b7c280 1 -- 172.21.15.45:0/3797055657 >> 172.21.15.45:0/3797055657 conn(0x5641a2c6cc00 msgr2=0x5641a2c9b800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:22.329 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.315+0000 7f8a16b7c280 1 -- 172.21.15.45:0/3797055657 shutdown_connections 2023-11-28T18:42:22.330 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.315+0000 7f8a16b7c280 1 -- 172.21.15.45:0/3797055657 wait complete. 2023-11-28T18:42:22.330 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.315+0000 7f8a16b7c280 1 -- 172.21.15.45:0/185843049 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5641a2c6d400 msgr2=0x5641a2cd8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.330 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.315+0000 7f8a16b7c280 1 --2- 172.21.15.45:0/185843049 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5641a2c6d400 0x5641a2cd8b00 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x5641a3a2af00 tx=0x5641a39eaf00 comp rx=0 tx=0).stop 2023-11-28T18:42:22.330 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.315+0000 7f8a16b7c280 1 -- 172.21.15.45:0/185843049 shutdown_connections 2023-11-28T18:42:22.330 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.315+0000 7f8a16b7c280 1 --2- 172.21.15.45:0/185843049 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5641a2c6d000 0x5641a2cd9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.330 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.315+0000 7f8a16b7c280 1 --2- 172.21.15.45:0/185843049 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5641a2c6d400 0x5641a2cd8b00 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.330 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.315+0000 7f8a16b7c280 1 --2- 172.21.15.45:0/185843049 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5641a2c6d800 0x5641a2cd8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.330 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.315+0000 7f8a16b7c280 1 -- 172.21.15.45:0/185843049 >> 172.21.15.45:0/185843049 conn(0x5641a2c6dc00 msgr2=0x5641a2c9b000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:22.330 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.315+0000 7f8a16b7c280 1 -- 172.21.15.45:0/185843049 shutdown_connections 2023-11-28T18:42:22.330 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.315+0000 7f8a16b7c280 1 -- 172.21.15.45:0/185843049 wait complete. 2023-11-28T18:42:22.331 INFO:tasks.workunit.client.0.smithi045.stderr:+ cephfs-journal-tool --rank=cephfs:0 journal inspect 2023-11-28T18:42:22.364 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.359+0000 7f26e6c46280 1 -- start start 2023-11-28T18:42:22.365 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.359+0000 7f26e6c46280 1 Processor -- start 2023-11-28T18:42:22.367 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.363+0000 7f26e6c46280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561880c31800 0x561880c9c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.367 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.363+0000 7f26e6c46280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561880c31400 0x561880c9cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.367 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.363+0000 7f26e6c46280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x561880c31000 0x561880c9d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.367 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.363+0000 7f26e6c46280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x561880c77180 con 0x561880c31800 2023-11-28T18:42:22.367 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.363+0000 7f26e6c46280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x561880c76140 con 0x561880c31400 2023-11-28T18:42:22.367 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.363+0000 7f26e6c46280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x561880c76000 con 0x561880c31000 2023-11-28T18:42:22.368 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.363+0000 7f26e4717640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561880c31800 0x561880c9c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.368 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.363+0000 7f26e4717640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561880c31800 0x561880c9c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57424/0 (socket says 172.21.15.45:57424) 2023-11-28T18:42:22.368 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.363+0000 7f26e4717640 1 -- 172.21.15.45:0/3476683156 learned_addr learned my addr 172.21.15.45:0/3476683156 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:22.368 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.363+0000 7f26e4f18640 1 --2- 172.21.15.45:0/3476683156 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x561880c31000 0x561880c9d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.368 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.363+0000 7f26e3f16640 1 --2- 172.21.15.45:0/3476683156 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561880c31400 0x561880c9cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.368 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.363+0000 7f26e4717640 1 -- 172.21.15.45:0/3476683156 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x561880c31000 msgr2=0x561880c9d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:22.368 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.363+0000 7f26e4717640 1 --2- 172.21.15.45:0/3476683156 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x561880c31000 0x561880c9d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.368 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.363+0000 7f26e4717640 1 -- 172.21.15.45:0/3476683156 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561880c31400 msgr2=0x561880c9cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:22.368 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.363+0000 7f26e4717640 1 --2- 172.21.15.45:0/3476683156 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561880c31400 0x561880c9cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.369 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.363+0000 7f26e4717640 1 -- 172.21.15.45:0/3476683156 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561880c669c0 con 0x561880c31800 2023-11-28T18:42:22.369 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.363+0000 7f26e3f16640 1 --2- 172.21.15.45:0/3476683156 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561880c31400 0x561880c9cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:42:22.369 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.363+0000 7f26e4717640 1 --2- 172.21.15.45:0/3476683156 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561880c31800 0x561880c9c580 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x561881ab0d80 tx=0x561880cb3140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=532b0c9691e402e9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.369 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.363+0000 7f26e1f12640 1 -- 172.21.15.45:0/3476683156 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x561880c911e0 con 0x561880c31800 2023-11-28T18:42:22.369 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.363+0000 7f26e1f12640 1 -- 172.21.15.45:0/3476683156 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561880c8c900 con 0x561880c31800 2023-11-28T18:42:22.369 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.363+0000 7f26e1f12640 1 -- 172.21.15.45:0/3476683156 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x561880c91080 con 0x561880c31800 2023-11-28T18:42:22.369 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.363+0000 7f26e6c46280 1 -- 172.21.15.45:0/3476683156 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561880c66b60 con 0x561880c31800 2023-11-28T18:42:22.369 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.363+0000 7f26e6c46280 1 -- 172.21.15.45:0/3476683156 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x561880c66340 con 0x561880c31800 2023-11-28T18:42:22.369 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.363+0000 7f26e1f12640 1 -- 172.21.15.45:0/3476683156 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x561880c72c40 con 0x561880c31800 2023-11-28T18:42:22.369 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.363+0000 7f26e1f12640 1 -- 172.21.15.45:0/3476683156 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 34) v1 ==== 3298+0+0 (secure 0 0 0) 0x561880c7ef00 con 0x561880c31800 2023-11-28T18:42:22.373 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.363+0000 7f26e6c46280 1 Processor -- start 2023-11-28T18:42:22.374 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.363+0000 7f26e6c46280 1 -- start start 2023-11-28T18:42:22.374 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.363+0000 7f26e6c46280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561881b4ac00 0x561880c9d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.374 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.363+0000 7f26e6c46280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561881b4b000 0x561880c9db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.374 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.363+0000 7f26e6c46280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x561881b4b400 0x561880c9e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.374 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.363+0000 7f26e6c46280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x561880c76a00 con 0x561881b4ac00 2023-11-28T18:42:22.374 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.363+0000 7f26e6c46280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x561880d01180 con 0x561881b4b000 2023-11-28T18:42:22.374 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.363+0000 7f26e6c46280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x561880d00dc0 con 0x561881b4b400 2023-11-28T18:42:22.374 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.363+0000 7f26e4f18640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561881b4ac00 0x561880c9d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.374 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.363+0000 7f26e4f18640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561881b4ac00 0x561880c9d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57426/0 (socket says 172.21.15.45:57426) 2023-11-28T18:42:22.374 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.363+0000 7f26e4f18640 1 -- 172.21.15.45:0/1510479336 learned_addr learned my addr 172.21.15.45:0/1510479336 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:22.375 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.367+0000 7f26e4f18640 1 -- 172.21.15.45:0/1510479336 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x561881b4b400 msgr2=0x561880c9e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:22.375 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.367+0000 7f26e4f18640 1 --2- 172.21.15.45:0/1510479336 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x561881b4b400 0x561880c9e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.375 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.367+0000 7f26e4f18640 1 -- 172.21.15.45:0/1510479336 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561881b4b000 msgr2=0x561880c9db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:22.375 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.367+0000 7f26e4717640 1 --2- 172.21.15.45:0/1510479336 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561881b4b000 0x561880c9db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.375 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.367+0000 7f26e4f18640 1 --2- 172.21.15.45:0/1510479336 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561881b4b000 0x561880c9db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.375 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.367+0000 7f26e4f18640 1 -- 172.21.15.45:0/1510479336 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561880c66000 con 0x561881b4ac00 2023-11-28T18:42:22.375 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.367+0000 7f26e4717640 1 --2- 172.21.15.45:0/1510479336 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561881b4b000 0x561880c9db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:42:22.375 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.367+0000 7f26e4f18640 1 --2- 172.21.15.45:0/1510479336 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561881b4ac00 0x561880c9d600 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x561881bac1b0 tx=0x561881a00000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d74ac92b8092d666 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.375 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.367+0000 7f26dff0e640 1 -- 172.21.15.45:0/1510479336 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x561880c90f20 con 0x561881b4ac00 2023-11-28T18:42:22.376 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.367+0000 7f26dff0e640 1 -- 172.21.15.45:0/1510479336 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561881a0f080 con 0x561881b4ac00 2023-11-28T18:42:22.376 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.367+0000 7f26dff0e640 1 -- 172.21.15.45:0/1510479336 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x561880c911e0 con 0x561881b4ac00 2023-11-28T18:42:22.376 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.367+0000 7f26e6c46280 1 -- 172.21.15.45:0/1510479336 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561881b4ac00 msgr2=0x561880c9d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.376 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.367+0000 7f26e6c46280 1 --2- 172.21.15.45:0/1510479336 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561881b4ac00 0x561880c9d600 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x561881bac1b0 tx=0x561881a00000 comp rx=0 tx=0).stop 2023-11-28T18:42:22.376 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.367+0000 7f26e6c46280 1 -- 172.21.15.45:0/1510479336 shutdown_connections 2023-11-28T18:42:22.376 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.367+0000 7f26e6c46280 1 --2- 172.21.15.45:0/1510479336 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x561881b4b400 0x561880c9e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.376 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.367+0000 7f26e6c46280 1 --2- 172.21.15.45:0/1510479336 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561881b4b000 0x561880c9db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.376 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.367+0000 7f26e6c46280 1 --2- 172.21.15.45:0/1510479336 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561881b4ac00 0x561880c9d600 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.376 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.367+0000 7f26e6c46280 1 -- 172.21.15.45:0/1510479336 >> 172.21.15.45:0/1510479336 conn(0x561880c30c00 msgr2=0x561880c5f800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:22.376 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.367+0000 7f26e6c46280 1 -- 172.21.15.45:0/1510479336 shutdown_connections 2023-11-28T18:42:22.376 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.367+0000 7f26e6c46280 1 -- 172.21.15.45:0/1510479336 wait complete. 2023-11-28T18:42:22.377 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.367+0000 7f26e6c46280 1 Processor -- start 2023-11-28T18:42:22.377 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.367+0000 7f26e6c46280 1 -- start start 2023-11-28T18:42:22.377 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.367+0000 7f26e6c46280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x561881b4ac00 0x561880c9f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.377 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.367+0000 7f26e6c46280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561881b4b000 0x561880c9ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.377 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.367+0000 7f26e6c46280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561881b4b400 0x561880c9e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.377 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.367+0000 7f26e6c46280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x561880d00c80 con 0x561881b4b000 2023-11-28T18:42:22.377 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.367+0000 7f26e6c46280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x561880c76140 con 0x561881b4b400 2023-11-28T18:42:22.377 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.367+0000 7f26e6c46280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x561880c76b40 con 0x561881b4ac00 2023-11-28T18:42:22.378 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.367+0000 7f26e4717640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561881b4b000 0x561880c9ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.378 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.367+0000 7f26e4717640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561881b4b000 0x561880c9ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57428/0 (socket says 172.21.15.45:57428) 2023-11-28T18:42:22.378 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.367+0000 7f26e4717640 1 -- 172.21.15.45:0/1650868055 learned_addr learned my addr 172.21.15.45:0/1650868055 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:22.378 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.367+0000 7f26e3f16640 1 --2- 172.21.15.45:0/1650868055 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561881b4b400 0x561880c9e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.378 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.367+0000 7f26e4f18640 1 --2- 172.21.15.45:0/1650868055 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x561881b4ac00 0x561880c9f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.378 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.367+0000 7f26e4717640 1 -- 172.21.15.45:0/1650868055 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x561881b4ac00 msgr2=0x561880c9f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.378 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.367+0000 7f26e4717640 1 --2- 172.21.15.45:0/1650868055 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x561881b4ac00 0x561880c9f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.378 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.367+0000 7f26e4717640 1 -- 172.21.15.45:0/1650868055 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561881b4b400 msgr2=0x561880c9e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.378 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.367+0000 7f26e4717640 1 --2- 172.21.15.45:0/1650868055 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561881b4b400 0x561880c9e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.378 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.367+0000 7f26e4717640 1 -- 172.21.15.45:0/1650868055 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561880c661a0 con 0x561881b4b000 2023-11-28T18:42:22.379 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.367+0000 7f26e4717640 1 --2- 172.21.15.45:0/1650868055 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561881b4b000 0x561880c9ec00 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x561881bac120 tx=0x561880cb25a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.379 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.367+0000 7f26de70b640 1 -- 172.21.15.45:0/1650868055 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x561880c90dc0 con 0x561881b4b000 2023-11-28T18:42:22.379 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.367+0000 7f26de70b640 1 -- 172.21.15.45:0/1650868055 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561881a0ed80 con 0x561881b4b000 2023-11-28T18:42:22.379 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.367+0000 7f26de70b640 1 -- 172.21.15.45:0/1650868055 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x561880c90f20 con 0x561881b4b000 2023-11-28T18:42:22.379 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.367+0000 7f26e6c46280 1 -- 172.21.15.45:0/1650868055 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561880c66000 con 0x561881b4b000 2023-11-28T18:42:22.379 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.371+0000 7f26e6c46280 1 -- 172.21.15.45:0/1650868055 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561880c669c0 con 0x561881b4b000 2023-11-28T18:42:22.381 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.371+0000 7f26de70b640 1 -- 172.21.15.45:0/1650868055 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x561880cbe840 con 0x561881b4b000 2023-11-28T18:42:22.381 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.371+0000 7f26de70b640 1 --2- 172.21.15.45:0/1650868055 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x561880f11400 0x561880c9f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.381 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.371+0000 7f26de70b640 1 -- 172.21.15.45:0/1650868055 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x561880c72a80 con 0x561881b4b000 2023-11-28T18:42:22.381 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.371+0000 7f26e6c46280 1 --2- 172.21.15.45:0/1650868055 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x561881b4b800 0x561880c9e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.381 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.371+0000 7f26e6c46280 1 -- 172.21.15.45:0/1650868055 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x561880c87880 con 0x561881b4b800 2023-11-28T18:42:22.381 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.371+0000 7f26e4f18640 1 --2- 172.21.15.45:0/1650868055 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x561880f11400 0x561880c9f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.382 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.371+0000 7f26e3f16640 1 --2- 172.21.15.45:0/1650868055 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x561881b4b800 0x561880c9e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.382 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.371+0000 7f26e4f18640 1 --2- 172.21.15.45:0/1650868055 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x561880f11400 0x561880c9f700 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x561881bac1b0 tx=0x561881a00420 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.382 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.371+0000 7f26e3f16640 1 --2- 172.21.15.45:0/1650868055 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x561881b4b800 0x561880c9e100 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.382 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.371+0000 7f26e3f16640 1 -- 172.21.15.45:0/1650868055 <== osd.2 v2:172.21.15.45:6816/193884539 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x561881b38b40 con 0x561881b4b800 2023-11-28T18:42:22.382 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.371+0000 7f26e6c46280 1 -- 172.21.15.45:0/1650868055 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x561880c87c00 con 0x561881b4b800 2023-11-28T18:42:22.382 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.371+0000 7f26e3f16640 1 -- 172.21.15.45:0/1650868055 <== osd.2 v2:172.21.15.45:6816/193884539 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv25 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x561881b38b40 con 0x561881b4b800 2023-11-28T18:42:22.382 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.371+0000 7f26e6c46280 1 --2- 172.21.15.45:0/1650868055 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x561881b4bc00 0x561880c9db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.382 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.371+0000 7f26e6c46280 1 -- 172.21.15.45:0/1650868055 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:3 6.1b 6:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x561880c87880 con 0x561881b4bc00 2023-11-28T18:42:22.382 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.375+0000 7f26e4f18640 1 --2- 172.21.15.45:0/1650868055 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x561881b4bc00 0x561880c9db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.382 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.375+0000 7f26e4f18640 1 --2- 172.21.15.45:0/1650868055 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x561881b4bc00 0x561880c9db80 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.382 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.375+0000 7f26e4f18640 1 -- 172.21.15.45:0/1650868055 <== osd.3 v2:172.21.15.45:6824/78541084 1 ==== osd_op_reply(3 200.00000002 [read 0~48 out=48b] v0'0 uv4 ondisk = 0) v8 ==== 156+0+48 (crc 0 0 0) 0x561881b38d80 con 0x561881b4bc00 2023-11-28T18:42:22.383 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.375+0000 7f26e6c46280 1 -- 172.21.15.45:0/1650868055 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:4 6.b 6:d5c7a900:::200.00000003:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x561880c87c00 con 0x561881b4bc00 2023-11-28T18:42:22.383 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.375+0000 7f26e4f18640 1 -- 172.21.15.45:0/1650868055 <== osd.3 v2:172.21.15.45:6824/78541084 2 ==== osd_op_reply(4 200.00000003 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x561881b38d80 con 0x561881b4bc00 2023-11-28T18:42:22.383 INFO:tasks.workunit.client.0.smithi045.stdout:Overall journal integrity: OK 2023-11-28T18:42:22.384 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.375+0000 7f26e6c46280 1 -- 172.21.15.45:0/1650868055 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x561881b4b800 msgr2=0x561880c9e100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.385 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.375+0000 7f26e6c46280 1 --2- 172.21.15.45:0/1650868055 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x561881b4b800 0x561880c9e100 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.385 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.375+0000 7f26e6c46280 1 -- 172.21.15.45:0/1650868055 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x561881b4bc00 msgr2=0x561880c9db80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.385 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.375+0000 7f26e6c46280 1 --2- 172.21.15.45:0/1650868055 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x561881b4bc00 0x561880c9db80 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.385 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.375+0000 7f26e6c46280 1 -- 172.21.15.45:0/1650868055 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x561880f11400 msgr2=0x561880c9f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.385 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.375+0000 7f26e6c46280 1 --2- 172.21.15.45:0/1650868055 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x561880f11400 0x561880c9f700 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x561881bac1b0 tx=0x561881a00420 comp rx=0 tx=0).stop 2023-11-28T18:42:22.385 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.375+0000 7f26e6c46280 1 -- 172.21.15.45:0/1650868055 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561881b4b000 msgr2=0x561880c9ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.385 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.375+0000 7f26e6c46280 1 --2- 172.21.15.45:0/1650868055 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561881b4b000 0x561880c9ec00 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x561881bac120 tx=0x561880cb25a0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.385 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.375+0000 7f26e3f16640 1 -- 172.21.15.45:0/1650868055 reap_dead start 2023-11-28T18:42:22.385 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.375+0000 7f26e6c46280 1 -- 172.21.15.45:0/1650868055 shutdown_connections 2023-11-28T18:42:22.386 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.375+0000 7f26e6c46280 1 --2- 172.21.15.45:0/1650868055 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561881b4b000 0x561880c9ec00 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.386 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.375+0000 7f26e6c46280 1 -- 172.21.15.45:0/1650868055 >> 172.21.15.45:0/1650868055 conn(0x561880c30c00 msgr2=0x561880c5f800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:22.386 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.375+0000 7f26e6c46280 1 -- 172.21.15.45:0/1650868055 shutdown_connections 2023-11-28T18:42:22.386 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.375+0000 7f26e6c46280 1 -- 172.21.15.45:0/1650868055 wait complete. 2023-11-28T18:42:22.386 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.375+0000 7f26e6c46280 1 -- 172.21.15.45:0/3476683156 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561880c31800 msgr2=0x561880c9c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.386 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.375+0000 7f26e6c46280 1 --2- 172.21.15.45:0/3476683156 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561880c31800 0x561880c9c580 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x561881ab0d80 tx=0x561880cb3140 comp rx=0 tx=0).stop 2023-11-28T18:42:22.386 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.375+0000 7f26e6c46280 1 -- 172.21.15.45:0/3476683156 shutdown_connections 2023-11-28T18:42:22.386 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.375+0000 7f26e6c46280 1 --2- 172.21.15.45:0/3476683156 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x561880c31000 0x561880c9d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.386 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.375+0000 7f26e6c46280 1 --2- 172.21.15.45:0/3476683156 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x561880c31400 0x561880c9cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.386 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.375+0000 7f26e6c46280 1 --2- 172.21.15.45:0/3476683156 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561880c31800 0x561880c9c580 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.387 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.375+0000 7f26e6c46280 1 -- 172.21.15.45:0/3476683156 >> 172.21.15.45:0/3476683156 conn(0x561880c31c00 msgr2=0x561880c5f000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:22.387 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.375+0000 7f26e6c46280 1 -- 172.21.15.45:0/3476683156 shutdown_connections 2023-11-28T18:42:22.387 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.375+0000 7f26e6c46280 1 -- 172.21.15.45:0/3476683156 wait complete. 2023-11-28T18:42:22.387 INFO:tasks.workunit.client.0.smithi045.stderr:+ cephfs-journal-tool --rank=cephfs:0 header get 2023-11-28T18:42:22.423 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.419+0000 7f6a2fa48280 1 -- start start 2023-11-28T18:42:22.423 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.419+0000 7f6a2fa48280 1 Processor -- start 2023-11-28T18:42:22.425 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.419+0000 7f6a2fa48280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558ad536b800 0x558ad53d6580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.425 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.419+0000 7f6a2fa48280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558ad536b400 0x558ad53d6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.425 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.419+0000 7f6a2fa48280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558ad536b000 0x558ad53d7080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.426 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.419+0000 7f6a2fa48280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ad53b1180 con 0x558ad536b000 2023-11-28T18:42:22.426 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.419+0000 7f6a2fa48280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ad53b0140 con 0x558ad536b400 2023-11-28T18:42:22.426 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.419+0000 7f6a2fa48280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x558ad53b0000 con 0x558ad536b800 2023-11-28T18:42:22.426 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.419+0000 7f6a2de01640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558ad536b000 0x558ad53d7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.426 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.419+0000 7f6a2de01640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558ad536b000 0x558ad53d7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57438/0 (socket says 172.21.15.45:57438) 2023-11-28T18:42:22.426 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.419+0000 7f6a2de01640 1 -- 172.21.15.45:0/1433659953 learned_addr learned my addr 172.21.15.45:0/1433659953 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:22.426 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.419+0000 7f6a2cdff640 1 --2- 172.21.15.45:0/1433659953 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558ad536b400 0x558ad53d6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.426 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.419+0000 7f6a2d600640 1 --2- 172.21.15.45:0/1433659953 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558ad536b800 0x558ad53d6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.426 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.419+0000 7f6a2de01640 1 -- 172.21.15.45:0/1433659953 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558ad536b800 msgr2=0x558ad53d6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:22.426 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.419+0000 7f6a2de01640 1 --2- 172.21.15.45:0/1433659953 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558ad536b800 0x558ad53d6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.427 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.419+0000 7f6a2de01640 1 -- 172.21.15.45:0/1433659953 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558ad536b400 msgr2=0x558ad53d6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:22.427 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.419+0000 7f6a2de01640 1 --2- 172.21.15.45:0/1433659953 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558ad536b400 0x558ad53d6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.427 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.419+0000 7f6a2de01640 1 -- 172.21.15.45:0/1433659953 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558ad53a09c0 con 0x558ad536b000 2023-11-28T18:42:22.427 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.419+0000 7f6a2d600640 1 --2- 172.21.15.45:0/1433659953 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558ad536b800 0x558ad53d6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:42:22.427 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.419+0000 7f6a2de01640 1 --2- 172.21.15.45:0/1433659953 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558ad536b000 0x558ad53d7080 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x558ad61eacc0 tx=0x558ad53ed140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ddf1c130ddde17f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.427 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.419+0000 7f6a2adfb640 1 -- 172.21.15.45:0/1433659953 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558ad53cb1e0 con 0x558ad536b000 2023-11-28T18:42:22.427 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.419+0000 7f6a2adfb640 1 -- 172.21.15.45:0/1433659953 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558ad53c6900 con 0x558ad536b000 2023-11-28T18:42:22.427 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.419+0000 7f6a2adfb640 1 -- 172.21.15.45:0/1433659953 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558ad53cb080 con 0x558ad536b000 2023-11-28T18:42:22.427 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.423+0000 7f6a2fa48280 1 -- 172.21.15.45:0/1433659953 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558ad53a0b60 con 0x558ad536b000 2023-11-28T18:42:22.427 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.423+0000 7f6a2fa48280 1 -- 172.21.15.45:0/1433659953 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x558ad53a0340 con 0x558ad536b000 2023-11-28T18:42:22.427 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.423+0000 7f6a2adfb640 1 -- 172.21.15.45:0/1433659953 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x558ad53acc40 con 0x558ad536b000 2023-11-28T18:42:22.427 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.423+0000 7f6a2adfb640 1 -- 172.21.15.45:0/1433659953 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 34) v1 ==== 3298+0+0 (secure 0 0 0) 0x558ad53b8f00 con 0x558ad536b000 2023-11-28T18:42:22.430 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.423+0000 7f6a2fa48280 1 Processor -- start 2023-11-28T18:42:22.430 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.423+0000 7f6a2fa48280 1 -- start start 2023-11-28T18:42:22.430 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.423+0000 7f6a2fa48280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558ad6284c00 0x558ad53d7600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.430 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.423+0000 7f6a2fa48280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558ad6285000 0x558ad53d7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.430 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.423+0000 7f6a2fa48280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558ad6285400 0x558ad53d8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.430 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.423+0000 7f6a2fa48280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ad53b0a00 con 0x558ad6285000 2023-11-28T18:42:22.430 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.423+0000 7f6a2fa48280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ad543b180 con 0x558ad6284c00 2023-11-28T18:42:22.430 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.423+0000 7f6a2fa48280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x558ad543adc0 con 0x558ad6285400 2023-11-28T18:42:22.430 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.423+0000 7f6a2d600640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558ad6285000 0x558ad53d7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.430 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.423+0000 7f6a2d600640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558ad6285000 0x558ad53d7b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57452/0 (socket says 172.21.15.45:57452) 2023-11-28T18:42:22.430 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.423+0000 7f6a2d600640 1 -- 172.21.15.45:0/795860375 learned_addr learned my addr 172.21.15.45:0/795860375 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:22.431 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.423+0000 7f6a2d600640 1 -- 172.21.15.45:0/795860375 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558ad6285400 msgr2=0x558ad53d8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:22.431 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.423+0000 7f6a2d600640 1 --2- 172.21.15.45:0/795860375 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558ad6285400 0x558ad53d8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.431 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.423+0000 7f6a2d600640 1 -- 172.21.15.45:0/795860375 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558ad6284c00 msgr2=0x558ad53d7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:22.431 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.423+0000 7f6a2d600640 1 --2- 172.21.15.45:0/795860375 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558ad6284c00 0x558ad53d7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.431 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.423+0000 7f6a2d600640 1 -- 172.21.15.45:0/795860375 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558ad53a0000 con 0x558ad6285000 2023-11-28T18:42:22.431 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.423+0000 7f6a2d600640 1 --2- 172.21.15.45:0/795860375 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558ad6285000 0x558ad53d7b80 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x558ad62e00f0 tx=0x558ad62ec000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85b86d210729c33f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.431 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.423+0000 7f6a28df7640 1 -- 172.21.15.45:0/795860375 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558ad53cb1e0 con 0x558ad6285000 2023-11-28T18:42:22.431 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.423+0000 7f6a28df7640 1 -- 172.21.15.45:0/795860375 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558ad614d080 con 0x558ad6285000 2023-11-28T18:42:22.431 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.423+0000 7f6a28df7640 1 -- 172.21.15.45:0/795860375 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558ad53cb080 con 0x558ad6285000 2023-11-28T18:42:22.431 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.423+0000 7f6a2fa48280 1 -- 172.21.15.45:0/795860375 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558ad6285000 msgr2=0x558ad53d7b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.431 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.423+0000 7f6a2fa48280 1 --2- 172.21.15.45:0/795860375 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558ad6285000 0x558ad53d7b80 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x558ad62e00f0 tx=0x558ad62ec000 comp rx=0 tx=0).stop 2023-11-28T18:42:22.431 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.423+0000 7f6a2fa48280 1 -- 172.21.15.45:0/795860375 shutdown_connections 2023-11-28T18:42:22.431 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.423+0000 7f6a2fa48280 1 --2- 172.21.15.45:0/795860375 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558ad6285400 0x558ad53d8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.432 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.423+0000 7f6a2fa48280 1 --2- 172.21.15.45:0/795860375 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558ad6285000 0x558ad53d7b80 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.432 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.423+0000 7f6a2fa48280 1 --2- 172.21.15.45:0/795860375 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558ad6284c00 0x558ad53d7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.432 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.423+0000 7f6a2fa48280 1 -- 172.21.15.45:0/795860375 >> 172.21.15.45:0/795860375 conn(0x558ad536ac00 msgr2=0x558ad5399800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:22.432 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.423+0000 7f6a2fa48280 1 -- 172.21.15.45:0/795860375 shutdown_connections 2023-11-28T18:42:22.432 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.423+0000 7f6a2fa48280 1 -- 172.21.15.45:0/795860375 wait complete. 2023-11-28T18:42:22.432 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.427+0000 7f6a2fa48280 1 Processor -- start 2023-11-28T18:42:22.432 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.427+0000 7f6a2fa48280 1 -- start start 2023-11-28T18:42:22.434 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.427+0000 7f6a2fa48280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558ad6284c00 0x558ad53d9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.435 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.427+0000 7f6a2fa48280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558ad6285000 0x558ad53d8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.435 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.427+0000 7f6a2fa48280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558ad6285400 0x558ad53d8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.435 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.427+0000 7f6a2fa48280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ad543ac80 con 0x558ad6285000 2023-11-28T18:42:22.435 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.427+0000 7f6a2fa48280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ad53b0140 con 0x558ad6284c00 2023-11-28T18:42:22.435 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.427+0000 7f6a2fa48280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x558ad53b0b40 con 0x558ad6285400 2023-11-28T18:42:22.435 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.427+0000 7f6a2d600640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558ad6285000 0x558ad53d8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.435 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.427+0000 7f6a2d600640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558ad6285000 0x558ad53d8c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57460/0 (socket says 172.21.15.45:57460) 2023-11-28T18:42:22.435 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.427+0000 7f6a2d600640 1 -- 172.21.15.45:0/3812059800 learned_addr learned my addr 172.21.15.45:0/3812059800 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:22.435 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.427+0000 7f6a2cdff640 1 --2- 172.21.15.45:0/3812059800 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558ad6284c00 0x558ad53d9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.435 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.427+0000 7f6a2cdff640 1 --2- 172.21.15.45:0/3812059800 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558ad6285400 0x558ad53d8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.436 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.427+0000 7f6a2d600640 1 -- 172.21.15.45:0/3812059800 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558ad6285400 msgr2=0x558ad53d8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.436 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.427+0000 7f6a2d600640 1 --2- 172.21.15.45:0/3812059800 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558ad6285400 0x558ad53d8680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.436 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.427+0000 7f6a2d600640 1 -- 172.21.15.45:0/3812059800 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558ad6284c00 msgr2=0x558ad53d9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.436 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.427+0000 7f6a2d600640 1 --2- 172.21.15.45:0/3812059800 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558ad6284c00 0x558ad53d9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.579 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.427+0000 7f6a2d600640 1 -- 172.21.15.45:0/3812059800 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558ad53a09c0 con 0x558ad6285000 2023-11-28T18:42:22.579 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.427+0000 7f6a2cdff640 1 --2- 172.21.15.45:0/3812059800 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558ad6285400 0x558ad53d8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:42:22.579 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.427+0000 7f6a2d600640 1 --2- 172.21.15.45:0/3812059800 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558ad6285000 0x558ad53d8c00 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x558ad62e0db0 tx=0x558ad542e9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.580 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.427+0000 7f6a275f4640 1 -- 172.21.15.45:0/3812059800 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558ad53ca420 con 0x558ad6285000 2023-11-28T18:42:22.580 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.427+0000 7f6a275f4640 1 -- 172.21.15.45:0/3812059800 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558ad614d680 con 0x558ad6285000 2023-11-28T18:42:22.580 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.427+0000 7f6a275f4640 1 -- 172.21.15.45:0/3812059800 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558ad53cb1e0 con 0x558ad6285000 2023-11-28T18:42:22.580 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.427+0000 7f6a2fa48280 1 -- 172.21.15.45:0/3812059800 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558ad53a0b60 con 0x558ad6285000 2023-11-28T18:42:22.580 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.427+0000 7f6a2fa48280 1 -- 172.21.15.45:0/3812059800 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558ad53a0ea0 con 0x558ad6285000 2023-11-28T18:42:22.580 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.431+0000 7f6a275f4640 1 -- 172.21.15.45:0/3812059800 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x558ad53f8840 con 0x558ad6285000 2023-11-28T18:42:22.581 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.431+0000 7f6a275f4640 1 --2- 172.21.15.45:0/3812059800 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x558ad62eb000 0x558ad53d9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.581 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.431+0000 7f6a275f4640 1 -- 172.21.15.45:0/3812059800 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x558ad53aca80 con 0x558ad6285000 2023-11-28T18:42:22.581 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.431+0000 7f6a2fa48280 1 --2- 172.21.15.45:0/3812059800 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x558ad6285800 0x558ad53d8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.581 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.431+0000 7f6a2fa48280 1 -- 172.21.15.45:0/3812059800 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x558ad53c1880 con 0x558ad6285800 2023-11-28T18:42:22.581 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.431+0000 7f6a2cdff640 1 --2- 172.21.15.45:0/3812059800 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x558ad62eb000 0x558ad53d9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.581 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.431+0000 7f6a2cdff640 1 --2- 172.21.15.45:0/3812059800 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x558ad6285800 0x558ad53d8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.581 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.431+0000 7f6a2cdff640 1 --2- 172.21.15.45:0/3812059800 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x558ad62eb000 0x558ad53d9700 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x558ad61ea2d0 tx=0x558ad613e0c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.581 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.431+0000 7f6a2cdff640 1 --2- 172.21.15.45:0/3812059800 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x558ad6285800 0x558ad53d8100 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.583 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.431+0000 7f6a2cdff640 1 -- 172.21.15.45:0/3812059800 <== osd.2 v2:172.21.15.45:6816/193884539 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x558ad60c2b40 con 0x558ad6285800 2023-11-28T18:42:22.583 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.431+0000 7f6a2fa48280 1 -- 172.21.15.45:0/3812059800 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x558ad53c1c00 con 0x558ad6285800 2023-11-28T18:42:22.583 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.431+0000 7f6a2cdff640 1 -- 172.21.15.45:0/3812059800 <== osd.2 v2:172.21.15.45:6816/193884539 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv25 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x558ad60c2b40 con 0x558ad6285800 2023-11-28T18:42:22.583 INFO:tasks.workunit.client.0.smithi045.stdout:{ 2023-11-28T18:42:22.584 INFO:tasks.workunit.client.0.smithi045.stdout: "magic": "ceph fs volume v011", 2023-11-28T18:42:22.584 INFO:tasks.workunit.client.0.smithi045.stdout: "write_pos": 8388608, 2023-11-28T18:42:22.584 INFO:tasks.workunit.client.0.smithi045.stdout: "expire_pos": 8388608, 2023-11-28T18:42:22.584 INFO:tasks.workunit.client.0.smithi045.stdout: "trimmed_pos": 8388608, 2023-11-28T18:42:22.584 INFO:tasks.workunit.client.0.smithi045.stdout: "stream_format": 1, 2023-11-28T18:42:22.584 INFO:tasks.workunit.client.0.smithi045.stdout: "layout": { 2023-11-28T18:42:22.584 INFO:tasks.workunit.client.0.smithi045.stdout: "stripe_unit": 4194304, 2023-11-28T18:42:22.585 INFO:tasks.workunit.client.0.smithi045.stdout: "stripe_count": 1, 2023-11-28T18:42:22.585 INFO:tasks.workunit.client.0.smithi045.stdout: "object_size": 4194304, 2023-11-28T18:42:22.585 INFO:tasks.workunit.client.0.smithi045.stdout: "pool_id": 6, 2023-11-28T18:42:22.585 INFO:tasks.workunit.client.0.smithi045.stdout: "pool_ns": "" 2023-11-28T18:42:22.585 INFO:tasks.workunit.client.0.smithi045.stdout: } 2023-11-28T18:42:22.585 INFO:tasks.workunit.client.0.smithi045.stdout:} 2023-11-28T18:42:22.585 INFO:tasks.workunit.client.0.smithi045.stdout: 2023-11-28T18:42:22.587 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.431+0000 7f6a2fa48280 1 -- 172.21.15.45:0/3812059800 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x558ad6285800 msgr2=0x558ad53d8100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.587 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.431+0000 7f6a2fa48280 1 --2- 172.21.15.45:0/3812059800 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x558ad6285800 0x558ad53d8100 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.587 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.431+0000 7f6a2fa48280 1 -- 172.21.15.45:0/3812059800 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x558ad62eb000 msgr2=0x558ad53d9700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.587 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.431+0000 7f6a2fa48280 1 --2- 172.21.15.45:0/3812059800 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x558ad62eb000 0x558ad53d9700 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x558ad61ea2d0 tx=0x558ad613e0c0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.588 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.431+0000 7f6a2fa48280 1 -- 172.21.15.45:0/3812059800 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558ad6285000 msgr2=0x558ad53d8c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.588 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.431+0000 7f6a2fa48280 1 --2- 172.21.15.45:0/3812059800 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558ad6285000 0x558ad53d8c00 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x558ad62e0db0 tx=0x558ad542e9c0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.589 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.431+0000 7f6a2d600640 1 -- 172.21.15.45:0/3812059800 reap_dead start 2023-11-28T18:42:22.589 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.431+0000 7f6a2fa48280 1 -- 172.21.15.45:0/3812059800 shutdown_connections 2023-11-28T18:42:22.589 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.431+0000 7f6a2fa48280 1 -- 172.21.15.45:0/3812059800 >> 172.21.15.45:0/3812059800 conn(0x558ad536ac00 msgr2=0x558ad5399800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:22.589 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.431+0000 7f6a2fa48280 1 -- 172.21.15.45:0/3812059800 shutdown_connections 2023-11-28T18:42:22.589 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.431+0000 7f6a2fa48280 1 -- 172.21.15.45:0/3812059800 wait complete. 2023-11-28T18:42:22.589 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.431+0000 7f6a2fa48280 1 -- 172.21.15.45:0/1433659953 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558ad536b000 msgr2=0x558ad53d7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.589 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.431+0000 7f6a2fa48280 1 --2- 172.21.15.45:0/1433659953 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558ad536b000 0x558ad53d7080 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x558ad61eacc0 tx=0x558ad53ed140 comp rx=0 tx=0).stop 2023-11-28T18:42:22.589 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.431+0000 7f6a2fa48280 1 -- 172.21.15.45:0/1433659953 shutdown_connections 2023-11-28T18:42:22.589 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.431+0000 7f6a2fa48280 1 --2- 172.21.15.45:0/1433659953 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558ad536b000 0x558ad53d7080 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.589 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.431+0000 7f6a2fa48280 1 --2- 172.21.15.45:0/1433659953 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558ad536b400 0x558ad53d6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.590 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.431+0000 7f6a2fa48280 1 --2- 172.21.15.45:0/1433659953 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558ad536b800 0x558ad53d6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.590 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.431+0000 7f6a2fa48280 1 -- 172.21.15.45:0/1433659953 >> 172.21.15.45:0/1433659953 conn(0x558ad536bc00 msgr2=0x558ad5399000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:22.590 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.431+0000 7f6a2fa48280 1 -- 172.21.15.45:0/1433659953 shutdown_connections 2023-11-28T18:42:22.590 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.431+0000 7f6a2fa48280 1 -- 172.21.15.45:0/1433659953 wait complete. 2023-11-28T18:42:22.590 INFO:tasks.workunit.client.0.smithi045.stdout:Rolling back journal to original state... 2023-11-28T18:42:22.600 INFO:tasks.workunit.client.0.smithi045.stderr:+ echo 'Rolling back journal to original state...' 2023-11-28T18:42:22.600 INFO:tasks.workunit.client.0.smithi045.stderr:+ cephfs-journal-tool --rank=cephfs:0 journal import /tmp/journal.bin 2023-11-28T18:42:22.600 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.475+0000 7fe11fe2b280 1 -- start start 2023-11-28T18:42:22.600 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.475+0000 7fe11fe2b280 1 Processor -- start 2023-11-28T18:42:22.600 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.479+0000 7fe11fe2b280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a33b1cd800 0x55a33b238580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.600 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.479+0000 7fe11fe2b280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a33b1cd400 0x55a33b238b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.600 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.479+0000 7fe11fe2b280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a33b1cd000 0x55a33b239080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.601 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.479+0000 7fe11fe2b280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a33b213180 con 0x55a33b1cd800 2023-11-28T18:42:22.601 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.479+0000 7fe11fe2b280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a33b212140 con 0x55a33b1cd000 2023-11-28T18:42:22.601 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.479+0000 7fe11fe2b280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a33b212000 con 0x55a33b1cd400 2023-11-28T18:42:22.601 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.479+0000 7fe11d519640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a33b1cd800 0x55a33b238580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.601 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.479+0000 7fe11d519640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a33b1cd800 0x55a33b238580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57468/0 (socket says 172.21.15.45:57468) 2023-11-28T18:42:22.601 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.479+0000 7fe11d519640 1 -- 172.21.15.45:0/2192763697 learned_addr learned my addr 172.21.15.45:0/2192763697 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:22.601 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.479+0000 7fe11dd1a640 1 --2- 172.21.15.45:0/2192763697 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a33b1cd000 0x55a33b239080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.601 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.479+0000 7fe11cd18640 1 --2- 172.21.15.45:0/2192763697 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a33b1cd400 0x55a33b238b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.601 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.479+0000 7fe11d519640 1 -- 172.21.15.45:0/2192763697 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a33b1cd400 msgr2=0x55a33b238b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:22.601 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.479+0000 7fe11d519640 1 --2- 172.21.15.45:0/2192763697 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a33b1cd400 0x55a33b238b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.601 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.479+0000 7fe11d519640 1 -- 172.21.15.45:0/2192763697 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a33b1cd000 msgr2=0x55a33b239080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:22.602 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.479+0000 7fe11d519640 1 --2- 172.21.15.45:0/2192763697 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a33b1cd000 0x55a33b239080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.602 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.479+0000 7fe11d519640 1 -- 172.21.15.45:0/2192763697 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a33b2029c0 con 0x55a33b1cd800 2023-11-28T18:42:22.602 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.479+0000 7fe11cd18640 1 --2- 172.21.15.45:0/2192763697 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a33b1cd400 0x55a33b238b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:42:22.602 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.479+0000 7fe11d519640 1 --2- 172.21.15.45:0/2192763697 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a33b1cd800 0x55a33b238580 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x55a33c04c390 tx=0x55a33bf98000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=964a6ba6069b75b0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.602 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.479+0000 7fe11ad14640 1 -- 172.21.15.45:0/2192763697 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55a33b22cf20 con 0x55a33b1cd800 2023-11-28T18:42:22.602 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.479+0000 7fe11ad14640 1 -- 172.21.15.45:0/2192763697 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a33b228900 con 0x55a33b1cd800 2023-11-28T18:42:22.602 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.479+0000 7fe11ad14640 1 -- 172.21.15.45:0/2192763697 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55a33b22d1e0 con 0x55a33b1cd800 2023-11-28T18:42:22.602 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.479+0000 7fe11fe2b280 1 -- 172.21.15.45:0/2192763697 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a33b2021a0 con 0x55a33b1cd800 2023-11-28T18:42:22.602 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.479+0000 7fe11fe2b280 1 -- 172.21.15.45:0/2192763697 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55a33b2029c0 con 0x55a33b1cd800 2023-11-28T18:42:22.602 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.479+0000 7fe11ad14640 1 -- 172.21.15.45:0/2192763697 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x55a33b20ec40 con 0x55a33b1cd800 2023-11-28T18:42:22.603 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.479+0000 7fe11ad14640 1 -- 172.21.15.45:0/2192763697 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 34) v1 ==== 3298+0+0 (secure 0 0 0) 0x55a33b21b200 con 0x55a33b1cd800 2023-11-28T18:42:22.603 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.479+0000 7fe11fe2b280 1 Processor -- start 2023-11-28T18:42:22.603 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.479+0000 7fe11fe2b280 1 -- start start 2023-11-28T18:42:22.603 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.483+0000 7fe11fe2b280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a33bfb1800 0x55a33b239600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.603 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.483+0000 7fe11fe2b280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a33bfb1c00 0x55a33b239b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.603 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.483+0000 7fe11fe2b280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a33c136000 0x55a33b23a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.603 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.483+0000 7fe11fe2b280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a33b212a00 con 0x55a33bfb1800 2023-11-28T18:42:22.603 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.483+0000 7fe11fe2b280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a33b29d180 con 0x55a33c136000 2023-11-28T18:42:22.603 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.483+0000 7fe11fe2b280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a33b29cdc0 con 0x55a33bfb1c00 2023-11-28T18:42:22.603 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.483+0000 7fe11dd1a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a33bfb1800 0x55a33b239600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.603 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.483+0000 7fe11dd1a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a33bfb1800 0x55a33b239600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57472/0 (socket says 172.21.15.45:57472) 2023-11-28T18:42:22.603 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.483+0000 7fe11dd1a640 1 -- 172.21.15.45:0/3082019968 learned_addr learned my addr 172.21.15.45:0/3082019968 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:22.604 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.483+0000 7fe11d519640 1 --2- 172.21.15.45:0/3082019968 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a33bfb1c00 0x55a33b239b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.604 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.483+0000 7fe11cd18640 1 --2- 172.21.15.45:0/3082019968 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a33c136000 0x55a33b23a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.604 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.483+0000 7fe11dd1a640 1 -- 172.21.15.45:0/3082019968 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a33bfb1c00 msgr2=0x55a33b239b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:22.604 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.483+0000 7fe11dd1a640 1 --2- 172.21.15.45:0/3082019968 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a33bfb1c00 0x55a33b239b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.604 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.483+0000 7fe11dd1a640 1 -- 172.21.15.45:0/3082019968 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a33c136000 msgr2=0x55a33b23a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:22.604 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.483+0000 7fe11dd1a640 1 --2- 172.21.15.45:0/3082019968 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a33c136000 0x55a33b23a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.604 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.483+0000 7fe11dd1a640 1 -- 172.21.15.45:0/3082019968 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a33b202b60 con 0x55a33bfb1800 2023-11-28T18:42:22.604 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.483+0000 7fe11dd1a640 1 --2- 172.21.15.45:0/3082019968 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a33bfb1800 0x55a33b239600 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x55a33c13c0c0 tx=0x55a33c14a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b476e0af7f598788 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.604 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.483+0000 7fe118d10640 1 -- 172.21.15.45:0/3082019968 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55a33b22cf20 con 0x55a33bfb1800 2023-11-28T18:42:22.604 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.483+0000 7fe118d10640 1 -- 172.21.15.45:0/3082019968 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a33bfa6480 con 0x55a33bfb1800 2023-11-28T18:42:22.605 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.483+0000 7fe118d10640 1 -- 172.21.15.45:0/3082019968 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55a33b22d1e0 con 0x55a33bfb1800 2023-11-28T18:42:22.605 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.483+0000 7fe11fe2b280 1 -- 172.21.15.45:0/3082019968 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a33bfb1800 msgr2=0x55a33b239600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.605 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.483+0000 7fe11fe2b280 1 --2- 172.21.15.45:0/3082019968 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a33bfb1800 0x55a33b239600 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x55a33c13c0c0 tx=0x55a33c14a000 comp rx=0 tx=0).stop 2023-11-28T18:42:22.605 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.483+0000 7fe11fe2b280 1 -- 172.21.15.45:0/3082019968 shutdown_connections 2023-11-28T18:42:22.605 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.483+0000 7fe11fe2b280 1 --2- 172.21.15.45:0/3082019968 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a33c136000 0x55a33b23a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.605 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.483+0000 7fe11fe2b280 1 --2- 172.21.15.45:0/3082019968 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a33bfb1c00 0x55a33b239b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.605 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.483+0000 7fe11fe2b280 1 --2- 172.21.15.45:0/3082019968 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a33bfb1800 0x55a33b239600 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.605 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.483+0000 7fe11fe2b280 1 -- 172.21.15.45:0/3082019968 >> 172.21.15.45:0/3082019968 conn(0x55a33b1ccc00 msgr2=0x55a33b1fb800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:22.605 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.483+0000 7fe11fe2b280 1 -- 172.21.15.45:0/3082019968 shutdown_connections 2023-11-28T18:42:22.605 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.483+0000 7fe11fe2b280 1 -- 172.21.15.45:0/3082019968 wait complete. 2023-11-28T18:42:22.605 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.483+0000 7fe11fe2b280 1 Processor -- start 2023-11-28T18:42:22.606 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.483+0000 7fe11fe2b280 1 -- start start 2023-11-28T18:42:22.606 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.483+0000 7fe11fe2b280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a33bfb1c00 0x55a33b23b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.606 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.483+0000 7fe11fe2b280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a33bfb1800 0x55a33b23ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.606 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.483+0000 7fe11fe2b280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a33c137800 0x55a33b23a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.606 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.483+0000 7fe11fe2b280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a33b212140 con 0x55a33bfb1c00 2023-11-28T18:42:22.606 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.483+0000 7fe11fe2b280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a33b213180 con 0x55a33bfb1800 2023-11-28T18:42:22.606 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.483+0000 7fe11fe2b280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a33b212b40 con 0x55a33c137800 2023-11-28T18:42:22.606 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.483+0000 7fe11dd1a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a33bfb1c00 0x55a33b23b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.606 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.483+0000 7fe11cd18640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a33c137800 0x55a33b23a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.607 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.483+0000 7fe11dd1a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a33bfb1c00 0x55a33b23b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57478/0 (socket says 172.21.15.45:57478) 2023-11-28T18:42:22.607 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.483+0000 7fe11dd1a640 1 -- 172.21.15.45:0/300782090 learned_addr learned my addr 172.21.15.45:0/300782090 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:22.607 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.483+0000 7fe11d519640 1 --2- 172.21.15.45:0/300782090 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a33bfb1800 0x55a33b23ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.607 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.487+0000 7fe11dd1a640 1 -- 172.21.15.45:0/300782090 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a33c137800 msgr2=0x55a33b23a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.607 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.487+0000 7fe11dd1a640 1 --2- 172.21.15.45:0/300782090 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a33c137800 0x55a33b23a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.607 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.487+0000 7fe11dd1a640 1 -- 172.21.15.45:0/300782090 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a33bfb1800 msgr2=0x55a33b23ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.607 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.487+0000 7fe11dd1a640 1 --2- 172.21.15.45:0/300782090 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a33bfb1800 0x55a33b23ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.607 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.487+0000 7fe11dd1a640 1 -- 172.21.15.45:0/300782090 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a33b202340 con 0x55a33bfb1c00 2023-11-28T18:42:22.607 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.487+0000 7fe11cd18640 1 --2- 172.21.15.45:0/300782090 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a33c137800 0x55a33b23a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:42:22.607 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.487+0000 7fe11dd1a640 1 --2- 172.21.15.45:0/300782090 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a33bfb1c00 0x55a33b23b180 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x55a33c13d380 tx=0x55a33bf98120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.608 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.487+0000 7fe11750d640 1 -- 172.21.15.45:0/300782090 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55a33b22c420 con 0x55a33bfb1c00 2023-11-28T18:42:22.608 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.487+0000 7fe11750d640 1 -- 172.21.15.45:0/300782090 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a33bfa6780 con 0x55a33bfb1c00 2023-11-28T18:42:22.608 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.487+0000 7fe11750d640 1 -- 172.21.15.45:0/300782090 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55a33b22cf20 con 0x55a33bfb1c00 2023-11-28T18:42:22.608 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.487+0000 7fe11fe2b280 1 -- 172.21.15.45:0/300782090 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a33b202000 con 0x55a33bfb1c00 2023-11-28T18:42:22.608 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.487+0000 7fe11fe2b280 1 -- 172.21.15.45:0/300782090 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a33b202ea0 con 0x55a33bfb1c00 2023-11-28T18:42:22.608 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.487+0000 7fe11750d640 1 -- 172.21.15.45:0/300782090 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x55a33b25a840 con 0x55a33bfb1c00 2023-11-28T18:42:22.608 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.487+0000 7fe11750d640 1 --2- 172.21.15.45:0/300782090 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x55a33c14d000 0x55a33b23b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.608 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.487+0000 7fe11750d640 1 -- 172.21.15.45:0/300782090 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x55a33b20ea80 con 0x55a33bfb1c00 2023-11-28T18:42:22.608 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.487+0000 7fe11d519640 1 --2- 172.21.15.45:0/300782090 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x55a33c14d000 0x55a33b23b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.609 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.487+0000 7fe11d519640 1 --2- 172.21.15.45:0/300782090 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x55a33c14d000 0x55a33b23b700 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x55a33c04ccf0 tx=0x55a33bf98300 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.609 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.487+0000 7fe11fe2b280 1 -- start start 2023-11-28T18:42:22.609 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.491+0000 7fe11fe2b280 1 Processor -- start 2023-11-28T18:42:22.609 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.491+0000 7fe11fe2b280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a33c137000 0x55a33b23a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.609 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.491+0000 7fe11fe2b280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a33c136c00 0x55a33b239b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.609 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.491+0000 7fe11fe2b280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a33c136800 0x55a33b239600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.609 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.491+0000 7fe11fe2b280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a33b29cdc0 con 0x55a33c136c00 2023-11-28T18:42:22.610 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.491+0000 7fe11fe2b280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a33b29d180 con 0x55a33c137000 2023-11-28T18:42:22.610 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.491+0000 7fe11fe2b280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a33b29cc80 con 0x55a33c136800 2023-11-28T18:42:22.610 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.491+0000 7fe11d519640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a33c136c00 0x55a33b239b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.610 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.491+0000 7fe11d519640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a33c136c00 0x55a33b239b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57494/0 (socket says 172.21.15.45:57494) 2023-11-28T18:42:22.610 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.491+0000 7fe11d519640 1 -- 172.21.15.45:0/3202571473 learned_addr learned my addr 172.21.15.45:0/3202571473 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:22.610 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.491+0000 7fe11cd18640 1 --2- 172.21.15.45:0/3202571473 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a33c136800 0x55a33b239600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.610 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.491+0000 7fe11dd1a640 1 --2- 172.21.15.45:0/3202571473 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a33c137000 0x55a33b23a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.610 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.491+0000 7fe11d519640 1 -- 172.21.15.45:0/3202571473 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a33c136800 msgr2=0x55a33b239600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:22.610 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.491+0000 7fe11d519640 1 --2- 172.21.15.45:0/3202571473 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a33c136800 0x55a33b239600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.610 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.491+0000 7fe11d519640 1 -- 172.21.15.45:0/3202571473 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a33c137000 msgr2=0x55a33b23a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:22.611 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.491+0000 7fe11d519640 1 --2- 172.21.15.45:0/3202571473 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a33c137000 0x55a33b23a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.611 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.491+0000 7fe11d519640 1 -- 172.21.15.45:0/3202571473 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a33b4dd520 con 0x55a33c136c00 2023-11-28T18:42:22.611 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.491+0000 7fe11cd18640 1 --2- 172.21.15.45:0/3202571473 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a33c136800 0x55a33b239600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:42:22.611 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.491+0000 7fe11d519640 1 --2- 172.21.15.45:0/3202571473 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a33c136c00 0x55a33b239b80 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x55a33c04d170 tx=0x55a33bf980c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e9caef0e6d2427e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.611 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.491+0000 7fe114507640 1 -- 172.21.15.45:0/3202571473 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55a33b22d080 con 0x55a33c136c00 2023-11-28T18:42:22.611 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.491+0000 7fe114507640 1 -- 172.21.15.45:0/3202571473 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a33bfa7800 con 0x55a33c136c00 2023-11-28T18:42:22.611 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.491+0000 7fe11fe2b280 1 -- 172.21.15.45:0/3202571473 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a33b4dd380 con 0x55a33c136c00 2023-11-28T18:42:22.611 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.491+0000 7fe11fe2b280 1 -- 172.21.15.45:0/3202571473 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55a33b4db6c0 con 0x55a33c136c00 2023-11-28T18:42:22.611 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.491+0000 7fe114507640 1 -- 172.21.15.45:0/3202571473 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55a33b22cdc0 con 0x55a33c136c00 2023-11-28T18:42:22.611 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.491+0000 7fe114507640 1 -- 172.21.15.45:0/3202571473 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x55a33b20e8c0 con 0x55a33c136c00 2023-11-28T18:42:22.612 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.491+0000 7fe114507640 1 -- 172.21.15.45:0/3202571473 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 34) v1 ==== 3298+0+0 (secure 0 0 0) 0x55a33b5fa900 con 0x55a33c136c00 2023-11-28T18:42:22.612 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.491+0000 7fe11fe2b280 1 --2- 172.21.15.45:0/3202571473 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x55a33c136400 0x55a33b60e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.612 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.491+0000 7fe11fe2b280 1 -- 172.21.15.45:0/3202571473 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55a33b608380 con 0x55a33c136400 2023-11-28T18:42:22.612 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.491+0000 7fe11dd1a640 1 --2- 172.21.15.45:0/3202571473 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x55a33c136400 0x55a33b60e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.612 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.491+0000 7fe11dd1a640 1 --2- 172.21.15.45:0/3202571473 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x55a33c136400 0x55a33b60e000 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=ec225c23d718d2c2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.612 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.491+0000 7fe11dd1a640 1 -- 172.21.15.45:0/3202571473 <== osd.2 v2:172.21.15.45:6816/193884539 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x55a33bf28b40 con 0x55a33c136400 2023-11-28T18:42:22.612 INFO:tasks.workunit.client.0.smithi045.stdout:undump /tmp/journal.bin 2023-11-28T18:42:22.613 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.491+0000 7fe11fe2b280 1 -- 172.21.15.45:0/3202571473 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55a33b608700 con 0x55a33c136400 2023-11-28T18:42:22.614 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.495+0000 7fe11dd1a640 1 -- 172.21.15.45:0/3202571473 <== osd.2 v2:172.21.15.45:6816/193884539 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv25 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x55a33bf28b40 con 0x55a33c136400 2023-11-28T18:42:22.614 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.495+0000 7fe112d04640 1 --2- 172.21.15.45:0/3202571473 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x55a33b5f1c00 0x55a33b610680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.614 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.495+0000 7fe112d04640 1 -- 172.21.15.45:0/3202571473 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:3 6.1b 6:ddb4e4d7:::200.00000002:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e49) v8 -- 0x55a33b608380 con 0x55a33b5f1c00 2023-11-28T18:42:22.614 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.495+0000 7fe11cd18640 1 --2- 172.21.15.45:0/3202571473 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x55a33b5f1c00 0x55a33b610680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.614 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.495+0000 7fe11cd18640 1 --2- 172.21.15.45:0/3202571473 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x55a33b5f1c00 0x55a33b610680 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=d1157293e9d841bd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.614 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.495+0000 7fe11cd18640 1 -- 172.21.15.45:0/3202571473 <== osd.3 v2:172.21.15.45:6824/78541084 1 ==== osd_op_reply(3 200.00000002 [stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 156+0+16 (crc 0 0 0) 0x55a33bf28d80 con 0x55a33b5f1c00 2023-11-28T18:42:22.614 INFO:tasks.workunit.client.0.smithi045.stdout:start 4194304 len 34160 write_pos 4200184 format 1 trimmed_pos 4194304 stripe_unit 4194304 stripe_count 1 object_size 4194304 2023-11-28T18:42:22.615 INFO:tasks.workunit.client.0.smithi045.stdout:writing header 200.00000000 2023-11-28T18:42:22.615 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.495+0000 7fe11fe2b280 1 -- 172.21.15.45:0/3202571473 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:4 6.14 6:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55a33b608a80 con 0x55a33c136400 2023-11-28T18:42:22.615 INFO:tasks.workunit.client.0.smithi045.stdout:Purging 2 objects from 1 2023-11-28T18:42:22.616 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.495+0000 7fe11dd1a640 1 -- 172.21.15.45:0/3202571473 <== osd.2 v2:172.21.15.45:6816/193884539 3 ==== osd_op_reply(4 200.00000000 [writefull 0~90] v49'26 uv26 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55a33bf28b40 con 0x55a33c136400 2023-11-28T18:42:22.616 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.495+0000 7fe11fe2b280 1 -- 172.21.15.45:0/3202571473 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:5 6.14 6:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55a33b608700 con 0x55a33c136400 2023-11-28T18:42:22.616 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.495+0000 7fe11fe2b280 1 -- 172.21.15.45:0/3202571473 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:6 6.1b 6:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55a33b608e00 con 0x55a33b5f1c00 2023-11-28T18:42:22.616 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.499+0000 7fe11dd1a640 1 -- 172.21.15.45:0/3202571473 <== osd.2 v2:172.21.15.45:6816/193884539 4 ==== osd_op_reply(5 200.00000001 [delete] v49'27 uv27 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55a33bf28b40 con 0x55a33c136400 2023-11-28T18:42:22.616 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.499+0000 7fe11cd18640 1 -- 172.21.15.45:0/3202571473 <== osd.3 v2:172.21.15.45:6824/78541084 2 ==== osd_op_reply(6 200.00000002 [delete] v49'5 uv5 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55a33bf28d80 con 0x55a33b5f1c00 2023-11-28T18:42:22.617 INFO:tasks.workunit.client.0.smithi045.stdout: writing 4194304~34160 2023-11-28T18:42:22.617 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.499+0000 7fe11fe2b280 1 -- 172.21.15.45:0/3202571473 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:7 6.14 6:2e2fa760:::200.00000001:head [write 0~34160 in=34160b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55a33b609180 con 0x55a33c136400 2023-11-28T18:42:22.617 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.499+0000 7fe11dd1a640 1 -- 172.21.15.45:0/3202571473 <== osd.2 v2:172.21.15.45:6816/193884539 5 ==== osd_op_reply(7 200.00000001 [write 0~34160] v49'28 uv28 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55a33bf28b40 con 0x55a33c136400 2023-11-28T18:42:22.617 INFO:tasks.workunit.client.0.smithi045.stdout:done. 2023-11-28T18:42:22.619 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.499+0000 7fe11fe2b280 1 -- 172.21.15.45:0/3202571473 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x55a33c136400 msgr2=0x55a33b60e000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.619 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.499+0000 7fe11fe2b280 1 --2- 172.21.15.45:0/3202571473 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x55a33c136400 0x55a33b60e000 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.619 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.499+0000 7fe11fe2b280 1 -- 172.21.15.45:0/3202571473 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x55a33b5f1c00 msgr2=0x55a33b610680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.620 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.499+0000 7fe11fe2b280 1 --2- 172.21.15.45:0/3202571473 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x55a33b5f1c00 0x55a33b610680 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.620 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.499+0000 7fe11fe2b280 1 -- 172.21.15.45:0/3202571473 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a33c136c00 msgr2=0x55a33b239b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.620 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.499+0000 7fe11fe2b280 1 --2- 172.21.15.45:0/3202571473 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a33c136c00 0x55a33b239b80 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x55a33c04d170 tx=0x55a33bf980c0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.620 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.499+0000 7fe11cd18640 1 -- 172.21.15.45:0/3202571473 reap_dead start 2023-11-28T18:42:22.620 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.499+0000 7fe11fe2b280 1 -- 172.21.15.45:0/3202571473 shutdown_connections 2023-11-28T18:42:22.620 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.499+0000 7fe11fe2b280 1 -- 172.21.15.45:0/3202571473 >> 172.21.15.45:0/3202571473 conn(0x55a33c137400 msgr2=0x55a33b5dc000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:22.620 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.499+0000 7fe11fe2b280 1 -- 172.21.15.45:0/3202571473 shutdown_connections 2023-11-28T18:42:22.620 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.499+0000 7fe11fe2b280 1 -- 172.21.15.45:0/3202571473 wait complete. 2023-11-28T18:42:22.620 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.499+0000 7fe11fe2b280 1 -- 172.21.15.45:0/300782090 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x55a33c14d000 msgr2=0x55a33b23b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.620 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.499+0000 7fe11fe2b280 1 --2- 172.21.15.45:0/300782090 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x55a33c14d000 0x55a33b23b700 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x55a33c04ccf0 tx=0x55a33bf98300 comp rx=0 tx=0).stop 2023-11-28T18:42:22.621 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.499+0000 7fe11fe2b280 1 -- 172.21.15.45:0/300782090 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a33bfb1c00 msgr2=0x55a33b23b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.621 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.499+0000 7fe11fe2b280 1 --2- 172.21.15.45:0/300782090 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a33bfb1c00 0x55a33b23b180 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x55a33c13d380 tx=0x55a33bf98120 comp rx=0 tx=0).stop 2023-11-28T18:42:22.621 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.499+0000 7fe11fe2b280 1 -- 172.21.15.45:0/300782090 shutdown_connections 2023-11-28T18:42:22.621 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.499+0000 7fe11fe2b280 1 --2- 172.21.15.45:0/300782090 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x55a33c14d000 0x55a33b23b700 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.621 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.499+0000 7fe11fe2b280 1 --2- 172.21.15.45:0/300782090 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a33c137800 0x55a33b23a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.621 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.499+0000 7fe11fe2b280 1 --2- 172.21.15.45:0/300782090 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a33bfb1800 0x55a33b23ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.621 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.499+0000 7fe11fe2b280 1 --2- 172.21.15.45:0/300782090 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a33bfb1c00 0x55a33b23b180 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.621 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.499+0000 7fe11fe2b280 1 -- 172.21.15.45:0/300782090 >> 172.21.15.45:0/300782090 conn(0x55a33b1ccc00 msgr2=0x55a33b1fb800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:22.621 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.499+0000 7fe11fe2b280 1 -- 172.21.15.45:0/300782090 shutdown_connections 2023-11-28T18:42:22.621 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.499+0000 7fe11fe2b280 1 -- 172.21.15.45:0/300782090 wait complete. 2023-11-28T18:42:22.621 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.499+0000 7fe11fe2b280 1 -- 172.21.15.45:0/2192763697 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a33b1cd800 msgr2=0x55a33b238580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.621 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.499+0000 7fe11fe2b280 1 --2- 172.21.15.45:0/2192763697 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a33b1cd800 0x55a33b238580 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x55a33c04c390 tx=0x55a33bf98000 comp rx=0 tx=0).stop 2023-11-28T18:42:22.622 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.503+0000 7fe11fe2b280 1 -- 172.21.15.45:0/2192763697 shutdown_connections 2023-11-28T18:42:22.622 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.503+0000 7fe11fe2b280 1 --2- 172.21.15.45:0/2192763697 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a33b1cd000 0x55a33b239080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.622 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.503+0000 7fe11fe2b280 1 --2- 172.21.15.45:0/2192763697 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a33b1cd400 0x55a33b238b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.622 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.503+0000 7fe11fe2b280 1 --2- 172.21.15.45:0/2192763697 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a33b1cd800 0x55a33b238580 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.622 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.503+0000 7fe11fe2b280 1 -- 172.21.15.45:0/2192763697 >> 172.21.15.45:0/2192763697 conn(0x55a33b1cdc00 msgr2=0x55a33b1fb000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:22.622 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.503+0000 7fe11fe2b280 1 -- 172.21.15.45:0/2192763697 shutdown_connections 2023-11-28T18:42:22.622 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.503+0000 7fe11fe2b280 1 -- 172.21.15.45:0/2192763697 wait complete. 2023-11-28T18:42:22.622 INFO:tasks.workunit.client.0.smithi045.stdout:Testing 'header' commands... 2023-11-28T18:42:22.630 INFO:tasks.workunit.client.0.smithi045.stderr:+ echo 'Testing '\''header'\'' commands...' 2023-11-28T18:42:22.630 INFO:tasks.workunit.client.0.smithi045.stderr:+ cephfs-journal-tool --rank=cephfs:0 header get 2023-11-28T18:42:22.630 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.547+0000 7fc71ba77280 1 -- start start 2023-11-28T18:42:22.630 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.547+0000 7fc71ba77280 1 Processor -- start 2023-11-28T18:42:22.630 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.547+0000 7fc71ba77280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55aed30ff800 0x55aed316a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.630 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.547+0000 7fc71ba77280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55aed30ff400 0x55aed316ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.630 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.547+0000 7fc71ba77280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aed30ff000 0x55aed316b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.630 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.547+0000 7fc71ba77280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aed3145180 con 0x55aed30ff000 2023-11-28T18:42:22.631 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.547+0000 7fc71ba77280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aed3144000 con 0x55aed30ff800 2023-11-28T18:42:22.631 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.547+0000 7fc71ba77280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x55aed3144140 con 0x55aed30ff400 2023-11-28T18:42:22.631 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.547+0000 7fc71aa37640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aed30ff000 0x55aed316b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.631 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.547+0000 7fc71aa37640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aed30ff000 0x55aed316b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57510/0 (socket says 172.21.15.45:57510) 2023-11-28T18:42:22.631 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.547+0000 7fc71aa37640 1 -- 172.21.15.45:0/2924331043 learned_addr learned my addr 172.21.15.45:0/2924331043 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:22.631 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.547+0000 7fc71a236640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55aed30ff800 0x55aed316a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.631 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.547+0000 7fc719a35640 1 --2- 172.21.15.45:0/2924331043 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55aed30ff400 0x55aed316ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.632 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.547+0000 7fc71aa37640 1 -- 172.21.15.45:0/2924331043 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55aed30ff400 msgr2=0x55aed316ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:22.632 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.547+0000 7fc71aa37640 1 --2- 172.21.15.45:0/2924331043 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55aed30ff400 0x55aed316ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.632 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.547+0000 7fc71aa37640 1 -- 172.21.15.45:0/2924331043 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55aed30ff800 msgr2=0x55aed316a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:22.632 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.547+0000 7fc71aa37640 1 --2- 172.21.15.45:0/2924331043 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55aed30ff800 0x55aed316a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.632 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.547+0000 7fc71aa37640 1 -- 172.21.15.45:0/2924331043 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aed31349c0 con 0x55aed30ff000 2023-11-28T18:42:22.632 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.547+0000 7fc71a236640 1 --2- 172.21.15.45:0/2924331043 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55aed30ff800 0x55aed316a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:42:22.632 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.547+0000 7fc71aa37640 1 --2- 172.21.15.45:0/2924331043 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aed30ff000 0x55aed316b080 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x55aed3f74cf0 tx=0x55aed3e87080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=325efaafa9bcfc32 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.632 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.547+0000 7fc717a31640 1 -- 172.21.15.45:0/2924331043 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55aed315f1e0 con 0x55aed30ff000 2023-11-28T18:42:22.632 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.547+0000 7fc717a31640 1 -- 172.21.15.45:0/2924331043 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55aed315a180 con 0x55aed30ff000 2023-11-28T18:42:22.632 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.547+0000 7fc717a31640 1 -- 172.21.15.45:0/2924331043 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55aed315f080 con 0x55aed30ff000 2023-11-28T18:42:22.633 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.547+0000 7fc71ba77280 1 -- 172.21.15.45:0/2924331043 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55aed3134b60 con 0x55aed30ff000 2023-11-28T18:42:22.633 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.547+0000 7fc71ba77280 1 -- 172.21.15.45:0/2924331043 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55aed3134340 con 0x55aed30ff000 2023-11-28T18:42:22.633 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.547+0000 7fc717a31640 1 -- 172.21.15.45:0/2924331043 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x55aed3140c40 con 0x55aed30ff000 2023-11-28T18:42:22.633 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.547+0000 7fc717a31640 1 -- 172.21.15.45:0/2924331043 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 34) v1 ==== 3298+0+0 (secure 0 0 0) 0x55aed314cf00 con 0x55aed30ff000 2023-11-28T18:42:22.633 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.547+0000 7fc71ba77280 1 Processor -- start 2023-11-28T18:42:22.633 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.547+0000 7fc71ba77280 1 -- start start 2023-11-28T18:42:22.633 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.551+0000 7fc71ba77280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55aed400ac00 0x55aed316b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.633 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.551+0000 7fc71ba77280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aed400b000 0x55aed316bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.633 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.551+0000 7fc71ba77280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55aed400b400 0x55aed316c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.633 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.551+0000 7fc71ba77280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aed3144a00 con 0x55aed400b000 2023-11-28T18:42:22.634 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.551+0000 7fc71ba77280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aed31cf180 con 0x55aed400b400 2023-11-28T18:42:22.634 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.551+0000 7fc71ba77280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x55aed31cedc0 con 0x55aed400ac00 2023-11-28T18:42:22.634 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.551+0000 7fc71a236640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aed400b000 0x55aed316bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.634 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.551+0000 7fc71a236640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aed400b000 0x55aed316bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57526/0 (socket says 172.21.15.45:57526) 2023-11-28T18:42:22.634 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.551+0000 7fc71a236640 1 -- 172.21.15.45:0/705205241 learned_addr learned my addr 172.21.15.45:0/705205241 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:22.634 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.551+0000 7fc71a236640 1 -- 172.21.15.45:0/705205241 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55aed400ac00 msgr2=0x55aed316b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:22.634 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.551+0000 7fc71a236640 1 --2- 172.21.15.45:0/705205241 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55aed400ac00 0x55aed316b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.634 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.551+0000 7fc71a236640 1 -- 172.21.15.45:0/705205241 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55aed400b400 msgr2=0x55aed316c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:22.634 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.551+0000 7fc71a236640 1 --2- 172.21.15.45:0/705205241 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55aed400b400 0x55aed316c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.634 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.551+0000 7fc71a236640 1 -- 172.21.15.45:0/705205241 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aed3134000 con 0x55aed400b000 2023-11-28T18:42:22.635 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.551+0000 7fc71a236640 1 --2- 172.21.15.45:0/705205241 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aed400b000 0x55aed316bb80 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x55aed4082030 tx=0x55aed3ec8000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a556be7cae8f7c46 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.635 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.551+0000 7fc715a2d640 1 -- 172.21.15.45:0/705205241 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55aed315ef20 con 0x55aed400b000 2023-11-28T18:42:22.635 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.551+0000 7fc715a2d640 1 -- 172.21.15.45:0/705205241 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55aed315a480 con 0x55aed400b000 2023-11-28T18:42:22.635 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.551+0000 7fc715a2d640 1 -- 172.21.15.45:0/705205241 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55aed315f1e0 con 0x55aed400b000 2023-11-28T18:42:22.635 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.551+0000 7fc71ba77280 1 -- 172.21.15.45:0/705205241 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aed400b000 msgr2=0x55aed316bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.635 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.551+0000 7fc71ba77280 1 --2- 172.21.15.45:0/705205241 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aed400b000 0x55aed316bb80 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x55aed4082030 tx=0x55aed3ec8000 comp rx=0 tx=0).stop 2023-11-28T18:42:22.635 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.551+0000 7fc71ba77280 1 -- 172.21.15.45:0/705205241 shutdown_connections 2023-11-28T18:42:22.635 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.551+0000 7fc71ba77280 1 --2- 172.21.15.45:0/705205241 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55aed400b400 0x55aed316c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.635 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.551+0000 7fc71ba77280 1 --2- 172.21.15.45:0/705205241 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aed400b000 0x55aed316bb80 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.635 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.551+0000 7fc71ba77280 1 --2- 172.21.15.45:0/705205241 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55aed400ac00 0x55aed316b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.636 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.551+0000 7fc71ba77280 1 -- 172.21.15.45:0/705205241 >> 172.21.15.45:0/705205241 conn(0x55aed30fec00 msgr2=0x55aed312d800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:22.636 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.551+0000 7fc71ba77280 1 -- 172.21.15.45:0/705205241 shutdown_connections 2023-11-28T18:42:22.636 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.551+0000 7fc71ba77280 1 -- 172.21.15.45:0/705205241 wait complete. 2023-11-28T18:42:22.636 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.551+0000 7fc71ba77280 1 Processor -- start 2023-11-28T18:42:22.636 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.551+0000 7fc71ba77280 1 -- start start 2023-11-28T18:42:22.636 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.551+0000 7fc71ba77280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55aed400ac00 0x55aed316d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.636 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.551+0000 7fc71ba77280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55aed400b000 0x55aed316cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.636 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.551+0000 7fc71ba77280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aed400b400 0x55aed316c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.636 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.551+0000 7fc71ba77280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aed31cec80 con 0x55aed400b400 2023-11-28T18:42:22.636 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.551+0000 7fc71ba77280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aed3144000 con 0x55aed400b000 2023-11-28T18:42:22.637 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.551+0000 7fc71ba77280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x55aed3144b40 con 0x55aed400ac00 2023-11-28T18:42:22.637 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.551+0000 7fc719a35640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aed400b400 0x55aed316c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.637 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.551+0000 7fc719a35640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aed400b400 0x55aed316c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57534/0 (socket says 172.21.15.45:57534) 2023-11-28T18:42:22.637 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.551+0000 7fc719a35640 1 -- 172.21.15.45:0/1682291095 learned_addr learned my addr 172.21.15.45:0/1682291095 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:22.637 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.551+0000 7fc71a236640 1 --2- 172.21.15.45:0/1682291095 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55aed400b000 0x55aed316cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.637 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.551+0000 7fc719a35640 1 --2- 172.21.15.45:0/1682291095 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55aed400ac00 0x55aed316d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.637 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.551+0000 7fc719a35640 1 -- 172.21.15.45:0/1682291095 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55aed400ac00 msgr2=0x55aed316d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.637 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.551+0000 7fc719a35640 1 --2- 172.21.15.45:0/1682291095 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55aed400ac00 0x55aed316d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.637 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.551+0000 7fc719a35640 1 -- 172.21.15.45:0/1682291095 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55aed400b000 msgr2=0x55aed316cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.637 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.551+0000 7fc719a35640 1 --2- 172.21.15.45:0/1682291095 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55aed400b000 0x55aed316cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.637 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.551+0000 7fc719a35640 1 -- 172.21.15.45:0/1682291095 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aed31341a0 con 0x55aed400b400 2023-11-28T18:42:22.638 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.555+0000 7fc719a35640 1 --2- 172.21.15.45:0/1682291095 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aed400b400 0x55aed316c680 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x55aed4082e70 tx=0x55aed33e80c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.638 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.555+0000 7fc71422a640 1 -- 172.21.15.45:0/1682291095 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55aed315ef20 con 0x55aed400b400 2023-11-28T18:42:22.638 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.555+0000 7fc71422a640 1 -- 172.21.15.45:0/1682291095 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55aed3ed7980 con 0x55aed400b400 2023-11-28T18:42:22.638 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.555+0000 7fc71ba77280 1 -- 172.21.15.45:0/1682291095 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55aed3134000 con 0x55aed400b400 2023-11-28T18:42:22.638 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.555+0000 7fc71422a640 1 -- 172.21.15.45:0/1682291095 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55aed315f1e0 con 0x55aed400b400 2023-11-28T18:42:22.638 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.555+0000 7fc71ba77280 1 -- 172.21.15.45:0/1682291095 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55aed31349c0 con 0x55aed400b400 2023-11-28T18:42:22.638 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.555+0000 7fc71422a640 1 -- 172.21.15.45:0/1682291095 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x55aed318c840 con 0x55aed400b400 2023-11-28T18:42:22.638 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.555+0000 7fc71422a640 1 --2- 172.21.15.45:0/1682291095 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x55aed33ef000 0x55aed316d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.638 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.555+0000 7fc71422a640 1 -- 172.21.15.45:0/1682291095 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x55aed3140a80 con 0x55aed400b400 2023-11-28T18:42:22.638 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.555+0000 7fc71ba77280 1 --2- 172.21.15.45:0/1682291095 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x55aed400b800 0x55aed316c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.638 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.555+0000 7fc71ba77280 1 -- 172.21.15.45:0/1682291095 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55aed3155880 con 0x55aed400b800 2023-11-28T18:42:22.639 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.555+0000 7fc71a236640 1 --2- 172.21.15.45:0/1682291095 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x55aed33ef000 0x55aed316d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.639 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.555+0000 7fc719a35640 1 --2- 172.21.15.45:0/1682291095 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x55aed400b800 0x55aed316c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.639 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.559+0000 7fc71a236640 1 --2- 172.21.15.45:0/1682291095 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x55aed33ef000 0x55aed316d700 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x55aed4082030 tx=0x55aed3ec8420 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.639 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.559+0000 7fc719a35640 1 --2- 172.21.15.45:0/1682291095 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x55aed400b800 0x55aed316c100 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.639 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.559+0000 7fc719a35640 1 -- 172.21.15.45:0/1682291095 <== osd.2 v2:172.21.15.45:6816/193884539 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x55aed4000b40 con 0x55aed400b800 2023-11-28T18:42:22.639 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.559+0000 7fc71ba77280 1 -- 172.21.15.45:0/1682291095 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55aed3155c00 con 0x55aed400b800 2023-11-28T18:42:22.639 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.559+0000 7fc719a35640 1 -- 172.21.15.45:0/1682291095 <== osd.2 v2:172.21.15.45:6816/193884539 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv26 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x55aed4000b40 con 0x55aed400b800 2023-11-28T18:42:22.639 INFO:tasks.workunit.client.0.smithi045.stdout:{ 2023-11-28T18:42:22.640 INFO:tasks.workunit.client.0.smithi045.stdout: "magic": "ceph fs volume v011", 2023-11-28T18:42:22.640 INFO:tasks.workunit.client.0.smithi045.stdout: "write_pos": 4200184, 2023-11-28T18:42:22.640 INFO:tasks.workunit.client.0.smithi045.stdout: "expire_pos": 4194304, 2023-11-28T18:42:22.640 INFO:tasks.workunit.client.0.smithi045.stdout: "trimmed_pos": 4194304, 2023-11-28T18:42:22.640 INFO:tasks.workunit.client.0.smithi045.stdout: "stream_format": 1, 2023-11-28T18:42:22.640 INFO:tasks.workunit.client.0.smithi045.stdout: "layout": { 2023-11-28T18:42:22.640 INFO:tasks.workunit.client.0.smithi045.stdout: "stripe_unit": 4194304, 2023-11-28T18:42:22.640 INFO:tasks.workunit.client.0.smithi045.stdout: "stripe_count": 1, 2023-11-28T18:42:22.640 INFO:tasks.workunit.client.0.smithi045.stdout: "object_size": 4194304, 2023-11-28T18:42:22.640 INFO:tasks.workunit.client.0.smithi045.stdout: "pool_id": 6, 2023-11-28T18:42:22.640 INFO:tasks.workunit.client.0.smithi045.stdout: "pool_ns": "" 2023-11-28T18:42:22.640 INFO:tasks.workunit.client.0.smithi045.stdout: } 2023-11-28T18:42:22.641 INFO:tasks.workunit.client.0.smithi045.stdout:} 2023-11-28T18:42:22.641 INFO:tasks.workunit.client.0.smithi045.stdout: 2023-11-28T18:42:22.648 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.559+0000 7fc71ba77280 1 -- 172.21.15.45:0/1682291095 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x55aed400b800 msgr2=0x55aed316c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.648 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.559+0000 7fc71ba77280 1 --2- 172.21.15.45:0/1682291095 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x55aed400b800 0x55aed316c100 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.648 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.559+0000 7fc71ba77280 1 -- 172.21.15.45:0/1682291095 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x55aed33ef000 msgr2=0x55aed316d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.648 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.559+0000 7fc71ba77280 1 --2- 172.21.15.45:0/1682291095 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x55aed33ef000 0x55aed316d700 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x55aed4082030 tx=0x55aed3ec8420 comp rx=0 tx=0).stop 2023-11-28T18:42:22.648 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.559+0000 7fc71ba77280 1 -- 172.21.15.45:0/1682291095 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aed400b400 msgr2=0x55aed316c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.648 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.559+0000 7fc71ba77280 1 --2- 172.21.15.45:0/1682291095 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aed400b400 0x55aed316c680 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x55aed4082e70 tx=0x55aed33e80c0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.648 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.559+0000 7fc71a236640 1 -- 172.21.15.45:0/1682291095 reap_dead start 2023-11-28T18:42:22.649 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.559+0000 7fc71ba77280 1 -- 172.21.15.45:0/1682291095 shutdown_connections 2023-11-28T18:42:22.649 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.559+0000 7fc71ba77280 1 -- 172.21.15.45:0/1682291095 >> 172.21.15.45:0/1682291095 conn(0x55aed30fec00 msgr2=0x55aed312d800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:22.649 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.559+0000 7fc71ba77280 1 -- 172.21.15.45:0/1682291095 shutdown_connections 2023-11-28T18:42:22.649 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.559+0000 7fc71ba77280 1 -- 172.21.15.45:0/1682291095 wait complete. 2023-11-28T18:42:22.649 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.559+0000 7fc71ba77280 1 -- 172.21.15.45:0/2924331043 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aed30ff000 msgr2=0x55aed316b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.649 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.559+0000 7fc71ba77280 1 --2- 172.21.15.45:0/2924331043 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aed30ff000 0x55aed316b080 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x55aed3f74cf0 tx=0x55aed3e87080 comp rx=0 tx=0).stop 2023-11-28T18:42:22.649 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.559+0000 7fc71ba77280 1 -- 172.21.15.45:0/2924331043 shutdown_connections 2023-11-28T18:42:22.649 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.559+0000 7fc71ba77280 1 --2- 172.21.15.45:0/2924331043 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aed30ff000 0x55aed316b080 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.649 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.559+0000 7fc71ba77280 1 --2- 172.21.15.45:0/2924331043 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55aed30ff400 0x55aed316ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.649 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.559+0000 7fc71ba77280 1 --2- 172.21.15.45:0/2924331043 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55aed30ff800 0x55aed316a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.649 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.559+0000 7fc71ba77280 1 -- 172.21.15.45:0/2924331043 >> 172.21.15.45:0/2924331043 conn(0x55aed30ffc00 msgr2=0x55aed312d000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:22.649 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.559+0000 7fc71ba77280 1 -- 172.21.15.45:0/2924331043 shutdown_connections 2023-11-28T18:42:22.650 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.559+0000 7fc71ba77280 1 -- 172.21.15.45:0/2924331043 wait complete. 2023-11-28T18:42:22.650 INFO:tasks.workunit.client.0.smithi045.stderr:+ cephfs-journal-tool --rank=cephfs:0 header set write_pos 123 2023-11-28T18:42:22.650 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.603+0000 7f3703b24280 1 -- start start 2023-11-28T18:42:22.650 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.603+0000 7f3703b24280 1 Processor -- start 2023-11-28T18:42:22.650 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.607+0000 7f3703b24280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b937da3800 0x55b937e0e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.650 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.607+0000 7f3703b24280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55b937da3400 0x55b937e0eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.650 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.607+0000 7f3703b24280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b937da3000 0x55b937e0f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.650 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.607+0000 7f3703b24280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b937de9180 con 0x55b937da3800 2023-11-28T18:42:22.650 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.607+0000 7f3703b24280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b937de8140 con 0x55b937da3000 2023-11-28T18:42:22.650 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.607+0000 7f3703b24280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b937de8000 con 0x55b937da3400 2023-11-28T18:42:22.650 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.607+0000 7f37022e3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b937da3800 0x55b937e0e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.651 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.607+0000 7f37022e3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b937da3800 0x55b937e0e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57540/0 (socket says 172.21.15.45:57540) 2023-11-28T18:42:22.651 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.607+0000 7f37022e3640 1 -- 172.21.15.45:0/3329093955 learned_addr learned my addr 172.21.15.45:0/3329093955 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:22.651 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.607+0000 7f3701ae2640 1 --2- 172.21.15.45:0/3329093955 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55b937da3400 0x55b937e0eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.651 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.607+0000 7f3702ae4640 1 --2- 172.21.15.45:0/3329093955 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b937da3000 0x55b937e0f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.651 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.607+0000 7f37022e3640 1 -- 172.21.15.45:0/3329093955 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55b937da3400 msgr2=0x55b937e0eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:22.651 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.607+0000 7f37022e3640 1 --2- 172.21.15.45:0/3329093955 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55b937da3400 0x55b937e0eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.651 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.607+0000 7f37022e3640 1 -- 172.21.15.45:0/3329093955 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b937da3000 msgr2=0x55b937e0f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:22.651 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.607+0000 7f37022e3640 1 --2- 172.21.15.45:0/3329093955 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b937da3000 0x55b937e0f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.651 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.607+0000 7f37022e3640 1 -- 172.21.15.45:0/3329093955 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b937dd89c0 con 0x55b937da3800 2023-11-28T18:42:22.651 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.607+0000 7f3701ae2640 1 --2- 172.21.15.45:0/3329093955 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55b937da3400 0x55b937e0eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:42:22.651 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.607+0000 7f37022e3640 1 --2- 172.21.15.45:0/3329093955 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b937da3800 0x55b937e0e580 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x55b938c16c00 tx=0x55b938b6c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5c960217869a56e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.652 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.607+0000 7f36ffade640 1 -- 172.21.15.45:0/3329093955 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55b937e02f20 con 0x55b937da3800 2023-11-28T18:42:22.652 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.607+0000 7f36ffade640 1 -- 172.21.15.45:0/3329093955 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b938b78300 con 0x55b937da3800 2023-11-28T18:42:22.652 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.607+0000 7f3703b24280 1 -- 172.21.15.45:0/3329093955 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b937dd81a0 con 0x55b937da3800 2023-11-28T18:42:22.652 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.607+0000 7f3703b24280 1 -- 172.21.15.45:0/3329093955 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55b937dd89c0 con 0x55b937da3800 2023-11-28T18:42:22.652 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.607+0000 7f36ffade640 1 -- 172.21.15.45:0/3329093955 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55b937e031e0 con 0x55b937da3800 2023-11-28T18:42:22.652 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.607+0000 7f36ffade640 1 -- 172.21.15.45:0/3329093955 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x55b937de4c40 con 0x55b937da3800 2023-11-28T18:42:22.652 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.607+0000 7f36ffade640 1 -- 172.21.15.45:0/3329093955 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 34) v1 ==== 3298+0+0 (secure 0 0 0) 0x55b937df0f00 con 0x55b937da3800 2023-11-28T18:42:22.652 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.607+0000 7f3703b24280 1 Processor -- start 2023-11-28T18:42:22.652 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.607+0000 7f3703b24280 1 -- start start 2023-11-28T18:42:22.652 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.607+0000 7f3703b24280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b938b7bc00 0x55b937e0f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.652 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.607+0000 7f3703b24280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55b938d18000 0x55b937e0fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.652 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.607+0000 7f3703b24280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b938d18400 0x55b937e10100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.653 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.607+0000 7f3703b24280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b937de8a00 con 0x55b938d18400 2023-11-28T18:42:22.653 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.607+0000 7f3703b24280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b937e73180 con 0x55b938b7bc00 2023-11-28T18:42:22.653 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.607+0000 7f3703b24280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b937e72dc0 con 0x55b938d18000 2023-11-28T18:42:22.653 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.607+0000 7f3701ae2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b938d18400 0x55b937e10100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.653 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.607+0000 7f37022e3640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55b938d18000 0x55b937e0fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.653 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.607+0000 7f3701ae2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b938d18400 0x55b937e10100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57552/0 (socket says 172.21.15.45:57552) 2023-11-28T18:42:22.653 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.611+0000 7f37022e3640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55b938d18000 0x55b937e0fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.45:42578/0 (socket says 172.21.15.45:42578) 2023-11-28T18:42:22.653 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.611+0000 7f3701ae2640 1 -- 172.21.15.45:0/2520402580 learned_addr learned my addr 172.21.15.45:0/2520402580 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:22.653 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.611+0000 7f3702ae4640 1 --2- 172.21.15.45:0/2520402580 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b938b7bc00 0x55b937e0f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.653 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.611+0000 7f3701ae2640 1 -- 172.21.15.45:0/2520402580 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55b938d18000 msgr2=0x55b937e0fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:22.653 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.611+0000 7f3701ae2640 1 --2- 172.21.15.45:0/2520402580 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55b938d18000 0x55b937e0fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.653 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.611+0000 7f3701ae2640 1 -- 172.21.15.45:0/2520402580 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b938b7bc00 msgr2=0x55b937e0f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:22.654 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.611+0000 7f3701ae2640 1 --2- 172.21.15.45:0/2520402580 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b938b7bc00 0x55b937e0f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.654 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.611+0000 7f3701ae2640 1 -- 172.21.15.45:0/2520402580 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b937dd8b60 con 0x55b938d18400 2023-11-28T18:42:22.654 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.611+0000 7f3701ae2640 1 --2- 172.21.15.45:0/2520402580 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b938d18400 0x55b937e10100 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x55b938d220c0 tx=0x55b938d24000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=329982a02e385973 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.654 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.611+0000 7f36fdada640 1 -- 172.21.15.45:0/2520402580 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55b937e02f20 con 0x55b938d18400 2023-11-28T18:42:22.654 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.611+0000 7f36fdada640 1 -- 172.21.15.45:0/2520402580 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b938b78a80 con 0x55b938d18400 2023-11-28T18:42:22.654 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.611+0000 7f36fdada640 1 -- 172.21.15.45:0/2520402580 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55b937e031e0 con 0x55b938d18400 2023-11-28T18:42:22.654 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.611+0000 7f3703b24280 1 -- 172.21.15.45:0/2520402580 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b938d18400 msgr2=0x55b937e10100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.654 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.611+0000 7f3703b24280 1 --2- 172.21.15.45:0/2520402580 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b938d18400 0x55b937e10100 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x55b938d220c0 tx=0x55b938d24000 comp rx=0 tx=0).stop 2023-11-28T18:42:22.654 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.611+0000 7f3703b24280 1 -- 172.21.15.45:0/2520402580 shutdown_connections 2023-11-28T18:42:22.654 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.611+0000 7f3703b24280 1 --2- 172.21.15.45:0/2520402580 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b938d18400 0x55b937e10100 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.654 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.611+0000 7f3703b24280 1 --2- 172.21.15.45:0/2520402580 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55b938d18000 0x55b937e0fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.654 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.611+0000 7f3703b24280 1 --2- 172.21.15.45:0/2520402580 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b938b7bc00 0x55b937e0f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.655 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.611+0000 7f3703b24280 1 -- 172.21.15.45:0/2520402580 >> 172.21.15.45:0/2520402580 conn(0x55b937da2c00 msgr2=0x55b937dd1800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:22.655 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.611+0000 7f3703b24280 1 -- 172.21.15.45:0/2520402580 shutdown_connections 2023-11-28T18:42:22.655 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.611+0000 7f3703b24280 1 -- 172.21.15.45:0/2520402580 wait complete. 2023-11-28T18:42:22.655 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.611+0000 7f3703b24280 1 Processor -- start 2023-11-28T18:42:22.655 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.611+0000 7f3703b24280 1 -- start start 2023-11-28T18:42:22.655 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.611+0000 7f3703b24280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b938b7bc00 0x55b937e11180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.655 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.611+0000 7f3703b24280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b938d19800 0x55b937e10c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.655 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.611+0000 7f3703b24280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55b938d19400 0x55b937e10680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.655 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.611+0000 7f3703b24280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b937de8140 con 0x55b938d19800 2023-11-28T18:42:22.655 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.611+0000 7f3703b24280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b937de9180 con 0x55b938b7bc00 2023-11-28T18:42:22.656 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.611+0000 7f3703b24280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b937de8b40 con 0x55b938d19400 2023-11-28T18:42:22.656 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.611+0000 7f37022e3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b938d19800 0x55b937e10c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.656 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.611+0000 7f37022e3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b938d19800 0x55b937e10c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57568/0 (socket says 172.21.15.45:57568) 2023-11-28T18:42:22.656 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.611+0000 7f37022e3640 1 -- 172.21.15.45:0/1429962764 learned_addr learned my addr 172.21.15.45:0/1429962764 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:22.656 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.611+0000 7f3701ae2640 1 --2- 172.21.15.45:0/1429962764 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55b938d19400 0x55b937e10680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.656 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.611+0000 7f3702ae4640 1 --2- 172.21.15.45:0/1429962764 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b938b7bc00 0x55b937e11180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.656 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.611+0000 7f37022e3640 1 -- 172.21.15.45:0/1429962764 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55b938d19400 msgr2=0x55b937e10680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.656 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.611+0000 7f37022e3640 1 --2- 172.21.15.45:0/1429962764 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55b938d19400 0x55b937e10680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.656 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.611+0000 7f37022e3640 1 -- 172.21.15.45:0/1429962764 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b938b7bc00 msgr2=0x55b937e11180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.656 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.611+0000 7f37022e3640 1 --2- 172.21.15.45:0/1429962764 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b938b7bc00 0x55b937e11180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.656 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.611+0000 7f37022e3640 1 -- 172.21.15.45:0/1429962764 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b937dd8340 con 0x55b938d19800 2023-11-28T18:42:22.657 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.611+0000 7f37022e3640 1 --2- 172.21.15.45:0/1429962764 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b938d19800 0x55b937e10c00 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x55b938c17080 tx=0x55b938b6c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.657 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.615+0000 7f36fc2d7640 1 -- 172.21.15.45:0/1429962764 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55b937e03080 con 0x55b938d19800 2023-11-28T18:42:22.657 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.615+0000 7f36fc2d7640 1 -- 172.21.15.45:0/1429962764 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b938b78c00 con 0x55b938d19800 2023-11-28T18:42:22.657 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.615+0000 7f3703b24280 1 -- 172.21.15.45:0/1429962764 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b937dd8000 con 0x55b938d19800 2023-11-28T18:42:22.657 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.615+0000 7f36fc2d7640 1 -- 172.21.15.45:0/1429962764 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55b937e02dc0 con 0x55b938d19800 2023-11-28T18:42:22.657 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.615+0000 7f3703b24280 1 -- 172.21.15.45:0/1429962764 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b937dd8ea0 con 0x55b938d19800 2023-11-28T18:42:22.657 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.615+0000 7f36fc2d7640 1 -- 172.21.15.45:0/1429962764 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x55b937e31080 con 0x55b938d19800 2023-11-28T18:42:22.657 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.615+0000 7f36fc2d7640 1 --2- 172.21.15.45:0/1429962764 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x55b938172000 0x55b937e11700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.657 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.615+0000 7f36fc2d7640 1 -- 172.21.15.45:0/1429962764 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x55b937de4a80 con 0x55b938d19800 2023-11-28T18:42:22.657 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.615+0000 7f3703b24280 1 --2- 172.21.15.45:0/1429962764 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x55b938d19000 0x55b937e10100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.657 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.615+0000 7f3703b24280 1 -- 172.21.15.45:0/1429962764 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55b937df9880 con 0x55b938d19000 2023-11-28T18:42:22.657 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.615+0000 7f3702ae4640 1 --2- 172.21.15.45:0/1429962764 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x55b938172000 0x55b937e11700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.658 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.615+0000 7f3701ae2640 1 --2- 172.21.15.45:0/1429962764 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x55b938d19000 0x55b937e10100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.658 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.615+0000 7f3702ae4640 1 --2- 172.21.15.45:0/1429962764 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x55b938172000 0x55b937e11700 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x55b938b5e2a0 tx=0x55b938d24420 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.658 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.615+0000 7f3701ae2640 1 --2- 172.21.15.45:0/1429962764 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x55b938d19000 0x55b937e10100 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.658 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.615+0000 7f3701ae2640 1 -- 172.21.15.45:0/1429962764 <== osd.2 v2:172.21.15.45:6816/193884539 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x55b938cacb40 con 0x55b938d19000 2023-11-28T18:42:22.658 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.615+0000 7f3703b24280 1 -- 172.21.15.45:0/1429962764 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55b937df9c00 con 0x55b938d19000 2023-11-28T18:42:22.658 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.615+0000 7f3701ae2640 1 -- 172.21.15.45:0/1429962764 <== osd.2 v2:172.21.15.45:6816/193884539 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv26 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x55b938cacb40 con 0x55b938d19000 2023-11-28T18:42:22.658 INFO:tasks.workunit.client.0.smithi045.stdout:Updating write_pos 0x4016f8 -> 0x7b 2023-11-28T18:42:22.659 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.615+0000 7f3703b24280 1 -- 172.21.15.45:0/1429962764 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:3 6.14 6:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55b937df9880 con 0x55b938d19000 2023-11-28T18:42:22.659 INFO:tasks.workunit.client.0.smithi045.stdout:Successfully updated header. 2023-11-28T18:42:22.661 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.619+0000 7f3701ae2640 1 -- 172.21.15.45:0/1429962764 <== osd.2 v2:172.21.15.45:6816/193884539 3 ==== osd_op_reply(3 200.00000000 [writefull 0~90] v49'29 uv29 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55b938cacb40 con 0x55b938d19000 2023-11-28T18:42:22.661 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.619+0000 7f3703b24280 1 -- 172.21.15.45:0/1429962764 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x55b938d19000 msgr2=0x55b937e10100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.661 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.619+0000 7f3703b24280 1 --2- 172.21.15.45:0/1429962764 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x55b938d19000 0x55b937e10100 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.661 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.619+0000 7f3703b24280 1 -- 172.21.15.45:0/1429962764 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x55b938172000 msgr2=0x55b937e11700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.661 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.619+0000 7f3703b24280 1 --2- 172.21.15.45:0/1429962764 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x55b938172000 0x55b937e11700 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x55b938b5e2a0 tx=0x55b938d24420 comp rx=0 tx=0).stop 2023-11-28T18:42:22.661 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.619+0000 7f3703b24280 1 -- 172.21.15.45:0/1429962764 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b938d19800 msgr2=0x55b937e10c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.661 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.619+0000 7f3703b24280 1 --2- 172.21.15.45:0/1429962764 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b938d19800 0x55b937e10c00 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x55b938c17080 tx=0x55b938b6c360 comp rx=0 tx=0).stop 2023-11-28T18:42:22.661 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.619+0000 7f3701ae2640 1 -- 172.21.15.45:0/1429962764 reap_dead start 2023-11-28T18:42:22.661 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.619+0000 7f3703b24280 1 -- 172.21.15.45:0/1429962764 shutdown_connections 2023-11-28T18:42:22.661 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.619+0000 7f3703b24280 1 -- 172.21.15.45:0/1429962764 >> 172.21.15.45:0/1429962764 conn(0x55b937da2c00 msgr2=0x55b937dd1800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:22.662 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.619+0000 7f3703b24280 1 -- 172.21.15.45:0/1429962764 shutdown_connections 2023-11-28T18:42:22.662 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.619+0000 7f3703b24280 1 -- 172.21.15.45:0/1429962764 wait complete. 2023-11-28T18:42:22.662 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.619+0000 7f3703b24280 1 -- 172.21.15.45:0/3329093955 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b937da3800 msgr2=0x55b937e0e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.662 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.619+0000 7f3703b24280 1 --2- 172.21.15.45:0/3329093955 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b937da3800 0x55b937e0e580 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x55b938c16c00 tx=0x55b938b6c480 comp rx=0 tx=0).stop 2023-11-28T18:42:22.662 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.619+0000 7f3703b24280 1 -- 172.21.15.45:0/3329093955 shutdown_connections 2023-11-28T18:42:22.662 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.619+0000 7f3703b24280 1 --2- 172.21.15.45:0/3329093955 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b937da3000 0x55b937e0f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.662 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.619+0000 7f3703b24280 1 --2- 172.21.15.45:0/3329093955 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55b937da3400 0x55b937e0eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.662 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.619+0000 7f3703b24280 1 --2- 172.21.15.45:0/3329093955 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b937da3800 0x55b937e0e580 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.663 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.619+0000 7f3703b24280 1 -- 172.21.15.45:0/3329093955 >> 172.21.15.45:0/3329093955 conn(0x55b937da3c00 msgr2=0x55b937dd1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:22.663 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.619+0000 7f3703b24280 1 -- 172.21.15.45:0/3329093955 shutdown_connections 2023-11-28T18:42:22.663 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.619+0000 7f3703b24280 1 -- 172.21.15.45:0/3329093955 wait complete. 2023-11-28T18:42:22.663 INFO:tasks.workunit.client.0.smithi045.stderr:+ cephfs-journal-tool --rank=cephfs:0 header set expire_pos 123 2023-11-28T18:42:22.670 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.667+0000 7f08dd173280 1 -- start start 2023-11-28T18:42:22.670 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.667+0000 7f08dd173280 1 Processor -- start 2023-11-28T18:42:22.676 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.667+0000 7f08dd173280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cba1fe9800 0x55cba2054580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.677 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.667+0000 7f08dd173280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cba1fe9400 0x55cba2054b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.677 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.667+0000 7f08dd173280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cba1fe9000 0x55cba2055080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.677 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.667+0000 7f08dd173280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cba202f180 con 0x55cba1fe9800 2023-11-28T18:42:22.677 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.667+0000 7f08dd173280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cba202e000 con 0x55cba1fe9000 2023-11-28T18:42:22.677 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.667+0000 7f08dd173280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cba202e140 con 0x55cba1fe9400 2023-11-28T18:42:22.677 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.667+0000 7f08db932640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cba1fe9800 0x55cba2054580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.677 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.667+0000 7f08db932640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cba1fe9800 0x55cba2054580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57576/0 (socket says 172.21.15.45:57576) 2023-11-28T18:42:22.677 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.667+0000 7f08db932640 1 -- 172.21.15.45:0/1103024457 learned_addr learned my addr 172.21.15.45:0/1103024457 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:22.677 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.667+0000 7f08dc133640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cba1fe9000 0x55cba2055080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.677 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.667+0000 7f08db131640 1 --2- 172.21.15.45:0/1103024457 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cba1fe9400 0x55cba2054b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.677 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.667+0000 7f08db932640 1 -- 172.21.15.45:0/1103024457 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cba1fe9400 msgr2=0x55cba2054b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:22.677 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.667+0000 7f08db932640 1 --2- 172.21.15.45:0/1103024457 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cba1fe9400 0x55cba2054b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.678 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.667+0000 7f08db932640 1 -- 172.21.15.45:0/1103024457 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cba1fe9000 msgr2=0x55cba2055080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:22.678 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.667+0000 7f08db932640 1 --2- 172.21.15.45:0/1103024457 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cba1fe9000 0x55cba2055080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.678 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.667+0000 7f08db932640 1 -- 172.21.15.45:0/1103024457 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cba201e9c0 con 0x55cba1fe9800 2023-11-28T18:42:22.678 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.667+0000 7f08db932640 1 --2- 172.21.15.45:0/1103024457 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cba1fe9800 0x55cba2054580 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x55cba2e5ecc0 tx=0x55cba2d71320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11fcadf18010444 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.678 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.667+0000 7f08d912d640 1 -- 172.21.15.45:0/1103024457 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55cba20491e0 con 0x55cba1fe9800 2023-11-28T18:42:22.678 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.667+0000 7f08d912d640 1 -- 172.21.15.45:0/1103024457 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cba2044900 con 0x55cba1fe9800 2023-11-28T18:42:22.678 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.667+0000 7f08d912d640 1 -- 172.21.15.45:0/1103024457 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55cba2049080 con 0x55cba1fe9800 2023-11-28T18:42:22.678 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.667+0000 7f08dd173280 1 -- 172.21.15.45:0/1103024457 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cba201eb60 con 0x55cba1fe9800 2023-11-28T18:42:22.678 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.667+0000 7f08dd173280 1 -- 172.21.15.45:0/1103024457 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55cba201e340 con 0x55cba1fe9800 2023-11-28T18:42:22.678 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.667+0000 7f08d912d640 1 -- 172.21.15.45:0/1103024457 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x55cba202ac40 con 0x55cba1fe9800 2023-11-28T18:42:22.678 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.667+0000 7f08d912d640 1 -- 172.21.15.45:0/1103024457 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 34) v1 ==== 3298+0+0 (secure 0 0 0) 0x55cba2036f00 con 0x55cba1fe9800 2023-11-28T18:42:22.679 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.667+0000 7f08dd173280 1 Processor -- start 2023-11-28T18:42:22.679 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.667+0000 7f08dd173280 1 -- start start 2023-11-28T18:42:22.679 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.671+0000 7f08dd173280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cba2dbec00 0x55cba2055600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.679 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.671+0000 7f08dd173280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cba2dbf000 0x55cba2055b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.679 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.671+0000 7f08dd173280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cba2dbf400 0x55cba2056100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.679 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.671+0000 7f08dd173280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cba202ea00 con 0x55cba2dbf400 2023-11-28T18:42:22.679 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.671+0000 7f08dd173280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cba20b9180 con 0x55cba2dbf000 2023-11-28T18:42:22.680 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.671+0000 7f08dd173280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cba20b8dc0 con 0x55cba2dbec00 2023-11-28T18:42:22.680 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.671+0000 7f08dc133640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cba2dbec00 0x55cba2055600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.680 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.671+0000 7f08db131640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cba2dbf400 0x55cba2056100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.680 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.671+0000 7f08dc133640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cba2dbec00 0x55cba2055600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.45:42620/0 (socket says 172.21.15.45:42620) 2023-11-28T18:42:22.680 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.671+0000 7f08dc133640 1 -- 172.21.15.45:0/4051027643 learned_addr learned my addr 172.21.15.45:0/4051027643 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:22.680 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.671+0000 7f08db932640 1 --2- 172.21.15.45:0/4051027643 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cba2dbf000 0x55cba2055b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.680 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.671+0000 7f08db131640 1 -- 172.21.15.45:0/4051027643 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cba2dbec00 msgr2=0x55cba2055600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:22.680 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.671+0000 7f08db131640 1 --2- 172.21.15.45:0/4051027643 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cba2dbec00 0x55cba2055600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.680 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.671+0000 7f08db131640 1 -- 172.21.15.45:0/4051027643 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cba2dbf000 msgr2=0x55cba2055b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:22.680 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.671+0000 7f08db131640 1 --2- 172.21.15.45:0/4051027643 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cba2dbf000 0x55cba2055b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.680 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.671+0000 7f08db131640 1 -- 172.21.15.45:0/4051027643 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cba201e000 con 0x55cba2dbf400 2023-11-28T18:42:22.680 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.671+0000 7f08dc133640 1 --2- 172.21.15.45:0/4051027643 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cba2dbec00 0x55cba2055600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:42:22.681 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.671+0000 7f08db131640 1 --2- 172.21.15.45:0/4051027643 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cba2dbf400 0x55cba2056100 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x55cba2e5e330 tx=0x55cba2db0000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=854dfa30ef93b972 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.681 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.671+0000 7f08d7129640 1 -- 172.21.15.45:0/4051027643 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55cba2048f20 con 0x55cba2dbf400 2023-11-28T18:42:22.681 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.671+0000 7f08d7129640 1 -- 172.21.15.45:0/4051027643 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cba2daac00 con 0x55cba2dbf400 2023-11-28T18:42:22.681 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.671+0000 7f08d7129640 1 -- 172.21.15.45:0/4051027643 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55cba20491e0 con 0x55cba2dbf400 2023-11-28T18:42:22.681 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.671+0000 7f08dd173280 1 -- 172.21.15.45:0/4051027643 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cba2dbf400 msgr2=0x55cba2056100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.681 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.671+0000 7f08dd173280 1 --2- 172.21.15.45:0/4051027643 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cba2dbf400 0x55cba2056100 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x55cba2e5e330 tx=0x55cba2db0000 comp rx=0 tx=0).stop 2023-11-28T18:42:22.681 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.671+0000 7f08dd173280 1 -- 172.21.15.45:0/4051027643 shutdown_connections 2023-11-28T18:42:22.681 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.671+0000 7f08dd173280 1 --2- 172.21.15.45:0/4051027643 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cba2dbf400 0x55cba2056100 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.681 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.671+0000 7f08dd173280 1 --2- 172.21.15.45:0/4051027643 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cba2dbf000 0x55cba2055b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.681 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.671+0000 7f08dd173280 1 --2- 172.21.15.45:0/4051027643 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cba2dbec00 0x55cba2055600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.681 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.671+0000 7f08dd173280 1 -- 172.21.15.45:0/4051027643 >> 172.21.15.45:0/4051027643 conn(0x55cba1fe8c00 msgr2=0x55cba2017800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:22.681 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.671+0000 7f08dd173280 1 -- 172.21.15.45:0/4051027643 shutdown_connections 2023-11-28T18:42:22.682 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.671+0000 7f08dd173280 1 -- 172.21.15.45:0/4051027643 wait complete. 2023-11-28T18:42:22.682 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.671+0000 7f08dd173280 1 Processor -- start 2023-11-28T18:42:22.682 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.671+0000 7f08dd173280 1 -- start start 2023-11-28T18:42:22.685 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.671+0000 7f08dd173280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cba2dbec00 0x55cba2057180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.685 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.671+0000 7f08dd173280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cba2dbf000 0x55cba2056c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.685 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.671+0000 7f08dd173280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cba2dbf400 0x55cba2056680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.685 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.671+0000 7f08dd173280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cba20b8c80 con 0x55cba2dbec00 2023-11-28T18:42:22.686 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.671+0000 7f08dd173280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cba202e000 con 0x55cba2dbf000 2023-11-28T18:42:22.686 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.671+0000 7f08dd173280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cba202eb40 con 0x55cba2dbf400 2023-11-28T18:42:22.686 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.675+0000 7f08dc133640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cba2dbec00 0x55cba2057180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.686 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.675+0000 7f08dc133640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cba2dbec00 0x55cba2057180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57592/0 (socket says 172.21.15.45:57592) 2023-11-28T18:42:22.686 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.675+0000 7f08dc133640 1 -- 172.21.15.45:0/2835356780 learned_addr learned my addr 172.21.15.45:0/2835356780 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:22.686 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.675+0000 7f08db131640 1 --2- 172.21.15.45:0/2835356780 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cba2dbf400 0x55cba2056680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.686 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.675+0000 7f08db932640 1 --2- 172.21.15.45:0/2835356780 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cba2dbf000 0x55cba2056c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.686 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.675+0000 7f08dc133640 1 -- 172.21.15.45:0/2835356780 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cba2dbf400 msgr2=0x55cba2056680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.686 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.675+0000 7f08dc133640 1 --2- 172.21.15.45:0/2835356780 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cba2dbf400 0x55cba2056680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.686 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.675+0000 7f08dc133640 1 -- 172.21.15.45:0/2835356780 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cba2dbf000 msgr2=0x55cba2056c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.686 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.675+0000 7f08dc133640 1 --2- 172.21.15.45:0/2835356780 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cba2dbf000 0x55cba2056c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.687 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.675+0000 7f08dc133640 1 -- 172.21.15.45:0/2835356780 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cba201e1a0 con 0x55cba2dbec00 2023-11-28T18:42:22.687 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.675+0000 7f08db932640 1 --2- 172.21.15.45:0/2835356780 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cba2dbf000 0x55cba2056c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:42:22.687 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.675+0000 7f08dc133640 1 --2- 172.21.15.45:0/2835356780 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cba2dbec00 0x55cba2057180 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x55cba2f60f00 tx=0x55cba2dae180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.687 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.675+0000 7f08d5926640 1 -- 172.21.15.45:0/2835356780 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55cba2048f20 con 0x55cba2dbec00 2023-11-28T18:42:22.687 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.675+0000 7f08d5926640 1 -- 172.21.15.45:0/2835356780 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cba2dab680 con 0x55cba2dbec00 2023-11-28T18:42:22.687 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.675+0000 7f08dd173280 1 -- 172.21.15.45:0/2835356780 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cba201e000 con 0x55cba2dbec00 2023-11-28T18:42:22.687 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.675+0000 7f08d5926640 1 -- 172.21.15.45:0/2835356780 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55cba20491e0 con 0x55cba2dbec00 2023-11-28T18:42:22.687 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.675+0000 7f08dd173280 1 -- 172.21.15.45:0/2835356780 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cba201e9c0 con 0x55cba2dbec00 2023-11-28T18:42:22.687 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.675+0000 7f08d5926640 1 -- 172.21.15.45:0/2835356780 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x55cba2076840 con 0x55cba2dbec00 2023-11-28T18:42:22.687 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.675+0000 7f08d5926640 1 --2- 172.21.15.45:0/2835356780 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x55cba2ef7000 0x55cba2057700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.687 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.675+0000 7f08d5926640 1 -- 172.21.15.45:0/2835356780 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x55cba202aa80 con 0x55cba2dbec00 2023-11-28T18:42:22.688 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.675+0000 7f08dd173280 1 --2- 172.21.15.45:0/2835356780 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x55cba2dbf800 0x55cba2056100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.688 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.675+0000 7f08dd173280 1 -- 172.21.15.45:0/2835356780 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55cba203f880 con 0x55cba2dbf800 2023-11-28T18:42:22.688 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.675+0000 7f08db932640 1 --2- 172.21.15.45:0/2835356780 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x55cba2ef7000 0x55cba2057700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.688 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.675+0000 7f08db131640 1 --2- 172.21.15.45:0/2835356780 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x55cba2dbf800 0x55cba2056100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.688 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.679+0000 7f08db932640 1 --2- 172.21.15.45:0/2835356780 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x55cba2ef7000 0x55cba2057700 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x55cba2e5f200 tx=0x55cba206af00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.688 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.679+0000 7f08db131640 1 --2- 172.21.15.45:0/2835356780 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x55cba2dbf800 0x55cba2056100 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.688 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.679+0000 7f08db131640 1 -- 172.21.15.45:0/2835356780 <== osd.2 v2:172.21.15.45:6816/193884539 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x55cba2eeeb40 con 0x55cba2dbf800 2023-11-28T18:42:22.688 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.679+0000 7f08dd173280 1 -- 172.21.15.45:0/2835356780 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55cba203fc00 con 0x55cba2dbf800 2023-11-28T18:42:22.688 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.679+0000 7f08db131640 1 -- 172.21.15.45:0/2835356780 <== osd.2 v2:172.21.15.45:6816/193884539 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv29 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x55cba2eeeb40 con 0x55cba2dbf800 2023-11-28T18:42:22.688 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.679+0000 7f08dd173280 -1 Header is invalid (inconsistent offsets) 2023-11-28T18:42:22.689 INFO:tasks.workunit.client.0.smithi045.stdout:Updating expire_pos 0x400000 -> 0x7b 2023-11-28T18:42:22.689 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.679+0000 7f08dd173280 1 -- 172.21.15.45:0/2835356780 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:3 6.14 6:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55cba203f880 con 0x55cba2dbf800 2023-11-28T18:42:22.689 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.679+0000 7f08db131640 1 -- 172.21.15.45:0/2835356780 <== osd.2 v2:172.21.15.45:6816/193884539 3 ==== osd_op_reply(3 200.00000000 [writefull 0~90] v49'30 uv30 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55cba2eeeb40 con 0x55cba2dbf800 2023-11-28T18:42:22.689 INFO:tasks.workunit.client.0.smithi045.stdout:Successfully updated header. 2023-11-28T18:42:22.691 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.679+0000 7f08dd173280 1 -- 172.21.15.45:0/2835356780 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x55cba2dbf800 msgr2=0x55cba2056100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.691 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.679+0000 7f08dd173280 1 --2- 172.21.15.45:0/2835356780 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x55cba2dbf800 0x55cba2056100 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.691 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.679+0000 7f08dd173280 1 -- 172.21.15.45:0/2835356780 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x55cba2ef7000 msgr2=0x55cba2057700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.691 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.679+0000 7f08dd173280 1 --2- 172.21.15.45:0/2835356780 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x55cba2ef7000 0x55cba2057700 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x55cba2e5f200 tx=0x55cba206af00 comp rx=0 tx=0).stop 2023-11-28T18:42:22.691 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.679+0000 7f08dd173280 1 -- 172.21.15.45:0/2835356780 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cba2dbec00 msgr2=0x55cba2057180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.691 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.679+0000 7f08dd173280 1 --2- 172.21.15.45:0/2835356780 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cba2dbec00 0x55cba2057180 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x55cba2f60f00 tx=0x55cba2dae180 comp rx=0 tx=0).stop 2023-11-28T18:42:22.691 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.679+0000 7f08db131640 1 -- 172.21.15.45:0/2835356780 reap_dead start 2023-11-28T18:42:22.691 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.679+0000 7f08dd173280 1 -- 172.21.15.45:0/2835356780 shutdown_connections 2023-11-28T18:42:22.692 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.679+0000 7f08dd173280 1 -- 172.21.15.45:0/2835356780 >> 172.21.15.45:0/2835356780 conn(0x55cba1fe8c00 msgr2=0x55cba2017800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:22.692 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.679+0000 7f08dd173280 1 -- 172.21.15.45:0/2835356780 shutdown_connections 2023-11-28T18:42:22.692 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.679+0000 7f08dd173280 1 -- 172.21.15.45:0/2835356780 wait complete. 2023-11-28T18:42:22.692 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.679+0000 7f08dd173280 1 -- 172.21.15.45:0/1103024457 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cba1fe9800 msgr2=0x55cba2054580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.692 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.679+0000 7f08dd173280 1 --2- 172.21.15.45:0/1103024457 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cba1fe9800 0x55cba2054580 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x55cba2e5ecc0 tx=0x55cba2d71320 comp rx=0 tx=0).stop 2023-11-28T18:42:22.692 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.679+0000 7f08dd173280 1 -- 172.21.15.45:0/1103024457 shutdown_connections 2023-11-28T18:42:22.694 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.679+0000 7f08dd173280 1 --2- 172.21.15.45:0/1103024457 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cba1fe9000 0x55cba2055080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.694 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.679+0000 7f08dd173280 1 --2- 172.21.15.45:0/1103024457 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cba1fe9400 0x55cba2054b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.694 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.679+0000 7f08dd173280 1 --2- 172.21.15.45:0/1103024457 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cba1fe9800 0x55cba2054580 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.694 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.679+0000 7f08dd173280 1 -- 172.21.15.45:0/1103024457 >> 172.21.15.45:0/1103024457 conn(0x55cba1fe9c00 msgr2=0x55cba2017000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:22.694 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.679+0000 7f08dd173280 1 -- 172.21.15.45:0/1103024457 shutdown_connections 2023-11-28T18:42:22.694 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.679+0000 7f08dd173280 1 -- 172.21.15.45:0/1103024457 wait complete. 2023-11-28T18:42:22.694 INFO:tasks.workunit.client.0.smithi045.stderr:+ cephfs-journal-tool --rank=cephfs:0 header set trimmed_pos 123 2023-11-28T18:42:22.731 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.727+0000 7f1cf5a46280 1 -- start start 2023-11-28T18:42:22.731 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.727+0000 7f1cf5a46280 1 Processor -- start 2023-11-28T18:42:22.732 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.727+0000 7f1cf5a46280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cf600ef800 0x55cf6015a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.732 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.727+0000 7f1cf5a46280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cf600ef400 0x55cf6015ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.732 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.727+0000 7f1cf5a46280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cf600ef000 0x55cf6015b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.732 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.727+0000 7f1cf5a46280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf60135180 con 0x55cf600ef400 2023-11-28T18:42:22.732 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.727+0000 7f1cf5a46280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf60134000 con 0x55cf600ef800 2023-11-28T18:42:22.732 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.727+0000 7f1cf5a46280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cf60134140 con 0x55cf600ef000 2023-11-28T18:42:22.732 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.727+0000 7f1cf2d18640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cf600ef400 0x55cf6015ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.732 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.727+0000 7f1cf3519640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cf600ef800 0x55cf6015a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.733 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.727+0000 7f1cf2d18640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cf600ef400 0x55cf6015ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57596/0 (socket says 172.21.15.45:57596) 2023-11-28T18:42:22.733 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.727+0000 7f1cf2d18640 1 -- 172.21.15.45:0/2874021137 learned_addr learned my addr 172.21.15.45:0/2874021137 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:22.733 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.727+0000 7f1cf3519640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cf600ef800 0x55cf6015a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.45:38232/0 (socket says 172.21.15.45:38232) 2023-11-28T18:42:22.733 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.727+0000 7f1cf3d1a640 1 --2- 172.21.15.45:0/2874021137 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cf600ef000 0x55cf6015b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.734 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.727+0000 7f1cf2d18640 1 -- 172.21.15.45:0/2874021137 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cf600ef000 msgr2=0x55cf6015b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:22.734 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.727+0000 7f1cf2d18640 1 --2- 172.21.15.45:0/2874021137 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cf600ef000 0x55cf6015b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.734 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.727+0000 7f1cf2d18640 1 -- 172.21.15.45:0/2874021137 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cf600ef800 msgr2=0x55cf6015a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:22.735 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.727+0000 7f1cf2d18640 1 --2- 172.21.15.45:0/2874021137 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cf600ef800 0x55cf6015a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.735 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.727+0000 7f1cf2d18640 1 -- 172.21.15.45:0/2874021137 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cf601249c0 con 0x55cf600ef400 2023-11-28T18:42:22.735 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.727+0000 7f1cf3519640 1 --2- 172.21.15.45:0/2874021137 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cf600ef800 0x55cf6015a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:42:22.735 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.727+0000 7f1cf3d1a640 1 --2- 172.21.15.45:0/2874021137 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cf600ef000 0x55cf6015b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:42:22.735 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.727+0000 7f1cf2d18640 1 --2- 172.21.15.45:0/2874021137 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cf600ef400 0x55cf6015ab00 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x55cf60f60cc0 tx=0x55cf60e77080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec6b3553334aa7a2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.735 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.727+0000 7f1cf0d14640 1 -- 172.21.15.45:0/2874021137 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55cf6014f1e0 con 0x55cf600ef400 2023-11-28T18:42:22.735 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.727+0000 7f1cf0d14640 1 -- 172.21.15.45:0/2874021137 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cf6014a180 con 0x55cf600ef400 2023-11-28T18:42:22.735 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.727+0000 7f1cf0d14640 1 -- 172.21.15.45:0/2874021137 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55cf6014f080 con 0x55cf600ef400 2023-11-28T18:42:22.735 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.727+0000 7f1cf5a46280 1 -- 172.21.15.45:0/2874021137 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cf60124b60 con 0x55cf600ef400 2023-11-28T18:42:22.735 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.727+0000 7f1cf5a46280 1 -- 172.21.15.45:0/2874021137 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55cf60124340 con 0x55cf600ef400 2023-11-28T18:42:22.735 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.727+0000 7f1cf0d14640 1 -- 172.21.15.45:0/2874021137 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x55cf60130c40 con 0x55cf600ef400 2023-11-28T18:42:22.736 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.731+0000 7f1cf0d14640 1 -- 172.21.15.45:0/2874021137 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 34) v1 ==== 3298+0+0 (secure 0 0 0) 0x55cf6013cf00 con 0x55cf600ef400 2023-11-28T18:42:22.736 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.731+0000 7f1cf5a46280 1 Processor -- start 2023-11-28T18:42:22.736 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.731+0000 7f1cf5a46280 1 -- start start 2023-11-28T18:42:22.739 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.731+0000 7f1cf5a46280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cf61012800 0x55cf6015b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.739 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.731+0000 7f1cf5a46280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cf61012c00 0x55cf6015bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.740 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.731+0000 7f1cf5a46280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cf61013000 0x55cf6015c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.740 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.731+0000 7f1cf5a46280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf60134a00 con 0x55cf61013000 2023-11-28T18:42:22.740 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.731+0000 7f1cf5a46280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf601bf180 con 0x55cf61012800 2023-11-28T18:42:22.740 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.731+0000 7f1cf5a46280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cf601bedc0 con 0x55cf61012c00 2023-11-28T18:42:22.740 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.731+0000 7f1cf2d18640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cf61013000 0x55cf6015c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.740 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.731+0000 7f1cf2d18640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cf61013000 0x55cf6015c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57610/0 (socket says 172.21.15.45:57610) 2023-11-28T18:42:22.740 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.731+0000 7f1cf3519640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cf61012c00 0x55cf6015bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.740 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.731+0000 7f1cf2d18640 1 -- 172.21.15.45:0/1470143252 learned_addr learned my addr 172.21.15.45:0/1470143252 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:22.740 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.731+0000 7f1cf3d1a640 1 --2- 172.21.15.45:0/1470143252 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cf61012800 0x55cf6015b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.740 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.731+0000 7f1cf2d18640 1 -- 172.21.15.45:0/1470143252 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cf61012c00 msgr2=0x55cf6015bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:22.740 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.731+0000 7f1cf2d18640 1 --2- 172.21.15.45:0/1470143252 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cf61012c00 0x55cf6015bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.740 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.731+0000 7f1cf2d18640 1 -- 172.21.15.45:0/1470143252 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cf61012800 msgr2=0x55cf6015b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:22.741 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.731+0000 7f1cf2d18640 1 --2- 172.21.15.45:0/1470143252 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cf61012800 0x55cf6015b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.741 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.731+0000 7f1cf2d18640 1 -- 172.21.15.45:0/1470143252 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cf60124000 con 0x55cf61013000 2023-11-28T18:42:22.741 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.731+0000 7f1cf2d18640 1 --2- 172.21.15.45:0/1470143252 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cf61013000 0x55cf6015c100 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x55cf61062150 tx=0x55cf60170f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e10626e731b32cba server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.741 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.731+0000 7f1ceed10640 1 -- 172.21.15.45:0/1470143252 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55cf6014edc0 con 0x55cf61013000 2023-11-28T18:42:22.741 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.731+0000 7f1ceed10640 1 -- 172.21.15.45:0/1470143252 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cf60ec2f00 con 0x55cf61013000 2023-11-28T18:42:22.741 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.731+0000 7f1ceed10640 1 -- 172.21.15.45:0/1470143252 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55cf6014f1e0 con 0x55cf61013000 2023-11-28T18:42:22.741 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.731+0000 7f1cf5a46280 1 -- 172.21.15.45:0/1470143252 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cf61013000 msgr2=0x55cf6015c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.741 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.731+0000 7f1cf5a46280 1 --2- 172.21.15.45:0/1470143252 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cf61013000 0x55cf6015c100 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x55cf61062150 tx=0x55cf60170f00 comp rx=0 tx=0).stop 2023-11-28T18:42:22.741 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.731+0000 7f1cf5a46280 1 -- 172.21.15.45:0/1470143252 shutdown_connections 2023-11-28T18:42:22.741 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.731+0000 7f1cf5a46280 1 --2- 172.21.15.45:0/1470143252 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cf61013000 0x55cf6015c100 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.741 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.731+0000 7f1cf5a46280 1 --2- 172.21.15.45:0/1470143252 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cf61012c00 0x55cf6015bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.742 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.731+0000 7f1cf5a46280 1 --2- 172.21.15.45:0/1470143252 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cf61012800 0x55cf6015b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.742 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.731+0000 7f1cf5a46280 1 -- 172.21.15.45:0/1470143252 >> 172.21.15.45:0/1470143252 conn(0x55cf600eec00 msgr2=0x55cf6011d800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:22.742 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.731+0000 7f1cf5a46280 1 -- 172.21.15.45:0/1470143252 shutdown_connections 2023-11-28T18:42:22.742 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.731+0000 7f1cf5a46280 1 -- 172.21.15.45:0/1470143252 wait complete. 2023-11-28T18:42:22.742 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.735+0000 7f1cf5a46280 1 Processor -- start 2023-11-28T18:42:22.742 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.735+0000 7f1cf5a46280 1 -- start start 2023-11-28T18:42:22.742 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.735+0000 7f1cf5a46280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cf61012800 0x55cf6015d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.742 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.735+0000 7f1cf5a46280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cf61012c00 0x55cf6015cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.742 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.735+0000 7f1cf5a46280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cf61013000 0x55cf6015c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.742 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.735+0000 7f1cf5a46280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf601bec80 con 0x55cf61012c00 2023-11-28T18:42:22.742 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.735+0000 7f1cf5a46280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf60134000 con 0x55cf61013000 2023-11-28T18:42:22.742 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.735+0000 7f1cf5a46280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cf60134b40 con 0x55cf61012800 2023-11-28T18:42:22.743 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.735+0000 7f1cf3519640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cf61012c00 0x55cf6015cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.743 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.735+0000 7f1cf3519640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cf61012c00 0x55cf6015cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57626/0 (socket says 172.21.15.45:57626) 2023-11-28T18:42:22.743 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.735+0000 7f1cf3519640 1 -- 172.21.15.45:0/2863665071 learned_addr learned my addr 172.21.15.45:0/2863665071 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:22.743 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.735+0000 7f1cf3d1a640 1 --2- 172.21.15.45:0/2863665071 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cf61012800 0x55cf6015d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.743 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.735+0000 7f1cf2d18640 1 --2- 172.21.15.45:0/2863665071 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cf61013000 0x55cf6015c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.743 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.735+0000 7f1cf3519640 1 -- 172.21.15.45:0/2863665071 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cf61012800 msgr2=0x55cf6015d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.743 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.735+0000 7f1cf3519640 1 --2- 172.21.15.45:0/2863665071 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cf61012800 0x55cf6015d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.743 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.735+0000 7f1cf3519640 1 -- 172.21.15.45:0/2863665071 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cf61013000 msgr2=0x55cf6015c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.743 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.735+0000 7f1cf3519640 1 --2- 172.21.15.45:0/2863665071 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cf61013000 0x55cf6015c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.743 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.735+0000 7f1cf3519640 1 -- 172.21.15.45:0/2863665071 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cf601249c0 con 0x55cf61012c00 2023-11-28T18:42:22.743 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.735+0000 7f1cf3519640 1 --2- 172.21.15.45:0/2863665071 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cf61012c00 0x55cf6015cc00 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x55cf61062d20 tx=0x55cf60eb8060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.743 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.735+0000 7f1ced50d640 1 -- 172.21.15.45:0/2863665071 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55cf6014ef20 con 0x55cf61012c00 2023-11-28T18:42:22.744 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.735+0000 7f1ced50d640 1 -- 172.21.15.45:0/2863665071 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cf60ec2480 con 0x55cf61012c00 2023-11-28T18:42:22.744 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.735+0000 7f1cf5a46280 1 -- 172.21.15.45:0/2863665071 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cf60124b60 con 0x55cf61012c00 2023-11-28T18:42:22.744 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.735+0000 7f1ced50d640 1 -- 172.21.15.45:0/2863665071 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55cf6014edc0 con 0x55cf61012c00 2023-11-28T18:42:22.744 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.735+0000 7f1cf5a46280 1 -- 172.21.15.45:0/2863665071 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cf60124ea0 con 0x55cf61012c00 2023-11-28T18:42:22.745 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.739+0000 7f1ced50d640 1 -- 172.21.15.45:0/2863665071 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x55cf6017d080 con 0x55cf61012c00 2023-11-28T18:42:22.745 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.739+0000 7f1ced50d640 1 --2- 172.21.15.45:0/2863665071 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x55cf603cb000 0x55cf6015d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.745 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.739+0000 7f1ced50d640 1 -- 172.21.15.45:0/2863665071 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x55cf60130a80 con 0x55cf61012c00 2023-11-28T18:42:22.745 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.739+0000 7f1cf5a46280 1 --2- 172.21.15.45:0/2863665071 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x55cf61013400 0x55cf6015c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.746 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.739+0000 7f1cf5a46280 1 -- 172.21.15.45:0/2863665071 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55cf60145880 con 0x55cf61013400 2023-11-28T18:42:22.746 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.739+0000 7f1cf3d1a640 1 --2- 172.21.15.45:0/2863665071 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x55cf603cb000 0x55cf6015d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.746 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.739+0000 7f1cf2d18640 1 --2- 172.21.15.45:0/2863665071 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x55cf61013400 0x55cf6015c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.746 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.739+0000 7f1cf2d18640 1 --2- 172.21.15.45:0/2863665071 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x55cf61013400 0x55cf6015c100 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.746 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.739+0000 7f1cf3d1a640 1 --2- 172.21.15.45:0/2863665071 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x55cf603cb000 0x55cf6015d700 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x55cf60eaa1b0 tx=0x55cf603cc120 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.746 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.739+0000 7f1cf2d18640 1 -- 172.21.15.45:0/2863665071 <== osd.2 v2:172.21.15.45:6816/193884539 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x55cf60ff4b40 con 0x55cf61013400 2023-11-28T18:42:22.746 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.739+0000 7f1cf5a46280 1 -- 172.21.15.45:0/2863665071 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55cf60145c00 con 0x55cf61013400 2023-11-28T18:42:22.746 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.739+0000 7f1cf2d18640 1 -- 172.21.15.45:0/2863665071 <== osd.2 v2:172.21.15.45:6816/193884539 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv30 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x55cf60ff4b40 con 0x55cf61013400 2023-11-28T18:42:22.746 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.739+0000 7f1cf5a46280 -1 Header is invalid (inconsistent offsets) 2023-11-28T18:42:22.747 INFO:tasks.workunit.client.0.smithi045.stdout:Updating trimmed_pos 0x400000 -> 0x7b 2023-11-28T18:42:22.747 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.739+0000 7f1cf5a46280 1 -- 172.21.15.45:0/2863665071 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:3 6.14 6:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55cf604ca000 con 0x55cf61013400 2023-11-28T18:42:22.747 INFO:tasks.workunit.client.0.smithi045.stdout:Successfully updated header. 2023-11-28T18:42:22.749 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.739+0000 7f1cf2d18640 1 -- 172.21.15.45:0/2863665071 <== osd.2 v2:172.21.15.45:6816/193884539 3 ==== osd_op_reply(3 200.00000000 [writefull 0~90] v49'31 uv31 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55cf60ff4b40 con 0x55cf61013400 2023-11-28T18:42:22.749 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.739+0000 7f1cf5a46280 1 -- 172.21.15.45:0/2863665071 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x55cf61013400 msgr2=0x55cf6015c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.749 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.739+0000 7f1cf5a46280 1 --2- 172.21.15.45:0/2863665071 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x55cf61013400 0x55cf6015c100 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.749 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.739+0000 7f1cf5a46280 1 -- 172.21.15.45:0/2863665071 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x55cf603cb000 msgr2=0x55cf6015d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.749 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.739+0000 7f1cf5a46280 1 --2- 172.21.15.45:0/2863665071 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x55cf603cb000 0x55cf6015d700 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x55cf60eaa1b0 tx=0x55cf603cc120 comp rx=0 tx=0).stop 2023-11-28T18:42:22.749 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.739+0000 7f1cf5a46280 1 -- 172.21.15.45:0/2863665071 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cf61012c00 msgr2=0x55cf6015cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.749 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.739+0000 7f1cf5a46280 1 --2- 172.21.15.45:0/2863665071 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cf61012c00 0x55cf6015cc00 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x55cf61062d20 tx=0x55cf60eb8060 comp rx=0 tx=0).stop 2023-11-28T18:42:22.749 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.739+0000 7f1cf3519640 1 -- 172.21.15.45:0/2863665071 reap_dead start 2023-11-28T18:42:22.749 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.739+0000 7f1cf5a46280 1 -- 172.21.15.45:0/2863665071 shutdown_connections 2023-11-28T18:42:22.750 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.739+0000 7f1cf5a46280 1 -- 172.21.15.45:0/2863665071 >> 172.21.15.45:0/2863665071 conn(0x55cf600eec00 msgr2=0x55cf6011d800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:22.750 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.743+0000 7f1cf5a46280 1 -- 172.21.15.45:0/2863665071 shutdown_connections 2023-11-28T18:42:22.750 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.743+0000 7f1cf5a46280 1 -- 172.21.15.45:0/2863665071 wait complete. 2023-11-28T18:42:22.750 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.743+0000 7f1cf5a46280 1 -- 172.21.15.45:0/2874021137 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cf600ef400 msgr2=0x55cf6015ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.750 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.743+0000 7f1cf5a46280 1 --2- 172.21.15.45:0/2874021137 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cf600ef400 0x55cf6015ab00 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x55cf60f60cc0 tx=0x55cf60e77080 comp rx=0 tx=0).stop 2023-11-28T18:42:22.750 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.743+0000 7f1cf5a46280 1 -- 172.21.15.45:0/2874021137 shutdown_connections 2023-11-28T18:42:22.750 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.743+0000 7f1cf5a46280 1 --2- 172.21.15.45:0/2874021137 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cf600ef000 0x55cf6015b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.750 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.743+0000 7f1cf5a46280 1 --2- 172.21.15.45:0/2874021137 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cf600ef400 0x55cf6015ab00 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.750 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.743+0000 7f1cf5a46280 1 --2- 172.21.15.45:0/2874021137 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cf600ef800 0x55cf6015a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.750 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.743+0000 7f1cf5a46280 1 -- 172.21.15.45:0/2874021137 >> 172.21.15.45:0/2874021137 conn(0x55cf600efc00 msgr2=0x55cf6011d000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:22.750 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.743+0000 7f1cf5a46280 1 -- 172.21.15.45:0/2874021137 shutdown_connections 2023-11-28T18:42:22.750 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.743+0000 7f1cf5a46280 1 -- 172.21.15.45:0/2874021137 wait complete. 2023-11-28T18:42:22.751 INFO:tasks.workunit.client.0.smithi045.stdout:Rolling back journal to original state... 2023-11-28T18:42:22.751 INFO:tasks.workunit.client.0.smithi045.stderr:+ echo 'Rolling back journal to original state...' 2023-11-28T18:42:22.751 INFO:tasks.workunit.client.0.smithi045.stderr:+ cephfs-journal-tool --rank=cephfs:0 journal import /tmp/journal.bin 2023-11-28T18:42:22.790 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.787+0000 7fa272c94280 1 -- start start 2023-11-28T18:42:22.790 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.787+0000 7fa272c94280 1 Processor -- start 2023-11-28T18:42:22.791 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.787+0000 7fa272c94280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ab0f74f800 0x55ab0f7ba580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.791 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.787+0000 7fa272c94280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ab0f74f400 0x55ab0f7bab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.792 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.787+0000 7fa272c94280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ab0f74f000 0x55ab0f7bb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.792 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.787+0000 7fa272c94280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab0f795180 con 0x55ab0f74f800 2023-11-28T18:42:22.792 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.787+0000 7fa272c94280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab0f794140 con 0x55ab0f74f000 2023-11-28T18:42:22.792 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.787+0000 7fa272c94280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ab0f794000 con 0x55ab0f74f400 2023-11-28T18:42:22.792 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.787+0000 7fa271455640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ab0f74f800 0x55ab0f7ba580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.792 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.787+0000 7fa271455640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ab0f74f800 0x55ab0f7ba580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57640/0 (socket says 172.21.15.45:57640) 2023-11-28T18:42:22.792 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.787+0000 7fa271455640 1 -- 172.21.15.45:0/3936257214 learned_addr learned my addr 172.21.15.45:0/3936257214 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:22.792 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.787+0000 7fa270c54640 1 --2- 172.21.15.45:0/3936257214 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ab0f74f400 0x55ab0f7bab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.792 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.787+0000 7fa271c56640 1 --2- 172.21.15.45:0/3936257214 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ab0f74f000 0x55ab0f7bb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.793 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.787+0000 7fa271455640 1 -- 172.21.15.45:0/3936257214 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ab0f74f400 msgr2=0x55ab0f7bab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:22.794 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.787+0000 7fa271455640 1 --2- 172.21.15.45:0/3936257214 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ab0f74f400 0x55ab0f7bab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.794 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.787+0000 7fa271455640 1 -- 172.21.15.45:0/3936257214 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ab0f74f000 msgr2=0x55ab0f7bb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:22.794 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.787+0000 7fa271455640 1 --2- 172.21.15.45:0/3936257214 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ab0f74f000 0x55ab0f7bb080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.794 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.787+0000 7fa271455640 1 -- 172.21.15.45:0/3936257214 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ab0f7849c0 con 0x55ab0f74f800 2023-11-28T18:42:22.794 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.787+0000 7fa271455640 1 --2- 172.21.15.45:0/3936257214 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ab0f74f800 0x55ab0f7ba580 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x55ab105cacf0 tx=0x55ab0f7d1140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84c326283cf1d349 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.794 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.787+0000 7fa26ec50640 1 -- 172.21.15.45:0/3936257214 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55ab0f7af1e0 con 0x55ab0f74f800 2023-11-28T18:42:22.794 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.787+0000 7fa26ec50640 1 -- 172.21.15.45:0/3936257214 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ab0f7aa180 con 0x55ab0f74f800 2023-11-28T18:42:22.794 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.787+0000 7fa26ec50640 1 -- 172.21.15.45:0/3936257214 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55ab0f7af080 con 0x55ab0f74f800 2023-11-28T18:42:22.794 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.787+0000 7fa272c94280 1 -- 172.21.15.45:0/3936257214 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ab0f784b60 con 0x55ab0f74f800 2023-11-28T18:42:22.794 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.787+0000 7fa272c94280 1 -- 172.21.15.45:0/3936257214 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55ab0f784340 con 0x55ab0f74f800 2023-11-28T18:42:22.795 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.787+0000 7fa26ec50640 1 -- 172.21.15.45:0/3936257214 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x55ab0f790c40 con 0x55ab0f74f800 2023-11-28T18:42:22.795 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.787+0000 7fa26ec50640 1 -- 172.21.15.45:0/3936257214 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 34) v1 ==== 3298+0+0 (secure 0 0 0) 0x55ab0f79d200 con 0x55ab0f74f800 2023-11-28T18:42:22.795 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.791+0000 7fa272c94280 1 Processor -- start 2023-11-28T18:42:22.795 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.791+0000 7fa272c94280 1 -- start start 2023-11-28T18:42:22.799 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.791+0000 7fa272c94280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ab10524c00 0x55ab0f7bb600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.800 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.791+0000 7fa272c94280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ab10525000 0x55ab0f7bbb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.800 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.791+0000 7fa272c94280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ab10525400 0x55ab0f7bc100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.800 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.791+0000 7fa272c94280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab0f794a00 con 0x55ab10525400 2023-11-28T18:42:22.800 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.791+0000 7fa272c94280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab0f81f180 con 0x55ab10525000 2023-11-28T18:42:22.800 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.791+0000 7fa272c94280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ab0f81edc0 con 0x55ab10524c00 2023-11-28T18:42:22.800 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.791+0000 7fa270c54640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ab10525400 0x55ab0f7bc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.800 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.791+0000 7fa270c54640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ab10525400 0x55ab0f7bc100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57656/0 (socket says 172.21.15.45:57656) 2023-11-28T18:42:22.800 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.791+0000 7fa270c54640 1 -- 172.21.15.45:0/868812985 learned_addr learned my addr 172.21.15.45:0/868812985 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:22.800 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.791+0000 7fa271c56640 1 --2- 172.21.15.45:0/868812985 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ab10524c00 0x55ab0f7bb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.800 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.791+0000 7fa271455640 1 --2- 172.21.15.45:0/868812985 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ab10525000 0x55ab0f7bbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.800 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.791+0000 7fa270c54640 1 -- 172.21.15.45:0/868812985 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ab10524c00 msgr2=0x55ab0f7bb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:22.801 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.791+0000 7fa270c54640 1 --2- 172.21.15.45:0/868812985 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ab10524c00 0x55ab0f7bb600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.801 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.791+0000 7fa270c54640 1 -- 172.21.15.45:0/868812985 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ab10525000 msgr2=0x55ab0f7bbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:22.801 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.791+0000 7fa270c54640 1 --2- 172.21.15.45:0/868812985 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ab10525000 0x55ab0f7bbb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.801 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.791+0000 7fa270c54640 1 -- 172.21.15.45:0/868812985 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ab0f784000 con 0x55ab10525400 2023-11-28T18:42:22.801 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.791+0000 7fa270c54640 1 --2- 172.21.15.45:0/868812985 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ab10525400 0x55ab0f7bc100 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x55ab106b81b0 tx=0x55ab10522000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82b69279b5bcd53e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.801 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.791+0000 7fa26cc4c640 1 -- 172.21.15.45:0/868812985 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55ab0f7aef20 con 0x55ab10525400 2023-11-28T18:42:22.801 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.791+0000 7fa26cc4c640 1 -- 172.21.15.45:0/868812985 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ab0f7aa480 con 0x55ab10525400 2023-11-28T18:42:22.801 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.791+0000 7fa26cc4c640 1 -- 172.21.15.45:0/868812985 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55ab0f7af1e0 con 0x55ab10525400 2023-11-28T18:42:22.801 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.791+0000 7fa272c94280 1 -- 172.21.15.45:0/868812985 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ab10525400 msgr2=0x55ab0f7bc100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.801 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.791+0000 7fa272c94280 1 --2- 172.21.15.45:0/868812985 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ab10525400 0x55ab0f7bc100 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x55ab106b81b0 tx=0x55ab10522000 comp rx=0 tx=0).stop 2023-11-28T18:42:22.801 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.791+0000 7fa272c94280 1 -- 172.21.15.45:0/868812985 shutdown_connections 2023-11-28T18:42:22.801 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.791+0000 7fa272c94280 1 --2- 172.21.15.45:0/868812985 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ab10525400 0x55ab0f7bc100 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.802 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.791+0000 7fa272c94280 1 --2- 172.21.15.45:0/868812985 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ab10525000 0x55ab0f7bbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.802 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.791+0000 7fa272c94280 1 --2- 172.21.15.45:0/868812985 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ab10524c00 0x55ab0f7bb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.802 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.791+0000 7fa272c94280 1 -- 172.21.15.45:0/868812985 >> 172.21.15.45:0/868812985 conn(0x55ab0f74ec00 msgr2=0x55ab0f77d800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:22.802 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.791+0000 7fa272c94280 1 -- 172.21.15.45:0/868812985 shutdown_connections 2023-11-28T18:42:22.802 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.791+0000 7fa272c94280 1 -- 172.21.15.45:0/868812985 wait complete. 2023-11-28T18:42:22.802 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.791+0000 7fa272c94280 1 Processor -- start 2023-11-28T18:42:22.802 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.795+0000 7fa272c94280 1 -- start start 2023-11-28T18:42:22.802 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.795+0000 7fa272c94280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ab10524c00 0x55ab0f7bd180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.802 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.795+0000 7fa272c94280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ab10525000 0x55ab0f7bcc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.803 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.795+0000 7fa272c94280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ab10525400 0x55ab0f7bc680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.803 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.795+0000 7fa272c94280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab0f81ec80 con 0x55ab10525400 2023-11-28T18:42:22.803 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.795+0000 7fa272c94280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab0f794140 con 0x55ab10524c00 2023-11-28T18:42:22.803 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.795+0000 7fa272c94280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ab0f794b40 con 0x55ab10525000 2023-11-28T18:42:22.803 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.795+0000 7fa270c54640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ab10525400 0x55ab0f7bc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.803 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.795+0000 7fa270c54640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ab10525400 0x55ab0f7bc680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57672/0 (socket says 172.21.15.45:57672) 2023-11-28T18:42:22.803 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.795+0000 7fa270c54640 1 -- 172.21.15.45:0/1889096398 learned_addr learned my addr 172.21.15.45:0/1889096398 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:22.803 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.795+0000 7fa271455640 1 --2- 172.21.15.45:0/1889096398 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ab10525000 0x55ab0f7bcc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.803 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.795+0000 7fa271c56640 1 --2- 172.21.15.45:0/1889096398 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ab10524c00 0x55ab0f7bd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.803 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.795+0000 7fa270c54640 1 -- 172.21.15.45:0/1889096398 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ab10525000 msgr2=0x55ab0f7bcc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.803 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.795+0000 7fa270c54640 1 --2- 172.21.15.45:0/1889096398 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ab10525000 0x55ab0f7bcc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.804 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.795+0000 7fa270c54640 1 -- 172.21.15.45:0/1889096398 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ab10524c00 msgr2=0x55ab0f7bd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.804 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.795+0000 7fa270c54640 1 --2- 172.21.15.45:0/1889096398 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ab10524c00 0x55ab0f7bd180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.804 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.795+0000 7fa270c54640 1 -- 172.21.15.45:0/1889096398 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ab0f7841a0 con 0x55ab10525400 2023-11-28T18:42:22.804 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.795+0000 7fa270c54640 1 --2- 172.21.15.45:0/1889096398 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ab10525400 0x55ab0f7bc680 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x55ab106b84e0 tx=0x55ab10522420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.804 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.795+0000 7fa26b449640 1 -- 172.21.15.45:0/1889096398 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55ab0f7af080 con 0x55ab10525400 2023-11-28T18:42:22.804 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.795+0000 7fa26b449640 1 -- 172.21.15.45:0/1889096398 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ab0f7aa900 con 0x55ab10525400 2023-11-28T18:42:22.804 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.795+0000 7fa26b449640 1 -- 172.21.15.45:0/1889096398 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55ab0f7ae420 con 0x55ab10525400 2023-11-28T18:42:22.804 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.795+0000 7fa272c94280 1 -- 172.21.15.45:0/1889096398 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ab0f784000 con 0x55ab10525400 2023-11-28T18:42:22.804 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.795+0000 7fa272c94280 1 -- 172.21.15.45:0/1889096398 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ab0f7849c0 con 0x55ab10525400 2023-11-28T18:42:22.807 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.795+0000 7fa26b449640 1 -- 172.21.15.45:0/1889096398 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x55ab0f7dd080 con 0x55ab10525400 2023-11-28T18:42:22.807 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.799+0000 7fa26b449640 1 --2- 172.21.15.45:0/1889096398 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x55ab0fa3a400 0x55ab0f7bd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.808 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.799+0000 7fa26b449640 1 -- 172.21.15.45:0/1889096398 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x55ab0f790a80 con 0x55ab10525400 2023-11-28T18:42:22.808 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.799+0000 7fa271c56640 1 --2- 172.21.15.45:0/1889096398 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x55ab0fa3a400 0x55ab0f7bd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.808 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.799+0000 7fa271c56640 1 --2- 172.21.15.45:0/1889096398 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x55ab0fa3a400 0x55ab0f7bd700 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x55ab105140f0 tx=0x55ab0fb22c00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.808 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.799+0000 7fa272c94280 1 -- start start 2023-11-28T18:42:22.808 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.799+0000 7fa272c94280 1 Processor -- start 2023-11-28T18:42:22.808 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.799+0000 7fa272c94280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ab10525c00 0x55ab0f7bc100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.808 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.799+0000 7fa272c94280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ab0fa3b400 0x55ab0f7bbb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.808 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.799+0000 7fa272c94280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ab0fa3b800 0x55ab0f7bb600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.808 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.799+0000 7fa272c94280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab0f81edc0 con 0x55ab0fa3b800 2023-11-28T18:42:22.808 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.799+0000 7fa272c94280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab0f81f180 con 0x55ab10525c00 2023-11-28T18:42:22.809 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.799+0000 7fa272c94280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ab0f81eb40 con 0x55ab0fa3b400 2023-11-28T18:42:22.809 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.799+0000 7fa270c54640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ab0fa3b800 0x55ab0f7bb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.809 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.799+0000 7fa270c54640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ab0fa3b800 0x55ab0f7bb600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57688/0 (socket says 172.21.15.45:57688) 2023-11-28T18:42:22.809 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.799+0000 7fa270c54640 1 -- 172.21.15.45:0/432612207 learned_addr learned my addr 172.21.15.45:0/432612207 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:22.809 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.799+0000 7fa271455640 1 --2- 172.21.15.45:0/432612207 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ab0fa3b400 0x55ab0f7bbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.809 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.799+0000 7fa271c56640 1 --2- 172.21.15.45:0/432612207 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ab10525c00 0x55ab0f7bc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.809 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.799+0000 7fa270c54640 1 -- 172.21.15.45:0/432612207 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ab0fa3b400 msgr2=0x55ab0f7bbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:22.809 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.799+0000 7fa270c54640 1 --2- 172.21.15.45:0/432612207 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ab0fa3b400 0x55ab0f7bbb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.809 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.799+0000 7fa270c54640 1 -- 172.21.15.45:0/432612207 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ab10525c00 msgr2=0x55ab0f7bc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:22.809 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.799+0000 7fa270c54640 1 --2- 172.21.15.45:0/432612207 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ab10525c00 0x55ab0f7bc100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.809 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.799+0000 7fa270c54640 1 -- 172.21.15.45:0/432612207 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ab0fa696c0 con 0x55ab0fa3b800 2023-11-28T18:42:22.810 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.799+0000 7fa271455640 1 --2- 172.21.15.45:0/432612207 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ab0fa3b400 0x55ab0f7bbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:42:22.810 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.799+0000 7fa270c54640 1 --2- 172.21.15.45:0/432612207 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ab0fa3b800 0x55ab0f7bb600 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x55ab0fa88db0 tx=0x55ab0fa306c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7940297de1c93d0a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.810 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.799+0000 7fa268443640 1 -- 172.21.15.45:0/432612207 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55ab0f7af1e0 con 0x55ab0fa3b800 2023-11-28T18:42:22.810 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.799+0000 7fa268443640 1 -- 172.21.15.45:0/432612207 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ab0f7aa180 con 0x55ab0fa3b800 2023-11-28T18:42:22.810 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.799+0000 7fa268443640 1 -- 172.21.15.45:0/432612207 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55ab0f7ae2c0 con 0x55ab0fa3b800 2023-11-28T18:42:22.810 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.799+0000 7fa272c94280 1 -- 172.21.15.45:0/432612207 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ab0fa69520 con 0x55ab0fa3b800 2023-11-28T18:42:22.810 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.799+0000 7fa272c94280 1 -- 172.21.15.45:0/432612207 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55ab0fa69380 con 0x55ab0fa3b800 2023-11-28T18:42:22.810 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.799+0000 7fa268443640 1 -- 172.21.15.45:0/432612207 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x55ab0f7908c0 con 0x55ab0fa3b800 2023-11-28T18:42:22.810 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.799+0000 7fa268443640 1 -- 172.21.15.45:0/432612207 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 34) v1 ==== 3298+0+0 (secure 0 0 0) 0x55ab0fb86900 con 0x55ab0fa3b800 2023-11-28T18:42:22.811 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.799+0000 7fa272c94280 1 --2- 172.21.15.45:0/432612207 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x55ab0fa3bc00 0x55ab0fb94000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.811 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.799+0000 7fa272c94280 1 -- 172.21.15.45:0/432612207 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55ab0fb98000 con 0x55ab0fa3bc00 2023-11-28T18:42:22.811 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.803+0000 7fa271c56640 1 --2- 172.21.15.45:0/432612207 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x55ab0fa3bc00 0x55ab0fb94000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.811 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.803+0000 7fa271c56640 1 --2- 172.21.15.45:0/432612207 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x55ab0fa3bc00 0x55ab0fb94000 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=6e06b9fc3f1f6ff2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.811 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.803+0000 7fa271c56640 1 -- 172.21.15.45:0/432612207 <== osd.2 v2:172.21.15.45:6816/193884539 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x55ab10654b40 con 0x55ab0fa3bc00 2023-11-28T18:42:22.811 INFO:tasks.workunit.client.0.smithi045.stdout:undump /tmp/journal.bin 2023-11-28T18:42:22.812 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.803+0000 7fa272c94280 1 -- 172.21.15.45:0/432612207 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55ab0fb98380 con 0x55ab0fa3bc00 2023-11-28T18:42:22.813 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.803+0000 7fa271c56640 1 -- 172.21.15.45:0/432612207 <== osd.2 v2:172.21.15.45:6816/193884539 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv31 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x55ab10654b40 con 0x55ab0fa3bc00 2023-11-28T18:42:22.813 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.803+0000 7fa266c40640 1 -- 172.21.15.45:0/432612207 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:3 6.14 6:292cf221:::200.00000000:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e49) v8 -- 0x55ab0fb98000 con 0x55ab0fa3bc00 2023-11-28T18:42:22.813 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.803+0000 7fa266c40640 1 -- 172.21.15.45:0/432612207 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:4 6.14 6:2e2fa760:::200.00000001:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e49) v8 -- 0x55ab0fb98380 con 0x55ab0fa3bc00 2023-11-28T18:42:22.813 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.803+0000 7fa271c56640 1 -- 172.21.15.45:0/432612207 <== osd.2 v2:172.21.15.45:6816/193884539 3 ==== osd_op_reply(3 200.00000000 [stat out=16b] v0'0 uv31 ondisk = 0) v8 ==== 156+0+16 (crc 0 0 0) 0x55ab10654b40 con 0x55ab0fa3bc00 2023-11-28T18:42:22.813 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.803+0000 7fa271c56640 1 -- 172.21.15.45:0/432612207 <== osd.2 v2:172.21.15.45:6816/193884539 4 ==== osd_op_reply(4 200.00000001 [stat out=16b] v0'0 uv28 ondisk = 0) v8 ==== 156+0+16 (crc 0 0 0) 0x55ab10654b40 con 0x55ab0fa3bc00 2023-11-28T18:42:22.813 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.803+0000 7fa266c40640 1 --2- 172.21.15.45:0/432612207 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x55ab0fb7f000 0x55ab0fb96680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.813 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.803+0000 7fa266c40640 1 -- 172.21.15.45:0/432612207 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:5 6.1b 6:ddb4e4d7:::200.00000002:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e49) v8 -- 0x55ab0fb98a80 con 0x55ab0fb7f000 2023-11-28T18:42:22.813 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.803+0000 7fa271455640 1 --2- 172.21.15.45:0/432612207 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x55ab0fb7f000 0x55ab0fb96680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.813 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.803+0000 7fa271455640 1 --2- 172.21.15.45:0/432612207 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x55ab0fb7f000 0x55ab0fb96680 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=ac559c099f9bfd8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.813 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.803+0000 7fa271455640 1 -- 172.21.15.45:0/432612207 <== osd.3 v2:172.21.15.45:6824/78541084 1 ==== osd_op_reply(5 200.00000002 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55ab10654d80 con 0x55ab0fb7f000 2023-11-28T18:42:22.814 INFO:tasks.workunit.client.0.smithi045.stdout:start 4194304 len 34160 write_pos 4200184 format 1 trimmed_pos 4194304 stripe_unit 4194304 stripe_count 1 object_size 4194304 2023-11-28T18:42:22.814 INFO:tasks.workunit.client.0.smithi045.stdout:writing header 200.00000000 2023-11-28T18:42:22.814 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.803+0000 7fa272c94280 1 -- 172.21.15.45:0/432612207 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:6 6.14 6:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55ab0fb98700 con 0x55ab0fa3bc00 2023-11-28T18:42:22.814 INFO:tasks.workunit.client.0.smithi045.stdout:Purging 2 objects from 1 2023-11-28T18:42:22.815 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.807+0000 7fa271c56640 1 -- 172.21.15.45:0/432612207 <== osd.2 v2:172.21.15.45:6816/193884539 5 ==== osd_op_reply(6 200.00000000 [writefull 0~90] v49'32 uv32 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55ab10654b40 con 0x55ab0fa3bc00 2023-11-28T18:42:22.815 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.807+0000 7fa272c94280 1 -- 172.21.15.45:0/432612207 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:7 6.14 6:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55ab0fb98000 con 0x55ab0fa3bc00 2023-11-28T18:42:22.815 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.807+0000 7fa272c94280 1 -- 172.21.15.45:0/432612207 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:8 6.1b 6:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55ab0fb98380 con 0x55ab0fb7f000 2023-11-28T18:42:22.815 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.807+0000 7fa271c56640 1 -- 172.21.15.45:0/432612207 <== osd.2 v2:172.21.15.45:6816/193884539 6 ==== osd_op_reply(7 200.00000001 [delete] v49'33 uv33 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55ab10654b40 con 0x55ab0fa3bc00 2023-11-28T18:42:22.815 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.807+0000 7fa271455640 1 -- 172.21.15.45:0/432612207 <== osd.3 v2:172.21.15.45:6824/78541084 2 ==== osd_op_reply(8 200.00000002 [delete] v49'6 uv5 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55ab10654d80 con 0x55ab0fb7f000 2023-11-28T18:42:22.816 INFO:tasks.workunit.client.0.smithi045.stdout: writing 4194304~34160 2023-11-28T18:42:22.816 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.807+0000 7fa272c94280 1 -- 172.21.15.45:0/432612207 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:9 6.14 6:2e2fa760:::200.00000001:head [write 0~34160 in=34160b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55ab0fb98700 con 0x55ab0fa3bc00 2023-11-28T18:42:22.816 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.807+0000 7fa271c56640 1 -- 172.21.15.45:0/432612207 <== osd.2 v2:172.21.15.45:6816/193884539 7 ==== osd_op_reply(9 200.00000001 [write 0~34160] v49'34 uv34 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55ab10654b40 con 0x55ab0fa3bc00 2023-11-28T18:42:22.816 INFO:tasks.workunit.client.0.smithi045.stdout:done. 2023-11-28T18:42:22.818 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.807+0000 7fa272c94280 1 -- 172.21.15.45:0/432612207 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x55ab0fa3bc00 msgr2=0x55ab0fb94000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.818 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.807+0000 7fa272c94280 1 --2- 172.21.15.45:0/432612207 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x55ab0fa3bc00 0x55ab0fb94000 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.818 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.807+0000 7fa272c94280 1 -- 172.21.15.45:0/432612207 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x55ab0fb7f000 msgr2=0x55ab0fb96680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.818 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.807+0000 7fa272c94280 1 --2- 172.21.15.45:0/432612207 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x55ab0fb7f000 0x55ab0fb96680 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.819 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.807+0000 7fa272c94280 1 -- 172.21.15.45:0/432612207 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ab0fa3b800 msgr2=0x55ab0f7bb600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.819 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.807+0000 7fa272c94280 1 --2- 172.21.15.45:0/432612207 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ab0fa3b800 0x55ab0f7bb600 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x55ab0fa88db0 tx=0x55ab0fa306c0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.819 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.807+0000 7fa271455640 1 -- 172.21.15.45:0/432612207 reap_dead start 2023-11-28T18:42:22.819 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.807+0000 7fa272c94280 1 -- 172.21.15.45:0/432612207 shutdown_connections 2023-11-28T18:42:22.819 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.807+0000 7fa272c94280 1 -- 172.21.15.45:0/432612207 >> 172.21.15.45:0/432612207 conn(0x55ab10525800 msgr2=0x55ab0fb6c000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:22.819 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.807+0000 7fa272c94280 1 -- 172.21.15.45:0/432612207 shutdown_connections 2023-11-28T18:42:22.819 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.807+0000 7fa272c94280 1 -- 172.21.15.45:0/432612207 wait complete. 2023-11-28T18:42:22.820 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.811+0000 7fa272c94280 1 -- 172.21.15.45:0/1889096398 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x55ab0fa3a400 msgr2=0x55ab0f7bd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.820 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.811+0000 7fa272c94280 1 --2- 172.21.15.45:0/1889096398 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x55ab0fa3a400 0x55ab0f7bd700 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x55ab105140f0 tx=0x55ab0fb22c00 comp rx=0 tx=0).stop 2023-11-28T18:42:22.820 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.811+0000 7fa272c94280 1 -- 172.21.15.45:0/1889096398 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ab10525400 msgr2=0x55ab0f7bc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.820 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.811+0000 7fa272c94280 1 --2- 172.21.15.45:0/1889096398 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ab10525400 0x55ab0f7bc680 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x55ab106b84e0 tx=0x55ab10522420 comp rx=0 tx=0).stop 2023-11-28T18:42:22.820 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.811+0000 7fa272c94280 1 -- 172.21.15.45:0/1889096398 shutdown_connections 2023-11-28T18:42:22.820 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.811+0000 7fa272c94280 1 --2- 172.21.15.45:0/1889096398 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x55ab0fa3a400 0x55ab0f7bd700 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.820 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.811+0000 7fa272c94280 1 --2- 172.21.15.45:0/1889096398 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ab10525400 0x55ab0f7bc680 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.820 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.811+0000 7fa272c94280 1 --2- 172.21.15.45:0/1889096398 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ab10525000 0x55ab0f7bcc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.820 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.811+0000 7fa272c94280 1 --2- 172.21.15.45:0/1889096398 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ab10524c00 0x55ab0f7bd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.820 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.811+0000 7fa272c94280 1 -- 172.21.15.45:0/1889096398 >> 172.21.15.45:0/1889096398 conn(0x55ab0f74ec00 msgr2=0x55ab0f77d800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:22.820 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.811+0000 7fa272c94280 1 -- 172.21.15.45:0/1889096398 shutdown_connections 2023-11-28T18:42:22.820 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.811+0000 7fa272c94280 1 -- 172.21.15.45:0/1889096398 wait complete. 2023-11-28T18:42:22.821 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.811+0000 7fa272c94280 1 -- 172.21.15.45:0/3936257214 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ab0f74f800 msgr2=0x55ab0f7ba580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.821 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.811+0000 7fa272c94280 1 --2- 172.21.15.45:0/3936257214 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ab0f74f800 0x55ab0f7ba580 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x55ab105cacf0 tx=0x55ab0f7d1140 comp rx=0 tx=0).stop 2023-11-28T18:42:22.821 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.811+0000 7fa272c94280 1 -- 172.21.15.45:0/3936257214 shutdown_connections 2023-11-28T18:42:22.821 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.811+0000 7fa272c94280 1 --2- 172.21.15.45:0/3936257214 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ab0f74f000 0x55ab0f7bb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.821 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.811+0000 7fa272c94280 1 --2- 172.21.15.45:0/3936257214 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ab0f74f400 0x55ab0f7bab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.821 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.811+0000 7fa272c94280 1 --2- 172.21.15.45:0/3936257214 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ab0f74f800 0x55ab0f7ba580 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.821 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.811+0000 7fa272c94280 1 -- 172.21.15.45:0/3936257214 >> 172.21.15.45:0/3936257214 conn(0x55ab0f74fc00 msgr2=0x55ab0f77d000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:22.821 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.811+0000 7fa272c94280 1 -- 172.21.15.45:0/3936257214 shutdown_connections 2023-11-28T18:42:22.821 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.811+0000 7fa272c94280 1 -- 172.21.15.45:0/3936257214 wait complete. 2023-11-28T18:42:22.822 INFO:tasks.workunit.client.0.smithi045.stdout:Testing 'event' commands... 2023-11-28T18:42:22.822 INFO:tasks.workunit.client.0.smithi045.stderr:+ echo 'Testing '\''event'\'' commands...' 2023-11-28T18:42:22.822 INFO:tasks.workunit.client.0.smithi045.stderr:+ cephfs-journal-tool --rank=cephfs:0 event get summary 2023-11-28T18:42:22.859 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.855+0000 7f4d4c31d280 1 -- start start 2023-11-28T18:42:22.859 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.855+0000 7f4d4c31d280 1 Processor -- start 2023-11-28T18:42:22.862 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.855+0000 7f4d4c31d280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560919deb800 0x560919e56580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.862 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.855+0000 7f4d4c31d280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560919deb400 0x560919e56b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.862 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.855+0000 7f4d4c31d280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560919deb000 0x560919e57080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.862 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.855+0000 7f4d4c31d280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x560919e31180 con 0x560919deb400 2023-11-28T18:42:22.862 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.855+0000 7f4d4c31d280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x560919e30140 con 0x560919deb800 2023-11-28T18:42:22.862 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.855+0000 7f4d4c31d280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x560919e30000 con 0x560919deb000 2023-11-28T18:42:22.862 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.855+0000 7f4d4a2db640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560919deb400 0x560919e56b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.862 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.855+0000 7f4d4a2db640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560919deb400 0x560919e56b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57700/0 (socket says 172.21.15.45:57700) 2023-11-28T18:42:22.862 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.855+0000 7f4d4a2db640 1 -- 172.21.15.45:0/1757230828 learned_addr learned my addr 172.21.15.45:0/1757230828 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:22.862 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.855+0000 7f4d4b2dd640 1 --2- 172.21.15.45:0/1757230828 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560919deb000 0x560919e57080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.863 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.855+0000 7f4d4aadc640 1 --2- 172.21.15.45:0/1757230828 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560919deb800 0x560919e56580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.863 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.855+0000 7f4d4a2db640 1 -- 172.21.15.45:0/1757230828 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560919deb000 msgr2=0x560919e57080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:22.863 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.855+0000 7f4d4a2db640 1 --2- 172.21.15.45:0/1757230828 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560919deb000 0x560919e57080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.863 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.855+0000 7f4d4a2db640 1 -- 172.21.15.45:0/1757230828 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560919deb800 msgr2=0x560919e56580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:22.863 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.855+0000 7f4d4a2db640 1 --2- 172.21.15.45:0/1757230828 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560919deb800 0x560919e56580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.863 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.855+0000 7f4d4a2db640 1 -- 172.21.15.45:0/1757230828 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560919e209c0 con 0x560919deb400 2023-11-28T18:42:22.863 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.855+0000 7f4d4a2db640 1 --2- 172.21.15.45:0/1757230828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560919deb400 0x560919e56b00 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x56091ac68cf0 tx=0x56091ab73320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b834f6805977986 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.863 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.859+0000 7f4d482d7640 1 -- 172.21.15.45:0/1757230828 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x560919e4b1e0 con 0x560919deb400 2023-11-28T18:42:22.863 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.859+0000 7f4d482d7640 1 -- 172.21.15.45:0/1757230828 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560919e46180 con 0x560919deb400 2023-11-28T18:42:22.863 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.859+0000 7f4d482d7640 1 -- 172.21.15.45:0/1757230828 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x560919e4b080 con 0x560919deb400 2023-11-28T18:42:22.863 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.859+0000 7f4d4c31d280 1 -- 172.21.15.45:0/1757230828 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560919e20b60 con 0x560919deb400 2023-11-28T18:42:22.863 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.859+0000 7f4d4c31d280 1 -- 172.21.15.45:0/1757230828 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x560919e20340 con 0x560919deb400 2023-11-28T18:42:22.864 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.859+0000 7f4d482d7640 1 -- 172.21.15.45:0/1757230828 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x560919e2cc40 con 0x560919deb400 2023-11-28T18:42:22.864 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.859+0000 7f4d482d7640 1 -- 172.21.15.45:0/1757230828 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 34) v1 ==== 3298+0+0 (secure 0 0 0) 0x560919e39200 con 0x560919deb400 2023-11-28T18:42:22.871 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.859+0000 7f4d4c31d280 1 Processor -- start 2023-11-28T18:42:22.871 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.859+0000 7f4d4c31d280 1 -- start start 2023-11-28T18:42:22.871 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.859+0000 7f4d4c31d280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56091ad0ec00 0x560919e57600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.871 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.859+0000 7f4d4c31d280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56091ad0f000 0x560919e57b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.871 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.859+0000 7f4d4c31d280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56091ad0f400 0x560919e58100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.871 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.859+0000 7f4d4c31d280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x560919e30a00 con 0x56091ad0f000 2023-11-28T18:42:22.871 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.859+0000 7f4d4c31d280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x560919ebb180 con 0x56091ad0ec00 2023-11-28T18:42:22.871 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.859+0000 7f4d4c31d280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x560919ebadc0 con 0x56091ad0f400 2023-11-28T18:42:22.871 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.859+0000 7f4d4aadc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56091ad0f000 0x560919e57b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.871 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.859+0000 7f4d4aadc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56091ad0f000 0x560919e57b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57710/0 (socket says 172.21.15.45:57710) 2023-11-28T18:42:22.872 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.859+0000 7f4d4aadc640 1 -- 172.21.15.45:0/823582542 learned_addr learned my addr 172.21.15.45:0/823582542 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:22.872 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.859+0000 7f4d4a2db640 1 --2- 172.21.15.45:0/823582542 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56091ad0f400 0x560919e58100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.872 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.859+0000 7f4d4b2dd640 1 --2- 172.21.15.45:0/823582542 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56091ad0ec00 0x560919e57600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.872 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.859+0000 7f4d4aadc640 1 -- 172.21.15.45:0/823582542 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56091ad0f400 msgr2=0x560919e58100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:22.872 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.859+0000 7f4d4aadc640 1 --2- 172.21.15.45:0/823582542 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56091ad0f400 0x560919e58100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.872 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.859+0000 7f4d4aadc640 1 -- 172.21.15.45:0/823582542 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56091ad0ec00 msgr2=0x560919e57600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:22.872 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.859+0000 7f4d4aadc640 1 --2- 172.21.15.45:0/823582542 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56091ad0ec00 0x560919e57600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.872 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.859+0000 7f4d4aadc640 1 -- 172.21.15.45:0/823582542 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560919e20000 con 0x56091ad0f000 2023-11-28T18:42:22.872 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.859+0000 7f4d4aadc640 1 --2- 172.21.15.45:0/823582542 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56091ad0f000 0x560919e57b80 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x56091ad72030 tx=0x56091abb6480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0bb6287b9993843 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.872 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.859+0000 7f4d462d3640 1 -- 172.21.15.45:0/823582542 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x560919e4af20 con 0x56091ad0f000 2023-11-28T18:42:22.872 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.859+0000 7f4d462d3640 1 -- 172.21.15.45:0/823582542 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56091abcb200 con 0x56091ad0f000 2023-11-28T18:42:22.872 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.859+0000 7f4d462d3640 1 -- 172.21.15.45:0/823582542 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x560919e4b1e0 con 0x56091ad0f000 2023-11-28T18:42:22.873 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.859+0000 7f4d4c31d280 1 -- 172.21.15.45:0/823582542 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56091ad0f000 msgr2=0x560919e57b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.873 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.859+0000 7f4d4c31d280 1 --2- 172.21.15.45:0/823582542 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56091ad0f000 0x560919e57b80 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x56091ad72030 tx=0x56091abb6480 comp rx=0 tx=0).stop 2023-11-28T18:42:22.873 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.859+0000 7f4d4c31d280 1 -- 172.21.15.45:0/823582542 shutdown_connections 2023-11-28T18:42:22.873 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.859+0000 7f4d4c31d280 1 --2- 172.21.15.45:0/823582542 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56091ad0f400 0x560919e58100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.873 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.859+0000 7f4d4c31d280 1 --2- 172.21.15.45:0/823582542 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56091ad0f000 0x560919e57b80 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.873 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.859+0000 7f4d4c31d280 1 --2- 172.21.15.45:0/823582542 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56091ad0ec00 0x560919e57600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.873 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.859+0000 7f4d4c31d280 1 -- 172.21.15.45:0/823582542 >> 172.21.15.45:0/823582542 conn(0x560919deac00 msgr2=0x560919e19800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:22.873 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.859+0000 7f4d4c31d280 1 -- 172.21.15.45:0/823582542 shutdown_connections 2023-11-28T18:42:22.873 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.859+0000 7f4d4c31d280 1 -- 172.21.15.45:0/823582542 wait complete. 2023-11-28T18:42:22.874 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.863+0000 7f4d4c31d280 1 Processor -- start 2023-11-28T18:42:22.874 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.863+0000 7f4d4c31d280 1 -- start start 2023-11-28T18:42:22.874 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.863+0000 7f4d4c31d280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56091ad0ec00 0x560919e59180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.874 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.863+0000 7f4d4c31d280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56091ad0f000 0x560919e58c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.874 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.863+0000 7f4d4c31d280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56091ad0f400 0x560919e58680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.874 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.863+0000 7f4d4c31d280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x560919ebac80 con 0x56091ad0f400 2023-11-28T18:42:22.874 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.863+0000 7f4d4c31d280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x560919e30140 con 0x56091ad0ec00 2023-11-28T18:42:22.874 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.863+0000 7f4d4c31d280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x560919e30b40 con 0x56091ad0f000 2023-11-28T18:42:22.874 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.863+0000 7f4d4a2db640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56091ad0f400 0x560919e58680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.874 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.863+0000 7f4d4a2db640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56091ad0f400 0x560919e58680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57726/0 (socket says 172.21.15.45:57726) 2023-11-28T18:42:22.874 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.863+0000 7f4d4a2db640 1 -- 172.21.15.45:0/2628708707 learned_addr learned my addr 172.21.15.45:0/2628708707 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:22.875 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.863+0000 7f4d4aadc640 1 --2- 172.21.15.45:0/2628708707 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56091ad0f000 0x560919e58c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.875 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.863+0000 7f4d4b2dd640 1 --2- 172.21.15.45:0/2628708707 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56091ad0ec00 0x560919e59180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.875 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.863+0000 7f4d4a2db640 1 -- 172.21.15.45:0/2628708707 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56091ad0f000 msgr2=0x560919e58c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.875 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.863+0000 7f4d4a2db640 1 --2- 172.21.15.45:0/2628708707 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56091ad0f000 0x560919e58c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.875 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.863+0000 7f4d4a2db640 1 -- 172.21.15.45:0/2628708707 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56091ad0ec00 msgr2=0x560919e59180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.875 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.863+0000 7f4d4a2db640 1 --2- 172.21.15.45:0/2628708707 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56091ad0ec00 0x560919e59180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.875 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.863+0000 7f4d4a2db640 1 -- 172.21.15.45:0/2628708707 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560919e201a0 con 0x56091ad0f400 2023-11-28T18:42:22.875 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.863+0000 7f4d4b2dd640 1 --2- 172.21.15.45:0/2628708707 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56091ad0ec00 0x560919e59180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:42:22.875 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.863+0000 7f4d4a2db640 1 --2- 172.21.15.45:0/2628708707 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56091ad0f400 0x560919e58680 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x56091ad72e70 tx=0x560919e6cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.875 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.863+0000 7f4d44ad0640 1 -- 172.21.15.45:0/2628708707 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x560919e4adc0 con 0x56091ad0f400 2023-11-28T18:42:22.875 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.863+0000 7f4d44ad0640 1 -- 172.21.15.45:0/2628708707 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56091abcad80 con 0x56091ad0f400 2023-11-28T18:42:22.875 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.863+0000 7f4d44ad0640 1 -- 172.21.15.45:0/2628708707 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x560919e4af20 con 0x56091ad0f400 2023-11-28T18:42:22.876 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.863+0000 7f4d4c31d280 1 -- 172.21.15.45:0/2628708707 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560919e20000 con 0x56091ad0f400 2023-11-28T18:42:22.876 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.863+0000 7f4d4c31d280 1 -- 172.21.15.45:0/2628708707 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560919e209c0 con 0x56091ad0f400 2023-11-28T18:42:22.876 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.867+0000 7f4d44ad0640 1 -- 172.21.15.45:0/2628708707 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x560919e78840 con 0x56091ad0f400 2023-11-28T18:42:22.876 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.867+0000 7f4d44ad0640 1 --2- 172.21.15.45:0/2628708707 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x56091a0d1400 0x560919e59700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.876 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.867+0000 7f4d44ad0640 1 -- 172.21.15.45:0/2628708707 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x560919e2ca80 con 0x56091ad0f400 2023-11-28T18:42:22.876 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.867+0000 7f4d4c31d280 1 --2- 172.21.15.45:0/2628708707 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x56091ad0f800 0x560919e58100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.876 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.867+0000 7f4d4c31d280 1 -- 172.21.15.45:0/2628708707 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x560919e41880 con 0x56091ad0f800 2023-11-28T18:42:22.876 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.867+0000 7f4d4b2dd640 1 --2- 172.21.15.45:0/2628708707 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x56091a0d1400 0x560919e59700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.877 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.867+0000 7f4d4aadc640 1 --2- 172.21.15.45:0/2628708707 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x56091ad0f800 0x560919e58100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.877 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.867+0000 7f4d4b2dd640 1 --2- 172.21.15.45:0/2628708707 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x56091a0d1400 0x560919e59700 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x56091aba60f0 tx=0x56091ad6d140 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.877 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.867+0000 7f4d4aadc640 1 --2- 172.21.15.45:0/2628708707 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x56091ad0f800 0x560919e58100 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.878 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.867+0000 7f4d4aadc640 1 -- 172.21.15.45:0/2628708707 <== osd.2 v2:172.21.15.45:6816/193884539 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x56091acf8b40 con 0x56091ad0f800 2023-11-28T18:42:22.878 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.867+0000 7f4d4c31d280 1 -- 172.21.15.45:0/2628708707 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x560919e41c00 con 0x56091ad0f800 2023-11-28T18:42:22.878 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.867+0000 7f4d4aadc640 1 -- 172.21.15.45:0/2628708707 <== osd.2 v2:172.21.15.45:6816/193884539 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv32 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x56091acf8b40 con 0x56091ad0f800 2023-11-28T18:42:22.878 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.867+0000 7f4d4c31d280 1 -- 172.21.15.45:0/2628708707 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:3 6.14 6:2e2fa760:::200.00000001:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x560919e41880 con 0x56091ad0f800 2023-11-28T18:42:22.878 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.867+0000 7f4d4aadc640 1 -- 172.21.15.45:0/2628708707 <== osd.2 v2:172.21.15.45:6816/193884539 3 ==== osd_op_reply(3 200.00000001 [read 0~34160 out=34160b] v0'0 uv34 ondisk = 0) v8 ==== 156+0+34160 (crc 0 0 0) 0x56091acf8b40 con 0x56091ad0f800 2023-11-28T18:42:22.878 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.867+0000 7f4d4c31d280 1 --2- 172.21.15.45:0/2628708707 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x56091ad0fc00 0x560919e57b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.879 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.867+0000 7f4d4c31d280 1 -- 172.21.15.45:0/2628708707 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:4 6.1b 6:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x560919e41c00 con 0x56091ad0fc00 2023-11-28T18:42:22.879 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.867+0000 7f4d4b2dd640 1 --2- 172.21.15.45:0/2628708707 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x56091ad0fc00 0x560919e57b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.879 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.867+0000 7f4d4b2dd640 1 --2- 172.21.15.45:0/2628708707 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x56091ad0fc00 0x560919e57b80 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.879 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.871+0000 7f4d4b2dd640 1 -- 172.21.15.45:0/2628708707 <== osd.3 v2:172.21.15.45:6824/78541084 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x56091acf8d80 con 0x56091ad0fc00 2023-11-28T18:42:22.879 INFO:tasks.workunit.client.0.smithi045.stdout:Events by type: 2023-11-28T18:42:22.879 INFO:tasks.workunit.client.0.smithi045.stdout: LID: 1 2023-11-28T18:42:22.880 INFO:tasks.workunit.client.0.smithi045.stdout: PURGED: 1 2023-11-28T18:42:22.880 INFO:tasks.workunit.client.0.smithi045.stdout: SESSION: 2 2023-11-28T18:42:22.880 INFO:tasks.workunit.client.0.smithi045.stdout: SUBTREEMAP: 1 2023-11-28T18:42:22.880 INFO:tasks.workunit.client.0.smithi045.stdout: UPDATE: 17 2023-11-28T18:42:22.880 INFO:tasks.workunit.client.0.smithi045.stdout:Errors: 0 2023-11-28T18:42:22.882 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.871+0000 7f4d4c31d280 1 -- 172.21.15.45:0/2628708707 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x56091ad0f800 msgr2=0x560919e58100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.882 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.871+0000 7f4d4c31d280 1 --2- 172.21.15.45:0/2628708707 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x56091ad0f800 0x560919e58100 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.882 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.871+0000 7f4d4c31d280 1 -- 172.21.15.45:0/2628708707 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x56091ad0fc00 msgr2=0x560919e57b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.882 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.871+0000 7f4d4c31d280 1 --2- 172.21.15.45:0/2628708707 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x56091ad0fc00 0x560919e57b80 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.882 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.871+0000 7f4d4c31d280 1 -- 172.21.15.45:0/2628708707 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x56091a0d1400 msgr2=0x560919e59700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.882 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.871+0000 7f4d4c31d280 1 --2- 172.21.15.45:0/2628708707 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x56091a0d1400 0x560919e59700 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x56091aba60f0 tx=0x56091ad6d140 comp rx=0 tx=0).stop 2023-11-28T18:42:22.882 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.871+0000 7f4d4c31d280 1 -- 172.21.15.45:0/2628708707 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56091ad0f400 msgr2=0x560919e58680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.882 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.871+0000 7f4d4c31d280 1 --2- 172.21.15.45:0/2628708707 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56091ad0f400 0x560919e58680 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x56091ad72e70 tx=0x560919e6cf00 comp rx=0 tx=0).stop 2023-11-28T18:42:22.882 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.871+0000 7f4d4aadc640 1 -- 172.21.15.45:0/2628708707 reap_dead start 2023-11-28T18:42:22.882 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.871+0000 7f4d4c31d280 1 -- 172.21.15.45:0/2628708707 shutdown_connections 2023-11-28T18:42:22.883 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.871+0000 7f4d4c31d280 1 --2- 172.21.15.45:0/2628708707 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56091ad0f400 0x560919e58680 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.883 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.871+0000 7f4d4c31d280 1 -- 172.21.15.45:0/2628708707 >> 172.21.15.45:0/2628708707 conn(0x560919deac00 msgr2=0x560919e19800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:22.883 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.871+0000 7f4d4c31d280 1 -- 172.21.15.45:0/2628708707 shutdown_connections 2023-11-28T18:42:22.883 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.871+0000 7f4d4c31d280 1 -- 172.21.15.45:0/2628708707 wait complete. 2023-11-28T18:42:22.883 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.871+0000 7f4d4c31d280 1 -- 172.21.15.45:0/1757230828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560919deb400 msgr2=0x560919e56b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.883 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.871+0000 7f4d4c31d280 1 --2- 172.21.15.45:0/1757230828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560919deb400 0x560919e56b00 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x56091ac68cf0 tx=0x56091ab73320 comp rx=0 tx=0).stop 2023-11-28T18:42:22.883 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.871+0000 7f4d4c31d280 1 -- 172.21.15.45:0/1757230828 shutdown_connections 2023-11-28T18:42:22.883 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.871+0000 7f4d4c31d280 1 --2- 172.21.15.45:0/1757230828 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560919deb000 0x560919e57080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.883 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.871+0000 7f4d4c31d280 1 --2- 172.21.15.45:0/1757230828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560919deb400 0x560919e56b00 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.883 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.871+0000 7f4d4c31d280 1 --2- 172.21.15.45:0/1757230828 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560919deb800 0x560919e56580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.883 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.871+0000 7f4d4c31d280 1 -- 172.21.15.45:0/1757230828 >> 172.21.15.45:0/1757230828 conn(0x560919debc00 msgr2=0x560919e19000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:22.883 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.871+0000 7f4d4c31d280 1 -- 172.21.15.45:0/1757230828 shutdown_connections 2023-11-28T18:42:22.884 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.871+0000 7f4d4c31d280 1 -- 172.21.15.45:0/1757230828 wait complete. 2023-11-28T18:42:22.884 INFO:tasks.workunit.client.0.smithi045.stderr:+ cephfs-journal-tool --rank=cephfs:0 event get --type=UPDATE --path=/ --inode=0 --frag=0x100 summary 2023-11-28T18:42:22.922 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.919+0000 7f14df9d4280 1 -- start start 2023-11-28T18:42:22.923 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.919+0000 7f14df9d4280 1 Processor -- start 2023-11-28T18:42:22.924 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.919+0000 7f14df9d4280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560506d3d800 0x560506da8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.925 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.919+0000 7f14df9d4280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560506d3d400 0x560506da8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.925 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.919+0000 7f14df9d4280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560506d3d000 0x560506da9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.925 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.919+0000 7f14df9d4280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x560506d83180 con 0x560506d3d800 2023-11-28T18:42:22.925 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.919+0000 7f14df9d4280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x560506d82140 con 0x560506d3d400 2023-11-28T18:42:22.925 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.919+0000 7f14df9d4280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x560506d82000 con 0x560506d3d000 2023-11-28T18:42:22.925 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.919+0000 7f14de195640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560506d3d800 0x560506da8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.925 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.919+0000 7f14de195640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560506d3d800 0x560506da8580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57734/0 (socket says 172.21.15.45:57734) 2023-11-28T18:42:22.925 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.919+0000 7f14de195640 1 -- 172.21.15.45:0/2587745411 learned_addr learned my addr 172.21.15.45:0/2587745411 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:22.925 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.919+0000 7f14dd994640 1 --2- 172.21.15.45:0/2587745411 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560506d3d400 0x560506da8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.925 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.919+0000 7f14de996640 1 --2- 172.21.15.45:0/2587745411 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560506d3d000 0x560506da9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.926 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.919+0000 7f14de195640 1 -- 172.21.15.45:0/2587745411 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560506d3d000 msgr2=0x560506da9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:22.926 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.919+0000 7f14de195640 1 --2- 172.21.15.45:0/2587745411 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560506d3d000 0x560506da9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.926 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.919+0000 7f14de195640 1 -- 172.21.15.45:0/2587745411 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560506d3d400 msgr2=0x560506da8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:22.926 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.919+0000 7f14de195640 1 --2- 172.21.15.45:0/2587745411 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560506d3d400 0x560506da8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.926 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.919+0000 7f14de195640 1 -- 172.21.15.45:0/2587745411 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560506d729c0 con 0x560506d3d800 2023-11-28T18:42:22.926 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.919+0000 7f14de195640 1 --2- 172.21.15.45:0/2587745411 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560506d3d800 0x560506da8580 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x560507bb2cf0 tx=0x560507ac5080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4fc5380cfaea1a9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.926 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.919+0000 7f14db990640 1 -- 172.21.15.45:0/2587745411 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x560506d9d1e0 con 0x560506d3d800 2023-11-28T18:42:22.926 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.919+0000 7f14db990640 1 -- 172.21.15.45:0/2587745411 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560506d98900 con 0x560506d3d800 2023-11-28T18:42:22.926 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.919+0000 7f14db990640 1 -- 172.21.15.45:0/2587745411 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x560506d9d080 con 0x560506d3d800 2023-11-28T18:42:22.926 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.919+0000 7f14df9d4280 1 -- 172.21.15.45:0/2587745411 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560506d72b60 con 0x560506d3d800 2023-11-28T18:42:22.927 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.919+0000 7f14df9d4280 1 -- 172.21.15.45:0/2587745411 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x560506d72340 con 0x560506d3d800 2023-11-28T18:42:22.927 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.919+0000 7f14db990640 1 -- 172.21.15.45:0/2587745411 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x560506d7ec40 con 0x560506d3d800 2023-11-28T18:42:22.927 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.919+0000 7f14db990640 1 -- 172.21.15.45:0/2587745411 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 34) v1 ==== 3298+0+0 (secure 0 0 0) 0x560506d8af00 con 0x560506d3d800 2023-11-28T18:42:22.929 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.923+0000 7f14df9d4280 1 Processor -- start 2023-11-28T18:42:22.929 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.923+0000 7f14df9d4280 1 -- start start 2023-11-28T18:42:22.929 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.923+0000 7f14df9d4280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560507c56c00 0x560506da9600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.929 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.923+0000 7f14df9d4280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560507c57000 0x560506da9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.929 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.923+0000 7f14df9d4280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560507c57400 0x560506daa100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.929 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.923+0000 7f14df9d4280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x560506d82a00 con 0x560507c57400 2023-11-28T18:42:22.930 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.923+0000 7f14df9d4280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x560506e0d180 con 0x560507c56c00 2023-11-28T18:42:22.930 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.923+0000 7f14df9d4280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x560506e0cdc0 con 0x560507c57000 2023-11-28T18:42:22.930 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.923+0000 7f14dd994640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560507c57400 0x560506daa100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.930 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.923+0000 7f14dd994640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560507c57400 0x560506daa100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57742/0 (socket says 172.21.15.45:57742) 2023-11-28T18:42:22.930 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.923+0000 7f14dd994640 1 -- 172.21.15.45:0/32465131 learned_addr learned my addr 172.21.15.45:0/32465131 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:22.930 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.923+0000 7f14dd994640 1 -- 172.21.15.45:0/32465131 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560507c57000 msgr2=0x560506da9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:22.930 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.923+0000 7f14dd994640 1 --2- 172.21.15.45:0/32465131 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560507c57000 0x560506da9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.930 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.923+0000 7f14dd994640 1 -- 172.21.15.45:0/32465131 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560507c56c00 msgr2=0x560506da9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:22.930 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.923+0000 7f14de996640 1 --2- 172.21.15.45:0/32465131 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560507c56c00 0x560506da9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.930 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.923+0000 7f14dd994640 1 --2- 172.21.15.45:0/32465131 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560507c56c00 0x560506da9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.930 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.923+0000 7f14dd994640 1 -- 172.21.15.45:0/32465131 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560506d72000 con 0x560507c57400 2023-11-28T18:42:22.931 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.923+0000 7f14de996640 1 --2- 172.21.15.45:0/32465131 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560507c56c00 0x560506da9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:42:22.931 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.923+0000 7f14dd994640 1 --2- 172.21.15.45:0/32465131 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560507c57400 0x560506daa100 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x560507bb2390 tx=0x560507b02000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f6d233cae952afe server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.931 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.923+0000 7f14d998c640 1 -- 172.21.15.45:0/32465131 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x560506d9cf20 con 0x560507c57400 2023-11-28T18:42:22.931 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.923+0000 7f14d998c640 1 -- 172.21.15.45:0/32465131 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560506d98900 con 0x560507c57400 2023-11-28T18:42:22.931 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.923+0000 7f14d998c640 1 -- 172.21.15.45:0/32465131 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x560506d9d1e0 con 0x560507c57400 2023-11-28T18:42:22.931 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.923+0000 7f14df9d4280 1 -- 172.21.15.45:0/32465131 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560507c57400 msgr2=0x560506daa100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.931 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.923+0000 7f14df9d4280 1 --2- 172.21.15.45:0/32465131 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560507c57400 0x560506daa100 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x560507bb2390 tx=0x560507b02000 comp rx=0 tx=0).stop 2023-11-28T18:42:22.931 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.923+0000 7f14df9d4280 1 -- 172.21.15.45:0/32465131 shutdown_connections 2023-11-28T18:42:22.931 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.923+0000 7f14df9d4280 1 --2- 172.21.15.45:0/32465131 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560507c57400 0x560506daa100 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.931 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.923+0000 7f14df9d4280 1 --2- 172.21.15.45:0/32465131 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560507c57000 0x560506da9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.931 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.923+0000 7f14df9d4280 1 --2- 172.21.15.45:0/32465131 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560507c56c00 0x560506da9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.932 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.923+0000 7f14df9d4280 1 -- 172.21.15.45:0/32465131 >> 172.21.15.45:0/32465131 conn(0x560506d3cc00 msgr2=0x560506d6b800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:22.932 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.923+0000 7f14df9d4280 1 -- 172.21.15.45:0/32465131 shutdown_connections 2023-11-28T18:42:22.932 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.923+0000 7f14df9d4280 1 -- 172.21.15.45:0/32465131 wait complete. 2023-11-28T18:42:22.932 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.923+0000 7f14df9d4280 1 Processor -- start 2023-11-28T18:42:22.932 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.927+0000 7f14df9d4280 1 -- start start 2023-11-28T18:42:22.935 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.927+0000 7f14df9d4280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560507c56c00 0x560506da9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.935 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.927+0000 7f14df9d4280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560507c57000 0x560506da9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.935 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.927+0000 7f14df9d4280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560507c57800 0x560506daa680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.936 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.927+0000 7f14df9d4280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x560506e0cc80 con 0x560507c57800 2023-11-28T18:42:22.936 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.927+0000 7f14df9d4280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x560506d82140 con 0x560507c57000 2023-11-28T18:42:22.936 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.927+0000 7f14df9d4280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x560506d82b40 con 0x560507c56c00 2023-11-28T18:42:22.936 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.927+0000 7f14dd994640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560507c57800 0x560506daa680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.936 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.927+0000 7f14dd994640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560507c57800 0x560506daa680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57746/0 (socket says 172.21.15.45:57746) 2023-11-28T18:42:22.936 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.927+0000 7f14dd994640 1 -- 172.21.15.45:0/29535729 learned_addr learned my addr 172.21.15.45:0/29535729 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:22.936 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.927+0000 7f14de195640 1 --2- 172.21.15.45:0/29535729 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560507c57000 0x560506da9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.936 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.927+0000 7f14de996640 1 --2- 172.21.15.45:0/29535729 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560507c56c00 0x560506da9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.936 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.927+0000 7f14dd994640 1 -- 172.21.15.45:0/29535729 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560507c56c00 msgr2=0x560506da9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.936 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.927+0000 7f14dd994640 1 --2- 172.21.15.45:0/29535729 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560507c56c00 0x560506da9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.937 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.927+0000 7f14dd994640 1 -- 172.21.15.45:0/29535729 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560507c57000 msgr2=0x560506da9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.937 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.927+0000 7f14dd994640 1 --2- 172.21.15.45:0/29535729 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560507c57000 0x560506da9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.937 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.927+0000 7f14dd994640 1 -- 172.21.15.45:0/29535729 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560506d721a0 con 0x560507c57800 2023-11-28T18:42:22.937 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.927+0000 7f14de195640 1 --2- 172.21.15.45:0/29535729 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560507c57000 0x560506da9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:42:22.937 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.927+0000 7f14de996640 1 --2- 172.21.15.45:0/29535729 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560507c56c00 0x560506da9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:42:22.937 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.927+0000 7f14dd994640 1 --2- 172.21.15.45:0/29535729 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560507c57800 0x560506daa680 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x560507cbc420 tx=0x560507b02420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.937 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.927+0000 7f14d8189640 1 -- 172.21.15.45:0/29535729 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x560506d9d080 con 0x560507c57800 2023-11-28T18:42:22.937 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.927+0000 7f14d8189640 1 -- 172.21.15.45:0/29535729 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560507b15500 con 0x560507c57800 2023-11-28T18:42:22.937 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.927+0000 7f14d8189640 1 -- 172.21.15.45:0/29535729 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x560506d9c420 con 0x560507c57800 2023-11-28T18:42:22.937 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.927+0000 7f14df9d4280 1 -- 172.21.15.45:0/29535729 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560506d72000 con 0x560507c57800 2023-11-28T18:42:22.937 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.927+0000 7f14df9d4280 1 -- 172.21.15.45:0/29535729 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560506d729c0 con 0x560507c57800 2023-11-28T18:42:22.937 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.927+0000 7f14d8189640 1 -- 172.21.15.45:0/29535729 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x560506dcb080 con 0x560507c57800 2023-11-28T18:42:22.938 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.931+0000 7f14d8189640 1 --2- 172.21.15.45:0/29535729 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x56050702e400 0x560506dab700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.938 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.931+0000 7f14d8189640 1 -- 172.21.15.45:0/29535729 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x560506d7ea80 con 0x560507c57800 2023-11-28T18:42:22.938 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.931+0000 7f14df9d4280 1 --2- 172.21.15.45:0/29535729 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x560507c57c00 0x560506daac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.938 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.931+0000 7f14df9d4280 1 -- 172.21.15.45:0/29535729 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x560506d93880 con 0x560507c57c00 2023-11-28T18:42:22.938 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.931+0000 7f14de996640 1 --2- 172.21.15.45:0/29535729 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x56050702e400 0x560506dab700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.938 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.931+0000 7f14de195640 1 --2- 172.21.15.45:0/29535729 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x560507c57c00 0x560506daac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.938 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.931+0000 7f14de195640 1 --2- 172.21.15.45:0/29535729 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x560507c57c00 0x560506daac00 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.938 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.931+0000 7f14de996640 1 --2- 172.21.15.45:0/29535729 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x56050702e400 0x560506dab700 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x560507bb2bd0 tx=0x560507024300 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.938 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.931+0000 7f14de195640 1 -- 172.21.15.45:0/29535729 <== osd.2 v2:172.21.15.45:6816/193884539 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x560507c3eb40 con 0x560507c57c00 2023-11-28T18:42:22.938 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.931+0000 7f14df9d4280 1 -- 172.21.15.45:0/29535729 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x560506d93c00 con 0x560507c57c00 2023-11-28T18:42:22.939 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.931+0000 7f14de195640 1 -- 172.21.15.45:0/29535729 <== osd.2 v2:172.21.15.45:6816/193884539 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv32 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x560507c3eb40 con 0x560507c57c00 2023-11-28T18:42:22.939 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.931+0000 7f14df9d4280 1 -- 172.21.15.45:0/29535729 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:3 6.14 6:2e2fa760:::200.00000001:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x56050711c000 con 0x560507c57c00 2023-11-28T18:42:22.939 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.931+0000 7f14de195640 1 -- 172.21.15.45:0/29535729 <== osd.2 v2:172.21.15.45:6816/193884539 3 ==== osd_op_reply(3 200.00000001 [read 0~34160 out=34160b] v0'0 uv34 ondisk = 0) v8 ==== 156+0+34160 (crc 0 0 0) 0x560507c3eb40 con 0x560507c57c00 2023-11-28T18:42:22.939 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.931+0000 7f14df9d4280 1 --2- 172.21.15.45:0/29535729 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x56050702f400 0x560506dab180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.939 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.931+0000 7f14df9d4280 1 -- 172.21.15.45:0/29535729 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:4 6.1b 6:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x56050711c380 con 0x56050702f400 2023-11-28T18:42:22.940 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.931+0000 7f14de996640 1 --2- 172.21.15.45:0/29535729 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x56050702f400 0x560506dab180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.940 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.931+0000 7f14de996640 1 --2- 172.21.15.45:0/29535729 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x56050702f400 0x560506dab180 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.940 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.931+0000 7f14de996640 1 -- 172.21.15.45:0/29535729 <== osd.3 v2:172.21.15.45:6824/78541084 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x560507c3ed80 con 0x56050702f400 2023-11-28T18:42:22.940 INFO:tasks.workunit.client.0.smithi045.stdout:Events by type: 2023-11-28T18:42:22.940 INFO:tasks.workunit.client.0.smithi045.stdout: UPDATE: 4 2023-11-28T18:42:22.940 INFO:tasks.workunit.client.0.smithi045.stdout:Errors: 0 2023-11-28T18:42:22.942 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.931+0000 7f14df9d4280 1 -- 172.21.15.45:0/29535729 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x560507c57c00 msgr2=0x560506daac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.942 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.931+0000 7f14df9d4280 1 --2- 172.21.15.45:0/29535729 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x560507c57c00 0x560506daac00 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.942 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.931+0000 7f14df9d4280 1 -- 172.21.15.45:0/29535729 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x56050702f400 msgr2=0x560506dab180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.942 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.931+0000 7f14df9d4280 1 --2- 172.21.15.45:0/29535729 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x56050702f400 0x560506dab180 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.942 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.931+0000 7f14df9d4280 1 -- 172.21.15.45:0/29535729 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x56050702e400 msgr2=0x560506dab700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.942 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.931+0000 7f14df9d4280 1 --2- 172.21.15.45:0/29535729 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x56050702e400 0x560506dab700 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x560507bb2bd0 tx=0x560507024300 comp rx=0 tx=0).stop 2023-11-28T18:42:22.942 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.931+0000 7f14df9d4280 1 -- 172.21.15.45:0/29535729 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560507c57800 msgr2=0x560506daa680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.942 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.931+0000 7f14df9d4280 1 --2- 172.21.15.45:0/29535729 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560507c57800 0x560506daa680 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x560507cbc420 tx=0x560507b02420 comp rx=0 tx=0).stop 2023-11-28T18:42:22.942 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.931+0000 7f14dd994640 1 -- 172.21.15.45:0/29535729 reap_dead start 2023-11-28T18:42:22.942 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.931+0000 7f14df9d4280 1 -- 172.21.15.45:0/29535729 shutdown_connections 2023-11-28T18:42:22.943 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.931+0000 7f14df9d4280 1 --2- 172.21.15.45:0/29535729 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560507c57800 0x560506daa680 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.943 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.935+0000 7f14df9d4280 1 -- 172.21.15.45:0/29535729 >> 172.21.15.45:0/29535729 conn(0x560506d3cc00 msgr2=0x560506d6b800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:22.943 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.935+0000 7f14df9d4280 1 -- 172.21.15.45:0/29535729 shutdown_connections 2023-11-28T18:42:22.943 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.935+0000 7f14df9d4280 1 -- 172.21.15.45:0/29535729 wait complete. 2023-11-28T18:42:22.943 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.935+0000 7f14df9d4280 1 -- 172.21.15.45:0/2587745411 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560506d3d800 msgr2=0x560506da8580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.943 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.935+0000 7f14df9d4280 1 --2- 172.21.15.45:0/2587745411 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560506d3d800 0x560506da8580 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x560507bb2cf0 tx=0x560507ac5080 comp rx=0 tx=0).stop 2023-11-28T18:42:22.943 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.935+0000 7f14df9d4280 1 -- 172.21.15.45:0/2587745411 shutdown_connections 2023-11-28T18:42:22.943 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.935+0000 7f14df9d4280 1 --2- 172.21.15.45:0/2587745411 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560506d3d000 0x560506da9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.943 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.935+0000 7f14df9d4280 1 --2- 172.21.15.45:0/2587745411 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560506d3d400 0x560506da8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.943 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.935+0000 7f14df9d4280 1 --2- 172.21.15.45:0/2587745411 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560506d3d800 0x560506da8580 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.943 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.935+0000 7f14df9d4280 1 -- 172.21.15.45:0/2587745411 >> 172.21.15.45:0/2587745411 conn(0x560506d3dc00 msgr2=0x560506d6b000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:22.943 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.935+0000 7f14df9d4280 1 -- 172.21.15.45:0/2587745411 shutdown_connections 2023-11-28T18:42:22.944 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.935+0000 7f14df9d4280 1 -- 172.21.15.45:0/2587745411 wait complete. 2023-11-28T18:42:22.944 INFO:tasks.workunit.client.0.smithi045.stderr:+ cephfs-journal-tool --rank=cephfs:0 event get json --path /tmp/json.tmp 2023-11-28T18:42:22.986 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.983+0000 7f9e4c324280 1 -- start start 2023-11-28T18:42:22.986 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.983+0000 7f9e4c324280 1 Processor -- start 2023-11-28T18:42:22.988 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.983+0000 7f9e4c324280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56453b08f000 0x56453b0fa580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.988 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.983+0000 7f9e4c324280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56453b08f400 0x56453b0fab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.988 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.983+0000 7f9e4c324280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56453b08f800 0x56453b0fb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.988 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.983+0000 7f9e4c324280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x56453b0d5180 con 0x56453b08f000 2023-11-28T18:42:22.988 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.983+0000 7f9e4c324280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x56453b15f180 con 0x56453b08f400 2023-11-28T18:42:22.988 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.983+0000 7f9e4c324280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x56453b0d4000 con 0x56453b08f800 2023-11-28T18:42:22.988 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.983+0000 7f9e4aae3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56453b08f000 0x56453b0fa580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.989 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.983+0000 7f9e4aae3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56453b08f000 0x56453b0fa580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57750/0 (socket says 172.21.15.45:57750) 2023-11-28T18:42:22.989 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.983+0000 7f9e4aae3640 1 -- 172.21.15.45:0/1678335359 learned_addr learned my addr 172.21.15.45:0/1678335359 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:22.989 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.983+0000 7f9e4a2e2640 1 --2- 172.21.15.45:0/1678335359 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56453b08f400 0x56453b0fab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.989 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.983+0000 7f9e4b2e4640 1 --2- 172.21.15.45:0/1678335359 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56453b08f800 0x56453b0fb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.989 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.983+0000 7f9e4aae3640 1 -- 172.21.15.45:0/1678335359 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56453b08f800 msgr2=0x56453b0fb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:22.989 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.983+0000 7f9e4aae3640 1 --2- 172.21.15.45:0/1678335359 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56453b08f800 0x56453b0fb080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.989 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.983+0000 7f9e4aae3640 1 -- 172.21.15.45:0/1678335359 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56453b08f400 msgr2=0x56453b0fab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:22.989 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.983+0000 7f9e4aae3640 1 --2- 172.21.15.45:0/1678335359 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56453b08f400 0x56453b0fab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.989 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.983+0000 7f9e4aae3640 1 -- 172.21.15.45:0/1678335359 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56453b0c4b60 con 0x56453b08f000 2023-11-28T18:42:22.989 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.983+0000 7f9e4b2e4640 1 --2- 172.21.15.45:0/1678335359 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56453b08f800 0x56453b0fb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:42:22.989 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.983+0000 7f9e4aae3640 1 --2- 172.21.15.45:0/1678335359 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56453b08f000 0x56453b0fa580 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x56453bf08d50 tx=0x56453bdea600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74ca301e3913445c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.989 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.983+0000 7f9e482de640 1 -- 172.21.15.45:0/1678335359 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56453b0ef1e0 con 0x56453b08f000 2023-11-28T18:42:22.990 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.983+0000 7f9e482de640 1 -- 172.21.15.45:0/1678335359 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56453bfb2000 con 0x56453b08f000 2023-11-28T18:42:22.990 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.983+0000 7f9e482de640 1 -- 172.21.15.45:0/1678335359 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56453b0ef080 con 0x56453b08f000 2023-11-28T18:42:22.990 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.983+0000 7f9e4c324280 1 -- 172.21.15.45:0/1678335359 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56453b0c4340 con 0x56453b08f000 2023-11-28T18:42:22.990 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.983+0000 7f9e4c324280 1 -- 172.21.15.45:0/1678335359 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x56453b0c4000 con 0x56453b08f000 2023-11-28T18:42:22.990 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.983+0000 7f9e482de640 1 -- 172.21.15.45:0/1678335359 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x56453b0d0c40 con 0x56453b08f000 2023-11-28T18:42:22.990 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.983+0000 7f9e482de640 1 -- 172.21.15.45:0/1678335359 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 34) v1 ==== 3298+0+0 (secure 0 0 0) 0x56453b0dd200 con 0x56453b08f000 2023-11-28T18:42:22.992 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.983+0000 7f9e4c324280 1 Processor -- start 2023-11-28T18:42:22.992 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.987+0000 7f9e4c324280 1 -- start start 2023-11-28T18:42:22.992 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.987+0000 7f9e4c324280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56453bfec400 0x56453b0fb600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.993 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.987+0000 7f9e4c324280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56453bfec800 0x56453b0fbb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.993 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.987+0000 7f9e4c324280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56453bfecc00 0x56453b0fc100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.993 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.987+0000 7f9e4c324280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x56453b0d4a00 con 0x56453bfec400 2023-11-28T18:42:22.993 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.987+0000 7f9e4c324280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x56453b0d4b40 con 0x56453bfec800 2023-11-28T18:42:22.993 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.987+0000 7f9e4c324280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x56453b15f180 con 0x56453bfecc00 2023-11-28T18:42:22.993 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.987+0000 7f9e4b2e4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56453bfec400 0x56453b0fb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.993 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.987+0000 7f9e4b2e4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56453bfec400 0x56453b0fb600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57758/0 (socket says 172.21.15.45:57758) 2023-11-28T18:42:22.993 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.987+0000 7f9e4b2e4640 1 -- 172.21.15.45:0/3735799434 learned_addr learned my addr 172.21.15.45:0/3735799434 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:22.993 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.987+0000 7f9e4aae3640 1 --2- 172.21.15.45:0/3735799434 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56453bfec800 0x56453b0fbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.993 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.987+0000 7f9e4a2e2640 1 --2- 172.21.15.45:0/3735799434 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56453bfecc00 0x56453b0fc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.993 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.987+0000 7f9e4b2e4640 1 -- 172.21.15.45:0/3735799434 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56453bfecc00 msgr2=0x56453b0fc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:22.994 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.987+0000 7f9e4b2e4640 1 --2- 172.21.15.45:0/3735799434 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56453bfecc00 0x56453b0fc100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.994 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.987+0000 7f9e4b2e4640 1 -- 172.21.15.45:0/3735799434 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56453bfec800 msgr2=0x56453b0fbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:22.994 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.987+0000 7f9e4b2e4640 1 --2- 172.21.15.45:0/3735799434 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56453bfec800 0x56453b0fbb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.994 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.987+0000 7f9e4b2e4640 1 -- 172.21.15.45:0/3735799434 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56453b0c4ea0 con 0x56453bfec400 2023-11-28T18:42:22.994 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.987+0000 7f9e4b2e4640 1 --2- 172.21.15.45:0/3735799434 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56453bfec400 0x56453b0fb600 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x56453bf09ce0 tx=0x56453c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8c66dcc138e7f67 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:22.994 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.987+0000 7f9e462da640 1 -- 172.21.15.45:0/3735799434 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56453b0ef1e0 con 0x56453bfec400 2023-11-28T18:42:22.994 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.987+0000 7f9e462da640 1 -- 172.21.15.45:0/3735799434 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56453bfb3200 con 0x56453bfec400 2023-11-28T18:42:22.994 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.987+0000 7f9e462da640 1 -- 172.21.15.45:0/3735799434 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56453b0ef080 con 0x56453bfec400 2023-11-28T18:42:22.994 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.987+0000 7f9e4c324280 1 -- 172.21.15.45:0/3735799434 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56453bfec400 msgr2=0x56453b0fb600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:22.994 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.987+0000 7f9e4c324280 1 --2- 172.21.15.45:0/3735799434 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56453bfec400 0x56453b0fb600 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x56453bf09ce0 tx=0x56453c012000 comp rx=0 tx=0).stop 2023-11-28T18:42:22.994 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.987+0000 7f9e4c324280 1 -- 172.21.15.45:0/3735799434 shutdown_connections 2023-11-28T18:42:22.995 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.987+0000 7f9e4c324280 1 --2- 172.21.15.45:0/3735799434 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56453bfecc00 0x56453b0fc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.995 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.987+0000 7f9e4c324280 1 --2- 172.21.15.45:0/3735799434 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56453bfec800 0x56453b0fbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.995 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.987+0000 7f9e4c324280 1 --2- 172.21.15.45:0/3735799434 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56453bfec400 0x56453b0fb600 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:22.995 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.987+0000 7f9e4c324280 1 -- 172.21.15.45:0/3735799434 >> 172.21.15.45:0/3735799434 conn(0x56453bfec000 msgr2=0x56453b0bc000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:22.995 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.987+0000 7f9e4c324280 1 -- 172.21.15.45:0/3735799434 shutdown_connections 2023-11-28T18:42:22.995 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.987+0000 7f9e4c324280 1 -- 172.21.15.45:0/3735799434 wait complete. 2023-11-28T18:42:22.995 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.987+0000 7f9e4c324280 1 Processor -- start 2023-11-28T18:42:22.995 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.987+0000 7f9e4c324280 1 -- start start 2023-11-28T18:42:22.999 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.987+0000 7f9e4c324280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56453bfec400 0x56453b0fd180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.999 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.987+0000 7f9e4c324280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56453bfec800 0x56453b0fcc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.999 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.987+0000 7f9e4c324280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56453bfecc00 0x56453b0fc680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:22.999 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.987+0000 7f9e4c324280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x56453b15edc0 con 0x56453bfecc00 2023-11-28T18:42:22.999 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.987+0000 7f9e4c324280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x56453b15ec80 con 0x56453bfec400 2023-11-28T18:42:22.999 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.987+0000 7f9e4c324280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x56453b15eb40 con 0x56453bfec800 2023-11-28T18:42:22.999 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.991+0000 7f9e4aae3640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56453bfec800 0x56453b0fcc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.999 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.991+0000 7f9e4a2e2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56453bfecc00 0x56453b0fc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:22.999 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.991+0000 7f9e4aae3640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56453bfec800 0x56453b0fcc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.45:42808/0 (socket says 172.21.15.45:42808) 2023-11-28T18:42:22.999 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.991+0000 7f9e4a2e2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56453bfecc00 0x56453b0fc680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57772/0 (socket says 172.21.15.45:57772) 2023-11-28T18:42:23.000 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.991+0000 7f9e4aae3640 1 -- 172.21.15.45:0/3161916547 learned_addr learned my addr 172.21.15.45:0/3161916547 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:23.000 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.991+0000 7f9e4b2e4640 1 --2- 172.21.15.45:0/3161916547 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56453bfec400 0x56453b0fd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:23.000 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.991+0000 7f9e4a2e2640 1 -- 172.21.15.45:0/3161916547 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56453bfec800 msgr2=0x56453b0fcc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:23.000 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.991+0000 7f9e4a2e2640 1 --2- 172.21.15.45:0/3161916547 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56453bfec800 0x56453b0fcc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.000 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.991+0000 7f9e4a2e2640 1 -- 172.21.15.45:0/3161916547 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56453bfec400 msgr2=0x56453b0fd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:23.000 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.991+0000 7f9e4a2e2640 1 --2- 172.21.15.45:0/3161916547 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56453bfec400 0x56453b0fd180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.000 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.991+0000 7f9e4a2e2640 1 -- 172.21.15.45:0/3161916547 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56453b0c49c0 con 0x56453bfecc00 2023-11-28T18:42:23.000 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.991+0000 7f9e4aae3640 1 --2- 172.21.15.45:0/3161916547 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56453bfec800 0x56453b0fcc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:42:23.000 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.991+0000 7f9e4a2e2640 1 --2- 172.21.15.45:0/3161916547 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56453bfecc00 0x56453b0fc680 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x56453bf08330 tx=0x56453bdea000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:23.000 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.991+0000 7f9e44ad7640 1 -- 172.21.15.45:0/3161916547 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56453b0ef1e0 con 0x56453bfecc00 2023-11-28T18:42:23.001 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.991+0000 7f9e44ad7640 1 -- 172.21.15.45:0/3161916547 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56453b0ea180 con 0x56453bfecc00 2023-11-28T18:42:23.001 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.991+0000 7f9e44ad7640 1 -- 172.21.15.45:0/3161916547 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56453b0ef080 con 0x56453bfecc00 2023-11-28T18:42:23.001 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.991+0000 7f9e4c324280 1 -- 172.21.15.45:0/3161916547 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56453b0c4b60 con 0x56453bfecc00 2023-11-28T18:42:23.001 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.991+0000 7f9e4c324280 1 -- 172.21.15.45:0/3161916547 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56453b0c4340 con 0x56453bfecc00 2023-11-28T18:42:23.001 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.991+0000 7f9e44ad7640 1 -- 172.21.15.45:0/3161916547 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x56453b11c840 con 0x56453bfecc00 2023-11-28T18:42:23.001 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.991+0000 7f9e44ad7640 1 --2- 172.21.15.45:0/3161916547 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x56453b388400 0x56453b0fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:23.001 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.991+0000 7f9e44ad7640 1 -- 172.21.15.45:0/3161916547 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x56453b0d0a80 con 0x56453bfecc00 2023-11-28T18:42:23.001 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.991+0000 7f9e4c324280 1 --2- 172.21.15.45:0/3161916547 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x56453b388800 0x56453b0fc100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:23.001 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.991+0000 7f9e4c324280 1 -- 172.21.15.45:0/3161916547 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x56453b0e5880 con 0x56453b388800 2023-11-28T18:42:23.001 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.991+0000 7f9e4b2e4640 1 --2- 172.21.15.45:0/3161916547 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x56453b388400 0x56453b0fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:23.001 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.991+0000 7f9e4aae3640 1 --2- 172.21.15.45:0/3161916547 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x56453b388800 0x56453b0fc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:23.001 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.995+0000 7f9e4b2e4640 1 --2- 172.21.15.45:0/3161916547 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x56453b388400 0x56453b0fd700 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x56453bf09ce0 tx=0x56453bdea540 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:23.002 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.995+0000 7f9e4aae3640 1 --2- 172.21.15.45:0/3161916547 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x56453b388800 0x56453b0fc100 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:23.002 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.995+0000 7f9e4aae3640 1 -- 172.21.15.45:0/3161916547 <== osd.2 v2:172.21.15.45:6816/193884539 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x56453bf9cb40 con 0x56453b388800 2023-11-28T18:42:23.002 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.995+0000 7f9e4c324280 1 -- 172.21.15.45:0/3161916547 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x56453b0e5c00 con 0x56453b388800 2023-11-28T18:42:23.002 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.995+0000 7f9e4aae3640 1 -- 172.21.15.45:0/3161916547 <== osd.2 v2:172.21.15.45:6816/193884539 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv32 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x56453bf9cb40 con 0x56453b388800 2023-11-28T18:42:23.002 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.995+0000 7f9e4c324280 1 -- 172.21.15.45:0/3161916547 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:3 6.14 6:2e2fa760:::200.00000001:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x56453b46e000 con 0x56453b388800 2023-11-28T18:42:23.002 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.995+0000 7f9e4aae3640 1 -- 172.21.15.45:0/3161916547 <== osd.2 v2:172.21.15.45:6816/193884539 3 ==== osd_op_reply(3 200.00000001 [read 0~34160 out=34160b] v0'0 uv34 ondisk = 0) v8 ==== 156+0+34160 (crc 0 0 0) 0x56453bf9cb40 con 0x56453b388800 2023-11-28T18:42:23.002 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.995+0000 7f9e4c324280 1 --2- 172.21.15.45:0/3161916547 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x56453b388c00 0x56453b0fbb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:23.002 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.995+0000 7f9e4c324280 1 -- 172.21.15.45:0/3161916547 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:4 6.1b 6:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x56453b46e380 con 0x56453b388c00 2023-11-28T18:42:23.002 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.995+0000 7f9e4b2e4640 1 --2- 172.21.15.45:0/3161916547 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x56453b388c00 0x56453b0fbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:23.003 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.995+0000 7f9e4b2e4640 1 --2- 172.21.15.45:0/3161916547 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x56453b388c00 0x56453b0fbb80 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:23.003 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.995+0000 7f9e4b2e4640 1 -- 172.21.15.45:0/3161916547 <== osd.3 v2:172.21.15.45:6824/78541084 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x56453bf9cd80 con 0x56453b388c00 2023-11-28T18:42:23.005 INFO:tasks.workunit.client.0.smithi045.stderr:Wrote output to JSON file '/tmp/json.tmp' 2023-11-28T18:42:23.005 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.999+0000 7f9e4c324280 1 -- 172.21.15.45:0/3161916547 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x56453b388800 msgr2=0x56453b0fc100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:23.005 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.999+0000 7f9e4c324280 1 --2- 172.21.15.45:0/3161916547 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x56453b388800 0x56453b0fc100 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.005 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.999+0000 7f9e4c324280 1 -- 172.21.15.45:0/3161916547 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x56453b388c00 msgr2=0x56453b0fbb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:23.005 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.999+0000 7f9e4c324280 1 --2- 172.21.15.45:0/3161916547 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x56453b388c00 0x56453b0fbb80 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.005 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.999+0000 7f9e4c324280 1 -- 172.21.15.45:0/3161916547 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x56453b388400 msgr2=0x56453b0fd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:23.005 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.999+0000 7f9e4c324280 1 --2- 172.21.15.45:0/3161916547 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x56453b388400 0x56453b0fd700 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x56453bf09ce0 tx=0x56453bdea540 comp rx=0 tx=0).stop 2023-11-28T18:42:23.005 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.999+0000 7f9e4c324280 1 -- 172.21.15.45:0/3161916547 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56453bfecc00 msgr2=0x56453b0fc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:23.006 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.999+0000 7f9e4c324280 1 --2- 172.21.15.45:0/3161916547 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56453bfecc00 0x56453b0fc680 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x56453bf08330 tx=0x56453bdea000 comp rx=0 tx=0).stop 2023-11-28T18:42:23.006 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.999+0000 7f9e4a2e2640 1 -- 172.21.15.45:0/3161916547 reap_dead start 2023-11-28T18:42:23.006 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.999+0000 7f9e4a2e2640 1 -- 172.21.15.45:0/3161916547 reap_dead start 2023-11-28T18:42:23.006 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.999+0000 7f9e4c324280 1 -- 172.21.15.45:0/3161916547 shutdown_connections 2023-11-28T18:42:23.006 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.999+0000 7f9e4c324280 1 -- 172.21.15.45:0/3161916547 >> 172.21.15.45:0/3161916547 conn(0x56453bfec000 msgr2=0x56453b0bc000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:23.006 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.999+0000 7f9e4c324280 1 -- 172.21.15.45:0/3161916547 shutdown_connections 2023-11-28T18:42:23.006 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.999+0000 7f9e4c324280 1 -- 172.21.15.45:0/3161916547 wait complete. 2023-11-28T18:42:23.006 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.999+0000 7f9e4c324280 1 -- 172.21.15.45:0/1678335359 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56453b08f000 msgr2=0x56453b0fa580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:23.006 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.999+0000 7f9e4c324280 1 --2- 172.21.15.45:0/1678335359 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56453b08f000 0x56453b0fa580 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x56453bf08d50 tx=0x56453bdea600 comp rx=0 tx=0).stop 2023-11-28T18:42:23.006 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.999+0000 7f9e4c324280 1 -- 172.21.15.45:0/1678335359 shutdown_connections 2023-11-28T18:42:23.006 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.999+0000 7f9e4c324280 1 --2- 172.21.15.45:0/1678335359 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56453b08f800 0x56453b0fb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.007 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.999+0000 7f9e4c324280 1 --2- 172.21.15.45:0/1678335359 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56453b08f400 0x56453b0fab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.007 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.999+0000 7f9e4c324280 1 --2- 172.21.15.45:0/1678335359 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56453b08f000 0x56453b0fa580 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.007 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.999+0000 7f9e4c324280 1 -- 172.21.15.45:0/1678335359 >> 172.21.15.45:0/1678335359 conn(0x56453b08ec00 msgr2=0x56453b0bb800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:23.007 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.999+0000 7f9e4c324280 1 -- 172.21.15.45:0/1678335359 shutdown_connections 2023-11-28T18:42:23.007 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:22.999+0000 7f9e4c324280 1 -- 172.21.15.45:0/1678335359 wait complete. 2023-11-28T18:42:23.009 INFO:tasks.workunit.client.0.smithi045.stderr:+ '[' '!' -s /tmp/json.tmp ']' 2023-11-28T18:42:23.009 INFO:tasks.workunit.client.0.smithi045.stderr:+ cephfs-journal-tool --rank=cephfs:0 event get binary --path /tmp/binary.tmp 2023-11-28T18:42:23.051 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.047+0000 7ff76d02d280 1 -- start start 2023-11-28T18:42:23.051 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.047+0000 7ff76d02d280 1 Processor -- start 2023-11-28T18:42:23.053 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.047+0000 7ff76d02d280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5650c3743800 0x5650c37ae580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:23.053 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.047+0000 7ff76d02d280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5650c3743400 0x5650c37aeb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:23.053 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.047+0000 7ff76d02d280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5650c3743000 0x5650c37af080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:23.053 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.047+0000 7ff76d02d280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650c3789180 con 0x5650c3743400 2023-11-28T18:42:23.053 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.047+0000 7ff76d02d280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650c3788000 con 0x5650c3743000 2023-11-28T18:42:23.053 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.047+0000 7ff76d02d280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x5650c3788140 con 0x5650c3743800 2023-11-28T18:42:23.053 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.047+0000 7ff769b18640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5650c3743400 0x5650c37aeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:23.053 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.047+0000 7ff76a319640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5650c3743800 0x5650c37ae580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:23.054 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.047+0000 7ff769b18640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5650c3743400 0x5650c37aeb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57774/0 (socket says 172.21.15.45:57774) 2023-11-28T18:42:23.054 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.047+0000 7ff769b18640 1 -- 172.21.15.45:0/2412460234 learned_addr learned my addr 172.21.15.45:0/2412460234 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:23.054 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.047+0000 7ff76ab1a640 1 --2- 172.21.15.45:0/2412460234 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5650c3743000 0x5650c37af080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:23.054 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.047+0000 7ff76a319640 1 -- 172.21.15.45:0/2412460234 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5650c3743000 msgr2=0x5650c37af080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:23.054 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.047+0000 7ff76a319640 1 --2- 172.21.15.45:0/2412460234 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5650c3743000 0x5650c37af080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.054 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.047+0000 7ff76a319640 1 -- 172.21.15.45:0/2412460234 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5650c3743400 msgr2=0x5650c37aeb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:23.054 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.047+0000 7ff76a319640 1 --2- 172.21.15.45:0/2412460234 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5650c3743400 0x5650c37aeb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.054 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.047+0000 7ff76a319640 1 -- 172.21.15.45:0/2412460234 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5650c37789c0 con 0x5650c3743800 2023-11-28T18:42:23.054 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.047+0000 7ff769b18640 1 --2- 172.21.15.45:0/2412460234 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5650c3743400 0x5650c37aeb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:42:23.054 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.047+0000 7ff76a319640 1 --2- 172.21.15.45:0/2412460234 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5650c3743800 0x5650c37ae580 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x5650c45c4bd0 tx=0x5650c44cbda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64a7acd0e5e85542 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:23.055 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.047+0000 7ff767b14640 1 -- 172.21.15.45:0/2412460234 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5650c37a31e0 con 0x5650c3743800 2023-11-28T18:42:23.055 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.047+0000 7ff767b14640 1 -- 172.21.15.45:0/2412460234 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5650c379e900 con 0x5650c3743800 2023-11-28T18:42:23.055 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.047+0000 7ff767b14640 1 -- 172.21.15.45:0/2412460234 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5650c37a3080 con 0x5650c3743800 2023-11-28T18:42:23.055 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.047+0000 7ff76d02d280 1 -- 172.21.15.45:0/2412460234 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5650c3778b60 con 0x5650c3743800 2023-11-28T18:42:23.055 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.047+0000 7ff76d02d280 1 -- 172.21.15.45:0/2412460234 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({fsmap=0}) v3 -- 0x5650c3778340 con 0x5650c3743800 2023-11-28T18:42:23.055 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.047+0000 7ff767b14640 1 -- 172.21.15.45:0/2412460234 <== mon.2 v2:172.21.15.190:3301/0 4 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x5650c3784c40 con 0x5650c3743800 2023-11-28T18:42:23.057 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.051+0000 7ff767b14640 1 -- 172.21.15.45:0/2412460234 <== mon.2 v2:172.21.15.190:3301/0 5 ==== fsmap(e 34) v1 ==== 3298+0+0 (secure 0 0 0) 0x5650c3790f00 con 0x5650c3743800 2023-11-28T18:42:23.057 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.051+0000 7ff76d02d280 1 Processor -- start 2023-11-28T18:42:23.057 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.051+0000 7ff76d02d280 1 -- start start 2023-11-28T18:42:23.057 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.051+0000 7ff76d02d280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5650c4670c00 0x5650c37af600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:23.057 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.051+0000 7ff76d02d280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5650c4671000 0x5650c37afb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:23.058 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.051+0000 7ff76d02d280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5650c4671400 0x5650c37b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:23.058 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.051+0000 7ff76d02d280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650c3788a00 con 0x5650c4671000 2023-11-28T18:42:23.058 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.051+0000 7ff76d02d280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650c3813180 con 0x5650c4671400 2023-11-28T18:42:23.058 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.051+0000 7ff76d02d280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x5650c3812dc0 con 0x5650c4670c00 2023-11-28T18:42:23.058 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.051+0000 7ff76a319640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5650c4671000 0x5650c37afb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:23.058 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.051+0000 7ff76a319640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5650c4671000 0x5650c37afb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57786/0 (socket says 172.21.15.45:57786) 2023-11-28T18:42:23.058 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.051+0000 7ff76a319640 1 -- 172.21.15.45:0/225567396 learned_addr learned my addr 172.21.15.45:0/225567396 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:23.058 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.051+0000 7ff76ab1a640 1 --2- 172.21.15.45:0/225567396 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5650c4670c00 0x5650c37af600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:23.058 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.051+0000 7ff769b18640 1 --2- 172.21.15.45:0/225567396 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5650c4671400 0x5650c37b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:23.059 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.051+0000 7ff76a319640 1 -- 172.21.15.45:0/225567396 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5650c4670c00 msgr2=0x5650c37af600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:23.059 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.051+0000 7ff76a319640 1 --2- 172.21.15.45:0/225567396 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5650c4670c00 0x5650c37af600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.059 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.051+0000 7ff76a319640 1 -- 172.21.15.45:0/225567396 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5650c4671400 msgr2=0x5650c37b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:23.059 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.051+0000 7ff76a319640 1 --2- 172.21.15.45:0/225567396 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5650c4671400 0x5650c37b0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.059 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.051+0000 7ff76a319640 1 -- 172.21.15.45:0/225567396 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5650c3778000 con 0x5650c4671000 2023-11-28T18:42:23.059 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.051+0000 7ff769b18640 1 --2- 172.21.15.45:0/225567396 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5650c4671400 0x5650c37b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:42:23.059 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.051+0000 7ff76a319640 1 --2- 172.21.15.45:0/225567396 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5650c4671000 0x5650c37afb80 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x5650c46c6060 tx=0x5650c44cba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=284a84e9c79166d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:23.059 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.055+0000 7ff765b10640 1 -- 172.21.15.45:0/225567396 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5650c37a2dc0 con 0x5650c4671000 2023-11-28T18:42:23.059 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.055+0000 7ff765b10640 1 -- 172.21.15.45:0/225567396 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5650c4527080 con 0x5650c4671000 2023-11-28T18:42:23.059 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.055+0000 7ff765b10640 1 -- 172.21.15.45:0/225567396 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5650c37a31e0 con 0x5650c4671000 2023-11-28T18:42:23.062 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.055+0000 7ff76d02d280 1 -- 172.21.15.45:0/225567396 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5650c4671000 msgr2=0x5650c37afb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:23.062 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.055+0000 7ff76d02d280 1 --2- 172.21.15.45:0/225567396 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5650c4671000 0x5650c37afb80 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x5650c46c6060 tx=0x5650c44cba40 comp rx=0 tx=0).stop 2023-11-28T18:42:23.062 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.055+0000 7ff76d02d280 1 -- 172.21.15.45:0/225567396 shutdown_connections 2023-11-28T18:42:23.062 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.055+0000 7ff76d02d280 1 --2- 172.21.15.45:0/225567396 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5650c4671400 0x5650c37b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.062 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.055+0000 7ff76d02d280 1 --2- 172.21.15.45:0/225567396 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5650c4671000 0x5650c37afb80 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.062 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.055+0000 7ff76d02d280 1 --2- 172.21.15.45:0/225567396 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5650c4670c00 0x5650c37af600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.062 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.055+0000 7ff76d02d280 1 -- 172.21.15.45:0/225567396 >> 172.21.15.45:0/225567396 conn(0x5650c3742c00 msgr2=0x5650c3771800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:23.063 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.055+0000 7ff76d02d280 1 -- 172.21.15.45:0/225567396 shutdown_connections 2023-11-28T18:42:23.063 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.055+0000 7ff76d02d280 1 -- 172.21.15.45:0/225567396 wait complete. 2023-11-28T18:42:23.063 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.055+0000 7ff76d02d280 1 Processor -- start 2023-11-28T18:42:23.063 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.055+0000 7ff76d02d280 1 -- start start 2023-11-28T18:42:23.063 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.055+0000 7ff76d02d280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5650c4670c00 0x5650c37b1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:23.063 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.055+0000 7ff76d02d280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5650c4671000 0x5650c37b0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:23.063 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.055+0000 7ff76d02d280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5650c4671400 0x5650c37b0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:23.063 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.055+0000 7ff76d02d280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650c3812c80 con 0x5650c4671400 2023-11-28T18:42:23.063 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.055+0000 7ff76d02d280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650c3789180 con 0x5650c4671000 2023-11-28T18:42:23.063 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.055+0000 7ff76d02d280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x5650c3788b40 con 0x5650c4670c00 2023-11-28T18:42:23.063 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.055+0000 7ff76a319640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5650c4671000 0x5650c37b0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:23.064 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.055+0000 7ff769b18640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5650c4671400 0x5650c37b0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:23.064 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.055+0000 7ff76a319640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5650c4671000 0x5650c37b0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.45:38426/0 (socket says 172.21.15.45:38426) 2023-11-28T18:42:23.064 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.055+0000 7ff76a319640 1 -- 172.21.15.45:0/757632530 learned_addr learned my addr 172.21.15.45:0/757632530 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:23.064 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.055+0000 7ff76ab1a640 1 --2- 172.21.15.45:0/757632530 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5650c4670c00 0x5650c37b1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:23.064 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.055+0000 7ff76a319640 1 -- 172.21.15.45:0/757632530 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5650c4670c00 msgr2=0x5650c37b1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:23.064 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.055+0000 7ff76a319640 1 --2- 172.21.15.45:0/757632530 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5650c4670c00 0x5650c37b1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.064 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.055+0000 7ff76a319640 1 -- 172.21.15.45:0/757632530 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5650c4671400 msgr2=0x5650c37b0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:23.064 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.055+0000 7ff76a319640 1 --2- 172.21.15.45:0/757632530 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5650c4671400 0x5650c37b0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.064 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.055+0000 7ff76a319640 1 -- 172.21.15.45:0/757632530 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5650c37789c0 con 0x5650c4671000 2023-11-28T18:42:23.064 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.055+0000 7ff769b18640 1 --2- 172.21.15.45:0/757632530 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5650c4671400 0x5650c37b0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:42:23.064 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.055+0000 7ff76a319640 1 --2- 172.21.15.45:0/757632530 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5650c4671000 0x5650c37b0c00 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x5650c46c6d20 tx=0x5650c4662300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:23.064 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.055+0000 7ff76430d640 1 -- 172.21.15.45:0/757632530 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5650c37a3080 con 0x5650c4671000 2023-11-28T18:42:23.065 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.055+0000 7ff76430d640 1 -- 172.21.15.45:0/757632530 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5650c4526f00 con 0x5650c4671000 2023-11-28T18:42:23.065 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.055+0000 7ff76430d640 1 -- 172.21.15.45:0/757632530 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5650c37a2420 con 0x5650c4671000 2023-11-28T18:42:23.065 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.055+0000 7ff76d02d280 1 -- 172.21.15.45:0/757632530 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5650c3778b60 con 0x5650c4671000 2023-11-28T18:42:23.065 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.055+0000 7ff76d02d280 1 -- 172.21.15.45:0/757632530 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5650c3778ea0 con 0x5650c4671000 2023-11-28T18:42:23.067 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.059+0000 7ff76430d640 1 -- 172.21.15.45:0/757632530 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x5650c37d0840 con 0x5650c4671000 2023-11-28T18:42:23.067 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.059+0000 7ff76430d640 1 --2- 172.21.15.45:0/757632530 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x5650c3a37400 0x5650c37b1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:23.067 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.059+0000 7ff76430d640 1 -- 172.21.15.45:0/757632530 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x5650c3784a80 con 0x5650c4671000 2023-11-28T18:42:23.067 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.059+0000 7ff76d02d280 1 --2- 172.21.15.45:0/757632530 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x5650c4671800 0x5650c37b0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:23.067 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.059+0000 7ff76d02d280 1 -- 172.21.15.45:0/757632530 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x5650c3799880 con 0x5650c4671800 2023-11-28T18:42:23.067 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.059+0000 7ff76ab1a640 1 --2- 172.21.15.45:0/757632530 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x5650c3a37400 0x5650c37b1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:23.067 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.059+0000 7ff769b18640 1 --2- 172.21.15.45:0/757632530 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x5650c4671800 0x5650c37b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:23.068 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.059+0000 7ff769b18640 1 --2- 172.21.15.45:0/757632530 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x5650c4671800 0x5650c37b0100 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:23.068 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.059+0000 7ff76ab1a640 1 --2- 172.21.15.45:0/757632530 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x5650c3a37400 0x5650c37b1700 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x5650c4506210 tx=0x5650c4662120 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:23.068 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.059+0000 7ff769b18640 1 -- 172.21.15.45:0/757632530 <== osd.2 v2:172.21.15.45:6816/193884539 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x5650c4650b40 con 0x5650c4671800 2023-11-28T18:42:23.068 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.059+0000 7ff76d02d280 1 -- 172.21.15.45:0/757632530 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x5650c3799c00 con 0x5650c4671800 2023-11-28T18:42:23.068 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.059+0000 7ff769b18640 1 -- 172.21.15.45:0/757632530 <== osd.2 v2:172.21.15.45:6816/193884539 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv32 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x5650c4650b40 con 0x5650c4671800 2023-11-28T18:42:23.068 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.059+0000 7ff76d02d280 1 -- 172.21.15.45:0/757632530 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:3 6.14 6:2e2fa760:::200.00000001:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x5650c3799880 con 0x5650c4671800 2023-11-28T18:42:23.068 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.059+0000 7ff769b18640 1 -- 172.21.15.45:0/757632530 <== osd.2 v2:172.21.15.45:6816/193884539 3 ==== osd_op_reply(3 200.00000001 [read 0~34160 out=34160b] v0'0 uv34 ondisk = 0) v8 ==== 156+0+34160 (crc 0 0 0) 0x5650c4650b40 con 0x5650c4671800 2023-11-28T18:42:23.068 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.063+0000 7ff76d02d280 1 --2- 172.21.15.45:0/757632530 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x5650c4671c00 0x5650c37afb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:23.068 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.063+0000 7ff76d02d280 1 -- 172.21.15.45:0/757632530 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:4 6.1b 6:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x5650c3799c00 con 0x5650c4671c00 2023-11-28T18:42:23.068 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.063+0000 7ff76ab1a640 1 --2- 172.21.15.45:0/757632530 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x5650c4671c00 0x5650c37afb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:23.069 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.063+0000 7ff76ab1a640 1 --2- 172.21.15.45:0/757632530 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x5650c4671c00 0x5650c37afb80 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:23.069 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.063+0000 7ff76ab1a640 1 -- 172.21.15.45:0/757632530 <== osd.3 v2:172.21.15.45:6824/78541084 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x5650c4650d80 con 0x5650c4671c00 2023-11-28T18:42:23.070 INFO:tasks.workunit.client.0.smithi045.stderr:Wrote output to binary files in directory '/tmp/binary.tmp' 2023-11-28T18:42:23.070 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.063+0000 7ff76d02d280 1 -- 172.21.15.45:0/757632530 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x5650c4671800 msgr2=0x5650c37b0100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:23.070 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.063+0000 7ff76d02d280 1 --2- 172.21.15.45:0/757632530 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x5650c4671800 0x5650c37b0100 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.070 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.063+0000 7ff76d02d280 1 -- 172.21.15.45:0/757632530 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x5650c4671c00 msgr2=0x5650c37afb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:23.071 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.063+0000 7ff76d02d280 1 --2- 172.21.15.45:0/757632530 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x5650c4671c00 0x5650c37afb80 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.071 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.063+0000 7ff76d02d280 1 -- 172.21.15.45:0/757632530 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x5650c3a37400 msgr2=0x5650c37b1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:23.071 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.063+0000 7ff76d02d280 1 --2- 172.21.15.45:0/757632530 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x5650c3a37400 0x5650c37b1700 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x5650c4506210 tx=0x5650c4662120 comp rx=0 tx=0).stop 2023-11-28T18:42:23.071 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.063+0000 7ff76d02d280 1 -- 172.21.15.45:0/757632530 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5650c4671000 msgr2=0x5650c37b0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:23.071 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.063+0000 7ff76d02d280 1 --2- 172.21.15.45:0/757632530 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5650c4671000 0x5650c37b0c00 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x5650c46c6d20 tx=0x5650c4662300 comp rx=0 tx=0).stop 2023-11-28T18:42:23.071 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.063+0000 7ff769b18640 1 -- 172.21.15.45:0/757632530 reap_dead start 2023-11-28T18:42:23.071 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.063+0000 7ff76d02d280 1 -- 172.21.15.45:0/757632530 shutdown_connections 2023-11-28T18:42:23.071 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.063+0000 7ff76d02d280 1 --2- 172.21.15.45:0/757632530 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5650c4671000 0x5650c37b0c00 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.071 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.063+0000 7ff76d02d280 1 -- 172.21.15.45:0/757632530 >> 172.21.15.45:0/757632530 conn(0x5650c3742c00 msgr2=0x5650c3771800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:23.071 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.063+0000 7ff76d02d280 1 -- 172.21.15.45:0/757632530 shutdown_connections 2023-11-28T18:42:23.071 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.063+0000 7ff76d02d280 1 -- 172.21.15.45:0/757632530 wait complete. 2023-11-28T18:42:23.072 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.063+0000 7ff76d02d280 1 -- 172.21.15.45:0/2412460234 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5650c3743800 msgr2=0x5650c37ae580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:23.072 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.063+0000 7ff76d02d280 1 --2- 172.21.15.45:0/2412460234 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5650c3743800 0x5650c37ae580 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x5650c45c4bd0 tx=0x5650c44cbda0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.072 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.063+0000 7ff76d02d280 1 -- 172.21.15.45:0/2412460234 shutdown_connections 2023-11-28T18:42:23.072 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.063+0000 7ff76d02d280 1 --2- 172.21.15.45:0/2412460234 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5650c3743000 0x5650c37af080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.072 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.063+0000 7ff76d02d280 1 --2- 172.21.15.45:0/2412460234 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5650c3743400 0x5650c37aeb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.072 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.063+0000 7ff76d02d280 1 --2- 172.21.15.45:0/2412460234 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5650c3743800 0x5650c37ae580 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.072 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.063+0000 7ff76d02d280 1 -- 172.21.15.45:0/2412460234 >> 172.21.15.45:0/2412460234 conn(0x5650c3743c00 msgr2=0x5650c3771000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:23.072 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.063+0000 7ff76d02d280 1 -- 172.21.15.45:0/2412460234 shutdown_connections 2023-11-28T18:42:23.072 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.063+0000 7ff76d02d280 1 -- 172.21.15.45:0/2412460234 wait complete. 2023-11-28T18:42:23.073 INFO:tasks.workunit.client.0.smithi045.stderr:+ '[' '!' -s /tmp/binary.tmp ']' 2023-11-28T18:42:23.073 INFO:tasks.workunit.client.0.smithi045.stderr:+ cephfs-journal-tool --rank=cephfs:0 event recover_dentries summary 2023-11-28T18:42:23.114 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.111+0000 7fc48d20a280 1 -- start start 2023-11-28T18:42:23.114 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.111+0000 7fc48d20a280 1 Processor -- start 2023-11-28T18:42:23.116 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.111+0000 7fc48d20a280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d7b7059800 0x55d7b70c4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:23.117 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.111+0000 7fc48d20a280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d7b7059400 0x55d7b70c4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:23.117 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.111+0000 7fc48d20a280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d7b7059000 0x55d7b70c5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:23.117 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.111+0000 7fc48d20a280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7b709f180 con 0x55d7b7059000 2023-11-28T18:42:23.117 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.111+0000 7fc48d20a280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7b709e140 con 0x55d7b7059400 2023-11-28T18:42:23.117 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.111+0000 7fc48d20a280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d7b709e000 con 0x55d7b7059800 2023-11-28T18:42:23.117 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.111+0000 7fc48c1ca640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d7b7059000 0x55d7b70c5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:23.118 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.111+0000 7fc48c1ca640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d7b7059000 0x55d7b70c5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57812/0 (socket says 172.21.15.45:57812) 2023-11-28T18:42:23.118 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.111+0000 7fc48c1ca640 1 -- 172.21.15.45:0/2123894964 learned_addr learned my addr 172.21.15.45:0/2123894964 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:23.118 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.111+0000 7fc48b9c9640 1 --2- 172.21.15.45:0/2123894964 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d7b7059800 0x55d7b70c4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:23.118 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.111+0000 7fc48b1c8640 1 --2- 172.21.15.45:0/2123894964 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d7b7059400 0x55d7b70c4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:23.118 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.111+0000 7fc48c1ca640 1 -- 172.21.15.45:0/2123894964 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d7b7059800 msgr2=0x55d7b70c4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:23.118 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.111+0000 7fc48c1ca640 1 --2- 172.21.15.45:0/2123894964 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d7b7059800 0x55d7b70c4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.118 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.111+0000 7fc48c1ca640 1 -- 172.21.15.45:0/2123894964 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d7b7059400 msgr2=0x55d7b70c4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:23.118 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.111+0000 7fc48c1ca640 1 --2- 172.21.15.45:0/2123894964 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d7b7059400 0x55d7b70c4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.118 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.111+0000 7fc48c1ca640 1 -- 172.21.15.45:0/2123894964 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d7b708e9c0 con 0x55d7b7059000 2023-11-28T18:42:23.118 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.111+0000 7fc48c1ca640 1 --2- 172.21.15.45:0/2123894964 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d7b7059000 0x55d7b70c5080 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x55d7b7e14f00 tx=0x55d7b70db140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=705721088f18a16f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:23.118 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.111+0000 7fc4891c4640 1 -- 172.21.15.45:0/2123894964 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55d7b70b91e0 con 0x55d7b7059000 2023-11-28T18:42:23.119 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.111+0000 7fc4891c4640 1 -- 172.21.15.45:0/2123894964 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d7b70b4900 con 0x55d7b7059000 2023-11-28T18:42:23.119 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.111+0000 7fc4891c4640 1 -- 172.21.15.45:0/2123894964 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55d7b70b9080 con 0x55d7b7059000 2023-11-28T18:42:23.119 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.111+0000 7fc48d20a280 1 -- 172.21.15.45:0/2123894964 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d7b708eb60 con 0x55d7b7059000 2023-11-28T18:42:23.119 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.111+0000 7fc48d20a280 1 -- 172.21.15.45:0/2123894964 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55d7b708e340 con 0x55d7b7059000 2023-11-28T18:42:23.119 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.111+0000 7fc4891c4640 1 -- 172.21.15.45:0/2123894964 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x55d7b709ac40 con 0x55d7b7059000 2023-11-28T18:42:23.119 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.111+0000 7fc4891c4640 1 -- 172.21.15.45:0/2123894964 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 34) v1 ==== 3298+0+0 (secure 0 0 0) 0x55d7b70a7200 con 0x55d7b7059000 2023-11-28T18:42:23.123 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.115+0000 7fc48d20a280 1 Processor -- start 2023-11-28T18:42:23.123 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.115+0000 7fc48d20a280 1 -- start start 2023-11-28T18:42:23.123 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.115+0000 7fc48d20a280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d7b7f7cc00 0x55d7b70c5600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:23.123 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.115+0000 7fc48d20a280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d7b7f7d000 0x55d7b70c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:23.123 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.115+0000 7fc48d20a280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d7b7f7d400 0x55d7b70c6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:23.123 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.115+0000 7fc48d20a280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7b709ea00 con 0x55d7b7f7d400 2023-11-28T18:42:23.123 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.115+0000 7fc48d20a280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7b7129180 con 0x55d7b7f7d000 2023-11-28T18:42:23.123 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.115+0000 7fc48d20a280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d7b7128dc0 con 0x55d7b7f7cc00 2023-11-28T18:42:23.123 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.115+0000 7fc48b1c8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d7b7f7d400 0x55d7b70c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:23.124 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.115+0000 7fc48b1c8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d7b7f7d400 0x55d7b70c6100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57826/0 (socket says 172.21.15.45:57826) 2023-11-28T18:42:23.124 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.115+0000 7fc48b1c8640 1 -- 172.21.15.45:0/1143298917 learned_addr learned my addr 172.21.15.45:0/1143298917 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:23.124 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.115+0000 7fc48b1c8640 1 --2- 172.21.15.45:0/1143298917 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d7b7f7cc00 0x55d7b70c5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:23.124 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.115+0000 7fc48b9c9640 1 --2- 172.21.15.45:0/1143298917 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d7b7f7d000 0x55d7b70c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:23.124 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.115+0000 7fc48b1c8640 1 -- 172.21.15.45:0/1143298917 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d7b7f7cc00 msgr2=0x55d7b70c5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:23.124 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.115+0000 7fc48b1c8640 1 --2- 172.21.15.45:0/1143298917 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d7b7f7cc00 0x55d7b70c5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.124 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.115+0000 7fc48b1c8640 1 -- 172.21.15.45:0/1143298917 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d7b7f7d000 msgr2=0x55d7b70c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:23.124 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.115+0000 7fc48b1c8640 1 --2- 172.21.15.45:0/1143298917 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d7b7f7d000 0x55d7b70c5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.124 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.115+0000 7fc48b1c8640 1 -- 172.21.15.45:0/1143298917 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d7b708e000 con 0x55d7b7f7d400 2023-11-28T18:42:23.124 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.115+0000 7fc48b9c9640 1 --2- 172.21.15.45:0/1143298917 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d7b7f7d000 0x55d7b70c5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:42:23.124 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.115+0000 7fc48b1c8640 1 --2- 172.21.15.45:0/1143298917 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d7b7f7d400 0x55d7b70c6100 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x55d7b7fdc120 tx=0x55d7b73380c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdb6d4a005aab9c0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:23.125 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.115+0000 7fc4871c0640 1 -- 172.21.15.45:0/1143298917 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55d7b70b91e0 con 0x55d7b7f7d400 2023-11-28T18:42:23.125 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.115+0000 7fc4871c0640 1 -- 172.21.15.45:0/1143298917 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d7b70b4900 con 0x55d7b7f7d400 2023-11-28T18:42:23.125 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.115+0000 7fc4871c0640 1 -- 172.21.15.45:0/1143298917 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55d7b70b9080 con 0x55d7b7f7d400 2023-11-28T18:42:23.125 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.115+0000 7fc48d20a280 1 -- 172.21.15.45:0/1143298917 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d7b7f7d400 msgr2=0x55d7b70c6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:23.125 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.115+0000 7fc48d20a280 1 --2- 172.21.15.45:0/1143298917 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d7b7f7d400 0x55d7b70c6100 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x55d7b7fdc120 tx=0x55d7b73380c0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.125 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.115+0000 7fc48d20a280 1 -- 172.21.15.45:0/1143298917 shutdown_connections 2023-11-28T18:42:23.125 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.115+0000 7fc48d20a280 1 --2- 172.21.15.45:0/1143298917 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d7b7f7d400 0x55d7b70c6100 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.125 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.115+0000 7fc48d20a280 1 --2- 172.21.15.45:0/1143298917 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d7b7f7d000 0x55d7b70c5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.125 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.115+0000 7fc48d20a280 1 --2- 172.21.15.45:0/1143298917 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d7b7f7cc00 0x55d7b70c5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.125 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.115+0000 7fc48d20a280 1 -- 172.21.15.45:0/1143298917 >> 172.21.15.45:0/1143298917 conn(0x55d7b7058c00 msgr2=0x55d7b7087800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:23.125 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.115+0000 7fc48d20a280 1 -- 172.21.15.45:0/1143298917 shutdown_connections 2023-11-28T18:42:23.125 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.115+0000 7fc48d20a280 1 -- 172.21.15.45:0/1143298917 wait complete. 2023-11-28T18:42:23.126 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.115+0000 7fc48d20a280 1 Processor -- start 2023-11-28T18:42:23.126 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.115+0000 7fc48d20a280 1 -- start start 2023-11-28T18:42:23.126 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.119+0000 7fc48d20a280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d7b7f7cc00 0x55d7b70c7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:23.126 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.119+0000 7fc48d20a280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d7b7f7d000 0x55d7b70c6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:23.126 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.119+0000 7fc48d20a280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d7b7f7d400 0x55d7b70c6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:23.126 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.119+0000 7fc48d20a280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7b7128c80 con 0x55d7b7f7d000 2023-11-28T18:42:23.126 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.119+0000 7fc48d20a280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7b709e140 con 0x55d7b7f7cc00 2023-11-28T18:42:23.126 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.119+0000 7fc48d20a280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d7b709eb40 con 0x55d7b7f7d400 2023-11-28T18:42:23.126 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.119+0000 7fc48b9c9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d7b7f7d000 0x55d7b70c6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:23.126 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.119+0000 7fc48b9c9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d7b7f7d000 0x55d7b70c6c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57840/0 (socket says 172.21.15.45:57840) 2023-11-28T18:42:23.126 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.119+0000 7fc48b9c9640 1 -- 172.21.15.45:0/2600468959 learned_addr learned my addr 172.21.15.45:0/2600468959 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:23.126 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.119+0000 7fc48b1c8640 1 --2- 172.21.15.45:0/2600468959 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d7b7f7cc00 0x55d7b70c7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:23.127 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.119+0000 7fc48b1c8640 1 --2- 172.21.15.45:0/2600468959 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d7b7f7d400 0x55d7b70c6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:23.127 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.119+0000 7fc48b9c9640 1 -- 172.21.15.45:0/2600468959 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d7b7f7d400 msgr2=0x55d7b70c6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:23.127 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.119+0000 7fc48b9c9640 1 --2- 172.21.15.45:0/2600468959 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d7b7f7d400 0x55d7b70c6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.127 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.119+0000 7fc48b9c9640 1 -- 172.21.15.45:0/2600468959 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d7b7f7cc00 msgr2=0x55d7b70c7180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:23.127 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.119+0000 7fc48b9c9640 1 --2- 172.21.15.45:0/2600468959 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d7b7f7cc00 0x55d7b70c7180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.127 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.119+0000 7fc48b9c9640 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d7b708e9c0 con 0x55d7b7f7d000 2023-11-28T18:42:23.127 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.119+0000 7fc48b1c8640 1 --2- 172.21.15.45:0/2600468959 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d7b7f7cc00 0x55d7b70c7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:42:23.127 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.119+0000 7fc48b9c9640 1 --2- 172.21.15.45:0/2600468959 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d7b7f7d000 0x55d7b70c6c00 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x55d7b7e143c0 tx=0x55d7b7e2a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:23.127 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.119+0000 7fc4859bd640 1 -- 172.21.15.45:0/2600468959 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55d7b70b8f20 con 0x55d7b7f7d000 2023-11-28T18:42:23.127 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.119+0000 7fc4859bd640 1 -- 172.21.15.45:0/2600468959 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d7b70b4180 con 0x55d7b7f7d000 2023-11-28T18:42:23.127 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.119+0000 7fc4859bd640 1 -- 172.21.15.45:0/2600468959 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55d7b70b91e0 con 0x55d7b7f7d000 2023-11-28T18:42:23.128 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.119+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d7b708eb60 con 0x55d7b7f7d000 2023-11-28T18:42:23.128 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.119+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d7b708eea0 con 0x55d7b7f7d000 2023-11-28T18:42:23.131 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.119+0000 7fc4859bd640 1 -- 172.21.15.45:0/2600468959 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x55d7b70e7080 con 0x55d7b7f7d000 2023-11-28T18:42:23.131 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.119+0000 7fc4859bd640 1 --2- 172.21.15.45:0/2600468959 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x55d7b7343000 0x55d7b70c7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:23.131 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.119+0000 7fc4859bd640 1 -- 172.21.15.45:0/2600468959 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x55d7b709aa80 con 0x55d7b7f7d000 2023-11-28T18:42:23.131 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.123+0000 7fc48d20a280 1 --2- 172.21.15.45:0/2600468959 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x55d7b7f7d800 0x55d7b70c6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:23.131 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.123+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b70af880 con 0x55d7b7f7d800 2023-11-28T18:42:23.131 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.123+0000 7fc48b1c8640 1 --2- 172.21.15.45:0/2600468959 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x55d7b7343000 0x55d7b70c7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:23.131 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.123+0000 7fc48b1c8640 1 --2- 172.21.15.45:0/2600468959 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x55d7b7f7d800 0x55d7b70c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:23.131 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.123+0000 7fc48b1c8640 1 --2- 172.21.15.45:0/2600468959 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x55d7b7f7d800 0x55d7b70c6100 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:23.131 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.123+0000 7fc48b1c8640 1 --2- 172.21.15.45:0/2600468959 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x55d7b7343000 0x55d7b70c7700 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x55d7b7fdc270 tx=0x55d7b7338420 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:23.131 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.123+0000 7fc48b1c8640 1 -- 172.21.15.45:0/2600468959 <== osd.2 v2:172.21.15.45:6816/193884539 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x55d7b7f66b40 con 0x55d7b7f7d800 2023-11-28T18:42:23.131 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.123+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b70afc00 con 0x55d7b7f7d800 2023-11-28T18:42:23.132 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.123+0000 7fc48b1c8640 1 -- 172.21.15.45:0/2600468959 <== osd.2 v2:172.21.15.45:6816/193884539 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv32 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x55d7b7f66b40 con 0x55d7b7f7d800 2023-11-28T18:42:23.132 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.123+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:3 6.14 6:2e2fa760:::200.00000001:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b70af880 con 0x55d7b7f7d800 2023-11-28T18:42:23.132 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.123+0000 7fc48b1c8640 1 -- 172.21.15.45:0/2600468959 <== osd.2 v2:172.21.15.45:6816/193884539 3 ==== osd_op_reply(3 200.00000001 [read 0~34160 out=34160b] v0'0 uv34 ondisk = 0) v8 ==== 156+0+34160 (crc 0 0 0) 0x55d7b7f66b40 con 0x55d7b7f7d800 2023-11-28T18:42:23.132 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.123+0000 7fc48d20a280 1 --2- 172.21.15.45:0/2600468959 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x55d7b7f7dc00 0x55d7b70c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:23.132 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.123+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:4 6.1b 6:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b70afc00 con 0x55d7b7f7dc00 2023-11-28T18:42:23.132 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.123+0000 7fc48c1ca640 1 --2- 172.21.15.45:0/2600468959 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x55d7b7f7dc00 0x55d7b70c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:23.132 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.123+0000 7fc48c1ca640 1 --2- 172.21.15.45:0/2600468959 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x55d7b7f7dc00 0x55d7b70c5b80 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:23.132 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.123+0000 7fc48c1ca640 1 -- 172.21.15.45:0/2600468959 <== osd.3 v2:172.21.15.45:6824/78541084 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55d7b7f66d80 con 0x55d7b7f7dc00 2023-11-28T18:42:23.132 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.123+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:5 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b744c000 con 0x55d7b7f7dc00 2023-11-28T18:42:23.132 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.123+0000 7fc48c1ca640 1 -- 172.21.15.45:0/2600468959 <== osd.3 v2:172.21.15.45:6824/78541084 2 ==== osd_op_reply(5 1.00000000 [omap-get-header out=274b] v0'0 uv2 ondisk = 0) v8 ==== 154+0+274 (crc 0 0 0) 0x55d7b7f66d80 con 0x55d7b7f7dc00 2023-11-28T18:42:23.132 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.123+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:6 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b744c380 con 0x55d7b7f7dc00 2023-11-28T18:42:23.132 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.123+0000 7fc48c1ca640 1 -- 172.21.15.45:0/2600468959 <== osd.3 v2:172.21.15.45:6824/78541084 3 ==== osd_op_reply(6 1.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv2 ondisk = 0) v8 ==== 154+0+4 (crc 0 0 0) 0x55d7b7f66d80 con 0x55d7b7f7dc00 2023-11-28T18:42:23.133 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.123+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:7 6.13 6:cd5a64a3:::100.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b744c700 con 0x55d7b7f7dc00 2023-11-28T18:42:23.133 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.127+0000 7fc48c1ca640 1 -- 172.21.15.45:0/2600468959 <== osd.3 v2:172.21.15.45:6824/78541084 4 ==== osd_op_reply(7 100.00000000 [omap-get-header out=274b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+274 (crc 0 0 0) 0x55d7b7f66d80 con 0x55d7b7f7dc00 2023-11-28T18:42:23.133 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.127+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:8 6.13 6:cd5a64a3:::100.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b744ca80 con 0x55d7b7f7dc00 2023-11-28T18:42:23.133 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.127+0000 7fc48c1ca640 1 -- 172.21.15.45:0/2600468959 <== osd.3 v2:172.21.15.45:6824/78541084 5 ==== osd_op_reply(8 100.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+4 (crc 0 0 0) 0x55d7b7f66d80 con 0x55d7b7f7dc00 2023-11-28T18:42:23.133 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.127+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:9 6.14 6:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b744ce00 con 0x55d7b7f7d800 2023-11-28T18:42:23.133 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.127+0000 7fc48b1c8640 1 -- 172.21.15.45:0/2600468959 <== osd.2 v2:172.21.15.45:6816/193884539 4 ==== osd_op_reply(9 1.00000000.inode [read 0~582 out=582b] v0'0 uv4 ondisk = 0) v8 ==== 160+0+582 (crc 0 0 0) 0x55d7b7f66b40 con 0x55d7b7f7d800 2023-11-28T18:42:23.133 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.127+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:10 6.14 6:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b744c000 con 0x55d7b7f7d800 2023-11-28T18:42:23.134 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.127+0000 7fc48b1c8640 1 -- 172.21.15.45:0/2600468959 <== osd.2 v2:172.21.15.45:6816/193884539 5 ==== osd_op_reply(10 1.00000000.inode [writefull 0~582] v49'35 uv35 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x55d7b7f66b40 con 0x55d7b7f7d800 2023-11-28T18:42:23.134 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.127+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:11 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b744c380 con 0x55d7b7f7dc00 2023-11-28T18:42:23.134 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.127+0000 7fc48c1ca640 1 -- 172.21.15.45:0/2600468959 <== osd.3 v2:172.21.15.45:6824/78541084 6 ==== osd_op_reply(11 1.00000000 [omap-get-header out=274b] v0'0 uv2 ondisk = 0) v8 ==== 154+0+274 (crc 0 0 0) 0x55d7b7f66d80 con 0x55d7b7f7dc00 2023-11-28T18:42:23.134 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.127+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:12 6.1f 6:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b744d180 con 0x55d7b7f7dc00 2023-11-28T18:42:23.135 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.131+0000 7fc48c1ca640 1 -- 172.21.15.45:0/2600468959 <== osd.3 v2:172.21.15.45:6824/78541084 7 ==== osd_op_reply(12 1.00000000 [omap-set-header] v49'6 uv6 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x55d7b7f66d80 con 0x55d7b7f7dc00 2023-11-28T18:42:23.135 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.131+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:13 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=21b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b744d500 con 0x55d7b7f7dc00 2023-11-28T18:42:23.135 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.131+0000 7fc48c1ca640 1 -- 172.21.15.45:0/2600468959 <== osd.3 v2:172.21.15.45:6824/78541084 8 ==== osd_op_reply(13 1.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+4 (crc 0 0 0) 0x55d7b7f66d80 con 0x55d7b7f7dc00 2023-11-28T18:42:23.135 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.131+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:14 6.1f 6:ff5b34d6:::1.00000000:head [omap-set-vals in=509b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b744d880 con 0x55d7b7f7dc00 2023-11-28T18:42:23.136 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.131+0000 7fc48c1ca640 1 -- 172.21.15.45:0/2600468959 <== osd.3 v2:172.21.15.45:6824/78541084 9 ==== osd_op_reply(14 1.00000000 [omap-set-vals] v49'7 uv7 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x55d7b7f66d80 con 0x55d7b7f7dc00 2023-11-28T18:42:23.136 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.131+0000 7fc48d20a280 1 --2- 172.21.15.45:0/2600468959 >> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] conn(0x55d7b7343400 0x55d7b70c5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:23.136 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.131+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:15 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b70afc00 con 0x55d7b7343400 2023-11-28T18:42:23.136 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.131+0000 7fc48b9c9640 1 --2- 172.21.15.45:0/2600468959 >> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] conn(0x55d7b7343400 0x55d7b70c5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:23.136 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.131+0000 7fc48b9c9640 1 --2- 172.21.15.45:0/2600468959 >> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] conn(0x55d7b7343400 0x55d7b70c5600 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:23.136 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.131+0000 7fc48b9c9640 1 -- 172.21.15.45:0/2600468959 <== osd.0 v2:172.21.15.45:6808/555237322 1 ==== osd_op_reply(15 10000000000.00000000 [omap-get-header] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55d7b7f67440 con 0x55d7b7343400 2023-11-28T18:42:23.136 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.131+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:16 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b744c700 con 0x55d7b7343400 2023-11-28T18:42:23.138 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.135+0000 7fc48b9c9640 1 -- 172.21.15.45:0/2600468959 <== osd.0 v2:172.21.15.45:6808/555237322 2 ==== osd_op_reply(16 10000000000.00000000 [omap-set-header] v49'10 uv10 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d7b7f67440 con 0x55d7b7343400 2023-11-28T18:42:23.138 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.135+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:17 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b744ca80 con 0x55d7b7343400 2023-11-28T18:42:23.138 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.135+0000 7fc48b9c9640 1 -- 172.21.15.45:0/2600468959 <== osd.0 v2:172.21.15.45:6808/555237322 3 ==== osd_op_reply(17 10000000000.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv10 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55d7b7f67440 con 0x55d7b7343400 2023-11-28T18:42:23.138 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.135+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:18 6.14 6:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b744c380 con 0x55d7b7f7d800 2023-11-28T18:42:23.139 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.135+0000 7fc48b1c8640 1 -- 172.21.15.45:0/2600468959 <== osd.2 v2:172.21.15.45:6816/193884539 6 ==== osd_op_reply(18 1.00000000.inode [read 0~582 out=582b] v0'0 uv35 ondisk = 0) v8 ==== 160+0+582 (crc 0 0 0) 0x55d7b7f66b40 con 0x55d7b7f7d800 2023-11-28T18:42:23.139 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.135+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:19 6.14 6:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b744d180 con 0x55d7b7f7d800 2023-11-28T18:42:23.140 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.135+0000 7fc48b1c8640 1 -- 172.21.15.45:0/2600468959 <== osd.2 v2:172.21.15.45:6816/193884539 7 ==== osd_op_reply(19 1.00000000.inode [writefull 0~582] v49'36 uv36 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x55d7b7f66b40 con 0x55d7b7f7d800 2023-11-28T18:42:23.141 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.135+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:20 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b744ce00 con 0x55d7b7f7dc00 2023-11-28T18:42:23.141 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.135+0000 7fc48c1ca640 1 -- 172.21.15.45:0/2600468959 <== osd.3 v2:172.21.15.45:6824/78541084 10 ==== osd_op_reply(20 1.00000000 [omap-get-header out=274b] v0'0 uv7 ondisk = 0) v8 ==== 154+0+274 (crc 0 0 0) 0x55d7b7f66d80 con 0x55d7b7f7dc00 2023-11-28T18:42:23.141 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.135+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:21 6.1f 6:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b744c000 con 0x55d7b7f7dc00 2023-11-28T18:42:23.143 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.139+0000 7fc48c1ca640 1 -- 172.21.15.45:0/2600468959 <== osd.3 v2:172.21.15.45:6824/78541084 11 ==== osd_op_reply(21 1.00000000 [omap-set-header] v49'8 uv8 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x55d7b7f66d80 con 0x55d7b7f7dc00 2023-11-28T18:42:23.144 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.139+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:22 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=21b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b70af880 con 0x55d7b7f7dc00 2023-11-28T18:42:23.144 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.139+0000 7fc48c1ca640 1 -- 172.21.15.45:0/2600468959 <== osd.3 v2:172.21.15.45:6824/78541084 12 ==== osd_op_reply(22 1.00000000 [omap-get-vals-by-keys out=509b] v0'0 uv8 ondisk = 0) v8 ==== 154+0+509 (crc 0 0 0) 0x55d7b7f66d80 con 0x55d7b7f7dc00 2023-11-28T18:42:23.145 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.139+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:23 6.1f 6:ff5b34d6:::1.00000000:head [omap-set-vals in=509b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b744d500 con 0x55d7b7f7dc00 2023-11-28T18:42:23.145 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.139+0000 7fc48c1ca640 1 -- 172.21.15.45:0/2600468959 <== osd.3 v2:172.21.15.45:6824/78541084 13 ==== osd_op_reply(23 1.00000000 [omap-set-vals] v49'9 uv9 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x55d7b7f66d80 con 0x55d7b7f7dc00 2023-11-28T18:42:23.145 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.139+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:24 6.14 6:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b744d880 con 0x55d7b7f7d800 2023-11-28T18:42:23.145 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.139+0000 7fc48b1c8640 1 -- 172.21.15.45:0/2600468959 <== osd.2 v2:172.21.15.45:6816/193884539 8 ==== osd_op_reply(24 1.00000000.inode [read 0~582 out=582b] v0'0 uv36 ondisk = 0) v8 ==== 160+0+582 (crc 0 0 0) 0x55d7b7f66b40 con 0x55d7b7f7d800 2023-11-28T18:42:23.146 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.139+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:25 6.14 6:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b744ce00 con 0x55d7b7f7d800 2023-11-28T18:42:23.149 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.139+0000 7fc48b1c8640 1 -- 172.21.15.45:0/2600468959 <== osd.2 v2:172.21.15.45:6816/193884539 9 ==== osd_op_reply(25 1.00000000.inode [writefull 0~582] v49'37 uv37 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x55d7b7f66b40 con 0x55d7b7f7d800 2023-11-28T18:42:23.150 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.139+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:26 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b744c000 con 0x55d7b7f7dc00 2023-11-28T18:42:23.150 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.139+0000 7fc48c1ca640 1 -- 172.21.15.45:0/2600468959 <== osd.3 v2:172.21.15.45:6824/78541084 14 ==== osd_op_reply(26 1.00000000 [omap-get-header out=274b] v0'0 uv9 ondisk = 0) v8 ==== 154+0+274 (crc 0 0 0) 0x55d7b7f66d80 con 0x55d7b7f7dc00 2023-11-28T18:42:23.150 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.139+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:27 6.1f 6:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b744c700 con 0x55d7b7f7dc00 2023-11-28T18:42:23.150 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.143+0000 7fc48c1ca640 1 -- 172.21.15.45:0/2600468959 <== osd.3 v2:172.21.15.45:6824/78541084 15 ==== osd_op_reply(27 1.00000000 [omap-set-header] v49'10 uv10 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x55d7b7f66d80 con 0x55d7b7f7dc00 2023-11-28T18:42:23.150 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.143+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:28 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=21b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b744dc00 con 0x55d7b7f7dc00 2023-11-28T18:42:23.150 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.143+0000 7fc48c1ca640 1 -- 172.21.15.45:0/2600468959 <== osd.3 v2:172.21.15.45:6824/78541084 16 ==== osd_op_reply(28 1.00000000 [omap-get-vals-by-keys out=509b] v0'0 uv10 ondisk = 0) v8 ==== 154+0+509 (crc 0 0 0) 0x55d7b7f66d80 con 0x55d7b7f7dc00 2023-11-28T18:42:23.150 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.143+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:29 6.1f 6:ff5b34d6:::1.00000000:head [omap-set-vals in=509b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b70af880 con 0x55d7b7f7dc00 2023-11-28T18:42:23.151 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.143+0000 7fc48c1ca640 1 -- 172.21.15.45:0/2600468959 <== osd.3 v2:172.21.15.45:6824/78541084 17 ==== osd_op_reply(29 1.00000000 [omap-set-vals] v49'11 uv11 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x55d7b7f66d80 con 0x55d7b7f7dc00 2023-11-28T18:42:23.151 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.143+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:30 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b70afc00 con 0x55d7b7343400 2023-11-28T18:42:23.151 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.143+0000 7fc48b9c9640 1 -- 172.21.15.45:0/2600468959 <== osd.0 v2:172.21.15.45:6808/555237322 4 ==== osd_op_reply(30 10000000000.00000000 [omap-get-header out=274b] v0'0 uv10 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55d7b7f67440 con 0x55d7b7343400 2023-11-28T18:42:23.151 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.143+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:31 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b744c380 con 0x55d7b7343400 2023-11-28T18:42:23.152 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.147+0000 7fc48b9c9640 1 -- 172.21.15.45:0/2600468959 <== osd.0 v2:172.21.15.45:6808/555237322 5 ==== osd_op_reply(31 10000000000.00000000 [omap-set-header] v49'11 uv11 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d7b7f67440 con 0x55d7b7343400 2023-11-28T18:42:23.152 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.147+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:32 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b744d180 con 0x55d7b7343400 2023-11-28T18:42:23.152 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.147+0000 7fc48b9c9640 1 -- 172.21.15.45:0/2600468959 <== osd.0 v2:172.21.15.45:6808/555237322 6 ==== osd_op_reply(32 10000000000.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv11 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55d7b7f67440 con 0x55d7b7343400 2023-11-28T18:42:23.152 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.147+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:33 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=504b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b744d880 con 0x55d7b7343400 2023-11-28T18:42:23.152 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.147+0000 7fc48b9c9640 1 -- 172.21.15.45:0/2600468959 <== osd.0 v2:172.21.15.45:6808/555237322 7 ==== osd_op_reply(33 10000000000.00000000 [omap-set-vals] v49'12 uv12 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d7b7f67440 con 0x55d7b7343400 2023-11-28T18:42:23.152 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.147+0000 7fc48d20a280 1 --2- 172.21.15.45:0/2600468959 >> [v2:172.21.15.190:6800/3296698407,v1:172.21.15.190:6801/3296698407] conn(0x55d7b7343800 0x55d7b7462000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:23.153 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.147+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.190:6800/3296698407,v1:172.21.15.190:6801/3296698407] -- osd_op(unknown.0.0:34 6.7 6:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b744ce00 con 0x55d7b7343800 2023-11-28T18:42:23.153 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.147+0000 7fc48b1c8640 1 --2- 172.21.15.45:0/2600468959 >> [v2:172.21.15.190:6800/3296698407,v1:172.21.15.190:6801/3296698407] conn(0x55d7b7343800 0x55d7b7462000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:23.153 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.147+0000 7fc48b1c8640 1 --2- 172.21.15.45:0/2600468959 >> [v2:172.21.15.190:6800/3296698407,v1:172.21.15.190:6801/3296698407] conn(0x55d7b7343800 0x55d7b7462000 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:23.153 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.147+0000 7fc48b1c8640 1 -- 172.21.15.45:0/2600468959 <== osd.5 v2:172.21.15.190:6800/3296698407 1 ==== osd_op_reply(34 10000000001.00000000 [omap-get-header] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55d7b7f66b40 con 0x55d7b7343800 2023-11-28T18:42:23.153 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.147+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.190:6800/3296698407,v1:172.21.15.190:6801/3296698407] -- osd_op(unknown.0.0:35 6.7 6:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b744ca80 con 0x55d7b7343800 2023-11-28T18:42:23.154 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.151+0000 7fc48b1c8640 1 -- 172.21.15.45:0/2600468959 <== osd.5 v2:172.21.15.190:6800/3296698407 2 ==== osd_op_reply(35 10000000001.00000000 [omap-set-header] v49'4 uv4 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d7b7f66b40 con 0x55d7b7343800 2023-11-28T18:42:23.154 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.151+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.190:6800/3296698407,v1:172.21.15.190:6801/3296698407] -- osd_op(unknown.0.0:36 6.7 6:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b744c380 con 0x55d7b7343800 2023-11-28T18:42:23.154 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.151+0000 7fc48b1c8640 1 -- 172.21.15.45:0/2600468959 <== osd.5 v2:172.21.15.190:6800/3296698407 3 ==== osd_op_reply(36 10000000001.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55d7b7f66b40 con 0x55d7b7343800 2023-11-28T18:42:23.155 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.151+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:37 6.14 6:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b70afc00 con 0x55d7b7f7d800 2023-11-28T18:42:23.155 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.151+0000 7fc48b1c8640 1 -- 172.21.15.45:0/2600468959 <== osd.2 v2:172.21.15.45:6816/193884539 10 ==== osd_op_reply(37 1.00000000.inode [read 0~582 out=582b] v0'0 uv37 ondisk = 0) v8 ==== 160+0+582 (crc 0 0 0) 0x55d7b7f66b40 con 0x55d7b7f7d800 2023-11-28T18:42:23.155 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.151+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:38 6.14 6:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b7468000 con 0x55d7b7f7d800 2023-11-28T18:42:23.156 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.151+0000 7fc48b1c8640 1 -- 172.21.15.45:0/2600468959 <== osd.2 v2:172.21.15.45:6816/193884539 11 ==== osd_op_reply(38 1.00000000.inode [writefull 0~582] v49'38 uv38 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x55d7b7f66b40 con 0x55d7b7f7d800 2023-11-28T18:42:23.156 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.151+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:39 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b7468380 con 0x55d7b7343400 2023-11-28T18:42:23.157 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.151+0000 7fc48b9c9640 1 -- 172.21.15.45:0/2600468959 <== osd.0 v2:172.21.15.45:6808/555237322 8 ==== osd_op_reply(39 10000000000.00000000 [omap-get-header out=274b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55d7b7f67440 con 0x55d7b7343400 2023-11-28T18:42:23.157 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.151+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:40 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b7468700 con 0x55d7b7343400 2023-11-28T18:42:23.158 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.155+0000 7fc48b9c9640 1 -- 172.21.15.45:0/2600468959 <== osd.0 v2:172.21.15.45:6808/555237322 9 ==== osd_op_reply(40 10000000000.00000000 [omap-set-header] v49'13 uv13 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d7b7f67440 con 0x55d7b7343400 2023-11-28T18:42:23.158 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.155+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:41 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b7468a80 con 0x55d7b7343400 2023-11-28T18:42:23.158 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.155+0000 7fc48b9c9640 1 -- 172.21.15.45:0/2600468959 <== osd.0 v2:172.21.15.45:6808/555237322 10 ==== osd_op_reply(41 10000000000.00000000 [omap-get-vals-by-keys out=504b] v0'0 uv13 ondisk = 0) v8 ==== 164+0+504 (crc 0 0 0) 0x55d7b7f67440 con 0x55d7b7343400 2023-11-28T18:42:23.159 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.155+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:42 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=504b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b7468e00 con 0x55d7b7343400 2023-11-28T18:42:23.161 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.155+0000 7fc48b9c9640 1 -- 172.21.15.45:0/2600468959 <== osd.0 v2:172.21.15.45:6808/555237322 11 ==== osd_op_reply(42 10000000000.00000000 [omap-set-vals] v49'14 uv14 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d7b7f67440 con 0x55d7b7343400 2023-11-28T18:42:23.161 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.155+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.190:6800/3296698407,v1:172.21.15.190:6801/3296698407] -- osd_op(unknown.0.0:43 6.7 6:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b7469180 con 0x55d7b7343800 2023-11-28T18:42:23.161 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.159+0000 7fc48b1c8640 1 -- 172.21.15.45:0/2600468959 <== osd.5 v2:172.21.15.190:6800/3296698407 4 ==== osd_op_reply(43 10000000001.00000000 [omap-get-header out=274b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55d7b7f66b40 con 0x55d7b7343800 2023-11-28T18:42:23.161 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.159+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.190:6800/3296698407,v1:172.21.15.190:6801/3296698407] -- osd_op(unknown.0.0:44 6.7 6:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b7469500 con 0x55d7b7343800 2023-11-28T18:42:23.163 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.159+0000 7fc48b1c8640 1 -- 172.21.15.45:0/2600468959 <== osd.5 v2:172.21.15.190:6800/3296698407 5 ==== osd_op_reply(44 10000000001.00000000 [omap-set-header] v49'5 uv5 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d7b7f66b40 con 0x55d7b7343800 2023-11-28T18:42:23.163 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.159+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.190:6800/3296698407,v1:172.21.15.190:6801/3296698407] -- osd_op(unknown.0.0:45 6.7 6:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b7469880 con 0x55d7b7343800 2023-11-28T18:42:23.163 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.159+0000 7fc48b1c8640 1 -- 172.21.15.45:0/2600468959 <== osd.5 v2:172.21.15.190:6800/3296698407 6 ==== osd_op_reply(45 10000000001.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv5 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55d7b7f66b40 con 0x55d7b7343800 2023-11-28T18:42:23.164 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.159+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.190:6800/3296698407,v1:172.21.15.190:6801/3296698407] -- osd_op(unknown.0.0:46 6.7 6:e2e07930:::10000000001.00000000:head [omap-set-vals in=504b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b7469c00 con 0x55d7b7343800 2023-11-28T18:42:23.166 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.163+0000 7fc48b1c8640 1 -- 172.21.15.45:0/2600468959 <== osd.5 v2:172.21.15.190:6800/3296698407 7 ==== osd_op_reply(46 10000000001.00000000 [omap-set-vals] v49'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d7b7f66b40 con 0x55d7b7343800 2023-11-28T18:42:23.166 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.163+0000 7fc48d20a280 1 --2- 172.21.15.45:0/2600468959 >> [v2:172.21.15.190:6824/2493232051,v1:172.21.15.190:6825/2493232051] conn(0x55d7b7343c00 0x55d7b7462580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:23.166 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.163+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.190:6824/2493232051,v1:172.21.15.190:6825/2493232051] -- osd_op(unknown.0.0:47 6.12 6:4bec3886:::10000000002.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b7468380 con 0x55d7b7343c00 2023-11-28T18:42:23.166 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.163+0000 7fc48c1ca640 1 --2- 172.21.15.45:0/2600468959 >> [v2:172.21.15.190:6824/2493232051,v1:172.21.15.190:6825/2493232051] conn(0x55d7b7343c00 0x55d7b7462580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:23.167 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.163+0000 7fc48c1ca640 1 --2- 172.21.15.45:0/2600468959 >> [v2:172.21.15.190:6824/2493232051,v1:172.21.15.190:6825/2493232051] conn(0x55d7b7343c00 0x55d7b7462580 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:23.167 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.163+0000 7fc48c1ca640 1 -- 172.21.15.45:0/2600468959 <== osd.7 v2:172.21.15.190:6824/2493232051 1 ==== osd_op_reply(47 10000000002.00000000 [omap-get-header] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55d7b7f66d80 con 0x55d7b7343c00 2023-11-28T18:42:23.167 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.163+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.190:6824/2493232051,v1:172.21.15.190:6825/2493232051] -- osd_op(unknown.0.0:48 6.12 6:4bec3886:::10000000002.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b7468700 con 0x55d7b7343c00 2023-11-28T18:42:23.169 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.163+0000 7fc48c1ca640 1 -- 172.21.15.45:0/2600468959 <== osd.7 v2:172.21.15.190:6824/2493232051 2 ==== osd_op_reply(48 10000000002.00000000 [omap-set-header] v49'2 uv2 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d7b7f66d80 con 0x55d7b7343c00 2023-11-28T18:42:23.169 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.163+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.190:6824/2493232051,v1:172.21.15.190:6825/2493232051] -- osd_op(unknown.0.0:49 6.12 6:4bec3886:::10000000002.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b7468000 con 0x55d7b7343c00 2023-11-28T18:42:23.169 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.163+0000 7fc48c1ca640 1 -- 172.21.15.45:0/2600468959 <== osd.7 v2:172.21.15.190:6824/2493232051 3 ==== osd_op_reply(49 10000000002.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55d7b7f66d80 con 0x55d7b7343c00 2023-11-28T18:42:23.169 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.163+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:50 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b70afc00 con 0x55d7b7343400 2023-11-28T18:42:23.169 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.167+0000 7fc48b9c9640 1 -- 172.21.15.45:0/2600468959 <== osd.0 v2:172.21.15.45:6808/555237322 12 ==== osd_op_reply(50 10000000000.00000000 [omap-get-header out=274b] v0'0 uv14 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55d7b7f67440 con 0x55d7b7343400 2023-11-28T18:42:23.170 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.167+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:51 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b744d180 con 0x55d7b7343400 2023-11-28T18:42:23.171 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.167+0000 7fc48b9c9640 1 -- 172.21.15.45:0/2600468959 <== osd.0 v2:172.21.15.45:6808/555237322 13 ==== osd_op_reply(51 10000000000.00000000 [omap-set-header] v49'15 uv15 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d7b7f67440 con 0x55d7b7343400 2023-11-28T18:42:23.171 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.167+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:52 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b744d880 con 0x55d7b7343400 2023-11-28T18:42:23.171 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.167+0000 7fc48b9c9640 1 -- 172.21.15.45:0/2600468959 <== osd.0 v2:172.21.15.45:6808/555237322 14 ==== osd_op_reply(52 10000000000.00000000 [omap-get-vals-by-keys out=504b] v0'0 uv15 ondisk = 0) v8 ==== 164+0+504 (crc 0 0 0) 0x55d7b7f67440 con 0x55d7b7343400 2023-11-28T18:42:23.171 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.167+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:53 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=504b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b744ce00 con 0x55d7b7343400 2023-11-28T18:42:23.173 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.171+0000 7fc48b9c9640 1 -- 172.21.15.45:0/2600468959 <== osd.0 v2:172.21.15.45:6808/555237322 15 ==== osd_op_reply(53 10000000000.00000000 [omap-set-vals] v49'16 uv16 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d7b7f67440 con 0x55d7b7343400 2023-11-28T18:42:23.173 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.171+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.190:6800/3296698407,v1:172.21.15.190:6801/3296698407] -- osd_op(unknown.0.0:54 6.7 6:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b744ca80 con 0x55d7b7343800 2023-11-28T18:42:23.174 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.171+0000 7fc48b1c8640 1 -- 172.21.15.45:0/2600468959 <== osd.5 v2:172.21.15.190:6800/3296698407 8 ==== osd_op_reply(54 10000000001.00000000 [omap-get-header out=274b] v0'0 uv6 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55d7b7f66b40 con 0x55d7b7343800 2023-11-28T18:42:23.174 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.171+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.190:6800/3296698407,v1:172.21.15.190:6801/3296698407] -- osd_op(unknown.0.0:55 6.7 6:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b744c380 con 0x55d7b7343800 2023-11-28T18:42:23.175 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.171+0000 7fc48b1c8640 1 -- 172.21.15.45:0/2600468959 <== osd.5 v2:172.21.15.190:6800/3296698407 9 ==== osd_op_reply(55 10000000001.00000000 [omap-set-header] v49'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d7b7f66b40 con 0x55d7b7343800 2023-11-28T18:42:23.175 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.171+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.190:6800/3296698407,v1:172.21.15.190:6801/3296698407] -- osd_op(unknown.0.0:56 6.7 6:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b7469180 con 0x55d7b7343800 2023-11-28T18:42:23.175 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.171+0000 7fc48b1c8640 1 -- 172.21.15.45:0/2600468959 <== osd.5 v2:172.21.15.190:6800/3296698407 10 ==== osd_op_reply(56 10000000001.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv7 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55d7b7f66b40 con 0x55d7b7343800 2023-11-28T18:42:23.176 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.171+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.190:6800/3296698407,v1:172.21.15.190:6801/3296698407] -- osd_op(unknown.0.0:57 6.7 6:e2e07930:::10000000001.00000000:head [omap-set-vals in=542b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b7469500 con 0x55d7b7343800 2023-11-28T18:42:23.177 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.171+0000 7fc48b1c8640 1 -- 172.21.15.45:0/2600468959 <== osd.5 v2:172.21.15.190:6800/3296698407 11 ==== osd_op_reply(57 10000000001.00000000 [omap-set-vals] v49'8 uv8 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d7b7f66b40 con 0x55d7b7343800 2023-11-28T18:42:23.177 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.171+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:58 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b7469880 con 0x55d7b7f7dc00 2023-11-28T18:42:23.177 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.171+0000 7fc48c1ca640 1 -- 172.21.15.45:0/2600468959 <== osd.3 v2:172.21.15.45:6824/78541084 18 ==== osd_op_reply(58 1.00000000 [omap-get-header out=274b] v0'0 uv11 ondisk = 0) v8 ==== 154+0+274 (crc 0 0 0) 0x55d7b7f66d80 con 0x55d7b7f7dc00 2023-11-28T18:42:23.177 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.171+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:59 6.1f 6:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b70afc00 con 0x55d7b7f7dc00 2023-11-28T18:42:23.178 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.175+0000 7fc48c1ca640 1 -- 172.21.15.45:0/2600468959 <== osd.3 v2:172.21.15.45:6824/78541084 19 ==== osd_op_reply(59 1.00000000 [omap-set-header] v49'12 uv12 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x55d7b7f66d80 con 0x55d7b7f7dc00 2023-11-28T18:42:23.178 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.175+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:60 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=21b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b70af880 con 0x55d7b7f7dc00 2023-11-28T18:42:23.179 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.175+0000 7fc48c1ca640 1 -- 172.21.15.45:0/2600468959 <== osd.3 v2:172.21.15.45:6824/78541084 20 ==== osd_op_reply(60 1.00000000 [omap-get-vals-by-keys out=509b] v0'0 uv12 ondisk = 0) v8 ==== 154+0+509 (crc 0 0 0) 0x55d7b7f66d80 con 0x55d7b7f7dc00 2023-11-28T18:42:23.179 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.175+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:61 6.1f 6:ff5b34d6:::1.00000000:head [omap-set-vals in=509b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b744ca80 con 0x55d7b7f7dc00 2023-11-28T18:42:23.180 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.175+0000 7fc48c1ca640 1 -- 172.21.15.45:0/2600468959 <== osd.3 v2:172.21.15.45:6824/78541084 21 ==== osd_op_reply(61 1.00000000 [omap-set-vals] v49'13 uv13 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x55d7b7f66d80 con 0x55d7b7f7dc00 2023-11-28T18:42:23.180 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.175+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:62 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b744c380 con 0x55d7b7343400 2023-11-28T18:42:23.180 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.175+0000 7fc48b9c9640 1 -- 172.21.15.45:0/2600468959 <== osd.0 v2:172.21.15.45:6808/555237322 16 ==== osd_op_reply(62 10000000000.00000000 [omap-get-header out=274b] v0'0 uv16 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55d7b7f67440 con 0x55d7b7343400 2023-11-28T18:42:23.180 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.175+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:63 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b744d180 con 0x55d7b7343400 2023-11-28T18:42:23.182 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.179+0000 7fc48b9c9640 1 -- 172.21.15.45:0/2600468959 <== osd.0 v2:172.21.15.45:6808/555237322 17 ==== osd_op_reply(63 10000000000.00000000 [omap-set-header] v49'17 uv17 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d7b7f67440 con 0x55d7b7343400 2023-11-28T18:42:23.182 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.179+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:64 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b744d880 con 0x55d7b7343400 2023-11-28T18:42:23.182 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.179+0000 7fc48b9c9640 1 -- 172.21.15.45:0/2600468959 <== osd.0 v2:172.21.15.45:6808/555237322 18 ==== osd_op_reply(64 10000000000.00000000 [omap-get-vals-by-keys out=504b] v0'0 uv17 ondisk = 0) v8 ==== 164+0+504 (crc 0 0 0) 0x55d7b7f67440 con 0x55d7b7343400 2023-11-28T18:42:23.182 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.179+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:65 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=504b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b744d500 con 0x55d7b7343400 2023-11-28T18:42:23.184 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.179+0000 7fc48b9c9640 1 -- 172.21.15.45:0/2600468959 <== osd.0 v2:172.21.15.45:6808/555237322 19 ==== osd_op_reply(65 10000000000.00000000 [omap-set-vals] v49'18 uv18 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d7b7f67440 con 0x55d7b7343400 2023-11-28T18:42:23.184 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.179+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:66 6.13 6:cd5a64a3:::100.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b744c000 con 0x55d7b7f7dc00 2023-11-28T18:42:23.184 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.179+0000 7fc48c1ca640 1 -- 172.21.15.45:0/2600468959 <== osd.3 v2:172.21.15.45:6824/78541084 22 ==== osd_op_reply(66 100.00000000 [omap-get-header out=274b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+274 (crc 0 0 0) 0x55d7b7f66d80 con 0x55d7b7f7dc00 2023-11-28T18:42:23.184 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.179+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:67 6.13 6:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b744c700 con 0x55d7b7f7dc00 2023-11-28T18:42:23.186 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.183+0000 7fc48c1ca640 1 -- 172.21.15.45:0/2600468959 <== osd.3 v2:172.21.15.45:6824/78541084 23 ==== osd_op_reply(67 100.00000000 [omap-set-header] v49'3 uv3 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55d7b7f66d80 con 0x55d7b7f7dc00 2023-11-28T18:42:23.186 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.183+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:68 6.13 6:cd5a64a3:::100.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b744dc00 con 0x55d7b7f7dc00 2023-11-28T18:42:23.186 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.183+0000 7fc48c1ca640 1 -- 172.21.15.45:0/2600468959 <== osd.3 v2:172.21.15.45:6824/78541084 24 ==== osd_op_reply(68 100.00000000 [omap-get-vals-by-keys out=523b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+523 (crc 0 0 0) 0x55d7b7f66d80 con 0x55d7b7f7dc00 2023-11-28T18:42:23.186 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.183+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:69 6.13 6:cd5a64a3:::100.00000000:head [omap-set-vals in=507b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b7468700 con 0x55d7b7f7dc00 2023-11-28T18:42:23.187 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.183+0000 7fc48c1ca640 1 -- 172.21.15.45:0/2600468959 <== osd.3 v2:172.21.15.45:6824/78541084 25 ==== osd_op_reply(69 100.00000000 [omap-set-vals] v49'4 uv4 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55d7b7f66d80 con 0x55d7b7f7dc00 2023-11-28T18:42:23.187 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.183+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:70 6.10 6:0bd6d154:::602.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b7468000 con 0x55d7b7343400 2023-11-28T18:42:23.188 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.183+0000 7fc48b9c9640 1 -- 172.21.15.45:0/2600468959 <== osd.0 v2:172.21.15.45:6808/555237322 20 ==== osd_op_reply(70 602.00000000 [omap-get-header out=274b] v0'0 uv7 ondisk = 0) v8 ==== 156+0+274 (crc 0 0 0) 0x55d7b7f67440 con 0x55d7b7343400 2023-11-28T18:42:23.188 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.183+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:71 6.10 6:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b7469880 con 0x55d7b7343400 2023-11-28T18:42:23.189 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.183+0000 7fc48b9c9640 1 -- 172.21.15.45:0/2600468959 <== osd.0 v2:172.21.15.45:6808/555237322 21 ==== osd_op_reply(71 602.00000000 [omap-set-header] v49'19 uv19 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55d7b7f67440 con 0x55d7b7343400 2023-11-28T18:42:23.189 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.183+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:72 6.10 6:0bd6d154:::602.00000000:head [omap-get-vals-by-keys in=24b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b7469c00 con 0x55d7b7343400 2023-11-28T18:42:23.189 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.187+0000 7fc48b9c9640 1 -- 172.21.15.45:0/2600468959 <== osd.0 v2:172.21.15.45:6808/555237322 22 ==== osd_op_reply(72 602.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv19 ondisk = 0) v8 ==== 156+0+4 (crc 0 0 0) 0x55d7b7f67440 con 0x55d7b7343400 2023-11-28T18:42:23.189 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.187+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:73 6.10 6:0bd6d154:::602.00000000:head [omap-set-vals in=529b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b7468a80 con 0x55d7b7343400 2023-11-28T18:42:23.190 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.187+0000 7fc48b9c9640 1 -- 172.21.15.45:0/2600468959 <== osd.0 v2:172.21.15.45:6808/555237322 23 ==== osd_op_reply(73 602.00000000 [omap-set-vals] v49'20 uv20 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55d7b7f67440 con 0x55d7b7343400 2023-11-28T18:42:23.191 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.187+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.190:6800/3296698407,v1:172.21.15.190:6801/3296698407] -- osd_op(unknown.0.0:74 6.7 6:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b7468e00 con 0x55d7b7343800 2023-11-28T18:42:23.191 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.187+0000 7fc48b1c8640 1 -- 172.21.15.45:0/2600468959 <== osd.5 v2:172.21.15.190:6800/3296698407 12 ==== osd_op_reply(74 10000000001.00000000 [omap-get-header out=274b] v0'0 uv8 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55d7b7f66b40 con 0x55d7b7343800 2023-11-28T18:42:23.191 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.187+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.190:6800/3296698407,v1:172.21.15.190:6801/3296698407] -- osd_op(unknown.0.0:75 6.7 6:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b7468380 con 0x55d7b7343800 2023-11-28T18:42:23.192 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.187+0000 7fc48b1c8640 1 -- 172.21.15.45:0/2600468959 <== osd.5 v2:172.21.15.190:6800/3296698407 13 ==== osd_op_reply(75 10000000001.00000000 [omap-set-header] v49'9 uv9 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d7b7f66b40 con 0x55d7b7343800 2023-11-28T18:42:23.193 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.187+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.190:6800/3296698407,v1:172.21.15.190:6801/3296698407] -- osd_op(unknown.0.0:76 6.7 6:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b744ca80 con 0x55d7b7343800 2023-11-28T18:42:23.193 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.187+0000 7fc48b1c8640 1 -- 172.21.15.45:0/2600468959 <== osd.5 v2:172.21.15.190:6800/3296698407 14 ==== osd_op_reply(76 10000000001.00000000 [omap-get-vals-by-keys out=504b] v0'0 uv9 ondisk = 0) v8 ==== 164+0+504 (crc 0 0 0) 0x55d7b7f66b40 con 0x55d7b7343800 2023-11-28T18:42:23.193 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.187+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.190:6800/3296698407,v1:172.21.15.190:6801/3296698407] -- osd_op(unknown.0.0:77 6.7 6:e2e07930:::10000000001.00000000:head [omap-rm-keys in=16b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b744c000 con 0x55d7b7343800 2023-11-28T18:42:23.195 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.191+0000 7fc48b1c8640 1 -- 172.21.15.45:0/2600468959 <== osd.5 v2:172.21.15.190:6800/3296698407 15 ==== osd_op_reply(77 10000000001.00000000 [omap-rm-keys] v49'10 uv10 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d7b7f66b40 con 0x55d7b7343800 2023-11-28T18:42:23.195 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.191+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:78 6.14 6:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b70afc00 con 0x55d7b7f7d800 2023-11-28T18:42:23.195 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.191+0000 7fc48b1c8640 1 -- 172.21.15.45:0/2600468959 <== osd.2 v2:172.21.15.45:6816/193884539 12 ==== osd_op_reply(78 1.00000000.inode [read 0~582 out=582b] v0'0 uv38 ondisk = 0) v8 ==== 160+0+582 (crc 0 0 0) 0x55d7b7f66b40 con 0x55d7b7f7d800 2023-11-28T18:42:23.195 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.191+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:79 6.14 6:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b70af880 con 0x55d7b7f7d800 2023-11-28T18:42:23.197 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.191+0000 7fc48b1c8640 1 -- 172.21.15.45:0/2600468959 <== osd.2 v2:172.21.15.45:6816/193884539 13 ==== osd_op_reply(79 1.00000000.inode [writefull 0~582] v49'39 uv39 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x55d7b7f66b40 con 0x55d7b7f7d800 2023-11-28T18:42:23.197 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.191+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:80 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b7469180 con 0x55d7b7343400 2023-11-28T18:42:23.197 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.195+0000 7fc48b9c9640 1 -- 172.21.15.45:0/2600468959 <== osd.0 v2:172.21.15.45:6808/555237322 24 ==== osd_op_reply(80 10000000000.00000000 [omap-get-header out=274b] v0'0 uv18 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55d7b7f67440 con 0x55d7b7343400 2023-11-28T18:42:23.198 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.195+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:81 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b7469500 con 0x55d7b7343400 2023-11-28T18:42:23.199 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.195+0000 7fc48b9c9640 1 -- 172.21.15.45:0/2600468959 <== osd.0 v2:172.21.15.45:6808/555237322 25 ==== osd_op_reply(81 10000000000.00000000 [omap-set-header] v49'21 uv21 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d7b7f67440 con 0x55d7b7343400 2023-11-28T18:42:23.199 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.195+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:82 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b7468e00 con 0x55d7b7343400 2023-11-28T18:42:23.199 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.195+0000 7fc48b9c9640 1 -- 172.21.15.45:0/2600468959 <== osd.0 v2:172.21.15.45:6808/555237322 26 ==== osd_op_reply(82 10000000000.00000000 [omap-get-vals-by-keys out=504b] v0'0 uv21 ondisk = 0) v8 ==== 164+0+504 (crc 0 0 0) 0x55d7b7f67440 con 0x55d7b7343400 2023-11-28T18:42:23.199 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.195+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:83 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=504b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b7468380 con 0x55d7b7343400 2023-11-28T18:42:23.201 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.199+0000 7fc48b9c9640 1 -- 172.21.15.45:0/2600468959 <== osd.0 v2:172.21.15.45:6808/555237322 27 ==== osd_op_reply(83 10000000000.00000000 [omap-set-vals] v49'22 uv22 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d7b7f67440 con 0x55d7b7343400 2023-11-28T18:42:23.201 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.199+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.190:6800/3296698407,v1:172.21.15.190:6801/3296698407] -- osd_op(unknown.0.0:84 6.7 6:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b7468000 con 0x55d7b7343800 2023-11-28T18:42:23.202 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.199+0000 7fc48b1c8640 1 -- 172.21.15.45:0/2600468959 <== osd.5 v2:172.21.15.190:6800/3296698407 16 ==== osd_op_reply(84 10000000001.00000000 [omap-get-header out=274b] v0'0 uv10 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55d7b7f66b40 con 0x55d7b7343800 2023-11-28T18:42:23.202 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.199+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.190:6800/3296698407,v1:172.21.15.190:6801/3296698407] -- osd_op(unknown.0.0:85 6.7 6:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b744ca80 con 0x55d7b7343800 2023-11-28T18:42:23.203 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.199+0000 7fc48b1c8640 1 -- 172.21.15.45:0/2600468959 <== osd.5 v2:172.21.15.190:6800/3296698407 17 ==== osd_op_reply(85 10000000001.00000000 [omap-set-header] v49'11 uv11 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d7b7f66b40 con 0x55d7b7343800 2023-11-28T18:42:23.203 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.199+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.190:6800/3296698407,v1:172.21.15.190:6801/3296698407] -- osd_op(unknown.0.0:86 6.7 6:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b744c000 con 0x55d7b7343800 2023-11-28T18:42:23.204 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.199+0000 7fc48b1c8640 1 -- 172.21.15.45:0/2600468959 <== osd.5 v2:172.21.15.190:6800/3296698407 18 ==== osd_op_reply(86 10000000001.00000000 [omap-get-vals-by-keys out=542b] v0'0 uv11 ondisk = 0) v8 ==== 164+0+542 (crc 0 0 0) 0x55d7b7f66b40 con 0x55d7b7343800 2023-11-28T18:42:23.205 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.199+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.190:6800/3296698407,v1:172.21.15.190:6801/3296698407] -- osd_op(unknown.0.0:87 6.7 6:e2e07930:::10000000001.00000000:head [omap-set-vals in=504b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b744ce00 con 0x55d7b7343800 2023-11-28T18:42:23.207 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.203+0000 7fc48b1c8640 1 -- 172.21.15.45:0/2600468959 <== osd.5 v2:172.21.15.190:6800/3296698407 19 ==== osd_op_reply(87 10000000001.00000000 [omap-set-vals] v49'12 uv12 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d7b7f66b40 con 0x55d7b7343800 2023-11-28T18:42:23.207 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.203+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:88 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b744c380 con 0x55d7b7343400 2023-11-28T18:42:23.207 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.203+0000 7fc48b9c9640 1 -- 172.21.15.45:0/2600468959 <== osd.0 v2:172.21.15.45:6808/555237322 28 ==== osd_op_reply(88 10000000000.00000000 [omap-get-header out=274b] v0'0 uv22 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55d7b7f67440 con 0x55d7b7343400 2023-11-28T18:42:23.207 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.203+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:89 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b744d180 con 0x55d7b7343400 2023-11-28T18:42:23.209 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.203+0000 7fc48b9c9640 1 -- 172.21.15.45:0/2600468959 <== osd.0 v2:172.21.15.45:6808/555237322 29 ==== osd_op_reply(89 10000000000.00000000 [omap-set-header] v49'23 uv23 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d7b7f67440 con 0x55d7b7343400 2023-11-28T18:42:23.209 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.203+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:90 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b744d880 con 0x55d7b7343400 2023-11-28T18:42:23.209 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.207+0000 7fc48b9c9640 1 -- 172.21.15.45:0/2600468959 <== osd.0 v2:172.21.15.45:6808/555237322 30 ==== osd_op_reply(90 10000000000.00000000 [omap-get-vals-by-keys out=504b] v0'0 uv23 ondisk = 0) v8 ==== 164+0+504 (crc 0 0 0) 0x55d7b7f67440 con 0x55d7b7343400 2023-11-28T18:42:23.209 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.207+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:91 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=504b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b744d500 con 0x55d7b7343400 2023-11-28T18:42:23.210 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.207+0000 7fc48b9c9640 1 -- 172.21.15.45:0/2600468959 <== osd.0 v2:172.21.15.45:6808/555237322 31 ==== osd_op_reply(91 10000000000.00000000 [omap-set-vals] v49'24 uv24 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d7b7f67440 con 0x55d7b7343400 2023-11-28T18:42:23.210 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.207+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:92 6.13 6:cd5a64a3:::100.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b70afc00 con 0x55d7b7f7dc00 2023-11-28T18:42:23.211 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.207+0000 7fc48c1ca640 1 -- 172.21.15.45:0/2600468959 <== osd.3 v2:172.21.15.45:6824/78541084 26 ==== osd_op_reply(92 100.00000000 [omap-get-header out=274b] v0'0 uv4 ondisk = 0) v8 ==== 156+0+274 (crc 0 0 0) 0x55d7b7f66d80 con 0x55d7b7f7dc00 2023-11-28T18:42:23.211 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.207+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:93 6.13 6:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b7469880 con 0x55d7b7f7dc00 2023-11-28T18:42:23.212 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.207+0000 7fc48c1ca640 1 -- 172.21.15.45:0/2600468959 <== osd.3 v2:172.21.15.45:6824/78541084 27 ==== osd_op_reply(93 100.00000000 [omap-set-header] v49'5 uv5 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55d7b7f66d80 con 0x55d7b7f7dc00 2023-11-28T18:42:23.213 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.207+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:94 6.13 6:cd5a64a3:::100.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b7469c00 con 0x55d7b7f7dc00 2023-11-28T18:42:23.213 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.207+0000 7fc48c1ca640 1 -- 172.21.15.45:0/2600468959 <== osd.3 v2:172.21.15.45:6824/78541084 28 ==== osd_op_reply(94 100.00000000 [omap-get-vals-by-keys out=507b] v0'0 uv5 ondisk = 0) v8 ==== 156+0+507 (crc 0 0 0) 0x55d7b7f66d80 con 0x55d7b7f7dc00 2023-11-28T18:42:23.213 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.207+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:95 6.13 6:cd5a64a3:::100.00000000:head [omap-set-vals in=507b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b7468a80 con 0x55d7b7f7dc00 2023-11-28T18:42:23.215 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.211+0000 7fc48c1ca640 1 -- 172.21.15.45:0/2600468959 <== osd.3 v2:172.21.15.45:6824/78541084 29 ==== osd_op_reply(95 100.00000000 [omap-set-vals] v49'6 uv6 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55d7b7f66d80 con 0x55d7b7f7dc00 2023-11-28T18:42:23.215 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.211+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:96 6.10 6:0bd6d154:::602.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b7469180 con 0x55d7b7343400 2023-11-28T18:42:23.215 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.211+0000 7fc48b9c9640 1 -- 172.21.15.45:0/2600468959 <== osd.0 v2:172.21.15.45:6808/555237322 32 ==== osd_op_reply(96 602.00000000 [omap-get-header out=274b] v0'0 uv20 ondisk = 0) v8 ==== 156+0+274 (crc 0 0 0) 0x55d7b7f67440 con 0x55d7b7343400 2023-11-28T18:42:23.215 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.211+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:97 6.10 6:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b7469500 con 0x55d7b7343400 2023-11-28T18:42:23.216 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.211+0000 7fc48b9c9640 1 -- 172.21.15.45:0/2600468959 <== osd.0 v2:172.21.15.45:6808/555237322 33 ==== osd_op_reply(97 602.00000000 [omap-set-header] v49'25 uv25 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55d7b7f67440 con 0x55d7b7343400 2023-11-28T18:42:23.216 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.211+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:98 6.10 6:0bd6d154:::602.00000000:head [omap-get-vals-by-keys in=24b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b7468e00 con 0x55d7b7343400 2023-11-28T18:42:23.216 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.211+0000 7fc48b9c9640 1 -- 172.21.15.45:0/2600468959 <== osd.0 v2:172.21.15.45:6808/555237322 34 ==== osd_op_reply(98 602.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv25 ondisk = 0) v8 ==== 156+0+4 (crc 0 0 0) 0x55d7b7f67440 con 0x55d7b7343400 2023-11-28T18:42:23.216 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.211+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:99 6.10 6:0bd6d154:::602.00000000:head [omap-set-vals in=529b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b7468380 con 0x55d7b7343400 2023-11-28T18:42:23.219 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.215+0000 7fc48b9c9640 1 -- 172.21.15.45:0/2600468959 <== osd.0 v2:172.21.15.45:6808/555237322 35 ==== osd_op_reply(99 602.00000000 [omap-set-vals] v49'26 uv26 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55d7b7f67440 con 0x55d7b7343400 2023-11-28T18:42:23.219 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.215+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.190:6800/3296698407,v1:172.21.15.190:6801/3296698407] -- osd_op(unknown.0.0:100 6.7 6:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b7469180 con 0x55d7b7343800 2023-11-28T18:42:23.219 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.215+0000 7fc48b1c8640 1 -- 172.21.15.45:0/2600468959 <== osd.5 v2:172.21.15.190:6800/3296698407 20 ==== osd_op_reply(100 10000000001.00000000 [omap-get-header out=274b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55d7b7f66b40 con 0x55d7b7343800 2023-11-28T18:42:23.219 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.215+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.190:6800/3296698407,v1:172.21.15.190:6801/3296698407] -- osd_op(unknown.0.0:101 6.7 6:e2e07930:::10000000001.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b7469500 con 0x55d7b7343800 2023-11-28T18:42:23.221 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.215+0000 7fc48b1c8640 1 -- 172.21.15.45:0/2600468959 <== osd.5 v2:172.21.15.190:6800/3296698407 21 ==== osd_op_reply(101 10000000001.00000000 [omap-set-header] v49'13 uv13 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d7b7f66b40 con 0x55d7b7343800 2023-11-28T18:42:23.221 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.215+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.190:6800/3296698407,v1:172.21.15.190:6801/3296698407] -- osd_op(unknown.0.0:102 6.7 6:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b7468e00 con 0x55d7b7343800 2023-11-28T18:42:23.221 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.219+0000 7fc48b1c8640 1 -- 172.21.15.45:0/2600468959 <== osd.5 v2:172.21.15.190:6800/3296698407 22 ==== osd_op_reply(102 10000000001.00000000 [omap-get-vals-by-keys out=504b] v0'0 uv13 ondisk = 0) v8 ==== 164+0+504 (crc 0 0 0) 0x55d7b7f66b40 con 0x55d7b7343800 2023-11-28T18:42:23.221 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.219+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.190:6800/3296698407,v1:172.21.15.190:6801/3296698407] -- osd_op(unknown.0.0:103 6.7 6:e2e07930:::10000000001.00000000:head [omap-rm-keys in=16b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b7468380 con 0x55d7b7343800 2023-11-28T18:42:23.222 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.219+0000 7fc48b1c8640 1 -- 172.21.15.45:0/2600468959 <== osd.5 v2:172.21.15.190:6800/3296698407 23 ==== osd_op_reply(103 10000000001.00000000 [omap-rm-keys] v49'14 uv14 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d7b7f66b40 con 0x55d7b7343800 2023-11-28T18:42:23.222 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.219+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:104 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b744c380 con 0x55d7b7f7dc00 2023-11-28T18:42:23.223 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.219+0000 7fc48c1ca640 1 -- 172.21.15.45:0/2600468959 <== osd.3 v2:172.21.15.45:6824/78541084 30 ==== osd_op_reply(104 1.00000000 [omap-get-header out=274b] v0'0 uv13 ondisk = 0) v8 ==== 154+0+274 (crc 0 0 0) 0x55d7b7f66d80 con 0x55d7b7f7dc00 2023-11-28T18:42:23.223 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.219+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:105 6.1f 6:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b744d180 con 0x55d7b7f7dc00 2023-11-28T18:42:23.224 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.219+0000 7fc48c1ca640 1 -- 172.21.15.45:0/2600468959 <== osd.3 v2:172.21.15.45:6824/78541084 31 ==== osd_op_reply(105 1.00000000 [omap-set-header] v49'14 uv14 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x55d7b7f66d80 con 0x55d7b7f7dc00 2023-11-28T18:42:23.224 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.219+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:106 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=21b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b744d880 con 0x55d7b7f7dc00 2023-11-28T18:42:23.224 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.219+0000 7fc48c1ca640 1 -- 172.21.15.45:0/2600468959 <== osd.3 v2:172.21.15.45:6824/78541084 32 ==== osd_op_reply(106 1.00000000 [omap-get-vals-by-keys out=509b] v0'0 uv14 ondisk = 0) v8 ==== 154+0+509 (crc 0 0 0) 0x55d7b7f66d80 con 0x55d7b7f7dc00 2023-11-28T18:42:23.224 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.219+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:107 6.1f 6:ff5b34d6:::1.00000000:head [omap-set-vals in=509b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b744d500 con 0x55d7b7f7dc00 2023-11-28T18:42:23.226 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.223+0000 7fc48c1ca640 1 -- 172.21.15.45:0/2600468959 <== osd.3 v2:172.21.15.45:6824/78541084 33 ==== osd_op_reply(107 1.00000000 [omap-set-vals] v49'15 uv15 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x55d7b7f66d80 con 0x55d7b7f7dc00 2023-11-28T18:42:23.226 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.223+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:108 6.13 6:cd5a64a3:::100.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b7468700 con 0x55d7b7f7dc00 2023-11-28T18:42:23.226 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.223+0000 7fc48c1ca640 1 -- 172.21.15.45:0/2600468959 <== osd.3 v2:172.21.15.45:6824/78541084 34 ==== osd_op_reply(108 100.00000000 [omap-get-header out=274b] v0'0 uv6 ondisk = 0) v8 ==== 156+0+274 (crc 0 0 0) 0x55d7b7f66d80 con 0x55d7b7f7dc00 2023-11-28T18:42:23.226 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.223+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:109 6.13 6:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b7469880 con 0x55d7b7f7dc00 2023-11-28T18:42:23.227 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.223+0000 7fc48c1ca640 1 -- 172.21.15.45:0/2600468959 <== osd.3 v2:172.21.15.45:6824/78541084 35 ==== osd_op_reply(109 100.00000000 [omap-set-header] v49'7 uv7 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55d7b7f66d80 con 0x55d7b7f7dc00 2023-11-28T18:42:23.227 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.223+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:110 6.13 6:cd5a64a3:::100.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b7469c00 con 0x55d7b7f7dc00 2023-11-28T18:42:23.227 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.223+0000 7fc48c1ca640 1 -- 172.21.15.45:0/2600468959 <== osd.3 v2:172.21.15.45:6824/78541084 36 ==== osd_op_reply(110 100.00000000 [omap-get-vals-by-keys out=507b] v0'0 uv7 ondisk = 0) v8 ==== 156+0+507 (crc 0 0 0) 0x55d7b7f66d80 con 0x55d7b7f7dc00 2023-11-28T18:42:23.228 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.223+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:111 6.13 6:cd5a64a3:::100.00000000:head [omap-set-vals in=507b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b7468a80 con 0x55d7b7f7dc00 2023-11-28T18:42:23.229 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.223+0000 7fc48c1ca640 1 -- 172.21.15.45:0/2600468959 <== osd.3 v2:172.21.15.45:6824/78541084 37 ==== osd_op_reply(111 100.00000000 [omap-set-vals] v49'8 uv8 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55d7b7f66d80 con 0x55d7b7f7dc00 2023-11-28T18:42:23.229 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.223+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:112 6.10 6:0bd6d154:::602.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b7468000 con 0x55d7b7343400 2023-11-28T18:42:23.229 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.227+0000 7fc48b9c9640 1 -- 172.21.15.45:0/2600468959 <== osd.0 v2:172.21.15.45:6808/555237322 36 ==== osd_op_reply(112 602.00000000 [omap-get-header out=274b] v0'0 uv26 ondisk = 0) v8 ==== 156+0+274 (crc 0 0 0) 0x55d7b7f67440 con 0x55d7b7343400 2023-11-28T18:42:23.229 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.227+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:113 6.10 6:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b7469180 con 0x55d7b7343400 2023-11-28T18:42:23.231 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.227+0000 7fc48b9c9640 1 -- 172.21.15.45:0/2600468959 <== osd.0 v2:172.21.15.45:6808/555237322 37 ==== osd_op_reply(113 602.00000000 [omap-set-header] v49'27 uv27 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55d7b7f67440 con 0x55d7b7343400 2023-11-28T18:42:23.231 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.227+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:114 6.10 6:0bd6d154:::602.00000000:head [omap-get-vals-by-keys in=24b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b7469500 con 0x55d7b7343400 2023-11-28T18:42:23.231 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.227+0000 7fc48b9c9640 1 -- 172.21.15.45:0/2600468959 <== osd.0 v2:172.21.15.45:6808/555237322 38 ==== osd_op_reply(114 602.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv27 ondisk = 0) v8 ==== 156+0+4 (crc 0 0 0) 0x55d7b7f67440 con 0x55d7b7343400 2023-11-28T18:42:23.231 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.227+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:115 6.10 6:0bd6d154:::602.00000000:head [omap-set-vals in=525b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b7468e00 con 0x55d7b7343400 2023-11-28T18:42:23.233 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.227+0000 7fc48b9c9640 1 -- 172.21.15.45:0/2600468959 <== osd.0 v2:172.21.15.45:6808/555237322 39 ==== osd_op_reply(115 602.00000000 [omap-set-vals] v49'28 uv28 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55d7b7f67440 con 0x55d7b7343400 2023-11-28T18:42:23.233 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.227+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:116 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b744c700 con 0x55d7b7343400 2023-11-28T18:42:23.233 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.227+0000 7fc48b9c9640 1 -- 172.21.15.45:0/2600468959 <== osd.0 v2:172.21.15.45:6808/555237322 40 ==== osd_op_reply(116 10000000000.00000000 [omap-get-header out=274b] v0'0 uv24 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55d7b7f67440 con 0x55d7b7343400 2023-11-28T18:42:23.233 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.227+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:117 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b744dc00 con 0x55d7b7343400 2023-11-28T18:42:23.234 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.231+0000 7fc48b9c9640 1 -- 172.21.15.45:0/2600468959 <== osd.0 v2:172.21.15.45:6808/555237322 41 ==== osd_op_reply(117 10000000000.00000000 [omap-set-header] v49'29 uv29 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d7b7f67440 con 0x55d7b7343400 2023-11-28T18:42:23.234 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.231+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:118 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b744c380 con 0x55d7b7343400 2023-11-28T18:42:23.235 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.231+0000 7fc48b9c9640 1 -- 172.21.15.45:0/2600468959 <== osd.0 v2:172.21.15.45:6808/555237322 42 ==== osd_op_reply(118 10000000000.00000000 [omap-get-vals-by-keys out=504b] v0'0 uv29 ondisk = 0) v8 ==== 164+0+504 (crc 0 0 0) 0x55d7b7f67440 con 0x55d7b7343400 2023-11-28T18:42:23.235 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.231+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:119 6.10 6:0cf6ad0f:::10000000000.00000000:head [omap-rm-keys in=16b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b744ca80 con 0x55d7b7343400 2023-11-28T18:42:23.236 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.231+0000 7fc48b9c9640 1 -- 172.21.15.45:0/2600468959 <== osd.0 v2:172.21.15.45:6808/555237322 43 ==== osd_op_reply(119 10000000000.00000000 [omap-rm-keys] v49'30 uv30 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d7b7f67440 con 0x55d7b7343400 2023-11-28T18:42:23.236 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.231+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:120 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b744c000 con 0x55d7b7f7dc00 2023-11-28T18:42:23.236 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.231+0000 7fc48c1ca640 1 -- 172.21.15.45:0/2600468959 <== osd.3 v2:172.21.15.45:6824/78541084 38 ==== osd_op_reply(120 1.00000000 [omap-get-header out=274b] v0'0 uv15 ondisk = 0) v8 ==== 154+0+274 (crc 0 0 0) 0x55d7b7f66d80 con 0x55d7b7f7dc00 2023-11-28T18:42:23.236 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.231+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:121 6.1f 6:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b744ce00 con 0x55d7b7f7dc00 2023-11-28T18:42:23.238 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.235+0000 7fc48c1ca640 1 -- 172.21.15.45:0/2600468959 <== osd.3 v2:172.21.15.45:6824/78541084 39 ==== osd_op_reply(121 1.00000000 [omap-set-header] v49'16 uv16 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x55d7b7f66d80 con 0x55d7b7f7dc00 2023-11-28T18:42:23.238 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.235+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:122 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=21b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b70afc00 con 0x55d7b7f7dc00 2023-11-28T18:42:23.238 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.235+0000 7fc48c1ca640 1 -- 172.21.15.45:0/2600468959 <== osd.3 v2:172.21.15.45:6824/78541084 40 ==== osd_op_reply(122 1.00000000 [omap-get-vals-by-keys out=509b] v0'0 uv16 ondisk = 0) v8 ==== 154+0+509 (crc 0 0 0) 0x55d7b7f66d80 con 0x55d7b7f7dc00 2023-11-28T18:42:23.238 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.235+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:123 6.1f 6:ff5b34d6:::1.00000000:head [omap-rm-keys in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b70af880 con 0x55d7b7f7dc00 2023-11-28T18:42:23.239 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.235+0000 7fc48c1ca640 1 -- 172.21.15.45:0/2600468959 <== osd.3 v2:172.21.15.45:6824/78541084 41 ==== osd_op_reply(123 1.00000000 [omap-rm-keys] v49'17 uv17 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x55d7b7f66d80 con 0x55d7b7f7dc00 2023-11-28T18:42:23.239 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.235+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:124 6.13 6:cd5a64a3:::100.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b744d180 con 0x55d7b7f7dc00 2023-11-28T18:42:23.239 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.235+0000 7fc48c1ca640 1 -- 172.21.15.45:0/2600468959 <== osd.3 v2:172.21.15.45:6824/78541084 42 ==== osd_op_reply(124 100.00000000 [omap-get-header out=274b] v0'0 uv8 ondisk = 0) v8 ==== 156+0+274 (crc 0 0 0) 0x55d7b7f66d80 con 0x55d7b7f7dc00 2023-11-28T18:42:23.240 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.235+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:125 6.13 6:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b744d880 con 0x55d7b7f7dc00 2023-11-28T18:42:23.241 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.239+0000 7fc48c1ca640 1 -- 172.21.15.45:0/2600468959 <== osd.3 v2:172.21.15.45:6824/78541084 43 ==== osd_op_reply(125 100.00000000 [omap-set-header] v49'9 uv9 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55d7b7f66d80 con 0x55d7b7f7dc00 2023-11-28T18:42:23.241 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.239+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:126 6.13 6:cd5a64a3:::100.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b744d500 con 0x55d7b7f7dc00 2023-11-28T18:42:23.241 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.239+0000 7fc48c1ca640 1 -- 172.21.15.45:0/2600468959 <== osd.3 v2:172.21.15.45:6824/78541084 44 ==== osd_op_reply(126 100.00000000 [omap-get-vals-by-keys out=507b] v0'0 uv9 ondisk = 0) v8 ==== 156+0+507 (crc 0 0 0) 0x55d7b7f66d80 con 0x55d7b7f7dc00 2023-11-28T18:42:23.241 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.239+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:127 6.13 6:cd5a64a3:::100.00000000:head [omap-set-vals in=507b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b744c000 con 0x55d7b7f7dc00 2023-11-28T18:42:23.246 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.239+0000 7fc48c1ca640 1 -- 172.21.15.45:0/2600468959 <== osd.3 v2:172.21.15.45:6824/78541084 45 ==== osd_op_reply(127 100.00000000 [omap-set-vals] v49'10 uv10 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55d7b7f66d80 con 0x55d7b7f7dc00 2023-11-28T18:42:23.246 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.239+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:128 6.10 6:0bd6d154:::602.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b744ce00 con 0x55d7b7343400 2023-11-28T18:42:23.246 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.239+0000 7fc48b9c9640 1 -- 172.21.15.45:0/2600468959 <== osd.0 v2:172.21.15.45:6808/555237322 44 ==== osd_op_reply(128 602.00000000 [omap-get-header out=274b] v0'0 uv28 ondisk = 0) v8 ==== 156+0+274 (crc 0 0 0) 0x55d7b7f67440 con 0x55d7b7343400 2023-11-28T18:42:23.246 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.239+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:129 6.10 6:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b7468700 con 0x55d7b7343400 2023-11-28T18:42:23.246 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.239+0000 7fc48b9c9640 1 -- 172.21.15.45:0/2600468959 <== osd.0 v2:172.21.15.45:6808/555237322 45 ==== osd_op_reply(129 602.00000000 [omap-set-header] v49'31 uv31 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55d7b7f67440 con 0x55d7b7343400 2023-11-28T18:42:23.246 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.239+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:130 6.10 6:0bd6d154:::602.00000000:head [omap-get-vals-by-keys in=24b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b7469880 con 0x55d7b7343400 2023-11-28T18:42:23.246 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.239+0000 7fc48b9c9640 1 -- 172.21.15.45:0/2600468959 <== osd.0 v2:172.21.15.45:6808/555237322 46 ==== osd_op_reply(130 602.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv31 ondisk = 0) v8 ==== 156+0+4 (crc 0 0 0) 0x55d7b7f67440 con 0x55d7b7343400 2023-11-28T18:42:23.246 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.239+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:131 6.10 6:0bd6d154:::602.00000000:head [omap-set-vals in=521b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b7469c00 con 0x55d7b7343400 2023-11-28T18:42:23.247 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.243+0000 7fc48b9c9640 1 -- 172.21.15.45:0/2600468959 <== osd.0 v2:172.21.15.45:6808/555237322 47 ==== osd_op_reply(131 602.00000000 [omap-set-vals] v49'32 uv32 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55d7b7f67440 con 0x55d7b7343400 2023-11-28T18:42:23.247 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.243+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:132 6.14 6:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b7468a80 con 0x55d7b7f7d800 2023-11-28T18:42:23.247 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.243+0000 7fc48b1c8640 1 -- 172.21.15.45:0/2600468959 <== osd.2 v2:172.21.15.45:6816/193884539 14 ==== osd_op_reply(132 1.00000000.inode [read 0~582 out=582b] v0'0 uv39 ondisk = 0) v8 ==== 160+0+582 (crc 0 0 0) 0x55d7b7f66b40 con 0x55d7b7f7d800 2023-11-28T18:42:23.247 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.243+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:133 6.14 6:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b744c700 con 0x55d7b7f7d800 2023-11-28T18:42:23.248 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.243+0000 7fc48b1c8640 1 -- 172.21.15.45:0/2600468959 <== osd.2 v2:172.21.15.45:6816/193884539 15 ==== osd_op_reply(133 1.00000000.inode [writefull 0~582] v49'40 uv40 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x55d7b7f66b40 con 0x55d7b7f7d800 2023-11-28T18:42:23.248 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.243+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:134 6.10 6:0bd6d154:::602.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b744dc00 con 0x55d7b7343400 2023-11-28T18:42:23.248 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.243+0000 7fc48b9c9640 1 -- 172.21.15.45:0/2600468959 <== osd.0 v2:172.21.15.45:6808/555237322 48 ==== osd_op_reply(134 602.00000000 [omap-get-header out=274b] v0'0 uv32 ondisk = 0) v8 ==== 156+0+274 (crc 0 0 0) 0x55d7b7f67440 con 0x55d7b7343400 2023-11-28T18:42:23.248 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.243+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:135 6.10 6:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b744c380 con 0x55d7b7343400 2023-11-28T18:42:23.250 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.247+0000 7fc48b9c9640 1 -- 172.21.15.45:0/2600468959 <== osd.0 v2:172.21.15.45:6808/555237322 49 ==== osd_op_reply(135 602.00000000 [omap-set-header] v49'33 uv33 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55d7b7f67440 con 0x55d7b7343400 2023-11-28T18:42:23.250 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.247+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:136 6.10 6:0bd6d154:::602.00000000:head [omap-get-vals-by-keys in=24b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b744ca80 con 0x55d7b7343400 2023-11-28T18:42:23.250 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.247+0000 7fc48b9c9640 1 -- 172.21.15.45:0/2600468959 <== osd.0 v2:172.21.15.45:6808/555237322 50 ==== osd_op_reply(136 602.00000000 [omap-get-vals-by-keys out=529b] v0'0 uv33 ondisk = 0) v8 ==== 156+0+529 (crc 0 0 0) 0x55d7b7f67440 con 0x55d7b7343400 2023-11-28T18:42:23.250 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.247+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:137 6.10 6:0bd6d154:::602.00000000:head [omap-rm-keys in=24b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b744ce00 con 0x55d7b7343400 2023-11-28T18:42:23.252 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.247+0000 7fc48b9c9640 1 -- 172.21.15.45:0/2600468959 <== osd.0 v2:172.21.15.45:6808/555237322 51 ==== osd_op_reply(137 602.00000000 [omap-rm-keys] v49'34 uv34 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55d7b7f67440 con 0x55d7b7343400 2023-11-28T18:42:23.252 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.247+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:138 6.10 6:0bd6d154:::602.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b7468000 con 0x55d7b7343400 2023-11-28T18:42:23.252 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.247+0000 7fc48b9c9640 1 -- 172.21.15.45:0/2600468959 <== osd.0 v2:172.21.15.45:6808/555237322 52 ==== osd_op_reply(138 602.00000000 [omap-get-header out=274b] v0'0 uv34 ondisk = 0) v8 ==== 156+0+274 (crc 0 0 0) 0x55d7b7f67440 con 0x55d7b7343400 2023-11-28T18:42:23.252 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.247+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:139 6.10 6:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b7469180 con 0x55d7b7343400 2023-11-28T18:42:23.253 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.251+0000 7fc48b9c9640 1 -- 172.21.15.45:0/2600468959 <== osd.0 v2:172.21.15.45:6808/555237322 53 ==== osd_op_reply(139 602.00000000 [omap-set-header] v49'35 uv35 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55d7b7f67440 con 0x55d7b7343400 2023-11-28T18:42:23.253 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.251+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:140 6.10 6:0bd6d154:::602.00000000:head [omap-get-vals-by-keys in=24b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b7469500 con 0x55d7b7343400 2023-11-28T18:42:23.254 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.251+0000 7fc48b9c9640 1 -- 172.21.15.45:0/2600468959 <== osd.0 v2:172.21.15.45:6808/555237322 54 ==== osd_op_reply(140 602.00000000 [omap-get-vals-by-keys out=529b] v0'0 uv35 ondisk = 0) v8 ==== 156+0+529 (crc 0 0 0) 0x55d7b7f67440 con 0x55d7b7343400 2023-11-28T18:42:23.254 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.251+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:141 6.10 6:0bd6d154:::602.00000000:head [omap-rm-keys in=24b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b7468e00 con 0x55d7b7343400 2023-11-28T18:42:23.255 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.251+0000 7fc48b9c9640 1 -- 172.21.15.45:0/2600468959 <== osd.0 v2:172.21.15.45:6808/555237322 55 ==== osd_op_reply(141 602.00000000 [omap-rm-keys] v49'36 uv36 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55d7b7f67440 con 0x55d7b7343400 2023-11-28T18:42:23.255 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.251+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:142 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b7468700 con 0x55d7b7f7dc00 2023-11-28T18:42:23.256 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.251+0000 7fc48c1ca640 1 -- 172.21.15.45:0/2600468959 <== osd.3 v2:172.21.15.45:6824/78541084 46 ==== osd_op_reply(142 1.00000000 [omap-get-header out=274b] v0'0 uv17 ondisk = 0) v8 ==== 154+0+274 (crc 0 0 0) 0x55d7b7f66d80 con 0x55d7b7f7dc00 2023-11-28T18:42:23.256 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.251+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:143 6.1f 6:ff5b34d6:::1.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b7469880 con 0x55d7b7f7dc00 2023-11-28T18:42:23.257 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.251+0000 7fc48c1ca640 1 -- 172.21.15.45:0/2600468959 <== osd.3 v2:172.21.15.45:6824/78541084 47 ==== osd_op_reply(143 1.00000000 [omap-set-header] v49'18 uv18 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x55d7b7f66d80 con 0x55d7b7f7dc00 2023-11-28T18:42:23.257 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.251+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:144 6.1f 6:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=4b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b7469c00 con 0x55d7b7f7dc00 2023-11-28T18:42:23.257 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.255+0000 7fc48c1ca640 1 -- 172.21.15.45:0/2600468959 <== osd.3 v2:172.21.15.45:6824/78541084 48 ==== osd_op_reply(144 1.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv18 ondisk = 0) v8 ==== 154+0+4 (crc 0 0 0) 0x55d7b7f66d80 con 0x55d7b7f7dc00 2023-11-28T18:42:23.257 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.255+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:145 6.14 6:287034c4:::1.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b7468000 con 0x55d7b7f7d800 2023-11-28T18:42:23.258 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.255+0000 7fc48b1c8640 1 -- 172.21.15.45:0/2600468959 <== osd.2 v2:172.21.15.45:6816/193884539 16 ==== osd_op_reply(145 1.00000000.inode [read 0~582 out=582b] v0'0 uv40 ondisk = 0) v8 ==== 160+0+582 (crc 0 0 0) 0x55d7b7f66b40 con 0x55d7b7f7d800 2023-11-28T18:42:23.258 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.255+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:146 6.14 6:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b7469180 con 0x55d7b7f7d800 2023-11-28T18:42:23.259 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.255+0000 7fc48b1c8640 1 -- 172.21.15.45:0/2600468959 <== osd.2 v2:172.21.15.45:6816/193884539 17 ==== osd_op_reply(146 1.00000000.inode [writefull 0~582] v49'41 uv41 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x55d7b7f66b40 con 0x55d7b7f7d800 2023-11-28T18:42:23.259 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.255+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:147 6.10 6:0bd6d154:::602.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b7469500 con 0x55d7b7343400 2023-11-28T18:42:23.259 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.255+0000 7fc48b9c9640 1 -- 172.21.15.45:0/2600468959 <== osd.0 v2:172.21.15.45:6808/555237322 56 ==== osd_op_reply(147 602.00000000 [omap-get-header out=274b] v0'0 uv36 ondisk = 0) v8 ==== 156+0+274 (crc 0 0 0) 0x55d7b7f67440 con 0x55d7b7343400 2023-11-28T18:42:23.260 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.255+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:148 6.10 6:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b744dc00 con 0x55d7b7343400 2023-11-28T18:42:23.261 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.255+0000 7fc48b9c9640 1 -- 172.21.15.45:0/2600468959 <== osd.0 v2:172.21.15.45:6808/555237322 57 ==== osd_op_reply(148 602.00000000 [omap-set-header] v49'37 uv37 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55d7b7f67440 con 0x55d7b7343400 2023-11-28T18:42:23.261 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.255+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:149 6.10 6:0bd6d154:::602.00000000:head [omap-get-vals-by-keys in=24b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b744c380 con 0x55d7b7343400 2023-11-28T18:42:23.261 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.259+0000 7fc48b9c9640 1 -- 172.21.15.45:0/2600468959 <== osd.0 v2:172.21.15.45:6808/555237322 58 ==== osd_op_reply(149 602.00000000 [omap-get-vals-by-keys out=525b] v0'0 uv37 ondisk = 0) v8 ==== 156+0+525 (crc 0 0 0) 0x55d7b7f67440 con 0x55d7b7343400 2023-11-28T18:42:23.261 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.259+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:150 6.10 6:0bd6d154:::602.00000000:head [omap-rm-keys in=24b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b744ca80 con 0x55d7b7343400 2023-11-28T18:42:23.263 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.259+0000 7fc48b9c9640 1 -- 172.21.15.45:0/2600468959 <== osd.0 v2:172.21.15.45:6808/555237322 59 ==== osd_op_reply(150 602.00000000 [omap-rm-keys] v49'38 uv38 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55d7b7f67440 con 0x55d7b7343400 2023-11-28T18:42:23.263 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.259+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:151 6.10 6:0bd6d154:::602.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b744ce00 con 0x55d7b7343400 2023-11-28T18:42:23.263 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.259+0000 7fc48b9c9640 1 -- 172.21.15.45:0/2600468959 <== osd.0 v2:172.21.15.45:6808/555237322 60 ==== osd_op_reply(151 602.00000000 [omap-get-header out=274b] v0'0 uv38 ondisk = 0) v8 ==== 156+0+274 (crc 0 0 0) 0x55d7b7f67440 con 0x55d7b7343400 2023-11-28T18:42:23.263 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.259+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:152 6.10 6:0bd6d154:::602.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b74a4000 con 0x55d7b7343400 2023-11-28T18:42:23.264 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.259+0000 7fc48b9c9640 1 -- 172.21.15.45:0/2600468959 <== osd.0 v2:172.21.15.45:6808/555237322 61 ==== osd_op_reply(152 602.00000000 [omap-set-header] v49'39 uv39 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55d7b7f67440 con 0x55d7b7343400 2023-11-28T18:42:23.264 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.259+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:153 6.10 6:0bd6d154:::602.00000000:head [omap-get-vals-by-keys in=24b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b74a4380 con 0x55d7b7343400 2023-11-28T18:42:23.264 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.259+0000 7fc48b9c9640 1 -- 172.21.15.45:0/2600468959 <== osd.0 v2:172.21.15.45:6808/555237322 62 ==== osd_op_reply(153 602.00000000 [omap-get-vals-by-keys out=521b] v0'0 uv39 ondisk = 0) v8 ==== 156+0+521 (crc 0 0 0) 0x55d7b7f67440 con 0x55d7b7343400 2023-11-28T18:42:23.264 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.259+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] -- osd_op(unknown.0.0:154 6.10 6:0bd6d154:::602.00000000:head [omap-rm-keys in=24b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b74a4700 con 0x55d7b7343400 2023-11-28T18:42:23.266 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.263+0000 7fc48b9c9640 1 -- 172.21.15.45:0/2600468959 <== osd.0 v2:172.21.15.45:6808/555237322 63 ==== osd_op_reply(154 602.00000000 [omap-rm-keys] v49'40 uv40 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55d7b7f67440 con 0x55d7b7343400 2023-11-28T18:42:23.266 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.263+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:155 6.13 6:cd5a64a3:::100.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b74a4a80 con 0x55d7b7f7dc00 2023-11-28T18:42:23.266 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.263+0000 7fc48c1ca640 1 -- 172.21.15.45:0/2600468959 <== osd.3 v2:172.21.15.45:6824/78541084 49 ==== osd_op_reply(155 100.00000000 [omap-get-header out=274b] v0'0 uv10 ondisk = 0) v8 ==== 156+0+274 (crc 0 0 0) 0x55d7b7f66d80 con 0x55d7b7f7dc00 2023-11-28T18:42:23.267 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.263+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:156 6.13 6:cd5a64a3:::100.00000000:head [omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b74a4e00 con 0x55d7b7f7dc00 2023-11-28T18:42:23.267 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.263+0000 7fc48c1ca640 1 -- 172.21.15.45:0/2600468959 <== osd.3 v2:172.21.15.45:6824/78541084 50 ==== osd_op_reply(156 100.00000000 [omap-set-header] v49'11 uv11 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55d7b7f66d80 con 0x55d7b7f7dc00 2023-11-28T18:42:23.268 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.263+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:157 6.13 6:cd5a64a3:::100.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b74a5180 con 0x55d7b7f7dc00 2023-11-28T18:42:23.268 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.263+0000 7fc48c1ca640 1 -- 172.21.15.45:0/2600468959 <== osd.3 v2:172.21.15.45:6824/78541084 51 ==== osd_op_reply(157 100.00000000 [omap-get-vals-by-keys out=507b] v0'0 uv11 ondisk = 0) v8 ==== 156+0+507 (crc 0 0 0) 0x55d7b7f66d80 con 0x55d7b7f7dc00 2023-11-28T18:42:23.268 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.263+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:158 6.13 6:cd5a64a3:::100.00000000:head [omap-set-vals in=507b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b74a5500 con 0x55d7b7f7dc00 2023-11-28T18:42:23.269 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.267+0000 7fc48c1ca640 1 -- 172.21.15.45:0/2600468959 <== osd.3 v2:172.21.15.45:6824/78541084 52 ==== osd_op_reply(158 100.00000000 [omap-set-vals] v49'12 uv12 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55d7b7f66d80 con 0x55d7b7f7dc00 2023-11-28T18:42:23.269 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.267+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:159 6.1f 6:fe07bba1:::100.00000000.inode:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b74a5880 con 0x55d7b7f7dc00 2023-11-28T18:42:23.269 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.267+0000 7fc48c1ca640 1 -- 172.21.15.45:0/2600468959 <== osd.3 v2:172.21.15.45:6824/78541084 53 ==== osd_op_reply(159 100.00000000.inode [read 0~582 out=582b] v0'0 uv3 ondisk = 0) v8 ==== 162+0+582 (crc 0 0 0) 0x55d7b7f66d80 con 0x55d7b7f7dc00 2023-11-28T18:42:23.270 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.267+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:160 6.1f 6:fe07bba1:::100.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b74a5c00 con 0x55d7b7f7dc00 2023-11-28T18:42:23.271 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.267+0000 7fc48c1ca640 1 -- 172.21.15.45:0/2600468959 <== osd.3 v2:172.21.15.45:6824/78541084 54 ==== osd_op_reply(160 100.00000000.inode [writefull 0~582] v49'19 uv19 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x55d7b7f66d80 con 0x55d7b7f7dc00 2023-11-28T18:42:23.271 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.267+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:161 6.13 6:c91d4a1d:::mds0_inotable:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b74a4a80 con 0x55d7b7f7dc00 2023-11-28T18:42:23.272 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.267+0000 7fc48c1ca640 1 -- 172.21.15.45:0/2600468959 <== osd.3 v2:172.21.15.45:6824/78541084 55 ==== osd_op_reply(161 mds0_inotable [read 0~34 out=34b] v0'0 uv2 ondisk = 0) v8 ==== 157+0+34 (crc 0 0 0) 0x55d7b7f66d80 con 0x55d7b7f7dc00 2023-11-28T18:42:23.272 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.267+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:162 6.13 6:c91d4a1d:::mds0_inotable:head [writefull 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55d7b7468700 con 0x55d7b7f7dc00 2023-11-28T18:42:23.273 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.267+0000 7fc48c1ca640 1 -- 172.21.15.45:0/2600468959 <== osd.3 v2:172.21.15.45:6824/78541084 56 ==== osd_op_reply(162 mds0_inotable [writefull 0~34] v49'13 uv13 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x55d7b7f66d80 con 0x55d7b7f7dc00 2023-11-28T18:42:23.273 INFO:tasks.workunit.client.0.smithi045.stdout:Events by type: 2023-11-28T18:42:23.273 INFO:tasks.workunit.client.0.smithi045.stdout: LID: 1 2023-11-28T18:42:23.274 INFO:tasks.workunit.client.0.smithi045.stdout: PURGED: 1 2023-11-28T18:42:23.274 INFO:tasks.workunit.client.0.smithi045.stdout: SESSION: 2 2023-11-28T18:42:23.274 INFO:tasks.workunit.client.0.smithi045.stdout: SUBTREEMAP: 1 2023-11-28T18:42:23.274 INFO:tasks.workunit.client.0.smithi045.stdout: UPDATE: 17 2023-11-28T18:42:23.274 INFO:tasks.workunit.client.0.smithi045.stdout:Errors: 0 2023-11-28T18:42:23.276 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.267+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 >> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] conn(0x55d7b7343400 msgr2=0x55d7b70c5600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:23.276 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.267+0000 7fc48d20a280 1 --2- 172.21.15.45:0/2600468959 >> [v2:172.21.15.45:6808/555237322,v1:172.21.15.45:6809/555237322] conn(0x55d7b7343400 0x55d7b70c5600 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.276 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.267+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x55d7b7f7d800 msgr2=0x55d7b70c6100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:23.276 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.267+0000 7fc48d20a280 1 --2- 172.21.15.45:0/2600468959 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x55d7b7f7d800 0x55d7b70c6100 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.276 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.267+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x55d7b7f7dc00 msgr2=0x55d7b70c5b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:23.276 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.267+0000 7fc48d20a280 1 --2- 172.21.15.45:0/2600468959 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x55d7b7f7dc00 0x55d7b70c5b80 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.276 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.267+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 >> [v2:172.21.15.190:6800/3296698407,v1:172.21.15.190:6801/3296698407] conn(0x55d7b7343800 msgr2=0x55d7b7462000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:23.277 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.267+0000 7fc48d20a280 1 --2- 172.21.15.45:0/2600468959 >> [v2:172.21.15.190:6800/3296698407,v1:172.21.15.190:6801/3296698407] conn(0x55d7b7343800 0x55d7b7462000 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.277 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.267+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 >> [v2:172.21.15.190:6824/2493232051,v1:172.21.15.190:6825/2493232051] conn(0x55d7b7343c00 msgr2=0x55d7b7462580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:23.277 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.267+0000 7fc48d20a280 1 --2- 172.21.15.45:0/2600468959 >> [v2:172.21.15.190:6824/2493232051,v1:172.21.15.190:6825/2493232051] conn(0x55d7b7343c00 0x55d7b7462580 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.277 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.271+0000 7fc48b9c9640 1 -- 172.21.15.45:0/2600468959 reap_dead start 2023-11-28T18:42:23.277 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.271+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x55d7b7343000 msgr2=0x55d7b70c7700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:23.277 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.271+0000 7fc48d20a280 1 --2- 172.21.15.45:0/2600468959 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x55d7b7343000 0x55d7b70c7700 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x55d7b7fdc270 tx=0x55d7b7338420 comp rx=0 tx=0).stop 2023-11-28T18:42:23.277 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.271+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d7b7f7d000 msgr2=0x55d7b70c6c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:23.277 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.271+0000 7fc48d20a280 1 --2- 172.21.15.45:0/2600468959 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d7b7f7d000 0x55d7b70c6c00 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x55d7b7e143c0 tx=0x55d7b7e2a000 comp rx=0 tx=0).stop 2023-11-28T18:42:23.277 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.271+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 shutdown_connections 2023-11-28T18:42:23.277 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.271+0000 7fc48d20a280 1 --2- 172.21.15.45:0/2600468959 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x55d7b7343000 0x55d7b70c7700 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.277 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.271+0000 7fc48d20a280 1 --2- 172.21.15.45:0/2600468959 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d7b7f7d000 0x55d7b70c6c00 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.278 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.271+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 >> 172.21.15.45:0/2600468959 conn(0x55d7b7058c00 msgr2=0x55d7b7087800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:23.278 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.271+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 shutdown_connections 2023-11-28T18:42:23.278 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.271+0000 7fc48d20a280 1 -- 172.21.15.45:0/2600468959 wait complete. 2023-11-28T18:42:23.278 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.271+0000 7fc48d20a280 1 -- 172.21.15.45:0/2123894964 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d7b7059000 msgr2=0x55d7b70c5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:23.278 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.271+0000 7fc48d20a280 1 --2- 172.21.15.45:0/2123894964 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d7b7059000 0x55d7b70c5080 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x55d7b7e14f00 tx=0x55d7b70db140 comp rx=0 tx=0).stop 2023-11-28T18:42:23.278 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.271+0000 7fc48d20a280 1 -- 172.21.15.45:0/2123894964 shutdown_connections 2023-11-28T18:42:23.278 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.271+0000 7fc48d20a280 1 --2- 172.21.15.45:0/2123894964 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d7b7059000 0x55d7b70c5080 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.278 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.271+0000 7fc48d20a280 1 --2- 172.21.15.45:0/2123894964 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d7b7059400 0x55d7b70c4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.278 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.271+0000 7fc48d20a280 1 --2- 172.21.15.45:0/2123894964 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d7b7059800 0x55d7b70c4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.278 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.271+0000 7fc48d20a280 1 -- 172.21.15.45:0/2123894964 >> 172.21.15.45:0/2123894964 conn(0x55d7b7059c00 msgr2=0x55d7b7087000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:23.279 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.271+0000 7fc48d20a280 1 -- 172.21.15.45:0/2123894964 shutdown_connections 2023-11-28T18:42:23.279 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.271+0000 7fc48d20a280 1 -- 172.21.15.45:0/2123894964 wait complete. 2023-11-28T18:42:23.279 INFO:tasks.workunit.client.0.smithi045.stderr:+ cephfs-journal-tool --rank=cephfs:0 event splice summary 2023-11-28T18:42:23.320 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.315+0000 7f7c63fc6280 1 -- start start 2023-11-28T18:42:23.320 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.315+0000 7f7c63fc6280 1 Processor -- start 2023-11-28T18:42:23.322 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.315+0000 7f7c63fc6280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563067d58400 0x563066fe5600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:23.322 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.315+0000 7f7c63fc6280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563066f79c00 0x563066fe5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:23.322 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.315+0000 7f7c63fc6280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563066f79800 0x563066fe5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:23.322 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.315+0000 7f7c63fc6280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x563066fbf180 con 0x563066f79800 2023-11-28T18:42:23.322 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.315+0000 7f7c63fc6280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x563067048dc0 con 0x563066f79c00 2023-11-28T18:42:23.322 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.315+0000 7f7c63fc6280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x563067049180 con 0x563067d58400 2023-11-28T18:42:23.323 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.315+0000 7f7c62f88640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563066f79800 0x563066fe5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:23.323 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.315+0000 7f7c62f88640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563066f79800 0x563066fe5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57866/0 (socket says 172.21.15.45:57866) 2023-11-28T18:42:23.323 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.315+0000 7f7c62f88640 1 -- 172.21.15.45:0/1855030744 learned_addr learned my addr 172.21.15.45:0/1855030744 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:23.323 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.315+0000 7f7c62787640 1 --2- 172.21.15.45:0/1855030744 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563067d58400 0x563066fe5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:23.323 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.315+0000 7f7c61f86640 1 --2- 172.21.15.45:0/1855030744 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563066f79c00 0x563066fe5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:23.323 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.319+0000 7f7c62f88640 1 -- 172.21.15.45:0/1855030744 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563067d58400 msgr2=0x563066fe5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:23.323 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.319+0000 7f7c62f88640 1 --2- 172.21.15.45:0/1855030744 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563067d58400 0x563066fe5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.323 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.319+0000 7f7c62f88640 1 -- 172.21.15.45:0/1855030744 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563066f79c00 msgr2=0x563066fe5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:23.323 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.319+0000 7f7c62f88640 1 --2- 172.21.15.45:0/1855030744 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563066f79c00 0x563066fe5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.323 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.319+0000 7f7c62f88640 1 -- 172.21.15.45:0/1855030744 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563066fae000 con 0x563066f79800 2023-11-28T18:42:23.324 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.319+0000 7f7c62f88640 1 --2- 172.21.15.45:0/1855030744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563066f79800 0x563066fe5080 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x563067d34e10 tx=0x563067d44240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16ec2b367a61ba6b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:23.324 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.319+0000 7f7c5ff82640 1 -- 172.21.15.45:0/1855030744 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x563066fd8f20 con 0x563066f79800 2023-11-28T18:42:23.324 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.319+0000 7f7c5ff82640 1 -- 172.21.15.45:0/1855030744 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563067d4e000 con 0x563066f79800 2023-11-28T18:42:23.324 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.319+0000 7f7c5ff82640 1 -- 172.21.15.45:0/1855030744 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x563066fd91e0 con 0x563066f79800 2023-11-28T18:42:23.324 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.319+0000 7f7c63fc6280 1 -- 172.21.15.45:0/1855030744 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563066faeea0 con 0x563066f79800 2023-11-28T18:42:23.324 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.319+0000 7f7c63fc6280 1 -- 172.21.15.45:0/1855030744 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x563067e98000 con 0x563066f79800 2023-11-28T18:42:23.324 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.319+0000 7f7c5ff82640 1 -- 172.21.15.45:0/1855030744 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x563066fbac40 con 0x563066f79800 2023-11-28T18:42:23.324 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.319+0000 7f7c5ff82640 1 -- 172.21.15.45:0/1855030744 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 34) v1 ==== 3298+0+0 (secure 0 0 0) 0x563066fc6f00 con 0x563066f79800 2023-11-28T18:42:23.327 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.319+0000 7f7c63fc6280 1 Processor -- start 2023-11-28T18:42:23.327 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.319+0000 7f7c63fc6280 1 -- start start 2023-11-28T18:42:23.327 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.319+0000 7f7c63fc6280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563067d58000 0x563066fe4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:23.327 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.319+0000 7f7c63fc6280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563067e96800 0x563066fe6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:23.327 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.319+0000 7f7c63fc6280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563067e96c00 0x563066fe6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:23.327 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.319+0000 7f7c63fc6280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x563066fbeb40 con 0x563067e96c00 2023-11-28T18:42:23.327 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.319+0000 7f7c63fc6280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x563066fbe000 con 0x563067e96800 2023-11-28T18:42:23.327 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.319+0000 7f7c63fc6280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x563067048dc0 con 0x563067d58000 2023-11-28T18:42:23.327 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.319+0000 7f7c61f86640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563067d58000 0x563066fe4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:23.327 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.319+0000 7f7c62787640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563067e96800 0x563066fe6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:23.328 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.319+0000 7f7c61f86640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563067e96c00 0x563066fe6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:23.328 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.319+0000 7f7c62787640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563067e96800 0x563066fe6100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.45:38502/0 (socket says 172.21.15.45:38502) 2023-11-28T18:42:23.328 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.319+0000 7f7c62787640 1 -- 172.21.15.45:0/957260130 learned_addr learned my addr 172.21.15.45:0/957260130 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:23.328 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.319+0000 7f7c61f86640 1 -- 172.21.15.45:0/957260130 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563067d58000 msgr2=0x563066fe4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:23.328 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.319+0000 7f7c61f86640 1 --2- 172.21.15.45:0/957260130 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563067d58000 0x563066fe4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.328 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.319+0000 7f7c61f86640 1 -- 172.21.15.45:0/957260130 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563067e96800 msgr2=0x563066fe6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:23.328 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.319+0000 7f7c61f86640 1 --2- 172.21.15.45:0/957260130 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563067e96800 0x563066fe6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.328 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.319+0000 7f7c61f86640 1 -- 172.21.15.45:0/957260130 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563067e981a0 con 0x563067e96c00 2023-11-28T18:42:23.328 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.319+0000 7f7c62787640 1 --2- 172.21.15.45:0/957260130 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563067e96800 0x563066fe6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:42:23.328 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.319+0000 7f7c61f86640 1 --2- 172.21.15.45:0/957260130 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563067e96c00 0x563066fe6680 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x563067d34690 tx=0x563067d44540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f13a6e6aa16e5b7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:23.328 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.323+0000 7f7c5df7e640 1 -- 172.21.15.45:0/957260130 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x563066fd8dc0 con 0x563067e96c00 2023-11-28T18:42:23.328 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.323+0000 7f7c5df7e640 1 -- 172.21.15.45:0/957260130 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563067d4ec00 con 0x563067e96c00 2023-11-28T18:42:23.329 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.323+0000 7f7c5df7e640 1 -- 172.21.15.45:0/957260130 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x563066fd8f20 con 0x563067e96c00 2023-11-28T18:42:23.329 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.323+0000 7f7c63fc6280 1 -- 172.21.15.45:0/957260130 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563067e96c00 msgr2=0x563066fe6680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:23.329 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.323+0000 7f7c63fc6280 1 --2- 172.21.15.45:0/957260130 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563067e96c00 0x563066fe6680 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x563067d34690 tx=0x563067d44540 comp rx=0 tx=0).stop 2023-11-28T18:42:23.329 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.323+0000 7f7c63fc6280 1 -- 172.21.15.45:0/957260130 shutdown_connections 2023-11-28T18:42:23.329 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.323+0000 7f7c63fc6280 1 --2- 172.21.15.45:0/957260130 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563067e96c00 0x563066fe6680 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.329 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.323+0000 7f7c63fc6280 1 --2- 172.21.15.45:0/957260130 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563067e96800 0x563066fe6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.329 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.323+0000 7f7c63fc6280 1 --2- 172.21.15.45:0/957260130 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563067d58000 0x563066fe4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.329 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.323+0000 7f7c63fc6280 1 -- 172.21.15.45:0/957260130 >> 172.21.15.45:0/957260130 conn(0x563067d58800 msgr2=0x563067ef8000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:23.330 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.323+0000 7f7c63fc6280 1 -- 172.21.15.45:0/957260130 shutdown_connections 2023-11-28T18:42:23.330 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.323+0000 7f7c63fc6280 1 -- 172.21.15.45:0/957260130 wait complete. 2023-11-28T18:42:23.330 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.323+0000 7f7c63fc6280 1 Processor -- start 2023-11-28T18:42:23.330 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.323+0000 7f7c63fc6280 1 -- start start 2023-11-28T18:42:23.333 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.323+0000 7f7c63fc6280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563067e97400 0x563066fe4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:23.333 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.323+0000 7f7c63fc6280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563067e97000 0x563066fe6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:23.333 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.323+0000 7f7c63fc6280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563067e96c00 0x563066fe6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:23.333 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.323+0000 7f7c63fc6280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x563067048c80 con 0x563067e96c00 2023-11-28T18:42:23.333 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.323+0000 7f7c63fc6280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x563067048b40 con 0x563067e97000 2023-11-28T18:42:23.333 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.323+0000 7f7c63fc6280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x563067048a00 con 0x563067e97400 2023-11-28T18:42:23.333 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.323+0000 7f7c61f86640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563067e96c00 0x563066fe6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:23.333 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.323+0000 7f7c61f86640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563067e96c00 0x563066fe6680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57892/0 (socket says 172.21.15.45:57892) 2023-11-28T18:42:23.333 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.323+0000 7f7c61f86640 1 -- 172.21.15.45:0/2427172361 learned_addr learned my addr 172.21.15.45:0/2427172361 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:23.333 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.323+0000 7f7c62787640 1 --2- 172.21.15.45:0/2427172361 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563067e97000 0x563066fe6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:23.333 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.323+0000 7f7c61f86640 1 --2- 172.21.15.45:0/2427172361 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563067e97400 0x563066fe4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:23.334 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.323+0000 7f7c61f86640 1 -- 172.21.15.45:0/2427172361 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563067e97400 msgr2=0x563066fe4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:23.334 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.323+0000 7f7c61f86640 1 --2- 172.21.15.45:0/2427172361 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563067e97400 0x563066fe4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.334 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.323+0000 7f7c61f86640 1 -- 172.21.15.45:0/2427172361 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563067e97000 msgr2=0x563066fe6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:23.334 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.323+0000 7f7c61f86640 1 --2- 172.21.15.45:0/2427172361 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563067e97000 0x563066fe6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.334 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.323+0000 7f7c61f86640 1 -- 172.21.15.45:0/2427172361 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563067e98340 con 0x563067e96c00 2023-11-28T18:42:23.334 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.323+0000 7f7c61f86640 1 --2- 172.21.15.45:0/2427172361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563067e96c00 0x563066fe6680 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x563067f00cf0 tx=0x563067d44480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:23.334 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.323+0000 7f7c5c77b640 1 -- 172.21.15.45:0/2427172361 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x563066fd91e0 con 0x563067e96c00 2023-11-28T18:42:23.334 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.323+0000 7f7c5c77b640 1 -- 172.21.15.45:0/2427172361 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563067d4e000 con 0x563067e96c00 2023-11-28T18:42:23.334 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.323+0000 7f7c5c77b640 1 -- 172.21.15.45:0/2427172361 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x563066fd8420 con 0x563067e96c00 2023-11-28T18:42:23.334 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.323+0000 7f7c63fc6280 1 -- 172.21.15.45:0/2427172361 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563067e984e0 con 0x563067e96c00 2023-11-28T18:42:23.334 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.323+0000 7f7c63fc6280 1 -- 172.21.15.45:0/2427172361 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563067e981a0 con 0x563067e96c00 2023-11-28T18:42:23.334 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.327+0000 7f7c5c77b640 1 -- 172.21.15.45:0/2427172361 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x563067007080 con 0x563067e96c00 2023-11-28T18:42:23.335 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.327+0000 7f7c5c77b640 1 --2- 172.21.15.45:0/2427172361 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x56306734a000 0x563066fe7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:23.335 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.327+0000 7f7c5c77b640 1 -- 172.21.15.45:0/2427172361 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x563066fbaa80 con 0x563067e96c00 2023-11-28T18:42:23.335 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.327+0000 7f7c63fc6280 1 --2- 172.21.15.45:0/2427172361 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x563067e96800 0x563066fe6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:23.335 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.327+0000 7f7c63fc6280 1 -- 172.21.15.45:0/2427172361 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x563066fcf880 con 0x563067e96800 2023-11-28T18:42:23.335 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.327+0000 7f7c61f86640 1 --2- 172.21.15.45:0/2427172361 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x563067e96800 0x563066fe6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:23.335 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.327+0000 7f7c62787640 1 --2- 172.21.15.45:0/2427172361 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x56306734a000 0x563066fe7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:23.335 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.327+0000 7f7c61f86640 1 --2- 172.21.15.45:0/2427172361 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x563067e96800 0x563066fe6c00 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:23.335 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.327+0000 7f7c62787640 1 --2- 172.21.15.45:0/2427172361 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x56306734a000 0x563066fe7700 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x563067d36480 tx=0x56306726e300 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:23.335 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.327+0000 7f7c61f86640 1 -- 172.21.15.45:0/2427172361 <== osd.2 v2:172.21.15.45:6816/193884539 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x563067d4cb40 con 0x563067e96800 2023-11-28T18:42:23.335 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.327+0000 7f7c63fc6280 1 -- 172.21.15.45:0/2427172361 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x563066fcfc00 con 0x563067e96800 2023-11-28T18:42:23.335 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.327+0000 7f7c61f86640 1 -- 172.21.15.45:0/2427172361 <== osd.2 v2:172.21.15.45:6816/193884539 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv32 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x563067d4cb40 con 0x563067e96800 2023-11-28T18:42:23.335 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.327+0000 7f7c63fc6280 1 -- 172.21.15.45:0/2427172361 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:3 6.14 6:2e2fa760:::200.00000001:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x563066fcf880 con 0x563067e96800 2023-11-28T18:42:23.336 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.327+0000 7f7c61f86640 1 -- 172.21.15.45:0/2427172361 <== osd.2 v2:172.21.15.45:6816/193884539 3 ==== osd_op_reply(3 200.00000001 [read 0~34160 out=34160b] v0'0 uv34 ondisk = 0) v8 ==== 156+0+34160 (crc 0 0 0) 0x563067d4cb40 con 0x563067e96800 2023-11-28T18:42:23.336 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.327+0000 7f7c63fc6280 1 --2- 172.21.15.45:0/2427172361 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x563067d58000 0x563066fe7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:23.336 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.327+0000 7f7c63fc6280 1 -- 172.21.15.45:0/2427172361 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:4 6.1b 6:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x563066fcfc00 con 0x563067d58000 2023-11-28T18:42:23.337 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.331+0000 7f7c62f88640 1 --2- 172.21.15.45:0/2427172361 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x563067d58000 0x563066fe7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:23.337 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.331+0000 7f7c62f88640 1 --2- 172.21.15.45:0/2427172361 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x563067d58000 0x563066fe7180 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:23.337 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.331+0000 7f7c62f88640 1 -- 172.21.15.45:0/2427172361 <== osd.3 v2:172.21.15.45:6824/78541084 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x563067d4cd80 con 0x563067d58000 2023-11-28T18:42:23.337 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.331+0000 7f7c63fc6280 1 -- 172.21.15.45:0/2427172361 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:5 6.14 6:2e2fa760:::200.00000001:head [write 0~48 in=48b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x563067376000 con 0x563067e96800 2023-11-28T18:42:23.337 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.331+0000 7f7c61f86640 1 -- 172.21.15.45:0/2427172361 <== osd.2 v2:172.21.15.45:6816/193884539 4 ==== osd_op_reply(5 200.00000001 [write 0~48] v49'42 uv42 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x563067d4cb40 con 0x563067e96800 2023-11-28T18:42:23.337 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.331+0000 7f7c63fc6280 1 -- 172.21.15.45:0/2427172361 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:6 6.14 6:2e2fa760:::200.00000001:head [write 48~892 in=892b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x563067376380 con 0x563067e96800 2023-11-28T18:42:23.338 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.335+0000 7f7c61f86640 1 -- 172.21.15.45:0/2427172361 <== osd.2 v2:172.21.15.45:6816/193884539 5 ==== osd_op_reply(6 200.00000001 [write 48~892] v49'43 uv43 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x563067d4cb40 con 0x563067e96800 2023-11-28T18:42:23.338 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.335+0000 7f7c63fc6280 1 -- 172.21.15.45:0/2427172361 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:7 6.14 6:2e2fa760:::200.00000001:head [write 940~440 in=440b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x563067376700 con 0x563067e96800 2023-11-28T18:42:23.339 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.335+0000 7f7c61f86640 1 -- 172.21.15.45:0/2427172361 <== osd.2 v2:172.21.15.45:6816/193884539 6 ==== osd_op_reply(7 200.00000001 [write 940~440] v49'44 uv44 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x563067d4cb40 con 0x563067e96800 2023-11-28T18:42:23.339 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.335+0000 7f7c63fc6280 1 -- 172.21.15.45:0/2427172361 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:8 6.14 6:2e2fa760:::200.00000001:head [write 1380~815 in=815b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x563067376a80 con 0x563067e96800 2023-11-28T18:42:23.340 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.335+0000 7f7c61f86640 1 -- 172.21.15.45:0/2427172361 <== osd.2 v2:172.21.15.45:6816/193884539 7 ==== osd_op_reply(8 200.00000001 [write 1380~815] v49'45 uv45 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x563067d4cb40 con 0x563067e96800 2023-11-28T18:42:23.340 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.335+0000 7f7c63fc6280 1 -- 172.21.15.45:0/2427172361 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:9 6.14 6:2e2fa760:::200.00000001:head [write 2195~2016 in=2016b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x563067376e00 con 0x563067e96800 2023-11-28T18:42:23.342 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.339+0000 7f7c61f86640 1 -- 172.21.15.45:0/2427172361 <== osd.2 v2:172.21.15.45:6816/193884539 8 ==== osd_op_reply(9 200.00000001 [write 2195~2016] v49'46 uv46 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x563067d4cb40 con 0x563067e96800 2023-11-28T18:42:23.342 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.339+0000 7f7c63fc6280 1 -- 172.21.15.45:0/2427172361 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:10 6.14 6:2e2fa760:::200.00000001:head [write 4211~1669 in=1669b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x563067376000 con 0x563067e96800 2023-11-28T18:42:23.344 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.339+0000 7f7c61f86640 1 -- 172.21.15.45:0/2427172361 <== osd.2 v2:172.21.15.45:6816/193884539 9 ==== osd_op_reply(10 200.00000001 [write 4211~1669] v49'47 uv47 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x563067d4cb40 con 0x563067e96800 2023-11-28T18:42:23.344 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.339+0000 7f7c63fc6280 1 -- 172.21.15.45:0/2427172361 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:11 6.14 6:2e2fa760:::200.00000001:head [write 5880~2846 in=2846b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x563067376380 con 0x563067e96800 2023-11-28T18:42:23.345 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.343+0000 7f7c61f86640 1 -- 172.21.15.45:0/2427172361 <== osd.2 v2:172.21.15.45:6816/193884539 10 ==== osd_op_reply(11 200.00000001 [write 5880~2846] v49'48 uv48 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x563067d4cb40 con 0x563067e96800 2023-11-28T18:42:23.346 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.343+0000 7f7c63fc6280 1 -- 172.21.15.45:0/2427172361 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:12 6.14 6:2e2fa760:::200.00000001:head [write 8726~2256 in=2256b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x563067377180 con 0x563067e96800 2023-11-28T18:42:23.347 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.343+0000 7f7c61f86640 1 -- 172.21.15.45:0/2427172361 <== osd.2 v2:172.21.15.45:6816/193884539 11 ==== osd_op_reply(12 200.00000001 [write 8726~2256] v49'49 uv49 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x563067d4cb40 con 0x563067e96800 2023-11-28T18:42:23.347 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.343+0000 7f7c63fc6280 1 -- 172.21.15.45:0/2427172361 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:13 6.14 6:2e2fa760:::200.00000001:head [write 10982~1954 in=1954b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x563067377500 con 0x563067e96800 2023-11-28T18:42:23.349 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.343+0000 7f7c61f86640 1 -- 172.21.15.45:0/2427172361 <== osd.2 v2:172.21.15.45:6816/193884539 12 ==== osd_op_reply(13 200.00000001 [write 10982~1954] v49'50 uv50 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x563067d4cb40 con 0x563067e96800 2023-11-28T18:42:23.349 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.343+0000 7f7c63fc6280 1 -- 172.21.15.45:0/2427172361 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:14 6.14 6:2e2fa760:::200.00000001:head [write 12936~4611 in=4611b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x563067377880 con 0x563067e96800 2023-11-28T18:42:23.350 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.347+0000 7f7c61f86640 1 -- 172.21.15.45:0/2427172361 <== osd.2 v2:172.21.15.45:6816/193884539 13 ==== osd_op_reply(14 200.00000001 [write 12936~4611] v49'51 uv51 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x563067d4cb40 con 0x563067e96800 2023-11-28T18:42:23.350 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.347+0000 7f7c63fc6280 1 -- 172.21.15.45:0/2427172361 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:15 6.14 6:2e2fa760:::200.00000001:head [write 17547~1921 in=1921b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x563066fcf880 con 0x563067e96800 2023-11-28T18:42:23.352 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.347+0000 7f7c61f86640 1 -- 172.21.15.45:0/2427172361 <== osd.2 v2:172.21.15.45:6816/193884539 14 ==== osd_op_reply(15 200.00000001 [write 17547~1921] v49'52 uv52 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x563067d4cb40 con 0x563067e96800 2023-11-28T18:42:23.352 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.347+0000 7f7c63fc6280 1 -- 172.21.15.45:0/2427172361 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:16 6.14 6:2e2fa760:::200.00000001:head [write 19468~3171 in=3171b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x563066fcf880 con 0x563067e96800 2023-11-28T18:42:23.353 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.351+0000 7f7c61f86640 1 -- 172.21.15.45:0/2427172361 <== osd.2 v2:172.21.15.45:6816/193884539 15 ==== osd_op_reply(16 200.00000001 [write 19468~3171] v49'53 uv53 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x563067d4cb40 con 0x563067e96800 2023-11-28T18:42:23.353 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.351+0000 7f7c63fc6280 1 -- 172.21.15.45:0/2427172361 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:17 6.14 6:2e2fa760:::200.00000001:head [write 22639~3176 in=3176b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x563067376000 con 0x563067e96800 2023-11-28T18:42:23.355 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.351+0000 7f7c61f86640 1 -- 172.21.15.45:0/2427172361 <== osd.2 v2:172.21.15.45:6816/193884539 16 ==== osd_op_reply(17 200.00000001 [write 22639~3176] v49'54 uv54 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x563067d4cb40 con 0x563067e96800 2023-11-28T18:42:23.355 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.351+0000 7f7c63fc6280 1 -- 172.21.15.45:0/2427172361 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:18 6.14 6:2e2fa760:::200.00000001:head [write 25815~2911 in=2911b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x563067376380 con 0x563067e96800 2023-11-28T18:42:23.356 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.351+0000 7f7c61f86640 1 -- 172.21.15.45:0/2427172361 <== osd.2 v2:172.21.15.45:6816/193884539 17 ==== osd_op_reply(18 200.00000001 [write 25815~2911] v49'55 uv55 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x563067d4cb40 con 0x563067e96800 2023-11-28T18:42:23.357 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.351+0000 7f7c63fc6280 1 -- 172.21.15.45:0/2427172361 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:19 6.14 6:2e2fa760:::200.00000001:head [write 28726~599 in=599b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x563067376700 con 0x563067e96800 2023-11-28T18:42:23.358 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.355+0000 7f7c61f86640 1 -- 172.21.15.45:0/2427172361 <== osd.2 v2:172.21.15.45:6816/193884539 18 ==== osd_op_reply(19 200.00000001 [write 28726~599] v49'56 uv56 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x563067d4cb40 con 0x563067e96800 2023-11-28T18:42:23.358 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.355+0000 7f7c63fc6280 1 -- 172.21.15.45:0/2427172361 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:20 6.14 6:2e2fa760:::200.00000001:head [write 29325~599 in=599b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x563067376a80 con 0x563067e96800 2023-11-28T18:42:23.359 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.355+0000 7f7c61f86640 1 -- 172.21.15.45:0/2427172361 <== osd.2 v2:172.21.15.45:6816/193884539 19 ==== osd_op_reply(20 200.00000001 [write 29325~599] v49'57 uv57 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x563067d4cb40 con 0x563067e96800 2023-11-28T18:42:23.359 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.355+0000 7f7c63fc6280 1 -- 172.21.15.45:0/2427172361 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:21 6.14 6:2e2fa760:::200.00000001:head [write 29924~1138 in=1138b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x563067376e00 con 0x563067e96800 2023-11-28T18:42:23.361 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.355+0000 7f7c61f86640 1 -- 172.21.15.45:0/2427172361 <== osd.2 v2:172.21.15.45:6816/193884539 20 ==== osd_op_reply(21 200.00000001 [write 29924~1138] v49'58 uv58 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x563067d4cb40 con 0x563067e96800 2023-11-28T18:42:23.361 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.355+0000 7f7c63fc6280 1 -- 172.21.15.45:0/2427172361 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:22 6.14 6:2e2fa760:::200.00000001:head [write 31062~599 in=599b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x563067377180 con 0x563067e96800 2023-11-28T18:42:23.362 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.359+0000 7f7c61f86640 1 -- 172.21.15.45:0/2427172361 <== osd.2 v2:172.21.15.45:6816/193884539 21 ==== osd_op_reply(22 200.00000001 [write 31062~599] v49'59 uv59 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x563067d4cb40 con 0x563067e96800 2023-11-28T18:42:23.362 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.359+0000 7f7c63fc6280 1 -- 172.21.15.45:0/2427172361 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:23 6.14 6:2e2fa760:::200.00000001:head [write 31661~599 in=599b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x563067377500 con 0x563067e96800 2023-11-28T18:42:23.363 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.359+0000 7f7c61f86640 1 -- 172.21.15.45:0/2427172361 <== osd.2 v2:172.21.15.45:6816/193884539 22 ==== osd_op_reply(23 200.00000001 [write 31661~599] v49'60 uv60 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x563067d4cb40 con 0x563067e96800 2023-11-28T18:42:23.364 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.359+0000 7f7c63fc6280 1 -- 172.21.15.45:0/2427172361 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:24 6.14 6:2e2fa760:::200.00000001:head [write 32260~173 in=173b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x563067377880 con 0x563067e96800 2023-11-28T18:42:23.365 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.359+0000 7f7c61f86640 1 -- 172.21.15.45:0/2427172361 <== osd.2 v2:172.21.15.45:6816/193884539 23 ==== osd_op_reply(24 200.00000001 [write 32260~173] v49'61 uv61 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x563067d4cb40 con 0x563067e96800 2023-11-28T18:42:23.365 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.363+0000 7f7c63fc6280 1 -- 172.21.15.45:0/2427172361 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:25 6.14 6:2e2fa760:::200.00000001:head [write 32433~76 in=76b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x563067376000 con 0x563067e96800 2023-11-28T18:42:23.366 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.363+0000 7f7c61f86640 1 -- 172.21.15.45:0/2427172361 <== osd.2 v2:172.21.15.45:6816/193884539 24 ==== osd_op_reply(25 200.00000001 [write 32433~76] v49'62 uv62 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x563067d4cb40 con 0x563067e96800 2023-11-28T18:42:23.367 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.363+0000 7f7c63fc6280 1 -- 172.21.15.45:0/2427172361 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:26 6.14 6:2e2fa760:::200.00000001:head [write 32509~1651 in=1651b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x563067376380 con 0x563067e96800 2023-11-28T18:42:23.368 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.363+0000 7f7c61f86640 1 -- 172.21.15.45:0/2427172361 <== osd.2 v2:172.21.15.45:6816/193884539 25 ==== osd_op_reply(26 200.00000001 [write 32509~1651] v49'63 uv63 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x563067d4cb40 con 0x563067e96800 2023-11-28T18:42:23.368 INFO:tasks.workunit.client.0.smithi045.stdout:Events by type: 2023-11-28T18:42:23.368 INFO:tasks.workunit.client.0.smithi045.stdout: LID: 1 2023-11-28T18:42:23.368 INFO:tasks.workunit.client.0.smithi045.stdout: PURGED: 1 2023-11-28T18:42:23.369 INFO:tasks.workunit.client.0.smithi045.stdout: SESSION: 2 2023-11-28T18:42:23.369 INFO:tasks.workunit.client.0.smithi045.stdout: SUBTREEMAP: 1 2023-11-28T18:42:23.369 INFO:tasks.workunit.client.0.smithi045.stdout: UPDATE: 17 2023-11-28T18:42:23.369 INFO:tasks.workunit.client.0.smithi045.stdout:Errors: 0 2023-11-28T18:42:23.370 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.363+0000 7f7c63fc6280 1 -- 172.21.15.45:0/2427172361 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x563067e96800 msgr2=0x563066fe6c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:23.370 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.363+0000 7f7c63fc6280 1 --2- 172.21.15.45:0/2427172361 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x563067e96800 0x563066fe6c00 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.370 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.363+0000 7f7c63fc6280 1 -- 172.21.15.45:0/2427172361 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x563067d58000 msgr2=0x563066fe7180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:23.371 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.363+0000 7f7c63fc6280 1 --2- 172.21.15.45:0/2427172361 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x563067d58000 0x563066fe7180 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.371 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.363+0000 7f7c63fc6280 1 -- 172.21.15.45:0/2427172361 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x56306734a000 msgr2=0x563066fe7700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:23.371 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.363+0000 7f7c63fc6280 1 --2- 172.21.15.45:0/2427172361 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x56306734a000 0x563066fe7700 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x563067d36480 tx=0x56306726e300 comp rx=0 tx=0).stop 2023-11-28T18:42:23.371 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.363+0000 7f7c63fc6280 1 -- 172.21.15.45:0/2427172361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563067e96c00 msgr2=0x563066fe6680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:23.371 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.363+0000 7f7c63fc6280 1 --2- 172.21.15.45:0/2427172361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563067e96c00 0x563066fe6680 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x563067f00cf0 tx=0x563067d44480 comp rx=0 tx=0).stop 2023-11-28T18:42:23.371 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.363+0000 7f7c62787640 1 -- 172.21.15.45:0/2427172361 reap_dead start 2023-11-28T18:42:23.371 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.363+0000 7f7c62787640 1 -- 172.21.15.45:0/2427172361 reap_dead start 2023-11-28T18:42:23.371 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.363+0000 7f7c63fc6280 1 -- 172.21.15.45:0/2427172361 shutdown_connections 2023-11-28T18:42:23.371 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.363+0000 7f7c63fc6280 1 -- 172.21.15.45:0/2427172361 >> 172.21.15.45:0/2427172361 conn(0x563067e97800 msgr2=0x563067ef8000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:23.371 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.363+0000 7f7c63fc6280 1 -- 172.21.15.45:0/2427172361 shutdown_connections 2023-11-28T18:42:23.371 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.363+0000 7f7c63fc6280 1 -- 172.21.15.45:0/2427172361 wait complete. 2023-11-28T18:42:23.372 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.363+0000 7f7c63fc6280 1 -- 172.21.15.45:0/1855030744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563066f79800 msgr2=0x563066fe5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:23.372 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.363+0000 7f7c63fc6280 1 --2- 172.21.15.45:0/1855030744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563066f79800 0x563066fe5080 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x563067d34e10 tx=0x563067d44240 comp rx=0 tx=0).stop 2023-11-28T18:42:23.372 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.367+0000 7f7c63fc6280 1 -- 172.21.15.45:0/1855030744 shutdown_connections 2023-11-28T18:42:23.372 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.367+0000 7f7c63fc6280 1 --2- 172.21.15.45:0/1855030744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563066f79800 0x563066fe5080 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.372 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.367+0000 7f7c63fc6280 1 --2- 172.21.15.45:0/1855030744 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563066f79c00 0x563066fe5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.372 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.367+0000 7f7c63fc6280 1 --2- 172.21.15.45:0/1855030744 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563067d58400 0x563066fe5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.372 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.367+0000 7f7c63fc6280 1 -- 172.21.15.45:0/1855030744 >> 172.21.15.45:0/1855030744 conn(0x563066f78c00 msgr2=0x563066fa7800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:23.372 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.367+0000 7f7c63fc6280 1 -- 172.21.15.45:0/1855030744 shutdown_connections 2023-11-28T18:42:23.372 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.367+0000 7f7c63fc6280 1 -- 172.21.15.45:0/1855030744 wait complete. 2023-11-28T18:42:23.374 INFO:tasks.workunit.client.0.smithi045.stderr:+ cephfs-journal-tool --rank=cephfs:0 journal reset 2023-11-28T18:42:23.413 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.407+0000 7f46e5e62280 1 -- start start 2023-11-28T18:42:23.413 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.407+0000 7f46e5e62280 1 Processor -- start 2023-11-28T18:42:23.416 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.411+0000 7f46e5e62280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x565087407800 0x565087472580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:23.416 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.411+0000 7f46e5e62280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565087407400 0x565087472b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:23.416 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.411+0000 7f46e5e62280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x565087407000 0x565087473080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:23.416 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.411+0000 7f46e5e62280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x56508744d180 con 0x565087407400 2023-11-28T18:42:23.417 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.411+0000 7f46e5e62280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x56508744c140 con 0x565087407000 2023-11-28T18:42:23.417 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.411+0000 7f46e5e62280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x56508744c000 con 0x565087407800 2023-11-28T18:42:23.417 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.411+0000 7f46e3e20640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565087407400 0x565087472b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:23.417 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.411+0000 7f46e3e20640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565087407400 0x565087472b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57902/0 (socket says 172.21.15.45:57902) 2023-11-28T18:42:23.417 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.411+0000 7f46e3e20640 1 -- 172.21.15.45:0/3237196743 learned_addr learned my addr 172.21.15.45:0/3237196743 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:23.417 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.411+0000 7f46e4e22640 1 --2- 172.21.15.45:0/3237196743 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x565087407000 0x565087473080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:23.418 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.411+0000 7f46e4621640 1 --2- 172.21.15.45:0/3237196743 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x565087407800 0x565087472580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:23.418 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.411+0000 7f46e3e20640 1 -- 172.21.15.45:0/3237196743 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x565087407800 msgr2=0x565087472580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:23.418 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.411+0000 7f46e3e20640 1 --2- 172.21.15.45:0/3237196743 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x565087407800 0x565087472580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.418 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.411+0000 7f46e3e20640 1 -- 172.21.15.45:0/3237196743 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x565087407000 msgr2=0x565087473080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:23.418 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.411+0000 7f46e3e20640 1 --2- 172.21.15.45:0/3237196743 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x565087407000 0x565087473080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.418 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.411+0000 7f46e3e20640 1 -- 172.21.15.45:0/3237196743 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56508743c9c0 con 0x565087407400 2023-11-28T18:42:23.418 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.411+0000 7f46e4621640 1 --2- 172.21.15.45:0/3237196743 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x565087407800 0x565087472580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:42:23.418 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.411+0000 7f46e4e22640 1 --2- 172.21.15.45:0/3237196743 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x565087407000 0x565087473080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:42:23.418 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.411+0000 7f46e3e20640 1 --2- 172.21.15.45:0/3237196743 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565087407400 0x565087472b00 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x5650881c2de0 tx=0x56508818f320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f6f6c1aba87831d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:23.418 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.411+0000 7f46e1e1c640 1 -- 172.21.15.45:0/3237196743 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5650874671e0 con 0x565087407400 2023-11-28T18:42:23.419 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.411+0000 7f46e1e1c640 1 -- 172.21.15.45:0/3237196743 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x565087462900 con 0x565087407400 2023-11-28T18:42:23.419 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.411+0000 7f46e1e1c640 1 -- 172.21.15.45:0/3237196743 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x565087467080 con 0x565087407400 2023-11-28T18:42:23.419 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.411+0000 7f46e5e62280 1 -- 172.21.15.45:0/3237196743 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56508743cb60 con 0x565087407400 2023-11-28T18:42:23.419 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.411+0000 7f46e5e62280 1 -- 172.21.15.45:0/3237196743 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x56508743c340 con 0x565087407400 2023-11-28T18:42:23.419 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.411+0000 7f46e1e1c640 1 -- 172.21.15.45:0/3237196743 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x565087448c40 con 0x565087407400 2023-11-28T18:42:23.419 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.411+0000 7f46e1e1c640 1 -- 172.21.15.45:0/3237196743 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 34) v1 ==== 3298+0+0 (secure 0 0 0) 0x565087454f00 con 0x565087407400 2023-11-28T18:42:23.419 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.411+0000 7f46e5e62280 1 Processor -- start 2023-11-28T18:42:23.419 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.411+0000 7f46e5e62280 1 -- start start 2023-11-28T18:42:23.424 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.415+0000 7f46e5e62280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565088326c00 0x565087473600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:23.424 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.415+0000 7f46e5e62280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x565088327000 0x565087473b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:23.424 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.415+0000 7f46e5e62280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x565088327400 0x565087474100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:23.424 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.415+0000 7f46e5e62280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x56508744ca00 con 0x565088326c00 2023-11-28T18:42:23.424 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.415+0000 7f46e5e62280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650874d7180 con 0x565088327400 2023-11-28T18:42:23.424 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.415+0000 7f46e5e62280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x5650874d6dc0 con 0x565088327000 2023-11-28T18:42:23.425 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.415+0000 7f46e4e22640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565088326c00 0x565087473600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:23.425 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.415+0000 7f46e4e22640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565088326c00 0x565087473600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57912/0 (socket says 172.21.15.45:57912) 2023-11-28T18:42:23.425 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.415+0000 7f46e4e22640 1 -- 172.21.15.45:0/4109300197 learned_addr learned my addr 172.21.15.45:0/4109300197 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:23.425 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.415+0000 7f46e4621640 1 --2- 172.21.15.45:0/4109300197 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x565088327000 0x565087473b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:23.425 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.415+0000 7f46e3e20640 1 --2- 172.21.15.45:0/4109300197 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x565088327400 0x565087474100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:23.425 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.415+0000 7f46e4e22640 1 -- 172.21.15.45:0/4109300197 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x565088327000 msgr2=0x565087473b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:23.425 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.415+0000 7f46e4e22640 1 --2- 172.21.15.45:0/4109300197 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x565088327000 0x565087473b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.425 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.415+0000 7f46e4e22640 1 -- 172.21.15.45:0/4109300197 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x565088327400 msgr2=0x565087474100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:23.426 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.415+0000 7f46e4e22640 1 --2- 172.21.15.45:0/4109300197 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x565088327400 0x565087474100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.426 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.415+0000 7f46e4e22640 1 -- 172.21.15.45:0/4109300197 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56508743c000 con 0x565088326c00 2023-11-28T18:42:23.426 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.415+0000 7f46e4e22640 1 --2- 172.21.15.45:0/4109300197 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565088326c00 0x565087473600 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x5650881c23f0 tx=0x5650881ce000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1f4b61ea9f20aa3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:23.426 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.415+0000 7f46dfe18640 1 -- 172.21.15.45:0/4109300197 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x565087466f20 con 0x565088326c00 2023-11-28T18:42:23.426 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.415+0000 7f46dfe18640 1 -- 172.21.15.45:0/4109300197 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5650881e1080 con 0x565088326c00 2023-11-28T18:42:23.426 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.415+0000 7f46dfe18640 1 -- 172.21.15.45:0/4109300197 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5650874671e0 con 0x565088326c00 2023-11-28T18:42:23.426 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.415+0000 7f46e5e62280 1 -- 172.21.15.45:0/4109300197 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565088326c00 msgr2=0x565087473600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:23.426 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.415+0000 7f46e5e62280 1 --2- 172.21.15.45:0/4109300197 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565088326c00 0x565087473600 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x5650881c23f0 tx=0x5650881ce000 comp rx=0 tx=0).stop 2023-11-28T18:42:23.426 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.415+0000 7f46e5e62280 1 -- 172.21.15.45:0/4109300197 shutdown_connections 2023-11-28T18:42:23.426 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.415+0000 7f46e5e62280 1 --2- 172.21.15.45:0/4109300197 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x565088327400 0x565087474100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.427 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.415+0000 7f46e5e62280 1 --2- 172.21.15.45:0/4109300197 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x565088327000 0x565087473b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.427 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.415+0000 7f46e5e62280 1 --2- 172.21.15.45:0/4109300197 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565088326c00 0x565087473600 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.427 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.415+0000 7f46e5e62280 1 -- 172.21.15.45:0/4109300197 >> 172.21.15.45:0/4109300197 conn(0x565087406c00 msgr2=0x565087435800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:23.427 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.415+0000 7f46e5e62280 1 -- 172.21.15.45:0/4109300197 shutdown_connections 2023-11-28T18:42:23.427 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.415+0000 7f46e5e62280 1 -- 172.21.15.45:0/4109300197 wait complete. 2023-11-28T18:42:23.427 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.415+0000 7f46e5e62280 1 Processor -- start 2023-11-28T18:42:23.427 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.415+0000 7f46e5e62280 1 -- start start 2023-11-28T18:42:23.428 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.415+0000 7f46e5e62280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x565088326c00 0x565087475180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:23.428 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.415+0000 7f46e5e62280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x565088327000 0x565087474c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:23.428 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.415+0000 7f46e5e62280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565088327400 0x565087474680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:23.428 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.415+0000 7f46e5e62280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650874d6c80 con 0x565088327400 2023-11-28T18:42:23.428 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.415+0000 7f46e5e62280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x56508744c140 con 0x565088327000 2023-11-28T18:42:23.428 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.415+0000 7f46e5e62280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x56508744cb40 con 0x565088326c00 2023-11-28T18:42:23.428 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.415+0000 7f46e3e20640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565088327400 0x565087474680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:23.428 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.415+0000 7f46e3e20640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565088327400 0x565087474680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57914/0 (socket says 172.21.15.45:57914) 2023-11-28T18:42:23.428 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.415+0000 7f46e3e20640 1 -- 172.21.15.45:0/704110978 learned_addr learned my addr 172.21.15.45:0/704110978 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:23.428 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.415+0000 7f46e4621640 1 --2- 172.21.15.45:0/704110978 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x565088327000 0x565087474c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:23.429 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.415+0000 7f46e4e22640 1 --2- 172.21.15.45:0/704110978 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x565088326c00 0x565087475180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:23.429 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.415+0000 7f46e3e20640 1 -- 172.21.15.45:0/704110978 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x565088326c00 msgr2=0x565087475180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:23.429 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.415+0000 7f46e3e20640 1 --2- 172.21.15.45:0/704110978 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x565088326c00 0x565087475180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.429 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.415+0000 7f46e3e20640 1 -- 172.21.15.45:0/704110978 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x565088327000 msgr2=0x565087474c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:23.429 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.415+0000 7f46e3e20640 1 --2- 172.21.15.45:0/704110978 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x565088327000 0x565087474c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.429 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.415+0000 7f46e3e20640 1 -- 172.21.15.45:0/704110978 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56508743c1a0 con 0x565088327400 2023-11-28T18:42:23.429 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.419+0000 7f46e3e20640 1 --2- 172.21.15.45:0/704110978 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565088327400 0x565087474680 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x565088386120 tx=0x565087488f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:23.429 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.419+0000 7f46de615640 1 -- 172.21.15.45:0/704110978 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x565087466dc0 con 0x565088327400 2023-11-28T18:42:23.429 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.419+0000 7f46de615640 1 -- 172.21.15.45:0/704110978 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5650881e1800 con 0x565088327400 2023-11-28T18:42:23.429 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.419+0000 7f46de615640 1 -- 172.21.15.45:0/704110978 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x565087466f20 con 0x565088327400 2023-11-28T18:42:23.430 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.419+0000 7f46e5e62280 1 -- 172.21.15.45:0/704110978 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56508743c000 con 0x565088327400 2023-11-28T18:42:23.430 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.419+0000 7f46e5e62280 1 -- 172.21.15.45:0/704110978 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56508743c9c0 con 0x565088327400 2023-11-28T18:42:23.430 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.419+0000 7f46de615640 1 -- 172.21.15.45:0/704110978 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x565087494840 con 0x565088327400 2023-11-28T18:42:23.430 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.419+0000 7f46de615640 1 --2- 172.21.15.45:0/704110978 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x5650876ed400 0x565087475700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:23.430 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.419+0000 7f46de615640 1 -- 172.21.15.45:0/704110978 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x565087448a80 con 0x565088327400 2023-11-28T18:42:23.434 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.419+0000 7f46e4e22640 1 --2- 172.21.15.45:0/704110978 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x5650876ed400 0x565087475700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:23.434 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.419+0000 7f46e4e22640 1 --2- 172.21.15.45:0/704110978 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x5650876ed400 0x565087475700 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x5650881c23f0 tx=0x5650881ce360 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:23.434 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.419+0000 7f46e5e62280 1 -- start start 2023-11-28T18:42:23.434 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.419+0000 7f46e5e62280 1 Processor -- start 2023-11-28T18:42:23.434 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.423+0000 7f46e5e62280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565088327c00 0x565087474100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:23.434 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.423+0000 7f46e5e62280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5650876ed800 0x565087473b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:23.434 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.423+0000 7f46e5e62280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5650876edc00 0x565087473600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:23.434 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.423+0000 7f46e5e62280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650874d6dc0 con 0x565088327c00 2023-11-28T18:42:23.435 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.423+0000 7f46e5e62280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650874d7180 con 0x5650876edc00 2023-11-28T18:42:23.435 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.423+0000 7f46e5e62280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x5650874d6b40 con 0x5650876ed800 2023-11-28T18:42:23.435 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.423+0000 7f46e4e22640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565088327c00 0x565087474100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:23.435 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.423+0000 7f46e4e22640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565088327c00 0x565087474100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57928/0 (socket says 172.21.15.45:57928) 2023-11-28T18:42:23.435 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.423+0000 7f46e4e22640 1 -- 172.21.15.45:0/1368257680 learned_addr learned my addr 172.21.15.45:0/1368257680 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:23.435 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.423+0000 7f46e4621640 1 --2- 172.21.15.45:0/1368257680 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5650876ed800 0x565087473b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:23.435 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.423+0000 7f46e3e20640 1 --2- 172.21.15.45:0/1368257680 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5650876edc00 0x565087473600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:23.435 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.423+0000 7f46e4e22640 1 -- 172.21.15.45:0/1368257680 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5650876ed800 msgr2=0x565087473b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:23.435 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.423+0000 7f46e4e22640 1 --2- 172.21.15.45:0/1368257680 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5650876ed800 0x565087473b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.436 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.423+0000 7f46e4e22640 1 -- 172.21.15.45:0/1368257680 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5650876edc00 msgr2=0x565087473600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:23.436 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.423+0000 7f46e4e22640 1 --2- 172.21.15.45:0/1368257680 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5650876edc00 0x565087473600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.436 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.423+0000 7f46e4e22640 1 -- 172.21.15.45:0/1368257680 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56508772b520 con 0x565088327c00 2023-11-28T18:42:23.436 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.423+0000 7f46e3e20640 1 --2- 172.21.15.45:0/1368257680 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5650876edc00 0x565087473600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:42:23.436 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.423+0000 7f46e4e22640 1 --2- 172.21.15.45:0/1368257680 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565088327c00 0x565087474100 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x5650883864b0 tx=0x5650881ce3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd53e994eacc3796 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:23.436 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.423+0000 7f46db60f640 1 -- 172.21.15.45:0/1368257680 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x565087467080 con 0x565088327c00 2023-11-28T18:42:23.436 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.423+0000 7f46db60f640 1 -- 172.21.15.45:0/1368257680 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5650881e0f00 con 0x565088327c00 2023-11-28T18:42:23.436 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.423+0000 7f46db60f640 1 -- 172.21.15.45:0/1368257680 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x565087466420 con 0x565088327c00 2023-11-28T18:42:23.436 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.423+0000 7f46e5e62280 1 -- 172.21.15.45:0/1368257680 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56508772b380 con 0x565088327c00 2023-11-28T18:42:23.436 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.423+0000 7f46e5e62280 1 -- 172.21.15.45:0/1368257680 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x56508772b1e0 con 0x565088327c00 2023-11-28T18:42:23.437 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.423+0000 7f46db60f640 1 -- 172.21.15.45:0/1368257680 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x565087448700 con 0x565088327c00 2023-11-28T18:42:23.437 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.423+0000 7f46db60f640 1 -- 172.21.15.45:0/1368257680 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 34) v1 ==== 3298+0+0 (secure 0 0 0) 0x565087840000 con 0x565088327c00 2023-11-28T18:42:23.437 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.423+0000 7f46e5e62280 1 --2- 172.21.15.45:0/1368257680 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x565087839000 0x565087850000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:23.437 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.423+0000 7f46e5e62280 1 -- 172.21.15.45:0/1368257680 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:1 6.f 6:f1f69726:::400.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x565087854000 con 0x565087839000 2023-11-28T18:42:23.437 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.423+0000 7f46e4621640 1 --2- 172.21.15.45:0/1368257680 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x565087839000 0x565087850000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:23.437 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.423+0000 7f46e4621640 1 --2- 172.21.15.45:0/1368257680 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x565087839000 0x565087850000 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=b5416d7d5ff3a5e4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:23.437 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.423+0000 7f46e4621640 1 -- 172.21.15.45:0/1368257680 <== osd.2 v2:172.21.15.45:6816/193884539 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x565088304b40 con 0x565087839000 2023-11-28T18:42:23.438 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.423+0000 7f46e5e62280 1 -- 172.21.15.45:0/1368257680 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:2 6.14 6:292cf221:::200.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49) v8 -- 0x565087854380 con 0x565087839000 2023-11-28T18:42:23.438 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.423+0000 7f46e4621640 1 -- 172.21.15.45:0/1368257680 <== osd.2 v2:172.21.15.45:6816/193884539 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv32 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x565088304b40 con 0x565087839000 2023-11-28T18:42:23.438 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.423+0000 7f46d9e0c640 1 -- 172.21.15.45:0/1368257680 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:3 6.14 6:2e2fa760:::200.00000001:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e49) v8 -- 0x565087854000 con 0x565087839000 2023-11-28T18:42:23.438 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.423+0000 7f46d9e0c640 1 --2- 172.21.15.45:0/1368257680 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x56508785c000 0x565087852680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:23.438 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.423+0000 7f46d9e0c640 1 -- 172.21.15.45:0/1368257680 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:4 6.1b 6:ddb4e4d7:::200.00000002:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e49) v8 -- 0x565087854380 con 0x56508785c000 2023-11-28T18:42:23.438 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.427+0000 7f46e4621640 1 -- 172.21.15.45:0/1368257680 <== osd.2 v2:172.21.15.45:6816/193884539 3 ==== osd_op_reply(3 200.00000001 [stat out=16b] v0'0 uv63 ondisk = 0) v8 ==== 156+0+16 (crc 0 0 0) 0x565088304b40 con 0x565087839000 2023-11-28T18:42:23.438 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.427+0000 7f46e3e20640 1 --2- 172.21.15.45:0/1368257680 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x56508785c000 0x565087852680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:23.438 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.427+0000 7f46e3e20640 1 --2- 172.21.15.45:0/1368257680 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x56508785c000 0x565087852680 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=5a55d35d87f954c9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:23.438 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.427+0000 7f46e3e20640 1 -- 172.21.15.45:0/1368257680 <== osd.3 v2:172.21.15.45:6824/78541084 1 ==== osd_op_reply(4 200.00000002 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x565088304d80 con 0x56508785c000 2023-11-28T18:42:23.439 INFO:tasks.workunit.client.0.smithi045.stdout:old journal was 4194304~34160 2023-11-28T18:42:23.439 INFO:tasks.workunit.client.0.smithi045.stdout:new journal start will be 8388608 (4160144 bytes past old end) 2023-11-28T18:42:23.439 INFO:tasks.workunit.client.0.smithi045.stdout:writing journal head 2023-11-28T18:42:23.439 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.427+0000 7f46e5e62280 1 -- 172.21.15.45:0/1368257680 --> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] -- osd_op(unknown.0.0:5 6.14 6:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x565087854700 con 0x565087839000 2023-11-28T18:42:23.439 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.427+0000 7f46e4621640 1 -- 172.21.15.45:0/1368257680 <== osd.2 v2:172.21.15.45:6816/193884539 4 ==== osd_op_reply(5 200.00000000 [writefull 0~90] v49'64 uv64 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x565088304b40 con 0x565087839000 2023-11-28T18:42:23.440 INFO:tasks.workunit.client.0.smithi045.stdout:writing EResetJournal entry 2023-11-28T18:42:23.441 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.427+0000 7f46e5e62280 1 -- 172.21.15.45:0/1368257680 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:6 6.1b 6:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x565087854e00 con 0x56508785c000 2023-11-28T18:42:23.442 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.427+0000 7f46e5e62280 1 -- 172.21.15.45:0/1368257680 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:7 6.b 6:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x565087855180 con 0x56508785c000 2023-11-28T18:42:23.442 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.427+0000 7f46e5e62280 1 -- 172.21.15.45:0/1368257680 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:8 6.1f 6:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x565087855500 con 0x56508785c000 2023-11-28T18:42:23.442 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.427+0000 7f46e5e62280 1 --2- 172.21.15.45:0/1368257680 >> [v2:172.21.15.190:6808/1537591987,v1:172.21.15.190:6809/1537591987] conn(0x565087839400 0x565087850580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:23.442 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.427+0000 7f46e5e62280 1 -- 172.21.15.45:0/1368257680 --> [v2:172.21.15.190:6808/1537591987,v1:172.21.15.190:6809/1537591987] -- osd_op(unknown.0.0:9 6.1a 6:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x565087855880 con 0x565087839400 2023-11-28T18:42:23.442 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.427+0000 7f46e5e62280 1 -- 172.21.15.45:0/1368257680 --> [v2:172.21.15.190:6808/1537591987,v1:172.21.15.190:6809/1537591987] -- osd_op(unknown.0.0:10 6.1e 6:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x565087854380 con 0x565087839400 2023-11-28T18:42:23.442 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.427+0000 7f46e5e62280 1 --2- 172.21.15.45:0/1368257680 >> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] conn(0x565087839800 0x565087850b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:23.442 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.427+0000 7f46e5e62280 1 -- 172.21.15.45:0/1368257680 --> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] -- osd_op(unknown.0.0:11 6.1d 6:bec1251c:::200.00000007:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x565087854e00 con 0x565087839800 2023-11-28T18:42:23.442 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.427+0000 7f46e4e22640 1 --2- 172.21.15.45:0/1368257680 >> [v2:172.21.15.190:6808/1537591987,v1:172.21.15.190:6809/1537591987] conn(0x565087839400 0x565087850580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:23.442 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.427+0000 7f46e4621640 1 --2- 172.21.15.45:0/1368257680 >> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] conn(0x565087839800 0x565087850b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:23.443 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.427+0000 7f46e4621640 1 --2- 172.21.15.45:0/1368257680 >> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] conn(0x565087839800 0x565087850b00 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=fa907f2ddedd2073 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:23.443 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.427+0000 7f46e4e22640 1 --2- 172.21.15.45:0/1368257680 >> [v2:172.21.15.190:6808/1537591987,v1:172.21.15.190:6809/1537591987] conn(0x565087839400 0x565087850580 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=a1670391de9d2f4e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:23.443 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.431+0000 7f46e3e20640 1 -- 172.21.15.45:0/1368257680 <== osd.3 v2:172.21.15.45:6824/78541084 2 ==== osd_op_reply(6 200.00000002 [delete] v49'7 uv5 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x565088304d80 con 0x56508785c000 2023-11-28T18:42:23.443 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.431+0000 7f46e3e20640 1 -- 172.21.15.45:0/1368257680 <== osd.3 v2:172.21.15.45:6824/78541084 3 ==== osd_op_reply(8 200.00000004 [delete] v49'20 uv19 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x565088304d80 con 0x56508785c000 2023-11-28T18:42:23.443 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.431+0000 7f46e3e20640 1 -- 172.21.15.45:0/1368257680 <== osd.3 v2:172.21.15.45:6824/78541084 4 ==== osd_op_reply(7 200.00000003 [delete] v49'5 uv1 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x565088304d80 con 0x56508785c000 2023-11-28T18:42:23.443 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.431+0000 7f46d9e0c640 1 -- 172.21.15.45:0/1368257680 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:12 6.1b 6:ddb4e4d7:::200.00000002:head [write 0~48 in=48b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x565087854a80 con 0x56508785c000 2023-11-28T18:42:23.443 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.431+0000 7f46e4621640 1 -- 172.21.15.45:0/1368257680 <== osd.1 v2:172.21.15.45:6800/2857063763 1 ==== osd_op_reply(11 200.00000007 [delete] v49'5 uv2 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x565088304b40 con 0x565087839800 2023-11-28T18:42:23.443 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.431+0000 7f46e4e22640 1 -- 172.21.15.45:0/1368257680 <== osd.4 v2:172.21.15.190:6808/1537591987 1 ==== osd_op_reply(10 200.00000006 [delete] v49'3 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x5650883058c0 con 0x565087839400 2023-11-28T18:42:23.443 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.431+0000 7f46e4e22640 1 -- 172.21.15.45:0/1368257680 <== osd.4 v2:172.21.15.190:6808/1537591987 2 ==== osd_op_reply(9 200.00000005 [delete] v49'3 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x5650883058c0 con 0x565087839400 2023-11-28T18:42:23.443 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.431+0000 7f46e3e20640 1 -- 172.21.15.45:0/1368257680 <== osd.3 v2:172.21.15.45:6824/78541084 5 ==== osd_op_reply(12 200.00000002 [write 0~48] v49'8 uv8 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x565088304d80 con 0x56508785c000 2023-11-28T18:42:23.444 INFO:tasks.workunit.client.0.smithi045.stdout:done 2023-11-28T18:42:23.446 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.431+0000 7f46e5e62280 1 -- 172.21.15.45:0/1368257680 >> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] conn(0x565087839800 msgr2=0x565087850b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:23.446 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.431+0000 7f46e5e62280 1 --2- 172.21.15.45:0/1368257680 >> [v2:172.21.15.45:6800/2857063763,v1:172.21.15.45:6801/2857063763] conn(0x565087839800 0x565087850b00 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.446 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.431+0000 7f46e5e62280 1 -- 172.21.15.45:0/1368257680 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x565087839000 msgr2=0x565087850000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:23.446 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.431+0000 7f46e5e62280 1 --2- 172.21.15.45:0/1368257680 >> [v2:172.21.15.45:6816/193884539,v1:172.21.15.45:6817/193884539] conn(0x565087839000 0x565087850000 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.447 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.431+0000 7f46e5e62280 1 -- 172.21.15.45:0/1368257680 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x56508785c000 msgr2=0x565087852680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:23.447 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.431+0000 7f46e5e62280 1 --2- 172.21.15.45:0/1368257680 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x56508785c000 0x565087852680 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.447 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.431+0000 7f46e5e62280 1 -- 172.21.15.45:0/1368257680 >> [v2:172.21.15.190:6808/1537591987,v1:172.21.15.190:6809/1537591987] conn(0x565087839400 msgr2=0x565087850580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:23.447 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.431+0000 7f46e5e62280 1 --2- 172.21.15.45:0/1368257680 >> [v2:172.21.15.190:6808/1537591987,v1:172.21.15.190:6809/1537591987] conn(0x565087839400 0x565087850580 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.447 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.431+0000 7f46e5e62280 1 -- 172.21.15.45:0/1368257680 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565088327c00 msgr2=0x565087474100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:23.447 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.431+0000 7f46e5e62280 1 --2- 172.21.15.45:0/1368257680 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565088327c00 0x565087474100 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x5650883864b0 tx=0x5650881ce3c0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.447 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.431+0000 7f46e4621640 1 -- 172.21.15.45:0/1368257680 reap_dead start 2023-11-28T18:42:23.447 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.431+0000 7f46e4621640 1 -- 172.21.15.45:0/1368257680 reap_dead start 2023-11-28T18:42:23.447 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.431+0000 7f46e5e62280 1 -- 172.21.15.45:0/1368257680 shutdown_connections 2023-11-28T18:42:23.447 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.431+0000 7f46e5e62280 1 -- 172.21.15.45:0/1368257680 >> 172.21.15.45:0/1368257680 conn(0x565088327800 msgr2=0x56508782a000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:23.448 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.431+0000 7f46e5e62280 1 -- 172.21.15.45:0/1368257680 shutdown_connections 2023-11-28T18:42:23.448 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.431+0000 7f46e5e62280 1 -- 172.21.15.45:0/1368257680 wait complete. 2023-11-28T18:42:23.448 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.431+0000 7f46e5e62280 1 -- 172.21.15.45:0/704110978 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x5650876ed400 msgr2=0x565087475700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:23.448 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.431+0000 7f46e5e62280 1 --2- 172.21.15.45:0/704110978 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x5650876ed400 0x565087475700 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x5650881c23f0 tx=0x5650881ce360 comp rx=0 tx=0).stop 2023-11-28T18:42:23.448 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.431+0000 7f46e5e62280 1 -- 172.21.15.45:0/704110978 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565088327400 msgr2=0x565087474680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:23.448 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.431+0000 7f46e5e62280 1 --2- 172.21.15.45:0/704110978 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565088327400 0x565087474680 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x565088386120 tx=0x565087488f00 comp rx=0 tx=0).stop 2023-11-28T18:42:23.448 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.431+0000 7f46e5e62280 1 -- 172.21.15.45:0/704110978 shutdown_connections 2023-11-28T18:42:23.448 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.431+0000 7f46e5e62280 1 --2- 172.21.15.45:0/704110978 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x5650876ed400 0x565087475700 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.448 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.431+0000 7f46e5e62280 1 --2- 172.21.15.45:0/704110978 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565088327400 0x565087474680 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.448 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.431+0000 7f46e5e62280 1 --2- 172.21.15.45:0/704110978 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x565088327000 0x565087474c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.449 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.431+0000 7f46e5e62280 1 --2- 172.21.15.45:0/704110978 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x565088326c00 0x565087475180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.449 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.431+0000 7f46e5e62280 1 -- 172.21.15.45:0/704110978 >> 172.21.15.45:0/704110978 conn(0x565087406c00 msgr2=0x565087435800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:23.449 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.431+0000 7f46e5e62280 1 -- 172.21.15.45:0/704110978 shutdown_connections 2023-11-28T18:42:23.449 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.431+0000 7f46e5e62280 1 -- 172.21.15.45:0/704110978 wait complete. 2023-11-28T18:42:23.449 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.431+0000 7f46e5e62280 1 -- 172.21.15.45:0/3237196743 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565087407400 msgr2=0x565087472b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:23.449 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.431+0000 7f46e5e62280 1 --2- 172.21.15.45:0/3237196743 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565087407400 0x565087472b00 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x5650881c2de0 tx=0x56508818f320 comp rx=0 tx=0).stop 2023-11-28T18:42:23.449 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.431+0000 7f46e5e62280 1 -- 172.21.15.45:0/3237196743 shutdown_connections 2023-11-28T18:42:23.449 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.431+0000 7f46e5e62280 1 --2- 172.21.15.45:0/3237196743 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x565087407000 0x565087473080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.449 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.431+0000 7f46e5e62280 1 --2- 172.21.15.45:0/3237196743 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565087407400 0x565087472b00 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.449 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.431+0000 7f46e5e62280 1 --2- 172.21.15.45:0/3237196743 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x565087407800 0x565087472580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.450 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.431+0000 7f46e5e62280 1 -- 172.21.15.45:0/3237196743 >> 172.21.15.45:0/3237196743 conn(0x565087407c00 msgr2=0x565087435000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:23.450 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.431+0000 7f46e5e62280 1 -- 172.21.15.45:0/3237196743 shutdown_connections 2023-11-28T18:42:23.450 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.431+0000 7f46e5e62280 1 -- 172.21.15.45:0/3237196743 wait complete. 2023-11-28T18:42:23.450 INFO:tasks.workunit.client.0.smithi045.stderr:+ cephfs-table-tool all reset session 2023-11-28T18:42:23.481 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.475+0000 7f3665277280 1 -- start start 2023-11-28T18:42:23.482 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.479+0000 7f3665277280 1 Processor -- start 2023-11-28T18:42:23.484 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.479+0000 7f3665277280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e7612d5800 0x55e761340580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:23.485 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.479+0000 7f3665277280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e7612d5400 0x55e761340b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:23.485 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.479+0000 7f3665277280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7612d5000 0x55e761341080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:23.485 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.479+0000 7f3665277280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e76131b180 con 0x55e7612d5000 2023-11-28T18:42:23.485 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.479+0000 7f3665277280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e76131a140 con 0x55e7612d5800 2023-11-28T18:42:23.485 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.479+0000 7f3665277280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e76131a000 con 0x55e7612d5400 2023-11-28T18:42:23.485 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.479+0000 7f3664237640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7612d5000 0x55e761341080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:23.485 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.479+0000 7f3664237640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7612d5000 0x55e761341080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57942/0 (socket says 172.21.15.45:57942) 2023-11-28T18:42:23.485 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.479+0000 7f3664237640 1 -- 172.21.15.45:0/735007852 learned_addr learned my addr 172.21.15.45:0/735007852 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:23.485 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.479+0000 7f3663235640 1 --2- 172.21.15.45:0/735007852 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e7612d5400 0x55e761340b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:23.486 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.479+0000 7f3663a36640 1 --2- 172.21.15.45:0/735007852 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e7612d5800 0x55e761340580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:23.486 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.479+0000 7f3664237640 1 -- 172.21.15.45:0/735007852 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e7612d5400 msgr2=0x55e761340b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:23.486 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.479+0000 7f3664237640 1 --2- 172.21.15.45:0/735007852 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e7612d5400 0x55e761340b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.486 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.479+0000 7f3664237640 1 -- 172.21.15.45:0/735007852 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e7612d5800 msgr2=0x55e761340580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:23.486 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.479+0000 7f3664237640 1 --2- 172.21.15.45:0/735007852 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e7612d5800 0x55e761340580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.486 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.479+0000 7f3664237640 1 -- 172.21.15.45:0/735007852 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e76130a9c0 con 0x55e7612d5000 2023-11-28T18:42:23.486 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.479+0000 7f3663a36640 1 --2- 172.21.15.45:0/735007852 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e7612d5800 0x55e761340580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:42:23.486 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.479+0000 7f3664237640 1 --2- 172.21.15.45:0/735007852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7612d5000 0x55e761341080 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x55e7621de720 tx=0x55e761356720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21727b174014ff5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:23.486 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.479+0000 7f3661231640 1 -- 172.21.15.45:0/735007852 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55e7613351e0 con 0x55e7612d5000 2023-11-28T18:42:23.487 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.479+0000 7f3661231640 1 -- 172.21.15.45:0/735007852 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e761330180 con 0x55e7612d5000 2023-11-28T18:42:23.487 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.479+0000 7f3661231640 1 -- 172.21.15.45:0/735007852 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55e761335080 con 0x55e7612d5000 2023-11-28T18:42:23.487 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.479+0000 7f3665277280 1 -- 172.21.15.45:0/735007852 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e76130ab60 con 0x55e7612d5000 2023-11-28T18:42:23.487 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.479+0000 7f3665277280 1 -- 172.21.15.45:0/735007852 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55e76130a340 con 0x55e7612d5000 2023-11-28T18:42:23.487 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.479+0000 7f3661231640 1 -- 172.21.15.45:0/735007852 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x55e761316c40 con 0x55e7612d5000 2023-11-28T18:42:23.487 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.479+0000 7f3661231640 1 -- 172.21.15.45:0/735007852 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 34) v1 ==== 3298+0+0 (secure 0 0 0) 0x55e761322f00 con 0x55e7612d5000 2023-11-28T18:42:23.487 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.479+0000 7f3665277280 1 Processor -- start 2023-11-28T18:42:23.487 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.479+0000 7f3665277280 1 -- start start 2023-11-28T18:42:23.493 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.483+0000 7f3665277280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7621e8c00 0x55e761341600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:23.493 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.483+0000 7f3665277280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e7621e9000 0x55e761341b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:23.494 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.483+0000 7f3665277280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e7621e9400 0x55e761342100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:23.494 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.483+0000 7f3665277280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e76131aa00 con 0x55e7621e8c00 2023-11-28T18:42:23.494 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.483+0000 7f3665277280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7613a5180 con 0x55e7621e9000 2023-11-28T18:42:23.494 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.483+0000 7f3665277280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e7613a4dc0 con 0x55e7621e9400 2023-11-28T18:42:23.494 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.483+0000 7f3663a36640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e7621e9000 0x55e761341b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:23.494 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.483+0000 7f3663235640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7621e8c00 0x55e761341600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:23.494 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.483+0000 7f3663a36640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e7621e9000 0x55e761341b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.45:38586/0 (socket says 172.21.15.45:38586) 2023-11-28T18:42:23.494 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.483+0000 7f3663a36640 1 -- 172.21.15.45:0/1547816167 learned_addr learned my addr 172.21.15.45:0/1547816167 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:23.494 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.483+0000 7f3663235640 1 --2- 172.21.15.45:0/1547816167 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e7621e9400 0x55e761342100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:23.495 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.483+0000 7f3663a36640 1 -- 172.21.15.45:0/1547816167 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e7621e9400 msgr2=0x55e761342100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:23.495 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.483+0000 7f3663a36640 1 --2- 172.21.15.45:0/1547816167 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e7621e9400 0x55e761342100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.495 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.483+0000 7f3663a36640 1 -- 172.21.15.45:0/1547816167 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7621e8c00 msgr2=0x55e761341600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:23.495 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.483+0000 7f3663a36640 1 --2- 172.21.15.45:0/1547816167 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7621e8c00 0x55e761341600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.495 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.483+0000 7f3663a36640 1 -- 172.21.15.45:0/1547816167 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e76130a000 con 0x55e7621e9000 2023-11-28T18:42:23.495 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.483+0000 7f3663235640 1 --2- 172.21.15.45:0/1547816167 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e7621e9400 0x55e761342100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:42:23.495 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.483+0000 7f3663a36640 1 --2- 172.21.15.45:0/1547816167 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e7621e9000 0x55e761341b80 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x55e7621dfb90 tx=0x55e7615b4000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b21785e8045530ee server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:23.495 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.483+0000 7f365f22d640 1 -- 172.21.15.45:0/1547816167 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55e7613351e0 con 0x55e7621e9000 2023-11-28T18:42:23.495 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.483+0000 7f365f22d640 1 -- 172.21.15.45:0/1547816167 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e7620b8f00 con 0x55e7621e9000 2023-11-28T18:42:23.495 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.483+0000 7f365f22d640 1 -- 172.21.15.45:0/1547816167 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55e761335080 con 0x55e7621e9000 2023-11-28T18:42:23.496 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.483+0000 7f3665277280 1 -- 172.21.15.45:0/1547816167 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e7621e9000 msgr2=0x55e761341b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:23.496 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.483+0000 7f3665277280 1 --2- 172.21.15.45:0/1547816167 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e7621e9000 0x55e761341b80 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x55e7621dfb90 tx=0x55e7615b4000 comp rx=0 tx=0).stop 2023-11-28T18:42:23.496 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.483+0000 7f3665277280 1 -- 172.21.15.45:0/1547816167 shutdown_connections 2023-11-28T18:42:23.496 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.483+0000 7f3665277280 1 --2- 172.21.15.45:0/1547816167 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e7621e9400 0x55e761342100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.496 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.483+0000 7f3665277280 1 --2- 172.21.15.45:0/1547816167 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e7621e9000 0x55e761341b80 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.496 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.483+0000 7f3665277280 1 --2- 172.21.15.45:0/1547816167 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7621e8c00 0x55e761341600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.496 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.483+0000 7f3665277280 1 -- 172.21.15.45:0/1547816167 >> 172.21.15.45:0/1547816167 conn(0x55e7612d4c00 msgr2=0x55e761303800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:23.496 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.483+0000 7f3665277280 1 -- 172.21.15.45:0/1547816167 shutdown_connections 2023-11-28T18:42:23.496 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.483+0000 7f3665277280 1 -- 172.21.15.45:0/1547816167 wait complete. 2023-11-28T18:42:23.496 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.483+0000 7f3665277280 1 Processor -- start 2023-11-28T18:42:23.497 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.483+0000 7f3665277280 1 -- start start 2023-11-28T18:42:23.497 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.483+0000 7f3665277280 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e7621e8c00 0x55e761343180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:23.497 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.483+0000 7f3665277280 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e7621e9000 0x55e761342c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:23.497 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.483+0000 7f3665277280 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7621e9400 0x55e761342680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:23.497 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.483+0000 7f3665277280 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7613a4c80 con 0x55e7621e9400 2023-11-28T18:42:23.497 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.483+0000 7f3665277280 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e76131a140 con 0x55e7621e9000 2023-11-28T18:42:23.497 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.483+0000 7f3665277280 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e76131ab40 con 0x55e7621e8c00 2023-11-28T18:42:23.497 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.483+0000 7f3663a36640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e7621e9000 0x55e761342c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:23.497 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.483+0000 7f3663a36640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e7621e9000 0x55e761342c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.45:38592/0 (socket says 172.21.15.45:38592) 2023-11-28T18:42:23.498 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.483+0000 7f3663a36640 1 -- 172.21.15.45:0/2117938250 learned_addr learned my addr 172.21.15.45:0/2117938250 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:23.498 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.483+0000 7f3663235640 1 --2- 172.21.15.45:0/2117938250 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e7621e8c00 0x55e761343180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:23.498 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.483+0000 7f3663235640 1 --2- 172.21.15.45:0/2117938250 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7621e9400 0x55e761342680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:23.498 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.487+0000 7f3663235640 1 -- 172.21.15.45:0/2117938250 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e7621e8c00 msgr2=0x55e761343180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:23.498 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.487+0000 7f3663235640 1 --2- 172.21.15.45:0/2117938250 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e7621e8c00 0x55e761343180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.498 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.487+0000 7f3663235640 1 -- 172.21.15.45:0/2117938250 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e7621e9000 msgr2=0x55e761342c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:23.498 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.487+0000 7f3663235640 1 --2- 172.21.15.45:0/2117938250 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e7621e9000 0x55e761342c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.498 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.487+0000 7f3663235640 1 -- 172.21.15.45:0/2117938250 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e76130a9c0 con 0x55e7621e9400 2023-11-28T18:42:23.498 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.487+0000 7f3663a36640 1 --2- 172.21.15.45:0/2117938250 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e7621e9000 0x55e761342c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:42:23.499 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.487+0000 7f3663235640 1 --2- 172.21.15.45:0/2117938250 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7621e9400 0x55e761342680 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x55e76224ed80 tx=0x55e7620a4360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:23.499 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.487+0000 7f365da2a640 1 -- 172.21.15.45:0/2117938250 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55e761334f20 con 0x55e7621e9400 2023-11-28T18:42:23.499 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.487+0000 7f365da2a640 1 -- 172.21.15.45:0/2117938250 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e7620b8300 con 0x55e7621e9400 2023-11-28T18:42:23.499 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.487+0000 7f365da2a640 1 -- 172.21.15.45:0/2117938250 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55e7613351e0 con 0x55e7621e9400 2023-11-28T18:42:23.499 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.487+0000 7f3665277280 1 -- 172.21.15.45:0/2117938250 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e76130ab60 con 0x55e7621e9400 2023-11-28T18:42:23.499 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.487+0000 7f3665277280 1 -- 172.21.15.45:0/2117938250 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e76130a340 con 0x55e7621e9400 2023-11-28T18:42:23.499 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.487+0000 7f365da2a640 1 -- 172.21.15.45:0/2117938250 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x55e761339080 con 0x55e7621e9400 2023-11-28T18:42:23.499 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.487+0000 7f365da2a640 1 --2- 172.21.15.45:0/2117938250 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x55e76225d000 0x55e761343700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:23.499 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.487+0000 7f365da2a640 1 -- 172.21.15.45:0/2117938250 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x55e761316a80 con 0x55e7621e9400 2023-11-28T18:42:23.499 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.487+0000 7f3665277280 1 --2- 172.21.15.45:0/2117938250 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x55e7621e9800 0x55e761342100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:23.500 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.487+0000 7f3665277280 1 -- 172.21.15.45:0/2117938250 --> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] -- osd_op(unknown.0.0:1 6.b 6:d0630e4c:::mds0_sessionmap:head [omap-clear,omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) v8 -- 0x55e76132b880 con 0x55e7621e9800 2023-11-28T18:42:23.500 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.487+0000 7f3663a36640 1 --2- 172.21.15.45:0/2117938250 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x55e76225d000 0x55e761343700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:23.500 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.487+0000 7f3663235640 1 --2- 172.21.15.45:0/2117938250 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x55e7621e9800 0x55e761342100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:23.500 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.491+0000 7f3663a36640 1 --2- 172.21.15.45:0/2117938250 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x55e76225d000 0x55e761343700 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x55e76224ec30 tx=0x55e7620a4120 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:23.500 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.491+0000 7f3663235640 1 --2- 172.21.15.45:0/2117938250 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x55e7621e9800 0x55e761342100 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:23.501 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.491+0000 7f3663235640 1 -- 172.21.15.45:0/2117938250 <== osd.3 v2:172.21.15.45:6824/78541084 1 ==== osd_op_reply(1 mds0_sessionmap [omap-clear,omap-set-header] v49'6 uv6 ondisk = 0) v8 ==== 201+0+0 (crc 0 0 0) 0x55e7621dcb40 con 0x55e7621e9800 2023-11-28T18:42:23.501 INFO:tasks.workunit.client.0.smithi045.stdout:{ 2023-11-28T18:42:23.501 INFO:tasks.workunit.client.0.smithi045.stdout: "0": { 2023-11-28T18:42:23.501 INFO:tasks.workunit.client.0.smithi045.stdout: "data": {}, 2023-11-28T18:42:23.501 INFO:tasks.workunit.client.0.smithi045.stdout: "result": 0 2023-11-28T18:42:23.502 INFO:tasks.workunit.client.0.smithi045.stdout: } 2023-11-28T18:42:23.502 INFO:tasks.workunit.client.0.smithi045.stdout:} 2023-11-28T18:42:23.502 INFO:tasks.workunit.client.0.smithi045.stdout: 2023-11-28T18:42:23.504 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.491+0000 7f3665277280 1 -- 172.21.15.45:0/2117938250 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x55e7621e9800 msgr2=0x55e761342100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:23.504 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.491+0000 7f3665277280 1 --2- 172.21.15.45:0/2117938250 >> [v2:172.21.15.45:6824/78541084,v1:172.21.15.45:6825/78541084] conn(0x55e7621e9800 0x55e761342100 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.504 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.491+0000 7f3665277280 1 -- 172.21.15.45:0/2117938250 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x55e76225d000 msgr2=0x55e761343700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:23.504 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.491+0000 7f3665277280 1 --2- 172.21.15.45:0/2117938250 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x55e76225d000 0x55e761343700 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x55e76224ec30 tx=0x55e7620a4120 comp rx=0 tx=0).stop 2023-11-28T18:42:23.504 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.491+0000 7f3665277280 1 -- 172.21.15.45:0/2117938250 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7621e9400 msgr2=0x55e761342680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:23.504 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.491+0000 7f3665277280 1 --2- 172.21.15.45:0/2117938250 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7621e9400 0x55e761342680 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x55e76224ed80 tx=0x55e7620a4360 comp rx=0 tx=0).stop 2023-11-28T18:42:23.504 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.491+0000 7f3663a36640 1 -- 172.21.15.45:0/2117938250 reap_dead start 2023-11-28T18:42:23.504 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.491+0000 7f3665277280 1 -- 172.21.15.45:0/2117938250 shutdown_connections 2023-11-28T18:42:23.505 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.491+0000 7f3665277280 1 -- 172.21.15.45:0/2117938250 >> 172.21.15.45:0/2117938250 conn(0x55e7612d4c00 msgr2=0x55e761303800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:23.505 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.491+0000 7f3665277280 1 -- 172.21.15.45:0/2117938250 shutdown_connections 2023-11-28T18:42:23.505 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.491+0000 7f3665277280 1 -- 172.21.15.45:0/2117938250 wait complete. 2023-11-28T18:42:23.505 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.491+0000 7f3665277280 1 -- 172.21.15.45:0/735007852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7612d5000 msgr2=0x55e761341080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:23.505 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.491+0000 7f3665277280 1 --2- 172.21.15.45:0/735007852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7612d5000 0x55e761341080 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x55e7621de720 tx=0x55e761356720 comp rx=0 tx=0).stop 2023-11-28T18:42:23.505 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.491+0000 7f3665277280 1 -- 172.21.15.45:0/735007852 shutdown_connections 2023-11-28T18:42:23.505 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.491+0000 7f3665277280 1 --2- 172.21.15.45:0/735007852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7612d5000 0x55e761341080 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.505 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.491+0000 7f3665277280 1 --2- 172.21.15.45:0/735007852 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e7612d5400 0x55e761340b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.505 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.491+0000 7f3665277280 1 --2- 172.21.15.45:0/735007852 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e7612d5800 0x55e761340580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:23.505 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.491+0000 7f3665277280 1 -- 172.21.15.45:0/735007852 >> 172.21.15.45:0/735007852 conn(0x55e7612d5c00 msgr2=0x55e761303000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:23.506 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.491+0000 7f3665277280 1 -- 172.21.15.45:0/735007852 shutdown_connections 2023-11-28T18:42:23.506 INFO:tasks.workunit.client.0.smithi045.stderr:2023-11-28T18:42:23.491+0000 7f3665277280 1 -- 172.21.15.45:0/735007852 wait complete. 2023-11-28T18:42:23.506 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-11-28T18:42:23.506 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-11-28T18:42:23.571 INFO:tasks.workunit:Stopping ['suites/cephfs_journal_tool_smoke.sh'] on client.0... 2023-11-28T18:42:23.571 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-11-28T18:42:24.010 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:42:24.016 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:42:24.423 DEBUG:teuthology.parallel:result is None 2023-11-28T18:42:24.424 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2023-11-28T18:42:24.445 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2023-11-28T18:42:24.445 DEBUG:teuthology.orchestra.run.smithi045:> rmdir -- /home/ubuntu/cephtest/mnt.0 2023-11-28T18:42:24.501 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2023-11-28T18:42:24.501 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2023-11-28T18:42:24.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:24.691+0000 7fac9b3d8640 1 Processor -- start 2023-11-28T18:42:24.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:24.691+0000 7fac9b3d8640 1 -- start start 2023-11-28T18:42:24.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:24.691+0000 7fac9b3d8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fac9414b220 0x7fac940b3e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:24.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:24.691+0000 7fac9b3d8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fac940b4390 0x7fac94070430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:24.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:24.691+0000 7fac9b3d8640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac940b2000 con 0x7fac9414ac20 2023-11-28T18:42:24.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:24.691+0000 7fac9b3d8640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac94166170 con 0x7fac9414b220 2023-11-28T18:42:24.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:24.691+0000 7fac9b3d8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac940b4800 con 0x7fac940b4390 2023-11-28T18:42:24.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:24.691+0000 7fac99174640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fac9414ac20 0x7fac94165a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:58256/0 (socket says 172.21.15.45:58256) 2023-11-28T18:42:24.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:24.691+0000 7fac99174640 1 -- 172.21.15.45:0/3785202206 learned_addr learned my addr 172.21.15.45:0/3785202206 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:42:24.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:24.691+0000 7fac98973640 1 --2- 172.21.15.45:0/3785202206 >> v2:172.21.15.45:3300/0 conn(0x7fac9414b220 0x7fac940b3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:24.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:24.691+0000 7fac99975640 1 --2- 172.21.15.45:0/3785202206 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fac940b4390 0x7fac94070430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:24.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:24.691+0000 7fac8bfff640 1 -- 172.21.15.45:0/3785202206 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4061060076 0 0) 0x7fac940b2000 con 0x7fac9414ac20 2023-11-28T18:42:24.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:24.691+0000 7fac8bfff640 1 -- 172.21.15.45:0/3785202206 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac80003530 con 0x7fac9414ac20 2023-11-28T18:42:24.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:24.691+0000 7fac98973640 1 -- 172.21.15.45:0/3785202206 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fac940b4390 msgr2=0x7fac94070430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:24.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:24.691+0000 7fac98973640 1 --2- 172.21.15.45:0/3785202206 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fac940b4390 0x7fac94070430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:24.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:24.691+0000 7fac98973640 1 -- 172.21.15.45:0/3785202206 >> v1:172.21.15.45:6789/0 conn(0x7fac9414ac20 legacy=0x7fac94165a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:24.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:24.691+0000 7fac98973640 1 -- 172.21.15.45:0/3785202206 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac940b22a0 con 0x7fac9414b220 2023-11-28T18:42:24.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:24.695+0000 7fac98973640 1 --2- 172.21.15.45:0/3785202206 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac9414b220 0x7fac940b3e50 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fac840097f0 tx=0x7fac8401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddd49f746d122935 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:24.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:24.695+0000 7fac8bfff640 1 -- 172.21.15.45:0/3785202206 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac840ab650 con 0x7fac9414b220 2023-11-28T18:42:24.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:24.695+0000 7fac8bfff640 1 -- 172.21.15.45:0/3785202206 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac840ab7b0 con 0x7fac9414b220 2023-11-28T18:42:24.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:24.695+0000 7fac8bfff640 1 -- 172.21.15.45:0/3785202206 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac840abb40 con 0x7fac9414b220 2023-11-28T18:42:24.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:24.695+0000 7fac9b3d8640 1 -- 172.21.15.45:0/3785202206 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac9414b220 msgr2=0x7fac940b3e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:24.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:24.695+0000 7fac9b3d8640 1 --2- 172.21.15.45:0/3785202206 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac9414b220 0x7fac940b3e50 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fac840097f0 tx=0x7fac8401c450 comp rx=0 tx=0).stop 2023-11-28T18:42:24.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:24.695+0000 7fac9b3d8640 1 -- 172.21.15.45:0/3785202206 shutdown_connections 2023-11-28T18:42:24.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:24.695+0000 7fac9b3d8640 1 --2- 172.21.15.45:0/3785202206 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fac940b4390 0x7fac94070430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:24.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:24.695+0000 7fac9b3d8640 1 --2- 172.21.15.45:0/3785202206 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac9414b220 0x7fac940b3e50 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:24.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:24.695+0000 7fac9b3d8640 1 -- 172.21.15.45:0/3785202206 >> 172.21.15.45:0/3785202206 conn(0x7fac940b0d00 msgr2=0x7fac940b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:24.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:24.695+0000 7fac9b3d8640 1 -- 172.21.15.45:0/3785202206 shutdown_connections 2023-11-28T18:42:24.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:24.695+0000 7fac9b3d8640 1 -- 172.21.15.45:0/3785202206 wait complete. 2023-11-28T18:42:24.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:24.699+0000 7fac9b3d8640 1 Processor -- start 2023-11-28T18:42:24.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:24.699+0000 7fac9b3d8640 1 -- start start 2023-11-28T18:42:24.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:24.699+0000 7fac9b3d8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fac940b4390 0x7fac94147d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:24.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:24.699+0000 7fac9b3d8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac9414ac20 0x7fac94142de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:24.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:24.699+0000 7fac9b3d8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fac94143f00 0x7fac94143320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:24.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:24.699+0000 7fac9b3d8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac9416c360 con 0x7fac9414ac20 2023-11-28T18:42:24.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:24.699+0000 7fac9b3d8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac9415ec70 con 0x7fac940b4390 2023-11-28T18:42:24.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:24.699+0000 7fac9b3d8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac9416bd10 con 0x7fac94143f00 2023-11-28T18:42:24.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:24.699+0000 7fac98973640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac9414ac20 0x7fac94142de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:24.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:24.699+0000 7fac98973640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac9414ac20 0x7fac94142de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57974/0 (socket says 172.21.15.45:57974) 2023-11-28T18:42:24.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:24.699+0000 7fac98973640 1 -- 172.21.15.45:0/2418758060 learned_addr learned my addr 172.21.15.45:0/2418758060 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:24.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:24.699+0000 7fac99975640 1 --2- 172.21.15.45:0/2418758060 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fac94143f00 0x7fac94143320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:24.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:24.699+0000 7fac99174640 1 --2- 172.21.15.45:0/2418758060 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fac940b4390 0x7fac94147d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:24.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:24.699+0000 7fac98973640 1 -- 172.21.15.45:0/2418758060 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fac94143f00 msgr2=0x7fac94143320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:24.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:24.699+0000 7fac98973640 1 --2- 172.21.15.45:0/2418758060 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fac94143f00 0x7fac94143320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:24.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:24.699+0000 7fac98973640 1 -- 172.21.15.45:0/2418758060 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fac940b4390 msgr2=0x7fac94147d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:24.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:24.699+0000 7fac98973640 1 --2- 172.21.15.45:0/2418758060 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fac940b4390 0x7fac94147d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:24.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:24.699+0000 7fac98973640 1 -- 172.21.15.45:0/2418758060 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac84009420 con 0x7fac9414ac20 2023-11-28T18:42:24.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:24.699+0000 7fac98973640 1 --2- 172.21.15.45:0/2418758060 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac9414ac20 0x7fac94142de0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fac8401a080 tx=0x7fac8401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:24.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:24.699+0000 7fac89ffb640 1 -- 172.21.15.45:0/2418758060 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac840bf610 con 0x7fac9414ac20 2023-11-28T18:42:24.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:24.699+0000 7fac89ffb640 1 -- 172.21.15.45:0/2418758060 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac840bf770 con 0x7fac9414ac20 2023-11-28T18:42:24.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:24.699+0000 7fac89ffb640 1 -- 172.21.15.45:0/2418758060 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac840bfb20 con 0x7fac9414ac20 2023-11-28T18:42:24.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:24.699+0000 7fac9b3d8640 1 -- 172.21.15.45:0/2418758060 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac9416bff0 con 0x7fac9414ac20 2023-11-28T18:42:24.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:24.699+0000 7fac9b3d8640 1 -- 172.21.15.45:0/2418758060 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac941439b0 con 0x7fac9414ac20 2023-11-28T18:42:24.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:24.699+0000 7fac9b3d8640 1 -- 172.21.15.45:0/2418758060 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac9416c180 con 0x7fac9414ac20 2023-11-28T18:42:24.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:24.703+0000 7fac89ffb640 1 -- 172.21.15.45:0/2418758060 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fac840bfc80 con 0x7fac9414ac20 2023-11-28T18:42:24.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:24.703+0000 7fac89ffb640 1 --2- 172.21.15.45:0/2418758060 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fac780668d0 0x7fac78068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:24.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:24.703+0000 7fac89ffb640 1 -- 172.21.15.45:0/2418758060 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fac8411f070 con 0x7fac9414ac20 2023-11-28T18:42:24.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:24.703+0000 7fac99174640 1 --2- 172.21.15.45:0/2418758060 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fac780668d0 0x7fac78068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:24.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:24.703+0000 7fac99174640 1 --2- 172.21.15.45:0/2418758060 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fac780668d0 0x7fac78068d90 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fac90005890 tx=0x7fac90009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:24.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:24.707+0000 7fac89ffb640 1 -- 172.21.15.45:0/2418758060 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fac840ec330 con 0x7fac9414ac20 2023-11-28T18:42:24.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:24.895+0000 7fac9b3d8640 1 -- 172.21.15.45:0/2418758060 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7fac9416be50 con 0x7fac9414ac20 2023-11-28T18:42:25.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.199+0000 7fac89ffb640 1 -- 172.21.15.45:0/2418758060 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v35) v1 ==== 162+0+0 (secure 0 0 0) 0x7fac9416be50 con 0x7fac9414ac20 2023-11-28T18:42:25.202 INFO:teuthology.orchestra.run.smithi045.stderr:cephfs marked joinable; MDS may join as newly active. 2023-11-28T18:42:25.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.199+0000 7fac9b3d8640 1 -- 172.21.15.45:0/2418758060 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fac780668d0 msgr2=0x7fac78068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:25.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.199+0000 7fac9b3d8640 1 --2- 172.21.15.45:0/2418758060 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fac780668d0 0x7fac78068d90 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fac90005890 tx=0x7fac90009040 comp rx=0 tx=0).stop 2023-11-28T18:42:25.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.199+0000 7fac9b3d8640 1 -- 172.21.15.45:0/2418758060 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac9414ac20 msgr2=0x7fac94142de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:25.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.199+0000 7fac9b3d8640 1 --2- 172.21.15.45:0/2418758060 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac9414ac20 0x7fac94142de0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fac8401a080 tx=0x7fac8401ac90 comp rx=0 tx=0).stop 2023-11-28T18:42:25.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.199+0000 7fac9b3d8640 1 -- 172.21.15.45:0/2418758060 shutdown_connections 2023-11-28T18:42:25.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.199+0000 7fac9b3d8640 1 --2- 172.21.15.45:0/2418758060 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fac780668d0 0x7fac78068d90 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:25.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.199+0000 7fac9b3d8640 1 --2- 172.21.15.45:0/2418758060 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fac94143f00 0x7fac94143320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:25.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.199+0000 7fac9b3d8640 1 --2- 172.21.15.45:0/2418758060 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac9414ac20 0x7fac94142de0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:25.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.199+0000 7fac9b3d8640 1 --2- 172.21.15.45:0/2418758060 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fac940b4390 0x7fac94147d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:25.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.199+0000 7fac9b3d8640 1 -- 172.21.15.45:0/2418758060 >> 172.21.15.45:0/2418758060 conn(0x7fac940b0d00 msgr2=0x7fac940cd990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:25.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.199+0000 7fac9b3d8640 1 -- 172.21.15.45:0/2418758060 shutdown_connections 2023-11-28T18:42:25.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.199+0000 7fac9b3d8640 1 -- 172.21.15.45:0/2418758060 wait complete. 2023-11-28T18:42:25.228 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T18:42:25.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.367+0000 7efc4412a640 1 Processor -- start 2023-11-28T18:42:25.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.367+0000 7efc4412a640 1 -- start start 2023-11-28T18:42:25.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.371+0000 7efc4412a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7efc3c144880 0x7efc3c06c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:25.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.371+0000 7efc4412a640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7efc3c0721c0 0x7efc3c06c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:25.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.371+0000 7efc4412a640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc3c071120 con 0x7efc3c0704a0 2023-11-28T18:42:25.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.371+0000 7efc4412a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc3c15f050 con 0x7efc3c144880 2023-11-28T18:42:25.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.371+0000 7efc4412a640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc3c071400 con 0x7efc3c0721c0 2023-11-28T18:42:25.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.371+0000 7efc41ec6640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7efc3c144880 0x7efc3c06c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:25.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.371+0000 7efc41ec6640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7efc3c144880 0x7efc3c06c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57978/0 (socket says 172.21.15.45:57978) 2023-11-28T18:42:25.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.371+0000 7efc41ec6640 1 -- 172.21.15.45:0/3406736955 learned_addr learned my addr 172.21.15.45:0/3406736955 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:25.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.371+0000 7efc41ec6640 1 -- 172.21.15.45:0/3406736955 >> v2:172.21.15.190:3300/0 conn(0x7efc3c0721c0 msgr2=0x7efc3c06c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:25.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.371+0000 7efc416c5640 1 --2- 172.21.15.45:0/3406736955 >> v2:172.21.15.190:3300/0 conn(0x7efc3c0721c0 0x7efc3c06c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:25.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.371+0000 7efc41ec6640 1 --2- 172.21.15.45:0/3406736955 >> v2:172.21.15.190:3300/0 conn(0x7efc3c0721c0 0x7efc3c06c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:25.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.371+0000 7efc41ec6640 1 -- 172.21.15.45:0/3406736955 >> v1:172.21.15.190:6789/0 conn(0x7efc3c0704a0 legacy=0x7efc3c070950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:25.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.371+0000 7efc41ec6640 1 -- 172.21.15.45:0/3406736955 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc3c0716e0 con 0x7efc3c144880 2023-11-28T18:42:25.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.371+0000 7efc416c5640 1 --2- 172.21.15.45:0/3406736955 >> v2:172.21.15.190:3300/0 conn(0x7efc3c0721c0 0x7efc3c06c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:42:25.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.375+0000 7efc41ec6640 1 --2- 172.21.15.45:0/3406736955 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc3c144880 0x7efc3c06c300 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7efc3c06d180 tx=0x7efc3801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45c1c5f55250e5f8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:25.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.375+0000 7efc40ec4640 1 -- 172.21.15.45:0/3406736955 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc380aa5f0 con 0x7efc3c144880 2023-11-28T18:42:25.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.375+0000 7efc40ec4640 1 -- 172.21.15.45:0/3406736955 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc380aa750 con 0x7efc3c144880 2023-11-28T18:42:25.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.375+0000 7efc40ec4640 1 -- 172.21.15.45:0/3406736955 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc380aaae0 con 0x7efc3c144880 2023-11-28T18:42:25.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.375+0000 7efc4412a640 1 -- 172.21.15.45:0/3406736955 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc3c144880 msgr2=0x7efc3c06c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:25.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.375+0000 7efc4412a640 1 --2- 172.21.15.45:0/3406736955 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc3c144880 0x7efc3c06c300 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7efc3c06d180 tx=0x7efc3801c490 comp rx=0 tx=0).stop 2023-11-28T18:42:25.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.375+0000 7efc4412a640 1 -- 172.21.15.45:0/3406736955 shutdown_connections 2023-11-28T18:42:25.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.375+0000 7efc4412a640 1 --2- 172.21.15.45:0/3406736955 >> v2:172.21.15.190:3300/0 conn(0x7efc3c0721c0 0x7efc3c06c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:25.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.375+0000 7efc4412a640 1 --2- 172.21.15.45:0/3406736955 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc3c144880 0x7efc3c06c300 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:25.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.375+0000 7efc4412a640 1 -- 172.21.15.45:0/3406736955 >> 172.21.15.45:0/3406736955 conn(0x7efc3c06a570 msgr2=0x7efc3c06a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:25.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.375+0000 7efc4412a640 1 -- 172.21.15.45:0/3406736955 shutdown_connections 2023-11-28T18:42:25.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.375+0000 7efc4412a640 1 -- 172.21.15.45:0/3406736955 wait complete. 2023-11-28T18:42:25.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.375+0000 7efc4412a640 1 Processor -- start 2023-11-28T18:42:25.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.375+0000 7efc4412a640 1 -- start start 2023-11-28T18:42:25.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.379+0000 7efc4412a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc3c0704a0 0x7efc3c164130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:25.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.379+0000 7efc4412a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efc3c0721c0 0x7efc3c1427a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:25.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.379+0000 7efc4412a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efc3c144880 0x7efc3c1650c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:25.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.379+0000 7efc4412a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc3c163d10 con 0x7efc3c0704a0 2023-11-28T18:42:25.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.379+0000 7efc4412a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc3c165df0 con 0x7efc3c144880 2023-11-28T18:42:25.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.379+0000 7efc4412a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc3c165b10 con 0x7efc3c0721c0 2023-11-28T18:42:25.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.379+0000 7efc41ec6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc3c0704a0 0x7efc3c164130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:25.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.379+0000 7efc41ec6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc3c0704a0 0x7efc3c164130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57992/0 (socket says 172.21.15.45:57992) 2023-11-28T18:42:25.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.379+0000 7efc41ec6640 1 -- 172.21.15.45:0/2158845499 learned_addr learned my addr 172.21.15.45:0/2158845499 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:25.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.379+0000 7efc416c5640 1 --2- 172.21.15.45:0/2158845499 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efc3c0721c0 0x7efc3c1427a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:25.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.379+0000 7efc426c7640 1 --2- 172.21.15.45:0/2158845499 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efc3c144880 0x7efc3c1650c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:25.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.379+0000 7efc41ec6640 1 -- 172.21.15.45:0/2158845499 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efc3c0721c0 msgr2=0x7efc3c1427a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:25.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.379+0000 7efc41ec6640 1 --2- 172.21.15.45:0/2158845499 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efc3c0721c0 0x7efc3c1427a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:25.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.379+0000 7efc41ec6640 1 -- 172.21.15.45:0/2158845499 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efc3c144880 msgr2=0x7efc3c1650c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:25.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.379+0000 7efc41ec6640 1 --2- 172.21.15.45:0/2158845499 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efc3c144880 0x7efc3c1650c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:25.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.379+0000 7efc41ec6640 1 -- 172.21.15.45:0/2158845499 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc380094d0 con 0x7efc3c0704a0 2023-11-28T18:42:25.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.379+0000 7efc416c5640 1 --2- 172.21.15.45:0/2158845499 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efc3c0721c0 0x7efc3c1427a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:42:25.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.379+0000 7efc426c7640 1 --2- 172.21.15.45:0/2158845499 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efc3c144880 0x7efc3c1650c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:42:25.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.379+0000 7efc41ec6640 1 --2- 172.21.15.45:0/2158845499 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc3c0704a0 0x7efc3c164130 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7efc3801a0c0 tx=0x7efc3801acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:25.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.379+0000 7efc327fc640 1 -- 172.21.15.45:0/2158845499 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc380b3800 con 0x7efc3c0704a0 2023-11-28T18:42:25.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.379+0000 7efc327fc640 1 -- 172.21.15.45:0/2158845499 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc380b3980 con 0x7efc3c0704a0 2023-11-28T18:42:25.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.379+0000 7efc327fc640 1 -- 172.21.15.45:0/2158845499 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc380b3d30 con 0x7efc3c0704a0 2023-11-28T18:42:25.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.379+0000 7efc4412a640 1 -- 172.21.15.45:0/2158845499 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc3c163650 con 0x7efc3c0704a0 2023-11-28T18:42:25.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.379+0000 7efc4412a640 1 -- 172.21.15.45:0/2158845499 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc3c15ac60 con 0x7efc3c0704a0 2023-11-28T18:42:25.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.379+0000 7efc4412a640 1 -- 172.21.15.45:0/2158845499 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc3c069480 con 0x7efc3c0704a0 2023-11-28T18:42:25.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.383+0000 7efc327fc640 1 -- 172.21.15.45:0/2158845499 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7efc380b2380 con 0x7efc3c0704a0 2023-11-28T18:42:25.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.383+0000 7efc327fc640 1 --2- 172.21.15.45:0/2158845499 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7efc200668d0 0x7efc20068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:25.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.383+0000 7efc327fc640 1 -- 172.21.15.45:0/2158845499 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x7efc380a7070 con 0x7efc3c0704a0 2023-11-28T18:42:25.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.383+0000 7efc416c5640 1 --2- 172.21.15.45:0/2158845499 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7efc200668d0 0x7efc20068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:25.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.383+0000 7efc416c5640 1 --2- 172.21.15.45:0/2158845499 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7efc200668d0 0x7efc20068d90 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7efc3c13ca50 tx=0x7efc2c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:25.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.387+0000 7efc327fc640 1 -- 172.21.15.45:0/2158845499 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efc380ebd80 con 0x7efc3c0704a0 2023-11-28T18:42:25.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.575+0000 7efc4412a640 1 -- 172.21.15.45:0/2158845499 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efc3c06d1b0 con 0x7efc3c0704a0 2023-11-28T18:42:25.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.575+0000 7efc327fc640 1 -- 172.21.15.45:0/2158845499 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4911 (secure 0 0 0) 0x7efc380c3090 con 0x7efc3c0704a0 2023-11-28T18:42:25.580 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:42:25.580 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":36,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5414,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/114066704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":114066704},{"type":"v1","addr":"172.21.15.190:6836","nonce":114066704}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5417,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/27225494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":27225494},{"type":"v1","addr":"172.21.15.190:6837","nonce":27225494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5973,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1061201705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":1061201705},{"type":"v1","addr":"172.21.15.45:6835","nonce":1061201705}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T18:39:36.424552+0000","modified":"2023-11-28T18:42:25.205435+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":49,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6207},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6207":{"gid":6207,"name":"c","rank":0,"incarnation":36,"state":"up:replay","state_seq":1,"addr":"172.21.15.45:6834/2228986336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2228986336},{"type":"v1","addr":"172.21.15.45:6834","nonce":2228986336}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-28T18:42:25.580 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 36 2023-11-28T18:42:25.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.579+0000 7efc4412a640 1 -- 172.21.15.45:0/2158845499 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7efc200668d0 msgr2=0x7efc20068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:25.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.579+0000 7efc4412a640 1 --2- 172.21.15.45:0/2158845499 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7efc200668d0 0x7efc20068d90 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7efc3c13ca50 tx=0x7efc2c008040 comp rx=0 tx=0).stop 2023-11-28T18:42:25.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.579+0000 7efc4412a640 1 -- 172.21.15.45:0/2158845499 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc3c0704a0 msgr2=0x7efc3c164130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:25.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.579+0000 7efc4412a640 1 --2- 172.21.15.45:0/2158845499 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc3c0704a0 0x7efc3c164130 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7efc3801a0c0 tx=0x7efc3801acd0 comp rx=0 tx=0).stop 2023-11-28T18:42:25.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.579+0000 7efc4412a640 1 -- 172.21.15.45:0/2158845499 shutdown_connections 2023-11-28T18:42:25.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.579+0000 7efc4412a640 1 --2- 172.21.15.45:0/2158845499 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7efc200668d0 0x7efc20068d90 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:25.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.579+0000 7efc4412a640 1 --2- 172.21.15.45:0/2158845499 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efc3c144880 0x7efc3c1650c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:25.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.579+0000 7efc4412a640 1 --2- 172.21.15.45:0/2158845499 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efc3c0721c0 0x7efc3c1427a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:25.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.579+0000 7efc4412a640 1 --2- 172.21.15.45:0/2158845499 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc3c0704a0 0x7efc3c164130 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:25.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.579+0000 7efc4412a640 1 -- 172.21.15.45:0/2158845499 >> 172.21.15.45:0/2158845499 conn(0x7efc3c06a570 msgr2=0x7efc3c13e8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:25.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.579+0000 7efc4412a640 1 -- 172.21.15.45:0/2158845499 shutdown_connections 2023-11-28T18:42:25.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:25.579+0000 7efc4412a640 1 -- 172.21.15.45:0/2158845499 wait complete. 2023-11-28T18:42:26.004 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 36, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-28T18:39:36.424552+0000', 'modified': '2023-11-28T18:42:25.205435+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 49, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6207}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6207': {'gid': 6207, 'name': 'c', 'rank': 0, 'incarnation': 36, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.45:6834/2228986336', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.45:6832', 'nonce': 2228986336}, {'type': 'v1', 'addr': '172.21.15.45:6834', 'nonce': 2228986336}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-28T18:42:26.004 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6207:up:replay 2023-11-28T18:42:27.004 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T18:42:27.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.155+0000 7f480849c640 1 Processor -- start 2023-11-28T18:42:27.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.155+0000 7f480849c640 1 -- start start 2023-11-28T18:42:27.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.155+0000 7f480849c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f480006cdf0 0x7f4800150290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:27.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.155+0000 7f480849c640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48000704a0 con 0x7f480006d1d0 2023-11-28T18:42:27.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.155+0000 7f480849c640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f480015a8d0 con 0x7f480015a4f0 2023-11-28T18:42:27.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.155+0000 7f480849c640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f480015ab60 con 0x7f480006cdf0 2023-11-28T18:42:27.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.155+0000 7f4805a37640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f480006d1d0 0x7f4800159de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:58268/0 (socket says 172.21.15.45:58268) 2023-11-28T18:42:27.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.155+0000 7f4805a37640 1 -- 172.21.15.45:0/694135168 learned_addr learned my addr 172.21.15.45:0/694135168 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:42:27.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.155+0000 7f4806238640 1 --2- 172.21.15.45:0/694135168 >> v2:172.21.15.190:3300/0 conn(0x7f480006cdf0 0x7f4800150290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:27.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.155+0000 7f4805236640 1 -- 172.21.15.45:0/694135168 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3181321131 0 0) 0x7f48000704a0 con 0x7f480006d1d0 2023-11-28T18:42:27.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.155+0000 7f4805236640 1 -- 172.21.15.45:0/694135168 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47ec003450 con 0x7f480006d1d0 2023-11-28T18:42:27.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.159+0000 7f4805236640 1 -- 172.21.15.45:0/694135168 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1275462239 0 0) 0x7f480015a8d0 con 0x7f480015a4f0 2023-11-28T18:42:27.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.159+0000 7f4805236640 1 -- 172.21.15.45:0/694135168 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48000704a0 con 0x7f480015a4f0 2023-11-28T18:42:27.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.159+0000 7f4805236640 1 -- 172.21.15.45:0/694135168 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4002434945 0 0) 0x7f47ec003450 con 0x7f480006d1d0 2023-11-28T18:42:27.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.159+0000 7f4805236640 1 -- 172.21.15.45:0/694135168 >> v2:172.21.15.190:3300/0 conn(0x7f480006cdf0 msgr2=0x7f4800150290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:27.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.159+0000 7f4805236640 1 --2- 172.21.15.45:0/694135168 >> v2:172.21.15.190:3300/0 conn(0x7f480006cdf0 0x7f4800150290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:27.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.159+0000 7f4805236640 1 -- 172.21.15.45:0/694135168 >> v1:172.21.15.190:6789/0 conn(0x7f480015a4f0 legacy=0x7f48000ce120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:27.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.159+0000 7f4805236640 1 -- 172.21.15.45:0/694135168 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48000706d0 con 0x7f480006d1d0 2023-11-28T18:42:27.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.159+0000 7f4805236640 1 -- 172.21.15.45:0/694135168 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4084481567 0 0) 0x7f47f0001680 con 0x7f480006d1d0 2023-11-28T18:42:27.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.159+0000 7f4805236640 1 -- 172.21.15.45:0/694135168 >> v1:172.21.15.45:6789/0 conn(0x7f480006d1d0 legacy=0x7f4800159de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:27.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.159+0000 7f4805236640 1 --2- 172.21.15.45:0/694135168 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f47ec003c50 0x7f47ec008860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:27.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.159+0000 7f4805236640 1 --2- 172.21.15.45:0/694135168 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47ec004180 0x7f47ec00ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:27.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.159+0000 7f4805236640 1 --2- 172.21.15.45:0/694135168 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f47ec00b4c0 0x7f47ec00d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:27.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.159+0000 7f4805236640 1 -- 172.21.15.45:0/694135168 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f480015ab60 con 0x7f47ec004180 2023-11-28T18:42:27.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.159+0000 7f4805236640 1 -- 172.21.15.45:0/694135168 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47ec00e260 con 0x7f47ec00b4c0 2023-11-28T18:42:27.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.159+0000 7f4805236640 1 -- 172.21.15.45:0/694135168 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47ec00e420 con 0x7f47ec003c50 2023-11-28T18:42:27.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.159+0000 7f4806238640 1 --2- 172.21.15.45:0/694135168 >> v2:172.21.15.190:3300/0 conn(0x7f480006cdf0 0x7f4800150290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:42:27.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.159+0000 7f4805a37640 1 --2- 172.21.15.45:0/694135168 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47ec004180 0x7f47ec00ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:27.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.159+0000 7f4806a39640 1 --2- 172.21.15.45:0/694135168 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f47ec00b4c0 0x7f47ec00d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:27.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.159+0000 7f4806238640 1 --2- 172.21.15.45:0/694135168 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f47ec003c50 0x7f47ec008860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:27.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.159+0000 7f4805a37640 1 -- 172.21.15.45:0/694135168 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f47ec003c50 msgr2=0x7f47ec008860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:27.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.159+0000 7f4805a37640 1 --2- 172.21.15.45:0/694135168 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f47ec003c50 0x7f47ec008860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:27.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.159+0000 7f4805a37640 1 -- 172.21.15.45:0/694135168 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f47ec00b4c0 msgr2=0x7f47ec00d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:27.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.159+0000 7f4805a37640 1 --2- 172.21.15.45:0/694135168 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f47ec00b4c0 0x7f47ec00d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:27.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.159+0000 7f4805a37640 1 -- 172.21.15.45:0/694135168 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47ec003450 con 0x7f47ec004180 2023-11-28T18:42:27.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.159+0000 7f4806a39640 1 --2- 172.21.15.45:0/694135168 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f47ec00b4c0 0x7f47ec00d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:42:27.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.159+0000 7f4806a39640 1 -- 172.21.15.45:0/694135168 reap_dead start 2023-11-28T18:42:27.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.159+0000 7f4805a37640 1 --2- 172.21.15.45:0/694135168 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47ec004180 0x7f47ec00ae50 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f47f0007fa0 tx=0x7f47f001cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dd92f9f24287e01 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:27.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.163+0000 7f4805236640 1 -- 172.21.15.45:0/694135168 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f0005ae0 con 0x7f47ec004180 2023-11-28T18:42:27.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.163+0000 7f4805236640 1 -- 172.21.15.45:0/694135168 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47f0005c40 con 0x7f47ec004180 2023-11-28T18:42:27.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.163+0000 7f4805236640 1 -- 172.21.15.45:0/694135168 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f00a5a00 con 0x7f47ec004180 2023-11-28T18:42:27.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.163+0000 7f480849c640 1 -- 172.21.15.45:0/694135168 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47ec004180 msgr2=0x7f47ec00ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:27.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.163+0000 7f480849c640 1 --2- 172.21.15.45:0/694135168 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47ec004180 0x7f47ec00ae50 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f47f0007fa0 tx=0x7f47f001cae0 comp rx=0 tx=0).stop 2023-11-28T18:42:27.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.163+0000 7f480849c640 1 -- 172.21.15.45:0/694135168 shutdown_connections 2023-11-28T18:42:27.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.163+0000 7f480849c640 1 --2- 172.21.15.45:0/694135168 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47ec004180 0x7f47ec00ae50 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:27.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.163+0000 7f480849c640 1 -- 172.21.15.45:0/694135168 >> 172.21.15.45:0/694135168 conn(0x7f480006a570 msgr2=0x7f480006a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:27.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.163+0000 7f480849c640 1 -- 172.21.15.45:0/694135168 shutdown_connections 2023-11-28T18:42:27.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.163+0000 7f480849c640 1 -- 172.21.15.45:0/694135168 wait complete. 2023-11-28T18:42:27.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.163+0000 7f480849c640 1 Processor -- start 2023-11-28T18:42:27.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.163+0000 7f480849c640 1 -- start start 2023-11-28T18:42:27.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.163+0000 7f480849c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47ec004180 0x7f48001f5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:27.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.163+0000 7f480849c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f480014e360 0x7f480015bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:27.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.163+0000 7f480849c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f480015c460 0x7f480014c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:27.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.163+0000 7f480849c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f480015c8e0 con 0x7f47ec004180 2023-11-28T18:42:27.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.163+0000 7f480849c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4800150900 con 0x7f480015c460 2023-11-28T18:42:27.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.163+0000 7f480849c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4800150be0 con 0x7f480014e360 2023-11-28T18:42:27.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.167+0000 7f4806238640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47ec004180 0x7f48001f5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:27.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.167+0000 7f4806238640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47ec004180 0x7f48001f5c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58006/0 (socket says 172.21.15.45:58006) 2023-11-28T18:42:27.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.167+0000 7f4806238640 1 -- 172.21.15.45:0/4287939780 learned_addr learned my addr 172.21.15.45:0/4287939780 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:27.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.167+0000 7f4805a37640 1 --2- 172.21.15.45:0/4287939780 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f480014e360 0x7f480015bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:27.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.167+0000 7f4806a39640 1 --2- 172.21.15.45:0/4287939780 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f480015c460 0x7f480014c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:27.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.167+0000 7f4806238640 1 -- 172.21.15.45:0/4287939780 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f480014e360 msgr2=0x7f480015bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:27.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.167+0000 7f4806238640 1 --2- 172.21.15.45:0/4287939780 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f480014e360 0x7f480015bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:27.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.167+0000 7f4806238640 1 -- 172.21.15.45:0/4287939780 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f480015c460 msgr2=0x7f480014c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:27.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.167+0000 7f4806238640 1 --2- 172.21.15.45:0/4287939780 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f480015c460 0x7f480014c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:27.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.167+0000 7f4806238640 1 -- 172.21.15.45:0/4287939780 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4800150ec0 con 0x7f47ec004180 2023-11-28T18:42:27.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.167+0000 7f4805a37640 1 --2- 172.21.15.45:0/4287939780 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f480014e360 0x7f480015bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:42:27.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.167+0000 7f4806238640 1 --2- 172.21.15.45:0/4287939780 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47ec004180 0x7f48001f5c70 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f47fc011800 tx=0x7f47fc011cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:27.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.167+0000 7f47f6ffd640 1 -- 172.21.15.45:0/4287939780 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47fc00f9c0 con 0x7f47ec004180 2023-11-28T18:42:27.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.167+0000 7f47f6ffd640 1 -- 172.21.15.45:0/4287939780 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47fc00fb20 con 0x7f47ec004180 2023-11-28T18:42:27.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.167+0000 7f47f6ffd640 1 -- 172.21.15.45:0/4287939780 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47fc00fe90 con 0x7f47ec004180 2023-11-28T18:42:27.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.167+0000 7f480849c640 1 -- 172.21.15.45:0/4287939780 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48001511a0 con 0x7f47ec004180 2023-11-28T18:42:27.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.167+0000 7f480849c640 1 -- 172.21.15.45:0/4287939780 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f480014e7e0 con 0x7f47ec004180 2023-11-28T18:42:27.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.167+0000 7f480849c640 1 -- 172.21.15.45:0/4287939780 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48000b3930 con 0x7f47ec004180 2023-11-28T18:42:27.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.167+0000 7f47f6ffd640 1 -- 172.21.15.45:0/4287939780 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f47fc015460 con 0x7f47ec004180 2023-11-28T18:42:27.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.167+0000 7f47f6ffd640 1 --2- 172.21.15.45:0/4287939780 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f47e4066900 0x7f47e4068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:27.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.167+0000 7f47f6ffd640 1 -- 172.21.15.45:0/4287939780 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f47fc084a90 con 0x7f47ec004180 2023-11-28T18:42:27.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.171+0000 7f4805a37640 1 --2- 172.21.15.45:0/4287939780 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f47e4066900 0x7f47e4068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:27.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.171+0000 7f4805a37640 1 --2- 172.21.15.45:0/4287939780 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f47e4066900 0x7f47e4068dc0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f47f00ab000 tx=0x7f47f00b1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:27.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.171+0000 7f47f6ffd640 1 -- 172.21.15.45:0/4287939780 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f47fc051ba0 con 0x7f47ec004180 2023-11-28T18:42:27.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.363+0000 7f480849c640 1 -- 172.21.15.45:0/4287939780 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4800069480 con 0x7f47ec004180 2023-11-28T18:42:27.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.363+0000 7f47f6ffd640 1 -- 172.21.15.45:0/4287939780 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4912 (secure 0 0 0) 0x7f47fc022090 con 0x7f47ec004180 2023-11-28T18:42:27.367 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:42:27.367 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":38,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5414,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/114066704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":114066704},{"type":"v1","addr":"172.21.15.190:6836","nonce":114066704}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5417,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/27225494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":27225494},{"type":"v1","addr":"172.21.15.190:6837","nonce":27225494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5973,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1061201705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":1061201705},{"type":"v1","addr":"172.21.15.45:6835","nonce":1061201705}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T18:39:36.424552+0000","modified":"2023-11-28T18:42:26.216611+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":49,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6207},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6207":{"gid":6207,"name":"c","rank":0,"incarnation":36,"state":"up:rejoin","state_seq":21,"addr":"172.21.15.45:6834/2228986336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2228986336},{"type":"v1","addr":"172.21.15.45:6834","nonce":2228986336}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-28T18:42:27.367 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 38 2023-11-28T18:42:27.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.363+0000 7f480849c640 1 -- 172.21.15.45:0/4287939780 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f47e4066900 msgr2=0x7f47e4068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:27.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.363+0000 7f480849c640 1 --2- 172.21.15.45:0/4287939780 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f47e4066900 0x7f47e4068dc0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f47f00ab000 tx=0x7f47f00b1040 comp rx=0 tx=0).stop 2023-11-28T18:42:27.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.363+0000 7f480849c640 1 -- 172.21.15.45:0/4287939780 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47ec004180 msgr2=0x7f48001f5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:27.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.363+0000 7f480849c640 1 --2- 172.21.15.45:0/4287939780 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47ec004180 0x7f48001f5c70 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f47fc011800 tx=0x7f47fc011cc0 comp rx=0 tx=0).stop 2023-11-28T18:42:27.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.363+0000 7f480849c640 1 -- 172.21.15.45:0/4287939780 shutdown_connections 2023-11-28T18:42:27.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.363+0000 7f480849c640 1 --2- 172.21.15.45:0/4287939780 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f47e4066900 0x7f47e4068dc0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:27.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.363+0000 7f480849c640 1 --2- 172.21.15.45:0/4287939780 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f480015c460 0x7f480014c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:27.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.363+0000 7f480849c640 1 --2- 172.21.15.45:0/4287939780 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f480014e360 0x7f480015bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:27.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.363+0000 7f480849c640 1 --2- 172.21.15.45:0/4287939780 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47ec004180 0x7f48001f5c70 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:27.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.363+0000 7f480849c640 1 -- 172.21.15.45:0/4287939780 >> 172.21.15.45:0/4287939780 conn(0x7f480006a570 msgr2=0x7f48000b0510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:27.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.363+0000 7f480849c640 1 -- 172.21.15.45:0/4287939780 shutdown_connections 2023-11-28T18:42:27.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:27.363+0000 7f480849c640 1 -- 172.21.15.45:0/4287939780 wait complete. 2023-11-28T18:42:27.790 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 38, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-28T18:39:36.424552+0000', 'modified': '2023-11-28T18:42:26.216611+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 49, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6207}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6207': {'gid': 6207, 'name': 'c', 'rank': 0, 'incarnation': 36, 'state': 'up:rejoin', 'state_seq': 21, 'addr': '172.21.15.45:6834/2228986336', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.45:6832', 'nonce': 2228986336}, {'type': 'v1', 'addr': '172.21.15.45:6834', 'nonce': 2228986336}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-28T18:42:27.791 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6207:up:rejoin 2023-11-28T18:42:28.792 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T18:42:28.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:28.943+0000 7f7ebd59d640 1 Processor -- start 2023-11-28T18:42:28.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:28.943+0000 7f7ebd59d640 1 -- start start 2023-11-28T18:42:28.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:28.943+0000 7f7ebd59d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f7eb80b3cb0 0x7f7eb80d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:28.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:28.943+0000 7f7ebd59d640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7eb80d38c0 con 0x7f7eb80cfed0 2023-11-28T18:42:28.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:28.943+0000 7f7ebd59d640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7eb80cdcc0 con 0x7f7eb80b35f0 2023-11-28T18:42:28.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:28.943+0000 7f7ebd59d640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7eb80d40d0 con 0x7f7eb80b3cb0 2023-11-28T18:42:28.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:28.943+0000 7f7eaffff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f7eb80cfed0 0x7f7eb80ce480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:60440/0 (socket says 172.21.15.45:60440) 2023-11-28T18:42:28.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:28.943+0000 7f7eaffff640 1 -- 172.21.15.45:0/248064144 learned_addr learned my addr 172.21.15.45:0/248064144 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:42:28.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:28.943+0000 7f7eb77fe640 1 --2- 172.21.15.45:0/248064144 >> v2:172.21.15.190:3300/0 conn(0x7f7eb80b3cb0 0x7f7eb80d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:28.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:28.943+0000 7f7eb67fc640 1 -- 172.21.15.45:0/248064144 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 346743822 0 0) 0x7f7eb80d38c0 con 0x7f7eb80cfed0 2023-11-28T18:42:28.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:28.943+0000 7f7eb67fc640 1 -- 172.21.15.45:0/248064144 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ea4003530 con 0x7f7eb80cfed0 2023-11-28T18:42:28.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:28.943+0000 7f7eb77fe640 1 -- 172.21.15.45:0/248064144 >> v1:172.21.15.190:6789/0 conn(0x7f7eb80b35f0 legacy=0x7f7eb80cf7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:28.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:28.943+0000 7f7eb77fe640 1 -- 172.21.15.45:0/248064144 >> v1:172.21.15.45:6789/0 conn(0x7f7eb80cfed0 legacy=0x7f7eb80ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:28.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:28.947+0000 7f7eb77fe640 1 -- 172.21.15.45:0/248064144 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb80d3b10 con 0x7f7eb80b3cb0 2023-11-28T18:42:28.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:28.947+0000 7f7eb77fe640 1 --2- 172.21.15.45:0/248064144 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7eb80b3cb0 0x7f7eb80d0f90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f7eb0009d90 tx=0x7f7eb001c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=712605062991420a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:28.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:28.947+0000 7f7eb67fc640 1 -- 172.21.15.45:0/248064144 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb00a59e0 con 0x7f7eb80b3cb0 2023-11-28T18:42:28.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:28.947+0000 7f7eb67fc640 1 -- 172.21.15.45:0/248064144 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eb00a5b40 con 0x7f7eb80b3cb0 2023-11-28T18:42:28.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:28.947+0000 7f7eb67fc640 1 -- 172.21.15.45:0/248064144 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb00ad440 con 0x7f7eb80b3cb0 2023-11-28T18:42:28.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:28.947+0000 7f7ebd59d640 1 -- 172.21.15.45:0/248064144 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7eb80b3cb0 msgr2=0x7f7eb80d0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:28.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:28.947+0000 7f7ebd59d640 1 --2- 172.21.15.45:0/248064144 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7eb80b3cb0 0x7f7eb80d0f90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f7eb0009d90 tx=0x7f7eb001c920 comp rx=0 tx=0).stop 2023-11-28T18:42:28.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:28.947+0000 7f7ebd59d640 1 -- 172.21.15.45:0/248064144 shutdown_connections 2023-11-28T18:42:28.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:28.947+0000 7f7ebd59d640 1 --2- 172.21.15.45:0/248064144 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7eb80b3cb0 0x7f7eb80d0f90 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:28.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:28.947+0000 7f7ebd59d640 1 -- 172.21.15.45:0/248064144 >> 172.21.15.45:0/248064144 conn(0x7f7eb809c4f0 msgr2=0x7f7eb80d31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:28.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:28.951+0000 7f7ebd59d640 1 -- 172.21.15.45:0/248064144 shutdown_connections 2023-11-28T18:42:28.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:28.951+0000 7f7ebd59d640 1 -- 172.21.15.45:0/248064144 wait complete. 2023-11-28T18:42:28.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:28.951+0000 7f7ebd59d640 1 Processor -- start 2023-11-28T18:42:28.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:28.951+0000 7f7ebd59d640 1 -- start start 2023-11-28T18:42:28.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:28.951+0000 7f7ebd59d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7eb80b35f0 0x7f7eb81465d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:28.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:28.951+0000 7f7ebd59d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7eb80b3cb0 0x7f7eb81442e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:28.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:28.951+0000 7f7ebd59d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7eb80cfed0 0x7f7eb8144820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:28.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:28.951+0000 7f7ebd59d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb8145bb0 con 0x7f7eb80cfed0 2023-11-28T18:42:28.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:28.951+0000 7f7ebd59d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb8144f30 con 0x7f7eb80b35f0 2023-11-28T18:42:28.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:28.951+0000 7f7ebd59d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb8145210 con 0x7f7eb80b3cb0 2023-11-28T18:42:28.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:28.951+0000 7f7eb77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7eb80cfed0 0x7f7eb8144820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:28.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:28.951+0000 7f7eb77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7eb80cfed0 0x7f7eb8144820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37168/0 (socket says 172.21.15.45:37168) 2023-11-28T18:42:28.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:28.951+0000 7f7eb77fe640 1 -- 172.21.15.45:0/799341012 learned_addr learned my addr 172.21.15.45:0/799341012 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:28.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:28.951+0000 7f7eb6ffd640 1 --2- 172.21.15.45:0/799341012 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7eb80b35f0 0x7f7eb81465d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:28.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:28.951+0000 7f7eaffff640 1 --2- 172.21.15.45:0/799341012 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7eb80b3cb0 0x7f7eb81442e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:28.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:28.951+0000 7f7eb77fe640 1 -- 172.21.15.45:0/799341012 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7eb80b3cb0 msgr2=0x7f7eb81442e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:28.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:28.951+0000 7f7eb77fe640 1 --2- 172.21.15.45:0/799341012 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7eb80b3cb0 0x7f7eb81442e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:28.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:28.951+0000 7f7eb77fe640 1 -- 172.21.15.45:0/799341012 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7eb80b35f0 msgr2=0x7f7eb81465d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:28.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:28.951+0000 7f7eb77fe640 1 --2- 172.21.15.45:0/799341012 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7eb80b35f0 0x7f7eb81465d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:28.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:28.951+0000 7f7eb77fe640 1 -- 172.21.15.45:0/799341012 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb0009a70 con 0x7f7eb80cfed0 2023-11-28T18:42:28.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:28.951+0000 7f7eb77fe640 1 --2- 172.21.15.45:0/799341012 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7eb80cfed0 0x7f7eb8144820 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f7eb0009d90 tx=0x7f7eb00196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:28.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:28.951+0000 7f7eaf7fe640 1 -- 172.21.15.45:0/799341012 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb0004240 con 0x7f7eb80cfed0 2023-11-28T18:42:28.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:28.951+0000 7f7eaf7fe640 1 -- 172.21.15.45:0/799341012 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eb00043a0 con 0x7f7eb80cfed0 2023-11-28T18:42:28.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:28.951+0000 7f7eaf7fe640 1 -- 172.21.15.45:0/799341012 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb0004710 con 0x7f7eb80cfed0 2023-11-28T18:42:28.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:28.951+0000 7f7ebd59d640 1 -- 172.21.15.45:0/799341012 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7eb81454f0 con 0x7f7eb80cfed0 2023-11-28T18:42:28.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:28.955+0000 7f7ebd59d640 1 -- 172.21.15.45:0/799341012 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7eb8145fd0 con 0x7f7eb80cfed0 2023-11-28T18:42:28.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:28.955+0000 7f7ebd59d640 1 -- 172.21.15.45:0/799341012 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7eb8145cf0 con 0x7f7eb80cfed0 2023-11-28T18:42:28.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:28.955+0000 7f7eaf7fe640 1 -- 172.21.15.45:0/799341012 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f7eb00b4030 con 0x7f7eb80cfed0 2023-11-28T18:42:28.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:28.955+0000 7f7eaf7fe640 1 --2- 172.21.15.45:0/799341012 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f7e980668d0 0x7f7e98068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:28.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:28.955+0000 7f7eaf7fe640 1 -- 172.21.15.45:0/799341012 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f7eb011f8f0 con 0x7f7eb80cfed0 2023-11-28T18:42:28.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:28.955+0000 7f7eb6ffd640 1 --2- 172.21.15.45:0/799341012 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f7e980668d0 0x7f7e98068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:28.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:28.959+0000 7f7eb6ffd640 1 --2- 172.21.15.45:0/799341012 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f7e980668d0 0x7f7e98068d90 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f7ea8001650 tx=0x7f7ea8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:28.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:28.959+0000 7f7eaf7fe640 1 -- 172.21.15.45:0/799341012 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7eb00ecbb0 con 0x7f7eb80cfed0 2023-11-28T18:42:29.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.147+0000 7f7ebd59d640 1 -- 172.21.15.45:0/799341012 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7eb8069480 con 0x7f7eb80cfed0 2023-11-28T18:42:29.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.147+0000 7f7eaf7fe640 1 -- 172.21.15.45:0/799341012 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4912 (secure 0 0 0) 0x7f7eb0004870 con 0x7f7eb80cfed0 2023-11-28T18:42:29.153 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:42:29.153 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":39,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5414,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/114066704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":114066704},{"type":"v1","addr":"172.21.15.190:6836","nonce":114066704}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5417,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/27225494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":27225494},{"type":"v1","addr":"172.21.15.190:6837","nonce":27225494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5973,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1061201705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":1061201705},{"type":"v1","addr":"172.21.15.45:6835","nonce":1061201705}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T18:39:36.424552+0000","modified":"2023-11-28T18:42:27.227565+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":49,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6207},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6207":{"gid":6207,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":22,"addr":"172.21.15.45:6834/2228986336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2228986336},{"type":"v1","addr":"172.21.15.45:6834","nonce":2228986336}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-28T18:42:29.153 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 39 2023-11-28T18:42:29.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.151+0000 7f7ebd59d640 1 -- 172.21.15.45:0/799341012 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f7e980668d0 msgr2=0x7f7e98068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:29.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.151+0000 7f7ebd59d640 1 --2- 172.21.15.45:0/799341012 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f7e980668d0 0x7f7e98068d90 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f7ea8001650 tx=0x7f7ea8009040 comp rx=0 tx=0).stop 2023-11-28T18:42:29.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.151+0000 7f7ebd59d640 1 -- 172.21.15.45:0/799341012 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7eb80cfed0 msgr2=0x7f7eb8144820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:29.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.151+0000 7f7ebd59d640 1 --2- 172.21.15.45:0/799341012 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7eb80cfed0 0x7f7eb8144820 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f7eb0009d90 tx=0x7f7eb00196c0 comp rx=0 tx=0).stop 2023-11-28T18:42:29.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.151+0000 7f7ebd59d640 1 -- 172.21.15.45:0/799341012 shutdown_connections 2023-11-28T18:42:29.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.151+0000 7f7ebd59d640 1 --2- 172.21.15.45:0/799341012 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f7e980668d0 0x7f7e98068d90 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:29.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.151+0000 7f7ebd59d640 1 --2- 172.21.15.45:0/799341012 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7eb80cfed0 0x7f7eb8144820 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:29.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.151+0000 7f7ebd59d640 1 --2- 172.21.15.45:0/799341012 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7eb80b3cb0 0x7f7eb81442e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:29.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.151+0000 7f7ebd59d640 1 --2- 172.21.15.45:0/799341012 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7eb80b35f0 0x7f7eb81465d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:29.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.151+0000 7f7ebd59d640 1 -- 172.21.15.45:0/799341012 >> 172.21.15.45:0/799341012 conn(0x7f7eb809c4f0 msgr2=0x7f7eb80afde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:29.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.151+0000 7f7ebd59d640 1 -- 172.21.15.45:0/799341012 shutdown_connections 2023-11-28T18:42:29.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.151+0000 7f7ebd59d640 1 -- 172.21.15.45:0/799341012 wait complete. 2023-11-28T18:42:29.581 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 39, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-28T18:39:36.424552+0000', 'modified': '2023-11-28T18:42:27.227565+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 49, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6207}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6207': {'gid': 6207, 'name': 'c', 'rank': 0, 'incarnation': 36, 'state': 'up:active', 'state_seq': 22, 'addr': '172.21.15.45:6834/2228986336', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.45:6832', 'nonce': 2228986336}, {'type': 'v1', 'addr': '172.21.15.45:6834', 'nonce': 2228986336}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-28T18:42:29.581 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-28T18:42:29.581 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-28T18:42:29.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.723+0000 7f49df51d640 1 Processor -- start 2023-11-28T18:42:29.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.723+0000 7f49df51d640 1 -- start start 2023-11-28T18:42:29.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.723+0000 7f49df51d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f49d806ca10 0x7f49d8145290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:29.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.723+0000 7f49df51d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f49d815c0b0 0x7f49d81457d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:29.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.723+0000 7f49df51d640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49d8146000 con 0x7f49d815bcd0 2023-11-28T18:42:29.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.723+0000 7f49df51d640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49d81462e0 con 0x7f49d815c0b0 2023-11-28T18:42:29.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.723+0000 7f49df51d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49d81465c0 con 0x7f49d806ca10 2023-11-28T18:42:29.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.727+0000 7f49dcab8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f49d806ca10 0x7f49d8145290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:29.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.727+0000 7f49ddaba640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f49d815c0b0 0x7f49d81457d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:29.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.727+0000 7f49dcab8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f49d806ca10 0x7f49d8145290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.45:51282/0 (socket says 172.21.15.45:51282) 2023-11-28T18:42:29.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.727+0000 7f49ddaba640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f49d815c0b0 0x7f49d81457d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.45:59368/0 (socket says 172.21.15.45:59368) 2023-11-28T18:42:29.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.727+0000 7f49dd2b9640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f49d815bcd0 0x7f49d806c300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.45:40752/0 (socket says 172.21.15.45:40752) 2023-11-28T18:42:29.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.727+0000 7f49dcab8640 1 -- 172.21.15.45:0/3248591281 learned_addr learned my addr 172.21.15.45:0/3248591281 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:29.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.727+0000 7f49cffff640 1 -- 172.21.15.45:0/3248591281 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3811641880 0 0) 0x7f49d8146000 con 0x7f49d815bcd0 2023-11-28T18:42:29.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.727+0000 7f49cffff640 1 -- 172.21.15.45:0/3248591281 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49c4003530 con 0x7f49d815bcd0 2023-11-28T18:42:29.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.727+0000 7f49ddaba640 1 -- 172.21.15.45:0/3248591281 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f49d806ca10 msgr2=0x7f49d8145290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:29.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.727+0000 7f49ddaba640 1 --2- 172.21.15.45:0/3248591281 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f49d806ca10 0x7f49d8145290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:29.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.727+0000 7f49ddaba640 1 -- 172.21.15.45:0/3248591281 >> v1:172.21.15.190:6789/0 conn(0x7f49d815bcd0 legacy=0x7f49d806c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:29.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.727+0000 7f49ddaba640 1 -- 172.21.15.45:0/3248591281 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d81468a0 con 0x7f49d815c0b0 2023-11-28T18:42:29.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.727+0000 7f49dcab8640 1 --2- 172.21.15.45:0/3248591281 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f49d806ca10 0x7f49d8145290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:42:29.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.727+0000 7f49ddaba640 1 --2- 172.21.15.45:0/3248591281 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f49d815c0b0 0x7f49d81457d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f49d0009d90 tx=0x7f49d001c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85d7635d681da4b6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:29.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.731+0000 7f49cffff640 1 -- 172.21.15.45:0/3248591281 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d00a5930 con 0x7f49d815c0b0 2023-11-28T18:42:29.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.731+0000 7f49cffff640 1 -- 172.21.15.45:0/3248591281 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49d00a5a90 con 0x7f49d815c0b0 2023-11-28T18:42:29.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.731+0000 7f49cffff640 1 -- 172.21.15.45:0/3248591281 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d00a5e20 con 0x7f49d815c0b0 2023-11-28T18:42:29.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.731+0000 7f49df51d640 1 -- 172.21.15.45:0/3248591281 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f49d815c0b0 msgr2=0x7f49d81457d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:29.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.731+0000 7f49df51d640 1 --2- 172.21.15.45:0/3248591281 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f49d815c0b0 0x7f49d81457d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f49d0009d90 tx=0x7f49d001c890 comp rx=0 tx=0).stop 2023-11-28T18:42:29.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.731+0000 7f49df51d640 1 -- 172.21.15.45:0/3248591281 shutdown_connections 2023-11-28T18:42:29.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.731+0000 7f49df51d640 1 --2- 172.21.15.45:0/3248591281 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f49d815c0b0 0x7f49d81457d0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:29.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.731+0000 7f49df51d640 1 --2- 172.21.15.45:0/3248591281 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f49d806ca10 0x7f49d8145290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:29.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.731+0000 7f49df51d640 1 -- 172.21.15.45:0/3248591281 >> 172.21.15.45:0/3248591281 conn(0x7f49d806a570 msgr2=0x7f49d806a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:29.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.731+0000 7f49df51d640 1 -- 172.21.15.45:0/3248591281 shutdown_connections 2023-11-28T18:42:29.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.731+0000 7f49df51d640 1 -- 172.21.15.45:0/3248591281 wait complete. 2023-11-28T18:42:29.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.731+0000 7f49df51d640 1 Processor -- start 2023-11-28T18:42:29.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.731+0000 7f49df51d640 1 -- start start 2023-11-28T18:42:29.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.731+0000 7f49df51d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f49d806ca10 0x7f49d8141820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:29.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.731+0000 7f49df51d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49d815bcd0 0x7f49d80ce790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:29.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.731+0000 7f49df51d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f49d815c0b0 0x7f49d8153790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:29.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.731+0000 7f49df51d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d8153390 con 0x7f49d815bcd0 2023-11-28T18:42:29.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.731+0000 7f49df51d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d80cecd0 con 0x7f49d806ca10 2023-11-28T18:42:29.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.731+0000 7f49df51d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49d8152d60 con 0x7f49d815c0b0 2023-11-28T18:42:29.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.731+0000 7f49dcab8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49d815bcd0 0x7f49d80ce790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:29.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.735+0000 7f49dcab8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49d815bcd0 0x7f49d80ce790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37170/0 (socket says 172.21.15.45:37170) 2023-11-28T18:42:29.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.735+0000 7f49dcab8640 1 -- 172.21.15.45:0/3286206772 learned_addr learned my addr 172.21.15.45:0/3286206772 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:29.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.735+0000 7f49ddaba640 1 --2- 172.21.15.45:0/3286206772 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f49d815c0b0 0x7f49d8153790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:29.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.735+0000 7f49dd2b9640 1 --2- 172.21.15.45:0/3286206772 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f49d806ca10 0x7f49d8141820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:29.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.735+0000 7f49dcab8640 1 -- 172.21.15.45:0/3286206772 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f49d815c0b0 msgr2=0x7f49d8153790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:29.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.735+0000 7f49dcab8640 1 --2- 172.21.15.45:0/3286206772 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f49d815c0b0 0x7f49d8153790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:29.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.735+0000 7f49dcab8640 1 -- 172.21.15.45:0/3286206772 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f49d806ca10 msgr2=0x7f49d8141820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:29.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.735+0000 7f49dcab8640 1 --2- 172.21.15.45:0/3286206772 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f49d806ca10 0x7f49d8141820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:29.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.735+0000 7f49dcab8640 1 -- 172.21.15.45:0/3286206772 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49c80094d0 con 0x7f49d815bcd0 2023-11-28T18:42:29.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.735+0000 7f49dcab8640 1 --2- 172.21.15.45:0/3286206772 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49d815bcd0 0x7f49d80ce790 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f49c800e9d0 tx=0x7f49c800ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:29.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.735+0000 7f49cdffb640 1 -- 172.21.15.45:0/3286206772 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c800ca60 con 0x7f49d815bcd0 2023-11-28T18:42:29.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.735+0000 7f49cdffb640 1 -- 172.21.15.45:0/3286206772 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49c800cbc0 con 0x7f49d815bcd0 2023-11-28T18:42:29.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.735+0000 7f49df51d640 1 -- 172.21.15.45:0/3286206772 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49d0009a70 con 0x7f49d815bcd0 2023-11-28T18:42:29.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.735+0000 7f49cdffb640 1 -- 172.21.15.45:0/3286206772 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c8013470 con 0x7f49d815bcd0 2023-11-28T18:42:29.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.735+0000 7f49df51d640 1 -- 172.21.15.45:0/3286206772 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49d8154ba0 con 0x7f49d815bcd0 2023-11-28T18:42:29.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.735+0000 7f49cdffb640 1 -- 172.21.15.45:0/3286206772 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f49c80135d0 con 0x7f49d815bcd0 2023-11-28T18:42:29.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.739+0000 7f49cdffb640 1 --2- 172.21.15.45:0/3286206772 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f49bc0668d0 0x7f49bc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:29.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.739+0000 7f49cdffb640 1 -- 172.21.15.45:0/3286206772 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f49c8084840 con 0x7f49d815bcd0 2023-11-28T18:42:29.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.739+0000 7f49e2898000 1 Processor -- start 2023-11-28T18:42:29.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.739+0000 7f49e2898000 1 -- start start 2023-11-28T18:42:29.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.739+0000 7f49dd2b9640 1 --2- 172.21.15.45:0/3286206772 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f49bc0668d0 0x7f49bc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:29.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.739+0000 7f49dd2b9640 1 --2- 172.21.15.45:0/3286206772 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f49bc0668d0 0x7f49bc068d90 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f49d40011f0 tx=0x7f49d4007b80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:29.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.739+0000 7f49e2898000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ae38c9ad30 0x55ae38c9b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:29.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.739+0000 7f49e2898000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ae38c9b650 0x55ae38c4dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:29.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.739+0000 7f49e2898000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ae38c4e500 0x55ae38c4e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:29.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.739+0000 7f49e2898000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae38b17110 con 0x55ae38c9ad30 2023-11-28T18:42:29.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.739+0000 7f49e2898000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae38aa79a0 con 0x55ae38c9b650 2023-11-28T18:42:29.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.739+0000 7f49e2898000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ae38aa4ed0 con 0x55ae38c4e500 2023-11-28T18:42:29.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.739+0000 7f49dd2b9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ae38c9ad30 0x55ae38c9b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:29.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.739+0000 7f49dd2b9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ae38c9ad30 0x55ae38c9b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37178/0 (socket says 172.21.15.45:37178) 2023-11-28T18:42:29.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.739+0000 7f49dd2b9640 1 -- 172.21.15.45:0/3289045378 learned_addr learned my addr 172.21.15.45:0/3289045378 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:29.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.739+0000 7f49dcab8640 1 --2- 172.21.15.45:0/3289045378 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ae38c9b650 0x55ae38c4dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:29.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.739+0000 7f49ddaba640 1 --2- 172.21.15.45:0/3289045378 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ae38c4e500 0x55ae38c4e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:29.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.739+0000 7f49dd2b9640 1 -- 172.21.15.45:0/3289045378 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ae38c4e500 msgr2=0x55ae38c4e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:29.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.739+0000 7f49dd2b9640 1 --2- 172.21.15.45:0/3289045378 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ae38c4e500 0x55ae38c4e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:29.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.739+0000 7f49dd2b9640 1 -- 172.21.15.45:0/3289045378 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ae38c9b650 msgr2=0x55ae38c4dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:29.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.739+0000 7f49dd2b9640 1 --2- 172.21.15.45:0/3289045378 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ae38c9b650 0x55ae38c4dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:29.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.739+0000 7f49dd2b9640 1 -- 172.21.15.45:0/3289045378 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ae38798890 con 0x55ae38c9ad30 2023-11-28T18:42:29.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.739+0000 7f49dd2b9640 1 --2- 172.21.15.45:0/3289045378 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ae38c9ad30 0x55ae38c9b110 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f49d4005cc0 tx=0x7f49d4012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d1446df2821ef1f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:29.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.739+0000 7f49c2ffd640 1 -- 172.21.15.45:0/3289045378 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d4015110 con 0x55ae38c9ad30 2023-11-28T18:42:29.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.739+0000 7f49c2ffd640 1 -- 172.21.15.45:0/3289045378 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49d4015270 con 0x55ae38c9ad30 2023-11-28T18:42:29.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.739+0000 7f49c2ffd640 1 -- 172.21.15.45:0/3289045378 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d4015bc0 con 0x55ae38c9ad30 2023-11-28T18:42:29.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.739+0000 7f49e2898000 1 -- 172.21.15.45:0/3289045378 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ae38c9ad30 msgr2=0x55ae38c9b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:29.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.739+0000 7f49e2898000 1 --2- 172.21.15.45:0/3289045378 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ae38c9ad30 0x55ae38c9b110 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f49d4005cc0 tx=0x7f49d4012000 comp rx=0 tx=0).stop 2023-11-28T18:42:29.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.739+0000 7f49e2898000 1 -- 172.21.15.45:0/3289045378 shutdown_connections 2023-11-28T18:42:29.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.739+0000 7f49e2898000 1 --2- 172.21.15.45:0/3289045378 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ae38c4e500 0x55ae38c4e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:29.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.739+0000 7f49e2898000 1 --2- 172.21.15.45:0/3289045378 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ae38c9b650 0x55ae38c4dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:29.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.739+0000 7f49e2898000 1 --2- 172.21.15.45:0/3289045378 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ae38c9ad30 0x55ae38c9b110 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:29.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.739+0000 7f49e2898000 1 -- 172.21.15.45:0/3289045378 >> 172.21.15.45:0/3289045378 conn(0x55ae38c7b8c0 msgr2=0x55ae38c7dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:29.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.743+0000 7f49e2898000 1 -- 172.21.15.45:0/3289045378 shutdown_connections 2023-11-28T18:42:29.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.743+0000 7f49e2898000 1 -- 172.21.15.45:0/3289045378 wait complete. 2023-11-28T18:42:29.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.743+0000 7f49e2898000 1 -- start start 2023-11-28T18:42:29.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.743+0000 7f49e2898000 1 Processor -- start 2023-11-28T18:42:29.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.743+0000 7f49e2898000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ae38c4e500 0x55ae38c544e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:29.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.743+0000 7f49e2898000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ae38c9ad30 0x55ae38c54a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:29.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.743+0000 7f49e2898000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ae38c9b650 0x55ae38c54f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:29.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.743+0000 7f49e2898000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae38aa07c0 con 0x55ae38c9b650 2023-11-28T18:42:29.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.743+0000 7f49e2898000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae38a58bf0 con 0x55ae38c9ad30 2023-11-28T18:42:29.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.743+0000 7f49e2898000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ae38a5ea90 con 0x55ae38c4e500 2023-11-28T18:42:29.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.743+0000 7f49e2898000 10 client.0 _ll_register_callbacks cb 0x55ae38c3be20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T18:42:29.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.743+0000 7f49ddaba640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ae38c9b650 0x55ae38c54f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:29.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.743+0000 7f49ddaba640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ae38c9b650 0x55ae38c54f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37190/0 (socket says 172.21.15.45:37190) 2023-11-28T18:42:29.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.743+0000 7f49ddaba640 1 -- 172.21.15.45:0/2724163756 learned_addr learned my addr 172.21.15.45:0/2724163756 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:29.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.743+0000 7f49dd2b9640 1 --2- 172.21.15.45:0/2724163756 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ae38c4e500 0x55ae38c544e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:29.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.743+0000 7f49dcab8640 1 --2- 172.21.15.45:0/2724163756 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ae38c9ad30 0x55ae38c54a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:29.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.743+0000 7f49ddaba640 1 -- 172.21.15.45:0/2724163756 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ae38c4e500 msgr2=0x55ae38c544e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:29.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.743+0000 7f49ddaba640 1 --2- 172.21.15.45:0/2724163756 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ae38c4e500 0x55ae38c544e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:29.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.743+0000 7f49ddaba640 1 -- 172.21.15.45:0/2724163756 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ae38c9ad30 msgr2=0x55ae38c54a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:29.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.743+0000 7f49ddaba640 1 --2- 172.21.15.45:0/2724163756 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ae38c9ad30 0x55ae38c54a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:29.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.743+0000 7f49ddaba640 1 -- 172.21.15.45:0/2724163756 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49d400f040 con 0x55ae38c9b650 2023-11-28T18:42:29.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.743+0000 7f49ddaba640 1 --2- 172.21.15.45:0/2724163756 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ae38c9b650 0x55ae38c54f60 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f49d00b0040 tx=0x7f49d001b0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8961b2cab4bda67f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:29.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.743+0000 7f49b7fff640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-11-28T18:42:29.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.743+0000 7f49b7fff640 1 -- 172.21.15.45:0/2724163756 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d00ad740 con 0x55ae38c9b650 2023-11-28T18:42:29.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.743+0000 7f49b7fff640 1 -- 172.21.15.45:0/2724163756 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f49d00be070 con 0x55ae38c9b650 2023-11-28T18:42:29.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.743+0000 7f49e2898000 1 -- 172.21.15.45:0/2724163756 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ae38a62470 con 0x55ae38c9b650 2023-11-28T18:42:29.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.743+0000 7f49b7fff640 1 -- 172.21.15.45:0/2724163756 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f49d00ad8a0 con 0x55ae38c9b650 2023-11-28T18:42:29.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.743+0000 7f49e2898000 10 client.6564 fetch_fsmap learned FSMap version 39 2023-11-28T18:42:29.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.743+0000 7f49e2898000 1 -- 172.21.15.45:0/2724163756 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0x55ae38a61190 con 0x55ae38c9b650 2023-11-28T18:42:29.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.747+0000 7f49b7fff640 1 -- 172.21.15.45:0/2724163756 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ae38a62470 con 0x55ae38c9b650 2023-11-28T18:42:29.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.747+0000 7f49b7fff640 1 -- 172.21.15.45:0/2724163756 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 39) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f49d00ada00 con 0x55ae38c9b650 2023-11-28T18:42:29.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.747+0000 7f49e2898000 10 client.6564 fetch_fsmap finished waiting for FSMap version 39 2023-11-28T18:42:29.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.747+0000 7f49e2898000 10 client.6564 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-28T18:42:29.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.747+0000 7f49e2898000 20 client.6564 populate_metadata read hostname 'smithi045' 2023-11-28T18:42:29.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.747+0000 7f49e2898000 1 --2- 172.21.15.45:0/2724163756 >> [v2:172.21.15.45:6832/2228986336,v1:172.21.15.45:6834/2228986336] conn(0x55ae38c55970 0x55ae38cacff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:29.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.747+0000 7f49e2898000 4 client.6564 mds_command: new command op to 6207 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-28T18:42:29.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.747+0000 7f49e2898000 1 -- 172.21.15.45:0/2724163756 --> [v2:172.21.15.45:6832/2228986336,v1:172.21.15.45:6834/2228986336] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ae38a65b50 con 0x55ae38c55970 2023-11-28T18:42:29.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.747+0000 7f49dd2b9640 1 --2- 172.21.15.45:0/2724163756 >> [v2:172.21.15.45:6832/2228986336,v1:172.21.15.45:6834/2228986336] conn(0x55ae38c55970 0x55ae38cacff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:29.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.747+0000 7f49dd2b9640 1 --2- 172.21.15.45:0/2724163756 >> [v2:172.21.15.45:6832/2228986336,v1:172.21.15.45:6834/2228986336] conn(0x55ae38c55970 0x55ae38cacff0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=925989f71f7da80f server_cookie=b2f983eb6aa46959 in_seq=0 out_seq=0 2023-11-28T18:42:29.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.747+0000 7f49b7fff640 10 client.6564 ms_handle_connect on v2:172.21.15.45:6832/2228986336 2023-11-28T18:42:29.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.747+0000 7f49b7fff640 1 -- 172.21.15.45:0/2724163756 <== mds.0 v2:172.21.15.45:6832/2228986336 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ae38a65b50 con 0x55ae38c55970 2023-11-28T18:42:29.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.747+0000 7f49b7fff640 10 client.6564 handle_command_reply: tid=0 2023-11-28T18:42:29.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.747+0000 7f49e2898000 1 client.6564 shutdown 2023-11-28T18:42:29.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.747+0000 7f49e2898000 1 -- 172.21.15.45:0/2724163756 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ae38c9b650 msgr2=0x55ae38c54f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:29.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.747+0000 7f49e2898000 1 --2- 172.21.15.45:0/2724163756 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ae38c9b650 0x55ae38c54f60 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f49d00b0040 tx=0x7f49d001b0d0 comp rx=0 tx=0).stop 2023-11-28T18:42:29.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.747+0000 7f49e2898000 1 -- 172.21.15.45:0/2724163756 shutdown_connections 2023-11-28T18:42:29.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.747+0000 7f49e2898000 1 --2- 172.21.15.45:0/2724163756 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ae38c9b650 0x55ae38c54f60 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:29.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.747+0000 7f49e2898000 1 --2- 172.21.15.45:0/2724163756 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ae38c9ad30 0x55ae38c54a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:29.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.747+0000 7f49e2898000 1 --2- 172.21.15.45:0/2724163756 >> [v2:172.21.15.45:6832/2228986336,v1:172.21.15.45:6834/2228986336] conn(0x55ae38c55970 0x55ae38cacff0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:29.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.747+0000 7f49e2898000 1 --2- 172.21.15.45:0/2724163756 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ae38c4e500 0x55ae38c544e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:29.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.747+0000 7f49e2898000 1 -- 172.21.15.45:0/2724163756 >> 172.21.15.45:0/2724163756 conn(0x55ae38c7b8c0 msgr2=0x55ae38c4d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:29.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.747+0000 7f49b7fff640 0 client.6564 ms_handle_reset on v2:172.21.15.45:6832/2228986336 2023-11-28T18:42:29.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.747+0000 7f49e2898000 1 -- 172.21.15.45:0/2724163756 shutdown_connections 2023-11-28T18:42:29.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.747+0000 7f49e2898000 1 -- 172.21.15.45:0/2724163756 wait complete. 2023-11-28T18:42:29.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.747+0000 7f49e2898000 20 client.6564 trim_cache size 0 max 16384 2023-11-28T18:42:29.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.763+0000 7f49e2898000 1 Processor -- start 2023-11-28T18:42:29.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.763+0000 7f49e2898000 1 -- start start 2023-11-28T18:42:29.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.763+0000 7f49e2898000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ae38c4e500 0x55ae38cf6e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:29.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.763+0000 7f49e2898000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ae38c9ad30 0x55ae38cf73b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:29.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.763+0000 7f49e2898000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ae38c9b650 0x55ae38cf78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:29.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.763+0000 7f49e2898000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae38759940 con 0x55ae38c4e500 2023-11-28T18:42:29.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.763+0000 7f49e2898000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae38a55760 con 0x55ae38c9b650 2023-11-28T18:42:29.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.763+0000 7f49e2898000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ae38ae1440 con 0x55ae38c9ad30 2023-11-28T18:42:29.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.763+0000 7f49dd2b9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ae38c4e500 0x55ae38cf6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:29.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.763+0000 7f49dd2b9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ae38c4e500 0x55ae38cf6e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37204/0 (socket says 172.21.15.45:37204) 2023-11-28T18:42:29.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.763+0000 7f49dd2b9640 1 -- 172.21.15.45:0/2642117955 learned_addr learned my addr 172.21.15.45:0/2642117955 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:29.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.763+0000 7f49ddaba640 1 --2- 172.21.15.45:0/2642117955 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ae38c9b650 0x55ae38cf78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:29.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.763+0000 7f49dd2b9640 1 -- 172.21.15.45:0/2642117955 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ae38c9ad30 msgr2=0x55ae38cf73b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:29.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.763+0000 7f49dd2b9640 1 --2- 172.21.15.45:0/2642117955 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ae38c9ad30 0x55ae38cf73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:29.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.763+0000 7f49dd2b9640 1 -- 172.21.15.45:0/2642117955 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ae38c9b650 msgr2=0x55ae38cf78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:29.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.763+0000 7f49dd2b9640 1 --2- 172.21.15.45:0/2642117955 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ae38c9b650 0x55ae38cf78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:29.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.763+0000 7f49dd2b9640 1 -- 172.21.15.45:0/2642117955 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ae38a47490 con 0x55ae38c4e500 2023-11-28T18:42:29.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.763+0000 7f49ddaba640 1 --2- 172.21.15.45:0/2642117955 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ae38c9b650 0x55ae38cf78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:42:29.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.767+0000 7f49dd2b9640 1 --2- 172.21.15.45:0/2642117955 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ae38c4e500 0x55ae38cf6e70 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f49d4000f70 tx=0x7f49d4013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=575d89381e42b266 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:29.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.767+0000 7f49c37fe640 1 -- 172.21.15.45:0/2642117955 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d40159c0 con 0x55ae38c4e500 2023-11-28T18:42:29.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.767+0000 7f49c37fe640 1 -- 172.21.15.45:0/2642117955 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49d400b030 con 0x55ae38c4e500 2023-11-28T18:42:29.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.767+0000 7f49c37fe640 1 -- 172.21.15.45:0/2642117955 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d4015d20 con 0x55ae38c4e500 2023-11-28T18:42:29.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.767+0000 7f49e2898000 1 -- 172.21.15.45:0/2642117955 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ae38c4e500 msgr2=0x55ae38cf6e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:29.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.767+0000 7f49e2898000 1 --2- 172.21.15.45:0/2642117955 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ae38c4e500 0x55ae38cf6e70 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f49d4000f70 tx=0x7f49d4013000 comp rx=0 tx=0).stop 2023-11-28T18:42:29.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.767+0000 7f49e2898000 1 -- 172.21.15.45:0/2642117955 shutdown_connections 2023-11-28T18:42:29.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.767+0000 7f49e2898000 1 --2- 172.21.15.45:0/2642117955 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ae38c9b650 0x55ae38cf78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:29.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.767+0000 7f49e2898000 1 --2- 172.21.15.45:0/2642117955 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ae38c9ad30 0x55ae38cf73b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:29.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.767+0000 7f49e2898000 1 --2- 172.21.15.45:0/2642117955 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ae38c4e500 0x55ae38cf6e70 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:29.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.767+0000 7f49e2898000 1 -- 172.21.15.45:0/2642117955 >> 172.21.15.45:0/2642117955 conn(0x55ae38c7b8c0 msgr2=0x55ae38ca8320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:29.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.767+0000 7f49e2898000 1 -- 172.21.15.45:0/2642117955 shutdown_connections 2023-11-28T18:42:29.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.767+0000 7f49e2898000 1 -- 172.21.15.45:0/2642117955 wait complete. 2023-11-28T18:42:29.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.767+0000 7f49e2898000 1 -- start start 2023-11-28T18:42:29.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.767+0000 7f49e2898000 1 Processor -- start 2023-11-28T18:42:29.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.767+0000 7f49e2898000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ae38c4e500 0x55ae38cfb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:29.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.767+0000 7f49e2898000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ae38c9ad30 0x55ae38cfb720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:29.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.767+0000 7f49e2898000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ae38c9b650 0x55ae38cb6a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:29.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.767+0000 7f49e2898000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae38a9f650 con 0x55ae38c9b650 2023-11-28T18:42:29.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.767+0000 7f49e2898000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae38c48430 con 0x55ae38c9ad30 2023-11-28T18:42:29.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.767+0000 7f49e2898000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ae38a9f470 con 0x55ae38c4e500 2023-11-28T18:42:29.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.767+0000 7f49e2898000 10 client.0 _ll_register_callbacks cb 0x55ae38b17060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T18:42:29.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.767+0000 7f49ddaba640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ae38c9b650 0x55ae38cb6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:29.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.767+0000 7f49ddaba640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ae38c9b650 0x55ae38cb6a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37218/0 (socket says 172.21.15.45:37218) 2023-11-28T18:42:29.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.767+0000 7f49ddaba640 1 -- 172.21.15.45:0/2477866842 learned_addr learned my addr 172.21.15.45:0/2477866842 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:29.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.767+0000 7f49dcab8640 1 --2- 172.21.15.45:0/2477866842 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ae38c9ad30 0x55ae38cfb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:29.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.767+0000 7f49dd2b9640 1 --2- 172.21.15.45:0/2477866842 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ae38c4e500 0x55ae38cfb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:29.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.767+0000 7f49ddaba640 1 -- 172.21.15.45:0/2477866842 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ae38c4e500 msgr2=0x55ae38cfb1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:29.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.767+0000 7f49ddaba640 1 --2- 172.21.15.45:0/2477866842 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ae38c4e500 0x55ae38cfb1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:29.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.767+0000 7f49ddaba640 1 -- 172.21.15.45:0/2477866842 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ae38c9ad30 msgr2=0x55ae38cfb720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:29.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.767+0000 7f49ddaba640 1 --2- 172.21.15.45:0/2477866842 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ae38c9ad30 0x55ae38cfb720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:29.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.767+0000 7f49ddaba640 1 -- 172.21.15.45:0/2477866842 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ae38798890 con 0x55ae38c9b650 2023-11-28T18:42:29.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.767+0000 7f49ddaba640 1 --2- 172.21.15.45:0/2477866842 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ae38c9b650 0x55ae38cb6a70 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f49d0002240 tx=0x7f49d0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d7fd76ff233fce1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:29.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.767+0000 7f49b7fff640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-11-28T18:42:29.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.771+0000 7f49b7fff640 1 -- 172.21.15.45:0/2477866842 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d0007000 con 0x55ae38c9b650 2023-11-28T18:42:29.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.771+0000 7f49b7fff640 1 -- 172.21.15.45:0/2477866842 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f49d00be070 con 0x55ae38c9b650 2023-11-28T18:42:29.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.771+0000 7f49e2898000 1 -- 172.21.15.45:0/2477866842 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ae38a9f110 con 0x55ae38c9b650 2023-11-28T18:42:29.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.771+0000 7f49b7fff640 1 -- 172.21.15.45:0/2477866842 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f49d00ad850 con 0x55ae38c9b650 2023-11-28T18:42:29.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.771+0000 7f49e2898000 10 client.6570 fetch_fsmap learned FSMap version 39 2023-11-28T18:42:29.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.771+0000 7f49e2898000 1 -- 172.21.15.45:0/2477866842 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0x55ae38798cc0 con 0x55ae38c9b650 2023-11-28T18:42:29.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.771+0000 7f49b7fff640 1 -- 172.21.15.45:0/2477866842 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ae38a9f110 con 0x55ae38c9b650 2023-11-28T18:42:29.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.771+0000 7f49b7fff640 1 -- 172.21.15.45:0/2477866842 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 39) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f49d00ad9b0 con 0x55ae38c9b650 2023-11-28T18:42:29.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.771+0000 7f49e2898000 10 client.6570 fetch_fsmap finished waiting for FSMap version 39 2023-11-28T18:42:29.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.771+0000 7f49e2898000 10 client.6570 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-28T18:42:29.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.771+0000 7f49e2898000 20 client.6570 populate_metadata read hostname 'smithi045' 2023-11-28T18:42:29.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.771+0000 7f49e2898000 1 --2- 172.21.15.45:0/2477866842 >> [v2:172.21.15.45:6832/2228986336,v1:172.21.15.45:6834/2228986336] conn(0x55ae38cb7430 0x55ae38cb7810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:29.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.771+0000 7f49e2898000 4 client.6570 mds_command: new command op to 6207 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-28T18:42:29.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.771+0000 7f49e2898000 1 -- 172.21.15.45:0/2477866842 --> [v2:172.21.15.45:6832/2228986336,v1:172.21.15.45:6834/2228986336] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55ae38acd650 con 0x55ae38cb7430 2023-11-28T18:42:29.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.771+0000 7f49dd2b9640 1 --2- 172.21.15.45:0/2477866842 >> [v2:172.21.15.45:6832/2228986336,v1:172.21.15.45:6834/2228986336] conn(0x55ae38cb7430 0x55ae38cb7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:29.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.771+0000 7f49b7fff640 10 client.6570 ms_handle_connect on v2:172.21.15.45:6832/2228986336 2023-11-28T18:42:29.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.771+0000 7f49dd2b9640 1 --2- 172.21.15.45:0/2477866842 >> [v2:172.21.15.45:6832/2228986336,v1:172.21.15.45:6834/2228986336] conn(0x55ae38cb7430 0x55ae38cb7810 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a6bbd08a4e150e4 server_cookie=8196355d52bc5459 in_seq=0 out_seq=0 2023-11-28T18:42:29.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.771+0000 7f49b7fff640 1 -- 172.21.15.45:0/2477866842 <== mds.0 v2:172.21.15.45:6832/2228986336 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55ae38acd650 con 0x55ae38cb7430 2023-11-28T18:42:29.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.771+0000 7f49b7fff640 10 client.6570 handle_command_reply: tid=0 2023-11-28T18:42:29.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.771+0000 7f49e2898000 1 client.6570 shutdown 2023-11-28T18:42:29.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.771+0000 7f49e2898000 1 -- 172.21.15.45:0/2477866842 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ae38c9b650 msgr2=0x55ae38cb6a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:29.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.771+0000 7f49e2898000 1 --2- 172.21.15.45:0/2477866842 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ae38c9b650 0x55ae38cb6a70 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f49d0002240 tx=0x7f49d0009750 comp rx=0 tx=0).stop 2023-11-28T18:42:29.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.771+0000 7f49e2898000 1 -- 172.21.15.45:0/2477866842 shutdown_connections 2023-11-28T18:42:29.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.771+0000 7f49e2898000 1 --2- 172.21.15.45:0/2477866842 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ae38c9b650 0x55ae38cb6a70 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:29.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.771+0000 7f49e2898000 1 --2- 172.21.15.45:0/2477866842 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ae38c9ad30 0x55ae38cfb720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:29.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.771+0000 7f49e2898000 1 --2- 172.21.15.45:0/2477866842 >> [v2:172.21.15.45:6832/2228986336,v1:172.21.15.45:6834/2228986336] conn(0x55ae38cb7430 0x55ae38cb7810 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:29.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.771+0000 7f49e2898000 1 --2- 172.21.15.45:0/2477866842 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55ae38c4e500 0x55ae38cfb1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:29.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.771+0000 7f49e2898000 1 -- 172.21.15.45:0/2477866842 >> 172.21.15.45:0/2477866842 conn(0x55ae38c7b8c0 msgr2=0x55ae38c4c720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:29.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.771+0000 7f49b7fff640 0 client.6570 ms_handle_reset on v2:172.21.15.45:6832/2228986336 2023-11-28T18:42:29.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.771+0000 7f49e2898000 1 -- 172.21.15.45:0/2477866842 shutdown_connections 2023-11-28T18:42:29.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.771+0000 7f49e2898000 1 -- 172.21.15.45:0/2477866842 wait complete. 2023-11-28T18:42:29.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.771+0000 7f49e2898000 20 client.6570 trim_cache size 0 max 16384 2023-11-28T18:42:29.784 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-11-28T18:42:29.784 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_fsid": "d10f5cd6-1d00-4019-99b6-6fa435498a15", 2023-11-28T18:42:29.784 INFO:teuthology.orchestra.run.smithi045.stdout: "whoami": 0, 2023-11-28T18:42:29.784 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 6207, 2023-11-28T18:42:29.785 INFO:teuthology.orchestra.run.smithi045.stdout: "want_state": "up:active", 2023-11-28T18:42:29.785 INFO:teuthology.orchestra.run.smithi045.stdout: "state": "up:active", 2023-11-28T18:42:29.785 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs", 2023-11-28T18:42:29.785 INFO:teuthology.orchestra.run.smithi045.stdout: "rank_uptime": 4.5685473679999999, 2023-11-28T18:42:29.785 INFO:teuthology.orchestra.run.smithi045.stdout: "mdsmap_epoch": 39, 2023-11-28T18:42:29.785 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch": 49, 2023-11-28T18:42:29.785 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch_barrier": 49, 2023-11-28T18:42:29.785 INFO:teuthology.orchestra.run.smithi045.stdout: "uptime": 78.431910278999993 2023-11-28T18:42:29.785 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-11-28T18:42:29.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.771+0000 7f49df51d640 1 -- 172.21.15.45:0/3286206772 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f49bc0668d0 msgr2=0x7f49bc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:29.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.771+0000 7f49df51d640 1 --2- 172.21.15.45:0/3286206772 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f49bc0668d0 0x7f49bc068d90 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f49d40011f0 tx=0x7f49d4007b80 comp rx=0 tx=0).stop 2023-11-28T18:42:29.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.771+0000 7f49df51d640 1 -- 172.21.15.45:0/3286206772 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49d815bcd0 msgr2=0x7f49d80ce790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:29.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.771+0000 7f49df51d640 1 --2- 172.21.15.45:0/3286206772 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49d815bcd0 0x7f49d80ce790 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f49c800e9d0 tx=0x7f49c800ee90 comp rx=0 tx=0).stop 2023-11-28T18:42:29.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.771+0000 7f49df51d640 1 -- 172.21.15.45:0/3286206772 shutdown_connections 2023-11-28T18:42:29.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.771+0000 7f49df51d640 1 --2- 172.21.15.45:0/3286206772 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f49bc0668d0 0x7f49bc068d90 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:29.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.771+0000 7f49df51d640 1 --2- 172.21.15.45:0/3286206772 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f49d815c0b0 0x7f49d8153790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:29.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.771+0000 7f49df51d640 1 --2- 172.21.15.45:0/3286206772 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49d815bcd0 0x7f49d80ce790 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:29.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.771+0000 7f49df51d640 1 --2- 172.21.15.45:0/3286206772 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f49d806ca10 0x7f49d8141820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:29.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.771+0000 7f49df51d640 1 -- 172.21.15.45:0/3286206772 >> 172.21.15.45:0/3286206772 conn(0x7f49d806a570 msgr2=0x7f49d8073530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:29.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.771+0000 7f49df51d640 1 -- 172.21.15.45:0/3286206772 shutdown_connections 2023-11-28T18:42:29.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.771+0000 7f49df51d640 1 -- 172.21.15.45:0/3286206772 wait complete. 2023-11-28T18:42:29.796 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T18:42:29.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.935+0000 7f9758396640 1 Processor -- start 2023-11-28T18:42:29.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.935+0000 7f9758396640 1 -- start start 2023-11-28T18:42:29.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.935+0000 7f9758396640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f97500b3cb0 0x7f97500d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:29.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.935+0000 7f9758396640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97500d38c0 con 0x7f97500cfed0 2023-11-28T18:42:29.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.935+0000 7f9758396640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97500cdcc0 con 0x7f97500b35f0 2023-11-28T18:42:29.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.935+0000 7f9758396640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97500d40d0 con 0x7f97500b3cb0 2023-11-28T18:42:29.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.935+0000 7f9755931640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f97500cfed0 0x7f97500ce480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:60442/0 (socket says 172.21.15.45:60442) 2023-11-28T18:42:29.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.935+0000 7f9755931640 1 -- 172.21.15.45:0/272243774 learned_addr learned my addr 172.21.15.45:0/272243774 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:42:29.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.935+0000 7f9756933640 1 --2- 172.21.15.45:0/272243774 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f97500b3cb0 0x7f97500d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:29.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.935+0000 7f9755130640 1 -- 172.21.15.45:0/272243774 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3888989801 0 0) 0x7f97500d38c0 con 0x7f97500cfed0 2023-11-28T18:42:29.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.935+0000 7f9755130640 1 -- 172.21.15.45:0/272243774 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f973c003530 con 0x7f97500cfed0 2023-11-28T18:42:29.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.935+0000 7f9755130640 1 -- 172.21.15.45:0/272243774 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3836806815 0 0) 0x7f973c003530 con 0x7f97500cfed0 2023-11-28T18:42:29.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.935+0000 7f9755130640 1 -- 172.21.15.45:0/272243774 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f97500b3cb0 msgr2=0x7f97500d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:29.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.935+0000 7f9755130640 1 --2- 172.21.15.45:0/272243774 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f97500b3cb0 0x7f97500d0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:29.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.935+0000 7f9755130640 1 -- 172.21.15.45:0/272243774 >> v1:172.21.15.190:6789/0 conn(0x7f97500b35f0 legacy=0x7f97500cf7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:29.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.935+0000 7f9755130640 1 -- 172.21.15.45:0/272243774 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97500d3b10 con 0x7f97500cfed0 2023-11-28T18:42:29.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.935+0000 7f9755130640 1 -- 172.21.15.45:0/272243774 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4084481567 0 0) 0x7f9740001680 con 0x7f97500cfed0 2023-11-28T18:42:29.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.935+0000 7f9755130640 1 -- 172.21.15.45:0/272243774 >> v1:172.21.15.45:6789/0 conn(0x7f97500cfed0 legacy=0x7f97500ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:29.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.935+0000 7f9755130640 1 --2- 172.21.15.45:0/272243774 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f97500b3cb0 0x7f973c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:29.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.935+0000 7f9755130640 1 --2- 172.21.15.45:0/272243774 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f973c003ef0 0x7f973c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:29.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.935+0000 7f9755130640 1 --2- 172.21.15.45:0/272243774 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f973c004d10 0x7f973c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:29.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.935+0000 7f9755130640 1 -- 172.21.15.45:0/272243774 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97500d40d0 con 0x7f973c003ef0 2023-11-28T18:42:29.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.935+0000 7f9755130640 1 -- 172.21.15.45:0/272243774 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f973c00ba40 con 0x7f973c004d10 2023-11-28T18:42:29.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.935+0000 7f9755130640 1 -- 172.21.15.45:0/272243774 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f973c00bc00 con 0x7f97500b3cb0 2023-11-28T18:42:29.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.935+0000 7f9755931640 1 --2- 172.21.15.45:0/272243774 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f973c003ef0 0x7f973c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:29.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.935+0000 7f9756132640 1 --2- 172.21.15.45:0/272243774 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f97500b3cb0 0x7f973c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:29.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.935+0000 7f9756933640 1 --2- 172.21.15.45:0/272243774 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f973c004d10 0x7f973c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:29.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.939+0000 7f9755931640 1 -- 172.21.15.45:0/272243774 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f97500b3cb0 msgr2=0x7f973c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:29.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.939+0000 7f9755931640 1 --2- 172.21.15.45:0/272243774 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f97500b3cb0 0x7f973c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:29.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.939+0000 7f9755931640 1 -- 172.21.15.45:0/272243774 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f973c004d10 msgr2=0x7f973c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:42:29.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.939+0000 7f9755931640 1 --2- 172.21.15.45:0/272243774 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f973c004d10 0x7f973c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:29.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.939+0000 7f9755931640 1 -- 172.21.15.45:0/272243774 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f973c003530 con 0x7f973c003ef0 2023-11-28T18:42:29.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.939+0000 7f9755931640 1 --2- 172.21.15.45:0/272243774 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f973c003ef0 0x7f973c0047d0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f974000c190 tx=0x7f974001cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=624d1785dd53ca2a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:29.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.939+0000 7f9755130640 1 -- 172.21.15.45:0/272243774 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9740005ae0 con 0x7f973c003ef0 2023-11-28T18:42:29.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.939+0000 7f9755130640 1 -- 172.21.15.45:0/272243774 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9740005c40 con 0x7f973c003ef0 2023-11-28T18:42:29.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.939+0000 7f9755130640 1 -- 172.21.15.45:0/272243774 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97400a5870 con 0x7f973c003ef0 2023-11-28T18:42:29.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.939+0000 7f9758396640 1 -- 172.21.15.45:0/272243774 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f973c003ef0 msgr2=0x7f973c0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:29.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.939+0000 7f9758396640 1 --2- 172.21.15.45:0/272243774 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f973c003ef0 0x7f973c0047d0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f974000c190 tx=0x7f974001cc00 comp rx=0 tx=0).stop 2023-11-28T18:42:29.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.939+0000 7f9756933640 1 -- 172.21.15.45:0/272243774 reap_dead start 2023-11-28T18:42:29.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.939+0000 7f9758396640 1 -- 172.21.15.45:0/272243774 shutdown_connections 2023-11-28T18:42:29.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.939+0000 7f9758396640 1 -- 172.21.15.45:0/272243774 >> 172.21.15.45:0/272243774 conn(0x7f975009c4f0 msgr2=0x7f97500d31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:29.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.939+0000 7f9758396640 1 -- 172.21.15.45:0/272243774 shutdown_connections 2023-11-28T18:42:29.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.939+0000 7f9758396640 1 -- 172.21.15.45:0/272243774 wait complete. 2023-11-28T18:42:29.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.943+0000 7f9758396640 1 Processor -- start 2023-11-28T18:42:29.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.943+0000 7f9758396640 1 -- start start 2023-11-28T18:42:29.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.943+0000 7f9758396640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f973c003ef0 0x7f975015f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:29.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.943+0000 7f9758396640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f975015d950 0x7f975015fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:29.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.943+0000 7f9758396640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f975009f870 0x7f975009fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:29.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.943+0000 7f9758396640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97500cbbd0 con 0x7f973c003ef0 2023-11-28T18:42:29.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.943+0000 7f9758396640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97500a05a0 con 0x7f975009f870 2023-11-28T18:42:29.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.943+0000 7f9758396640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97500a0880 con 0x7f975015d950 2023-11-28T18:42:29.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.943+0000 7f9756132640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f973c003ef0 0x7f975015f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:29.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.943+0000 7f9756132640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f973c003ef0 0x7f975015f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37228/0 (socket says 172.21.15.45:37228) 2023-11-28T18:42:29.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.943+0000 7f9756132640 1 -- 172.21.15.45:0/552339821 learned_addr learned my addr 172.21.15.45:0/552339821 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:42:29.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.943+0000 7f9755931640 1 --2- 172.21.15.45:0/552339821 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f975015d950 0x7f975015fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:29.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.943+0000 7f9756933640 1 --2- 172.21.15.45:0/552339821 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f975009f870 0x7f975009fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:29.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.943+0000 7f9756132640 1 -- 172.21.15.45:0/552339821 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f975015d950 msgr2=0x7f975015fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:29.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.943+0000 7f9756132640 1 --2- 172.21.15.45:0/552339821 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f975015d950 0x7f975015fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:29.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.943+0000 7f9756132640 1 -- 172.21.15.45:0/552339821 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f975009f870 msgr2=0x7f975009fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:29.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.943+0000 7f9756132640 1 --2- 172.21.15.45:0/552339821 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f975009f870 0x7f975009fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:29.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.943+0000 7f9756132640 1 -- 172.21.15.45:0/552339821 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97500a0b60 con 0x7f973c003ef0 2023-11-28T18:42:29.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.943+0000 7f9755931640 1 --2- 172.21.15.45:0/552339821 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f975015d950 0x7f975015fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:42:29.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.943+0000 7f9756132640 1 --2- 172.21.15.45:0/552339821 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f973c003ef0 0x7f975015f910 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f974c011b70 tx=0x7f974c00f5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:29.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.943+0000 7f9746ffd640 1 -- 172.21.15.45:0/552339821 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f974c011c60 con 0x7f973c003ef0 2023-11-28T18:42:29.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.943+0000 7f9746ffd640 1 -- 172.21.15.45:0/552339821 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f974c011de0 con 0x7f973c003ef0 2023-11-28T18:42:29.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.943+0000 7f9746ffd640 1 -- 172.21.15.45:0/552339821 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f974c005310 con 0x7f973c003ef0 2023-11-28T18:42:29.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.943+0000 7f9758396640 1 -- 172.21.15.45:0/552339821 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97500a0e40 con 0x7f973c003ef0 2023-11-28T18:42:29.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.943+0000 7f9758396640 1 -- 172.21.15.45:0/552339821 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97500ca280 con 0x7f973c003ef0 2023-11-28T18:42:29.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.947+0000 7f9758396640 1 -- 172.21.15.45:0/552339821 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9750069480 con 0x7f973c003ef0 2023-11-28T18:42:29.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.947+0000 7f9746ffd640 1 -- 172.21.15.45:0/552339821 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f974c003600 con 0x7f973c003ef0 2023-11-28T18:42:29.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.947+0000 7f9746ffd640 1 --2- 172.21.15.45:0/552339821 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9734066900 0x7f9734068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:42:29.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.947+0000 7f9746ffd640 1 -- 172.21.15.45:0/552339821 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f974c087e50 con 0x7f973c003ef0 2023-11-28T18:42:29.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.947+0000 7f9755931640 1 --2- 172.21.15.45:0/552339821 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9734066900 0x7f9734068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:42:29.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.951+0000 7f9755931640 1 --2- 172.21.15.45:0/552339821 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9734066900 0x7f9734068dc0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9740005fd0 tx=0x7f97400a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:42:29.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:29.951+0000 7f9746ffd640 1 -- 172.21.15.45:0/552339821 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f974c054f60 con 0x7f973c003ef0 2023-11-28T18:42:30.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:30.147+0000 7f9758396640 1 -- 172.21.15.45:0/552339821 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f975009ca30 con 0x7f973c003ef0 2023-11-28T18:42:30.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:30.147+0000 7f9746ffd640 1 -- 172.21.15.45:0/552339821 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v39) v1 ==== 53+0+73 (secure 0 0 0) 0x7f974c019070 con 0x7f973c003ef0 2023-11-28T18:42:30.153 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T18:42:30.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:30.151+0000 7f9758396640 1 -- 172.21.15.45:0/552339821 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9734066900 msgr2=0x7f9734068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:30.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:30.151+0000 7f9758396640 1 --2- 172.21.15.45:0/552339821 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9734066900 0x7f9734068dc0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9740005fd0 tx=0x7f97400a7070 comp rx=0 tx=0).stop 2023-11-28T18:42:30.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:30.151+0000 7f9758396640 1 -- 172.21.15.45:0/552339821 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f973c003ef0 msgr2=0x7f975015f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:42:30.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:30.151+0000 7f9758396640 1 --2- 172.21.15.45:0/552339821 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f973c003ef0 0x7f975015f910 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f974c011b70 tx=0x7f974c00f5a0 comp rx=0 tx=0).stop 2023-11-28T18:42:30.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:30.151+0000 7f9758396640 1 -- 172.21.15.45:0/552339821 shutdown_connections 2023-11-28T18:42:30.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:30.151+0000 7f9758396640 1 --2- 172.21.15.45:0/552339821 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9734066900 0x7f9734068dc0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:30.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:30.151+0000 7f9758396640 1 --2- 172.21.15.45:0/552339821 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f975009f870 0x7f975009fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:30.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:30.151+0000 7f9758396640 1 --2- 172.21.15.45:0/552339821 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f975015d950 0x7f975015fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:30.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:30.151+0000 7f9758396640 1 --2- 172.21.15.45:0/552339821 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f973c003ef0 0x7f975015f910 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:42:30.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:30.151+0000 7f9758396640 1 -- 172.21.15.45:0/552339821 >> 172.21.15.45:0/552339821 conn(0x7f975009c4f0 msgr2=0x7f97500b5510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:42:30.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:30.151+0000 7f9758396640 1 -- 172.21.15.45:0/552339821 shutdown_connections 2023-11-28T18:42:30.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:30.151+0000 7f9758396640 1 -- 172.21.15.45:0/552339821 wait complete. 2023-11-28T18:42:30.174 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-28T18:42:30.174 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T18:42:30.174 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi045.front.sepia.ceph.com 2023-11-28T18:42:30.174 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-28T18:42:30.174 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-28T18:42:30.175 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-28T18:42:30.175 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-28T18:42:30.175 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T18:42:30.175 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T18:42:30.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:42:30.176 DEBUG:teuthology.orchestra.run.smithi045:> ip addr 2023-11-28T18:42:30.186 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T18:42:30.187 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T18:42:30.187 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T18:42:30.187 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:42:30.187 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2023-11-28T18:42:30.187 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:42:30.187 INFO:teuthology.orchestra.run.smithi045.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T18:42:30.187 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a6 brd ff:ff:ff:ff:ff:ff 2023-11-28T18:42:30.187 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f0 2023-11-28T18:42:30.187 INFO:teuthology.orchestra.run.smithi045.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T18:42:30.188 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a7 brd ff:ff:ff:ff:ff:ff 2023-11-28T18:42:30.188 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f1 2023-11-28T18:42:30.188 INFO:teuthology.orchestra.run.smithi045.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T18:42:30.188 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:be brd ff:ff:ff:ff:ff:ff 2023-11-28T18:42:30.188 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f0 2023-11-28T18:42:30.188 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.21.15.45/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-11-28T18:42:30.188 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft 42108sec preferred_lft 42108sec 2023-11-28T18:42:30.189 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec4:7aff:febd:12be/64 scope link 2023-11-28T18:42:30.189 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:42:30.189 INFO:teuthology.orchestra.run.smithi045.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T18:42:30.189 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:bf brd ff:ff:ff:ff:ff:ff 2023-11-28T18:42:30.189 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f1 2023-11-28T18:42:30.189 INFO:teuthology.orchestra.run.smithi045.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T18:42:30.189 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 02:42:ab:69:35:3d brd ff:ff:ff:ff:ff:ff 2023-11-28T18:42:30.189 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T18:42:30.189 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:42:30.189 INFO:teuthology.orchestra.run.smithi045.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T18:42:30.189 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-28T18:42:30.189 INFO:teuthology.orchestra.run.smithi045.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-28T18:42:30.190 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:42:30.190 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-28T18:42:30.190 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:42:30.190 INFO:teuthology.orchestra.run.smithi045.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T18:42:30.190 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T18:42:30.190 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-28T18:42:30.190 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:42:30.190 INFO:teuthology.orchestra.run.smithi045.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T18:42:30.190 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T18:42:30.191 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-11-28T18:42:30.191 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:42:30.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:42:30.192 DEBUG:teuthology.orchestra.run.smithi045:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T18:42:30.252 INFO:teuthology.orchestra.run.smithi045.stdout:1 2023-11-28T18:42:30.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:42:30.255 DEBUG:teuthology.orchestra.run.smithi045:> route 2023-11-28T18:42:30.313 INFO:teuthology.orchestra.run.smithi045.stdout:Kernel IP routing table 2023-11-28T18:42:30.313 INFO:teuthology.orchestra.run.smithi045.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T18:42:30.313 INFO:teuthology.orchestra.run.smithi045.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-11-28T18:42:30.313 INFO:teuthology.orchestra.run.smithi045.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T18:42:30.313 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-11-28T18:42:30.313 INFO:teuthology.orchestra.run.smithi045.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T18:42:30.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:42:30.314 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-11-28T18:42:30.314 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-11-28T18:42:30.314 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-28T18:42:30.314 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-28T18:42:30.314 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-28T18:42:30.314 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-11-28T18:42:30.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:42:30.410 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-11-28T18:42:30.463 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-28T18:42:30.463 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-28T18:42:30.463 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T18:42:30.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:42:30.463 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set brx.0 up 2023-11-28T18:42:30.530 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-28T18:42:30.530 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T18:42:30.531 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-28T18:42:30.582 INFO:teuthology.orchestra.run.smithi045.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-28T18:42:30.582 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T18:42:30.582 DEBUG:teuthology.orchestra.run.smithi045:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-28T18:42:30.633 DEBUG:teuthology.orchestra.run.smithi045:> sudo modprobe fuse 2023-11-28T18:42:30.699 DEBUG:teuthology.orchestra.run.smithi045:> cat /proc/self/mounts | awk '{print $2}' 2023-11-28T18:42:30.755 INFO:teuthology.orchestra.run.smithi045.stdout:/sys 2023-11-28T18:42:30.756 INFO:teuthology.orchestra.run.smithi045.stdout:/proc 2023-11-28T18:42:30.756 INFO:teuthology.orchestra.run.smithi045.stdout:/dev 2023-11-28T18:42:30.756 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/pts 2023-11-28T18:42:30.756 INFO:teuthology.orchestra.run.smithi045.stdout:/run 2023-11-28T18:42:30.756 INFO:teuthology.orchestra.run.smithi045.stdout:/ 2023-11-28T18:42:30.756 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/security 2023-11-28T18:42:30.756 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/shm 2023-11-28T18:42:30.756 INFO:teuthology.orchestra.run.smithi045.stdout:/run/lock 2023-11-28T18:42:30.757 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/cgroup 2023-11-28T18:42:30.757 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/pstore 2023-11-28T18:42:30.757 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/bpf 2023-11-28T18:42:30.757 INFO:teuthology.orchestra.run.smithi045.stdout:/proc/sys/fs/binfmt_misc 2023-11-28T18:42:30.757 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/hugepages 2023-11-28T18:42:30.757 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/mqueue 2023-11-28T18:42:30.757 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/debug 2023-11-28T18:42:30.757 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/tracing 2023-11-28T18:42:30.758 INFO:teuthology.orchestra.run.smithi045.stdout:/proc/fs/nfsd 2023-11-28T18:42:30.758 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/fuse/connections 2023-11-28T18:42:30.758 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/config 2023-11-28T18:42:30.758 INFO:teuthology.orchestra.run.smithi045.stdout:/run/credentials/systemd-sysusers.service 2023-11-28T18:42:30.758 INFO:teuthology.orchestra.run.smithi045.stdout:/run/rpc_pipefs 2023-11-28T18:42:30.758 INFO:teuthology.orchestra.run.smithi045.stdout:/run/user/1000 2023-11-28T18:42:30.758 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph 2023-11-28T18:42:30.758 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-0 2023-11-28T18:42:30.758 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-1 2023-11-28T18:42:30.759 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-2 2023-11-28T18:42:30.759 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-3 2023-11-28T18:42:30.759 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns 2023-11-28T18:42:30.759 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T18:42:30.759 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T18:42:30.759 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T18:42:30.759 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T18:42:30.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:42:30.761 DEBUG:teuthology.orchestra.run.smithi045:> ls /sys/fs/fuse/connections 2023-11-28T18:42:30.809 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-28T18:42:30.810 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-28T18:42:30.856 DEBUG:teuthology.orchestra.run.smithi045:> sudo modprobe fuse 2023-11-28T18:42:30.878 DEBUG:teuthology.orchestra.run.smithi045:> cat /proc/self/mounts | awk '{print $2}' 2023-11-28T18:42:30.931 INFO:teuthology.orchestra.run.smithi045.stdout:/sys 2023-11-28T18:42:30.931 INFO:teuthology.orchestra.run.smithi045.stdout:/proc 2023-11-28T18:42:30.931 INFO:teuthology.orchestra.run.smithi045.stdout:/dev 2023-11-28T18:42:30.931 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/pts 2023-11-28T18:42:30.931 INFO:teuthology.orchestra.run.smithi045.stdout:/run 2023-11-28T18:42:30.932 INFO:teuthology.orchestra.run.smithi045.stdout:/ 2023-11-28T18:42:30.932 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/security 2023-11-28T18:42:30.932 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/shm 2023-11-28T18:42:30.932 INFO:teuthology.orchestra.run.smithi045.stdout:/run/lock 2023-11-28T18:42:30.932 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/cgroup 2023-11-28T18:42:30.932 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/pstore 2023-11-28T18:42:30.932 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/bpf 2023-11-28T18:42:30.932 INFO:teuthology.orchestra.run.smithi045.stdout:/proc/sys/fs/binfmt_misc 2023-11-28T18:42:30.932 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/hugepages 2023-11-28T18:42:30.932 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/mqueue 2023-11-28T18:42:30.933 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/debug 2023-11-28T18:42:30.933 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/tracing 2023-11-28T18:42:30.933 INFO:teuthology.orchestra.run.smithi045.stdout:/proc/fs/nfsd 2023-11-28T18:42:30.933 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/fuse/connections 2023-11-28T18:42:30.933 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/config 2023-11-28T18:42:30.933 INFO:teuthology.orchestra.run.smithi045.stdout:/run/credentials/systemd-sysusers.service 2023-11-28T18:42:30.933 INFO:teuthology.orchestra.run.smithi045.stdout:/run/rpc_pipefs 2023-11-28T18:42:30.933 INFO:teuthology.orchestra.run.smithi045.stdout:/run/user/1000 2023-11-28T18:42:30.933 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph 2023-11-28T18:42:30.934 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-0 2023-11-28T18:42:30.934 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-1 2023-11-28T18:42:30.934 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-2 2023-11-28T18:42:30.934 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-3 2023-11-28T18:42:30.934 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns 2023-11-28T18:42:30.934 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T18:42:30.934 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T18:42:30.934 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T18:42:30.934 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T18:42:30.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:42:30.936 DEBUG:teuthology.orchestra.run.smithi045:> ls /sys/fs/fuse/connections 2023-11-28T18:42:30.955 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:2023-11-28T18:42:30.951+0000 7fb74904e580 -1 init, newargv = 0x5632b6b1bf40 newargc=15 2023-11-28T18:42:30.955 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:ceph-fuse[51663]: starting ceph client 2023-11-28T18:42:30.962 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:ceph-fuse[51663]: starting fuse 2023-11-28T18:42:30.965 INFO:teuthology.orchestra.run.smithi045.stdout:43 2023-11-28T18:42:30.965 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-11-28T18:42:30.966 DEBUG:teuthology.orchestra.run.smithi045:> sudo stdin-killer -- python3 -c ' 2023-11-28T18:42:30.966 DEBUG:teuthology.orchestra.run.smithi045:> import glob 2023-11-28T18:42:30.966 DEBUG:teuthology.orchestra.run.smithi045:> import re 2023-11-28T18:42:30.966 DEBUG:teuthology.orchestra.run.smithi045:> import os 2023-11-28T18:42:30.966 DEBUG:teuthology.orchestra.run.smithi045:> import subprocess 2023-11-28T18:42:30.966 DEBUG:teuthology.orchestra.run.smithi045:> 2023-11-28T18:42:30.966 DEBUG:teuthology.orchestra.run.smithi045:> def _find_admin_socket(client_name): 2023-11-28T18:42:30.966 DEBUG:teuthology.orchestra.run.smithi045:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-28T18:42:30.966 DEBUG:teuthology.orchestra.run.smithi045:> files = glob.glob(asok_path) 2023-11-28T18:42:30.967 DEBUG:teuthology.orchestra.run.smithi045:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-28T18:42:30.967 DEBUG:teuthology.orchestra.run.smithi045:> 2023-11-28T18:42:30.967 DEBUG:teuthology.orchestra.run.smithi045:> # Given a non-glob path, it better be there 2023-11-28T18:42:30.967 DEBUG:teuthology.orchestra.run.smithi045:> if "*" not in asok_path: 2023-11-28T18:42:30.967 DEBUG:teuthology.orchestra.run.smithi045:> assert(len(files) == 1) 2023-11-28T18:42:30.967 DEBUG:teuthology.orchestra.run.smithi045:> return files[0] 2023-11-28T18:42:30.967 DEBUG:teuthology.orchestra.run.smithi045:> 2023-11-28T18:42:30.967 DEBUG:teuthology.orchestra.run.smithi045:> for f in files: 2023-11-28T18:42:30.967 DEBUG:teuthology.orchestra.run.smithi045:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-28T18:42:30.967 DEBUG:teuthology.orchestra.run.smithi045:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-28T18:42:30.967 DEBUG:teuthology.orchestra.run.smithi045:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-28T18:42:30.967 DEBUG:teuthology.orchestra.run.smithi045:> contents = proc_f.read() 2023-11-28T18:42:30.968 DEBUG:teuthology.orchestra.run.smithi045:> if mountpoint in contents: 2023-11-28T18:42:30.968 DEBUG:teuthology.orchestra.run.smithi045:> return f 2023-11-28T18:42:30.968 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-28T18:42:30.968 DEBUG:teuthology.orchestra.run.smithi045:> 2023-11-28T18:42:30.968 DEBUG:teuthology.orchestra.run.smithi045:> print(_find_admin_socket("client.0")) 2023-11-28T18:42:30.968 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-11-28T18:42:31.093 INFO:teuthology.orchestra.run.smithi045.stdout:/var/run/ceph/ceph-client.0.51663.asok 2023-11-28T18:42:31.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:42:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-28T18:42:31.104 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.51663.asok 2023-11-28T18:42:31.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:42:31.104 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.51663.asok status 2023-11-28T18:42:31.279 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-11-28T18:42:31.279 INFO:teuthology.orchestra.run.smithi045.stdout: "metadata": { 2023-11-28T18:42:31.279 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_sha1": "47c1c547372ed5bff7984647dc200bac0e019caf", 2023-11-28T18:42:31.280 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_version": "ceph version 18.0.0-7531-g47c1c547 (47c1c547372ed5bff7984647dc200bac0e019caf) reef (dev)", 2023-11-28T18:42:31.280 INFO:teuthology.orchestra.run.smithi045.stdout: "entity_id": "0", 2023-11-28T18:42:31.280 INFO:teuthology.orchestra.run.smithi045.stdout: "hostname": "smithi045", 2023-11-28T18:42:31.280 INFO:teuthology.orchestra.run.smithi045.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-28T18:42:31.280 INFO:teuthology.orchestra.run.smithi045.stdout: "pid": "51663", 2023-11-28T18:42:31.280 INFO:teuthology.orchestra.run.smithi045.stdout: "root": "/" 2023-11-28T18:42:31.280 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:42:31.280 INFO:teuthology.orchestra.run.smithi045.stdout: "dentry_count": 0, 2023-11-28T18:42:31.280 INFO:teuthology.orchestra.run.smithi045.stdout: "dentry_pinned_count": 0, 2023-11-28T18:42:31.280 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 6585, 2023-11-28T18:42:31.280 INFO:teuthology.orchestra.run.smithi045.stdout: "inst": { 2023-11-28T18:42:31.281 INFO:teuthology.orchestra.run.smithi045.stdout: "name": { 2023-11-28T18:42:31.281 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "client", 2023-11-28T18:42:31.281 INFO:teuthology.orchestra.run.smithi045.stdout: "num": 6585 2023-11-28T18:42:31.281 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:42:31.281 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": { 2023-11-28T18:42:31.281 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-11-28T18:42:31.281 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "192.168.0.1:0", 2023-11-28T18:42:31.281 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 751762511 2023-11-28T18:42:31.281 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:42:31.282 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:42:31.282 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": { 2023-11-28T18:42:31.282 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-11-28T18:42:31.282 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "192.168.0.1:0", 2023-11-28T18:42:31.282 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 751762511 2023-11-28T18:42:31.285 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:42:31.285 INFO:teuthology.orchestra.run.smithi045.stdout: "inst_str": "client.6585 192.168.0.1:0/751762511", 2023-11-28T18:42:31.286 INFO:teuthology.orchestra.run.smithi045.stdout: "addr_str": "192.168.0.1:0/751762511", 2023-11-28T18:42:31.286 INFO:teuthology.orchestra.run.smithi045.stdout: "inode_count": 1, 2023-11-28T18:42:31.286 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_epoch": 39, 2023-11-28T18:42:31.286 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_epoch": 49, 2023-11-28T18:42:31.286 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_epoch_barrier": 0, 2023-11-28T18:42:31.287 INFO:teuthology.orchestra.run.smithi045.stdout: "blocklisted": false, 2023-11-28T18:42:31.287 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs" 2023-11-28T18:42:31.287 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-11-28T18:42:31.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:42:31.295 DEBUG:teuthology.orchestra.run.smithi045:> stat --file-system '--printf=%T 2023-11-28T18:42:31.295 DEBUG:teuthology.orchestra.run.smithi045:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-28T18:42:31.306 INFO:teuthology.orchestra.run.smithi045.stdout:fuseblk 2023-11-28T18:42:31.306 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-28T18:42:31.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:42:31.306 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-28T18:42:31.374 INFO:tasks.workunit:Pulling workunits from ref 47c1c547372ed5bff7984647dc200bac0e019caf 2023-11-28T18:42:31.374 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-11-28T18:42:31.375 DEBUG:teuthology.orchestra.run.smithi045:> stat -- /home/ubuntu/cephtest/mnt.0 2023-11-28T18:42:31.426 INFO:teuthology.orchestra.run.smithi045.stdout: File: /home/ubuntu/cephtest/mnt.0 2023-11-28T18:42:31.426 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2023-11-28T18:42:31.426 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 2bh/43d Inode: 1 Links: 2 2023-11-28T18:42:31.426 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T18:42:31.426 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-11-28T18:42:31.426 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2023-11-28 18:41:00.954900151 +0000 2023-11-28T18:42:31.426 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2023-11-28 18:41:00.954900151 +0000 2023-11-28T18:42:31.427 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: - 2023-11-28T18:42:31.427 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2023-11-28T18:42:31.427 DEBUG:teuthology.orchestra.run.smithi045:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2023-11-28T18:42:31.499 INFO:tasks.workunit:timeout=1h 2023-11-28T18:42:31.499 INFO:tasks.workunit:cleanup=True 2023-11-28T18:42:31.500 DEBUG:teuthology.orchestra.run.smithi045:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 47c1c547372ed5bff7984647dc200bac0e019caf 2023-11-28T18:42:31.556 INFO:tasks.workunit.client.0.smithi045.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-11-28T18:42:32.288 INFO:tasks.ceph.mds.c.smithi045.stderr:2023-11-28T18:42:32.283+0000 7f8eaf6cc640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T18:42:54.078 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:42:54.082 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:43:24.133 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:43:24.200 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:43:36.934 INFO:tasks.workunit.client.0.smithi045.stderr:Updating files: 65% (7993/12117) Updating files: 66% (7998/12117) Updating files: 67% (8119/12117) Updating files: 68% (8240/12117) Updating files: 69% (8361/12117) Updating files: 70% (8482/12117) Updating files: 71% (8604/12117) Updating files: 72% (8725/12117) Updating files: 73% (8846/12117) Updating files: 74% (8967/12117) Updating files: 75% (9088/12117) Updating files: 76% (9209/12117) Updating files: 77% (9331/12117) Updating files: 78% (9452/12117) Updating files: 79% (9573/12117) Updating files: 80% (9694/12117) Updating files: 81% (9815/12117) Updating files: 82% (9936/12117) Updating files: 83% (10058/12117) Updating files: 84% (10179/12117) Updating files: 85% (10300/12117) Updating files: 86% (10421/12117) Updating files: 87% (10542/12117) Updating files: 88% (10663/12117) Updating files: 89% (10785/12117) Updating files: 90% (10906/12117) Updating files: 91% (11027/12117) Updating files: 92% (11148/12117) Updating files: 93% (11269/12117) Updating files: 94% (11390/12117) Updating files: 95% (11512/12117) Updating files: 96% (11633/12117) Updating files: 97% (11754/12117) Updating files: 98% (11875/12117) Updating files: 99% (11996/12117) Updating files: 100% (12117/12117) Updating files: 100% (12117/12117), done. 2023-11-28T18:43:37.555 INFO:tasks.workunit.client.0.smithi045.stderr:Note: switching to '47c1c547372ed5bff7984647dc200bac0e019caf'. 2023-11-28T18:43:37.555 INFO:tasks.workunit.client.0.smithi045.stderr: 2023-11-28T18:43:37.555 INFO:tasks.workunit.client.0.smithi045.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-11-28T18:43:37.555 INFO:tasks.workunit.client.0.smithi045.stderr:changes and commit them, and you can discard any commits you make in this 2023-11-28T18:43:37.555 INFO:tasks.workunit.client.0.smithi045.stderr:state without impacting any branches by switching back to a branch. 2023-11-28T18:43:37.555 INFO:tasks.workunit.client.0.smithi045.stderr: 2023-11-28T18:43:37.556 INFO:tasks.workunit.client.0.smithi045.stderr:If you want to create a new branch to retain commits you create, you may 2023-11-28T18:43:37.556 INFO:tasks.workunit.client.0.smithi045.stderr:do so (now or later) by using -c with the switch command. Example: 2023-11-28T18:43:37.556 INFO:tasks.workunit.client.0.smithi045.stderr: 2023-11-28T18:43:37.556 INFO:tasks.workunit.client.0.smithi045.stderr: git switch -c 2023-11-28T18:43:37.556 INFO:tasks.workunit.client.0.smithi045.stderr: 2023-11-28T18:43:37.556 INFO:tasks.workunit.client.0.smithi045.stderr:Or undo this operation with: 2023-11-28T18:43:37.556 INFO:tasks.workunit.client.0.smithi045.stderr: 2023-11-28T18:43:37.557 INFO:tasks.workunit.client.0.smithi045.stderr: git switch - 2023-11-28T18:43:37.557 INFO:tasks.workunit.client.0.smithi045.stderr: 2023-11-28T18:43:37.557 INFO:tasks.workunit.client.0.smithi045.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-11-28T18:43:37.557 INFO:tasks.workunit.client.0.smithi045.stderr: 2023-11-28T18:43:37.557 INFO:tasks.workunit.client.0.smithi045.stderr:HEAD is now at 47c1c547372 Merge PR #51931 into wip-vshankar-testing-20231127.102654 2023-11-28T18:43:37.559 DEBUG:teuthology.orchestra.run.smithi045:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-11-28T18:43:37.570 INFO:tasks.workunit.client.0.smithi045.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-11-28T18:43:37.573 INFO:tasks.workunit.client.0.smithi045.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-11-28T18:43:37.573 INFO:tasks.workunit.client.0.smithi045.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-11-28T18:43:37.639 INFO:tasks.workunit.client.0.smithi045.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-11-28T18:43:37.706 INFO:tasks.workunit.client.0.smithi045.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-11-28T18:43:37.762 INFO:tasks.workunit.client.0.smithi045.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-11-28T18:43:37.766 INFO:tasks.workunit.client.0.smithi045.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-11-28T18:43:37.766 INFO:tasks.workunit.client.0.smithi045.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-11-28T18:43:37.821 INFO:tasks.workunit.client.0.smithi045.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-11-28T18:43:37.826 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T18:43:37.827 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-11-28T18:43:37.877 INFO:tasks.workunit:Running workunits matching fs/misc/trivial_sync.sh on client.0... 2023-11-28T18:43:37.878 INFO:tasks.workunit:Running workunit fs/misc/trivial_sync.sh... 2023-11-28T18:43:37.879 DEBUG:teuthology.orchestra.run.smithi045:workunit test fs/misc/trivial_sync.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=47c1c547372ed5bff7984647dc200bac0e019caf TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 1h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/trivial_sync.sh 2023-11-28T18:43:39.659 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-11-28T18:43:39.660 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-11-28T18:43:39.709 INFO:tasks.workunit:Stopping ['fs/misc/trivial_sync.sh'] on client.0... 2023-11-28T18:43:39.710 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-11-28T18:43:40.583 DEBUG:teuthology.parallel:result is None 2023-11-28T18:43:40.584 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2023-11-28T18:43:40.612 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2023-11-28T18:43:40.612 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-28T18:43:40.613 DEBUG:teuthology.orchestra.run.smithi045:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T18:43:40.732 DEBUG:teuthology.orchestra.run.smithi190:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T18:43:40.790 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-28T18:43:40.790 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T18:43:40.790 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T18:43:40.801 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T18:43:40.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.982+0000 7fb59f1d1640 1 Processor -- start 2023-11-28T18:43:40.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.982+0000 7fb59f1d1640 1 -- start start 2023-11-28T18:43:40.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.982+0000 7fb59f1d1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb59806ca10 0x7fb59815a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:40.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.982+0000 7fb59f1d1640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb59815b3e0 con 0x7fb59813cf70 2023-11-28T18:43:40.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.986+0000 7fb59f1d1640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb59813f760 con 0x7fb59815abb0 2023-11-28T18:43:40.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.986+0000 7fb59f1d1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb59813d350 con 0x7fb59806ca10 2023-11-28T18:43:40.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.986+0000 7fb59cf6d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fb59813cf70 0x7fb59806c300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47568/0 (socket says 172.21.15.45:47568) 2023-11-28T18:43:40.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.986+0000 7fb59cf6d640 1 -- 172.21.15.45:0/3585639359 learned_addr learned my addr 172.21.15.45:0/3585639359 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:43:40.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.986+0000 7fb597fff640 1 --2- 172.21.15.45:0/3585639359 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb59806ca10 0x7fb59815a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:40.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.986+0000 7fb5977fe640 1 -- 172.21.15.45:0/3585639359 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2911873226 0 0) 0x7fb59815b3e0 con 0x7fb59813cf70 2023-11-28T18:43:40.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.986+0000 7fb5977fe640 1 -- 172.21.15.45:0/3585639359 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb588005740 con 0x7fb59813cf70 2023-11-28T18:43:40.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.986+0000 7fb5977fe640 1 -- 172.21.15.45:0/3585639359 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1995266702 0 0) 0x7fb59813f760 con 0x7fb59815abb0 2023-11-28T18:43:40.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.986+0000 7fb5977fe640 1 -- 172.21.15.45:0/3585639359 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb59815b3e0 con 0x7fb59815abb0 2023-11-28T18:43:40.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.986+0000 7fb5977fe640 1 -- 172.21.15.45:0/3585639359 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 184694564 0 0) 0x7fb588005740 con 0x7fb59813cf70 2023-11-28T18:43:40.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.986+0000 7fb5977fe640 1 -- 172.21.15.45:0/3585639359 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb59806ca10 msgr2=0x7fb59815a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:43:40.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.986+0000 7fb5977fe640 1 --2- 172.21.15.45:0/3585639359 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb59806ca10 0x7fb59815a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:40.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.986+0000 7fb5977fe640 1 -- 172.21.15.45:0/3585639359 >> v1:172.21.15.190:6789/0 conn(0x7fb59815abb0 legacy=0x7fb5980cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:40.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.986+0000 7fb5977fe640 1 -- 172.21.15.45:0/3585639359 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb59813fa40 con 0x7fb59813cf70 2023-11-28T18:43:40.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.986+0000 7fb5977fe640 1 -- 172.21.15.45:0/3585639359 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4084481567 0 0) 0x7fb58c001680 con 0x7fb59813cf70 2023-11-28T18:43:40.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.986+0000 7fb5977fe640 1 -- 172.21.15.45:0/3585639359 >> v1:172.21.15.45:6789/0 conn(0x7fb59813cf70 legacy=0x7fb59806c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:40.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.986+0000 7fb5977fe640 1 --2- 172.21.15.45:0/3585639359 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb588005d50 0x7fb588006150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:40.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.986+0000 7fb5977fe640 1 --2- 172.21.15.45:0/3585639359 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb5880069e0 0x7fb588006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:40.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.986+0000 7fb5977fe640 1 --2- 172.21.15.45:0/3585639359 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5880073a0 0x7fb58800dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:40.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.986+0000 7fb5977fe640 1 -- 172.21.15.45:0/3585639359 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb58800e270 con 0x7fb5880073a0 2023-11-28T18:43:40.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.986+0000 7fb5977fe640 1 -- 172.21.15.45:0/3585639359 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb58800e3b0 con 0x7fb588005d50 2023-11-28T18:43:40.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.986+0000 7fb5977fe640 1 -- 172.21.15.45:0/3585639359 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb58800e570 con 0x7fb5880069e0 2023-11-28T18:43:40.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.986+0000 7fb597fff640 1 --2- 172.21.15.45:0/3585639359 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb59806ca10 0x7fb59815a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:43:40.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.986+0000 7fb59d76e640 1 --2- 172.21.15.45:0/3585639359 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5880073a0 0x7fb58800dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:40.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.986+0000 7fb59cf6d640 1 --2- 172.21.15.45:0/3585639359 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb588005d50 0x7fb588006150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:40.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.986+0000 7fb597fff640 1 --2- 172.21.15.45:0/3585639359 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb5880069e0 0x7fb588006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:40.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.986+0000 7fb59d76e640 1 -- 172.21.15.45:0/3585639359 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb5880069e0 msgr2=0x7fb588006e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:43:40.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.986+0000 7fb59d76e640 1 --2- 172.21.15.45:0/3585639359 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb5880069e0 0x7fb588006e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:40.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.986+0000 7fb59d76e640 1 -- 172.21.15.45:0/3585639359 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb588005d50 msgr2=0x7fb588006150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:43:40.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.986+0000 7fb59d76e640 1 --2- 172.21.15.45:0/3585639359 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb588005d50 0x7fb588006150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:40.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.986+0000 7fb59d76e640 1 -- 172.21.15.45:0/3585639359 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb588005740 con 0x7fb5880073a0 2023-11-28T18:43:40.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.990+0000 7fb59d76e640 1 --2- 172.21.15.45:0/3585639359 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5880073a0 0x7fb58800dba0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fb590001fd0 tx=0x7fb59001f050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3652ed65a3744adc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:40.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.990+0000 7fb5977fe640 1 -- 172.21.15.45:0/3585639359 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5900a8c70 con 0x7fb5880073a0 2023-11-28T18:43:40.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.990+0000 7fb5977fe640 1 -- 172.21.15.45:0/3585639359 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5900a8df0 con 0x7fb5880073a0 2023-11-28T18:43:40.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.990+0000 7fb5977fe640 1 -- 172.21.15.45:0/3585639359 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb590003bc0 con 0x7fb5880073a0 2023-11-28T18:43:40.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.990+0000 7fb59f1d1640 1 -- 172.21.15.45:0/3585639359 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5880073a0 msgr2=0x7fb58800dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:40.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.990+0000 7fb59f1d1640 1 --2- 172.21.15.45:0/3585639359 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5880073a0 0x7fb58800dba0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fb590001fd0 tx=0x7fb59001f050 comp rx=0 tx=0).stop 2023-11-28T18:43:40.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.990+0000 7fb59d76e640 1 -- 172.21.15.45:0/3585639359 reap_dead start 2023-11-28T18:43:40.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.990+0000 7fb59f1d1640 1 -- 172.21.15.45:0/3585639359 shutdown_connections 2023-11-28T18:43:40.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.990+0000 7fb59f1d1640 1 -- 172.21.15.45:0/3585639359 >> 172.21.15.45:0/3585639359 conn(0x7fb59806a570 msgr2=0x7fb59806a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:43:40.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.990+0000 7fb59f1d1640 1 -- 172.21.15.45:0/3585639359 shutdown_connections 2023-11-28T18:43:40.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.990+0000 7fb59f1d1640 1 -- 172.21.15.45:0/3585639359 wait complete. 2023-11-28T18:43:40.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.990+0000 7fb59f1d1640 1 Processor -- start 2023-11-28T18:43:40.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.990+0000 7fb59f1d1640 1 -- start start 2023-11-28T18:43:40.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.994+0000 7fb59f1d1640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb5880073a0 0x7fb5980abcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:40.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.994+0000 7fb59f1d1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb598138350 0x7fb598158040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:40.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.994+0000 7fb59f1d1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb598137a90 0x7fb59813d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:40.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.994+0000 7fb59f1d1640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5980a8510 con 0x7fb598137a90 2023-11-28T18:43:40.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.994+0000 7fb59f1d1640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5980ac230 con 0x7fb5880073a0 2023-11-28T18:43:40.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.994+0000 7fb59f1d1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb598158870 con 0x7fb598138350 2023-11-28T18:43:40.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.994+0000 7fb59d76e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb598137a90 0x7fb59813d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:41.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.994+0000 7fb59d76e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb598137a90 0x7fb59813d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38182/0 (socket says 172.21.15.45:38182) 2023-11-28T18:43:41.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.994+0000 7fb59d76e640 1 -- 172.21.15.45:0/4006284190 learned_addr learned my addr 172.21.15.45:0/4006284190 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:43:41.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.994+0000 7fb597fff640 1 --2- 172.21.15.45:0/4006284190 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb598138350 0x7fb598158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:41.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.994+0000 7fb59cf6d640 1 --2- 172.21.15.45:0/4006284190 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb5880073a0 0x7fb5980abcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:41.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.994+0000 7fb59d76e640 1 -- 172.21.15.45:0/4006284190 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb598138350 msgr2=0x7fb598158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:41.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.994+0000 7fb59d76e640 1 --2- 172.21.15.45:0/4006284190 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb598138350 0x7fb598158040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:41.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.994+0000 7fb59d76e640 1 -- 172.21.15.45:0/4006284190 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb5880073a0 msgr2=0x7fb5980abcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:41.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.994+0000 7fb59d76e640 1 --2- 172.21.15.45:0/4006284190 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb5880073a0 0x7fb5980abcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:41.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.994+0000 7fb59d76e640 1 -- 172.21.15.45:0/4006284190 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb598158b50 con 0x7fb598137a90 2023-11-28T18:43:41.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.994+0000 7fb59d76e640 1 --2- 172.21.15.45:0/4006284190 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb598137a90 0x7fb59813d9a0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fb59001ee80 tx=0x7fb588007a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:41.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.994+0000 7fb5957fa640 1 -- 172.21.15.45:0/4006284190 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb590003e80 con 0x7fb598137a90 2023-11-28T18:43:41.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.994+0000 7fb5957fa640 1 -- 172.21.15.45:0/4006284190 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5900a8c70 con 0x7fb598137a90 2023-11-28T18:43:41.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.994+0000 7fb5957fa640 1 -- 172.21.15.45:0/4006284190 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb590006d60 con 0x7fb598137a90 2023-11-28T18:43:41.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.994+0000 7fb59f1d1640 1 -- 172.21.15.45:0/4006284190 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb598158e30 con 0x7fb598137a90 2023-11-28T18:43:41.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.994+0000 7fb59f1d1640 1 -- 172.21.15.45:0/4006284190 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb598159110 con 0x7fb598137a90 2023-11-28T18:43:41.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.994+0000 7fb59f1d1640 1 -- 172.21.15.45:0/4006284190 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5980a86e0 con 0x7fb598137a90 2023-11-28T18:43:41.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.998+0000 7fb5957fa640 1 -- 172.21.15.45:0/4006284190 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fb5900050d0 con 0x7fb598137a90 2023-11-28T18:43:41.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.998+0000 7fb5957fa640 1 --2- 172.21.15.45:0/4006284190 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fb57c066900 0x7fb57c068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:41.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.998+0000 7fb5957fa640 1 -- 172.21.15.45:0/4006284190 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fb5901211f0 con 0x7fb598137a90 2023-11-28T18:43:41.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.998+0000 7fb59cf6d640 1 --2- 172.21.15.45:0/4006284190 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fb57c066900 0x7fb57c068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:41.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:40.998+0000 7fb59cf6d640 1 --2- 172.21.15.45:0/4006284190 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fb57c066900 0x7fb57c068dc0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fb58c001130 tx=0x7fb58c000ee0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:41.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.002+0000 7fb5957fa640 1 -- 172.21.15.45:0/4006284190 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb5980a86e0 con 0x7fb598137a90 2023-11-28T18:43:41.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.162+0000 7fb59f1d1640 1 -- 172.21.15.45:0/4006284190 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb5980a86e0 con 0x7fb598137a90 2023-11-28T18:43:41.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.166+0000 7fb5957fa640 1 -- 172.21.15.45:0/4006284190 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+16702 (secure 0 0 0) 0x7fb5980a86e0 con 0x7fb598137a90 2023-11-28T18:43:41.169 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:43:41.169 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":49,"fsid":"d10f5cd6-1d00-4019-99b6-6fa435498a15","created":"2023-11-28T18:37:08.189030+0000","modified":"2023-11-28T18:41:11.270317+0000","last_up_change":"2023-11-28T18:37:20.196124+0000","last_in_change":"2023-11-28T18:37:10.742043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T18:37:21.293917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-28T18:39:34.106789+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-28T18:39:35.426601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"84465384-103c-4f2c-a45a-96f5bb9c835f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6809","nonce":555237322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6811","nonce":555237322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6815","nonce":555237322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6813","nonce":555237322}]},"public_addr":"172.21.15.45:6809/555237322","cluster_addr":"172.21.15.45:6811/555237322","heartbeat_back_addr":"172.21.15.45:6815/555237322","heartbeat_front_addr":"172.21.15.45:6813/555237322","state":["exists","up"]},{"osd":1,"uuid":"7d9eed24-a58f-42c7-a787-ac06be8553fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6801","nonce":2857063763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6803","nonce":2857063763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6807","nonce":2857063763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6805","nonce":2857063763}]},"public_addr":"172.21.15.45:6801/2857063763","cluster_addr":"172.21.15.45:6803/2857063763","heartbeat_back_addr":"172.21.15.45:6807/2857063763","heartbeat_front_addr":"172.21.15.45:6805/2857063763","state":["exists","up"]},{"osd":2,"uuid":"575eeccc-4abf-45b4-9caf-f3e797859588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6817","nonce":193884539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6819","nonce":193884539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6823","nonce":193884539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6821","nonce":193884539}]},"public_addr":"172.21.15.45:6817/193884539","cluster_addr":"172.21.15.45:6819/193884539","heartbeat_back_addr":"172.21.15.45:6823/193884539","heartbeat_front_addr":"172.21.15.45:6821/193884539","state":["exists","up"]},{"osd":3,"uuid":"9b0290d6-9a52-4bc8-b2a1-7622c5dc8e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6825","nonce":78541084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6827","nonce":78541084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6831","nonce":78541084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6829","nonce":78541084}]},"public_addr":"172.21.15.45:6825/78541084","cluster_addr":"172.21.15.45:6827/78541084","heartbeat_back_addr":"172.21.15.45:6831/78541084","heartbeat_front_addr":"172.21.15.45:6829/78541084","state":["exists","up"]},{"osd":4,"uuid":"ce632829-f027-4fbf-a627-02c571aa9d53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6809","nonce":1537591987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6811","nonce":1537591987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6815","nonce":1537591987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6813","nonce":1537591987}]},"public_addr":"172.21.15.190:6809/1537591987","cluster_addr":"172.21.15.190:6811/1537591987","heartbeat_back_addr":"172.21.15.190:6815/1537591987","heartbeat_front_addr":"172.21.15.190:6813/1537591987","state":["exists","up"]},{"osd":5,"uuid":"8700b609-27be-40bd-a251-4c0ae0a29ead","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6801","nonce":3296698407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6803","nonce":3296698407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6807","nonce":3296698407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6805","nonce":3296698407}]},"public_addr":"172.21.15.190:6801/3296698407","cluster_addr":"172.21.15.190:6803/3296698407","heartbeat_back_addr":"172.21.15.190:6807/3296698407","heartbeat_front_addr":"172.21.15.190:6805/3296698407","state":["exists","up"]},{"osd":6,"uuid":"44ce4a40-e6ff-4f4d-8e8a-7341e5c91f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6817","nonce":2317686718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6819","nonce":2317686718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6823","nonce":2317686718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6821","nonce":2317686718}]},"public_addr":"172.21.15.190:6817/2317686718","cluster_addr":"172.21.15.190:6819/2317686718","heartbeat_back_addr":"172.21.15.190:6823/2317686718","heartbeat_front_addr":"172.21.15.190:6821/2317686718","state":["exists","up"]},{"osd":7,"uuid":"192238c9-1423-4b7e-ac8f-84ba32113ddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6825","nonce":2493232051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6827","nonce":2493232051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6831","nonce":2493232051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6829","nonce":2493232051}]},"public_addr":"172.21.15.190:6825/2493232051","cluster_addr":"172.21.15.190:6827/2493232051","heartbeat_back_addr":"172.21.15.190:6831/2493232051","heartbeat_front_addr":"172.21.15.190:6829/2493232051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.393552+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.385453+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.361421+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.366408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.363226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.276007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.414605+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.445885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.2d","mappings":[{"from":0,"to":4}]},{"pgid":"7.3e","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6834/2737877840":"2023-11-29T18:41:11.270289+0000","172.21.15.45:6832/2737877840":"2023-11-29T18:41:11.270289+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T18:43:41.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.166+0000 7fb59f1d1640 1 -- 172.21.15.45:0/4006284190 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fb57c066900 msgr2=0x7fb57c068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:41.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.166+0000 7fb59f1d1640 1 --2- 172.21.15.45:0/4006284190 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fb57c066900 0x7fb57c068dc0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fb58c001130 tx=0x7fb58c000ee0 comp rx=0 tx=0).stop 2023-11-28T18:43:41.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.166+0000 7fb59f1d1640 1 -- 172.21.15.45:0/4006284190 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb598137a90 msgr2=0x7fb59813d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:41.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.166+0000 7fb59f1d1640 1 --2- 172.21.15.45:0/4006284190 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb598137a90 0x7fb59813d9a0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fb59001ee80 tx=0x7fb588007a10 comp rx=0 tx=0).stop 2023-11-28T18:43:41.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.166+0000 7fb59f1d1640 1 -- 172.21.15.45:0/4006284190 shutdown_connections 2023-11-28T18:43:41.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.166+0000 7fb59f1d1640 1 --2- 172.21.15.45:0/4006284190 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fb57c066900 0x7fb57c068dc0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:41.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.166+0000 7fb59f1d1640 1 --2- 172.21.15.45:0/4006284190 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb598137a90 0x7fb59813d9a0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:41.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.166+0000 7fb59f1d1640 1 --2- 172.21.15.45:0/4006284190 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb598138350 0x7fb598158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:41.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.166+0000 7fb59f1d1640 1 --2- 172.21.15.45:0/4006284190 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb5880073a0 0x7fb5980abcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:41.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.166+0000 7fb59f1d1640 1 -- 172.21.15.45:0/4006284190 >> 172.21.15.45:0/4006284190 conn(0x7fb59806a570 msgr2=0x7fb5980cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:43:41.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.166+0000 7fb59f1d1640 1 -- 172.21.15.45:0/4006284190 shutdown_connections 2023-11-28T18:43:41.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.166+0000 7fb59f1d1640 1 -- 172.21.15.45:0/4006284190 wait complete. 2023-11-28T18:43:41.190 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T18:37:21.293917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T18:39:34.106789+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T18:39:35.426601+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T18:43:41.191 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T18:43:41.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.334+0000 7f745e846640 1 Processor -- start 2023-11-28T18:43:41.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.334+0000 7f745e846640 1 -- start start 2023-11-28T18:43:41.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.338+0000 7f745e846640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f74580cba50 0x7f745815be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:41.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.338+0000 7f745e846640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f74580b4310 0x7f74580b4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:41.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.338+0000 7f745e846640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74580b4ca0 con 0x7f7458158ce0 2023-11-28T18:43:41.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.338+0000 7f745e846640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f745815b6b0 con 0x7f74580b4310 2023-11-28T18:43:41.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.338+0000 7f745e846640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f745815f450 con 0x7f74580cba50 2023-11-28T18:43:41.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.338+0000 7f745cde3640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f74580b4310 0x7f74580b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:41.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.338+0000 7f745cde3640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f74580b4310 0x7f74580b4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38198/0 (socket says 172.21.15.45:38198) 2023-11-28T18:43:41.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.338+0000 7f745cde3640 1 -- 172.21.15.45:0/3116670790 learned_addr learned my addr 172.21.15.45:0/3116670790 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:43:41.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.338+0000 7f74577fe640 1 --2- 172.21.15.45:0/3116670790 >> v2:172.21.15.190:3300/0 conn(0x7f74580cba50 0x7f745815be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:41.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.338+0000 7f745cde3640 1 -- 172.21.15.45:0/3116670790 >> v2:172.21.15.190:3300/0 conn(0x7f74580cba50 msgr2=0x7f745815be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:43:41.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.338+0000 7f745cde3640 1 --2- 172.21.15.45:0/3116670790 >> v2:172.21.15.190:3300/0 conn(0x7f74580cba50 0x7f745815be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:41.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.338+0000 7f745cde3640 1 -- 172.21.15.45:0/3116670790 >> v1:172.21.15.190:6789/0 conn(0x7f7458158ce0 legacy=0x7f745815eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:41.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.338+0000 7f745cde3640 1 -- 172.21.15.45:0/3116670790 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f745815f730 con 0x7f74580b4310 2023-11-28T18:43:41.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.338+0000 7f745cde3640 1 --2- 172.21.15.45:0/3116670790 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74580b4310 0x7f74580b4760 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f74580cef00 tx=0x7f745001c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=974fb71c07c0a8d8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:41.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.338+0000 7f7456ffd640 1 -- 172.21.15.45:0/3116670790 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74500a57a0 con 0x7f74580b4310 2023-11-28T18:43:41.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.342+0000 7f7456ffd640 1 -- 172.21.15.45:0/3116670790 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74500a5900 con 0x7f74580b4310 2023-11-28T18:43:41.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.342+0000 7f7456ffd640 1 -- 172.21.15.45:0/3116670790 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74500a5c90 con 0x7f74580b4310 2023-11-28T18:43:41.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.342+0000 7f745e846640 1 -- 172.21.15.45:0/3116670790 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74580b4310 msgr2=0x7f74580b4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:41.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.342+0000 7f745e846640 1 --2- 172.21.15.45:0/3116670790 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74580b4310 0x7f74580b4760 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f74580cef00 tx=0x7f745001c9d0 comp rx=0 tx=0).stop 2023-11-28T18:43:41.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.342+0000 7f745e846640 1 -- 172.21.15.45:0/3116670790 shutdown_connections 2023-11-28T18:43:41.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.342+0000 7f745e846640 1 --2- 172.21.15.45:0/3116670790 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74580b4310 0x7f74580b4760 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:41.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.342+0000 7f745e846640 1 --2- 172.21.15.45:0/3116670790 >> v2:172.21.15.190:3300/0 conn(0x7f74580cba50 0x7f745815be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:41.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.342+0000 7f745e846640 1 -- 172.21.15.45:0/3116670790 >> 172.21.15.45:0/3116670790 conn(0x7f74580b0d00 msgr2=0x7f74580b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:43:41.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.342+0000 7f745e846640 1 -- 172.21.15.45:0/3116670790 shutdown_connections 2023-11-28T18:43:41.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.342+0000 7f745e846640 1 -- 172.21.15.45:0/3116670790 wait complete. 2023-11-28T18:43:41.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.342+0000 7f745e846640 1 Processor -- start 2023-11-28T18:43:41.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.342+0000 7f745e846640 1 -- start start 2023-11-28T18:43:41.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.346+0000 7f745e846640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f74580b4310 0x7f74581f80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:41.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.346+0000 7f745e846640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74580cba50 0x7f745814d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:41.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.346+0000 7f745e846640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7458158ce0 0x7f7458156c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:41.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.346+0000 7f745e846640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74581f85f0 con 0x7f74580cba50 2023-11-28T18:43:41.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.346+0000 7f745e846640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74581f8890 con 0x7f74580b4310 2023-11-28T18:43:41.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.346+0000 7f745e846640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74581f8b70 con 0x7f7458158ce0 2023-11-28T18:43:41.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.346+0000 7f74577fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74580cba50 0x7f745814d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:41.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.346+0000 7f74577fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74580cba50 0x7f745814d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38202/0 (socket says 172.21.15.45:38202) 2023-11-28T18:43:41.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.346+0000 7f74577fe640 1 -- 172.21.15.45:0/2500876764 learned_addr learned my addr 172.21.15.45:0/2500876764 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:43:41.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.346+0000 7f7457fff640 1 --2- 172.21.15.45:0/2500876764 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f74580b4310 0x7f74581f80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:41.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.346+0000 7f745cde3640 1 --2- 172.21.15.45:0/2500876764 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7458158ce0 0x7f7458156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:41.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.346+0000 7f74577fe640 1 -- 172.21.15.45:0/2500876764 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7458158ce0 msgr2=0x7f7458156c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:41.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.346+0000 7f74577fe640 1 --2- 172.21.15.45:0/2500876764 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7458158ce0 0x7f7458156c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:41.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.346+0000 7f74577fe640 1 -- 172.21.15.45:0/2500876764 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f74580b4310 msgr2=0x7f74581f80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:41.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.346+0000 7f74577fe640 1 --2- 172.21.15.45:0/2500876764 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f74580b4310 0x7f74581f80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:41.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.346+0000 7f74577fe640 1 -- 172.21.15.45:0/2500876764 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7450009b30 con 0x7f74580cba50 2023-11-28T18:43:41.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.346+0000 7f74577fe640 1 --2- 172.21.15.45:0/2500876764 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74580cba50 0x7f745814d5f0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f744c00d7d0 tx=0x7f744c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:41.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.346+0000 7f7454ff9640 1 -- 172.21.15.45:0/2500876764 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744c00b6c0 con 0x7f74580cba50 2023-11-28T18:43:41.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.346+0000 7f7454ff9640 1 -- 172.21.15.45:0/2500876764 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f744c00b820 con 0x7f74580cba50 2023-11-28T18:43:41.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.346+0000 7f745e846640 1 -- 172.21.15.45:0/2500876764 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74581f8e50 con 0x7f74580cba50 2023-11-28T18:43:41.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.346+0000 7f7454ff9640 1 -- 172.21.15.45:0/2500876764 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744c00bbd0 con 0x7f74580cba50 2023-11-28T18:43:41.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.346+0000 7f745e846640 1 -- 172.21.15.45:0/2500876764 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f745814cd10 con 0x7f74580cba50 2023-11-28T18:43:41.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.346+0000 7f745e846640 1 -- 172.21.15.45:0/2500876764 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f745814cf30 con 0x7f74580cba50 2023-11-28T18:43:41.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.350+0000 7f7454ff9640 1 -- 172.21.15.45:0/2500876764 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f744c00bd30 con 0x7f74580cba50 2023-11-28T18:43:41.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.350+0000 7f7454ff9640 1 --2- 172.21.15.45:0/2500876764 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f74440668d0 0x7f7444068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:41.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.350+0000 7f7454ff9640 1 -- 172.21.15.45:0/2500876764 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f744c084950 con 0x7f74580cba50 2023-11-28T18:43:41.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.350+0000 7f7457fff640 1 --2- 172.21.15.45:0/2500876764 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f74440668d0 0x7f7444068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:41.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.350+0000 7f7457fff640 1 --2- 172.21.15.45:0/2500876764 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f74440668d0 0x7f7444068d90 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f7448007fd0 tx=0x7f7448009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:41.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.354+0000 7f7454ff9640 1 -- 172.21.15.45:0/2500876764 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f745814cf30 con 0x7f74580cba50 2023-11-28T18:43:41.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.514+0000 7f745e846640 1 -- 172.21.15.45:0/2500876764 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f745814cf30 con 0x7f74580cba50 2023-11-28T18:43:41.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.514+0000 7f7454ff9640 1 -- 172.21.15.45:0/2500876764 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v49) v1 ==== 93+0+10 (secure 0 0 0) 0x7f745814cf30 con 0x7f74580cba50 2023-11-28T18:43:41.519 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-11-28T18:43:41.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.514+0000 7f745e846640 1 -- 172.21.15.45:0/2500876764 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f74440668d0 msgr2=0x7f7444068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:41.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.514+0000 7f745e846640 1 --2- 172.21.15.45:0/2500876764 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f74440668d0 0x7f7444068d90 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f7448007fd0 tx=0x7f7448009040 comp rx=0 tx=0).stop 2023-11-28T18:43:41.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.514+0000 7f745e846640 1 -- 172.21.15.45:0/2500876764 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74580cba50 msgr2=0x7f745814d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:41.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.514+0000 7f745e846640 1 --2- 172.21.15.45:0/2500876764 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74580cba50 0x7f745814d5f0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f744c00d7d0 tx=0x7f744c00dc90 comp rx=0 tx=0).stop 2023-11-28T18:43:41.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.514+0000 7f745e846640 1 -- 172.21.15.45:0/2500876764 shutdown_connections 2023-11-28T18:43:41.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.514+0000 7f745e846640 1 --2- 172.21.15.45:0/2500876764 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f74440668d0 0x7f7444068d90 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:41.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.514+0000 7f745e846640 1 --2- 172.21.15.45:0/2500876764 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7458158ce0 0x7f7458156c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:41.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.514+0000 7f745e846640 1 --2- 172.21.15.45:0/2500876764 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74580cba50 0x7f745814d5f0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:41.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.514+0000 7f745e846640 1 --2- 172.21.15.45:0/2500876764 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f74580b4310 0x7f74581f80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:41.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.514+0000 7f745e846640 1 -- 172.21.15.45:0/2500876764 >> 172.21.15.45:0/2500876764 conn(0x7f74580b0d00 msgr2=0x7f74581538f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:43:41.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.514+0000 7f745e846640 1 -- 172.21.15.45:0/2500876764 shutdown_connections 2023-11-28T18:43:41.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.514+0000 7f745e846640 1 -- 172.21.15.45:0/2500876764 wait complete. 2023-11-28T18:43:41.540 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T18:43:41.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.682+0000 7f20cc232640 1 Processor -- start 2023-11-28T18:43:41.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.682+0000 7f20cc232640 1 -- start start 2023-11-28T18:43:41.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.682+0000 7f20cc232640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f20c414b220 0x7f20c40b3e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:41.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.682+0000 7f20cc232640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f20c40b4390 0x7f20c4070430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:41.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.682+0000 7f20cc232640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20c40b2000 con 0x7f20c414ac20 2023-11-28T18:43:41.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.682+0000 7f20cc232640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20c40b4820 con 0x7f20c40b4390 2023-11-28T18:43:41.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.682+0000 7f20cc232640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20c4166170 con 0x7f20c414b220 2023-11-28T18:43:41.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.682+0000 7f20ca7cf640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f20c40b4390 0x7f20c4070430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:41.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.682+0000 7f20c9fce640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f20c414ac20 0x7f20c4165a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47574/0 (socket says 172.21.15.45:47574) 2023-11-28T18:43:41.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.682+0000 7f20c9fce640 1 -- 172.21.15.45:0/1345567294 learned_addr learned my addr 172.21.15.45:0/1345567294 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:43:41.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.682+0000 7f20c97cd640 1 --2- 172.21.15.45:0/1345567294 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f20c414b220 0x7f20c40b3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:41.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.682+0000 7f20ca7cf640 1 -- 172.21.15.45:0/1345567294 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f20c414b220 msgr2=0x7f20c40b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:43:41.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.682+0000 7f20ca7cf640 1 --2- 172.21.15.45:0/1345567294 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f20c414b220 0x7f20c40b3e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:41.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.682+0000 7f20ca7cf640 1 -- 172.21.15.45:0/1345567294 >> v1:172.21.15.45:6789/0 conn(0x7f20c414ac20 legacy=0x7f20c4165a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:41.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.682+0000 7f20ca7cf640 1 -- 172.21.15.45:0/1345567294 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20c40b22a0 con 0x7f20c40b4390 2023-11-28T18:43:41.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.686+0000 7f20ca7cf640 1 --2- 172.21.15.45:0/1345567294 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20c40b4390 0x7f20c4070430 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f20bc009d90 tx=0x7f20bc01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c755e87094ca1efa server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:41.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.686+0000 7f20c8fcc640 1 -- 172.21.15.45:0/1345567294 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20bc0a59e0 con 0x7f20c40b4390 2023-11-28T18:43:41.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.686+0000 7f20c8fcc640 1 -- 172.21.15.45:0/1345567294 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20bc0a5b40 con 0x7f20c40b4390 2023-11-28T18:43:41.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.686+0000 7f20c8fcc640 1 -- 172.21.15.45:0/1345567294 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20bc0ad440 con 0x7f20c40b4390 2023-11-28T18:43:41.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.686+0000 7f20cc232640 1 -- 172.21.15.45:0/1345567294 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20c40b4390 msgr2=0x7f20c4070430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:41.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.686+0000 7f20cc232640 1 --2- 172.21.15.45:0/1345567294 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20c40b4390 0x7f20c4070430 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f20bc009d90 tx=0x7f20bc01c920 comp rx=0 tx=0).stop 2023-11-28T18:43:41.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.686+0000 7f20cc232640 1 -- 172.21.15.45:0/1345567294 shutdown_connections 2023-11-28T18:43:41.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.686+0000 7f20cc232640 1 --2- 172.21.15.45:0/1345567294 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20c40b4390 0x7f20c4070430 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:41.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.686+0000 7f20cc232640 1 --2- 172.21.15.45:0/1345567294 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f20c414b220 0x7f20c40b3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:41.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.686+0000 7f20cc232640 1 -- 172.21.15.45:0/1345567294 >> 172.21.15.45:0/1345567294 conn(0x7f20c40b0d00 msgr2=0x7f20c40b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:43:41.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.686+0000 7f20cc232640 1 -- 172.21.15.45:0/1345567294 shutdown_connections 2023-11-28T18:43:41.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.686+0000 7f20cc232640 1 -- 172.21.15.45:0/1345567294 wait complete. 2023-11-28T18:43:41.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.690+0000 7f20cc232640 1 Processor -- start 2023-11-28T18:43:41.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.690+0000 7f20cc232640 1 -- start start 2023-11-28T18:43:41.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.690+0000 7f20cc232640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f20c40b4390 0x7f20c4143000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:41.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.690+0000 7f20cc232640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20c414ac20 0x7f20c415a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:41.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.690+0000 7f20cc232640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f20c4159a30 0x7f20c415ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:41.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.690+0000 7f20cc232640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20c4142510 con 0x7f20c414ac20 2023-11-28T18:43:41.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.690+0000 7f20cc232640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20c415dd30 con 0x7f20c4159a30 2023-11-28T18:43:41.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.690+0000 7f20cc232640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20c4142760 con 0x7f20c40b4390 2023-11-28T18:43:41.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.690+0000 7f20c97cd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20c414ac20 0x7f20c415a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:41.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.690+0000 7f20c97cd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20c414ac20 0x7f20c415a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38212/0 (socket says 172.21.15.45:38212) 2023-11-28T18:43:41.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.690+0000 7f20c97cd640 1 -- 172.21.15.45:0/3020028709 learned_addr learned my addr 172.21.15.45:0/3020028709 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:43:41.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.690+0000 7f20ca7cf640 1 --2- 172.21.15.45:0/3020028709 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f20c4159a30 0x7f20c415ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:41.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.690+0000 7f20c9fce640 1 --2- 172.21.15.45:0/3020028709 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f20c40b4390 0x7f20c4143000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:41.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.690+0000 7f20c97cd640 1 -- 172.21.15.45:0/3020028709 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f20c40b4390 msgr2=0x7f20c4143000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:41.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.690+0000 7f20c97cd640 1 --2- 172.21.15.45:0/3020028709 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f20c40b4390 0x7f20c4143000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:41.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.690+0000 7f20c97cd640 1 -- 172.21.15.45:0/3020028709 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f20c4159a30 msgr2=0x7f20c415ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:41.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.690+0000 7f20c97cd640 1 --2- 172.21.15.45:0/3020028709 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f20c4159a30 0x7f20c415ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:41.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.690+0000 7f20c97cd640 1 -- 172.21.15.45:0/3020028709 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20bc009a70 con 0x7f20c414ac20 2023-11-28T18:43:41.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.690+0000 7f20c97cd640 1 --2- 172.21.15.45:0/3020028709 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20c414ac20 0x7f20c415a8e0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f20b400d5f0 tx=0x7f20b400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:41.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.690+0000 7f20ba7fc640 1 -- 172.21.15.45:0/3020028709 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b40125f0 con 0x7f20c414ac20 2023-11-28T18:43:41.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.690+0000 7f20ba7fc640 1 -- 172.21.15.45:0/3020028709 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20b4012750 con 0x7f20c414ac20 2023-11-28T18:43:41.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.690+0000 7f20cc232640 1 -- 172.21.15.45:0/3020028709 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20c4142a40 con 0x7f20c414ac20 2023-11-28T18:43:41.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.690+0000 7f20ba7fc640 1 -- 172.21.15.45:0/3020028709 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b4012ae0 con 0x7f20c414ac20 2023-11-28T18:43:41.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.690+0000 7f20cc232640 1 -- 172.21.15.45:0/3020028709 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20c415d850 con 0x7f20c414ac20 2023-11-28T18:43:41.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.690+0000 7f20cc232640 1 -- 172.21.15.45:0/3020028709 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20c4069410 con 0x7f20c414ac20 2023-11-28T18:43:41.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.694+0000 7f20ba7fc640 1 -- 172.21.15.45:0/3020028709 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f20b4012c40 con 0x7f20c414ac20 2023-11-28T18:43:41.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.694+0000 7f20ba7fc640 1 --2- 172.21.15.45:0/3020028709 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f20a80668d0 0x7f20a8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:41.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.694+0000 7f20ba7fc640 1 -- 172.21.15.45:0/3020028709 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f20b4084990 con 0x7f20c414ac20 2023-11-28T18:43:41.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.694+0000 7f20c9fce640 1 --2- 172.21.15.45:0/3020028709 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f20a80668d0 0x7f20a8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:41.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.694+0000 7f20c9fce640 1 --2- 172.21.15.45:0/3020028709 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f20a80668d0 0x7f20a8068d90 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f20c0005890 tx=0x7f20c0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:41.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.698+0000 7f20ba7fc640 1 -- 172.21.15.45:0/3020028709 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f20b4051b30 con 0x7f20c414ac20 2023-11-28T18:43:41.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.854+0000 7f20cc232640 1 -- 172.21.15.45:0/3020028709 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f20c40cb410 con 0x7f20c414ac20 2023-11-28T18:43:41.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.854+0000 7f20ba7fc640 1 -- 172.21.15.45:0/3020028709 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v49) v1 ==== 104+0+11 (secure 0 0 0) 0x7f20b4007380 con 0x7f20c414ac20 2023-11-28T18:43:41.859 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-11-28T18:43:41.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.854+0000 7f20cc232640 1 -- 172.21.15.45:0/3020028709 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f20a80668d0 msgr2=0x7f20a8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:41.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.854+0000 7f20cc232640 1 --2- 172.21.15.45:0/3020028709 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f20a80668d0 0x7f20a8068d90 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f20c0005890 tx=0x7f20c0009040 comp rx=0 tx=0).stop 2023-11-28T18:43:41.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.858+0000 7f20cc232640 1 -- 172.21.15.45:0/3020028709 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20c414ac20 msgr2=0x7f20c415a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:41.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.858+0000 7f20cc232640 1 --2- 172.21.15.45:0/3020028709 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20c414ac20 0x7f20c415a8e0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f20b400d5f0 tx=0x7f20b400dab0 comp rx=0 tx=0).stop 2023-11-28T18:43:41.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.858+0000 7f20cc232640 1 -- 172.21.15.45:0/3020028709 shutdown_connections 2023-11-28T18:43:41.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.858+0000 7f20cc232640 1 --2- 172.21.15.45:0/3020028709 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f20a80668d0 0x7f20a8068d90 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:41.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.858+0000 7f20cc232640 1 --2- 172.21.15.45:0/3020028709 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f20c4159a30 0x7f20c415ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:41.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.858+0000 7f20cc232640 1 --2- 172.21.15.45:0/3020028709 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20c414ac20 0x7f20c415a8e0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:41.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.858+0000 7f20cc232640 1 --2- 172.21.15.45:0/3020028709 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f20c40b4390 0x7f20c4143000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:41.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.858+0000 7f20cc232640 1 -- 172.21.15.45:0/3020028709 >> 172.21.15.45:0/3020028709 conn(0x7f20c40b0d00 msgr2=0x7f20c40b36f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:43:41.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.858+0000 7f20cc232640 1 -- 172.21.15.45:0/3020028709 shutdown_connections 2023-11-28T18:43:41.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:41.858+0000 7f20cc232640 1 -- 172.21.15.45:0/3020028709 wait complete. 2023-11-28T18:43:41.881 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T18:43:42.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.022+0000 7f94ceff5640 1 Processor -- start 2023-11-28T18:43:42.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.022+0000 7f94ceff5640 1 -- start start 2023-11-28T18:43:42.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.022+0000 7f94ceff5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f94c8140e10 0x7f94c806b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:42.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.022+0000 7f94ceff5640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94c8141220 con 0x7f94c81401f0 2023-11-28T18:43:42.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.022+0000 7f94ceff5640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94c80ad5e0 con 0x7f94c81409a0 2023-11-28T18:43:42.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.022+0000 7f94ceff5640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94c80ad880 con 0x7f94c8140e10 2023-11-28T18:43:42.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.022+0000 7f94ccd91640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f94c81401f0 0x7f94c8161730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47582/0 (socket says 172.21.15.45:47582) 2023-11-28T18:43:42.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.022+0000 7f94ccd91640 1 -- 172.21.15.45:0/217679282 learned_addr learned my addr 172.21.15.45:0/217679282 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:43:42.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.022+0000 7f94cd592640 1 --2- 172.21.15.45:0/217679282 >> v2:172.21.15.45:3300/0 conn(0x7f94c8140e10 0x7f94c806b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:42.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.022+0000 7f94cd592640 1 -- 172.21.15.45:0/217679282 >> v1:172.21.15.190:6789/0 conn(0x7f94c81409a0 legacy=0x7f94c80ae920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:42.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.022+0000 7f94cd592640 1 -- 172.21.15.45:0/217679282 >> v1:172.21.15.45:6789/0 conn(0x7f94c81401f0 legacy=0x7f94c8161730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:42.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.026+0000 7f94cd592640 1 -- 172.21.15.45:0/217679282 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c80adb60 con 0x7f94c8140e10 2023-11-28T18:43:42.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.022+0000 7f94c77fe640 1 -- 172.21.15.45:0/217679282 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4150793185 0 0) 0x7f94c8141220 con 0x7f94c81401f0 2023-11-28T18:43:42.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.026+0000 7f94cd592640 1 --2- 172.21.15.45:0/217679282 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94c8140e10 0x7f94c806b580 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f94c0009d90 tx=0x7f94c001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e2427fff6ed59a2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:42.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.026+0000 7f94c77fe640 1 -- 172.21.15.45:0/217679282 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c00a5810 con 0x7f94c8140e10 2023-11-28T18:43:42.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.026+0000 7f94c77fe640 1 -- 172.21.15.45:0/217679282 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94c00a5970 con 0x7f94c8140e10 2023-11-28T18:43:42.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.026+0000 7f94c77fe640 1 -- 172.21.15.45:0/217679282 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c00a5d00 con 0x7f94c8140e10 2023-11-28T18:43:42.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.026+0000 7f94ceff5640 1 -- 172.21.15.45:0/217679282 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94c8140e10 msgr2=0x7f94c806b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:42.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.026+0000 7f94ceff5640 1 --2- 172.21.15.45:0/217679282 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94c8140e10 0x7f94c806b580 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f94c0009d90 tx=0x7f94c001c950 comp rx=0 tx=0).stop 2023-11-28T18:43:42.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.026+0000 7f94ceff5640 1 -- 172.21.15.45:0/217679282 shutdown_connections 2023-11-28T18:43:42.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.026+0000 7f94ceff5640 1 --2- 172.21.15.45:0/217679282 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94c8140e10 0x7f94c806b580 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:42.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.026+0000 7f94ceff5640 1 -- 172.21.15.45:0/217679282 >> 172.21.15.45:0/217679282 conn(0x7f94c80b1b70 msgr2=0x7f94c8070cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:43:42.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.026+0000 7f94ceff5640 1 -- 172.21.15.45:0/217679282 shutdown_connections 2023-11-28T18:43:42.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.026+0000 7f94ceff5640 1 -- 172.21.15.45:0/217679282 wait complete. 2023-11-28T18:43:42.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.030+0000 7f94ceff5640 1 Processor -- start 2023-11-28T18:43:42.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.030+0000 7f94ceff5640 1 -- start start 2023-11-28T18:43:42.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.030+0000 7f94ceff5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94c81401f0 0x7f94c813afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:42.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.030+0000 7f94ceff5640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f94c81409a0 0x7f94c8152e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:42.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.030+0000 7f94ceff5640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f94c8140e10 0x7f94c813e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:42.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.030+0000 7f94ceff5640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c8137940 con 0x7f94c81401f0 2023-11-28T18:43:42.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.030+0000 7f94ceff5640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c81533a0 con 0x7f94c8140e10 2023-11-28T18:43:42.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.030+0000 7f94ceff5640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94c8137b90 con 0x7f94c81409a0 2023-11-28T18:43:42.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.030+0000 7f94ccd91640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94c81401f0 0x7f94c813afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:42.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.030+0000 7f94ccd91640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94c81401f0 0x7f94c813afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38238/0 (socket says 172.21.15.45:38238) 2023-11-28T18:43:42.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.030+0000 7f94ccd91640 1 -- 172.21.15.45:0/2551048041 learned_addr learned my addr 172.21.15.45:0/2551048041 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:43:42.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.030+0000 7f94cd592640 1 --2- 172.21.15.45:0/2551048041 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f94c8140e10 0x7f94c813e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:42.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.030+0000 7f94c7fff640 1 --2- 172.21.15.45:0/2551048041 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f94c81409a0 0x7f94c8152e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:42.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.030+0000 7f94ccd91640 1 -- 172.21.15.45:0/2551048041 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f94c81409a0 msgr2=0x7f94c8152e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:42.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.030+0000 7f94ccd91640 1 --2- 172.21.15.45:0/2551048041 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f94c81409a0 0x7f94c8152e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:42.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.030+0000 7f94ccd91640 1 -- 172.21.15.45:0/2551048041 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f94c8140e10 msgr2=0x7f94c813e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:42.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.030+0000 7f94ccd91640 1 --2- 172.21.15.45:0/2551048041 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f94c8140e10 0x7f94c813e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:42.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.030+0000 7f94ccd91640 1 -- 172.21.15.45:0/2551048041 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c0009a70 con 0x7f94c81401f0 2023-11-28T18:43:42.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.030+0000 7f94ccd91640 1 --2- 172.21.15.45:0/2551048041 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94c81401f0 0x7f94c813afd0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f94bc00c4a0 tx=0x7f94bc00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:42.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.030+0000 7f94c57fa640 1 -- 172.21.15.45:0/2551048041 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94bc0074e0 con 0x7f94c81401f0 2023-11-28T18:43:42.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.030+0000 7f94c57fa640 1 -- 172.21.15.45:0/2551048041 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94bc007640 con 0x7f94c81401f0 2023-11-28T18:43:42.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.030+0000 7f94ceff5640 1 -- 172.21.15.45:0/2551048041 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94c8137e70 con 0x7f94c81401f0 2023-11-28T18:43:42.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.030+0000 7f94c57fa640 1 -- 172.21.15.45:0/2551048041 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94bc004a30 con 0x7f94c81401f0 2023-11-28T18:43:42.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.034+0000 7f94ceff5640 1 -- 172.21.15.45:0/2551048041 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94c8138430 con 0x7f94c81401f0 2023-11-28T18:43:42.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.034+0000 7f94ceff5640 1 -- 172.21.15.45:0/2551048041 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94c8069410 con 0x7f94c81401f0 2023-11-28T18:43:42.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.034+0000 7f94c57fa640 1 -- 172.21.15.45:0/2551048041 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f94bc004b90 con 0x7f94c81401f0 2023-11-28T18:43:42.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.034+0000 7f94c57fa640 1 --2- 172.21.15.45:0/2551048041 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f94ac0668d0 0x7f94ac068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:42.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.034+0000 7f94c57fa640 1 -- 172.21.15.45:0/2551048041 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f94bc083890 con 0x7f94c81401f0 2023-11-28T18:43:42.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.034+0000 7f94c7fff640 1 --2- 172.21.15.45:0/2551048041 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f94ac0668d0 0x7f94ac068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:42.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.034+0000 7f94c7fff640 1 --2- 172.21.15.45:0/2551048041 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f94ac0668d0 0x7f94ac068d90 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f94c80b0d40 tx=0x7f94b4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:42.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.038+0000 7f94c57fa640 1 -- 172.21.15.45:0/2551048041 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f94bc050910 con 0x7f94c81401f0 2023-11-28T18:43:42.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.198+0000 7f94ceff5640 1 -- 172.21.15.45:0/2551048041 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f94c8071f40 con 0x7f94c81401f0 2023-11-28T18:43:42.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.198+0000 7f94c57fa640 1 -- 172.21.15.45:0/2551048041 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v49) v1 ==== 100+0+11 (secure 0 0 0) 0x7f94bc018030 con 0x7f94c81401f0 2023-11-28T18:43:42.202 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-11-28T18:43:42.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.198+0000 7f94ceff5640 1 -- 172.21.15.45:0/2551048041 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f94ac0668d0 msgr2=0x7f94ac068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:42.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.198+0000 7f94ceff5640 1 --2- 172.21.15.45:0/2551048041 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f94ac0668d0 0x7f94ac068d90 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f94c80b0d40 tx=0x7f94b4009040 comp rx=0 tx=0).stop 2023-11-28T18:43:42.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.198+0000 7f94ceff5640 1 -- 172.21.15.45:0/2551048041 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94c81401f0 msgr2=0x7f94c813afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:42.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.198+0000 7f94ceff5640 1 --2- 172.21.15.45:0/2551048041 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94c81401f0 0x7f94c813afd0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f94bc00c4a0 tx=0x7f94bc00c960 comp rx=0 tx=0).stop 2023-11-28T18:43:42.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.198+0000 7f94ceff5640 1 -- 172.21.15.45:0/2551048041 shutdown_connections 2023-11-28T18:43:42.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.198+0000 7f94ceff5640 1 --2- 172.21.15.45:0/2551048041 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f94ac0668d0 0x7f94ac068d90 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:42.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.198+0000 7f94ceff5640 1 --2- 172.21.15.45:0/2551048041 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f94c8140e10 0x7f94c813e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:42.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.198+0000 7f94ceff5640 1 --2- 172.21.15.45:0/2551048041 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f94c81409a0 0x7f94c8152e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:42.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.198+0000 7f94ceff5640 1 --2- 172.21.15.45:0/2551048041 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94c81401f0 0x7f94c813afd0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:42.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.198+0000 7f94ceff5640 1 -- 172.21.15.45:0/2551048041 >> 172.21.15.45:0/2551048041 conn(0x7f94c80b1b70 msgr2=0x7f94c80ae920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:43:42.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.198+0000 7f94ceff5640 1 -- 172.21.15.45:0/2551048041 shutdown_connections 2023-11-28T18:43:42.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.198+0000 7f94ceff5640 1 -- 172.21.15.45:0/2551048041 wait complete. 2023-11-28T18:43:42.223 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T18:43:42.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.366+0000 7f9ae5279640 1 Processor -- start 2023-11-28T18:43:42.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.366+0000 7f9ae5279640 1 -- start start 2023-11-28T18:43:42.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.366+0000 7f9ae5279640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9ae00cfed0 0x7f9ae00d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:42.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.366+0000 7f9ae5279640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ae00b3cb0 0x7f9ae015f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:42.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.366+0000 7f9ae5279640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ae00d38c0 con 0x7f9ae00b35f0 2023-11-28T18:43:42.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.366+0000 7f9ae5279640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ae00d40d0 con 0x7f9ae00cfed0 2023-11-28T18:43:42.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.366+0000 7f9ae5279640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae00cdcc0 con 0x7f9ae00b3cb0 2023-11-28T18:43:42.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.366+0000 7f9ad7fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9ae00cfed0 0x7f9ae00d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:42.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.366+0000 7f9adeffd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f9ae00b35f0 0x7f9ae00cf7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47592/0 (socket says 172.21.15.45:47592) 2023-11-28T18:43:42.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.366+0000 7f9adeffd640 1 -- 172.21.15.45:0/3308180046 learned_addr learned my addr 172.21.15.45:0/3308180046 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:43:42.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.366+0000 7f9ad7fff640 1 -- 172.21.15.45:0/3308180046 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ae00b3cb0 msgr2=0x7f9ae015f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:43:42.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.366+0000 7f9adf7fe640 1 --2- 172.21.15.45:0/3308180046 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ae00b3cb0 0x7f9ae015f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:42.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.366+0000 7f9ad7fff640 1 --2- 172.21.15.45:0/3308180046 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ae00b3cb0 0x7f9ae015f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:42.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.366+0000 7f9ade7fc640 1 -- 172.21.15.45:0/3308180046 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3236615242 0 0) 0x7f9ae00d38c0 con 0x7f9ae00b35f0 2023-11-28T18:43:42.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.366+0000 7f9ad7fff640 1 -- 172.21.15.45:0/3308180046 >> v1:172.21.15.45:6789/0 conn(0x7f9ae00b35f0 legacy=0x7f9ae00cf7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:42.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.366+0000 7f9ad7fff640 1 -- 172.21.15.45:0/3308180046 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ae00d3b10 con 0x7f9ae00cfed0 2023-11-28T18:43:42.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.366+0000 7f9adf7fe640 1 --2- 172.21.15.45:0/3308180046 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ae00b3cb0 0x7f9ae015f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:43:42.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.370+0000 7f9ad7fff640 1 --2- 172.21.15.45:0/3308180046 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ae00cfed0 0x7f9ae00d0f90 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f9ac80097c0 tx=0x7f9ac801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbcf64ac0a7a7f44 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:42.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.370+0000 7f9ade7fc640 1 -- 172.21.15.45:0/3308180046 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac80ab680 con 0x7f9ae00cfed0 2023-11-28T18:43:42.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.370+0000 7f9ade7fc640 1 -- 172.21.15.45:0/3308180046 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ac80ab7e0 con 0x7f9ae00cfed0 2023-11-28T18:43:42.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.370+0000 7f9ade7fc640 1 -- 172.21.15.45:0/3308180046 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac80abb70 con 0x7f9ae00cfed0 2023-11-28T18:43:42.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.370+0000 7f9ae5279640 1 -- 172.21.15.45:0/3308180046 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ae00cfed0 msgr2=0x7f9ae00d0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:42.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.370+0000 7f9ae5279640 1 --2- 172.21.15.45:0/3308180046 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ae00cfed0 0x7f9ae00d0f90 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f9ac80097c0 tx=0x7f9ac801c480 comp rx=0 tx=0).stop 2023-11-28T18:43:42.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.370+0000 7f9ae5279640 1 -- 172.21.15.45:0/3308180046 shutdown_connections 2023-11-28T18:43:42.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.370+0000 7f9ae5279640 1 --2- 172.21.15.45:0/3308180046 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ae00b3cb0 0x7f9ae015f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:42.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.370+0000 7f9ae5279640 1 --2- 172.21.15.45:0/3308180046 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ae00cfed0 0x7f9ae00d0f90 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:42.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.370+0000 7f9ae5279640 1 -- 172.21.15.45:0/3308180046 >> 172.21.15.45:0/3308180046 conn(0x7f9ae009c4f0 msgr2=0x7f9ae00d31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:43:42.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.370+0000 7f9ae5279640 1 -- 172.21.15.45:0/3308180046 shutdown_connections 2023-11-28T18:43:42.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.370+0000 7f9ae5279640 1 -- 172.21.15.45:0/3308180046 wait complete. 2023-11-28T18:43:42.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.374+0000 7f9ae5279640 1 Processor -- start 2023-11-28T18:43:42.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.374+0000 7f9ae5279640 1 -- start start 2023-11-28T18:43:42.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.374+0000 7f9ae5279640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ae00b35f0 0x7f9ae009e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:42.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.374+0000 7f9ae5279640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ae00b3cb0 0x7f9ae0159bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:42.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.374+0000 7f9ae5279640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ae00cfed0 0x7f9ae006c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:42.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.374+0000 7f9ae5279640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae015a130 con 0x7f9ae00b35f0 2023-11-28T18:43:42.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.374+0000 7f9ae5279640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae015bb80 con 0x7f9ae00b3cb0 2023-11-28T18:43:42.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.374+0000 7f9ae5279640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae015aec0 con 0x7f9ae00cfed0 2023-11-28T18:43:42.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.374+0000 7f9adeffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ae00b35f0 0x7f9ae009e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:42.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.374+0000 7f9adeffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ae00b35f0 0x7f9ae009e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38256/0 (socket says 172.21.15.45:38256) 2023-11-28T18:43:42.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.374+0000 7f9adeffd640 1 -- 172.21.15.45:0/1056921167 learned_addr learned my addr 172.21.15.45:0/1056921167 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:43:42.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.374+0000 7f9adf7fe640 1 --2- 172.21.15.45:0/1056921167 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ae00cfed0 0x7f9ae006c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:42.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.374+0000 7f9ad7fff640 1 --2- 172.21.15.45:0/1056921167 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ae00b3cb0 0x7f9ae0159bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:42.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.374+0000 7f9adeffd640 1 -- 172.21.15.45:0/1056921167 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ae00cfed0 msgr2=0x7f9ae006c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:42.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.374+0000 7f9adeffd640 1 --2- 172.21.15.45:0/1056921167 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ae00cfed0 0x7f9ae006c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:42.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.374+0000 7f9adeffd640 1 -- 172.21.15.45:0/1056921167 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ae00b3cb0 msgr2=0x7f9ae0159bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:42.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.374+0000 7f9adeffd640 1 --2- 172.21.15.45:0/1056921167 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ae00b3cb0 0x7f9ae0159bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:42.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.374+0000 7f9adeffd640 1 -- 172.21.15.45:0/1056921167 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac8009420 con 0x7f9ae00b35f0 2023-11-28T18:43:42.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.374+0000 7f9ad7fff640 1 --2- 172.21.15.45:0/1056921167 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ae00b3cb0 0x7f9ae0159bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:43:42.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.374+0000 7f9adeffd640 1 --2- 172.21.15.45:0/1056921167 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ae00b35f0 0x7f9ae009e480 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f9ad00011f0 tx=0x7f9ad000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:42.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.374+0000 7f9ad77fe640 1 -- 172.21.15.45:0/1056921167 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad00074e0 con 0x7f9ae00b35f0 2023-11-28T18:43:42.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.374+0000 7f9ad77fe640 1 -- 172.21.15.45:0/1056921167 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ad0007640 con 0x7f9ae00b35f0 2023-11-28T18:43:42.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.374+0000 7f9ad77fe640 1 -- 172.21.15.45:0/1056921167 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad0004a10 con 0x7f9ae00b35f0 2023-11-28T18:43:42.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.374+0000 7f9ae5279640 1 -- 172.21.15.45:0/1056921167 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ae015b1a0 con 0x7f9ae00b35f0 2023-11-28T18:43:42.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.374+0000 7f9ae5279640 1 -- 172.21.15.45:0/1056921167 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ae00b6d40 con 0x7f9ae00b35f0 2023-11-28T18:43:42.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.378+0000 7f9ae5279640 1 -- 172.21.15.45:0/1056921167 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ae0069480 con 0x7f9ae00b35f0 2023-11-28T18:43:42.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.378+0000 7f9ad77fe640 1 -- 172.21.15.45:0/1056921167 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f9ad0004b70 con 0x7f9ae00b35f0 2023-11-28T18:43:42.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.378+0000 7f9ad77fe640 1 --2- 172.21.15.45:0/1056921167 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9ac00668d0 0x7f9ac0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:42.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.378+0000 7f9ad77fe640 1 -- 172.21.15.45:0/1056921167 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f9ad00837e0 con 0x7f9ae00b35f0 2023-11-28T18:43:42.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.378+0000 7f9ad7fff640 1 --2- 172.21.15.45:0/1056921167 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9ac00668d0 0x7f9ac0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:42.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.378+0000 7f9ad7fff640 1 --2- 172.21.15.45:0/1056921167 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9ac00668d0 0x7f9ac0068d90 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f9ac80af000 tx=0x7f9ac80a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:42.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.382+0000 7f9ad77fe640 1 -- 172.21.15.45:0/1056921167 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9ad0050980 con 0x7f9ae00b35f0 2023-11-28T18:43:42.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.550+0000 7f9ae5279640 1 -- 172.21.15.45:0/1056921167 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9ae00b1080 con 0x7f9ae00b35f0 2023-11-28T18:43:42.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.550+0000 7f9ad77fe640 1 -- 172.21.15.45:0/1056921167 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v49) v1 ==== 80+0+122 (secure 0 0 0) 0x7f9ad0018080 con 0x7f9ae00b35f0 2023-11-28T18:43:42.557 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:6834/2737877840 2023-11-29T18:41:11.270289+0000 2023-11-28T18:43:42.557 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:6832/2737877840 2023-11-29T18:41:11.270289+0000 2023-11-28T18:43:42.557 INFO:teuthology.orchestra.run.smithi045.stderr:listed 2 entries 2023-11-28T18:43:42.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.554+0000 7f9ae5279640 1 -- 172.21.15.45:0/1056921167 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9ac00668d0 msgr2=0x7f9ac0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:42.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.554+0000 7f9ae5279640 1 --2- 172.21.15.45:0/1056921167 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9ac00668d0 0x7f9ac0068d90 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f9ac80af000 tx=0x7f9ac80a7000 comp rx=0 tx=0).stop 2023-11-28T18:43:42.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.554+0000 7f9ae5279640 1 -- 172.21.15.45:0/1056921167 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ae00b35f0 msgr2=0x7f9ae009e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:42.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.554+0000 7f9ae5279640 1 --2- 172.21.15.45:0/1056921167 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ae00b35f0 0x7f9ae009e480 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f9ad00011f0 tx=0x7f9ad000c9b0 comp rx=0 tx=0).stop 2023-11-28T18:43:42.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.554+0000 7f9ae5279640 1 -- 172.21.15.45:0/1056921167 shutdown_connections 2023-11-28T18:43:42.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.554+0000 7f9ae5279640 1 --2- 172.21.15.45:0/1056921167 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9ac00668d0 0x7f9ac0068d90 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:42.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.554+0000 7f9ae5279640 1 --2- 172.21.15.45:0/1056921167 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ae00cfed0 0x7f9ae006c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:42.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.554+0000 7f9ae5279640 1 --2- 172.21.15.45:0/1056921167 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ae00b3cb0 0x7f9ae0159bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:42.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.554+0000 7f9ae5279640 1 --2- 172.21.15.45:0/1056921167 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ae00b35f0 0x7f9ae009e480 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:42.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.554+0000 7f9ae5279640 1 -- 172.21.15.45:0/1056921167 >> 172.21.15.45:0/1056921167 conn(0x7f9ae009c4f0 msgr2=0x7f9ae00cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:43:42.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.554+0000 7f9ae5279640 1 -- 172.21.15.45:0/1056921167 shutdown_connections 2023-11-28T18:43:42.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:42.554+0000 7f9ae5279640 1 -- 172.21.15.45:0/1056921167 wait complete. 2023-11-28T18:43:42.578 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi045.front.sepia.ceph.com... 2023-11-28T18:43:42.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:43:42.578 DEBUG:teuthology.orchestra.run.smithi045:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-28T18:43:42.598 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:ceph-fuse[51663]: fuse finished with error 0 and tester_r 0 2023-11-28T18:43:42.601 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi045.front.sepia.ceph.com 2023-11-28T18:43:42.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:43:42.601 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-28T18:43:42.772 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-28T18:43:42.772 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T18:43:42.782 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354684k,nr_inodes=4088671,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9377 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-28T18:43:42.782 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi190.front.sepia.ceph.com 2023-11-28T18:43:42.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:43:42.782 DEBUG:teuthology.orchestra.run.smithi190:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-28T18:43:42.830 INFO:teuthology.orchestra.run.smithi190.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-11-28T18:43:42.831 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T18:43:42.832 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T18:43:42.832 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T18:43:42.841 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357768k,nr_inodes=4089442,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9360 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276000k,nr_inodes=819000,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-28T18:43:42.841 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi045.front.sepia.ceph.com 2023-11-28T18:43:42.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:43:42.842 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-28T18:43:42.893 INFO:teuthology.orchestra.run.smithi045.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-28T18:43:42.895 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T18:43:42.896 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-28T18:43:42.896 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T18:43:42.908 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354684k,nr_inodes=4088671,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9377 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-28T18:43:42.908 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi190.front.sepia.ceph.com 2023-11-28T18:43:42.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:43:42.909 DEBUG:teuthology.orchestra.run.smithi190:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-28T18:43:42.959 INFO:teuthology.orchestra.run.smithi190.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-28T18:43:42.959 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T18:43:42.960 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T18:43:43.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.098+0000 7fe12cc32640 1 Processor -- start 2023-11-28T18:43:43.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.098+0000 7fe12cc32640 1 -- start start 2023-11-28T18:43:43.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.102+0000 7fe12cc32640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe12806ca10 0x7fe1280704a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:43.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.102+0000 7fe12cc32640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe1280721c0 0x7fe1280709e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:43.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.102+0000 7fe12cc32640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe128071120 con 0x7fe128144880 2023-11-28T18:43:43.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.102+0000 7fe12cc32640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe12815f050 con 0x7fe1280721c0 2023-11-28T18:43:43.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.102+0000 7fe12cc32640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe128070f20 con 0x7fe12806ca10 2023-11-28T18:43:43.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.102+0000 7fe126d9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe1280721c0 0x7fe1280709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:43.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.102+0000 7fe126d9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe1280721c0 0x7fe1280709e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38266/0 (socket says 172.21.15.45:38266) 2023-11-28T18:43:43.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.102+0000 7fe126d9d640 1 -- 172.21.15.45:0/89371230 learned_addr learned my addr 172.21.15.45:0/89371230 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:43:43.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.102+0000 7fe125d9b640 1 --2- 172.21.15.45:0/89371230 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe12806ca10 0x7fe1280704a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:43.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.102+0000 7fe126d9d640 1 -- 172.21.15.45:0/89371230 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe12806ca10 msgr2=0x7fe1280704a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:43:43.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.102+0000 7fe126d9d640 1 --2- 172.21.15.45:0/89371230 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe12806ca10 0x7fe1280704a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:43.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.102+0000 7fe126d9d640 1 -- 172.21.15.45:0/89371230 >> v1:172.21.15.190:6789/0 conn(0x7fe128144880 legacy=0x7fe12806c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:43:43.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.102+0000 7fe126d9d640 1 -- 172.21.15.45:0/89371230 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe128071400 con 0x7fe1280721c0 2023-11-28T18:43:43.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.102+0000 7fe125d9b640 1 --2- 172.21.15.45:0/89371230 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe12806ca10 0x7fe1280704a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:43:43.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.106+0000 7fe126d9d640 1 --2- 172.21.15.45:0/89371230 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1280721c0 0x7fe1280709e0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fe120009e50 tx=0x7fe12001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2567424126c11374 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:43.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.106+0000 7fe12559a640 1 -- 172.21.15.45:0/89371230 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1200a5820 con 0x7fe1280721c0 2023-11-28T18:43:43.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.106+0000 7fe12559a640 1 -- 172.21.15.45:0/89371230 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1200a5980 con 0x7fe1280721c0 2023-11-28T18:43:43.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.106+0000 7fe12559a640 1 -- 172.21.15.45:0/89371230 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1200a5d10 con 0x7fe1280721c0 2023-11-28T18:43:43.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.106+0000 7fe12cc32640 1 -- 172.21.15.45:0/89371230 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1280721c0 msgr2=0x7fe1280709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:43.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.106+0000 7fe12cc32640 1 --2- 172.21.15.45:0/89371230 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1280721c0 0x7fe1280709e0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fe120009e50 tx=0x7fe12001c9a0 comp rx=0 tx=0).stop 2023-11-28T18:43:43.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.106+0000 7fe12cc32640 1 -- 172.21.15.45:0/89371230 shutdown_connections 2023-11-28T18:43:43.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.106+0000 7fe12cc32640 1 --2- 172.21.15.45:0/89371230 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1280721c0 0x7fe1280709e0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:43.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.106+0000 7fe12cc32640 1 --2- 172.21.15.45:0/89371230 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe12806ca10 0x7fe1280704a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:43.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.106+0000 7fe12cc32640 1 -- 172.21.15.45:0/89371230 >> 172.21.15.45:0/89371230 conn(0x7fe12806a570 msgr2=0x7fe12806a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:43:43.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.106+0000 7fe12cc32640 1 -- 172.21.15.45:0/89371230 shutdown_connections 2023-11-28T18:43:43.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.106+0000 7fe12cc32640 1 -- 172.21.15.45:0/89371230 wait complete. 2023-11-28T18:43:43.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.106+0000 7fe12cc32640 1 Processor -- start 2023-11-28T18:43:43.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.106+0000 7fe12cc32640 1 -- start start 2023-11-28T18:43:43.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.110+0000 7fe12cc32640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe12806ca10 0x7fe12813c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:43.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.110+0000 7fe12cc32640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1280721c0 0x7fe1281430d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:43.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.110+0000 7fe12cc32640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe128144880 0x7fe1280c3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:43.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.110+0000 7fe12cc32640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1280b3910 con 0x7fe1280721c0 2023-11-28T18:43:43.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.110+0000 7fe12cc32640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe128142970 con 0x7fe12806ca10 2023-11-28T18:43:43.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.110+0000 7fe12cc32640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1280b2c90 con 0x7fe128144880 2023-11-28T18:43:43.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.110+0000 7fe125d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1280721c0 0x7fe1281430d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:43.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.110+0000 7fe125d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1280721c0 0x7fe1281430d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38282/0 (socket says 172.21.15.45:38282) 2023-11-28T18:43:43.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.110+0000 7fe125d9b640 1 -- 172.21.15.45:0/3136704621 learned_addr learned my addr 172.21.15.45:0/3136704621 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:43:43.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.110+0000 7fe126d9d640 1 --2- 172.21.15.45:0/3136704621 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe128144880 0x7fe1280c3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:43.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.110+0000 7fe12659c640 1 --2- 172.21.15.45:0/3136704621 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe12806ca10 0x7fe12813c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:43.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.110+0000 7fe125d9b640 1 -- 172.21.15.45:0/3136704621 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe128144880 msgr2=0x7fe1280c3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:43.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.110+0000 7fe125d9b640 1 --2- 172.21.15.45:0/3136704621 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe128144880 0x7fe1280c3f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:43.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.110+0000 7fe125d9b640 1 -- 172.21.15.45:0/3136704621 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe12806ca10 msgr2=0x7fe12813c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:43.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.110+0000 7fe125d9b640 1 --2- 172.21.15.45:0/3136704621 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe12806ca10 0x7fe12813c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:43.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.110+0000 7fe125d9b640 1 -- 172.21.15.45:0/3136704621 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe120009b30 con 0x7fe1280721c0 2023-11-28T18:43:43.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.110+0000 7fe125d9b640 1 --2- 172.21.15.45:0/3136704621 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1280721c0 0x7fe1281430d0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fe11c00c7f0 tx=0x7fe11c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:43.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.110+0000 7fe116ffd640 1 -- 172.21.15.45:0/3136704621 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11c00cea0 con 0x7fe1280721c0 2023-11-28T18:43:43.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.110+0000 7fe116ffd640 1 -- 172.21.15.45:0/3136704621 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe11c007a30 con 0x7fe1280721c0 2023-11-28T18:43:43.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.110+0000 7fe116ffd640 1 -- 172.21.15.45:0/3136704621 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11c007dc0 con 0x7fe1280721c0 2023-11-28T18:43:43.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.110+0000 7fe12cc32640 1 -- 172.21.15.45:0/3136704621 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1280b2f70 con 0x7fe1280721c0 2023-11-28T18:43:43.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.110+0000 7fe12cc32640 1 -- 172.21.15.45:0/3136704621 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1280b3530 con 0x7fe1280721c0 2023-11-28T18:43:43.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.110+0000 7fe12cc32640 1 -- 172.21.15.45:0/3136704621 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1280b3a50 con 0x7fe1280721c0 2023-11-28T18:43:43.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.114+0000 7fe116ffd640 1 -- 172.21.15.45:0/3136704621 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe11c0113f0 con 0x7fe1280721c0 2023-11-28T18:43:43.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.114+0000 7fe116ffd640 1 --2- 172.21.15.45:0/3136704621 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe1080668d0 0x7fe108068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:43.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.114+0000 7fe116ffd640 1 -- 172.21.15.45:0/3136704621 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fe11c0845a0 con 0x7fe1280721c0 2023-11-28T18:43:43.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.114+0000 7fe12659c640 1 --2- 172.21.15.45:0/3136704621 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe1080668d0 0x7fe108068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:43.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.114+0000 7fe12659c640 1 --2- 172.21.15.45:0/3136704621 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe1080668d0 0x7fe108068d90 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fe12815f930 tx=0x7fe118009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:43.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.118+0000 7fe116ffd640 1 -- 172.21.15.45:0/3136704621 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe1280b3a50 con 0x7fe1280721c0 2023-11-28T18:43:43.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.310+0000 7fe12cc32640 1 -- 172.21.15.45:0/3136704621 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe1280b3a50 con 0x7fe1280721c0 2023-11-28T18:43:43.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.310+0000 7fe116ffd640 1 -- 172.21.15.45:0/3136704621 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4912 (secure 0 0 0) 0x7fe1280b3a50 con 0x7fe1280721c0 2023-11-28T18:43:43.315 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:43:43.315 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":39,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5414,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/114066704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":114066704},{"type":"v1","addr":"172.21.15.190:6836","nonce":114066704}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5417,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/27225494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":27225494},{"type":"v1","addr":"172.21.15.190:6837","nonce":27225494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5973,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1061201705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":1061201705},{"type":"v1","addr":"172.21.15.45:6835","nonce":1061201705}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T18:39:36.424552+0000","modified":"2023-11-28T18:42:27.227565+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":49,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6207},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6207":{"gid":6207,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":22,"addr":"172.21.15.45:6834/2228986336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2228986336},{"type":"v1","addr":"172.21.15.45:6834","nonce":2228986336}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-28T18:43:43.316 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 39 2023-11-28T18:43:43.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.314+0000 7fe12cc32640 1 -- 172.21.15.45:0/3136704621 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe1080668d0 msgr2=0x7fe108068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:43.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.314+0000 7fe12cc32640 1 --2- 172.21.15.45:0/3136704621 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe1080668d0 0x7fe108068d90 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fe12815f930 tx=0x7fe118009060 comp rx=0 tx=0).stop 2023-11-28T18:43:43.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.314+0000 7fe12cc32640 1 -- 172.21.15.45:0/3136704621 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1280721c0 msgr2=0x7fe1281430d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:43.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.314+0000 7fe12cc32640 1 --2- 172.21.15.45:0/3136704621 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1280721c0 0x7fe1281430d0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fe11c00c7f0 tx=0x7fe11c00ccb0 comp rx=0 tx=0).stop 2023-11-28T18:43:43.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.314+0000 7fe12cc32640 1 -- 172.21.15.45:0/3136704621 shutdown_connections 2023-11-28T18:43:43.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.314+0000 7fe12cc32640 1 --2- 172.21.15.45:0/3136704621 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe1080668d0 0x7fe108068d90 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:43.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.314+0000 7fe12cc32640 1 --2- 172.21.15.45:0/3136704621 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe128144880 0x7fe1280c3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:43.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.314+0000 7fe12cc32640 1 --2- 172.21.15.45:0/3136704621 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1280721c0 0x7fe1281430d0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:43.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.314+0000 7fe12cc32640 1 --2- 172.21.15.45:0/3136704621 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe12806ca10 0x7fe12813c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:43.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.314+0000 7fe12cc32640 1 -- 172.21.15.45:0/3136704621 >> 172.21.15.45:0/3136704621 conn(0x7fe12806a570 msgr2=0x7fe1280704a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:43:43.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.314+0000 7fe12cc32640 1 -- 172.21.15.45:0/3136704621 shutdown_connections 2023-11-28T18:43:43.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.314+0000 7fe12cc32640 1 -- 172.21.15.45:0/3136704621 wait complete. 2023-11-28T18:43:43.337 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T18:43:43.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.474+0000 7fd9e359e640 1 Processor -- start 2023-11-28T18:43:43.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.474+0000 7fd9e359e640 1 -- start start 2023-11-28T18:43:43.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.478+0000 7fd9e359e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd9e40cf950 0x7fd9e40cfd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:43.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.478+0000 7fd9e359e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd9e40d0270 0x7fd9e40d0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:43.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.478+0000 7fd9e359e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9e40c7000 con 0x7fd9e40d06d0 2023-11-28T18:43:43.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.478+0000 7fd9e359e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9e40cf0a0 con 0x7fd9e40d0270 2023-11-28T18:43:43.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.478+0000 7fd9e359e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e40ceae0 con 0x7fd9e40cf950 2023-11-28T18:43:43.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.478+0000 7fd9dbfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd9e40d0270 0x7fd9e40d0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:43.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.478+0000 7fd9e2d9d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd9e40d06d0 0x7fd9e40d12c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47606/0 (socket says 172.21.15.45:47606) 2023-11-28T18:43:43.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.478+0000 7fd9e2d9d640 1 -- 172.21.15.45:0/385919896 learned_addr learned my addr 172.21.15.45:0/385919896 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:43:43.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.478+0000 7fd9dbfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd9e40d0270 0x7fd9e40d0d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38296/0 (socket says 172.21.15.45:38296) 2023-11-28T18:43:43.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.478+0000 7fd9e259c640 1 --2- 172.21.15.45:0/385919896 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd9e40cf950 0x7fd9e40cfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:43.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.478+0000 7fd9dbfff640 1 -- 172.21.15.45:0/385919896 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd9e40cf950 msgr2=0x7fd9e40cfd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:43:43.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.478+0000 7fd9dbfff640 1 --2- 172.21.15.45:0/385919896 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd9e40cf950 0x7fd9e40cfd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:43.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.478+0000 7fd9dbfff640 1 -- 172.21.15.45:0/385919896 >> v1:172.21.15.45:6789/0 conn(0x7fd9e40d06d0 legacy=0x7fd9e40d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:43.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.478+0000 7fd9dbfff640 1 -- 172.21.15.45:0/385919896 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9e40cedc0 con 0x7fd9e40d0270 2023-11-28T18:43:43.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.478+0000 7fd9e259c640 1 --2- 172.21.15.45:0/385919896 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd9e40cf950 0x7fd9e40cfd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:43:43.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.478+0000 7fd9e1d9b640 1 -- 172.21.15.45:0/385919896 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 970743222 0 0) 0x7fd9e40c7000 con 0x7fd9e40d06d0 2023-11-28T18:43:43.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.482+0000 7fd9dbfff640 1 --2- 172.21.15.45:0/385919896 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9e40d0270 0x7fd9e40d0d80 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc0097c0 tx=0x7fd9cc01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48015b45821a430c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:43.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.482+0000 7fd9e1d9b640 1 -- 172.21.15.45:0/385919896 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9cc0ab600 con 0x7fd9e40d0270 2023-11-28T18:43:43.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.482+0000 7fd9e1d9b640 1 -- 172.21.15.45:0/385919896 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9cc0a7050 con 0x7fd9e40d0270 2023-11-28T18:43:43.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.482+0000 7fd9e1d9b640 1 -- 172.21.15.45:0/385919896 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9cc0ab980 con 0x7fd9e40d0270 2023-11-28T18:43:43.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.482+0000 7fd9e359e640 1 -- 172.21.15.45:0/385919896 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9e40d0270 msgr2=0x7fd9e40d0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:43.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.482+0000 7fd9e359e640 1 --2- 172.21.15.45:0/385919896 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9e40d0270 0x7fd9e40d0d80 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc0097c0 tx=0x7fd9cc01c3c0 comp rx=0 tx=0).stop 2023-11-28T18:43:43.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.482+0000 7fd9e359e640 1 -- 172.21.15.45:0/385919896 shutdown_connections 2023-11-28T18:43:43.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.482+0000 7fd9e359e640 1 --2- 172.21.15.45:0/385919896 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9e40d0270 0x7fd9e40d0d80 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:43.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.482+0000 7fd9e359e640 1 --2- 172.21.15.45:0/385919896 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd9e40cf950 0x7fd9e40cfd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:43.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.482+0000 7fd9e359e640 1 -- 172.21.15.45:0/385919896 >> 172.21.15.45:0/385919896 conn(0x7fd9e40d2fa0 msgr2=0x7fd9e40d3380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:43:43.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.482+0000 7fd9e359e640 1 -- 172.21.15.45:0/385919896 shutdown_connections 2023-11-28T18:43:43.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.482+0000 7fd9e359e640 1 -- 172.21.15.45:0/385919896 wait complete. 2023-11-28T18:43:43.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.482+0000 7fd9e359e640 1 Processor -- start 2023-11-28T18:43:43.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.482+0000 7fd9e359e640 1 -- start start 2023-11-28T18:43:43.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.486+0000 7fd9e359e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9e40cf950 0x7fd9e40b85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:43.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.486+0000 7fd9e359e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd9e40d0270 0x7fd9e40caa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:43.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.486+0000 7fd9e359e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd9e40d06d0 0x7fd9e41570e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:43.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.486+0000 7fd9e359e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e40cc130 con 0x7fd9e40cf950 2023-11-28T18:43:43.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.486+0000 7fd9e359e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e41f56c0 con 0x7fd9e40d0270 2023-11-28T18:43:43.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.486+0000 7fd9e359e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e40cb520 con 0x7fd9e40d06d0 2023-11-28T18:43:43.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.486+0000 7fd9e259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9e40cf950 0x7fd9e40b85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:43.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.486+0000 7fd9e259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9e40cf950 0x7fd9e40b85e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38300/0 (socket says 172.21.15.45:38300) 2023-11-28T18:43:43.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.486+0000 7fd9e259c640 1 -- 172.21.15.45:0/1771506047 learned_addr learned my addr 172.21.15.45:0/1771506047 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:43:43.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.486+0000 7fd9e2d9d640 1 --2- 172.21.15.45:0/1771506047 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd9e40d06d0 0x7fd9e41570e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:43.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.486+0000 7fd9dbfff640 1 --2- 172.21.15.45:0/1771506047 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd9e40d0270 0x7fd9e40caa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:43.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.486+0000 7fd9e259c640 1 -- 172.21.15.45:0/1771506047 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd9e40d06d0 msgr2=0x7fd9e41570e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:43.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.486+0000 7fd9e259c640 1 --2- 172.21.15.45:0/1771506047 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd9e40d06d0 0x7fd9e41570e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:43.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.486+0000 7fd9e259c640 1 -- 172.21.15.45:0/1771506047 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd9e40d0270 msgr2=0x7fd9e40caa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:43.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.486+0000 7fd9e259c640 1 --2- 172.21.15.45:0/1771506047 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd9e40d0270 0x7fd9e40caa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:43.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.486+0000 7fd9e259c640 1 -- 172.21.15.45:0/1771506047 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9cc009420 con 0x7fd9e40cf950 2023-11-28T18:43:43.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.486+0000 7fd9e259c640 1 --2- 172.21.15.45:0/1771506047 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9e40cf950 0x7fd9e40b85e0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fd9d400e810 tx=0x7fd9d400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:43.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.486+0000 7fd9daffd640 1 -- 172.21.15.45:0/1771506047 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d400c870 con 0x7fd9e40cf950 2023-11-28T18:43:43.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.486+0000 7fd9daffd640 1 -- 172.21.15.45:0/1771506047 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9d400c9d0 con 0x7fd9e40cf950 2023-11-28T18:43:43.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.486+0000 7fd9daffd640 1 -- 172.21.15.45:0/1771506047 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d400cd60 con 0x7fd9e40cf950 2023-11-28T18:43:43.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.486+0000 7fd9e359e640 1 -- 172.21.15.45:0/1771506047 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9e40cb800 con 0x7fd9e40cf950 2023-11-28T18:43:43.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.486+0000 7fd9e359e640 1 -- 172.21.15.45:0/1771506047 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9e40cbdc0 con 0x7fd9e40cf950 2023-11-28T18:43:43.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.486+0000 7fd9e359e640 1 -- 172.21.15.45:0/1771506047 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9e40a0f70 con 0x7fd9e40cf950 2023-11-28T18:43:43.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.486+0000 7fd9daffd640 1 -- 172.21.15.45:0/1771506047 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fd9d4013410 con 0x7fd9e40cf950 2023-11-28T18:43:43.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.490+0000 7fd9daffd640 1 --2- 172.21.15.45:0/1771506047 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fd9c4066900 0x7fd9c4068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:43.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.490+0000 7fd9daffd640 1 -- 172.21.15.45:0/1771506047 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fd9d4084300 con 0x7fd9e40cf950 2023-11-28T18:43:43.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.490+0000 7fd9dbfff640 1 --2- 172.21.15.45:0/1771506047 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fd9c4066900 0x7fd9c4068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:43.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.490+0000 7fd9dbfff640 1 --2- 172.21.15.45:0/1771506047 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fd9c4066900 0x7fd9c4068dc0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc0ad000 tx=0x7fd9cc0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:43.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.490+0000 7fd9daffd640 1 -- 172.21.15.45:0/1771506047 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd9d4051410 con 0x7fd9e40cf950 2023-11-28T18:43:43.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.650+0000 7fd9e359e640 1 -- 172.21.15.45:0/1771506047 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd9e404e970 con 0x7fd9e40cf950 2023-11-28T18:43:43.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.650+0000 7fd9daffd640 1 -- 172.21.15.45:0/1771506047 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+16702 (secure 0 0 0) 0x7fd9d4054a30 con 0x7fd9e40cf950 2023-11-28T18:43:43.655 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:43:43.656 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":49,"fsid":"d10f5cd6-1d00-4019-99b6-6fa435498a15","created":"2023-11-28T18:37:08.189030+0000","modified":"2023-11-28T18:41:11.270317+0000","last_up_change":"2023-11-28T18:37:20.196124+0000","last_in_change":"2023-11-28T18:37:10.742043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T18:37:21.293917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-28T18:39:34.106789+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-28T18:39:35.426601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"84465384-103c-4f2c-a45a-96f5bb9c835f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6809","nonce":555237322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6811","nonce":555237322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6815","nonce":555237322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6813","nonce":555237322}]},"public_addr":"172.21.15.45:6809/555237322","cluster_addr":"172.21.15.45:6811/555237322","heartbeat_back_addr":"172.21.15.45:6815/555237322","heartbeat_front_addr":"172.21.15.45:6813/555237322","state":["exists","up"]},{"osd":1,"uuid":"7d9eed24-a58f-42c7-a787-ac06be8553fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6801","nonce":2857063763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6803","nonce":2857063763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6807","nonce":2857063763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6805","nonce":2857063763}]},"public_addr":"172.21.15.45:6801/2857063763","cluster_addr":"172.21.15.45:6803/2857063763","heartbeat_back_addr":"172.21.15.45:6807/2857063763","heartbeat_front_addr":"172.21.15.45:6805/2857063763","state":["exists","up"]},{"osd":2,"uuid":"575eeccc-4abf-45b4-9caf-f3e797859588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6817","nonce":193884539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6819","nonce":193884539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6823","nonce":193884539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6821","nonce":193884539}]},"public_addr":"172.21.15.45:6817/193884539","cluster_addr":"172.21.15.45:6819/193884539","heartbeat_back_addr":"172.21.15.45:6823/193884539","heartbeat_front_addr":"172.21.15.45:6821/193884539","state":["exists","up"]},{"osd":3,"uuid":"9b0290d6-9a52-4bc8-b2a1-7622c5dc8e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6825","nonce":78541084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6827","nonce":78541084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6831","nonce":78541084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6829","nonce":78541084}]},"public_addr":"172.21.15.45:6825/78541084","cluster_addr":"172.21.15.45:6827/78541084","heartbeat_back_addr":"172.21.15.45:6831/78541084","heartbeat_front_addr":"172.21.15.45:6829/78541084","state":["exists","up"]},{"osd":4,"uuid":"ce632829-f027-4fbf-a627-02c571aa9d53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6809","nonce":1537591987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6811","nonce":1537591987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6815","nonce":1537591987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6813","nonce":1537591987}]},"public_addr":"172.21.15.190:6809/1537591987","cluster_addr":"172.21.15.190:6811/1537591987","heartbeat_back_addr":"172.21.15.190:6815/1537591987","heartbeat_front_addr":"172.21.15.190:6813/1537591987","state":["exists","up"]},{"osd":5,"uuid":"8700b609-27be-40bd-a251-4c0ae0a29ead","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6801","nonce":3296698407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6803","nonce":3296698407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6807","nonce":3296698407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6805","nonce":3296698407}]},"public_addr":"172.21.15.190:6801/3296698407","cluster_addr":"172.21.15.190:6803/3296698407","heartbeat_back_addr":"172.21.15.190:6807/3296698407","heartbeat_front_addr":"172.21.15.190:6805/3296698407","state":["exists","up"]},{"osd":6,"uuid":"44ce4a40-e6ff-4f4d-8e8a-7341e5c91f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6817","nonce":2317686718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6819","nonce":2317686718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6823","nonce":2317686718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6821","nonce":2317686718}]},"public_addr":"172.21.15.190:6817/2317686718","cluster_addr":"172.21.15.190:6819/2317686718","heartbeat_back_addr":"172.21.15.190:6823/2317686718","heartbeat_front_addr":"172.21.15.190:6821/2317686718","state":["exists","up"]},{"osd":7,"uuid":"192238c9-1423-4b7e-ac8f-84ba32113ddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6825","nonce":2493232051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6827","nonce":2493232051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6831","nonce":2493232051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6829","nonce":2493232051}]},"public_addr":"172.21.15.190:6825/2493232051","cluster_addr":"172.21.15.190:6827/2493232051","heartbeat_back_addr":"172.21.15.190:6831/2493232051","heartbeat_front_addr":"172.21.15.190:6829/2493232051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.393552+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.385453+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.361421+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.366408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.363226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.276007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.414605+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.445885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.2d","mappings":[{"from":0,"to":4}]},{"pgid":"7.3e","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6834/2737877840":"2023-11-29T18:41:11.270289+0000","172.21.15.45:6832/2737877840":"2023-11-29T18:41:11.270289+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T18:43:43.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.654+0000 7fd9e359e640 1 -- 172.21.15.45:0/1771506047 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fd9c4066900 msgr2=0x7fd9c4068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:43.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.654+0000 7fd9e359e640 1 --2- 172.21.15.45:0/1771506047 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fd9c4066900 0x7fd9c4068dc0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc0ad000 tx=0x7fd9cc0a6000 comp rx=0 tx=0).stop 2023-11-28T18:43:43.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.654+0000 7fd9e359e640 1 -- 172.21.15.45:0/1771506047 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9e40cf950 msgr2=0x7fd9e40b85e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:43.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.654+0000 7fd9e359e640 1 --2- 172.21.15.45:0/1771506047 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9e40cf950 0x7fd9e40b85e0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fd9d400e810 tx=0x7fd9d400ecd0 comp rx=0 tx=0).stop 2023-11-28T18:43:43.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.654+0000 7fd9e359e640 1 -- 172.21.15.45:0/1771506047 shutdown_connections 2023-11-28T18:43:43.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.654+0000 7fd9e359e640 1 --2- 172.21.15.45:0/1771506047 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fd9c4066900 0x7fd9c4068dc0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:43.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.654+0000 7fd9e359e640 1 --2- 172.21.15.45:0/1771506047 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd9e40d06d0 0x7fd9e41570e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:43.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.654+0000 7fd9e359e640 1 --2- 172.21.15.45:0/1771506047 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd9e40d0270 0x7fd9e40caa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:43.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.654+0000 7fd9e359e640 1 --2- 172.21.15.45:0/1771506047 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9e40cf950 0x7fd9e40b85e0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:43.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.654+0000 7fd9e359e640 1 -- 172.21.15.45:0/1771506047 >> 172.21.15.45:0/1771506047 conn(0x7fd9e40d2fa0 msgr2=0x7fd9e40c6420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:43:43.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.654+0000 7fd9e359e640 1 -- 172.21.15.45:0/1771506047 shutdown_connections 2023-11-28T18:43:43.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.654+0000 7fd9e359e640 1 -- 172.21.15.45:0/1771506047 wait complete. 2023-11-28T18:43:43.678 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T18:37:21.293917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T18:39:34.106789+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T18:39:35.426601+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T18:43:43.679 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T18:43:43.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.822+0000 7f530b757640 1 Processor -- start 2023-11-28T18:43:43.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.822+0000 7f530b757640 1 -- start start 2023-11-28T18:43:43.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.822+0000 7f530b757640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f530414b220 0x7f53040b3e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:43.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.822+0000 7f530b757640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53040b47b0 con 0x7f530414ac20 2023-11-28T18:43:43.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.822+0000 7f530b757640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53040b2000 con 0x7f53040b4390 2023-11-28T18:43:43.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.822+0000 7f530b757640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5304166170 con 0x7f530414b220 2023-11-28T18:43:43.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.822+0000 7f53094f3640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f530414ac20 0x7f5304165a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47610/0 (socket says 172.21.15.45:47610) 2023-11-28T18:43:43.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.822+0000 7f53094f3640 1 -- 172.21.15.45:0/2598231372 learned_addr learned my addr 172.21.15.45:0/2598231372 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:43:43.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.822+0000 7f5308cf2640 1 --2- 172.21.15.45:0/2598231372 >> v2:172.21.15.190:3300/0 conn(0x7f530414b220 0x7f53040b3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:43.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.822+0000 7f52fbfff640 1 -- 172.21.15.45:0/2598231372 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4128466864 0 0) 0x7f53040b47b0 con 0x7f530414ac20 2023-11-28T18:43:43.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.822+0000 7f52fbfff640 1 -- 172.21.15.45:0/2598231372 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52f0003530 con 0x7f530414ac20 2023-11-28T18:43:43.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.822+0000 7f5308cf2640 1 -- 172.21.15.45:0/2598231372 >> v1:172.21.15.190:6789/0 conn(0x7f53040b4390 legacy=0x7f5304070430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:43.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.822+0000 7f5308cf2640 1 -- 172.21.15.45:0/2598231372 >> v1:172.21.15.45:6789/0 conn(0x7f530414ac20 legacy=0x7f5304165a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:43.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.822+0000 7f5308cf2640 1 -- 172.21.15.45:0/2598231372 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53040b22a0 con 0x7f530414b220 2023-11-28T18:43:43.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.826+0000 7f5308cf2640 1 --2- 172.21.15.45:0/2598231372 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f530414b220 0x7f53040b3e50 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f52f40097c0 tx=0x7f52f401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a802f965167d7fb9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:43.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.826+0000 7f52fbfff640 1 -- 172.21.15.45:0/2598231372 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f40ab650 con 0x7f530414b220 2023-11-28T18:43:43.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.826+0000 7f52fbfff640 1 -- 172.21.15.45:0/2598231372 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52f40ab7b0 con 0x7f530414b220 2023-11-28T18:43:43.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.826+0000 7f52fbfff640 1 -- 172.21.15.45:0/2598231372 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f40abb20 con 0x7f530414b220 2023-11-28T18:43:43.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.826+0000 7f530b757640 1 -- 172.21.15.45:0/2598231372 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f530414b220 msgr2=0x7f53040b3e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:43.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.826+0000 7f530b757640 1 --2- 172.21.15.45:0/2598231372 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f530414b220 0x7f53040b3e50 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f52f40097c0 tx=0x7f52f401c450 comp rx=0 tx=0).stop 2023-11-28T18:43:43.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.826+0000 7f530b757640 1 -- 172.21.15.45:0/2598231372 shutdown_connections 2023-11-28T18:43:43.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.826+0000 7f530b757640 1 --2- 172.21.15.45:0/2598231372 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f530414b220 0x7f53040b3e50 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:43.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.826+0000 7f530b757640 1 -- 172.21.15.45:0/2598231372 >> 172.21.15.45:0/2598231372 conn(0x7f53040b0d00 msgr2=0x7f53040b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:43:43.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.826+0000 7f530b757640 1 -- 172.21.15.45:0/2598231372 shutdown_connections 2023-11-28T18:43:43.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.826+0000 7f530b757640 1 -- 172.21.15.45:0/2598231372 wait complete. 2023-11-28T18:43:43.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.830+0000 7f530b757640 1 Processor -- start 2023-11-28T18:43:43.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.830+0000 7f530b757640 1 -- start start 2023-11-28T18:43:43.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.830+0000 7f530b757640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f53040b4390 0x7f5304164430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:43.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.830+0000 7f530b757640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f530414ac20 0x7f5304145b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:43.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.830+0000 7f530b757640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5304160d30 0x7f5304146050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:43.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.830+0000 7f530b757640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5304163fa0 con 0x7f5304160d30 2023-11-28T18:43:43.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.830+0000 7f530b757640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53041636b0 con 0x7f530414ac20 2023-11-28T18:43:43.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.830+0000 7f530b757640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5304162230 con 0x7f53040b4390 2023-11-28T18:43:43.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.830+0000 7f5309cf4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5304160d30 0x7f5304146050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:43.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.830+0000 7f5309cf4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5304160d30 0x7f5304146050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38316/0 (socket says 172.21.15.45:38316) 2023-11-28T18:43:43.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.830+0000 7f5308cf2640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f530414ac20 0x7f5304145b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:43.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.830+0000 7f5309cf4640 1 -- 172.21.15.45:0/1381311745 learned_addr learned my addr 172.21.15.45:0/1381311745 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:43:43.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.830+0000 7f53094f3640 1 --2- 172.21.15.45:0/1381311745 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f53040b4390 0x7f5304164430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:43.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.830+0000 7f5309cf4640 1 -- 172.21.15.45:0/1381311745 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f53040b4390 msgr2=0x7f5304164430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:43.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.830+0000 7f5309cf4640 1 --2- 172.21.15.45:0/1381311745 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f53040b4390 0x7f5304164430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:43.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.830+0000 7f5309cf4640 1 -- 172.21.15.45:0/1381311745 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f530414ac20 msgr2=0x7f5304145b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:43.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.830+0000 7f5309cf4640 1 --2- 172.21.15.45:0/1381311745 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f530414ac20 0x7f5304145b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:43.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.830+0000 7f5309cf4640 1 -- 172.21.15.45:0/1381311745 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52f4009420 con 0x7f5304160d30 2023-11-28T18:43:43.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.830+0000 7f5309cf4640 1 --2- 172.21.15.45:0/1381311745 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5304160d30 0x7f5304146050 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f52fc00c770 tx=0x7f52fc00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:43.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.830+0000 7f52f9ffb640 1 -- 172.21.15.45:0/1381311745 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52fc003b80 con 0x7f5304160d30 2023-11-28T18:43:43.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.830+0000 7f52f9ffb640 1 -- 172.21.15.45:0/1381311745 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52fc003ce0 con 0x7f5304160d30 2023-11-28T18:43:43.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.830+0000 7f530b757640 1 -- 172.21.15.45:0/1381311745 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5304161f50 con 0x7f5304160d30 2023-11-28T18:43:43.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.830+0000 7f52f9ffb640 1 -- 172.21.15.45:0/1381311745 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52fc00aa90 con 0x7f5304160d30 2023-11-28T18:43:43.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.830+0000 7f530b757640 1 -- 172.21.15.45:0/1381311745 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5304163c30 con 0x7f5304160d30 2023-11-28T18:43:43.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.834+0000 7f530b757640 1 -- 172.21.15.45:0/1381311745 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5304069410 con 0x7f5304160d30 2023-11-28T18:43:43.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.834+0000 7f52f9ffb640 1 -- 172.21.15.45:0/1381311745 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f52fc00abf0 con 0x7f5304160d30 2023-11-28T18:43:43.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.834+0000 7f52f9ffb640 1 --2- 172.21.15.45:0/1381311745 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f52e80668d0 0x7f52e8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:43.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.834+0000 7f52f9ffb640 1 -- 172.21.15.45:0/1381311745 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f52fc084260 con 0x7f5304160d30 2023-11-28T18:43:43.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.834+0000 7f53094f3640 1 --2- 172.21.15.45:0/1381311745 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f52e80668d0 0x7f52e8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:43.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.834+0000 7f53094f3640 1 --2- 172.21.15.45:0/1381311745 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f52e80668d0 0x7f52e8068d90 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f53000011f0 tx=0x7f5300007d40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:43.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.838+0000 7f52f9ffb640 1 -- 172.21.15.45:0/1381311745 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f52fc051420 con 0x7f5304160d30 2023-11-28T18:43:44.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.994+0000 7f530b757640 1 -- 172.21.15.45:0/1381311745 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f53041640e0 con 0x7f5304160d30 2023-11-28T18:43:44.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.998+0000 7f52f9ffb640 1 -- 172.21.15.45:0/1381311745 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v49) v1 ==== 93+0+10 (secure 0 0 0) 0x7f52fc054a40 con 0x7f5304160d30 2023-11-28T18:43:44.001 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-11-28T18:43:44.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.998+0000 7f530b757640 1 -- 172.21.15.45:0/1381311745 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f52e80668d0 msgr2=0x7f52e8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:44.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.998+0000 7f530b757640 1 --2- 172.21.15.45:0/1381311745 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f52e80668d0 0x7f52e8068d90 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f53000011f0 tx=0x7f5300007d40 comp rx=0 tx=0).stop 2023-11-28T18:43:44.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.998+0000 7f530b757640 1 -- 172.21.15.45:0/1381311745 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5304160d30 msgr2=0x7f5304146050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:44.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.998+0000 7f530b757640 1 --2- 172.21.15.45:0/1381311745 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5304160d30 0x7f5304146050 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f52fc00c770 tx=0x7f52fc00cc30 comp rx=0 tx=0).stop 2023-11-28T18:43:44.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.998+0000 7f530b757640 1 -- 172.21.15.45:0/1381311745 shutdown_connections 2023-11-28T18:43:44.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.998+0000 7f530b757640 1 --2- 172.21.15.45:0/1381311745 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f52e80668d0 0x7f52e8068d90 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:44.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.998+0000 7f530b757640 1 --2- 172.21.15.45:0/1381311745 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5304160d30 0x7f5304146050 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:44.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.998+0000 7f530b757640 1 --2- 172.21.15.45:0/1381311745 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f530414ac20 0x7f5304145b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:44.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.998+0000 7f530b757640 1 --2- 172.21.15.45:0/1381311745 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f53040b4390 0x7f5304164430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:44.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.998+0000 7f530b757640 1 -- 172.21.15.45:0/1381311745 >> 172.21.15.45:0/1381311745 conn(0x7f53040b0d00 msgr2=0x7f53040734a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:43:44.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.998+0000 7f530b757640 1 -- 172.21.15.45:0/1381311745 shutdown_connections 2023-11-28T18:43:44.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:43.998+0000 7f530b757640 1 -- 172.21.15.45:0/1381311745 wait complete. 2023-11-28T18:43:44.023 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T18:43:44.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.166+0000 7feb6d372640 1 Processor -- start 2023-11-28T18:43:44.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.166+0000 7feb6d372640 1 -- start start 2023-11-28T18:43:44.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.166+0000 7feb6d372640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feb6815d2f0 0x7feb680d17f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:44.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.166+0000 7feb6d372640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7feb680d0330 0x7feb680b0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:44.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.166+0000 7feb6d372640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb680aff70 con 0x7feb680d1d30 2023-11-28T18:43:44.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.166+0000 7feb6d372640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb680b0210 con 0x7feb680d0330 2023-11-28T18:43:44.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.166+0000 7feb6d372640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb680b04f0 con 0x7feb6815d2f0 2023-11-28T18:43:44.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.170+0000 7feb677fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7feb680d0330 0x7feb680b0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:44.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.170+0000 7feb5ffff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7feb680d1d30 0x7feb680cfc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47626/0 (socket says 172.21.15.45:47626) 2023-11-28T18:43:44.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.170+0000 7feb5ffff640 1 -- 172.21.15.45:0/867720840 learned_addr learned my addr 172.21.15.45:0/867720840 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:43:44.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.170+0000 7feb66ffd640 1 --2- 172.21.15.45:0/867720840 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feb6815d2f0 0x7feb680d17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:44.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.170+0000 7feb677fe640 1 -- 172.21.15.45:0/867720840 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feb6815d2f0 msgr2=0x7feb680d17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:43:44.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.170+0000 7feb677fe640 1 --2- 172.21.15.45:0/867720840 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feb6815d2f0 0x7feb680d17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:44.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.170+0000 7feb677fe640 1 -- 172.21.15.45:0/867720840 >> v1:172.21.15.45:6789/0 conn(0x7feb680d1d30 legacy=0x7feb680cfc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:44.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.170+0000 7feb677fe640 1 -- 172.21.15.45:0/867720840 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb680b07d0 con 0x7feb680d0330 2023-11-28T18:43:44.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.170+0000 7feb667fc640 1 -- 172.21.15.45:0/867720840 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 108007397 0 0) 0x7feb680aff70 con 0x7feb680d1d30 2023-11-28T18:43:44.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.170+0000 7feb677fe640 1 --2- 172.21.15.45:0/867720840 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb680d0330 0x7feb680b0cf0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7feb60009d90 tx=0x7feb6001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2070f0a92bccb06d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:44.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.170+0000 7feb667fc640 1 -- 172.21.15.45:0/867720840 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb600a59b0 con 0x7feb680d0330 2023-11-28T18:43:44.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.170+0000 7feb667fc640 1 -- 172.21.15.45:0/867720840 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb600a5b10 con 0x7feb680d0330 2023-11-28T18:43:44.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.170+0000 7feb667fc640 1 -- 172.21.15.45:0/867720840 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb600a5ea0 con 0x7feb680d0330 2023-11-28T18:43:44.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.174+0000 7feb6d372640 1 -- 172.21.15.45:0/867720840 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb680d0330 msgr2=0x7feb680b0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:44.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.174+0000 7feb6d372640 1 --2- 172.21.15.45:0/867720840 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb680d0330 0x7feb680b0cf0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7feb60009d90 tx=0x7feb6001c950 comp rx=0 tx=0).stop 2023-11-28T18:43:44.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.174+0000 7feb6d372640 1 -- 172.21.15.45:0/867720840 shutdown_connections 2023-11-28T18:43:44.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.174+0000 7feb6d372640 1 --2- 172.21.15.45:0/867720840 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb680d0330 0x7feb680b0cf0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:44.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.174+0000 7feb6d372640 1 --2- 172.21.15.45:0/867720840 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feb6815d2f0 0x7feb680d17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:44.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.174+0000 7feb6d372640 1 -- 172.21.15.45:0/867720840 >> 172.21.15.45:0/867720840 conn(0x7feb6809c550 msgr2=0x7feb680d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:43:44.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.174+0000 7feb6d372640 1 -- 172.21.15.45:0/867720840 shutdown_connections 2023-11-28T18:43:44.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.174+0000 7feb6d372640 1 -- 172.21.15.45:0/867720840 wait complete. 2023-11-28T18:43:44.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.174+0000 7feb6d372640 1 Processor -- start 2023-11-28T18:43:44.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.174+0000 7feb6d372640 1 -- start start 2023-11-28T18:43:44.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.174+0000 7feb6d372640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feb680d0330 0x7feb6806bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:44.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.174+0000 7feb6d372640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb680d1d30 0x7feb681545e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:44.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.174+0000 7feb6d372640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feb6815d2f0 0x7feb68159150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:44.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.174+0000 7feb6d372640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb6806c470 con 0x7feb680d1d30 2023-11-28T18:43:44.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.174+0000 7feb6d372640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb681566c0 con 0x7feb6815d2f0 2023-11-28T18:43:44.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.174+0000 7feb6d372640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb681553b0 con 0x7feb680d0330 2023-11-28T18:43:44.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.174+0000 7feb5ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb680d1d30 0x7feb681545e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:44.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.174+0000 7feb5ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb680d1d30 0x7feb681545e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38326/0 (socket says 172.21.15.45:38326) 2023-11-28T18:43:44.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.174+0000 7feb5ffff640 1 -- 172.21.15.45:0/3327450848 learned_addr learned my addr 172.21.15.45:0/3327450848 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:43:44.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.174+0000 7feb66ffd640 1 --2- 172.21.15.45:0/3327450848 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feb680d0330 0x7feb6806bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:44.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.174+0000 7feb677fe640 1 --2- 172.21.15.45:0/3327450848 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feb6815d2f0 0x7feb68159150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:44.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.174+0000 7feb5ffff640 1 -- 172.21.15.45:0/3327450848 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feb680d0330 msgr2=0x7feb6806bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:44.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.174+0000 7feb5ffff640 1 --2- 172.21.15.45:0/3327450848 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feb680d0330 0x7feb6806bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:44.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.174+0000 7feb5ffff640 1 -- 172.21.15.45:0/3327450848 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feb6815d2f0 msgr2=0x7feb68159150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:44.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.174+0000 7feb5ffff640 1 --2- 172.21.15.45:0/3327450848 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feb6815d2f0 0x7feb68159150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:44.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.174+0000 7feb5ffff640 1 -- 172.21.15.45:0/3327450848 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb60009a70 con 0x7feb680d1d30 2023-11-28T18:43:44.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.174+0000 7feb677fe640 1 --2- 172.21.15.45:0/3327450848 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feb6815d2f0 0x7feb68159150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:43:44.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.174+0000 7feb66ffd640 1 --2- 172.21.15.45:0/3327450848 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feb680d0330 0x7feb6806bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:43:44.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.178+0000 7feb5ffff640 1 --2- 172.21.15.45:0/3327450848 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb680d1d30 0x7feb681545e0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7feb500011f0 tx=0x7feb5000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:44.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.178+0000 7feb5f7fe640 1 -- 172.21.15.45:0/3327450848 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb500074e0 con 0x7feb680d1d30 2023-11-28T18:43:44.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.178+0000 7feb5f7fe640 1 -- 172.21.15.45:0/3327450848 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb50007640 con 0x7feb680d1d30 2023-11-28T18:43:44.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.178+0000 7feb5f7fe640 1 -- 172.21.15.45:0/3327450848 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb50004a10 con 0x7feb680d1d30 2023-11-28T18:43:44.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.178+0000 7feb6d372640 1 -- 172.21.15.45:0/3327450848 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb68155690 con 0x7feb680d1d30 2023-11-28T18:43:44.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.178+0000 7feb6d372640 1 -- 172.21.15.45:0/3327450848 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb68155c50 con 0x7feb680d1d30 2023-11-28T18:43:44.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.178+0000 7feb6d372640 1 -- 172.21.15.45:0/3327450848 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb68067a30 con 0x7feb680d1d30 2023-11-28T18:43:44.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.178+0000 7feb5f7fe640 1 -- 172.21.15.45:0/3327450848 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7feb50004b70 con 0x7feb680d1d30 2023-11-28T18:43:44.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.178+0000 7feb5f7fe640 1 --2- 172.21.15.45:0/3327450848 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7feb480668d0 0x7feb48068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:44.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.178+0000 7feb5f7fe640 1 -- 172.21.15.45:0/3327450848 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x7feb500837a0 con 0x7feb680d1d30 2023-11-28T18:43:44.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.178+0000 7feb66ffd640 1 --2- 172.21.15.45:0/3327450848 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7feb480668d0 0x7feb48068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:44.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.182+0000 7feb66ffd640 1 --2- 172.21.15.45:0/3327450848 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7feb480668d0 0x7feb48068d90 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7feb58009b10 tx=0x7feb58008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:44.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.182+0000 7feb5f7fe640 1 -- 172.21.15.45:0/3327450848 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7feb50050940 con 0x7feb680d1d30 2023-11-28T18:43:44.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.342+0000 7feb6d372640 1 -- 172.21.15.45:0/3327450848 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7feb68069410 con 0x7feb680d1d30 2023-11-28T18:43:44.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.342+0000 7feb5f7fe640 1 -- 172.21.15.45:0/3327450848 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v49) v1 ==== 104+0+11 (secure 0 0 0) 0x7feb50018020 con 0x7feb680d1d30 2023-11-28T18:43:44.347 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-11-28T18:43:44.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.342+0000 7feb6d372640 1 -- 172.21.15.45:0/3327450848 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7feb480668d0 msgr2=0x7feb48068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:44.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.342+0000 7feb6d372640 1 --2- 172.21.15.45:0/3327450848 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7feb480668d0 0x7feb48068d90 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7feb58009b10 tx=0x7feb58008040 comp rx=0 tx=0).stop 2023-11-28T18:43:44.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.342+0000 7feb6d372640 1 -- 172.21.15.45:0/3327450848 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb680d1d30 msgr2=0x7feb681545e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:44.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.342+0000 7feb6d372640 1 --2- 172.21.15.45:0/3327450848 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb680d1d30 0x7feb681545e0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7feb500011f0 tx=0x7feb5000c9b0 comp rx=0 tx=0).stop 2023-11-28T18:43:44.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.342+0000 7feb6d372640 1 -- 172.21.15.45:0/3327450848 shutdown_connections 2023-11-28T18:43:44.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.342+0000 7feb6d372640 1 --2- 172.21.15.45:0/3327450848 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7feb480668d0 0x7feb48068d90 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:44.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.342+0000 7feb6d372640 1 --2- 172.21.15.45:0/3327450848 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feb6815d2f0 0x7feb68159150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:44.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.342+0000 7feb6d372640 1 --2- 172.21.15.45:0/3327450848 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb680d1d30 0x7feb681545e0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:44.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.342+0000 7feb6d372640 1 --2- 172.21.15.45:0/3327450848 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feb680d0330 0x7feb6806bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:44.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.342+0000 7feb6d372640 1 -- 172.21.15.45:0/3327450848 >> 172.21.15.45:0/3327450848 conn(0x7feb6809c550 msgr2=0x7feb680ce5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:43:44.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.342+0000 7feb6d372640 1 -- 172.21.15.45:0/3327450848 shutdown_connections 2023-11-28T18:43:44.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.342+0000 7feb6d372640 1 -- 172.21.15.45:0/3327450848 wait complete. 2023-11-28T18:43:44.368 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T18:43:44.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.510+0000 7fcca3aad640 1 Processor -- start 2023-11-28T18:43:44.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.510+0000 7fcca3aad640 1 -- start start 2023-11-28T18:43:44.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.510+0000 7fcca3aad640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcc9c158ce0 0x7fcc9c15eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:44.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.510+0000 7fcca3aad640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fcc9c0b4310 0x7fcc9c0b4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:44.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.510+0000 7fcca3aad640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc9c0b4ca0 con 0x7fcc9c0cba50 2023-11-28T18:43:44.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.510+0000 7fcca3aad640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc9c15b6b0 con 0x7fcc9c158ce0 2023-11-28T18:43:44.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.510+0000 7fcca3aad640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc9c15c550 con 0x7fcc9c0b4310 2023-11-28T18:43:44.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.514+0000 7fcca1849640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcc9c158ce0 0x7fcc9c15eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:44.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.514+0000 7fcca1849640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcc9c158ce0 0x7fcc9c15eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38338/0 (socket says 172.21.15.45:38338) 2023-11-28T18:43:44.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.514+0000 7fcca1849640 1 -- 172.21.15.45:0/4098507987 learned_addr learned my addr 172.21.15.45:0/4098507987 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:43:44.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.514+0000 7fcca204a640 1 --2- 172.21.15.45:0/4098507987 >> v2:172.21.15.190:3300/0 conn(0x7fcc9c0b4310 0x7fcc9c0b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:44.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.514+0000 7fcca1849640 1 -- 172.21.15.45:0/4098507987 >> v2:172.21.15.190:3300/0 conn(0x7fcc9c0b4310 msgr2=0x7fcc9c0b4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:43:44.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.514+0000 7fcca1849640 1 --2- 172.21.15.45:0/4098507987 >> v2:172.21.15.190:3300/0 conn(0x7fcc9c0b4310 0x7fcc9c0b4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:44.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.514+0000 7fcca1849640 1 -- 172.21.15.45:0/4098507987 >> v1:172.21.15.190:6789/0 conn(0x7fcc9c0cba50 legacy=0x7fcc9c15be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:43:44.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.514+0000 7fcca1849640 1 -- 172.21.15.45:0/4098507987 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc9c15f450 con 0x7fcc9c158ce0 2023-11-28T18:43:44.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.514+0000 7fcca1849640 1 --2- 172.21.15.45:0/4098507987 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc9c158ce0 0x7fcc9c15eb90 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c0cb9b0 tx=0x7fcc9801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85a71605a29382ba server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:44.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.514+0000 7fcca0847640 1 -- 172.21.15.45:0/4098507987 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc980aa5f0 con 0x7fcc9c158ce0 2023-11-28T18:43:44.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.514+0000 7fcca0847640 1 -- 172.21.15.45:0/4098507987 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc980aa750 con 0x7fcc9c158ce0 2023-11-28T18:43:44.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.514+0000 7fcca0847640 1 -- 172.21.15.45:0/4098507987 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc980aaae0 con 0x7fcc9c158ce0 2023-11-28T18:43:44.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.518+0000 7fcca3aad640 1 -- 172.21.15.45:0/4098507987 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc9c158ce0 msgr2=0x7fcc9c15eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:44.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.518+0000 7fcca3aad640 1 --2- 172.21.15.45:0/4098507987 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc9c158ce0 0x7fcc9c15eb90 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c0cb9b0 tx=0x7fcc9801c490 comp rx=0 tx=0).stop 2023-11-28T18:43:44.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.518+0000 7fcca3aad640 1 -- 172.21.15.45:0/4098507987 shutdown_connections 2023-11-28T18:43:44.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.518+0000 7fcca3aad640 1 --2- 172.21.15.45:0/4098507987 >> v2:172.21.15.190:3300/0 conn(0x7fcc9c0b4310 0x7fcc9c0b4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:44.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.518+0000 7fcca3aad640 1 --2- 172.21.15.45:0/4098507987 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc9c158ce0 0x7fcc9c15eb90 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:44.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.518+0000 7fcca3aad640 1 -- 172.21.15.45:0/4098507987 >> 172.21.15.45:0/4098507987 conn(0x7fcc9c0b0d00 msgr2=0x7fcc9c0b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:43:44.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.518+0000 7fcca3aad640 1 -- 172.21.15.45:0/4098507987 shutdown_connections 2023-11-28T18:43:44.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.518+0000 7fcca3aad640 1 -- 172.21.15.45:0/4098507987 wait complete. 2023-11-28T18:43:44.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.518+0000 7fcca3aad640 1 Processor -- start 2023-11-28T18:43:44.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.518+0000 7fcca3aad640 1 -- start start 2023-11-28T18:43:44.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.518+0000 7fcca3aad640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc9c0b4310 0x7fcc9c144200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:44.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.518+0000 7fcca3aad640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcc9c0cba50 0x7fcc9c0b3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:44.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.518+0000 7fcca3aad640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcc9c158ce0 0x7fcc9c0b2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:44.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.518+0000 7fcca3aad640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc9c15d970 con 0x7fcc9c0b4310 2023-11-28T18:43:44.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.518+0000 7fcca3aad640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc9c0b3680 con 0x7fcc9c158ce0 2023-11-28T18:43:44.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.518+0000 7fcca3aad640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc9c0b2a70 con 0x7fcc9c0cba50 2023-11-28T18:43:44.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.518+0000 7fcca1849640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc9c0b4310 0x7fcc9c144200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:44.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.518+0000 7fcca1849640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc9c0b4310 0x7fcc9c144200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38352/0 (socket says 172.21.15.45:38352) 2023-11-28T18:43:44.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.518+0000 7fcca1849640 1 -- 172.21.15.45:0/2080456800 learned_addr learned my addr 172.21.15.45:0/2080456800 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:43:44.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.518+0000 7fcca1849640 1 -- 172.21.15.45:0/2080456800 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcc9c0cba50 msgr2=0x7fcc9c0b3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:44.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.518+0000 7fcca1849640 1 --2- 172.21.15.45:0/2080456800 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcc9c0cba50 0x7fcc9c0b3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:44.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.518+0000 7fcca1849640 1 -- 172.21.15.45:0/2080456800 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcc9c158ce0 msgr2=0x7fcc9c0b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:44.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.518+0000 7fcca1849640 1 --2- 172.21.15.45:0/2080456800 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcc9c158ce0 0x7fcc9c0b2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:44.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.518+0000 7fcca1849640 1 -- 172.21.15.45:0/2080456800 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc980094d0 con 0x7fcc9c0b4310 2023-11-28T18:43:44.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.522+0000 7fcca1849640 1 --2- 172.21.15.45:0/2080456800 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc9c0b4310 0x7fcc9c144200 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fcc9801a0c0 tx=0x7fcc9801acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:44.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.522+0000 7fcc927fc640 1 -- 172.21.15.45:0/2080456800 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc980aa5f0 con 0x7fcc9c0b4310 2023-11-28T18:43:44.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.522+0000 7fcc927fc640 1 -- 172.21.15.45:0/2080456800 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc980b3800 con 0x7fcc9c0b4310 2023-11-28T18:43:44.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.522+0000 7fcc927fc640 1 -- 172.21.15.45:0/2080456800 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc980b3b90 con 0x7fcc9c0b4310 2023-11-28T18:43:44.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.522+0000 7fcca3aad640 1 -- 172.21.15.45:0/2080456800 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc9c0b2d50 con 0x7fcc9c0b4310 2023-11-28T18:43:44.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.522+0000 7fcca3aad640 1 -- 172.21.15.45:0/2080456800 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc9c0b3310 con 0x7fcc9c0b4310 2023-11-28T18:43:44.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.522+0000 7fcca3aad640 1 -- 172.21.15.45:0/2080456800 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc9c15f050 con 0x7fcc9c0b4310 2023-11-28T18:43:44.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.522+0000 7fcc927fc640 1 -- 172.21.15.45:0/2080456800 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fcc980b3cf0 con 0x7fcc9c0b4310 2023-11-28T18:43:44.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.522+0000 7fcc927fc640 1 --2- 172.21.15.45:0/2080456800 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fcc80066900 0x7fcc80068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:44.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.522+0000 7fcc927fc640 1 -- 172.21.15.45:0/2080456800 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fcc980a7070 con 0x7fcc9c0b4310 2023-11-28T18:43:44.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.522+0000 7fcca1048640 1 --2- 172.21.15.45:0/2080456800 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fcc80066900 0x7fcc80068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:44.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.526+0000 7fcca1048640 1 --2- 172.21.15.45:0/2080456800 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fcc80066900 0x7fcc80068dc0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c14da10 tx=0x7fcc8c0079c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:44.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.526+0000 7fcc927fc640 1 -- 172.21.15.45:0/2080456800 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcc980ebdc0 con 0x7fcc9c0b4310 2023-11-28T18:43:44.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.682+0000 7fcca3aad640 1 -- 172.21.15.45:0/2080456800 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcc9c0b4ca0 con 0x7fcc9c0b4310 2023-11-28T18:43:44.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.682+0000 7fcc927fc640 1 -- 172.21.15.45:0/2080456800 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v49) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcc9c0b4ca0 con 0x7fcc9c0b4310 2023-11-28T18:43:44.688 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-11-28T18:43:44.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.686+0000 7fcca3aad640 1 -- 172.21.15.45:0/2080456800 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fcc80066900 msgr2=0x7fcc80068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:44.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.686+0000 7fcca3aad640 1 --2- 172.21.15.45:0/2080456800 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fcc80066900 0x7fcc80068dc0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c14da10 tx=0x7fcc8c0079c0 comp rx=0 tx=0).stop 2023-11-28T18:43:44.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.686+0000 7fcca3aad640 1 -- 172.21.15.45:0/2080456800 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc9c0b4310 msgr2=0x7fcc9c144200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:44.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.686+0000 7fcca3aad640 1 --2- 172.21.15.45:0/2080456800 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc9c0b4310 0x7fcc9c144200 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fcc9801a0c0 tx=0x7fcc9801acd0 comp rx=0 tx=0).stop 2023-11-28T18:43:44.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.686+0000 7fcca3aad640 1 -- 172.21.15.45:0/2080456800 shutdown_connections 2023-11-28T18:43:44.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.686+0000 7fcca3aad640 1 --2- 172.21.15.45:0/2080456800 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fcc80066900 0x7fcc80068dc0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:44.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.686+0000 7fcca3aad640 1 --2- 172.21.15.45:0/2080456800 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcc9c158ce0 0x7fcc9c0b2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:44.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.686+0000 7fcca3aad640 1 --2- 172.21.15.45:0/2080456800 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcc9c0cba50 0x7fcc9c0b3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:44.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.686+0000 7fcca3aad640 1 --2- 172.21.15.45:0/2080456800 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc9c0b4310 0x7fcc9c144200 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:44.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.686+0000 7fcca3aad640 1 -- 172.21.15.45:0/2080456800 >> 172.21.15.45:0/2080456800 conn(0x7fcc9c0b0d00 msgr2=0x7fcc9c159350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:43:44.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.686+0000 7fcca3aad640 1 -- 172.21.15.45:0/2080456800 shutdown_connections 2023-11-28T18:43:44.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.686+0000 7fcca3aad640 1 -- 172.21.15.45:0/2080456800 wait complete. 2023-11-28T18:43:44.709 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T18:43:44.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.846+0000 7f97236c9640 1 Processor -- start 2023-11-28T18:43:44.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.846+0000 7f97236c9640 1 -- start start 2023-11-28T18:43:44.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.850+0000 7f97236c9640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f971c06dc40 0x7f971c0cccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:44.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.850+0000 7f97236c9640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f971c13d820 con 0x7f971c159e90 2023-11-28T18:43:44.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.850+0000 7f97236c9640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f971c0715b0 con 0x7f971c0cd1f0 2023-11-28T18:43:44.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.850+0000 7f97236c9640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f971c0cd630 con 0x7f971c06dc40 2023-11-28T18:43:44.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.850+0000 7f9721465640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f971c159e90 0x7f971c06d530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47642/0 (socket says 172.21.15.45:47642) 2023-11-28T18:43:44.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.850+0000 7f9721465640 1 -- 172.21.15.45:0/2301823775 learned_addr learned my addr 172.21.15.45:0/2301823775 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:43:44.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.850+0000 7f9720c64640 1 --2- 172.21.15.45:0/2301823775 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f971c06dc40 0x7f971c0cccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:44.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.850+0000 7f9713fff640 1 -- 172.21.15.45:0/2301823775 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2242854850 0 0) 0x7f971c13d820 con 0x7f971c159e90 2023-11-28T18:43:44.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.850+0000 7f9713fff640 1 -- 172.21.15.45:0/2301823775 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9708003530 con 0x7f971c159e90 2023-11-28T18:43:44.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.850+0000 7f9713fff640 1 -- 172.21.15.45:0/2301823775 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1047016331 0 0) 0x7f9708003530 con 0x7f971c159e90 2023-11-28T18:43:44.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.850+0000 7f9713fff640 1 -- 172.21.15.45:0/2301823775 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f971c06dc40 msgr2=0x7f971c0cccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:43:44.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.850+0000 7f9713fff640 1 --2- 172.21.15.45:0/2301823775 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f971c06dc40 0x7f971c0cccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:44.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.850+0000 7f9713fff640 1 -- 172.21.15.45:0/2301823775 >> v1:172.21.15.190:6789/0 conn(0x7f971c0cd1f0 legacy=0x7f971c0ced00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:44.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.850+0000 7f9713fff640 1 -- 172.21.15.45:0/2301823775 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f971c071850 con 0x7f971c159e90 2023-11-28T18:43:44.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.850+0000 7f9713fff640 1 -- 172.21.15.45:0/2301823775 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4084481567 0 0) 0x7f9718001680 con 0x7f971c159e90 2023-11-28T18:43:44.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.850+0000 7f9713fff640 1 -- 172.21.15.45:0/2301823775 >> v1:172.21.15.45:6789/0 conn(0x7f971c159e90 legacy=0x7f971c06d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:44.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.850+0000 7f9713fff640 1 --2- 172.21.15.45:0/2301823775 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f971c06dc40 0x7f97080039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:44.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.850+0000 7f9713fff640 1 --2- 172.21.15.45:0/2301823775 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9708003f30 0x7f97080047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:44.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.850+0000 7f9713fff640 1 --2- 172.21.15.45:0/2301823775 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9708004d10 0x7f9708005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:44.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.850+0000 7f9713fff640 1 -- 172.21.15.45:0/2301823775 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f971c0cd630 con 0x7f9708003f30 2023-11-28T18:43:44.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.850+0000 7f9713fff640 1 -- 172.21.15.45:0/2301823775 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f970800dc80 con 0x7f9708004d10 2023-11-28T18:43:44.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.850+0000 7f9713fff640 1 -- 172.21.15.45:0/2301823775 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f970800de40 con 0x7f971c06dc40 2023-11-28T18:43:44.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.850+0000 7f9720c64640 1 --2- 172.21.15.45:0/2301823775 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9708003f30 0x7f97080047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:44.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.850+0000 7f9721465640 1 --2- 172.21.15.45:0/2301823775 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f971c06dc40 0x7f97080039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:44.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.850+0000 7f9721c66640 1 --2- 172.21.15.45:0/2301823775 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9708004d10 0x7f9708005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:44.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.850+0000 7f9720c64640 1 -- 172.21.15.45:0/2301823775 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f971c06dc40 msgr2=0x7f97080039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:43:44.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.850+0000 7f9720c64640 1 --2- 172.21.15.45:0/2301823775 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f971c06dc40 0x7f97080039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:44.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.850+0000 7f9720c64640 1 -- 172.21.15.45:0/2301823775 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9708004d10 msgr2=0x7f9708005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:43:44.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.850+0000 7f9720c64640 1 --2- 172.21.15.45:0/2301823775 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9708004d10 0x7f9708005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:44.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.850+0000 7f9720c64640 1 -- 172.21.15.45:0/2301823775 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9708003530 con 0x7f9708003f30 2023-11-28T18:43:44.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.854+0000 7f9720c64640 1 --2- 172.21.15.45:0/2301823775 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9708003f30 0x7f97080047d0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f970c009ae0 tx=0x7f970c01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=541dee2321841bff server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:44.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.854+0000 7f9713fff640 1 -- 172.21.15.45:0/2301823775 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f970c0a5540 con 0x7f9708003f30 2023-11-28T18:43:44.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.854+0000 7f9713fff640 1 -- 172.21.15.45:0/2301823775 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f970c0a56a0 con 0x7f9708003f30 2023-11-28T18:43:44.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.854+0000 7f9713fff640 1 -- 172.21.15.45:0/2301823775 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f970c0a5a50 con 0x7f9708003f30 2023-11-28T18:43:44.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.854+0000 7f97236c9640 1 -- 172.21.15.45:0/2301823775 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9708003f30 msgr2=0x7f97080047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:44.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.854+0000 7f97236c9640 1 --2- 172.21.15.45:0/2301823775 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9708003f30 0x7f97080047d0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f970c009ae0 tx=0x7f970c01ca50 comp rx=0 tx=0).stop 2023-11-28T18:43:44.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.854+0000 7f9721c66640 1 -- 172.21.15.45:0/2301823775 reap_dead start 2023-11-28T18:43:44.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.854+0000 7f97236c9640 1 -- 172.21.15.45:0/2301823775 shutdown_connections 2023-11-28T18:43:44.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.854+0000 7f97236c9640 1 -- 172.21.15.45:0/2301823775 >> 172.21.15.45:0/2301823775 conn(0x7f971c06b680 msgr2=0x7f971c06ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:43:44.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.854+0000 7f97236c9640 1 -- 172.21.15.45:0/2301823775 shutdown_connections 2023-11-28T18:43:44.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.854+0000 7f97236c9640 1 -- 172.21.15.45:0/2301823775 wait complete. 2023-11-28T18:43:44.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.858+0000 7f97236c9640 1 Processor -- start 2023-11-28T18:43:44.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.858+0000 7f97236c9640 1 -- start start 2023-11-28T18:43:44.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.858+0000 7f97236c9640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9708003f30 0x7f971c1ee100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:44.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.858+0000 7f97236c9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f971c1403e0 0x7f971c142690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:44.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.858+0000 7f97236c9640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f971c13e5a0 0x7f971c13ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:44.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.858+0000 7f97236c9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f971c13ef90 con 0x7f971c1403e0 2023-11-28T18:43:44.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.858+0000 7f97236c9640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f971c143270 con 0x7f971c13e5a0 2023-11-28T18:43:44.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.858+0000 7f97236c9640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f971c0b05f0 con 0x7f9708003f30 2023-11-28T18:43:44.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.858+0000 7f9720c64640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f971c1403e0 0x7f971c142690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:44.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.858+0000 7f9720c64640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f971c1403e0 0x7f971c142690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38370/0 (socket says 172.21.15.45:38370) 2023-11-28T18:43:44.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.858+0000 7f9721465640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9708003f30 0x7f971c1ee100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:44.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.858+0000 7f9720c64640 1 -- 172.21.15.45:0/3508670509 learned_addr learned my addr 172.21.15.45:0/3508670509 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:43:44.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.858+0000 7f9721c66640 1 --2- 172.21.15.45:0/3508670509 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f971c13e5a0 0x7f971c13ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:44.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.858+0000 7f9720c64640 1 -- 172.21.15.45:0/3508670509 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9708003f30 msgr2=0x7f971c1ee100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:44.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.858+0000 7f9720c64640 1 --2- 172.21.15.45:0/3508670509 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9708003f30 0x7f971c1ee100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:44.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.858+0000 7f9720c64640 1 -- 172.21.15.45:0/3508670509 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f971c13e5a0 msgr2=0x7f971c13ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:44.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.858+0000 7f9720c64640 1 --2- 172.21.15.45:0/3508670509 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f971c13e5a0 0x7f971c13ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:44.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.858+0000 7f9720c64640 1 -- 172.21.15.45:0/3508670509 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f971c142f90 con 0x7f971c1403e0 2023-11-28T18:43:44.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.858+0000 7f9720c64640 1 --2- 172.21.15.45:0/3508670509 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f971c1403e0 0x7f971c142690 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f970c01c880 tx=0x7f9708005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:44.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.858+0000 7f9711ffb640 1 -- 172.21.15.45:0/3508670509 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f970c0a5540 con 0x7f971c1403e0 2023-11-28T18:43:44.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.858+0000 7f9711ffb640 1 -- 172.21.15.45:0/3508670509 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f970c004220 con 0x7f971c1403e0 2023-11-28T18:43:44.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.858+0000 7f9711ffb640 1 -- 172.21.15.45:0/3508670509 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f970c0059a0 con 0x7f971c1403e0 2023-11-28T18:43:44.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.858+0000 7f97236c9640 1 -- 172.21.15.45:0/3508670509 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f971c0affa0 con 0x7f971c1403e0 2023-11-28T18:43:44.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.858+0000 7f97236c9640 1 -- 172.21.15.45:0/3508670509 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f971c142bd0 con 0x7f971c1403e0 2023-11-28T18:43:44.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.862+0000 7f97236c9640 1 -- 172.21.15.45:0/3508670509 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f971c0afe00 con 0x7f971c1403e0 2023-11-28T18:43:44.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.862+0000 7f9711ffb640 1 -- 172.21.15.45:0/3508670509 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f970c0b4040 con 0x7f971c1403e0 2023-11-28T18:43:44.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.862+0000 7f9711ffb640 1 --2- 172.21.15.45:0/3508670509 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9700066900 0x7f9700068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:44.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.862+0000 7f9711ffb640 1 -- 172.21.15.45:0/3508670509 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f970c11dad0 con 0x7f971c1403e0 2023-11-28T18:43:44.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.862+0000 7f9721465640 1 --2- 172.21.15.45:0/3508670509 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9700066900 0x7f9700068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:44.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.862+0000 7f9721465640 1 --2- 172.21.15.45:0/3508670509 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9700066900 0x7f9700068dc0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f97180017b0 tx=0x7f97180015a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:44.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:44.866+0000 7f9711ffb640 1 -- 172.21.15.45:0/3508670509 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f971c0afe00 con 0x7f971c1403e0 2023-11-28T18:43:45.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.058+0000 7f97236c9640 1 -- 172.21.15.45:0/3508670509 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f971c0afe00 con 0x7f971c1403e0 2023-11-28T18:43:45.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.058+0000 7f9711ffb640 1 -- 172.21.15.45:0/3508670509 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4912 (secure 0 0 0) 0x7f971c0afe00 con 0x7f971c1403e0 2023-11-28T18:43:45.063 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:43:45.063 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":39,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5414,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/114066704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":114066704},{"type":"v1","addr":"172.21.15.190:6836","nonce":114066704}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5417,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/27225494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":27225494},{"type":"v1","addr":"172.21.15.190:6837","nonce":27225494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5973,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1061201705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":1061201705},{"type":"v1","addr":"172.21.15.45:6835","nonce":1061201705}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T18:39:36.424552+0000","modified":"2023-11-28T18:42:27.227565+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":49,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6207},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6207":{"gid":6207,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":22,"addr":"172.21.15.45:6834/2228986336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2228986336},{"type":"v1","addr":"172.21.15.45:6834","nonce":2228986336}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-28T18:43:45.063 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 39 2023-11-28T18:43:45.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.062+0000 7f97236c9640 1 -- 172.21.15.45:0/3508670509 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9700066900 msgr2=0x7f9700068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:45.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.062+0000 7f97236c9640 1 --2- 172.21.15.45:0/3508670509 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9700066900 0x7f9700068dc0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f97180017b0 tx=0x7f97180015a0 comp rx=0 tx=0).stop 2023-11-28T18:43:45.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.062+0000 7f97236c9640 1 -- 172.21.15.45:0/3508670509 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f971c1403e0 msgr2=0x7f971c142690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:45.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.062+0000 7f97236c9640 1 --2- 172.21.15.45:0/3508670509 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f971c1403e0 0x7f971c142690 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f970c01c880 tx=0x7f9708005800 comp rx=0 tx=0).stop 2023-11-28T18:43:45.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.062+0000 7f97236c9640 1 -- 172.21.15.45:0/3508670509 shutdown_connections 2023-11-28T18:43:45.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.062+0000 7f97236c9640 1 --2- 172.21.15.45:0/3508670509 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9700066900 0x7f9700068dc0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:45.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.062+0000 7f97236c9640 1 --2- 172.21.15.45:0/3508670509 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f971c13e5a0 0x7f971c13ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:45.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.062+0000 7f97236c9640 1 --2- 172.21.15.45:0/3508670509 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f971c1403e0 0x7f971c142690 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:45.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.062+0000 7f97236c9640 1 --2- 172.21.15.45:0/3508670509 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9708003f30 0x7f971c1ee100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:45.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.062+0000 7f97236c9640 1 -- 172.21.15.45:0/3508670509 >> 172.21.15.45:0/3508670509 conn(0x7f971c06b680 msgr2=0x7f971c0cc310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:43:45.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.062+0000 7f97236c9640 1 -- 172.21.15.45:0/3508670509 shutdown_connections 2023-11-28T18:43:45.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.062+0000 7f97236c9640 1 -- 172.21.15.45:0/3508670509 wait complete. 2023-11-28T18:43:45.085 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T18:43:45.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.226+0000 7fb671609640 1 Processor -- start 2023-11-28T18:43:45.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.226+0000 7fb671609640 1 -- start start 2023-11-28T18:43:45.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.226+0000 7fb671609640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fb66c15d360 0x7fb66c0d1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:45.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.226+0000 7fb671609640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb66c0b0fd0 0x7fb66c0d1980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:45.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.226+0000 7fb671609640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb66c0afb30 con 0x7fb66c0b1fa0 2023-11-28T18:43:45.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.226+0000 7fb671609640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb66c0ce940 con 0x7fb66c15d360 2023-11-28T18:43:45.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.226+0000 7fb671609640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb66c0cec00 con 0x7fb66c0b0fd0 2023-11-28T18:43:45.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.226+0000 7fb66affd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fb66c15d360 0x7fb66c0d1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:45.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.226+0000 7fb66b7fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb66c0b0fd0 0x7fb66c0d1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:45.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.226+0000 7fb66b7fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb66c0b0fd0 0x7fb66c0d1980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.45:44588/0 (socket says 172.21.15.45:44588) 2023-11-28T18:43:45.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.226+0000 7fb66affd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fb66c15d360 0x7fb66c0d1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.45:52064/0 (socket says 172.21.15.45:52064) 2023-11-28T18:43:45.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.226+0000 7fb66a7fc640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fb66c0b1fa0 0x7fb66c0cf740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.45:58336/0 (socket says 172.21.15.45:58336) 2023-11-28T18:43:45.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.226+0000 7fb66b7fe640 1 -- 172.21.15.45:0/11722960 learned_addr learned my addr 172.21.15.45:0/11722960 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:43:45.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.226+0000 7fb66b7fe640 1 -- 172.21.15.45:0/11722960 >> v2:172.21.15.190:3300/0 conn(0x7fb66c15d360 msgr2=0x7fb66c0d1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:43:45.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.226+0000 7fb66b7fe640 1 --2- 172.21.15.45:0/11722960 >> v2:172.21.15.190:3300/0 conn(0x7fb66c15d360 0x7fb66c0d1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:45.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.226+0000 7fb66b7fe640 1 -- 172.21.15.45:0/11722960 >> v1:172.21.15.190:6789/0 conn(0x7fb66c0b1fa0 legacy=0x7fb66c0cf740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:45.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.226+0000 7fb66b7fe640 1 -- 172.21.15.45:0/11722960 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb66c0ceee0 con 0x7fb66c0b0fd0 2023-11-28T18:43:45.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.230+0000 7fb66b7fe640 1 --2- 172.21.15.45:0/11722960 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb66c0b0fd0 0x7fb66c0d1980 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb664009e50 tx=0x7fb66401c980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72f58c6161d236d9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:45.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.230+0000 7fb669ffb640 1 -- 172.21.15.45:0/11722960 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6640a5750 con 0x7fb66c0b0fd0 2023-11-28T18:43:45.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.230+0000 7fb669ffb640 1 -- 172.21.15.45:0/11722960 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6640a58b0 con 0x7fb66c0b0fd0 2023-11-28T18:43:45.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.230+0000 7fb669ffb640 1 -- 172.21.15.45:0/11722960 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6640a5c40 con 0x7fb66c0b0fd0 2023-11-28T18:43:45.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.230+0000 7fb671609640 1 -- 172.21.15.45:0/11722960 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb66c0b0fd0 msgr2=0x7fb66c0d1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:45.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.230+0000 7fb671609640 1 --2- 172.21.15.45:0/11722960 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb66c0b0fd0 0x7fb66c0d1980 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb664009e50 tx=0x7fb66401c980 comp rx=0 tx=0).stop 2023-11-28T18:43:45.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.230+0000 7fb671609640 1 -- 172.21.15.45:0/11722960 shutdown_connections 2023-11-28T18:43:45.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.230+0000 7fb671609640 1 --2- 172.21.15.45:0/11722960 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb66c0b0fd0 0x7fb66c0d1980 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:45.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.230+0000 7fb671609640 1 --2- 172.21.15.45:0/11722960 >> v2:172.21.15.190:3300/0 conn(0x7fb66c15d360 0x7fb66c0d1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:45.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.230+0000 7fb671609640 1 -- 172.21.15.45:0/11722960 >> 172.21.15.45:0/11722960 conn(0x7fb66c0d2f60 msgr2=0x7fb66c0d3370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:43:45.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.230+0000 7fb671609640 1 -- 172.21.15.45:0/11722960 shutdown_connections 2023-11-28T18:43:45.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.230+0000 7fb671609640 1 -- 172.21.15.45:0/11722960 wait complete. 2023-11-28T18:43:45.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.230+0000 7fb671609640 1 Processor -- start 2023-11-28T18:43:45.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.234+0000 7fb671609640 1 -- start start 2023-11-28T18:43:45.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.234+0000 7fb671609640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb66c0b0fd0 0x7fb66c154400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:45.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.234+0000 7fb671609640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb66c0b1fa0 0x7fb66c15b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:45.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.234+0000 7fb671609640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb66c15d360 0x7fb66c15b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:45.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.234+0000 7fb671609640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb66c156750 con 0x7fb66c0b1fa0 2023-11-28T18:43:45.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.234+0000 7fb671609640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb66c15c080 con 0x7fb66c15d360 2023-11-28T18:43:45.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.234+0000 7fb671609640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb66c15c360 con 0x7fb66c0b0fd0 2023-11-28T18:43:45.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.234+0000 7fb66a7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb66c0b1fa0 0x7fb66c15b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:45.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.234+0000 7fb66a7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb66c0b1fa0 0x7fb66c15b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38382/0 (socket says 172.21.15.45:38382) 2023-11-28T18:43:45.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.234+0000 7fb66a7fc640 1 -- 172.21.15.45:0/836240827 learned_addr learned my addr 172.21.15.45:0/836240827 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:43:45.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.234+0000 7fb66b7fe640 1 --2- 172.21.15.45:0/836240827 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb66c15d360 0x7fb66c15b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:45.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.234+0000 7fb66affd640 1 --2- 172.21.15.45:0/836240827 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb66c0b0fd0 0x7fb66c154400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:45.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.234+0000 7fb66a7fc640 1 -- 172.21.15.45:0/836240827 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb66c0b0fd0 msgr2=0x7fb66c154400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:45.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.234+0000 7fb66a7fc640 1 --2- 172.21.15.45:0/836240827 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb66c0b0fd0 0x7fb66c154400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:45.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.234+0000 7fb66a7fc640 1 -- 172.21.15.45:0/836240827 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb66c15d360 msgr2=0x7fb66c15b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:45.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.234+0000 7fb66a7fc640 1 --2- 172.21.15.45:0/836240827 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb66c15d360 0x7fb66c15b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:45.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.234+0000 7fb66a7fc640 1 -- 172.21.15.45:0/836240827 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb664009b30 con 0x7fb66c0b1fa0 2023-11-28T18:43:45.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.234+0000 7fb66a7fc640 1 --2- 172.21.15.45:0/836240827 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb66c0b1fa0 0x7fb66c15b240 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fb66000c490 tx=0x7fb66000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:45.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.234+0000 7fb6537fe640 1 -- 172.21.15.45:0/836240827 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb660007480 con 0x7fb66c0b1fa0 2023-11-28T18:43:45.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.234+0000 7fb6537fe640 1 -- 172.21.15.45:0/836240827 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6600075e0 con 0x7fb66c0b1fa0 2023-11-28T18:43:45.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.234+0000 7fb6537fe640 1 -- 172.21.15.45:0/836240827 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb660004a10 con 0x7fb66c0b1fa0 2023-11-28T18:43:45.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.234+0000 7fb671609640 1 -- 172.21.15.45:0/836240827 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb66c0a0600 con 0x7fb66c0b1fa0 2023-11-28T18:43:45.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.234+0000 7fb671609640 1 -- 172.21.15.45:0/836240827 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb66c0a0bc0 con 0x7fb66c0b1fa0 2023-11-28T18:43:45.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.234+0000 7fb671609640 1 -- 172.21.15.45:0/836240827 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb66c069410 con 0x7fb66c0b1fa0 2023-11-28T18:43:45.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.238+0000 7fb6537fe640 1 -- 172.21.15.45:0/836240827 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fb660004b70 con 0x7fb66c0b1fa0 2023-11-28T18:43:45.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.238+0000 7fb6537fe640 1 --2- 172.21.15.45:0/836240827 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fb6580668d0 0x7fb658068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:45.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.238+0000 7fb6537fe640 1 -- 172.21.15.45:0/836240827 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fb6600836b0 con 0x7fb66c0b1fa0 2023-11-28T18:43:45.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.238+0000 7fb66affd640 1 --2- 172.21.15.45:0/836240827 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fb6580668d0 0x7fb658068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:45.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.238+0000 7fb66affd640 1 --2- 172.21.15.45:0/836240827 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fb6580668d0 0x7fb658068d90 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fb65c009a50 tx=0x7fb65c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:45.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.242+0000 7fb6537fe640 1 -- 172.21.15.45:0/836240827 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb660050860 con 0x7fb66c0b1fa0 2023-11-28T18:43:45.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.402+0000 7fb671609640 1 -- 172.21.15.45:0/836240827 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb66c0cb2f0 con 0x7fb66c0b1fa0 2023-11-28T18:43:45.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.402+0000 7fb6537fe640 1 -- 172.21.15.45:0/836240827 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+16702 (secure 0 0 0) 0x7fb660053e80 con 0x7fb66c0b1fa0 2023-11-28T18:43:45.407 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:43:45.407 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":49,"fsid":"d10f5cd6-1d00-4019-99b6-6fa435498a15","created":"2023-11-28T18:37:08.189030+0000","modified":"2023-11-28T18:41:11.270317+0000","last_up_change":"2023-11-28T18:37:20.196124+0000","last_in_change":"2023-11-28T18:37:10.742043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T18:37:21.293917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-28T18:39:34.106789+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-28T18:39:35.426601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"84465384-103c-4f2c-a45a-96f5bb9c835f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6809","nonce":555237322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6811","nonce":555237322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6815","nonce":555237322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6813","nonce":555237322}]},"public_addr":"172.21.15.45:6809/555237322","cluster_addr":"172.21.15.45:6811/555237322","heartbeat_back_addr":"172.21.15.45:6815/555237322","heartbeat_front_addr":"172.21.15.45:6813/555237322","state":["exists","up"]},{"osd":1,"uuid":"7d9eed24-a58f-42c7-a787-ac06be8553fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6801","nonce":2857063763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6803","nonce":2857063763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6807","nonce":2857063763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6805","nonce":2857063763}]},"public_addr":"172.21.15.45:6801/2857063763","cluster_addr":"172.21.15.45:6803/2857063763","heartbeat_back_addr":"172.21.15.45:6807/2857063763","heartbeat_front_addr":"172.21.15.45:6805/2857063763","state":["exists","up"]},{"osd":2,"uuid":"575eeccc-4abf-45b4-9caf-f3e797859588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6817","nonce":193884539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6819","nonce":193884539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6823","nonce":193884539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6821","nonce":193884539}]},"public_addr":"172.21.15.45:6817/193884539","cluster_addr":"172.21.15.45:6819/193884539","heartbeat_back_addr":"172.21.15.45:6823/193884539","heartbeat_front_addr":"172.21.15.45:6821/193884539","state":["exists","up"]},{"osd":3,"uuid":"9b0290d6-9a52-4bc8-b2a1-7622c5dc8e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6825","nonce":78541084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6827","nonce":78541084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6831","nonce":78541084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6829","nonce":78541084}]},"public_addr":"172.21.15.45:6825/78541084","cluster_addr":"172.21.15.45:6827/78541084","heartbeat_back_addr":"172.21.15.45:6831/78541084","heartbeat_front_addr":"172.21.15.45:6829/78541084","state":["exists","up"]},{"osd":4,"uuid":"ce632829-f027-4fbf-a627-02c571aa9d53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6809","nonce":1537591987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6811","nonce":1537591987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6815","nonce":1537591987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6813","nonce":1537591987}]},"public_addr":"172.21.15.190:6809/1537591987","cluster_addr":"172.21.15.190:6811/1537591987","heartbeat_back_addr":"172.21.15.190:6815/1537591987","heartbeat_front_addr":"172.21.15.190:6813/1537591987","state":["exists","up"]},{"osd":5,"uuid":"8700b609-27be-40bd-a251-4c0ae0a29ead","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6801","nonce":3296698407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6803","nonce":3296698407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6807","nonce":3296698407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6805","nonce":3296698407}]},"public_addr":"172.21.15.190:6801/3296698407","cluster_addr":"172.21.15.190:6803/3296698407","heartbeat_back_addr":"172.21.15.190:6807/3296698407","heartbeat_front_addr":"172.21.15.190:6805/3296698407","state":["exists","up"]},{"osd":6,"uuid":"44ce4a40-e6ff-4f4d-8e8a-7341e5c91f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6817","nonce":2317686718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6819","nonce":2317686718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6823","nonce":2317686718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6821","nonce":2317686718}]},"public_addr":"172.21.15.190:6817/2317686718","cluster_addr":"172.21.15.190:6819/2317686718","heartbeat_back_addr":"172.21.15.190:6823/2317686718","heartbeat_front_addr":"172.21.15.190:6821/2317686718","state":["exists","up"]},{"osd":7,"uuid":"192238c9-1423-4b7e-ac8f-84ba32113ddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6825","nonce":2493232051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6827","nonce":2493232051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6831","nonce":2493232051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6829","nonce":2493232051}]},"public_addr":"172.21.15.190:6825/2493232051","cluster_addr":"172.21.15.190:6827/2493232051","heartbeat_back_addr":"172.21.15.190:6831/2493232051","heartbeat_front_addr":"172.21.15.190:6829/2493232051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.393552+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.385453+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.361421+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.366408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.363226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.276007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.414605+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.445885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.2d","mappings":[{"from":0,"to":4}]},{"pgid":"7.3e","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6834/2737877840":"2023-11-29T18:41:11.270289+0000","172.21.15.45:6832/2737877840":"2023-11-29T18:41:11.270289+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T18:43:45.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.402+0000 7fb671609640 1 -- 172.21.15.45:0/836240827 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fb6580668d0 msgr2=0x7fb658068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:45.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.402+0000 7fb671609640 1 --2- 172.21.15.45:0/836240827 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fb6580668d0 0x7fb658068d90 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fb65c009a50 tx=0x7fb65c008040 comp rx=0 tx=0).stop 2023-11-28T18:43:45.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.402+0000 7fb671609640 1 -- 172.21.15.45:0/836240827 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb66c0b1fa0 msgr2=0x7fb66c15b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:45.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.402+0000 7fb671609640 1 --2- 172.21.15.45:0/836240827 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb66c0b1fa0 0x7fb66c15b240 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fb66000c490 tx=0x7fb66000c950 comp rx=0 tx=0).stop 2023-11-28T18:43:45.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.402+0000 7fb671609640 1 -- 172.21.15.45:0/836240827 shutdown_connections 2023-11-28T18:43:45.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.402+0000 7fb671609640 1 --2- 172.21.15.45:0/836240827 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fb6580668d0 0x7fb658068d90 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:45.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.402+0000 7fb671609640 1 --2- 172.21.15.45:0/836240827 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb66c15d360 0x7fb66c15b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:45.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.402+0000 7fb671609640 1 --2- 172.21.15.45:0/836240827 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb66c0b1fa0 0x7fb66c15b240 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:45.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.402+0000 7fb671609640 1 --2- 172.21.15.45:0/836240827 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb66c0b0fd0 0x7fb66c154400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:45.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.402+0000 7fb671609640 1 -- 172.21.15.45:0/836240827 >> 172.21.15.45:0/836240827 conn(0x7fb66c0d2f60 msgr2=0x7fb66c06c820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:43:45.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.402+0000 7fb671609640 1 -- 172.21.15.45:0/836240827 shutdown_connections 2023-11-28T18:43:45.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.406+0000 7fb671609640 1 -- 172.21.15.45:0/836240827 wait complete. 2023-11-28T18:43:45.428 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-28T18:43:45.428 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T18:43:45.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.566+0000 7ff68472a640 1 Processor -- start 2023-11-28T18:43:45.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.566+0000 7ff68472a640 1 -- start start 2023-11-28T18:43:45.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.570+0000 7ff68472a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff67c0b35f0 0x7ff67c0d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:45.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.570+0000 7ff68472a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff67c0b3cb0 0x7ff67c15f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:45.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.570+0000 7ff68472a640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff67c0d38c0 con 0x7ff67c0cf7c0 2023-11-28T18:43:45.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.570+0000 7ff68472a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff67c0d40d0 con 0x7ff67c0b3cb0 2023-11-28T18:43:45.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.570+0000 7ff68472a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff67c0cdcc0 con 0x7ff67c0b35f0 2023-11-28T18:43:45.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.570+0000 7ff681cc5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff67c0b3cb0 0x7ff67c15f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:45.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.570+0000 7ff681cc5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff67c0b3cb0 0x7ff67c15f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38384/0 (socket says 172.21.15.45:38384) 2023-11-28T18:43:45.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.570+0000 7ff681cc5640 1 -- 172.21.15.45:0/2927637102 learned_addr learned my addr 172.21.15.45:0/2927637102 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:43:45.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.570+0000 7ff6824c6640 1 --2- 172.21.15.45:0/2927637102 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff67c0b35f0 0x7ff67c0d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:45.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.570+0000 7ff681cc5640 1 -- 172.21.15.45:0/2927637102 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff67c0b35f0 msgr2=0x7ff67c0d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:43:45.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.570+0000 7ff681cc5640 1 --2- 172.21.15.45:0/2927637102 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff67c0b35f0 0x7ff67c0d0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:45.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.570+0000 7ff681cc5640 1 -- 172.21.15.45:0/2927637102 >> v1:172.21.15.190:6789/0 conn(0x7ff67c0cf7c0 legacy=0x7ff67c0ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:43:45.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.570+0000 7ff681cc5640 1 -- 172.21.15.45:0/2927637102 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff67c0d3b10 con 0x7ff67c0b3cb0 2023-11-28T18:43:45.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.570+0000 7ff6824c6640 1 --2- 172.21.15.45:0/2927637102 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff67c0b35f0 0x7ff67c0d0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:43:45.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.574+0000 7ff681cc5640 1 --2- 172.21.15.45:0/2927637102 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff67c0b3cb0 0x7ff67c15f0a0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7ff66c009870 tx=0x7ff66c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68884074705ff2a5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:45.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.574+0000 7ff6814c4640 1 -- 172.21.15.45:0/2927637102 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff66c0aa620 con 0x7ff67c0b3cb0 2023-11-28T18:43:45.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.574+0000 7ff6814c4640 1 -- 172.21.15.45:0/2927637102 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff66c0aa780 con 0x7ff67c0b3cb0 2023-11-28T18:43:45.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.574+0000 7ff6814c4640 1 -- 172.21.15.45:0/2927637102 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff66c0aab10 con 0x7ff67c0b3cb0 2023-11-28T18:43:45.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.574+0000 7ff68472a640 1 -- 172.21.15.45:0/2927637102 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff67c0b3cb0 msgr2=0x7ff67c15f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:45.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.574+0000 7ff68472a640 1 --2- 172.21.15.45:0/2927637102 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff67c0b3cb0 0x7ff67c15f0a0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7ff66c009870 tx=0x7ff66c01c500 comp rx=0 tx=0).stop 2023-11-28T18:43:45.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.574+0000 7ff68472a640 1 -- 172.21.15.45:0/2927637102 shutdown_connections 2023-11-28T18:43:45.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.574+0000 7ff68472a640 1 --2- 172.21.15.45:0/2927637102 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff67c0b3cb0 0x7ff67c15f0a0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:45.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.574+0000 7ff68472a640 1 --2- 172.21.15.45:0/2927637102 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff67c0b35f0 0x7ff67c0d0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:45.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.574+0000 7ff68472a640 1 -- 172.21.15.45:0/2927637102 >> 172.21.15.45:0/2927637102 conn(0x7ff67c09c4f0 msgr2=0x7ff67c0d31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:43:45.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.574+0000 7ff68472a640 1 -- 172.21.15.45:0/2927637102 shutdown_connections 2023-11-28T18:43:45.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.574+0000 7ff68472a640 1 -- 172.21.15.45:0/2927637102 wait complete. 2023-11-28T18:43:45.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.574+0000 7ff68472a640 1 Processor -- start 2023-11-28T18:43:45.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.574+0000 7ff68472a640 1 -- start start 2023-11-28T18:43:45.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.578+0000 7ff68472a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff67c0b35f0 0x7ff67c0cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:45.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.578+0000 7ff68472a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff67c0b3cb0 0x7ff67c156b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:45.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.578+0000 7ff68472a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff67c0cf7c0 0x7ff67c09cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:45.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.578+0000 7ff68472a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff67c157090 con 0x7ff67c0b35f0 2023-11-28T18:43:45.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.578+0000 7ff68472a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff67c0ca800 con 0x7ff67c0cf7c0 2023-11-28T18:43:45.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.578+0000 7ff68472a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff67c09d4a0 con 0x7ff67c0b3cb0 2023-11-28T18:43:45.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.578+0000 7ff6824c6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff67c0b35f0 0x7ff67c0cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:45.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.578+0000 7ff6824c6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff67c0b35f0 0x7ff67c0cbc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38394/0 (socket says 172.21.15.45:38394) 2023-11-28T18:43:45.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.578+0000 7ff6824c6640 1 -- 172.21.15.45:0/2514252673 learned_addr learned my addr 172.21.15.45:0/2514252673 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:43:45.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.578+0000 7ff681cc5640 1 --2- 172.21.15.45:0/2514252673 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff67c0b3cb0 0x7ff67c156b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:45.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.578+0000 7ff682cc7640 1 --2- 172.21.15.45:0/2514252673 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff67c0cf7c0 0x7ff67c09cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:45.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.578+0000 7ff6824c6640 1 -- 172.21.15.45:0/2514252673 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff67c0b3cb0 msgr2=0x7ff67c156b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:45.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.578+0000 7ff6824c6640 1 --2- 172.21.15.45:0/2514252673 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff67c0b3cb0 0x7ff67c156b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:45.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.578+0000 7ff6824c6640 1 -- 172.21.15.45:0/2514252673 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff67c0cf7c0 msgr2=0x7ff67c09cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:45.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.578+0000 7ff6824c6640 1 --2- 172.21.15.45:0/2514252673 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff67c0cf7c0 0x7ff67c09cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:45.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.578+0000 7ff6824c6640 1 -- 172.21.15.45:0/2514252673 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff66c0094d0 con 0x7ff67c0b35f0 2023-11-28T18:43:45.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.578+0000 7ff6824c6640 1 --2- 172.21.15.45:0/2514252673 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff67c0b35f0 0x7ff67c0cbc50 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7ff67800c7f0 tx=0x7ff67800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:45.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.578+0000 7ff672ffd640 1 -- 172.21.15.45:0/2514252673 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff678007820 con 0x7ff67c0b35f0 2023-11-28T18:43:45.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.578+0000 7ff672ffd640 1 -- 172.21.15.45:0/2514252673 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff678007980 con 0x7ff67c0b35f0 2023-11-28T18:43:45.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.578+0000 7ff672ffd640 1 -- 172.21.15.45:0/2514252673 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff678007d30 con 0x7ff67c0b35f0 2023-11-28T18:43:45.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.578+0000 7ff68472a640 1 -- 172.21.15.45:0/2514252673 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff67c0cb190 con 0x7ff67c0b35f0 2023-11-28T18:43:45.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.578+0000 7ff68472a640 1 -- 172.21.15.45:0/2514252673 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff67c0cad80 con 0x7ff67c0b35f0 2023-11-28T18:43:45.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.578+0000 7ff68472a640 1 -- 172.21.15.45:0/2514252673 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff67c069480 con 0x7ff67c0b35f0 2023-11-28T18:43:45.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.578+0000 7ff672ffd640 1 -- 172.21.15.45:0/2514252673 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ff6780113f0 con 0x7ff67c0b35f0 2023-11-28T18:43:45.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.582+0000 7ff672ffd640 1 --2- 172.21.15.45:0/2514252673 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff6600668d0 0x7ff660068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:45.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.582+0000 7ff672ffd640 1 -- 172.21.15.45:0/2514252673 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x7ff6780848d0 con 0x7ff67c0b35f0 2023-11-28T18:43:45.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.582+0000 7ff681cc5640 1 --2- 172.21.15.45:0/2514252673 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff6600668d0 0x7ff660068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:45.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.582+0000 7ff681cc5640 1 --2- 172.21.15.45:0/2514252673 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff6600668d0 0x7ff660068d90 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff66c0ae000 tx=0x7ff66c0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:45.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.582+0000 7ff672ffd640 1 -- 172.21.15.45:0/2514252673 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff6780519e0 con 0x7ff67c0b35f0 2023-11-28T18:43:45.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.778+0000 7ff68472a640 1 -- 172.21.15.45:0/2514252673 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff67c0d0760 con 0x7ff67c0b35f0 2023-11-28T18:43:45.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.782+0000 7ff672ffd640 1 -- 172.21.15.45:0/2514252673 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4912 (secure 0 0 0) 0x7ff67801f090 con 0x7ff67c0b35f0 2023-11-28T18:43:45.785 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:43:45.785 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":39,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5414,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/114066704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":114066704},{"type":"v1","addr":"172.21.15.190:6836","nonce":114066704}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5417,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/27225494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":27225494},{"type":"v1","addr":"172.21.15.190:6837","nonce":27225494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5973,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1061201705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":1061201705},{"type":"v1","addr":"172.21.15.45:6835","nonce":1061201705}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T18:39:36.424552+0000","modified":"2023-11-28T18:42:27.227565+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":49,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6207},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6207":{"gid":6207,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":22,"addr":"172.21.15.45:6834/2228986336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2228986336},{"type":"v1","addr":"172.21.15.45:6834","nonce":2228986336}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-28T18:43:45.786 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 39 2023-11-28T18:43:45.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.782+0000 7ff68472a640 1 -- 172.21.15.45:0/2514252673 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff6600668d0 msgr2=0x7ff660068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:45.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.782+0000 7ff68472a640 1 --2- 172.21.15.45:0/2514252673 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff6600668d0 0x7ff660068d90 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff66c0ae000 tx=0x7ff66c0a7000 comp rx=0 tx=0).stop 2023-11-28T18:43:45.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.782+0000 7ff68472a640 1 -- 172.21.15.45:0/2514252673 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff67c0b35f0 msgr2=0x7ff67c0cbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:45.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.782+0000 7ff68472a640 1 --2- 172.21.15.45:0/2514252673 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff67c0b35f0 0x7ff67c0cbc50 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7ff67800c7f0 tx=0x7ff67800ccb0 comp rx=0 tx=0).stop 2023-11-28T18:43:45.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.782+0000 7ff68472a640 1 -- 172.21.15.45:0/2514252673 shutdown_connections 2023-11-28T18:43:45.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.782+0000 7ff68472a640 1 --2- 172.21.15.45:0/2514252673 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff6600668d0 0x7ff660068d90 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:45.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.782+0000 7ff68472a640 1 --2- 172.21.15.45:0/2514252673 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff67c0cf7c0 0x7ff67c09cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:45.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.782+0000 7ff68472a640 1 --2- 172.21.15.45:0/2514252673 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff67c0b3cb0 0x7ff67c156b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:45.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.782+0000 7ff68472a640 1 --2- 172.21.15.45:0/2514252673 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff67c0b35f0 0x7ff67c0cbc50 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:45.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.782+0000 7ff68472a640 1 -- 172.21.15.45:0/2514252673 >> 172.21.15.45:0/2514252673 conn(0x7ff67c09c4f0 msgr2=0x7ff67c0b0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:43:45.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.782+0000 7ff68472a640 1 -- 172.21.15.45:0/2514252673 shutdown_connections 2023-11-28T18:43:45.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.782+0000 7ff68472a640 1 -- 172.21.15.45:0/2514252673 wait complete. 2023-11-28T18:43:45.806 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T18:43:45.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.946+0000 7f9236dd8640 1 Processor -- start 2023-11-28T18:43:45.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.946+0000 7f9236dd8640 1 -- start start 2023-11-28T18:43:45.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.946+0000 7f9236dd8640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f923015bcd0 0x7f923006c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:45.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.946+0000 7f9236dd8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f92301459a0 0x7f923006c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:45.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.946+0000 7f9236dd8640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9230146000 con 0x7f923015c0b0 2023-11-28T18:43:45.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.946+0000 7f9236dd8640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92301462e0 con 0x7f92301459a0 2023-11-28T18:43:45.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.946+0000 7f9236dd8640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92301465c0 con 0x7f923015bcd0 2023-11-28T18:43:45.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.946+0000 7f9235375640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f92301459a0 0x7f923006c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:45.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.946+0000 7f9235375640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f92301459a0 0x7f923006c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38408/0 (socket says 172.21.15.45:38408) 2023-11-28T18:43:45.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.946+0000 7f9235375640 1 -- 172.21.15.45:0/1125439710 learned_addr learned my addr 172.21.15.45:0/1125439710 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:43:45.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.946+0000 7f9234b74640 1 --2- 172.21.15.45:0/1125439710 >> v2:172.21.15.190:3300/0 conn(0x7f923015bcd0 0x7f923006c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:45.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.946+0000 7f9235375640 1 -- 172.21.15.45:0/1125439710 >> v2:172.21.15.190:3300/0 conn(0x7f923015bcd0 msgr2=0x7f923006c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:43:45.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.946+0000 7f9235375640 1 --2- 172.21.15.45:0/1125439710 >> v2:172.21.15.190:3300/0 conn(0x7f923015bcd0 0x7f923006c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:45.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.946+0000 7f9235375640 1 -- 172.21.15.45:0/1125439710 >> v1:172.21.15.190:6789/0 conn(0x7f923015c0b0 legacy=0x7f9230145290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:43:45.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.946+0000 7f9235375640 1 -- 172.21.15.45:0/1125439710 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92301468a0 con 0x7f92301459a0 2023-11-28T18:43:45.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.946+0000 7f9234b74640 1 --2- 172.21.15.45:0/1125439710 >> v2:172.21.15.190:3300/0 conn(0x7f923015bcd0 0x7f923006c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:43:45.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.950+0000 7f9235375640 1 --2- 172.21.15.45:0/1125439710 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92301459a0 0x7f923006c840 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f9228009e50 tx=0x7f922801c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2920ba60a2d5eee1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:45.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.950+0000 7f922f7fe640 1 -- 172.21.15.45:0/1125439710 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92280a56d0 con 0x7f92301459a0 2023-11-28T18:43:45.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.950+0000 7f922f7fe640 1 -- 172.21.15.45:0/1125439710 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92280a5830 con 0x7f92301459a0 2023-11-28T18:43:45.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.950+0000 7f922f7fe640 1 -- 172.21.15.45:0/1125439710 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92280a5bc0 con 0x7f92301459a0 2023-11-28T18:43:45.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.950+0000 7f9236dd8640 1 -- 172.21.15.45:0/1125439710 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92301459a0 msgr2=0x7f923006c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:45.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.950+0000 7f9236dd8640 1 --2- 172.21.15.45:0/1125439710 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92301459a0 0x7f923006c840 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f9228009e50 tx=0x7f922801c900 comp rx=0 tx=0).stop 2023-11-28T18:43:45.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.950+0000 7f9236dd8640 1 -- 172.21.15.45:0/1125439710 shutdown_connections 2023-11-28T18:43:45.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.950+0000 7f9236dd8640 1 --2- 172.21.15.45:0/1125439710 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92301459a0 0x7f923006c840 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:45.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.950+0000 7f9236dd8640 1 --2- 172.21.15.45:0/1125439710 >> v2:172.21.15.190:3300/0 conn(0x7f923015bcd0 0x7f923006c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:45.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.950+0000 7f9236dd8640 1 -- 172.21.15.45:0/1125439710 >> 172.21.15.45:0/1125439710 conn(0x7f923006a570 msgr2=0x7f923006a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:43:45.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.950+0000 7f9236dd8640 1 -- 172.21.15.45:0/1125439710 shutdown_connections 2023-11-28T18:43:45.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.950+0000 7f9236dd8640 1 -- 172.21.15.45:0/1125439710 wait complete. 2023-11-28T18:43:45.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.954+0000 7f9236dd8640 1 Processor -- start 2023-11-28T18:43:45.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.954+0000 7f9236dd8640 1 -- start start 2023-11-28T18:43:45.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.954+0000 7f9236dd8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92301459a0 0x7f9230158b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:45.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.954+0000 7f9236dd8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f923015bcd0 0x7f92301436d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:45.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.954+0000 7f9236dd8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f923015c0b0 0x7f9230143c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:45.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.954+0000 7f9236dd8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92300aec70 con 0x7f92301459a0 2023-11-28T18:43:45.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.954+0000 7f9236dd8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9230159060 con 0x7f923015bcd0 2023-11-28T18:43:45.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.954+0000 7f9236dd8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92300aeec0 con 0x7f923015c0b0 2023-11-28T18:43:45.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.954+0000 7f9234b74640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92301459a0 0x7f9230158b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:45.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.954+0000 7f9234b74640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92301459a0 0x7f9230158b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38414/0 (socket says 172.21.15.45:38414) 2023-11-28T18:43:45.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.954+0000 7f9234b74640 1 -- 172.21.15.45:0/230124886 learned_addr learned my addr 172.21.15.45:0/230124886 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:43:45.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.954+0000 7f922ffff640 1 --2- 172.21.15.45:0/230124886 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f923015bcd0 0x7f92301436d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:45.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.954+0000 7f9235375640 1 --2- 172.21.15.45:0/230124886 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f923015c0b0 0x7f9230143c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:45.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.954+0000 7f9234b74640 1 -- 172.21.15.45:0/230124886 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f923015c0b0 msgr2=0x7f9230143c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:45.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.954+0000 7f9234b74640 1 --2- 172.21.15.45:0/230124886 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f923015c0b0 0x7f9230143c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:45.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.954+0000 7f9234b74640 1 -- 172.21.15.45:0/230124886 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f923015bcd0 msgr2=0x7f92301436d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:45.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.954+0000 7f9234b74640 1 --2- 172.21.15.45:0/230124886 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f923015bcd0 0x7f92301436d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:45.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.954+0000 7f9234b74640 1 -- 172.21.15.45:0/230124886 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9228009b30 con 0x7f92301459a0 2023-11-28T18:43:45.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.954+0000 7f9234b74640 1 --2- 172.21.15.45:0/230124886 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92301459a0 0x7f9230158b20 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f922400c7c0 tx=0x7f922400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:45.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.954+0000 7f922d7fa640 1 -- 172.21.15.45:0/230124886 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9224007a30 con 0x7f92301459a0 2023-11-28T18:43:45.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.954+0000 7f922d7fa640 1 -- 172.21.15.45:0/230124886 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9224007b90 con 0x7f92301459a0 2023-11-28T18:43:45.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.954+0000 7f922d7fa640 1 -- 172.21.15.45:0/230124886 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f922400ce70 con 0x7f92301459a0 2023-11-28T18:43:45.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.954+0000 7f9236dd8640 1 -- 172.21.15.45:0/230124886 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92300af1a0 con 0x7f92301459a0 2023-11-28T18:43:45.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.954+0000 7f9236dd8640 1 -- 172.21.15.45:0/230124886 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92300af760 con 0x7f92301459a0 2023-11-28T18:43:45.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.954+0000 7f9236dd8640 1 -- 172.21.15.45:0/230124886 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92300af980 con 0x7f92301459a0 2023-11-28T18:43:45.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.958+0000 7f922d7fa640 1 -- 172.21.15.45:0/230124886 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f92240113f0 con 0x7f92301459a0 2023-11-28T18:43:45.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.958+0000 7f922d7fa640 1 --2- 172.21.15.45:0/230124886 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9214066900 0x7f9214068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:45.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.958+0000 7f922d7fa640 1 -- 172.21.15.45:0/230124886 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f9224084970 con 0x7f92301459a0 2023-11-28T18:43:45.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.958+0000 7f922ffff640 1 --2- 172.21.15.45:0/230124886 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9214066900 0x7f9214068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:45.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.958+0000 7f922ffff640 1 --2- 172.21.15.45:0/230124886 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9214066900 0x7f9214068dc0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f923015acb0 tx=0x7f921c009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:45.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:45.962+0000 7f922d7fa640 1 -- 172.21.15.45:0/230124886 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9224051b30 con 0x7f92301459a0 2023-11-28T18:43:46.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.150+0000 7f9236dd8640 1 -- 172.21.15.45:0/230124886 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9230069480 con 0x7f92301459a0 2023-11-28T18:43:46.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.150+0000 7f922d7fa640 1 -- 172.21.15.45:0/230124886 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4912 (secure 0 0 0) 0x7f9224055150 con 0x7f92301459a0 2023-11-28T18:43:46.156 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:43:46.156 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":39,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5414,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/114066704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":114066704},{"type":"v1","addr":"172.21.15.190:6836","nonce":114066704}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5417,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/27225494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":27225494},{"type":"v1","addr":"172.21.15.190:6837","nonce":27225494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5973,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1061201705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":1061201705},{"type":"v1","addr":"172.21.15.45:6835","nonce":1061201705}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T18:39:36.424552+0000","modified":"2023-11-28T18:42:27.227565+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":49,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6207},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6207":{"gid":6207,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":22,"addr":"172.21.15.45:6834/2228986336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2228986336},{"type":"v1","addr":"172.21.15.45:6834","nonce":2228986336}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-28T18:43:46.156 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 39 2023-11-28T18:43:46.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.154+0000 7f9236dd8640 1 -- 172.21.15.45:0/230124886 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9214066900 msgr2=0x7f9214068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:46.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.154+0000 7f9236dd8640 1 --2- 172.21.15.45:0/230124886 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9214066900 0x7f9214068dc0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f923015acb0 tx=0x7f921c009060 comp rx=0 tx=0).stop 2023-11-28T18:43:46.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.154+0000 7f9236dd8640 1 -- 172.21.15.45:0/230124886 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92301459a0 msgr2=0x7f9230158b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:46.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.154+0000 7f9236dd8640 1 --2- 172.21.15.45:0/230124886 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92301459a0 0x7f9230158b20 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f922400c7c0 tx=0x7f922400cc80 comp rx=0 tx=0).stop 2023-11-28T18:43:46.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.154+0000 7f9236dd8640 1 -- 172.21.15.45:0/230124886 shutdown_connections 2023-11-28T18:43:46.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.154+0000 7f9236dd8640 1 --2- 172.21.15.45:0/230124886 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9214066900 0x7f9214068dc0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:46.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.154+0000 7f9236dd8640 1 --2- 172.21.15.45:0/230124886 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f923015c0b0 0x7f9230143c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:46.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.154+0000 7f9236dd8640 1 --2- 172.21.15.45:0/230124886 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f923015bcd0 0x7f92301436d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:46.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.154+0000 7f9236dd8640 1 --2- 172.21.15.45:0/230124886 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92301459a0 0x7f9230158b20 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:46.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.154+0000 7f9236dd8640 1 -- 172.21.15.45:0/230124886 >> 172.21.15.45:0/230124886 conn(0x7f923006a570 msgr2=0x7f92300cded0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:43:46.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.154+0000 7f9236dd8640 1 -- 172.21.15.45:0/230124886 shutdown_connections 2023-11-28T18:43:46.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.154+0000 7f9236dd8640 1 -- 172.21.15.45:0/230124886 wait complete. 2023-11-28T18:43:46.177 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T18:43:46.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.318+0000 7f1de031d640 1 Processor -- start 2023-11-28T18:43:46.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.318+0000 7f1de031d640 1 -- start start 2023-11-28T18:43:46.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.318+0000 7f1de031d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f1dd815e430 0x7f1dd80b2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:46.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.318+0000 7f1de031d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1dd80b30f0 0x7f1dd8160f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:46.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.318+0000 7f1de031d640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dd8146fe0 con 0x7f1dd8146c00 2023-11-28T18:43:46.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.318+0000 7f1de031d640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dd80b3580 con 0x7f1dd815e430 2023-11-28T18:43:46.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.318+0000 7f1de031d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd815e8b0 con 0x7f1dd80b30f0 2023-11-28T18:43:46.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.318+0000 7f1dde0b9640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f1dd8146c00 0x7f1dd806e8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47650/0 (socket says 172.21.15.45:47650) 2023-11-28T18:43:46.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.318+0000 7f1dde0b9640 1 -- 172.21.15.45:0/3514493054 learned_addr learned my addr 172.21.15.45:0/3514493054 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:43:46.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.318+0000 7f1dde8ba640 1 --2- 172.21.15.45:0/3514493054 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1dd80b30f0 0x7f1dd8160f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:46.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.318+0000 7f1ddd8b8640 1 --2- 172.21.15.45:0/3514493054 >> v2:172.21.15.190:3300/0 conn(0x7f1dd815e430 0x7f1dd80b2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:46.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.318+0000 7f1ddd0b7640 1 -- 172.21.15.45:0/3514493054 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4163457565 0 0) 0x7f1dd8146fe0 con 0x7f1dd8146c00 2023-11-28T18:43:46.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.318+0000 7f1ddd0b7640 1 -- 172.21.15.45:0/3514493054 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1dc4003530 con 0x7f1dd8146c00 2023-11-28T18:43:46.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.318+0000 7f1ddd0b7640 1 -- 172.21.15.45:0/3514493054 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 956547390 0 0) 0x7f1dc4003530 con 0x7f1dd8146c00 2023-11-28T18:43:46.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.318+0000 7f1ddd8b8640 1 -- 172.21.15.45:0/3514493054 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1dd80b30f0 msgr2=0x7f1dd8160f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:43:46.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.318+0000 7f1ddd8b8640 1 --2- 172.21.15.45:0/3514493054 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1dd80b30f0 0x7f1dd8160f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:46.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.318+0000 7f1ddd8b8640 1 -- 172.21.15.45:0/3514493054 >> v1:172.21.15.45:6789/0 conn(0x7f1dd8146c00 legacy=0x7f1dd806e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:46.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.318+0000 7f1ddd8b8640 1 -- 172.21.15.45:0/3514493054 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dd806f390 con 0x7f1dd815e430 2023-11-28T18:43:46.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.322+0000 7f1ddd8b8640 1 --2- 172.21.15.45:0/3514493054 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1dd815e430 0x7f1dd80b2bb0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1dc80097c0 tx=0x7f1dc801c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6fe6f7e1099d8511 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:46.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.322+0000 7f1ddd0b7640 1 -- 172.21.15.45:0/3514493054 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd4001680 con 0x7f1dd815e430 2023-11-28T18:43:46.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.322+0000 7f1ddd0b7640 1 -- 172.21.15.45:0/3514493054 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc80a7050 con 0x7f1dd815e430 2023-11-28T18:43:46.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.322+0000 7f1ddd0b7640 1 -- 172.21.15.45:0/3514493054 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc80ab620 con 0x7f1dd815e430 2023-11-28T18:43:46.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.322+0000 7f1de031d640 1 -- 172.21.15.45:0/3514493054 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1dd815e430 msgr2=0x7f1dd80b2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:46.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.322+0000 7f1de031d640 1 --2- 172.21.15.45:0/3514493054 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1dd815e430 0x7f1dd80b2bb0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1dc80097c0 tx=0x7f1dc801c370 comp rx=0 tx=0).stop 2023-11-28T18:43:46.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.322+0000 7f1de031d640 1 -- 172.21.15.45:0/3514493054 shutdown_connections 2023-11-28T18:43:46.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.322+0000 7f1de031d640 1 --2- 172.21.15.45:0/3514493054 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1dd80b30f0 0x7f1dd8160f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:46.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.322+0000 7f1de031d640 1 --2- 172.21.15.45:0/3514493054 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1dd815e430 0x7f1dd80b2bb0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:46.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.322+0000 7f1de031d640 1 -- 172.21.15.45:0/3514493054 >> 172.21.15.45:0/3514493054 conn(0x7f1dd806a570 msgr2=0x7f1dd806a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:43:46.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.322+0000 7f1de031d640 1 -- 172.21.15.45:0/3514493054 shutdown_connections 2023-11-28T18:43:46.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.322+0000 7f1de031d640 1 -- 172.21.15.45:0/3514493054 wait complete. 2023-11-28T18:43:46.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.326+0000 7f1de031d640 1 Processor -- start 2023-11-28T18:43:46.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.326+0000 7f1de031d640 1 -- start start 2023-11-28T18:43:46.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.326+0000 7f1de031d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1dd80b30f0 0x7f1dd81405a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:46.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.326+0000 7f1de031d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1dd8146c00 0x7f1dd8145500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:46.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.326+0000 7f1de031d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1dd815e430 0x7f1dd813b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:46.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.326+0000 7f1de031d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd813d450 con 0x7f1dd80b30f0 2023-11-28T18:43:46.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.326+0000 7f1de031d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd813c0d0 con 0x7f1dd8146c00 2023-11-28T18:43:46.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.326+0000 7f1de031d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd813c3b0 con 0x7f1dd815e430 2023-11-28T18:43:46.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.326+0000 7f1dde0b9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1dd80b30f0 0x7f1dd81405a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:46.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.326+0000 7f1dde0b9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1dd80b30f0 0x7f1dd81405a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38416/0 (socket says 172.21.15.45:38416) 2023-11-28T18:43:46.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.326+0000 7f1dde0b9640 1 -- 172.21.15.45:0/805378818 learned_addr learned my addr 172.21.15.45:0/805378818 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:43:46.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.326+0000 7f1ddd8b8640 1 --2- 172.21.15.45:0/805378818 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1dd8146c00 0x7f1dd8145500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:46.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.326+0000 7f1dde8ba640 1 --2- 172.21.15.45:0/805378818 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1dd815e430 0x7f1dd813b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:46.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.326+0000 7f1dde0b9640 1 -- 172.21.15.45:0/805378818 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1dd815e430 msgr2=0x7f1dd813b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:46.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.326+0000 7f1dde0b9640 1 --2- 172.21.15.45:0/805378818 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1dd815e430 0x7f1dd813b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:46.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.326+0000 7f1dde0b9640 1 -- 172.21.15.45:0/805378818 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1dd8146c00 msgr2=0x7f1dd8145500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:46.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.326+0000 7f1dde0b9640 1 --2- 172.21.15.45:0/805378818 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1dd8146c00 0x7f1dd8145500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:46.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.326+0000 7f1dde0b9640 1 -- 172.21.15.45:0/805378818 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc8009420 con 0x7f1dd80b30f0 2023-11-28T18:43:46.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.326+0000 7f1dde0b9640 1 --2- 172.21.15.45:0/805378818 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1dd80b30f0 0x7f1dd81405a0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f1dd400c780 tx=0x7f1dd400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:46.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.326+0000 7f1dceffd640 1 -- 172.21.15.45:0/805378818 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd4005ae0 con 0x7f1dd80b30f0 2023-11-28T18:43:46.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.326+0000 7f1dceffd640 1 -- 172.21.15.45:0/805378818 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dd4005c40 con 0x7f1dd80b30f0 2023-11-28T18:43:46.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.326+0000 7f1dceffd640 1 -- 172.21.15.45:0/805378818 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd4007070 con 0x7f1dd80b30f0 2023-11-28T18:43:46.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.326+0000 7f1de031d640 1 -- 172.21.15.45:0/805378818 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dd813c690 con 0x7f1dd80b30f0 2023-11-28T18:43:46.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.326+0000 7f1de031d640 1 -- 172.21.15.45:0/805378818 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dd813cc50 con 0x7f1dd80b30f0 2023-11-28T18:43:46.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.330+0000 7f1de031d640 1 -- 172.21.15.45:0/805378818 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dd8069480 con 0x7f1dd80b30f0 2023-11-28T18:43:46.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.330+0000 7f1dceffd640 1 -- 172.21.15.45:0/805378818 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f1dd40071d0 con 0x7f1dd80b30f0 2023-11-28T18:43:46.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.330+0000 7f1dceffd640 1 --2- 172.21.15.45:0/805378818 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1dbc0668d0 0x7f1dbc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:46.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.330+0000 7f1dceffd640 1 -- 172.21.15.45:0/805378818 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f1dd40840e0 con 0x7f1dd80b30f0 2023-11-28T18:43:46.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.330+0000 7f1ddd8b8640 1 --2- 172.21.15.45:0/805378818 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1dbc0668d0 0x7f1dbc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:46.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.330+0000 7f1ddd8b8640 1 --2- 172.21.15.45:0/805378818 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1dbc0668d0 0x7f1dbc068d90 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f1dc80ad000 tx=0x7f1dc80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:46.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.334+0000 7f1dceffd640 1 -- 172.21.15.45:0/805378818 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1dd4051360 con 0x7f1dd80b30f0 2023-11-28T18:43:46.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.494+0000 7f1de031d640 1 -- 172.21.15.45:0/805378818 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1dd815d8d0 con 0x7f1dd80b30f0 2023-11-28T18:43:46.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.494+0000 7f1dceffd640 1 -- 172.21.15.45:0/805378818 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+16702 (secure 0 0 0) 0x7f1dd4054980 con 0x7f1dd80b30f0 2023-11-28T18:43:46.499 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:43:46.499 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":49,"fsid":"d10f5cd6-1d00-4019-99b6-6fa435498a15","created":"2023-11-28T18:37:08.189030+0000","modified":"2023-11-28T18:41:11.270317+0000","last_up_change":"2023-11-28T18:37:20.196124+0000","last_in_change":"2023-11-28T18:37:10.742043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T18:37:21.293917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-28T18:39:34.106789+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-28T18:39:35.426601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"84465384-103c-4f2c-a45a-96f5bb9c835f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6809","nonce":555237322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6811","nonce":555237322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6815","nonce":555237322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6813","nonce":555237322}]},"public_addr":"172.21.15.45:6809/555237322","cluster_addr":"172.21.15.45:6811/555237322","heartbeat_back_addr":"172.21.15.45:6815/555237322","heartbeat_front_addr":"172.21.15.45:6813/555237322","state":["exists","up"]},{"osd":1,"uuid":"7d9eed24-a58f-42c7-a787-ac06be8553fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6801","nonce":2857063763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6803","nonce":2857063763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6807","nonce":2857063763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6805","nonce":2857063763}]},"public_addr":"172.21.15.45:6801/2857063763","cluster_addr":"172.21.15.45:6803/2857063763","heartbeat_back_addr":"172.21.15.45:6807/2857063763","heartbeat_front_addr":"172.21.15.45:6805/2857063763","state":["exists","up"]},{"osd":2,"uuid":"575eeccc-4abf-45b4-9caf-f3e797859588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6817","nonce":193884539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6819","nonce":193884539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6823","nonce":193884539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6821","nonce":193884539}]},"public_addr":"172.21.15.45:6817/193884539","cluster_addr":"172.21.15.45:6819/193884539","heartbeat_back_addr":"172.21.15.45:6823/193884539","heartbeat_front_addr":"172.21.15.45:6821/193884539","state":["exists","up"]},{"osd":3,"uuid":"9b0290d6-9a52-4bc8-b2a1-7622c5dc8e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6825","nonce":78541084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6827","nonce":78541084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6831","nonce":78541084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6829","nonce":78541084}]},"public_addr":"172.21.15.45:6825/78541084","cluster_addr":"172.21.15.45:6827/78541084","heartbeat_back_addr":"172.21.15.45:6831/78541084","heartbeat_front_addr":"172.21.15.45:6829/78541084","state":["exists","up"]},{"osd":4,"uuid":"ce632829-f027-4fbf-a627-02c571aa9d53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6809","nonce":1537591987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6811","nonce":1537591987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6815","nonce":1537591987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6813","nonce":1537591987}]},"public_addr":"172.21.15.190:6809/1537591987","cluster_addr":"172.21.15.190:6811/1537591987","heartbeat_back_addr":"172.21.15.190:6815/1537591987","heartbeat_front_addr":"172.21.15.190:6813/1537591987","state":["exists","up"]},{"osd":5,"uuid":"8700b609-27be-40bd-a251-4c0ae0a29ead","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6801","nonce":3296698407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6803","nonce":3296698407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6807","nonce":3296698407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6805","nonce":3296698407}]},"public_addr":"172.21.15.190:6801/3296698407","cluster_addr":"172.21.15.190:6803/3296698407","heartbeat_back_addr":"172.21.15.190:6807/3296698407","heartbeat_front_addr":"172.21.15.190:6805/3296698407","state":["exists","up"]},{"osd":6,"uuid":"44ce4a40-e6ff-4f4d-8e8a-7341e5c91f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6817","nonce":2317686718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6819","nonce":2317686718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6823","nonce":2317686718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6821","nonce":2317686718}]},"public_addr":"172.21.15.190:6817/2317686718","cluster_addr":"172.21.15.190:6819/2317686718","heartbeat_back_addr":"172.21.15.190:6823/2317686718","heartbeat_front_addr":"172.21.15.190:6821/2317686718","state":["exists","up"]},{"osd":7,"uuid":"192238c9-1423-4b7e-ac8f-84ba32113ddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6825","nonce":2493232051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6827","nonce":2493232051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6831","nonce":2493232051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6829","nonce":2493232051}]},"public_addr":"172.21.15.190:6825/2493232051","cluster_addr":"172.21.15.190:6827/2493232051","heartbeat_back_addr":"172.21.15.190:6831/2493232051","heartbeat_front_addr":"172.21.15.190:6829/2493232051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.393552+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.385453+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.361421+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.366408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.363226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.276007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.414605+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.445885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.2d","mappings":[{"from":0,"to":4}]},{"pgid":"7.3e","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6834/2737877840":"2023-11-29T18:41:11.270289+0000","172.21.15.45:6832/2737877840":"2023-11-29T18:41:11.270289+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T18:43:46.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.498+0000 7f1de031d640 1 -- 172.21.15.45:0/805378818 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1dbc0668d0 msgr2=0x7f1dbc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:46.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.498+0000 7f1de031d640 1 --2- 172.21.15.45:0/805378818 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1dbc0668d0 0x7f1dbc068d90 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f1dc80ad000 tx=0x7f1dc80a6000 comp rx=0 tx=0).stop 2023-11-28T18:43:46.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.498+0000 7f1de031d640 1 -- 172.21.15.45:0/805378818 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1dd80b30f0 msgr2=0x7f1dd81405a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:46.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.498+0000 7f1de031d640 1 --2- 172.21.15.45:0/805378818 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1dd80b30f0 0x7f1dd81405a0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f1dd400c780 tx=0x7f1dd400cc40 comp rx=0 tx=0).stop 2023-11-28T18:43:46.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.498+0000 7f1de031d640 1 -- 172.21.15.45:0/805378818 shutdown_connections 2023-11-28T18:43:46.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.498+0000 7f1de031d640 1 --2- 172.21.15.45:0/805378818 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f1dbc0668d0 0x7f1dbc068d90 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:46.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.498+0000 7f1de031d640 1 --2- 172.21.15.45:0/805378818 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1dd815e430 0x7f1dd813b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:46.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.498+0000 7f1de031d640 1 --2- 172.21.15.45:0/805378818 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1dd8146c00 0x7f1dd8145500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:46.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.498+0000 7f1de031d640 1 --2- 172.21.15.45:0/805378818 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1dd80b30f0 0x7f1dd81405a0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:46.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.498+0000 7f1de031d640 1 -- 172.21.15.45:0/805378818 >> 172.21.15.45:0/805378818 conn(0x7f1dd806a570 msgr2=0x7f1dd806e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:43:46.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.498+0000 7f1de031d640 1 -- 172.21.15.45:0/805378818 shutdown_connections 2023-11-28T18:43:46.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.498+0000 7f1de031d640 1 -- 172.21.15.45:0/805378818 wait complete. 2023-11-28T18:43:46.521 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-28T18:43:46.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.662+0000 7f596d8c9640 1 Processor -- start 2023-11-28T18:43:46.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.662+0000 7f596d8c9640 1 -- start start 2023-11-28T18:43:46.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.662+0000 7f596d8c9640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f596813cf70 0x7f596806c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:46.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.662+0000 7f596d8c9640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f596806c840 0x7f596815a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:46.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.662+0000 7f596d8c9640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f596815abb0 0x7f59680715b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:46.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.662+0000 7f596d8c9640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f596813d350 con 0x7f596813cf70 2023-11-28T18:43:46.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.662+0000 7f596d8c9640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5968140520 con 0x7f596806c840 2023-11-28T18:43:46.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.662+0000 7f596d8c9640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f596806ccb0 con 0x7f596815abb0 2023-11-28T18:43:46.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.662+0000 7f5966ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f596813cf70 0x7f596806c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:46.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.662+0000 7f5966ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f596813cf70 0x7f596806c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38426/0 (socket says 172.21.15.45:38426) 2023-11-28T18:43:46.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.662+0000 7f5966ffd640 1 -- 172.21.15.45:0/550314236 learned_addr learned my addr 172.21.15.45:0/550314236 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:43:46.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.662+0000 7f595e7fc640 1 --2- 172.21.15.45:0/550314236 >> v2:172.21.15.190:3300/0 conn(0x7f596806c840 0x7f596815a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:46.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.662+0000 7f59677fe640 1 --2- 172.21.15.45:0/550314236 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f596815abb0 0x7f59680715b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:46.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.662+0000 7f5966ffd640 1 -- 172.21.15.45:0/550314236 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f596815abb0 msgr2=0x7f59680715b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:43:46.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.662+0000 7f5966ffd640 1 --2- 172.21.15.45:0/550314236 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f596815abb0 0x7f59680715b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:46.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.662+0000 7f5966ffd640 1 -- 172.21.15.45:0/550314236 >> v2:172.21.15.190:3300/0 conn(0x7f596806c840 msgr2=0x7f596815a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:43:46.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.662+0000 7f5966ffd640 1 --2- 172.21.15.45:0/550314236 >> v2:172.21.15.190:3300/0 conn(0x7f596806c840 0x7f596815a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:46.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.662+0000 7f5966ffd640 1 -- 172.21.15.45:0/550314236 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f596815b3e0 con 0x7f596813cf70 2023-11-28T18:43:46.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.666+0000 7f5966ffd640 1 --2- 172.21.15.45:0/550314236 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f596813cf70 0x7f596806c300 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f59680cc7d0 tx=0x7f595801eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=691973dee7a84f83 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:46.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.666+0000 7f59667fc640 1 -- 172.21.15.45:0/550314236 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59580a7b80 con 0x7f596813cf70 2023-11-28T18:43:46.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.666+0000 7f59667fc640 1 -- 172.21.15.45:0/550314236 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59580a7ce0 con 0x7f596813cf70 2023-11-28T18:43:46.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.666+0000 7f59667fc640 1 -- 172.21.15.45:0/550314236 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59580af660 con 0x7f596813cf70 2023-11-28T18:43:46.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.666+0000 7f596d8c9640 1 -- 172.21.15.45:0/550314236 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f596813cf70 msgr2=0x7f596806c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:46.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.666+0000 7f596d8c9640 1 --2- 172.21.15.45:0/550314236 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f596813cf70 0x7f596806c300 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f59680cc7d0 tx=0x7f595801eaf0 comp rx=0 tx=0).stop 2023-11-28T18:43:46.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.666+0000 7f596d8c9640 1 -- 172.21.15.45:0/550314236 shutdown_connections 2023-11-28T18:43:46.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.666+0000 7f596d8c9640 1 --2- 172.21.15.45:0/550314236 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f596815abb0 0x7f59680715b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:46.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.666+0000 7f596d8c9640 1 --2- 172.21.15.45:0/550314236 >> v2:172.21.15.190:3300/0 conn(0x7f596806c840 0x7f596815a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:46.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.666+0000 7f596d8c9640 1 --2- 172.21.15.45:0/550314236 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f596813cf70 0x7f596806c300 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:46.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.666+0000 7f596d8c9640 1 -- 172.21.15.45:0/550314236 >> 172.21.15.45:0/550314236 conn(0x7f596806a570 msgr2=0x7f596806a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:43:46.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.666+0000 7f596d8c9640 1 -- 172.21.15.45:0/550314236 shutdown_connections 2023-11-28T18:43:46.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.666+0000 7f596d8c9640 1 -- 172.21.15.45:0/550314236 wait complete. 2023-11-28T18:43:46.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.670+0000 7f596d8c9640 1 Processor -- start 2023-11-28T18:43:46.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.670+0000 7f596d8c9640 1 -- start start 2023-11-28T18:43:46.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.670+0000 7f596d8c9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f596806c840 0x7f59680713d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:46.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.670+0000 7f596d8c9640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f596813cf70 0x7f596813b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:46.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.670+0000 7f596d8c9640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f596815abb0 0x7f59680ad8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:46.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.670+0000 7f596d8c9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f596813bf60 con 0x7f596806c840 2023-11-28T18:43:46.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.670+0000 7f596d8c9640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5968071910 con 0x7f596815abb0 2023-11-28T18:43:46.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.670+0000 7f596d8c9640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59680b2ce0 con 0x7f596813cf70 2023-11-28T18:43:46.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.670+0000 7f5966ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f596806c840 0x7f59680713d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:46.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.670+0000 7f5966ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f596806c840 0x7f59680713d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38430/0 (socket says 172.21.15.45:38430) 2023-11-28T18:43:46.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.670+0000 7f5966ffd640 1 -- 172.21.15.45:0/49003534 learned_addr learned my addr 172.21.15.45:0/49003534 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:43:46.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.670+0000 7f595e7fc640 1 --2- 172.21.15.45:0/49003534 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f596813cf70 0x7f596813b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:46.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.670+0000 7f59677fe640 1 --2- 172.21.15.45:0/49003534 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f596815abb0 0x7f59680ad8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:46.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.670+0000 7f5966ffd640 1 -- 172.21.15.45:0/49003534 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f596813cf70 msgr2=0x7f596813b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:46.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.670+0000 7f5966ffd640 1 --2- 172.21.15.45:0/49003534 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f596813cf70 0x7f596813b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:46.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.670+0000 7f5966ffd640 1 -- 172.21.15.45:0/49003534 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f596815abb0 msgr2=0x7f59680ad8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:46.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.670+0000 7f5966ffd640 1 --2- 172.21.15.45:0/49003534 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f596815abb0 0x7f59680ad8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:46.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.670+0000 7f5966ffd640 1 -- 172.21.15.45:0/49003534 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f595800b770 con 0x7f596806c840 2023-11-28T18:43:46.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.670+0000 7f595e7fc640 1 --2- 172.21.15.45:0/49003534 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f596813cf70 0x7f596813b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:43:46.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.670+0000 7f5966ffd640 1 --2- 172.21.15.45:0/49003534 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f596806c840 0x7f59680713d0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f595801d1a0 tx=0x7f595801b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:46.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.670+0000 7f5964ff9640 1 -- 172.21.15.45:0/49003534 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59580a7b80 con 0x7f596806c840 2023-11-28T18:43:46.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.670+0000 7f5964ff9640 1 -- 172.21.15.45:0/49003534 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59580ba440 con 0x7f596806c840 2023-11-28T18:43:46.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.670+0000 7f596d8c9640 1 -- 172.21.15.45:0/49003534 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59680b2fc0 con 0x7f596806c840 2023-11-28T18:43:46.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.670+0000 7f5964ff9640 1 -- 172.21.15.45:0/49003534 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59580ba810 con 0x7f596806c840 2023-11-28T18:43:46.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.670+0000 7f596d8c9640 1 -- 172.21.15.45:0/49003534 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59680b3580 con 0x7f596806c840 2023-11-28T18:43:46.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.674+0000 7f596d8c9640 1 -- 172.21.15.45:0/49003534 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5968069480 con 0x7f596806c840 2023-11-28T18:43:46.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.674+0000 7f5964ff9640 1 -- 172.21.15.45:0/49003534 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f59580b93e0 con 0x7f596806c840 2023-11-28T18:43:46.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.674+0000 7f5964ff9640 1 --2- 172.21.15.45:0/49003534 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f5948066900 0x7f5948068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:46.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.674+0000 7f5964ff9640 1 -- 172.21.15.45:0/49003534 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f595811ef60 con 0x7f596806c840 2023-11-28T18:43:46.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.674+0000 7f595e7fc640 1 --2- 172.21.15.45:0/49003534 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f5948066900 0x7f5948068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:46.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.674+0000 7f595e7fc640 1 --2- 172.21.15.45:0/49003534 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f5948066900 0x7f5948068dc0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f5950003fd0 tx=0x7f59500039e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:46.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.678+0000 7f5964ff9640 1 -- 172.21.15.45:0/49003534 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f59580ec070 con 0x7f596806c840 2023-11-28T18:43:46.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.866+0000 7f596d8c9640 1 -- 172.21.15.45:0/49003534 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f596815b5e0 con 0x7f596806c840 2023-11-28T18:43:46.872 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-11-28T18:43:46.866+0000 7f5668eb3640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-28T18:43:46.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.870+0000 7f5964ff9640 1 -- 172.21.15.45:0/49003534 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v40) v1 ==== 161+0+0 (secure 0 0 0) 0x7f59580ef690 con 0x7f596806c840 2023-11-28T18:43:46.875 INFO:teuthology.orchestra.run.smithi045.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-28T18:43:46.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.874+0000 7f596d8c9640 1 -- 172.21.15.45:0/49003534 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f5948066900 msgr2=0x7f5948068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:46.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.874+0000 7f596d8c9640 1 --2- 172.21.15.45:0/49003534 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f5948066900 0x7f5948068dc0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f5950003fd0 tx=0x7f59500039e0 comp rx=0 tx=0).stop 2023-11-28T18:43:46.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.874+0000 7f596d8c9640 1 -- 172.21.15.45:0/49003534 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f596806c840 msgr2=0x7f59680713d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:46.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.874+0000 7f596d8c9640 1 --2- 172.21.15.45:0/49003534 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f596806c840 0x7f59680713d0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f595801d1a0 tx=0x7f595801b890 comp rx=0 tx=0).stop 2023-11-28T18:43:46.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.874+0000 7f596d8c9640 1 -- 172.21.15.45:0/49003534 shutdown_connections 2023-11-28T18:43:46.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.874+0000 7f596d8c9640 1 --2- 172.21.15.45:0/49003534 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f5948066900 0x7f5948068dc0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:46.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.874+0000 7f596d8c9640 1 --2- 172.21.15.45:0/49003534 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f596815abb0 0x7f59680ad8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:46.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.874+0000 7f596d8c9640 1 --2- 172.21.15.45:0/49003534 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f596813cf70 0x7f596813b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:46.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.874+0000 7f596d8c9640 1 --2- 172.21.15.45:0/49003534 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f596806c840 0x7f59680713d0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:46.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.874+0000 7f596d8c9640 1 -- 172.21.15.45:0/49003534 >> 172.21.15.45:0/49003534 conn(0x7f596806a570 msgr2=0x7f596813d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:43:46.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.874+0000 7f596d8c9640 1 -- 172.21.15.45:0/49003534 shutdown_connections 2023-11-28T18:43:46.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:46.874+0000 7f596d8c9640 1 -- 172.21.15.45:0/49003534 wait complete. 2023-11-28T18:43:46.890 INFO:tasks.ceph.mds.c.smithi045.stderr: -7981> 2023-11-28T18:42:32.283+0000 7f8eaf6cc640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T18:43:46.900 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-28T18:43:46.943 INFO:tasks.ceph.mds.c.smithi045.stdout:starting mds.c at 2023-11-28T18:43:47.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:47.042+0000 7fed79646640 1 Processor -- start 2023-11-28T18:43:47.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:47.042+0000 7fed79646640 1 -- start start 2023-11-28T18:43:47.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:47.046+0000 7fed79646640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fed7415adf0 0x7fed7413d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:47.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:47.046+0000 7fed79646640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed7413d2f0 con 0x7fed7413f630 2023-11-28T18:43:47.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:47.046+0000 7fed79646640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed740cddb0 con 0x7fed74071dd0 2023-11-28T18:43:47.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:47.046+0000 7fed79646640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed74140560 con 0x7fed7415adf0 2023-11-28T18:43:47.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:47.046+0000 7fed737fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fed7413f630 0x7fed740ce240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47652/0 (socket says 172.21.15.45:47652) 2023-11-28T18:43:47.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:47.046+0000 7fed737fe640 1 -- 172.21.15.45:0/3558925831 learned_addr learned my addr 172.21.15.45:0/3558925831 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:43:47.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:47.046+0000 7fed6bfff640 1 --2- 172.21.15.45:0/3558925831 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fed7415adf0 0x7fed7413d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:47.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:47.046+0000 7fed727fc640 1 -- 172.21.15.45:0/3558925831 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2516640721 0 0) 0x7fed7413d2f0 con 0x7fed7413f630 2023-11-28T18:43:47.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:47.046+0000 7fed727fc640 1 -- 172.21.15.45:0/3558925831 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed60003530 con 0x7fed7413f630 2023-11-28T18:43:47.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:47.046+0000 7fed727fc640 1 -- 172.21.15.45:0/3558925831 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 582532074 0 0) 0x7fed740cddb0 con 0x7fed74071dd0 2023-11-28T18:43:47.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:47.046+0000 7fed6bfff640 1 -- 172.21.15.45:0/3558925831 >> v1:172.21.15.190:6789/0 conn(0x7fed74071dd0 legacy=0x7fed740721b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:47.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:47.046+0000 7fed6bfff640 1 -- 172.21.15.45:0/3558925831 >> v1:172.21.15.45:6789/0 conn(0x7fed7413f630 legacy=0x7fed740ce240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:47.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:47.046+0000 7fed6bfff640 1 -- 172.21.15.45:0/3558925831 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed7413ffa0 con 0x7fed7415adf0 2023-11-28T18:43:47.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:47.050+0000 7fed6bfff640 1 --2- 172.21.15.45:0/3558925831 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fed7415adf0 0x7fed7413d5a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fed5c0097f0 tx=0x7fed5c01c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ff73de64226412a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:47.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:47.050+0000 7fed727fc640 1 -- 172.21.15.45:0/3558925831 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5c0ac410 con 0x7fed7415adf0 2023-11-28T18:43:47.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:47.050+0000 7fed727fc640 1 -- 172.21.15.45:0/3558925831 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed5c0ac570 con 0x7fed7415adf0 2023-11-28T18:43:47.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:47.050+0000 7fed727fc640 1 -- 172.21.15.45:0/3558925831 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5c0ac900 con 0x7fed7415adf0 2023-11-28T18:43:47.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:47.050+0000 7fed79646640 1 -- 172.21.15.45:0/3558925831 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fed7415adf0 msgr2=0x7fed7413d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:47.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:47.050+0000 7fed79646640 1 --2- 172.21.15.45:0/3558925831 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fed7415adf0 0x7fed7413d5a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fed5c0097f0 tx=0x7fed5c01c4c0 comp rx=0 tx=0).stop 2023-11-28T18:43:47.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:47.050+0000 7fed79646640 1 -- 172.21.15.45:0/3558925831 shutdown_connections 2023-11-28T18:43:47.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:47.050+0000 7fed79646640 1 --2- 172.21.15.45:0/3558925831 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fed7415adf0 0x7fed7413d5a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:47.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:47.050+0000 7fed79646640 1 -- 172.21.15.45:0/3558925831 >> 172.21.15.45:0/3558925831 conn(0x7fed740b0d00 msgr2=0x7fed740b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:43:47.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:47.050+0000 7fed79646640 1 -- 172.21.15.45:0/3558925831 shutdown_connections 2023-11-28T18:43:47.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:47.050+0000 7fed79646640 1 -- 172.21.15.45:0/3558925831 wait complete. 2023-11-28T18:43:47.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:47.050+0000 7fed79646640 1 Processor -- start 2023-11-28T18:43:47.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:47.050+0000 7fed79646640 1 -- start start 2023-11-28T18:43:47.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:47.054+0000 7fed79646640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fed74071dd0 0x7fed74135200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:47.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:47.054+0000 7fed79646640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fed7413f630 0x7fed740b2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:47.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:47.054+0000 7fed79646640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed7415adf0 0x7fed740b2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:47.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:47.054+0000 7fed79646640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed7415bf80 con 0x7fed7413f630 2023-11-28T18:43:47.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:47.054+0000 7fed79646640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed740b4bd0 con 0x7fed7415adf0 2023-11-28T18:43:47.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:47.054+0000 7fed79646640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed7415c220 con 0x7fed74071dd0 2023-11-28T18:43:47.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:47.054+0000 7fed6bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fed7413f630 0x7fed740b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:47.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:47.054+0000 7fed6bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fed7413f630 0x7fed740b2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38456/0 (socket says 172.21.15.45:38456) 2023-11-28T18:43:47.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:47.054+0000 7fed6bfff640 1 -- 172.21.15.45:0/3884811364 learned_addr learned my addr 172.21.15.45:0/3884811364 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:43:47.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:47.054+0000 7fed737fe640 1 --2- 172.21.15.45:0/3884811364 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed7415adf0 0x7fed740b2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:47.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:47.054+0000 7fed72ffd640 1 --2- 172.21.15.45:0/3884811364 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fed74071dd0 0x7fed74135200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:47.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:47.054+0000 7fed6bfff640 1 -- 172.21.15.45:0/3884811364 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fed74071dd0 msgr2=0x7fed74135200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:47.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:47.054+0000 7fed6bfff640 1 --2- 172.21.15.45:0/3884811364 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fed74071dd0 0x7fed74135200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:47.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:47.054+0000 7fed6bfff640 1 -- 172.21.15.45:0/3884811364 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed7415adf0 msgr2=0x7fed740b2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:47.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:47.054+0000 7fed6bfff640 1 --2- 172.21.15.45:0/3884811364 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed7415adf0 0x7fed740b2b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:47.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:47.054+0000 7fed6bfff640 1 -- 172.21.15.45:0/3884811364 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed5c009420 con 0x7fed7413f630 2023-11-28T18:43:47.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:47.054+0000 7fed737fe640 1 --2- 172.21.15.45:0/3884811364 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed7415adf0 0x7fed740b2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:43:47.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:47.054+0000 7fed72ffd640 1 --2- 172.21.15.45:0/3884811364 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fed74071dd0 0x7fed74135200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:43:47.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:47.054+0000 7fed6bfff640 1 --2- 172.21.15.45:0/3884811364 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fed7413f630 0x7fed740b2620 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fed5c0097f0 tx=0x7fed5c019260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:47.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:47.054+0000 7fed6b7fe640 1 -- 172.21.15.45:0/3884811364 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5c0ace90 con 0x7fed7413f630 2023-11-28T18:43:47.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:47.054+0000 7fed6b7fe640 1 -- 172.21.15.45:0/3884811364 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed5c006e20 con 0x7fed7413f630 2023-11-28T18:43:47.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:47.054+0000 7fed6b7fe640 1 -- 172.21.15.45:0/3884811364 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5c0b5840 con 0x7fed7413f630 2023-11-28T18:43:47.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:47.054+0000 7fed79646640 1 -- 172.21.15.45:0/3884811364 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed7415c500 con 0x7fed7413f630 2023-11-28T18:43:47.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:47.054+0000 7fed79646640 1 -- 172.21.15.45:0/3884811364 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed741511a0 con 0x7fed7413f630 2023-11-28T18:43:47.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:47.054+0000 7fed79646640 1 -- 172.21.15.45:0/3884811364 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed74137d40 con 0x7fed7413f630 2023-11-28T18:43:47.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:47.054+0000 7fed6b7fe640 1 -- 172.21.15.45:0/3884811364 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fed5c0b3040 con 0x7fed7413f630 2023-11-28T18:43:47.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:47.058+0000 7fed6b7fe640 1 --2- 172.21.15.45:0/3884811364 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fed540668d0 0x7fed54068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:47.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:47.058+0000 7fed6b7fe640 1 -- 172.21.15.45:0/3884811364 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5939+0+0 (secure 0 0 0) 0x7fed5c11e570 con 0x7fed7413f630 2023-11-28T18:43:47.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:47.058+0000 7fed72ffd640 1 --2- 172.21.15.45:0/3884811364 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fed540668d0 0x7fed54068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:47.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:47.058+0000 7fed72ffd640 1 --2- 172.21.15.45:0/3884811364 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fed540668d0 0x7fed54068d90 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fed64000f70 tx=0x7fed64009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:47.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:47.062+0000 7fed6b7fe640 1 -- 172.21.15.45:0/3884811364 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fed74137d40 con 0x7fed7413f630 2023-11-28T18:43:47.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:47.250+0000 7fed79646640 1 -- 172.21.15.45:0/3884811364 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fed74137d40 con 0x7fed7413f630 2023-11-28T18:43:47.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:47.874+0000 7fed6b7fe640 1 -- 172.21.15.45:0/3884811364 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v41) v1 ==== 104+0+0 (secure 0 0 0) 0x7fed74137d40 con 0x7fed7413f630 2023-11-28T18:43:47.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:47.874+0000 7fed79646640 1 -- 172.21.15.45:0/3884811364 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fed540668d0 msgr2=0x7fed54068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:47.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:47.874+0000 7fed79646640 1 --2- 172.21.15.45:0/3884811364 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fed540668d0 0x7fed54068d90 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fed64000f70 tx=0x7fed64009040 comp rx=0 tx=0).stop 2023-11-28T18:43:47.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:47.874+0000 7fed79646640 1 -- 172.21.15.45:0/3884811364 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fed7413f630 msgr2=0x7fed740b2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:47.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:47.874+0000 7fed79646640 1 --2- 172.21.15.45:0/3884811364 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fed7413f630 0x7fed740b2620 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fed5c0097f0 tx=0x7fed5c019260 comp rx=0 tx=0).stop 2023-11-28T18:43:47.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:47.874+0000 7fed79646640 1 -- 172.21.15.45:0/3884811364 shutdown_connections 2023-11-28T18:43:47.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:47.874+0000 7fed79646640 1 --2- 172.21.15.45:0/3884811364 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fed540668d0 0x7fed54068d90 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:47.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:47.874+0000 7fed79646640 1 --2- 172.21.15.45:0/3884811364 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed7415adf0 0x7fed740b2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:47.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:47.874+0000 7fed79646640 1 --2- 172.21.15.45:0/3884811364 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fed7413f630 0x7fed740b2620 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:47.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:47.874+0000 7fed79646640 1 --2- 172.21.15.45:0/3884811364 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fed74071dd0 0x7fed74135200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:47.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:47.874+0000 7fed79646640 1 -- 172.21.15.45:0/3884811364 >> 172.21.15.45:0/3884811364 conn(0x7fed740b0d00 msgr2=0x7fed7413c850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:43:47.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:47.874+0000 7fed79646640 1 -- 172.21.15.45:0/3884811364 shutdown_connections 2023-11-28T18:43:47.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:47.874+0000 7fed79646640 1 -- 172.21.15.45:0/3884811364 wait complete. 2023-11-28T18:43:47.905 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-28T18:43:48.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:48.098+0000 7f83127d1640 1 Processor -- start 2023-11-28T18:43:48.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:48.098+0000 7f83127d1640 1 -- start start 2023-11-28T18:43:48.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:48.098+0000 7f83127d1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f830c0ce680 0x7f830c165e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:48.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:48.098+0000 7f83127d1640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f830c15b720 con 0x7f830c0ccea0 2023-11-28T18:43:48.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:48.098+0000 7f83127d1640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f830c0cb590 con 0x7f830c06d730 2023-11-28T18:43:48.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:48.098+0000 7f83127d1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f830c0cb870 con 0x7f830c0ce680 2023-11-28T18:43:48.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:48.098+0000 7f830bfff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f830c0ccea0 0x7f830c0cd280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:60826/0 (socket says 172.21.15.45:60826) 2023-11-28T18:43:48.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:48.098+0000 7f830bfff640 1 -- 172.21.15.45:0/332416263 learned_addr learned my addr 172.21.15.45:0/332416263 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:43:48.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:48.098+0000 7f8310d6e640 1 --2- 172.21.15.45:0/332416263 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f830c0ce680 0x7f830c165e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:48.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:48.102+0000 7f830affd640 1 -- 172.21.15.45:0/332416263 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3176993727 0 0) 0x7f830c15b720 con 0x7f830c0ccea0 2023-11-28T18:43:48.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:48.102+0000 7f830affd640 1 -- 172.21.15.45:0/332416263 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82f4003530 con 0x7f830c0ccea0 2023-11-28T18:43:48.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:48.102+0000 7f830affd640 1 -- 172.21.15.45:0/332416263 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1093632198 0 0) 0x7f830c0cb590 con 0x7f830c06d730 2023-11-28T18:43:48.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:48.102+0000 7f830affd640 1 -- 172.21.15.45:0/332416263 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f830c15b720 con 0x7f830c06d730 2023-11-28T18:43:48.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:48.102+0000 7f8310d6e640 1 -- 172.21.15.45:0/332416263 >> v1:172.21.15.190:6789/0 conn(0x7f830c06d730 legacy=0x7f830c0cdf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:48.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:48.102+0000 7f8310d6e640 1 -- 172.21.15.45:0/332416263 >> v1:172.21.15.45:6789/0 conn(0x7f830c0ccea0 legacy=0x7f830c0cd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:48.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:48.102+0000 7f8310d6e640 1 -- 172.21.15.45:0/332416263 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f830c0cbb50 con 0x7f830c0ce680 2023-11-28T18:43:48.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:48.102+0000 7f8310d6e640 1 --2- 172.21.15.45:0/332416263 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f830c0ce680 0x7f830c165e90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8304009dc0 tx=0x7f830401c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1913d6c466d5c42 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:48.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:48.102+0000 7f830affd640 1 -- 172.21.15.45:0/332416263 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83040a5a00 con 0x7f830c0ce680 2023-11-28T18:43:48.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:48.102+0000 7f830affd640 1 -- 172.21.15.45:0/332416263 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83040a5b60 con 0x7f830c0ce680 2023-11-28T18:43:48.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:48.102+0000 7f830affd640 1 -- 172.21.15.45:0/332416263 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83040ad440 con 0x7f830c0ce680 2023-11-28T18:43:48.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:48.102+0000 7f83127d1640 1 -- 172.21.15.45:0/332416263 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f830c0ce680 msgr2=0x7f830c165e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:48.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:48.102+0000 7f83127d1640 1 --2- 172.21.15.45:0/332416263 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f830c0ce680 0x7f830c165e90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8304009dc0 tx=0x7f830401c940 comp rx=0 tx=0).stop 2023-11-28T18:43:48.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:48.106+0000 7f83127d1640 1 -- 172.21.15.45:0/332416263 shutdown_connections 2023-11-28T18:43:48.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:48.106+0000 7f83127d1640 1 --2- 172.21.15.45:0/332416263 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f830c0ce680 0x7f830c165e90 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:48.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:48.106+0000 7f83127d1640 1 -- 172.21.15.45:0/332416263 >> 172.21.15.45:0/332416263 conn(0x7f830c0b0c90 msgr2=0x7f830c0b10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:43:48.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:48.106+0000 7f83127d1640 1 -- 172.21.15.45:0/332416263 shutdown_connections 2023-11-28T18:43:48.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:48.106+0000 7f83127d1640 1 -- 172.21.15.45:0/332416263 wait complete. 2023-11-28T18:43:48.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:48.106+0000 7f83127d1640 1 Processor -- start 2023-11-28T18:43:48.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:48.106+0000 7f83127d1640 1 -- start start 2023-11-28T18:43:48.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:48.106+0000 7f83127d1640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f830c06d730 0x7f830c14d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:48.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:48.106+0000 7f83127d1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f830c0ccea0 0x7f830c1526f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:48.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:48.106+0000 7f83127d1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f830c14dae0 0x7f830c152c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:48.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:48.106+0000 7f83127d1640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f830c154be0 con 0x7f830c14dae0 2023-11-28T18:43:48.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:48.106+0000 7f83127d1640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f830c154620 con 0x7f830c06d730 2023-11-28T18:43:48.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:48.106+0000 7f83127d1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f830c154900 con 0x7f830c0ccea0 2023-11-28T18:43:48.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:48.106+0000 7f8310d6e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f830c14dae0 0x7f830c152c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:48.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:48.106+0000 7f8310d6e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f830c14dae0 0x7f830c152c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45740/0 (socket says 172.21.15.45:45740) 2023-11-28T18:43:48.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:48.106+0000 7f8310d6e640 1 -- 172.21.15.45:0/3664758166 learned_addr learned my addr 172.21.15.45:0/3664758166 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:43:48.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:48.106+0000 7f830bfff640 1 --2- 172.21.15.45:0/3664758166 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f830c06d730 0x7f830c14d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:48.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:48.106+0000 7f830b7fe640 1 --2- 172.21.15.45:0/3664758166 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f830c0ccea0 0x7f830c1526f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:48.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:48.106+0000 7f8310d6e640 1 -- 172.21.15.45:0/3664758166 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f830c0ccea0 msgr2=0x7f830c1526f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:48.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:48.106+0000 7f8310d6e640 1 --2- 172.21.15.45:0/3664758166 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f830c0ccea0 0x7f830c1526f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:48.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:48.106+0000 7f8310d6e640 1 -- 172.21.15.45:0/3664758166 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f830c06d730 msgr2=0x7f830c14d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:48.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:48.106+0000 7f8310d6e640 1 --2- 172.21.15.45:0/3664758166 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f830c06d730 0x7f830c14d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:48.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:48.106+0000 7f8310d6e640 1 -- 172.21.15.45:0/3664758166 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8304009a70 con 0x7f830c14dae0 2023-11-28T18:43:48.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:48.106+0000 7f830b7fe640 1 --2- 172.21.15.45:0/3664758166 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f830c0ccea0 0x7f830c1526f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:43:48.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:48.106+0000 7f8310d6e640 1 --2- 172.21.15.45:0/3664758166 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f830c14dae0 0x7f830c152c30 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f830401a570 tx=0x7f83040196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:48.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:48.110+0000 7f8308ff9640 1 -- 172.21.15.45:0/3664758166 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83040adca0 con 0x7f830c14dae0 2023-11-28T18:43:48.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:48.110+0000 7f8308ff9640 1 -- 172.21.15.45:0/3664758166 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83040ade00 con 0x7f830c14dae0 2023-11-28T18:43:48.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:48.110+0000 7f8308ff9640 1 -- 172.21.15.45:0/3664758166 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83040b9690 con 0x7f830c14dae0 2023-11-28T18:43:48.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:48.110+0000 7f83127d1640 1 -- 172.21.15.45:0/3664758166 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f830c156a30 con 0x7f830c14dae0 2023-11-28T18:43:48.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:48.110+0000 7f83127d1640 1 -- 172.21.15.45:0/3664758166 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f830c15b0f0 con 0x7f830c14dae0 2023-11-28T18:43:48.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:48.110+0000 7f83127d1640 1 -- 172.21.15.45:0/3664758166 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f830c04e890 con 0x7f830c14dae0 2023-11-28T18:43:48.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:48.110+0000 7f8308ff9640 1 -- 172.21.15.45:0/3664758166 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f83040b97f0 con 0x7f830c14dae0 2023-11-28T18:43:48.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:48.110+0000 7f8308ff9640 1 --2- 172.21.15.45:0/3664758166 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f82f80668d0 0x7f82f8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:48.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:48.110+0000 7f8308ff9640 1 -- 172.21.15.45:0/3664758166 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5939+0+0 (secure 0 0 0) 0x7f830411fbd0 con 0x7f830c14dae0 2023-11-28T18:43:48.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:48.110+0000 7f830bfff640 1 --2- 172.21.15.45:0/3664758166 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f82f80668d0 0x7f82f8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:48.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:48.114+0000 7f830bfff640 1 --2- 172.21.15.45:0/3664758166 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f82f80668d0 0x7f82f8068d90 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f82fc000f70 tx=0x7f82fc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:48.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:48.114+0000 7f8308ff9640 1 -- 172.21.15.45:0/3664758166 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f83040ecd40 con 0x7f830c14dae0 2023-11-28T18:43:48.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:48.278+0000 7f83127d1640 1 -- 172.21.15.45:0/3664758166 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f830c069410 con 0x7f830c14dae0 2023-11-28T18:43:49.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.190+0000 7f8308ff9640 1 -- 172.21.15.45:0/3664758166 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v51) v1 ==== 181+0+0 (secure 0 0 0) 0x7f8304009450 con 0x7f830c14dae0 2023-11-28T18:43:49.195 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' removed 2023-11-28T18:43:49.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.194+0000 7f83127d1640 1 -- 172.21.15.45:0/3664758166 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f82f80668d0 msgr2=0x7f82f8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:49.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.194+0000 7f83127d1640 1 --2- 172.21.15.45:0/3664758166 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f82f80668d0 0x7f82f8068d90 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f82fc000f70 tx=0x7f82fc009040 comp rx=0 tx=0).stop 2023-11-28T18:43:49.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.194+0000 7f83127d1640 1 -- 172.21.15.45:0/3664758166 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f830c14dae0 msgr2=0x7f830c152c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:49.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.194+0000 7f83127d1640 1 --2- 172.21.15.45:0/3664758166 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f830c14dae0 0x7f830c152c30 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f830401a570 tx=0x7f83040196e0 comp rx=0 tx=0).stop 2023-11-28T18:43:49.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.194+0000 7f83127d1640 1 -- 172.21.15.45:0/3664758166 shutdown_connections 2023-11-28T18:43:49.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.194+0000 7f83127d1640 1 --2- 172.21.15.45:0/3664758166 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f82f80668d0 0x7f82f8068d90 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:49.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.194+0000 7f83127d1640 1 --2- 172.21.15.45:0/3664758166 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f830c14dae0 0x7f830c152c30 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:49.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.194+0000 7f83127d1640 1 --2- 172.21.15.45:0/3664758166 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f830c0ccea0 0x7f830c1526f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:49.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.194+0000 7f83127d1640 1 --2- 172.21.15.45:0/3664758166 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f830c06d730 0x7f830c14d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:49.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.194+0000 7f83127d1640 1 -- 172.21.15.45:0/3664758166 >> 172.21.15.45:0/3664758166 conn(0x7f830c0b0c90 msgr2=0x7f830c0cef80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:43:49.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.194+0000 7f83127d1640 1 -- 172.21.15.45:0/3664758166 shutdown_connections 2023-11-28T18:43:49.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.194+0000 7f83127d1640 1 -- 172.21.15.45:0/3664758166 wait complete. 2023-11-28T18:43:49.225 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-28T18:43:49.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.370+0000 7fd54fe6b640 1 Processor -- start 2023-11-28T18:43:49.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.370+0000 7fd54fe6b640 1 -- start start 2023-11-28T18:43:49.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.374+0000 7fd54fe6b640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd5480ae660 0x7fd5480ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:49.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.374+0000 7fd54fe6b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd54806d730 0x7fd54806dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:49.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.374+0000 7fd54fe6b640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5480ce3b0 con 0x7fd54815a4c0 2023-11-28T18:43:49.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.374+0000 7fd54fe6b640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5480cd5b0 con 0x7fd5480ae660 2023-11-28T18:43:49.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.374+0000 7fd54fe6b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd54806e0e0 con 0x7fd54806d730 2023-11-28T18:43:49.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.374+0000 7fd54dc07640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd54815a4c0 0x7fd5480ccea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:60834/0 (socket says 172.21.15.45:60834) 2023-11-28T18:43:49.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.374+0000 7fd54dc07640 1 -- 172.21.15.45:0/2871770177 learned_addr learned my addr 172.21.15.45:0/2871770177 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:43:49.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.374+0000 7fd54d406640 1 --2- 172.21.15.45:0/2871770177 >> v2:172.21.15.190:3300/0 conn(0x7fd5480ae660 0x7fd5480ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:49.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.374+0000 7fd54e408640 1 --2- 172.21.15.45:0/2871770177 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd54806d730 0x7fd54806dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:49.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.374+0000 7fd54cc05640 1 -- 172.21.15.45:0/2871770177 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 223646181 0 0) 0x7fd5480ce3b0 con 0x7fd54815a4c0 2023-11-28T18:43:49.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.374+0000 7fd54cc05640 1 -- 172.21.15.45:0/2871770177 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd534003530 con 0x7fd54815a4c0 2023-11-28T18:43:49.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.374+0000 7fd54d406640 1 -- 172.21.15.45:0/2871770177 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd54806d730 msgr2=0x7fd54806dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:43:49.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.374+0000 7fd54d406640 1 --2- 172.21.15.45:0/2871770177 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd54806d730 0x7fd54806dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:49.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.374+0000 7fd54d406640 1 -- 172.21.15.45:0/2871770177 >> v1:172.21.15.45:6789/0 conn(0x7fd54815a4c0 legacy=0x7fd5480ccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:49.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.374+0000 7fd54d406640 1 -- 172.21.15.45:0/2871770177 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5480cd7a0 con 0x7fd5480ae660 2023-11-28T18:43:49.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.374+0000 7fd54e408640 1 --2- 172.21.15.45:0/2871770177 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd54806d730 0x7fd54806dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:43:49.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.378+0000 7fd54d406640 1 --2- 172.21.15.45:0/2871770177 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd5480ae660 0x7fd5480ce840 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fd5380097f0 tx=0x7fd53801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ff68d6c87a41b5c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:49.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.378+0000 7fd54cc05640 1 -- 172.21.15.45:0/2871770177 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5380ab680 con 0x7fd5480ae660 2023-11-28T18:43:49.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.378+0000 7fd54cc05640 1 -- 172.21.15.45:0/2871770177 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5380ab7e0 con 0x7fd5480ae660 2023-11-28T18:43:49.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.378+0000 7fd54cc05640 1 -- 172.21.15.45:0/2871770177 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5380abb70 con 0x7fd5480ae660 2023-11-28T18:43:49.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.378+0000 7fd54fe6b640 1 -- 172.21.15.45:0/2871770177 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd5480ae660 msgr2=0x7fd5480ce840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:49.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.378+0000 7fd54fe6b640 1 --2- 172.21.15.45:0/2871770177 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd5480ae660 0x7fd5480ce840 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fd5380097f0 tx=0x7fd53801c480 comp rx=0 tx=0).stop 2023-11-28T18:43:49.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.378+0000 7fd54fe6b640 1 -- 172.21.15.45:0/2871770177 shutdown_connections 2023-11-28T18:43:49.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.378+0000 7fd54fe6b640 1 --2- 172.21.15.45:0/2871770177 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd54806d730 0x7fd54806dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:49.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.378+0000 7fd54fe6b640 1 --2- 172.21.15.45:0/2871770177 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd5480ae660 0x7fd5480ce840 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:49.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.378+0000 7fd54fe6b640 1 -- 172.21.15.45:0/2871770177 >> 172.21.15.45:0/2871770177 conn(0x7fd5480b0c90 msgr2=0x7fd5480b10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:43:49.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.378+0000 7fd54fe6b640 1 -- 172.21.15.45:0/2871770177 shutdown_connections 2023-11-28T18:43:49.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.378+0000 7fd54fe6b640 1 -- 172.21.15.45:0/2871770177 wait complete. 2023-11-28T18:43:49.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.382+0000 7fd54fe6b640 1 Processor -- start 2023-11-28T18:43:49.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.382+0000 7fd54fe6b640 1 -- start start 2023-11-28T18:43:49.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.382+0000 7fd54fe6b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd54806d730 0x7fd54813f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:49.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.382+0000 7fd54fe6b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd5480ae660 0x7fd54806c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:49.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.382+0000 7fd54fe6b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd54815a4c0 0x7fd54806cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:49.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.382+0000 7fd54fe6b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd54815b330 con 0x7fd54815a4c0 2023-11-28T18:43:49.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.382+0000 7fd54fe6b640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd548140010 con 0x7fd5480ae660 2023-11-28T18:43:49.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.382+0000 7fd54fe6b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd54813fb10 con 0x7fd54806d730 2023-11-28T18:43:49.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.382+0000 7fd54e408640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd54815a4c0 0x7fd54806cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:49.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.382+0000 7fd54e408640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd54815a4c0 0x7fd54806cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45756/0 (socket says 172.21.15.45:45756) 2023-11-28T18:43:49.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.382+0000 7fd54d406640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd5480ae660 0x7fd54806c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:49.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.382+0000 7fd54e408640 1 -- 172.21.15.45:0/3281554230 learned_addr learned my addr 172.21.15.45:0/3281554230 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:43:49.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.382+0000 7fd54dc07640 1 --2- 172.21.15.45:0/3281554230 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd54806d730 0x7fd54813f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:49.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.382+0000 7fd54e408640 1 -- 172.21.15.45:0/3281554230 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd54806d730 msgr2=0x7fd54813f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:49.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.382+0000 7fd54e408640 1 --2- 172.21.15.45:0/3281554230 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd54806d730 0x7fd54813f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:49.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.382+0000 7fd54e408640 1 -- 172.21.15.45:0/3281554230 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd5480ae660 msgr2=0x7fd54806c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:49.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.382+0000 7fd54e408640 1 --2- 172.21.15.45:0/3281554230 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd5480ae660 0x7fd54806c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:49.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.382+0000 7fd54e408640 1 -- 172.21.15.45:0/3281554230 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd540009a70 con 0x7fd54815a4c0 2023-11-28T18:43:49.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.382+0000 7fd54e408640 1 --2- 172.21.15.45:0/3281554230 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd54815a4c0 0x7fd54806cb60 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fd540009db0 tx=0x7fd54000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:49.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.382+0000 7fd53e7fc640 1 -- 172.21.15.45:0/3281554230 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd540009c20 con 0x7fd54815a4c0 2023-11-28T18:43:49.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.382+0000 7fd53e7fc640 1 -- 172.21.15.45:0/3281554230 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd54000f040 con 0x7fd54815a4c0 2023-11-28T18:43:49.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.382+0000 7fd54fe6b640 1 -- 172.21.15.45:0/3281554230 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd538009420 con 0x7fd54815a4c0 2023-11-28T18:43:49.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.382+0000 7fd53e7fc640 1 -- 172.21.15.45:0/3281554230 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5400039a0 con 0x7fd54815a4c0 2023-11-28T18:43:49.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.382+0000 7fd54fe6b640 1 -- 172.21.15.45:0/3281554230 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5481581d0 con 0x7fd54815a4c0 2023-11-28T18:43:49.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.382+0000 7fd54fe6b640 1 -- 172.21.15.45:0/3281554230 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd54804e890 con 0x7fd54815a4c0 2023-11-28T18:43:49.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.386+0000 7fd53e7fc640 1 -- 172.21.15.45:0/3281554230 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fd540014480 con 0x7fd54815a4c0 2023-11-28T18:43:49.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.386+0000 7fd53e7fc640 1 --2- 172.21.15.45:0/3281554230 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fd52c066900 0x7fd52c068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:49.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.386+0000 7fd53e7fc640 1 -- 172.21.15.45:0/3281554230 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5501+0+0 (secure 0 0 0) 0x7fd540084df0 con 0x7fd54815a4c0 2023-11-28T18:43:49.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.386+0000 7fd54dc07640 1 --2- 172.21.15.45:0/3281554230 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fd52c066900 0x7fd52c068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:49.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.386+0000 7fd54dc07640 1 --2- 172.21.15.45:0/3281554230 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fd52c066900 0x7fd52c068dc0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fd5440011f0 tx=0x7fd544007d40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:49.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.390+0000 7fd53e7fc640 1 -- 172.21.15.45:0/3281554230 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd540052110 con 0x7fd54815a4c0 2023-11-28T18:43:49.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:49.546+0000 7fd54fe6b640 1 -- 172.21.15.45:0/3281554230 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd548069410 con 0x7fd54815a4c0 2023-11-28T18:43:50.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.198+0000 7fd53e7fc640 1 -- 172.21.15.45:0/3281554230 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v52) v1 ==== 169+0+0 (secure 0 0 0) 0x7fd540055730 con 0x7fd54815a4c0 2023-11-28T18:43:50.202 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' removed 2023-11-28T18:43:50.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.198+0000 7fd54fe6b640 1 -- 172.21.15.45:0/3281554230 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fd52c066900 msgr2=0x7fd52c068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:50.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.198+0000 7fd54fe6b640 1 --2- 172.21.15.45:0/3281554230 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fd52c066900 0x7fd52c068dc0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fd5440011f0 tx=0x7fd544007d40 comp rx=0 tx=0).stop 2023-11-28T18:43:50.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.198+0000 7fd54fe6b640 1 -- 172.21.15.45:0/3281554230 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd54815a4c0 msgr2=0x7fd54806cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:50.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.198+0000 7fd54fe6b640 1 --2- 172.21.15.45:0/3281554230 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd54815a4c0 0x7fd54806cb60 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fd540009db0 tx=0x7fd54000c490 comp rx=0 tx=0).stop 2023-11-28T18:43:50.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.202+0000 7fd54fe6b640 1 -- 172.21.15.45:0/3281554230 shutdown_connections 2023-11-28T18:43:50.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.202+0000 7fd54fe6b640 1 --2- 172.21.15.45:0/3281554230 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fd52c066900 0x7fd52c068dc0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:50.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.202+0000 7fd54fe6b640 1 --2- 172.21.15.45:0/3281554230 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd54815a4c0 0x7fd54806cb60 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:50.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.202+0000 7fd54fe6b640 1 --2- 172.21.15.45:0/3281554230 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd5480ae660 0x7fd54806c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:50.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.202+0000 7fd54fe6b640 1 --2- 172.21.15.45:0/3281554230 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd54806d730 0x7fd54813f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:50.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.202+0000 7fd54fe6b640 1 -- 172.21.15.45:0/3281554230 >> 172.21.15.45:0/3281554230 conn(0x7fd5480b0c90 msgr2=0x7fd5480ccea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:43:50.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.202+0000 7fd54fe6b640 1 -- 172.21.15.45:0/3281554230 shutdown_connections 2023-11-28T18:43:50.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.202+0000 7fd54fe6b640 1 -- 172.21.15.45:0/3281554230 wait complete. 2023-11-28T18:43:50.230 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-28T18:43:50.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.370+0000 7ff6cc3d8640 1 Processor -- start 2023-11-28T18:43:50.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.370+0000 7ff6cc3d8640 1 -- start start 2023-11-28T18:43:50.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.370+0000 7ff6cc3d8640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff6c4158ce0 0x7ff6c415eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:50.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.374+0000 7ff6cc3d8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff6c40cba50 0x7ff6c415be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:50.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.374+0000 7ff6cc3d8640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6c415b6b0 con 0x7ff6c40b4310 2023-11-28T18:43:50.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.374+0000 7ff6cc3d8640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6c415f450 con 0x7ff6c40cba50 2023-11-28T18:43:50.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.374+0000 7ff6cc3d8640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6c415f730 con 0x7ff6c4158ce0 2023-11-28T18:43:50.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.374+0000 7ff6c9973640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff6c40cba50 0x7ff6c415be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:50.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.374+0000 7ff6ca975640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff6c40b4310 0x7ff6c4070430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:60844/0 (socket says 172.21.15.45:60844) 2023-11-28T18:43:50.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.374+0000 7ff6ca975640 1 -- 172.21.15.45:0/2144438524 learned_addr learned my addr 172.21.15.45:0/2144438524 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:43:50.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.374+0000 7ff6c9973640 1 -- 172.21.15.45:0/2144438524 >> v2:172.21.15.190:3300/0 conn(0x7ff6c4158ce0 msgr2=0x7ff6c415eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:43:50.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.374+0000 7ff6ca174640 1 --2- 172.21.15.45:0/2144438524 >> v2:172.21.15.190:3300/0 conn(0x7ff6c4158ce0 0x7ff6c415eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:50.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.374+0000 7ff6c9973640 1 --2- 172.21.15.45:0/2144438524 >> v2:172.21.15.190:3300/0 conn(0x7ff6c4158ce0 0x7ff6c415eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:50.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.374+0000 7ff6c9172640 1 -- 172.21.15.45:0/2144438524 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3910106611 0 0) 0x7ff6c415b6b0 con 0x7ff6c40b4310 2023-11-28T18:43:50.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.374+0000 7ff6c9973640 1 -- 172.21.15.45:0/2144438524 >> v1:172.21.15.45:6789/0 conn(0x7ff6c40b4310 legacy=0x7ff6c4070430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:50.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.374+0000 7ff6c9973640 1 -- 172.21.15.45:0/2144438524 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c415b920 con 0x7ff6c40cba50 2023-11-28T18:43:50.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.374+0000 7ff6ca174640 1 --2- 172.21.15.45:0/2144438524 >> v2:172.21.15.190:3300/0 conn(0x7ff6c4158ce0 0x7ff6c415eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:43:50.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.374+0000 7ff6c9973640 1 --2- 172.21.15.45:0/2144438524 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6c40cba50 0x7ff6c415be40 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7ff6c4067fb0 tx=0x7ff6b401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1ef0db1a31e7d1a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:50.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.378+0000 7ff6c9172640 1 -- 172.21.15.45:0/2144438524 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b40ab680 con 0x7ff6c40cba50 2023-11-28T18:43:50.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.378+0000 7ff6c9172640 1 -- 172.21.15.45:0/2144438524 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b40ab7e0 con 0x7ff6c40cba50 2023-11-28T18:43:50.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.378+0000 7ff6c9172640 1 -- 172.21.15.45:0/2144438524 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b40abb70 con 0x7ff6c40cba50 2023-11-28T18:43:50.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.378+0000 7ff6cc3d8640 1 -- 172.21.15.45:0/2144438524 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6c40cba50 msgr2=0x7ff6c415be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:50.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.378+0000 7ff6cc3d8640 1 --2- 172.21.15.45:0/2144438524 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6c40cba50 0x7ff6c415be40 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7ff6c4067fb0 tx=0x7ff6b401c460 comp rx=0 tx=0).stop 2023-11-28T18:43:50.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.378+0000 7ff6cc3d8640 1 -- 172.21.15.45:0/2144438524 shutdown_connections 2023-11-28T18:43:50.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.378+0000 7ff6cc3d8640 1 --2- 172.21.15.45:0/2144438524 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6c40cba50 0x7ff6c415be40 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:50.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.378+0000 7ff6cc3d8640 1 --2- 172.21.15.45:0/2144438524 >> v2:172.21.15.190:3300/0 conn(0x7ff6c4158ce0 0x7ff6c415eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:50.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.378+0000 7ff6cc3d8640 1 -- 172.21.15.45:0/2144438524 >> 172.21.15.45:0/2144438524 conn(0x7ff6c40b0d00 msgr2=0x7ff6c40b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:43:50.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.378+0000 7ff6cc3d8640 1 -- 172.21.15.45:0/2144438524 shutdown_connections 2023-11-28T18:43:50.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.378+0000 7ff6cc3d8640 1 -- 172.21.15.45:0/2144438524 wait complete. 2023-11-28T18:43:50.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.382+0000 7ff6cc3d8640 1 Processor -- start 2023-11-28T18:43:50.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.382+0000 7ff6cc3d8640 1 -- start start 2023-11-28T18:43:50.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.382+0000 7ff6cc3d8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6c40b4310 0x7ff6c414ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:50.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.382+0000 7ff6cc3d8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6c40cba50 0x7ff6c4156b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:50.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.382+0000 7ff6cc3d8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff6c4158ce0 0x7ff6c4157060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:50.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.382+0000 7ff6cc3d8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c4151030 con 0x7ff6c40cba50 2023-11-28T18:43:50.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.382+0000 7ff6cc3d8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c4153f90 con 0x7ff6c40b4310 2023-11-28T18:43:50.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.382+0000 7ff6cc3d8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c415eed0 con 0x7ff6c4158ce0 2023-11-28T18:43:50.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.382+0000 7ff6ca975640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff6c4158ce0 0x7ff6c4157060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:50.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.382+0000 7ff6ca174640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6c40b4310 0x7ff6c414ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:50.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.382+0000 7ff6ca174640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6c40b4310 0x7ff6c414ff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.45:33636/0 (socket says 172.21.15.45:33636) 2023-11-28T18:43:50.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.382+0000 7ff6ca174640 1 -- 172.21.15.45:0/3226248613 learned_addr learned my addr 172.21.15.45:0/3226248613 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:43:50.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.382+0000 7ff6c9973640 1 --2- 172.21.15.45:0/3226248613 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6c40cba50 0x7ff6c4156b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:50.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.382+0000 7ff6c9973640 1 -- 172.21.15.45:0/3226248613 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff6c4158ce0 msgr2=0x7ff6c4157060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:50.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.382+0000 7ff6c9973640 1 --2- 172.21.15.45:0/3226248613 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff6c4158ce0 0x7ff6c4157060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:50.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.382+0000 7ff6c9973640 1 -- 172.21.15.45:0/3226248613 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6c40b4310 msgr2=0x7ff6c414ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:50.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.386+0000 7ff6c9973640 1 --2- 172.21.15.45:0/3226248613 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6c40b4310 0x7ff6c414ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:50.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.386+0000 7ff6c9973640 1 -- 172.21.15.45:0/3226248613 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b4009420 con 0x7ff6c40cba50 2023-11-28T18:43:50.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.386+0000 7ff6ca174640 1 --2- 172.21.15.45:0/3226248613 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6c40b4310 0x7ff6c414ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:43:50.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.386+0000 7ff6c9973640 1 --2- 172.21.15.45:0/3226248613 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6c40cba50 0x7ff6c4156b20 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7ff6b40ac000 tx=0x7ff6b401aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:50.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.386+0000 7ff6baffd640 1 -- 172.21.15.45:0/3226248613 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b40b5810 con 0x7ff6c40cba50 2023-11-28T18:43:50.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.386+0000 7ff6baffd640 1 -- 172.21.15.45:0/3226248613 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b40b59b0 con 0x7ff6c40cba50 2023-11-28T18:43:50.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.386+0000 7ff6baffd640 1 -- 172.21.15.45:0/3226248613 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b40b5d60 con 0x7ff6c40cba50 2023-11-28T18:43:50.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.386+0000 7ff6cc3d8640 1 -- 172.21.15.45:0/3226248613 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6c4154420 con 0x7ff6c40cba50 2023-11-28T18:43:50.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.386+0000 7ff6cc3d8640 1 -- 172.21.15.45:0/3226248613 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6c4153940 con 0x7ff6c40cba50 2023-11-28T18:43:50.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.386+0000 7ff6cc3d8640 1 -- 172.21.15.45:0/3226248613 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6c4154120 con 0x7ff6c40cba50 2023-11-28T18:43:50.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.390+0000 7ff6baffd640 1 -- 172.21.15.45:0/3226248613 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ff6b40b4390 con 0x7ff6c40cba50 2023-11-28T18:43:50.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.390+0000 7ff6baffd640 1 --2- 172.21.15.45:0/3226248613 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff6a80668d0 0x7ff6a8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:50.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.390+0000 7ff6baffd640 1 -- 172.21.15.45:0/3226248613 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5029+0+0 (secure 0 0 0) 0x7ff6b411ef80 con 0x7ff6c40cba50 2023-11-28T18:43:50.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.390+0000 7ff6ca174640 1 --2- 172.21.15.45:0/3226248613 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff6a80668d0 0x7ff6a8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:50.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.390+0000 7ff6ca174640 1 --2- 172.21.15.45:0/3226248613 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff6a80668d0 0x7ff6a8068d90 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ff6c0006fd0 tx=0x7ff6c0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:50.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.394+0000 7ff6baffd640 1 -- 172.21.15.45:0/3226248613 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff6b40ec500 con 0x7ff6c40cba50 2023-11-28T18:43:50.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.562+0000 7ff6cc3d8640 1 -- 172.21.15.45:0/3226248613 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7ff6c4069410 con 0x7ff6c40cba50 2023-11-28T18:43:50.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.566+0000 7ff6baffd640 1 -- 172.21.15.45:0/3226248613 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff6b40efb20 con 0x7ff6c40cba50 2023-11-28T18:43:50.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.570+0000 7ff6cc3d8640 1 -- 172.21.15.45:0/3226248613 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff6a80668d0 msgr2=0x7ff6a8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:50.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.570+0000 7ff6cc3d8640 1 --2- 172.21.15.45:0/3226248613 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff6a80668d0 0x7ff6a8068d90 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ff6c0006fd0 tx=0x7ff6c0008040 comp rx=0 tx=0).stop 2023-11-28T18:43:50.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.570+0000 7ff6cc3d8640 1 -- 172.21.15.45:0/3226248613 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6c40cba50 msgr2=0x7ff6c4156b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:50.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.570+0000 7ff6cc3d8640 1 --2- 172.21.15.45:0/3226248613 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6c40cba50 0x7ff6c4156b20 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7ff6b40ac000 tx=0x7ff6b401aca0 comp rx=0 tx=0).stop 2023-11-28T18:43:50.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.570+0000 7ff6cc3d8640 1 -- 172.21.15.45:0/3226248613 shutdown_connections 2023-11-28T18:43:50.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.570+0000 7ff6cc3d8640 1 --2- 172.21.15.45:0/3226248613 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff6a80668d0 0x7ff6a8068d90 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:50.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.570+0000 7ff6cc3d8640 1 --2- 172.21.15.45:0/3226248613 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff6c4158ce0 0x7ff6c4157060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:50.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.570+0000 7ff6cc3d8640 1 --2- 172.21.15.45:0/3226248613 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6c40cba50 0x7ff6c4156b20 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:50.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.570+0000 7ff6cc3d8640 1 --2- 172.21.15.45:0/3226248613 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6c40b4310 0x7ff6c414ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:50.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.570+0000 7ff6cc3d8640 1 -- 172.21.15.45:0/3226248613 >> 172.21.15.45:0/3226248613 conn(0x7ff6c40b0d00 msgr2=0x7ff6c40b0400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:43:50.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.570+0000 7ff6cc3d8640 1 -- 172.21.15.45:0/3226248613 shutdown_connections 2023-11-28T18:43:50.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.570+0000 7ff6cc3d8640 1 -- 172.21.15.45:0/3226248613 wait complete. 2023-11-28T18:43:50.594 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_journal_repair.TestJournalRepair.test_journal_smoke' 2023-11-28T18:43:50.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.734+0000 7f277dd96640 1 Processor -- start 2023-11-28T18:43:50.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.734+0000 7f277dd96640 1 -- start start 2023-11-28T18:43:50.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.734+0000 7f277dd96640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f277806cdf0 0x7f2778150290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:50.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.734+0000 7f277dd96640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f277806d1d0 0x7f27781507d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:50.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.734+0000 7f277dd96640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27780704a0 con 0x7f2778159de0 2023-11-28T18:43:50.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.734+0000 7f277dd96640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2778150d10 con 0x7f277806d1d0 2023-11-28T18:43:50.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.734+0000 7f277dd96640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f277815a8d0 con 0x7f277806cdf0 2023-11-28T18:43:50.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.734+0000 7f276ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f277806d1d0 0x7f27781507d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:50.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.734+0000 7f2777fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f2778159de0 0x7f277815a1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:60858/0 (socket says 172.21.15.45:60858) 2023-11-28T18:43:50.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.734+0000 7f2777fff640 1 -- 172.21.15.45:0/2429419914 learned_addr learned my addr 172.21.15.45:0/2429419914 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:43:50.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.734+0000 7f276ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f277806d1d0 0x7f27781507d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45786/0 (socket says 172.21.15.45:45786) 2023-11-28T18:43:50.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.734+0000 7f27777fe640 1 --2- 172.21.15.45:0/2429419914 >> v2:172.21.15.190:3300/0 conn(0x7f277806cdf0 0x7f2778150290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:50.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.734+0000 7f276ffff640 1 -- 172.21.15.45:0/2429419914 >> v2:172.21.15.190:3300/0 conn(0x7f277806cdf0 msgr2=0x7f2778150290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:43:50.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.734+0000 7f276ffff640 1 --2- 172.21.15.45:0/2429419914 >> v2:172.21.15.190:3300/0 conn(0x7f277806cdf0 0x7f2778150290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:50.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.734+0000 7f2776ffd640 1 -- 172.21.15.45:0/2429419914 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 53153350 0 0) 0x7f27780704a0 con 0x7f2778159de0 2023-11-28T18:43:50.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.734+0000 7f276ffff640 1 -- 172.21.15.45:0/2429419914 >> v1:172.21.15.45:6789/0 conn(0x7f2778159de0 legacy=0x7f277815a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:50.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.734+0000 7f276ffff640 1 -- 172.21.15.45:0/2429419914 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f277815ab60 con 0x7f277806d1d0 2023-11-28T18:43:50.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.738+0000 7f276ffff640 1 --2- 172.21.15.45:0/2429419914 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f277806d1d0 0x7f27781507d0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f27780673d0 tx=0x7f276001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e27753f386779952 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:50.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.738+0000 7f2776ffd640 1 -- 172.21.15.45:0/2429419914 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2760004230 con 0x7f277806d1d0 2023-11-28T18:43:50.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.738+0000 7f2776ffd640 1 -- 172.21.15.45:0/2429419914 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27600a7050 con 0x7f277806d1d0 2023-11-28T18:43:50.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.738+0000 7f2776ffd640 1 -- 172.21.15.45:0/2429419914 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2760003620 con 0x7f277806d1d0 2023-11-28T18:43:50.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.738+0000 7f277dd96640 1 -- 172.21.15.45:0/2429419914 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f277806d1d0 msgr2=0x7f27781507d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:50.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.738+0000 7f277dd96640 1 --2- 172.21.15.45:0/2429419914 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f277806d1d0 0x7f27781507d0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f27780673d0 tx=0x7f276001c460 comp rx=0 tx=0).stop 2023-11-28T18:43:50.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.738+0000 7f277dd96640 1 -- 172.21.15.45:0/2429419914 shutdown_connections 2023-11-28T18:43:50.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.738+0000 7f277dd96640 1 --2- 172.21.15.45:0/2429419914 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f277806d1d0 0x7f27781507d0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:50.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.738+0000 7f277dd96640 1 --2- 172.21.15.45:0/2429419914 >> v2:172.21.15.190:3300/0 conn(0x7f277806cdf0 0x7f2778150290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:50.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.738+0000 7f277dd96640 1 -- 172.21.15.45:0/2429419914 >> 172.21.15.45:0/2429419914 conn(0x7f277806a570 msgr2=0x7f277806a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:43:50.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.738+0000 7f277dd96640 1 -- 172.21.15.45:0/2429419914 shutdown_connections 2023-11-28T18:43:50.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.738+0000 7f277dd96640 1 -- 172.21.15.45:0/2429419914 wait complete. 2023-11-28T18:43:50.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.742+0000 7f277dd96640 1 Processor -- start 2023-11-28T18:43:50.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.742+0000 7f277dd96640 1 -- start start 2023-11-28T18:43:50.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.742+0000 7f277dd96640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f277806cdf0 0x7f277814cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:50.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.742+0000 7f277dd96640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f277806d1d0 0x7f27780b0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:50.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.742+0000 7f277dd96640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2778159de0 0x7f27780b1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:50.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.742+0000 7f277dd96640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f277814c9a0 con 0x7f277806d1d0 2023-11-28T18:43:50.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.742+0000 7f277dd96640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f277814fe50 con 0x7f277806cdf0 2023-11-28T18:43:50.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.742+0000 7f277dd96640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f277814d530 con 0x7f2778159de0 2023-11-28T18:43:50.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.742+0000 7f276ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f277806d1d0 0x7f27780b0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:50.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.742+0000 7f276ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f277806d1d0 0x7f27780b0ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45798/0 (socket says 172.21.15.45:45798) 2023-11-28T18:43:50.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.742+0000 7f276ffff640 1 -- 172.21.15.45:0/3383924543 learned_addr learned my addr 172.21.15.45:0/3383924543 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:43:50.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.742+0000 7f2777fff640 1 --2- 172.21.15.45:0/3383924543 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2778159de0 0x7f27780b1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:50.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.742+0000 7f27777fe640 1 --2- 172.21.15.45:0/3383924543 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f277806cdf0 0x7f277814cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:50.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.742+0000 7f276ffff640 1 -- 172.21.15.45:0/3383924543 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2778159de0 msgr2=0x7f27780b1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:50.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.742+0000 7f276ffff640 1 --2- 172.21.15.45:0/3383924543 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2778159de0 0x7f27780b1220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:50.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.742+0000 7f276ffff640 1 -- 172.21.15.45:0/3383924543 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f277806cdf0 msgr2=0x7f277814cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:50.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.742+0000 7f276ffff640 1 --2- 172.21.15.45:0/3383924543 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f277806cdf0 0x7f277814cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:50.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.742+0000 7f276ffff640 1 -- 172.21.15.45:0/3383924543 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2760009420 con 0x7f277806d1d0 2023-11-28T18:43:50.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.742+0000 7f276ffff640 1 --2- 172.21.15.45:0/3383924543 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f277806d1d0 0x7f27780b0ce0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f276001a090 tx=0x7f2760019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:50.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.742+0000 7f2774ff9640 1 -- 172.21.15.45:0/3383924543 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2760003bf0 con 0x7f277806d1d0 2023-11-28T18:43:50.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.742+0000 7f2774ff9640 1 -- 172.21.15.45:0/3383924543 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2760003d50 con 0x7f277806d1d0 2023-11-28T18:43:50.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.742+0000 7f2774ff9640 1 -- 172.21.15.45:0/3383924543 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27600ab680 con 0x7f277806d1d0 2023-11-28T18:43:50.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.742+0000 7f277dd96640 1 -- 172.21.15.45:0/3383924543 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f277814f9c0 con 0x7f277806d1d0 2023-11-28T18:43:50.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.742+0000 7f277dd96640 1 -- 172.21.15.45:0/3383924543 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2778150540 con 0x7f277806d1d0 2023-11-28T18:43:50.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.742+0000 7f277dd96640 1 -- 172.21.15.45:0/3383924543 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f277814fb50 con 0x7f277806d1d0 2023-11-28T18:43:50.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.746+0000 7f2774ff9640 1 -- 172.21.15.45:0/3383924543 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f27600b2040 con 0x7f277806d1d0 2023-11-28T18:43:50.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.746+0000 7f2774ff9640 1 --2- 172.21.15.45:0/3383924543 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f27580668d0 0x7f2758068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:50.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.746+0000 7f2774ff9640 1 -- 172.21.15.45:0/3383924543 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f276011e2a0 con 0x7f277806d1d0 2023-11-28T18:43:50.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.746+0000 7f27777fe640 1 --2- 172.21.15.45:0/3383924543 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f27580668d0 0x7f2758068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:50.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.746+0000 7f27777fe640 1 --2- 172.21.15.45:0/3383924543 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f27580668d0 0x7f2758068d90 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f27781596f0 tx=0x7f2768008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:50.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.750+0000 7f2774ff9640 1 -- 172.21.15.45:0/3383924543 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f27600eb890 con 0x7f277806d1d0 2023-11-28T18:43:50.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:50.962+0000 7f277dd96640 1 -- 172.21.15.45:0/3383924543 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_journal_repair.TestJournalRepair.test_journal_smoke"]} v 0) v1 -- 0x7f2778069480 con 0x7f277806d1d0 2023-11-28T18:43:51.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.202+0000 7f2774ff9640 1 -- 172.21.15.45:0/3383924543 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_journal_repair.TestJournalRepair.test_journal_smoke"]}]=0 v279) v1 ==== 148+0+0 (secure 0 0 0) 0x7f27600eeeb0 con 0x7f277806d1d0 2023-11-28T18:43:51.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.202+0000 7f277dd96640 1 -- 172.21.15.45:0/3383924543 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f27580668d0 msgr2=0x7f2758068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:51.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.202+0000 7f277dd96640 1 --2- 172.21.15.45:0/3383924543 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f27580668d0 0x7f2758068d90 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f27781596f0 tx=0x7f2768008040 comp rx=0 tx=0).stop 2023-11-28T18:43:51.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.202+0000 7f277dd96640 1 -- 172.21.15.45:0/3383924543 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f277806d1d0 msgr2=0x7f27780b0ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:51.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.202+0000 7f277dd96640 1 --2- 172.21.15.45:0/3383924543 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f277806d1d0 0x7f27780b0ce0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f276001a090 tx=0x7f2760019200 comp rx=0 tx=0).stop 2023-11-28T18:43:51.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.202+0000 7f277dd96640 1 -- 172.21.15.45:0/3383924543 shutdown_connections 2023-11-28T18:43:51.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.202+0000 7f277dd96640 1 --2- 172.21.15.45:0/3383924543 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f27580668d0 0x7f2758068d90 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:51.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.202+0000 7f277dd96640 1 --2- 172.21.15.45:0/3383924543 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2778159de0 0x7f27780b1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:51.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.202+0000 7f277dd96640 1 --2- 172.21.15.45:0/3383924543 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f277806d1d0 0x7f27780b0ce0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:51.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.202+0000 7f277dd96640 1 --2- 172.21.15.45:0/3383924543 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f277806cdf0 0x7f277814cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:51.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.202+0000 7f277dd96640 1 -- 172.21.15.45:0/3383924543 >> 172.21.15.45:0/3383924543 conn(0x7f277806a570 msgr2=0x7f27780b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:43:51.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.202+0000 7f277dd96640 1 -- 172.21.15.45:0/3383924543 shutdown_connections 2023-11-28T18:43:51.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.202+0000 7f277dd96640 1 -- 172.21.15.45:0/3383924543 wait complete. 2023-11-28T18:43:51.226 INFO:tasks.cephfs_test_runner:test_journal_smoke (tasks.cephfs.test_journal_repair.TestJournalRepair) ... ok 2023-11-28T18:43:51.226 INFO:tasks.cephfs_test_runner:Starting test: test_reset (tasks.cephfs.test_journal_repair.TestJournalRepair) That after forcibly modifying the backing store, we can get back into 2023-11-28T18:43:51.226 INFO:tasks.cephfs_test_runner:test_reset (tasks.cephfs.test_journal_repair.TestJournalRepair) 2023-11-28T18:43:51.227 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T18:43:51.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.366+0000 7f74c6838640 1 Processor -- start 2023-11-28T18:43:51.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.366+0000 7f74c6838640 1 -- start start 2023-11-28T18:43:51.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.366+0000 7f74c6838640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f74c015d490 0x7f74c00ce730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:51.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.366+0000 7f74c6838640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f74c00d1c50 0x7f74c00ca030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:51.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.366+0000 7f74c6838640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74c00cf5b0 con 0x7f74c00cec70 2023-11-28T18:43:51.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.366+0000 7f74c6838640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74c00cf800 con 0x7f74c00d1c50 2023-11-28T18:43:51.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.366+0000 7f74c6838640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74c00cfae0 con 0x7f74c015d490 2023-11-28T18:43:51.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.366+0000 7f74c6037640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f74c00d1c50 0x7f74c00ca030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:51.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.366+0000 7f74c5035640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f74c00cec70 0x7f74c00d1540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:60872/0 (socket says 172.21.15.45:60872) 2023-11-28T18:43:51.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.366+0000 7f74c6037640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f74c00d1c50 0x7f74c00ca030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45814/0 (socket says 172.21.15.45:45814) 2023-11-28T18:43:51.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.366+0000 7f74c5035640 1 -- 172.21.15.45:0/717707540 learned_addr learned my addr 172.21.15.45:0/717707540 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:43:51.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.366+0000 7f74c5836640 1 --2- 172.21.15.45:0/717707540 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f74c015d490 0x7f74c00ce730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:51.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.370+0000 7f74c6037640 1 -- 172.21.15.45:0/717707540 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f74c015d490 msgr2=0x7f74c00ce730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:43:51.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.370+0000 7f74c6037640 1 --2- 172.21.15.45:0/717707540 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f74c015d490 0x7f74c00ce730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:51.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.370+0000 7f74c6037640 1 -- 172.21.15.45:0/717707540 >> v1:172.21.15.45:6789/0 conn(0x7f74c00cec70 legacy=0x7f74c00d1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:51.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.370+0000 7f74c6037640 1 -- 172.21.15.45:0/717707540 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74c00cfdc0 con 0x7f74c00d1c50 2023-11-28T18:43:51.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.370+0000 7f74c4834640 1 -- 172.21.15.45:0/717707540 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 117882209 0 0) 0x7f74c00cf5b0 con 0x7f74c00cec70 2023-11-28T18:43:51.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.370+0000 7f74c6037640 1 --2- 172.21.15.45:0/717707540 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74c00d1c50 0x7f74c00ca030 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f74b8009d90 tx=0x7f74b801c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b414fad2ca7e2cc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:51.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.370+0000 7f74c4834640 1 -- 172.21.15.45:0/717707540 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b80a5970 con 0x7f74c00d1c50 2023-11-28T18:43:51.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.370+0000 7f74c4834640 1 -- 172.21.15.45:0/717707540 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74b80a5ad0 con 0x7f74c00d1c50 2023-11-28T18:43:51.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.370+0000 7f74c4834640 1 -- 172.21.15.45:0/717707540 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b80a5e60 con 0x7f74c00d1c50 2023-11-28T18:43:51.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.370+0000 7f74c6838640 1 -- 172.21.15.45:0/717707540 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74c00d1c50 msgr2=0x7f74c00ca030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:51.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.370+0000 7f74c6838640 1 --2- 172.21.15.45:0/717707540 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74c00d1c50 0x7f74c00ca030 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f74b8009d90 tx=0x7f74b801c890 comp rx=0 tx=0).stop 2023-11-28T18:43:51.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.370+0000 7f74c6838640 1 -- 172.21.15.45:0/717707540 shutdown_connections 2023-11-28T18:43:51.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.370+0000 7f74c6838640 1 --2- 172.21.15.45:0/717707540 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74c00d1c50 0x7f74c00ca030 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:51.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.370+0000 7f74c6838640 1 --2- 172.21.15.45:0/717707540 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f74c015d490 0x7f74c00ce730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:51.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.370+0000 7f74c6838640 1 -- 172.21.15.45:0/717707540 >> 172.21.15.45:0/717707540 conn(0x7f74c00d2f60 msgr2=0x7f74c00d3370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:43:51.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.374+0000 7f74c6838640 1 -- 172.21.15.45:0/717707540 shutdown_connections 2023-11-28T18:43:51.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.374+0000 7f74c6838640 1 -- 172.21.15.45:0/717707540 wait complete. 2023-11-28T18:43:51.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.374+0000 7f74c6838640 1 Processor -- start 2023-11-28T18:43:51.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.374+0000 7f74c6838640 1 -- start start 2023-11-28T18:43:51.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.374+0000 7f74c6838640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74c00cec70 0x7f74c0153d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:51.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.374+0000 7f74c6838640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f74c00d1c50 0x7f74c0158d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:51.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.374+0000 7f74c6838640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f74c015d490 0x7f74c01592a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:51.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.374+0000 7f74c6838640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c0154dc0 con 0x7f74c00cec70 2023-11-28T18:43:51.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.374+0000 7f74c6838640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c0154fd0 con 0x7f74c00d1c50 2023-11-28T18:43:51.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.374+0000 7f74c6838640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74c01552b0 con 0x7f74c015d490 2023-11-28T18:43:51.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.374+0000 7f74c5836640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74c00cec70 0x7f74c0153d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:51.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.374+0000 7f74c5836640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74c00cec70 0x7f74c0153d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45824/0 (socket says 172.21.15.45:45824) 2023-11-28T18:43:51.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.374+0000 7f74c5836640 1 -- 172.21.15.45:0/1582027014 learned_addr learned my addr 172.21.15.45:0/1582027014 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:43:51.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.374+0000 7f74c5035640 1 --2- 172.21.15.45:0/1582027014 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f74c00d1c50 0x7f74c0158d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:51.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.374+0000 7f74c6037640 1 --2- 172.21.15.45:0/1582027014 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f74c015d490 0x7f74c01592a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:51.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.374+0000 7f74c5836640 1 -- 172.21.15.45:0/1582027014 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f74c015d490 msgr2=0x7f74c01592a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:51.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.374+0000 7f74c5836640 1 --2- 172.21.15.45:0/1582027014 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f74c015d490 0x7f74c01592a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:51.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.374+0000 7f74c5836640 1 -- 172.21.15.45:0/1582027014 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f74c00d1c50 msgr2=0x7f74c0158d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:51.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.374+0000 7f74c5836640 1 --2- 172.21.15.45:0/1582027014 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f74c00d1c50 0x7f74c0158d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:51.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.374+0000 7f74c5836640 1 -- 172.21.15.45:0/1582027014 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b8009a70 con 0x7f74c00cec70 2023-11-28T18:43:51.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.374+0000 7f74c5836640 1 --2- 172.21.15.45:0/1582027014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74c00cec70 0x7f74c0153d80 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f74bc00d5f0 tx=0x7f74bc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:51.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.374+0000 7f74b67fc640 1 -- 172.21.15.45:0/1582027014 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74bc0125f0 con 0x7f74c00cec70 2023-11-28T18:43:51.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.374+0000 7f74b67fc640 1 -- 172.21.15.45:0/1582027014 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74bc012750 con 0x7f74c00cec70 2023-11-28T18:43:51.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.374+0000 7f74b67fc640 1 -- 172.21.15.45:0/1582027014 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74bc012ae0 con 0x7f74c00cec70 2023-11-28T18:43:51.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.374+0000 7f74c6838640 1 -- 172.21.15.45:0/1582027014 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74c0155590 con 0x7f74c00cec70 2023-11-28T18:43:51.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.378+0000 7f74c6838640 1 -- 172.21.15.45:0/1582027014 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74c0155d90 con 0x7f74c00cec70 2023-11-28T18:43:51.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.378+0000 7f74c6838640 1 -- 172.21.15.45:0/1582027014 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74c00a0eb0 con 0x7f74c00cec70 2023-11-28T18:43:51.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.378+0000 7f74b67fc640 1 -- 172.21.15.45:0/1582027014 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f74bc012c40 con 0x7f74c00cec70 2023-11-28T18:43:51.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.378+0000 7f74b67fc640 1 --2- 172.21.15.45:0/1582027014 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f74a40668d0 0x7f74a4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:51.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.378+0000 7f74b67fc640 1 -- 172.21.15.45:0/1582027014 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f74bc084740 con 0x7f74c00cec70 2023-11-28T18:43:51.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.378+0000 7f74c5035640 1 --2- 172.21.15.45:0/1582027014 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f74a40668d0 0x7f74a4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:51.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.378+0000 7f74c5035640 1 --2- 172.21.15.45:0/1582027014 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f74a40668d0 0x7f74a4068d90 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f74c00b3ee0 tx=0x7f74b0007b60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:51.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.382+0000 7f74b67fc640 1 -- 172.21.15.45:0/1582027014 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f74bc051b80 con 0x7f74c00cec70 2023-11-28T18:43:51.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.542+0000 7f74c6838640 1 -- 172.21.15.45:0/1582027014 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f74c004e970 con 0x7f74c00cec70 2023-11-28T18:43:51.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.542+0000 7f74b67fc640 1 -- 172.21.15.45:0/1582027014 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+13080 (secure 0 0 0) 0x7f74bc007380 con 0x7f74c00cec70 2023-11-28T18:43:51.547 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:43:51.547 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":52,"fsid":"d10f5cd6-1d00-4019-99b6-6fa435498a15","created":"2023-11-28T18:37:08.189030+0000","modified":"2023-11-28T18:43:50.196813+0000","last_up_change":"2023-11-28T18:37:20.196124+0000","last_in_change":"2023-11-28T18:37:10.742043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T18:37:21.293917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"84465384-103c-4f2c-a45a-96f5bb9c835f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6809","nonce":555237322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6811","nonce":555237322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6815","nonce":555237322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6813","nonce":555237322}]},"public_addr":"172.21.15.45:6809/555237322","cluster_addr":"172.21.15.45:6811/555237322","heartbeat_back_addr":"172.21.15.45:6815/555237322","heartbeat_front_addr":"172.21.15.45:6813/555237322","state":["exists","up"]},{"osd":1,"uuid":"7d9eed24-a58f-42c7-a787-ac06be8553fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6801","nonce":2857063763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6803","nonce":2857063763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6807","nonce":2857063763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6805","nonce":2857063763}]},"public_addr":"172.21.15.45:6801/2857063763","cluster_addr":"172.21.15.45:6803/2857063763","heartbeat_back_addr":"172.21.15.45:6807/2857063763","heartbeat_front_addr":"172.21.15.45:6805/2857063763","state":["exists","up"]},{"osd":2,"uuid":"575eeccc-4abf-45b4-9caf-f3e797859588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6817","nonce":193884539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6819","nonce":193884539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6823","nonce":193884539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6821","nonce":193884539}]},"public_addr":"172.21.15.45:6817/193884539","cluster_addr":"172.21.15.45:6819/193884539","heartbeat_back_addr":"172.21.15.45:6823/193884539","heartbeat_front_addr":"172.21.15.45:6821/193884539","state":["exists","up"]},{"osd":3,"uuid":"9b0290d6-9a52-4bc8-b2a1-7622c5dc8e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6825","nonce":78541084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6827","nonce":78541084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6831","nonce":78541084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6829","nonce":78541084}]},"public_addr":"172.21.15.45:6825/78541084","cluster_addr":"172.21.15.45:6827/78541084","heartbeat_back_addr":"172.21.15.45:6831/78541084","heartbeat_front_addr":"172.21.15.45:6829/78541084","state":["exists","up"]},{"osd":4,"uuid":"ce632829-f027-4fbf-a627-02c571aa9d53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6809","nonce":1537591987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6811","nonce":1537591987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6815","nonce":1537591987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6813","nonce":1537591987}]},"public_addr":"172.21.15.190:6809/1537591987","cluster_addr":"172.21.15.190:6811/1537591987","heartbeat_back_addr":"172.21.15.190:6815/1537591987","heartbeat_front_addr":"172.21.15.190:6813/1537591987","state":["exists","up"]},{"osd":5,"uuid":"8700b609-27be-40bd-a251-4c0ae0a29ead","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6801","nonce":3296698407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6803","nonce":3296698407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6807","nonce":3296698407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6805","nonce":3296698407}]},"public_addr":"172.21.15.190:6801/3296698407","cluster_addr":"172.21.15.190:6803/3296698407","heartbeat_back_addr":"172.21.15.190:6807/3296698407","heartbeat_front_addr":"172.21.15.190:6805/3296698407","state":["exists","up"]},{"osd":6,"uuid":"44ce4a40-e6ff-4f4d-8e8a-7341e5c91f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6817","nonce":2317686718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6819","nonce":2317686718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6823","nonce":2317686718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6821","nonce":2317686718}]},"public_addr":"172.21.15.190:6817/2317686718","cluster_addr":"172.21.15.190:6819/2317686718","heartbeat_back_addr":"172.21.15.190:6823/2317686718","heartbeat_front_addr":"172.21.15.190:6821/2317686718","state":["exists","up"]},{"osd":7,"uuid":"192238c9-1423-4b7e-ac8f-84ba32113ddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6825","nonce":2493232051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6827","nonce":2493232051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6831","nonce":2493232051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6829","nonce":2493232051}]},"public_addr":"172.21.15.190:6825/2493232051","cluster_addr":"172.21.15.190:6827/2493232051","heartbeat_back_addr":"172.21.15.190:6831/2493232051","heartbeat_front_addr":"172.21.15.190:6829/2493232051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.393552+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.385453+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.361421+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.366408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.363226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.276007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.414605+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.445885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6834/2228986336":"2023-11-29T18:43:46.873754+0000","172.21.15.45:6832/2228986336":"2023-11-29T18:43:46.873754+0000","172.21.15.45:6834/2737877840":"2023-11-29T18:41:11.270289+0000","172.21.15.45:6832/2737877840":"2023-11-29T18:41:11.270289+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T18:43:51.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.546+0000 7f74c6838640 1 -- 172.21.15.45:0/1582027014 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f74a40668d0 msgr2=0x7f74a4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:51.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.546+0000 7f74c6838640 1 --2- 172.21.15.45:0/1582027014 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f74a40668d0 0x7f74a4068d90 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f74c00b3ee0 tx=0x7f74b0007b60 comp rx=0 tx=0).stop 2023-11-28T18:43:51.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.546+0000 7f74c6838640 1 -- 172.21.15.45:0/1582027014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74c00cec70 msgr2=0x7f74c0153d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:51.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.546+0000 7f74c6838640 1 --2- 172.21.15.45:0/1582027014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74c00cec70 0x7f74c0153d80 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f74bc00d5f0 tx=0x7f74bc00dab0 comp rx=0 tx=0).stop 2023-11-28T18:43:51.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.546+0000 7f74c6838640 1 -- 172.21.15.45:0/1582027014 shutdown_connections 2023-11-28T18:43:51.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.546+0000 7f74c6838640 1 --2- 172.21.15.45:0/1582027014 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f74a40668d0 0x7f74a4068d90 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:51.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.546+0000 7f74c6838640 1 --2- 172.21.15.45:0/1582027014 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f74c015d490 0x7f74c01592a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:51.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.546+0000 7f74c6838640 1 --2- 172.21.15.45:0/1582027014 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f74c00d1c50 0x7f74c0158d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:51.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.546+0000 7f74c6838640 1 --2- 172.21.15.45:0/1582027014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74c00cec70 0x7f74c0153d80 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:51.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.546+0000 7f74c6838640 1 -- 172.21.15.45:0/1582027014 >> 172.21.15.45:0/1582027014 conn(0x7f74c00d2f60 msgr2=0x7f74c00d2810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:43:51.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.546+0000 7f74c6838640 1 -- 172.21.15.45:0/1582027014 shutdown_connections 2023-11-28T18:43:51.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.546+0000 7f74c6838640 1 -- 172.21.15.45:0/1582027014 wait complete. 2023-11-28T18:43:51.568 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T18:37:21.293917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T18:43:51.569 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T18:43:51.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.710+0000 7f733d0fe640 1 Processor -- start 2023-11-28T18:43:51.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.710+0000 7f733d0fe640 1 -- start start 2023-11-28T18:43:51.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.710+0000 7f733d0fe640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f73381469a0 0x7f733806cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:51.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.710+0000 7f733d0fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f73380b4070 0x7f73380b44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:51.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.710+0000 7f733d0fe640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73380b4a10 con 0x7f733806e8e0 2023-11-28T18:43:51.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.710+0000 7f733d0fe640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f733815e940 con 0x7f73381469a0 2023-11-28T18:43:51.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.710+0000 7f733d0fe640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f733815dd30 con 0x7f73380b4070 2023-11-28T18:43:51.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.710+0000 7f7336d9d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f73381469a0 0x7f733806cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:51.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.710+0000 7f732ffff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f73380b4070 0x7f73380b44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:51.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.710+0000 7f7336d9d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f73381469a0 0x7f733806cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.45:33668/0 (socket says 172.21.15.45:33668) 2023-11-28T18:43:51.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.710+0000 7f733759e640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f733806e8e0 0x7f733806ed30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.45:53272/0 (socket says 172.21.15.45:53272) 2023-11-28T18:43:51.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.710+0000 7f7336d9d640 1 -- 172.21.15.45:0/1529071316 learned_addr learned my addr 172.21.15.45:0/1529071316 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:43:51.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.714+0000 7f7336d9d640 1 -- 172.21.15.45:0/1529071316 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f73380b4070 msgr2=0x7f73380b44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:43:51.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.714+0000 7f7336d9d640 1 --2- 172.21.15.45:0/1529071316 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f73380b4070 0x7f73380b44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:51.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.714+0000 7f7336d9d640 1 -- 172.21.15.45:0/1529071316 >> v1:172.21.15.190:6789/0 conn(0x7f733806e8e0 legacy=0x7f733806ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:51.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.714+0000 7f7336d9d640 1 -- 172.21.15.45:0/1529071316 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f733815e010 con 0x7f73381469a0 2023-11-28T18:43:51.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.714+0000 7f732ffff640 1 --2- 172.21.15.45:0/1529071316 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f73380b4070 0x7f73380b44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:43:51.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.714+0000 7f7336d9d640 1 --2- 172.21.15.45:0/1529071316 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f73381469a0 0x7f733806cab0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f7328009870 tx=0x7f732801c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24bf0cd862e0e9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:51.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.714+0000 7f733659c640 1 -- 172.21.15.45:0/1529071316 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73280a7070 con 0x7f73381469a0 2023-11-28T18:43:51.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.714+0000 7f733659c640 1 -- 172.21.15.45:0/1529071316 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73280ab430 con 0x7f73381469a0 2023-11-28T18:43:51.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.714+0000 7f733659c640 1 -- 172.21.15.45:0/1529071316 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73280ab7c0 con 0x7f73381469a0 2023-11-28T18:43:51.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.714+0000 7f733d0fe640 1 -- 172.21.15.45:0/1529071316 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f73381469a0 msgr2=0x7f733806cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:51.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.714+0000 7f733d0fe640 1 --2- 172.21.15.45:0/1529071316 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f73381469a0 0x7f733806cab0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f7328009870 tx=0x7f732801c540 comp rx=0 tx=0).stop 2023-11-28T18:43:51.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.714+0000 7f733d0fe640 1 -- 172.21.15.45:0/1529071316 shutdown_connections 2023-11-28T18:43:51.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.714+0000 7f733d0fe640 1 --2- 172.21.15.45:0/1529071316 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f73380b4070 0x7f73380b44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:51.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.714+0000 7f733d0fe640 1 --2- 172.21.15.45:0/1529071316 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f73381469a0 0x7f733806cab0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:51.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.714+0000 7f733d0fe640 1 -- 172.21.15.45:0/1529071316 >> 172.21.15.45:0/1529071316 conn(0x7f7338070b80 msgr2=0x7f7338066360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:43:51.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.718+0000 7f733d0fe640 1 -- 172.21.15.45:0/1529071316 shutdown_connections 2023-11-28T18:43:51.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.718+0000 7f733d0fe640 1 -- 172.21.15.45:0/1529071316 wait complete. 2023-11-28T18:43:51.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.718+0000 7f733d0fe640 1 Processor -- start 2023-11-28T18:43:51.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.718+0000 7f733d0fe640 1 -- start start 2023-11-28T18:43:51.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.718+0000 7f733d0fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f733806e8e0 0x7f733813e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:51.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.718+0000 7f733d0fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f73380b4070 0x7f7338165300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:51.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.718+0000 7f733d0fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73381469a0 0x7f7338165840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:51.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.718+0000 7f733d0fe640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f733814de90 con 0x7f73381469a0 2023-11-28T18:43:51.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.718+0000 7f733d0fe640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73381f8460 con 0x7f73380b4070 2023-11-28T18:43:51.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.718+0000 7f733d0fe640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73381f7850 con 0x7f733806e8e0 2023-11-28T18:43:51.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.718+0000 7f733759e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73381469a0 0x7f7338165840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:51.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.718+0000 7f733759e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73381469a0 0x7f7338165840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45840/0 (socket says 172.21.15.45:45840) 2023-11-28T18:43:51.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.718+0000 7f733759e640 1 -- 172.21.15.45:0/158280118 learned_addr learned my addr 172.21.15.45:0/158280118 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:43:51.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.718+0000 7f7336d9d640 1 --2- 172.21.15.45:0/158280118 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f733806e8e0 0x7f733813e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:51.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.718+0000 7f732ffff640 1 --2- 172.21.15.45:0/158280118 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f73380b4070 0x7f7338165300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:51.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.718+0000 7f733759e640 1 -- 172.21.15.45:0/158280118 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f733806e8e0 msgr2=0x7f733813e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:51.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.718+0000 7f733759e640 1 --2- 172.21.15.45:0/158280118 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f733806e8e0 0x7f733813e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:51.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.718+0000 7f733759e640 1 -- 172.21.15.45:0/158280118 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f73380b4070 msgr2=0x7f7338165300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:51.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.718+0000 7f733759e640 1 --2- 172.21.15.45:0/158280118 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f73380b4070 0x7f7338165300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:51.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.718+0000 7f733759e640 1 -- 172.21.15.45:0/158280118 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7320009420 con 0x7f73381469a0 2023-11-28T18:43:51.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.718+0000 7f733759e640 1 --2- 172.21.15.45:0/158280118 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73381469a0 0x7f7338165840 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f733000c700 tx=0x7f733000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:51.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.722+0000 7f732f7fe640 1 -- 172.21.15.45:0/158280118 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733000ce10 con 0x7f73381469a0 2023-11-28T18:43:51.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.722+0000 7f732f7fe640 1 -- 172.21.15.45:0/158280118 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f733000a640 con 0x7f73381469a0 2023-11-28T18:43:51.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.722+0000 7f732f7fe640 1 -- 172.21.15.45:0/158280118 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733000a9b0 con 0x7f73381469a0 2023-11-28T18:43:51.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.722+0000 7f733d0fe640 1 -- 172.21.15.45:0/158280118 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73280094d0 con 0x7f73381469a0 2023-11-28T18:43:51.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.722+0000 7f733d0fe640 1 -- 172.21.15.45:0/158280118 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73381f7e10 con 0x7f73381469a0 2023-11-28T18:43:51.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.722+0000 7f733d0fe640 1 -- 172.21.15.45:0/158280118 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7338069410 con 0x7f73381469a0 2023-11-28T18:43:51.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.722+0000 7f732f7fe640 1 -- 172.21.15.45:0/158280118 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f733000ab10 con 0x7f73381469a0 2023-11-28T18:43:51.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.722+0000 7f732f7fe640 1 --2- 172.21.15.45:0/158280118 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f73180668d0 0x7f7318068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:51.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.722+0000 7f732f7fe640 1 -- 172.21.15.45:0/158280118 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f73300838c0 con 0x7f73381469a0 2023-11-28T18:43:51.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.722+0000 7f7336d9d640 1 --2- 172.21.15.45:0/158280118 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f73180668d0 0x7f7318068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:51.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.726+0000 7f7336d9d640 1 --2- 172.21.15.45:0/158280118 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f73180668d0 0x7f7318068d90 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f73280af000 tx=0x7f7328008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:51.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.726+0000 7f732f7fe640 1 -- 172.21.15.45:0/158280118 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7330050e40 con 0x7f73381469a0 2023-11-28T18:43:51.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.882+0000 7f733d0fe640 1 -- 172.21.15.45:0/158280118 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f73381f85a0 con 0x7f73381469a0 2023-11-28T18:43:51.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.882+0000 7f732f7fe640 1 -- 172.21.15.45:0/158280118 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v52) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7330017020 con 0x7f73381469a0 2023-11-28T18:43:51.888 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-11-28T18:43:51.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.886+0000 7f733d0fe640 1 -- 172.21.15.45:0/158280118 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f73180668d0 msgr2=0x7f7318068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:51.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.886+0000 7f733d0fe640 1 --2- 172.21.15.45:0/158280118 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f73180668d0 0x7f7318068d90 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f73280af000 tx=0x7f7328008040 comp rx=0 tx=0).stop 2023-11-28T18:43:51.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.886+0000 7f733d0fe640 1 -- 172.21.15.45:0/158280118 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73381469a0 msgr2=0x7f7338165840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:51.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.886+0000 7f733d0fe640 1 --2- 172.21.15.45:0/158280118 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73381469a0 0x7f7338165840 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f733000c700 tx=0x7f733000cbc0 comp rx=0 tx=0).stop 2023-11-28T18:43:51.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.886+0000 7f733d0fe640 1 -- 172.21.15.45:0/158280118 shutdown_connections 2023-11-28T18:43:51.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.886+0000 7f733d0fe640 1 --2- 172.21.15.45:0/158280118 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f73180668d0 0x7f7318068d90 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:51.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.886+0000 7f733d0fe640 1 --2- 172.21.15.45:0/158280118 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73381469a0 0x7f7338165840 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:51.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.886+0000 7f733d0fe640 1 --2- 172.21.15.45:0/158280118 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f73380b4070 0x7f7338165300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:51.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.886+0000 7f733d0fe640 1 --2- 172.21.15.45:0/158280118 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f733806e8e0 0x7f733813e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:51.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.886+0000 7f733d0fe640 1 -- 172.21.15.45:0/158280118 >> 172.21.15.45:0/158280118 conn(0x7f7338070b80 msgr2=0x7f7338143070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:43:51.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.886+0000 7f733d0fe640 1 -- 172.21.15.45:0/158280118 shutdown_connections 2023-11-28T18:43:51.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:51.886+0000 7f733d0fe640 1 -- 172.21.15.45:0/158280118 wait complete. 2023-11-28T18:43:51.910 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_journal_repair.TestJournalRepair.test_reset' 2023-11-28T18:43:52.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:52.050+0000 7fd277e79640 1 Processor -- start 2023-11-28T18:43:52.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:52.050+0000 7fd277e79640 1 -- start start 2023-11-28T18:43:52.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:52.050+0000 7fd277e79640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd2700cfed0 0x7fd2700d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:52.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:52.050+0000 7fd277e79640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd2700b3cb0 0x7fd27015f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:52.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:52.050+0000 7fd277e79640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2700d38c0 con 0x7fd2700b35f0 2023-11-28T18:43:52.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:52.050+0000 7fd277e79640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2700d40d0 con 0x7fd2700cfed0 2023-11-28T18:43:52.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:52.050+0000 7fd277e79640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2700cdcc0 con 0x7fd2700b3cb0 2023-11-28T18:43:52.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:52.050+0000 7fd275414640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd2700cfed0 0x7fd2700d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:52.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:52.050+0000 7fd275414640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd2700cfed0 0x7fd2700d0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45846/0 (socket says 172.21.15.45:45846) 2023-11-28T18:43:52.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:52.050+0000 7fd275414640 1 -- 172.21.15.45:0/1091064844 learned_addr learned my addr 172.21.15.45:0/1091064844 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:43:52.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:52.050+0000 7fd276416640 1 --2- 172.21.15.45:0/1091064844 >> v2:172.21.15.190:3300/0 conn(0x7fd2700b3cb0 0x7fd27015f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:52.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:52.050+0000 7fd275414640 1 -- 172.21.15.45:0/1091064844 >> v2:172.21.15.190:3300/0 conn(0x7fd2700b3cb0 msgr2=0x7fd27015f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:43:52.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:52.050+0000 7fd275414640 1 --2- 172.21.15.45:0/1091064844 >> v2:172.21.15.190:3300/0 conn(0x7fd2700b3cb0 0x7fd27015f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:52.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:52.050+0000 7fd275414640 1 -- 172.21.15.45:0/1091064844 >> v1:172.21.15.190:6789/0 conn(0x7fd2700b35f0 legacy=0x7fd2700cf7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:52.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:52.050+0000 7fd275414640 1 -- 172.21.15.45:0/1091064844 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2700d3b10 con 0x7fd2700cfed0 2023-11-28T18:43:52.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:52.054+0000 7fd275414640 1 --2- 172.21.15.45:0/1091064844 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2700cfed0 0x7fd2700d0f90 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fd2700d2b20 tx=0x7fd26001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6b776a0b2bf7627 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:52.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:52.054+0000 7fd274c13640 1 -- 172.21.15.45:0/1091064844 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2600aa660 con 0x7fd2700cfed0 2023-11-28T18:43:52.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:52.054+0000 7fd274c13640 1 -- 172.21.15.45:0/1091064844 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2600aa7c0 con 0x7fd2700cfed0 2023-11-28T18:43:52.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:52.054+0000 7fd274c13640 1 -- 172.21.15.45:0/1091064844 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2600aab50 con 0x7fd2700cfed0 2023-11-28T18:43:52.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:52.054+0000 7fd277e79640 1 -- 172.21.15.45:0/1091064844 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2700cfed0 msgr2=0x7fd2700d0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:52.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:52.054+0000 7fd277e79640 1 --2- 172.21.15.45:0/1091064844 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2700cfed0 0x7fd2700d0f90 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fd2700d2b20 tx=0x7fd26001c500 comp rx=0 tx=0).stop 2023-11-28T18:43:52.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:52.054+0000 7fd277e79640 1 -- 172.21.15.45:0/1091064844 shutdown_connections 2023-11-28T18:43:52.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:52.054+0000 7fd277e79640 1 --2- 172.21.15.45:0/1091064844 >> v2:172.21.15.190:3300/0 conn(0x7fd2700b3cb0 0x7fd27015f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:52.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:52.054+0000 7fd277e79640 1 --2- 172.21.15.45:0/1091064844 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2700cfed0 0x7fd2700d0f90 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:52.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:52.054+0000 7fd277e79640 1 -- 172.21.15.45:0/1091064844 >> 172.21.15.45:0/1091064844 conn(0x7fd27009c4f0 msgr2=0x7fd2700d31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:43:52.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:52.054+0000 7fd277e79640 1 -- 172.21.15.45:0/1091064844 shutdown_connections 2023-11-28T18:43:52.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:52.054+0000 7fd277e79640 1 -- 172.21.15.45:0/1091064844 wait complete. 2023-11-28T18:43:52.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:52.058+0000 7fd277e79640 1 Processor -- start 2023-11-28T18:43:52.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:52.058+0000 7fd277e79640 1 -- start start 2023-11-28T18:43:52.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:52.058+0000 7fd277e79640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd2700b35f0 0x7fd2700ca280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:52.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:52.058+0000 7fd277e79640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2700b3cb0 0x7fd27015e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:52.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:52.058+0000 7fd277e79640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd2700cfed0 0x7fd2700b7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:52.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:52.058+0000 7fd277e79640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2700b70f0 con 0x7fd2700b3cb0 2023-11-28T18:43:52.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:52.058+0000 7fd277e79640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2700b73d0 con 0x7fd2700cfed0 2023-11-28T18:43:52.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:52.058+0000 7fd277e79640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2700b76b0 con 0x7fd2700b35f0 2023-11-28T18:43:52.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:52.058+0000 7fd275414640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2700b3cb0 0x7fd27015e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:52.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:52.058+0000 7fd275414640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2700b3cb0 0x7fd27015e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45854/0 (socket says 172.21.15.45:45854) 2023-11-28T18:43:52.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:52.058+0000 7fd275414640 1 -- 172.21.15.45:0/3119567318 learned_addr learned my addr 172.21.15.45:0/3119567318 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:43:52.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:52.058+0000 7fd275c15640 1 --2- 172.21.15.45:0/3119567318 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd2700b35f0 0x7fd2700ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:52.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:52.058+0000 7fd276416640 1 --2- 172.21.15.45:0/3119567318 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd2700cfed0 0x7fd2700b7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:52.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:52.058+0000 7fd275414640 1 -- 172.21.15.45:0/3119567318 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd2700b35f0 msgr2=0x7fd2700ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:52.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:52.058+0000 7fd275414640 1 --2- 172.21.15.45:0/3119567318 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd2700b35f0 0x7fd2700ca280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:52.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:52.058+0000 7fd275414640 1 -- 172.21.15.45:0/3119567318 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd2700cfed0 msgr2=0x7fd2700b7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:52.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:52.058+0000 7fd275414640 1 --2- 172.21.15.45:0/3119567318 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd2700cfed0 0x7fd2700b7eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:52.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:52.058+0000 7fd275414640 1 -- 172.21.15.45:0/3119567318 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2600094d0 con 0x7fd2700b3cb0 2023-11-28T18:43:52.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:52.058+0000 7fd275414640 1 --2- 172.21.15.45:0/3119567318 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2700b3cb0 0x7fd27015e250 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fd260019110 tx=0x7fd26001ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:52.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:52.058+0000 7fd2667fc640 1 -- 172.21.15.45:0/3119567318 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2600b3800 con 0x7fd2700b3cb0 2023-11-28T18:43:52.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:52.058+0000 7fd2667fc640 1 -- 172.21.15.45:0/3119567318 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2600b3980 con 0x7fd2700b3cb0 2023-11-28T18:43:52.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:52.058+0000 7fd2667fc640 1 -- 172.21.15.45:0/3119567318 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2600b3d30 con 0x7fd2700b3cb0 2023-11-28T18:43:52.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:52.058+0000 7fd277e79640 1 -- 172.21.15.45:0/3119567318 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2700b7990 con 0x7fd2700b3cb0 2023-11-28T18:43:52.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:52.058+0000 7fd277e79640 1 -- 172.21.15.45:0/3119567318 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2700ca7c0 con 0x7fd2700b3cb0 2023-11-28T18:43:52.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:52.062+0000 7fd277e79640 1 -- 172.21.15.45:0/3119567318 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd270069480 con 0x7fd2700b3cb0 2023-11-28T18:43:52.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:52.062+0000 7fd2667fc640 1 -- 172.21.15.45:0/3119567318 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fd2600b2380 con 0x7fd2700b3cb0 2023-11-28T18:43:52.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:52.062+0000 7fd2667fc640 1 --2- 172.21.15.45:0/3119567318 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fd2540668d0 0x7fd254068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:52.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:52.062+0000 7fd2667fc640 1 -- 172.21.15.45:0/3119567318 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fd2600a6040 con 0x7fd2700b3cb0 2023-11-28T18:43:52.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:52.062+0000 7fd275c15640 1 --2- 172.21.15.45:0/3119567318 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fd2540668d0 0x7fd254068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:52.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:52.062+0000 7fd275c15640 1 --2- 172.21.15.45:0/3119567318 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fd2540668d0 0x7fd254068d90 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd2700b2b30 tx=0x7fd26c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:52.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:52.066+0000 7fd2667fc640 1 -- 172.21.15.45:0/3119567318 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd2600ebd50 con 0x7fd2700b3cb0 2023-11-28T18:43:52.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:52.282+0000 7fd277e79640 1 -- 172.21.15.45:0/3119567318 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_journal_repair.TestJournalRepair.test_reset"]} v 0) v1 -- 0x7fd2700b7230 con 0x7fd2700b3cb0 2023-11-28T18:43:53.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.210+0000 7fd2667fc640 1 -- 172.21.15.45:0/3119567318 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_journal_repair.TestJournalRepair.test_reset"]}]=0 v281) v1 ==== 143+0+0 (secure 0 0 0) 0x7fd2700b7230 con 0x7fd2700b3cb0 2023-11-28T18:43:53.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.210+0000 7fd277e79640 1 -- 172.21.15.45:0/3119567318 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fd2540668d0 msgr2=0x7fd254068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:53.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.210+0000 7fd277e79640 1 --2- 172.21.15.45:0/3119567318 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fd2540668d0 0x7fd254068d90 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd2700b2b30 tx=0x7fd26c009040 comp rx=0 tx=0).stop 2023-11-28T18:43:53.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.210+0000 7fd277e79640 1 -- 172.21.15.45:0/3119567318 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2700b3cb0 msgr2=0x7fd27015e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:53.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.210+0000 7fd277e79640 1 --2- 172.21.15.45:0/3119567318 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2700b3cb0 0x7fd27015e250 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fd260019110 tx=0x7fd26001ad40 comp rx=0 tx=0).stop 2023-11-28T18:43:53.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.210+0000 7fd277e79640 1 -- 172.21.15.45:0/3119567318 shutdown_connections 2023-11-28T18:43:53.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.210+0000 7fd277e79640 1 --2- 172.21.15.45:0/3119567318 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fd2540668d0 0x7fd254068d90 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:53.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.210+0000 7fd277e79640 1 --2- 172.21.15.45:0/3119567318 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd2700cfed0 0x7fd2700b7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:53.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.210+0000 7fd277e79640 1 --2- 172.21.15.45:0/3119567318 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2700b3cb0 0x7fd27015e250 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:53.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.210+0000 7fd277e79640 1 --2- 172.21.15.45:0/3119567318 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd2700b35f0 0x7fd2700ca280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:53.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.210+0000 7fd277e79640 1 -- 172.21.15.45:0/3119567318 >> 172.21.15.45:0/3119567318 conn(0x7fd27009c4f0 msgr2=0x7fd2700afde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:43:53.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.210+0000 7fd277e79640 1 -- 172.21.15.45:0/3119567318 shutdown_connections 2023-11-28T18:43:53.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.210+0000 7fd277e79640 1 -- 172.21.15.45:0/3119567318 wait complete. 2023-11-28T18:43:53.240 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-28T18:43:53.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.390+0000 7f0b205df640 1 Processor -- start 2023-11-28T18:43:53.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.390+0000 7f0b205df640 1 -- start start 2023-11-28T18:43:53.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.390+0000 7f0b205df640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b180aee10 0x7f0b1815dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:53.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.390+0000 7f0b205df640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0b18071b10 0x7f0b180b41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:53.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.390+0000 7f0b205df640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b180b4700 con 0x7f0b1815a890 2023-11-28T18:43:53.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.390+0000 7f0b205df640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b18159be0 con 0x7f0b18071b10 2023-11-28T18:43:53.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.390+0000 7f0b205df640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b180af1f0 con 0x7f0b180aee10 2023-11-28T18:43:53.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.390+0000 7f0b1eb7c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0b18071b10 0x7f0b180b41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:53.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.390+0000 7f0b1db7a640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f0b1815a890 0x7f0b18071400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:60888/0 (socket says 172.21.15.45:60888) 2023-11-28T18:43:53.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.390+0000 7f0b1db7a640 1 -- 172.21.15.45:0/3325563857 learned_addr learned my addr 172.21.15.45:0/3325563857 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:43:53.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.390+0000 7f0b1e37b640 1 --2- 172.21.15.45:0/3325563857 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b180aee10 0x7f0b1815dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:53.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.390+0000 7f0b1eb7c640 1 -- 172.21.15.45:0/3325563857 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b180aee10 msgr2=0x7f0b1815dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:43:53.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.390+0000 7f0b1eb7c640 1 --2- 172.21.15.45:0/3325563857 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b180aee10 0x7f0b1815dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:53.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.390+0000 7f0b1eb7c640 1 -- 172.21.15.45:0/3325563857 >> v1:172.21.15.45:6789/0 conn(0x7f0b1815a890 legacy=0x7f0b18071400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:53.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.390+0000 7f0b1eb7c640 1 -- 172.21.15.45:0/3325563857 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b180b4930 con 0x7f0b18071b10 2023-11-28T18:43:53.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.390+0000 7f0b1e37b640 1 --2- 172.21.15.45:0/3325563857 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b180aee10 0x7f0b1815dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:43:53.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.390+0000 7f0b1eb7c640 1 --2- 172.21.15.45:0/3325563857 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b18071b10 0x7f0b180b41c0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f0b1000aea0 tx=0x7f0b1001d9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c8a3141172730c6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:53.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.390+0000 7f0b1d379640 1 -- 172.21.15.45:0/3325563857 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1000a2d0 con 0x7f0b18071b10 2023-11-28T18:43:53.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.390+0000 7f0b1d379640 1 -- 172.21.15.45:0/3325563857 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b100a66f0 con 0x7f0b18071b10 2023-11-28T18:43:53.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.390+0000 7f0b1d379640 1 -- 172.21.15.45:0/3325563857 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b100a6a80 con 0x7f0b18071b10 2023-11-28T18:43:53.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.390+0000 7f0b205df640 1 -- 172.21.15.45:0/3325563857 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b18071b10 msgr2=0x7f0b180b41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:53.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.390+0000 7f0b205df640 1 --2- 172.21.15.45:0/3325563857 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b18071b10 0x7f0b180b41c0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f0b1000aea0 tx=0x7f0b1001d9c0 comp rx=0 tx=0).stop 2023-11-28T18:43:53.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.390+0000 7f0b205df640 1 -- 172.21.15.45:0/3325563857 shutdown_connections 2023-11-28T18:43:53.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.390+0000 7f0b205df640 1 --2- 172.21.15.45:0/3325563857 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b18071b10 0x7f0b180b41c0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:53.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.390+0000 7f0b205df640 1 --2- 172.21.15.45:0/3325563857 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b180aee10 0x7f0b1815dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:53.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.390+0000 7f0b205df640 1 -- 172.21.15.45:0/3325563857 >> 172.21.15.45:0/3325563857 conn(0x7f0b180b1b70 msgr2=0x7f0b18070cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:43:53.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.390+0000 7f0b205df640 1 -- 172.21.15.45:0/3325563857 shutdown_connections 2023-11-28T18:43:53.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.394+0000 7f0b205df640 1 -- 172.21.15.45:0/3325563857 wait complete. 2023-11-28T18:43:53.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.394+0000 7f0b205df640 1 Processor -- start 2023-11-28T18:43:53.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.394+0000 7f0b205df640 1 -- start start 2023-11-28T18:43:53.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.394+0000 7f0b205df640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b18071b10 0x7f0b18146050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:53.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.394+0000 7f0b205df640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b180aee10 0x7f0b18157660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:53.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.394+0000 7f0b205df640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b1815a890 0x7f0b18150ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:53.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.394+0000 7f0b205df640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b181586d0 con 0x7f0b1815a890 2023-11-28T18:43:53.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.394+0000 7f0b205df640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1814f9f0 con 0x7f0b18071b10 2023-11-28T18:43:53.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.394+0000 7f0b205df640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1814fc40 con 0x7f0b180aee10 2023-11-28T18:43:53.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.394+0000 7f0b1eb7c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b1815a890 0x7f0b18150ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:53.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.394+0000 7f0b1eb7c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b1815a890 0x7f0b18150ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45876/0 (socket says 172.21.15.45:45876) 2023-11-28T18:43:53.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.394+0000 7f0b1eb7c640 1 -- 172.21.15.45:0/3395984558 learned_addr learned my addr 172.21.15.45:0/3395984558 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:43:53.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.394+0000 7f0b1e37b640 1 --2- 172.21.15.45:0/3395984558 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b18071b10 0x7f0b18146050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:53.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.394+0000 7f0b1db7a640 1 --2- 172.21.15.45:0/3395984558 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b180aee10 0x7f0b18157660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:53.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.394+0000 7f0b1eb7c640 1 -- 172.21.15.45:0/3395984558 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b180aee10 msgr2=0x7f0b18157660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:53.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.394+0000 7f0b1eb7c640 1 --2- 172.21.15.45:0/3395984558 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b180aee10 0x7f0b18157660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:53.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.394+0000 7f0b1eb7c640 1 -- 172.21.15.45:0/3395984558 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b18071b10 msgr2=0x7f0b18146050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:53.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.394+0000 7f0b1eb7c640 1 --2- 172.21.15.45:0/3395984558 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b18071b10 0x7f0b18146050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:53.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.394+0000 7f0b1eb7c640 1 -- 172.21.15.45:0/3395984558 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b1000ab80 con 0x7f0b1815a890 2023-11-28T18:43:53.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.394+0000 7f0b1eb7c640 1 --2- 172.21.15.45:0/3395984558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b1815a890 0x7f0b18150ce0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f0b1001b5f0 tx=0x7f0b1001a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:53.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.394+0000 7f0b0effd640 1 -- 172.21.15.45:0/3395984558 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b100b7680 con 0x7f0b1815a890 2023-11-28T18:43:53.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.394+0000 7f0b0effd640 1 -- 172.21.15.45:0/3395984558 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b100b77e0 con 0x7f0b1815a890 2023-11-28T18:43:53.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.394+0000 7f0b0effd640 1 -- 172.21.15.45:0/3395984558 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b100b7b90 con 0x7f0b1815a890 2023-11-28T18:43:53.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.394+0000 7f0b205df640 1 -- 172.21.15.45:0/3395984558 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b1814ff20 con 0x7f0b1815a890 2023-11-28T18:43:53.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.394+0000 7f0b205df640 1 -- 172.21.15.45:0/3395984558 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b181504e0 con 0x7f0b1815a890 2023-11-28T18:43:53.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.398+0000 7f0b205df640 1 -- 172.21.15.45:0/3395984558 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b18069410 con 0x7f0b1815a890 2023-11-28T18:43:53.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.398+0000 7f0b0effd640 1 -- 172.21.15.45:0/3395984558 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f0b100b7cf0 con 0x7f0b1815a890 2023-11-28T18:43:53.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.398+0000 7f0b0effd640 1 --2- 172.21.15.45:0/3395984558 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f0afc0668d0 0x7f0afc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:53.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.398+0000 7f0b0effd640 1 -- 172.21.15.45:0/3395984558 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f0b1011f640 con 0x7f0b1815a890 2023-11-28T18:43:53.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.398+0000 7f0b1e37b640 1 --2- 172.21.15.45:0/3395984558 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f0afc0668d0 0x7f0afc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:53.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.398+0000 7f0b1e37b640 1 --2- 172.21.15.45:0/3395984558 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f0afc0668d0 0x7f0afc068d90 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f0b1400a9a0 tx=0x7f0b14008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:53.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.406+0000 7f0b0effd640 1 -- 172.21.15.45:0/3395984558 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0b100ecc60 con 0x7f0b1815a890 2023-11-28T18:43:53.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.562+0000 7f0b205df640 1 -- 172.21.15.45:0/3395984558 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f0b1806e040 con 0x7f0b1815a890 2023-11-28T18:43:53.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.566+0000 7f0b0effd640 1 -- 172.21.15.45:0/3395984558 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0b100f0280 con 0x7f0b1815a890 2023-11-28T18:43:53.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.566+0000 7f0b205df640 1 -- 172.21.15.45:0/3395984558 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f0afc0668d0 msgr2=0x7f0afc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:53.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.566+0000 7f0b205df640 1 --2- 172.21.15.45:0/3395984558 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f0afc0668d0 0x7f0afc068d90 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f0b1400a9a0 tx=0x7f0b14008040 comp rx=0 tx=0).stop 2023-11-28T18:43:53.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.566+0000 7f0b205df640 1 -- 172.21.15.45:0/3395984558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b1815a890 msgr2=0x7f0b18150ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:53.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.566+0000 7f0b205df640 1 --2- 172.21.15.45:0/3395984558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b1815a890 0x7f0b18150ce0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f0b1001b5f0 tx=0x7f0b1001a760 comp rx=0 tx=0).stop 2023-11-28T18:43:53.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.566+0000 7f0b205df640 1 -- 172.21.15.45:0/3395984558 shutdown_connections 2023-11-28T18:43:53.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.566+0000 7f0b205df640 1 --2- 172.21.15.45:0/3395984558 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f0afc0668d0 0x7f0afc068d90 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:53.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.566+0000 7f0b205df640 1 --2- 172.21.15.45:0/3395984558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b1815a890 0x7f0b18150ce0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:53.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.566+0000 7f0b205df640 1 --2- 172.21.15.45:0/3395984558 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b180aee10 0x7f0b18157660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:53.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.566+0000 7f0b205df640 1 --2- 172.21.15.45:0/3395984558 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b18071b10 0x7f0b18146050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:53.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.566+0000 7f0b205df640 1 -- 172.21.15.45:0/3395984558 >> 172.21.15.45:0/3395984558 conn(0x7f0b180b1b70 msgr2=0x7f0b18071360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:43:53.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.566+0000 7f0b205df640 1 -- 172.21.15.45:0/3395984558 shutdown_connections 2023-11-28T18:43:53.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:53.566+0000 7f0b205df640 1 -- 172.21.15.45:0/3395984558 wait complete. 2023-11-28T18:43:53.592 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-28T18:43:53.593 DEBUG:teuthology.orchestra.run.smithi045:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T18:43:53.687 DEBUG:teuthology.orchestra.run.smithi190:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T18:43:53.793 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-28T18:43:53.794 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T18:43:53.794 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T18:43:53.804 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357768k,nr_inodes=4089442,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9360 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276000k,nr_inodes=819000,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-28T18:43:53.804 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-28T18:43:53.804 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T18:43:53.814 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354684k,nr_inodes=4088671,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9377 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-28T18:43:53.815 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T18:43:53.815 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T18:43:53.853 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357768k,nr_inodes=4089442,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9360 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276000k,nr_inodes=819000,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-28T18:43:53.853 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-28T18:43:53.853 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T18:43:53.871 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354684k,nr_inodes=4088671,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9377 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-28T18:43:53.871 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-28T18:43:53.872 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T18:43:54.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.038+0000 7eff875b8640 1 Processor -- start 2023-11-28T18:43:54.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.038+0000 7eff875b8640 1 -- start start 2023-11-28T18:43:54.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.042+0000 7eff875b8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff8015ad80 0x7eff80164e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:54.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.042+0000 7eff875b8640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff8015b3e0 con 0x7eff8006ca10 2023-11-28T18:43:54.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.042+0000 7eff875b8640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff8013f760 con 0x7eff8013cf70 2023-11-28T18:43:54.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.042+0000 7eff875b8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff8013d350 con 0x7eff8015ad80 2023-11-28T18:43:54.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.042+0000 7eff84b53640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7eff8006ca10 0x7eff8015a670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:60904/0 (socket says 172.21.15.45:60904) 2023-11-28T18:43:54.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.042+0000 7eff84b53640 1 -- 172.21.15.45:0/1115260657 learned_addr learned my addr 172.21.15.45:0/1115260657 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:43:54.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.042+0000 7eff85b55640 1 --2- 172.21.15.45:0/1115260657 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff8015ad80 0x7eff80164e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:54.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.042+0000 7eff77fff640 1 -- 172.21.15.45:0/1115260657 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4102179790 0 0) 0x7eff8015b3e0 con 0x7eff8006ca10 2023-11-28T18:43:54.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.042+0000 7eff77fff640 1 -- 172.21.15.45:0/1115260657 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff6c003530 con 0x7eff8006ca10 2023-11-28T18:43:54.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.042+0000 7eff77fff640 1 -- 172.21.15.45:0/1115260657 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1720998930 0 0) 0x7eff8013f760 con 0x7eff8013cf70 2023-11-28T18:43:54.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.042+0000 7eff77fff640 1 -- 172.21.15.45:0/1115260657 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff8015b3e0 con 0x7eff8013cf70 2023-11-28T18:43:54.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.042+0000 7eff85b55640 1 -- 172.21.15.45:0/1115260657 >> v1:172.21.15.190:6789/0 conn(0x7eff8013cf70 legacy=0x7eff8006c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:54.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.042+0000 7eff85b55640 1 -- 172.21.15.45:0/1115260657 >> v1:172.21.15.45:6789/0 conn(0x7eff8006ca10 legacy=0x7eff8015a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:54.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.042+0000 7eff77fff640 1 -- 172.21.15.45:0/1115260657 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1352466566 0 0) 0x7eff6c003530 con 0x7eff8006ca10 2023-11-28T18:43:54.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.042+0000 7eff85b55640 1 -- 172.21.15.45:0/1115260657 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff8013fa40 con 0x7eff8015ad80 2023-11-28T18:43:54.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.042+0000 7eff85b55640 1 --2- 172.21.15.45:0/1115260657 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff8015ad80 0x7eff80164e30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7eff78009dc0 tx=0x7eff7801c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff933c433869ce4e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:54.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.042+0000 7eff77fff640 1 -- 172.21.15.45:0/1115260657 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff70001680 con 0x7eff8015ad80 2023-11-28T18:43:54.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.042+0000 7eff77fff640 1 -- 172.21.15.45:0/1115260657 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff780a9450 con 0x7eff8015ad80 2023-11-28T18:43:54.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.042+0000 7eff77fff640 1 -- 172.21.15.45:0/1115260657 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff780a97c0 con 0x7eff8015ad80 2023-11-28T18:43:54.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.042+0000 7eff875b8640 1 -- 172.21.15.45:0/1115260657 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff8015ad80 msgr2=0x7eff80164e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:54.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.042+0000 7eff875b8640 1 --2- 172.21.15.45:0/1115260657 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff8015ad80 0x7eff80164e30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7eff78009dc0 tx=0x7eff7801c800 comp rx=0 tx=0).stop 2023-11-28T18:43:54.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.042+0000 7eff875b8640 1 -- 172.21.15.45:0/1115260657 shutdown_connections 2023-11-28T18:43:54.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.042+0000 7eff875b8640 1 --2- 172.21.15.45:0/1115260657 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff8015ad80 0x7eff80164e30 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:54.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.042+0000 7eff875b8640 1 -- 172.21.15.45:0/1115260657 >> 172.21.15.45:0/1115260657 conn(0x7eff8006a570 msgr2=0x7eff8006a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:43:54.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.042+0000 7eff875b8640 1 -- 172.21.15.45:0/1115260657 shutdown_connections 2023-11-28T18:43:54.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.042+0000 7eff875b8640 1 -- 172.21.15.45:0/1115260657 wait complete. 2023-11-28T18:43:54.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.042+0000 7eff875b8640 1 Processor -- start 2023-11-28T18:43:54.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.042+0000 7eff875b8640 1 -- start start 2023-11-28T18:43:54.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.046+0000 7eff875b8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff8006ca10 0x7eff8013b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:54.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.046+0000 7eff875b8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7eff8013cf70 0x7eff800b3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:54.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.046+0000 7eff875b8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff8015ad80 0x7eff80136090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:54.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.046+0000 7eff875b8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff800b3d80 con 0x7eff8015ad80 2023-11-28T18:43:54.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.046+0000 7eff875b8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff800b2720 con 0x7eff8013cf70 2023-11-28T18:43:54.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.046+0000 7eff875b8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff8014fde0 con 0x7eff8006ca10 2023-11-28T18:43:54.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.046+0000 7eff85b55640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff8015ad80 0x7eff80136090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:54.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.046+0000 7eff85b55640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff8015ad80 0x7eff80136090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45888/0 (socket says 172.21.15.45:45888) 2023-11-28T18:43:54.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.046+0000 7eff85b55640 1 -- 172.21.15.45:0/3811122450 learned_addr learned my addr 172.21.15.45:0/3811122450 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:43:54.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.046+0000 7eff84b53640 1 --2- 172.21.15.45:0/3811122450 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7eff8013cf70 0x7eff800b3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:54.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.046+0000 7eff85354640 1 --2- 172.21.15.45:0/3811122450 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff8006ca10 0x7eff8013b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:54.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.046+0000 7eff85b55640 1 -- 172.21.15.45:0/3811122450 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff8006ca10 msgr2=0x7eff8013b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:54.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.046+0000 7eff85b55640 1 --2- 172.21.15.45:0/3811122450 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff8006ca10 0x7eff8013b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:54.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.046+0000 7eff85b55640 1 -- 172.21.15.45:0/3811122450 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7eff8013cf70 msgr2=0x7eff800b3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:54.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.046+0000 7eff85b55640 1 --2- 172.21.15.45:0/3811122450 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7eff8013cf70 0x7eff800b3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:54.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.046+0000 7eff85b55640 1 -- 172.21.15.45:0/3811122450 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff78009a70 con 0x7eff8015ad80 2023-11-28T18:43:54.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.046+0000 7eff85354640 1 --2- 172.21.15.45:0/3811122450 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff8006ca10 0x7eff8013b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:43:54.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.046+0000 7eff85b55640 1 --2- 172.21.15.45:0/3811122450 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff8015ad80 0x7eff80136090 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7eff7801aeb0 tx=0x7eff780195a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:54.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.046+0000 7eff75ffb640 1 -- 172.21.15.45:0/3811122450 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff780b7070 con 0x7eff8015ad80 2023-11-28T18:43:54.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.046+0000 7eff75ffb640 1 -- 172.21.15.45:0/3811122450 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff78004250 con 0x7eff8015ad80 2023-11-28T18:43:54.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.046+0000 7eff875b8640 1 -- 172.21.15.45:0/3811122450 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff801500c0 con 0x7eff8015ad80 2023-11-28T18:43:54.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.046+0000 7eff75ffb640 1 -- 172.21.15.45:0/3811122450 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff780046a0 con 0x7eff8015ad80 2023-11-28T18:43:54.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.046+0000 7eff875b8640 1 -- 172.21.15.45:0/3811122450 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff800b1fd0 con 0x7eff8015ad80 2023-11-28T18:43:54.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.046+0000 7eff875b8640 1 -- 172.21.15.45:0/3811122450 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff800b28b0 con 0x7eff8015ad80 2023-11-28T18:43:54.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.046+0000 7eff75ffb640 1 -- 172.21.15.45:0/3811122450 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7eff780a95c0 con 0x7eff8015ad80 2023-11-28T18:43:54.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.050+0000 7eff75ffb640 1 --2- 172.21.15.45:0/3811122450 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7eff640668d0 0x7eff64068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:54.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.050+0000 7eff75ffb640 1 -- 172.21.15.45:0/3811122450 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5029+0+0 (secure 0 0 0) 0x7eff7811ea90 con 0x7eff8015ad80 2023-11-28T18:43:54.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.050+0000 7eff85354640 1 --2- 172.21.15.45:0/3811122450 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7eff640668d0 0x7eff64068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:54.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.050+0000 7eff85354640 1 --2- 172.21.15.45:0/3811122450 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7eff640668d0 0x7eff64068d90 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7eff7c0011f0 tx=0x7eff7c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:54.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.058+0000 7eff75ffb640 1 -- 172.21.15.45:0/3811122450 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7eff780ebed0 con 0x7eff8015ad80 2023-11-28T18:43:54.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.242+0000 7eff875b8640 1 -- 172.21.15.45:0/3811122450 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7eff800b21c0 con 0x7eff8015ad80 2023-11-28T18:43:54.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.242+0000 7eff75ffb640 1 -- 172.21.15.45:0/3811122450 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+3696 (secure 0 0 0) 0x7eff780ade80 con 0x7eff8015ad80 2023-11-28T18:43:54.248 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:43:54.248 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":41,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5414,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/114066704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":114066704},{"type":"v1","addr":"172.21.15.190:6836","nonce":114066704}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5417,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/27225494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":27225494},{"type":"v1","addr":"172.21.15.190:6837","nonce":27225494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5973,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1061201705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":1061201705},{"type":"v1","addr":"172.21.15.45:6835","nonce":1061201705}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":6457,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/2991041740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2991041740},{"type":"v1","addr":"172.21.15.45:6834","nonce":2991041740}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41}],"filesystems":[]} 2023-11-28T18:43:54.248 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 41 2023-11-28T18:43:54.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.246+0000 7eff875b8640 1 -- 172.21.15.45:0/3811122450 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7eff640668d0 msgr2=0x7eff64068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:54.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.246+0000 7eff875b8640 1 --2- 172.21.15.45:0/3811122450 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7eff640668d0 0x7eff64068d90 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7eff7c0011f0 tx=0x7eff7c009040 comp rx=0 tx=0).stop 2023-11-28T18:43:54.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.246+0000 7eff875b8640 1 -- 172.21.15.45:0/3811122450 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff8015ad80 msgr2=0x7eff80136090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:54.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.246+0000 7eff875b8640 1 --2- 172.21.15.45:0/3811122450 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff8015ad80 0x7eff80136090 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7eff7801aeb0 tx=0x7eff780195a0 comp rx=0 tx=0).stop 2023-11-28T18:43:54.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.246+0000 7eff875b8640 1 -- 172.21.15.45:0/3811122450 shutdown_connections 2023-11-28T18:43:54.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.246+0000 7eff875b8640 1 --2- 172.21.15.45:0/3811122450 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7eff640668d0 0x7eff64068d90 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:54.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.246+0000 7eff875b8640 1 --2- 172.21.15.45:0/3811122450 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff8015ad80 0x7eff80136090 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:54.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.246+0000 7eff875b8640 1 --2- 172.21.15.45:0/3811122450 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7eff8013cf70 0x7eff800b3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:54.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.246+0000 7eff875b8640 1 --2- 172.21.15.45:0/3811122450 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff8006ca10 0x7eff8013b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:54.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.246+0000 7eff875b8640 1 -- 172.21.15.45:0/3811122450 >> 172.21.15.45:0/3811122450 conn(0x7eff8006a570 msgr2=0x7eff80139d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:43:54.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.246+0000 7eff875b8640 1 -- 172.21.15.45:0/3811122450 shutdown_connections 2023-11-28T18:43:54.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.246+0000 7eff875b8640 1 -- 172.21.15.45:0/3811122450 wait complete. 2023-11-28T18:43:54.265 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:43:54.269 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:43:54.271 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-28T18:43:54.271 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-28T18:43:54.271 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-28T18:43:54.271 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T18:43:54.271 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-28T18:43:54.271 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-28T18:43:54.272 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-28T18:43:54.272 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T18:43:54.272 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-28T18:43:54.272 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-28T18:43:54.272 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-28T18:43:54.272 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T18:43:54.272 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-28T18:43:54.272 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-28T18:43:54.273 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-28T18:43:54.273 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T18:43:54.286 INFO:tasks.ceph.mds.b:Stopped 2023-11-28T18:43:54.286 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-28T18:43:54.300 INFO:tasks.ceph.mds.d:Stopped 2023-11-28T18:43:54.300 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-28T18:43:54.301 INFO:tasks.ceph.mds.b:Started 2023-11-28T18:43:54.302 DEBUG:teuthology.parallel:result is None 2023-11-28T18:43:54.304 INFO:tasks.ceph.mds.d:Started 2023-11-28T18:43:54.304 DEBUG:teuthology.parallel:result is None 2023-11-28T18:43:54.322 INFO:tasks.ceph.mds.c:Stopped 2023-11-28T18:43:54.323 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-28T18:43:54.323 INFO:tasks.ceph.mds.a:Stopped 2023-11-28T18:43:54.323 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-28T18:43:54.368 INFO:tasks.ceph.mds.c:Started 2023-11-28T18:43:54.368 DEBUG:teuthology.parallel:result is None 2023-11-28T18:43:54.370 INFO:tasks.ceph.mds.a:Started 2023-11-28T18:43:54.370 DEBUG:teuthology.parallel:result is None 2023-11-28T18:43:54.370 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-28T18:43:54.391 INFO:tasks.ceph.mds.b.smithi190.stdout:starting mds.b at 2023-11-28T18:43:54.391 INFO:tasks.ceph.mds.d.smithi190.stdout:starting mds.d at 2023-11-28T18:43:54.457 INFO:tasks.ceph.mds.c.smithi045.stdout:starting mds.c at 2023-11-28T18:43:54.459 INFO:tasks.ceph.mds.a.smithi045.stdout:starting mds.a at 2023-11-28T18:43:54.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.518+0000 7ff04af80640 1 Processor -- start 2023-11-28T18:43:54.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.518+0000 7ff04af80640 1 -- start start 2023-11-28T18:43:54.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.522+0000 7ff04af80640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff04406c300 0x7ff04406c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:54.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.522+0000 7ff04af80640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff0440b3440 0x7ff0440b3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:54.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.522+0000 7ff04af80640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff044140900 con 0x7ff0441401c0 2023-11-28T18:43:54.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.522+0000 7ff04af80640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff04406ccf0 con 0x7ff0440b3440 2023-11-28T18:43:54.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.522+0000 7ff04af80640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff04415dbc0 con 0x7ff04406c300 2023-11-28T18:43:54.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.522+0000 7ff04951d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff0440b3440 0x7ff0440b3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:54.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.522+0000 7ff04951d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff0440b3440 0x7ff0440b3870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.45:33754/0 (socket says 172.21.15.45:33754) 2023-11-28T18:43:54.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.522+0000 7ff043fff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff04406c300 0x7ff04406c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:54.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.522+0000 7ff04951d640 1 -- 172.21.15.45:0/2305870944 learned_addr learned my addr 172.21.15.45:0/2305870944 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:43:54.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.522+0000 7ff043fff640 1 -- 172.21.15.45:0/2305870944 >> v2:172.21.15.190:3300/0 conn(0x7ff0440b3440 msgr2=0x7ff0440b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:43:54.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.522+0000 7ff043fff640 1 --2- 172.21.15.45:0/2305870944 >> v2:172.21.15.190:3300/0 conn(0x7ff0440b3440 0x7ff0440b3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:54.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.522+0000 7ff043fff640 1 -- 172.21.15.45:0/2305870944 >> v1:172.21.15.190:6789/0 conn(0x7ff0441401c0 legacy=0x7ff044071f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:54.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.522+0000 7ff043fff640 1 -- 172.21.15.45:0/2305870944 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff04415dea0 con 0x7ff04406c300 2023-11-28T18:43:54.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.522+0000 7ff043fff640 1 --2- 172.21.15.45:0/2305870944 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff04406c300 0x7ff04406c7b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff0300097c0 tx=0x7ff03001c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e9f442d59ed5eb7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:54.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.522+0000 7ff0437fe640 1 -- 172.21.15.45:0/2305870944 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0440b45c0 con 0x7ff04406c300 2023-11-28T18:43:54.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.522+0000 7ff0437fe640 1 -- 172.21.15.45:0/2305870944 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0300ac620 con 0x7ff04406c300 2023-11-28T18:43:54.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.522+0000 7ff0437fe640 1 -- 172.21.15.45:0/2305870944 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0300ac9b0 con 0x7ff04406c300 2023-11-28T18:43:54.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.522+0000 7ff04af80640 1 -- 172.21.15.45:0/2305870944 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff04406c300 msgr2=0x7ff04406c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:54.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.522+0000 7ff04af80640 1 --2- 172.21.15.45:0/2305870944 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff04406c300 0x7ff04406c7b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff0300097c0 tx=0x7ff03001c3c0 comp rx=0 tx=0).stop 2023-11-28T18:43:54.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.522+0000 7ff04af80640 1 -- 172.21.15.45:0/2305870944 shutdown_connections 2023-11-28T18:43:54.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.522+0000 7ff04af80640 1 --2- 172.21.15.45:0/2305870944 >> v2:172.21.15.190:3300/0 conn(0x7ff0440b3440 0x7ff0440b3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:54.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.522+0000 7ff04af80640 1 --2- 172.21.15.45:0/2305870944 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff04406c300 0x7ff04406c7b0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:54.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.522+0000 7ff04af80640 1 -- 172.21.15.45:0/2305870944 >> 172.21.15.45:0/2305870944 conn(0x7ff04406a570 msgr2=0x7ff04406a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:43:54.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.522+0000 7ff04af80640 1 -- 172.21.15.45:0/2305870944 shutdown_connections 2023-11-28T18:43:54.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.522+0000 7ff04af80640 1 -- 172.21.15.45:0/2305870944 wait complete. 2023-11-28T18:43:54.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.522+0000 7ff04af80640 1 Processor -- start 2023-11-28T18:43:54.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.522+0000 7ff04af80640 1 -- start start 2023-11-28T18:43:54.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.526+0000 7ff04af80640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff04406c300 0x7ff0441564a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:54.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.526+0000 7ff04af80640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff0440b3440 0x7ff0440ad290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:54.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.526+0000 7ff04af80640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0441401c0 0x7ff0440aefa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:54.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.526+0000 7ff04af80640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0440adce0 con 0x7ff0441401c0 2023-11-28T18:43:54.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.526+0000 7ff04af80640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0440ae1e0 con 0x7ff04406c300 2023-11-28T18:43:54.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.526+0000 7ff04af80640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0440ae4c0 con 0x7ff0440b3440 2023-11-28T18:43:54.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.526+0000 7ff04951d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0441401c0 0x7ff0440aefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:54.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.526+0000 7ff04951d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0441401c0 0x7ff0440aefa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45930/0 (socket says 172.21.15.45:45930) 2023-11-28T18:43:54.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.526+0000 7ff04951d640 1 -- 172.21.15.45:0/2730101366 learned_addr learned my addr 172.21.15.45:0/2730101366 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:43:54.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.526+0000 7ff043fff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff0440b3440 0x7ff0440ad290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:54.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.526+0000 7ff048d1c640 1 --2- 172.21.15.45:0/2730101366 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff04406c300 0x7ff0441564a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:54.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.526+0000 7ff043fff640 1 -- 172.21.15.45:0/2730101366 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff04406c300 msgr2=0x7ff0441564a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:54.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.526+0000 7ff043fff640 1 --2- 172.21.15.45:0/2730101366 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff04406c300 0x7ff0441564a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:54.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.526+0000 7ff043fff640 1 -- 172.21.15.45:0/2730101366 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0441401c0 msgr2=0x7ff0440aefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:54.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.526+0000 7ff043fff640 1 --2- 172.21.15.45:0/2730101366 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0441401c0 0x7ff0440aefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:54.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.526+0000 7ff043fff640 1 -- 172.21.15.45:0/2730101366 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff030009420 con 0x7ff0440b3440 2023-11-28T18:43:54.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.526+0000 7ff04951d640 1 --2- 172.21.15.45:0/2730101366 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0441401c0 0x7ff0440aefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:43:54.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.526+0000 7ff043fff640 1 --2- 172.21.15.45:0/2730101366 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff0440b3440 0x7ff0440ad290 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff0300ac000 tx=0x7ff030019160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:54.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.526+0000 7ff0417fa640 1 -- 172.21.15.45:0/2730101366 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0300b5410 con 0x7ff0440b3440 2023-11-28T18:43:54.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.526+0000 7ff0417fa640 1 -- 172.21.15.45:0/2730101366 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0300b55b0 con 0x7ff0440b3440 2023-11-28T18:43:54.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.526+0000 7ff0417fa640 1 -- 172.21.15.45:0/2730101366 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0300b5960 con 0x7ff0440b3440 2023-11-28T18:43:54.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.526+0000 7ff04af80640 1 -- 172.21.15.45:0/2730101366 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0440ae7a0 con 0x7ff0440b3440 2023-11-28T18:43:54.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.526+0000 7ff04af80640 1 -- 172.21.15.45:0/2730101366 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0441569e0 con 0x7ff0440b3440 2023-11-28T18:43:54.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.526+0000 7ff04af80640 1 -- 172.21.15.45:0/2730101366 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff044069480 con 0x7ff0440b3440 2023-11-28T18:43:54.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.534+0000 7ff0417fa640 1 -- 172.21.15.45:0/2730101366 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ff0300b3040 con 0x7ff0440b3440 2023-11-28T18:43:54.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.534+0000 7ff0417fa640 1 --2- 172.21.15.45:0/2730101366 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff0280668d0 0x7ff028068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:54.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.534+0000 7ff0417fa640 1 -- 172.21.15.45:0/2730101366 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5029+0+0 (secure 0 0 0) 0x7ff03011e230 con 0x7ff0440b3440 2023-11-28T18:43:54.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.534+0000 7ff048d1c640 1 --2- 172.21.15.45:0/2730101366 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff0280668d0 0x7ff028068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:54.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.534+0000 7ff048d1c640 1 --2- 172.21.15.45:0/2730101366 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff0280668d0 0x7ff028068d90 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7ff044160b40 tx=0x7ff038009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:54.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.538+0000 7ff0417fa640 1 -- 172.21.15.45:0/2730101366 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff0300eb720 con 0x7ff0440b3440 2023-11-28T18:43:54.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:54.706+0000 7ff04af80640 1 -- 172.21.15.45:0/2730101366 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7ff044141940 con 0x7ff0440b3440 2023-11-28T18:43:55.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.234+0000 7ff0417fa640 1 -- 172.21.15.45:0/2730101366 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v54) v1 ==== 97+0+0 (secure 0 0 0) 0x7ff0300eed40 con 0x7ff0440b3440 2023-11-28T18:43:55.246 INFO:teuthology.orchestra.run.smithi045.stderr: removed all blocklist entries 2023-11-28T18:43:55.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.234+0000 7ff04af80640 1 -- 172.21.15.45:0/2730101366 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff0280668d0 msgr2=0x7ff028068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:55.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.234+0000 7ff04af80640 1 --2- 172.21.15.45:0/2730101366 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff0280668d0 0x7ff028068d90 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7ff044160b40 tx=0x7ff038009040 comp rx=0 tx=0).stop 2023-11-28T18:43:55.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.234+0000 7ff04af80640 1 -- 172.21.15.45:0/2730101366 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff0440b3440 msgr2=0x7ff0440ad290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:55.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.234+0000 7ff04af80640 1 --2- 172.21.15.45:0/2730101366 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff0440b3440 0x7ff0440ad290 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff0300ac000 tx=0x7ff030019160 comp rx=0 tx=0).stop 2023-11-28T18:43:55.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.234+0000 7ff04af80640 1 -- 172.21.15.45:0/2730101366 shutdown_connections 2023-11-28T18:43:55.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.234+0000 7ff04af80640 1 --2- 172.21.15.45:0/2730101366 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff0280668d0 0x7ff028068d90 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:55.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.234+0000 7ff04af80640 1 --2- 172.21.15.45:0/2730101366 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0441401c0 0x7ff0440aefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:55.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.234+0000 7ff04af80640 1 --2- 172.21.15.45:0/2730101366 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff0440b3440 0x7ff0440ad290 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:55.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.234+0000 7ff04af80640 1 --2- 172.21.15.45:0/2730101366 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff04406c300 0x7ff0441564a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:55.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.234+0000 7ff04af80640 1 -- 172.21.15.45:0/2730101366 >> 172.21.15.45:0/2730101366 conn(0x7ff04406a570 msgr2=0x7ff044140fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:43:55.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.234+0000 7ff04af80640 1 -- 172.21.15.45:0/2730101366 shutdown_connections 2023-11-28T18:43:55.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.234+0000 7ff04af80640 1 -- 172.21.15.45:0/2730101366 wait complete. 2023-11-28T18:43:55.259 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-28T18:43:55.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.406+0000 7fc3f572a640 1 Processor -- start 2023-11-28T18:43:55.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.406+0000 7fc3f572a640 1 -- start start 2023-11-28T18:43:55.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.410+0000 7fc3f572a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc3f006ca10 0x7fc3f00704a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:55.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.410+0000 7fc3f572a640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3f0071120 con 0x7fc3f0144880 2023-11-28T18:43:55.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.410+0000 7fc3f572a640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3f0071400 con 0x7fc3f00721c0 2023-11-28T18:43:55.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.410+0000 7fc3f572a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3f015f050 con 0x7fc3f006ca10 2023-11-28T18:43:55.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.410+0000 7fc3eeffd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fc3f0144880 0x7fc3f006c300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:60918/0 (socket says 172.21.15.45:60918) 2023-11-28T18:43:55.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.410+0000 7fc3eeffd640 1 -- 172.21.15.45:0/4015633955 learned_addr learned my addr 172.21.15.45:0/4015633955 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:43:55.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.410+0000 7fc3ee7fc640 1 --2- 172.21.15.45:0/4015633955 >> v2:172.21.15.45:3300/0 conn(0x7fc3f006ca10 0x7fc3f00704a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:55.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.410+0000 7fc3ee7fc640 1 -- 172.21.15.45:0/4015633955 >> v1:172.21.15.190:6789/0 conn(0x7fc3f00721c0 legacy=0x7fc3f015b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:43:55.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.410+0000 7fc3ee7fc640 1 -- 172.21.15.45:0/4015633955 >> v1:172.21.15.45:6789/0 conn(0x7fc3f0144880 legacy=0x7fc3f006c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:55.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.410+0000 7fc3ee7fc640 1 -- 172.21.15.45:0/4015633955 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3f00716e0 con 0x7fc3f006ca10 2023-11-28T18:43:55.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.410+0000 7fc3edffb640 1 -- 172.21.15.45:0/4015633955 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1131395013 0 0) 0x7fc3f0071120 con 0x7fc3f0144880 2023-11-28T18:43:55.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.414+0000 7fc3ee7fc640 1 --2- 172.21.15.45:0/4015633955 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3f006ca10 0x7fc3f00704a0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fc3e40097c0 tx=0x7fc3e401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f5bddc1b308d24f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:55.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.414+0000 7fc3edffb640 1 -- 172.21.15.45:0/4015633955 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e40ab610 con 0x7fc3f006ca10 2023-11-28T18:43:55.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.414+0000 7fc3edffb640 1 -- 172.21.15.45:0/4015633955 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3e40ab770 con 0x7fc3f006ca10 2023-11-28T18:43:55.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.414+0000 7fc3edffb640 1 -- 172.21.15.45:0/4015633955 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e40abb00 con 0x7fc3f006ca10 2023-11-28T18:43:55.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.414+0000 7fc3f572a640 1 -- 172.21.15.45:0/4015633955 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3f006ca10 msgr2=0x7fc3f00704a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:55.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.414+0000 7fc3f572a640 1 --2- 172.21.15.45:0/4015633955 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3f006ca10 0x7fc3f00704a0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fc3e40097c0 tx=0x7fc3e401c410 comp rx=0 tx=0).stop 2023-11-28T18:43:55.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.414+0000 7fc3f572a640 1 -- 172.21.15.45:0/4015633955 shutdown_connections 2023-11-28T18:43:55.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.414+0000 7fc3f572a640 1 --2- 172.21.15.45:0/4015633955 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3f006ca10 0x7fc3f00704a0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:55.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.414+0000 7fc3f572a640 1 -- 172.21.15.45:0/4015633955 >> 172.21.15.45:0/4015633955 conn(0x7fc3f006a570 msgr2=0x7fc3f006a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:43:55.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.414+0000 7fc3f572a640 1 -- 172.21.15.45:0/4015633955 shutdown_connections 2023-11-28T18:43:55.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.414+0000 7fc3f572a640 1 -- 172.21.15.45:0/4015633955 wait complete. 2023-11-28T18:43:55.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.414+0000 7fc3f572a640 1 Processor -- start 2023-11-28T18:43:55.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.414+0000 7fc3f572a640 1 -- start start 2023-11-28T18:43:55.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.414+0000 7fc3f572a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3f006ca10 0x7fc3f0159c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:55.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.414+0000 7fc3f572a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc3f00721c0 0x7fc3f013e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:55.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.414+0000 7fc3f572a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc3f0144880 0x7fc3f015da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:55.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.414+0000 7fc3f572a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f015a150 con 0x7fc3f006ca10 2023-11-28T18:43:55.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.414+0000 7fc3f572a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f013fa30 con 0x7fc3f0144880 2023-11-28T18:43:55.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.414+0000 7fc3f572a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f013a980 con 0x7fc3f00721c0 2023-11-28T18:43:55.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.418+0000 7fc3eeffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3f006ca10 0x7fc3f0159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:55.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.418+0000 7fc3eeffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3f006ca10 0x7fc3f0159c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45944/0 (socket says 172.21.15.45:45944) 2023-11-28T18:43:55.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.418+0000 7fc3eeffd640 1 -- 172.21.15.45:0/4024126490 learned_addr learned my addr 172.21.15.45:0/4024126490 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:43:55.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.418+0000 7fc3ee7fc640 1 --2- 172.21.15.45:0/4024126490 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc3f00721c0 0x7fc3f013e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:55.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.418+0000 7fc3ef7fe640 1 --2- 172.21.15.45:0/4024126490 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc3f0144880 0x7fc3f015da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:55.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.418+0000 7fc3eeffd640 1 -- 172.21.15.45:0/4024126490 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc3f00721c0 msgr2=0x7fc3f013e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:55.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.418+0000 7fc3eeffd640 1 --2- 172.21.15.45:0/4024126490 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc3f00721c0 0x7fc3f013e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:55.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.418+0000 7fc3eeffd640 1 -- 172.21.15.45:0/4024126490 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc3f0144880 msgr2=0x7fc3f015da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:55.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.418+0000 7fc3eeffd640 1 --2- 172.21.15.45:0/4024126490 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc3f0144880 0x7fc3f015da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:55.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.418+0000 7fc3eeffd640 1 -- 172.21.15.45:0/4024126490 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3e4009420 con 0x7fc3f006ca10 2023-11-28T18:43:55.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.418+0000 7fc3ef7fe640 1 --2- 172.21.15.45:0/4024126490 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc3f0144880 0x7fc3f015da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:43:55.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.418+0000 7fc3eeffd640 1 --2- 172.21.15.45:0/4024126490 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3f006ca10 0x7fc3f0159c10 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fc3e000c480 tx=0x7fc3e000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:55.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.418+0000 7fc3d77fe640 1 -- 172.21.15.45:0/4024126490 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e00074e0 con 0x7fc3f006ca10 2023-11-28T18:43:55.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.418+0000 7fc3d77fe640 1 -- 172.21.15.45:0/4024126490 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3e0007660 con 0x7fc3f006ca10 2023-11-28T18:43:55.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.418+0000 7fc3d77fe640 1 -- 172.21.15.45:0/4024126490 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e0004a30 con 0x7fc3f006ca10 2023-11-28T18:43:55.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.418+0000 7fc3f572a640 1 -- 172.21.15.45:0/4024126490 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3f013a3c0 con 0x7fc3f006ca10 2023-11-28T18:43:55.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.418+0000 7fc3f572a640 1 -- 172.21.15.45:0/4024126490 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3f013d940 con 0x7fc3f006ca10 2023-11-28T18:43:55.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.418+0000 7fc3f572a640 1 -- 172.21.15.45:0/4024126490 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3f013d7a0 con 0x7fc3f006ca10 2023-11-28T18:43:55.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.418+0000 7fc3d77fe640 1 -- 172.21.15.45:0/4024126490 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fc3e0004b90 con 0x7fc3f006ca10 2023-11-28T18:43:55.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.418+0000 7fc3d77fe640 1 --2- 172.21.15.45:0/4024126490 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fc3dc0668d0 0x7fc3dc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:55.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.418+0000 7fc3d77fe640 1 -- 172.21.15.45:0/4024126490 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc3e0083290 con 0x7fc3f006ca10 2023-11-28T18:43:55.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.422+0000 7fc3ee7fc640 1 --2- 172.21.15.45:0/4024126490 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fc3dc0668d0 0x7fc3dc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:55.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.422+0000 7fc3ee7fc640 1 --2- 172.21.15.45:0/4024126490 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fc3dc0668d0 0x7fc3dc068d90 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fc3e40af000 tx=0x7fc3e40a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:55.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.422+0000 7fc3d77fe640 1 -- 172.21.15.45:0/4024126490 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc3f013d7a0 con 0x7fc3f006ca10 2023-11-28T18:43:55.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.634+0000 7fc3f572a640 1 -- 172.21.15.45:0/4024126490 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fc3f013d7a0 con 0x7fc3f006ca10 2023-11-28T18:43:55.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.634+0000 7fc3d77fe640 1 -- 172.21.15.45:0/4024126490 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fc3f013d7a0 con 0x7fc3f006ca10 2023-11-28T18:43:55.637 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:43:55.637 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-11-28T18:43:55.637 INFO:teuthology.orchestra.run.smithi045.stdout: "auth_dump": [ 2023-11-28T18:43:55.637 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T18:43:55.638 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.a", 2023-11-28T18:43:55.638 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQApM2ZlwyjdFxAAPGPzbFeQHiSnfmd6fx12HA==", 2023-11-28T18:43:55.638 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T18:43:55.638 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-11-28T18:43:55.638 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-11-28T18:43:55.638 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-11-28T18:43:55.638 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T18:43:55.639 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:43:55.639 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:43:55.639 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T18:43:55.639 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.b", 2023-11-28T18:43:55.639 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQApM2ZlrJe9JBAAV2uXCF1nOYAUZf9Vm6BIWQ==", 2023-11-28T18:43:55.639 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T18:43:55.640 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-11-28T18:43:55.640 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-11-28T18:43:55.640 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-11-28T18:43:55.640 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T18:43:55.640 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:43:55.640 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:43:55.640 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T18:43:55.641 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.c", 2023-11-28T18:43:55.641 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQApM2Zl7guBHxAA42VxKvKwW30qtt+nyQZ4Aw==", 2023-11-28T18:43:55.641 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T18:43:55.641 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-11-28T18:43:55.641 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-11-28T18:43:55.641 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-11-28T18:43:55.641 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T18:43:55.642 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:43:55.642 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:43:55.642 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T18:43:55.642 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.d", 2023-11-28T18:43:55.643 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQApM2Zl1xU7LBAAHQ+Co90EW5qv+8793OyE/A==", 2023-11-28T18:43:55.643 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T18:43:55.644 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-11-28T18:43:55.644 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-11-28T18:43:55.644 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-11-28T18:43:55.644 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T18:43:55.644 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:43:55.644 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:43:55.644 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T18:43:55.645 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.0", 2023-11-28T18:43:55.645 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQArM2ZluGYOEhAAOKSw2u1izQOjdoRctC8s7g==", 2023-11-28T18:43:55.645 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T18:43:55.645 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-11-28T18:43:55.645 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-11-28T18:43:55.645 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T18:43:55.646 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:43:55.646 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:43:55.646 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T18:43:55.646 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.1", 2023-11-28T18:43:55.646 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAuM2ZlIFuuGRAAK+YCnRUy8yKlojp9gukUYw==", 2023-11-28T18:43:55.646 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T18:43:55.646 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-11-28T18:43:55.647 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-11-28T18:43:55.647 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T18:43:55.647 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:43:55.647 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:43:55.647 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T18:43:55.647 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.2", 2023-11-28T18:43:55.648 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAxM2ZlOytnHxAAxXh2AsKCqrG5iYdmnF9+Qg==", 2023-11-28T18:43:55.648 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T18:43:55.648 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-11-28T18:43:55.648 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-11-28T18:43:55.648 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T18:43:55.648 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:43:55.648 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:43:55.648 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T18:43:55.649 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.3", 2023-11-28T18:43:55.649 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQA0M2Zl2fnBJxAAv68KZJFnQWwyUupB+whAEg==", 2023-11-28T18:43:55.649 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T18:43:55.649 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-11-28T18:43:55.649 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-11-28T18:43:55.649 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T18:43:55.649 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:43:55.649 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:43:55.649 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T18:43:55.649 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.4", 2023-11-28T18:43:55.649 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQA6M2ZllZg1MBAAzvMRW0IZnwwqfzhJ7wWjjQ==", 2023-11-28T18:43:55.650 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T18:43:55.650 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-11-28T18:43:55.650 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-11-28T18:43:55.650 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T18:43:55.650 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:43:55.650 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:43:55.650 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T18:43:55.651 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.5", 2023-11-28T18:43:55.651 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQA9M2Zlq0KjNxAAXOkL+JS09zzWRoPlgPGx+A==", 2023-11-28T18:43:55.651 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T18:43:55.651 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-11-28T18:43:55.651 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-11-28T18:43:55.651 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T18:43:55.652 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:43:55.652 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:43:55.652 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T18:43:55.652 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.6", 2023-11-28T18:43:55.652 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBBM2ZlVUVPAhAAurFCH6ubc+fXb8cUcg2nIg==", 2023-11-28T18:43:55.652 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T18:43:55.652 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-11-28T18:43:55.653 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-11-28T18:43:55.653 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T18:43:55.653 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:43:55.653 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:43:55.653 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T18:43:55.653 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.7", 2023-11-28T18:43:55.654 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQBEM2ZlD846CRAA7GWGdOzRdv8vN7YbQyU4NQ==", 2023-11-28T18:43:55.654 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T18:43:55.654 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-11-28T18:43:55.654 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-11-28T18:43:55.655 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T18:43:55.655 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:43:55.655 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:43:55.656 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T18:43:55.656 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.0", 2023-11-28T18:43:55.656 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQApM2ZlTJxNMBAAwJAMWm1Y180iNJmgHnWFnw==", 2023-11-28T18:43:55.656 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T18:43:55.656 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-11-28T18:43:55.656 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow r", 2023-11-28T18:43:55.656 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-28T18:43:55.656 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:43:55.656 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:43:55.657 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T18:43:55.657 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.1", 2023-11-28T18:43:55.657 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQApM2Zl7yM7OhAA+Nu2Ay/zIVuRsCk90QGWbg==", 2023-11-28T18:43:55.657 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T18:43:55.657 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-11-28T18:43:55.657 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-11-28T18:43:55.657 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-11-28T18:43:55.657 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-11-28T18:43:55.657 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:43:55.657 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:43:55.657 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T18:43:55.658 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.2", 2023-11-28T18:43:55.658 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQApM2ZlhvR6NhAAbs7Rqb1gatb4fymZ2IHy5w==", 2023-11-28T18:43:55.658 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T18:43:55.658 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-11-28T18:43:55.658 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-11-28T18:43:55.658 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-11-28T18:43:55.658 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-11-28T18:43:55.658 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:43:55.658 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:43:55.658 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T18:43:55.658 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.3", 2023-11-28T18:43:55.659 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqM2ZlsarFBBAA1avYCNMV4t4UGM00iN6XiQ==", 2023-11-28T18:43:55.659 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T18:43:55.659 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-11-28T18:43:55.659 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-11-28T18:43:55.659 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-11-28T18:43:55.659 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-11-28T18:43:55.659 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:43:55.659 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:43:55.660 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T18:43:55.660 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.admin", 2023-11-28T18:43:55.660 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAoM2Zlhs1lNhAAsjadFkCQjkeqhuBhlHrHfQ==", 2023-11-28T18:43:55.660 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T18:43:55.660 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-11-28T18:43:55.660 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-11-28T18:43:55.660 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-11-28T18:43:55.660 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T18:43:55.660 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:43:55.660 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:43:55.660 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T18:43:55.660 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mgr.x", 2023-11-28T18:43:55.661 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQApM2ZlVReeExAAlYEJ4EwbGHtSUIkimoiJ2Q==", 2023-11-28T18:43:55.661 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T18:43:55.661 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-11-28T18:43:55.661 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile mgr", 2023-11-28T18:43:55.661 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T18:43:55.661 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:43:55.661 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:43:55.661 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T18:43:55.661 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mgr.y", 2023-11-28T18:43:55.661 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQApM2ZlnK1sDxAAfGqLMBH8IHZdQ7he/TVa6w==", 2023-11-28T18:43:55.662 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T18:43:55.662 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-11-28T18:43:55.663 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile mgr", 2023-11-28T18:43:55.663 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T18:43:55.663 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:43:55.663 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:43:55.663 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-11-28T18:43:55.664 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-11-28T18:43:55.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.638+0000 7fc3f572a640 1 -- 172.21.15.45:0/4024126490 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fc3dc0668d0 msgr2=0x7fc3dc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:55.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.638+0000 7fc3f572a640 1 --2- 172.21.15.45:0/4024126490 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fc3dc0668d0 0x7fc3dc068d90 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fc3e40af000 tx=0x7fc3e40a7000 comp rx=0 tx=0).stop 2023-11-28T18:43:55.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.638+0000 7fc3f572a640 1 -- 172.21.15.45:0/4024126490 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3f006ca10 msgr2=0x7fc3f0159c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:55.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.638+0000 7fc3f572a640 1 --2- 172.21.15.45:0/4024126490 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3f006ca10 0x7fc3f0159c10 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fc3e000c480 tx=0x7fc3e000c940 comp rx=0 tx=0).stop 2023-11-28T18:43:55.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.638+0000 7fc3f572a640 1 -- 172.21.15.45:0/4024126490 shutdown_connections 2023-11-28T18:43:55.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.638+0000 7fc3f572a640 1 --2- 172.21.15.45:0/4024126490 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fc3dc0668d0 0x7fc3dc068d90 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:55.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.638+0000 7fc3f572a640 1 --2- 172.21.15.45:0/4024126490 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc3f0144880 0x7fc3f015da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:55.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.638+0000 7fc3f572a640 1 --2- 172.21.15.45:0/4024126490 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc3f00721c0 0x7fc3f013e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:55.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.638+0000 7fc3f572a640 1 --2- 172.21.15.45:0/4024126490 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3f006ca10 0x7fc3f0159c10 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:55.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.638+0000 7fc3f572a640 1 -- 172.21.15.45:0/4024126490 >> 172.21.15.45:0/4024126490 conn(0x7fc3f006a570 msgr2=0x7fc3f006c300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:43:55.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.638+0000 7fc3f572a640 1 -- 172.21.15.45:0/4024126490 shutdown_connections 2023-11-28T18:43:55.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.638+0000 7fc3f572a640 1 -- 172.21.15.45:0/4024126490 wait complete. 2023-11-28T18:43:55.669 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T18:43:55.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.810+0000 7f300506b640 1 Processor -- start 2023-11-28T18:43:55.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.810+0000 7f300506b640 1 -- start start 2023-11-28T18:43:55.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.814+0000 7f300506b640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f30000b3f20 0x7f30000b2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:55.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.814+0000 7f300506b640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30000d0670 con 0x7f30001449a0 2023-11-28T18:43:55.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.814+0000 7f300506b640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30000b3510 con 0x7f30000b30f0 2023-11-28T18:43:55.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.814+0000 7f300506b640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30000cbd20 con 0x7f30000b3f20 2023-11-28T18:43:55.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.814+0000 7f2ffed9d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f30001449a0 0x7f300006f3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:60926/0 (socket says 172.21.15.45:60926) 2023-11-28T18:43:55.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.814+0000 7f2ffed9d640 1 -- 172.21.15.45:0/3335063701 learned_addr learned my addr 172.21.15.45:0/3335063701 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:43:55.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.814+0000 7f2ffe59c640 1 -- 172.21.15.45:0/3335063701 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3500267985 0 0) 0x7f30000d0670 con 0x7f30001449a0 2023-11-28T18:43:55.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.814+0000 7f2ffe59c640 1 -- 172.21.15.45:0/3335063701 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fec003530 con 0x7f30001449a0 2023-11-28T18:43:55.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.814+0000 7f2ff7fff640 1 --2- 172.21.15.45:0/3335063701 >> v2:172.21.15.190:3300/0 conn(0x7f30000b3f20 0x7f30000b2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:55.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.814+0000 7f2ffe59c640 1 -- 172.21.15.45:0/3335063701 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 377955996 0 0) 0x7f2fec003530 con 0x7f30001449a0 2023-11-28T18:43:55.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.814+0000 7f2ffe59c640 1 -- 172.21.15.45:0/3335063701 >> v2:172.21.15.190:3300/0 conn(0x7f30000b3f20 msgr2=0x7f30000b2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:43:55.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.814+0000 7f2ffe59c640 1 --2- 172.21.15.45:0/3335063701 >> v2:172.21.15.190:3300/0 conn(0x7f30000b3f20 0x7f30000b2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:55.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.814+0000 7f2ffe59c640 1 -- 172.21.15.45:0/3335063701 >> v1:172.21.15.190:6789/0 conn(0x7f30000b30f0 legacy=0x7f30000cf020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:55.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.814+0000 7f2ffe59c640 1 -- 172.21.15.45:0/3335063701 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30000cb760 con 0x7f30001449a0 2023-11-28T18:43:55.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.814+0000 7f2ffe59c640 1 -- 172.21.15.45:0/3335063701 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4084481567 0 0) 0x7f2ff0001680 con 0x7f30001449a0 2023-11-28T18:43:55.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.814+0000 7f2ff7fff640 1 --2- 172.21.15.45:0/3335063701 >> v2:172.21.15.190:3300/0 conn(0x7f30000b3f20 0x7f30000b2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:43:55.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.814+0000 7f2ffe59c640 1 -- 172.21.15.45:0/3335063701 >> v1:172.21.15.45:6789/0 conn(0x7f30001449a0 legacy=0x7f300006f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:55.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.814+0000 7f2ffe59c640 1 --2- 172.21.15.45:0/3335063701 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2fec003980 0x7f2fec003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:55.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.814+0000 7f2ffe59c640 1 --2- 172.21.15.45:0/3335063701 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2fec0047d0 0x7f2fec004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:55.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.814+0000 7f2ffe59c640 1 --2- 172.21.15.45:0/3335063701 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fec005190 0x7f2fec00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:55.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.814+0000 7f2ffe59c640 1 -- 172.21.15.45:0/3335063701 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30000cbd20 con 0x7f2fec005190 2023-11-28T18:43:55.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.814+0000 7f2ffe59c640 1 -- 172.21.15.45:0/3335063701 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fec00c0e0 con 0x7f2fec0047d0 2023-11-28T18:43:55.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.814+0000 7f2ffe59c640 1 -- 172.21.15.45:0/3335063701 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fec00c2a0 con 0x7f2fec003980 2023-11-28T18:43:55.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.814+0000 7f2fff59e640 1 --2- 172.21.15.45:0/3335063701 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fec005190 0x7f2fec00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:55.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.814+0000 7f2ffed9d640 1 --2- 172.21.15.45:0/3335063701 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2fec003980 0x7f2fec003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:55.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.814+0000 7f2ff7fff640 1 --2- 172.21.15.45:0/3335063701 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2fec0047d0 0x7f2fec004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:55.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.814+0000 7f2fff59e640 1 -- 172.21.15.45:0/3335063701 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2fec003980 msgr2=0x7f2fec003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:43:55.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.814+0000 7f2fff59e640 1 --2- 172.21.15.45:0/3335063701 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2fec003980 0x7f2fec003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:55.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.814+0000 7f2fff59e640 1 -- 172.21.15.45:0/3335063701 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2fec0047d0 msgr2=0x7f2fec004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:43:55.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.814+0000 7f2fff59e640 1 --2- 172.21.15.45:0/3335063701 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2fec0047d0 0x7f2fec004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:55.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.814+0000 7f2fff59e640 1 -- 172.21.15.45:0/3335063701 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fec003530 con 0x7f2fec005190 2023-11-28T18:43:55.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.818+0000 7f2fff59e640 1 -- 172.21.15.45:0/3335063701 reap_dead start 2023-11-28T18:43:55.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.818+0000 7f2fff59e640 1 --2- 172.21.15.45:0/3335063701 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fec005190 0x7f2fec00b990 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f2ff8001e70 tx=0x7f2ff801c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64203a60ef31f057 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:55.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.818+0000 7f2ffe59c640 1 -- 172.21.15.45:0/3335063701 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff8003b80 con 0x7f2fec005190 2023-11-28T18:43:55.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.818+0000 7f2ffe59c640 1 -- 172.21.15.45:0/3335063701 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ff8003d20 con 0x7f2fec005190 2023-11-28T18:43:55.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.818+0000 7f2ffe59c640 1 -- 172.21.15.45:0/3335063701 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff8005260 con 0x7f2fec005190 2023-11-28T18:43:55.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.818+0000 7f300506b640 1 -- 172.21.15.45:0/3335063701 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fec005190 msgr2=0x7f2fec00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:55.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.818+0000 7f300506b640 1 --2- 172.21.15.45:0/3335063701 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fec005190 0x7f2fec00b990 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f2ff8001e70 tx=0x7f2ff801c760 comp rx=0 tx=0).stop 2023-11-28T18:43:55.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.818+0000 7f300506b640 1 -- 172.21.15.45:0/3335063701 shutdown_connections 2023-11-28T18:43:55.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.818+0000 7f300506b640 1 --2- 172.21.15.45:0/3335063701 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fec005190 0x7f2fec00b990 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:55.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.818+0000 7f300506b640 1 -- 172.21.15.45:0/3335063701 >> 172.21.15.45:0/3335063701 conn(0x7f300006a570 msgr2=0x7f300006a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:43:55.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.818+0000 7f300506b640 1 -- 172.21.15.45:0/3335063701 shutdown_connections 2023-11-28T18:43:55.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.818+0000 7f300506b640 1 -- 172.21.15.45:0/3335063701 wait complete. 2023-11-28T18:43:55.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.822+0000 7f300506b640 1 Processor -- start 2023-11-28T18:43:55.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.822+0000 7f300506b640 1 -- start start 2023-11-28T18:43:55.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.822+0000 7f300506b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2fec005190 0x7f3000159850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:55.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.822+0000 7f300506b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f300015e220 0x7f300013bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:55.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.822+0000 7f300506b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f300013a890 0x7f300006cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:55.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.822+0000 7f300506b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f300013c530 con 0x7f300015e220 2023-11-28T18:43:55.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.822+0000 7f300506b640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f300015d210 con 0x7f2fec005190 2023-11-28T18:43:55.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.822+0000 7f300506b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f300015dd90 con 0x7f300013a890 2023-11-28T18:43:55.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.822+0000 7f2ff7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f300015e220 0x7f300013bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:55.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.822+0000 7f2ff7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f300015e220 0x7f300013bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45956/0 (socket says 172.21.15.45:45956) 2023-11-28T18:43:55.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.822+0000 7f2ff7fff640 1 -- 172.21.15.45:0/3401326741 learned_addr learned my addr 172.21.15.45:0/3401326741 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:43:55.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.822+0000 7f2ffed9d640 1 --2- 172.21.15.45:0/3401326741 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2fec005190 0x7f3000159850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:55.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.822+0000 7f2fff59e640 1 --2- 172.21.15.45:0/3401326741 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f300013a890 0x7f300006cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:55.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.822+0000 7f2ff7fff640 1 -- 172.21.15.45:0/3401326741 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f300013a890 msgr2=0x7f300006cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:55.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.822+0000 7f2ff7fff640 1 --2- 172.21.15.45:0/3401326741 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f300013a890 0x7f300006cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:55.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.822+0000 7f2ff7fff640 1 -- 172.21.15.45:0/3401326741 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2fec005190 msgr2=0x7f3000159850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:55.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.822+0000 7f2ff7fff640 1 --2- 172.21.15.45:0/3401326741 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2fec005190 0x7f3000159850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:55.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.822+0000 7f2ff7fff640 1 -- 172.21.15.45:0/3401326741 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f300015e6a0 con 0x7f300015e220 2023-11-28T18:43:55.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.822+0000 7f2ff7fff640 1 --2- 172.21.15.45:0/3401326741 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f300015e220 0x7f300013bd20 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f2fe80115c0 tx=0x7f2fe80119c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:55.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.822+0000 7f2ff77fe640 1 -- 172.21.15.45:0/3401326741 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe8004440 con 0x7f300015e220 2023-11-28T18:43:55.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.822+0000 7f2ff77fe640 1 -- 172.21.15.45:0/3401326741 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fe8003620 con 0x7f300015e220 2023-11-28T18:43:55.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.822+0000 7f2ff77fe640 1 -- 172.21.15.45:0/3401326741 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe8003990 con 0x7f300015e220 2023-11-28T18:43:55.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.822+0000 7f300506b640 1 -- 172.21.15.45:0/3401326741 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f300013c260 con 0x7f300015e220 2023-11-28T18:43:55.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.822+0000 7f300506b640 1 -- 172.21.15.45:0/3401326741 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f300015d740 con 0x7f300015e220 2023-11-28T18:43:55.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.826+0000 7f300506b640 1 -- 172.21.15.45:0/3401326741 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3000069480 con 0x7f300015e220 2023-11-28T18:43:55.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.826+0000 7f2ff77fe640 1 -- 172.21.15.45:0/3401326741 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f2fe8003af0 con 0x7f300015e220 2023-11-28T18:43:55.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.826+0000 7f2ff77fe640 1 --2- 172.21.15.45:0/3401326741 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f2fe0066900 0x7f2fe0068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:55.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.826+0000 7f2ff77fe640 1 -- 172.21.15.45:0/3401326741 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2fe8084500 con 0x7f300015e220 2023-11-28T18:43:55.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.826+0000 7f2ffed9d640 1 --2- 172.21.15.45:0/3401326741 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f2fe0066900 0x7f2fe0068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:55.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.826+0000 7f2ffed9d640 1 --2- 172.21.15.45:0/3401326741 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f2fe0066900 0x7f2fe0068dc0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f2ff0007d30 tx=0x7f2ff0000ee0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:55.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.830+0000 7f2ff77fe640 1 -- 172.21.15.45:0/3401326741 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2fe8051a00 con 0x7f300015e220 2023-11-28T18:43:55.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.990+0000 7f300506b640 1 -- 172.21.15.45:0/3401326741 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f300015ded0 con 0x7f300015e220 2023-11-28T18:43:55.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.990+0000 7f2ff77fe640 1 -- 172.21.15.45:0/3401326741 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+12821 (secure 0 0 0) 0x7f2fe8055020 con 0x7f300015e220 2023-11-28T18:43:55.990 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:43:55.991 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":56,"fsid":"d10f5cd6-1d00-4019-99b6-6fa435498a15","created":"2023-11-28T18:37:08.189030+0000","modified":"2023-11-28T18:43:55.238991+0000","last_up_change":"2023-11-28T18:37:20.196124+0000","last_in_change":"2023-11-28T18:37:10.742043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T18:37:21.293917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"84465384-103c-4f2c-a45a-96f5bb9c835f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6809","nonce":555237322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6811","nonce":555237322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6815","nonce":555237322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6813","nonce":555237322}]},"public_addr":"172.21.15.45:6809/555237322","cluster_addr":"172.21.15.45:6811/555237322","heartbeat_back_addr":"172.21.15.45:6815/555237322","heartbeat_front_addr":"172.21.15.45:6813/555237322","state":["exists","up"]},{"osd":1,"uuid":"7d9eed24-a58f-42c7-a787-ac06be8553fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6801","nonce":2857063763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6803","nonce":2857063763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6807","nonce":2857063763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6805","nonce":2857063763}]},"public_addr":"172.21.15.45:6801/2857063763","cluster_addr":"172.21.15.45:6803/2857063763","heartbeat_back_addr":"172.21.15.45:6807/2857063763","heartbeat_front_addr":"172.21.15.45:6805/2857063763","state":["exists","up"]},{"osd":2,"uuid":"575eeccc-4abf-45b4-9caf-f3e797859588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6817","nonce":193884539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6819","nonce":193884539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6823","nonce":193884539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6821","nonce":193884539}]},"public_addr":"172.21.15.45:6817/193884539","cluster_addr":"172.21.15.45:6819/193884539","heartbeat_back_addr":"172.21.15.45:6823/193884539","heartbeat_front_addr":"172.21.15.45:6821/193884539","state":["exists","up"]},{"osd":3,"uuid":"9b0290d6-9a52-4bc8-b2a1-7622c5dc8e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6825","nonce":78541084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6827","nonce":78541084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6831","nonce":78541084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6829","nonce":78541084}]},"public_addr":"172.21.15.45:6825/78541084","cluster_addr":"172.21.15.45:6827/78541084","heartbeat_back_addr":"172.21.15.45:6831/78541084","heartbeat_front_addr":"172.21.15.45:6829/78541084","state":["exists","up"]},{"osd":4,"uuid":"ce632829-f027-4fbf-a627-02c571aa9d53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6809","nonce":1537591987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6811","nonce":1537591987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6815","nonce":1537591987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6813","nonce":1537591987}]},"public_addr":"172.21.15.190:6809/1537591987","cluster_addr":"172.21.15.190:6811/1537591987","heartbeat_back_addr":"172.21.15.190:6815/1537591987","heartbeat_front_addr":"172.21.15.190:6813/1537591987","state":["exists","up"]},{"osd":5,"uuid":"8700b609-27be-40bd-a251-4c0ae0a29ead","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6801","nonce":3296698407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6803","nonce":3296698407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6807","nonce":3296698407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6805","nonce":3296698407}]},"public_addr":"172.21.15.190:6801/3296698407","cluster_addr":"172.21.15.190:6803/3296698407","heartbeat_back_addr":"172.21.15.190:6807/3296698407","heartbeat_front_addr":"172.21.15.190:6805/3296698407","state":["exists","up"]},{"osd":6,"uuid":"44ce4a40-e6ff-4f4d-8e8a-7341e5c91f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6817","nonce":2317686718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6819","nonce":2317686718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6823","nonce":2317686718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6821","nonce":2317686718}]},"public_addr":"172.21.15.190:6817/2317686718","cluster_addr":"172.21.15.190:6819/2317686718","heartbeat_back_addr":"172.21.15.190:6823/2317686718","heartbeat_front_addr":"172.21.15.190:6821/2317686718","state":["exists","up"]},{"osd":7,"uuid":"192238c9-1423-4b7e-ac8f-84ba32113ddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6825","nonce":2493232051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6827","nonce":2493232051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6831","nonce":2493232051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6829","nonce":2493232051}]},"public_addr":"172.21.15.190:6825/2493232051","cluster_addr":"172.21.15.190:6827/2493232051","heartbeat_back_addr":"172.21.15.190:6831/2493232051","heartbeat_front_addr":"172.21.15.190:6829/2493232051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.393552+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.385453+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.361421+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.366408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.363226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.276007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.414605+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.445885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T18:43:55.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.990+0000 7f300506b640 1 -- 172.21.15.45:0/3401326741 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f2fe0066900 msgr2=0x7f2fe0068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:55.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.990+0000 7f300506b640 1 --2- 172.21.15.45:0/3401326741 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f2fe0066900 0x7f2fe0068dc0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f2ff0007d30 tx=0x7f2ff0000ee0 comp rx=0 tx=0).stop 2023-11-28T18:43:55.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.990+0000 7f300506b640 1 -- 172.21.15.45:0/3401326741 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f300015e220 msgr2=0x7f300013bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:55.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.990+0000 7f300506b640 1 --2- 172.21.15.45:0/3401326741 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f300015e220 0x7f300013bd20 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f2fe80115c0 tx=0x7f2fe80119c0 comp rx=0 tx=0).stop 2023-11-28T18:43:55.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.990+0000 7f300506b640 1 -- 172.21.15.45:0/3401326741 shutdown_connections 2023-11-28T18:43:55.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.990+0000 7f300506b640 1 --2- 172.21.15.45:0/3401326741 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f2fe0066900 0x7f2fe0068dc0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:55.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.990+0000 7f300506b640 1 --2- 172.21.15.45:0/3401326741 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f300013a890 0x7f300006cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:55.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.990+0000 7f300506b640 1 --2- 172.21.15.45:0/3401326741 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f300015e220 0x7f300013bd20 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:55.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.990+0000 7f300506b640 1 --2- 172.21.15.45:0/3401326741 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2fec005190 0x7f3000159850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:55.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.990+0000 7f300506b640 1 -- 172.21.15.45:0/3401326741 >> 172.21.15.45:0/3401326741 conn(0x7f300006a570 msgr2=0x7f300006be90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:43:55.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.990+0000 7f300506b640 1 -- 172.21.15.45:0/3401326741 shutdown_connections 2023-11-28T18:43:55.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:55.990+0000 7f300506b640 1 -- 172.21.15.45:0/3401326741 wait complete. 2023-11-28T18:43:56.012 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T18:37:21.293917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T18:43:56.012 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T18:43:56.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.158+0000 7fbd98646640 1 Processor -- start 2023-11-28T18:43:56.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.158+0000 7fbd98646640 1 -- start start 2023-11-28T18:43:56.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.158+0000 7fbd98646640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbd900ce9a0 0x7fbd900ae0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:56.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.158+0000 7fbd98646640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd900af1c0 con 0x7fbd9006bc90 2023-11-28T18:43:56.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.158+0000 7fbd98646640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd900ae920 con 0x7fbd900ced80 2023-11-28T18:43:56.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.158+0000 7fbd98646640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd900aec00 con 0x7fbd900ce9a0 2023-11-28T18:43:56.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.158+0000 7fbd96be3640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fbd9006bc90 0x7fbd900b2d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:60936/0 (socket says 172.21.15.45:60936) 2023-11-28T18:43:56.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.158+0000 7fbd96be3640 1 -- 172.21.15.45:0/1669503594 learned_addr learned my addr 172.21.15.45:0/1669503594 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:43:56.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.158+0000 7fbd963e2640 1 --2- 172.21.15.45:0/1669503594 >> v2:172.21.15.45:3300/0 conn(0x7fbd900ce9a0 0x7fbd900ae0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:56.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.158+0000 7fbd953e0640 1 -- 172.21.15.45:0/1669503594 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 931243706 0 0) 0x7fbd900af1c0 con 0x7fbd9006bc90 2023-11-28T18:43:56.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.158+0000 7fbd953e0640 1 -- 172.21.15.45:0/1669503594 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd7c003530 con 0x7fbd9006bc90 2023-11-28T18:43:56.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.162+0000 7fbd963e2640 1 -- 172.21.15.45:0/1669503594 >> v1:172.21.15.190:6789/0 conn(0x7fbd900ced80 legacy=0x7fbd9006b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:56.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.162+0000 7fbd963e2640 1 -- 172.21.15.45:0/1669503594 >> v1:172.21.15.45:6789/0 conn(0x7fbd9006bc90 legacy=0x7fbd900b2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:56.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.162+0000 7fbd963e2640 1 -- 172.21.15.45:0/1669503594 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd900aeee0 con 0x7fbd900ce9a0 2023-11-28T18:43:56.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.162+0000 7fbd963e2640 1 --2- 172.21.15.45:0/1669503594 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd900ce9a0 0x7fbd900ae0a0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c0097c0 tx=0x7fbd8c01c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9112e7619be02709 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:56.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.162+0000 7fbd953e0640 1 -- 172.21.15.45:0/1669503594 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd8c0ab600 con 0x7fbd900ce9a0 2023-11-28T18:43:56.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.162+0000 7fbd953e0640 1 -- 172.21.15.45:0/1669503594 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd8c0a7050 con 0x7fbd900ce9a0 2023-11-28T18:43:56.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.162+0000 7fbd953e0640 1 -- 172.21.15.45:0/1669503594 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd8c0ab980 con 0x7fbd900ce9a0 2023-11-28T18:43:56.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.162+0000 7fbd98646640 1 -- 172.21.15.45:0/1669503594 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd900ce9a0 msgr2=0x7fbd900ae0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:56.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.162+0000 7fbd98646640 1 --2- 172.21.15.45:0/1669503594 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd900ce9a0 0x7fbd900ae0a0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c0097c0 tx=0x7fbd8c01c330 comp rx=0 tx=0).stop 2023-11-28T18:43:56.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.162+0000 7fbd98646640 1 -- 172.21.15.45:0/1669503594 shutdown_connections 2023-11-28T18:43:56.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.162+0000 7fbd98646640 1 --2- 172.21.15.45:0/1669503594 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd900ce9a0 0x7fbd900ae0a0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:56.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.162+0000 7fbd98646640 1 -- 172.21.15.45:0/1669503594 >> 172.21.15.45:0/1669503594 conn(0x7fbd900b1b70 msgr2=0x7fbd90070cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:43:56.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.162+0000 7fbd98646640 1 -- 172.21.15.45:0/1669503594 shutdown_connections 2023-11-28T18:43:56.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.162+0000 7fbd98646640 1 -- 172.21.15.45:0/1669503594 wait complete. 2023-11-28T18:43:56.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.166+0000 7fbd98646640 1 Processor -- start 2023-11-28T18:43:56.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.166+0000 7fbd98646640 1 -- start start 2023-11-28T18:43:56.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.166+0000 7fbd98646640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd9006bc90 0x7fbd90139d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:56.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.166+0000 7fbd98646640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbd900ce9a0 0x7fbd901570d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:56.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.166+0000 7fbd98646640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbd900ced80 0x7fbd9015fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:56.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.166+0000 7fbd98646640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd901517d0 con 0x7fbd9006bc90 2023-11-28T18:43:56.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.166+0000 7fbd98646640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd90151ab0 con 0x7fbd900ce9a0 2023-11-28T18:43:56.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.166+0000 7fbd98646640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd90151d90 con 0x7fbd900ced80 2023-11-28T18:43:56.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.166+0000 7fbd963e2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd9006bc90 0x7fbd90139d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:56.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.166+0000 7fbd963e2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd9006bc90 0x7fbd90139d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45966/0 (socket says 172.21.15.45:45966) 2023-11-28T18:43:56.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.166+0000 7fbd963e2640 1 -- 172.21.15.45:0/1585868145 learned_addr learned my addr 172.21.15.45:0/1585868145 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:43:56.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.166+0000 7fbd95be1640 1 --2- 172.21.15.45:0/1585868145 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbd900ce9a0 0x7fbd901570d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:56.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.166+0000 7fbd96be3640 1 --2- 172.21.15.45:0/1585868145 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbd900ced80 0x7fbd9015fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:56.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.166+0000 7fbd963e2640 1 -- 172.21.15.45:0/1585868145 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbd900ced80 msgr2=0x7fbd9015fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:56.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.166+0000 7fbd963e2640 1 --2- 172.21.15.45:0/1585868145 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbd900ced80 0x7fbd9015fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:56.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.166+0000 7fbd963e2640 1 -- 172.21.15.45:0/1585868145 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbd900ce9a0 msgr2=0x7fbd901570d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:56.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.166+0000 7fbd963e2640 1 --2- 172.21.15.45:0/1585868145 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbd900ce9a0 0x7fbd901570d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:56.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.166+0000 7fbd963e2640 1 -- 172.21.15.45:0/1585868145 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd8c009420 con 0x7fbd9006bc90 2023-11-28T18:43:56.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.166+0000 7fbd96be3640 1 --2- 172.21.15.45:0/1585868145 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbd900ced80 0x7fbd9015fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:43:56.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.166+0000 7fbd963e2640 1 --2- 172.21.15.45:0/1585868145 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd9006bc90 0x7fbd90139d40 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c0ae040 tx=0x7fbd8c01ab70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:56.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.166+0000 7fbd86ffd640 1 -- 172.21.15.45:0/1585868145 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd8c0b7450 con 0x7fbd9006bc90 2023-11-28T18:43:56.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.166+0000 7fbd86ffd640 1 -- 172.21.15.45:0/1585868145 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd8c0b75d0 con 0x7fbd9006bc90 2023-11-28T18:43:56.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.166+0000 7fbd86ffd640 1 -- 172.21.15.45:0/1585868145 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd8c0b7980 con 0x7fbd9006bc90 2023-11-28T18:43:56.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.166+0000 7fbd98646640 1 -- 172.21.15.45:0/1585868145 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd90152070 con 0x7fbd9006bc90 2023-11-28T18:43:56.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.166+0000 7fbd98646640 1 -- 172.21.15.45:0/1585868145 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd9013a280 con 0x7fbd9006bc90 2023-11-28T18:43:56.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.170+0000 7fbd98646640 1 -- 172.21.15.45:0/1585868145 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd90069410 con 0x7fbd9006bc90 2023-11-28T18:43:56.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.170+0000 7fbd86ffd640 1 -- 172.21.15.45:0/1585868145 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fbd8c0b7ae0 con 0x7fbd9006bc90 2023-11-28T18:43:56.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.170+0000 7fbd86ffd640 1 --2- 172.21.15.45:0/1585868145 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbd740668d0 0x7fbd74068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:56.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.170+0000 7fbd86ffd640 1 -- 172.21.15.45:0/1585868145 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fbd8c11e930 con 0x7fbd9006bc90 2023-11-28T18:43:56.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.170+0000 7fbd95be1640 1 --2- 172.21.15.45:0/1585868145 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbd740668d0 0x7fbd74068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:56.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.170+0000 7fbd95be1640 1 --2- 172.21.15.45:0/1585868145 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbd740668d0 0x7fbd74068d90 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fbd90147f40 tx=0x7fbd80009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:56.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.174+0000 7fbd86ffd640 1 -- 172.21.15.45:0/1585868145 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbd8c0ebd90 con 0x7fbd9006bc90 2023-11-28T18:43:56.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.334+0000 7fbd98646640 1 -- 172.21.15.45:0/1585868145 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbd90152520 con 0x7fbd9006bc90 2023-11-28T18:43:56.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.334+0000 7fbd86ffd640 1 -- 172.21.15.45:0/1585868145 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v56) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbd8c0b0020 con 0x7fbd9006bc90 2023-11-28T18:43:56.336 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-11-28T18:43:56.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.338+0000 7fbd98646640 1 -- 172.21.15.45:0/1585868145 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbd740668d0 msgr2=0x7fbd74068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:56.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.338+0000 7fbd98646640 1 --2- 172.21.15.45:0/1585868145 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbd740668d0 0x7fbd74068d90 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fbd90147f40 tx=0x7fbd80009040 comp rx=0 tx=0).stop 2023-11-28T18:43:56.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.338+0000 7fbd98646640 1 -- 172.21.15.45:0/1585868145 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd9006bc90 msgr2=0x7fbd90139d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:56.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.338+0000 7fbd98646640 1 --2- 172.21.15.45:0/1585868145 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd9006bc90 0x7fbd90139d40 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c0ae040 tx=0x7fbd8c01ab70 comp rx=0 tx=0).stop 2023-11-28T18:43:56.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.338+0000 7fbd98646640 1 -- 172.21.15.45:0/1585868145 shutdown_connections 2023-11-28T18:43:56.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.338+0000 7fbd98646640 1 --2- 172.21.15.45:0/1585868145 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbd740668d0 0x7fbd74068d90 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:56.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.338+0000 7fbd98646640 1 --2- 172.21.15.45:0/1585868145 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbd900ced80 0x7fbd9015fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:56.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.338+0000 7fbd98646640 1 --2- 172.21.15.45:0/1585868145 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbd900ce9a0 0x7fbd901570d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:56.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.338+0000 7fbd98646640 1 --2- 172.21.15.45:0/1585868145 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd9006bc90 0x7fbd90139d40 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:56.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.338+0000 7fbd98646640 1 -- 172.21.15.45:0/1585868145 >> 172.21.15.45:0/1585868145 conn(0x7fbd900b1b70 msgr2=0x7fbd900b2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:43:56.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.338+0000 7fbd98646640 1 -- 172.21.15.45:0/1585868145 shutdown_connections 2023-11-28T18:43:56.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.338+0000 7fbd98646640 1 -- 172.21.15.45:0/1585868145 wait complete. 2023-11-28T18:43:56.357 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-28T18:43:56.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.498+0000 7fa613fd1640 1 Processor -- start 2023-11-28T18:43:56.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.498+0000 7fa613fd1640 1 -- start start 2023-11-28T18:43:56.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.502+0000 7fa613fd1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa60c15e430 0x7fa60c0b2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:56.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.502+0000 7fa613fd1640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa60c0b30f0 0x7fa60c160f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:56.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.502+0000 7fa613fd1640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa60c146fe0 con 0x7fa60c146c00 2023-11-28T18:43:56.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.502+0000 7fa613fd1640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa60c0b3580 con 0x7fa60c0b30f0 2023-11-28T18:43:56.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.502+0000 7fa613fd1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa60c15e8b0 con 0x7fa60c15e430 2023-11-28T18:43:56.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.502+0000 7fa61256e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa60c0b30f0 0x7fa60c160f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:56.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.502+0000 7fa61256e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa60c0b30f0 0x7fa60c160f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45982/0 (socket says 172.21.15.45:45982) 2023-11-28T18:43:56.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.502+0000 7fa61256e640 1 -- 172.21.15.45:0/1764724382 learned_addr learned my addr 172.21.15.45:0/1764724382 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:43:56.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.502+0000 7fa61156c640 1 --2- 172.21.15.45:0/1764724382 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa60c15e430 0x7fa60c0b2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:56.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.502+0000 7fa61256e640 1 -- 172.21.15.45:0/1764724382 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa60c15e430 msgr2=0x7fa60c0b2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:43:56.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.502+0000 7fa61256e640 1 --2- 172.21.15.45:0/1764724382 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa60c15e430 0x7fa60c0b2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:56.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.502+0000 7fa61256e640 1 -- 172.21.15.45:0/1764724382 >> v1:172.21.15.190:6789/0 conn(0x7fa60c146c00 legacy=0x7fa60c06e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:56.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.502+0000 7fa61256e640 1 -- 172.21.15.45:0/1764724382 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa60c06f390 con 0x7fa60c0b30f0 2023-11-28T18:43:56.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.506+0000 7fa61256e640 1 --2- 172.21.15.45:0/1764724382 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa60c0b30f0 0x7fa60c160f10 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fa604009e50 tx=0x7fa60401c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c61f247034a93416 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:56.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.506+0000 7fa610d6b640 1 -- 172.21.15.45:0/1764724382 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6040a57c0 con 0x7fa60c0b30f0 2023-11-28T18:43:56.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.506+0000 7fa610d6b640 1 -- 172.21.15.45:0/1764724382 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6040a5920 con 0x7fa60c0b30f0 2023-11-28T18:43:56.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.506+0000 7fa610d6b640 1 -- 172.21.15.45:0/1764724382 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6040a5cb0 con 0x7fa60c0b30f0 2023-11-28T18:43:56.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.506+0000 7fa613fd1640 1 -- 172.21.15.45:0/1764724382 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa60c0b30f0 msgr2=0x7fa60c160f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:56.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.506+0000 7fa613fd1640 1 --2- 172.21.15.45:0/1764724382 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa60c0b30f0 0x7fa60c160f10 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fa604009e50 tx=0x7fa60401c9e0 comp rx=0 tx=0).stop 2023-11-28T18:43:56.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.506+0000 7fa613fd1640 1 -- 172.21.15.45:0/1764724382 shutdown_connections 2023-11-28T18:43:56.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.506+0000 7fa613fd1640 1 --2- 172.21.15.45:0/1764724382 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa60c0b30f0 0x7fa60c160f10 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:56.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.506+0000 7fa613fd1640 1 --2- 172.21.15.45:0/1764724382 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa60c15e430 0x7fa60c0b2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:56.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.506+0000 7fa613fd1640 1 -- 172.21.15.45:0/1764724382 >> 172.21.15.45:0/1764724382 conn(0x7fa60c06a570 msgr2=0x7fa60c06a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:43:56.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.506+0000 7fa613fd1640 1 -- 172.21.15.45:0/1764724382 shutdown_connections 2023-11-28T18:43:56.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.506+0000 7fa613fd1640 1 -- 172.21.15.45:0/1764724382 wait complete. 2023-11-28T18:43:56.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.506+0000 7fa613fd1640 1 Processor -- start 2023-11-28T18:43:56.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.506+0000 7fa613fd1640 1 -- start start 2023-11-28T18:43:56.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.510+0000 7fa613fd1640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa60c0b30f0 0x7fa60c0b40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:56.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.510+0000 7fa613fd1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa60c146c00 0x7fa60c13e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:56.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.510+0000 7fa613fd1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa60c15e430 0x7fa60c15bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:56.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.510+0000 7fa613fd1640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa60c15d6d0 con 0x7fa60c15e430 2023-11-28T18:43:56.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.510+0000 7fa613fd1640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa60c0b4620 con 0x7fa60c0b30f0 2023-11-28T18:43:56.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.510+0000 7fa613fd1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa60c0b1280 con 0x7fa60c146c00 2023-11-28T18:43:56.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.510+0000 7fa61256e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa60c15e430 0x7fa60c15bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:56.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.510+0000 7fa61256e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa60c15e430 0x7fa60c15bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45992/0 (socket says 172.21.15.45:45992) 2023-11-28T18:43:56.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.510+0000 7fa61256e640 1 -- 172.21.15.45:0/1434661638 learned_addr learned my addr 172.21.15.45:0/1434661638 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:43:56.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.510+0000 7fa611d6d640 1 --2- 172.21.15.45:0/1434661638 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa60c0b30f0 0x7fa60c0b40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:56.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.510+0000 7fa61156c640 1 --2- 172.21.15.45:0/1434661638 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa60c146c00 0x7fa60c13e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:56.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.510+0000 7fa61256e640 1 -- 172.21.15.45:0/1434661638 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa60c146c00 msgr2=0x7fa60c13e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:56.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.510+0000 7fa61256e640 1 --2- 172.21.15.45:0/1434661638 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa60c146c00 0x7fa60c13e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:56.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.510+0000 7fa61256e640 1 -- 172.21.15.45:0/1434661638 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa60c0b30f0 msgr2=0x7fa60c0b40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:56.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.510+0000 7fa61256e640 1 --2- 172.21.15.45:0/1434661638 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa60c0b30f0 0x7fa60c0b40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:56.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.510+0000 7fa61256e640 1 -- 172.21.15.45:0/1434661638 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa604009b30 con 0x7fa60c15e430 2023-11-28T18:43:56.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.510+0000 7fa61256e640 1 --2- 172.21.15.45:0/1434661638 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa60c15e430 0x7fa60c15bdc0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fa604009e50 tx=0x7fa604019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:56.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.510+0000 7fa6027fc640 1 -- 172.21.15.45:0/1434661638 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6040a57c0 con 0x7fa60c15e430 2023-11-28T18:43:56.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.510+0000 7fa6027fc640 1 -- 172.21.15.45:0/1434661638 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6040b8670 con 0x7fa60c15e430 2023-11-28T18:43:56.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.510+0000 7fa6027fc640 1 -- 172.21.15.45:0/1434661638 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6040b8a00 con 0x7fa60c15e430 2023-11-28T18:43:56.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.510+0000 7fa613fd1640 1 -- 172.21.15.45:0/1434661638 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa60c140b20 con 0x7fa60c15e430 2023-11-28T18:43:56.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.510+0000 7fa613fd1640 1 -- 172.21.15.45:0/1434661638 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa60c0b0f10 con 0x7fa60c15e430 2023-11-28T18:43:56.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.510+0000 7fa613fd1640 1 -- 172.21.15.45:0/1434661638 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa60c069480 con 0x7fa60c15e430 2023-11-28T18:43:56.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.510+0000 7fa6027fc640 1 -- 172.21.15.45:0/1434661638 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa6040b8b60 con 0x7fa60c15e430 2023-11-28T18:43:56.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.514+0000 7fa6027fc640 1 --2- 172.21.15.45:0/1434661638 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa5f0066900 0x7fa5f0068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:56.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.514+0000 7fa6027fc640 1 -- 172.21.15.45:0/1434661638 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa60411ef10 con 0x7fa60c15e430 2023-11-28T18:43:56.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.514+0000 7fa611d6d640 1 --2- 172.21.15.45:0/1434661638 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa5f0066900 0x7fa5f0068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:56.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.514+0000 7fa611d6d640 1 --2- 172.21.15.45:0/1434661638 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa5f0066900 0x7fa5f0068dc0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fa608001770 tx=0x7fa608009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:56.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.518+0000 7fa6027fc640 1 -- 172.21.15.45:0/1434661638 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa6040ec5d0 con 0x7fa60c15e430 2023-11-28T18:43:56.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.678+0000 7fa613fd1640 1 -- 172.21.15.45:0/1434661638 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa60c0b13c0 con 0x7fa60c15e430 2023-11-28T18:43:56.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.678+0000 7fa6027fc640 1 -- 172.21.15.45:0/1434661638 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v56) v1 ==== 84+0+65 (secure 0 0 0) 0x7fa6040efbf0 con 0x7fa60c15e430 2023-11-28T18:43:56.678 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:43:56.678 INFO:teuthology.orchestra.run.smithi045.stdout:[ 2023-11-28T18:43:56.678 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T18:43:56.679 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 1, 2023-11-28T18:43:56.679 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": ".mgr" 2023-11-28T18:43:56.679 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:43:56.679 INFO:teuthology.orchestra.run.smithi045.stdout:] 2023-11-28T18:43:56.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.678+0000 7fa613fd1640 1 -- 172.21.15.45:0/1434661638 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa5f0066900 msgr2=0x7fa5f0068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:56.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.678+0000 7fa613fd1640 1 --2- 172.21.15.45:0/1434661638 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa5f0066900 0x7fa5f0068dc0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fa608001770 tx=0x7fa608009040 comp rx=0 tx=0).stop 2023-11-28T18:43:56.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.678+0000 7fa613fd1640 1 -- 172.21.15.45:0/1434661638 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa60c15e430 msgr2=0x7fa60c15bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:56.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.678+0000 7fa613fd1640 1 --2- 172.21.15.45:0/1434661638 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa60c15e430 0x7fa60c15bdc0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fa604009e50 tx=0x7fa604019780 comp rx=0 tx=0).stop 2023-11-28T18:43:56.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.678+0000 7fa613fd1640 1 -- 172.21.15.45:0/1434661638 shutdown_connections 2023-11-28T18:43:56.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.678+0000 7fa613fd1640 1 --2- 172.21.15.45:0/1434661638 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa5f0066900 0x7fa5f0068dc0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:56.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.678+0000 7fa613fd1640 1 --2- 172.21.15.45:0/1434661638 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa60c15e430 0x7fa60c15bdc0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:56.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.678+0000 7fa613fd1640 1 --2- 172.21.15.45:0/1434661638 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa60c146c00 0x7fa60c13e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:56.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.678+0000 7fa613fd1640 1 --2- 172.21.15.45:0/1434661638 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa60c0b30f0 0x7fa60c0b40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:56.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.678+0000 7fa613fd1640 1 -- 172.21.15.45:0/1434661638 >> 172.21.15.45:0/1434661638 conn(0x7fa60c06a570 msgr2=0x7fa60c13f4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:43:56.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.678+0000 7fa613fd1640 1 -- 172.21.15.45:0/1434661638 shutdown_connections 2023-11-28T18:43:56.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.678+0000 7fa613fd1640 1 -- 172.21.15.45:0/1434661638 wait complete. 2023-11-28T18:43:56.700 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-28T18:43:56.700 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-28T18:43:56.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.846+0000 7f36354c9640 1 Processor -- start 2023-11-28T18:43:56.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.846+0000 7f36354c9640 1 -- start start 2023-11-28T18:43:56.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.846+0000 7f36354c9640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f363006d730 0x7f36300cdf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:56.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.846+0000 7f36354c9640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f363015b720 con 0x7f36300ccea0 2023-11-28T18:43:56.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.846+0000 7f36354c9640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36300cb590 con 0x7f36300ce4b0 2023-11-28T18:43:56.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.846+0000 7f36354c9640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36300ce930 con 0x7f363006d730 2023-11-28T18:43:56.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.846+0000 7f362effd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f36300ccea0 0x7f36300cd280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:60946/0 (socket says 172.21.15.45:60946) 2023-11-28T18:43:56.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.846+0000 7f362effd640 1 -- 172.21.15.45:0/251338597 learned_addr learned my addr 172.21.15.45:0/251338597 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:43:56.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.850+0000 7f3627fff640 1 --2- 172.21.15.45:0/251338597 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f363006d730 0x7f36300cdf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:56.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.850+0000 7f362e7fc640 1 -- 172.21.15.45:0/251338597 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2747337173 0 0) 0x7f363015b720 con 0x7f36300ccea0 2023-11-28T18:43:56.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.850+0000 7f362e7fc640 1 -- 172.21.15.45:0/251338597 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f361c003530 con 0x7f36300ccea0 2023-11-28T18:43:56.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.850+0000 7f362e7fc640 1 -- 172.21.15.45:0/251338597 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2789399583 0 0) 0x7f361c003530 con 0x7f36300ccea0 2023-11-28T18:43:56.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.850+0000 7f362e7fc640 1 -- 172.21.15.45:0/251338597 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f363006d730 msgr2=0x7f36300cdf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:43:56.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.850+0000 7f362e7fc640 1 --2- 172.21.15.45:0/251338597 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f363006d730 0x7f36300cdf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:56.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.850+0000 7f362e7fc640 1 -- 172.21.15.45:0/251338597 >> v1:172.21.15.190:6789/0 conn(0x7f36300ce4b0 legacy=0x7f3630164e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:56.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.850+0000 7f362e7fc640 1 -- 172.21.15.45:0/251338597 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36300cb870 con 0x7f36300ccea0 2023-11-28T18:43:56.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.850+0000 7f362e7fc640 1 -- 172.21.15.45:0/251338597 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4084481567 0 0) 0x7f3620001680 con 0x7f36300ccea0 2023-11-28T18:43:56.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.850+0000 7f362e7fc640 1 -- 172.21.15.45:0/251338597 >> v1:172.21.15.45:6789/0 conn(0x7f36300ccea0 legacy=0x7f36300cd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:56.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.850+0000 7f362e7fc640 1 --2- 172.21.15.45:0/251338597 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f361c0039b0 0x7f361c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:56.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.850+0000 7f362e7fc640 1 --2- 172.21.15.45:0/251338597 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f361c0047d0 0x7f361c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:56.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.850+0000 7f362e7fc640 1 --2- 172.21.15.45:0/251338597 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f361c005190 0x7f361c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:56.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.850+0000 7f362e7fc640 1 -- 172.21.15.45:0/251338597 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36300ce930 con 0x7f361c0039b0 2023-11-28T18:43:56.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.850+0000 7f362e7fc640 1 -- 172.21.15.45:0/251338597 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f361c00bf80 con 0x7f361c0047d0 2023-11-28T18:43:56.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.850+0000 7f362e7fc640 1 -- 172.21.15.45:0/251338597 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f361c00c110 con 0x7f361c005190 2023-11-28T18:43:56.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.850+0000 7f3627fff640 1 --2- 172.21.15.45:0/251338597 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f363006d730 0x7f36300cdf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:43:56.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.850+0000 7f362effd640 1 --2- 172.21.15.45:0/251338597 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f361c0039b0 0x7f361c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:56.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.850+0000 7f362f7fe640 1 --2- 172.21.15.45:0/251338597 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f361c005190 0x7f361c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:56.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.850+0000 7f3627fff640 1 --2- 172.21.15.45:0/251338597 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f361c0047d0 0x7f361c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:56.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.850+0000 7f362effd640 1 -- 172.21.15.45:0/251338597 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f361c005190 msgr2=0x7f361c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:43:56.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.850+0000 7f362effd640 1 --2- 172.21.15.45:0/251338597 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f361c005190 0x7f361c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:56.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.850+0000 7f362effd640 1 -- 172.21.15.45:0/251338597 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f361c0047d0 msgr2=0x7f361c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:43:56.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.850+0000 7f362effd640 1 --2- 172.21.15.45:0/251338597 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f361c0047d0 0x7f361c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:56.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.850+0000 7f362effd640 1 -- 172.21.15.45:0/251338597 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f361c003530 con 0x7f361c0039b0 2023-11-28T18:43:56.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.854+0000 7f362effd640 1 --2- 172.21.15.45:0/251338597 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f361c0039b0 0x7f361c003d90 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f362000c1c0 tx=0x7f362001cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea543449531c3a99 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:56.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.854+0000 7f362e7fc640 1 -- 172.21.15.45:0/251338597 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3620005ae0 con 0x7f361c0039b0 2023-11-28T18:43:56.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.854+0000 7f362e7fc640 1 -- 172.21.15.45:0/251338597 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3620005c40 con 0x7f361c0039b0 2023-11-28T18:43:56.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.854+0000 7f362e7fc640 1 -- 172.21.15.45:0/251338597 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3620007070 con 0x7f361c0039b0 2023-11-28T18:43:56.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.854+0000 7f36354c9640 1 -- 172.21.15.45:0/251338597 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f361c0039b0 msgr2=0x7f361c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:56.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.854+0000 7f36354c9640 1 --2- 172.21.15.45:0/251338597 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f361c0039b0 0x7f361c003d90 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f362000c1c0 tx=0x7f362001cbd0 comp rx=0 tx=0).stop 2023-11-28T18:43:56.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.854+0000 7f362f7fe640 1 -- 172.21.15.45:0/251338597 reap_dead start 2023-11-28T18:43:56.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.854+0000 7f36354c9640 1 -- 172.21.15.45:0/251338597 shutdown_connections 2023-11-28T18:43:56.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.854+0000 7f36354c9640 1 -- 172.21.15.45:0/251338597 >> 172.21.15.45:0/251338597 conn(0x7f36300b0c90 msgr2=0x7f36300b10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:43:56.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.854+0000 7f36354c9640 1 -- 172.21.15.45:0/251338597 shutdown_connections 2023-11-28T18:43:56.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.854+0000 7f36354c9640 1 -- 172.21.15.45:0/251338597 wait complete. 2023-11-28T18:43:56.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.854+0000 7f36354c9640 1 Processor -- start 2023-11-28T18:43:56.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.854+0000 7f36354c9640 1 -- start start 2023-11-28T18:43:56.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.854+0000 7f36354c9640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f361c0039b0 0x7f3630159450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:56.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.854+0000 7f36354c9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3630165b20 0x7f36300b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:56.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.854+0000 7f36354c9640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36300acfc0 0x7f36300b39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:56.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.858+0000 7f36354c9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3630159990 con 0x7f3630165b20 2023-11-28T18:43:56.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.858+0000 7f36354c9640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3630153430 con 0x7f36300acfc0 2023-11-28T18:43:56.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.858+0000 7f36354c9640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36301f9550 con 0x7f361c0039b0 2023-11-28T18:43:56.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.858+0000 7f3627fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3630165b20 0x7f36300b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:56.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.858+0000 7f3627fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3630165b20 0x7f36300b34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46004/0 (socket says 172.21.15.45:46004) 2023-11-28T18:43:56.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.858+0000 7f3627fff640 1 -- 172.21.15.45:0/2169343731 learned_addr learned my addr 172.21.15.45:0/2169343731 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:43:56.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.858+0000 7f362f7fe640 1 --2- 172.21.15.45:0/2169343731 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36300acfc0 0x7f36300b39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:56.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.858+0000 7f362effd640 1 --2- 172.21.15.45:0/2169343731 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f361c0039b0 0x7f3630159450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:56.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.858+0000 7f3627fff640 1 -- 172.21.15.45:0/2169343731 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f361c0039b0 msgr2=0x7f3630159450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:56.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.858+0000 7f3627fff640 1 --2- 172.21.15.45:0/2169343731 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f361c0039b0 0x7f3630159450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:56.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.858+0000 7f3627fff640 1 -- 172.21.15.45:0/2169343731 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36300acfc0 msgr2=0x7f36300b39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:56.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.858+0000 7f3627fff640 1 --2- 172.21.15.45:0/2169343731 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36300acfc0 0x7f36300b39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:56.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.858+0000 7f3627fff640 1 -- 172.21.15.45:0/2169343731 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36301f84b0 con 0x7f3630165b20 2023-11-28T18:43:56.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.858+0000 7f362f7fe640 1 --2- 172.21.15.45:0/2169343731 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36300acfc0 0x7f36300b39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:43:56.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.858+0000 7f3627fff640 1 --2- 172.21.15.45:0/2169343731 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3630165b20 0x7f36300b34b0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f3618011830 tx=0x7f3618011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:56.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.858+0000 7f36277fe640 1 -- 172.21.15.45:0/2169343731 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f361800f9c0 con 0x7f3630165b20 2023-11-28T18:43:56.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.858+0000 7f36277fe640 1 -- 172.21.15.45:0/2169343731 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f361800fb20 con 0x7f3630165b20 2023-11-28T18:43:56.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.858+0000 7f36354c9640 1 -- 172.21.15.45:0/2169343731 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36301f8790 con 0x7f3630165b20 2023-11-28T18:43:56.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.858+0000 7f36277fe640 1 -- 172.21.15.45:0/2169343731 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f361800fe90 con 0x7f3630165b20 2023-11-28T18:43:56.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.858+0000 7f36354c9640 1 -- 172.21.15.45:0/2169343731 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36301f8d50 con 0x7f3630165b20 2023-11-28T18:43:56.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.858+0000 7f36354c9640 1 -- 172.21.15.45:0/2169343731 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f363004e890 con 0x7f3630165b20 2023-11-28T18:43:56.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.858+0000 7f36277fe640 1 -- 172.21.15.45:0/2169343731 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f3618015460 con 0x7f3630165b20 2023-11-28T18:43:56.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.862+0000 7f36277fe640 1 --2- 172.21.15.45:0/2169343731 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f3610066900 0x7f3610068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:56.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.862+0000 7f36277fe640 1 -- 172.21.15.45:0/2169343731 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3618084980 con 0x7f3630165b20 2023-11-28T18:43:56.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.862+0000 7f362effd640 1 --2- 172.21.15.45:0/2169343731 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f3610066900 0x7f3610068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:56.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.862+0000 7f362effd640 1 --2- 172.21.15.45:0/2169343731 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f3610066900 0x7f3610068dc0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f36200ab000 tx=0x7f36200a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:56.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:56.866+0000 7f36277fe640 1 -- 172.21.15.45:0/2169343731 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3618051fb0 con 0x7f3630165b20 2023-11-28T18:43:57.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:57.022+0000 7f36354c9640 1 -- 172.21.15.45:0/2169343731 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f3630069410 con 0x7f3630165b20 2023-11-28T18:43:57.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:57.242+0000 7f36277fe640 1 -- 172.21.15.45:0/2169343731 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v57) v1 ==== 138+0+0 (secure 0 0 0) 0x7f36180555d0 con 0x7f3630165b20 2023-11-28T18:43:57.244 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' created 2023-11-28T18:43:57.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:57.246+0000 7f36354c9640 1 -- 172.21.15.45:0/2169343731 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f3610066900 msgr2=0x7f3610068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:57.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:57.246+0000 7f36354c9640 1 --2- 172.21.15.45:0/2169343731 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f3610066900 0x7f3610068dc0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f36200ab000 tx=0x7f36200a7070 comp rx=0 tx=0).stop 2023-11-28T18:43:57.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:57.246+0000 7f36354c9640 1 -- 172.21.15.45:0/2169343731 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3630165b20 msgr2=0x7f36300b34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:57.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:57.246+0000 7f36354c9640 1 --2- 172.21.15.45:0/2169343731 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3630165b20 0x7f36300b34b0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f3618011830 tx=0x7f3618011cf0 comp rx=0 tx=0).stop 2023-11-28T18:43:57.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:57.246+0000 7f36354c9640 1 -- 172.21.15.45:0/2169343731 shutdown_connections 2023-11-28T18:43:57.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:57.246+0000 7f36354c9640 1 --2- 172.21.15.45:0/2169343731 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f3610066900 0x7f3610068dc0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:57.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:57.246+0000 7f36354c9640 1 --2- 172.21.15.45:0/2169343731 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36300acfc0 0x7f36300b39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:57.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:57.246+0000 7f36354c9640 1 --2- 172.21.15.45:0/2169343731 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3630165b20 0x7f36300b34b0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:57.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:57.246+0000 7f36354c9640 1 --2- 172.21.15.45:0/2169343731 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f361c0039b0 0x7f3630159450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:57.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:57.246+0000 7f36354c9640 1 -- 172.21.15.45:0/2169343731 >> 172.21.15.45:0/2169343731 conn(0x7f36300b0c90 msgr2=0x7f36300cd280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:43:57.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:57.246+0000 7f36354c9640 1 -- 172.21.15.45:0/2169343731 shutdown_connections 2023-11-28T18:43:57.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:57.246+0000 7f36354c9640 1 -- 172.21.15.45:0/2169343731 wait complete. 2023-11-28T18:43:57.271 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-28T18:43:57.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:57.422+0000 7ff873172640 1 Processor -- start 2023-11-28T18:43:57.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:57.422+0000 7ff873172640 1 -- start start 2023-11-28T18:43:57.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:57.422+0000 7ff873172640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff86c143d50 0x7ff86c15f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:57.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:57.422+0000 7ff873172640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff86c144730 con 0x7ff86c0704c0 2023-11-28T18:43:57.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:57.422+0000 7ff873172640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff86c070950 con 0x7ff86c0b4310 2023-11-28T18:43:57.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:57.422+0000 7ff873172640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff86c0715d0 con 0x7ff86c143d50 2023-11-28T18:43:57.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:57.422+0000 7ff870f0e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff86c143d50 0x7ff86c15f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:57.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:57.422+0000 7ff870f0e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff86c143d50 0x7ff86c15f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46014/0 (socket says 172.21.15.45:46014) 2023-11-28T18:43:57.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:57.422+0000 7ff86bfff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff86c0704c0 0x7ff86c15b620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:60950/0 (socket says 172.21.15.45:60950) 2023-11-28T18:43:57.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:57.422+0000 7ff870f0e640 1 -- 172.21.15.45:0/892468945 learned_addr learned my addr 172.21.15.45:0/892468945 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:43:57.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:57.422+0000 7ff870f0e640 1 -- 172.21.15.45:0/892468945 >> v1:172.21.15.190:6789/0 conn(0x7ff86c0b4310 legacy=0x7ff86c0719f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:43:57.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:57.422+0000 7ff870f0e640 1 -- 172.21.15.45:0/892468945 >> v1:172.21.15.45:6789/0 conn(0x7ff86c0704c0 legacy=0x7ff86c15b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:57.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:57.422+0000 7ff870f0e640 1 -- 172.21.15.45:0/892468945 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff86c070c30 con 0x7ff86c143d50 2023-11-28T18:43:57.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:57.426+0000 7ff870f0e640 1 --2- 172.21.15.45:0/892468945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff86c143d50 0x7ff86c15f640 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7ff860009870 tx=0x7ff86001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e684e0c6217209d3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:57.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:57.426+0000 7ff86b7fe640 1 -- 172.21.15.45:0/892468945 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8600ad660 con 0x7ff86c143d50 2023-11-28T18:43:57.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:57.426+0000 7ff86b7fe640 1 -- 172.21.15.45:0/892468945 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8600ad7c0 con 0x7ff86c143d50 2023-11-28T18:43:57.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:57.426+0000 7ff86b7fe640 1 -- 172.21.15.45:0/892468945 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8600adb50 con 0x7ff86c143d50 2023-11-28T18:43:57.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:57.426+0000 7ff873172640 1 -- 172.21.15.45:0/892468945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff86c143d50 msgr2=0x7ff86c15f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:57.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:57.426+0000 7ff873172640 1 --2- 172.21.15.45:0/892468945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff86c143d50 0x7ff86c15f640 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7ff860009870 tx=0x7ff86001c470 comp rx=0 tx=0).stop 2023-11-28T18:43:57.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:57.426+0000 7ff873172640 1 -- 172.21.15.45:0/892468945 shutdown_connections 2023-11-28T18:43:57.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:57.426+0000 7ff873172640 1 --2- 172.21.15.45:0/892468945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff86c143d50 0x7ff86c15f640 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:57.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:57.426+0000 7ff873172640 1 -- 172.21.15.45:0/892468945 >> 172.21.15.45:0/892468945 conn(0x7ff86c0b0d00 msgr2=0x7ff86c0b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:43:57.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:57.426+0000 7ff873172640 1 -- 172.21.15.45:0/892468945 shutdown_connections 2023-11-28T18:43:57.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:57.426+0000 7ff873172640 1 -- 172.21.15.45:0/892468945 wait complete. 2023-11-28T18:43:57.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:57.430+0000 7ff873172640 1 Processor -- start 2023-11-28T18:43:57.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:57.430+0000 7ff873172640 1 -- start start 2023-11-28T18:43:57.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:57.430+0000 7ff873172640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff86c0b4310 0x7ff86c1662d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:57.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:57.430+0000 7ff873172640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff86c143d50 0x7ff86c159ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:57.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:57.430+0000 7ff873172640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff86c15a380 0x7ff86c13f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:57.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:57.430+0000 7ff873172640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff86c166810 con 0x7ff86c0b4310 2023-11-28T18:43:57.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:57.430+0000 7ff873172640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff86c15ac20 con 0x7ff86c143d50 2023-11-28T18:43:57.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:57.430+0000 7ff873172640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff86c13e1b0 con 0x7ff86c15a380 2023-11-28T18:43:57.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:57.430+0000 7ff870f0e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff86c0b4310 0x7ff86c1662d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:57.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:57.430+0000 7ff870f0e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff86c0b4310 0x7ff86c1662d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46028/0 (socket says 172.21.15.45:46028) 2023-11-28T18:43:57.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:57.430+0000 7ff870f0e640 1 -- 172.21.15.45:0/2485308334 learned_addr learned my addr 172.21.15.45:0/2485308334 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:43:57.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:57.430+0000 7ff870f0e640 1 -- 172.21.15.45:0/2485308334 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff86c15a380 msgr2=0x7ff86c13f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:57.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:57.430+0000 7ff870f0e640 1 --2- 172.21.15.45:0/2485308334 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff86c15a380 0x7ff86c13f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:57.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:57.430+0000 7ff870f0e640 1 -- 172.21.15.45:0/2485308334 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff86c143d50 msgr2=0x7ff86c159ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:57.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:57.430+0000 7ff870f0e640 1 --2- 172.21.15.45:0/2485308334 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff86c143d50 0x7ff86c159ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:57.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:57.430+0000 7ff870f0e640 1 -- 172.21.15.45:0/2485308334 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8600094d0 con 0x7ff86c0b4310 2023-11-28T18:43:57.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:57.430+0000 7ff870f0e640 1 --2- 172.21.15.45:0/2485308334 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff86c0b4310 0x7ff86c1662d0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7ff8600b0040 tx=0x7ff86001acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:57.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:57.430+0000 7ff8697fa640 1 -- 172.21.15.45:0/2485308334 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8600b8830 con 0x7ff86c0b4310 2023-11-28T18:43:57.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:57.430+0000 7ff8697fa640 1 -- 172.21.15.45:0/2485308334 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8600b89d0 con 0x7ff86c0b4310 2023-11-28T18:43:57.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:57.430+0000 7ff8697fa640 1 -- 172.21.15.45:0/2485308334 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8600b8d80 con 0x7ff86c0b4310 2023-11-28T18:43:57.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:57.430+0000 7ff873172640 1 -- 172.21.15.45:0/2485308334 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff86c13e490 con 0x7ff86c0b4310 2023-11-28T18:43:57.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:57.430+0000 7ff873172640 1 -- 172.21.15.45:0/2485308334 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff86c13ea50 con 0x7ff86c0b4310 2023-11-28T18:43:57.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:57.434+0000 7ff873172640 1 -- 172.21.15.45:0/2485308334 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff86c069480 con 0x7ff86c0b4310 2023-11-28T18:43:57.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:57.434+0000 7ff8697fa640 1 -- 172.21.15.45:0/2485308334 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ff8600b4040 con 0x7ff86c0b4310 2023-11-28T18:43:57.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:57.434+0000 7ff8697fa640 1 --2- 172.21.15.45:0/2485308334 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff8500668d0 0x7ff850068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:57.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:57.434+0000 7ff8697fa640 1 -- 172.21.15.45:0/2485308334 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5227+0+0 (secure 0 0 0) 0x7ff86011ec40 con 0x7ff86c0b4310 2023-11-28T18:43:57.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:57.434+0000 7ff86bfff640 1 --2- 172.21.15.45:0/2485308334 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff8500668d0 0x7ff850068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:57.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:57.434+0000 7ff86bfff640 1 --2- 172.21.15.45:0/2485308334 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff8500668d0 0x7ff850068d90 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7ff86c164900 tx=0x7ff8580079d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:57.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:57.438+0000 7ff8697fa640 1 -- 172.21.15.45:0/2485308334 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff8600ebfc0 con 0x7ff86c0b4310 2023-11-28T18:43:57.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:57.598+0000 7ff873172640 1 -- 172.21.15.45:0/2485308334 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ff86c0b19d0 con 0x7ff86c0b4310 2023-11-28T18:43:58.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:58.250+0000 7ff8697fa640 1 -- 172.21.15.45:0/2485308334 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v58) v1 ==== 170+0+0 (secure 0 0 0) 0x7ff8600ef5e0 con 0x7ff86c0b4310 2023-11-28T18:43:58.252 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' created 2023-11-28T18:43:58.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:58.254+0000 7ff873172640 1 -- 172.21.15.45:0/2485308334 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff8500668d0 msgr2=0x7ff850068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:58.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:58.254+0000 7ff873172640 1 --2- 172.21.15.45:0/2485308334 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff8500668d0 0x7ff850068d90 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7ff86c164900 tx=0x7ff8580079d0 comp rx=0 tx=0).stop 2023-11-28T18:43:58.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:58.254+0000 7ff873172640 1 -- 172.21.15.45:0/2485308334 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff86c0b4310 msgr2=0x7ff86c1662d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:58.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:58.254+0000 7ff873172640 1 --2- 172.21.15.45:0/2485308334 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff86c0b4310 0x7ff86c1662d0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7ff8600b0040 tx=0x7ff86001acb0 comp rx=0 tx=0).stop 2023-11-28T18:43:58.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:58.254+0000 7ff873172640 1 -- 172.21.15.45:0/2485308334 shutdown_connections 2023-11-28T18:43:58.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:58.254+0000 7ff873172640 1 --2- 172.21.15.45:0/2485308334 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ff8500668d0 0x7ff850068d90 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:58.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:58.254+0000 7ff873172640 1 --2- 172.21.15.45:0/2485308334 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff86c15a380 0x7ff86c13f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:58.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:58.254+0000 7ff873172640 1 --2- 172.21.15.45:0/2485308334 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff86c143d50 0x7ff86c159ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:58.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:58.254+0000 7ff873172640 1 --2- 172.21.15.45:0/2485308334 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff86c0b4310 0x7ff86c1662d0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:58.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:58.254+0000 7ff873172640 1 -- 172.21.15.45:0/2485308334 >> 172.21.15.45:0/2485308334 conn(0x7ff86c0b0d00 msgr2=0x7ff86c0cc380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:43:58.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:58.254+0000 7ff873172640 1 -- 172.21.15.45:0/2485308334 shutdown_connections 2023-11-28T18:43:58.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:58.254+0000 7ff873172640 1 -- 172.21.15.45:0/2485308334 wait complete. 2023-11-28T18:43:58.294 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-28T18:43:58.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:58.442+0000 7f3a78c9c640 1 Processor -- start 2023-11-28T18:43:58.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:58.442+0000 7f3a78c9c640 1 -- start start 2023-11-28T18:43:58.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:58.442+0000 7f3a78c9c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3a74158ce0 0x7f3a7415eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:58.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:58.442+0000 7f3a78c9c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3a740cba50 0x7f3a7415be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:58.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:58.442+0000 7f3a78c9c640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a7415b6b0 con 0x7f3a740b4310 2023-11-28T18:43:58.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:58.442+0000 7f3a78c9c640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a7415f450 con 0x7f3a740cba50 2023-11-28T18:43:58.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:58.442+0000 7f3a78c9c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a7415f730 con 0x7f3a74158ce0 2023-11-28T18:43:58.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:58.442+0000 7f3a6bfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3a740cba50 0x7f3a7415be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:58.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:58.442+0000 7f3a6bfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3a740cba50 0x7f3a7415be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56156/0 (socket says 172.21.15.45:56156) 2023-11-28T18:43:58.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:58.442+0000 7f3a6bfff640 1 -- 172.21.15.45:0/30675138 learned_addr learned my addr 172.21.15.45:0/30675138 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:43:58.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:58.446+0000 7f3a7259c640 1 --2- 172.21.15.45:0/30675138 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3a74158ce0 0x7f3a7415eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:58.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:58.446+0000 7f3a6bfff640 1 -- 172.21.15.45:0/30675138 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3a74158ce0 msgr2=0x7f3a7415eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:43:58.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:58.446+0000 7f3a6bfff640 1 --2- 172.21.15.45:0/30675138 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3a74158ce0 0x7f3a7415eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:58.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:58.446+0000 7f3a6bfff640 1 -- 172.21.15.45:0/30675138 >> v1:172.21.15.190:6789/0 conn(0x7f3a740b4310 legacy=0x7f3a74070430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:43:58.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:58.446+0000 7f3a6bfff640 1 -- 172.21.15.45:0/30675138 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a7415b920 con 0x7f3a740cba50 2023-11-28T18:43:58.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:58.446+0000 7f3a6bfff640 1 --2- 172.21.15.45:0/30675138 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a740cba50 0x7f3a7415be40 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c009870 tx=0x7f3a5c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44ea466f4dc4765f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:58.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:58.446+0000 7f3a71d9b640 1 -- 172.21.15.45:0/30675138 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c0aa640 con 0x7f3a740cba50 2023-11-28T18:43:58.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:58.446+0000 7f3a71d9b640 1 -- 172.21.15.45:0/30675138 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a5c0aa7a0 con 0x7f3a740cba50 2023-11-28T18:43:58.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:58.446+0000 7f3a71d9b640 1 -- 172.21.15.45:0/30675138 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c0aab30 con 0x7f3a740cba50 2023-11-28T18:43:58.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:58.450+0000 7f3a78c9c640 1 -- 172.21.15.45:0/30675138 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a740cba50 msgr2=0x7f3a7415be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:58.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:58.450+0000 7f3a78c9c640 1 --2- 172.21.15.45:0/30675138 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a740cba50 0x7f3a7415be40 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c009870 tx=0x7f3a5c01c500 comp rx=0 tx=0).stop 2023-11-28T18:43:58.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:58.450+0000 7f3a78c9c640 1 -- 172.21.15.45:0/30675138 shutdown_connections 2023-11-28T18:43:58.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:58.450+0000 7f3a78c9c640 1 --2- 172.21.15.45:0/30675138 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a740cba50 0x7f3a7415be40 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:58.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:58.450+0000 7f3a78c9c640 1 --2- 172.21.15.45:0/30675138 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3a74158ce0 0x7f3a7415eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:58.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:58.450+0000 7f3a78c9c640 1 -- 172.21.15.45:0/30675138 >> 172.21.15.45:0/30675138 conn(0x7f3a740b0d00 msgr2=0x7f3a740b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:43:58.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:58.450+0000 7f3a78c9c640 1 -- 172.21.15.45:0/30675138 shutdown_connections 2023-11-28T18:43:58.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:58.450+0000 7f3a78c9c640 1 -- 172.21.15.45:0/30675138 wait complete. 2023-11-28T18:43:58.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:58.450+0000 7f3a78c9c640 1 Processor -- start 2023-11-28T18:43:58.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:58.450+0000 7f3a78c9c640 1 -- start start 2023-11-28T18:43:58.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:58.450+0000 7f3a78c9c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3a740b4310 0x7f3a7414fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:58.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:58.450+0000 7f3a78c9c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3a740cba50 0x7f3a741578a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:58.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:58.450+0000 7f3a78c9c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a74158ce0 0x7f3a74157de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:58.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:58.450+0000 7f3a78c9c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a7415d8b0 con 0x7f3a74158ce0 2023-11-28T18:43:58.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:58.450+0000 7f3a78c9c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a7415dac0 con 0x7f3a740b4310 2023-11-28T18:43:58.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:58.450+0000 7f3a78c9c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a7415dda0 con 0x7f3a740cba50 2023-11-28T18:43:58.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:58.450+0000 7f3a72d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a74158ce0 0x7f3a74157de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:58.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:58.450+0000 7f3a72d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a74158ce0 0x7f3a74157de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56172/0 (socket says 172.21.15.45:56172) 2023-11-28T18:43:58.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:58.450+0000 7f3a72d9d640 1 -- 172.21.15.45:0/3718194440 learned_addr learned my addr 172.21.15.45:0/3718194440 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:43:58.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:58.450+0000 7f3a6bfff640 1 --2- 172.21.15.45:0/3718194440 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3a740cba50 0x7f3a741578a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:58.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:58.450+0000 7f3a7259c640 1 --2- 172.21.15.45:0/3718194440 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3a740b4310 0x7f3a7414fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:58.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:58.450+0000 7f3a72d9d640 1 -- 172.21.15.45:0/3718194440 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3a740cba50 msgr2=0x7f3a741578a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:58.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:58.450+0000 7f3a72d9d640 1 --2- 172.21.15.45:0/3718194440 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3a740cba50 0x7f3a741578a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:58.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:58.450+0000 7f3a72d9d640 1 -- 172.21.15.45:0/3718194440 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3a740b4310 msgr2=0x7f3a7414fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:58.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:58.450+0000 7f3a72d9d640 1 --2- 172.21.15.45:0/3718194440 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3a740b4310 0x7f3a7414fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:58.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:58.450+0000 7f3a72d9d640 1 -- 172.21.15.45:0/3718194440 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a5c0094d0 con 0x7f3a74158ce0 2023-11-28T18:43:58.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:58.450+0000 7f3a72d9d640 1 --2- 172.21.15.45:0/3718194440 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a74158ce0 0x7f3a74157de0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c00c780 tx=0x7f3a6c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:58.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:58.454+0000 7f3a6affd640 1 -- 172.21.15.45:0/3718194440 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a6c004b70 con 0x7f3a74158ce0 2023-11-28T18:43:58.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:58.454+0000 7f3a6affd640 1 -- 172.21.15.45:0/3718194440 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a6c00ce90 con 0x7f3a74158ce0 2023-11-28T18:43:58.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:58.454+0000 7f3a6affd640 1 -- 172.21.15.45:0/3718194440 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a6c00a850 con 0x7f3a74158ce0 2023-11-28T18:43:58.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:58.454+0000 7f3a78c9c640 1 -- 172.21.15.45:0/3718194440 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a7415e080 con 0x7f3a74158ce0 2023-11-28T18:43:58.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:58.454+0000 7f3a78c9c640 1 -- 172.21.15.45:0/3718194440 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a74158320 con 0x7f3a74158ce0 2023-11-28T18:43:58.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:58.454+0000 7f3a78c9c640 1 -- 172.21.15.45:0/3718194440 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a74069410 con 0x7f3a74158ce0 2023-11-28T18:43:58.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:58.454+0000 7f3a6affd640 1 -- 172.21.15.45:0/3718194440 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f3a6c00a9b0 con 0x7f3a74158ce0 2023-11-28T18:43:58.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:58.454+0000 7f3a6affd640 1 --2- 172.21.15.45:0/3718194440 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f3a540668d0 0x7f3a54068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:58.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:58.454+0000 7f3a6affd640 1 -- 172.21.15.45:0/3718194440 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f3a6c0844c0 con 0x7f3a74158ce0 2023-11-28T18:43:58.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:58.458+0000 7f3a7259c640 1 --2- 172.21.15.45:0/3718194440 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f3a540668d0 0x7f3a54068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:58.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:58.458+0000 7f3a7259c640 1 --2- 172.21.15.45:0/3718194440 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f3a540668d0 0x7f3a54068d90 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f3a640079c0 tx=0x7f3a64008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:58.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:58.462+0000 7f3a6affd640 1 -- 172.21.15.45:0/3718194440 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3a6c051770 con 0x7f3a74158ce0 2023-11-28T18:43:58.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:58.650+0000 7f3a78c9c640 1 -- 172.21.15.45:0/3718194440 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f3a7415e530 con 0x7f3a74158ce0 2023-11-28T18:43:59.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.254+0000 7f3a6affd640 1 -- 172.21.15.45:0/3718194440 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v44) v1 ==== 172+0+0 (secure 0 0 0) 0x7f3a6c054d90 con 0x7f3a74158ce0 2023-11-28T18:43:59.255 INFO:teuthology.orchestra.run.smithi045.stderr:new fs with metadata pool 8 and data pool 9 2023-11-28T18:43:59.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.258+0000 7f3a78c9c640 1 -- 172.21.15.45:0/3718194440 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f3a540668d0 msgr2=0x7f3a54068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:59.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.258+0000 7f3a78c9c640 1 --2- 172.21.15.45:0/3718194440 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f3a540668d0 0x7f3a54068d90 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f3a640079c0 tx=0x7f3a64008040 comp rx=0 tx=0).stop 2023-11-28T18:43:59.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.258+0000 7f3a78c9c640 1 -- 172.21.15.45:0/3718194440 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a74158ce0 msgr2=0x7f3a74157de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:59.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.258+0000 7f3a78c9c640 1 --2- 172.21.15.45:0/3718194440 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a74158ce0 0x7f3a74157de0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c00c780 tx=0x7f3a6c00cc40 comp rx=0 tx=0).stop 2023-11-28T18:43:59.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.258+0000 7f3a78c9c640 1 -- 172.21.15.45:0/3718194440 shutdown_connections 2023-11-28T18:43:59.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.258+0000 7f3a78c9c640 1 --2- 172.21.15.45:0/3718194440 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f3a540668d0 0x7f3a54068d90 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:59.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.258+0000 7f3a78c9c640 1 --2- 172.21.15.45:0/3718194440 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a74158ce0 0x7f3a74157de0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:59.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.258+0000 7f3a78c9c640 1 --2- 172.21.15.45:0/3718194440 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3a740cba50 0x7f3a741578a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:59.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.258+0000 7f3a78c9c640 1 --2- 172.21.15.45:0/3718194440 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3a740b4310 0x7f3a7414fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:59.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.258+0000 7f3a78c9c640 1 -- 172.21.15.45:0/3718194440 >> 172.21.15.45:0/3718194440 conn(0x7f3a740b0d00 msgr2=0x7f3a74070fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:43:59.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.258+0000 7f3a78c9c640 1 -- 172.21.15.45:0/3718194440 shutdown_connections 2023-11-28T18:43:59.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.258+0000 7f3a78c9c640 1 -- 172.21.15.45:0/3718194440 wait complete. 2023-11-28T18:43:59.307 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T18:43:59.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.450+0000 7f4b216bb640 1 Processor -- start 2023-11-28T18:43:59.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.450+0000 7f4b216bb640 1 -- start start 2023-11-28T18:43:59.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.454+0000 7f4b216bb640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f4b1c15bcd0 0x7f4b1c06c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:59.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.454+0000 7f4b216bb640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b1c146000 con 0x7f4b1c1459a0 2023-11-28T18:43:59.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.454+0000 7f4b216bb640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b1c1462e0 con 0x7f4b1c15c0b0 2023-11-28T18:43:59.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.454+0000 7f4b216bb640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b1c1465c0 con 0x7f4b1c15bcd0 2023-11-28T18:43:59.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.454+0000 7f4b1b7fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f4b1c1459a0 0x7f4b1c0b20e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47246/0 (socket says 172.21.15.45:47246) 2023-11-28T18:43:59.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.454+0000 7f4b1b7fe640 1 -- 172.21.15.45:0/1940239616 learned_addr learned my addr 172.21.15.45:0/1940239616 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:43:59.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.454+0000 7f4b1affd640 1 --2- 172.21.15.45:0/1940239616 >> v2:172.21.15.190:3300/0 conn(0x7f4b1c15bcd0 0x7f4b1c06c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:59.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.454+0000 7f4b1a7fc640 1 -- 172.21.15.45:0/1940239616 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4012114098 0 0) 0x7f4b1c146000 con 0x7f4b1c1459a0 2023-11-28T18:43:59.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.454+0000 7f4b1a7fc640 1 -- 172.21.15.45:0/1940239616 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b08003530 con 0x7f4b1c1459a0 2023-11-28T18:43:59.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.454+0000 7f4b1affd640 1 -- 172.21.15.45:0/1940239616 >> v1:172.21.15.190:6789/0 conn(0x7f4b1c15c0b0 legacy=0x7f4b1c145290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:59.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.454+0000 7f4b1affd640 1 -- 172.21.15.45:0/1940239616 >> v1:172.21.15.45:6789/0 conn(0x7f4b1c1459a0 legacy=0x7f4b1c0b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:59.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.454+0000 7f4b1affd640 1 -- 172.21.15.45:0/1940239616 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b1c1468a0 con 0x7f4b1c15bcd0 2023-11-28T18:43:59.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.458+0000 7f4b1affd640 1 --2- 172.21.15.45:0/1940239616 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4b1c15bcd0 0x7f4b1c06c300 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c0097f0 tx=0x7f4b0c01c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec7fd6bbc7d9c96c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:59.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.458+0000 7f4b1a7fc640 1 -- 172.21.15.45:0/1940239616 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c0ab600 con 0x7f4b1c15bcd0 2023-11-28T18:43:59.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.458+0000 7f4b1a7fc640 1 -- 172.21.15.45:0/1940239616 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b0c0a7050 con 0x7f4b1c15bcd0 2023-11-28T18:43:59.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.458+0000 7f4b1a7fc640 1 -- 172.21.15.45:0/1940239616 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c0ab960 con 0x7f4b1c15bcd0 2023-11-28T18:43:59.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.458+0000 7f4b216bb640 1 -- 172.21.15.45:0/1940239616 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4b1c15bcd0 msgr2=0x7f4b1c06c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:59.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.458+0000 7f4b216bb640 1 --2- 172.21.15.45:0/1940239616 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4b1c15bcd0 0x7f4b1c06c300 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c0097f0 tx=0x7f4b0c01c3f0 comp rx=0 tx=0).stop 2023-11-28T18:43:59.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.458+0000 7f4b216bb640 1 -- 172.21.15.45:0/1940239616 shutdown_connections 2023-11-28T18:43:59.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.458+0000 7f4b216bb640 1 --2- 172.21.15.45:0/1940239616 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4b1c15bcd0 0x7f4b1c06c300 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:59.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.458+0000 7f4b216bb640 1 -- 172.21.15.45:0/1940239616 >> 172.21.15.45:0/1940239616 conn(0x7f4b1c06a570 msgr2=0x7f4b1c06a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:43:59.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.458+0000 7f4b216bb640 1 -- 172.21.15.45:0/1940239616 shutdown_connections 2023-11-28T18:43:59.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.458+0000 7f4b216bb640 1 -- 172.21.15.45:0/1940239616 wait complete. 2023-11-28T18:43:59.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.458+0000 7f4b216bb640 1 Processor -- start 2023-11-28T18:43:59.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.458+0000 7f4b216bb640 1 -- start start 2023-11-28T18:43:59.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.462+0000 7f4b216bb640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4b1c1459a0 0x7f4b1c1405b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:59.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.462+0000 7f4b216bb640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4b1c15bcd0 0x7f4b1c15a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:59.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.462+0000 7f4b216bb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b1c15c0b0 0x7f4b1c0714f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:59.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.462+0000 7f4b216bb640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1c163f00 con 0x7f4b1c15c0b0 2023-11-28T18:43:59.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.462+0000 7f4b216bb640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1c1641e0 con 0x7f4b1c15bcd0 2023-11-28T18:43:59.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.462+0000 7f4b216bb640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1c1644c0 con 0x7f4b1c1459a0 2023-11-28T18:43:59.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.462+0000 7f4b1b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b1c15c0b0 0x7f4b1c0714f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:59.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.462+0000 7f4b1b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b1c15c0b0 0x7f4b1c0714f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56180/0 (socket says 172.21.15.45:56180) 2023-11-28T18:43:59.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.462+0000 7f4b1b7fe640 1 -- 172.21.15.45:0/4115505492 learned_addr learned my addr 172.21.15.45:0/4115505492 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:43:59.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.462+0000 7f4b13fff640 1 --2- 172.21.15.45:0/4115505492 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4b1c15bcd0 0x7f4b1c15a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:59.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.462+0000 7f4b1affd640 1 --2- 172.21.15.45:0/4115505492 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4b1c1459a0 0x7f4b1c1405b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:59.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.462+0000 7f4b1b7fe640 1 -- 172.21.15.45:0/4115505492 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4b1c1459a0 msgr2=0x7f4b1c1405b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:59.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.462+0000 7f4b1b7fe640 1 --2- 172.21.15.45:0/4115505492 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4b1c1459a0 0x7f4b1c1405b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:59.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.462+0000 7f4b1b7fe640 1 -- 172.21.15.45:0/4115505492 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4b1c15bcd0 msgr2=0x7f4b1c15a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:59.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.462+0000 7f4b1b7fe640 1 --2- 172.21.15.45:0/4115505492 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4b1c15bcd0 0x7f4b1c15a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:59.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.462+0000 7f4b1b7fe640 1 -- 172.21.15.45:0/4115505492 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b0c009420 con 0x7f4b1c15c0b0 2023-11-28T18:43:59.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.462+0000 7f4b1b7fe640 1 --2- 172.21.15.45:0/4115505492 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b1c15c0b0 0x7f4b1c0714f0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f4b1400cb40 tx=0x7f4b1400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:59.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.462+0000 7f4b137fe640 1 -- 172.21.15.45:0/4115505492 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1400aca0 con 0x7f4b1c15c0b0 2023-11-28T18:43:59.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.462+0000 7f4b137fe640 1 -- 172.21.15.45:0/4115505492 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b1400ae00 con 0x7f4b1c15c0b0 2023-11-28T18:43:59.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.462+0000 7f4b137fe640 1 -- 172.21.15.45:0/4115505492 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b14012620 con 0x7f4b1c15c0b0 2023-11-28T18:43:59.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.462+0000 7f4b216bb640 1 -- 172.21.15.45:0/4115505492 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b1c1647a0 con 0x7f4b1c15c0b0 2023-11-28T18:43:59.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.462+0000 7f4b216bb640 1 -- 172.21.15.45:0/4115505492 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b1c164d60 con 0x7f4b1c15c0b0 2023-11-28T18:43:59.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.462+0000 7f4b216bb640 1 -- 172.21.15.45:0/4115505492 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b1c13ba60 con 0x7f4b1c15c0b0 2023-11-28T18:43:59.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.462+0000 7f4b137fe640 1 -- 172.21.15.45:0/4115505492 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f4b14007070 con 0x7f4b1c15c0b0 2023-11-28T18:43:59.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.466+0000 7f4b137fe640 1 --2- 172.21.15.45:0/4115505492 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4afc066900 0x7f4afc068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:59.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.466+0000 7f4b137fe640 1 -- 172.21.15.45:0/4115505492 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4b140843b0 con 0x7f4b1c15c0b0 2023-11-28T18:43:59.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.466+0000 7f4b1affd640 1 --2- 172.21.15.45:0/4115505492 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4afc066900 0x7f4afc068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:59.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.466+0000 7f4b1affd640 1 --2- 172.21.15.45:0/4115505492 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4afc066900 0x7f4afc068dc0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c0ad000 tx=0x7f4b0c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:59.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.470+0000 7f4b137fe640 1 -- 172.21.15.45:0/4115505492 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4b1c13ba60 con 0x7f4b1c15c0b0 2023-11-28T18:43:59.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.626+0000 7f4b216bb640 1 -- 172.21.15.45:0/4115505492 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4b1c13ba60 con 0x7f4b1c15c0b0 2023-11-28T18:43:59.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.630+0000 7f4b137fe640 1 -- 172.21.15.45:0/4115505492 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+16542 (secure 0 0 0) 0x7f4b1c13ba60 con 0x7f4b1c15c0b0 2023-11-28T18:43:59.629 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:43:59.629 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":59,"fsid":"d10f5cd6-1d00-4019-99b6-6fa435498a15","created":"2023-11-28T18:37:08.189030+0000","modified":"2023-11-28T18:43:58.653754+0000","last_up_change":"2023-11-28T18:37:20.196124+0000","last_in_change":"2023-11-28T18:37:10.742043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T18:37:21.293917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-28T18:43:57.069740+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-28T18:43:57.647964+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"84465384-103c-4f2c-a45a-96f5bb9c835f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6809","nonce":555237322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6811","nonce":555237322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6815","nonce":555237322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6813","nonce":555237322}]},"public_addr":"172.21.15.45:6809/555237322","cluster_addr":"172.21.15.45:6811/555237322","heartbeat_back_addr":"172.21.15.45:6815/555237322","heartbeat_front_addr":"172.21.15.45:6813/555237322","state":["exists","up"]},{"osd":1,"uuid":"7d9eed24-a58f-42c7-a787-ac06be8553fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6801","nonce":2857063763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6803","nonce":2857063763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6807","nonce":2857063763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6805","nonce":2857063763}]},"public_addr":"172.21.15.45:6801/2857063763","cluster_addr":"172.21.15.45:6803/2857063763","heartbeat_back_addr":"172.21.15.45:6807/2857063763","heartbeat_front_addr":"172.21.15.45:6805/2857063763","state":["exists","up"]},{"osd":2,"uuid":"575eeccc-4abf-45b4-9caf-f3e797859588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6817","nonce":193884539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6819","nonce":193884539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6823","nonce":193884539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6821","nonce":193884539}]},"public_addr":"172.21.15.45:6817/193884539","cluster_addr":"172.21.15.45:6819/193884539","heartbeat_back_addr":"172.21.15.45:6823/193884539","heartbeat_front_addr":"172.21.15.45:6821/193884539","state":["exists","up"]},{"osd":3,"uuid":"9b0290d6-9a52-4bc8-b2a1-7622c5dc8e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6825","nonce":78541084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6827","nonce":78541084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6831","nonce":78541084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6829","nonce":78541084}]},"public_addr":"172.21.15.45:6825/78541084","cluster_addr":"172.21.15.45:6827/78541084","heartbeat_back_addr":"172.21.15.45:6831/78541084","heartbeat_front_addr":"172.21.15.45:6829/78541084","state":["exists","up"]},{"osd":4,"uuid":"ce632829-f027-4fbf-a627-02c571aa9d53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6809","nonce":1537591987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6811","nonce":1537591987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6815","nonce":1537591987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6813","nonce":1537591987}]},"public_addr":"172.21.15.190:6809/1537591987","cluster_addr":"172.21.15.190:6811/1537591987","heartbeat_back_addr":"172.21.15.190:6815/1537591987","heartbeat_front_addr":"172.21.15.190:6813/1537591987","state":["exists","up"]},{"osd":5,"uuid":"8700b609-27be-40bd-a251-4c0ae0a29ead","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6801","nonce":3296698407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6803","nonce":3296698407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6807","nonce":3296698407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6805","nonce":3296698407}]},"public_addr":"172.21.15.190:6801/3296698407","cluster_addr":"172.21.15.190:6803/3296698407","heartbeat_back_addr":"172.21.15.190:6807/3296698407","heartbeat_front_addr":"172.21.15.190:6805/3296698407","state":["exists","up"]},{"osd":6,"uuid":"44ce4a40-e6ff-4f4d-8e8a-7341e5c91f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6817","nonce":2317686718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6819","nonce":2317686718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6823","nonce":2317686718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6821","nonce":2317686718}]},"public_addr":"172.21.15.190:6817/2317686718","cluster_addr":"172.21.15.190:6819/2317686718","heartbeat_back_addr":"172.21.15.190:6823/2317686718","heartbeat_front_addr":"172.21.15.190:6821/2317686718","state":["exists","up"]},{"osd":7,"uuid":"192238c9-1423-4b7e-ac8f-84ba32113ddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6825","nonce":2493232051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6827","nonce":2493232051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6831","nonce":2493232051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6829","nonce":2493232051}]},"public_addr":"172.21.15.190:6825/2493232051","cluster_addr":"172.21.15.190:6827/2493232051","heartbeat_back_addr":"172.21.15.190:6831/2493232051","heartbeat_front_addr":"172.21.15.190:6829/2493232051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.393552+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.385453+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.361421+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.366408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.363226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.276007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.414605+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.445885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T18:43:59.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.630+0000 7f4b216bb640 1 -- 172.21.15.45:0/4115505492 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4afc066900 msgr2=0x7f4afc068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:59.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.630+0000 7f4b216bb640 1 --2- 172.21.15.45:0/4115505492 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4afc066900 0x7f4afc068dc0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c0ad000 tx=0x7f4b0c0a6000 comp rx=0 tx=0).stop 2023-11-28T18:43:59.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.630+0000 7f4b216bb640 1 -- 172.21.15.45:0/4115505492 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b1c15c0b0 msgr2=0x7f4b1c0714f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:59.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.630+0000 7f4b216bb640 1 --2- 172.21.15.45:0/4115505492 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b1c15c0b0 0x7f4b1c0714f0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f4b1400cb40 tx=0x7f4b1400a060 comp rx=0 tx=0).stop 2023-11-28T18:43:59.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.630+0000 7f4b216bb640 1 -- 172.21.15.45:0/4115505492 shutdown_connections 2023-11-28T18:43:59.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.630+0000 7f4b216bb640 1 --2- 172.21.15.45:0/4115505492 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4afc066900 0x7f4afc068dc0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:59.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.630+0000 7f4b216bb640 1 --2- 172.21.15.45:0/4115505492 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b1c15c0b0 0x7f4b1c0714f0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:59.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.630+0000 7f4b216bb640 1 --2- 172.21.15.45:0/4115505492 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4b1c15bcd0 0x7f4b1c15a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:59.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.630+0000 7f4b216bb640 1 --2- 172.21.15.45:0/4115505492 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4b1c1459a0 0x7f4b1c1405b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:59.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.630+0000 7f4b216bb640 1 -- 172.21.15.45:0/4115505492 >> 172.21.15.45:0/4115505492 conn(0x7f4b1c06a570 msgr2=0x7f4b1c0cb1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:43:59.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.630+0000 7f4b216bb640 1 -- 172.21.15.45:0/4115505492 shutdown_connections 2023-11-28T18:43:59.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.630+0000 7f4b216bb640 1 -- 172.21.15.45:0/4115505492 wait complete. 2023-11-28T18:43:59.651 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T18:43:59.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.794+0000 7f6bac0e3640 1 Processor -- start 2023-11-28T18:43:59.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.794+0000 7f6bac0e3640 1 -- start start 2023-11-28T18:43:59.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.794+0000 7f6bac0e3640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6ba41608b0 0x7f6ba40d2b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:59.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.794+0000 7f6bac0e3640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ba40cdb60 0x7f6ba40b6270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:59.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.794+0000 7f6bac0e3640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f6ba40b51e0 0x7f6ba40b5650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:59.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.794+0000 7f6bac0e3640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ba4160c90 con 0x7f6ba41608b0 2023-11-28T18:43:59.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.794+0000 7f6bac0e3640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ba40b5b90 con 0x7f6ba40b51e0 2023-11-28T18:43:59.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.794+0000 7f6bac0e3640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba40d0db0 con 0x7f6ba40cdb60 2023-11-28T18:43:59.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.794+0000 7f6ba9e7f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6ba41608b0 0x7f6ba40d2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:59.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.794+0000 7f6ba9e7f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6ba41608b0 0x7f6ba40d2b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56186/0 (socket says 172.21.15.45:56186) 2023-11-28T18:43:59.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.794+0000 7f6ba9e7f640 1 -- 172.21.15.45:0/1164261594 learned_addr learned my addr 172.21.15.45:0/1164261594 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:43:59.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.794+0000 7f6baa680640 1 --2- 172.21.15.45:0/1164261594 >> v2:172.21.15.190:3300/0 conn(0x7f6ba40b51e0 0x7f6ba40b5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:59.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.794+0000 7f6ba967e640 1 --2- 172.21.15.45:0/1164261594 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ba40cdb60 0x7f6ba40b6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:59.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.794+0000 7f6ba9e7f640 1 -- 172.21.15.45:0/1164261594 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ba40cdb60 msgr2=0x7f6ba40b6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:43:59.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.794+0000 7f6ba9e7f640 1 --2- 172.21.15.45:0/1164261594 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ba40cdb60 0x7f6ba40b6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:59.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.794+0000 7f6ba9e7f640 1 -- 172.21.15.45:0/1164261594 >> v2:172.21.15.190:3300/0 conn(0x7f6ba40b51e0 msgr2=0x7f6ba40b5650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:43:59.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.794+0000 7f6ba9e7f640 1 --2- 172.21.15.45:0/1164261594 >> v2:172.21.15.190:3300/0 conn(0x7f6ba40b51e0 0x7f6ba40b5650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:59.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.794+0000 7f6ba9e7f640 1 -- 172.21.15.45:0/1164261594 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba40ce320 con 0x7f6ba41608b0 2023-11-28T18:43:59.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.794+0000 7f6ba967e640 1 --2- 172.21.15.45:0/1164261594 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ba40cdb60 0x7f6ba40b6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:43:59.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.798+0000 7f6ba9e7f640 1 --2- 172.21.15.45:0/1164261594 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ba41608b0 0x7f6ba40d2b50 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f6ba40b4c80 tx=0x7f6ba001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdb0fdc7670941ef server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:59.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.798+0000 7f6ba8e7d640 1 -- 172.21.15.45:0/1164261594 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba00ac410 con 0x7f6ba41608b0 2023-11-28T18:43:59.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.798+0000 7f6ba8e7d640 1 -- 172.21.15.45:0/1164261594 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ba00ac570 con 0x7f6ba41608b0 2023-11-28T18:43:59.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.798+0000 7f6ba8e7d640 1 -- 172.21.15.45:0/1164261594 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba00ac900 con 0x7f6ba41608b0 2023-11-28T18:43:59.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.798+0000 7f6bac0e3640 1 -- 172.21.15.45:0/1164261594 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ba41608b0 msgr2=0x7f6ba40d2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:59.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.798+0000 7f6bac0e3640 1 --2- 172.21.15.45:0/1164261594 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ba41608b0 0x7f6ba40d2b50 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f6ba40b4c80 tx=0x7f6ba001c500 comp rx=0 tx=0).stop 2023-11-28T18:43:59.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.798+0000 7f6bac0e3640 1 -- 172.21.15.45:0/1164261594 shutdown_connections 2023-11-28T18:43:59.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.798+0000 7f6bac0e3640 1 --2- 172.21.15.45:0/1164261594 >> v2:172.21.15.190:3300/0 conn(0x7f6ba40b51e0 0x7f6ba40b5650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:59.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.798+0000 7f6bac0e3640 1 --2- 172.21.15.45:0/1164261594 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ba40cdb60 0x7f6ba40b6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:59.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.798+0000 7f6bac0e3640 1 --2- 172.21.15.45:0/1164261594 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ba41608b0 0x7f6ba40d2b50 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:59.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.798+0000 7f6bac0e3640 1 -- 172.21.15.45:0/1164261594 >> 172.21.15.45:0/1164261594 conn(0x7f6ba40720a0 msgr2=0x7f6ba40724b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:43:59.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.798+0000 7f6bac0e3640 1 -- 172.21.15.45:0/1164261594 shutdown_connections 2023-11-28T18:43:59.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.798+0000 7f6bac0e3640 1 -- 172.21.15.45:0/1164261594 wait complete. 2023-11-28T18:43:59.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.802+0000 7f6bac0e3640 1 Processor -- start 2023-11-28T18:43:59.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.802+0000 7f6bac0e3640 1 -- start start 2023-11-28T18:43:59.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.802+0000 7f6bac0e3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ba40b51e0 0x7f6ba414b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:59.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.802+0000 7f6bac0e3640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ba40cdb60 0x7f6ba414aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:59.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.802+0000 7f6bac0e3640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ba41608b0 0x7f6ba4156440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:59.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.802+0000 7f6bac0e3640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba414c580 con 0x7f6ba40b51e0 2023-11-28T18:43:59.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.802+0000 7f6bac0e3640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba414b760 con 0x7f6ba41608b0 2023-11-28T18:43:59.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.802+0000 7f6bac0e3640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba414afe0 con 0x7f6ba40cdb60 2023-11-28T18:43:59.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.802+0000 7f6ba9e7f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ba40b51e0 0x7f6ba414b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:59.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.802+0000 7f6ba9e7f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ba40b51e0 0x7f6ba414b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56192/0 (socket says 172.21.15.45:56192) 2023-11-28T18:43:59.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.802+0000 7f6ba9e7f640 1 -- 172.21.15.45:0/3407749455 learned_addr learned my addr 172.21.15.45:0/3407749455 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:43:59.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.802+0000 7f6ba967e640 1 --2- 172.21.15.45:0/3407749455 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ba40cdb60 0x7f6ba414aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:59.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.802+0000 7f6baa680640 1 --2- 172.21.15.45:0/3407749455 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ba41608b0 0x7f6ba4156440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:59.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.802+0000 7f6ba9e7f640 1 -- 172.21.15.45:0/3407749455 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ba40cdb60 msgr2=0x7f6ba414aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:59.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.802+0000 7f6ba9e7f640 1 --2- 172.21.15.45:0/3407749455 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ba40cdb60 0x7f6ba414aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:59.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.802+0000 7f6ba9e7f640 1 -- 172.21.15.45:0/3407749455 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ba41608b0 msgr2=0x7f6ba4156440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:59.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.802+0000 7f6ba9e7f640 1 --2- 172.21.15.45:0/3407749455 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ba41608b0 0x7f6ba4156440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:59.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.802+0000 7f6ba9e7f640 1 -- 172.21.15.45:0/3407749455 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba00094d0 con 0x7f6ba40b51e0 2023-11-28T18:43:59.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.802+0000 7f6ba967e640 1 --2- 172.21.15.45:0/3407749455 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ba40cdb60 0x7f6ba414aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:43:59.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.802+0000 7f6ba9e7f640 1 --2- 172.21.15.45:0/3407749455 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ba40b51e0 0x7f6ba414b220 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f6ba00af040 tx=0x7f6ba00192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:59.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.802+0000 7f6b9a7fc640 1 -- 172.21.15.45:0/3407749455 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba00ac410 con 0x7f6ba40b51e0 2023-11-28T18:43:59.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.802+0000 7f6b9a7fc640 1 -- 172.21.15.45:0/3407749455 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ba00b65f0 con 0x7f6ba40b51e0 2023-11-28T18:43:59.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.802+0000 7f6b9a7fc640 1 -- 172.21.15.45:0/3407749455 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba00b69c0 con 0x7f6ba40b51e0 2023-11-28T18:43:59.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.802+0000 7f6bac0e3640 1 -- 172.21.15.45:0/3407749455 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ba414ba00 con 0x7f6ba40b51e0 2023-11-28T18:43:59.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.802+0000 7f6bac0e3640 1 -- 172.21.15.45:0/3407749455 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ba414bfc0 con 0x7f6ba40b51e0 2023-11-28T18:43:59.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.806+0000 7f6bac0e3640 1 -- 172.21.15.45:0/3407749455 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ba4069480 con 0x7f6ba40b51e0 2023-11-28T18:43:59.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.806+0000 7f6b9a7fc640 1 -- 172.21.15.45:0/3407749455 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f6ba00b6b20 con 0x7f6ba40b51e0 2023-11-28T18:43:59.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.806+0000 7f6b9a7fc640 1 --2- 172.21.15.45:0/3407749455 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6b880668d0 0x7f6b88068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:43:59.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.806+0000 7f6b9a7fc640 1 -- 172.21.15.45:0/3407749455 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6ba011ee50 con 0x7f6ba40b51e0 2023-11-28T18:43:59.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.806+0000 7f6ba967e640 1 --2- 172.21.15.45:0/3407749455 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6b880668d0 0x7f6b88068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:43:59.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.806+0000 7f6ba967e640 1 --2- 172.21.15.45:0/3407749455 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6b880668d0 0x7f6b88068d90 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f6b94006fd0 tx=0x7f6b94008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:43:59.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.810+0000 7f6b9a7fc640 1 -- 172.21.15.45:0/3407749455 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6ba00ec080 con 0x7f6ba40b51e0 2023-11-28T18:43:59.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.970+0000 7f6bac0e3640 1 -- 172.21.15.45:0/3407749455 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6ba4150320 con 0x7f6ba40b51e0 2023-11-28T18:43:59.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.970+0000 7f6b9a7fc640 1 -- 172.21.15.45:0/3407749455 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+16542 (secure 0 0 0) 0x7f6ba00ef6a0 con 0x7f6ba40b51e0 2023-11-28T18:43:59.970 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:43:59.971 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":59,"fsid":"d10f5cd6-1d00-4019-99b6-6fa435498a15","created":"2023-11-28T18:37:08.189030+0000","modified":"2023-11-28T18:43:58.653754+0000","last_up_change":"2023-11-28T18:37:20.196124+0000","last_in_change":"2023-11-28T18:37:10.742043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T18:37:21.293917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-28T18:43:57.069740+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-28T18:43:57.647964+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"84465384-103c-4f2c-a45a-96f5bb9c835f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6809","nonce":555237322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6811","nonce":555237322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6815","nonce":555237322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6813","nonce":555237322}]},"public_addr":"172.21.15.45:6809/555237322","cluster_addr":"172.21.15.45:6811/555237322","heartbeat_back_addr":"172.21.15.45:6815/555237322","heartbeat_front_addr":"172.21.15.45:6813/555237322","state":["exists","up"]},{"osd":1,"uuid":"7d9eed24-a58f-42c7-a787-ac06be8553fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6801","nonce":2857063763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6803","nonce":2857063763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6807","nonce":2857063763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6805","nonce":2857063763}]},"public_addr":"172.21.15.45:6801/2857063763","cluster_addr":"172.21.15.45:6803/2857063763","heartbeat_back_addr":"172.21.15.45:6807/2857063763","heartbeat_front_addr":"172.21.15.45:6805/2857063763","state":["exists","up"]},{"osd":2,"uuid":"575eeccc-4abf-45b4-9caf-f3e797859588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6817","nonce":193884539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6819","nonce":193884539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6823","nonce":193884539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6821","nonce":193884539}]},"public_addr":"172.21.15.45:6817/193884539","cluster_addr":"172.21.15.45:6819/193884539","heartbeat_back_addr":"172.21.15.45:6823/193884539","heartbeat_front_addr":"172.21.15.45:6821/193884539","state":["exists","up"]},{"osd":3,"uuid":"9b0290d6-9a52-4bc8-b2a1-7622c5dc8e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6825","nonce":78541084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6827","nonce":78541084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6831","nonce":78541084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6829","nonce":78541084}]},"public_addr":"172.21.15.45:6825/78541084","cluster_addr":"172.21.15.45:6827/78541084","heartbeat_back_addr":"172.21.15.45:6831/78541084","heartbeat_front_addr":"172.21.15.45:6829/78541084","state":["exists","up"]},{"osd":4,"uuid":"ce632829-f027-4fbf-a627-02c571aa9d53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6809","nonce":1537591987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6811","nonce":1537591987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6815","nonce":1537591987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6813","nonce":1537591987}]},"public_addr":"172.21.15.190:6809/1537591987","cluster_addr":"172.21.15.190:6811/1537591987","heartbeat_back_addr":"172.21.15.190:6815/1537591987","heartbeat_front_addr":"172.21.15.190:6813/1537591987","state":["exists","up"]},{"osd":5,"uuid":"8700b609-27be-40bd-a251-4c0ae0a29ead","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6801","nonce":3296698407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6803","nonce":3296698407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6807","nonce":3296698407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6805","nonce":3296698407}]},"public_addr":"172.21.15.190:6801/3296698407","cluster_addr":"172.21.15.190:6803/3296698407","heartbeat_back_addr":"172.21.15.190:6807/3296698407","heartbeat_front_addr":"172.21.15.190:6805/3296698407","state":["exists","up"]},{"osd":6,"uuid":"44ce4a40-e6ff-4f4d-8e8a-7341e5c91f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6817","nonce":2317686718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6819","nonce":2317686718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6823","nonce":2317686718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6821","nonce":2317686718}]},"public_addr":"172.21.15.190:6817/2317686718","cluster_addr":"172.21.15.190:6819/2317686718","heartbeat_back_addr":"172.21.15.190:6823/2317686718","heartbeat_front_addr":"172.21.15.190:6821/2317686718","state":["exists","up"]},{"osd":7,"uuid":"192238c9-1423-4b7e-ac8f-84ba32113ddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6825","nonce":2493232051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6827","nonce":2493232051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6831","nonce":2493232051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6829","nonce":2493232051}]},"public_addr":"172.21.15.190:6825/2493232051","cluster_addr":"172.21.15.190:6827/2493232051","heartbeat_back_addr":"172.21.15.190:6831/2493232051","heartbeat_front_addr":"172.21.15.190:6829/2493232051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.393552+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.385453+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.361421+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.366408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.363226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.276007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.414605+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.445885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T18:43:59.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.970+0000 7f6bac0e3640 1 -- 172.21.15.45:0/3407749455 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6b880668d0 msgr2=0x7f6b88068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:59.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.970+0000 7f6bac0e3640 1 --2- 172.21.15.45:0/3407749455 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6b880668d0 0x7f6b88068d90 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f6b94006fd0 tx=0x7f6b94008040 comp rx=0 tx=0).stop 2023-11-28T18:43:59.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.970+0000 7f6bac0e3640 1 -- 172.21.15.45:0/3407749455 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ba40b51e0 msgr2=0x7f6ba414b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:43:59.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.970+0000 7f6bac0e3640 1 --2- 172.21.15.45:0/3407749455 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ba40b51e0 0x7f6ba414b220 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f6ba00af040 tx=0x7f6ba00192a0 comp rx=0 tx=0).stop 2023-11-28T18:43:59.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.970+0000 7f6bac0e3640 1 -- 172.21.15.45:0/3407749455 shutdown_connections 2023-11-28T18:43:59.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.970+0000 7f6bac0e3640 1 --2- 172.21.15.45:0/3407749455 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6b880668d0 0x7f6b88068d90 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:59.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.970+0000 7f6bac0e3640 1 --2- 172.21.15.45:0/3407749455 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ba41608b0 0x7f6ba4156440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:59.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.970+0000 7f6bac0e3640 1 --2- 172.21.15.45:0/3407749455 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ba40cdb60 0x7f6ba414aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:59.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.970+0000 7f6bac0e3640 1 --2- 172.21.15.45:0/3407749455 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ba40b51e0 0x7f6ba414b220 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:43:59.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.970+0000 7f6bac0e3640 1 -- 172.21.15.45:0/3407749455 >> 172.21.15.45:0/3407749455 conn(0x7f6ba40720a0 msgr2=0x7f6ba40c7450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:43:59.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.970+0000 7f6bac0e3640 1 -- 172.21.15.45:0/3407749455 shutdown_connections 2023-11-28T18:43:59.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:43:59.970+0000 7f6bac0e3640 1 -- 172.21.15.45:0/3407749455 wait complete. 2023-11-28T18:43:59.992 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-28T18:44:00.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:00.138+0000 7fe6def2a640 1 Processor -- start 2023-11-28T18:44:00.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:00.138+0000 7fe6def2a640 1 -- start start 2023-11-28T18:44:00.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:00.138+0000 7fe6def2a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe6d815adf0 0x7fe6d813d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:00.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:00.138+0000 7fe6def2a640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6d813d2f0 con 0x7fe6d813f630 2023-11-28T18:44:00.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:00.138+0000 7fe6def2a640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6d80cddb0 con 0x7fe6d8071dd0 2023-11-28T18:44:00.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:00.138+0000 7fe6def2a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6d8140560 con 0x7fe6d815adf0 2023-11-28T18:44:00.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:00.138+0000 7fe6dd4c7640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe6d813f630 0x7fe6d80ce240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47262/0 (socket says 172.21.15.45:47262) 2023-11-28T18:44:00.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:00.138+0000 7fe6dd4c7640 1 -- 172.21.15.45:0/2311511737 learned_addr learned my addr 172.21.15.45:0/2311511737 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:44:00.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:00.138+0000 7fe6d7fff640 1 --2- 172.21.15.45:0/2311511737 >> v2:172.21.15.45:3300/0 conn(0x7fe6d815adf0 0x7fe6d813d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:00.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:00.138+0000 7fe6d7fff640 1 -- 172.21.15.45:0/2311511737 >> v1:172.21.15.190:6789/0 conn(0x7fe6d8071dd0 legacy=0x7fe6d80721b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:00.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:00.138+0000 7fe6d7fff640 1 -- 172.21.15.45:0/2311511737 >> v1:172.21.15.45:6789/0 conn(0x7fe6d813f630 legacy=0x7fe6d80ce240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:00.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:00.138+0000 7fe6d7fff640 1 -- 172.21.15.45:0/2311511737 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6d813ffa0 con 0x7fe6d815adf0 2023-11-28T18:44:00.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:00.142+0000 7fe6d7fff640 1 --2- 172.21.15.45:0/2311511737 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6d815adf0 0x7fe6d813d5a0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fe6c40097c0 tx=0x7fe6c401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddd10612148aee9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:44:00.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:00.142+0000 7fe6d77fe640 1 -- 172.21.15.45:0/2311511737 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c40ab600 con 0x7fe6d815adf0 2023-11-28T18:44:00.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:00.142+0000 7fe6d77fe640 1 -- 172.21.15.45:0/2311511737 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6c40a7050 con 0x7fe6d815adf0 2023-11-28T18:44:00.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:00.142+0000 7fe6d77fe640 1 -- 172.21.15.45:0/2311511737 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c40ab980 con 0x7fe6d815adf0 2023-11-28T18:44:00.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:00.142+0000 7fe6def2a640 1 -- 172.21.15.45:0/2311511737 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6d815adf0 msgr2=0x7fe6d813d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:00.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:00.142+0000 7fe6def2a640 1 --2- 172.21.15.45:0/2311511737 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6d815adf0 0x7fe6d813d5a0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fe6c40097c0 tx=0x7fe6c401c480 comp rx=0 tx=0).stop 2023-11-28T18:44:00.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:00.142+0000 7fe6def2a640 1 -- 172.21.15.45:0/2311511737 shutdown_connections 2023-11-28T18:44:00.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:00.142+0000 7fe6def2a640 1 --2- 172.21.15.45:0/2311511737 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6d815adf0 0x7fe6d813d5a0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:00.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:00.142+0000 7fe6def2a640 1 -- 172.21.15.45:0/2311511737 >> 172.21.15.45:0/2311511737 conn(0x7fe6d80b0d00 msgr2=0x7fe6d80b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:44:00.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:00.142+0000 7fe6def2a640 1 -- 172.21.15.45:0/2311511737 shutdown_connections 2023-11-28T18:44:00.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:00.142+0000 7fe6def2a640 1 -- 172.21.15.45:0/2311511737 wait complete. 2023-11-28T18:44:00.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:00.146+0000 7fe6def2a640 1 Processor -- start 2023-11-28T18:44:00.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:00.146+0000 7fe6def2a640 1 -- start start 2023-11-28T18:44:00.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:00.146+0000 7fe6def2a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6d8071dd0 0x7fe6d813b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:00.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:00.146+0000 7fe6def2a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6d813f630 0x7fe6d8151720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:00.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:00.146+0000 7fe6def2a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe6d815adf0 0x7fe6d8143000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:00.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:00.146+0000 7fe6def2a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d813b9e0 con 0x7fe6d813f630 2023-11-28T18:44:00.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:00.146+0000 7fe6def2a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d8141f60 con 0x7fe6d815adf0 2023-11-28T18:44:00.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:00.146+0000 7fe6def2a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d8142240 con 0x7fe6d8071dd0 2023-11-28T18:44:00.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:00.146+0000 7fe6d7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6d813f630 0x7fe6d8151720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:00.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:00.146+0000 7fe6d7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6d813f630 0x7fe6d8151720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56202/0 (socket says 172.21.15.45:56202) 2023-11-28T18:44:00.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:00.146+0000 7fe6d7fff640 1 -- 172.21.15.45:0/3278498740 learned_addr learned my addr 172.21.15.45:0/3278498740 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:44:00.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:00.146+0000 7fe6dd4c7640 1 --2- 172.21.15.45:0/3278498740 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe6d815adf0 0x7fe6d8143000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:00.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:00.146+0000 7fe6dccc6640 1 --2- 172.21.15.45:0/3278498740 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6d8071dd0 0x7fe6d813b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:00.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:00.146+0000 7fe6d7fff640 1 -- 172.21.15.45:0/3278498740 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6d8071dd0 msgr2=0x7fe6d813b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:00.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:00.146+0000 7fe6d7fff640 1 --2- 172.21.15.45:0/3278498740 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6d8071dd0 0x7fe6d813b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:00.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:00.146+0000 7fe6d7fff640 1 -- 172.21.15.45:0/3278498740 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe6d815adf0 msgr2=0x7fe6d8143000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:00.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:00.146+0000 7fe6d7fff640 1 --2- 172.21.15.45:0/3278498740 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe6d815adf0 0x7fe6d8143000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:00.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:00.146+0000 7fe6d7fff640 1 -- 172.21.15.45:0/3278498740 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6c4009420 con 0x7fe6d813f630 2023-11-28T18:44:00.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:00.146+0000 7fe6d7fff640 1 --2- 172.21.15.45:0/3278498740 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6d813f630 0x7fe6d8151720 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fe6c40ae040 tx=0x7fe6c4019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:44:00.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:00.146+0000 7fe6d57fa640 1 -- 172.21.15.45:0/3278498740 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c40b4900 con 0x7fe6d813f630 2023-11-28T18:44:00.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:00.146+0000 7fe6d57fa640 1 -- 172.21.15.45:0/3278498740 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6c40b4a80 con 0x7fe6d813f630 2023-11-28T18:44:00.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:00.146+0000 7fe6d57fa640 1 -- 172.21.15.45:0/3278498740 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c40b4e30 con 0x7fe6d813f630 2023-11-28T18:44:00.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:00.146+0000 7fe6def2a640 1 -- 172.21.15.45:0/3278498740 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6d8142520 con 0x7fe6d813f630 2023-11-28T18:44:00.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:00.146+0000 7fe6def2a640 1 -- 172.21.15.45:0/3278498740 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6d8142ae0 con 0x7fe6d813f630 2023-11-28T18:44:00.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:00.150+0000 7fe6def2a640 1 -- 172.21.15.45:0/3278498740 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6d8069410 con 0x7fe6d813f630 2023-11-28T18:44:00.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:00.150+0000 7fe6d57fa640 1 -- 172.21.15.45:0/3278498740 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe6c40b2040 con 0x7fe6d813f630 2023-11-28T18:44:00.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:00.150+0000 7fe6d57fa640 1 --2- 172.21.15.45:0/3278498740 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe6bc066920 0x7fe6bc068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:00.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:00.150+0000 7fe6d57fa640 1 -- 172.21.15.45:0/3278498740 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe6c411e6a0 con 0x7fe6d813f630 2023-11-28T18:44:00.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:00.150+0000 7fe6dccc6640 1 --2- 172.21.15.45:0/3278498740 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe6bc066920 0x7fe6bc068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:00.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:00.150+0000 7fe6dccc6640 1 --2- 172.21.15.45:0/3278498740 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe6bc066920 0x7fe6bc068de0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fe6d8151330 tx=0x7fe6cc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:44:00.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:00.154+0000 7fe6d57fa640 1 -- 172.21.15.45:0/3278498740 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe6c40eba00 con 0x7fe6d813f630 2023-11-28T18:44:00.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:00.350+0000 7fe6def2a640 1 -- 172.21.15.45:0/3278498740 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fe6d8151380 con 0x7fe6d813f630 2023-11-28T18:44:01.235 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-11-28T18:44:01.234+0000 7f366ba81640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T18:44:01.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.282+0000 7fe6d57fa640 1 -- 172.21.15.45:0/3278498740 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v47) v1 ==== 118+0+0 (secure 0 0 0) 0x7fe6c40ef020 con 0x7fe6d813f630 2023-11-28T18:44:01.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.282+0000 7fe6def2a640 1 -- 172.21.15.45:0/3278498740 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe6bc066920 msgr2=0x7fe6bc068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:01.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.282+0000 7fe6def2a640 1 --2- 172.21.15.45:0/3278498740 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe6bc066920 0x7fe6bc068de0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fe6d8151330 tx=0x7fe6cc009040 comp rx=0 tx=0).stop 2023-11-28T18:44:01.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.282+0000 7fe6def2a640 1 -- 172.21.15.45:0/3278498740 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6d813f630 msgr2=0x7fe6d8151720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:01.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.282+0000 7fe6def2a640 1 --2- 172.21.15.45:0/3278498740 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6d813f630 0x7fe6d8151720 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fe6c40ae040 tx=0x7fe6c4019220 comp rx=0 tx=0).stop 2023-11-28T18:44:01.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.282+0000 7fe6def2a640 1 -- 172.21.15.45:0/3278498740 shutdown_connections 2023-11-28T18:44:01.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.282+0000 7fe6def2a640 1 --2- 172.21.15.45:0/3278498740 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fe6bc066920 0x7fe6bc068de0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:01.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.282+0000 7fe6def2a640 1 --2- 172.21.15.45:0/3278498740 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe6d815adf0 0x7fe6d8143000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:01.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.282+0000 7fe6def2a640 1 --2- 172.21.15.45:0/3278498740 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6d813f630 0x7fe6d8151720 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:01.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.282+0000 7fe6def2a640 1 --2- 172.21.15.45:0/3278498740 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6d8071dd0 0x7fe6d813b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:01.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.282+0000 7fe6def2a640 1 -- 172.21.15.45:0/3278498740 >> 172.21.15.45:0/3278498740 conn(0x7fe6d80b0d00 msgr2=0x7fe6d815b950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:44:01.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.282+0000 7fe6def2a640 1 -- 172.21.15.45:0/3278498740 shutdown_connections 2023-11-28T18:44:01.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.282+0000 7fe6def2a640 1 -- 172.21.15.45:0/3278498740 wait complete. 2023-11-28T18:44:01.307 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-28T18:44:01.308 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-28T18:44:01.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.458+0000 7fa97873e640 1 Processor -- start 2023-11-28T18:44:01.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.458+0000 7fa97873e640 1 -- start start 2023-11-28T18:44:01.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.462+0000 7fa97873e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa970071dd0 0x7fa9700721b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:01.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.462+0000 7fa97873e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa97015adf0 0x7fa97013d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:01.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.462+0000 7fa97873e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa97013f630 0x7fa9700ce240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:01.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.462+0000 7fa97873e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa970140560 con 0x7fa970071dd0 2023-11-28T18:44:01.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.462+0000 7fa97873e640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9700cd830 con 0x7fa97015adf0 2023-11-28T18:44:01.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.462+0000 7fa97873e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa97013d2f0 con 0x7fa97013f630 2023-11-28T18:44:01.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.462+0000 7fa9764da640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa970071dd0 0x7fa9700721b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:01.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.462+0000 7fa9764da640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa970071dd0 0x7fa9700721b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56210/0 (socket says 172.21.15.45:56210) 2023-11-28T18:44:01.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.462+0000 7fa9764da640 1 -- 172.21.15.45:0/3758409242 learned_addr learned my addr 172.21.15.45:0/3758409242 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:44:01.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.462+0000 7fa976cdb640 1 --2- 172.21.15.45:0/3758409242 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa97013f630 0x7fa9700ce240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:01.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.462+0000 7fa975cd9640 1 --2- 172.21.15.45:0/3758409242 >> v2:172.21.15.190:3300/0 conn(0x7fa97015adf0 0x7fa97013d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:01.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.462+0000 7fa9764da640 1 -- 172.21.15.45:0/3758409242 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa97013f630 msgr2=0x7fa9700ce240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:44:01.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.462+0000 7fa9764da640 1 --2- 172.21.15.45:0/3758409242 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa97013f630 0x7fa9700ce240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:01.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.462+0000 7fa9764da640 1 -- 172.21.15.45:0/3758409242 >> v2:172.21.15.190:3300/0 conn(0x7fa97015adf0 msgr2=0x7fa97013d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:44:01.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.462+0000 7fa9764da640 1 --2- 172.21.15.45:0/3758409242 >> v2:172.21.15.190:3300/0 conn(0x7fa97015adf0 0x7fa97013d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:01.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.462+0000 7fa9764da640 1 -- 172.21.15.45:0/3758409242 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9700cddb0 con 0x7fa970071dd0 2023-11-28T18:44:01.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.462+0000 7fa9764da640 1 --2- 172.21.15.45:0/3758409242 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa970071dd0 0x7fa9700721b0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fa970074510 tx=0x7fa96c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3338d1c961c77896 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:44:01.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.462+0000 7fa9754d8640 1 -- 172.21.15.45:0/3758409242 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa96c0aa620 con 0x7fa970071dd0 2023-11-28T18:44:01.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.462+0000 7fa9754d8640 1 -- 172.21.15.45:0/3758409242 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa96c0aa780 con 0x7fa970071dd0 2023-11-28T18:44:01.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.466+0000 7fa9754d8640 1 -- 172.21.15.45:0/3758409242 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa96c0aab10 con 0x7fa970071dd0 2023-11-28T18:44:01.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.466+0000 7fa97873e640 1 -- 172.21.15.45:0/3758409242 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa970071dd0 msgr2=0x7fa9700721b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:01.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.466+0000 7fa97873e640 1 --2- 172.21.15.45:0/3758409242 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa970071dd0 0x7fa9700721b0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fa970074510 tx=0x7fa96c01c500 comp rx=0 tx=0).stop 2023-11-28T18:44:01.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.466+0000 7fa97873e640 1 -- 172.21.15.45:0/3758409242 shutdown_connections 2023-11-28T18:44:01.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.466+0000 7fa97873e640 1 --2- 172.21.15.45:0/3758409242 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa97013f630 0x7fa9700ce240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:01.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.466+0000 7fa97873e640 1 --2- 172.21.15.45:0/3758409242 >> v2:172.21.15.190:3300/0 conn(0x7fa97015adf0 0x7fa97013d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:01.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.466+0000 7fa97873e640 1 --2- 172.21.15.45:0/3758409242 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa970071dd0 0x7fa9700721b0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:01.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.466+0000 7fa97873e640 1 -- 172.21.15.45:0/3758409242 >> 172.21.15.45:0/3758409242 conn(0x7fa9700b0d00 msgr2=0x7fa9700b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:44:01.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.466+0000 7fa97873e640 1 -- 172.21.15.45:0/3758409242 shutdown_connections 2023-11-28T18:44:01.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.466+0000 7fa97873e640 1 -- 172.21.15.45:0/3758409242 wait complete. 2023-11-28T18:44:01.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.466+0000 7fa97873e640 1 Processor -- start 2023-11-28T18:44:01.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.466+0000 7fa97873e640 1 -- start start 2023-11-28T18:44:01.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.466+0000 7fa97873e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa970071dd0 0x7fa97013a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:01.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.466+0000 7fa97873e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa97013f630 0x7fa970151fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:01.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.466+0000 7fa97873e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa97015adf0 0x7fa970152520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:01.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.466+0000 7fa97873e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9701530c0 con 0x7fa970071dd0 2023-11-28T18:44:01.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.466+0000 7fa97873e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa97013aa60 con 0x7fa97013f630 2023-11-28T18:44:01.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.466+0000 7fa97873e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa970153310 con 0x7fa97015adf0 2023-11-28T18:44:01.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.466+0000 7fa9764da640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa970071dd0 0x7fa97013a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:01.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.466+0000 7fa9764da640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa970071dd0 0x7fa97013a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56216/0 (socket says 172.21.15.45:56216) 2023-11-28T18:44:01.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.466+0000 7fa9764da640 1 -- 172.21.15.45:0/2523157448 learned_addr learned my addr 172.21.15.45:0/2523157448 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:44:01.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.466+0000 7fa976cdb640 1 --2- 172.21.15.45:0/2523157448 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa97015adf0 0x7fa970152520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:01.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.466+0000 7fa975cd9640 1 --2- 172.21.15.45:0/2523157448 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa97013f630 0x7fa970151fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:01.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.470+0000 7fa9764da640 1 -- 172.21.15.45:0/2523157448 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa97015adf0 msgr2=0x7fa970152520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:01.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.470+0000 7fa9764da640 1 --2- 172.21.15.45:0/2523157448 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa97015adf0 0x7fa970152520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:01.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.470+0000 7fa9764da640 1 -- 172.21.15.45:0/2523157448 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa97013f630 msgr2=0x7fa970151fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:01.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.470+0000 7fa9764da640 1 --2- 172.21.15.45:0/2523157448 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa97013f630 0x7fa970151fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:01.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.470+0000 7fa9764da640 1 -- 172.21.15.45:0/2523157448 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa96c0094d0 con 0x7fa970071dd0 2023-11-28T18:44:01.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.470+0000 7fa9764da640 1 --2- 172.21.15.45:0/2523157448 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa970071dd0 0x7fa97013a520 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fa96c0ac040 tx=0x7fa96c01ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:44:01.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.470+0000 7fa966ffd640 1 -- 172.21.15.45:0/2523157448 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa96c0bd5f0 con 0x7fa970071dd0 2023-11-28T18:44:01.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.470+0000 7fa966ffd640 1 -- 172.21.15.45:0/2523157448 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa96c0bd750 con 0x7fa970071dd0 2023-11-28T18:44:01.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.470+0000 7fa97873e640 1 -- 172.21.15.45:0/2523157448 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9701535f0 con 0x7fa970071dd0 2023-11-28T18:44:01.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.470+0000 7fa966ffd640 1 -- 172.21.15.45:0/2523157448 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa96c0bdb00 con 0x7fa970071dd0 2023-11-28T18:44:01.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.470+0000 7fa97873e640 1 -- 172.21.15.45:0/2523157448 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa970153bb0 con 0x7fa970071dd0 2023-11-28T18:44:01.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.470+0000 7fa97873e640 1 -- 172.21.15.45:0/2523157448 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa970069410 con 0x7fa970071dd0 2023-11-28T18:44:01.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.470+0000 7fa966ffd640 1 -- 172.21.15.45:0/2523157448 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa96c0b33f0 con 0x7fa970071dd0 2023-11-28T18:44:01.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.470+0000 7fa966ffd640 1 --2- 172.21.15.45:0/2523157448 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa9540668d0 0x7fa954068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:01.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.474+0000 7fa966ffd640 1 -- 172.21.15.45:0/2523157448 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa96c11f4b0 con 0x7fa970071dd0 2023-11-28T18:44:01.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.474+0000 7fa975cd9640 1 --2- 172.21.15.45:0/2523157448 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa9540668d0 0x7fa954068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:01.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.474+0000 7fa975cd9640 1 --2- 172.21.15.45:0/2523157448 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa9540668d0 0x7fa954068d90 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fa9700aead0 tx=0x7fa960008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:44:01.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.478+0000 7fa966ffd640 1 -- 172.21.15.45:0/2523157448 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa96c0ec700 con 0x7fa970071dd0 2023-11-28T18:44:01.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:01.666+0000 7fa97873e640 1 -- 172.21.15.45:0/2523157448 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fa97006e750 con 0x7fa970071dd0 2023-11-28T18:44:02.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.286+0000 7fa966ffd640 1 -- 172.21.15.45:0/2523157448 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v48) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa96c0efd20 con 0x7fa970071dd0 2023-11-28T18:44:02.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.290+0000 7fa97873e640 1 -- 172.21.15.45:0/2523157448 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa9540668d0 msgr2=0x7fa954068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:02.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.290+0000 7fa97873e640 1 --2- 172.21.15.45:0/2523157448 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa9540668d0 0x7fa954068d90 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fa9700aead0 tx=0x7fa960008040 comp rx=0 tx=0).stop 2023-11-28T18:44:02.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.290+0000 7fa97873e640 1 -- 172.21.15.45:0/2523157448 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa970071dd0 msgr2=0x7fa97013a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:02.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.290+0000 7fa97873e640 1 --2- 172.21.15.45:0/2523157448 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa970071dd0 0x7fa97013a520 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fa96c0ac040 tx=0x7fa96c01ad40 comp rx=0 tx=0).stop 2023-11-28T18:44:02.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.290+0000 7fa97873e640 1 -- 172.21.15.45:0/2523157448 shutdown_connections 2023-11-28T18:44:02.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.290+0000 7fa97873e640 1 --2- 172.21.15.45:0/2523157448 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa9540668d0 0x7fa954068d90 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:02.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.290+0000 7fa97873e640 1 --2- 172.21.15.45:0/2523157448 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa97015adf0 0x7fa970152520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:02.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.290+0000 7fa97873e640 1 --2- 172.21.15.45:0/2523157448 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa97013f630 0x7fa970151fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:02.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.290+0000 7fa97873e640 1 --2- 172.21.15.45:0/2523157448 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa970071dd0 0x7fa97013a520 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:02.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.290+0000 7fa97873e640 1 -- 172.21.15.45:0/2523157448 >> 172.21.15.45:0/2523157448 conn(0x7fa9700b0d00 msgr2=0x7fa97013c790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:44:02.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.290+0000 7fa97873e640 1 -- 172.21.15.45:0/2523157448 shutdown_connections 2023-11-28T18:44:02.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.290+0000 7fa97873e640 1 -- 172.21.15.45:0/2523157448 wait complete. 2023-11-28T18:44:02.314 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-28T18:44:02.314 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T18:44:02.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.462+0000 7f12e62ea640 1 Processor -- start 2023-11-28T18:44:02.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.462+0000 7f12e62ea640 1 -- start start 2023-11-28T18:44:02.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.462+0000 7f12e62ea640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f12e00b4b80 0x7f12e0143350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:02.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.462+0000 7f12e62ea640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12e015d800 con 0x7f12e00b47a0 2023-11-28T18:44:02.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.462+0000 7f12e62ea640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12e0140970 con 0x7f12e00d17f0 2023-11-28T18:44:02.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.462+0000 7f12e62ea640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12e0161e00 con 0x7f12e00b4b80 2023-11-28T18:44:02.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.462+0000 7f12dffff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f12e00b47a0 0x7f12e00d10e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47278/0 (socket says 172.21.15.45:47278) 2023-11-28T18:44:02.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.462+0000 7f12dffff640 1 -- 172.21.15.45:0/4043283181 learned_addr learned my addr 172.21.15.45:0/4043283181 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:44:02.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.462+0000 7f12e4887640 1 --2- 172.21.15.45:0/4043283181 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f12e00b4b80 0x7f12e0143350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:02.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.462+0000 7f12deffd640 1 -- 172.21.15.45:0/4043283181 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4061188258 0 0) 0x7f12e015d800 con 0x7f12e00b47a0 2023-11-28T18:44:02.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.462+0000 7f12deffd640 1 -- 172.21.15.45:0/4043283181 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12c8003530 con 0x7f12e00b47a0 2023-11-28T18:44:02.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.462+0000 7f12deffd640 1 -- 172.21.15.45:0/4043283181 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3217394002 0 0) 0x7f12c8003530 con 0x7f12e00b47a0 2023-11-28T18:44:02.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.462+0000 7f12deffd640 1 -- 172.21.15.45:0/4043283181 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f12e00b4b80 msgr2=0x7f12e0143350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:44:02.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.462+0000 7f12deffd640 1 --2- 172.21.15.45:0/4043283181 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f12e00b4b80 0x7f12e0143350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:02.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.462+0000 7f12deffd640 1 -- 172.21.15.45:0/4043283181 >> v1:172.21.15.190:6789/0 conn(0x7f12e00d17f0 legacy=0x7f12e0142c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:02.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.462+0000 7f12deffd640 1 -- 172.21.15.45:0/4043283181 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12e015da50 con 0x7f12e00b47a0 2023-11-28T18:44:02.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.462+0000 7f12deffd640 1 -- 172.21.15.45:0/4043283181 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4084481567 0 0) 0x7f12d0001680 con 0x7f12e00b47a0 2023-11-28T18:44:02.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.462+0000 7f12deffd640 1 -- 172.21.15.45:0/4043283181 >> v1:172.21.15.45:6789/0 conn(0x7f12e00b47a0 legacy=0x7f12e00d10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:02.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.462+0000 7f12deffd640 1 --2- 172.21.15.45:0/4043283181 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f12e00b4b80 0x7f12c80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:02.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.462+0000 7f12deffd640 1 --2- 172.21.15.45:0/4043283181 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12c8003f30 0x7f12c80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:02.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.462+0000 7f12deffd640 1 --2- 172.21.15.45:0/4043283181 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f12c8004d10 0x7f12c8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:02.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.462+0000 7f12deffd640 1 -- 172.21.15.45:0/4043283181 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12e0161e00 con 0x7f12c8003f30 2023-11-28T18:44:02.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.462+0000 7f12deffd640 1 -- 172.21.15.45:0/4043283181 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c800ba70 con 0x7f12c8004d10 2023-11-28T18:44:02.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.462+0000 7f12deffd640 1 -- 172.21.15.45:0/4043283181 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12c800bc30 con 0x7f12e00b4b80 2023-11-28T18:44:02.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.462+0000 7f12df7fe640 1 --2- 172.21.15.45:0/4043283181 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12c8003f30 0x7f12c80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:02.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.462+0000 7f12dffff640 1 --2- 172.21.15.45:0/4043283181 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f12e00b4b80 0x7f12c80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:02.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.462+0000 7f12e4887640 1 --2- 172.21.15.45:0/4043283181 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f12c8004d10 0x7f12c8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:02.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.462+0000 7f12df7fe640 1 -- 172.21.15.45:0/4043283181 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f12e00b4b80 msgr2=0x7f12c80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:44:02.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.462+0000 7f12df7fe640 1 --2- 172.21.15.45:0/4043283181 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f12e00b4b80 0x7f12c80039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:02.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.462+0000 7f12df7fe640 1 -- 172.21.15.45:0/4043283181 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f12c8004d10 msgr2=0x7f12c8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:44:02.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.462+0000 7f12df7fe640 1 --2- 172.21.15.45:0/4043283181 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f12c8004d10 0x7f12c8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:02.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.462+0000 7f12df7fe640 1 -- 172.21.15.45:0/4043283181 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12c8003530 con 0x7f12c8003f30 2023-11-28T18:44:02.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.466+0000 7f12df7fe640 1 --2- 172.21.15.45:0/4043283181 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12c8003f30 0x7f12c80047d0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f12d4001750 tx=0x7f12d401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7da8b21625e6c725 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:44:02.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.466+0000 7f12deffd640 1 -- 172.21.15.45:0/4043283181 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d40052d0 con 0x7f12c8003f30 2023-11-28T18:44:02.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.466+0000 7f12deffd640 1 -- 172.21.15.45:0/4043283181 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12d40a7050 con 0x7f12c8003f30 2023-11-28T18:44:02.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.466+0000 7f12deffd640 1 -- 172.21.15.45:0/4043283181 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d4003600 con 0x7f12c8003f30 2023-11-28T18:44:02.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.466+0000 7f12e62ea640 1 -- 172.21.15.45:0/4043283181 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12c8003f30 msgr2=0x7f12c80047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:02.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.466+0000 7f12e62ea640 1 --2- 172.21.15.45:0/4043283181 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12c8003f30 0x7f12c80047d0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f12d4001750 tx=0x7f12d401c3c0 comp rx=0 tx=0).stop 2023-11-28T18:44:02.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.466+0000 7f12e4887640 1 -- 172.21.15.45:0/4043283181 reap_dead start 2023-11-28T18:44:02.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.466+0000 7f12e62ea640 1 -- 172.21.15.45:0/4043283181 shutdown_connections 2023-11-28T18:44:02.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.466+0000 7f12e62ea640 1 -- 172.21.15.45:0/4043283181 >> 172.21.15.45:0/4043283181 conn(0x7f12e006a570 msgr2=0x7f12e006a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:44:02.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.466+0000 7f12e62ea640 1 -- 172.21.15.45:0/4043283181 shutdown_connections 2023-11-28T18:44:02.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.466+0000 7f12e62ea640 1 -- 172.21.15.45:0/4043283181 wait complete. 2023-11-28T18:44:02.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.470+0000 7f12e62ea640 1 Processor -- start 2023-11-28T18:44:02.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.470+0000 7f12e62ea640 1 -- start start 2023-11-28T18:44:02.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.470+0000 7f12e62ea640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12c8003f30 0x7f12e013d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:02.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.470+0000 7f12e62ea640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f12e00ca380 0x7f12e00cb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:02.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.470+0000 7f12e62ea640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f12e0159da0 0x7f12e015c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:02.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.470+0000 7f12e62ea640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12e00cb420 con 0x7f12c8003f30 2023-11-28T18:44:02.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.470+0000 7f12e62ea640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12e00ca810 con 0x7f12e00ca380 2023-11-28T18:44:02.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.470+0000 7f12e62ea640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12e00caaf0 con 0x7f12e0159da0 2023-11-28T18:44:02.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.470+0000 7f12dffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12c8003f30 0x7f12e013d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:02.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.470+0000 7f12dffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12c8003f30 0x7f12e013d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56226/0 (socket says 172.21.15.45:56226) 2023-11-28T18:44:02.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.470+0000 7f12dffff640 1 -- 172.21.15.45:0/1370094536 learned_addr learned my addr 172.21.15.45:0/1370094536 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:44:02.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.470+0000 7f12e4887640 1 --2- 172.21.15.45:0/1370094536 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f12e0159da0 0x7f12e015c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:02.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.470+0000 7f12df7fe640 1 --2- 172.21.15.45:0/1370094536 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f12e00ca380 0x7f12e00cb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:02.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.470+0000 7f12dffff640 1 -- 172.21.15.45:0/1370094536 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f12e0159da0 msgr2=0x7f12e015c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:02.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.470+0000 7f12dffff640 1 --2- 172.21.15.45:0/1370094536 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f12e0159da0 0x7f12e015c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:02.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.470+0000 7f12dffff640 1 -- 172.21.15.45:0/1370094536 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f12e00ca380 msgr2=0x7f12e00cb8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:02.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.470+0000 7f12dffff640 1 --2- 172.21.15.45:0/1370094536 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f12e00ca380 0x7f12e00cb8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:02.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.470+0000 7f12dffff640 1 -- 172.21.15.45:0/1370094536 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12e00cadd0 con 0x7f12c8003f30 2023-11-28T18:44:02.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.470+0000 7f12dffff640 1 --2- 172.21.15.45:0/1370094536 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12c8003f30 0x7f12e013d460 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f12d0004880 tx=0x7f12d0012900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:44:02.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.470+0000 7f12dcff9640 1 -- 172.21.15.45:0/1370094536 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d0014810 con 0x7f12c8003f30 2023-11-28T18:44:02.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.470+0000 7f12dcff9640 1 -- 172.21.15.45:0/1370094536 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12d0014970 con 0x7f12c8003f30 2023-11-28T18:44:02.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.470+0000 7f12dcff9640 1 -- 172.21.15.45:0/1370094536 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d0014d20 con 0x7f12c8003f30 2023-11-28T18:44:02.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.470+0000 7f12e62ea640 1 -- 172.21.15.45:0/1370094536 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12e00cb0b0 con 0x7f12c8003f30 2023-11-28T18:44:02.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.474+0000 7f12e62ea640 1 -- 172.21.15.45:0/1370094536 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12e00cbfc0 con 0x7f12c8003f30 2023-11-28T18:44:02.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.474+0000 7f12e62ea640 1 -- 172.21.15.45:0/1370094536 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12e01432d0 con 0x7f12c8003f30 2023-11-28T18:44:02.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.474+0000 7f12dcff9640 1 -- 172.21.15.45:0/1370094536 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f12d00153e0 con 0x7f12c8003f30 2023-11-28T18:44:02.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.474+0000 7f12dcff9640 1 --2- 172.21.15.45:0/1370094536 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f12cc066900 0x7f12cc068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:02.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.474+0000 7f12dcff9640 1 -- 172.21.15.45:0/1370094536 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f12d0086ae0 con 0x7f12c8003f30 2023-11-28T18:44:02.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.474+0000 7f12df7fe640 1 --2- 172.21.15.45:0/1370094536 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f12cc066900 0x7f12cc068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:02.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.478+0000 7f12df7fe640 1 --2- 172.21.15.45:0/1370094536 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f12cc066900 0x7f12cc068dc0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f12e00d0f80 tx=0x7f12d40011a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:44:02.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.478+0000 7f12dcff9640 1 -- 172.21.15.45:0/1370094536 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f12d0053db0 con 0x7f12c8003f30 2023-11-28T18:44:02.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.670+0000 7f12e62ea640 1 -- 172.21.15.45:0/1370094536 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f12e00cbfc0 con 0x7f12c8003f30 2023-11-28T18:44:02.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.670+0000 7f12dcff9640 1 -- 172.21.15.45:0/1370094536 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4919 (secure 0 0 0) 0x7f12e00cbfc0 con 0x7f12c8003f30 2023-11-28T18:44:02.670 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:44:02.670 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":48,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6002,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/1183598108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":1183598108},{"type":"v1","addr":"172.21.15.190:6836","nonce":1183598108}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6005,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/3723100406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":3723100406},{"type":"v1","addr":"172.21.15.190:6837","nonce":3723100406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6789,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/1994543507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1994543507},{"type":"v1","addr":"172.21.15.45:6833","nonce":1994543507}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T18:43:58.654090+0000","modified":"2023-11-28T18:44:01.668714+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6792},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6792":{"gid":6792,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/2107305848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2107305848},{"type":"v1","addr":"172.21.15.45:6835","nonce":2107305848}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-28T18:44:02.670 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 48 2023-11-28T18:44:02.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.670+0000 7f12e62ea640 1 -- 172.21.15.45:0/1370094536 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f12cc066900 msgr2=0x7f12cc068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:02.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.670+0000 7f12e62ea640 1 --2- 172.21.15.45:0/1370094536 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f12cc066900 0x7f12cc068dc0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f12e00d0f80 tx=0x7f12d40011a0 comp rx=0 tx=0).stop 2023-11-28T18:44:02.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.670+0000 7f12e62ea640 1 -- 172.21.15.45:0/1370094536 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12c8003f30 msgr2=0x7f12e013d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:02.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.670+0000 7f12e62ea640 1 --2- 172.21.15.45:0/1370094536 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12c8003f30 0x7f12e013d460 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f12d0004880 tx=0x7f12d0012900 comp rx=0 tx=0).stop 2023-11-28T18:44:02.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.670+0000 7f12e62ea640 1 -- 172.21.15.45:0/1370094536 shutdown_connections 2023-11-28T18:44:02.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.670+0000 7f12e62ea640 1 --2- 172.21.15.45:0/1370094536 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f12cc066900 0x7f12cc068dc0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:02.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.670+0000 7f12e62ea640 1 --2- 172.21.15.45:0/1370094536 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f12e0159da0 0x7f12e015c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:02.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.670+0000 7f12e62ea640 1 --2- 172.21.15.45:0/1370094536 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f12e00ca380 0x7f12e00cb8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:02.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.670+0000 7f12e62ea640 1 --2- 172.21.15.45:0/1370094536 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12c8003f30 0x7f12e013d460 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:02.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.670+0000 7f12e62ea640 1 -- 172.21.15.45:0/1370094536 >> 172.21.15.45:0/1370094536 conn(0x7f12e006a570 msgr2=0x7f12e0142b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:44:02.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.670+0000 7f12e62ea640 1 -- 172.21.15.45:0/1370094536 shutdown_connections 2023-11-28T18:44:02.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.670+0000 7f12e62ea640 1 -- 172.21.15.45:0/1370094536 wait complete. 2023-11-28T18:44:02.691 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T18:44:02.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.834+0000 7efd7d654640 1 Processor -- start 2023-11-28T18:44:02.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.834+0000 7efd7d654640 1 -- start start 2023-11-28T18:44:02.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.834+0000 7efd7d654640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7efd78072010 0x7efd780af1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:02.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.834+0000 7efd7d654640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7efd780af720 0x7efd780b3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:02.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.834+0000 7efd7d654640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd780afb60 con 0x7efd7815d3f0 2023-11-28T18:44:02.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.834+0000 7efd7d654640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd780aeb70 con 0x7efd780af720 2023-11-28T18:44:02.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.834+0000 7efd7d654640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd780addf0 con 0x7efd78072010 2023-11-28T18:44:02.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.834+0000 7efd76ffd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7efd7815d3f0 0x7efd780ad6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47282/0 (socket says 172.21.15.45:47282) 2023-11-28T18:44:02.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.834+0000 7efd76ffd640 1 -- 172.21.15.45:0/1194390680 learned_addr learned my addr 172.21.15.45:0/1194390680 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:44:02.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.834+0000 7efd777fe640 1 --2- 172.21.15.45:0/1194390680 >> v2:172.21.15.45:3300/0 conn(0x7efd780af720 0x7efd780b3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:02.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.838+0000 7efd6ffff640 1 --2- 172.21.15.45:0/1194390680 >> v2:172.21.15.190:3300/0 conn(0x7efd78072010 0x7efd780af1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:02.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.838+0000 7efd767fc640 1 -- 172.21.15.45:0/1194390680 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3247508546 0 0) 0x7efd780afb60 con 0x7efd7815d3f0 2023-11-28T18:44:02.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.838+0000 7efd767fc640 1 -- 172.21.15.45:0/1194390680 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd64003530 con 0x7efd7815d3f0 2023-11-28T18:44:02.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.838+0000 7efd777fe640 1 -- 172.21.15.45:0/1194390680 >> v2:172.21.15.190:3300/0 conn(0x7efd78072010 msgr2=0x7efd780af1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:44:02.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.838+0000 7efd777fe640 1 --2- 172.21.15.45:0/1194390680 >> v2:172.21.15.190:3300/0 conn(0x7efd78072010 0x7efd780af1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:02.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.838+0000 7efd777fe640 1 -- 172.21.15.45:0/1194390680 >> v1:172.21.15.45:6789/0 conn(0x7efd7815d3f0 legacy=0x7efd780ad6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:02.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.838+0000 7efd777fe640 1 -- 172.21.15.45:0/1194390680 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd780adff0 con 0x7efd780af720 2023-11-28T18:44:02.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.838+0000 7efd777fe640 1 --2- 172.21.15.45:0/1194390680 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd780af720 0x7efd780b3500 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7efd78072dd0 tx=0x7efd7001f0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d893a6fe293ecfa server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:44:02.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.838+0000 7efd767fc640 1 -- 172.21.15.45:0/1194390680 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd700b0440 con 0x7efd780af720 2023-11-28T18:44:02.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.838+0000 7efd767fc640 1 -- 172.21.15.45:0/1194390680 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd700b05a0 con 0x7efd780af720 2023-11-28T18:44:02.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.838+0000 7efd767fc640 1 -- 172.21.15.45:0/1194390680 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd700b0910 con 0x7efd780af720 2023-11-28T18:44:02.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.842+0000 7efd7d654640 1 -- 172.21.15.45:0/1194390680 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd780af720 msgr2=0x7efd780b3500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:02.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.842+0000 7efd7d654640 1 --2- 172.21.15.45:0/1194390680 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd780af720 0x7efd780b3500 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7efd78072dd0 tx=0x7efd7001f0f0 comp rx=0 tx=0).stop 2023-11-28T18:44:02.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.842+0000 7efd7d654640 1 -- 172.21.15.45:0/1194390680 shutdown_connections 2023-11-28T18:44:02.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.842+0000 7efd7d654640 1 --2- 172.21.15.45:0/1194390680 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd780af720 0x7efd780b3500 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:02.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.842+0000 7efd7d654640 1 --2- 172.21.15.45:0/1194390680 >> v2:172.21.15.190:3300/0 conn(0x7efd78072010 0x7efd780af1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:02.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.842+0000 7efd7d654640 1 -- 172.21.15.45:0/1194390680 >> 172.21.15.45:0/1194390680 conn(0x7efd7806b680 msgr2=0x7efd7806ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:44:02.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.842+0000 7efd7d654640 1 -- 172.21.15.45:0/1194390680 shutdown_connections 2023-11-28T18:44:02.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.842+0000 7efd7d654640 1 -- 172.21.15.45:0/1194390680 wait complete. 2023-11-28T18:44:02.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.842+0000 7efd7d654640 1 Processor -- start 2023-11-28T18:44:02.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.842+0000 7efd7d654640 1 -- start start 2023-11-28T18:44:02.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.842+0000 7efd7d654640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd78072010 0x7efd7815da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:02.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.842+0000 7efd7d654640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efd780af720 0x7efd780b2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:02.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.842+0000 7efd7d654640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efd7815d3f0 0x7efd7814cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:02.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.842+0000 7efd7d654640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd7814dbd0 con 0x7efd78072010 2023-11-28T18:44:02.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.842+0000 7efd7d654640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd780b2bd0 con 0x7efd7815d3f0 2023-11-28T18:44:02.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.842+0000 7efd7d654640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd78160170 con 0x7efd780af720 2023-11-28T18:44:02.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.842+0000 7efd76ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd78072010 0x7efd7815da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:02.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.842+0000 7efd76ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd78072010 0x7efd7815da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56238/0 (socket says 172.21.15.45:56238) 2023-11-28T18:44:02.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.842+0000 7efd76ffd640 1 -- 172.21.15.45:0/1739715640 learned_addr learned my addr 172.21.15.45:0/1739715640 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:44:02.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.842+0000 7efd6ffff640 1 --2- 172.21.15.45:0/1739715640 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efd780af720 0x7efd780b2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:02.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.842+0000 7efd777fe640 1 --2- 172.21.15.45:0/1739715640 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efd7815d3f0 0x7efd7814cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:02.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.842+0000 7efd76ffd640 1 -- 172.21.15.45:0/1739715640 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efd780af720 msgr2=0x7efd780b2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:02.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.842+0000 7efd76ffd640 1 --2- 172.21.15.45:0/1739715640 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efd780af720 0x7efd780b2690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:02.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.842+0000 7efd76ffd640 1 -- 172.21.15.45:0/1739715640 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efd7815d3f0 msgr2=0x7efd7814cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:02.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.842+0000 7efd76ffd640 1 --2- 172.21.15.45:0/1739715640 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efd7815d3f0 0x7efd7814cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:02.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.842+0000 7efd76ffd640 1 -- 172.21.15.45:0/1739715640 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd70009a70 con 0x7efd78072010 2023-11-28T18:44:02.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.842+0000 7efd6ffff640 1 --2- 172.21.15.45:0/1739715640 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efd780af720 0x7efd780b2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:44:02.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.842+0000 7efd777fe640 1 --2- 172.21.15.45:0/1739715640 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efd7815d3f0 0x7efd7814cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:44:02.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.846+0000 7efd76ffd640 1 --2- 172.21.15.45:0/1739715640 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd78072010 0x7efd7815da70 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7efd6800c480 tx=0x7efd6800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:44:02.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.846+0000 7efd6f7fe640 1 -- 172.21.15.45:0/1739715640 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd68005cf0 con 0x7efd78072010 2023-11-28T18:44:02.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.846+0000 7efd6f7fe640 1 -- 172.21.15.45:0/1739715640 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd68005e50 con 0x7efd78072010 2023-11-28T18:44:02.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.846+0000 7efd6f7fe640 1 -- 172.21.15.45:0/1739715640 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd68007290 con 0x7efd78072010 2023-11-28T18:44:02.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.846+0000 7efd7d654640 1 -- 172.21.15.45:0/1739715640 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd78160450 con 0x7efd78072010 2023-11-28T18:44:02.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.846+0000 7efd7d654640 1 -- 172.21.15.45:0/1739715640 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd78160a10 con 0x7efd78072010 2023-11-28T18:44:02.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.846+0000 7efd7d654640 1 -- 172.21.15.45:0/1739715640 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd780afcf0 con 0x7efd78072010 2023-11-28T18:44:02.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.846+0000 7efd6f7fe640 1 -- 172.21.15.45:0/1739715640 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7efd680073f0 con 0x7efd78072010 2023-11-28T18:44:02.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.846+0000 7efd6f7fe640 1 --2- 172.21.15.45:0/1739715640 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7efd580668d0 0x7efd58068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:02.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.846+0000 7efd6f7fe640 1 -- 172.21.15.45:0/1739715640 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efd68083a30 con 0x7efd78072010 2023-11-28T18:44:02.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.846+0000 7efd6ffff640 1 --2- 172.21.15.45:0/1739715640 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7efd580668d0 0x7efd58068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:02.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.850+0000 7efd6ffff640 1 --2- 172.21.15.45:0/1739715640 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7efd580668d0 0x7efd58068d90 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7efd7806afe0 tx=0x7efd60008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:44:02.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:02.850+0000 7efd6f7fe640 1 -- 172.21.15.45:0/1739715640 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efd780afcf0 con 0x7efd78072010 2023-11-28T18:44:03.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.010+0000 7efd7d654640 1 -- 172.21.15.45:0/1739715640 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efd780afcf0 con 0x7efd78072010 2023-11-28T18:44:03.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.010+0000 7efd6f7fe640 1 -- 172.21.15.45:0/1739715640 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+16529 (secure 0 0 0) 0x7efd780afcf0 con 0x7efd78072010 2023-11-28T18:44:03.013 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:44:03.013 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":60,"fsid":"d10f5cd6-1d00-4019-99b6-6fa435498a15","created":"2023-11-28T18:37:08.189030+0000","modified":"2023-11-28T18:44:00.269525+0000","last_up_change":"2023-11-28T18:37:20.196124+0000","last_in_change":"2023-11-28T18:37:10.742043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T18:37:21.293917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-28T18:43:57.069740+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-28T18:43:57.647964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"84465384-103c-4f2c-a45a-96f5bb9c835f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6809","nonce":555237322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6811","nonce":555237322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6815","nonce":555237322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6813","nonce":555237322}]},"public_addr":"172.21.15.45:6809/555237322","cluster_addr":"172.21.15.45:6811/555237322","heartbeat_back_addr":"172.21.15.45:6815/555237322","heartbeat_front_addr":"172.21.15.45:6813/555237322","state":["exists","up"]},{"osd":1,"uuid":"7d9eed24-a58f-42c7-a787-ac06be8553fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6801","nonce":2857063763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6803","nonce":2857063763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6807","nonce":2857063763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6805","nonce":2857063763}]},"public_addr":"172.21.15.45:6801/2857063763","cluster_addr":"172.21.15.45:6803/2857063763","heartbeat_back_addr":"172.21.15.45:6807/2857063763","heartbeat_front_addr":"172.21.15.45:6805/2857063763","state":["exists","up"]},{"osd":2,"uuid":"575eeccc-4abf-45b4-9caf-f3e797859588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6817","nonce":193884539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6819","nonce":193884539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6823","nonce":193884539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6821","nonce":193884539}]},"public_addr":"172.21.15.45:6817/193884539","cluster_addr":"172.21.15.45:6819/193884539","heartbeat_back_addr":"172.21.15.45:6823/193884539","heartbeat_front_addr":"172.21.15.45:6821/193884539","state":["exists","up"]},{"osd":3,"uuid":"9b0290d6-9a52-4bc8-b2a1-7622c5dc8e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6825","nonce":78541084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6827","nonce":78541084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6831","nonce":78541084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6829","nonce":78541084}]},"public_addr":"172.21.15.45:6825/78541084","cluster_addr":"172.21.15.45:6827/78541084","heartbeat_back_addr":"172.21.15.45:6831/78541084","heartbeat_front_addr":"172.21.15.45:6829/78541084","state":["exists","up"]},{"osd":4,"uuid":"ce632829-f027-4fbf-a627-02c571aa9d53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6809","nonce":1537591987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6811","nonce":1537591987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6815","nonce":1537591987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6813","nonce":1537591987}]},"public_addr":"172.21.15.190:6809/1537591987","cluster_addr":"172.21.15.190:6811/1537591987","heartbeat_back_addr":"172.21.15.190:6815/1537591987","heartbeat_front_addr":"172.21.15.190:6813/1537591987","state":["exists","up"]},{"osd":5,"uuid":"8700b609-27be-40bd-a251-4c0ae0a29ead","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6801","nonce":3296698407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6803","nonce":3296698407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6807","nonce":3296698407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6805","nonce":3296698407}]},"public_addr":"172.21.15.190:6801/3296698407","cluster_addr":"172.21.15.190:6803/3296698407","heartbeat_back_addr":"172.21.15.190:6807/3296698407","heartbeat_front_addr":"172.21.15.190:6805/3296698407","state":["exists","up"]},{"osd":6,"uuid":"44ce4a40-e6ff-4f4d-8e8a-7341e5c91f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6817","nonce":2317686718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6819","nonce":2317686718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6823","nonce":2317686718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6821","nonce":2317686718}]},"public_addr":"172.21.15.190:6817/2317686718","cluster_addr":"172.21.15.190:6819/2317686718","heartbeat_back_addr":"172.21.15.190:6823/2317686718","heartbeat_front_addr":"172.21.15.190:6821/2317686718","state":["exists","up"]},{"osd":7,"uuid":"192238c9-1423-4b7e-ac8f-84ba32113ddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6825","nonce":2493232051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6827","nonce":2493232051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6831","nonce":2493232051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6829","nonce":2493232051}]},"public_addr":"172.21.15.190:6825/2493232051","cluster_addr":"172.21.15.190:6827/2493232051","heartbeat_back_addr":"172.21.15.190:6831/2493232051","heartbeat_front_addr":"172.21.15.190:6829/2493232051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.393552+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.385453+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.361421+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.366408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.363226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.276007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.414605+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.445885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T18:44:03.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.014+0000 7efd7d654640 1 -- 172.21.15.45:0/1739715640 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7efd580668d0 msgr2=0x7efd58068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:03.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.014+0000 7efd7d654640 1 --2- 172.21.15.45:0/1739715640 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7efd580668d0 0x7efd58068d90 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7efd7806afe0 tx=0x7efd60008040 comp rx=0 tx=0).stop 2023-11-28T18:44:03.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.014+0000 7efd7d654640 1 -- 172.21.15.45:0/1739715640 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd78072010 msgr2=0x7efd7815da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:03.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.014+0000 7efd7d654640 1 --2- 172.21.15.45:0/1739715640 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd78072010 0x7efd7815da70 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7efd6800c480 tx=0x7efd6800c940 comp rx=0 tx=0).stop 2023-11-28T18:44:03.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.014+0000 7efd7d654640 1 -- 172.21.15.45:0/1739715640 shutdown_connections 2023-11-28T18:44:03.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.014+0000 7efd7d654640 1 --2- 172.21.15.45:0/1739715640 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7efd580668d0 0x7efd58068d90 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:03.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.014+0000 7efd7d654640 1 --2- 172.21.15.45:0/1739715640 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efd7815d3f0 0x7efd7814cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:03.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.014+0000 7efd7d654640 1 --2- 172.21.15.45:0/1739715640 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efd780af720 0x7efd780b2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:03.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.014+0000 7efd7d654640 1 --2- 172.21.15.45:0/1739715640 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd78072010 0x7efd7815da70 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:03.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.014+0000 7efd7d654640 1 -- 172.21.15.45:0/1739715640 >> 172.21.15.45:0/1739715640 conn(0x7efd7806b680 msgr2=0x7efd7806ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:44:03.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.014+0000 7efd7d654640 1 -- 172.21.15.45:0/1739715640 shutdown_connections 2023-11-28T18:44:03.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.014+0000 7efd7d654640 1 -- 172.21.15.45:0/1739715640 wait complete. 2023-11-28T18:44:03.034 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-28T18:44:03.034 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T18:44:03.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.178+0000 7fa36a5b8640 1 Processor -- start 2023-11-28T18:44:03.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.178+0000 7fa36a5b8640 1 -- start start 2023-11-28T18:44:03.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.178+0000 7fa36a5b8640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa36415d3f0 0x7fa3640ad6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:03.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.178+0000 7fa36a5b8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa364072010 0x7fa3640af1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:03.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.178+0000 7fa36a5b8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa3640af720 0x7fa36406d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:03.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.178+0000 7fa36a5b8640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3640aeb70 con 0x7fa364072010 2023-11-28T18:44:03.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.178+0000 7fa36a5b8640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3640afbb0 con 0x7fa36415d3f0 2023-11-28T18:44:03.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.178+0000 7fa36a5b8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3640adff0 con 0x7fa3640af720 2023-11-28T18:44:03.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.182+0000 7fa3637fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa364072010 0x7fa3640af1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:03.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.182+0000 7fa3637fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa364072010 0x7fa3640af1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56242/0 (socket says 172.21.15.45:56242) 2023-11-28T18:44:03.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.182+0000 7fa3637fe640 1 -- 172.21.15.45:0/4252289617 learned_addr learned my addr 172.21.15.45:0/4252289617 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:44:03.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.182+0000 7fa363fff640 1 --2- 172.21.15.45:0/4252289617 >> v2:172.21.15.190:3300/0 conn(0x7fa36415d3f0 0x7fa3640ad6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:03.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.182+0000 7fa368b55640 1 --2- 172.21.15.45:0/4252289617 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa3640af720 0x7fa36406d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:03.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.182+0000 7fa3637fe640 1 -- 172.21.15.45:0/4252289617 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa3640af720 msgr2=0x7fa36406d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:44:03.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.182+0000 7fa3637fe640 1 --2- 172.21.15.45:0/4252289617 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa3640af720 0x7fa36406d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:03.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.182+0000 7fa3637fe640 1 -- 172.21.15.45:0/4252289617 >> v2:172.21.15.190:3300/0 conn(0x7fa36415d3f0 msgr2=0x7fa3640ad6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:44:03.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.182+0000 7fa3637fe640 1 --2- 172.21.15.45:0/4252289617 >> v2:172.21.15.190:3300/0 conn(0x7fa36415d3f0 0x7fa3640ad6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:03.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.182+0000 7fa3637fe640 1 -- 172.21.15.45:0/4252289617 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3640ae2d0 con 0x7fa364072010 2023-11-28T18:44:03.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.182+0000 7fa368b55640 1 --2- 172.21.15.45:0/4252289617 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa3640af720 0x7fa36406d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:44:03.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.182+0000 7fa3637fe640 1 --2- 172.21.15.45:0/4252289617 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa364072010 0x7fa3640af1e0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fa36406b150 tx=0x7fa35801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97a9fb66d2cac7e3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:44:03.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.182+0000 7fa362ffd640 1 -- 172.21.15.45:0/4252289617 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3580a89b0 con 0x7fa364072010 2023-11-28T18:44:03.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.182+0000 7fa362ffd640 1 -- 172.21.15.45:0/4252289617 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3580a8b10 con 0x7fa364072010 2023-11-28T18:44:03.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.182+0000 7fa362ffd640 1 -- 172.21.15.45:0/4252289617 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3580a8ea0 con 0x7fa364072010 2023-11-28T18:44:03.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.186+0000 7fa36a5b8640 1 -- 172.21.15.45:0/4252289617 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa364072010 msgr2=0x7fa3640af1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:03.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.186+0000 7fa36a5b8640 1 --2- 172.21.15.45:0/4252289617 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa364072010 0x7fa3640af1e0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fa36406b150 tx=0x7fa35801ecf0 comp rx=0 tx=0).stop 2023-11-28T18:44:03.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.186+0000 7fa36a5b8640 1 -- 172.21.15.45:0/4252289617 shutdown_connections 2023-11-28T18:44:03.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.186+0000 7fa36a5b8640 1 --2- 172.21.15.45:0/4252289617 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa3640af720 0x7fa36406d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:03.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.186+0000 7fa36a5b8640 1 --2- 172.21.15.45:0/4252289617 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa364072010 0x7fa3640af1e0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:03.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.186+0000 7fa36a5b8640 1 --2- 172.21.15.45:0/4252289617 >> v2:172.21.15.190:3300/0 conn(0x7fa36415d3f0 0x7fa3640ad6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:03.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.186+0000 7fa36a5b8640 1 -- 172.21.15.45:0/4252289617 >> 172.21.15.45:0/4252289617 conn(0x7fa36406b680 msgr2=0x7fa36406ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:44:03.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.186+0000 7fa36a5b8640 1 -- 172.21.15.45:0/4252289617 shutdown_connections 2023-11-28T18:44:03.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.186+0000 7fa36a5b8640 1 -- 172.21.15.45:0/4252289617 wait complete. 2023-11-28T18:44:03.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.186+0000 7fa36a5b8640 1 Processor -- start 2023-11-28T18:44:03.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.186+0000 7fa36a5b8640 1 -- start start 2023-11-28T18:44:03.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.186+0000 7fa36a5b8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa364072010 0x7fa364148870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:03.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.186+0000 7fa36a5b8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa3640af720 0x7fa36415e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:03.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.186+0000 7fa36a5b8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa36415d3f0 0x7fa36415e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:03.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.186+0000 7fa36a5b8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3641f27f0 con 0x7fa36415d3f0 2023-11-28T18:44:03.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.186+0000 7fa36a5b8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa36415ef20 con 0x7fa364072010 2023-11-28T18:44:03.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.186+0000 7fa36a5b8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa36415f200 con 0x7fa3640af720 2023-11-28T18:44:03.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.186+0000 7fa368b55640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa36415d3f0 0x7fa36415e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:03.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.186+0000 7fa363fff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa364072010 0x7fa364148870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:03.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.186+0000 7fa363fff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa364072010 0x7fa364148870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.45:46484/0 (socket says 172.21.15.45:46484) 2023-11-28T18:44:03.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.186+0000 7fa363fff640 1 -- 172.21.15.45:0/1174927866 learned_addr learned my addr 172.21.15.45:0/1174927866 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:44:03.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.186+0000 7fa3637fe640 1 --2- 172.21.15.45:0/1174927866 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa3640af720 0x7fa36415e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:03.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.186+0000 7fa368b55640 1 -- 172.21.15.45:0/1174927866 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa3640af720 msgr2=0x7fa36415e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:03.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.186+0000 7fa368b55640 1 --2- 172.21.15.45:0/1174927866 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa3640af720 0x7fa36415e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:03.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.190+0000 7fa368b55640 1 -- 172.21.15.45:0/1174927866 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa364072010 msgr2=0x7fa364148870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:03.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.190+0000 7fa368b55640 1 --2- 172.21.15.45:0/1174927866 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa364072010 0x7fa364148870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:03.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.190+0000 7fa368b55640 1 -- 172.21.15.45:0/1174927866 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3580094d0 con 0x7fa36415d3f0 2023-11-28T18:44:03.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.190+0000 7fa368b55640 1 --2- 172.21.15.45:0/1174927866 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa36415d3f0 0x7fa36415e6a0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fa35c007fd0 tx=0x7fa35c00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:44:03.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.190+0000 7fa360ff9640 1 -- 172.21.15.45:0/1174927866 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35c00d840 con 0x7fa36415d3f0 2023-11-28T18:44:03.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.190+0000 7fa360ff9640 1 -- 172.21.15.45:0/1174927866 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa35c00d9a0 con 0x7fa36415d3f0 2023-11-28T18:44:03.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.190+0000 7fa360ff9640 1 -- 172.21.15.45:0/1174927866 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35c00dd50 con 0x7fa36415d3f0 2023-11-28T18:44:03.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.190+0000 7fa36a5b8640 1 -- 172.21.15.45:0/1174927866 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa36415f4e0 con 0x7fa36415d3f0 2023-11-28T18:44:03.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.190+0000 7fa36a5b8640 1 -- 172.21.15.45:0/1174927866 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa36415faa0 con 0x7fa36415d3f0 2023-11-28T18:44:03.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.190+0000 7fa36a5b8640 1 -- 172.21.15.45:0/1174927866 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa36415fc90 con 0x7fa36415d3f0 2023-11-28T18:44:03.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.190+0000 7fa360ff9640 1 -- 172.21.15.45:0/1174927866 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa35c01e3b0 con 0x7fa36415d3f0 2023-11-28T18:44:03.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.190+0000 7fa360ff9640 1 --2- 172.21.15.45:0/1174927866 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa3500668d0 0x7fa350068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:03.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.190+0000 7fa360ff9640 1 -- 172.21.15.45:0/1174927866 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa35c084d30 con 0x7fa36415d3f0 2023-11-28T18:44:03.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.194+0000 7fa363fff640 1 --2- 172.21.15.45:0/1174927866 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa3500668d0 0x7fa350068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:03.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.194+0000 7fa363fff640 1 --2- 172.21.15.45:0/1174927866 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa3500668d0 0x7fa350068d90 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fa354007a70 tx=0x7fa354008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:44:03.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.194+0000 7fa360ff9640 1 -- 172.21.15.45:0/1174927866 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa35c052020 con 0x7fa36415d3f0 2023-11-28T18:44:03.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.350+0000 7fa36a5b8640 1 -- 172.21.15.45:0/1174927866 --> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa36415d7d0 con 0x7fa3500668d0 2023-11-28T18:44:03.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.358+0000 7fa360ff9640 1 -- 172.21.15.45:0/1174927866 <== mgr.4100 v2:172.21.15.190:6832/645101166 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288973 (secure 0 0 0) 0x7fa354010990 con 0x7fa3500668d0 2023-11-28T18:44:03.362 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:44:03.364 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-11-28T18:44:03.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.362+0000 7fa36a5b8640 1 -- 172.21.15.45:0/1174927866 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa3500668d0 msgr2=0x7fa350068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:03.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.362+0000 7fa36a5b8640 1 --2- 172.21.15.45:0/1174927866 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa3500668d0 0x7fa350068d90 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fa354007a70 tx=0x7fa354008040 comp rx=0 tx=0).stop 2023-11-28T18:44:03.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.362+0000 7fa36a5b8640 1 -- 172.21.15.45:0/1174927866 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa36415d3f0 msgr2=0x7fa36415e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:03.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.362+0000 7fa36a5b8640 1 --2- 172.21.15.45:0/1174927866 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa36415d3f0 0x7fa36415e6a0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fa35c007fd0 tx=0x7fa35c00a710 comp rx=0 tx=0).stop 2023-11-28T18:44:03.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.362+0000 7fa36a5b8640 1 -- 172.21.15.45:0/1174927866 shutdown_connections 2023-11-28T18:44:03.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.362+0000 7fa36a5b8640 1 --2- 172.21.15.45:0/1174927866 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa3500668d0 0x7fa350068d90 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:03.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.362+0000 7fa36a5b8640 1 --2- 172.21.15.45:0/1174927866 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa36415d3f0 0x7fa36415e6a0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:03.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.362+0000 7fa36a5b8640 1 --2- 172.21.15.45:0/1174927866 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa3640af720 0x7fa36415e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:03.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.362+0000 7fa36a5b8640 1 --2- 172.21.15.45:0/1174927866 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa364072010 0x7fa364148870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:03.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.362+0000 7fa36a5b8640 1 -- 172.21.15.45:0/1174927866 >> 172.21.15.45:0/1174927866 conn(0x7fa36406b680 msgr2=0x7fa364155580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:44:03.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.362+0000 7fa36a5b8640 1 -- 172.21.15.45:0/1174927866 shutdown_connections 2023-11-28T18:44:03.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.362+0000 7fa36a5b8640 1 -- 172.21.15.45:0/1174927866 wait complete. 2023-11-28T18:44:03.383 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":255,"stamp":"2023-11-28T18:44:03.330674+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":141,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":256212,"kb_used_data":6760,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754718508,"statfs":{"total":773094113280,"available":772831752192,"internally_reserved":0,"allocated":6922240,"data_stored":3562092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001602"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.295736+0000","last_change":"2023-11-28T18:43:59.286942+0000","last_active":"2023-11-28T18:43:59.295736+0000","last_peered":"2023-11-28T18:43:59.295736+0000","last_clean":"2023-11-28T18:43:59.295736+0000","last_became_active":"2023-11-28T18:43:59.286674+0000","last_became_peered":"2023-11-28T18:43:59.286674+0000","last_unstale":"2023-11-28T18:43:59.295736+0000","last_undegraded":"2023-11-28T18:43:59.295736+0000","last_fullsized":"2023-11-28T18:43:59.295736+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:08:51.579521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.277760+0000","last_change":"2023-11-28T18:43:59.303931+0000","last_active":"2023-11-28T18:44:00.277760+0000","last_peered":"2023-11-28T18:44:00.277760+0000","last_clean":"2023-11-28T18:44:00.277760+0000","last_became_active":"2023-11-28T18:43:59.303644+0000","last_became_peered":"2023-11-28T18:43:59.303644+0000","last_unstale":"2023-11-28T18:44:00.277760+0000","last_undegraded":"2023-11-28T18:44:00.277760+0000","last_fullsized":"2023-11-28T18:44:00.277760+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:10:07.258819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.299878+0000","last_change":"2023-11-28T18:43:59.295908+0000","last_active":"2023-11-28T18:43:59.299878+0000","last_peered":"2023-11-28T18:43:59.299878+0000","last_clean":"2023-11-28T18:43:59.299878+0000","last_became_active":"2023-11-28T18:43:59.295625+0000","last_became_peered":"2023-11-28T18:43:59.295625+0000","last_unstale":"2023-11-28T18:43:59.299878+0000","last_undegraded":"2023-11-28T18:43:59.299878+0000","last_fullsized":"2023-11-28T18:43:59.299878+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:30:46.046412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.281350+0000","last_change":"2023-11-28T18:43:59.286232+0000","last_active":"2023-11-28T18:44:00.281350+0000","last_peered":"2023-11-28T18:44:00.281350+0000","last_clean":"2023-11-28T18:44:00.281350+0000","last_became_active":"2023-11-28T18:43:59.285674+0000","last_became_peered":"2023-11-28T18:43:59.285674+0000","last_unstale":"2023-11-28T18:44:00.281350+0000","last_undegraded":"2023-11-28T18:44:00.281350+0000","last_fullsized":"2023-11-28T18:44:00.281350+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:51:42.154474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.293750+0000","last_change":"2023-11-28T18:43:59.283079+0000","last_active":"2023-11-28T18:43:59.293750+0000","last_peered":"2023-11-28T18:43:59.293750+0000","last_clean":"2023-11-28T18:43:59.293750+0000","last_became_active":"2023-11-28T18:43:59.282807+0000","last_became_peered":"2023-11-28T18:43:59.282807+0000","last_unstale":"2023-11-28T18:43:59.293750+0000","last_undegraded":"2023-11-28T18:43:59.293750+0000","last_fullsized":"2023-11-28T18:43:59.293750+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:33:17.779178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.299629+0000","last_change":"2023-11-28T18:43:59.294848+0000","last_active":"2023-11-28T18:43:59.299629+0000","last_peered":"2023-11-28T18:43:59.299629+0000","last_clean":"2023-11-28T18:43:59.299629+0000","last_became_active":"2023-11-28T18:43:59.294585+0000","last_became_peered":"2023-11-28T18:43:59.294585+0000","last_unstale":"2023-11-28T18:43:59.299629+0000","last_undegraded":"2023-11-28T18:43:59.299629+0000","last_fullsized":"2023-11-28T18:43:59.299629+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:17:06.124969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.280246+0000","last_change":"2023-11-28T18:43:59.273918+0000","last_active":"2023-11-28T18:44:00.280246+0000","last_peered":"2023-11-28T18:44:00.280246+0000","last_clean":"2023-11-28T18:44:00.280246+0000","last_became_active":"2023-11-28T18:43:59.273619+0000","last_became_peered":"2023-11-28T18:43:59.273619+0000","last_unstale":"2023-11-28T18:44:00.280246+0000","last_undegraded":"2023-11-28T18:44:00.280246+0000","last_fullsized":"2023-11-28T18:44:00.280246+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:23:02.291448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.277256+0000","last_change":"2023-11-28T18:43:59.289656+0000","last_active":"2023-11-28T18:44:00.277256+0000","last_peered":"2023-11-28T18:44:00.277256+0000","last_clean":"2023-11-28T18:44:00.277256+0000","last_became_active":"2023-11-28T18:43:59.289391+0000","last_became_peered":"2023-11-28T18:43:59.289391+0000","last_unstale":"2023-11-28T18:44:00.277256+0000","last_undegraded":"2023-11-28T18:44:00.277256+0000","last_fullsized":"2023-11-28T18:44:00.277256+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:15:28.453340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.280664+0000","last_change":"2023-11-28T18:43:59.285680+0000","last_active":"2023-11-28T18:44:00.280664+0000","last_peered":"2023-11-28T18:44:00.280664+0000","last_clean":"2023-11-28T18:44:00.280664+0000","last_became_active":"2023-11-28T18:43:59.285364+0000","last_became_peered":"2023-11-28T18:43:59.285364+0000","last_unstale":"2023-11-28T18:44:00.280664+0000","last_undegraded":"2023-11-28T18:44:00.280664+0000","last_fullsized":"2023-11-28T18:44:00.280664+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:48:59.882919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.292632+0000","last_change":"2023-11-28T18:43:59.285728+0000","last_active":"2023-11-28T18:43:59.292632+0000","last_peered":"2023-11-28T18:43:59.292632+0000","last_clean":"2023-11-28T18:43:59.292632+0000","last_became_active":"2023-11-28T18:43:59.285454+0000","last_became_peered":"2023-11-28T18:43:59.285454+0000","last_unstale":"2023-11-28T18:43:59.292632+0000","last_undegraded":"2023-11-28T18:43:59.292632+0000","last_fullsized":"2023-11-28T18:43:59.292632+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:48:38.128338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.295578+0000","last_change":"2023-11-28T18:43:59.292100+0000","last_active":"2023-11-28T18:43:59.295578+0000","last_peered":"2023-11-28T18:43:59.295578+0000","last_clean":"2023-11-28T18:43:59.295578+0000","last_became_active":"2023-11-28T18:43:59.291821+0000","last_became_peered":"2023-11-28T18:43:59.291821+0000","last_unstale":"2023-11-28T18:43:59.295578+0000","last_undegraded":"2023-11-28T18:43:59.295578+0000","last_fullsized":"2023-11-28T18:43:59.295578+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:44:07.880942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.281344+0000","last_change":"2023-11-28T18:43:59.287912+0000","last_active":"2023-11-28T18:44:00.281344+0000","last_peered":"2023-11-28T18:44:00.281344+0000","last_clean":"2023-11-28T18:44:00.281344+0000","last_became_active":"2023-11-28T18:43:59.287611+0000","last_became_peered":"2023-11-28T18:43:59.287611+0000","last_unstale":"2023-11-28T18:44:00.281344+0000","last_undegraded":"2023-11-28T18:44:00.281344+0000","last_fullsized":"2023-11-28T18:44:00.281344+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:48:38.871672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.293034+0000","last_change":"2023-11-28T18:43:59.282916+0000","last_active":"2023-11-28T18:43:59.293034+0000","last_peered":"2023-11-28T18:43:59.293034+0000","last_clean":"2023-11-28T18:43:59.293034+0000","last_became_active":"2023-11-28T18:43:59.282596+0000","last_became_peered":"2023-11-28T18:43:59.282596+0000","last_unstale":"2023-11-28T18:43:59.293034+0000","last_undegraded":"2023-11-28T18:43:59.293034+0000","last_fullsized":"2023-11-28T18:43:59.293034+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:48:38.128338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.280529+0000","last_change":"2023-11-28T18:43:59.288637+0000","last_active":"2023-11-28T18:44:00.280529+0000","last_peered":"2023-11-28T18:44:00.280529+0000","last_clean":"2023-11-28T18:44:00.280529+0000","last_became_active":"2023-11-28T18:43:59.288316+0000","last_became_peered":"2023-11-28T18:43:59.288316+0000","last_unstale":"2023-11-28T18:44:00.280529+0000","last_undegraded":"2023-11-28T18:44:00.280529+0000","last_fullsized":"2023-11-28T18:44:00.280529+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:30:44.379096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.280410+0000","last_change":"2023-11-28T18:43:59.287850+0000","last_active":"2023-11-28T18:44:00.280410+0000","last_peered":"2023-11-28T18:44:00.280410+0000","last_clean":"2023-11-28T18:44:00.280410+0000","last_became_active":"2023-11-28T18:43:59.287514+0000","last_became_peered":"2023-11-28T18:43:59.287514+0000","last_unstale":"2023-11-28T18:44:00.280410+0000","last_undegraded":"2023-11-28T18:44:00.280410+0000","last_fullsized":"2023-11-28T18:44:00.280410+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:17:06.124969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.291840+0000","last_change":"2023-11-28T18:43:59.284192+0000","last_active":"2023-11-28T18:43:59.291840+0000","last_peered":"2023-11-28T18:43:59.291840+0000","last_clean":"2023-11-28T18:43:59.291840+0000","last_became_active":"2023-11-28T18:43:59.283762+0000","last_became_peered":"2023-11-28T18:43:59.283762+0000","last_unstale":"2023-11-28T18:43:59.291840+0000","last_undegraded":"2023-11-28T18:43:59.291840+0000","last_fullsized":"2023-11-28T18:43:59.291840+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:15:13.056963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.277578+0000","last_change":"2023-11-28T18:43:59.295949+0000","last_active":"2023-11-28T18:44:00.277578+0000","last_peered":"2023-11-28T18:44:00.277578+0000","last_clean":"2023-11-28T18:44:00.277578+0000","last_became_active":"2023-11-28T18:43:59.295644+0000","last_became_peered":"2023-11-28T18:43:59.295644+0000","last_unstale":"2023-11-28T18:44:00.277578+0000","last_undegraded":"2023-11-28T18:44:00.277578+0000","last_fullsized":"2023-11-28T18:44:00.277578+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:16:36.805137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.299580+0000","last_change":"2023-11-28T18:43:59.292726+0000","last_active":"2023-11-28T18:43:59.299580+0000","last_peered":"2023-11-28T18:43:59.299580+0000","last_clean":"2023-11-28T18:43:59.299580+0000","last_became_active":"2023-11-28T18:43:59.292424+0000","last_became_peered":"2023-11-28T18:43:59.292424+0000","last_unstale":"2023-11-28T18:43:59.299580+0000","last_undegraded":"2023-11-28T18:43:59.299580+0000","last_fullsized":"2023-11-28T18:43:59.299580+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:23:42.919325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.293183+0000","last_change":"2023-11-28T18:43:59.281357+0000","last_active":"2023-11-28T18:43:59.293183+0000","last_peered":"2023-11-28T18:43:59.293183+0000","last_clean":"2023-11-28T18:43:59.293183+0000","last_became_active":"2023-11-28T18:43:59.281077+0000","last_became_peered":"2023-11-28T18:43:59.281077+0000","last_unstale":"2023-11-28T18:43:59.293183+0000","last_undegraded":"2023-11-28T18:43:59.293183+0000","last_fullsized":"2023-11-28T18:43:59.293183+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:03:45.953094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.277531+0000","last_change":"2023-11-28T18:43:59.304270+0000","last_active":"2023-11-28T18:44:00.277531+0000","last_peered":"2023-11-28T18:44:00.277531+0000","last_clean":"2023-11-28T18:44:00.277531+0000","last_became_active":"2023-11-28T18:43:59.302827+0000","last_became_peered":"2023-11-28T18:43:59.302827+0000","last_unstale":"2023-11-28T18:44:00.277531+0000","last_undegraded":"2023-11-28T18:44:00.277531+0000","last_fullsized":"2023-11-28T18:44:00.277531+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:50:47.546997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.300295+0000","last_change":"2023-11-28T18:43:59.294174+0000","last_active":"2023-11-28T18:43:59.300295+0000","last_peered":"2023-11-28T18:43:59.300295+0000","last_clean":"2023-11-28T18:43:59.300295+0000","last_became_active":"2023-11-28T18:43:59.293892+0000","last_became_peered":"2023-11-28T18:43:59.293892+0000","last_unstale":"2023-11-28T18:43:59.300295+0000","last_undegraded":"2023-11-28T18:43:59.300295+0000","last_fullsized":"2023-11-28T18:43:59.300295+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:45:26.433437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.277478+0000","last_change":"2023-11-28T18:43:59.302416+0000","last_active":"2023-11-28T18:44:00.277478+0000","last_peered":"2023-11-28T18:44:00.277478+0000","last_clean":"2023-11-28T18:44:00.277478+0000","last_became_active":"2023-11-28T18:43:59.301404+0000","last_became_peered":"2023-11-28T18:43:59.301404+0000","last_unstale":"2023-11-28T18:44:00.277478+0000","last_undegraded":"2023-11-28T18:44:00.277478+0000","last_fullsized":"2023-11-28T18:44:00.277478+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:26:39.306000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.299702+0000","last_change":"2023-11-28T18:43:59.294010+0000","last_active":"2023-11-28T18:43:59.299702+0000","last_peered":"2023-11-28T18:43:59.299702+0000","last_clean":"2023-11-28T18:43:59.299702+0000","last_became_active":"2023-11-28T18:43:59.293725+0000","last_became_peered":"2023-11-28T18:43:59.293725+0000","last_unstale":"2023-11-28T18:43:59.299702+0000","last_undegraded":"2023-11-28T18:43:59.299702+0000","last_fullsized":"2023-11-28T18:43:59.299702+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:38:08.605608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.293129+0000","last_change":"2023-11-28T18:43:59.283645+0000","last_active":"2023-11-28T18:43:59.293129+0000","last_peered":"2023-11-28T18:43:59.293129+0000","last_clean":"2023-11-28T18:43:59.293129+0000","last_became_active":"2023-11-28T18:43:59.282041+0000","last_became_peered":"2023-11-28T18:43:59.282041+0000","last_unstale":"2023-11-28T18:43:59.293129+0000","last_undegraded":"2023-11-28T18:43:59.293129+0000","last_fullsized":"2023-11-28T18:43:59.293129+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:27:07.292895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.298074+0000","last_change":"2023-11-28T18:43:59.293589+0000","last_active":"2023-11-28T18:43:59.298074+0000","last_peered":"2023-11-28T18:43:59.298074+0000","last_clean":"2023-11-28T18:43:59.298074+0000","last_became_active":"2023-11-28T18:43:59.293300+0000","last_became_peered":"2023-11-28T18:43:59.293300+0000","last_unstale":"2023-11-28T18:43:59.298074+0000","last_undegraded":"2023-11-28T18:43:59.298074+0000","last_fullsized":"2023-11-28T18:43:59.298074+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:09:56.919478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.281550+0000","last_change":"2023-11-28T18:43:59.277345+0000","last_active":"2023-11-28T18:44:00.281550+0000","last_peered":"2023-11-28T18:44:00.281550+0000","last_clean":"2023-11-28T18:44:00.281550+0000","last_became_active":"2023-11-28T18:43:59.277022+0000","last_became_peered":"2023-11-28T18:43:59.277022+0000","last_unstale":"2023-11-28T18:44:00.281550+0000","last_undegraded":"2023-11-28T18:44:00.281550+0000","last_fullsized":"2023-11-28T18:44:00.281550+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:28:59.636189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.295712+0000","last_change":"2023-11-28T18:43:59.286510+0000","last_active":"2023-11-28T18:43:59.295712+0000","last_peered":"2023-11-28T18:43:59.295712+0000","last_clean":"2023-11-28T18:43:59.295712+0000","last_became_active":"2023-11-28T18:43:59.286244+0000","last_became_peered":"2023-11-28T18:43:59.286244+0000","last_unstale":"2023-11-28T18:43:59.295712+0000","last_undegraded":"2023-11-28T18:43:59.295712+0000","last_fullsized":"2023-11-28T18:43:59.295712+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:57.543750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.294913+0000","last_change":"2023-11-28T18:43:59.281331+0000","last_active":"2023-11-28T18:43:59.294913+0000","last_peered":"2023-11-28T18:43:59.294913+0000","last_clean":"2023-11-28T18:43:59.294913+0000","last_became_active":"2023-11-28T18:43:59.281032+0000","last_became_peered":"2023-11-28T18:43:59.281032+0000","last_unstale":"2023-11-28T18:43:59.294913+0000","last_undegraded":"2023-11-28T18:43:59.294913+0000","last_fullsized":"2023-11-28T18:43:59.294913+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:50:32.538521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.277814+0000","last_change":"2023-11-28T18:43:59.301506+0000","last_active":"2023-11-28T18:44:00.277814+0000","last_peered":"2023-11-28T18:44:00.277814+0000","last_clean":"2023-11-28T18:44:00.277814+0000","last_became_active":"2023-11-28T18:43:59.300186+0000","last_became_peered":"2023-11-28T18:43:59.300186+0000","last_unstale":"2023-11-28T18:44:00.277814+0000","last_undegraded":"2023-11-28T18:44:00.277814+0000","last_fullsized":"2023-11-28T18:44:00.277814+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:42:17.493004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.299642+0000","last_change":"2023-11-28T18:43:59.292027+0000","last_active":"2023-11-28T18:43:59.299642+0000","last_peered":"2023-11-28T18:43:59.299642+0000","last_clean":"2023-11-28T18:43:59.299642+0000","last_became_active":"2023-11-28T18:43:59.290681+0000","last_became_peered":"2023-11-28T18:43:59.290681+0000","last_unstale":"2023-11-28T18:43:59.299642+0000","last_undegraded":"2023-11-28T18:43:59.299642+0000","last_fullsized":"2023-11-28T18:43:59.299642+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:58:06.281969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.298976+0000","last_change":"2023-11-28T18:43:59.293857+0000","last_active":"2023-11-28T18:43:59.298976+0000","last_peered":"2023-11-28T18:43:59.298976+0000","last_clean":"2023-11-28T18:43:59.298976+0000","last_became_active":"2023-11-28T18:43:59.293413+0000","last_became_peered":"2023-11-28T18:43:59.293413+0000","last_unstale":"2023-11-28T18:43:59.298976+0000","last_undegraded":"2023-11-28T18:43:59.298976+0000","last_fullsized":"2023-11-28T18:43:59.298976+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:40:43.573310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.299035+0000","last_change":"2023-11-28T18:43:59.291978+0000","last_active":"2023-11-28T18:43:59.299035+0000","last_peered":"2023-11-28T18:43:59.299035+0000","last_clean":"2023-11-28T18:43:59.299035+0000","last_became_active":"2023-11-28T18:43:59.291615+0000","last_became_peered":"2023-11-28T18:43:59.291615+0000","last_unstale":"2023-11-28T18:43:59.299035+0000","last_undegraded":"2023-11-28T18:43:59.299035+0000","last_fullsized":"2023-11-28T18:43:59.299035+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:51:07.451317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.296421+0000","last_change":"2023-11-28T18:43:59.289145+0000","last_active":"2023-11-28T18:43:59.296421+0000","last_peered":"2023-11-28T18:43:59.296421+0000","last_clean":"2023-11-28T18:43:59.296421+0000","last_became_active":"2023-11-28T18:43:59.288588+0000","last_became_peered":"2023-11-28T18:43:59.288588+0000","last_unstale":"2023-11-28T18:43:59.296421+0000","last_undegraded":"2023-11-28T18:43:59.296421+0000","last_fullsized":"2023-11-28T18:43:59.296421+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:22:30.045326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"59'4","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.292513+0000","last_change":"2023-11-28T18:43:58.276085+0000","last_active":"2023-11-28T18:43:59.292513+0000","last_peered":"2023-11-28T18:43:59.292513+0000","last_clean":"2023-11-28T18:43:59.292513+0000","last_became_active":"2023-11-28T18:43:58.275800+0000","last_became_peered":"2023-11-28T18:43:58.275800+0000","last_unstale":"2023-11-28T18:43:59.292513+0000","last_undegraded":"2023-11-28T18:43:59.292513+0000","last_fullsized":"2023-11-28T18:43:59.292513+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_clean_scrub_stamp":"2023-11-28T18:43:57.243206+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:48:58.880299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.300842+0000","last_change":"2023-11-28T18:43:59.297363+0000","last_active":"2023-11-28T18:43:59.300842+0000","last_peered":"2023-11-28T18:43:59.300842+0000","last_clean":"2023-11-28T18:43:59.300842+0000","last_became_active":"2023-11-28T18:43:59.296656+0000","last_became_peered":"2023-11-28T18:43:59.296656+0000","last_unstale":"2023-11-28T18:43:59.300842+0000","last_undegraded":"2023-11-28T18:43:59.300842+0000","last_fullsized":"2023-11-28T18:43:59.300842+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:27:07.292895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"59'1","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.277845+0000","last_change":"2023-11-28T18:43:58.287762+0000","last_active":"2023-11-28T18:44:00.277845+0000","last_peered":"2023-11-28T18:44:00.277845+0000","last_clean":"2023-11-28T18:44:00.277845+0000","last_became_active":"2023-11-28T18:43:58.287083+0000","last_became_peered":"2023-11-28T18:43:58.287083+0000","last_unstale":"2023-11-28T18:44:00.277845+0000","last_undegraded":"2023-11-28T18:44:00.277845+0000","last_fullsized":"2023-11-28T18:44:00.277845+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_clean_scrub_stamp":"2023-11-28T18:43:57.243206+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:21:17.090938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.299822+0000","last_change":"2023-11-28T18:43:59.298861+0000","last_active":"2023-11-28T18:43:59.299822+0000","last_peered":"2023-11-28T18:43:59.299822+0000","last_clean":"2023-11-28T18:43:59.299822+0000","last_became_active":"2023-11-28T18:43:59.298448+0000","last_became_peered":"2023-11-28T18:43:59.298448+0000","last_unstale":"2023-11-28T18:43:59.299822+0000","last_undegraded":"2023-11-28T18:43:59.299822+0000","last_fullsized":"2023-11-28T18:43:59.299822+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:06:23.955254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"59'2","reported_seq":13,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.298527+0000","last_change":"2023-11-28T18:43:58.278132+0000","last_active":"2023-11-28T18:43:59.298527+0000","last_peered":"2023-11-28T18:43:59.298527+0000","last_clean":"2023-11-28T18:43:59.298527+0000","last_became_active":"2023-11-28T18:43:58.277378+0000","last_became_peered":"2023-11-28T18:43:58.277378+0000","last_unstale":"2023-11-28T18:43:59.298527+0000","last_undegraded":"2023-11-28T18:43:59.298527+0000","last_fullsized":"2023-11-28T18:43:59.298527+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_clean_scrub_stamp":"2023-11-28T18:43:57.243206+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:45:25.430817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.275321+0000","last_change":"2023-11-28T18:43:59.272371+0000","last_active":"2023-11-28T18:43:59.275321+0000","last_peered":"2023-11-28T18:43:59.275321+0000","last_clean":"2023-11-28T18:43:59.275321+0000","last_became_active":"2023-11-28T18:43:59.271987+0000","last_became_peered":"2023-11-28T18:43:59.271987+0000","last_unstale":"2023-11-28T18:43:59.275321+0000","last_undegraded":"2023-11-28T18:43:59.275321+0000","last_fullsized":"2023-11-28T18:43:59.275321+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:58:06.281969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"59'2","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.281561+0000","last_change":"2023-11-28T18:43:58.275496+0000","last_active":"2023-11-28T18:44:00.281561+0000","last_peered":"2023-11-28T18:44:00.281561+0000","last_clean":"2023-11-28T18:44:00.281561+0000","last_became_active":"2023-11-28T18:43:58.275206+0000","last_became_peered":"2023-11-28T18:43:58.275206+0000","last_unstale":"2023-11-28T18:44:00.281561+0000","last_undegraded":"2023-11-28T18:44:00.281561+0000","last_fullsized":"2023-11-28T18:44:00.281561+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_clean_scrub_stamp":"2023-11-28T18:43:57.243206+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:26:05.161280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.277595+0000","last_change":"2023-11-28T18:43:59.301083+0000","last_active":"2023-11-28T18:44:00.277595+0000","last_peered":"2023-11-28T18:44:00.277595+0000","last_clean":"2023-11-28T18:44:00.277595+0000","last_became_active":"2023-11-28T18:43:59.300374+0000","last_became_peered":"2023-11-28T18:43:59.300374+0000","last_unstale":"2023-11-28T18:44:00.277595+0000","last_undegraded":"2023-11-28T18:44:00.277595+0000","last_fullsized":"2023-11-28T18:44:00.277595+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:30:22.585340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"59'1","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.280743+0000","last_change":"2023-11-28T18:43:58.275778+0000","last_active":"2023-11-28T18:44:00.280743+0000","last_peered":"2023-11-28T18:44:00.280743+0000","last_clean":"2023-11-28T18:44:00.280743+0000","last_became_active":"2023-11-28T18:43:58.275468+0000","last_became_peered":"2023-11-28T18:43:58.275468+0000","last_unstale":"2023-11-28T18:44:00.280743+0000","last_undegraded":"2023-11-28T18:44:00.280743+0000","last_fullsized":"2023-11-28T18:44:00.280743+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_clean_scrub_stamp":"2023-11-28T18:43:57.243206+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:31:18.741449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.277579+0000","last_change":"2023-11-28T18:43:59.301582+0000","last_active":"2023-11-28T18:44:00.277579+0000","last_peered":"2023-11-28T18:44:00.277579+0000","last_clean":"2023-11-28T18:44:00.277579+0000","last_became_active":"2023-11-28T18:43:59.300251+0000","last_became_peered":"2023-11-28T18:43:59.300251+0000","last_unstale":"2023-11-28T18:44:00.277579+0000","last_undegraded":"2023-11-28T18:44:00.277579+0000","last_fullsized":"2023-11-28T18:44:00.277579+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:08.170914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"59'1","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.287382+0000","last_change":"2023-11-28T18:43:58.279878+0000","last_active":"2023-11-28T18:43:59.287382+0000","last_peered":"2023-11-28T18:43:59.287382+0000","last_clean":"2023-11-28T18:43:59.287382+0000","last_became_active":"2023-11-28T18:43:58.279583+0000","last_became_peered":"2023-11-28T18:43:58.279583+0000","last_unstale":"2023-11-28T18:43:59.287382+0000","last_undegraded":"2023-11-28T18:43:59.287382+0000","last_fullsized":"2023-11-28T18:43:59.287382+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_clean_scrub_stamp":"2023-11-28T18:43:57.243206+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:30:43.376476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.294507+0000","last_change":"2023-11-28T18:43:59.287200+0000","last_active":"2023-11-28T18:43:59.294507+0000","last_peered":"2023-11-28T18:43:59.294507+0000","last_clean":"2023-11-28T18:43:59.294507+0000","last_became_active":"2023-11-28T18:43:59.286924+0000","last_became_peered":"2023-11-28T18:43:59.286924+0000","last_unstale":"2023-11-28T18:43:59.294507+0000","last_undegraded":"2023-11-28T18:43:59.294507+0000","last_fullsized":"2023-11-28T18:43:59.294507+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:32:27.557372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.281449+0000","last_change":"2023-11-28T18:43:58.274084+0000","last_active":"2023-11-28T18:44:00.281449+0000","last_peered":"2023-11-28T18:44:00.281449+0000","last_clean":"2023-11-28T18:44:00.281449+0000","last_became_active":"2023-11-28T18:43:58.273653+0000","last_became_peered":"2023-11-28T18:43:58.273653+0000","last_unstale":"2023-11-28T18:44:00.281449+0000","last_undegraded":"2023-11-28T18:44:00.281449+0000","last_fullsized":"2023-11-28T18:44:00.281449+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_clean_scrub_stamp":"2023-11-28T18:43:57.243206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:45:25.430817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.277355+0000","last_change":"2023-11-28T18:43:59.301918+0000","last_active":"2023-11-28T18:44:00.277355+0000","last_peered":"2023-11-28T18:44:00.277355+0000","last_clean":"2023-11-28T18:44:00.277355+0000","last_became_active":"2023-11-28T18:43:59.301358+0000","last_became_peered":"2023-11-28T18:43:59.301358+0000","last_unstale":"2023-11-28T18:44:00.277355+0000","last_undegraded":"2023-11-28T18:44:00.277355+0000","last_fullsized":"2023-11-28T18:44:00.277355+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:16:10.035568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.280245+0000","last_change":"2023-11-28T18:43:58.279583+0000","last_active":"2023-11-28T18:44:00.280245+0000","last_peered":"2023-11-28T18:44:00.280245+0000","last_clean":"2023-11-28T18:44:00.280245+0000","last_became_active":"2023-11-28T18:43:58.279218+0000","last_became_peered":"2023-11-28T18:43:58.279218+0000","last_unstale":"2023-11-28T18:44:00.280245+0000","last_undegraded":"2023-11-28T18:44:00.280245+0000","last_fullsized":"2023-11-28T18:44:00.280245+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_clean_scrub_stamp":"2023-11-28T18:43:57.243206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:11:52.434184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.280846+0000","last_change":"2023-11-28T18:43:59.294345+0000","last_active":"2023-11-28T18:44:00.280846+0000","last_peered":"2023-11-28T18:44:00.280846+0000","last_clean":"2023-11-28T18:44:00.280846+0000","last_became_active":"2023-11-28T18:43:59.294053+0000","last_became_peered":"2023-11-28T18:43:59.294053+0000","last_unstale":"2023-11-28T18:44:00.280846+0000","last_undegraded":"2023-11-28T18:44:00.280846+0000","last_fullsized":"2023-11-28T18:44:00.280846+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:10:34.305144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.283938+0000","last_change":"2023-11-28T18:43:58.277222+0000","last_active":"2023-11-28T18:43:59.283938+0000","last_peered":"2023-11-28T18:43:59.283938+0000","last_clean":"2023-11-28T18:43:59.283938+0000","last_became_active":"2023-11-28T18:43:58.276950+0000","last_became_peered":"2023-11-28T18:43:58.276950+0000","last_unstale":"2023-11-28T18:43:59.283938+0000","last_undegraded":"2023-11-28T18:43:59.283938+0000","last_fullsized":"2023-11-28T18:43:59.283938+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_clean_scrub_stamp":"2023-11-28T18:43:57.243206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:48:37.869052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.301133+0000","last_change":"2023-11-28T18:43:59.299355+0000","last_active":"2023-11-28T18:43:59.301133+0000","last_peered":"2023-11-28T18:43:59.301133+0000","last_clean":"2023-11-28T18:43:59.301133+0000","last_became_active":"2023-11-28T18:43:59.298967+0000","last_became_peered":"2023-11-28T18:43:59.298967+0000","last_unstale":"2023-11-28T18:43:59.301133+0000","last_undegraded":"2023-11-28T18:43:59.301133+0000","last_fullsized":"2023-11-28T18:43:59.301133+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:03:19.767349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.277935+0000","last_change":"2023-11-28T18:43:58.284880+0000","last_active":"2023-11-28T18:44:00.277935+0000","last_peered":"2023-11-28T18:44:00.277935+0000","last_clean":"2023-11-28T18:44:00.277935+0000","last_became_active":"2023-11-28T18:43:58.284585+0000","last_became_peered":"2023-11-28T18:43:58.284585+0000","last_unstale":"2023-11-28T18:44:00.277935+0000","last_undegraded":"2023-11-28T18:44:00.277935+0000","last_fullsized":"2023-11-28T18:44:00.277935+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_clean_scrub_stamp":"2023-11-28T18:43:57.243206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:32:10.817844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.289451+0000","last_change":"2023-11-28T18:43:59.283102+0000","last_active":"2023-11-28T18:43:59.289451+0000","last_peered":"2023-11-28T18:43:59.289451+0000","last_clean":"2023-11-28T18:43:59.289451+0000","last_became_active":"2023-11-28T18:43:59.282502+0000","last_became_peered":"2023-11-28T18:43:59.282502+0000","last_unstale":"2023-11-28T18:43:59.289451+0000","last_undegraded":"2023-11-28T18:43:59.289451+0000","last_fullsized":"2023-11-28T18:43:59.289451+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:32:27.557372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"59'3","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.298478+0000","last_change":"2023-11-28T18:43:58.275839+0000","last_active":"2023-11-28T18:43:59.298478+0000","last_peered":"2023-11-28T18:43:59.298478+0000","last_clean":"2023-11-28T18:43:59.298478+0000","last_became_active":"2023-11-28T18:43:58.275545+0000","last_became_peered":"2023-11-28T18:43:58.275545+0000","last_unstale":"2023-11-28T18:43:59.298478+0000","last_undegraded":"2023-11-28T18:43:59.298478+0000","last_fullsized":"2023-11-28T18:43:59.298478+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_clean_scrub_stamp":"2023-11-28T18:43:57.243206+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:23:32.281568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.299630+0000","last_change":"2023-11-28T18:43:59.291390+0000","last_active":"2023-11-28T18:43:59.299630+0000","last_peered":"2023-11-28T18:43:59.299630+0000","last_clean":"2023-11-28T18:43:59.299630+0000","last_became_active":"2023-11-28T18:43:59.291100+0000","last_became_peered":"2023-11-28T18:43:59.291100+0000","last_unstale":"2023-11-28T18:43:59.299630+0000","last_undegraded":"2023-11-28T18:43:59.299630+0000","last_fullsized":"2023-11-28T18:43:59.299630+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:18:35.757235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"59'6","reported_seq":18,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.280681+0000","last_change":"2023-11-28T18:43:58.284144+0000","last_active":"2023-11-28T18:44:00.280681+0000","last_peered":"2023-11-28T18:44:00.280681+0000","last_clean":"2023-11-28T18:44:00.280681+0000","last_became_active":"2023-11-28T18:43:58.283818+0000","last_became_peered":"2023-11-28T18:43:58.283818+0000","last_unstale":"2023-11-28T18:44:00.280681+0000","last_undegraded":"2023-11-28T18:44:00.280681+0000","last_fullsized":"2023-11-28T18:44:00.280681+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_clean_scrub_stamp":"2023-11-28T18:43:57.243206+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:08:37.761668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.281034+0000","last_change":"2023-11-28T18:43:59.290145+0000","last_active":"2023-11-28T18:44:00.281034+0000","last_peered":"2023-11-28T18:44:00.281034+0000","last_clean":"2023-11-28T18:44:00.281034+0000","last_became_active":"2023-11-28T18:43:59.289168+0000","last_became_peered":"2023-11-28T18:43:59.289168+0000","last_unstale":"2023-11-28T18:44:00.281034+0000","last_undegraded":"2023-11-28T18:44:00.281034+0000","last_fullsized":"2023-11-28T18:44:00.281034+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:23:42.919325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"59'2","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.277677+0000","last_change":"2023-11-28T18:43:58.284988+0000","last_active":"2023-11-28T18:44:00.277677+0000","last_peered":"2023-11-28T18:44:00.277677+0000","last_clean":"2023-11-28T18:44:00.277677+0000","last_became_active":"2023-11-28T18:43:58.284687+0000","last_became_peered":"2023-11-28T18:43:58.284687+0000","last_unstale":"2023-11-28T18:44:00.277677+0000","last_undegraded":"2023-11-28T18:44:00.277677+0000","last_fullsized":"2023-11-28T18:44:00.277677+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_clean_scrub_stamp":"2023-11-28T18:43:57.243206+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:32:26.879403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.300316+0000","last_change":"2023-11-28T18:43:59.294609+0000","last_active":"2023-11-28T18:43:59.300316+0000","last_peered":"2023-11-28T18:43:59.300316+0000","last_clean":"2023-11-28T18:43:59.300316+0000","last_became_active":"2023-11-28T18:43:59.294318+0000","last_became_peered":"2023-11-28T18:43:59.294318+0000","last_unstale":"2023-11-28T18:43:59.300316+0000","last_undegraded":"2023-11-28T18:43:59.300316+0000","last_fullsized":"2023-11-28T18:43:59.300316+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:17:04.792032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.270895+0000","last_change":"2023-11-28T18:43:58.277106+0000","last_active":"2023-11-28T18:43:59.270895+0000","last_peered":"2023-11-28T18:43:59.270895+0000","last_clean":"2023-11-28T18:43:59.270895+0000","last_became_active":"2023-11-28T18:43:58.276849+0000","last_became_peered":"2023-11-28T18:43:58.276849+0000","last_unstale":"2023-11-28T18:43:59.270895+0000","last_undegraded":"2023-11-28T18:43:59.270895+0000","last_fullsized":"2023-11-28T18:43:59.270895+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_clean_scrub_stamp":"2023-11-28T18:43:57.243206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:48:54.770159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.280233+0000","last_change":"2023-11-28T18:43:59.289067+0000","last_active":"2023-11-28T18:44:00.280233+0000","last_peered":"2023-11-28T18:44:00.280233+0000","last_clean":"2023-11-28T18:44:00.280233+0000","last_became_active":"2023-11-28T18:43:59.287105+0000","last_became_peered":"2023-11-28T18:43:59.287105+0000","last_unstale":"2023-11-28T18:44:00.280233+0000","last_undegraded":"2023-11-28T18:44:00.280233+0000","last_fullsized":"2023-11-28T18:44:00.280233+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:15:13.056963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.281536+0000","last_change":"2023-11-28T18:43:58.276542+0000","last_active":"2023-11-28T18:44:00.281536+0000","last_peered":"2023-11-28T18:44:00.281536+0000","last_clean":"2023-11-28T18:44:00.281536+0000","last_became_active":"2023-11-28T18:43:58.275667+0000","last_became_peered":"2023-11-28T18:43:58.275667+0000","last_unstale":"2023-11-28T18:44:00.281536+0000","last_undegraded":"2023-11-28T18:44:00.281536+0000","last_fullsized":"2023-11-28T18:44:00.281536+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_clean_scrub_stamp":"2023-11-28T18:43:57.243206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:18:34.754615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.299886+0000","last_change":"2023-11-28T18:43:59.294454+0000","last_active":"2023-11-28T18:43:59.299886+0000","last_peered":"2023-11-28T18:43:59.299886+0000","last_clean":"2023-11-28T18:43:59.299886+0000","last_became_active":"2023-11-28T18:43:59.293573+0000","last_became_peered":"2023-11-28T18:43:59.293573+0000","last_unstale":"2023-11-28T18:43:59.299886+0000","last_undegraded":"2023-11-28T18:43:59.299886+0000","last_fullsized":"2023-11-28T18:43:59.299886+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:57.543750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"59'8","reported_seq":19,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.296664+0000","last_change":"2023-11-28T18:43:58.271516+0000","last_active":"2023-11-28T18:43:59.296664+0000","last_peered":"2023-11-28T18:43:59.296664+0000","last_clean":"2023-11-28T18:43:59.296664+0000","last_became_active":"2023-11-28T18:43:58.271030+0000","last_became_peered":"2023-11-28T18:43:58.271030+0000","last_unstale":"2023-11-28T18:43:59.296664+0000","last_undegraded":"2023-11-28T18:43:59.296664+0000","last_fullsized":"2023-11-28T18:43:59.296664+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_clean_scrub_stamp":"2023-11-28T18:43:57.243206+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:06:22.952634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.300459+0000","last_change":"2023-11-28T18:43:59.296414+0000","last_active":"2023-11-28T18:43:59.300459+0000","last_peered":"2023-11-28T18:43:59.300459+0000","last_clean":"2023-11-28T18:43:59.300459+0000","last_became_active":"2023-11-28T18:43:59.296112+0000","last_became_peered":"2023-11-28T18:43:59.296112+0000","last_unstale":"2023-11-28T18:43:59.300459+0000","last_undegraded":"2023-11-28T18:43:59.300459+0000","last_fullsized":"2023-11-28T18:43:59.300459+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:22:30.045326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"59'1","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.278009+0000","last_change":"2023-11-28T18:43:58.285062+0000","last_active":"2023-11-28T18:44:00.278009+0000","last_peered":"2023-11-28T18:44:00.278009+0000","last_clean":"2023-11-28T18:44:00.278009+0000","last_became_active":"2023-11-28T18:43:58.284767+0000","last_became_peered":"2023-11-28T18:43:58.284767+0000","last_unstale":"2023-11-28T18:44:00.278009+0000","last_undegraded":"2023-11-28T18:44:00.278009+0000","last_fullsized":"2023-11-28T18:44:00.278009+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_clean_scrub_stamp":"2023-11-28T18:43:57.243206+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:37:56.175669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.281704+0000","last_change":"2023-11-28T18:43:59.290026+0000","last_active":"2023-11-28T18:44:00.281704+0000","last_peered":"2023-11-28T18:44:00.281704+0000","last_clean":"2023-11-28T18:44:00.281704+0000","last_became_active":"2023-11-28T18:43:59.289742+0000","last_became_peered":"2023-11-28T18:43:59.289742+0000","last_unstale":"2023-11-28T18:44:00.281704+0000","last_undegraded":"2023-11-28T18:44:00.281704+0000","last_fullsized":"2023-11-28T18:44:00.281704+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:37:57.178289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"59'2","reported_seq":13,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.296421+0000","last_change":"2023-11-28T18:43:58.286965+0000","last_active":"2023-11-28T18:43:59.296421+0000","last_peered":"2023-11-28T18:43:59.296421+0000","last_clean":"2023-11-28T18:43:59.296421+0000","last_became_active":"2023-11-28T18:43:58.285679+0000","last_became_peered":"2023-11-28T18:43:58.285679+0000","last_unstale":"2023-11-28T18:43:59.296421+0000","last_undegraded":"2023-11-28T18:43:59.296421+0000","last_fullsized":"2023-11-28T18:43:59.296421+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_clean_scrub_stamp":"2023-11-28T18:43:57.243206+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:18:34.754615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.277662+0000","last_change":"2023-11-28T18:43:59.304967+0000","last_active":"2023-11-28T18:44:00.277662+0000","last_peered":"2023-11-28T18:44:00.277662+0000","last_clean":"2023-11-28T18:44:00.277662+0000","last_became_active":"2023-11-28T18:43:59.304609+0000","last_became_peered":"2023-11-28T18:43:59.304609+0000","last_unstale":"2023-11-28T18:44:00.277662+0000","last_undegraded":"2023-11-28T18:44:00.277662+0000","last_fullsized":"2023-11-28T18:44:00.277662+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:22:55.971501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"59'1","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.281475+0000","last_change":"2023-11-28T18:43:58.277015+0000","last_active":"2023-11-28T18:44:00.281475+0000","last_peered":"2023-11-28T18:44:00.281475+0000","last_clean":"2023-11-28T18:44:00.281475+0000","last_became_active":"2023-11-28T18:43:58.276491+0000","last_became_peered":"2023-11-28T18:43:58.276491+0000","last_unstale":"2023-11-28T18:44:00.281475+0000","last_undegraded":"2023-11-28T18:44:00.281475+0000","last_fullsized":"2023-11-28T18:44:00.281475+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_clean_scrub_stamp":"2023-11-28T18:43:57.243206+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:23:32.281568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.301119+0000","last_change":"2023-11-28T18:43:59.299300+0000","last_active":"2023-11-28T18:43:59.301119+0000","last_peered":"2023-11-28T18:43:59.301119+0000","last_clean":"2023-11-28T18:43:59.301119+0000","last_became_active":"2023-11-28T18:43:59.298698+0000","last_became_peered":"2023-11-28T18:43:59.298698+0000","last_unstale":"2023-11-28T18:43:59.301119+0000","last_undegraded":"2023-11-28T18:43:59.301119+0000","last_fullsized":"2023-11-28T18:43:59.301119+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:33:55.744963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.262518+0000","last_change":"2023-11-28T18:43:58.283321+0000","last_active":"2023-11-28T18:43:59.262518+0000","last_peered":"2023-11-28T18:43:59.262518+0000","last_clean":"2023-11-28T18:43:59.262518+0000","last_became_active":"2023-11-28T18:43:58.281941+0000","last_became_peered":"2023-11-28T18:43:58.281941+0000","last_unstale":"2023-11-28T18:43:59.262518+0000","last_undegraded":"2023-11-28T18:43:59.262518+0000","last_fullsized":"2023-11-28T18:43:59.262518+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_clean_scrub_stamp":"2023-11-28T18:43:57.243206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:38:07.602988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.281036+0000","last_change":"2023-11-28T18:43:59.289279+0000","last_active":"2023-11-28T18:44:00.281036+0000","last_peered":"2023-11-28T18:44:00.281036+0000","last_clean":"2023-11-28T18:44:00.281036+0000","last_became_active":"2023-11-28T18:43:59.288984+0000","last_became_peered":"2023-11-28T18:43:59.288984+0000","last_unstale":"2023-11-28T18:44:00.281036+0000","last_undegraded":"2023-11-28T18:44:00.281036+0000","last_fullsized":"2023-11-28T18:44:00.281036+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:03:19.767349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"59'2","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.277832+0000","last_change":"2023-11-28T18:43:58.283409+0000","last_active":"2023-11-28T18:44:00.277832+0000","last_peered":"2023-11-28T18:44:00.277832+0000","last_clean":"2023-11-28T18:44:00.277832+0000","last_became_active":"2023-11-28T18:43:58.283140+0000","last_became_peered":"2023-11-28T18:43:58.283140+0000","last_unstale":"2023-11-28T18:44:00.277832+0000","last_undegraded":"2023-11-28T18:44:00.277832+0000","last_fullsized":"2023-11-28T18:44:00.277832+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_clean_scrub_stamp":"2023-11-28T18:43:57.243206+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:52:49.154126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.295530+0000","last_change":"2023-11-28T18:43:59.287253+0000","last_active":"2023-11-28T18:43:59.295530+0000","last_peered":"2023-11-28T18:43:59.295530+0000","last_clean":"2023-11-28T18:43:59.295530+0000","last_became_active":"2023-11-28T18:43:59.283809+0000","last_became_peered":"2023-11-28T18:43:59.283809+0000","last_unstale":"2023-11-28T18:43:59.295530+0000","last_undegraded":"2023-11-28T18:43:59.295530+0000","last_fullsized":"2023-11-28T18:43:59.295530+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:10:34.305144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.271448+0000","last_change":"2023-11-28T18:43:58.272326+0000","last_active":"2023-11-28T18:43:59.271448+0000","last_peered":"2023-11-28T18:43:59.271448+0000","last_clean":"2023-11-28T18:43:59.271448+0000","last_became_active":"2023-11-28T18:43:58.272023+0000","last_became_peered":"2023-11-28T18:43:58.272023+0000","last_unstale":"2023-11-28T18:43:59.271448+0000","last_undegraded":"2023-11-28T18:43:59.271448+0000","last_fullsized":"2023-11-28T18:43:59.271448+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_clean_scrub_stamp":"2023-11-28T18:43:57.243206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:11:56.478375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.299003+0000","last_change":"2023-11-28T18:43:59.289240+0000","last_active":"2023-11-28T18:43:59.299003+0000","last_peered":"2023-11-28T18:43:59.299003+0000","last_clean":"2023-11-28T18:43:59.299003+0000","last_became_active":"2023-11-28T18:43:59.288929+0000","last_became_peered":"2023-11-28T18:43:59.288929+0000","last_unstale":"2023-11-28T18:43:59.299003+0000","last_undegraded":"2023-11-28T18:43:59.299003+0000","last_fullsized":"2023-11-28T18:43:59.299003+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:23:02.291448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.281115+0000","last_change":"2023-11-28T18:43:58.280347+0000","last_active":"2023-11-28T18:44:00.281115+0000","last_peered":"2023-11-28T18:44:00.281115+0000","last_clean":"2023-11-28T18:44:00.281115+0000","last_became_active":"2023-11-28T18:43:58.279871+0000","last_became_peered":"2023-11-28T18:43:58.279871+0000","last_unstale":"2023-11-28T18:44:00.281115+0000","last_undegraded":"2023-11-28T18:44:00.281115+0000","last_fullsized":"2023-11-28T18:44:00.281115+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_clean_scrub_stamp":"2023-11-28T18:43:57.243206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:56.541131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.281697+0000","last_change":"2023-11-28T18:43:59.285638+0000","last_active":"2023-11-28T18:44:00.281697+0000","last_peered":"2023-11-28T18:44:00.281697+0000","last_clean":"2023-11-28T18:44:00.281697+0000","last_became_active":"2023-11-28T18:43:59.285330+0000","last_became_peered":"2023-11-28T18:43:59.285330+0000","last_unstale":"2023-11-28T18:44:00.281697+0000","last_undegraded":"2023-11-28T18:44:00.281697+0000","last_fullsized":"2023-11-28T18:44:00.281697+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:58:10.520321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"59'2","reported_seq":13,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.290887+0000","last_change":"2023-11-28T18:43:58.285006+0000","last_active":"2023-11-28T18:43:59.290887+0000","last_peered":"2023-11-28T18:43:59.290887+0000","last_clean":"2023-11-28T18:43:59.290887+0000","last_became_active":"2023-11-28T18:43:58.284708+0000","last_became_peered":"2023-11-28T18:43:58.284708+0000","last_unstale":"2023-11-28T18:43:59.290887+0000","last_undegraded":"2023-11-28T18:43:59.290887+0000","last_fullsized":"2023-11-28T18:43:59.290887+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_clean_scrub_stamp":"2023-11-28T18:43:57.243206+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:15:31.322866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.281775+0000","last_change":"2023-11-28T18:43:59.287785+0000","last_active":"2023-11-28T18:44:00.281775+0000","last_peered":"2023-11-28T18:44:00.281775+0000","last_clean":"2023-11-28T18:44:00.281775+0000","last_became_active":"2023-11-28T18:43:59.286604+0000","last_became_peered":"2023-11-28T18:43:59.286604+0000","last_unstale":"2023-11-28T18:44:00.281775+0000","last_undegraded":"2023-11-28T18:44:00.281775+0000","last_fullsized":"2023-11-28T18:44:00.281775+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:56:54.827147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.264220+0000","last_change":"2023-11-28T18:43:58.280815+0000","last_active":"2023-11-28T18:43:59.264220+0000","last_peered":"2023-11-28T18:43:59.264220+0000","last_clean":"2023-11-28T18:43:59.264220+0000","last_became_active":"2023-11-28T18:43:58.278827+0000","last_became_peered":"2023-11-28T18:43:58.278827+0000","last_unstale":"2023-11-28T18:43:59.264220+0000","last_undegraded":"2023-11-28T18:43:59.264220+0000","last_fullsized":"2023-11-28T18:43:59.264220+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_clean_scrub_stamp":"2023-11-28T18:43:57.243206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:26:05.161280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.289471+0000","last_change":"2023-11-28T18:43:59.283279+0000","last_active":"2023-11-28T18:43:59.289471+0000","last_peered":"2023-11-28T18:43:59.289471+0000","last_clean":"2023-11-28T18:43:59.289471+0000","last_became_active":"2023-11-28T18:43:59.282809+0000","last_became_peered":"2023-11-28T18:43:59.282809+0000","last_unstale":"2023-11-28T18:43:59.289471+0000","last_undegraded":"2023-11-28T18:43:59.289471+0000","last_fullsized":"2023-11-28T18:43:59.289471+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:48:55.772779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.274513+0000","last_change":"2023-11-28T18:43:58.281032+0000","last_active":"2023-11-28T18:43:59.274513+0000","last_peered":"2023-11-28T18:43:59.274513+0000","last_clean":"2023-11-28T18:43:59.274513+0000","last_became_active":"2023-11-28T18:43:58.280369+0000","last_became_peered":"2023-11-28T18:43:58.280369+0000","last_unstale":"2023-11-28T18:43:59.274513+0000","last_undegraded":"2023-11-28T18:43:59.274513+0000","last_fullsized":"2023-11-28T18:43:59.274513+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_clean_scrub_stamp":"2023-11-28T18:43:57.243206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:44:06.878322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.275342+0000","last_change":"2023-11-28T18:43:59.272686+0000","last_active":"2023-11-28T18:43:59.275342+0000","last_peered":"2023-11-28T18:43:59.275342+0000","last_clean":"2023-11-28T18:43:59.275342+0000","last_became_active":"2023-11-28T18:43:59.272410+0000","last_became_peered":"2023-11-28T18:43:59.272410+0000","last_unstale":"2023-11-28T18:43:59.275342+0000","last_undegraded":"2023-11-28T18:43:59.275342+0000","last_fullsized":"2023-11-28T18:43:59.275342+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:33:55.744963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.281487+0000","last_change":"2023-11-28T18:43:58.274083+0000","last_active":"2023-11-28T18:44:00.281487+0000","last_peered":"2023-11-28T18:44:00.281487+0000","last_clean":"2023-11-28T18:44:00.281487+0000","last_became_active":"2023-11-28T18:43:58.273731+0000","last_became_peered":"2023-11-28T18:43:58.273731+0000","last_unstale":"2023-11-28T18:44:00.281487+0000","last_undegraded":"2023-11-28T18:44:00.281487+0000","last_fullsized":"2023-11-28T18:44:00.281487+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_clean_scrub_stamp":"2023-11-28T18:43:57.243206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:33:54.742343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.277721+0000","last_change":"2023-11-28T18:43:59.292667+0000","last_active":"2023-11-28T18:44:00.277721+0000","last_peered":"2023-11-28T18:44:00.277721+0000","last_clean":"2023-11-28T18:44:00.277721+0000","last_became_active":"2023-11-28T18:43:59.292325+0000","last_became_peered":"2023-11-28T18:43:59.292325+0000","last_unstale":"2023-11-28T18:44:00.277721+0000","last_undegraded":"2023-11-28T18:44:00.277721+0000","last_fullsized":"2023-11-28T18:44:00.277721+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:49:43.351344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.273137+0000","last_change":"2023-11-28T18:43:58.272737+0000","last_active":"2023-11-28T18:43:59.273137+0000","last_peered":"2023-11-28T18:43:59.273137+0000","last_clean":"2023-11-28T18:43:59.273137+0000","last_became_active":"2023-11-28T18:43:58.272056+0000","last_became_peered":"2023-11-28T18:43:58.272056+0000","last_unstale":"2023-11-28T18:43:59.273137+0000","last_undegraded":"2023-11-28T18:43:59.273137+0000","last_fullsized":"2023-11-28T18:43:59.273137+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_clean_scrub_stamp":"2023-11-28T18:43:57.243206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:09:37.112065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.306133+0000","last_change":"2023-11-28T18:43:59.304916+0000","last_active":"2023-11-28T18:43:59.306133+0000","last_peered":"2023-11-28T18:43:59.306133+0000","last_clean":"2023-11-28T18:43:59.306133+0000","last_became_active":"2023-11-28T18:43:59.304564+0000","last_became_peered":"2023-11-28T18:43:59.304564+0000","last_unstale":"2023-11-28T18:43:59.306133+0000","last_undegraded":"2023-11-28T18:43:59.306133+0000","last_fullsized":"2023-11-28T18:43:59.306133+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:26:06.163900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.280505+0000","last_change":"2023-11-28T18:43:58.284268+0000","last_active":"2023-11-28T18:44:00.280505+0000","last_peered":"2023-11-28T18:44:00.280505+0000","last_clean":"2023-11-28T18:44:00.280505+0000","last_became_active":"2023-11-28T18:43:58.283802+0000","last_became_peered":"2023-11-28T18:43:58.283802+0000","last_unstale":"2023-11-28T18:44:00.280505+0000","last_undegraded":"2023-11-28T18:44:00.280505+0000","last_fullsized":"2023-11-28T18:44:00.280505+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_clean_scrub_stamp":"2023-11-28T18:43:57.243206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:51:06.448697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.288481+0000","last_change":"2023-11-28T18:43:59.282950+0000","last_active":"2023-11-28T18:43:59.288481+0000","last_peered":"2023-11-28T18:43:59.288481+0000","last_clean":"2023-11-28T18:43:59.288481+0000","last_became_active":"2023-11-28T18:43:59.281828+0000","last_became_peered":"2023-11-28T18:43:59.281828+0000","last_unstale":"2023-11-28T18:43:59.288481+0000","last_undegraded":"2023-11-28T18:43:59.288481+0000","last_fullsized":"2023-11-28T18:43:59.288481+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:47:34.364400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.270970+0000","last_change":"2023-11-28T18:43:58.277650+0000","last_active":"2023-11-28T18:43:59.270970+0000","last_peered":"2023-11-28T18:43:59.270970+0000","last_clean":"2023-11-28T18:43:59.270970+0000","last_became_active":"2023-11-28T18:43:58.277363+0000","last_became_peered":"2023-11-28T18:43:58.277363+0000","last_unstale":"2023-11-28T18:43:59.270970+0000","last_undegraded":"2023-11-28T18:43:59.270970+0000","last_fullsized":"2023-11-28T18:43:59.270970+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_clean_scrub_stamp":"2023-11-28T18:43:57.243206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:16:30.964163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.277406+0000","last_change":"2023-11-28T18:43:59.292682+0000","last_active":"2023-11-28T18:44:00.277406+0000","last_peered":"2023-11-28T18:44:00.277406+0000","last_clean":"2023-11-28T18:44:00.277406+0000","last_became_active":"2023-11-28T18:43:59.292428+0000","last_became_peered":"2023-11-28T18:43:59.292428+0000","last_unstale":"2023-11-28T18:44:00.277406+0000","last_undegraded":"2023-11-28T18:44:00.277406+0000","last_fullsized":"2023-11-28T18:44:00.277406+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:54:00.252840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.277425+0000","last_change":"2023-11-28T18:43:58.278956+0000","last_active":"2023-11-28T18:44:00.277425+0000","last_peered":"2023-11-28T18:44:00.277425+0000","last_clean":"2023-11-28T18:44:00.277425+0000","last_became_active":"2023-11-28T18:43:58.278681+0000","last_became_peered":"2023-11-28T18:43:58.278681+0000","last_unstale":"2023-11-28T18:44:00.277425+0000","last_undegraded":"2023-11-28T18:44:00.277425+0000","last_fullsized":"2023-11-28T18:44:00.277425+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_clean_scrub_stamp":"2023-11-28T18:43:57.243206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:23:00.696296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.277327+0000","last_change":"2023-11-28T18:43:59.285823+0000","last_active":"2023-11-28T18:44:00.277327+0000","last_peered":"2023-11-28T18:44:00.277327+0000","last_clean":"2023-11-28T18:44:00.277327+0000","last_became_active":"2023-11-28T18:43:59.285537+0000","last_became_peered":"2023-11-28T18:43:59.285537+0000","last_unstale":"2023-11-28T18:44:00.277327+0000","last_undegraded":"2023-11-28T18:44:00.277327+0000","last_fullsized":"2023-11-28T18:44:00.277327+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:25:11.118389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.270802+0000","last_change":"2023-11-28T18:43:58.278600+0000","last_active":"2023-11-28T18:43:59.270802+0000","last_peered":"2023-11-28T18:43:59.270802+0000","last_clean":"2023-11-28T18:43:59.270802+0000","last_became_active":"2023-11-28T18:43:58.277993+0000","last_became_peered":"2023-11-28T18:43:58.277993+0000","last_unstale":"2023-11-28T18:43:59.270802+0000","last_undegraded":"2023-11-28T18:43:59.270802+0000","last_fullsized":"2023-11-28T18:43:59.270802+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_clean_scrub_stamp":"2023-11-28T18:43:57.243206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:47:33.361780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":201,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-28T18:43:58.261123+0000","last_change":"2023-11-28T18:37:22.369132+0000","last_active":"2023-11-28T18:43:58.261123+0000","last_peered":"2023-11-28T18:43:58.261123+0000","last_clean":"2023-11-28T18:43:58.261123+0000","last_became_active":"2023-11-28T18:37:22.368142+0000","last_became_peered":"2023-11-28T18:37:22.368142+0000","last_unstale":"2023-11-28T18:43:58.261123+0000","last_undegraded":"2023-11-28T18:43:58.261123+0000","last_fullsized":"2023-11-28T18:43:58.261123+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:21.313053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:21.313053+0000","last_clean_scrub_stamp":"2023-11-28T18:37:21.313053+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:55:01.432028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574931,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32464,"kb_used_data":1280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339376,"statfs":{"total":96636764160,"available":96603521024,"internally_reserved":0,"allocated":1310720,"data_stored":887595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 18:43:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.67600000000000005,"15min":0.81399999999999995},"min":{"1min":0.51000000000000001,"5min":0.43099999999999999,"15min":0.40300000000000002},"max":{"1min":0.873,"5min":1.0509999999999999,"15min":4.8559999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.67900000000000005,"15min":0.79900000000000004},"min":{"1min":0.46700000000000003,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.90600000000000003,"5min":0.998,"15min":4.8319999999999999},"last":0.48599999999999999}]},{"osd":1,"last update":"Tue Nov 28 18:43:40 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.68799999999999994,"15min":0.81200000000000006},"min":{"1min":0.504,"5min":0.46000000000000002,"15min":0.45400000000000001},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":4.8109999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.71599999999999997,"15min":0.86099999999999999},"min":{"1min":0.52800000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.873,"5min":0.997,"15min":4.8700000000000001},"last":0.68899999999999995}]},{"osd":2,"last update":"Tue Nov 28 18:43:40 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.72199999999999998,"15min":0.73599999999999999},"min":{"1min":0.55100000000000005,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.97299999999999998,"5min":1.032,"15min":1.151},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.76600000000000001,"15min":0.75600000000000001},"min":{"1min":0.57799999999999996,"5min":0.54900000000000004,"15min":0.51100000000000001},"max":{"1min":1.024,"5min":1.113,"15min":1.1160000000000001},"last":0.74099999999999999}]},{"osd":3,"last update":"Tue Nov 28 18:43:40 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.71099999999999997,"15min":0.86199999999999999},"min":{"1min":0.57399999999999995,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.873,"5min":1.0329999999999999,"15min":4.7619999999999996},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.749,"15min":0.75900000000000001},"min":{"1min":0.58999999999999997,"5min":0.499,"15min":0.499},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.80800000000000005}]},{"osd":4,"last update":"Tue Nov 28 18:43:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.60399999999999998,"15min":0.63800000000000001},"min":{"1min":0.45600000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.72999999999999998,"5min":1.032,"15min":1.032},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63600000000000001,"15min":0.67900000000000005},"min":{"1min":0.46600000000000003,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.83299999999999996,"5min":0.96599999999999997,"15min":0.96699999999999997},"last":0.72099999999999997}]},{"osd":5,"last update":"Tue Nov 28 18:43:40 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.66300000000000003,"15min":0.69299999999999995},"min":{"1min":0.47299999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.81499999999999995,"5min":0.95599999999999996,"15min":1.0880000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.68899999999999995,"15min":0.73599999999999999},"min":{"1min":0.53200000000000003,"5min":0.433,"15min":0.433},"max":{"1min":0.88500000000000001,"5min":1.079,"15min":1.079},"last":0.75700000000000001}]},{"osd":6,"last update":"Tue Nov 28 18:43:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.73199999999999998,"15min":0.79900000000000004},"min":{"1min":0.50900000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.93500000000000005,"5min":1.107,"15min":1.484},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.70199999999999996,"15min":0.76800000000000002},"min":{"1min":0.51500000000000001,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.86399999999999999,"5min":1.046,"15min":1.169},"last":0.66700000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574933,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31872,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339968,"statfs":{"total":96636764160,"available":96604127232,"internally_reserved":0,"allocated":708608,"data_stored":297067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 18:43:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.63,"15min":0.628},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.93899999999999995},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.64900000000000002,"15min":0.63400000000000001},"min":{"1min":0.43099999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.93500000000000005,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.70699999999999996}]},{"osd":1,"last update":"Tue Nov 28 18:43:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.69599999999999995,"15min":0.67300000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.38800000000000001},"max":{"1min":0.95099999999999996,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.72199999999999998,"15min":0.73399999999999999},"min":{"1min":0.56299999999999994,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.89900000000000002,"5min":0.97699999999999998,"15min":0.98099999999999998},"last":0.65500000000000003}]},{"osd":2,"last update":"Tue Nov 28 18:43:35 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65700000000000003,"15min":0.65600000000000003},"min":{"1min":0.5,"5min":0.42699999999999999,"15min":0.38900000000000001},"max":{"1min":0.97299999999999998,"5min":0.99199999999999999,"15min":1.01},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.70899999999999996,"15min":0.69599999999999995},"min":{"1min":0.46400000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.86099999999999999,"5min":0.96899999999999997,"15min":1.0289999999999999},"last":0.80800000000000005}]},{"osd":3,"last update":"Tue Nov 28 18:43:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.49299999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.88,"5min":0.97399999999999998,"15min":1.097},"last":0.62},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68799999999999994,"15min":0.69699999999999995},"min":{"1min":0.55900000000000005,"5min":0.49399999999999999,"15min":0.44},"max":{"1min":0.83699999999999997,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.72799999999999998}]},{"osd":4,"last update":"Tue Nov 28 18:43:35 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.58099999999999996,"15min":0.64100000000000001},"min":{"1min":0.38500000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.69999999999999996,"5min":0.91700000000000004,"15min":1.1819999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.63400000000000001,"15min":0.66500000000000004},"min":{"1min":0.44500000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.85199999999999998,"5min":0.91100000000000003,"15min":1.163},"last":0.55900000000000005}]},{"osd":5,"last update":"Tue Nov 28 18:43:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.623,"15min":0.67100000000000004},"min":{"1min":0.42399999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.878,"5min":0.93300000000000005,"15min":1.052},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.747,"5min":0.72899999999999998,"15min":0.77900000000000003},"min":{"1min":0.55200000000000005,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.91400000000000003,"5min":0.99399999999999999,"15min":1.2290000000000001},"last":0.74399999999999999}]},{"osd":7,"last update":"Tue Nov 28 18:43:35 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.71199999999999997,"15min":0.755},"min":{"1min":0.52200000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93000000000000005,"5min":1.0149999999999999,"15min":1.2070000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72899999999999998,"15min":0.75900000000000001},"min":{"1min":0.50900000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.91000000000000003,"5min":1.032,"15min":1.131},"last":0.67100000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574930,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31880,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339960,"statfs":{"total":96636764160,"available":96604119040,"internally_reserved":0,"allocated":716800,"data_stored":297719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 18:43:31 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.63800000000000001,"15min":0.628},"min":{"1min":0.52000000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.86399999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.67900000000000005,"15min":0.68100000000000005},"min":{"1min":0.54500000000000004,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.90100000000000002,"5min":0.93500000000000005,"15min":0.94799999999999995},"last":0.496}]},{"osd":1,"last update":"Tue Nov 28 18:43:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.71999999999999997,"15min":0.72999999999999998},"min":{"1min":0.50800000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.93899999999999995,"5min":0.97199999999999998,"15min":1.073},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71099999999999997,"15min":0.72599999999999998},"min":{"1min":0.56999999999999995,"5min":0.48399999999999999,"15min":0.47099999999999997},"max":{"1min":0.875,"5min":0.96799999999999997,"15min":0.98099999999999998},"last":0.48099999999999998}]},{"osd":2,"last update":"Tue Nov 28 18:43:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.70999999999999996,"15min":0.70799999999999996},"min":{"1min":0.45400000000000001,"5min":0.45100000000000001,"15min":0.39400000000000002},"max":{"1min":0.94999999999999996,"5min":1.022,"15min":1.022},"last":0.621},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.72799999999999998,"15min":0.73999999999999999},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.45900000000000002},"max":{"1min":0.91200000000000003,"5min":0.98899999999999999,"15min":1.002},"last":0.60999999999999999}]},{"osd":3,"last update":"Tue Nov 28 18:43:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.72499999999999998,"15min":0.72999999999999998},"min":{"1min":0.52300000000000002,"5min":0.46300000000000002,"15min":0.44500000000000001},"max":{"1min":0.93400000000000005,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.75,"15min":0.77000000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.94099999999999995,"5min":0.97899999999999998,"15min":1.147},"last":0.71099999999999997}]},{"osd":4,"last update":"Tue Nov 28 18:43:31 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.61399999999999999,"15min":0.61899999999999999},"min":{"1min":0.42299999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.81699999999999995,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.66800000000000004,"15min":0.67600000000000005},"min":{"1min":0.48499999999999999,"5min":0.42799999999999999,"15min":0.41899999999999998},"max":{"1min":0.96399999999999997,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.46800000000000003}]},{"osd":6,"last update":"Tue Nov 28 18:43:31 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.65500000000000003,"15min":0.67600000000000005},"min":{"1min":0.47999999999999998,"5min":0.439,"15min":0.439},"max":{"1min":0.95199999999999996,"5min":1.026,"15min":1.026},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.68200000000000005,"15min":0.71899999999999997},"min":{"1min":0.505,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.873,"5min":0.97699999999999998,"15min":1.048},"last":0.40500000000000003}]},{"osd":7,"last update":"Tue Nov 28 18:43:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.72599999999999998,"15min":0.75},"min":{"1min":0.502,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.89200000000000002,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.748,"15min":0.79400000000000004},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.97499999999999998,"5min":1.0840000000000001,"15min":1.1200000000000001},"last":0.50900000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574931,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31888,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339952,"statfs":{"total":96636764160,"available":96604110848,"internally_reserved":0,"allocated":720896,"data_stored":298679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 18:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67200000000000004,"15min":0.63600000000000001},"min":{"1min":0.39800000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.93500000000000005,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.65300000000000002,"15min":0.78500000000000003},"min":{"1min":0.45700000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.91700000000000004,"5min":1.01,"15min":3.5179999999999998},"last":0.84999999999999998}]},{"osd":1,"last update":"Tue Nov 28 18:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.67900000000000005,"15min":0.80000000000000004},"min":{"1min":0.45500000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.83999999999999997,"5min":0.94399999999999995,"15min":3.5019999999999998},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.69099999999999995,"15min":0.81200000000000006},"min":{"1min":0.42599999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.91100000000000003,"5min":1.0640000000000001,"15min":3.5630000000000002},"last":0.89700000000000002}]},{"osd":2,"last update":"Tue Nov 28 18:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69899999999999995,"15min":0.80700000000000005},"min":{"1min":0.54800000000000004,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.91200000000000003,"5min":0.998,"15min":3.6709999999999998},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.71699999999999997,"15min":0.82499999999999996},"min":{"1min":0.53600000000000003,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.89400000000000002,"5min":1.018,"15min":3.4849999999999999},"last":0.93600000000000005}]},{"osd":3,"last update":"Tue Nov 28 18:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.68500000000000005,"15min":0.83699999999999997},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.82599999999999996,"5min":1.002,"15min":3.7130000000000001},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.72499999999999998,"15min":0.749},"min":{"1min":0.50600000000000001,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.95299999999999996,"5min":0.96499999999999997,"15min":0.98499999999999999},"last":0.87}]},{"osd":5,"last update":"Tue Nov 28 18:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.626,"15min":0.66000000000000003},"min":{"1min":0.43099999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.93999999999999995,"5min":1.05,"15min":1.05},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.63200000000000001,"15min":0.68400000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.82499999999999996,"5min":0.93700000000000006,"15min":0.95399999999999996},"last":0.53300000000000003}]},{"osd":6,"last update":"Tue Nov 28 18:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.64500000000000002,"15min":0.75900000000000001},"min":{"1min":0.47099999999999997,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.873,"5min":1.032,"15min":1.718},"last":0.627},{"interface":"front","average":{"1min":0.75,"5min":0.70599999999999996,"15min":0.75600000000000001},"min":{"1min":0.55400000000000005,"5min":0.441,"15min":0.441},"max":{"1min":0.93200000000000005,"5min":1.143,"15min":1.304},"last":0.66000000000000003}]},{"osd":7,"last update":"Tue Nov 28 18:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.66500000000000004,"15min":0.72899999999999998},"min":{"1min":0.501,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.86899999999999999,"5min":0.91800000000000004,"15min":1.0029999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.748,"5min":0.72099999999999997,"15min":0.80200000000000005},"min":{"1min":0.53000000000000003,"5min":0.504,"15min":0.504},"max":{"1min":0.99199999999999999,"5min":1.018,"15min":1.0329999999999999},"last":0.68200000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574931,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31880,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339960,"statfs":{"total":96636764160,"available":96604119040,"internally_reserved":0,"allocated":716800,"data_stored":297123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 18:43:32 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48299999999999998,"15min":0.442},"min":{"1min":0.32300000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.80700000000000005,"5min":2.4940000000000002,"15min":2.4940000000000002},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.501,"15min":0.48199999999999998},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.876,"5min":0.879,"15min":0.879},"last":0.35599999999999998}]},{"osd":1,"last update":"Tue Nov 28 18:43:32 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.50600000000000001,"15min":0.47099999999999997},"min":{"1min":0.30499999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.90200000000000002,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.436},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.57499999999999996,"15min":0.55000000000000004},"min":{"1min":0.39900000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.032,"5min":1.097,"15min":1.097},"last":0.50700000000000001}]},{"osd":2,"last update":"Tue Nov 28 18:43:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.59999999999999998,"15min":0.53600000000000003},"min":{"1min":0.38400000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.94899999999999995,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.374},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.61299999999999999,"15min":0.59299999999999997},"min":{"1min":0.41399999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.61199999999999999}]},{"osd":4,"last update":"Tue Nov 28 18:43:32 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.73399999999999999,"15min":0.76200000000000001},"min":{"1min":0.55200000000000005,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.093,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.76800000000000002,"15min":0.79200000000000004},"min":{"1min":0.505,"5min":0.504,"15min":0.504},"max":{"1min":0.98299999999999998,"5min":1.403,"15min":1.4990000000000001},"last":0.57799999999999996}]},{"osd":5,"last update":"Tue Nov 28 18:43:32 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.79900000000000004,"15min":0.81799999999999995},"min":{"1min":0.53900000000000003,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.26},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.79900000000000004,"15min":0.82499999999999996},"min":{"1min":0.60699999999999998,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.016,"5min":1.1339999999999999,"15min":1.2470000000000001},"last":0.56100000000000005}]},{"osd":6,"last update":"Tue Nov 28 18:43:32 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.78300000000000003,"15min":0.80700000000000005},"min":{"1min":0.64300000000000002,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.94899999999999995,"5min":1.371,"15min":1.4490000000000001},"last":0.629},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.77800000000000002,"15min":0.80600000000000005},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.171,"5min":1.171,"15min":1.377},"last":0.64800000000000002}]},{"osd":7,"last update":"Tue Nov 28 18:43:32 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.80900000000000005,"15min":0.82499999999999996},"min":{"1min":0.53200000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0149999999999999,"5min":1.155,"15min":1.169},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.82699999999999996,"15min":0.85099999999999998},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.008,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.52500000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574931,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31884,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339956,"statfs":{"total":96636764160,"available":96604114944,"internally_reserved":0,"allocated":716800,"data_stored":297123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 18:43:34 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.438,"15min":0.42999999999999999},"min":{"1min":0.28599999999999998,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.78300000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.48399999999999999,"15min":0.499},"min":{"1min":0.35999999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":1.589},"last":0.42299999999999999}]},{"osd":1,"last update":"Tue Nov 28 18:43:34 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.50600000000000001,"15min":0.48599999999999999},"min":{"1min":0.39300000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.85899999999999999,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.55400000000000005,"15min":0.53000000000000003},"min":{"1min":0.41499999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.90500000000000003,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.60699999999999998}]},{"osd":3,"last update":"Tue Nov 28 18:43:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.57999999999999996,"15min":0.56999999999999995},"min":{"1min":0.443,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.98499999999999999,"5min":1.0600000000000001,"15min":1.1879999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.57899999999999996,"15min":0.57699999999999996},"min":{"1min":0.45300000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.93600000000000005,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.56200000000000006}]},{"osd":4,"last update":"Tue Nov 28 18:43:34 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77500000000000002,"15min":0.755},"min":{"1min":0.61099999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.96199999999999997,"5min":1.167,"15min":1.167},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.748,"15min":0.748},"min":{"1min":0.58999999999999997,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0249999999999999,"5min":1.1279999999999999,"15min":1.665},"last":0.745}]},{"osd":5,"last update":"Tue Nov 28 18:43:34 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.77500000000000002,"15min":0.78000000000000003},"min":{"1min":0.60999999999999999,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.97999999999999998,"5min":1.2090000000000001,"15min":1.4099999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.78400000000000003,"15min":0.79400000000000004},"min":{"1min":0.58699999999999997,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.004,"5min":1.3029999999999999,"15min":1.4450000000000001},"last":0.80400000000000005}]},{"osd":6,"last update":"Tue Nov 28 18:43:34 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.77400000000000002,"15min":0.80100000000000005},"min":{"1min":0.57799999999999996,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0880000000000001,"5min":1.24,"15min":1.7070000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.78700000000000003,"15min":0.78300000000000003},"min":{"1min":0.67300000000000004,"5min":0.499,"15min":0.499},"max":{"1min":0.94499999999999995,"5min":1.1479999999999999,"15min":1.4950000000000001},"last":0.77900000000000003}]},{"osd":7,"last update":"Tue Nov 28 18:43:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.78600000000000003,"15min":0.78700000000000003},"min":{"1min":0.621,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.123,"5min":1.3180000000000001,"15min":1.7509999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.81999999999999995,"15min":0.81799999999999995},"min":{"1min":0.63600000000000001,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.0369999999999999,"5min":1.2729999999999999,"15min":1.341},"last":0.877}]}]},{"osd":1,"up_from":13,"seq":55834574931,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31876,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339964,"statfs":{"total":96636764160,"available":96604123136,"internally_reserved":0,"allocated":712704,"data_stored":297157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 18:43:31 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.44600000000000001,"15min":0.55700000000000005},"min":{"1min":0.313,"5min":0.255,"15min":0.255},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":2.2090000000000001},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.48999999999999999,"15min":0.67200000000000004},"min":{"1min":0.33200000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.89200000000000002,"5min":0.96499999999999997,"15min":4.0899999999999999},"last":0.379}]},{"osd":2,"last update":"Tue Nov 28 18:43:31 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.498,"15min":0.60999999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.77300000000000002,"5min":0.872,"15min":3.8620000000000001},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.55100000000000005,"15min":0.68700000000000006},"min":{"1min":0.371,"5min":0.309,"15min":0.309},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":2.823},"last":0.40200000000000002}]},{"osd":3,"last update":"Tue Nov 28 18:43:31 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.59199999999999997,"15min":0.70999999999999996},"min":{"1min":0.41899999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.89900000000000002,"5min":0.93899999999999995,"15min":4.0739999999999998},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.64500000000000002,"15min":0.80500000000000005},"min":{"1min":0.499,"5min":0.47699999999999998,"15min":0.44800000000000001},"max":{"1min":0.97799999999999998,"5min":0.995,"15min":3.6659999999999999},"last":0.65000000000000002}]},{"osd":4,"last update":"Tue Nov 28 18:43:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72599999999999998,"15min":0.94699999999999995},"min":{"1min":0.61499999999999999,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.96099999999999997,"5min":1.1399999999999999,"15min":5.3540000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.75,"15min":0.90900000000000003},"min":{"1min":0.495,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.97999999999999998,"5min":1.2769999999999999,"15min":5.5},"last":0.54400000000000004}]},{"osd":5,"last update":"Tue Nov 28 18:43:31 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.78300000000000003,"15min":0.99299999999999999},"min":{"1min":0.55300000000000005,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.002,"5min":1.347,"15min":5.4379999999999997},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.82199999999999995,"15min":1.026},"min":{"1min":0.57899999999999996,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.077,"5min":1.204,"15min":3.4500000000000002},"last":0.61099999999999999}]},{"osd":6,"last update":"Tue Nov 28 18:43:31 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.84299999999999997,"15min":0.98099999999999998},"min":{"1min":0.70199999999999996,"5min":0.58799999999999997,"15min":0.54500000000000004},"max":{"1min":1.0720000000000001,"5min":1.367,"15min":3.0369999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79600000000000004,"15min":0.99299999999999999},"min":{"1min":0.59499999999999997,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.032,"5min":1.3100000000000001,"15min":5.4000000000000004},"last":0.63}]},{"osd":7,"last update":"Tue Nov 28 18:43:31 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.79400000000000004,"15min":0.97799999999999998},"min":{"1min":0.53500000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.014,"5min":1.331,"15min":5.5369999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.85799999999999998,"15min":1.0249999999999999},"min":{"1min":0.74199999999999999,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.044,"5min":1.4079999999999999,"15min":3.2480000000000002},"last":0.55300000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574932,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32468,"kb_used_data":1288,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339372,"statfs":{"total":96636764160,"available":96603516928,"internally_reserved":0,"allocated":1318912,"data_stored":889629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 18:43:33 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.45600000000000002,"15min":0.41599999999999998},"min":{"1min":0.30199999999999999,"5min":0.253,"15min":0.253},"max":{"1min":0.65400000000000003,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.51700000000000002,"15min":0.47299999999999998},"min":{"1min":0.316,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.82899999999999996,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.51100000000000001}]},{"osd":2,"last update":"Tue Nov 28 18:43:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.54600000000000004,"15min":0.501},"min":{"1min":0.36299999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.89700000000000002,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.54400000000000004,"15min":0.51600000000000001},"min":{"1min":0.35699999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.94599999999999995,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.59399999999999997}]},{"osd":3,"last update":"Tue Nov 28 18:43:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.54900000000000004,"15min":0.497},"min":{"1min":0.37,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.60099999999999998,"15min":0.56499999999999995},"min":{"1min":0.47299999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.46100000000000002}]},{"osd":4,"last update":"Tue Nov 28 18:43:33 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.79000000000000004,"15min":0.754},"min":{"1min":0.59799999999999998,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.81499999999999995,"15min":0.77200000000000002},"min":{"1min":0.64000000000000001,"5min":0.56999999999999995,"15min":0.55500000000000005},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.96399999999999997}]},{"osd":5,"last update":"Tue Nov 28 18:43:33 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.77700000000000002,"15min":0.75600000000000001},"min":{"1min":0.57799999999999996,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.76200000000000001,"15min":0.73799999999999999},"min":{"1min":0.65900000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0269999999999999},"last":0.86099999999999999}]},{"osd":6,"last update":"Tue Nov 28 18:43:33 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.78300000000000003,"15min":0.77300000000000002},"min":{"1min":0.61199999999999999,"5min":0.56000000000000005,"15min":0.54900000000000004},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.76500000000000001,"15min":0.76400000000000001},"min":{"1min":0.66900000000000004,"5min":0.498,"15min":0.498},"max":{"1min":1.222,"5min":1.222,"15min":1.3420000000000001},"last":0.876}]},{"osd":7,"last update":"Tue Nov 28 18:43:33 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81100000000000005,"15min":0.81200000000000006},"min":{"1min":0.64000000000000001,"5min":0.57799999999999996,"15min":0.57299999999999995},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.68999999999999995,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.91900000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T18:44:03.388 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T18:44:03.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.566+0000 7fbb8526b640 1 Processor -- start 2023-11-28T18:44:03.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.566+0000 7fbb8526b640 1 -- start start 2023-11-28T18:44:03.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.566+0000 7fbb8526b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbb8015e430 0x7fbb800b2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:03.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.566+0000 7fbb8526b640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb80146fe0 con 0x7fbb800b30f0 2023-11-28T18:44:03.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.566+0000 7fbb8526b640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb8015e8b0 con 0x7fbb80146c00 2023-11-28T18:44:03.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.566+0000 7fbb8526b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb800b3580 con 0x7fbb8015e430 2023-11-28T18:44:03.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.566+0000 7fbb7f7fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fbb800b30f0 0x7fbb80160f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47288/0 (socket says 172.21.15.45:47288) 2023-11-28T18:44:03.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.566+0000 7fbb7f7fe640 1 -- 172.21.15.45:0/1112198757 learned_addr learned my addr 172.21.15.45:0/1112198757 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:44:03.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.566+0000 7fbb767fc640 1 --2- 172.21.15.45:0/1112198757 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbb8015e430 0x7fbb800b2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:03.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.566+0000 7fbb7e7fc640 1 -- 172.21.15.45:0/1112198757 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 969757996 0 0) 0x7fbb80146fe0 con 0x7fbb800b30f0 2023-11-28T18:44:03.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.566+0000 7fbb7e7fc640 1 -- 172.21.15.45:0/1112198757 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb6c003530 con 0x7fbb800b30f0 2023-11-28T18:44:03.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.570+0000 7fbb7e7fc640 1 -- 172.21.15.45:0/1112198757 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2667171742 0 0) 0x7fbb8015e8b0 con 0x7fbb80146c00 2023-11-28T18:44:03.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.570+0000 7fbb7e7fc640 1 -- 172.21.15.45:0/1112198757 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb80146fe0 con 0x7fbb80146c00 2023-11-28T18:44:03.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.570+0000 7fbb7e7fc640 1 -- 172.21.15.45:0/1112198757 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4261280677 0 0) 0x7fbb6c003530 con 0x7fbb800b30f0 2023-11-28T18:44:03.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.570+0000 7fbb767fc640 1 -- 172.21.15.45:0/1112198757 >> v1:172.21.15.190:6789/0 conn(0x7fbb80146c00 legacy=0x7fbb8006e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:03.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.570+0000 7fbb767fc640 1 -- 172.21.15.45:0/1112198757 >> v1:172.21.15.45:6789/0 conn(0x7fbb800b30f0 legacy=0x7fbb80160f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:03.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.570+0000 7fbb767fc640 1 -- 172.21.15.45:0/1112198757 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb8006f390 con 0x7fbb8015e430 2023-11-28T18:44:03.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.570+0000 7fbb767fc640 1 --2- 172.21.15.45:0/1112198757 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbb8015e430 0x7fbb800b2bb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbb68009dc0 tx=0x7fbb6801c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a590b18666ad99c0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:44:03.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.570+0000 7fbb7e7fc640 1 -- 172.21.15.45:0/1112198757 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb78001680 con 0x7fbb8015e430 2023-11-28T18:44:03.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.570+0000 7fbb7e7fc640 1 -- 172.21.15.45:0/1112198757 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb680a56a0 con 0x7fbb8015e430 2023-11-28T18:44:03.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.570+0000 7fbb7e7fc640 1 -- 172.21.15.45:0/1112198757 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb680a5a30 con 0x7fbb8015e430 2023-11-28T18:44:03.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.570+0000 7fbb8526b640 1 -- 172.21.15.45:0/1112198757 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbb8015e430 msgr2=0x7fbb800b2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:03.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.570+0000 7fbb8526b640 1 --2- 172.21.15.45:0/1112198757 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbb8015e430 0x7fbb800b2bb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbb68009dc0 tx=0x7fbb6801c860 comp rx=0 tx=0).stop 2023-11-28T18:44:03.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.570+0000 7fbb8526b640 1 -- 172.21.15.45:0/1112198757 shutdown_connections 2023-11-28T18:44:03.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.574+0000 7fbb8526b640 1 --2- 172.21.15.45:0/1112198757 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbb8015e430 0x7fbb800b2bb0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:03.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.574+0000 7fbb8526b640 1 -- 172.21.15.45:0/1112198757 >> 172.21.15.45:0/1112198757 conn(0x7fbb8006a570 msgr2=0x7fbb8006a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:44:03.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.574+0000 7fbb8526b640 1 -- 172.21.15.45:0/1112198757 shutdown_connections 2023-11-28T18:44:03.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.574+0000 7fbb8526b640 1 -- 172.21.15.45:0/1112198757 wait complete. 2023-11-28T18:44:03.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.574+0000 7fbb8526b640 1 Processor -- start 2023-11-28T18:44:03.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.574+0000 7fbb8526b640 1 -- start start 2023-11-28T18:44:03.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.574+0000 7fbb8526b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb800b30f0 0x7fbb80158b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:03.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.574+0000 7fbb8526b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbb80146c00 0x7fbb80157d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:03.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.574+0000 7fbb8526b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbb8015e430 0x7fbb80158240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:03.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.574+0000 7fbb8526b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8015eac0 con 0x7fbb800b30f0 2023-11-28T18:44:03.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.574+0000 7fbb8526b640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb800b2200 con 0x7fbb8015e430 2023-11-28T18:44:03.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.574+0000 7fbb8526b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb800b24e0 con 0x7fbb80146c00 2023-11-28T18:44:03.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.574+0000 7fbb7effd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb800b30f0 0x7fbb80158b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:03.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.574+0000 7fbb7effd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb800b30f0 0x7fbb80158b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56260/0 (socket says 172.21.15.45:56260) 2023-11-28T18:44:03.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.574+0000 7fbb7effd640 1 -- 172.21.15.45:0/3782571648 learned_addr learned my addr 172.21.15.45:0/3782571648 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:44:03.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.574+0000 7fbb767fc640 1 --2- 172.21.15.45:0/3782571648 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbb80146c00 0x7fbb80157d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:03.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.574+0000 7fbb7f7fe640 1 --2- 172.21.15.45:0/3782571648 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbb8015e430 0x7fbb80158240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:03.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.574+0000 7fbb7effd640 1 -- 172.21.15.45:0/3782571648 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbb80146c00 msgr2=0x7fbb80157d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:03.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.574+0000 7fbb7effd640 1 --2- 172.21.15.45:0/3782571648 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbb80146c00 0x7fbb80157d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:03.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.574+0000 7fbb7effd640 1 -- 172.21.15.45:0/3782571648 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbb8015e430 msgr2=0x7fbb80158240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:03.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.574+0000 7fbb7effd640 1 --2- 172.21.15.45:0/3782571648 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbb8015e430 0x7fbb80158240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:03.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.574+0000 7fbb7effd640 1 -- 172.21.15.45:0/3782571648 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb68009a70 con 0x7fbb800b30f0 2023-11-28T18:44:03.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.574+0000 7fbb767fc640 1 --2- 172.21.15.45:0/3782571648 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbb80146c00 0x7fbb80157d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:44:03.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.574+0000 7fbb7effd640 1 --2- 172.21.15.45:0/3782571648 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb800b30f0 0x7fbb80158b60 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fbb7000c490 tx=0x7fbb7000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:44:03.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.578+0000 7fbb77fff640 1 -- 172.21.15.45:0/3782571648 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb700052d0 con 0x7fbb800b30f0 2023-11-28T18:44:03.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.578+0000 7fbb77fff640 1 -- 172.21.15.45:0/3782571648 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb70005430 con 0x7fbb800b30f0 2023-11-28T18:44:03.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.578+0000 7fbb8526b640 1 -- 172.21.15.45:0/3782571648 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb800b27c0 con 0x7fbb800b30f0 2023-11-28T18:44:03.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.578+0000 7fbb77fff640 1 -- 172.21.15.45:0/3782571648 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb70012870 con 0x7fbb800b30f0 2023-11-28T18:44:03.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.578+0000 7fbb8526b640 1 -- 172.21.15.45:0/3782571648 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb801590a0 con 0x7fbb800b30f0 2023-11-28T18:44:03.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.578+0000 7fbb8526b640 1 -- 172.21.15.45:0/3782571648 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb8015ec30 con 0x7fbb800b30f0 2023-11-28T18:44:03.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.578+0000 7fbb77fff640 1 -- 172.21.15.45:0/3782571648 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fbb700129d0 con 0x7fbb800b30f0 2023-11-28T18:44:03.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.578+0000 7fbb77fff640 1 --2- 172.21.15.45:0/3782571648 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbb600668d0 0x7fbb60068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:03.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.578+0000 7fbb77fff640 1 -- 172.21.15.45:0/3782571648 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbb70083ff0 con 0x7fbb800b30f0 2023-11-28T18:44:03.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.578+0000 7fbb767fc640 1 --2- 172.21.15.45:0/3782571648 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbb600668d0 0x7fbb60068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:03.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.582+0000 7fbb767fc640 1 --2- 172.21.15.45:0/3782571648 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbb600668d0 0x7fbb60068d90 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fbb680af000 tx=0x7fbb680a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:44:03.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.582+0000 7fbb77fff640 1 -- 172.21.15.45:0/3782571648 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbb700b5280 con 0x7fbb800b30f0 2023-11-28T18:44:03.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.738+0000 7fbb8526b640 1 -- 172.21.15.45:0/3782571648 --> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbb800cad00 con 0x7fbb600668d0 2023-11-28T18:44:03.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.746+0000 7fbb77fff640 1 -- 172.21.15.45:0/3782571648 <== mgr.4100 v2:172.21.15.190:6832/645101166 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288973 (secure 0 0 0) 0x7fbb680be090 con 0x7fbb600668d0 2023-11-28T18:44:03.749 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:44:03.751 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-11-28T18:44:03.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.750+0000 7fbb8526b640 1 -- 172.21.15.45:0/3782571648 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbb600668d0 msgr2=0x7fbb60068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:03.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.750+0000 7fbb8526b640 1 --2- 172.21.15.45:0/3782571648 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbb600668d0 0x7fbb60068d90 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fbb680af000 tx=0x7fbb680a7070 comp rx=0 tx=0).stop 2023-11-28T18:44:03.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.750+0000 7fbb8526b640 1 -- 172.21.15.45:0/3782571648 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb800b30f0 msgr2=0x7fbb80158b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:03.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.750+0000 7fbb8526b640 1 --2- 172.21.15.45:0/3782571648 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb800b30f0 0x7fbb80158b60 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fbb7000c490 tx=0x7fbb7000c950 comp rx=0 tx=0).stop 2023-11-28T18:44:03.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.750+0000 7fbb8526b640 1 -- 172.21.15.45:0/3782571648 shutdown_connections 2023-11-28T18:44:03.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.750+0000 7fbb8526b640 1 --2- 172.21.15.45:0/3782571648 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fbb600668d0 0x7fbb60068d90 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:03.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.750+0000 7fbb8526b640 1 --2- 172.21.15.45:0/3782571648 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbb8015e430 0x7fbb80158240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:03.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.750+0000 7fbb8526b640 1 --2- 172.21.15.45:0/3782571648 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbb80146c00 0x7fbb80157d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:03.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.750+0000 7fbb8526b640 1 --2- 172.21.15.45:0/3782571648 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb800b30f0 0x7fbb80158b60 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:03.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.750+0000 7fbb8526b640 1 -- 172.21.15.45:0/3782571648 >> 172.21.15.45:0/3782571648 conn(0x7fbb8006a570 msgr2=0x7fbb800cba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:44:03.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.750+0000 7fbb8526b640 1 -- 172.21.15.45:0/3782571648 shutdown_connections 2023-11-28T18:44:03.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.750+0000 7fbb8526b640 1 -- 172.21.15.45:0/3782571648 wait complete. 2023-11-28T18:44:03.770 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":255,"stamp":"2023-11-28T18:44:03.330674+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":141,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":256212,"kb_used_data":6760,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754718508,"statfs":{"total":773094113280,"available":772831752192,"internally_reserved":0,"allocated":6922240,"data_stored":3562092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001602"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.295736+0000","last_change":"2023-11-28T18:43:59.286942+0000","last_active":"2023-11-28T18:43:59.295736+0000","last_peered":"2023-11-28T18:43:59.295736+0000","last_clean":"2023-11-28T18:43:59.295736+0000","last_became_active":"2023-11-28T18:43:59.286674+0000","last_became_peered":"2023-11-28T18:43:59.286674+0000","last_unstale":"2023-11-28T18:43:59.295736+0000","last_undegraded":"2023-11-28T18:43:59.295736+0000","last_fullsized":"2023-11-28T18:43:59.295736+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:08:51.579521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.277760+0000","last_change":"2023-11-28T18:43:59.303931+0000","last_active":"2023-11-28T18:44:00.277760+0000","last_peered":"2023-11-28T18:44:00.277760+0000","last_clean":"2023-11-28T18:44:00.277760+0000","last_became_active":"2023-11-28T18:43:59.303644+0000","last_became_peered":"2023-11-28T18:43:59.303644+0000","last_unstale":"2023-11-28T18:44:00.277760+0000","last_undegraded":"2023-11-28T18:44:00.277760+0000","last_fullsized":"2023-11-28T18:44:00.277760+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:10:07.258819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.299878+0000","last_change":"2023-11-28T18:43:59.295908+0000","last_active":"2023-11-28T18:43:59.299878+0000","last_peered":"2023-11-28T18:43:59.299878+0000","last_clean":"2023-11-28T18:43:59.299878+0000","last_became_active":"2023-11-28T18:43:59.295625+0000","last_became_peered":"2023-11-28T18:43:59.295625+0000","last_unstale":"2023-11-28T18:43:59.299878+0000","last_undegraded":"2023-11-28T18:43:59.299878+0000","last_fullsized":"2023-11-28T18:43:59.299878+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:30:46.046412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.281350+0000","last_change":"2023-11-28T18:43:59.286232+0000","last_active":"2023-11-28T18:44:00.281350+0000","last_peered":"2023-11-28T18:44:00.281350+0000","last_clean":"2023-11-28T18:44:00.281350+0000","last_became_active":"2023-11-28T18:43:59.285674+0000","last_became_peered":"2023-11-28T18:43:59.285674+0000","last_unstale":"2023-11-28T18:44:00.281350+0000","last_undegraded":"2023-11-28T18:44:00.281350+0000","last_fullsized":"2023-11-28T18:44:00.281350+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:51:42.154474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.293750+0000","last_change":"2023-11-28T18:43:59.283079+0000","last_active":"2023-11-28T18:43:59.293750+0000","last_peered":"2023-11-28T18:43:59.293750+0000","last_clean":"2023-11-28T18:43:59.293750+0000","last_became_active":"2023-11-28T18:43:59.282807+0000","last_became_peered":"2023-11-28T18:43:59.282807+0000","last_unstale":"2023-11-28T18:43:59.293750+0000","last_undegraded":"2023-11-28T18:43:59.293750+0000","last_fullsized":"2023-11-28T18:43:59.293750+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:33:17.779178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.299629+0000","last_change":"2023-11-28T18:43:59.294848+0000","last_active":"2023-11-28T18:43:59.299629+0000","last_peered":"2023-11-28T18:43:59.299629+0000","last_clean":"2023-11-28T18:43:59.299629+0000","last_became_active":"2023-11-28T18:43:59.294585+0000","last_became_peered":"2023-11-28T18:43:59.294585+0000","last_unstale":"2023-11-28T18:43:59.299629+0000","last_undegraded":"2023-11-28T18:43:59.299629+0000","last_fullsized":"2023-11-28T18:43:59.299629+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:17:06.124969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.280246+0000","last_change":"2023-11-28T18:43:59.273918+0000","last_active":"2023-11-28T18:44:00.280246+0000","last_peered":"2023-11-28T18:44:00.280246+0000","last_clean":"2023-11-28T18:44:00.280246+0000","last_became_active":"2023-11-28T18:43:59.273619+0000","last_became_peered":"2023-11-28T18:43:59.273619+0000","last_unstale":"2023-11-28T18:44:00.280246+0000","last_undegraded":"2023-11-28T18:44:00.280246+0000","last_fullsized":"2023-11-28T18:44:00.280246+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:23:02.291448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.277256+0000","last_change":"2023-11-28T18:43:59.289656+0000","last_active":"2023-11-28T18:44:00.277256+0000","last_peered":"2023-11-28T18:44:00.277256+0000","last_clean":"2023-11-28T18:44:00.277256+0000","last_became_active":"2023-11-28T18:43:59.289391+0000","last_became_peered":"2023-11-28T18:43:59.289391+0000","last_unstale":"2023-11-28T18:44:00.277256+0000","last_undegraded":"2023-11-28T18:44:00.277256+0000","last_fullsized":"2023-11-28T18:44:00.277256+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:15:28.453340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.280664+0000","last_change":"2023-11-28T18:43:59.285680+0000","last_active":"2023-11-28T18:44:00.280664+0000","last_peered":"2023-11-28T18:44:00.280664+0000","last_clean":"2023-11-28T18:44:00.280664+0000","last_became_active":"2023-11-28T18:43:59.285364+0000","last_became_peered":"2023-11-28T18:43:59.285364+0000","last_unstale":"2023-11-28T18:44:00.280664+0000","last_undegraded":"2023-11-28T18:44:00.280664+0000","last_fullsized":"2023-11-28T18:44:00.280664+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:48:59.882919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.292632+0000","last_change":"2023-11-28T18:43:59.285728+0000","last_active":"2023-11-28T18:43:59.292632+0000","last_peered":"2023-11-28T18:43:59.292632+0000","last_clean":"2023-11-28T18:43:59.292632+0000","last_became_active":"2023-11-28T18:43:59.285454+0000","last_became_peered":"2023-11-28T18:43:59.285454+0000","last_unstale":"2023-11-28T18:43:59.292632+0000","last_undegraded":"2023-11-28T18:43:59.292632+0000","last_fullsized":"2023-11-28T18:43:59.292632+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:48:38.128338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.295578+0000","last_change":"2023-11-28T18:43:59.292100+0000","last_active":"2023-11-28T18:43:59.295578+0000","last_peered":"2023-11-28T18:43:59.295578+0000","last_clean":"2023-11-28T18:43:59.295578+0000","last_became_active":"2023-11-28T18:43:59.291821+0000","last_became_peered":"2023-11-28T18:43:59.291821+0000","last_unstale":"2023-11-28T18:43:59.295578+0000","last_undegraded":"2023-11-28T18:43:59.295578+0000","last_fullsized":"2023-11-28T18:43:59.295578+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:44:07.880942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.281344+0000","last_change":"2023-11-28T18:43:59.287912+0000","last_active":"2023-11-28T18:44:00.281344+0000","last_peered":"2023-11-28T18:44:00.281344+0000","last_clean":"2023-11-28T18:44:00.281344+0000","last_became_active":"2023-11-28T18:43:59.287611+0000","last_became_peered":"2023-11-28T18:43:59.287611+0000","last_unstale":"2023-11-28T18:44:00.281344+0000","last_undegraded":"2023-11-28T18:44:00.281344+0000","last_fullsized":"2023-11-28T18:44:00.281344+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:48:38.871672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.293034+0000","last_change":"2023-11-28T18:43:59.282916+0000","last_active":"2023-11-28T18:43:59.293034+0000","last_peered":"2023-11-28T18:43:59.293034+0000","last_clean":"2023-11-28T18:43:59.293034+0000","last_became_active":"2023-11-28T18:43:59.282596+0000","last_became_peered":"2023-11-28T18:43:59.282596+0000","last_unstale":"2023-11-28T18:43:59.293034+0000","last_undegraded":"2023-11-28T18:43:59.293034+0000","last_fullsized":"2023-11-28T18:43:59.293034+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:48:38.128338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.280529+0000","last_change":"2023-11-28T18:43:59.288637+0000","last_active":"2023-11-28T18:44:00.280529+0000","last_peered":"2023-11-28T18:44:00.280529+0000","last_clean":"2023-11-28T18:44:00.280529+0000","last_became_active":"2023-11-28T18:43:59.288316+0000","last_became_peered":"2023-11-28T18:43:59.288316+0000","last_unstale":"2023-11-28T18:44:00.280529+0000","last_undegraded":"2023-11-28T18:44:00.280529+0000","last_fullsized":"2023-11-28T18:44:00.280529+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:30:44.379096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.280410+0000","last_change":"2023-11-28T18:43:59.287850+0000","last_active":"2023-11-28T18:44:00.280410+0000","last_peered":"2023-11-28T18:44:00.280410+0000","last_clean":"2023-11-28T18:44:00.280410+0000","last_became_active":"2023-11-28T18:43:59.287514+0000","last_became_peered":"2023-11-28T18:43:59.287514+0000","last_unstale":"2023-11-28T18:44:00.280410+0000","last_undegraded":"2023-11-28T18:44:00.280410+0000","last_fullsized":"2023-11-28T18:44:00.280410+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:17:06.124969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.291840+0000","last_change":"2023-11-28T18:43:59.284192+0000","last_active":"2023-11-28T18:43:59.291840+0000","last_peered":"2023-11-28T18:43:59.291840+0000","last_clean":"2023-11-28T18:43:59.291840+0000","last_became_active":"2023-11-28T18:43:59.283762+0000","last_became_peered":"2023-11-28T18:43:59.283762+0000","last_unstale":"2023-11-28T18:43:59.291840+0000","last_undegraded":"2023-11-28T18:43:59.291840+0000","last_fullsized":"2023-11-28T18:43:59.291840+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:15:13.056963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.277578+0000","last_change":"2023-11-28T18:43:59.295949+0000","last_active":"2023-11-28T18:44:00.277578+0000","last_peered":"2023-11-28T18:44:00.277578+0000","last_clean":"2023-11-28T18:44:00.277578+0000","last_became_active":"2023-11-28T18:43:59.295644+0000","last_became_peered":"2023-11-28T18:43:59.295644+0000","last_unstale":"2023-11-28T18:44:00.277578+0000","last_undegraded":"2023-11-28T18:44:00.277578+0000","last_fullsized":"2023-11-28T18:44:00.277578+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:16:36.805137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.299580+0000","last_change":"2023-11-28T18:43:59.292726+0000","last_active":"2023-11-28T18:43:59.299580+0000","last_peered":"2023-11-28T18:43:59.299580+0000","last_clean":"2023-11-28T18:43:59.299580+0000","last_became_active":"2023-11-28T18:43:59.292424+0000","last_became_peered":"2023-11-28T18:43:59.292424+0000","last_unstale":"2023-11-28T18:43:59.299580+0000","last_undegraded":"2023-11-28T18:43:59.299580+0000","last_fullsized":"2023-11-28T18:43:59.299580+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:23:42.919325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.293183+0000","last_change":"2023-11-28T18:43:59.281357+0000","last_active":"2023-11-28T18:43:59.293183+0000","last_peered":"2023-11-28T18:43:59.293183+0000","last_clean":"2023-11-28T18:43:59.293183+0000","last_became_active":"2023-11-28T18:43:59.281077+0000","last_became_peered":"2023-11-28T18:43:59.281077+0000","last_unstale":"2023-11-28T18:43:59.293183+0000","last_undegraded":"2023-11-28T18:43:59.293183+0000","last_fullsized":"2023-11-28T18:43:59.293183+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:03:45.953094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.277531+0000","last_change":"2023-11-28T18:43:59.304270+0000","last_active":"2023-11-28T18:44:00.277531+0000","last_peered":"2023-11-28T18:44:00.277531+0000","last_clean":"2023-11-28T18:44:00.277531+0000","last_became_active":"2023-11-28T18:43:59.302827+0000","last_became_peered":"2023-11-28T18:43:59.302827+0000","last_unstale":"2023-11-28T18:44:00.277531+0000","last_undegraded":"2023-11-28T18:44:00.277531+0000","last_fullsized":"2023-11-28T18:44:00.277531+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:50:47.546997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.300295+0000","last_change":"2023-11-28T18:43:59.294174+0000","last_active":"2023-11-28T18:43:59.300295+0000","last_peered":"2023-11-28T18:43:59.300295+0000","last_clean":"2023-11-28T18:43:59.300295+0000","last_became_active":"2023-11-28T18:43:59.293892+0000","last_became_peered":"2023-11-28T18:43:59.293892+0000","last_unstale":"2023-11-28T18:43:59.300295+0000","last_undegraded":"2023-11-28T18:43:59.300295+0000","last_fullsized":"2023-11-28T18:43:59.300295+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:45:26.433437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.277478+0000","last_change":"2023-11-28T18:43:59.302416+0000","last_active":"2023-11-28T18:44:00.277478+0000","last_peered":"2023-11-28T18:44:00.277478+0000","last_clean":"2023-11-28T18:44:00.277478+0000","last_became_active":"2023-11-28T18:43:59.301404+0000","last_became_peered":"2023-11-28T18:43:59.301404+0000","last_unstale":"2023-11-28T18:44:00.277478+0000","last_undegraded":"2023-11-28T18:44:00.277478+0000","last_fullsized":"2023-11-28T18:44:00.277478+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:26:39.306000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.299702+0000","last_change":"2023-11-28T18:43:59.294010+0000","last_active":"2023-11-28T18:43:59.299702+0000","last_peered":"2023-11-28T18:43:59.299702+0000","last_clean":"2023-11-28T18:43:59.299702+0000","last_became_active":"2023-11-28T18:43:59.293725+0000","last_became_peered":"2023-11-28T18:43:59.293725+0000","last_unstale":"2023-11-28T18:43:59.299702+0000","last_undegraded":"2023-11-28T18:43:59.299702+0000","last_fullsized":"2023-11-28T18:43:59.299702+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:38:08.605608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.293129+0000","last_change":"2023-11-28T18:43:59.283645+0000","last_active":"2023-11-28T18:43:59.293129+0000","last_peered":"2023-11-28T18:43:59.293129+0000","last_clean":"2023-11-28T18:43:59.293129+0000","last_became_active":"2023-11-28T18:43:59.282041+0000","last_became_peered":"2023-11-28T18:43:59.282041+0000","last_unstale":"2023-11-28T18:43:59.293129+0000","last_undegraded":"2023-11-28T18:43:59.293129+0000","last_fullsized":"2023-11-28T18:43:59.293129+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:27:07.292895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.298074+0000","last_change":"2023-11-28T18:43:59.293589+0000","last_active":"2023-11-28T18:43:59.298074+0000","last_peered":"2023-11-28T18:43:59.298074+0000","last_clean":"2023-11-28T18:43:59.298074+0000","last_became_active":"2023-11-28T18:43:59.293300+0000","last_became_peered":"2023-11-28T18:43:59.293300+0000","last_unstale":"2023-11-28T18:43:59.298074+0000","last_undegraded":"2023-11-28T18:43:59.298074+0000","last_fullsized":"2023-11-28T18:43:59.298074+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:09:56.919478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.281550+0000","last_change":"2023-11-28T18:43:59.277345+0000","last_active":"2023-11-28T18:44:00.281550+0000","last_peered":"2023-11-28T18:44:00.281550+0000","last_clean":"2023-11-28T18:44:00.281550+0000","last_became_active":"2023-11-28T18:43:59.277022+0000","last_became_peered":"2023-11-28T18:43:59.277022+0000","last_unstale":"2023-11-28T18:44:00.281550+0000","last_undegraded":"2023-11-28T18:44:00.281550+0000","last_fullsized":"2023-11-28T18:44:00.281550+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:28:59.636189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.295712+0000","last_change":"2023-11-28T18:43:59.286510+0000","last_active":"2023-11-28T18:43:59.295712+0000","last_peered":"2023-11-28T18:43:59.295712+0000","last_clean":"2023-11-28T18:43:59.295712+0000","last_became_active":"2023-11-28T18:43:59.286244+0000","last_became_peered":"2023-11-28T18:43:59.286244+0000","last_unstale":"2023-11-28T18:43:59.295712+0000","last_undegraded":"2023-11-28T18:43:59.295712+0000","last_fullsized":"2023-11-28T18:43:59.295712+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:57.543750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.294913+0000","last_change":"2023-11-28T18:43:59.281331+0000","last_active":"2023-11-28T18:43:59.294913+0000","last_peered":"2023-11-28T18:43:59.294913+0000","last_clean":"2023-11-28T18:43:59.294913+0000","last_became_active":"2023-11-28T18:43:59.281032+0000","last_became_peered":"2023-11-28T18:43:59.281032+0000","last_unstale":"2023-11-28T18:43:59.294913+0000","last_undegraded":"2023-11-28T18:43:59.294913+0000","last_fullsized":"2023-11-28T18:43:59.294913+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:50:32.538521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.277814+0000","last_change":"2023-11-28T18:43:59.301506+0000","last_active":"2023-11-28T18:44:00.277814+0000","last_peered":"2023-11-28T18:44:00.277814+0000","last_clean":"2023-11-28T18:44:00.277814+0000","last_became_active":"2023-11-28T18:43:59.300186+0000","last_became_peered":"2023-11-28T18:43:59.300186+0000","last_unstale":"2023-11-28T18:44:00.277814+0000","last_undegraded":"2023-11-28T18:44:00.277814+0000","last_fullsized":"2023-11-28T18:44:00.277814+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:42:17.493004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.299642+0000","last_change":"2023-11-28T18:43:59.292027+0000","last_active":"2023-11-28T18:43:59.299642+0000","last_peered":"2023-11-28T18:43:59.299642+0000","last_clean":"2023-11-28T18:43:59.299642+0000","last_became_active":"2023-11-28T18:43:59.290681+0000","last_became_peered":"2023-11-28T18:43:59.290681+0000","last_unstale":"2023-11-28T18:43:59.299642+0000","last_undegraded":"2023-11-28T18:43:59.299642+0000","last_fullsized":"2023-11-28T18:43:59.299642+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:58:06.281969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.298976+0000","last_change":"2023-11-28T18:43:59.293857+0000","last_active":"2023-11-28T18:43:59.298976+0000","last_peered":"2023-11-28T18:43:59.298976+0000","last_clean":"2023-11-28T18:43:59.298976+0000","last_became_active":"2023-11-28T18:43:59.293413+0000","last_became_peered":"2023-11-28T18:43:59.293413+0000","last_unstale":"2023-11-28T18:43:59.298976+0000","last_undegraded":"2023-11-28T18:43:59.298976+0000","last_fullsized":"2023-11-28T18:43:59.298976+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:40:43.573310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.299035+0000","last_change":"2023-11-28T18:43:59.291978+0000","last_active":"2023-11-28T18:43:59.299035+0000","last_peered":"2023-11-28T18:43:59.299035+0000","last_clean":"2023-11-28T18:43:59.299035+0000","last_became_active":"2023-11-28T18:43:59.291615+0000","last_became_peered":"2023-11-28T18:43:59.291615+0000","last_unstale":"2023-11-28T18:43:59.299035+0000","last_undegraded":"2023-11-28T18:43:59.299035+0000","last_fullsized":"2023-11-28T18:43:59.299035+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:51:07.451317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.296421+0000","last_change":"2023-11-28T18:43:59.289145+0000","last_active":"2023-11-28T18:43:59.296421+0000","last_peered":"2023-11-28T18:43:59.296421+0000","last_clean":"2023-11-28T18:43:59.296421+0000","last_became_active":"2023-11-28T18:43:59.288588+0000","last_became_peered":"2023-11-28T18:43:59.288588+0000","last_unstale":"2023-11-28T18:43:59.296421+0000","last_undegraded":"2023-11-28T18:43:59.296421+0000","last_fullsized":"2023-11-28T18:43:59.296421+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:22:30.045326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"59'4","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.292513+0000","last_change":"2023-11-28T18:43:58.276085+0000","last_active":"2023-11-28T18:43:59.292513+0000","last_peered":"2023-11-28T18:43:59.292513+0000","last_clean":"2023-11-28T18:43:59.292513+0000","last_became_active":"2023-11-28T18:43:58.275800+0000","last_became_peered":"2023-11-28T18:43:58.275800+0000","last_unstale":"2023-11-28T18:43:59.292513+0000","last_undegraded":"2023-11-28T18:43:59.292513+0000","last_fullsized":"2023-11-28T18:43:59.292513+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_clean_scrub_stamp":"2023-11-28T18:43:57.243206+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:48:58.880299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.300842+0000","last_change":"2023-11-28T18:43:59.297363+0000","last_active":"2023-11-28T18:43:59.300842+0000","last_peered":"2023-11-28T18:43:59.300842+0000","last_clean":"2023-11-28T18:43:59.300842+0000","last_became_active":"2023-11-28T18:43:59.296656+0000","last_became_peered":"2023-11-28T18:43:59.296656+0000","last_unstale":"2023-11-28T18:43:59.300842+0000","last_undegraded":"2023-11-28T18:43:59.300842+0000","last_fullsized":"2023-11-28T18:43:59.300842+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:27:07.292895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"59'1","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.277845+0000","last_change":"2023-11-28T18:43:58.287762+0000","last_active":"2023-11-28T18:44:00.277845+0000","last_peered":"2023-11-28T18:44:00.277845+0000","last_clean":"2023-11-28T18:44:00.277845+0000","last_became_active":"2023-11-28T18:43:58.287083+0000","last_became_peered":"2023-11-28T18:43:58.287083+0000","last_unstale":"2023-11-28T18:44:00.277845+0000","last_undegraded":"2023-11-28T18:44:00.277845+0000","last_fullsized":"2023-11-28T18:44:00.277845+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_clean_scrub_stamp":"2023-11-28T18:43:57.243206+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:21:17.090938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.299822+0000","last_change":"2023-11-28T18:43:59.298861+0000","last_active":"2023-11-28T18:43:59.299822+0000","last_peered":"2023-11-28T18:43:59.299822+0000","last_clean":"2023-11-28T18:43:59.299822+0000","last_became_active":"2023-11-28T18:43:59.298448+0000","last_became_peered":"2023-11-28T18:43:59.298448+0000","last_unstale":"2023-11-28T18:43:59.299822+0000","last_undegraded":"2023-11-28T18:43:59.299822+0000","last_fullsized":"2023-11-28T18:43:59.299822+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:06:23.955254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"59'2","reported_seq":13,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.298527+0000","last_change":"2023-11-28T18:43:58.278132+0000","last_active":"2023-11-28T18:43:59.298527+0000","last_peered":"2023-11-28T18:43:59.298527+0000","last_clean":"2023-11-28T18:43:59.298527+0000","last_became_active":"2023-11-28T18:43:58.277378+0000","last_became_peered":"2023-11-28T18:43:58.277378+0000","last_unstale":"2023-11-28T18:43:59.298527+0000","last_undegraded":"2023-11-28T18:43:59.298527+0000","last_fullsized":"2023-11-28T18:43:59.298527+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_clean_scrub_stamp":"2023-11-28T18:43:57.243206+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:45:25.430817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.275321+0000","last_change":"2023-11-28T18:43:59.272371+0000","last_active":"2023-11-28T18:43:59.275321+0000","last_peered":"2023-11-28T18:43:59.275321+0000","last_clean":"2023-11-28T18:43:59.275321+0000","last_became_active":"2023-11-28T18:43:59.271987+0000","last_became_peered":"2023-11-28T18:43:59.271987+0000","last_unstale":"2023-11-28T18:43:59.275321+0000","last_undegraded":"2023-11-28T18:43:59.275321+0000","last_fullsized":"2023-11-28T18:43:59.275321+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:58:06.281969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"59'2","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.281561+0000","last_change":"2023-11-28T18:43:58.275496+0000","last_active":"2023-11-28T18:44:00.281561+0000","last_peered":"2023-11-28T18:44:00.281561+0000","last_clean":"2023-11-28T18:44:00.281561+0000","last_became_active":"2023-11-28T18:43:58.275206+0000","last_became_peered":"2023-11-28T18:43:58.275206+0000","last_unstale":"2023-11-28T18:44:00.281561+0000","last_undegraded":"2023-11-28T18:44:00.281561+0000","last_fullsized":"2023-11-28T18:44:00.281561+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_clean_scrub_stamp":"2023-11-28T18:43:57.243206+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:26:05.161280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.277595+0000","last_change":"2023-11-28T18:43:59.301083+0000","last_active":"2023-11-28T18:44:00.277595+0000","last_peered":"2023-11-28T18:44:00.277595+0000","last_clean":"2023-11-28T18:44:00.277595+0000","last_became_active":"2023-11-28T18:43:59.300374+0000","last_became_peered":"2023-11-28T18:43:59.300374+0000","last_unstale":"2023-11-28T18:44:00.277595+0000","last_undegraded":"2023-11-28T18:44:00.277595+0000","last_fullsized":"2023-11-28T18:44:00.277595+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:30:22.585340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"59'1","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.280743+0000","last_change":"2023-11-28T18:43:58.275778+0000","last_active":"2023-11-28T18:44:00.280743+0000","last_peered":"2023-11-28T18:44:00.280743+0000","last_clean":"2023-11-28T18:44:00.280743+0000","last_became_active":"2023-11-28T18:43:58.275468+0000","last_became_peered":"2023-11-28T18:43:58.275468+0000","last_unstale":"2023-11-28T18:44:00.280743+0000","last_undegraded":"2023-11-28T18:44:00.280743+0000","last_fullsized":"2023-11-28T18:44:00.280743+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_clean_scrub_stamp":"2023-11-28T18:43:57.243206+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:31:18.741449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.277579+0000","last_change":"2023-11-28T18:43:59.301582+0000","last_active":"2023-11-28T18:44:00.277579+0000","last_peered":"2023-11-28T18:44:00.277579+0000","last_clean":"2023-11-28T18:44:00.277579+0000","last_became_active":"2023-11-28T18:43:59.300251+0000","last_became_peered":"2023-11-28T18:43:59.300251+0000","last_unstale":"2023-11-28T18:44:00.277579+0000","last_undegraded":"2023-11-28T18:44:00.277579+0000","last_fullsized":"2023-11-28T18:44:00.277579+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:08.170914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"59'1","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.287382+0000","last_change":"2023-11-28T18:43:58.279878+0000","last_active":"2023-11-28T18:43:59.287382+0000","last_peered":"2023-11-28T18:43:59.287382+0000","last_clean":"2023-11-28T18:43:59.287382+0000","last_became_active":"2023-11-28T18:43:58.279583+0000","last_became_peered":"2023-11-28T18:43:58.279583+0000","last_unstale":"2023-11-28T18:43:59.287382+0000","last_undegraded":"2023-11-28T18:43:59.287382+0000","last_fullsized":"2023-11-28T18:43:59.287382+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_clean_scrub_stamp":"2023-11-28T18:43:57.243206+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:30:43.376476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.294507+0000","last_change":"2023-11-28T18:43:59.287200+0000","last_active":"2023-11-28T18:43:59.294507+0000","last_peered":"2023-11-28T18:43:59.294507+0000","last_clean":"2023-11-28T18:43:59.294507+0000","last_became_active":"2023-11-28T18:43:59.286924+0000","last_became_peered":"2023-11-28T18:43:59.286924+0000","last_unstale":"2023-11-28T18:43:59.294507+0000","last_undegraded":"2023-11-28T18:43:59.294507+0000","last_fullsized":"2023-11-28T18:43:59.294507+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:32:27.557372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.281449+0000","last_change":"2023-11-28T18:43:58.274084+0000","last_active":"2023-11-28T18:44:00.281449+0000","last_peered":"2023-11-28T18:44:00.281449+0000","last_clean":"2023-11-28T18:44:00.281449+0000","last_became_active":"2023-11-28T18:43:58.273653+0000","last_became_peered":"2023-11-28T18:43:58.273653+0000","last_unstale":"2023-11-28T18:44:00.281449+0000","last_undegraded":"2023-11-28T18:44:00.281449+0000","last_fullsized":"2023-11-28T18:44:00.281449+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_clean_scrub_stamp":"2023-11-28T18:43:57.243206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:45:25.430817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.277355+0000","last_change":"2023-11-28T18:43:59.301918+0000","last_active":"2023-11-28T18:44:00.277355+0000","last_peered":"2023-11-28T18:44:00.277355+0000","last_clean":"2023-11-28T18:44:00.277355+0000","last_became_active":"2023-11-28T18:43:59.301358+0000","last_became_peered":"2023-11-28T18:43:59.301358+0000","last_unstale":"2023-11-28T18:44:00.277355+0000","last_undegraded":"2023-11-28T18:44:00.277355+0000","last_fullsized":"2023-11-28T18:44:00.277355+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:16:10.035568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.280245+0000","last_change":"2023-11-28T18:43:58.279583+0000","last_active":"2023-11-28T18:44:00.280245+0000","last_peered":"2023-11-28T18:44:00.280245+0000","last_clean":"2023-11-28T18:44:00.280245+0000","last_became_active":"2023-11-28T18:43:58.279218+0000","last_became_peered":"2023-11-28T18:43:58.279218+0000","last_unstale":"2023-11-28T18:44:00.280245+0000","last_undegraded":"2023-11-28T18:44:00.280245+0000","last_fullsized":"2023-11-28T18:44:00.280245+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_clean_scrub_stamp":"2023-11-28T18:43:57.243206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:11:52.434184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.280846+0000","last_change":"2023-11-28T18:43:59.294345+0000","last_active":"2023-11-28T18:44:00.280846+0000","last_peered":"2023-11-28T18:44:00.280846+0000","last_clean":"2023-11-28T18:44:00.280846+0000","last_became_active":"2023-11-28T18:43:59.294053+0000","last_became_peered":"2023-11-28T18:43:59.294053+0000","last_unstale":"2023-11-28T18:44:00.280846+0000","last_undegraded":"2023-11-28T18:44:00.280846+0000","last_fullsized":"2023-11-28T18:44:00.280846+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:10:34.305144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.283938+0000","last_change":"2023-11-28T18:43:58.277222+0000","last_active":"2023-11-28T18:43:59.283938+0000","last_peered":"2023-11-28T18:43:59.283938+0000","last_clean":"2023-11-28T18:43:59.283938+0000","last_became_active":"2023-11-28T18:43:58.276950+0000","last_became_peered":"2023-11-28T18:43:58.276950+0000","last_unstale":"2023-11-28T18:43:59.283938+0000","last_undegraded":"2023-11-28T18:43:59.283938+0000","last_fullsized":"2023-11-28T18:43:59.283938+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_clean_scrub_stamp":"2023-11-28T18:43:57.243206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:48:37.869052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.301133+0000","last_change":"2023-11-28T18:43:59.299355+0000","last_active":"2023-11-28T18:43:59.301133+0000","last_peered":"2023-11-28T18:43:59.301133+0000","last_clean":"2023-11-28T18:43:59.301133+0000","last_became_active":"2023-11-28T18:43:59.298967+0000","last_became_peered":"2023-11-28T18:43:59.298967+0000","last_unstale":"2023-11-28T18:43:59.301133+0000","last_undegraded":"2023-11-28T18:43:59.301133+0000","last_fullsized":"2023-11-28T18:43:59.301133+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:03:19.767349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.277935+0000","last_change":"2023-11-28T18:43:58.284880+0000","last_active":"2023-11-28T18:44:00.277935+0000","last_peered":"2023-11-28T18:44:00.277935+0000","last_clean":"2023-11-28T18:44:00.277935+0000","last_became_active":"2023-11-28T18:43:58.284585+0000","last_became_peered":"2023-11-28T18:43:58.284585+0000","last_unstale":"2023-11-28T18:44:00.277935+0000","last_undegraded":"2023-11-28T18:44:00.277935+0000","last_fullsized":"2023-11-28T18:44:00.277935+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_clean_scrub_stamp":"2023-11-28T18:43:57.243206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:32:10.817844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.289451+0000","last_change":"2023-11-28T18:43:59.283102+0000","last_active":"2023-11-28T18:43:59.289451+0000","last_peered":"2023-11-28T18:43:59.289451+0000","last_clean":"2023-11-28T18:43:59.289451+0000","last_became_active":"2023-11-28T18:43:59.282502+0000","last_became_peered":"2023-11-28T18:43:59.282502+0000","last_unstale":"2023-11-28T18:43:59.289451+0000","last_undegraded":"2023-11-28T18:43:59.289451+0000","last_fullsized":"2023-11-28T18:43:59.289451+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:32:27.557372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"59'3","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.298478+0000","last_change":"2023-11-28T18:43:58.275839+0000","last_active":"2023-11-28T18:43:59.298478+0000","last_peered":"2023-11-28T18:43:59.298478+0000","last_clean":"2023-11-28T18:43:59.298478+0000","last_became_active":"2023-11-28T18:43:58.275545+0000","last_became_peered":"2023-11-28T18:43:58.275545+0000","last_unstale":"2023-11-28T18:43:59.298478+0000","last_undegraded":"2023-11-28T18:43:59.298478+0000","last_fullsized":"2023-11-28T18:43:59.298478+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_clean_scrub_stamp":"2023-11-28T18:43:57.243206+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:23:32.281568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.299630+0000","last_change":"2023-11-28T18:43:59.291390+0000","last_active":"2023-11-28T18:43:59.299630+0000","last_peered":"2023-11-28T18:43:59.299630+0000","last_clean":"2023-11-28T18:43:59.299630+0000","last_became_active":"2023-11-28T18:43:59.291100+0000","last_became_peered":"2023-11-28T18:43:59.291100+0000","last_unstale":"2023-11-28T18:43:59.299630+0000","last_undegraded":"2023-11-28T18:43:59.299630+0000","last_fullsized":"2023-11-28T18:43:59.299630+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:18:35.757235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"59'6","reported_seq":18,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.280681+0000","last_change":"2023-11-28T18:43:58.284144+0000","last_active":"2023-11-28T18:44:00.280681+0000","last_peered":"2023-11-28T18:44:00.280681+0000","last_clean":"2023-11-28T18:44:00.280681+0000","last_became_active":"2023-11-28T18:43:58.283818+0000","last_became_peered":"2023-11-28T18:43:58.283818+0000","last_unstale":"2023-11-28T18:44:00.280681+0000","last_undegraded":"2023-11-28T18:44:00.280681+0000","last_fullsized":"2023-11-28T18:44:00.280681+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_clean_scrub_stamp":"2023-11-28T18:43:57.243206+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:08:37.761668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.281034+0000","last_change":"2023-11-28T18:43:59.290145+0000","last_active":"2023-11-28T18:44:00.281034+0000","last_peered":"2023-11-28T18:44:00.281034+0000","last_clean":"2023-11-28T18:44:00.281034+0000","last_became_active":"2023-11-28T18:43:59.289168+0000","last_became_peered":"2023-11-28T18:43:59.289168+0000","last_unstale":"2023-11-28T18:44:00.281034+0000","last_undegraded":"2023-11-28T18:44:00.281034+0000","last_fullsized":"2023-11-28T18:44:00.281034+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:23:42.919325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"59'2","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.277677+0000","last_change":"2023-11-28T18:43:58.284988+0000","last_active":"2023-11-28T18:44:00.277677+0000","last_peered":"2023-11-28T18:44:00.277677+0000","last_clean":"2023-11-28T18:44:00.277677+0000","last_became_active":"2023-11-28T18:43:58.284687+0000","last_became_peered":"2023-11-28T18:43:58.284687+0000","last_unstale":"2023-11-28T18:44:00.277677+0000","last_undegraded":"2023-11-28T18:44:00.277677+0000","last_fullsized":"2023-11-28T18:44:00.277677+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_clean_scrub_stamp":"2023-11-28T18:43:57.243206+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:32:26.879403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.300316+0000","last_change":"2023-11-28T18:43:59.294609+0000","last_active":"2023-11-28T18:43:59.300316+0000","last_peered":"2023-11-28T18:43:59.300316+0000","last_clean":"2023-11-28T18:43:59.300316+0000","last_became_active":"2023-11-28T18:43:59.294318+0000","last_became_peered":"2023-11-28T18:43:59.294318+0000","last_unstale":"2023-11-28T18:43:59.300316+0000","last_undegraded":"2023-11-28T18:43:59.300316+0000","last_fullsized":"2023-11-28T18:43:59.300316+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:17:04.792032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.270895+0000","last_change":"2023-11-28T18:43:58.277106+0000","last_active":"2023-11-28T18:43:59.270895+0000","last_peered":"2023-11-28T18:43:59.270895+0000","last_clean":"2023-11-28T18:43:59.270895+0000","last_became_active":"2023-11-28T18:43:58.276849+0000","last_became_peered":"2023-11-28T18:43:58.276849+0000","last_unstale":"2023-11-28T18:43:59.270895+0000","last_undegraded":"2023-11-28T18:43:59.270895+0000","last_fullsized":"2023-11-28T18:43:59.270895+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_clean_scrub_stamp":"2023-11-28T18:43:57.243206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:48:54.770159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.280233+0000","last_change":"2023-11-28T18:43:59.289067+0000","last_active":"2023-11-28T18:44:00.280233+0000","last_peered":"2023-11-28T18:44:00.280233+0000","last_clean":"2023-11-28T18:44:00.280233+0000","last_became_active":"2023-11-28T18:43:59.287105+0000","last_became_peered":"2023-11-28T18:43:59.287105+0000","last_unstale":"2023-11-28T18:44:00.280233+0000","last_undegraded":"2023-11-28T18:44:00.280233+0000","last_fullsized":"2023-11-28T18:44:00.280233+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:15:13.056963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.281536+0000","last_change":"2023-11-28T18:43:58.276542+0000","last_active":"2023-11-28T18:44:00.281536+0000","last_peered":"2023-11-28T18:44:00.281536+0000","last_clean":"2023-11-28T18:44:00.281536+0000","last_became_active":"2023-11-28T18:43:58.275667+0000","last_became_peered":"2023-11-28T18:43:58.275667+0000","last_unstale":"2023-11-28T18:44:00.281536+0000","last_undegraded":"2023-11-28T18:44:00.281536+0000","last_fullsized":"2023-11-28T18:44:00.281536+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_clean_scrub_stamp":"2023-11-28T18:43:57.243206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:18:34.754615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.299886+0000","last_change":"2023-11-28T18:43:59.294454+0000","last_active":"2023-11-28T18:43:59.299886+0000","last_peered":"2023-11-28T18:43:59.299886+0000","last_clean":"2023-11-28T18:43:59.299886+0000","last_became_active":"2023-11-28T18:43:59.293573+0000","last_became_peered":"2023-11-28T18:43:59.293573+0000","last_unstale":"2023-11-28T18:43:59.299886+0000","last_undegraded":"2023-11-28T18:43:59.299886+0000","last_fullsized":"2023-11-28T18:43:59.299886+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:57.543750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"59'8","reported_seq":19,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.296664+0000","last_change":"2023-11-28T18:43:58.271516+0000","last_active":"2023-11-28T18:43:59.296664+0000","last_peered":"2023-11-28T18:43:59.296664+0000","last_clean":"2023-11-28T18:43:59.296664+0000","last_became_active":"2023-11-28T18:43:58.271030+0000","last_became_peered":"2023-11-28T18:43:58.271030+0000","last_unstale":"2023-11-28T18:43:59.296664+0000","last_undegraded":"2023-11-28T18:43:59.296664+0000","last_fullsized":"2023-11-28T18:43:59.296664+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_clean_scrub_stamp":"2023-11-28T18:43:57.243206+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:06:22.952634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.300459+0000","last_change":"2023-11-28T18:43:59.296414+0000","last_active":"2023-11-28T18:43:59.300459+0000","last_peered":"2023-11-28T18:43:59.300459+0000","last_clean":"2023-11-28T18:43:59.300459+0000","last_became_active":"2023-11-28T18:43:59.296112+0000","last_became_peered":"2023-11-28T18:43:59.296112+0000","last_unstale":"2023-11-28T18:43:59.300459+0000","last_undegraded":"2023-11-28T18:43:59.300459+0000","last_fullsized":"2023-11-28T18:43:59.300459+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:22:30.045326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"59'1","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.278009+0000","last_change":"2023-11-28T18:43:58.285062+0000","last_active":"2023-11-28T18:44:00.278009+0000","last_peered":"2023-11-28T18:44:00.278009+0000","last_clean":"2023-11-28T18:44:00.278009+0000","last_became_active":"2023-11-28T18:43:58.284767+0000","last_became_peered":"2023-11-28T18:43:58.284767+0000","last_unstale":"2023-11-28T18:44:00.278009+0000","last_undegraded":"2023-11-28T18:44:00.278009+0000","last_fullsized":"2023-11-28T18:44:00.278009+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_clean_scrub_stamp":"2023-11-28T18:43:57.243206+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:37:56.175669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.281704+0000","last_change":"2023-11-28T18:43:59.290026+0000","last_active":"2023-11-28T18:44:00.281704+0000","last_peered":"2023-11-28T18:44:00.281704+0000","last_clean":"2023-11-28T18:44:00.281704+0000","last_became_active":"2023-11-28T18:43:59.289742+0000","last_became_peered":"2023-11-28T18:43:59.289742+0000","last_unstale":"2023-11-28T18:44:00.281704+0000","last_undegraded":"2023-11-28T18:44:00.281704+0000","last_fullsized":"2023-11-28T18:44:00.281704+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:37:57.178289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"59'2","reported_seq":13,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.296421+0000","last_change":"2023-11-28T18:43:58.286965+0000","last_active":"2023-11-28T18:43:59.296421+0000","last_peered":"2023-11-28T18:43:59.296421+0000","last_clean":"2023-11-28T18:43:59.296421+0000","last_became_active":"2023-11-28T18:43:58.285679+0000","last_became_peered":"2023-11-28T18:43:58.285679+0000","last_unstale":"2023-11-28T18:43:59.296421+0000","last_undegraded":"2023-11-28T18:43:59.296421+0000","last_fullsized":"2023-11-28T18:43:59.296421+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_clean_scrub_stamp":"2023-11-28T18:43:57.243206+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:18:34.754615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.277662+0000","last_change":"2023-11-28T18:43:59.304967+0000","last_active":"2023-11-28T18:44:00.277662+0000","last_peered":"2023-11-28T18:44:00.277662+0000","last_clean":"2023-11-28T18:44:00.277662+0000","last_became_active":"2023-11-28T18:43:59.304609+0000","last_became_peered":"2023-11-28T18:43:59.304609+0000","last_unstale":"2023-11-28T18:44:00.277662+0000","last_undegraded":"2023-11-28T18:44:00.277662+0000","last_fullsized":"2023-11-28T18:44:00.277662+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:22:55.971501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"59'1","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.281475+0000","last_change":"2023-11-28T18:43:58.277015+0000","last_active":"2023-11-28T18:44:00.281475+0000","last_peered":"2023-11-28T18:44:00.281475+0000","last_clean":"2023-11-28T18:44:00.281475+0000","last_became_active":"2023-11-28T18:43:58.276491+0000","last_became_peered":"2023-11-28T18:43:58.276491+0000","last_unstale":"2023-11-28T18:44:00.281475+0000","last_undegraded":"2023-11-28T18:44:00.281475+0000","last_fullsized":"2023-11-28T18:44:00.281475+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_clean_scrub_stamp":"2023-11-28T18:43:57.243206+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:23:32.281568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.301119+0000","last_change":"2023-11-28T18:43:59.299300+0000","last_active":"2023-11-28T18:43:59.301119+0000","last_peered":"2023-11-28T18:43:59.301119+0000","last_clean":"2023-11-28T18:43:59.301119+0000","last_became_active":"2023-11-28T18:43:59.298698+0000","last_became_peered":"2023-11-28T18:43:59.298698+0000","last_unstale":"2023-11-28T18:43:59.301119+0000","last_undegraded":"2023-11-28T18:43:59.301119+0000","last_fullsized":"2023-11-28T18:43:59.301119+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:33:55.744963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.262518+0000","last_change":"2023-11-28T18:43:58.283321+0000","last_active":"2023-11-28T18:43:59.262518+0000","last_peered":"2023-11-28T18:43:59.262518+0000","last_clean":"2023-11-28T18:43:59.262518+0000","last_became_active":"2023-11-28T18:43:58.281941+0000","last_became_peered":"2023-11-28T18:43:58.281941+0000","last_unstale":"2023-11-28T18:43:59.262518+0000","last_undegraded":"2023-11-28T18:43:59.262518+0000","last_fullsized":"2023-11-28T18:43:59.262518+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_clean_scrub_stamp":"2023-11-28T18:43:57.243206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:38:07.602988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.281036+0000","last_change":"2023-11-28T18:43:59.289279+0000","last_active":"2023-11-28T18:44:00.281036+0000","last_peered":"2023-11-28T18:44:00.281036+0000","last_clean":"2023-11-28T18:44:00.281036+0000","last_became_active":"2023-11-28T18:43:59.288984+0000","last_became_peered":"2023-11-28T18:43:59.288984+0000","last_unstale":"2023-11-28T18:44:00.281036+0000","last_undegraded":"2023-11-28T18:44:00.281036+0000","last_fullsized":"2023-11-28T18:44:00.281036+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:03:19.767349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"59'2","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.277832+0000","last_change":"2023-11-28T18:43:58.283409+0000","last_active":"2023-11-28T18:44:00.277832+0000","last_peered":"2023-11-28T18:44:00.277832+0000","last_clean":"2023-11-28T18:44:00.277832+0000","last_became_active":"2023-11-28T18:43:58.283140+0000","last_became_peered":"2023-11-28T18:43:58.283140+0000","last_unstale":"2023-11-28T18:44:00.277832+0000","last_undegraded":"2023-11-28T18:44:00.277832+0000","last_fullsized":"2023-11-28T18:44:00.277832+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_clean_scrub_stamp":"2023-11-28T18:43:57.243206+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:52:49.154126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.295530+0000","last_change":"2023-11-28T18:43:59.287253+0000","last_active":"2023-11-28T18:43:59.295530+0000","last_peered":"2023-11-28T18:43:59.295530+0000","last_clean":"2023-11-28T18:43:59.295530+0000","last_became_active":"2023-11-28T18:43:59.283809+0000","last_became_peered":"2023-11-28T18:43:59.283809+0000","last_unstale":"2023-11-28T18:43:59.295530+0000","last_undegraded":"2023-11-28T18:43:59.295530+0000","last_fullsized":"2023-11-28T18:43:59.295530+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:10:34.305144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.271448+0000","last_change":"2023-11-28T18:43:58.272326+0000","last_active":"2023-11-28T18:43:59.271448+0000","last_peered":"2023-11-28T18:43:59.271448+0000","last_clean":"2023-11-28T18:43:59.271448+0000","last_became_active":"2023-11-28T18:43:58.272023+0000","last_became_peered":"2023-11-28T18:43:58.272023+0000","last_unstale":"2023-11-28T18:43:59.271448+0000","last_undegraded":"2023-11-28T18:43:59.271448+0000","last_fullsized":"2023-11-28T18:43:59.271448+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_clean_scrub_stamp":"2023-11-28T18:43:57.243206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:11:56.478375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.299003+0000","last_change":"2023-11-28T18:43:59.289240+0000","last_active":"2023-11-28T18:43:59.299003+0000","last_peered":"2023-11-28T18:43:59.299003+0000","last_clean":"2023-11-28T18:43:59.299003+0000","last_became_active":"2023-11-28T18:43:59.288929+0000","last_became_peered":"2023-11-28T18:43:59.288929+0000","last_unstale":"2023-11-28T18:43:59.299003+0000","last_undegraded":"2023-11-28T18:43:59.299003+0000","last_fullsized":"2023-11-28T18:43:59.299003+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:23:02.291448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.281115+0000","last_change":"2023-11-28T18:43:58.280347+0000","last_active":"2023-11-28T18:44:00.281115+0000","last_peered":"2023-11-28T18:44:00.281115+0000","last_clean":"2023-11-28T18:44:00.281115+0000","last_became_active":"2023-11-28T18:43:58.279871+0000","last_became_peered":"2023-11-28T18:43:58.279871+0000","last_unstale":"2023-11-28T18:44:00.281115+0000","last_undegraded":"2023-11-28T18:44:00.281115+0000","last_fullsized":"2023-11-28T18:44:00.281115+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_clean_scrub_stamp":"2023-11-28T18:43:57.243206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:56.541131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.281697+0000","last_change":"2023-11-28T18:43:59.285638+0000","last_active":"2023-11-28T18:44:00.281697+0000","last_peered":"2023-11-28T18:44:00.281697+0000","last_clean":"2023-11-28T18:44:00.281697+0000","last_became_active":"2023-11-28T18:43:59.285330+0000","last_became_peered":"2023-11-28T18:43:59.285330+0000","last_unstale":"2023-11-28T18:44:00.281697+0000","last_undegraded":"2023-11-28T18:44:00.281697+0000","last_fullsized":"2023-11-28T18:44:00.281697+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:58:10.520321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"59'2","reported_seq":13,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.290887+0000","last_change":"2023-11-28T18:43:58.285006+0000","last_active":"2023-11-28T18:43:59.290887+0000","last_peered":"2023-11-28T18:43:59.290887+0000","last_clean":"2023-11-28T18:43:59.290887+0000","last_became_active":"2023-11-28T18:43:58.284708+0000","last_became_peered":"2023-11-28T18:43:58.284708+0000","last_unstale":"2023-11-28T18:43:59.290887+0000","last_undegraded":"2023-11-28T18:43:59.290887+0000","last_fullsized":"2023-11-28T18:43:59.290887+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_clean_scrub_stamp":"2023-11-28T18:43:57.243206+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:15:31.322866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.281775+0000","last_change":"2023-11-28T18:43:59.287785+0000","last_active":"2023-11-28T18:44:00.281775+0000","last_peered":"2023-11-28T18:44:00.281775+0000","last_clean":"2023-11-28T18:44:00.281775+0000","last_became_active":"2023-11-28T18:43:59.286604+0000","last_became_peered":"2023-11-28T18:43:59.286604+0000","last_unstale":"2023-11-28T18:44:00.281775+0000","last_undegraded":"2023-11-28T18:44:00.281775+0000","last_fullsized":"2023-11-28T18:44:00.281775+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:56:54.827147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.264220+0000","last_change":"2023-11-28T18:43:58.280815+0000","last_active":"2023-11-28T18:43:59.264220+0000","last_peered":"2023-11-28T18:43:59.264220+0000","last_clean":"2023-11-28T18:43:59.264220+0000","last_became_active":"2023-11-28T18:43:58.278827+0000","last_became_peered":"2023-11-28T18:43:58.278827+0000","last_unstale":"2023-11-28T18:43:59.264220+0000","last_undegraded":"2023-11-28T18:43:59.264220+0000","last_fullsized":"2023-11-28T18:43:59.264220+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_clean_scrub_stamp":"2023-11-28T18:43:57.243206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:26:05.161280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.289471+0000","last_change":"2023-11-28T18:43:59.283279+0000","last_active":"2023-11-28T18:43:59.289471+0000","last_peered":"2023-11-28T18:43:59.289471+0000","last_clean":"2023-11-28T18:43:59.289471+0000","last_became_active":"2023-11-28T18:43:59.282809+0000","last_became_peered":"2023-11-28T18:43:59.282809+0000","last_unstale":"2023-11-28T18:43:59.289471+0000","last_undegraded":"2023-11-28T18:43:59.289471+0000","last_fullsized":"2023-11-28T18:43:59.289471+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:48:55.772779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.274513+0000","last_change":"2023-11-28T18:43:58.281032+0000","last_active":"2023-11-28T18:43:59.274513+0000","last_peered":"2023-11-28T18:43:59.274513+0000","last_clean":"2023-11-28T18:43:59.274513+0000","last_became_active":"2023-11-28T18:43:58.280369+0000","last_became_peered":"2023-11-28T18:43:58.280369+0000","last_unstale":"2023-11-28T18:43:59.274513+0000","last_undegraded":"2023-11-28T18:43:59.274513+0000","last_fullsized":"2023-11-28T18:43:59.274513+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_clean_scrub_stamp":"2023-11-28T18:43:57.243206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:44:06.878322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.275342+0000","last_change":"2023-11-28T18:43:59.272686+0000","last_active":"2023-11-28T18:43:59.275342+0000","last_peered":"2023-11-28T18:43:59.275342+0000","last_clean":"2023-11-28T18:43:59.275342+0000","last_became_active":"2023-11-28T18:43:59.272410+0000","last_became_peered":"2023-11-28T18:43:59.272410+0000","last_unstale":"2023-11-28T18:43:59.275342+0000","last_undegraded":"2023-11-28T18:43:59.275342+0000","last_fullsized":"2023-11-28T18:43:59.275342+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:33:55.744963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.281487+0000","last_change":"2023-11-28T18:43:58.274083+0000","last_active":"2023-11-28T18:44:00.281487+0000","last_peered":"2023-11-28T18:44:00.281487+0000","last_clean":"2023-11-28T18:44:00.281487+0000","last_became_active":"2023-11-28T18:43:58.273731+0000","last_became_peered":"2023-11-28T18:43:58.273731+0000","last_unstale":"2023-11-28T18:44:00.281487+0000","last_undegraded":"2023-11-28T18:44:00.281487+0000","last_fullsized":"2023-11-28T18:44:00.281487+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_clean_scrub_stamp":"2023-11-28T18:43:57.243206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:33:54.742343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.277721+0000","last_change":"2023-11-28T18:43:59.292667+0000","last_active":"2023-11-28T18:44:00.277721+0000","last_peered":"2023-11-28T18:44:00.277721+0000","last_clean":"2023-11-28T18:44:00.277721+0000","last_became_active":"2023-11-28T18:43:59.292325+0000","last_became_peered":"2023-11-28T18:43:59.292325+0000","last_unstale":"2023-11-28T18:44:00.277721+0000","last_undegraded":"2023-11-28T18:44:00.277721+0000","last_fullsized":"2023-11-28T18:44:00.277721+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:49:43.351344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.273137+0000","last_change":"2023-11-28T18:43:58.272737+0000","last_active":"2023-11-28T18:43:59.273137+0000","last_peered":"2023-11-28T18:43:59.273137+0000","last_clean":"2023-11-28T18:43:59.273137+0000","last_became_active":"2023-11-28T18:43:58.272056+0000","last_became_peered":"2023-11-28T18:43:58.272056+0000","last_unstale":"2023-11-28T18:43:59.273137+0000","last_undegraded":"2023-11-28T18:43:59.273137+0000","last_fullsized":"2023-11-28T18:43:59.273137+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_clean_scrub_stamp":"2023-11-28T18:43:57.243206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:09:37.112065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.306133+0000","last_change":"2023-11-28T18:43:59.304916+0000","last_active":"2023-11-28T18:43:59.306133+0000","last_peered":"2023-11-28T18:43:59.306133+0000","last_clean":"2023-11-28T18:43:59.306133+0000","last_became_active":"2023-11-28T18:43:59.304564+0000","last_became_peered":"2023-11-28T18:43:59.304564+0000","last_unstale":"2023-11-28T18:43:59.306133+0000","last_undegraded":"2023-11-28T18:43:59.306133+0000","last_fullsized":"2023-11-28T18:43:59.306133+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:26:06.163900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.280505+0000","last_change":"2023-11-28T18:43:58.284268+0000","last_active":"2023-11-28T18:44:00.280505+0000","last_peered":"2023-11-28T18:44:00.280505+0000","last_clean":"2023-11-28T18:44:00.280505+0000","last_became_active":"2023-11-28T18:43:58.283802+0000","last_became_peered":"2023-11-28T18:43:58.283802+0000","last_unstale":"2023-11-28T18:44:00.280505+0000","last_undegraded":"2023-11-28T18:44:00.280505+0000","last_fullsized":"2023-11-28T18:44:00.280505+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_clean_scrub_stamp":"2023-11-28T18:43:57.243206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:51:06.448697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.288481+0000","last_change":"2023-11-28T18:43:59.282950+0000","last_active":"2023-11-28T18:43:59.288481+0000","last_peered":"2023-11-28T18:43:59.288481+0000","last_clean":"2023-11-28T18:43:59.288481+0000","last_became_active":"2023-11-28T18:43:59.281828+0000","last_became_peered":"2023-11-28T18:43:59.281828+0000","last_unstale":"2023-11-28T18:43:59.288481+0000","last_undegraded":"2023-11-28T18:43:59.288481+0000","last_fullsized":"2023-11-28T18:43:59.288481+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:47:34.364400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.270970+0000","last_change":"2023-11-28T18:43:58.277650+0000","last_active":"2023-11-28T18:43:59.270970+0000","last_peered":"2023-11-28T18:43:59.270970+0000","last_clean":"2023-11-28T18:43:59.270970+0000","last_became_active":"2023-11-28T18:43:58.277363+0000","last_became_peered":"2023-11-28T18:43:58.277363+0000","last_unstale":"2023-11-28T18:43:59.270970+0000","last_undegraded":"2023-11-28T18:43:59.270970+0000","last_fullsized":"2023-11-28T18:43:59.270970+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_clean_scrub_stamp":"2023-11-28T18:43:57.243206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:16:30.964163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.277406+0000","last_change":"2023-11-28T18:43:59.292682+0000","last_active":"2023-11-28T18:44:00.277406+0000","last_peered":"2023-11-28T18:44:00.277406+0000","last_clean":"2023-11-28T18:44:00.277406+0000","last_became_active":"2023-11-28T18:43:59.292428+0000","last_became_peered":"2023-11-28T18:43:59.292428+0000","last_unstale":"2023-11-28T18:44:00.277406+0000","last_undegraded":"2023-11-28T18:44:00.277406+0000","last_fullsized":"2023-11-28T18:44:00.277406+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:54:00.252840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.277425+0000","last_change":"2023-11-28T18:43:58.278956+0000","last_active":"2023-11-28T18:44:00.277425+0000","last_peered":"2023-11-28T18:44:00.277425+0000","last_clean":"2023-11-28T18:44:00.277425+0000","last_became_active":"2023-11-28T18:43:58.278681+0000","last_became_peered":"2023-11-28T18:43:58.278681+0000","last_unstale":"2023-11-28T18:44:00.277425+0000","last_undegraded":"2023-11-28T18:44:00.277425+0000","last_fullsized":"2023-11-28T18:44:00.277425+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_clean_scrub_stamp":"2023-11-28T18:43:57.243206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:23:00.696296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T18:44:00.277327+0000","last_change":"2023-11-28T18:43:59.285823+0000","last_active":"2023-11-28T18:44:00.277327+0000","last_peered":"2023-11-28T18:44:00.277327+0000","last_clean":"2023-11-28T18:44:00.277327+0000","last_became_active":"2023-11-28T18:43:59.285537+0000","last_became_peered":"2023-11-28T18:43:59.285537+0000","last_unstale":"2023-11-28T18:44:00.277327+0000","last_undegraded":"2023-11-28T18:44:00.277327+0000","last_fullsized":"2023-11-28T18:44:00.277327+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:58.245826+0000","last_clean_scrub_stamp":"2023-11-28T18:43:58.245826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:25:11.118389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T18:43:59.270802+0000","last_change":"2023-11-28T18:43:58.278600+0000","last_active":"2023-11-28T18:43:59.270802+0000","last_peered":"2023-11-28T18:43:59.270802+0000","last_clean":"2023-11-28T18:43:59.270802+0000","last_became_active":"2023-11-28T18:43:58.277993+0000","last_became_peered":"2023-11-28T18:43:58.277993+0000","last_unstale":"2023-11-28T18:43:59.270802+0000","last_undegraded":"2023-11-28T18:43:59.270802+0000","last_fullsized":"2023-11-28T18:43:59.270802+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:43:57.243206+0000","last_clean_scrub_stamp":"2023-11-28T18:43:57.243206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:47:33.361780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":201,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-11-28T18:43:58.261123+0000","last_change":"2023-11-28T18:37:22.369132+0000","last_active":"2023-11-28T18:43:58.261123+0000","last_peered":"2023-11-28T18:43:58.261123+0000","last_clean":"2023-11-28T18:43:58.261123+0000","last_became_active":"2023-11-28T18:37:22.368142+0000","last_became_peered":"2023-11-28T18:37:22.368142+0000","last_unstale":"2023-11-28T18:43:58.261123+0000","last_undegraded":"2023-11-28T18:43:58.261123+0000","last_fullsized":"2023-11-28T18:43:58.261123+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T18:37:21.313053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T18:37:21.313053+0000","last_clean_scrub_stamp":"2023-11-28T18:37:21.313053+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:55:01.432028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574931,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32464,"kb_used_data":1280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339376,"statfs":{"total":96636764160,"available":96603521024,"internally_reserved":0,"allocated":1310720,"data_stored":887595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 18:43:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.67600000000000005,"15min":0.81399999999999995},"min":{"1min":0.51000000000000001,"5min":0.43099999999999999,"15min":0.40300000000000002},"max":{"1min":0.873,"5min":1.0509999999999999,"15min":4.8559999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.67900000000000005,"15min":0.79900000000000004},"min":{"1min":0.46700000000000003,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.90600000000000003,"5min":0.998,"15min":4.8319999999999999},"last":0.48599999999999999}]},{"osd":1,"last update":"Tue Nov 28 18:43:40 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.68799999999999994,"15min":0.81200000000000006},"min":{"1min":0.504,"5min":0.46000000000000002,"15min":0.45400000000000001},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":4.8109999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.71599999999999997,"15min":0.86099999999999999},"min":{"1min":0.52800000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.873,"5min":0.997,"15min":4.8700000000000001},"last":0.68899999999999995}]},{"osd":2,"last update":"Tue Nov 28 18:43:40 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.72199999999999998,"15min":0.73599999999999999},"min":{"1min":0.55100000000000005,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.97299999999999998,"5min":1.032,"15min":1.151},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.76600000000000001,"15min":0.75600000000000001},"min":{"1min":0.57799999999999996,"5min":0.54900000000000004,"15min":0.51100000000000001},"max":{"1min":1.024,"5min":1.113,"15min":1.1160000000000001},"last":0.74099999999999999}]},{"osd":3,"last update":"Tue Nov 28 18:43:40 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.71099999999999997,"15min":0.86199999999999999},"min":{"1min":0.57399999999999995,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.873,"5min":1.0329999999999999,"15min":4.7619999999999996},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.749,"15min":0.75900000000000001},"min":{"1min":0.58999999999999997,"5min":0.499,"15min":0.499},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.80800000000000005}]},{"osd":4,"last update":"Tue Nov 28 18:43:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.60399999999999998,"15min":0.63800000000000001},"min":{"1min":0.45600000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.72999999999999998,"5min":1.032,"15min":1.032},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63600000000000001,"15min":0.67900000000000005},"min":{"1min":0.46600000000000003,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.83299999999999996,"5min":0.96599999999999997,"15min":0.96699999999999997},"last":0.72099999999999997}]},{"osd":5,"last update":"Tue Nov 28 18:43:40 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.66300000000000003,"15min":0.69299999999999995},"min":{"1min":0.47299999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.81499999999999995,"5min":0.95599999999999996,"15min":1.0880000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.68899999999999995,"15min":0.73599999999999999},"min":{"1min":0.53200000000000003,"5min":0.433,"15min":0.433},"max":{"1min":0.88500000000000001,"5min":1.079,"15min":1.079},"last":0.75700000000000001}]},{"osd":6,"last update":"Tue Nov 28 18:43:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.73199999999999998,"15min":0.79900000000000004},"min":{"1min":0.50900000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.93500000000000005,"5min":1.107,"15min":1.484},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.70199999999999996,"15min":0.76800000000000002},"min":{"1min":0.51500000000000001,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.86399999999999999,"5min":1.046,"15min":1.169},"last":0.66700000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574933,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31872,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339968,"statfs":{"total":96636764160,"available":96604127232,"internally_reserved":0,"allocated":708608,"data_stored":297067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 18:43:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.63,"15min":0.628},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.93899999999999995},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.64900000000000002,"15min":0.63400000000000001},"min":{"1min":0.43099999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.93500000000000005,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.70699999999999996}]},{"osd":1,"last update":"Tue Nov 28 18:43:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.69599999999999995,"15min":0.67300000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.38800000000000001},"max":{"1min":0.95099999999999996,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.72199999999999998,"15min":0.73399999999999999},"min":{"1min":0.56299999999999994,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.89900000000000002,"5min":0.97699999999999998,"15min":0.98099999999999998},"last":0.65500000000000003}]},{"osd":2,"last update":"Tue Nov 28 18:43:35 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65700000000000003,"15min":0.65600000000000003},"min":{"1min":0.5,"5min":0.42699999999999999,"15min":0.38900000000000001},"max":{"1min":0.97299999999999998,"5min":0.99199999999999999,"15min":1.01},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.70899999999999996,"15min":0.69599999999999995},"min":{"1min":0.46400000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.86099999999999999,"5min":0.96899999999999997,"15min":1.0289999999999999},"last":0.80800000000000005}]},{"osd":3,"last update":"Tue Nov 28 18:43:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.49299999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.88,"5min":0.97399999999999998,"15min":1.097},"last":0.62},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68799999999999994,"15min":0.69699999999999995},"min":{"1min":0.55900000000000005,"5min":0.49399999999999999,"15min":0.44},"max":{"1min":0.83699999999999997,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.72799999999999998}]},{"osd":4,"last update":"Tue Nov 28 18:43:35 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.58099999999999996,"15min":0.64100000000000001},"min":{"1min":0.38500000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.69999999999999996,"5min":0.91700000000000004,"15min":1.1819999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.63400000000000001,"15min":0.66500000000000004},"min":{"1min":0.44500000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.85199999999999998,"5min":0.91100000000000003,"15min":1.163},"last":0.55900000000000005}]},{"osd":5,"last update":"Tue Nov 28 18:43:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.623,"15min":0.67100000000000004},"min":{"1min":0.42399999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.878,"5min":0.93300000000000005,"15min":1.052},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.747,"5min":0.72899999999999998,"15min":0.77900000000000003},"min":{"1min":0.55200000000000005,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.91400000000000003,"5min":0.99399999999999999,"15min":1.2290000000000001},"last":0.74399999999999999}]},{"osd":7,"last update":"Tue Nov 28 18:43:35 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.71199999999999997,"15min":0.755},"min":{"1min":0.52200000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93000000000000005,"5min":1.0149999999999999,"15min":1.2070000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72899999999999998,"15min":0.75900000000000001},"min":{"1min":0.50900000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.91000000000000003,"5min":1.032,"15min":1.131},"last":0.67100000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574930,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31880,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339960,"statfs":{"total":96636764160,"available":96604119040,"internally_reserved":0,"allocated":716800,"data_stored":297719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 18:43:31 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.63800000000000001,"15min":0.628},"min":{"1min":0.52000000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.86399999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.67900000000000005,"15min":0.68100000000000005},"min":{"1min":0.54500000000000004,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.90100000000000002,"5min":0.93500000000000005,"15min":0.94799999999999995},"last":0.496}]},{"osd":1,"last update":"Tue Nov 28 18:43:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.71999999999999997,"15min":0.72999999999999998},"min":{"1min":0.50800000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.93899999999999995,"5min":0.97199999999999998,"15min":1.073},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71099999999999997,"15min":0.72599999999999998},"min":{"1min":0.56999999999999995,"5min":0.48399999999999999,"15min":0.47099999999999997},"max":{"1min":0.875,"5min":0.96799999999999997,"15min":0.98099999999999998},"last":0.48099999999999998}]},{"osd":2,"last update":"Tue Nov 28 18:43:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.70999999999999996,"15min":0.70799999999999996},"min":{"1min":0.45400000000000001,"5min":0.45100000000000001,"15min":0.39400000000000002},"max":{"1min":0.94999999999999996,"5min":1.022,"15min":1.022},"last":0.621},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.72799999999999998,"15min":0.73999999999999999},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.45900000000000002},"max":{"1min":0.91200000000000003,"5min":0.98899999999999999,"15min":1.002},"last":0.60999999999999999}]},{"osd":3,"last update":"Tue Nov 28 18:43:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.72499999999999998,"15min":0.72999999999999998},"min":{"1min":0.52300000000000002,"5min":0.46300000000000002,"15min":0.44500000000000001},"max":{"1min":0.93400000000000005,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.75,"15min":0.77000000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.94099999999999995,"5min":0.97899999999999998,"15min":1.147},"last":0.71099999999999997}]},{"osd":4,"last update":"Tue Nov 28 18:43:31 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.61399999999999999,"15min":0.61899999999999999},"min":{"1min":0.42299999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.81699999999999995,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.66800000000000004,"15min":0.67600000000000005},"min":{"1min":0.48499999999999999,"5min":0.42799999999999999,"15min":0.41899999999999998},"max":{"1min":0.96399999999999997,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.46800000000000003}]},{"osd":6,"last update":"Tue Nov 28 18:43:31 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.65500000000000003,"15min":0.67600000000000005},"min":{"1min":0.47999999999999998,"5min":0.439,"15min":0.439},"max":{"1min":0.95199999999999996,"5min":1.026,"15min":1.026},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.68200000000000005,"15min":0.71899999999999997},"min":{"1min":0.505,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.873,"5min":0.97699999999999998,"15min":1.048},"last":0.40500000000000003}]},{"osd":7,"last update":"Tue Nov 28 18:43:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.72599999999999998,"15min":0.75},"min":{"1min":0.502,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.89200000000000002,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.748,"15min":0.79400000000000004},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.97499999999999998,"5min":1.0840000000000001,"15min":1.1200000000000001},"last":0.50900000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574931,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31888,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339952,"statfs":{"total":96636764160,"available":96604110848,"internally_reserved":0,"allocated":720896,"data_stored":298679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 18:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67200000000000004,"15min":0.63600000000000001},"min":{"1min":0.39800000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.93500000000000005,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.65300000000000002,"15min":0.78500000000000003},"min":{"1min":0.45700000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.91700000000000004,"5min":1.01,"15min":3.5179999999999998},"last":0.84999999999999998}]},{"osd":1,"last update":"Tue Nov 28 18:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.67900000000000005,"15min":0.80000000000000004},"min":{"1min":0.45500000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.83999999999999997,"5min":0.94399999999999995,"15min":3.5019999999999998},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.69099999999999995,"15min":0.81200000000000006},"min":{"1min":0.42599999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.91100000000000003,"5min":1.0640000000000001,"15min":3.5630000000000002},"last":0.89700000000000002}]},{"osd":2,"last update":"Tue Nov 28 18:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69899999999999995,"15min":0.80700000000000005},"min":{"1min":0.54800000000000004,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.91200000000000003,"5min":0.998,"15min":3.6709999999999998},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.71699999999999997,"15min":0.82499999999999996},"min":{"1min":0.53600000000000003,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.89400000000000002,"5min":1.018,"15min":3.4849999999999999},"last":0.93600000000000005}]},{"osd":3,"last update":"Tue Nov 28 18:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.68500000000000005,"15min":0.83699999999999997},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.82599999999999996,"5min":1.002,"15min":3.7130000000000001},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.72499999999999998,"15min":0.749},"min":{"1min":0.50600000000000001,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.95299999999999996,"5min":0.96499999999999997,"15min":0.98499999999999999},"last":0.87}]},{"osd":5,"last update":"Tue Nov 28 18:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.626,"15min":0.66000000000000003},"min":{"1min":0.43099999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.93999999999999995,"5min":1.05,"15min":1.05},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.63200000000000001,"15min":0.68400000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.82499999999999996,"5min":0.93700000000000006,"15min":0.95399999999999996},"last":0.53300000000000003}]},{"osd":6,"last update":"Tue Nov 28 18:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.64500000000000002,"15min":0.75900000000000001},"min":{"1min":0.47099999999999997,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.873,"5min":1.032,"15min":1.718},"last":0.627},{"interface":"front","average":{"1min":0.75,"5min":0.70599999999999996,"15min":0.75600000000000001},"min":{"1min":0.55400000000000005,"5min":0.441,"15min":0.441},"max":{"1min":0.93200000000000005,"5min":1.143,"15min":1.304},"last":0.66000000000000003}]},{"osd":7,"last update":"Tue Nov 28 18:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.66500000000000004,"15min":0.72899999999999998},"min":{"1min":0.501,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.86899999999999999,"5min":0.91800000000000004,"15min":1.0029999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.748,"5min":0.72099999999999997,"15min":0.80200000000000005},"min":{"1min":0.53000000000000003,"5min":0.504,"15min":0.504},"max":{"1min":0.99199999999999999,"5min":1.018,"15min":1.0329999999999999},"last":0.68200000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574931,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31880,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339960,"statfs":{"total":96636764160,"available":96604119040,"internally_reserved":0,"allocated":716800,"data_stored":297123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 18:43:32 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48299999999999998,"15min":0.442},"min":{"1min":0.32300000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.80700000000000005,"5min":2.4940000000000002,"15min":2.4940000000000002},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.501,"15min":0.48199999999999998},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.876,"5min":0.879,"15min":0.879},"last":0.35599999999999998}]},{"osd":1,"last update":"Tue Nov 28 18:43:32 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.50600000000000001,"15min":0.47099999999999997},"min":{"1min":0.30499999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.90200000000000002,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.436},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.57499999999999996,"15min":0.55000000000000004},"min":{"1min":0.39900000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.032,"5min":1.097,"15min":1.097},"last":0.50700000000000001}]},{"osd":2,"last update":"Tue Nov 28 18:43:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.59999999999999998,"15min":0.53600000000000003},"min":{"1min":0.38400000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.94899999999999995,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.374},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.61299999999999999,"15min":0.59299999999999997},"min":{"1min":0.41399999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.61199999999999999}]},{"osd":4,"last update":"Tue Nov 28 18:43:32 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.73399999999999999,"15min":0.76200000000000001},"min":{"1min":0.55200000000000005,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.093,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.76800000000000002,"15min":0.79200000000000004},"min":{"1min":0.505,"5min":0.504,"15min":0.504},"max":{"1min":0.98299999999999998,"5min":1.403,"15min":1.4990000000000001},"last":0.57799999999999996}]},{"osd":5,"last update":"Tue Nov 28 18:43:32 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.79900000000000004,"15min":0.81799999999999995},"min":{"1min":0.53900000000000003,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.26},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.79900000000000004,"15min":0.82499999999999996},"min":{"1min":0.60699999999999998,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.016,"5min":1.1339999999999999,"15min":1.2470000000000001},"last":0.56100000000000005}]},{"osd":6,"last update":"Tue Nov 28 18:43:32 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.78300000000000003,"15min":0.80700000000000005},"min":{"1min":0.64300000000000002,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.94899999999999995,"5min":1.371,"15min":1.4490000000000001},"last":0.629},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.77800000000000002,"15min":0.80600000000000005},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.171,"5min":1.171,"15min":1.377},"last":0.64800000000000002}]},{"osd":7,"last update":"Tue Nov 28 18:43:32 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.80900000000000005,"15min":0.82499999999999996},"min":{"1min":0.53200000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0149999999999999,"5min":1.155,"15min":1.169},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.82699999999999996,"15min":0.85099999999999998},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.008,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.52500000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574931,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31884,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339956,"statfs":{"total":96636764160,"available":96604114944,"internally_reserved":0,"allocated":716800,"data_stored":297123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 18:43:34 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.438,"15min":0.42999999999999999},"min":{"1min":0.28599999999999998,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.78300000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.48399999999999999,"15min":0.499},"min":{"1min":0.35999999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":1.589},"last":0.42299999999999999}]},{"osd":1,"last update":"Tue Nov 28 18:43:34 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.50600000000000001,"15min":0.48599999999999999},"min":{"1min":0.39300000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.85899999999999999,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.55400000000000005,"15min":0.53000000000000003},"min":{"1min":0.41499999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.90500000000000003,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.60699999999999998}]},{"osd":3,"last update":"Tue Nov 28 18:43:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.57999999999999996,"15min":0.56999999999999995},"min":{"1min":0.443,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.98499999999999999,"5min":1.0600000000000001,"15min":1.1879999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.57899999999999996,"15min":0.57699999999999996},"min":{"1min":0.45300000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.93600000000000005,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.56200000000000006}]},{"osd":4,"last update":"Tue Nov 28 18:43:34 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77500000000000002,"15min":0.755},"min":{"1min":0.61099999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.96199999999999997,"5min":1.167,"15min":1.167},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.748,"15min":0.748},"min":{"1min":0.58999999999999997,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0249999999999999,"5min":1.1279999999999999,"15min":1.665},"last":0.745}]},{"osd":5,"last update":"Tue Nov 28 18:43:34 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.77500000000000002,"15min":0.78000000000000003},"min":{"1min":0.60999999999999999,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.97999999999999998,"5min":1.2090000000000001,"15min":1.4099999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.78400000000000003,"15min":0.79400000000000004},"min":{"1min":0.58699999999999997,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.004,"5min":1.3029999999999999,"15min":1.4450000000000001},"last":0.80400000000000005}]},{"osd":6,"last update":"Tue Nov 28 18:43:34 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.77400000000000002,"15min":0.80100000000000005},"min":{"1min":0.57799999999999996,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0880000000000001,"5min":1.24,"15min":1.7070000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.78700000000000003,"15min":0.78300000000000003},"min":{"1min":0.67300000000000004,"5min":0.499,"15min":0.499},"max":{"1min":0.94499999999999995,"5min":1.1479999999999999,"15min":1.4950000000000001},"last":0.77900000000000003}]},{"osd":7,"last update":"Tue Nov 28 18:43:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.78600000000000003,"15min":0.78700000000000003},"min":{"1min":0.621,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.123,"5min":1.3180000000000001,"15min":1.7509999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.81999999999999995,"15min":0.81799999999999995},"min":{"1min":0.63600000000000001,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.0369999999999999,"5min":1.2729999999999999,"15min":1.341},"last":0.877}]}]},{"osd":1,"up_from":13,"seq":55834574931,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31876,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339964,"statfs":{"total":96636764160,"available":96604123136,"internally_reserved":0,"allocated":712704,"data_stored":297157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 18:43:31 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.44600000000000001,"15min":0.55700000000000005},"min":{"1min":0.313,"5min":0.255,"15min":0.255},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":2.2090000000000001},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.48999999999999999,"15min":0.67200000000000004},"min":{"1min":0.33200000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.89200000000000002,"5min":0.96499999999999997,"15min":4.0899999999999999},"last":0.379}]},{"osd":2,"last update":"Tue Nov 28 18:43:31 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.498,"15min":0.60999999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.77300000000000002,"5min":0.872,"15min":3.8620000000000001},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.55100000000000005,"15min":0.68700000000000006},"min":{"1min":0.371,"5min":0.309,"15min":0.309},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":2.823},"last":0.40200000000000002}]},{"osd":3,"last update":"Tue Nov 28 18:43:31 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.59199999999999997,"15min":0.70999999999999996},"min":{"1min":0.41899999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.89900000000000002,"5min":0.93899999999999995,"15min":4.0739999999999998},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.64500000000000002,"15min":0.80500000000000005},"min":{"1min":0.499,"5min":0.47699999999999998,"15min":0.44800000000000001},"max":{"1min":0.97799999999999998,"5min":0.995,"15min":3.6659999999999999},"last":0.65000000000000002}]},{"osd":4,"last update":"Tue Nov 28 18:43:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72599999999999998,"15min":0.94699999999999995},"min":{"1min":0.61499999999999999,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.96099999999999997,"5min":1.1399999999999999,"15min":5.3540000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.75,"15min":0.90900000000000003},"min":{"1min":0.495,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.97999999999999998,"5min":1.2769999999999999,"15min":5.5},"last":0.54400000000000004}]},{"osd":5,"last update":"Tue Nov 28 18:43:31 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.78300000000000003,"15min":0.99299999999999999},"min":{"1min":0.55300000000000005,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.002,"5min":1.347,"15min":5.4379999999999997},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.82199999999999995,"15min":1.026},"min":{"1min":0.57899999999999996,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.077,"5min":1.204,"15min":3.4500000000000002},"last":0.61099999999999999}]},{"osd":6,"last update":"Tue Nov 28 18:43:31 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.84299999999999997,"15min":0.98099999999999998},"min":{"1min":0.70199999999999996,"5min":0.58799999999999997,"15min":0.54500000000000004},"max":{"1min":1.0720000000000001,"5min":1.367,"15min":3.0369999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79600000000000004,"15min":0.99299999999999999},"min":{"1min":0.59499999999999997,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.032,"5min":1.3100000000000001,"15min":5.4000000000000004},"last":0.63}]},{"osd":7,"last update":"Tue Nov 28 18:43:31 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.79400000000000004,"15min":0.97799999999999998},"min":{"1min":0.53500000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.014,"5min":1.331,"15min":5.5369999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.85799999999999998,"15min":1.0249999999999999},"min":{"1min":0.74199999999999999,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.044,"5min":1.4079999999999999,"15min":3.2480000000000002},"last":0.55300000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574932,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32468,"kb_used_data":1288,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339372,"statfs":{"total":96636764160,"available":96603516928,"internally_reserved":0,"allocated":1318912,"data_stored":889629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 18:43:33 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.45600000000000002,"15min":0.41599999999999998},"min":{"1min":0.30199999999999999,"5min":0.253,"15min":0.253},"max":{"1min":0.65400000000000003,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.51700000000000002,"15min":0.47299999999999998},"min":{"1min":0.316,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.82899999999999996,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.51100000000000001}]},{"osd":2,"last update":"Tue Nov 28 18:43:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.54600000000000004,"15min":0.501},"min":{"1min":0.36299999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.89700000000000002,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.54400000000000004,"15min":0.51600000000000001},"min":{"1min":0.35699999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.94599999999999995,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.59399999999999997}]},{"osd":3,"last update":"Tue Nov 28 18:43:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.54900000000000004,"15min":0.497},"min":{"1min":0.37,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.60099999999999998,"15min":0.56499999999999995},"min":{"1min":0.47299999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.46100000000000002}]},{"osd":4,"last update":"Tue Nov 28 18:43:33 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.79000000000000004,"15min":0.754},"min":{"1min":0.59799999999999998,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.81499999999999995,"15min":0.77200000000000002},"min":{"1min":0.64000000000000001,"5min":0.56999999999999995,"15min":0.55500000000000005},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.96399999999999997}]},{"osd":5,"last update":"Tue Nov 28 18:43:33 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.77700000000000002,"15min":0.75600000000000001},"min":{"1min":0.57799999999999996,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.76200000000000001,"15min":0.73799999999999999},"min":{"1min":0.65900000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0269999999999999},"last":0.86099999999999999}]},{"osd":6,"last update":"Tue Nov 28 18:43:33 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.78300000000000003,"15min":0.77300000000000002},"min":{"1min":0.61199999999999999,"5min":0.56000000000000005,"15min":0.54900000000000004},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.76500000000000001,"15min":0.76400000000000001},"min":{"1min":0.66900000000000004,"5min":0.498,"15min":0.498},"max":{"1min":1.222,"5min":1.222,"15min":1.3420000000000001},"last":0.876}]},{"osd":7,"last update":"Tue Nov 28 18:43:33 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81100000000000005,"15min":0.81200000000000006},"min":{"1min":0.64000000000000001,"5min":0.57799999999999996,"15min":0.57299999999999995},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.68999999999999995,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.91900000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T18:44:03.774 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-28T18:44:03.775 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-28T18:44:03.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.962+0000 7f552fa5a640 1 Processor -- start 2023-11-28T18:44:03.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.962+0000 7f552fa5a640 1 -- start start 2023-11-28T18:44:03.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.962+0000 7f552fa5a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f55280b4500 0x7f55280b48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:03.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.962+0000 7f552fa5a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f552806e3f0 0x7f55280b3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:03.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.962+0000 7f552fa5a640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f552815e160 con 0x7f552815d610 2023-11-28T18:44:03.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.962+0000 7f552fa5a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55280af6d0 con 0x7f55280b4500 2023-11-28T18:44:03.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.962+0000 7f552fa5a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55280af930 con 0x7f552806e3f0 2023-11-28T18:44:03.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.962+0000 7f552d7f6640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f55280b4500 0x7f55280b48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:03.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.962+0000 7f552d7f6640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f55280b4500 0x7f55280b48e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56262/0 (socket says 172.21.15.45:56262) 2023-11-28T18:44:03.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.962+0000 7f552d7f6640 1 -- 172.21.15.45:0/3130720762 learned_addr learned my addr 172.21.15.45:0/3130720762 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:44:03.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.962+0000 7f552dff7640 1 --2- 172.21.15.45:0/3130720762 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f552806e3f0 0x7f55280b3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:03.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.962+0000 7f552d7f6640 1 -- 172.21.15.45:0/3130720762 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f552806e3f0 msgr2=0x7f55280b3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:44:03.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.962+0000 7f552d7f6640 1 --2- 172.21.15.45:0/3130720762 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f552806e3f0 0x7f55280b3080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:03.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.962+0000 7f552d7f6640 1 -- 172.21.15.45:0/3130720762 >> v1:172.21.15.190:6789/0 conn(0x7f552815d610 legacy=0x7f55280aefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:03.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.962+0000 7f552d7f6640 1 -- 172.21.15.45:0/3130720762 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f552815db10 con 0x7f55280b4500 2023-11-28T18:44:03.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.966+0000 7f552d7f6640 1 --2- 172.21.15.45:0/3130720762 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55280b4500 0x7f55280b48e0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f5524009870 tx=0x7f552401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6351352143aaeca8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:44:03.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.966+0000 7f551ffff640 1 -- 172.21.15.45:0/3130720762 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55240a6040 con 0x7f55280b4500 2023-11-28T18:44:03.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.966+0000 7f551ffff640 1 -- 172.21.15.45:0/3130720762 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55240aa600 con 0x7f55280b4500 2023-11-28T18:44:03.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.966+0000 7f551ffff640 1 -- 172.21.15.45:0/3130720762 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55240aa990 con 0x7f55280b4500 2023-11-28T18:44:03.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.966+0000 7f552fa5a640 1 -- 172.21.15.45:0/3130720762 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55280b4500 msgr2=0x7f55280b48e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:03.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.966+0000 7f552fa5a640 1 --2- 172.21.15.45:0/3130720762 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55280b4500 0x7f55280b48e0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f5524009870 tx=0x7f552401c480 comp rx=0 tx=0).stop 2023-11-28T18:44:03.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.966+0000 7f552fa5a640 1 -- 172.21.15.45:0/3130720762 shutdown_connections 2023-11-28T18:44:03.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.966+0000 7f552fa5a640 1 --2- 172.21.15.45:0/3130720762 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f552806e3f0 0x7f55280b3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:03.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.966+0000 7f552fa5a640 1 --2- 172.21.15.45:0/3130720762 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55280b4500 0x7f55280b48e0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:03.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.966+0000 7f552fa5a640 1 -- 172.21.15.45:0/3130720762 >> 172.21.15.45:0/3130720762 conn(0x7f552806d530 msgr2=0x7f552806d940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:44:03.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.966+0000 7f552fa5a640 1 -- 172.21.15.45:0/3130720762 shutdown_connections 2023-11-28T18:44:03.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.966+0000 7f552fa5a640 1 -- 172.21.15.45:0/3130720762 wait complete. 2023-11-28T18:44:03.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.970+0000 7f552fa5a640 1 Processor -- start 2023-11-28T18:44:03.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.970+0000 7f552fa5a640 1 -- start start 2023-11-28T18:44:03.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.970+0000 7f552fa5a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f552806e3f0 0x7f55281462a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:03.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.970+0000 7f552fa5a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f55280b4500 0x7f55281450d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:03.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.970+0000 7f552fa5a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f552815d610 0x7f5528150500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:03.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.970+0000 7f552fa5a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f552814a310 con 0x7f552815d610 2023-11-28T18:44:03.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.970+0000 7f552fa5a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5528149a00 con 0x7f552806e3f0 2023-11-28T18:44:03.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.970+0000 7f552fa5a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5528146ad0 con 0x7f55280b4500 2023-11-28T18:44:03.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.970+0000 7f552dff7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f552815d610 0x7f5528150500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:03.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.970+0000 7f552dff7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f552815d610 0x7f5528150500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56270/0 (socket says 172.21.15.45:56270) 2023-11-28T18:44:03.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.970+0000 7f552dff7640 1 -- 172.21.15.45:0/3783933618 learned_addr learned my addr 172.21.15.45:0/3783933618 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:44:03.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.970+0000 7f552d7f6640 1 --2- 172.21.15.45:0/3783933618 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f552806e3f0 0x7f55281462a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:03.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.970+0000 7f552cff5640 1 --2- 172.21.15.45:0/3783933618 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f55280b4500 0x7f55281450d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:03.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.970+0000 7f552dff7640 1 -- 172.21.15.45:0/3783933618 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f55280b4500 msgr2=0x7f55281450d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:03.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.970+0000 7f552dff7640 1 --2- 172.21.15.45:0/3783933618 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f55280b4500 0x7f55281450d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:03.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.970+0000 7f552dff7640 1 -- 172.21.15.45:0/3783933618 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f552806e3f0 msgr2=0x7f55281462a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:03.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.970+0000 7f552dff7640 1 --2- 172.21.15.45:0/3783933618 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f552806e3f0 0x7f55281462a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:03.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.970+0000 7f552dff7640 1 -- 172.21.15.45:0/3783933618 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55240094d0 con 0x7f552815d610 2023-11-28T18:44:03.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.970+0000 7f552dff7640 1 --2- 172.21.15.45:0/3783933618 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f552815d610 0x7f5528150500 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f5520007e40 tx=0x7f552000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:44:03.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.970+0000 7f551dffb640 1 -- 172.21.15.45:0/3783933618 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5520014620 con 0x7f552815d610 2023-11-28T18:44:03.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.970+0000 7f551dffb640 1 -- 172.21.15.45:0/3783933618 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f552000ee90 con 0x7f552815d610 2023-11-28T18:44:03.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.970+0000 7f552fa5a640 1 -- 172.21.15.45:0/3783933618 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5528149cc0 con 0x7f552815d610 2023-11-28T18:44:03.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.970+0000 7f551dffb640 1 -- 172.21.15.45:0/3783933618 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55200149e0 con 0x7f552815d610 2023-11-28T18:44:03.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.974+0000 7f552fa5a640 1 -- 172.21.15.45:0/3783933618 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55281467e0 con 0x7f552815d610 2023-11-28T18:44:03.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.974+0000 7f552fa5a640 1 -- 172.21.15.45:0/3783933618 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f552814a480 con 0x7f552815d610 2023-11-28T18:44:03.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.974+0000 7f551dffb640 1 -- 172.21.15.45:0/3783933618 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f5520014b40 con 0x7f552815d610 2023-11-28T18:44:03.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.974+0000 7f551dffb640 1 --2- 172.21.15.45:0/3783933618 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f550c0668d0 0x7f550c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:03.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.974+0000 7f551dffb640 1 -- 172.21.15.45:0/3783933618 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5520084cc0 con 0x7f552815d610 2023-11-28T18:44:03.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.974+0000 7f552d7f6640 1 --2- 172.21.15.45:0/3783933618 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f550c0668d0 0x7f550c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:03.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.978+0000 7f552d7f6640 1 --2- 172.21.15.45:0/3783933618 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f550c0668d0 0x7f550c068d90 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f55240ae000 tx=0x7f55240b5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:44:03.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:03.978+0000 7f551dffb640 1 -- 172.21.15.45:0/3783933618 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5520051fa0 con 0x7f552815d610 2023-11-28T18:44:04.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.194+0000 7f552fa5a640 1 -- 172.21.15.45:0/3783933618 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f5528069480 con 0x7f552815d610 2023-11-28T18:44:04.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.198+0000 7f551dffb640 1 -- 172.21.15.45:0/3783933618 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+147 (secure 0 0 0) 0x7f55200555c0 con 0x7f552815d610 2023-11-28T18:44:04.199 INFO:teuthology.orchestra.run.smithi045.stdout:[client.0] 2023-11-28T18:44:04.200 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQApM2ZlTJxNMBAAwJAMWm1Y180iNJmgHnWFnw== 2023-11-28T18:44:04.200 INFO:teuthology.orchestra.run.smithi045.stdout: caps mds = "allow" 2023-11-28T18:44:04.200 INFO:teuthology.orchestra.run.smithi045.stdout: caps mon = "allow r" 2023-11-28T18:44:04.200 INFO:teuthology.orchestra.run.smithi045.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-28T18:44:04.201 INFO:teuthology.orchestra.run.smithi045.stderr:updated caps for client.0 2023-11-28T18:44:04.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.202+0000 7f552fa5a640 1 -- 172.21.15.45:0/3783933618 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f550c0668d0 msgr2=0x7f550c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:04.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.202+0000 7f552fa5a640 1 --2- 172.21.15.45:0/3783933618 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f550c0668d0 0x7f550c068d90 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f55240ae000 tx=0x7f55240b5040 comp rx=0 tx=0).stop 2023-11-28T18:44:04.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.202+0000 7f552fa5a640 1 -- 172.21.15.45:0/3783933618 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f552815d610 msgr2=0x7f5528150500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:04.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.202+0000 7f552fa5a640 1 --2- 172.21.15.45:0/3783933618 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f552815d610 0x7f5528150500 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f5520007e40 tx=0x7f552000e4b0 comp rx=0 tx=0).stop 2023-11-28T18:44:04.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.202+0000 7f552fa5a640 1 -- 172.21.15.45:0/3783933618 shutdown_connections 2023-11-28T18:44:04.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.202+0000 7f552fa5a640 1 --2- 172.21.15.45:0/3783933618 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f550c0668d0 0x7f550c068d90 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:04.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.202+0000 7f552fa5a640 1 --2- 172.21.15.45:0/3783933618 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f552815d610 0x7f5528150500 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:04.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.202+0000 7f552fa5a640 1 --2- 172.21.15.45:0/3783933618 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f55280b4500 0x7f55281450d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:04.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.202+0000 7f552fa5a640 1 --2- 172.21.15.45:0/3783933618 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f552806e3f0 0x7f55281462a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:04.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.202+0000 7f552fa5a640 1 -- 172.21.15.45:0/3783933618 >> 172.21.15.45:0/3783933618 conn(0x7f552806d530 msgr2=0x7f55280ae000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:44:04.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.202+0000 7f552fa5a640 1 -- 172.21.15.45:0/3783933618 shutdown_connections 2023-11-28T18:44:04.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.202+0000 7f552fa5a640 1 -- 172.21.15.45:0/3783933618 wait complete. 2023-11-28T18:44:04.221 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T18:44:04.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.366+0000 7f4162b3e640 1 Processor -- start 2023-11-28T18:44:04.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.366+0000 7f4162b3e640 1 -- start start 2023-11-28T18:44:04.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.366+0000 7f4162b3e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f415c0b35f0 0x7f415c0d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:04.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.366+0000 7f4162b3e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f415c0b3cb0 0x7f415c15f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:04.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.366+0000 7f4162b3e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f415c0d38c0 con 0x7f415c0cf7c0 2023-11-28T18:44:04.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.366+0000 7f4162b3e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f415c0d40d0 con 0x7f415c0b3cb0 2023-11-28T18:44:04.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.366+0000 7f4162b3e640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f415c0cdcc0 con 0x7f415c0b35f0 2023-11-28T18:44:04.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.366+0000 7f41610db640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f415c0cf7c0 0x7f415c0ce480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47290/0 (socket says 172.21.15.45:47290) 2023-11-28T18:44:04.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.366+0000 7f41610db640 1 -- 172.21.15.45:0/3267891194 learned_addr learned my addr 172.21.15.45:0/3267891194 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:44:04.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.366+0000 7f415bfff640 1 --2- 172.21.15.45:0/3267891194 >> v2:172.21.15.45:3300/0 conn(0x7f415c0b3cb0 0x7f415c15f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:04.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.366+0000 7f41608da640 1 --2- 172.21.15.45:0/3267891194 >> v2:172.21.15.190:3300/0 conn(0x7f415c0b35f0 0x7f415c0d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:04.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.366+0000 7f415bfff640 1 -- 172.21.15.45:0/3267891194 >> v2:172.21.15.190:3300/0 conn(0x7f415c0b35f0 msgr2=0x7f415c0d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:44:04.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.366+0000 7f415bfff640 1 --2- 172.21.15.45:0/3267891194 >> v2:172.21.15.190:3300/0 conn(0x7f415c0b35f0 0x7f415c0d0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:04.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.366+0000 7f415bfff640 1 -- 172.21.15.45:0/3267891194 >> v1:172.21.15.45:6789/0 conn(0x7f415c0cf7c0 legacy=0x7f415c0ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:04.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.366+0000 7f415bfff640 1 -- 172.21.15.45:0/3267891194 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f415c0d3b10 con 0x7f415c0b3cb0 2023-11-28T18:44:04.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.366+0000 7f415b7fe640 1 -- 172.21.15.45:0/3267891194 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1299778832 0 0) 0x7f415c0d38c0 con 0x7f415c0cf7c0 2023-11-28T18:44:04.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.370+0000 7f415bfff640 1 --2- 172.21.15.45:0/3267891194 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f415c0b3cb0 0x7f415c15f0a0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f415c08ca20 tx=0x7f414801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caf75fd6c18fd82f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:44:04.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.370+0000 7f415b7fe640 1 -- 172.21.15.45:0/3267891194 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41480ab660 con 0x7f415c0b3cb0 2023-11-28T18:44:04.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.370+0000 7f415b7fe640 1 -- 172.21.15.45:0/3267891194 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41480ab7c0 con 0x7f415c0b3cb0 2023-11-28T18:44:04.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.370+0000 7f415b7fe640 1 -- 172.21.15.45:0/3267891194 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41480abb50 con 0x7f415c0b3cb0 2023-11-28T18:44:04.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.370+0000 7f4162b3e640 1 -- 172.21.15.45:0/3267891194 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f415c0b3cb0 msgr2=0x7f415c15f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:04.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.370+0000 7f4162b3e640 1 --2- 172.21.15.45:0/3267891194 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f415c0b3cb0 0x7f415c15f0a0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f415c08ca20 tx=0x7f414801c460 comp rx=0 tx=0).stop 2023-11-28T18:44:04.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.370+0000 7f4162b3e640 1 -- 172.21.15.45:0/3267891194 shutdown_connections 2023-11-28T18:44:04.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.370+0000 7f4162b3e640 1 --2- 172.21.15.45:0/3267891194 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f415c0b3cb0 0x7f415c15f0a0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:04.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.370+0000 7f4162b3e640 1 --2- 172.21.15.45:0/3267891194 >> v2:172.21.15.190:3300/0 conn(0x7f415c0b35f0 0x7f415c0d0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:04.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.370+0000 7f4162b3e640 1 -- 172.21.15.45:0/3267891194 >> 172.21.15.45:0/3267891194 conn(0x7f415c09c4f0 msgr2=0x7f415c0d31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:44:04.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.370+0000 7f4162b3e640 1 -- 172.21.15.45:0/3267891194 shutdown_connections 2023-11-28T18:44:04.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.370+0000 7f4162b3e640 1 -- 172.21.15.45:0/3267891194 wait complete. 2023-11-28T18:44:04.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.374+0000 7f4162b3e640 1 Processor -- start 2023-11-28T18:44:04.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.374+0000 7f4162b3e640 1 -- start start 2023-11-28T18:44:04.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.374+0000 7f4162b3e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f415c0b35f0 0x7f415c1445c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:04.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.374+0000 7f4162b3e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f415c0b3cb0 0x7f415c15ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:04.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.374+0000 7f4162b3e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f415c0cf7c0 0x7f415c140cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:04.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.374+0000 7f4162b3e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f415c0cb470 con 0x7f415c0cf7c0 2023-11-28T18:44:04.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.374+0000 7f4162b3e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f415c144b00 con 0x7f415c0b35f0 2023-11-28T18:44:04.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.374+0000 7f4162b3e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f415c15dbf0 con 0x7f415c0b3cb0 2023-11-28T18:44:04.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.374+0000 7f41610db640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f415c0cf7c0 0x7f415c140cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:04.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.374+0000 7f41610db640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f415c0cf7c0 0x7f415c140cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56280/0 (socket says 172.21.15.45:56280) 2023-11-28T18:44:04.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.374+0000 7f41610db640 1 -- 172.21.15.45:0/283884079 learned_addr learned my addr 172.21.15.45:0/283884079 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:44:04.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.374+0000 7f41608da640 1 --2- 172.21.15.45:0/283884079 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f415c0b35f0 0x7f415c1445c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:04.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.374+0000 7f415bfff640 1 --2- 172.21.15.45:0/283884079 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f415c0b3cb0 0x7f415c15ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:04.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.374+0000 7f41610db640 1 -- 172.21.15.45:0/283884079 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f415c0b3cb0 msgr2=0x7f415c15ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:04.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.374+0000 7f41610db640 1 --2- 172.21.15.45:0/283884079 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f415c0b3cb0 0x7f415c15ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:04.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.374+0000 7f41610db640 1 -- 172.21.15.45:0/283884079 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f415c0b35f0 msgr2=0x7f415c1445c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:04.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.374+0000 7f41610db640 1 --2- 172.21.15.45:0/283884079 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f415c0b35f0 0x7f415c1445c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:04.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.374+0000 7f41610db640 1 -- 172.21.15.45:0/283884079 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4148009420 con 0x7f415c0cf7c0 2023-11-28T18:44:04.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.374+0000 7f415bfff640 1 --2- 172.21.15.45:0/283884079 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f415c0b3cb0 0x7f415c15ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:44:04.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.374+0000 7f41610db640 1 --2- 172.21.15.45:0/283884079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f415c0cf7c0 0x7f415c140cb0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f415400c780 tx=0x7f415400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:44:04.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.374+0000 7f41597fa640 1 -- 172.21.15.45:0/283884079 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4154004d70 con 0x7f415c0cf7c0 2023-11-28T18:44:04.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.374+0000 7f41597fa640 1 -- 172.21.15.45:0/283884079 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f415400a640 con 0x7f415c0cf7c0 2023-11-28T18:44:04.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.374+0000 7f41597fa640 1 -- 172.21.15.45:0/283884079 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f415400aa70 con 0x7f415c0cf7c0 2023-11-28T18:44:04.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.374+0000 7f4162b3e640 1 -- 172.21.15.45:0/283884079 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f415c0d0160 con 0x7f415c0cf7c0 2023-11-28T18:44:04.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.374+0000 7f4162b3e640 1 -- 172.21.15.45:0/283884079 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f415c0cba10 con 0x7f415c0cf7c0 2023-11-28T18:44:04.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.378+0000 7f4162b3e640 1 -- 172.21.15.45:0/283884079 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f415c0cbba0 con 0x7f415c0cf7c0 2023-11-28T18:44:04.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.378+0000 7f41597fa640 1 -- 172.21.15.45:0/283884079 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f415400abd0 con 0x7f415c0cf7c0 2023-11-28T18:44:04.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.378+0000 7f41597fa640 1 --2- 172.21.15.45:0/283884079 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4140066900 0x7f4140068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:04.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.378+0000 7f41597fa640 1 -- 172.21.15.45:0/283884079 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f41540837a0 con 0x7f415c0cf7c0 2023-11-28T18:44:04.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.378+0000 7f41608da640 1 --2- 172.21.15.45:0/283884079 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4140066900 0x7f4140068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:04.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.378+0000 7f41608da640 1 --2- 172.21.15.45:0/283884079 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4140066900 0x7f4140068dc0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f4150007a60 tx=0x7f4150008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:44:04.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.382+0000 7f41597fa640 1 -- 172.21.15.45:0/283884079 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4154050a90 con 0x7f415c0cf7c0 2023-11-28T18:44:04.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.578+0000 7f4162b3e640 1 -- 172.21.15.45:0/283884079 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f415c069480 con 0x7f415c0cf7c0 2023-11-28T18:44:04.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.578+0000 7f41597fa640 1 -- 172.21.15.45:0/283884079 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4919 (secure 0 0 0) 0x7f4154018090 con 0x7f415c0cf7c0 2023-11-28T18:44:04.580 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:44:04.580 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":48,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6002,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/1183598108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":1183598108},{"type":"v1","addr":"172.21.15.190:6836","nonce":1183598108}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6005,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/3723100406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":3723100406},{"type":"v1","addr":"172.21.15.190:6837","nonce":3723100406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6789,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/1994543507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1994543507},{"type":"v1","addr":"172.21.15.45:6833","nonce":1994543507}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T18:43:58.654090+0000","modified":"2023-11-28T18:44:01.668714+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6792},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6792":{"gid":6792,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/2107305848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2107305848},{"type":"v1","addr":"172.21.15.45:6835","nonce":2107305848}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-28T18:44:04.581 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 48 2023-11-28T18:44:04.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.582+0000 7f4162b3e640 1 -- 172.21.15.45:0/283884079 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4140066900 msgr2=0x7f4140068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:04.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.582+0000 7f4162b3e640 1 --2- 172.21.15.45:0/283884079 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4140066900 0x7f4140068dc0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f4150007a60 tx=0x7f4150008040 comp rx=0 tx=0).stop 2023-11-28T18:44:04.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.582+0000 7f4162b3e640 1 -- 172.21.15.45:0/283884079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f415c0cf7c0 msgr2=0x7f415c140cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:04.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.582+0000 7f4162b3e640 1 --2- 172.21.15.45:0/283884079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f415c0cf7c0 0x7f415c140cb0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f415400c780 tx=0x7f415400cc40 comp rx=0 tx=0).stop 2023-11-28T18:44:04.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.582+0000 7f4162b3e640 1 -- 172.21.15.45:0/283884079 shutdown_connections 2023-11-28T18:44:04.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.582+0000 7f4162b3e640 1 --2- 172.21.15.45:0/283884079 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f4140066900 0x7f4140068dc0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:04.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.582+0000 7f4162b3e640 1 --2- 172.21.15.45:0/283884079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f415c0cf7c0 0x7f415c140cb0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:04.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.582+0000 7f4162b3e640 1 --2- 172.21.15.45:0/283884079 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f415c0b3cb0 0x7f415c15ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:04.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.582+0000 7f4162b3e640 1 --2- 172.21.15.45:0/283884079 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f415c0b35f0 0x7f415c1445c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:04.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.582+0000 7f4162b3e640 1 -- 172.21.15.45:0/283884079 >> 172.21.15.45:0/283884079 conn(0x7f415c09c4f0 msgr2=0x7f415c0ce380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:44:04.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.582+0000 7f4162b3e640 1 -- 172.21.15.45:0/283884079 shutdown_connections 2023-11-28T18:44:04.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:04.582+0000 7f4162b3e640 1 -- 172.21.15.45:0/283884079 wait complete. 2023-11-28T18:44:05.004 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 48, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-28T18:43:58.654090+0000', 'modified': '2023-11-28T18:44:01.668714+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6792}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6792': {'gid': 6792, 'name': 'a', 'rank': 0, 'incarnation': 44, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.45:6835/2107305848', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.45:6834', 'nonce': 2107305848}, {'type': 'v1', 'addr': '172.21.15.45:6835', 'nonce': 2107305848}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-28T18:44:05.005 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-28T18:44:05.005 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-28T18:44:05.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.150+0000 7f5c96afe640 1 Processor -- start 2023-11-28T18:44:05.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.150+0000 7f5c96afe640 1 -- start start 2023-11-28T18:44:05.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.150+0000 7f5c96afe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5c9006ca10 0x7f5c900704a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:05.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.150+0000 7f5c96afe640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c90071120 con 0x7f5c90144880 2023-11-28T18:44:05.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.150+0000 7f5c96afe640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c90071400 con 0x7f5c900721c0 2023-11-28T18:44:05.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.150+0000 7f5c96afe640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c9015f050 con 0x7f5c9006ca10 2023-11-28T18:44:05.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.150+0000 7f5c9489a640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f5c90144880 0x7f5c9006c300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47294/0 (socket says 172.21.15.45:47294) 2023-11-28T18:44:05.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.150+0000 7f5c9489a640 1 -- 172.21.15.45:0/926924375 learned_addr learned my addr 172.21.15.45:0/926924375 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:44:05.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.150+0000 7f5c8ffff640 1 --2- 172.21.15.45:0/926924375 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5c9006ca10 0x7f5c900704a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:05.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.150+0000 7f5c8f7fe640 1 -- 172.21.15.45:0/926924375 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2373460589 0 0) 0x7f5c90071120 con 0x7f5c90144880 2023-11-28T18:44:05.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.150+0000 7f5c8f7fe640 1 -- 172.21.15.45:0/926924375 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c80003530 con 0x7f5c90144880 2023-11-28T18:44:05.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.154+0000 7f5c8f7fe640 1 -- 172.21.15.45:0/926924375 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3358145941 0 0) 0x7f5c90071400 con 0x7f5c900721c0 2023-11-28T18:44:05.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.154+0000 7f5c8f7fe640 1 -- 172.21.15.45:0/926924375 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c90071120 con 0x7f5c900721c0 2023-11-28T18:44:05.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.154+0000 7f5c8f7fe640 1 -- 172.21.15.45:0/926924375 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 877490075 0 0) 0x7f5c80003530 con 0x7f5c90144880 2023-11-28T18:44:05.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.154+0000 7f5c8f7fe640 1 -- 172.21.15.45:0/926924375 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5c9006ca10 msgr2=0x7f5c900704a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:44:05.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.154+0000 7f5c8f7fe640 1 --2- 172.21.15.45:0/926924375 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5c9006ca10 0x7f5c900704a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:05.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.154+0000 7f5c8f7fe640 1 -- 172.21.15.45:0/926924375 >> v1:172.21.15.190:6789/0 conn(0x7f5c900721c0 legacy=0x7f5c9015b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:05.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.154+0000 7f5c8f7fe640 1 -- 172.21.15.45:0/926924375 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c900716e0 con 0x7f5c90144880 2023-11-28T18:44:05.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.154+0000 7f5c8f7fe640 1 -- 172.21.15.45:0/926924375 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4084481567 0 0) 0x7f5c84001680 con 0x7f5c90144880 2023-11-28T18:44:05.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.154+0000 7f5c8f7fe640 1 -- 172.21.15.45:0/926924375 >> v1:172.21.15.45:6789/0 conn(0x7f5c90144880 legacy=0x7f5c9006c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:05.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.154+0000 7f5c8f7fe640 1 --2- 172.21.15.45:0/926924375 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5c9006ca10 0x7f5c80003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:05.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.154+0000 7f5c8f7fe640 1 --2- 172.21.15.45:0/926924375 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5c800040a0 0x7f5c800047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:05.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.154+0000 7f5c8f7fe640 1 --2- 172.21.15.45:0/926924375 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c80004d10 0x7f5c80005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:05.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.154+0000 7f5c8f7fe640 1 -- 172.21.15.45:0/926924375 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c8000ba40 con 0x7f5c80004d10 2023-11-28T18:44:05.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.154+0000 7f5c8f7fe640 1 -- 172.21.15.45:0/926924375 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c8000bbb0 con 0x7f5c800040a0 2023-11-28T18:44:05.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.154+0000 7f5c8f7fe640 1 -- 172.21.15.45:0/926924375 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c8000bd70 con 0x7f5c9006ca10 2023-11-28T18:44:05.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.154+0000 7f5c9509b640 1 --2- 172.21.15.45:0/926924375 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c80004d10 0x7f5c80005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:05.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.154+0000 7f5c8ffff640 1 --2- 172.21.15.45:0/926924375 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5c800040a0 0x7f5c800047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:05.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.154+0000 7f5c9489a640 1 --2- 172.21.15.45:0/926924375 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5c9006ca10 0x7f5c80003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:05.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.154+0000 7f5c9509b640 1 -- 172.21.15.45:0/926924375 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5c9006ca10 msgr2=0x7f5c80003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:44:05.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.154+0000 7f5c9509b640 1 --2- 172.21.15.45:0/926924375 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5c9006ca10 0x7f5c80003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:05.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.154+0000 7f5c9509b640 1 -- 172.21.15.45:0/926924375 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5c800040a0 msgr2=0x7f5c800047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:44:05.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.154+0000 7f5c9509b640 1 --2- 172.21.15.45:0/926924375 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5c800040a0 0x7f5c800047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:05.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.154+0000 7f5c9509b640 1 -- 172.21.15.45:0/926924375 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c80003530 con 0x7f5c80004d10 2023-11-28T18:44:05.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.158+0000 7f5c9509b640 1 --2- 172.21.15.45:0/926924375 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c80004d10 0x7f5c80005190 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f5c9006e7b0 tx=0x7f5c8801c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bd832902e60faac server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:44:05.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.158+0000 7f5c8f7fe640 1 -- 172.21.15.45:0/926924375 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c84007ea0 con 0x7f5c80004d10 2023-11-28T18:44:05.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.158+0000 7f5c8f7fe640 1 -- 172.21.15.45:0/926924375 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c88003ba0 con 0x7f5c80004d10 2023-11-28T18:44:05.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.158+0000 7f5c8f7fe640 1 -- 172.21.15.45:0/926924375 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c880050d0 con 0x7f5c80004d10 2023-11-28T18:44:05.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.158+0000 7f5c96afe640 1 -- 172.21.15.45:0/926924375 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c80004d10 msgr2=0x7f5c80005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:05.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.158+0000 7f5c96afe640 1 --2- 172.21.15.45:0/926924375 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c80004d10 0x7f5c80005190 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f5c9006e7b0 tx=0x7f5c8801c8c0 comp rx=0 tx=0).stop 2023-11-28T18:44:05.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.158+0000 7f5c9509b640 1 -- 172.21.15.45:0/926924375 reap_dead start 2023-11-28T18:44:05.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.158+0000 7f5c96afe640 1 -- 172.21.15.45:0/926924375 shutdown_connections 2023-11-28T18:44:05.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.158+0000 7f5c96afe640 1 -- 172.21.15.45:0/926924375 >> 172.21.15.45:0/926924375 conn(0x7f5c9006a570 msgr2=0x7f5c9006a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:44:05.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.158+0000 7f5c96afe640 1 -- 172.21.15.45:0/926924375 shutdown_connections 2023-11-28T18:44:05.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.158+0000 7f5c96afe640 1 -- 172.21.15.45:0/926924375 wait complete. 2023-11-28T18:44:05.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.158+0000 7f5c96afe640 1 Processor -- start 2023-11-28T18:44:05.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.158+0000 7f5c96afe640 1 -- start start 2023-11-28T18:44:05.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.158+0000 7f5c96afe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c9015a450 0x7f5c9013be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:05.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.158+0000 7f5c96afe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5c9015a830 0x7f5c9013eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:05.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.158+0000 7f5c96afe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5c9013f2e0 0x7f5c900ac880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:05.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.158+0000 7f5c96afe640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c9013cac0 con 0x7f5c9015a450 2023-11-28T18:44:05.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.158+0000 7f5c96afe640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c9013fd10 con 0x7f5c9013f2e0 2023-11-28T18:44:05.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.158+0000 7f5c96afe640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c9013d450 con 0x7f5c9015a830 2023-11-28T18:44:05.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.162+0000 7f5c9489a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c9015a450 0x7f5c9013be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:05.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.162+0000 7f5c9489a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c9015a450 0x7f5c9013be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56308/0 (socket says 172.21.15.45:56308) 2023-11-28T18:44:05.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.162+0000 7f5c9489a640 1 -- 172.21.15.45:0/2672067071 learned_addr learned my addr 172.21.15.45:0/2672067071 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:44:05.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.162+0000 7f5c9489a640 1 -- 172.21.15.45:0/2672067071 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5c9015a830 msgr2=0x7f5c9013eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:05.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.162+0000 7f5c9489a640 1 --2- 172.21.15.45:0/2672067071 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5c9015a830 0x7f5c9013eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:05.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.162+0000 7f5c9489a640 1 -- 172.21.15.45:0/2672067071 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5c9013f2e0 msgr2=0x7f5c900ac880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:05.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.162+0000 7f5c9489a640 1 --2- 172.21.15.45:0/2672067071 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5c9013f2e0 0x7f5c900ac880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:05.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.162+0000 7f5c9489a640 1 -- 172.21.15.45:0/2672067071 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c9013d730 con 0x7f5c9015a450 2023-11-28T18:44:05.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.162+0000 7f5c9489a640 1 --2- 172.21.15.45:0/2672067071 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c9015a450 0x7f5c9013be60 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f5c840124f0 tx=0x7f5c840129b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:44:05.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.162+0000 7f5c8d7fa640 1 -- 172.21.15.45:0/2672067071 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c84014750 con 0x7f5c9015a450 2023-11-28T18:44:05.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.162+0000 7f5c8d7fa640 1 -- 172.21.15.45:0/2672067071 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c840148d0 con 0x7f5c9015a450 2023-11-28T18:44:05.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.162+0000 7f5c96afe640 1 -- 172.21.15.45:0/2672067071 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c9013ff60 con 0x7f5c9015a450 2023-11-28T18:44:05.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.162+0000 7f5c8d7fa640 1 -- 172.21.15.45:0/2672067071 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c84014c80 con 0x7f5c9015a450 2023-11-28T18:44:05.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.162+0000 7f5c96afe640 1 -- 172.21.15.45:0/2672067071 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c9013f760 con 0x7f5c9015a450 2023-11-28T18:44:05.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.162+0000 7f5c8d7fa640 1 -- 172.21.15.45:0/2672067071 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f5c840153e0 con 0x7f5c9015a450 2023-11-28T18:44:05.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.162+0000 7f5c8d7fa640 1 --2- 172.21.15.45:0/2672067071 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f5c740668d0 0x7f5c74068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:05.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.162+0000 7f5c8d7fa640 1 -- 172.21.15.45:0/2672067071 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5c84087120 con 0x7f5c9015a450 2023-11-28T18:44:05.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.166+0000 7f5c99e5c000 1 Processor -- start 2023-11-28T18:44:05.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.166+0000 7f5c8ffff640 1 --2- 172.21.15.45:0/2672067071 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f5c740668d0 0x7f5c74068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:05.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.166+0000 7f5c99e5c000 1 -- start start 2023-11-28T18:44:05.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.166+0000 7f5c8ffff640 1 --2- 172.21.15.45:0/2672067071 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f5c740668d0 0x7f5c74068d90 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f5c9015af80 tx=0x7f5c7c0095f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:44:05.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.166+0000 7f5c99e5c000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eaca0f5d30 0x55eaca0f6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:05.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.166+0000 7f5c99e5c000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55eaca0f6650 0x55eaca0a8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:05.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.166+0000 7f5c99e5c000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55eaca0a9500 0x55eaca0a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:05.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.166+0000 7f5c99e5c000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eac9f72110 con 0x55eaca0a9500 2023-11-28T18:44:05.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.166+0000 7f5c99e5c000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eac9f029a0 con 0x55eaca0f5d30 2023-11-28T18:44:05.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.166+0000 7f5c99e5c000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x55eac9effed0 con 0x55eaca0f6650 2023-11-28T18:44:05.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.166+0000 7f5c9509b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55eaca0a9500 0x55eaca0a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:05.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.166+0000 7f5c9509b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55eaca0a9500 0x55eaca0a98e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56318/0 (socket says 172.21.15.45:56318) 2023-11-28T18:44:05.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.166+0000 7f5c9509b640 1 -- 172.21.15.45:0/888289550 learned_addr learned my addr 172.21.15.45:0/888289550 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:44:05.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.166+0000 7f5c9489a640 1 --2- 172.21.15.45:0/888289550 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eaca0f5d30 0x55eaca0f6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:05.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.166+0000 7f5c8ffff640 1 --2- 172.21.15.45:0/888289550 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55eaca0f6650 0x55eaca0a8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:05.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.166+0000 7f5c9509b640 1 -- 172.21.15.45:0/888289550 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55eaca0f6650 msgr2=0x55eaca0a8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:44:05.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.166+0000 7f5c9509b640 1 --2- 172.21.15.45:0/888289550 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55eaca0f6650 0x55eaca0a8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:05.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.166+0000 7f5c9509b640 1 -- 172.21.15.45:0/888289550 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eaca0f5d30 msgr2=0x55eaca0f6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:44:05.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.166+0000 7f5c9509b640 1 --2- 172.21.15.45:0/888289550 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eaca0f5d30 0x55eaca0f6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:05.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.166+0000 7f5c9509b640 1 -- 172.21.15.45:0/888289550 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eac9bf3890 con 0x55eaca0a9500 2023-11-28T18:44:05.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.166+0000 7f5c9509b640 1 --2- 172.21.15.45:0/888289550 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55eaca0a9500 0x55eaca0a98e0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f5c88005040 tx=0x7f5c8801b100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d912f31d71e9a6f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:44:05.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.166+0000 7f5c7a7fc640 1 -- 172.21.15.45:0/888289550 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c880b3070 con 0x55eaca0a9500 2023-11-28T18:44:05.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.166+0000 7f5c7a7fc640 1 -- 172.21.15.45:0/888289550 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c88003980 con 0x55eaca0a9500 2023-11-28T18:44:05.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.166+0000 7f5c7a7fc640 1 -- 172.21.15.45:0/888289550 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c88006b60 con 0x55eaca0a9500 2023-11-28T18:44:05.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.166+0000 7f5c99e5c000 1 -- 172.21.15.45:0/888289550 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55eaca0a9500 msgr2=0x55eaca0a98e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:05.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.166+0000 7f5c99e5c000 1 --2- 172.21.15.45:0/888289550 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55eaca0a9500 0x55eaca0a98e0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f5c88005040 tx=0x7f5c8801b100 comp rx=0 tx=0).stop 2023-11-28T18:44:05.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.166+0000 7f5c99e5c000 1 -- 172.21.15.45:0/888289550 shutdown_connections 2023-11-28T18:44:05.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.166+0000 7f5c99e5c000 1 --2- 172.21.15.45:0/888289550 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55eaca0a9500 0x55eaca0a98e0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:05.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.166+0000 7f5c99e5c000 1 --2- 172.21.15.45:0/888289550 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55eaca0f6650 0x55eaca0a8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:05.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.166+0000 7f5c99e5c000 1 --2- 172.21.15.45:0/888289550 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eaca0f5d30 0x55eaca0f6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:05.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.166+0000 7f5c99e5c000 1 -- 172.21.15.45:0/888289550 >> 172.21.15.45:0/888289550 conn(0x55eaca0d68c0 msgr2=0x55eaca0d8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:44:05.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.166+0000 7f5c99e5c000 1 -- 172.21.15.45:0/888289550 shutdown_connections 2023-11-28T18:44:05.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.166+0000 7f5c99e5c000 1 -- 172.21.15.45:0/888289550 wait complete. 2023-11-28T18:44:05.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.170+0000 7f5c99e5c000 1 -- start start 2023-11-28T18:44:05.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.170+0000 7f5c99e5c000 1 Processor -- start 2023-11-28T18:44:05.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.170+0000 7f5c99e5c000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55eaca0a9500 0x55eaca0af520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:05.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.170+0000 7f5c99e5c000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55eaca0f5d30 0x55eaca0afa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:05.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.170+0000 7f5c99e5c000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eaca0f6650 0x55eaca0affa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:05.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.170+0000 7f5c99e5c000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eac9efb7c0 con 0x55eaca0f5d30 2023-11-28T18:44:05.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.170+0000 7f5c99e5c000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eac9eb3bf0 con 0x55eaca0f6650 2023-11-28T18:44:05.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.170+0000 7f5c99e5c000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x55eac9eb9a90 con 0x55eaca0a9500 2023-11-28T18:44:05.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.170+0000 7f5c99e5c000 10 client.0 _ll_register_callbacks cb 0x55eaca096e20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T18:44:05.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.170+0000 7f5c8ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55eaca0f5d30 0x55eaca0afa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:05.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.170+0000 7f5c8ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55eaca0f5d30 0x55eaca0afa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56324/0 (socket says 172.21.15.45:56324) 2023-11-28T18:44:05.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.170+0000 7f5c8ffff640 1 -- 172.21.15.45:0/1676527236 learned_addr learned my addr 172.21.15.45:0/1676527236 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:44:05.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.170+0000 7f5c9489a640 1 --2- 172.21.15.45:0/1676527236 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55eaca0a9500 0x55eaca0af520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:05.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.170+0000 7f5c9509b640 1 --2- 172.21.15.45:0/1676527236 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eaca0f6650 0x55eaca0affa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:05.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.170+0000 7f5c8ffff640 1 -- 172.21.15.45:0/1676527236 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55eaca0a9500 msgr2=0x55eaca0af520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:44:05.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.170+0000 7f5c8ffff640 1 --2- 172.21.15.45:0/1676527236 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55eaca0a9500 0x55eaca0af520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:05.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.170+0000 7f5c8ffff640 1 -- 172.21.15.45:0/1676527236 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eaca0f6650 msgr2=0x55eaca0affa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:44:05.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.170+0000 7f5c8ffff640 1 --2- 172.21.15.45:0/1676527236 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eaca0f6650 0x55eaca0affa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:05.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.170+0000 7f5c8ffff640 1 -- 172.21.15.45:0/1676527236 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c80003530 con 0x55eaca0f5d30 2023-11-28T18:44:05.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.170+0000 7f5c8ffff640 1 --2- 172.21.15.45:0/1676527236 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55eaca0f5d30 0x55eaca0afa60 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c0149c0 tx=0x7f5c7c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=110049bc8fd11914 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:44:05.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.170+0000 7f5c6f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-11-28T18:44:05.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.170+0000 7f5c6f7fe640 1 -- 172.21.15.45:0/1676527236 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c7c022620 con 0x55eaca0f5d30 2023-11-28T18:44:05.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.170+0000 7f5c99e5c000 1 -- 172.21.15.45:0/1676527236 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55eac9ebd470 con 0x55eaca0f5d30 2023-11-28T18:44:05.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.170+0000 7f5c6f7fe640 1 -- 172.21.15.45:0/1676527236 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5c7c01c040 con 0x55eaca0f5d30 2023-11-28T18:44:05.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.170+0000 7f5c6f7fe640 1 -- 172.21.15.45:0/1676527236 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5c7c022780 con 0x55eaca0f5d30 2023-11-28T18:44:05.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.170+0000 7f5c99e5c000 10 client.6927 fetch_fsmap learned FSMap version 48 2023-11-28T18:44:05.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.170+0000 7f5c99e5c000 1 -- 172.21.15.45:0/1676527236 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=2+}) v3 -- 0x55eac9ebc190 con 0x55eaca0f5d30 2023-11-28T18:44:05.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.170+0000 7f5c6f7fe640 1 -- 172.21.15.45:0/1676527236 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55eac9ebd470 con 0x55eaca0f5d30 2023-11-28T18:44:05.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.170+0000 7f5c6f7fe640 1 -- 172.21.15.45:0/1676527236 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 48) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f5c7c004020 con 0x55eaca0f5d30 2023-11-28T18:44:05.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.170+0000 7f5c99e5c000 10 client.6927 fetch_fsmap finished waiting for FSMap version 48 2023-11-28T18:44:05.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.170+0000 7f5c99e5c000 10 client.6927 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-28T18:44:05.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.170+0000 7f5c99e5c000 20 client.6927 populate_metadata read hostname 'smithi045' 2023-11-28T18:44:05.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.170+0000 7f5c99e5c000 1 --2- 172.21.15.45:0/1676527236 >> [v2:172.21.15.45:6834/2107305848,v1:172.21.15.45:6835/2107305848] conn(0x55eaca0b09b0 0x55eaca107ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:05.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.170+0000 7f5c99e5c000 4 client.6927 mds_command: new command op to 6792 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-28T18:44:05.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.170+0000 7f5c99e5c000 1 -- 172.21.15.45:0/1676527236 --> [v2:172.21.15.45:6834/2107305848,v1:172.21.15.45:6835/2107305848] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55eac9ec0b50 con 0x55eaca0b09b0 2023-11-28T18:44:05.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.174+0000 7f5c9489a640 1 --2- 172.21.15.45:0/1676527236 >> [v2:172.21.15.45:6834/2107305848,v1:172.21.15.45:6835/2107305848] conn(0x55eaca0b09b0 0x55eaca107ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:05.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.174+0000 7f5c9489a640 1 --2- 172.21.15.45:0/1676527236 >> [v2:172.21.15.45:6834/2107305848,v1:172.21.15.45:6835/2107305848] conn(0x55eaca0b09b0 0x55eaca107ff0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65e41849ac5e5281 server_cookie=d481e89f679a4713 in_seq=0 out_seq=0 2023-11-28T18:44:05.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.174+0000 7f5c6f7fe640 10 client.6927 ms_handle_connect on v2:172.21.15.45:6834/2107305848 2023-11-28T18:44:05.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.174+0000 7f5c6f7fe640 1 -- 172.21.15.45:0/1676527236 <== mds.0 v2:172.21.15.45:6834/2107305848 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55eac9ec0b50 con 0x55eaca0b09b0 2023-11-28T18:44:05.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.174+0000 7f5c6f7fe640 10 client.6927 handle_command_reply: tid=0 2023-11-28T18:44:05.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.174+0000 7f5c99e5c000 1 client.6927 shutdown 2023-11-28T18:44:05.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.174+0000 7f5c99e5c000 1 -- 172.21.15.45:0/1676527236 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55eaca0f5d30 msgr2=0x55eaca0afa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:05.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.174+0000 7f5c99e5c000 1 --2- 172.21.15.45:0/1676527236 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55eaca0f5d30 0x55eaca0afa60 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c0149c0 tx=0x7f5c7c004740 comp rx=0 tx=0).stop 2023-11-28T18:44:05.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.174+0000 7f5c99e5c000 1 -- 172.21.15.45:0/1676527236 shutdown_connections 2023-11-28T18:44:05.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.174+0000 7f5c99e5c000 1 --2- 172.21.15.45:0/1676527236 >> [v2:172.21.15.45:6834/2107305848,v1:172.21.15.45:6835/2107305848] conn(0x55eaca0b09b0 0x55eaca107ff0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:05.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.174+0000 7f5c99e5c000 1 --2- 172.21.15.45:0/1676527236 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eaca0f6650 0x55eaca0affa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:05.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.174+0000 7f5c99e5c000 1 --2- 172.21.15.45:0/1676527236 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55eaca0f5d30 0x55eaca0afa60 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:05.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.174+0000 7f5c99e5c000 1 --2- 172.21.15.45:0/1676527236 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55eaca0a9500 0x55eaca0af520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:05.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.174+0000 7f5c6f7fe640 0 client.6927 ms_handle_reset on v2:172.21.15.45:6834/2107305848 2023-11-28T18:44:05.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.174+0000 7f5c99e5c000 1 -- 172.21.15.45:0/1676527236 >> 172.21.15.45:0/1676527236 conn(0x55eaca0d68c0 msgr2=0x55eaca0a86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:44:05.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.174+0000 7f5c99e5c000 1 -- 172.21.15.45:0/1676527236 shutdown_connections 2023-11-28T18:44:05.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.174+0000 7f5c99e5c000 1 -- 172.21.15.45:0/1676527236 wait complete. 2023-11-28T18:44:05.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.174+0000 7f5c99e5c000 20 client.6927 trim_cache size 0 max 16384 2023-11-28T18:44:05.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.190+0000 7f5c99e5c000 1 Processor -- start 2023-11-28T18:44:05.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.190+0000 7f5c99e5c000 1 -- start start 2023-11-28T18:44:05.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.190+0000 7f5c99e5c000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eaca0a9500 0x55eaca0d53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:05.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.190+0000 7f5c99e5c000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55eaca0f5d30 0x55eaca0d58e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:05.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.190+0000 7f5c99e5c000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55eaca0f6650 0x55eaca107ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:05.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.190+0000 7f5c99e5c000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eac9bb4940 con 0x55eaca0f5d30 2023-11-28T18:44:05.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.190+0000 7f5c99e5c000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eaca0ace10 con 0x55eaca0a9500 2023-11-28T18:44:05.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.190+0000 7f5c99e5c000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x55eac9efe320 con 0x55eaca0f6650 2023-11-28T18:44:05.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.190+0000 7f5c8ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55eaca0f5d30 0x55eaca0d58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:05.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.190+0000 7f5c8ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55eaca0f5d30 0x55eaca0d58e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56338/0 (socket says 172.21.15.45:56338) 2023-11-28T18:44:05.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.190+0000 7f5c8ffff640 1 -- 172.21.15.45:0/3245360051 learned_addr learned my addr 172.21.15.45:0/3245360051 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:44:05.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.190+0000 7f5c9489a640 1 --2- 172.21.15.45:0/3245360051 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eaca0a9500 0x55eaca0d53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:05.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.190+0000 7f5c9509b640 1 --2- 172.21.15.45:0/3245360051 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55eaca0f6650 0x55eaca107ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:05.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.190+0000 7f5c8ffff640 1 -- 172.21.15.45:0/3245360051 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55eaca0f6650 msgr2=0x55eaca107ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:44:05.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.190+0000 7f5c8ffff640 1 --2- 172.21.15.45:0/3245360051 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55eaca0f6650 0x55eaca107ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:05.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.190+0000 7f5c8ffff640 1 -- 172.21.15.45:0/3245360051 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eaca0a9500 msgr2=0x55eaca0d53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:44:05.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.190+0000 7f5c8ffff640 1 --2- 172.21.15.45:0/3245360051 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eaca0a9500 0x55eaca0d53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:05.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.190+0000 7f5c8ffff640 1 -- 172.21.15.45:0/3245360051 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eac9ea2490 con 0x55eaca0f5d30 2023-11-28T18:44:05.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.190+0000 7f5c9509b640 1 --2- 172.21.15.45:0/3245360051 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55eaca0f6650 0x55eaca107ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:44:05.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.190+0000 7f5c8ffff640 1 --2- 172.21.15.45:0/3245360051 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55eaca0f5d30 0x55eaca0d58e0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c011ef0 tx=0x7f5c7c01d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f12b86d47c978071 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:44:05.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.190+0000 7f5c7affd640 1 -- 172.21.15.45:0/3245360051 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c7c0044e0 con 0x55eaca0f5d30 2023-11-28T18:44:05.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.190+0000 7f5c7affd640 1 -- 172.21.15.45:0/3245360051 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c7c006d20 con 0x55eaca0f5d30 2023-11-28T18:44:05.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.190+0000 7f5c7affd640 1 -- 172.21.15.45:0/3245360051 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c7c022620 con 0x55eaca0f5d30 2023-11-28T18:44:05.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.194+0000 7f5c99e5c000 1 -- 172.21.15.45:0/3245360051 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55eaca0f5d30 msgr2=0x55eaca0d58e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:05.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.194+0000 7f5c99e5c000 1 --2- 172.21.15.45:0/3245360051 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55eaca0f5d30 0x55eaca0d58e0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c011ef0 tx=0x7f5c7c01d000 comp rx=0 tx=0).stop 2023-11-28T18:44:05.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.194+0000 7f5c99e5c000 1 -- 172.21.15.45:0/3245360051 shutdown_connections 2023-11-28T18:44:05.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.194+0000 7f5c99e5c000 1 --2- 172.21.15.45:0/3245360051 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55eaca0f6650 0x55eaca107ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:05.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.194+0000 7f5c99e5c000 1 --2- 172.21.15.45:0/3245360051 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55eaca0f5d30 0x55eaca0d58e0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:05.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.194+0000 7f5c99e5c000 1 --2- 172.21.15.45:0/3245360051 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eaca0a9500 0x55eaca0d53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:05.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.194+0000 7f5c99e5c000 1 -- 172.21.15.45:0/3245360051 >> 172.21.15.45:0/3245360051 conn(0x55eaca0d68c0 msgr2=0x55eaca0a7720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:44:05.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.194+0000 7f5c99e5c000 1 -- 172.21.15.45:0/3245360051 shutdown_connections 2023-11-28T18:44:05.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.194+0000 7f5c99e5c000 1 -- 172.21.15.45:0/3245360051 wait complete. 2023-11-28T18:44:05.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.194+0000 7f5c99e5c000 1 -- start start 2023-11-28T18:44:05.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.194+0000 7f5c99e5c000 1 Processor -- start 2023-11-28T18:44:05.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.194+0000 7f5c99e5c000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eaca0a9500 0x55eaca156810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:05.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.194+0000 7f5c99e5c000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55eaca0f5d30 0x55eaca156d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:05.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.194+0000 7f5c99e5c000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55eaca0f6650 0x55eaca111a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:05.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.194+0000 7f5c99e5c000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eac9ef8bc0 con 0x55eaca0f5d30 2023-11-28T18:44:05.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.194+0000 7f5c99e5c000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eac9ef85c0 con 0x55eaca0a9500 2023-11-28T18:44:05.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.194+0000 7f5c99e5c000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x55eac9efafd0 con 0x55eaca0f6650 2023-11-28T18:44:05.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.194+0000 7f5c99e5c000 10 client.0 _ll_register_callbacks cb 0x55eac9f72060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T18:44:05.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.194+0000 7f5c8ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55eaca0f5d30 0x55eaca156d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:05.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.194+0000 7f5c8ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55eaca0f5d30 0x55eaca156d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56354/0 (socket says 172.21.15.45:56354) 2023-11-28T18:44:05.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.194+0000 7f5c8ffff640 1 -- 172.21.15.45:0/1900650410 learned_addr learned my addr 172.21.15.45:0/1900650410 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:44:05.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.194+0000 7f5c9489a640 1 --2- 172.21.15.45:0/1900650410 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eaca0a9500 0x55eaca156810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:05.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.194+0000 7f5c9509b640 1 --2- 172.21.15.45:0/1900650410 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55eaca0f6650 0x55eaca111a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:05.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.194+0000 7f5c8ffff640 1 -- 172.21.15.45:0/1900650410 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55eaca0f6650 msgr2=0x55eaca111a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:44:05.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.194+0000 7f5c8ffff640 1 --2- 172.21.15.45:0/1900650410 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55eaca0f6650 0x55eaca111a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:05.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.194+0000 7f5c8ffff640 1 -- 172.21.15.45:0/1900650410 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eaca0a9500 msgr2=0x55eaca156810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:44:05.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.194+0000 7f5c8ffff640 1 --2- 172.21.15.45:0/1900650410 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eaca0a9500 0x55eaca156810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:05.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.194+0000 7f5c8ffff640 1 -- 172.21.15.45:0/1900650410 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55eac9ebc190 con 0x55eaca0f5d30 2023-11-28T18:44:05.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.194+0000 7f5c9509b640 1 --2- 172.21.15.45:0/1900650410 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55eaca0f6650 0x55eaca111a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:44:05.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.194+0000 7f5c8ffff640 1 --2- 172.21.15.45:0/1900650410 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55eaca0f5d30 0x55eaca156d50 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c00b010 tx=0x7f5c7c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70c16e0e133cb5f3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:44:05.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.194+0000 7f5c6f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-11-28T18:44:05.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.194+0000 7f5c6f7fe640 1 -- 172.21.15.45:0/1900650410 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c7c004500 con 0x55eaca0f5d30 2023-11-28T18:44:05.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.194+0000 7f5c6f7fe640 1 -- 172.21.15.45:0/1900650410 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5c7c022c60 con 0x55eaca0f5d30 2023-11-28T18:44:05.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.194+0000 7f5c99e5c000 1 -- 172.21.15.45:0/1900650410 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55eaca0a92f0 con 0x55eaca0f5d30 2023-11-28T18:44:05.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.194+0000 7f5c6f7fe640 1 -- 172.21.15.45:0/1900650410 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5c7c022e20 con 0x55eaca0f5d30 2023-11-28T18:44:05.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.194+0000 7f5c99e5c000 10 client.6933 fetch_fsmap learned FSMap version 48 2023-11-28T18:44:05.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.194+0000 7f5c99e5c000 1 -- 172.21.15.45:0/1900650410 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=2+}) v3 -- 0x55eac9bf3cc0 con 0x55eaca0f5d30 2023-11-28T18:44:05.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.198+0000 7f5c6f7fe640 1 -- 172.21.15.45:0/1900650410 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55eaca0a92f0 con 0x55eaca0f5d30 2023-11-28T18:44:05.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.198+0000 7f5c6f7fe640 1 -- 172.21.15.45:0/1900650410 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 48) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f5c7c03f070 con 0x55eaca0f5d30 2023-11-28T18:44:05.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.198+0000 7f5c99e5c000 10 client.6933 fetch_fsmap finished waiting for FSMap version 48 2023-11-28T18:44:05.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.198+0000 7f5c99e5c000 10 client.6933 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-28T18:44:05.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.198+0000 7f5c99e5c000 20 client.6933 populate_metadata read hostname 'smithi045' 2023-11-28T18:44:05.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.198+0000 7f5c99e5c000 1 --2- 172.21.15.45:0/1900650410 >> [v2:172.21.15.45:6834/2107305848,v1:172.21.15.45:6835/2107305848] conn(0x55eaca1123a0 0x55eaca112780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:05.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.198+0000 7f5c99e5c000 4 client.6933 mds_command: new command op to 6792 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-28T18:44:05.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.198+0000 7f5c99e5c000 1 -- 172.21.15.45:0/1900650410 --> [v2:172.21.15.45:6834/2107305848,v1:172.21.15.45:6835/2107305848] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55eac9efa110 con 0x55eaca1123a0 2023-11-28T18:44:05.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.198+0000 7f5c9489a640 1 --2- 172.21.15.45:0/1900650410 >> [v2:172.21.15.45:6834/2107305848,v1:172.21.15.45:6835/2107305848] conn(0x55eaca1123a0 0x55eaca112780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:05.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.198+0000 7f5c9489a640 1 --2- 172.21.15.45:0/1900650410 >> [v2:172.21.15.45:6834/2107305848,v1:172.21.15.45:6835/2107305848] conn(0x55eaca1123a0 0x55eaca112780 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2b99c2784920e06 server_cookie=8896989a0ba1422a in_seq=0 out_seq=0 2023-11-28T18:44:05.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.198+0000 7f5c6f7fe640 10 client.6933 ms_handle_connect on v2:172.21.15.45:6834/2107305848 2023-11-28T18:44:05.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.198+0000 7f5c6f7fe640 1 -- 172.21.15.45:0/1900650410 <== mds.0 v2:172.21.15.45:6834/2107305848 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55eac9efa110 con 0x55eaca1123a0 2023-11-28T18:44:05.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.198+0000 7f5c6f7fe640 10 client.6933 handle_command_reply: tid=0 2023-11-28T18:44:05.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.198+0000 7f5c99e5c000 1 client.6933 shutdown 2023-11-28T18:44:05.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.198+0000 7f5c99e5c000 1 -- 172.21.15.45:0/1900650410 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55eaca0f5d30 msgr2=0x55eaca156d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:05.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.198+0000 7f5c99e5c000 1 --2- 172.21.15.45:0/1900650410 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55eaca0f5d30 0x55eaca156d50 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c00b010 tx=0x7f5c7c019000 comp rx=0 tx=0).stop 2023-11-28T18:44:05.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.198+0000 7f5c99e5c000 1 -- 172.21.15.45:0/1900650410 shutdown_connections 2023-11-28T18:44:05.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.198+0000 7f5c99e5c000 1 --2- 172.21.15.45:0/1900650410 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55eaca0f6650 0x55eaca111a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:05.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.198+0000 7f5c99e5c000 1 --2- 172.21.15.45:0/1900650410 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55eaca0f5d30 0x55eaca156d50 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:05.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.198+0000 7f5c99e5c000 1 --2- 172.21.15.45:0/1900650410 >> [v2:172.21.15.45:6834/2107305848,v1:172.21.15.45:6835/2107305848] conn(0x55eaca1123a0 0x55eaca112780 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:05.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.198+0000 7f5c99e5c000 1 --2- 172.21.15.45:0/1900650410 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55eaca0a9500 0x55eaca156810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:05.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.198+0000 7f5c99e5c000 1 -- 172.21.15.45:0/1900650410 >> 172.21.15.45:0/1900650410 conn(0x55eaca0d68c0 msgr2=0x55eaca0a7fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:44:05.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.198+0000 7f5c6f7fe640 0 client.6933 ms_handle_reset on v2:172.21.15.45:6834/2107305848 2023-11-28T18:44:05.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.198+0000 7f5c99e5c000 1 -- 172.21.15.45:0/1900650410 shutdown_connections 2023-11-28T18:44:05.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.198+0000 7f5c99e5c000 1 -- 172.21.15.45:0/1900650410 wait complete. 2023-11-28T18:44:05.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.198+0000 7f5c99e5c000 20 client.6933 trim_cache size 0 max 16384 2023-11-28T18:44:05.204 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-11-28T18:44:05.204 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_fsid": "d10f5cd6-1d00-4019-99b6-6fa435498a15", 2023-11-28T18:44:05.204 INFO:teuthology.orchestra.run.smithi045.stdout: "whoami": 0, 2023-11-28T18:44:05.204 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 6792, 2023-11-28T18:44:05.204 INFO:teuthology.orchestra.run.smithi045.stdout: "want_state": "up:active", 2023-11-28T18:44:05.204 INFO:teuthology.orchestra.run.smithi045.stdout: "state": "up:active", 2023-11-28T18:44:05.204 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs", 2023-11-28T18:44:05.204 INFO:teuthology.orchestra.run.smithi045.stdout: "rank_uptime": 5.9423489500000004, 2023-11-28T18:44:05.204 INFO:teuthology.orchestra.run.smithi045.stdout: "mdsmap_epoch": 48, 2023-11-28T18:44:05.204 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch": 60, 2023-11-28T18:44:05.204 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch_barrier": 60, 2023-11-28T18:44:05.205 INFO:teuthology.orchestra.run.smithi045.stdout: "uptime": 10.733478577 2023-11-28T18:44:05.205 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-11-28T18:44:05.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.198+0000 7f5c96afe640 1 -- 172.21.15.45:0/2672067071 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f5c740668d0 msgr2=0x7f5c74068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:05.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.198+0000 7f5c96afe640 1 --2- 172.21.15.45:0/2672067071 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f5c740668d0 0x7f5c74068d90 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f5c9015af80 tx=0x7f5c7c0095f0 comp rx=0 tx=0).stop 2023-11-28T18:44:05.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.198+0000 7f5c96afe640 1 -- 172.21.15.45:0/2672067071 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c9015a450 msgr2=0x7f5c9013be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:05.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.198+0000 7f5c96afe640 1 --2- 172.21.15.45:0/2672067071 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c9015a450 0x7f5c9013be60 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f5c840124f0 tx=0x7f5c840129b0 comp rx=0 tx=0).stop 2023-11-28T18:44:05.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.198+0000 7f5c96afe640 1 -- 172.21.15.45:0/2672067071 shutdown_connections 2023-11-28T18:44:05.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.198+0000 7f5c96afe640 1 --2- 172.21.15.45:0/2672067071 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f5c740668d0 0x7f5c74068d90 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:05.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.198+0000 7f5c96afe640 1 --2- 172.21.15.45:0/2672067071 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5c9013f2e0 0x7f5c900ac880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:05.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.198+0000 7f5c96afe640 1 --2- 172.21.15.45:0/2672067071 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5c9015a830 0x7f5c9013eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:05.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.198+0000 7f5c96afe640 1 --2- 172.21.15.45:0/2672067071 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c9015a450 0x7f5c9013be60 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:05.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.198+0000 7f5c96afe640 1 -- 172.21.15.45:0/2672067071 >> 172.21.15.45:0/2672067071 conn(0x7f5c9006a570 msgr2=0x7f5c901437e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:44:05.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.198+0000 7f5c96afe640 1 -- 172.21.15.45:0/2672067071 shutdown_connections 2023-11-28T18:44:05.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.198+0000 7f5c96afe640 1 -- 172.21.15.45:0/2672067071 wait complete. 2023-11-28T18:44:05.218 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T18:44:05.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.366+0000 7ffb42a6b640 1 Processor -- start 2023-11-28T18:44:05.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.366+0000 7ffb42a6b640 1 -- start start 2023-11-28T18:44:05.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.366+0000 7ffb42a6b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffb3c06ca10 0x7ffb3c0704a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:05.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.366+0000 7ffb42a6b640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ffb3c0721c0 0x7ffb3c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:05.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.366+0000 7ffb42a6b640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb3c071120 con 0x7ffb3c144880 2023-11-28T18:44:05.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.366+0000 7ffb42a6b640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb3c15f050 con 0x7ffb3c0721c0 2023-11-28T18:44:05.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.366+0000 7ffb42a6b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb3c070f20 con 0x7ffb3c06ca10 2023-11-28T18:44:05.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.366+0000 7ffb40807640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ffb3c144880 0x7ffb3c06c300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47298/0 (socket says 172.21.15.45:47298) 2023-11-28T18:44:05.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.366+0000 7ffb40807640 1 -- 172.21.15.45:0/4005285253 learned_addr learned my addr 172.21.15.45:0/4005285253 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:44:05.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.366+0000 7ffb41008640 1 --2- 172.21.15.45:0/4005285253 >> v2:172.21.15.190:3300/0 conn(0x7ffb3c0721c0 0x7ffb3c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:05.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.366+0000 7ffb3bfff640 1 --2- 172.21.15.45:0/4005285253 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffb3c06ca10 0x7ffb3c0704a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:05.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.366+0000 7ffb3b7fe640 1 -- 172.21.15.45:0/4005285253 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2808298856 0 0) 0x7ffb3c071120 con 0x7ffb3c144880 2023-11-28T18:44:05.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.366+0000 7ffb3b7fe640 1 -- 172.21.15.45:0/4005285253 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb2c003530 con 0x7ffb3c144880 2023-11-28T18:44:05.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.366+0000 7ffb3b7fe640 1 -- 172.21.15.45:0/4005285253 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3167593383 0 0) 0x7ffb2c003530 con 0x7ffb3c144880 2023-11-28T18:44:05.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.366+0000 7ffb41008640 1 -- 172.21.15.45:0/4005285253 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffb3c06ca10 msgr2=0x7ffb3c0704a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:44:05.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.366+0000 7ffb41008640 1 --2- 172.21.15.45:0/4005285253 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffb3c06ca10 0x7ffb3c0704a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:05.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.366+0000 7ffb41008640 1 -- 172.21.15.45:0/4005285253 >> v1:172.21.15.45:6789/0 conn(0x7ffb3c144880 legacy=0x7ffb3c06c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:05.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.366+0000 7ffb41008640 1 -- 172.21.15.45:0/4005285253 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb3c071400 con 0x7ffb3c0721c0 2023-11-28T18:44:05.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.366+0000 7ffb3bfff640 1 --2- 172.21.15.45:0/4005285253 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffb3c06ca10 0x7ffb3c0704a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:44:05.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.370+0000 7ffb41008640 1 --2- 172.21.15.45:0/4005285253 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb3c0721c0 0x7ffb3c0709e0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ffb34009d90 tx=0x7ffb3401c840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36e0c23e605edd28 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:44:05.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.370+0000 7ffb3b7fe640 1 -- 172.21.15.45:0/4005285253 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb30001680 con 0x7ffb3c0721c0 2023-11-28T18:44:05.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.370+0000 7ffb3b7fe640 1 -- 172.21.15.45:0/4005285253 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb340a5640 con 0x7ffb3c0721c0 2023-11-28T18:44:05.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.370+0000 7ffb3b7fe640 1 -- 172.21.15.45:0/4005285253 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb340a59b0 con 0x7ffb3c0721c0 2023-11-28T18:44:05.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.370+0000 7ffb42a6b640 1 -- 172.21.15.45:0/4005285253 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb3c0721c0 msgr2=0x7ffb3c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:05.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.370+0000 7ffb42a6b640 1 --2- 172.21.15.45:0/4005285253 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb3c0721c0 0x7ffb3c0709e0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ffb34009d90 tx=0x7ffb3401c840 comp rx=0 tx=0).stop 2023-11-28T18:44:05.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.370+0000 7ffb42a6b640 1 -- 172.21.15.45:0/4005285253 shutdown_connections 2023-11-28T18:44:05.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.370+0000 7ffb42a6b640 1 --2- 172.21.15.45:0/4005285253 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb3c0721c0 0x7ffb3c0709e0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:05.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.370+0000 7ffb42a6b640 1 --2- 172.21.15.45:0/4005285253 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffb3c06ca10 0x7ffb3c0704a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:05.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.370+0000 7ffb42a6b640 1 -- 172.21.15.45:0/4005285253 >> 172.21.15.45:0/4005285253 conn(0x7ffb3c06a570 msgr2=0x7ffb3c06a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:44:05.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.370+0000 7ffb42a6b640 1 -- 172.21.15.45:0/4005285253 shutdown_connections 2023-11-28T18:44:05.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.370+0000 7ffb42a6b640 1 -- 172.21.15.45:0/4005285253 wait complete. 2023-11-28T18:44:05.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.374+0000 7ffb42a6b640 1 Processor -- start 2023-11-28T18:44:05.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.374+0000 7ffb42a6b640 1 -- start start 2023-11-28T18:44:05.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.374+0000 7ffb42a6b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb3c06ca10 0x7ffb3c0c4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:05.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.374+0000 7ffb42a6b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffb3c0721c0 0x7ffb3c0c50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:05.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.374+0000 7ffb42a6b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb3c144880 0x7ffb3c0c70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:05.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.374+0000 7ffb42a6b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb3c0c9150 con 0x7ffb3c144880 2023-11-28T18:44:05.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.374+0000 7ffb42a6b640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb3c0c4c80 con 0x7ffb3c06ca10 2023-11-28T18:44:05.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.374+0000 7ffb42a6b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb3c0c93f0 con 0x7ffb3c0721c0 2023-11-28T18:44:05.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.374+0000 7ffb41008640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb3c144880 0x7ffb3c0c70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:05.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.374+0000 7ffb41008640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb3c144880 0x7ffb3c0c70f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56358/0 (socket says 172.21.15.45:56358) 2023-11-28T18:44:05.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.374+0000 7ffb41008640 1 -- 172.21.15.45:0/2118267180 learned_addr learned my addr 172.21.15.45:0/2118267180 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:44:05.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.374+0000 7ffb40807640 1 --2- 172.21.15.45:0/2118267180 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb3c06ca10 0x7ffb3c0c4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:05.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.374+0000 7ffb3bfff640 1 --2- 172.21.15.45:0/2118267180 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffb3c0721c0 0x7ffb3c0c50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:05.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.374+0000 7ffb41008640 1 -- 172.21.15.45:0/2118267180 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffb3c0721c0 msgr2=0x7ffb3c0c50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:05.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.374+0000 7ffb41008640 1 --2- 172.21.15.45:0/2118267180 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffb3c0721c0 0x7ffb3c0c50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:05.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.374+0000 7ffb41008640 1 -- 172.21.15.45:0/2118267180 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb3c06ca10 msgr2=0x7ffb3c0c4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:05.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.374+0000 7ffb41008640 1 --2- 172.21.15.45:0/2118267180 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb3c06ca10 0x7ffb3c0c4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:05.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.374+0000 7ffb41008640 1 -- 172.21.15.45:0/2118267180 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb28009420 con 0x7ffb3c144880 2023-11-28T18:44:05.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.374+0000 7ffb3bfff640 1 --2- 172.21.15.45:0/2118267180 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffb3c0721c0 0x7ffb3c0c50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:44:05.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.374+0000 7ffb40807640 1 --2- 172.21.15.45:0/2118267180 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb3c06ca10 0x7ffb3c0c4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:44:05.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.374+0000 7ffb41008640 1 --2- 172.21.15.45:0/2118267180 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb3c144880 0x7ffb3c0c70f0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7ffb34009d90 tx=0x7ffb340195e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:44:05.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.374+0000 7ffb397fa640 1 -- 172.21.15.45:0/2118267180 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb340ad850 con 0x7ffb3c144880 2023-11-28T18:44:05.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.374+0000 7ffb397fa640 1 -- 172.21.15.45:0/2118267180 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb340ad9b0 con 0x7ffb3c144880 2023-11-28T18:44:05.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.374+0000 7ffb397fa640 1 -- 172.21.15.45:0/2118267180 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb340add40 con 0x7ffb3c144880 2023-11-28T18:44:05.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.374+0000 7ffb42a6b640 1 -- 172.21.15.45:0/2118267180 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb34009a70 con 0x7ffb3c144880 2023-11-28T18:44:05.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.374+0000 7ffb42a6b640 1 -- 172.21.15.45:0/2118267180 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb3c0c99b0 con 0x7ffb3c144880 2023-11-28T18:44:05.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.378+0000 7ffb42a6b640 1 -- 172.21.15.45:0/2118267180 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb3c069480 con 0x7ffb3c144880 2023-11-28T18:44:05.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.378+0000 7ffb397fa640 1 -- 172.21.15.45:0/2118267180 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ffb340b4070 con 0x7ffb3c144880 2023-11-28T18:44:05.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.378+0000 7ffb397fa640 1 --2- 172.21.15.45:0/2118267180 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ffb200668d0 0x7ffb20068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:05.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.378+0000 7ffb397fa640 1 -- 172.21.15.45:0/2118267180 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffb3411f090 con 0x7ffb3c144880 2023-11-28T18:44:05.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.378+0000 7ffb40807640 1 --2- 172.21.15.45:0/2118267180 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ffb200668d0 0x7ffb20068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:05.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.378+0000 7ffb40807640 1 --2- 172.21.15.45:0/2118267180 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ffb200668d0 0x7ffb20068d90 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7ffb30007a10 tx=0x7ffb30009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:44:05.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.382+0000 7ffb397fa640 1 -- 172.21.15.45:0/2118267180 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ffb340ec230 con 0x7ffb3c144880 2023-11-28T18:44:05.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.574+0000 7ffb42a6b640 1 -- 172.21.15.45:0/2118267180 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ffb3c06d1b0 con 0x7ffb3c144880 2023-11-28T18:44:05.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.574+0000 7ffb397fa640 1 -- 172.21.15.45:0/2118267180 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v48) v1 ==== 53+0+73 (secure 0 0 0) 0x7ffb340b2060 con 0x7ffb3c144880 2023-11-28T18:44:05.574 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T18:44:05.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.574+0000 7ffb42a6b640 1 -- 172.21.15.45:0/2118267180 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ffb200668d0 msgr2=0x7ffb20068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:05.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.574+0000 7ffb42a6b640 1 --2- 172.21.15.45:0/2118267180 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ffb200668d0 0x7ffb20068d90 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7ffb30007a10 tx=0x7ffb30009040 comp rx=0 tx=0).stop 2023-11-28T18:44:05.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.574+0000 7ffb42a6b640 1 -- 172.21.15.45:0/2118267180 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb3c144880 msgr2=0x7ffb3c0c70f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:05.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.574+0000 7ffb42a6b640 1 --2- 172.21.15.45:0/2118267180 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb3c144880 0x7ffb3c0c70f0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7ffb34009d90 tx=0x7ffb340195e0 comp rx=0 tx=0).stop 2023-11-28T18:44:05.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.574+0000 7ffb42a6b640 1 -- 172.21.15.45:0/2118267180 shutdown_connections 2023-11-28T18:44:05.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.574+0000 7ffb42a6b640 1 --2- 172.21.15.45:0/2118267180 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7ffb200668d0 0x7ffb20068d90 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:05.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.574+0000 7ffb42a6b640 1 --2- 172.21.15.45:0/2118267180 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb3c144880 0x7ffb3c0c70f0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:05.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.574+0000 7ffb42a6b640 1 --2- 172.21.15.45:0/2118267180 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffb3c0721c0 0x7ffb3c0c50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:05.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.574+0000 7ffb42a6b640 1 --2- 172.21.15.45:0/2118267180 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb3c06ca10 0x7ffb3c0c4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:05.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.574+0000 7ffb42a6b640 1 -- 172.21.15.45:0/2118267180 >> 172.21.15.45:0/2118267180 conn(0x7ffb3c06a570 msgr2=0x7ffb3c15f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:44:05.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.574+0000 7ffb42a6b640 1 -- 172.21.15.45:0/2118267180 shutdown_connections 2023-11-28T18:44:05.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:05.574+0000 7ffb42a6b640 1 -- 172.21.15.45:0/2118267180 wait complete. 2023-11-28T18:44:05.596 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-28T18:44:05.596 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T18:44:05.596 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi045.front.sepia.ceph.com 2023-11-28T18:44:05.596 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-28T18:44:05.596 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-28T18:44:05.596 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-28T18:44:05.596 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-28T18:44:05.596 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T18:44:05.596 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T18:44:05.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:44:05.597 DEBUG:teuthology.orchestra.run.smithi045:> ip addr 2023-11-28T18:44:05.607 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T18:44:05.607 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T18:44:05.608 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T18:44:05.608 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:44:05.608 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2023-11-28T18:44:05.608 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:44:05.608 INFO:teuthology.orchestra.run.smithi045.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T18:44:05.608 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a6 brd ff:ff:ff:ff:ff:ff 2023-11-28T18:44:05.608 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f0 2023-11-28T18:44:05.608 INFO:teuthology.orchestra.run.smithi045.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T18:44:05.608 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a7 brd ff:ff:ff:ff:ff:ff 2023-11-28T18:44:05.608 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f1 2023-11-28T18:44:05.608 INFO:teuthology.orchestra.run.smithi045.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T18:44:05.609 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:be brd ff:ff:ff:ff:ff:ff 2023-11-28T18:44:05.609 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f0 2023-11-28T18:44:05.609 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.21.15.45/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-11-28T18:44:05.609 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft 42012sec preferred_lft 42012sec 2023-11-28T18:44:05.609 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec4:7aff:febd:12be/64 scope link 2023-11-28T18:44:05.609 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:44:05.609 INFO:teuthology.orchestra.run.smithi045.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T18:44:05.609 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:bf brd ff:ff:ff:ff:ff:ff 2023-11-28T18:44:05.609 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f1 2023-11-28T18:44:05.609 INFO:teuthology.orchestra.run.smithi045.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T18:44:05.609 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 02:42:ab:69:35:3d brd ff:ff:ff:ff:ff:ff 2023-11-28T18:44:05.609 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T18:44:05.610 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:44:05.610 INFO:teuthology.orchestra.run.smithi045.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T18:44:05.610 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-28T18:44:05.610 INFO:teuthology.orchestra.run.smithi045.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-28T18:44:05.610 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:44:05.610 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-28T18:44:05.610 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:44:05.610 INFO:teuthology.orchestra.run.smithi045.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T18:44:05.610 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T18:44:05.610 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-28T18:44:05.610 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:44:05.611 INFO:teuthology.orchestra.run.smithi045.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T18:44:05.611 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T18:44:05.611 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-11-28T18:44:05.611 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T18:44:05.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:44:05.611 DEBUG:teuthology.orchestra.run.smithi045:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T18:44:05.667 INFO:teuthology.orchestra.run.smithi045.stdout:1 2023-11-28T18:44:05.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:44:05.670 DEBUG:teuthology.orchestra.run.smithi045:> route 2023-11-28T18:44:05.723 INFO:teuthology.orchestra.run.smithi045.stdout:Kernel IP routing table 2023-11-28T18:44:05.723 INFO:teuthology.orchestra.run.smithi045.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T18:44:05.723 INFO:teuthology.orchestra.run.smithi045.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-11-28T18:44:05.724 INFO:teuthology.orchestra.run.smithi045.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T18:44:05.724 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-11-28T18:44:05.724 INFO:teuthology.orchestra.run.smithi045.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T18:44:05.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:44:05.724 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-11-28T18:44:05.725 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-11-28T18:44:05.725 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-28T18:44:05.725 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-28T18:44:05.725 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-28T18:44:05.725 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-11-28T18:44:05.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:44:05.817 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-11-28T18:44:05.827 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-28T18:44:05.827 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-28T18:44:05.828 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T18:44:05.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:44:05.828 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set brx.0 up 2023-11-28T18:44:05.890 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-28T18:44:05.890 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T18:44:05.890 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-28T18:44:05.941 INFO:teuthology.orchestra.run.smithi045.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-28T18:44:05.941 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T18:44:05.941 DEBUG:teuthology.orchestra.run.smithi045:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-28T18:44:05.992 DEBUG:teuthology.orchestra.run.smithi045:> sudo modprobe fuse 2023-11-28T18:44:06.058 DEBUG:teuthology.orchestra.run.smithi045:> cat /proc/self/mounts | awk '{print $2}' 2023-11-28T18:44:06.110 INFO:teuthology.orchestra.run.smithi045.stdout:/sys 2023-11-28T18:44:06.110 INFO:teuthology.orchestra.run.smithi045.stdout:/proc 2023-11-28T18:44:06.111 INFO:teuthology.orchestra.run.smithi045.stdout:/dev 2023-11-28T18:44:06.111 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/pts 2023-11-28T18:44:06.111 INFO:teuthology.orchestra.run.smithi045.stdout:/run 2023-11-28T18:44:06.111 INFO:teuthology.orchestra.run.smithi045.stdout:/ 2023-11-28T18:44:06.111 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/security 2023-11-28T18:44:06.111 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/shm 2023-11-28T18:44:06.111 INFO:teuthology.orchestra.run.smithi045.stdout:/run/lock 2023-11-28T18:44:06.111 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/cgroup 2023-11-28T18:44:06.111 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/pstore 2023-11-28T18:44:06.111 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/bpf 2023-11-28T18:44:06.111 INFO:teuthology.orchestra.run.smithi045.stdout:/proc/sys/fs/binfmt_misc 2023-11-28T18:44:06.112 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/hugepages 2023-11-28T18:44:06.112 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/mqueue 2023-11-28T18:44:06.112 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/debug 2023-11-28T18:44:06.112 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/tracing 2023-11-28T18:44:06.112 INFO:teuthology.orchestra.run.smithi045.stdout:/proc/fs/nfsd 2023-11-28T18:44:06.112 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/fuse/connections 2023-11-28T18:44:06.112 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/config 2023-11-28T18:44:06.112 INFO:teuthology.orchestra.run.smithi045.stdout:/run/credentials/systemd-sysusers.service 2023-11-28T18:44:06.112 INFO:teuthology.orchestra.run.smithi045.stdout:/run/rpc_pipefs 2023-11-28T18:44:06.112 INFO:teuthology.orchestra.run.smithi045.stdout:/run/user/1000 2023-11-28T18:44:06.112 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph 2023-11-28T18:44:06.113 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-0 2023-11-28T18:44:06.113 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-1 2023-11-28T18:44:06.113 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-2 2023-11-28T18:44:06.113 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-3 2023-11-28T18:44:06.113 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns 2023-11-28T18:44:06.113 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T18:44:06.113 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T18:44:06.113 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T18:44:06.113 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T18:44:06.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:44:06.115 DEBUG:teuthology.orchestra.run.smithi045:> ls /sys/fs/fuse/connections 2023-11-28T18:44:06.169 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-28T18:44:06.169 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-28T18:44:06.219 DEBUG:teuthology.orchestra.run.smithi045:> sudo modprobe fuse 2023-11-28T18:44:06.241 DEBUG:teuthology.orchestra.run.smithi045:> cat /proc/self/mounts | awk '{print $2}' 2023-11-28T18:44:06.294 INFO:teuthology.orchestra.run.smithi045.stdout:/sys 2023-11-28T18:44:06.295 INFO:teuthology.orchestra.run.smithi045.stdout:/proc 2023-11-28T18:44:06.295 INFO:teuthology.orchestra.run.smithi045.stdout:/dev 2023-11-28T18:44:06.295 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/pts 2023-11-28T18:44:06.295 INFO:teuthology.orchestra.run.smithi045.stdout:/run 2023-11-28T18:44:06.295 INFO:teuthology.orchestra.run.smithi045.stdout:/ 2023-11-28T18:44:06.295 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/security 2023-11-28T18:44:06.295 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/shm 2023-11-28T18:44:06.295 INFO:teuthology.orchestra.run.smithi045.stdout:/run/lock 2023-11-28T18:44:06.296 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/cgroup 2023-11-28T18:44:06.296 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/pstore 2023-11-28T18:44:06.296 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/bpf 2023-11-28T18:44:06.296 INFO:teuthology.orchestra.run.smithi045.stdout:/proc/sys/fs/binfmt_misc 2023-11-28T18:44:06.296 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/hugepages 2023-11-28T18:44:06.296 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/mqueue 2023-11-28T18:44:06.296 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/debug 2023-11-28T18:44:06.296 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/tracing 2023-11-28T18:44:06.296 INFO:teuthology.orchestra.run.smithi045.stdout:/proc/fs/nfsd 2023-11-28T18:44:06.296 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/fuse/connections 2023-11-28T18:44:06.296 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/config 2023-11-28T18:44:06.296 INFO:teuthology.orchestra.run.smithi045.stdout:/run/credentials/systemd-sysusers.service 2023-11-28T18:44:06.297 INFO:teuthology.orchestra.run.smithi045.stdout:/run/rpc_pipefs 2023-11-28T18:44:06.297 INFO:teuthology.orchestra.run.smithi045.stdout:/run/user/1000 2023-11-28T18:44:06.297 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph 2023-11-28T18:44:06.297 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-0 2023-11-28T18:44:06.297 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-1 2023-11-28T18:44:06.297 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-2 2023-11-28T18:44:06.297 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph/osd/ceph-3 2023-11-28T18:44:06.297 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns 2023-11-28T18:44:06.297 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T18:44:06.297 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T18:44:06.297 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T18:44:06.298 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T18:44:06.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:44:06.299 DEBUG:teuthology.orchestra.run.smithi045:> ls /sys/fs/fuse/connections 2023-11-28T18:44:06.322 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:2023-11-28T18:44:06.322+0000 7f91c3847580 -1 init, newargv = 0x55e5672f82d0 newargc=15 2023-11-28T18:44:06.322 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:ceph-fuse[53168]: starting ceph client 2023-11-28T18:44:06.330 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:ceph-fuse[53168]: starting fuse 2023-11-28T18:44:06.332 INFO:teuthology.orchestra.run.smithi045.stdout:43 2023-11-28T18:44:06.332 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-11-28T18:44:06.333 DEBUG:teuthology.orchestra.run.smithi045:> sudo stdin-killer -- python3 -c ' 2023-11-28T18:44:06.333 DEBUG:teuthology.orchestra.run.smithi045:> import glob 2023-11-28T18:44:06.333 DEBUG:teuthology.orchestra.run.smithi045:> import re 2023-11-28T18:44:06.333 DEBUG:teuthology.orchestra.run.smithi045:> import os 2023-11-28T18:44:06.333 DEBUG:teuthology.orchestra.run.smithi045:> import subprocess 2023-11-28T18:44:06.333 DEBUG:teuthology.orchestra.run.smithi045:> 2023-11-28T18:44:06.333 DEBUG:teuthology.orchestra.run.smithi045:> def _find_admin_socket(client_name): 2023-11-28T18:44:06.333 DEBUG:teuthology.orchestra.run.smithi045:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-28T18:44:06.333 DEBUG:teuthology.orchestra.run.smithi045:> files = glob.glob(asok_path) 2023-11-28T18:44:06.333 DEBUG:teuthology.orchestra.run.smithi045:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-28T18:44:06.333 DEBUG:teuthology.orchestra.run.smithi045:> 2023-11-28T18:44:06.333 DEBUG:teuthology.orchestra.run.smithi045:> # Given a non-glob path, it better be there 2023-11-28T18:44:06.334 DEBUG:teuthology.orchestra.run.smithi045:> if "*" not in asok_path: 2023-11-28T18:44:06.334 DEBUG:teuthology.orchestra.run.smithi045:> assert(len(files) == 1) 2023-11-28T18:44:06.334 DEBUG:teuthology.orchestra.run.smithi045:> return files[0] 2023-11-28T18:44:06.334 DEBUG:teuthology.orchestra.run.smithi045:> 2023-11-28T18:44:06.334 DEBUG:teuthology.orchestra.run.smithi045:> for f in files: 2023-11-28T18:44:06.334 DEBUG:teuthology.orchestra.run.smithi045:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-28T18:44:06.334 DEBUG:teuthology.orchestra.run.smithi045:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-28T18:44:06.334 DEBUG:teuthology.orchestra.run.smithi045:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-28T18:44:06.334 DEBUG:teuthology.orchestra.run.smithi045:> contents = proc_f.read() 2023-11-28T18:44:06.335 DEBUG:teuthology.orchestra.run.smithi045:> if mountpoint in contents: 2023-11-28T18:44:06.335 DEBUG:teuthology.orchestra.run.smithi045:> return f 2023-11-28T18:44:06.335 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-28T18:44:06.335 DEBUG:teuthology.orchestra.run.smithi045:> 2023-11-28T18:44:06.335 DEBUG:teuthology.orchestra.run.smithi045:> print(_find_admin_socket("client.0")) 2023-11-28T18:44:06.335 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-11-28T18:44:06.460 INFO:teuthology.orchestra.run.smithi045.stdout:/var/run/ceph/ceph-client.0.53168.asok 2023-11-28T18:44:06.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-28T18:44:06.471 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.53168.asok 2023-11-28T18:44:06.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:44:06.472 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.53168.asok status 2023-11-28T18:44:06.650 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-11-28T18:44:06.650 INFO:teuthology.orchestra.run.smithi045.stdout: "metadata": { 2023-11-28T18:44:06.650 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_sha1": "47c1c547372ed5bff7984647dc200bac0e019caf", 2023-11-28T18:44:06.650 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_version": "ceph version 18.0.0-7531-g47c1c547 (47c1c547372ed5bff7984647dc200bac0e019caf) reef (dev)", 2023-11-28T18:44:06.650 INFO:teuthology.orchestra.run.smithi045.stdout: "entity_id": "0", 2023-11-28T18:44:06.650 INFO:teuthology.orchestra.run.smithi045.stdout: "hostname": "smithi045", 2023-11-28T18:44:06.650 INFO:teuthology.orchestra.run.smithi045.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-28T18:44:06.651 INFO:teuthology.orchestra.run.smithi045.stdout: "pid": "53168", 2023-11-28T18:44:06.651 INFO:teuthology.orchestra.run.smithi045.stdout: "root": "/" 2023-11-28T18:44:06.651 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:44:06.651 INFO:teuthology.orchestra.run.smithi045.stdout: "dentry_count": 0, 2023-11-28T18:44:06.651 INFO:teuthology.orchestra.run.smithi045.stdout: "dentry_pinned_count": 0, 2023-11-28T18:44:06.652 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 6945, 2023-11-28T18:44:06.652 INFO:teuthology.orchestra.run.smithi045.stdout: "inst": { 2023-11-28T18:44:06.652 INFO:teuthology.orchestra.run.smithi045.stdout: "name": { 2023-11-28T18:44:06.652 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "client", 2023-11-28T18:44:06.652 INFO:teuthology.orchestra.run.smithi045.stdout: "num": 6945 2023-11-28T18:44:06.653 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:44:06.653 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": { 2023-11-28T18:44:06.653 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-11-28T18:44:06.653 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "192.168.0.1:0", 2023-11-28T18:44:06.653 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 632468228 2023-11-28T18:44:06.654 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T18:44:06.654 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:44:06.654 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": { 2023-11-28T18:44:06.654 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-11-28T18:44:06.654 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "192.168.0.1:0", 2023-11-28T18:44:06.654 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 632468228 2023-11-28T18:44:06.655 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T18:44:06.655 INFO:teuthology.orchestra.run.smithi045.stdout: "inst_str": "client.6945 192.168.0.1:0/632468228", 2023-11-28T18:44:06.655 INFO:teuthology.orchestra.run.smithi045.stdout: "addr_str": "192.168.0.1:0/632468228", 2023-11-28T18:44:06.655 INFO:teuthology.orchestra.run.smithi045.stdout: "inode_count": 1, 2023-11-28T18:44:06.655 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_epoch": 48, 2023-11-28T18:44:06.656 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_epoch": 60, 2023-11-28T18:44:06.656 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_epoch_barrier": 0, 2023-11-28T18:44:06.656 INFO:teuthology.orchestra.run.smithi045.stdout: "blocklisted": false, 2023-11-28T18:44:06.656 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs" 2023-11-28T18:44:06.656 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-11-28T18:44:06.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:44:06.666 DEBUG:teuthology.orchestra.run.smithi045:> stat --file-system '--printf=%T 2023-11-28T18:44:06.666 DEBUG:teuthology.orchestra.run.smithi045:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-28T18:44:06.676 INFO:teuthology.orchestra.run.smithi045.stdout:fuseblk 2023-11-28T18:44:06.676 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-28T18:44:06.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:44:06.677 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-28T18:44:06.741 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 2 2023-11-28T18:44:06.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:06.930+0000 7f44828fe640 1 Processor -- start 2023-11-28T18:44:06.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:06.930+0000 7f44828fe640 1 -- start start 2023-11-28T18:44:06.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:06.930+0000 7f44828fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f447c0ce9a0 0x7f447c0ae0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:06.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:06.930+0000 7f44828fe640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f447c06bc90 0x7f447c0b2d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:06.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:06.930+0000 7f44828fe640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f447c0af1c0 con 0x7f447c0ced80 2023-11-28T18:44:06.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:06.930+0000 7f44828fe640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f447c0ae920 con 0x7f447c0ce9a0 2023-11-28T18:44:06.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:06.930+0000 7f44828fe640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f447c0aec00 con 0x7f447c06bc90 2023-11-28T18:44:06.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:06.930+0000 7f447bfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f447c0ce9a0 0x7f447c0ae0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:06.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:06.930+0000 7f447bfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f447c0ce9a0 0x7f447c0ae0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56362/0 (socket says 172.21.15.45:56362) 2023-11-28T18:44:06.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:06.930+0000 7f447bfff640 1 -- 172.21.15.45:0/2023897676 learned_addr learned my addr 172.21.15.45:0/2023897676 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:44:06.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:06.930+0000 7f4480e9b640 1 --2- 172.21.15.45:0/2023897676 >> v2:172.21.15.190:3300/0 conn(0x7f447c06bc90 0x7f447c0b2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:06.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:06.930+0000 7f447bfff640 1 -- 172.21.15.45:0/2023897676 >> v2:172.21.15.190:3300/0 conn(0x7f447c06bc90 msgr2=0x7f447c0b2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:44:06.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:06.930+0000 7f447bfff640 1 --2- 172.21.15.45:0/2023897676 >> v2:172.21.15.190:3300/0 conn(0x7f447c06bc90 0x7f447c0b2d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:06.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:06.930+0000 7f447bfff640 1 -- 172.21.15.45:0/2023897676 >> v1:172.21.15.190:6789/0 conn(0x7f447c0ced80 legacy=0x7f447c06b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:44:06.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:06.930+0000 7f447bfff640 1 -- 172.21.15.45:0/2023897676 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f447c0aeee0 con 0x7f447c0ce9a0 2023-11-28T18:44:06.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:06.930+0000 7f4480e9b640 1 --2- 172.21.15.45:0/2023897676 >> v2:172.21.15.190:3300/0 conn(0x7f447c06bc90 0x7f447c0b2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:44:06.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:06.934+0000 7f447bfff640 1 --2- 172.21.15.45:0/2023897676 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f447c0ce9a0 0x7f447c0ae0a0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f447c1548c0 tx=0x7f446c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adddab4030b80008 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:44:06.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:06.934+0000 7f447affd640 1 -- 172.21.15.45:0/2023897676 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f446c0ab600 con 0x7f447c0ce9a0 2023-11-28T18:44:06.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:06.934+0000 7f447affd640 1 -- 172.21.15.45:0/2023897676 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f446c0a7050 con 0x7f447c0ce9a0 2023-11-28T18:44:06.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:06.934+0000 7f447affd640 1 -- 172.21.15.45:0/2023897676 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f446c0ab980 con 0x7f447c0ce9a0 2023-11-28T18:44:06.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:06.934+0000 7f44828fe640 1 -- 172.21.15.45:0/2023897676 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f447c0ce9a0 msgr2=0x7f447c0ae0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:06.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:06.934+0000 7f44828fe640 1 --2- 172.21.15.45:0/2023897676 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f447c0ce9a0 0x7f447c0ae0a0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f447c1548c0 tx=0x7f446c01c370 comp rx=0 tx=0).stop 2023-11-28T18:44:06.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:06.934+0000 7f44828fe640 1 -- 172.21.15.45:0/2023897676 shutdown_connections 2023-11-28T18:44:06.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:06.934+0000 7f44828fe640 1 --2- 172.21.15.45:0/2023897676 >> v2:172.21.15.190:3300/0 conn(0x7f447c06bc90 0x7f447c0b2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:06.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:06.934+0000 7f44828fe640 1 --2- 172.21.15.45:0/2023897676 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f447c0ce9a0 0x7f447c0ae0a0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:06.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:06.934+0000 7f44828fe640 1 -- 172.21.15.45:0/2023897676 >> 172.21.15.45:0/2023897676 conn(0x7f447c0b1b70 msgr2=0x7f447c070cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:44:06.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:06.934+0000 7f44828fe640 1 -- 172.21.15.45:0/2023897676 shutdown_connections 2023-11-28T18:44:06.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:06.934+0000 7f44828fe640 1 -- 172.21.15.45:0/2023897676 wait complete. 2023-11-28T18:44:06.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:06.938+0000 7f44828fe640 1 Processor -- start 2023-11-28T18:44:06.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:06.938+0000 7f44828fe640 1 -- start start 2023-11-28T18:44:06.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:06.938+0000 7f44828fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f447c06bc90 0x7f447c14e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:06.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:06.938+0000 7f44828fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f447c0ce9a0 0x7f447c138a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:06.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:06.938+0000 7f44828fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f447c0ced80 0x7f447c138fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:06.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:06.938+0000 7f44828fe640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f447c152a50 con 0x7f447c0ce9a0 2023-11-28T18:44:06.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:06.938+0000 7f44828fe640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f447c1394e0 con 0x7f447c06bc90 2023-11-28T18:44:06.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:06.938+0000 7f44828fe640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f447c1520f0 con 0x7f447c0ced80 2023-11-28T18:44:06.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:06.938+0000 7f447b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f447c0ce9a0 0x7f447c138a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:06.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:06.938+0000 7f447bfff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f447c06bc90 0x7f447c14e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:06.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:06.938+0000 7f447b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f447c0ce9a0 0x7f447c138a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56378/0 (socket says 172.21.15.45:56378) 2023-11-28T18:44:06.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:06.938+0000 7f447b7fe640 1 -- 172.21.15.45:0/64697318 learned_addr learned my addr 172.21.15.45:0/64697318 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:44:06.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:06.938+0000 7f4480e9b640 1 --2- 172.21.15.45:0/64697318 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f447c0ced80 0x7f447c138fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:06.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:06.938+0000 7f447b7fe640 1 -- 172.21.15.45:0/64697318 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f447c0ced80 msgr2=0x7f447c138fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:06.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:06.938+0000 7f447b7fe640 1 --2- 172.21.15.45:0/64697318 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f447c0ced80 0x7f447c138fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:06.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:06.938+0000 7f447b7fe640 1 -- 172.21.15.45:0/64697318 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f447c06bc90 msgr2=0x7f447c14e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:06.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:06.938+0000 7f447b7fe640 1 --2- 172.21.15.45:0/64697318 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f447c06bc90 0x7f447c14e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:06.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:06.938+0000 7f447b7fe640 1 -- 172.21.15.45:0/64697318 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f446c0094d0 con 0x7f447c0ce9a0 2023-11-28T18:44:06.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:06.938+0000 7f447b7fe640 1 --2- 172.21.15.45:0/64697318 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f447c0ce9a0 0x7f447c138a60 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f447000b410 tx=0x7f447000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:44:06.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:06.938+0000 7f4478ff9640 1 -- 172.21.15.45:0/64697318 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4470004020 con 0x7f447c0ce9a0 2023-11-28T18:44:06.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:06.938+0000 7f4478ff9640 1 -- 172.21.15.45:0/64697318 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4470004180 con 0x7f447c0ce9a0 2023-11-28T18:44:06.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:06.938+0000 7f44828fe640 1 -- 172.21.15.45:0/64697318 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f447c1574c0 con 0x7f447c0ce9a0 2023-11-28T18:44:06.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:06.938+0000 7f4478ff9640 1 -- 172.21.15.45:0/64697318 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4470011630 con 0x7f447c0ce9a0 2023-11-28T18:44:06.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:06.938+0000 7f44828fe640 1 -- 172.21.15.45:0/64697318 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f447c152670 con 0x7f447c0ce9a0 2023-11-28T18:44:06.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:06.942+0000 7f44828fe640 1 -- 172.21.15.45:0/64697318 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f447c0b30d0 con 0x7f447c0ce9a0 2023-11-28T18:44:06.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:06.942+0000 7f4478ff9640 1 -- 172.21.15.45:0/64697318 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f4470011790 con 0x7f447c0ce9a0 2023-11-28T18:44:06.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:06.942+0000 7f4478ff9640 1 --2- 172.21.15.45:0/64697318 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f44680668d0 0x7f4468068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:06.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:06.942+0000 7f4478ff9640 1 -- 172.21.15.45:0/64697318 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4470083ff0 con 0x7f447c0ce9a0 2023-11-28T18:44:06.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:06.942+0000 7f447bfff640 1 --2- 172.21.15.45:0/64697318 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f44680668d0 0x7f4468068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:06.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:06.942+0000 7f447bfff640 1 --2- 172.21.15.45:0/64697318 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f44680668d0 0x7f4468068d90 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f446c0ad000 tx=0x7f446c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:44:06.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:06.946+0000 7f4478ff9640 1 -- 172.21.15.45:0/64697318 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f44700b5280 con 0x7f447c0ce9a0 2023-11-28T18:44:07.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.138+0000 7f44828fe640 1 -- 172.21.15.45:0/64697318 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) v1 -- 0x7f447c069410 con 0x7f447c0ce9a0 2023-11-28T18:44:07.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.318+0000 7f4478ff9640 1 -- 172.21.15.45:0/64697318 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v49) v1 ==== 105+0+0 (secure 0 0 0) 0x7f44700512f0 con 0x7f447c0ce9a0 2023-11-28T18:44:07.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.318+0000 7f44828fe640 1 -- 172.21.15.45:0/64697318 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f44680668d0 msgr2=0x7f4468068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:07.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.318+0000 7f44828fe640 1 --2- 172.21.15.45:0/64697318 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f44680668d0 0x7f4468068d90 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f446c0ad000 tx=0x7f446c008040 comp rx=0 tx=0).stop 2023-11-28T18:44:07.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.318+0000 7f44828fe640 1 -- 172.21.15.45:0/64697318 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f447c0ce9a0 msgr2=0x7f447c138a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:07.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.318+0000 7f44828fe640 1 --2- 172.21.15.45:0/64697318 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f447c0ce9a0 0x7f447c138a60 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f447000b410 tx=0x7f447000b8d0 comp rx=0 tx=0).stop 2023-11-28T18:44:07.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.318+0000 7f44828fe640 1 -- 172.21.15.45:0/64697318 shutdown_connections 2023-11-28T18:44:07.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.318+0000 7f44828fe640 1 --2- 172.21.15.45:0/64697318 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f44680668d0 0x7f4468068d90 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:07.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.318+0000 7f44828fe640 1 --2- 172.21.15.45:0/64697318 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f447c0ced80 0x7f447c138fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:07.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.318+0000 7f44828fe640 1 --2- 172.21.15.45:0/64697318 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f447c0ce9a0 0x7f447c138a60 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:07.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.318+0000 7f44828fe640 1 --2- 172.21.15.45:0/64697318 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f447c06bc90 0x7f447c14e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:07.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.318+0000 7f44828fe640 1 -- 172.21.15.45:0/64697318 >> 172.21.15.45:0/64697318 conn(0x7f447c0b1b70 msgr2=0x7f447c15ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:44:07.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.318+0000 7f44828fe640 1 -- 172.21.15.45:0/64697318 shutdown_connections 2023-11-28T18:44:07.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.318+0000 7f44828fe640 1 -- 172.21.15.45:0/64697318 wait complete. 2023-11-28T18:44:07.347 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T18:44:07.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.490+0000 7f6776c5f640 1 Processor -- start 2023-11-28T18:44:07.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.490+0000 7f6776c5f640 1 -- start start 2023-11-28T18:44:07.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.490+0000 7f6776c5f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6770144880 0x7f677006c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:07.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.490+0000 7f6776c5f640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f67700721c0 0x7f677006c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:07.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.490+0000 7f6776c5f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f67700704a0 0x7f6770070920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:07.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.490+0000 7f6776c5f640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f677015f050 con 0x7f67700704a0 2023-11-28T18:44:07.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.490+0000 7f6776c5f640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6770070e60 con 0x7f67700721c0 2023-11-28T18:44:07.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.490+0000 7f6776c5f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6770071120 con 0x7f6770144880 2023-11-28T18:44:07.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.490+0000 7f67751fc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f67700704a0 0x7f6770070920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:07.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.490+0000 7f67751fc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f67700704a0 0x7f6770070920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56386/0 (socket says 172.21.15.45:56386) 2023-11-28T18:44:07.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.490+0000 7f67751fc640 1 -- 172.21.15.45:0/752218693 learned_addr learned my addr 172.21.15.45:0/752218693 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:44:07.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.490+0000 7f67749fb640 1 --2- 172.21.15.45:0/752218693 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6770144880 0x7f677006c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:07.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.490+0000 7f676ffff640 1 --2- 172.21.15.45:0/752218693 >> v2:172.21.15.190:3300/0 conn(0x7f67700721c0 0x7f677006c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:07.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.490+0000 7f67751fc640 1 -- 172.21.15.45:0/752218693 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6770144880 msgr2=0x7f677006c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:44:07.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.490+0000 7f67751fc640 1 --2- 172.21.15.45:0/752218693 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6770144880 0x7f677006c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:07.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.490+0000 7f67751fc640 1 -- 172.21.15.45:0/752218693 >> v2:172.21.15.190:3300/0 conn(0x7f67700721c0 msgr2=0x7f677006c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:44:07.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.494+0000 7f67751fc640 1 --2- 172.21.15.45:0/752218693 >> v2:172.21.15.190:3300/0 conn(0x7f67700721c0 0x7f677006c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:07.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.494+0000 7f67751fc640 1 -- 172.21.15.45:0/752218693 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6770071400 con 0x7f67700704a0 2023-11-28T18:44:07.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.494+0000 7f67749fb640 1 --2- 172.21.15.45:0/752218693 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6770144880 0x7f677006c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:44:07.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.494+0000 7f67751fc640 1 --2- 172.21.15.45:0/752218693 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67700704a0 0x7f6770070920 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f6770067f70 tx=0x7f676801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bed08789ddb1ebf server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:44:07.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.494+0000 7f676f7fe640 1 -- 172.21.15.45:0/752218693 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67680a5820 con 0x7f67700704a0 2023-11-28T18:44:07.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.494+0000 7f676f7fe640 1 -- 172.21.15.45:0/752218693 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67680a5980 con 0x7f67700704a0 2023-11-28T18:44:07.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.494+0000 7f676f7fe640 1 -- 172.21.15.45:0/752218693 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67680a5d10 con 0x7f67700704a0 2023-11-28T18:44:07.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.494+0000 7f6776c5f640 1 -- 172.21.15.45:0/752218693 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67700704a0 msgr2=0x7f6770070920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:07.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.494+0000 7f6776c5f640 1 --2- 172.21.15.45:0/752218693 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67700704a0 0x7f6770070920 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f6770067f70 tx=0x7f676801c9a0 comp rx=0 tx=0).stop 2023-11-28T18:44:07.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.494+0000 7f6776c5f640 1 -- 172.21.15.45:0/752218693 shutdown_connections 2023-11-28T18:44:07.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.494+0000 7f6776c5f640 1 --2- 172.21.15.45:0/752218693 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67700704a0 0x7f6770070920 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:07.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.494+0000 7f6776c5f640 1 --2- 172.21.15.45:0/752218693 >> v2:172.21.15.190:3300/0 conn(0x7f67700721c0 0x7f677006c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:07.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.494+0000 7f6776c5f640 1 --2- 172.21.15.45:0/752218693 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6770144880 0x7f677006c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:07.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.494+0000 7f6776c5f640 1 -- 172.21.15.45:0/752218693 >> 172.21.15.45:0/752218693 conn(0x7f677006a570 msgr2=0x7f677006a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:44:07.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.494+0000 7f6776c5f640 1 -- 172.21.15.45:0/752218693 shutdown_connections 2023-11-28T18:44:07.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.494+0000 7f6776c5f640 1 -- 172.21.15.45:0/752218693 wait complete. 2023-11-28T18:44:07.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.498+0000 7f6776c5f640 1 Processor -- start 2023-11-28T18:44:07.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.498+0000 7f6776c5f640 1 -- start start 2023-11-28T18:44:07.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.498+0000 7f6776c5f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f67700704a0 0x7f6770164b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:07.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.498+0000 7f6776c5f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f67700721c0 0x7f6770161a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:07.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.498+0000 7f6776c5f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6770144880 0x7f677013cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:07.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.498+0000 7f6776c5f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6770163870 con 0x7f6770144880 2023-11-28T18:44:07.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.498+0000 7f6776c5f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6770163a80 con 0x7f67700704a0 2023-11-28T18:44:07.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.498+0000 7f6776c5f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6770163d60 con 0x7f67700721c0 2023-11-28T18:44:07.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.498+0000 7f67751fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6770144880 0x7f677013cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:07.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.498+0000 7f67751fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6770144880 0x7f677013cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56398/0 (socket says 172.21.15.45:56398) 2023-11-28T18:44:07.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.498+0000 7f67751fc640 1 -- 172.21.15.45:0/2854732837 learned_addr learned my addr 172.21.15.45:0/2854732837 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:44:07.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.498+0000 7f676ffff640 1 --2- 172.21.15.45:0/2854732837 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f67700721c0 0x7f6770161a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:07.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.498+0000 7f67749fb640 1 --2- 172.21.15.45:0/2854732837 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f67700704a0 0x7f6770164b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:07.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.498+0000 7f67751fc640 1 -- 172.21.15.45:0/2854732837 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f67700721c0 msgr2=0x7f6770161a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:07.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.498+0000 7f67751fc640 1 --2- 172.21.15.45:0/2854732837 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f67700721c0 0x7f6770161a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:07.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.498+0000 7f67751fc640 1 -- 172.21.15.45:0/2854732837 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f67700704a0 msgr2=0x7f6770164b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:07.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.498+0000 7f67751fc640 1 --2- 172.21.15.45:0/2854732837 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f67700704a0 0x7f6770164b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:07.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.498+0000 7f67751fc640 1 -- 172.21.15.45:0/2854732837 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6768009b30 con 0x7f6770144880 2023-11-28T18:44:07.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.498+0000 7f67751fc640 1 --2- 172.21.15.45:0/2854732837 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6770144880 0x7f677013cbc0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f67680af040 tx=0x7f6768019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:44:07.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.498+0000 7f676d7fa640 1 -- 172.21.15.45:0/2854732837 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67680b8670 con 0x7f6770144880 2023-11-28T18:44:07.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.498+0000 7f676d7fa640 1 -- 172.21.15.45:0/2854732837 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67680b87d0 con 0x7f6770144880 2023-11-28T18:44:07.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.498+0000 7f676d7fa640 1 -- 172.21.15.45:0/2854732837 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67680b8b80 con 0x7f6770144880 2023-11-28T18:44:07.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.498+0000 7f6776c5f640 1 -- 172.21.15.45:0/2854732837 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6770164040 con 0x7f6770144880 2023-11-28T18:44:07.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.502+0000 7f6776c5f640 1 -- 172.21.15.45:0/2854732837 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6770164600 con 0x7f6770144880 2023-11-28T18:44:07.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.502+0000 7f6776c5f640 1 -- 172.21.15.45:0/2854732837 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67701647f0 con 0x7f6770144880 2023-11-28T18:44:07.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.502+0000 7f676d7fa640 1 -- 172.21.15.45:0/2854732837 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f67680b8ce0 con 0x7f6770144880 2023-11-28T18:44:07.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.502+0000 7f676d7fa640 1 --2- 172.21.15.45:0/2854732837 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f67540668d0 0x7f6754068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:07.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.502+0000 7f676d7fa640 1 -- 172.21.15.45:0/2854732837 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f676811f9e0 con 0x7f6770144880 2023-11-28T18:44:07.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.502+0000 7f67749fb640 1 --2- 172.21.15.45:0/2854732837 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f67540668d0 0x7f6754068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:07.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.502+0000 7f67749fb640 1 --2- 172.21.15.45:0/2854732837 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f67540668d0 0x7f6754068d90 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f6764006fd0 tx=0x7f6764008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:44:07.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.506+0000 7f676d7fa640 1 -- 172.21.15.45:0/2854732837 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f67680eccc0 con 0x7f6770144880 2023-11-28T18:44:07.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.698+0000 7f6776c5f640 1 -- 172.21.15.45:0/2854732837 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6770069480 con 0x7f6770144880 2023-11-28T18:44:07.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.698+0000 7f676d7fa640 1 -- 172.21.15.45:0/2854732837 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+4935 (secure 0 0 0) 0x7f67680f02e0 con 0x7f6770144880 2023-11-28T18:44:07.698 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:44:07.698 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":50,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6002,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/1183598108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":1183598108},{"type":"v1","addr":"172.21.15.190:6836","nonce":1183598108}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6005,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/3723100406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":3723100406},{"type":"v1","addr":"172.21.15.190:6837","nonce":3723100406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T18:43:58.654090+0000","modified":"2023-11-28T18:44:07.321627+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6792,"mds_1":6789},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6789":{"gid":6789,"name":"c","rank":1,"incarnation":50,"state":"up:creating","state_seq":1,"addr":"172.21.15.45:6833/1994543507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1994543507},{"type":"v1","addr":"172.21.15.45:6833","nonce":1994543507}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_6792":{"gid":6792,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/2107305848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2107305848},{"type":"v1","addr":"172.21.15.45:6835","nonce":2107305848}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-28T18:44:07.700 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 50 2023-11-28T18:44:07.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.698+0000 7f6776c5f640 1 -- 172.21.15.45:0/2854732837 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f67540668d0 msgr2=0x7f6754068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:07.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.698+0000 7f6776c5f640 1 --2- 172.21.15.45:0/2854732837 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f67540668d0 0x7f6754068d90 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f6764006fd0 tx=0x7f6764008040 comp rx=0 tx=0).stop 2023-11-28T18:44:07.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.698+0000 7f6776c5f640 1 -- 172.21.15.45:0/2854732837 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6770144880 msgr2=0x7f677013cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:07.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.698+0000 7f6776c5f640 1 --2- 172.21.15.45:0/2854732837 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6770144880 0x7f677013cbc0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f67680af040 tx=0x7f6768019740 comp rx=0 tx=0).stop 2023-11-28T18:44:07.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.698+0000 7f6776c5f640 1 -- 172.21.15.45:0/2854732837 shutdown_connections 2023-11-28T18:44:07.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.698+0000 7f6776c5f640 1 --2- 172.21.15.45:0/2854732837 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f67540668d0 0x7f6754068d90 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:07.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.698+0000 7f6776c5f640 1 --2- 172.21.15.45:0/2854732837 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6770144880 0x7f677013cbc0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:07.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.698+0000 7f6776c5f640 1 --2- 172.21.15.45:0/2854732837 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f67700721c0 0x7f6770161a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:07.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.698+0000 7f6776c5f640 1 --2- 172.21.15.45:0/2854732837 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f67700704a0 0x7f6770164b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:07.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.698+0000 7f6776c5f640 1 -- 172.21.15.45:0/2854732837 >> 172.21.15.45:0/2854732837 conn(0x7f677006a570 msgr2=0x7f677006c300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:44:07.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.698+0000 7f6776c5f640 1 -- 172.21.15.45:0/2854732837 shutdown_connections 2023-11-28T18:44:07.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:07.698+0000 7f6776c5f640 1 -- 172.21.15.45:0/2854732837 wait complete. 2023-11-28T18:44:08.123 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 50, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-28T18:43:58.654090+0000', 'modified': '2023-11-28T18:44:07.321627+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 6792, 'mds_1': 6789}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6789': {'gid': 6789, 'name': 'c', 'rank': 1, 'incarnation': 50, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.45:6833/1994543507', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.45:6832', 'nonce': 1994543507}, {'type': 'v1', 'addr': '172.21.15.45:6833', 'nonce': 1994543507}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_6792': {'gid': 6792, 'name': 'a', 'rank': 0, 'incarnation': 44, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.45:6835/2107305848', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.45:6834', 'nonce': 2107305848}, {'type': 'v1', 'addr': '172.21.15.45:6835', 'nonce': 2107305848}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-28T18:44:08.123 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6789:up:creating 2023-11-28T18:44:09.123 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T18:44:09.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:09.278+0000 7fa1a5c79640 1 Processor -- start 2023-11-28T18:44:09.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:09.278+0000 7fa1a5c79640 1 -- start start 2023-11-28T18:44:09.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:09.278+0000 7fa1a5c79640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1a00b47a0 0x7fa1a00d10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:09.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:09.278+0000 7fa1a5c79640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa1a00b4b80 0x7fa1a00d1620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:09.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:09.278+0000 7fa1a5c79640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1a01437c0 con 0x7fa1a0142c40 2023-11-28T18:44:09.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:09.278+0000 7fa1a5c79640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1a0161e00 con 0x7fa1a00b4b80 2023-11-28T18:44:09.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:09.278+0000 7fa1a5c79640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a015d800 con 0x7fa1a00b47a0 2023-11-28T18:44:09.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:09.278+0000 7fa19effd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa1a00b4b80 0x7fa1a00d1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:09.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:09.278+0000 7fa19effd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa1a00b4b80 0x7fa1a00d1620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45962/0 (socket says 172.21.15.45:45962) 2023-11-28T18:44:09.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:09.278+0000 7fa19effd640 1 -- 172.21.15.45:0/1062424852 learned_addr learned my addr 172.21.15.45:0/1062424852 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:44:09.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:09.278+0000 7fa19f7fe640 1 --2- 172.21.15.45:0/1062424852 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1a00b47a0 0x7fa1a00d10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:09.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:09.278+0000 7fa19effd640 1 -- 172.21.15.45:0/1062424852 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1a00b47a0 msgr2=0x7fa1a00d10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:44:09.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:09.278+0000 7fa19effd640 1 --2- 172.21.15.45:0/1062424852 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1a00b47a0 0x7fa1a00d10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:09.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:09.278+0000 7fa19effd640 1 -- 172.21.15.45:0/1062424852 >> v1:172.21.15.190:6789/0 conn(0x7fa1a0142c40 legacy=0x7fa1a01430b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:09.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:09.278+0000 7fa19effd640 1 -- 172.21.15.45:0/1062424852 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1a0140970 con 0x7fa1a00b4b80 2023-11-28T18:44:09.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:09.278+0000 7fa19f7fe640 1 --2- 172.21.15.45:0/1062424852 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1a00b47a0 0x7fa1a00d10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:44:09.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:09.282+0000 7fa19effd640 1 --2- 172.21.15.45:0/1062424852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa1a00b4b80 0x7fa1a00d1620 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fa194009870 tx=0x7fa19401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be270a92f1b517bb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:44:09.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:09.282+0000 7fa19e7fc640 1 -- 172.21.15.45:0/1062424852 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1940ab600 con 0x7fa1a00b4b80 2023-11-28T18:44:09.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:09.282+0000 7fa19e7fc640 1 -- 172.21.15.45:0/1062424852 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1940a7050 con 0x7fa1a00b4b80 2023-11-28T18:44:09.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:09.282+0000 7fa19e7fc640 1 -- 172.21.15.45:0/1062424852 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1940ab980 con 0x7fa1a00b4b80 2023-11-28T18:44:09.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:09.282+0000 7fa1a5c79640 1 -- 172.21.15.45:0/1062424852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa1a00b4b80 msgr2=0x7fa1a00d1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:09.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:09.282+0000 7fa1a5c79640 1 --2- 172.21.15.45:0/1062424852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa1a00b4b80 0x7fa1a00d1620 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fa194009870 tx=0x7fa19401c540 comp rx=0 tx=0).stop 2023-11-28T18:44:09.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:09.282+0000 7fa1a5c79640 1 -- 172.21.15.45:0/1062424852 shutdown_connections 2023-11-28T18:44:09.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:09.282+0000 7fa1a5c79640 1 --2- 172.21.15.45:0/1062424852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa1a00b4b80 0x7fa1a00d1620 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:09.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:09.282+0000 7fa1a5c79640 1 --2- 172.21.15.45:0/1062424852 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1a00b47a0 0x7fa1a00d10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:09.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:09.282+0000 7fa1a5c79640 1 -- 172.21.15.45:0/1062424852 >> 172.21.15.45:0/1062424852 conn(0x7fa1a006a570 msgr2=0x7fa1a006a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:44:09.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:09.282+0000 7fa1a5c79640 1 -- 172.21.15.45:0/1062424852 shutdown_connections 2023-11-28T18:44:09.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:09.282+0000 7fa1a5c79640 1 -- 172.21.15.45:0/1062424852 wait complete. 2023-11-28T18:44:09.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:09.286+0000 7fa1a5c79640 1 Processor -- start 2023-11-28T18:44:09.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:09.286+0000 7fa1a5c79640 1 -- start start 2023-11-28T18:44:09.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:09.286+0000 7fa1a5c79640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa1a00b47a0 0x7fa1a0167810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:09.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:09.286+0000 7fa1a5c79640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1a00b4b80 0x7fa1a013b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:09.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:09.286+0000 7fa1a5c79640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa1a0142c40 0x7fa1a0159f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:09.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:09.286+0000 7fa1a5c79640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a0157ec0 con 0x7fa1a0142c40 2023-11-28T18:44:09.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:09.286+0000 7fa1a5c79640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a01f5710 con 0x7fa1a00b47a0 2023-11-28T18:44:09.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:09.286+0000 7fa1a5c79640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a013c4c0 con 0x7fa1a00b4b80 2023-11-28T18:44:09.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:09.286+0000 7fa19ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa1a0142c40 0x7fa1a0159f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:09.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:09.286+0000 7fa19ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa1a0142c40 0x7fa1a0159f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45970/0 (socket says 172.21.15.45:45970) 2023-11-28T18:44:09.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:09.286+0000 7fa19ffff640 1 -- 172.21.15.45:0/198126514 learned_addr learned my addr 172.21.15.45:0/198126514 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:44:09.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:09.286+0000 7fa19f7fe640 1 --2- 172.21.15.45:0/198126514 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa1a00b47a0 0x7fa1a0167810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:09.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:09.286+0000 7fa19effd640 1 --2- 172.21.15.45:0/198126514 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1a00b4b80 0x7fa1a013b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:09.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:09.286+0000 7fa19ffff640 1 -- 172.21.15.45:0/198126514 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1a00b4b80 msgr2=0x7fa1a013b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:09.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:09.286+0000 7fa19ffff640 1 --2- 172.21.15.45:0/198126514 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1a00b4b80 0x7fa1a013b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:09.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:09.286+0000 7fa19ffff640 1 -- 172.21.15.45:0/198126514 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa1a00b47a0 msgr2=0x7fa1a0167810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:09.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:09.286+0000 7fa19ffff640 1 --2- 172.21.15.45:0/198126514 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa1a00b47a0 0x7fa1a0167810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:09.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:09.286+0000 7fa19ffff640 1 -- 172.21.15.45:0/198126514 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1940094d0 con 0x7fa1a0142c40 2023-11-28T18:44:09.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:09.286+0000 7fa19ffff640 1 --2- 172.21.15.45:0/198126514 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa1a0142c40 0x7fa1a0159f60 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fa19800c730 tx=0x7fa19800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:44:09.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:09.286+0000 7fa187fff640 1 -- 172.21.15.45:0/198126514 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa198003b80 con 0x7fa1a0142c40 2023-11-28T18:44:09.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:09.286+0000 7fa187fff640 1 -- 172.21.15.45:0/198126514 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa198003ce0 con 0x7fa1a0142c40 2023-11-28T18:44:09.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:09.286+0000 7fa1a5c79640 1 -- 172.21.15.45:0/198126514 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1a013c7a0 con 0x7fa1a0142c40 2023-11-28T18:44:09.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:09.286+0000 7fa187fff640 1 -- 172.21.15.45:0/198126514 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa19800aa30 con 0x7fa1a0142c40 2023-11-28T18:44:09.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:09.286+0000 7fa1a5c79640 1 -- 172.21.15.45:0/198126514 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1a013cd60 con 0x7fa1a0142c40 2023-11-28T18:44:09.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:09.290+0000 7fa1a5c79640 1 -- 172.21.15.45:0/198126514 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1a013cf50 con 0x7fa1a0142c40 2023-11-28T18:44:09.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:09.290+0000 7fa187fff640 1 -- 172.21.15.45:0/198126514 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa19800ab90 con 0x7fa1a0142c40 2023-11-28T18:44:09.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:09.290+0000 7fa187fff640 1 --2- 172.21.15.45:0/198126514 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa18c0668d0 0x7fa18c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:09.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:09.290+0000 7fa187fff640 1 -- 172.21.15.45:0/198126514 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa1980840b0 con 0x7fa1a0142c40 2023-11-28T18:44:09.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:09.290+0000 7fa19f7fe640 1 --2- 172.21.15.45:0/198126514 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa18c0668d0 0x7fa18c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:09.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:09.290+0000 7fa19f7fe640 1 --2- 172.21.15.45:0/198126514 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa18c0668d0 0x7fa18c068d90 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fa19000ab60 tx=0x7fa190008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:44:09.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:09.294+0000 7fa187fff640 1 -- 172.21.15.45:0/198126514 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa1a013cf50 con 0x7fa1a0142c40 2023-11-28T18:44:09.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:09.490+0000 7fa1a5c79640 1 -- 172.21.15.45:0/198126514 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa1a0158030 con 0x7fa1a0142c40 2023-11-28T18:44:09.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:09.490+0000 7fa187fff640 1 -- 172.21.15.45:0/198126514 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4933 (secure 0 0 0) 0x7fa1a0158030 con 0x7fa1a0142c40 2023-11-28T18:44:09.490 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:44:09.490 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":51,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6002,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/1183598108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":1183598108},{"type":"v1","addr":"172.21.15.190:6836","nonce":1183598108}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6005,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/3723100406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":3723100406},{"type":"v1","addr":"172.21.15.190:6837","nonce":3723100406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T18:43:58.654090+0000","modified":"2023-11-28T18:44:07.340799+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6792,"mds_1":6789},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6789":{"gid":6789,"name":"c","rank":1,"incarnation":50,"state":"up:active","state_seq":5,"addr":"172.21.15.45:6833/1994543507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1994543507},{"type":"v1","addr":"172.21.15.45:6833","nonce":1994543507}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_6792":{"gid":6792,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/2107305848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2107305848},{"type":"v1","addr":"172.21.15.45:6835","nonce":2107305848}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-28T18:44:09.491 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 51 2023-11-28T18:44:09.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:09.490+0000 7fa1a5c79640 1 -- 172.21.15.45:0/198126514 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa18c0668d0 msgr2=0x7fa18c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:09.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:09.490+0000 7fa1a5c79640 1 --2- 172.21.15.45:0/198126514 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa18c0668d0 0x7fa18c068d90 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fa19000ab60 tx=0x7fa190008040 comp rx=0 tx=0).stop 2023-11-28T18:44:09.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:09.490+0000 7fa1a5c79640 1 -- 172.21.15.45:0/198126514 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa1a0142c40 msgr2=0x7fa1a0159f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:09.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:09.490+0000 7fa1a5c79640 1 --2- 172.21.15.45:0/198126514 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa1a0142c40 0x7fa1a0159f60 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fa19800c730 tx=0x7fa19800cbf0 comp rx=0 tx=0).stop 2023-11-28T18:44:09.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:09.490+0000 7fa1a5c79640 1 -- 172.21.15.45:0/198126514 shutdown_connections 2023-11-28T18:44:09.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:09.490+0000 7fa1a5c79640 1 --2- 172.21.15.45:0/198126514 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa18c0668d0 0x7fa18c068d90 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:09.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:09.490+0000 7fa1a5c79640 1 --2- 172.21.15.45:0/198126514 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa1a0142c40 0x7fa1a0159f60 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:09.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:09.490+0000 7fa1a5c79640 1 --2- 172.21.15.45:0/198126514 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1a00b4b80 0x7fa1a013b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:09.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:09.490+0000 7fa1a5c79640 1 --2- 172.21.15.45:0/198126514 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa1a00b47a0 0x7fa1a0167810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:09.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:09.490+0000 7fa1a5c79640 1 -- 172.21.15.45:0/198126514 >> 172.21.15.45:0/198126514 conn(0x7fa1a006a570 msgr2=0x7fa1a0156e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:44:09.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:09.490+0000 7fa1a5c79640 1 -- 172.21.15.45:0/198126514 shutdown_connections 2023-11-28T18:44:09.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:09.490+0000 7fa1a5c79640 1 -- 172.21.15.45:0/198126514 wait complete. 2023-11-28T18:44:09.914 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 51, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-28T18:43:58.654090+0000', 'modified': '2023-11-28T18:44:07.340799+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 6792, 'mds_1': 6789}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6789': {'gid': 6789, 'name': 'c', 'rank': 1, 'incarnation': 50, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.45:6833/1994543507', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.45:6832', 'nonce': 1994543507}, {'type': 'v1', 'addr': '172.21.15.45:6833', 'nonce': 1994543507}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_6792': {'gid': 6792, 'name': 'a', 'rank': 0, 'incarnation': 44, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.45:6835/2107305848', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.45:6834', 'nonce': 2107305848}, {'type': 'v1', 'addr': '172.21.15.45:6835', 'nonce': 2107305848}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-28T18:44:09.914 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 2/2 2023-11-28T18:44:09.914 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-28T18:44:10.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.062+0000 7f10d76dd640 1 Processor -- start 2023-11-28T18:44:10.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.066+0000 7f10d76dd640 1 -- start start 2023-11-28T18:44:10.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.066+0000 7f10d76dd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10d013cf70 0x7f10d006c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:10.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.066+0000 7f10d76dd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f10d006c840 0x7f10d015a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:10.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.066+0000 7f10d76dd640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10d015b3e0 con 0x7f10d015abb0 2023-11-28T18:44:10.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.066+0000 7f10d76dd640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10d013d350 con 0x7f10d006c840 2023-11-28T18:44:10.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.066+0000 7f10d76dd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10d0140520 con 0x7f10d013cf70 2023-11-28T18:44:10.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.066+0000 7f10d4c78640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f10d006c840 0x7f10d015a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:10.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.066+0000 7f10d4c78640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f10d006c840 0x7f10d015a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45972/0 (socket says 172.21.15.45:45972) 2023-11-28T18:44:10.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.066+0000 7f10d4c78640 1 -- 172.21.15.45:0/1760878217 learned_addr learned my addr 172.21.15.45:0/1760878217 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:44:10.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.066+0000 7f10d5479640 1 --2- 172.21.15.45:0/1760878217 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10d013cf70 0x7f10d006c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:10.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.066+0000 7f10d4c78640 1 -- 172.21.15.45:0/1760878217 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10d013cf70 msgr2=0x7f10d006c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:44:10.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.066+0000 7f10d4c78640 1 --2- 172.21.15.45:0/1760878217 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10d013cf70 0x7f10d006c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:10.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.066+0000 7f10d4c78640 1 -- 172.21.15.45:0/1760878217 >> v1:172.21.15.45:6789/0 conn(0x7f10d015abb0 legacy=0x7f10d00715b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:10.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.066+0000 7f10d4c78640 1 -- 172.21.15.45:0/1760878217 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d006cc80 con 0x7f10d006c840 2023-11-28T18:44:10.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.070+0000 7f10d4c78640 1 --2- 172.21.15.45:0/1760878217 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10d006c840 0x7f10d015a670 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f10c00098a0 tx=0x7f10c001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a1cdeeb126b6fd6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:44:10.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.070+0000 7f10c7fff640 1 -- 172.21.15.45:0/1760878217 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c00ab660 con 0x7f10d006c840 2023-11-28T18:44:10.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.070+0000 7f10c7fff640 1 -- 172.21.15.45:0/1760878217 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c00ab7c0 con 0x7f10d006c840 2023-11-28T18:44:10.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.070+0000 7f10c7fff640 1 -- 172.21.15.45:0/1760878217 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c00abb50 con 0x7f10d006c840 2023-11-28T18:44:10.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.070+0000 7f10d76dd640 1 -- 172.21.15.45:0/1760878217 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10d006c840 msgr2=0x7f10d015a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:10.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.070+0000 7f10d76dd640 1 --2- 172.21.15.45:0/1760878217 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10d006c840 0x7f10d015a670 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f10c00098a0 tx=0x7f10c001c460 comp rx=0 tx=0).stop 2023-11-28T18:44:10.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.070+0000 7f10d76dd640 1 -- 172.21.15.45:0/1760878217 shutdown_connections 2023-11-28T18:44:10.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.070+0000 7f10d76dd640 1 --2- 172.21.15.45:0/1760878217 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10d006c840 0x7f10d015a670 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:10.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.070+0000 7f10d76dd640 1 --2- 172.21.15.45:0/1760878217 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10d013cf70 0x7f10d006c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:10.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.070+0000 7f10d76dd640 1 -- 172.21.15.45:0/1760878217 >> 172.21.15.45:0/1760878217 conn(0x7f10d006a570 msgr2=0x7f10d006a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:44:10.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.070+0000 7f10d76dd640 1 -- 172.21.15.45:0/1760878217 shutdown_connections 2023-11-28T18:44:10.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.070+0000 7f10d76dd640 1 -- 172.21.15.45:0/1760878217 wait complete. 2023-11-28T18:44:10.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.070+0000 7f10d76dd640 1 Processor -- start 2023-11-28T18:44:10.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.070+0000 7f10d76dd640 1 -- start start 2023-11-28T18:44:10.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.074+0000 7f10d76dd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f10d006c840 0x7f10d0135f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:10.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.074+0000 7f10d76dd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10d013cf70 0x7f10d014b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:10.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.074+0000 7f10d76dd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10d015abb0 0x7f10d013ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:10.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.074+0000 7f10d76dd640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d0136e60 con 0x7f10d015abb0 2023-11-28T18:44:10.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.074+0000 7f10d76dd640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d0136440 con 0x7f10d006c840 2023-11-28T18:44:10.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.074+0000 7f10d76dd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10d01580b0 con 0x7f10d013cf70 2023-11-28T18:44:10.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.074+0000 7f10d5c7a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10d015abb0 0x7f10d013ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:10.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.074+0000 7f10d5c7a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10d015abb0 0x7f10d013ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45984/0 (socket says 172.21.15.45:45984) 2023-11-28T18:44:10.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.074+0000 7f10d5c7a640 1 -- 172.21.15.45:0/361680925 learned_addr learned my addr 172.21.15.45:0/361680925 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:44:10.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.074+0000 7f10d4c78640 1 --2- 172.21.15.45:0/361680925 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10d013cf70 0x7f10d014b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:10.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.074+0000 7f10d5479640 1 --2- 172.21.15.45:0/361680925 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f10d006c840 0x7f10d0135f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:10.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.074+0000 7f10d5c7a640 1 -- 172.21.15.45:0/361680925 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10d013cf70 msgr2=0x7f10d014b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:10.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.074+0000 7f10d5c7a640 1 --2- 172.21.15.45:0/361680925 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10d013cf70 0x7f10d014b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:10.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.074+0000 7f10d5c7a640 1 -- 172.21.15.45:0/361680925 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f10d006c840 msgr2=0x7f10d0135f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:10.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.074+0000 7f10d5c7a640 1 --2- 172.21.15.45:0/361680925 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f10d006c840 0x7f10d0135f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:10.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.074+0000 7f10d5c7a640 1 -- 172.21.15.45:0/361680925 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c00094d0 con 0x7f10d015abb0 2023-11-28T18:44:10.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.074+0000 7f10d5c7a640 1 --2- 172.21.15.45:0/361680925 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10d015abb0 0x7f10d013ddf0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f10c800c7a0 tx=0x7f10c800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:44:10.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.074+0000 7f10c5ffb640 1 -- 172.21.15.45:0/361680925 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c8003b80 con 0x7f10d015abb0 2023-11-28T18:44:10.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.074+0000 7f10c5ffb640 1 -- 172.21.15.45:0/361680925 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c8003ce0 con 0x7f10d015abb0 2023-11-28T18:44:10.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.074+0000 7f10c5ffb640 1 -- 172.21.15.45:0/361680925 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c800aa30 con 0x7f10d015abb0 2023-11-28T18:44:10.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.074+0000 7f10d76dd640 1 -- 172.21.15.45:0/361680925 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10d014ce60 con 0x7f10d015abb0 2023-11-28T18:44:10.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.074+0000 7f10d76dd640 1 -- 172.21.15.45:0/361680925 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10d014d100 con 0x7f10d015abb0 2023-11-28T18:44:10.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.074+0000 7f10c5ffb640 1 -- 172.21.15.45:0/361680925 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f10c800ab90 con 0x7f10d015abb0 2023-11-28T18:44:10.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.078+0000 7f10c5ffb640 1 --2- 172.21.15.45:0/361680925 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f10b40668d0 0x7f10b4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:10.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.078+0000 7f10c5ffb640 1 -- 172.21.15.45:0/361680925 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f10c8084170 con 0x7f10d015abb0 2023-11-28T18:44:10.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.078+0000 7f10d5479640 1 --2- 172.21.15.45:0/361680925 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f10b40668d0 0x7f10b4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:10.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.078+0000 7f10daa3a000 1 Processor -- start 2023-11-28T18:44:10.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.078+0000 7f10daa3a000 1 -- start start 2023-11-28T18:44:10.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.078+0000 7f10d5479640 1 --2- 172.21.15.45:0/361680925 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f10b40668d0 0x7f10b4068d90 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f10cc00b930 tx=0x7f10cc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:44:10.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.078+0000 7f10daa3a000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a2e9e0ad30 0x55a2e9e0b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:10.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.078+0000 7f10daa3a000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a2e9e0b650 0x55a2e9dbdfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:10.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.078+0000 7f10daa3a000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a2e9dbe500 0x55a2e9dbe8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:10.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.078+0000 7f10daa3a000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2e9c87110 con 0x55a2e9e0b650 2023-11-28T18:44:10.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.078+0000 7f10daa3a000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2e9c179a0 con 0x55a2e9dbe500 2023-11-28T18:44:10.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.078+0000 7f10daa3a000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a2e9c14ed0 con 0x55a2e9e0ad30 2023-11-28T18:44:10.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.078+0000 7f10d4c78640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a2e9e0b650 0x55a2e9dbdfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:10.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.078+0000 7f10d4c78640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a2e9e0b650 0x55a2e9dbdfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45998/0 (socket says 172.21.15.45:45998) 2023-11-28T18:44:10.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.078+0000 7f10d4c78640 1 -- 172.21.15.45:0/2345721950 learned_addr learned my addr 172.21.15.45:0/2345721950 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:44:10.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.078+0000 7f10d5479640 1 --2- 172.21.15.45:0/2345721950 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a2e9e0ad30 0x55a2e9e0b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:10.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.078+0000 7f10d5c7a640 1 --2- 172.21.15.45:0/2345721950 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a2e9dbe500 0x55a2e9dbe8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:10.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.078+0000 7f10d4c78640 1 -- 172.21.15.45:0/2345721950 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a2e9e0ad30 msgr2=0x55a2e9e0b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:44:10.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.078+0000 7f10d4c78640 1 --2- 172.21.15.45:0/2345721950 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a2e9e0ad30 0x55a2e9e0b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:10.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.078+0000 7f10d4c78640 1 -- 172.21.15.45:0/2345721950 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a2e9dbe500 msgr2=0x55a2e9dbe8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:44:10.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.078+0000 7f10d4c78640 1 --2- 172.21.15.45:0/2345721950 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a2e9dbe500 0x55a2e9dbe8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:10.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.078+0000 7f10d4c78640 1 -- 172.21.15.45:0/2345721950 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a2e9908890 con 0x55a2e9e0b650 2023-11-28T18:44:10.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.078+0000 7f10d4c78640 1 --2- 172.21.15.45:0/2345721950 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a2e9e0b650 0x55a2e9dbdfc0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f10c00097f0 tx=0x7f10c00a7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf979ce9f722f20 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:44:10.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.082+0000 7f10b2ffd640 1 -- 172.21.15.45:0/2345721950 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c00ab9f0 con 0x55a2e9e0b650 2023-11-28T18:44:10.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.082+0000 7f10b2ffd640 1 -- 172.21.15.45:0/2345721950 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c00abb50 con 0x55a2e9e0b650 2023-11-28T18:44:10.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.082+0000 7f10b2ffd640 1 -- 172.21.15.45:0/2345721950 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c00bf420 con 0x55a2e9e0b650 2023-11-28T18:44:10.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.082+0000 7f10daa3a000 1 -- 172.21.15.45:0/2345721950 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a2e9e0b650 msgr2=0x55a2e9dbdfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:10.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.082+0000 7f10daa3a000 1 --2- 172.21.15.45:0/2345721950 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a2e9e0b650 0x55a2e9dbdfc0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f10c00097f0 tx=0x7f10c00a7000 comp rx=0 tx=0).stop 2023-11-28T18:44:10.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.082+0000 7f10daa3a000 1 -- 172.21.15.45:0/2345721950 shutdown_connections 2023-11-28T18:44:10.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.082+0000 7f10daa3a000 1 --2- 172.21.15.45:0/2345721950 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a2e9dbe500 0x55a2e9dbe8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:10.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.082+0000 7f10daa3a000 1 --2- 172.21.15.45:0/2345721950 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a2e9e0b650 0x55a2e9dbdfc0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:10.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.082+0000 7f10daa3a000 1 --2- 172.21.15.45:0/2345721950 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a2e9e0ad30 0x55a2e9e0b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:10.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.082+0000 7f10daa3a000 1 -- 172.21.15.45:0/2345721950 >> 172.21.15.45:0/2345721950 conn(0x55a2e9deb8c0 msgr2=0x55a2e9dedcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:44:10.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.082+0000 7f10daa3a000 1 -- 172.21.15.45:0/2345721950 shutdown_connections 2023-11-28T18:44:10.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.082+0000 7f10daa3a000 1 -- 172.21.15.45:0/2345721950 wait complete. 2023-11-28T18:44:10.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.082+0000 7f10daa3a000 1 -- start start 2023-11-28T18:44:10.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.082+0000 7f10daa3a000 1 Processor -- start 2023-11-28T18:44:10.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.082+0000 7f10daa3a000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a2e9dbe500 0x55a2e9dc4520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:10.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.082+0000 7f10daa3a000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a2e9e0ad30 0x55a2e9dc4a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:10.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.082+0000 7f10daa3a000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a2e9e0b650 0x55a2e9dc4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:10.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.082+0000 7f10daa3a000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2e9c107c0 con 0x55a2e9e0ad30 2023-11-28T18:44:10.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.082+0000 7f10daa3a000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2e9bc8bf0 con 0x55a2e9dbe500 2023-11-28T18:44:10.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.082+0000 7f10daa3a000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a2e9bcea90 con 0x55a2e9e0b650 2023-11-28T18:44:10.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.082+0000 7f10daa3a000 10 client.0 _ll_register_callbacks cb 0x55a2e9dabe20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T18:44:10.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.082+0000 7f10d4c78640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a2e9e0ad30 0x55a2e9dc4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:10.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.082+0000 7f10d4c78640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a2e9e0ad30 0x55a2e9dc4a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46000/0 (socket says 172.21.15.45:46000) 2023-11-28T18:44:10.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.082+0000 7f10d4c78640 1 -- 172.21.15.45:0/3843043939 learned_addr learned my addr 172.21.15.45:0/3843043939 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:44:10.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.082+0000 7f10d5479640 1 --2- 172.21.15.45:0/3843043939 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a2e9dbe500 0x55a2e9dc4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:10.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.082+0000 7f10d5c7a640 1 --2- 172.21.15.45:0/3843043939 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a2e9e0b650 0x55a2e9dc4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:10.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.082+0000 7f10d4c78640 1 -- 172.21.15.45:0/3843043939 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a2e9e0b650 msgr2=0x55a2e9dc4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:44:10.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.082+0000 7f10d4c78640 1 --2- 172.21.15.45:0/3843043939 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a2e9e0b650 0x55a2e9dc4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:10.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.082+0000 7f10d4c78640 1 -- 172.21.15.45:0/3843043939 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a2e9dbe500 msgr2=0x55a2e9dc4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:44:10.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.082+0000 7f10d4c78640 1 --2- 172.21.15.45:0/3843043939 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a2e9dbe500 0x55a2e9dc4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:10.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.082+0000 7f10d4c78640 1 -- 172.21.15.45:0/3843043939 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10d006cc80 con 0x55a2e9e0ad30 2023-11-28T18:44:10.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.082+0000 7f10d4c78640 1 --2- 172.21.15.45:0/3843043939 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a2e9e0ad30 0x55a2e9dc4a60 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f10c0019070 tx=0x7f10c001aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cbe2687fcb11739 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:44:10.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.082+0000 7f10abfff640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-11-28T18:44:10.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.086+0000 7f10abfff640 1 -- 172.21.15.45:0/3843043939 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c0004230 con 0x55a2e9e0ad30 2023-11-28T18:44:10.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.086+0000 7f10abfff640 1 -- 172.21.15.45:0/3843043939 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f10c0004390 con 0x55a2e9e0ad30 2023-11-28T18:44:10.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.086+0000 7f10daa3a000 1 -- 172.21.15.45:0/3843043939 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a2e9bd2470 con 0x55a2e9e0ad30 2023-11-28T18:44:10.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.086+0000 7f10abfff640 1 -- 172.21.15.45:0/3843043939 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f10c0006a70 con 0x55a2e9e0ad30 2023-11-28T18:44:10.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.086+0000 7f10daa3a000 10 client.6978 fetch_fsmap learned FSMap version 51 2023-11-28T18:44:10.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.086+0000 7f10daa3a000 1 -- 172.21.15.45:0/3843043939 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=2+}) v3 -- 0x55a2e9bd1190 con 0x55a2e9e0ad30 2023-11-28T18:44:10.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.086+0000 7f10abfff640 1 -- 172.21.15.45:0/3843043939 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a2e9bd2470 con 0x55a2e9e0ad30 2023-11-28T18:44:10.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.086+0000 7f10abfff640 1 -- 172.21.15.45:0/3843043939 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 51) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f10c0003620 con 0x55a2e9e0ad30 2023-11-28T18:44:10.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.086+0000 7f10daa3a000 10 client.6978 fetch_fsmap finished waiting for FSMap version 51 2023-11-28T18:44:10.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.086+0000 7f10daa3a000 10 client.6978 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-28T18:44:10.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.086+0000 7f10daa3a000 20 client.6978 populate_metadata read hostname 'smithi045' 2023-11-28T18:44:10.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.086+0000 7f10daa3a000 1 --2- 172.21.15.45:0/3843043939 >> [v2:172.21.15.45:6832/1994543507,v1:172.21.15.45:6833/1994543507] conn(0x55a2e9dc59b0 0x55a2e9e1cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:10.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.086+0000 7f10daa3a000 4 client.6978 mds_command: new command op to 6789 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-28T18:44:10.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.086+0000 7f10daa3a000 1 -- 172.21.15.45:0/3843043939 --> [v2:172.21.15.45:6832/1994543507,v1:172.21.15.45:6833/1994543507] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a2e9bd5b50 con 0x55a2e9dc59b0 2023-11-28T18:44:10.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.086+0000 7f10d5479640 1 --2- 172.21.15.45:0/3843043939 >> [v2:172.21.15.45:6832/1994543507,v1:172.21.15.45:6833/1994543507] conn(0x55a2e9dc59b0 0x55a2e9e1cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:10.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.086+0000 7f10d5479640 1 --2- 172.21.15.45:0/3843043939 >> [v2:172.21.15.45:6832/1994543507,v1:172.21.15.45:6833/1994543507] conn(0x55a2e9dc59b0 0x55a2e9e1cff0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d0e942a6408bde69 server_cookie=a6174e5a6fd7ad38 in_seq=0 out_seq=0 2023-11-28T18:44:10.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.086+0000 7f10abfff640 10 client.6978 ms_handle_connect on v2:172.21.15.45:6832/1994543507 2023-11-28T18:44:10.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.086+0000 7f10abfff640 1 -- 172.21.15.45:0/3843043939 <== mds.1 v2:172.21.15.45:6832/1994543507 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a2e9bd5b50 con 0x55a2e9dc59b0 2023-11-28T18:44:10.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.086+0000 7f10abfff640 10 client.6978 handle_command_reply: tid=0 2023-11-28T18:44:10.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.086+0000 7f10daa3a000 1 client.6978 shutdown 2023-11-28T18:44:10.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.086+0000 7f10daa3a000 1 -- 172.21.15.45:0/3843043939 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a2e9e0ad30 msgr2=0x55a2e9dc4a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:10.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.086+0000 7f10daa3a000 1 --2- 172.21.15.45:0/3843043939 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a2e9e0ad30 0x55a2e9dc4a60 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f10c0019070 tx=0x7f10c001aca0 comp rx=0 tx=0).stop 2023-11-28T18:44:10.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.086+0000 7f10daa3a000 1 -- 172.21.15.45:0/3843043939 shutdown_connections 2023-11-28T18:44:10.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.086+0000 7f10daa3a000 1 --2- 172.21.15.45:0/3843043939 >> [v2:172.21.15.45:6832/1994543507,v1:172.21.15.45:6833/1994543507] conn(0x55a2e9dc59b0 0x55a2e9e1cff0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:10.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.086+0000 7f10daa3a000 1 --2- 172.21.15.45:0/3843043939 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a2e9e0b650 0x55a2e9dc4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:10.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.086+0000 7f10daa3a000 1 --2- 172.21.15.45:0/3843043939 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a2e9e0ad30 0x55a2e9dc4a60 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:10.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.086+0000 7f10abfff640 0 client.6978 ms_handle_reset on v2:172.21.15.45:6832/1994543507 2023-11-28T18:44:10.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.086+0000 7f10daa3a000 1 --2- 172.21.15.45:0/3843043939 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a2e9dbe500 0x55a2e9dc4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:10.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.086+0000 7f10daa3a000 1 -- 172.21.15.45:0/3843043939 >> 172.21.15.45:0/3843043939 conn(0x55a2e9deb8c0 msgr2=0x55a2e9dbd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:44:10.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.086+0000 7f10daa3a000 1 -- 172.21.15.45:0/3843043939 shutdown_connections 2023-11-28T18:44:10.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.086+0000 7f10daa3a000 1 -- 172.21.15.45:0/3843043939 wait complete. 2023-11-28T18:44:10.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.086+0000 7f10daa3a000 20 client.6978 trim_cache size 0 max 16384 2023-11-28T18:44:10.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.102+0000 7f10daa3a000 1 Processor -- start 2023-11-28T18:44:10.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.102+0000 7f10daa3a000 1 -- start start 2023-11-28T18:44:10.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.102+0000 7f10daa3a000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a2e9dbe500 0x55a2e9dea3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:10.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.102+0000 7f10daa3a000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a2e9e0ad30 0x55a2e9dea8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:10.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.102+0000 7f10daa3a000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a2e9e0b650 0x55a2e9e1cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:10.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.102+0000 7f10daa3a000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2e98c9940 con 0x55a2e9dbe500 2023-11-28T18:44:10.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.102+0000 7f10daa3a000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2e9db8430 con 0x55a2e9e0ad30 2023-11-28T18:44:10.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.102+0000 7f10daa3a000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a2e9c0ffd0 con 0x55a2e9e0b650 2023-11-28T18:44:10.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.102+0000 7f10d5479640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a2e9dbe500 0x55a2e9dea3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:10.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.102+0000 7f10d5479640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a2e9dbe500 0x55a2e9dea3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46012/0 (socket says 172.21.15.45:46012) 2023-11-28T18:44:10.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.102+0000 7f10d5479640 1 -- 172.21.15.45:0/3539223707 learned_addr learned my addr 172.21.15.45:0/3539223707 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:44:10.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.106+0000 7f10d5c7a640 1 --2- 172.21.15.45:0/3539223707 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a2e9e0b650 0x55a2e9e1cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:10.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.106+0000 7f10d4c78640 1 --2- 172.21.15.45:0/3539223707 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a2e9e0ad30 0x55a2e9dea8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:10.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.106+0000 7f10d5479640 1 -- 172.21.15.45:0/3539223707 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a2e9e0b650 msgr2=0x55a2e9e1cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:44:10.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.106+0000 7f10d5479640 1 --2- 172.21.15.45:0/3539223707 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a2e9e0b650 0x55a2e9e1cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:10.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.106+0000 7f10d5479640 1 -- 172.21.15.45:0/3539223707 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a2e9e0ad30 msgr2=0x55a2e9dea8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:44:10.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.106+0000 7f10d5479640 1 --2- 172.21.15.45:0/3539223707 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a2e9e0ad30 0x55a2e9dea8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:10.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.106+0000 7f10d5479640 1 -- 172.21.15.45:0/3539223707 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a2e9dbe370 con 0x55a2e9dbe500 2023-11-28T18:44:10.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.106+0000 7f10d5479640 1 --2- 172.21.15.45:0/3539223707 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a2e9dbe500 0x55a2e9dea3a0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x55a2e9bc6580 tx=0x7f10cc015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58c55791a4dc67dc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:44:10.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.106+0000 7f10b37fe640 1 -- 172.21.15.45:0/3539223707 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10cc014930 con 0x55a2e9dbe500 2023-11-28T18:44:10.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.106+0000 7f10b37fe640 1 -- 172.21.15.45:0/3539223707 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10cc014a90 con 0x55a2e9dbe500 2023-11-28T18:44:10.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.106+0000 7f10b37fe640 1 -- 172.21.15.45:0/3539223707 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10cc014e00 con 0x55a2e9dbe500 2023-11-28T18:44:10.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.106+0000 7f10daa3a000 1 -- 172.21.15.45:0/3539223707 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a2e9dbe500 msgr2=0x55a2e9dea3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:10.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.106+0000 7f10daa3a000 1 --2- 172.21.15.45:0/3539223707 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a2e9dbe500 0x55a2e9dea3a0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x55a2e9bc6580 tx=0x7f10cc015000 comp rx=0 tx=0).stop 2023-11-28T18:44:10.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.106+0000 7f10daa3a000 1 -- 172.21.15.45:0/3539223707 shutdown_connections 2023-11-28T18:44:10.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.106+0000 7f10daa3a000 1 --2- 172.21.15.45:0/3539223707 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a2e9e0b650 0x55a2e9e1cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:10.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.106+0000 7f10daa3a000 1 --2- 172.21.15.45:0/3539223707 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a2e9e0ad30 0x55a2e9dea8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:10.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.106+0000 7f10daa3a000 1 --2- 172.21.15.45:0/3539223707 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a2e9dbe500 0x55a2e9dea3a0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:10.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.106+0000 7f10daa3a000 1 -- 172.21.15.45:0/3539223707 >> 172.21.15.45:0/3539223707 conn(0x55a2e9deb8c0 msgr2=0x55a2e9dbc720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:44:10.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.106+0000 7f10daa3a000 1 -- 172.21.15.45:0/3539223707 shutdown_connections 2023-11-28T18:44:10.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.106+0000 7f10daa3a000 1 -- 172.21.15.45:0/3539223707 wait complete. 2023-11-28T18:44:10.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.106+0000 7f10daa3a000 1 -- start start 2023-11-28T18:44:10.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.106+0000 7f10daa3a000 1 Processor -- start 2023-11-28T18:44:10.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.106+0000 7f10daa3a000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a2e9dbe500 0x55a2e9e6b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:10.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.106+0000 7f10daa3a000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a2e9e0ad30 0x55a2e9e6bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:10.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.106+0000 7f10daa3a000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a2e9e0b650 0x55a2e9e26a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:10.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.106+0000 7f10daa3a000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2e9ba7420 con 0x55a2e9e0b650 2023-11-28T18:44:10.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.106+0000 7f10daa3a000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2e9bda2e0 con 0x55a2e9dbe500 2023-11-28T18:44:10.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.106+0000 7f10daa3a000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a2e9e0abe0 con 0x55a2e9e0ad30 2023-11-28T18:44:10.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.106+0000 7f10daa3a000 10 client.0 _ll_register_callbacks cb 0x55a2e9c87060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T18:44:10.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.106+0000 7f10d5c7a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a2e9e0b650 0x55a2e9e26a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:10.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.106+0000 7f10d5479640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a2e9dbe500 0x55a2e9e6b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:10.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.106+0000 7f10d5c7a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a2e9e0b650 0x55a2e9e26a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46026/0 (socket says 172.21.15.45:46026) 2023-11-28T18:44:10.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.106+0000 7f10d5c7a640 1 -- 172.21.15.45:0/3013332515 learned_addr learned my addr 172.21.15.45:0/3013332515 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:44:10.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.106+0000 7f10d4c78640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a2e9e0ad30 0x55a2e9e6bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:10.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.110+0000 7f10d5c7a640 1 -- 172.21.15.45:0/3013332515 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a2e9e0ad30 msgr2=0x55a2e9e6bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:44:10.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.110+0000 7f10d5c7a640 1 --2- 172.21.15.45:0/3013332515 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a2e9e0ad30 0x55a2e9e6bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:10.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.110+0000 7f10d5c7a640 1 -- 172.21.15.45:0/3013332515 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a2e9dbe500 msgr2=0x55a2e9e6b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:44:10.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.110+0000 7f10d5c7a640 1 --2- 172.21.15.45:0/3013332515 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a2e9dbe500 0x55a2e9e6b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:10.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.110+0000 7f10d5c7a640 1 -- 172.21.15.45:0/3013332515 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10cc00e040 con 0x55a2e9e0b650 2023-11-28T18:44:10.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.110+0000 7f10d5c7a640 1 --2- 172.21.15.45:0/3013332515 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a2e9e0b650 0x55a2e9e26a70 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f10c8051520 tx=0x7f10c80014b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1778d2cf9cf993c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:44:10.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.110+0000 7f10abfff640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-11-28T18:44:10.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.110+0000 7f10abfff640 1 -- 172.21.15.45:0/3013332515 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c80591c0 con 0x55a2e9e0b650 2023-11-28T18:44:10.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.110+0000 7f10daa3a000 1 -- 172.21.15.45:0/3013332515 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a2e9c0f110 con 0x55a2e9e0b650 2023-11-28T18:44:10.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.110+0000 7f10abfff640 1 -- 172.21.15.45:0/3013332515 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f10c805d370 con 0x55a2e9e0b650 2023-11-28T18:44:10.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.110+0000 7f10abfff640 1 -- 172.21.15.45:0/3013332515 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f10c805b0b0 con 0x55a2e9e0b650 2023-11-28T18:44:10.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.110+0000 7f10daa3a000 10 client.6984 fetch_fsmap learned FSMap version 51 2023-11-28T18:44:10.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.110+0000 7f10daa3a000 1 -- 172.21.15.45:0/3013332515 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=2+}) v3 -- 0x55a2e9bb7490 con 0x55a2e9e0b650 2023-11-28T18:44:10.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.110+0000 7f10abfff640 1 -- 172.21.15.45:0/3013332515 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a2e9c0f110 con 0x55a2e9e0b650 2023-11-28T18:44:10.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.110+0000 7f10abfff640 1 -- 172.21.15.45:0/3013332515 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 51) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f10c8019020 con 0x55a2e9e0b650 2023-11-28T18:44:10.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.110+0000 7f10daa3a000 10 client.6984 fetch_fsmap finished waiting for FSMap version 51 2023-11-28T18:44:10.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.110+0000 7f10daa3a000 10 client.6984 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-28T18:44:10.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.110+0000 7f10daa3a000 20 client.6984 populate_metadata read hostname 'smithi045' 2023-11-28T18:44:10.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.110+0000 7f10daa3a000 1 --2- 172.21.15.45:0/3013332515 >> [v2:172.21.15.45:6832/1994543507,v1:172.21.15.45:6833/1994543507] conn(0x55a2e9e26fb0 0x55a2e9e27390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:10.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.110+0000 7f10daa3a000 4 client.6984 mds_command: new command op to 6789 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-28T18:44:10.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.110+0000 7f10daa3a000 1 -- 172.21.15.45:0/3013332515 --> [v2:172.21.15.45:6832/1994543507,v1:172.21.15.45:6833/1994543507] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a2e9c3d650 con 0x55a2e9e26fb0 2023-11-28T18:44:10.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.110+0000 7f10d5479640 1 --2- 172.21.15.45:0/3013332515 >> [v2:172.21.15.45:6832/1994543507,v1:172.21.15.45:6833/1994543507] conn(0x55a2e9e26fb0 0x55a2e9e27390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:10.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.110+0000 7f10d5479640 1 --2- 172.21.15.45:0/3013332515 >> [v2:172.21.15.45:6832/1994543507,v1:172.21.15.45:6833/1994543507] conn(0x55a2e9e26fb0 0x55a2e9e27390 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f7a85fbbbfacb084 server_cookie=a5763c7855219999 in_seq=0 out_seq=0 2023-11-28T18:44:10.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.110+0000 7f10abfff640 10 client.6984 ms_handle_connect on v2:172.21.15.45:6832/1994543507 2023-11-28T18:44:10.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.110+0000 7f10abfff640 1 -- 172.21.15.45:0/3013332515 <== mds.1 v2:172.21.15.45:6832/1994543507 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55a2e9c3d650 con 0x55a2e9e26fb0 2023-11-28T18:44:10.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.110+0000 7f10abfff640 10 client.6984 handle_command_reply: tid=0 2023-11-28T18:44:10.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.110+0000 7f10daa3a000 1 client.6984 shutdown 2023-11-28T18:44:10.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.110+0000 7f10daa3a000 1 -- 172.21.15.45:0/3013332515 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a2e9e0b650 msgr2=0x55a2e9e26a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:10.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.110+0000 7f10daa3a000 1 --2- 172.21.15.45:0/3013332515 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a2e9e0b650 0x55a2e9e26a70 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f10c8051520 tx=0x7f10c80014b0 comp rx=0 tx=0).stop 2023-11-28T18:44:10.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.110+0000 7f10daa3a000 1 -- 172.21.15.45:0/3013332515 shutdown_connections 2023-11-28T18:44:10.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.110+0000 7f10daa3a000 1 --2- 172.21.15.45:0/3013332515 >> [v2:172.21.15.45:6832/1994543507,v1:172.21.15.45:6833/1994543507] conn(0x55a2e9e26fb0 0x55a2e9e27390 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:10.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.110+0000 7f10daa3a000 1 --2- 172.21.15.45:0/3013332515 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a2e9e0b650 0x55a2e9e26a70 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:10.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.110+0000 7f10daa3a000 1 --2- 172.21.15.45:0/3013332515 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55a2e9e0ad30 0x55a2e9e6bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:10.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.110+0000 7f10daa3a000 1 --2- 172.21.15.45:0/3013332515 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a2e9dbe500 0x55a2e9e6b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:10.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.110+0000 7f10abfff640 0 client.6984 ms_handle_reset on v2:172.21.15.45:6832/1994543507 2023-11-28T18:44:10.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.110+0000 7f10daa3a000 1 -- 172.21.15.45:0/3013332515 >> 172.21.15.45:0/3013332515 conn(0x55a2e9deb8c0 msgr2=0x55a2e9dbcfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:44:10.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.110+0000 7f10daa3a000 1 -- 172.21.15.45:0/3013332515 shutdown_connections 2023-11-28T18:44:10.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.110+0000 7f10daa3a000 1 -- 172.21.15.45:0/3013332515 wait complete. 2023-11-28T18:44:10.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.110+0000 7f10daa3a000 20 client.6984 trim_cache size 0 max 16384 2023-11-28T18:44:10.120 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-11-28T18:44:10.121 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_fsid": "d10f5cd6-1d00-4019-99b6-6fa435498a15", 2023-11-28T18:44:10.121 INFO:teuthology.orchestra.run.smithi045.stdout: "whoami": 1, 2023-11-28T18:44:10.121 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 6789, 2023-11-28T18:44:10.121 INFO:teuthology.orchestra.run.smithi045.stdout: "want_state": "up:active", 2023-11-28T18:44:10.121 INFO:teuthology.orchestra.run.smithi045.stdout: "state": "up:active", 2023-11-28T18:44:10.121 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs", 2023-11-28T18:44:10.121 INFO:teuthology.orchestra.run.smithi045.stdout: "rank_uptime": 2.786240812, 2023-11-28T18:44:10.121 INFO:teuthology.orchestra.run.smithi045.stdout: "mdsmap_epoch": 51, 2023-11-28T18:44:10.121 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch": 60, 2023-11-28T18:44:10.122 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch_barrier": 60, 2023-11-28T18:44:10.122 INFO:teuthology.orchestra.run.smithi045.stdout: "uptime": 15.650836529999999 2023-11-28T18:44:10.122 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-11-28T18:44:10.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.110+0000 7f10d76dd640 1 -- 172.21.15.45:0/361680925 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f10b40668d0 msgr2=0x7f10b4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:10.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.110+0000 7f10d76dd640 1 --2- 172.21.15.45:0/361680925 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f10b40668d0 0x7f10b4068d90 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f10cc00b930 tx=0x7f10cc008040 comp rx=0 tx=0).stop 2023-11-28T18:44:10.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.110+0000 7f10d76dd640 1 -- 172.21.15.45:0/361680925 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10d015abb0 msgr2=0x7f10d013ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:10.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.110+0000 7f10d76dd640 1 --2- 172.21.15.45:0/361680925 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10d015abb0 0x7f10d013ddf0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f10c800c7a0 tx=0x7f10c800cc60 comp rx=0 tx=0).stop 2023-11-28T18:44:10.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.110+0000 7f10d76dd640 1 -- 172.21.15.45:0/361680925 shutdown_connections 2023-11-28T18:44:10.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.110+0000 7f10d76dd640 1 --2- 172.21.15.45:0/361680925 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f10b40668d0 0x7f10b4068d90 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:10.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.110+0000 7f10d76dd640 1 --2- 172.21.15.45:0/361680925 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10d015abb0 0x7f10d013ddf0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:10.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.110+0000 7f10d76dd640 1 --2- 172.21.15.45:0/361680925 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10d013cf70 0x7f10d014b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:10.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.110+0000 7f10d76dd640 1 --2- 172.21.15.45:0/361680925 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f10d006c840 0x7f10d0135f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:10.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.110+0000 7f10d76dd640 1 -- 172.21.15.45:0/361680925 >> 172.21.15.45:0/361680925 conn(0x7f10d006a570 msgr2=0x7f10d014dfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:44:10.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.110+0000 7f10d76dd640 1 -- 172.21.15.45:0/361680925 shutdown_connections 2023-11-28T18:44:10.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.110+0000 7f10d76dd640 1 -- 172.21.15.45:0/361680925 wait complete. 2023-11-28T18:44:10.131 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-28T18:44:10.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.274+0000 7fea841d8640 1 Processor -- start 2023-11-28T18:44:10.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.274+0000 7fea841d8640 1 -- start start 2023-11-28T18:44:10.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.274+0000 7fea841d8640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fea7c0b35f0 0x7fea7c0d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:10.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.274+0000 7fea841d8640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea7c0d38c0 con 0x7fea7c0cfed0 2023-11-28T18:44:10.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.274+0000 7fea841d8640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea7c0cdcc0 con 0x7fea7c0b3cb0 2023-11-28T18:44:10.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.274+0000 7fea841d8640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea7c0d40d0 con 0x7fea7c0b35f0 2023-11-28T18:44:10.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.274+0000 7fea82775640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fea7c0cfed0 0x7fea7c0ce480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33864/0 (socket says 172.21.15.45:33864) 2023-11-28T18:44:10.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.274+0000 7fea82775640 1 -- 172.21.15.45:0/1301341458 learned_addr learned my addr 172.21.15.45:0/1301341458 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:44:10.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.274+0000 7fea81f74640 1 --2- 172.21.15.45:0/1301341458 >> v2:172.21.15.190:3300/0 conn(0x7fea7c0b35f0 0x7fea7c0d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:10.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.274+0000 7fea80f72640 1 -- 172.21.15.45:0/1301341458 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1982594707 0 0) 0x7fea7c0d38c0 con 0x7fea7c0cfed0 2023-11-28T18:44:10.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.274+0000 7fea80f72640 1 -- 172.21.15.45:0/1301341458 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea68003530 con 0x7fea7c0cfed0 2023-11-28T18:44:10.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.274+0000 7fea81f74640 1 -- 172.21.15.45:0/1301341458 >> v1:172.21.15.190:6789/0 conn(0x7fea7c0b3cb0 legacy=0x7fea7c0cf7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:10.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.274+0000 7fea80f72640 1 -- 172.21.15.45:0/1301341458 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 211087146 0 0) 0x7fea68003530 con 0x7fea7c0cfed0 2023-11-28T18:44:10.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.274+0000 7fea81f74640 1 -- 172.21.15.45:0/1301341458 >> v1:172.21.15.45:6789/0 conn(0x7fea7c0cfed0 legacy=0x7fea7c0ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:10.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.274+0000 7fea81f74640 1 -- 172.21.15.45:0/1301341458 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea7c0d3b10 con 0x7fea7c0b35f0 2023-11-28T18:44:10.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.278+0000 7fea81f74640 1 --2- 172.21.15.45:0/1301341458 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fea7c0b35f0 0x7fea7c0d0f90 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fea780097c0 tx=0x7fea7801c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=989cbc3e51a4cda7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:44:10.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.278+0000 7fea80f72640 1 -- 172.21.15.45:0/1301341458 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea74001a00 con 0x7fea7c0b35f0 2023-11-28T18:44:10.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.278+0000 7fea80f72640 1 -- 172.21.15.45:0/1301341458 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea780a7050 con 0x7fea7c0b35f0 2023-11-28T18:44:10.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.278+0000 7fea80f72640 1 -- 172.21.15.45:0/1301341458 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea780ab620 con 0x7fea7c0b35f0 2023-11-28T18:44:10.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.278+0000 7fea841d8640 1 -- 172.21.15.45:0/1301341458 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fea7c0b35f0 msgr2=0x7fea7c0d0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:10.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.278+0000 7fea841d8640 1 --2- 172.21.15.45:0/1301341458 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fea7c0b35f0 0x7fea7c0d0f90 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fea780097c0 tx=0x7fea7801c370 comp rx=0 tx=0).stop 2023-11-28T18:44:10.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.278+0000 7fea841d8640 1 -- 172.21.15.45:0/1301341458 shutdown_connections 2023-11-28T18:44:10.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.278+0000 7fea841d8640 1 --2- 172.21.15.45:0/1301341458 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fea7c0b35f0 0x7fea7c0d0f90 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:10.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.278+0000 7fea841d8640 1 -- 172.21.15.45:0/1301341458 >> 172.21.15.45:0/1301341458 conn(0x7fea7c09c4f0 msgr2=0x7fea7c0d31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:44:10.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.278+0000 7fea841d8640 1 -- 172.21.15.45:0/1301341458 shutdown_connections 2023-11-28T18:44:10.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.278+0000 7fea841d8640 1 -- 172.21.15.45:0/1301341458 wait complete. 2023-11-28T18:44:10.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.282+0000 7fea841d8640 1 Processor -- start 2023-11-28T18:44:10.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.282+0000 7fea841d8640 1 -- start start 2023-11-28T18:44:10.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.282+0000 7fea841d8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea7c0b35f0 0x7fea7c1599a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:10.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.282+0000 7fea841d8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fea7c0b3cb0 0x7fea7c0b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:10.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.282+0000 7fea841d8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fea7c0cfed0 0x7fea7c09f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:10.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.282+0000 7fea841d8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea7c09cf60 con 0x7fea7c0b35f0 2023-11-28T18:44:10.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.282+0000 7fea841d8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea7c15a6e0 con 0x7fea7c0cfed0 2023-11-28T18:44:10.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.282+0000 7fea841d8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea7c09d1b0 con 0x7fea7c0b3cb0 2023-11-28T18:44:10.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.282+0000 7fea81f74640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea7c0b35f0 0x7fea7c1599a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:10.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.282+0000 7fea81f74640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea7c0b35f0 0x7fea7c1599a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46032/0 (socket says 172.21.15.45:46032) 2023-11-28T18:44:10.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.282+0000 7fea81f74640 1 -- 172.21.15.45:0/2254520932 learned_addr learned my addr 172.21.15.45:0/2254520932 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:44:10.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.282+0000 7fea82775640 1 --2- 172.21.15.45:0/2254520932 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fea7c0cfed0 0x7fea7c09f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:10.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.282+0000 7fea81773640 1 --2- 172.21.15.45:0/2254520932 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fea7c0b3cb0 0x7fea7c0b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:10.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.282+0000 7fea81f74640 1 -- 172.21.15.45:0/2254520932 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fea7c0b3cb0 msgr2=0x7fea7c0b89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:10.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.282+0000 7fea81f74640 1 --2- 172.21.15.45:0/2254520932 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fea7c0b3cb0 0x7fea7c0b89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:10.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.282+0000 7fea81f74640 1 -- 172.21.15.45:0/2254520932 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fea7c0cfed0 msgr2=0x7fea7c09f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:10.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.282+0000 7fea81f74640 1 --2- 172.21.15.45:0/2254520932 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fea7c0cfed0 0x7fea7c09f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:10.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.282+0000 7fea81f74640 1 -- 172.21.15.45:0/2254520932 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea78009420 con 0x7fea7c0b35f0 2023-11-28T18:44:10.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.282+0000 7fea81f74640 1 --2- 172.21.15.45:0/2254520932 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea7c0b35f0 0x7fea7c1599a0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fea780097c0 tx=0x7fea7801abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:44:10.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.282+0000 7fea727fc640 1 -- 172.21.15.45:0/2254520932 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea780abd00 con 0x7fea7c0b35f0 2023-11-28T18:44:10.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.282+0000 7fea727fc640 1 -- 172.21.15.45:0/2254520932 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea780abe60 con 0x7fea7c0b35f0 2023-11-28T18:44:10.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.282+0000 7fea727fc640 1 -- 172.21.15.45:0/2254520932 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea78004260 con 0x7fea7c0b35f0 2023-11-28T18:44:10.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.286+0000 7fea841d8640 1 -- 172.21.15.45:0/2254520932 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea7c09d490 con 0x7fea7c0b35f0 2023-11-28T18:44:10.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.286+0000 7fea841d8640 1 -- 172.21.15.45:0/2254520932 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea7c159ee0 con 0x7fea7c0b35f0 2023-11-28T18:44:10.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.286+0000 7fea727fc640 1 -- 172.21.15.45:0/2254520932 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fea780043c0 con 0x7fea7c0b35f0 2023-11-28T18:44:10.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.286+0000 7fea727fc640 1 --2- 172.21.15.45:0/2254520932 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fea600668d0 0x7fea60068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:10.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.286+0000 7fea727fc640 1 -- 172.21.15.45:0/2254520932 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fea7811e6d0 con 0x7fea7c0b35f0 2023-11-28T18:44:10.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.286+0000 7fea8753a000 1 Processor -- start 2023-11-28T18:44:10.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.286+0000 7fea81773640 1 --2- 172.21.15.45:0/2254520932 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fea600668d0 0x7fea60068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:10.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.286+0000 7fea8753a000 1 -- start start 2023-11-28T18:44:10.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.290+0000 7fea81773640 1 --2- 172.21.15.45:0/2254520932 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fea600668d0 0x7fea60068d90 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fea7c0ca000 tx=0x7fea6c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:44:10.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.290+0000 7fea8753a000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56118f678d30 0x56118f679110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:10.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.290+0000 7fea8753a000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56118f679650 0x56118f62bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:10.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.290+0000 7fea8753a000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56118f62c500 0x56118f62c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:10.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.290+0000 7fea8753a000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x56118f4f5110 con 0x56118f679650 2023-11-28T18:44:10.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.290+0000 7fea8753a000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x56118f4859a0 con 0x56118f678d30 2023-11-28T18:44:10.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.290+0000 7fea8753a000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x56118f482ed0 con 0x56118f62c500 2023-11-28T18:44:10.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.290+0000 7fea81773640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56118f679650 0x56118f62bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:10.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.290+0000 7fea81f74640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56118f678d30 0x56118f679110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:10.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.290+0000 7fea82775640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56118f62c500 0x56118f62c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:10.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.290+0000 7fea81773640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56118f679650 0x56118f62bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46038/0 (socket says 172.21.15.45:46038) 2023-11-28T18:44:10.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.290+0000 7fea81773640 1 -- 172.21.15.45:0/3188754657 learned_addr learned my addr 172.21.15.45:0/3188754657 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:44:10.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.290+0000 7fea81773640 1 -- 172.21.15.45:0/3188754657 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56118f62c500 msgr2=0x56118f62c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:44:10.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.290+0000 7fea81773640 1 --2- 172.21.15.45:0/3188754657 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56118f62c500 0x56118f62c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:10.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.290+0000 7fea81773640 1 -- 172.21.15.45:0/3188754657 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56118f678d30 msgr2=0x56118f679110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:44:10.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.290+0000 7fea81773640 1 --2- 172.21.15.45:0/3188754657 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56118f678d30 0x56118f679110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:10.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.290+0000 7fea81773640 1 -- 172.21.15.45:0/3188754657 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56118f176890 con 0x56118f679650 2023-11-28T18:44:10.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.290+0000 7fea81773640 1 --2- 172.21.15.45:0/3188754657 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56118f679650 0x56118f62bfc0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fea6c001490 tx=0x7fea6c011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77e024db59a8bd28 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:44:10.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.290+0000 7fea5f7fe640 1 -- 172.21.15.45:0/3188754657 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea6c00eee0 con 0x56118f679650 2023-11-28T18:44:10.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.290+0000 7fea5f7fe640 1 -- 172.21.15.45:0/3188754657 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea6c003600 con 0x56118f679650 2023-11-28T18:44:10.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.290+0000 7fea5f7fe640 1 -- 172.21.15.45:0/3188754657 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea6c003970 con 0x56118f679650 2023-11-28T18:44:10.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.290+0000 7fea8753a000 1 -- 172.21.15.45:0/3188754657 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56118f679650 msgr2=0x56118f62bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:10.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.290+0000 7fea8753a000 1 --2- 172.21.15.45:0/3188754657 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56118f679650 0x56118f62bfc0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fea6c001490 tx=0x7fea6c011000 comp rx=0 tx=0).stop 2023-11-28T18:44:10.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.290+0000 7fea8753a000 1 -- 172.21.15.45:0/3188754657 shutdown_connections 2023-11-28T18:44:10.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.290+0000 7fea8753a000 1 --2- 172.21.15.45:0/3188754657 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56118f62c500 0x56118f62c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:10.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.290+0000 7fea8753a000 1 --2- 172.21.15.45:0/3188754657 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56118f679650 0x56118f62bfc0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:10.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.290+0000 7fea8753a000 1 --2- 172.21.15.45:0/3188754657 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56118f678d30 0x56118f679110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:10.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.290+0000 7fea8753a000 1 -- 172.21.15.45:0/3188754657 >> 172.21.15.45:0/3188754657 conn(0x56118f6598c0 msgr2=0x56118f65bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:44:10.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.290+0000 7fea8753a000 1 -- 172.21.15.45:0/3188754657 shutdown_connections 2023-11-28T18:44:10.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.290+0000 7fea8753a000 1 -- 172.21.15.45:0/3188754657 wait complete. 2023-11-28T18:44:10.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.290+0000 7fea8753a000 1 -- start start 2023-11-28T18:44:10.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.290+0000 7fea8753a000 1 Processor -- start 2023-11-28T18:44:10.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.294+0000 7fea8753a000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56118f62c500 0x56118f6324e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:10.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.294+0000 7fea8753a000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56118f678d30 0x56118f632a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:10.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.294+0000 7fea8753a000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56118f679650 0x56118f632f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:10.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.294+0000 7fea8753a000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x56118f47e7c0 con 0x56118f679650 2023-11-28T18:44:10.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.294+0000 7fea8753a000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x56118f436bf0 con 0x56118f678d30 2023-11-28T18:44:10.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.294+0000 7fea8753a000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x56118f43ca90 con 0x56118f62c500 2023-11-28T18:44:10.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.294+0000 7fea8753a000 10 client.0 _ll_register_callbacks cb 0x56118f619e20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T18:44:10.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.294+0000 7fea82775640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56118f679650 0x56118f632f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:10.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.294+0000 7fea82775640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56118f679650 0x56118f632f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46046/0 (socket says 172.21.15.45:46046) 2023-11-28T18:44:10.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.294+0000 7fea82775640 1 -- 172.21.15.45:0/3108148532 learned_addr learned my addr 172.21.15.45:0/3108148532 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:44:10.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.294+0000 7fea81f74640 1 --2- 172.21.15.45:0/3108148532 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56118f62c500 0x56118f6324e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:10.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.294+0000 7fea81773640 1 --2- 172.21.15.45:0/3108148532 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56118f678d30 0x56118f632a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:10.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.294+0000 7fea82775640 1 -- 172.21.15.45:0/3108148532 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56118f62c500 msgr2=0x56118f6324e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:44:10.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.294+0000 7fea82775640 1 --2- 172.21.15.45:0/3108148532 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56118f62c500 0x56118f6324e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:10.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.294+0000 7fea82775640 1 -- 172.21.15.45:0/3108148532 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56118f678d30 msgr2=0x56118f632a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:44:10.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.294+0000 7fea82775640 1 --2- 172.21.15.45:0/3108148532 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56118f678d30 0x56118f632a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:10.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.294+0000 7fea82775640 1 -- 172.21.15.45:0/3108148532 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea6c00f040 con 0x56118f679650 2023-11-28T18:44:10.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.294+0000 7fea81f74640 1 --2- 172.21.15.45:0/3108148532 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56118f62c500 0x56118f6324e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:44:10.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.294+0000 7fea82775640 1 --2- 172.21.15.45:0/3108148532 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56118f679650 0x56118f632f60 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fea74011920 tx=0x7fea74011de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eaa5045e451641e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:44:10.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.294+0000 7fea5cff9640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-11-28T18:44:10.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.294+0000 7fea5cff9640 1 -- 172.21.15.45:0/3108148532 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea7400fa80 con 0x56118f679650 2023-11-28T18:44:10.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.294+0000 7fea5cff9640 1 -- 172.21.15.45:0/3108148532 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fea7400fbe0 con 0x56118f679650 2023-11-28T18:44:10.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.294+0000 7fea8753a000 1 -- 172.21.15.45:0/3108148532 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56118f440470 con 0x56118f679650 2023-11-28T18:44:10.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.294+0000 7fea5cff9640 1 -- 172.21.15.45:0/3108148532 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7fea7400fda0 con 0x56118f679650 2023-11-28T18:44:10.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.294+0000 7fea8753a000 10 client.6996 fetch_fsmap learned FSMap version 51 2023-11-28T18:44:10.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.294+0000 7fea8753a000 1 -- 172.21.15.45:0/3108148532 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=2+}) v3 -- 0x56118f43f190 con 0x56118f679650 2023-11-28T18:44:10.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.294+0000 7fea5cff9640 1 -- 172.21.15.45:0/3108148532 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56118f440470 con 0x56118f679650 2023-11-28T18:44:10.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.294+0000 7fea5cff9640 1 -- 172.21.15.45:0/3108148532 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 51) v1 ==== 3306+0+0 (secure 0 0 0) 0x7fea74015470 con 0x56118f679650 2023-11-28T18:44:10.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.294+0000 7fea8753a000 10 client.6996 fetch_fsmap finished waiting for FSMap version 51 2023-11-28T18:44:10.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.294+0000 7fea8753a000 10 client.6996 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-28T18:44:10.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.294+0000 7fea8753a000 20 client.6996 populate_metadata read hostname 'smithi045' 2023-11-28T18:44:10.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.294+0000 7fea8753a000 1 --2- 172.21.15.45:0/3108148532 >> [v2:172.21.15.45:6834/2107305848,v1:172.21.15.45:6835/2107305848] conn(0x56118f633970 0x56118f68aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:10.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.294+0000 7fea8753a000 4 client.6996 mds_command: new command op to 6792 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-28T18:44:10.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.294+0000 7fea8753a000 1 -- 172.21.15.45:0/3108148532 --> [v2:172.21.15.45:6834/2107305848,v1:172.21.15.45:6835/2107305848] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56118f443b50 con 0x56118f633970 2023-11-28T18:44:10.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.294+0000 7fea81f74640 1 --2- 172.21.15.45:0/3108148532 >> [v2:172.21.15.45:6834/2107305848,v1:172.21.15.45:6835/2107305848] conn(0x56118f633970 0x56118f68aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:10.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.294+0000 7fea81f74640 1 --2- 172.21.15.45:0/3108148532 >> [v2:172.21.15.45:6834/2107305848,v1:172.21.15.45:6835/2107305848] conn(0x56118f633970 0x56118f68aff0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c889588840048d80 server_cookie=57d167e38ab2d2f0 in_seq=0 out_seq=0 2023-11-28T18:44:10.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.294+0000 7fea5cff9640 10 client.6996 ms_handle_connect on v2:172.21.15.45:6834/2107305848 2023-11-28T18:44:10.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.298+0000 7fea5cff9640 1 -- 172.21.15.45:0/3108148532 <== mds.0 v2:172.21.15.45:6834/2107305848 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56118f443b50 con 0x56118f633970 2023-11-28T18:44:10.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.298+0000 7fea5cff9640 10 client.6996 handle_command_reply: tid=0 2023-11-28T18:44:10.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.298+0000 7fea8753a000 1 client.6996 shutdown 2023-11-28T18:44:10.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.298+0000 7fea8753a000 1 -- 172.21.15.45:0/3108148532 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56118f679650 msgr2=0x56118f632f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:10.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.298+0000 7fea8753a000 1 --2- 172.21.15.45:0/3108148532 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56118f679650 0x56118f632f60 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fea74011920 tx=0x7fea74011de0 comp rx=0 tx=0).stop 2023-11-28T18:44:10.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.298+0000 7fea8753a000 1 -- 172.21.15.45:0/3108148532 shutdown_connections 2023-11-28T18:44:10.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.298+0000 7fea8753a000 1 --2- 172.21.15.45:0/3108148532 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56118f679650 0x56118f632f60 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:10.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.298+0000 7fea8753a000 1 --2- 172.21.15.45:0/3108148532 >> [v2:172.21.15.45:6834/2107305848,v1:172.21.15.45:6835/2107305848] conn(0x56118f633970 0x56118f68aff0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:10.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.298+0000 7fea8753a000 1 --2- 172.21.15.45:0/3108148532 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56118f678d30 0x56118f632a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:10.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.298+0000 7fea8753a000 1 --2- 172.21.15.45:0/3108148532 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56118f62c500 0x56118f6324e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:10.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.298+0000 7fea5cff9640 0 client.6996 ms_handle_reset on v2:172.21.15.45:6834/2107305848 2023-11-28T18:44:10.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.298+0000 7fea8753a000 1 -- 172.21.15.45:0/3108148532 >> 172.21.15.45:0/3108148532 conn(0x56118f6598c0 msgr2=0x56118f62b6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:44:10.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.298+0000 7fea8753a000 1 -- 172.21.15.45:0/3108148532 shutdown_connections 2023-11-28T18:44:10.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.298+0000 7fea8753a000 1 -- 172.21.15.45:0/3108148532 wait complete. 2023-11-28T18:44:10.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.298+0000 7fea8753a000 20 client.6996 trim_cache size 0 max 16384 2023-11-28T18:44:10.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.314+0000 7fea8753a000 1 Processor -- start 2023-11-28T18:44:10.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.314+0000 7fea8753a000 1 -- start start 2023-11-28T18:44:10.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.314+0000 7fea8753a000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56118f62c500 0x56118f6583a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:10.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.314+0000 7fea8753a000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56118f678d30 0x56118f6588e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:10.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.314+0000 7fea8753a000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56118f679650 0x56118f68aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:10.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.314+0000 7fea8753a000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x56118f137940 con 0x56118f678d30 2023-11-28T18:44:10.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.314+0000 7fea8753a000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x56118f478ac0 con 0x56118f679650 2023-11-28T18:44:10.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.314+0000 7fea8753a000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x56118f433760 con 0x56118f62c500 2023-11-28T18:44:10.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.314+0000 7fea81773640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56118f678d30 0x56118f6588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:10.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.314+0000 7fea81773640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56118f678d30 0x56118f6588e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46052/0 (socket says 172.21.15.45:46052) 2023-11-28T18:44:10.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.314+0000 7fea81773640 1 -- 172.21.15.45:0/1947847052 learned_addr learned my addr 172.21.15.45:0/1947847052 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:44:10.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.314+0000 7fea81f74640 1 --2- 172.21.15.45:0/1947847052 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56118f62c500 0x56118f6583a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:10.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.314+0000 7fea82775640 1 --2- 172.21.15.45:0/1947847052 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56118f679650 0x56118f68aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:10.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.314+0000 7fea81773640 1 -- 172.21.15.45:0/1947847052 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56118f62c500 msgr2=0x56118f6583a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:44:10.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.314+0000 7fea81773640 1 --2- 172.21.15.45:0/1947847052 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56118f62c500 0x56118f6583a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:10.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.314+0000 7fea81773640 1 -- 172.21.15.45:0/1947847052 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56118f679650 msgr2=0x56118f68aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:44:10.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.314+0000 7fea81773640 1 --2- 172.21.15.45:0/1947847052 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56118f679650 0x56118f68aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:10.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.314+0000 7fea81773640 1 -- 172.21.15.45:0/1947847052 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56118f62c370 con 0x56118f678d30 2023-11-28T18:44:10.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.314+0000 7fea82775640 1 --2- 172.21.15.45:0/1947847052 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56118f679650 0x56118f68aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:44:10.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.314+0000 7fea81773640 1 --2- 172.21.15.45:0/1947847052 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56118f678d30 0x56118f6588e0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fea6c014000 tx=0x7fea6c005000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea96c0a1742a15f3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:44:10.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.314+0000 7fea5ffff640 1 -- 172.21.15.45:0/1947847052 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea6c028070 con 0x56118f678d30 2023-11-28T18:44:10.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.314+0000 7fea5ffff640 1 -- 172.21.15.45:0/1947847052 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea6c019070 con 0x56118f678d30 2023-11-28T18:44:10.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.314+0000 7fea5ffff640 1 -- 172.21.15.45:0/1947847052 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea6c0038c0 con 0x56118f678d30 2023-11-28T18:44:10.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.318+0000 7fea8753a000 1 -- 172.21.15.45:0/1947847052 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56118f678d30 msgr2=0x56118f6588e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:10.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.318+0000 7fea8753a000 1 --2- 172.21.15.45:0/1947847052 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56118f678d30 0x56118f6588e0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fea6c014000 tx=0x7fea6c005000 comp rx=0 tx=0).stop 2023-11-28T18:44:10.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.318+0000 7fea8753a000 1 -- 172.21.15.45:0/1947847052 shutdown_connections 2023-11-28T18:44:10.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.318+0000 7fea8753a000 1 --2- 172.21.15.45:0/1947847052 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56118f679650 0x56118f68aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:10.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.318+0000 7fea8753a000 1 --2- 172.21.15.45:0/1947847052 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56118f678d30 0x56118f6588e0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:10.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.318+0000 7fea8753a000 1 --2- 172.21.15.45:0/1947847052 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56118f62c500 0x56118f6583a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:10.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.318+0000 7fea8753a000 1 -- 172.21.15.45:0/1947847052 >> 172.21.15.45:0/1947847052 conn(0x56118f6598c0 msgr2=0x56118f62a720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:44:10.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.318+0000 7fea8753a000 1 -- 172.21.15.45:0/1947847052 shutdown_connections 2023-11-28T18:44:10.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.318+0000 7fea8753a000 1 -- 172.21.15.45:0/1947847052 wait complete. 2023-11-28T18:44:10.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.318+0000 7fea8753a000 1 -- start start 2023-11-28T18:44:10.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.318+0000 7fea8753a000 1 Processor -- start 2023-11-28T18:44:10.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.318+0000 7fea8753a000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56118f62c500 0x56118f6d9810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:10.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.318+0000 7fea8753a000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56118f678d30 0x56118f6d9d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:10.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.318+0000 7fea8753a000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56118f679650 0x56118f694a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:10.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.318+0000 7fea8753a000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x56118f62fdd0 con 0x56118f62c500 2023-11-28T18:44:10.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.318+0000 7fea8753a000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x56118f633f80 con 0x56118f678d30 2023-11-28T18:44:10.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.318+0000 7fea8753a000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x56118f435a10 con 0x56118f679650 2023-11-28T18:44:10.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.318+0000 7fea8753a000 10 client.0 _ll_register_callbacks cb 0x56118f4f5060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T18:44:10.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.318+0000 7fea81f74640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56118f62c500 0x56118f6d9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:10.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.318+0000 7fea81f74640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56118f62c500 0x56118f6d9810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46056/0 (socket says 172.21.15.45:46056) 2023-11-28T18:44:10.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.318+0000 7fea81f74640 1 -- 172.21.15.45:0/3869540045 learned_addr learned my addr 172.21.15.45:0/3869540045 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:44:10.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.318+0000 7fea82775640 1 --2- 172.21.15.45:0/3869540045 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56118f679650 0x56118f694a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:10.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.318+0000 7fea81773640 1 --2- 172.21.15.45:0/3869540045 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56118f678d30 0x56118f6d9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:10.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.318+0000 7fea81f74640 1 -- 172.21.15.45:0/3869540045 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56118f679650 msgr2=0x56118f694a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:44:10.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.318+0000 7fea81f74640 1 --2- 172.21.15.45:0/3869540045 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56118f679650 0x56118f694a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:10.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.318+0000 7fea81f74640 1 -- 172.21.15.45:0/3869540045 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56118f678d30 msgr2=0x56118f6d9d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:44:10.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.318+0000 7fea81f74640 1 --2- 172.21.15.45:0/3869540045 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56118f678d30 0x56118f6d9d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:10.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.318+0000 7fea81f74640 1 -- 172.21.15.45:0/3869540045 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56118f176890 con 0x56118f62c500 2023-11-28T18:44:10.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.318+0000 7fea82775640 1 --2- 172.21.15.45:0/3869540045 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56118f679650 0x56118f694a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:44:10.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.318+0000 7fea81773640 1 --2- 172.21.15.45:0/3869540045 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56118f678d30 0x56118f6d9d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:44:10.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.318+0000 7fea81f74640 1 --2- 172.21.15.45:0/3869540045 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56118f62c500 0x56118f6d9810 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fea780ebbe0 tx=0x7fea780ef7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bec08b83ab201a9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:44:10.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.318+0000 7fea5cff9640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-11-28T18:44:10.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.318+0000 7fea5cff9640 1 -- 172.21.15.45:0/3869540045 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea780f79e0 con 0x56118f62c500 2023-11-28T18:44:10.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.318+0000 7fea5cff9640 1 -- 172.21.15.45:0/3869540045 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fea780ef940 con 0x56118f62c500 2023-11-28T18:44:10.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.318+0000 7fea8753a000 1 -- 172.21.15.45:0/3869540045 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56118f47d110 con 0x56118f62c500 2023-11-28T18:44:10.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.318+0000 7fea5cff9640 1 -- 172.21.15.45:0/3869540045 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7fea780efb00 con 0x56118f62c500 2023-11-28T18:44:10.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.318+0000 7fea8753a000 10 client.7002 fetch_fsmap learned FSMap version 51 2023-11-28T18:44:10.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.318+0000 7fea8753a000 1 -- 172.21.15.45:0/3869540045 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=2+}) v3 -- 0x56118f425490 con 0x56118f62c500 2023-11-28T18:44:10.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.318+0000 7fea5cff9640 1 -- 172.21.15.45:0/3869540045 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56118f47d110 con 0x56118f62c500 2023-11-28T18:44:10.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.318+0000 7fea5cff9640 1 -- 172.21.15.45:0/3869540045 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 51) v1 ==== 3306+0+0 (secure 0 0 0) 0x7fea780eebd0 con 0x56118f62c500 2023-11-28T18:44:10.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.318+0000 7fea8753a000 10 client.7002 fetch_fsmap finished waiting for FSMap version 51 2023-11-28T18:44:10.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.318+0000 7fea8753a000 10 client.7002 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-28T18:44:10.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.318+0000 7fea8753a000 20 client.7002 populate_metadata read hostname 'smithi045' 2023-11-28T18:44:10.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.318+0000 7fea8753a000 1 --2- 172.21.15.45:0/3869540045 >> [v2:172.21.15.45:6834/2107305848,v1:172.21.15.45:6835/2107305848] conn(0x56118f6e0670 0x56118f6e2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:10.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.318+0000 7fea8753a000 4 client.7002 mds_command: new command op to 6792 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-28T18:44:10.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.318+0000 7fea8753a000 1 -- 172.21.15.45:0/3869540045 --> [v2:172.21.15.45:6834/2107305848,v1:172.21.15.45:6835/2107305848] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56118f4ab650 con 0x56118f6e0670 2023-11-28T18:44:10.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.322+0000 7fea81773640 1 --2- 172.21.15.45:0/3869540045 >> [v2:172.21.15.45:6834/2107305848,v1:172.21.15.45:6835/2107305848] conn(0x56118f6e0670 0x56118f6e2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:10.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.322+0000 7fea5cff9640 10 client.7002 ms_handle_connect on v2:172.21.15.45:6834/2107305848 2023-11-28T18:44:10.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.322+0000 7fea81773640 1 --2- 172.21.15.45:0/3869540045 >> [v2:172.21.15.45:6834/2107305848,v1:172.21.15.45:6835/2107305848] conn(0x56118f6e0670 0x56118f6e2a60 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=abdc3257db6c52ea server_cookie=b9b8d56944a578b1 in_seq=0 out_seq=0 2023-11-28T18:44:10.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.322+0000 7fea5cff9640 1 -- 172.21.15.45:0/3869540045 <== mds.0 v2:172.21.15.45:6834/2107305848 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+319 (crc 0 0 0) 0x56118f4ab650 con 0x56118f6e0670 2023-11-28T18:44:10.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.322+0000 7fea5cff9640 10 client.7002 handle_command_reply: tid=0 2023-11-28T18:44:10.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.322+0000 7fea8753a000 1 client.7002 shutdown 2023-11-28T18:44:10.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.322+0000 7fea8753a000 1 -- 172.21.15.45:0/3869540045 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56118f62c500 msgr2=0x56118f6d9810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:10.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.322+0000 7fea8753a000 1 --2- 172.21.15.45:0/3869540045 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56118f62c500 0x56118f6d9810 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fea780ebbe0 tx=0x7fea780ef7a0 comp rx=0 tx=0).stop 2023-11-28T18:44:10.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.322+0000 7fea8753a000 1 -- 172.21.15.45:0/3869540045 shutdown_connections 2023-11-28T18:44:10.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.322+0000 7fea8753a000 1 --2- 172.21.15.45:0/3869540045 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56118f679650 0x56118f694a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:10.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.322+0000 7fea8753a000 1 --2- 172.21.15.45:0/3869540045 >> [v2:172.21.15.45:6834/2107305848,v1:172.21.15.45:6835/2107305848] conn(0x56118f6e0670 0x56118f6e2a60 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:10.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.322+0000 7fea8753a000 1 --2- 172.21.15.45:0/3869540045 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56118f678d30 0x56118f6d9d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:10.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.322+0000 7fea8753a000 1 --2- 172.21.15.45:0/3869540045 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56118f62c500 0x56118f6d9810 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:10.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.322+0000 7fea8753a000 1 -- 172.21.15.45:0/3869540045 >> 172.21.15.45:0/3869540045 conn(0x56118f6598c0 msgr2=0x56118f62afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:44:10.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.322+0000 7fea5cff9640 0 client.7002 ms_handle_reset on v2:172.21.15.45:6834/2107305848 2023-11-28T18:44:10.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.322+0000 7fea8753a000 1 -- 172.21.15.45:0/3869540045 shutdown_connections 2023-11-28T18:44:10.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.322+0000 7fea8753a000 1 -- 172.21.15.45:0/3869540045 wait complete. 2023-11-28T18:44:10.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.322+0000 7fea8753a000 20 client.7002 trim_cache size 0 max 16384 2023-11-28T18:44:10.336 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-11-28T18:44:10.336 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_fsid": "d10f5cd6-1d00-4019-99b6-6fa435498a15", 2023-11-28T18:44:10.336 INFO:teuthology.orchestra.run.smithi045.stdout: "whoami": 0, 2023-11-28T18:44:10.336 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 6792, 2023-11-28T18:44:10.336 INFO:teuthology.orchestra.run.smithi045.stdout: "want_state": "up:active", 2023-11-28T18:44:10.337 INFO:teuthology.orchestra.run.smithi045.stdout: "state": "up:active", 2023-11-28T18:44:10.337 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs", 2023-11-28T18:44:10.337 INFO:teuthology.orchestra.run.smithi045.stdout: "rank_uptime": 11.066195423, 2023-11-28T18:44:10.337 INFO:teuthology.orchestra.run.smithi045.stdout: "mdsmap_epoch": 51, 2023-11-28T18:44:10.337 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch": 60, 2023-11-28T18:44:10.337 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch_barrier": 60, 2023-11-28T18:44:10.337 INFO:teuthology.orchestra.run.smithi045.stdout: "uptime": 15.857325947 2023-11-28T18:44:10.337 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-11-28T18:44:10.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.322+0000 7fea841d8640 1 -- 172.21.15.45:0/2254520932 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fea600668d0 msgr2=0x7fea60068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:10.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.322+0000 7fea841d8640 1 --2- 172.21.15.45:0/2254520932 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fea600668d0 0x7fea60068d90 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fea7c0ca000 tx=0x7fea6c009040 comp rx=0 tx=0).stop 2023-11-28T18:44:10.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.322+0000 7fea841d8640 1 -- 172.21.15.45:0/2254520932 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea7c0b35f0 msgr2=0x7fea7c1599a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:10.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.322+0000 7fea841d8640 1 --2- 172.21.15.45:0/2254520932 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea7c0b35f0 0x7fea7c1599a0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fea780097c0 tx=0x7fea7801abb0 comp rx=0 tx=0).stop 2023-11-28T18:44:10.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.322+0000 7fea841d8640 1 -- 172.21.15.45:0/2254520932 shutdown_connections 2023-11-28T18:44:10.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.322+0000 7fea841d8640 1 --2- 172.21.15.45:0/2254520932 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fea600668d0 0x7fea60068d90 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:10.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.322+0000 7fea841d8640 1 --2- 172.21.15.45:0/2254520932 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fea7c0cfed0 0x7fea7c09f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:10.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.322+0000 7fea841d8640 1 --2- 172.21.15.45:0/2254520932 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fea7c0b3cb0 0x7fea7c0b89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:10.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.322+0000 7fea841d8640 1 --2- 172.21.15.45:0/2254520932 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea7c0b35f0 0x7fea7c1599a0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:10.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.322+0000 7fea841d8640 1 -- 172.21.15.45:0/2254520932 >> 172.21.15.45:0/2254520932 conn(0x7fea7c09c4f0 msgr2=0x7fea7c0b0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:44:10.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.322+0000 7fea841d8640 1 -- 172.21.15.45:0/2254520932 shutdown_connections 2023-11-28T18:44:10.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.322+0000 7fea841d8640 1 -- 172.21.15.45:0/2254520932 wait complete. 2023-11-28T18:44:10.342 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable false 2023-11-28T18:44:10.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.486+0000 7f8a03609640 1 Processor -- start 2023-11-28T18:44:10.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.490+0000 7f8a03609640 1 -- start start 2023-11-28T18:44:10.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.490+0000 7f8a03609640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f89fc158ce0 0x7f89fc15eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:10.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.490+0000 7f8a03609640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f89fc0b4310 0x7f89fc0b4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:10.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.490+0000 7f8a03609640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89fc0b4ca0 con 0x7f89fc0cba50 2023-11-28T18:44:10.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.490+0000 7f8a03609640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89fc15b6b0 con 0x7f89fc158ce0 2023-11-28T18:44:10.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.490+0000 7f8a03609640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89fc15c550 con 0x7f89fc0b4310 2023-11-28T18:44:10.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.490+0000 7f8a00ba4640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f89fc0cba50 0x7f89fc15be40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33878/0 (socket says 172.21.15.45:33878) 2023-11-28T18:44:10.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.490+0000 7f8a00ba4640 1 -- 172.21.15.45:0/4103870412 learned_addr learned my addr 172.21.15.45:0/4103870412 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:44:10.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.490+0000 7f8a01ba6640 1 --2- 172.21.15.45:0/4103870412 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f89fc0b4310 0x7f89fc0b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:10.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.490+0000 7f8a013a5640 1 --2- 172.21.15.45:0/4103870412 >> v2:172.21.15.190:3300/0 conn(0x7f89fc158ce0 0x7f89fc15eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:10.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.490+0000 7f89f3fff640 1 -- 172.21.15.45:0/4103870412 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2013569020 0 0) 0x7f89ec001120 con 0x7f89fc0cba50 2023-11-28T18:44:10.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.490+0000 7f89f3fff640 1 -- 172.21.15.45:0/4103870412 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89e8003530 con 0x7f89fc0cba50 2023-11-28T18:44:10.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.490+0000 7f8a01ba6640 1 -- 172.21.15.45:0/4103870412 >> v2:172.21.15.190:3300/0 conn(0x7f89fc158ce0 msgr2=0x7f89fc15eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:44:10.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.490+0000 7f8a01ba6640 1 --2- 172.21.15.45:0/4103870412 >> v2:172.21.15.190:3300/0 conn(0x7f89fc158ce0 0x7f89fc15eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:10.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.490+0000 7f8a01ba6640 1 -- 172.21.15.45:0/4103870412 >> v1:172.21.15.45:6789/0 conn(0x7f89fc0cba50 legacy=0x7f89fc15be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:10.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.490+0000 7f89f3fff640 1 -- 172.21.15.45:0/4103870412 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 273055837 0 0) 0x7f89e8003530 con 0x7f89fc0cba50 2023-11-28T18:44:10.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.490+0000 7f8a01ba6640 1 -- 172.21.15.45:0/4103870412 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89fc15f450 con 0x7f89fc0b4310 2023-11-28T18:44:10.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.494+0000 7f8a01ba6640 1 --2- 172.21.15.45:0/4103870412 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f89fc0b4310 0x7f89fc0b4760 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f89f4009d90 tx=0x7f89f401c840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1441823760c9c51 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:44:10.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.494+0000 7f89f3fff640 1 -- 172.21.15.45:0/4103870412 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89ec001810 con 0x7f89fc0b4310 2023-11-28T18:44:10.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.494+0000 7f89f3fff640 1 -- 172.21.15.45:0/4103870412 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89f40a5640 con 0x7f89fc0b4310 2023-11-28T18:44:10.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.494+0000 7f89f3fff640 1 -- 172.21.15.45:0/4103870412 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f40a59b0 con 0x7f89fc0b4310 2023-11-28T18:44:10.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.494+0000 7f8a03609640 1 -- 172.21.15.45:0/4103870412 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f89fc0b4310 msgr2=0x7f89fc0b4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:10.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.494+0000 7f8a03609640 1 --2- 172.21.15.45:0/4103870412 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f89fc0b4310 0x7f89fc0b4760 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f89f4009d90 tx=0x7f89f401c840 comp rx=0 tx=0).stop 2023-11-28T18:44:10.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.494+0000 7f8a03609640 1 -- 172.21.15.45:0/4103870412 shutdown_connections 2023-11-28T18:44:10.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.494+0000 7f8a03609640 1 --2- 172.21.15.45:0/4103870412 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f89fc0b4310 0x7f89fc0b4760 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:10.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.494+0000 7f8a03609640 1 --2- 172.21.15.45:0/4103870412 >> v2:172.21.15.190:3300/0 conn(0x7f89fc158ce0 0x7f89fc15eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:10.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.494+0000 7f8a03609640 1 -- 172.21.15.45:0/4103870412 >> 172.21.15.45:0/4103870412 conn(0x7f89fc0b0d00 msgr2=0x7f89fc0b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:44:10.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.494+0000 7f8a03609640 1 -- 172.21.15.45:0/4103870412 shutdown_connections 2023-11-28T18:44:10.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.494+0000 7f8a03609640 1 -- 172.21.15.45:0/4103870412 wait complete. 2023-11-28T18:44:10.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.498+0000 7f8a03609640 1 Processor -- start 2023-11-28T18:44:10.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.498+0000 7f8a03609640 1 -- start start 2023-11-28T18:44:10.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.498+0000 7f8a03609640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f89fc0b4310 0x7f89fc0b3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:10.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.498+0000 7f8a03609640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f89fc0cba50 0x7f89fc152320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:10.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.498+0000 7f8a03609640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89fc158ce0 0x7f89fc1505f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:10.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.498+0000 7f8a03609640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89fc152d30 con 0x7f89fc158ce0 2023-11-28T18:44:10.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.498+0000 7f8a03609640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89fc152860 con 0x7f89fc0cba50 2023-11-28T18:44:10.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.498+0000 7f8a03609640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89fc152a50 con 0x7f89fc0b4310 2023-11-28T18:44:10.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.498+0000 7f8a01ba6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89fc158ce0 0x7f89fc1505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:10.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.498+0000 7f8a01ba6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89fc158ce0 0x7f89fc1505f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46070/0 (socket says 172.21.15.45:46070) 2023-11-28T18:44:10.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.498+0000 7f8a01ba6640 1 -- 172.21.15.45:0/2078145189 learned_addr learned my addr 172.21.15.45:0/2078145189 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:44:10.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.498+0000 7f8a013a5640 1 --2- 172.21.15.45:0/2078145189 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f89fc0b4310 0x7f89fc0b3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:10.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.498+0000 7f8a00ba4640 1 --2- 172.21.15.45:0/2078145189 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f89fc0cba50 0x7f89fc152320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:10.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.498+0000 7f8a01ba6640 1 -- 172.21.15.45:0/2078145189 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f89fc0b4310 msgr2=0x7f89fc0b3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:10.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.498+0000 7f8a01ba6640 1 --2- 172.21.15.45:0/2078145189 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f89fc0b4310 0x7f89fc0b3d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:10.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.498+0000 7f8a01ba6640 1 -- 172.21.15.45:0/2078145189 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f89fc0cba50 msgr2=0x7f89fc152320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:10.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.498+0000 7f8a01ba6640 1 --2- 172.21.15.45:0/2078145189 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f89fc0cba50 0x7f89fc152320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:10.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.498+0000 7f8a01ba6640 1 -- 172.21.15.45:0/2078145189 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f4009a70 con 0x7f89fc158ce0 2023-11-28T18:44:10.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.498+0000 7f8a00ba4640 1 --2- 172.21.15.45:0/2078145189 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f89fc0cba50 0x7f89fc152320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:44:10.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.498+0000 7f8a01ba6640 1 --2- 172.21.15.45:0/2078145189 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89fc158ce0 0x7f89fc1505f0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f89f401d0e0 tx=0x7f89f40195e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:44:10.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.498+0000 7f89f1ffb640 1 -- 172.21.15.45:0/2078145189 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f40bc070 con 0x7f89fc158ce0 2023-11-28T18:44:10.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.498+0000 7f89f1ffb640 1 -- 172.21.15.45:0/2078145189 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89f40a59c0 con 0x7f89fc158ce0 2023-11-28T18:44:10.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.498+0000 7f8a03609640 1 -- 172.21.15.45:0/2078145189 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89fc1536a0 con 0x7f89fc158ce0 2023-11-28T18:44:10.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.498+0000 7f89f1ffb640 1 -- 172.21.15.45:0/2078145189 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f40a5d50 con 0x7f89fc158ce0 2023-11-28T18:44:10.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.498+0000 7f8a03609640 1 -- 172.21.15.45:0/2078145189 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89fc153c60 con 0x7f89fc158ce0 2023-11-28T18:44:10.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.498+0000 7f8a03609640 1 -- 172.21.15.45:0/2078145189 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89fc153500 con 0x7f89fc158ce0 2023-11-28T18:44:10.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.502+0000 7f89f1ffb640 1 -- 172.21.15.45:0/2078145189 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f89f40b4070 con 0x7f89fc158ce0 2023-11-28T18:44:10.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.502+0000 7f89f1ffb640 1 --2- 172.21.15.45:0/2078145189 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f89e00668d0 0x7f89e0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:44:10.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.502+0000 7f89f1ffb640 1 -- 172.21.15.45:0/2078145189 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f89f411e800 con 0x7f89fc158ce0 2023-11-28T18:44:10.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.502+0000 7f8a013a5640 1 --2- 172.21.15.45:0/2078145189 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f89e00668d0 0x7f89e0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:44:10.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.502+0000 7f8a013a5640 1 --2- 172.21.15.45:0/2078145189 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f89e00668d0 0x7f89e0068d90 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f89f8009af0 tx=0x7f89f8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:44:10.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.506+0000 7f89f1ffb640 1 -- 172.21.15.45:0/2078145189 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f89fc153500 con 0x7f89fc158ce0 2023-11-28T18:44:10.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:10.698+0000 7f8a03609640 1 -- 172.21.15.45:0/2078145189 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "false"} v 0) v1 -- 0x7f89fc153500 con 0x7f89fc158ce0 2023-11-28T18:44:11.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:11.342+0000 7f89f1ffb640 1 -- 172.21.15.45:0/2078145189 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "false"}]=0 cephfs marked not joinable; MDS cannot join as newly active. v52) v1 ==== 170+0+0 (secure 0 0 0) 0x7f89fc153500 con 0x7f89fc158ce0 2023-11-28T18:44:11.342 INFO:teuthology.orchestra.run.smithi045.stderr:cephfs marked not joinable; MDS cannot join as newly active. 2023-11-28T18:44:11.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:11.342+0000 7f8a03609640 1 -- 172.21.15.45:0/2078145189 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f89e00668d0 msgr2=0x7f89e0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:11.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:11.342+0000 7f8a03609640 1 --2- 172.21.15.45:0/2078145189 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f89e00668d0 0x7f89e0068d90 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f89f8009af0 tx=0x7f89f8008040 comp rx=0 tx=0).stop 2023-11-28T18:44:11.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:11.342+0000 7f8a03609640 1 -- 172.21.15.45:0/2078145189 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89fc158ce0 msgr2=0x7f89fc1505f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:44:11.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:11.342+0000 7f8a03609640 1 --2- 172.21.15.45:0/2078145189 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89fc158ce0 0x7f89fc1505f0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f89f401d0e0 tx=0x7f89f40195e0 comp rx=0 tx=0).stop 2023-11-28T18:44:11.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:11.342+0000 7f8a03609640 1 -- 172.21.15.45:0/2078145189 shutdown_connections 2023-11-28T18:44:11.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:11.342+0000 7f8a03609640 1 --2- 172.21.15.45:0/2078145189 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f89e00668d0 0x7f89e0068d90 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:11.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:11.342+0000 7f8a03609640 1 --2- 172.21.15.45:0/2078145189 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89fc158ce0 0x7f89fc1505f0 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:11.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:11.342+0000 7f8a03609640 1 --2- 172.21.15.45:0/2078145189 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f89fc0cba50 0x7f89fc152320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:11.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:11.342+0000 7f8a03609640 1 --2- 172.21.15.45:0/2078145189 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f89fc0b4310 0x7f89fc0b3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:44:11.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:11.342+0000 7f8a03609640 1 -- 172.21.15.45:0/2078145189 >> 172.21.15.45:0/2078145189 conn(0x7f89fc0b0d00 msgr2=0x7f89fc165330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:44:11.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:11.346+0000 7f8a03609640 1 -- 172.21.15.45:0/2078145189 shutdown_connections 2023-11-28T18:44:11.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:11.346+0000 7f8a03609640 1 -- 172.21.15.45:0/2078145189 wait complete. 2023-11-28T18:44:11.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:44:11.368 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'mkdir {alpha,bravo} && touch {alpha,bravo}/file') 2023-11-28T18:44:11.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:44:11.403 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 0 alpha/) 2023-11-28T18:44:11.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:44:11.477 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 1 bravo/) 2023-11-28T18:44:11.534 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2023-11-28T18:44:11.740 INFO:teuthology.orchestra.run.smithi045.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"13","version":"9","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":2,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":1},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-11-28T18:44:11.741 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 2, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 1, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "13", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "9" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-11-28T18:44:11.741 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/alpha', 0), ('/bravo', 1)] 2023-11-28T18:44:13.742 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2023-11-28T18:44:13.916 INFO:teuthology.orchestra.run.smithi045.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"13","version":"9","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":2,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":1},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-11-28T18:44:13.916 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 2, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 1, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "13", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "9" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-11-28T18:44:13.916 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/alpha', 0), ('/bravo', 1)] 2023-11-28T18:44:15.917 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2023-11-28T18:44:16.091 INFO:teuthology.orchestra.run.smithi045.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"13","version":"13","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-11-28T18:44:16.091 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "13", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-11-28T18:44:16.092 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/alpha', 0), ('/bravo', 1)] 2023-11-28T18:44:18.093 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2023-11-28T18:44:18.266 INFO:teuthology.orchestra.run.smithi045.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"17","version":"13","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":2,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":1},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-11-28T18:44:18.266 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 2, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 1, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "17", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-11-28T18:44:18.267 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/alpha', 0), ('/bravo', 1)] 2023-11-28T18:44:20.268 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2023-11-28T18:44:20.443 INFO:teuthology.orchestra.run.smithi045.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"18","version":"18","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":0,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":0,"dir":{"path":"/alpha","dirfrag":"0x10000000000","snapid_first":2,"projected_version":"5","version":"5","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":1,"authpin":0},"nref":3}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/bravo","dirfrag":"0x10000000001","snapid_first":2,"projected_version":"5","version":"5","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":0,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":1}}] 2023-11-28T18:44:20.444 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "18", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "18" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x10000000000", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 3, "path": "/alpha", "pins": { "authpin": 0, "child": 1, "dirty": 1, "subtree": 1 }, "projected_version": "5", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "5" }, "distributed_ephemeral_pin": false, "export_pin": 0, "export_pin_target": 0, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000001", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 1, "path": "/bravo", "pins": { "authpin": 0, "child": 0, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "5", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "5" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": false } ] 2023-11-28T18:44:20.444 INFO:tasks.cephfs.cephfs_test_case:[('/alpha', 0), ('/bravo', 1)] =?= [('/alpha', 0), ('/bravo', 1)] 2023-11-28T18:44:20.445 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T18:44:20.445 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T18:44:20.457 DEBUG:teuthology.orchestra.run.smithi045:> stdin-killer -- python3 -c ' 2023-11-28T18:44:20.457 DEBUG:teuthology.orchestra.run.smithi045:> import os 2023-11-28T18:44:20.457 DEBUG:teuthology.orchestra.run.smithi045:> import uuid 2023-11-28T18:44:20.457 DEBUG:teuthology.orchestra.run.smithi045:> 2023-11-28T18:44:20.457 DEBUG:teuthology.orchestra.run.smithi045:> n = 1000 2023-11-28T18:44:20.457 DEBUG:teuthology.orchestra.run.smithi045:> create_hard_links = False 2023-11-28T18:44:20.458 DEBUG:teuthology.orchestra.run.smithi045:> if 0 > 0: 2023-11-28T18:44:20.458 DEBUG:teuthology.orchestra.run.smithi045:> create_hard_links = True 2023-11-28T18:44:20.458 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/alpha/file" 2023-11-28T18:44:20.458 DEBUG:teuthology.orchestra.run.smithi045:> 2023-11-28T18:44:20.458 DEBUG:teuthology.orchestra.run.smithi045:> dpath = os.path.dirname(path) 2023-11-28T18:44:20.458 DEBUG:teuthology.orchestra.run.smithi045:> fnameprefix = os.path.basename(path) 2023-11-28T18:44:20.458 DEBUG:teuthology.orchestra.run.smithi045:> os.makedirs(dpath, exist_ok=True) 2023-11-28T18:44:20.459 DEBUG:teuthology.orchestra.run.smithi045:> 2023-11-28T18:44:20.459 DEBUG:teuthology.orchestra.run.smithi045:> try: 2023-11-28T18:44:20.459 DEBUG:teuthology.orchestra.run.smithi045:> dirfd = os.open(dpath, os.O_DIRECTORY) 2023-11-28T18:44:20.459 DEBUG:teuthology.orchestra.run.smithi045:> 2023-11-28T18:44:20.459 DEBUG:teuthology.orchestra.run.smithi045:> for i in range(n): 2023-11-28T18:44:20.459 DEBUG:teuthology.orchestra.run.smithi045:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2023-11-28T18:44:20.459 DEBUG:teuthology.orchestra.run.smithi045:> with open(fpath, '"'"'w'"'"') as f: 2023-11-28T18:44:20.459 DEBUG:teuthology.orchestra.run.smithi045:> f.write(f"{i}") 2023-11-28T18:44:20.460 DEBUG:teuthology.orchestra.run.smithi045:> if False: 2023-11-28T18:44:20.460 DEBUG:teuthology.orchestra.run.smithi045:> f.flush() 2023-11-28T18:44:20.460 DEBUG:teuthology.orchestra.run.smithi045:> os.fsync(f.fileno()) 2023-11-28T18:44:20.460 DEBUG:teuthology.orchestra.run.smithi045:> if False: 2023-11-28T18:44:20.460 DEBUG:teuthology.orchestra.run.smithi045:> os.unlink(fpath) 2023-11-28T18:44:20.460 DEBUG:teuthology.orchestra.run.smithi045:> if False: 2023-11-28T18:44:20.461 DEBUG:teuthology.orchestra.run.smithi045:> os.fsync(dirfd) 2023-11-28T18:44:20.461 DEBUG:teuthology.orchestra.run.smithi045:> if create_hard_links: 2023-11-28T18:44:20.461 DEBUG:teuthology.orchestra.run.smithi045:> for j in range(0): 2023-11-28T18:44:20.461 DEBUG:teuthology.orchestra.run.smithi045:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2023-11-28T18:44:20.461 DEBUG:teuthology.orchestra.run.smithi045:> if False: 2023-11-28T18:44:20.462 DEBUG:teuthology.orchestra.run.smithi045:> os.fsync(dirfd) 2023-11-28T18:44:20.462 DEBUG:teuthology.orchestra.run.smithi045:> finally: 2023-11-28T18:44:20.462 DEBUG:teuthology.orchestra.run.smithi045:> os.close(dirfd) 2023-11-28T18:44:20.462 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-11-28T18:44:24.399 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:44:24.403 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:44:26.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:44:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-28T18:44:26.340 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T18:44:26.340 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T18:44:26.352 DEBUG:teuthology.orchestra.run.smithi045:> stdin-killer -- python3 -c ' 2023-11-28T18:44:26.352 DEBUG:teuthology.orchestra.run.smithi045:> import os 2023-11-28T18:44:26.352 DEBUG:teuthology.orchestra.run.smithi045:> import uuid 2023-11-28T18:44:26.352 DEBUG:teuthology.orchestra.run.smithi045:> 2023-11-28T18:44:26.352 DEBUG:teuthology.orchestra.run.smithi045:> n = 1000 2023-11-28T18:44:26.352 DEBUG:teuthology.orchestra.run.smithi045:> create_hard_links = False 2023-11-28T18:44:26.352 DEBUG:teuthology.orchestra.run.smithi045:> if 0 > 0: 2023-11-28T18:44:26.352 DEBUG:teuthology.orchestra.run.smithi045:> create_hard_links = True 2023-11-28T18:44:26.352 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/bravo/file" 2023-11-28T18:44:26.352 DEBUG:teuthology.orchestra.run.smithi045:> 2023-11-28T18:44:26.352 DEBUG:teuthology.orchestra.run.smithi045:> dpath = os.path.dirname(path) 2023-11-28T18:44:26.353 DEBUG:teuthology.orchestra.run.smithi045:> fnameprefix = os.path.basename(path) 2023-11-28T18:44:26.353 DEBUG:teuthology.orchestra.run.smithi045:> os.makedirs(dpath, exist_ok=True) 2023-11-28T18:44:26.353 DEBUG:teuthology.orchestra.run.smithi045:> 2023-11-28T18:44:26.353 DEBUG:teuthology.orchestra.run.smithi045:> try: 2023-11-28T18:44:26.353 DEBUG:teuthology.orchestra.run.smithi045:> dirfd = os.open(dpath, os.O_DIRECTORY) 2023-11-28T18:44:26.353 DEBUG:teuthology.orchestra.run.smithi045:> 2023-11-28T18:44:26.353 DEBUG:teuthology.orchestra.run.smithi045:> for i in range(n): 2023-11-28T18:44:26.353 DEBUG:teuthology.orchestra.run.smithi045:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2023-11-28T18:44:26.353 DEBUG:teuthology.orchestra.run.smithi045:> with open(fpath, '"'"'w'"'"') as f: 2023-11-28T18:44:26.353 DEBUG:teuthology.orchestra.run.smithi045:> f.write(f"{i}") 2023-11-28T18:44:26.353 DEBUG:teuthology.orchestra.run.smithi045:> if False: 2023-11-28T18:44:26.353 DEBUG:teuthology.orchestra.run.smithi045:> f.flush() 2023-11-28T18:44:26.354 DEBUG:teuthology.orchestra.run.smithi045:> os.fsync(f.fileno()) 2023-11-28T18:44:26.354 DEBUG:teuthology.orchestra.run.smithi045:> if False: 2023-11-28T18:44:26.354 DEBUG:teuthology.orchestra.run.smithi045:> os.unlink(fpath) 2023-11-28T18:44:26.354 DEBUG:teuthology.orchestra.run.smithi045:> if False: 2023-11-28T18:44:26.354 DEBUG:teuthology.orchestra.run.smithi045:> os.fsync(dirfd) 2023-11-28T18:44:26.354 DEBUG:teuthology.orchestra.run.smithi045:> if create_hard_links: 2023-11-28T18:44:26.354 DEBUG:teuthology.orchestra.run.smithi045:> for j in range(0): 2023-11-28T18:44:26.354 DEBUG:teuthology.orchestra.run.smithi045:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2023-11-28T18:44:26.354 DEBUG:teuthology.orchestra.run.smithi045:> if False: 2023-11-28T18:44:26.354 DEBUG:teuthology.orchestra.run.smithi045:> os.fsync(dirfd) 2023-11-28T18:44:26.354 DEBUG:teuthology.orchestra.run.smithi045:> finally: 2023-11-28T18:44:26.354 DEBUG:teuthology.orchestra.run.smithi045:> os.close(dirfd) 2023-11-28T18:44:26.354 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-11-28T18:44:26.476 INFO:tasks.ceph.mds.c.smithi045.stderr:./src/mds/Locker.cc: In function 'bool Locker::xlock_start(SimpleLock*, MDRequestRef&)' thread 7f6a6d19b640 time 2023-11-28T18:44:26.477899+0000 2023-11-28T18:44:26.476 INFO:tasks.ceph.mds.c.smithi045.stderr:./src/mds/Locker.cc: 1963: FAILED ceph_assert(lock->get_sm()->can_remote_xlock) 2023-11-28T18:44:26.476 INFO:tasks.ceph.mds.c.smithi045.stderr: ceph version 18.0.0-7531-g47c1c547 (47c1c547372ed5bff7984647dc200bac0e019caf) reef (dev) 2023-11-28T18:44:26.477 INFO:tasks.ceph.mds.c.smithi045.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f6a7316fe96] 2023-11-28T18:44:26.477 INFO:tasks.ceph.mds.c.smithi045.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x17004a) [0x7f6a7317004a] 2023-11-28T18:44:26.477 INFO:tasks.ceph.mds.c.smithi045.stderr: 3: (Locker::xlock_start(SimpleLock*, boost::intrusive_ptr&)+0x8d8) [0x563d9224e3e8] 2023-11-28T18:44:26.477 INFO:tasks.ceph.mds.c.smithi045.stderr: 4: (Locker::acquire_locks(boost::intrusive_ptr&, MutationImpl::LockOpVec&, CInode*, bool)+0x20b4) [0x563d92243174] 2023-11-28T18:44:26.477 INFO:tasks.ceph.mds.c.smithi045.stderr: 5: (MDCache::path_traverse(boost::intrusive_ptr&, ContextFactory&, filepath const&, int, std::vector >*, CInode**)+0x8d3) [0x563d921f4033] 2023-11-28T18:44:26.477 INFO:tasks.ceph.mds.c.smithi045.stderr: 6: (Server::rdlock_path_xlock_dentry(boost::intrusive_ptr&, bool, bool, bool, bool)+0x21c) [0x563d9212edec] 2023-11-28T18:44:26.477 INFO:tasks.ceph.mds.c.smithi045.stderr: 7: (Server::handle_client_openc(boost::intrusive_ptr&)+0xd8) [0x563d92135be8] 2023-11-28T18:44:26.477 INFO:tasks.ceph.mds.c.smithi045.stderr: 8: (Server::handle_peer_auth_pin_ack(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x801) [0x563d9212ba91] 2023-11-28T18:44:26.477 INFO:tasks.ceph.mds.c.smithi045.stderr: 9: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x6ac) [0x563d9212c34c] 2023-11-28T18:44:26.477 INFO:tasks.ceph.mds.c.smithi045.stderr: 10: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x563d92118837] 2023-11-28T18:44:26.477 INFO:tasks.ceph.mds.c.smithi045.stderr: 11: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x563d9209c5fb] 2023-11-28T18:44:26.478 INFO:tasks.ceph.mds.c.smithi045.stderr: 12: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x563d9209cacc] 2023-11-28T18:44:26.478 INFO:tasks.ceph.mds.c.smithi045.stderr: 13: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x563d920878e5] 2023-11-28T18:44:26.478 INFO:tasks.ceph.mds.c.smithi045.stderr: 14: (DispatchQueue::entry()+0x5ea) [0x7f6a7335c11a] 2023-11-28T18:44:26.478 INFO:tasks.ceph.mds.c.smithi045.stderr: 15: /usr/lib/ceph/libceph-common.so.2(+0x3ee991) [0x7f6a733ee991] 2023-11-28T18:44:26.478 INFO:tasks.ceph.mds.c.smithi045.stderr: 16: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f6a72894b43] 2023-11-28T18:44:26.478 INFO:tasks.ceph.mds.c.smithi045.stderr: 17: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f6a72926a00] 2023-11-28T18:44:26.478 INFO:tasks.ceph.mds.c.smithi045.stderr:2023-11-28T18:44:26.478+0000 7f6a6d19b640 -1 ./src/mds/Locker.cc: In function 'bool Locker::xlock_start(SimpleLock*, MDRequestRef&)' thread 7f6a6d19b640 time 2023-11-28T18:44:26.477899+0000 2023-11-28T18:44:26.478 INFO:tasks.ceph.mds.c.smithi045.stderr:./src/mds/Locker.cc: 1963: FAILED ceph_assert(lock->get_sm()->can_remote_xlock) 2023-11-28T18:44:26.478 INFO:tasks.ceph.mds.c.smithi045.stderr: 2023-11-28T18:44:26.478 INFO:tasks.ceph.mds.c.smithi045.stderr: ceph version 18.0.0-7531-g47c1c547 (47c1c547372ed5bff7984647dc200bac0e019caf) reef (dev) 2023-11-28T18:44:26.478 INFO:tasks.ceph.mds.c.smithi045.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f6a7316fe96] 2023-11-28T18:44:26.479 INFO:tasks.ceph.mds.c.smithi045.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x17004a) [0x7f6a7317004a] 2023-11-28T18:44:26.479 INFO:tasks.ceph.mds.c.smithi045.stderr: 3: (Locker::xlock_start(SimpleLock*, boost::intrusive_ptr&)+0x8d8) [0x563d9224e3e8] 2023-11-28T18:44:26.479 INFO:tasks.ceph.mds.c.smithi045.stderr: 4: (Locker::acquire_locks(boost::intrusive_ptr&, MutationImpl::LockOpVec&, CInode*, bool)+0x20b4) [0x563d92243174] 2023-11-28T18:44:26.479 INFO:tasks.ceph.mds.c.smithi045.stderr: 5: (MDCache::path_traverse(boost::intrusive_ptr&, ContextFactory&, filepath const&, int, std::vector >*, CInode**)+0x8d3) [0x563d921f4033] 2023-11-28T18:44:26.479 INFO:tasks.ceph.mds.c.smithi045.stderr: 6: (Server::rdlock_path_xlock_dentry(boost::intrusive_ptr&, bool, bool, bool, bool)+0x21c) [0x563d9212edec] 2023-11-28T18:44:26.479 INFO:tasks.ceph.mds.c.smithi045.stderr: 7: (Server::handle_client_openc(boost::intrusive_ptr&)+0xd8) [0x563d92135be8] 2023-11-28T18:44:26.479 INFO:tasks.ceph.mds.c.smithi045.stderr: 8: (Server::handle_peer_auth_pin_ack(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x801) [0x563d9212ba91] 2023-11-28T18:44:26.479 INFO:tasks.ceph.mds.c.smithi045.stderr: 9: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x6ac) [0x563d9212c34c] 2023-11-28T18:44:26.479 INFO:tasks.ceph.mds.c.smithi045.stderr: 10: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x563d92118837] 2023-11-28T18:44:26.479 INFO:tasks.ceph.mds.c.smithi045.stderr: 11: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x563d9209c5fb] 2023-11-28T18:44:26.479 INFO:tasks.ceph.mds.c.smithi045.stderr: 12: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x563d9209cacc] 2023-11-28T18:44:26.480 INFO:tasks.ceph.mds.c.smithi045.stderr: 13: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x563d920878e5] 2023-11-28T18:44:26.480 INFO:tasks.ceph.mds.c.smithi045.stderr: 14: (DispatchQueue::entry()+0x5ea) [0x7f6a7335c11a] 2023-11-28T18:44:26.480 INFO:tasks.ceph.mds.c.smithi045.stderr: 15: /usr/lib/ceph/libceph-common.so.2(+0x3ee991) [0x7f6a733ee991] 2023-11-28T18:44:26.480 INFO:tasks.ceph.mds.c.smithi045.stderr: 16: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f6a72894b43] 2023-11-28T18:44:26.480 INFO:tasks.ceph.mds.c.smithi045.stderr: 17: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f6a72926a00] 2023-11-28T18:44:26.480 INFO:tasks.ceph.mds.c.smithi045.stderr: 2023-11-28T18:44:26.480 INFO:tasks.ceph.mds.c.smithi045.stderr:*** Caught signal (Aborted) ** 2023-11-28T18:44:26.480 INFO:tasks.ceph.mds.c.smithi045.stderr: in thread 7f6a6d19b640 thread_name:ms_dispatch 2023-11-28T18:44:26.481 INFO:tasks.ceph.mds.c.smithi045.stderr: ceph version 18.0.0-7531-g47c1c547 (47c1c547372ed5bff7984647dc200bac0e019caf) reef (dev) 2023-11-28T18:44:26.481 INFO:tasks.ceph.mds.c.smithi045.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f6a72842520] 2023-11-28T18:44:26.481 INFO:tasks.ceph.mds.c.smithi045.stderr: 2: pthread_kill() 2023-11-28T18:44:26.481 INFO:tasks.ceph.mds.c.smithi045.stderr: 3: raise() 2023-11-28T18:44:26.481 INFO:tasks.ceph.mds.c.smithi045.stderr: 4: abort() 2023-11-28T18:44:26.481 INFO:tasks.ceph.mds.c.smithi045.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f6a7316fef0] 2023-11-28T18:44:26.481 INFO:tasks.ceph.mds.c.smithi045.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x17004a) [0x7f6a7317004a] 2023-11-28T18:44:26.481 INFO:tasks.ceph.mds.c.smithi045.stderr: 7: (Locker::xlock_start(SimpleLock*, boost::intrusive_ptr&)+0x8d8) [0x563d9224e3e8] 2023-11-28T18:44:26.481 INFO:tasks.ceph.mds.c.smithi045.stderr: 8: (Locker::acquire_locks(boost::intrusive_ptr&, MutationImpl::LockOpVec&, CInode*, bool)+0x20b4) [0x563d92243174] 2023-11-28T18:44:26.481 INFO:tasks.ceph.mds.c.smithi045.stderr: 9: (MDCache::path_traverse(boost::intrusive_ptr&, ContextFactory&, filepath const&, int, std::vector >*, CInode**)+0x8d3) [0x563d921f4033] 2023-11-28T18:44:26.482 INFO:tasks.ceph.mds.c.smithi045.stderr: 10: (Server::rdlock_path_xlock_dentry(boost::intrusive_ptr&, bool, bool, bool, bool)+0x21c) [0x563d9212edec] 2023-11-28T18:44:26.482 INFO:tasks.ceph.mds.c.smithi045.stderr: 11: (Server::handle_client_openc(boost::intrusive_ptr&)+0xd8) [0x563d92135be8] 2023-11-28T18:44:26.482 INFO:tasks.ceph.mds.c.smithi045.stderr: 12: (Server::handle_peer_auth_pin_ack(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x801) [0x563d9212ba91] 2023-11-28T18:44:26.482 INFO:tasks.ceph.mds.c.smithi045.stderr: 13: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x6ac) [0x563d9212c34c] 2023-11-28T18:44:26.482 INFO:tasks.ceph.mds.c.smithi045.stderr: 14: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x563d92118837] 2023-11-28T18:44:26.482 INFO:tasks.ceph.mds.c.smithi045.stderr: 15: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x563d9209c5fb] 2023-11-28T18:44:26.482 INFO:tasks.ceph.mds.c.smithi045.stderr: 16: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x563d9209cacc] 2023-11-28T18:44:26.482 INFO:tasks.ceph.mds.c.smithi045.stderr: 17: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x563d920878e5] 2023-11-28T18:44:26.482 INFO:tasks.ceph.mds.c.smithi045.stderr: 18: (DispatchQueue::entry()+0x5ea) [0x7f6a7335c11a] 2023-11-28T18:44:26.482 INFO:tasks.ceph.mds.c.smithi045.stderr: 19: /usr/lib/ceph/libceph-common.so.2(+0x3ee991) [0x7f6a733ee991] 2023-11-28T18:44:26.482 INFO:tasks.ceph.mds.c.smithi045.stderr: 20: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f6a72894b43] 2023-11-28T18:44:26.483 INFO:tasks.ceph.mds.c.smithi045.stderr: 21: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f6a72926a00] 2023-11-28T18:44:26.483 INFO:tasks.ceph.mds.c.smithi045.stderr:2023-11-28T18:44:26.478+0000 7f6a6d19b640 -1 *** Caught signal (Aborted) ** 2023-11-28T18:44:26.483 INFO:tasks.ceph.mds.c.smithi045.stderr: in thread 7f6a6d19b640 thread_name:ms_dispatch 2023-11-28T18:44:26.483 INFO:tasks.ceph.mds.c.smithi045.stderr: 2023-11-28T18:44:26.483 INFO:tasks.ceph.mds.c.smithi045.stderr: ceph version 18.0.0-7531-g47c1c547 (47c1c547372ed5bff7984647dc200bac0e019caf) reef (dev) 2023-11-28T18:44:26.483 INFO:tasks.ceph.mds.c.smithi045.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f6a72842520] 2023-11-28T18:44:26.483 INFO:tasks.ceph.mds.c.smithi045.stderr: 2: pthread_kill() 2023-11-28T18:44:26.483 INFO:tasks.ceph.mds.c.smithi045.stderr: 3: raise() 2023-11-28T18:44:26.483 INFO:tasks.ceph.mds.c.smithi045.stderr: 4: abort() 2023-11-28T18:44:26.483 INFO:tasks.ceph.mds.c.smithi045.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f6a7316fef0] 2023-11-28T18:44:26.483 INFO:tasks.ceph.mds.c.smithi045.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x17004a) [0x7f6a7317004a] 2023-11-28T18:44:26.483 INFO:tasks.ceph.mds.c.smithi045.stderr: 7: (Locker::xlock_start(SimpleLock*, boost::intrusive_ptr&)+0x8d8) [0x563d9224e3e8] 2023-11-28T18:44:26.484 INFO:tasks.ceph.mds.c.smithi045.stderr: 8: (Locker::acquire_locks(boost::intrusive_ptr&, MutationImpl::LockOpVec&, CInode*, bool)+0x20b4) [0x563d92243174] 2023-11-28T18:44:26.484 INFO:tasks.ceph.mds.c.smithi045.stderr: 9: (MDCache::path_traverse(boost::intrusive_ptr&, ContextFactory&, filepath const&, int, std::vector >*, CInode**)+0x8d3) [0x563d921f4033] 2023-11-28T18:44:26.484 INFO:tasks.ceph.mds.c.smithi045.stderr: 10: (Server::rdlock_path_xlock_dentry(boost::intrusive_ptr&, bool, bool, bool, bool)+0x21c) [0x563d9212edec] 2023-11-28T18:44:26.484 INFO:tasks.ceph.mds.c.smithi045.stderr: 11: (Server::handle_client_openc(boost::intrusive_ptr&)+0xd8) [0x563d92135be8] 2023-11-28T18:44:26.484 INFO:tasks.ceph.mds.c.smithi045.stderr: 12: (Server::handle_peer_auth_pin_ack(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x801) [0x563d9212ba91] 2023-11-28T18:44:26.484 INFO:tasks.ceph.mds.c.smithi045.stderr: 13: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x6ac) [0x563d9212c34c] 2023-11-28T18:44:26.484 INFO:tasks.ceph.mds.c.smithi045.stderr: 14: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x563d92118837] 2023-11-28T18:44:26.484 INFO:tasks.ceph.mds.c.smithi045.stderr: 15: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x563d9209c5fb] 2023-11-28T18:44:26.484 INFO:tasks.ceph.mds.c.smithi045.stderr: 16: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x563d9209cacc] 2023-11-28T18:44:26.484 INFO:tasks.ceph.mds.c.smithi045.stderr: 17: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x563d920878e5] 2023-11-28T18:44:26.484 INFO:tasks.ceph.mds.c.smithi045.stderr: 18: (DispatchQueue::entry()+0x5ea) [0x7f6a7335c11a] 2023-11-28T18:44:26.484 INFO:tasks.ceph.mds.c.smithi045.stderr: 19: /usr/lib/ceph/libceph-common.so.2(+0x3ee991) [0x7f6a733ee991] 2023-11-28T18:44:26.485 INFO:tasks.ceph.mds.c.smithi045.stderr: 20: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f6a72894b43] 2023-11-28T18:44:26.485 INFO:tasks.ceph.mds.c.smithi045.stderr: 21: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f6a72926a00] 2023-11-28T18:44:26.485 INFO:tasks.ceph.mds.c.smithi045.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-28T18:44:26.485 INFO:tasks.ceph.mds.c.smithi045.stderr: 2023-11-28T18:44:26.500 INFO:tasks.ceph.mds.c.smithi045.stderr: -1> 2023-11-28T18:44:26.478+0000 7f6a6d19b640 -1 ./src/mds/Locker.cc: In function 'bool Locker::xlock_start(SimpleLock*, MDRequestRef&)' thread 7f6a6d19b640 time 2023-11-28T18:44:26.477899+0000 2023-11-28T18:44:26.500 INFO:tasks.ceph.mds.c.smithi045.stderr:./src/mds/Locker.cc: 1963: FAILED ceph_assert(lock->get_sm()->can_remote_xlock) 2023-11-28T18:44:26.500 INFO:tasks.ceph.mds.c.smithi045.stderr: 2023-11-28T18:44:26.501 INFO:tasks.ceph.mds.c.smithi045.stderr: ceph version 18.0.0-7531-g47c1c547 (47c1c547372ed5bff7984647dc200bac0e019caf) reef (dev) 2023-11-28T18:44:26.501 INFO:tasks.ceph.mds.c.smithi045.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f6a7316fe96] 2023-11-28T18:44:26.501 INFO:tasks.ceph.mds.c.smithi045.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x17004a) [0x7f6a7317004a] 2023-11-28T18:44:26.501 INFO:tasks.ceph.mds.c.smithi045.stderr: 3: (Locker::xlock_start(SimpleLock*, boost::intrusive_ptr&)+0x8d8) [0x563d9224e3e8] 2023-11-28T18:44:26.501 INFO:tasks.ceph.mds.c.smithi045.stderr: 4: (Locker::acquire_locks(boost::intrusive_ptr&, MutationImpl::LockOpVec&, CInode*, bool)+0x20b4) [0x563d92243174] 2023-11-28T18:44:26.501 INFO:tasks.ceph.mds.c.smithi045.stderr: 5: (MDCache::path_traverse(boost::intrusive_ptr&, ContextFactory&, filepath const&, int, std::vector >*, CInode**)+0x8d3) [0x563d921f4033] 2023-11-28T18:44:26.501 INFO:tasks.ceph.mds.c.smithi045.stderr: 6: (Server::rdlock_path_xlock_dentry(boost::intrusive_ptr&, bool, bool, bool, bool)+0x21c) [0x563d9212edec] 2023-11-28T18:44:26.501 INFO:tasks.ceph.mds.c.smithi045.stderr: 7: (Server::handle_client_openc(boost::intrusive_ptr&)+0xd8) [0x563d92135be8] 2023-11-28T18:44:26.501 INFO:tasks.ceph.mds.c.smithi045.stderr: 8: (Server::handle_peer_auth_pin_ack(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x801) [0x563d9212ba91] 2023-11-28T18:44:26.501 INFO:tasks.ceph.mds.c.smithi045.stderr: 9: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x6ac) [0x563d9212c34c] 2023-11-28T18:44:26.501 INFO:tasks.ceph.mds.c.smithi045.stderr: 10: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x563d92118837] 2023-11-28T18:44:26.502 INFO:tasks.ceph.mds.c.smithi045.stderr: 11: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x563d9209c5fb] 2023-11-28T18:44:26.502 INFO:tasks.ceph.mds.c.smithi045.stderr: 12: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x563d9209cacc] 2023-11-28T18:44:26.502 INFO:tasks.ceph.mds.c.smithi045.stderr: 13: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x563d920878e5] 2023-11-28T18:44:26.502 INFO:tasks.ceph.mds.c.smithi045.stderr: 14: (DispatchQueue::entry()+0x5ea) [0x7f6a7335c11a] 2023-11-28T18:44:26.502 INFO:tasks.ceph.mds.c.smithi045.stderr: 15: /usr/lib/ceph/libceph-common.so.2(+0x3ee991) [0x7f6a733ee991] 2023-11-28T18:44:26.502 INFO:tasks.ceph.mds.c.smithi045.stderr: 16: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f6a72894b43] 2023-11-28T18:44:26.502 INFO:tasks.ceph.mds.c.smithi045.stderr: 17: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f6a72926a00] 2023-11-28T18:44:26.502 INFO:tasks.ceph.mds.c.smithi045.stderr: 2023-11-28T18:44:26.502 INFO:tasks.ceph.mds.c.smithi045.stderr: 0> 2023-11-28T18:44:26.478+0000 7f6a6d19b640 -1 *** Caught signal (Aborted) ** 2023-11-28T18:44:26.502 INFO:tasks.ceph.mds.c.smithi045.stderr: in thread 7f6a6d19b640 thread_name:ms_dispatch 2023-11-28T18:44:26.502 INFO:tasks.ceph.mds.c.smithi045.stderr: 2023-11-28T18:44:26.502 INFO:tasks.ceph.mds.c.smithi045.stderr: ceph version 18.0.0-7531-g47c1c547 (47c1c547372ed5bff7984647dc200bac0e019caf) reef (dev) 2023-11-28T18:44:26.503 INFO:tasks.ceph.mds.c.smithi045.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f6a72842520] 2023-11-28T18:44:26.503 INFO:tasks.ceph.mds.c.smithi045.stderr: 2: pthread_kill() 2023-11-28T18:44:26.503 INFO:tasks.ceph.mds.c.smithi045.stderr: 3: raise() 2023-11-28T18:44:26.503 INFO:tasks.ceph.mds.c.smithi045.stderr: 4: abort() 2023-11-28T18:44:26.503 INFO:tasks.ceph.mds.c.smithi045.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f6a7316fef0] 2023-11-28T18:44:26.503 INFO:tasks.ceph.mds.c.smithi045.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x17004a) [0x7f6a7317004a] 2023-11-28T18:44:26.503 INFO:tasks.ceph.mds.c.smithi045.stderr: 7: (Locker::xlock_start(SimpleLock*, boost::intrusive_ptr&)+0x8d8) [0x563d9224e3e8] 2023-11-28T18:44:26.503 INFO:tasks.ceph.mds.c.smithi045.stderr: 8: (Locker::acquire_locks(boost::intrusive_ptr&, MutationImpl::LockOpVec&, CInode*, bool)+0x20b4) [0x563d92243174] 2023-11-28T18:44:26.503 INFO:tasks.ceph.mds.c.smithi045.stderr: 9: (MDCache::path_traverse(boost::intrusive_ptr&, ContextFactory&, filepath const&, int, std::vector >*, CInode**)+0x8d3) [0x563d921f4033] 2023-11-28T18:44:26.503 INFO:tasks.ceph.mds.c.smithi045.stderr: 10: (Server::rdlock_path_xlock_dentry(boost::intrusive_ptr&, bool, bool, bool, bool)+0x21c) [0x563d9212edec] 2023-11-28T18:44:26.503 INFO:tasks.ceph.mds.c.smithi045.stderr: 11: (Server::handle_client_openc(boost::intrusive_ptr&)+0xd8) [0x563d92135be8] 2023-11-28T18:44:26.504 INFO:tasks.ceph.mds.c.smithi045.stderr: 12: (Server::handle_peer_auth_pin_ack(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x801) [0x563d9212ba91] 2023-11-28T18:44:26.504 INFO:tasks.ceph.mds.c.smithi045.stderr: 13: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x6ac) [0x563d9212c34c] 2023-11-28T18:44:26.504 INFO:tasks.ceph.mds.c.smithi045.stderr: 14: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x563d92118837] 2023-11-28T18:44:26.504 INFO:tasks.ceph.mds.c.smithi045.stderr: 15: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x563d9209c5fb] 2023-11-28T18:44:26.504 INFO:tasks.ceph.mds.c.smithi045.stderr: 16: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x563d9209cacc] 2023-11-28T18:44:26.504 INFO:tasks.ceph.mds.c.smithi045.stderr: 17: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x563d920878e5] 2023-11-28T18:44:26.504 INFO:tasks.ceph.mds.c.smithi045.stderr: 18: (DispatchQueue::entry()+0x5ea) [0x7f6a7335c11a] 2023-11-28T18:44:26.504 INFO:tasks.ceph.mds.c.smithi045.stderr: 19: /usr/lib/ceph/libceph-common.so.2(+0x3ee991) [0x7f6a733ee991] 2023-11-28T18:44:26.504 INFO:tasks.ceph.mds.c.smithi045.stderr: 20: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f6a72894b43] 2023-11-28T18:44:26.504 INFO:tasks.ceph.mds.c.smithi045.stderr: 21: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f6a72926a00] 2023-11-28T18:44:26.504 INFO:tasks.ceph.mds.c.smithi045.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-28T18:44:26.504 INFO:tasks.ceph.mds.c.smithi045.stderr: 2023-11-28T18:44:26.510 INFO:tasks.ceph.mds.c.smithi045.stderr: -1> 2023-11-28T18:44:26.478+0000 7f6a6d19b640 -1 ./src/mds/Locker.cc: In function 'bool Locker::xlock_start(SimpleLock*, MDRequestRef&)' thread 7f6a6d19b640 time 2023-11-28T18:44:26.477899+0000 2023-11-28T18:44:26.510 INFO:tasks.ceph.mds.c.smithi045.stderr:./src/mds/Locker.cc: 1963: FAILED ceph_assert(lock->get_sm()->can_remote_xlock) 2023-11-28T18:44:26.511 INFO:tasks.ceph.mds.c.smithi045.stderr: 2023-11-28T18:44:26.511 INFO:tasks.ceph.mds.c.smithi045.stderr: ceph version 18.0.0-7531-g47c1c547 (47c1c547372ed5bff7984647dc200bac0e019caf) reef (dev) 2023-11-28T18:44:26.511 INFO:tasks.ceph.mds.c.smithi045.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f6a7316fe96] 2023-11-28T18:44:26.511 INFO:tasks.ceph.mds.c.smithi045.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x17004a) [0x7f6a7317004a] 2023-11-28T18:44:26.511 INFO:tasks.ceph.mds.c.smithi045.stderr: 3: (Locker::xlock_start(SimpleLock*, boost::intrusive_ptr&)+0x8d8) [0x563d9224e3e8] 2023-11-28T18:44:26.511 INFO:tasks.ceph.mds.c.smithi045.stderr: 4: (Locker::acquire_locks(boost::intrusive_ptr&, MutationImpl::LockOpVec&, CInode*, bool)+0x20b4) [0x563d92243174] 2023-11-28T18:44:26.511 INFO:tasks.ceph.mds.c.smithi045.stderr: 5: (MDCache::path_traverse(boost::intrusive_ptr&, ContextFactory&, filepath const&, int, std::vector >*, CInode**)+0x8d3) [0x563d921f4033] 2023-11-28T18:44:26.511 INFO:tasks.ceph.mds.c.smithi045.stderr: 6: (Server::rdlock_path_xlock_dentry(boost::intrusive_ptr&, bool, bool, bool, bool)+0x21c) [0x563d9212edec] 2023-11-28T18:44:26.511 INFO:tasks.ceph.mds.c.smithi045.stderr: 7: (Server::handle_client_openc(boost::intrusive_ptr&)+0xd8) [0x563d92135be8] 2023-11-28T18:44:26.511 INFO:tasks.ceph.mds.c.smithi045.stderr: 8: (Server::handle_peer_auth_pin_ack(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x801) [0x563d9212ba91] 2023-11-28T18:44:26.511 INFO:tasks.ceph.mds.c.smithi045.stderr: 9: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x6ac) [0x563d9212c34c] 2023-11-28T18:44:26.512 INFO:tasks.ceph.mds.c.smithi045.stderr: 10: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x563d92118837] 2023-11-28T18:44:26.512 INFO:tasks.ceph.mds.c.smithi045.stderr: 11: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x563d9209c5fb] 2023-11-28T18:44:26.512 INFO:tasks.ceph.mds.c.smithi045.stderr: 12: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x563d9209cacc] 2023-11-28T18:44:26.512 INFO:tasks.ceph.mds.c.smithi045.stderr: 13: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x563d920878e5] 2023-11-28T18:44:26.512 INFO:tasks.ceph.mds.c.smithi045.stderr: 14: (DispatchQueue::entry()+0x5ea) [0x7f6a7335c11a] 2023-11-28T18:44:26.512 INFO:tasks.ceph.mds.c.smithi045.stderr: 15: /usr/lib/ceph/libceph-common.so.2(+0x3ee991) [0x7f6a733ee991] 2023-11-28T18:44:26.512 INFO:tasks.ceph.mds.c.smithi045.stderr: 16: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f6a72894b43] 2023-11-28T18:44:26.512 INFO:tasks.ceph.mds.c.smithi045.stderr: 17: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f6a72926a00] 2023-11-28T18:44:26.512 INFO:tasks.ceph.mds.c.smithi045.stderr: 2023-11-28T18:44:26.512 INFO:tasks.ceph.mds.c.smithi045.stderr: 0> 2023-11-28T18:44:26.478+0000 7f6a6d19b640 -1 *** Caught signal (Aborted) ** 2023-11-28T18:44:26.512 INFO:tasks.ceph.mds.c.smithi045.stderr: in thread 7f6a6d19b640 thread_name:ms_dispatch 2023-11-28T18:44:26.512 INFO:tasks.ceph.mds.c.smithi045.stderr: 2023-11-28T18:44:26.513 INFO:tasks.ceph.mds.c.smithi045.stderr: ceph version 18.0.0-7531-g47c1c547 (47c1c547372ed5bff7984647dc200bac0e019caf) reef (dev) 2023-11-28T18:44:26.513 INFO:tasks.ceph.mds.c.smithi045.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f6a72842520] 2023-11-28T18:44:26.513 INFO:tasks.ceph.mds.c.smithi045.stderr: 2: pthread_kill() 2023-11-28T18:44:26.513 INFO:tasks.ceph.mds.c.smithi045.stderr: 3: raise() 2023-11-28T18:44:26.513 INFO:tasks.ceph.mds.c.smithi045.stderr: 4: abort() 2023-11-28T18:44:26.513 INFO:tasks.ceph.mds.c.smithi045.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f6a7316fef0] 2023-11-28T18:44:26.513 INFO:tasks.ceph.mds.c.smithi045.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x17004a) [0x7f6a7317004a] 2023-11-28T18:44:26.513 INFO:tasks.ceph.mds.c.smithi045.stderr: 7: (Locker::xlock_start(SimpleLock*, boost::intrusive_ptr&)+0x8d8) [0x563d9224e3e8] 2023-11-28T18:44:26.513 INFO:tasks.ceph.mds.c.smithi045.stderr: 8: (Locker::acquire_locks(boost::intrusive_ptr&, MutationImpl::LockOpVec&, CInode*, bool)+0x20b4) [0x563d92243174] 2023-11-28T18:44:26.513 INFO:tasks.ceph.mds.c.smithi045.stderr: 9: (MDCache::path_traverse(boost::intrusive_ptr&, ContextFactory&, filepath const&, int, std::vector >*, CInode**)+0x8d3) [0x563d921f4033] 2023-11-28T18:44:26.513 INFO:tasks.ceph.mds.c.smithi045.stderr: 10: (Server::rdlock_path_xlock_dentry(boost::intrusive_ptr&, bool, bool, bool, bool)+0x21c) [0x563d9212edec] 2023-11-28T18:44:26.513 INFO:tasks.ceph.mds.c.smithi045.stderr: 11: (Server::handle_client_openc(boost::intrusive_ptr&)+0xd8) [0x563d92135be8] 2023-11-28T18:44:26.514 INFO:tasks.ceph.mds.c.smithi045.stderr: 12: (Server::handle_peer_auth_pin_ack(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x801) [0x563d9212ba91] 2023-11-28T18:44:26.514 INFO:tasks.ceph.mds.c.smithi045.stderr: 13: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0x6ac) [0x563d9212c34c] 2023-11-28T18:44:26.514 INFO:tasks.ceph.mds.c.smithi045.stderr: 14: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x563d92118837] 2023-11-28T18:44:26.514 INFO:tasks.ceph.mds.c.smithi045.stderr: 15: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x563d9209c5fb] 2023-11-28T18:44:26.514 INFO:tasks.ceph.mds.c.smithi045.stderr: 16: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x563d9209cacc] 2023-11-28T18:44:26.514 INFO:tasks.ceph.mds.c.smithi045.stderr: 17: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x563d920878e5] 2023-11-28T18:44:26.514 INFO:tasks.ceph.mds.c.smithi045.stderr: 18: (DispatchQueue::entry()+0x5ea) [0x7f6a7335c11a] 2023-11-28T18:44:26.514 INFO:tasks.ceph.mds.c.smithi045.stderr: 19: /usr/lib/ceph/libceph-common.so.2(+0x3ee991) [0x7f6a733ee991] 2023-11-28T18:44:26.514 INFO:tasks.ceph.mds.c.smithi045.stderr: 20: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f6a72894b43] 2023-11-28T18:44:26.514 INFO:tasks.ceph.mds.c.smithi045.stderr: 21: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f6a72926a00] 2023-11-28T18:44:26.514 INFO:tasks.ceph.mds.c.smithi045.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-28T18:44:26.515 INFO:tasks.ceph.mds.c.smithi045.stderr: 2023-11-28T18:44:26.668 INFO:tasks.ceph.mds.c.smithi045.stderr:daemon-helper: command crashed with signal 6 2023-11-28T18:44:29.013 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-11-28T18:44:35.626 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~7s 2023-11-28T18:44:42.237 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~13s 2023-11-28T18:44:48.854 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~20s 2023-11-28T18:44:54.480 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:44:54.485 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:44:55.864 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~27s 2023-11-28T18:45:02.479 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~33s 2023-11-28T18:45:09.092 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~40s 2023-11-28T18:45:15.704 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~47s 2023-11-28T18:45:22.318 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~53s 2023-11-28T18:45:24.568 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:45:24.573 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:45:28.929 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~60s 2023-11-28T18:45:35.540 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~67s 2023-11-28T18:45:42.151 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~73s 2023-11-28T18:45:48.761 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~80s 2023-11-28T18:45:54.628 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:45:54.633 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:45:55.374 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~86s 2023-11-28T18:46:01.986 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~93s 2023-11-28T18:46:08.598 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~100s 2023-11-28T18:46:15.209 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~106s 2023-11-28T18:46:21.821 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~113s 2023-11-28T18:46:24.889 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:46:24.894 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:46:28.435 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~119s 2023-11-28T18:46:35.047 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~126s 2023-11-28T18:46:41.660 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~133s 2023-11-28T18:46:48.274 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~139s 2023-11-28T18:46:54.886 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~146s 2023-11-28T18:46:54.953 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:46:54.957 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:47:01.499 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~152s 2023-11-28T18:47:08.112 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~159s 2023-11-28T18:47:14.723 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~166s 2023-11-28T18:47:21.335 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~172s 2023-11-28T18:47:25.108 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:47:25.113 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:47:27.949 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~179s 2023-11-28T18:47:34.563 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~186s 2023-11-28T18:47:41.175 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~192s 2023-11-28T18:47:47.788 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~199s 2023-11-28T18:47:54.401 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~205s 2023-11-28T18:47:55.171 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:47:55.176 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:48:01.018 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~212s 2023-11-28T18:48:07.632 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~219s 2023-11-28T18:48:14.245 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~225s 2023-11-28T18:48:20.858 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~232s 2023-11-28T18:48:25.247 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:48:25.252 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:48:27.470 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~238s 2023-11-28T18:48:34.084 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~245s 2023-11-28T18:48:40.696 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~252s 2023-11-28T18:48:47.309 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~258s 2023-11-28T18:48:53.920 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~265s 2023-11-28T18:48:55.441 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:48:55.445 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:49:00.533 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~272s 2023-11-28T18:49:07.146 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~278s 2023-11-28T18:49:13.758 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~285s 2023-11-28T18:49:20.371 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~291s 2023-11-28T18:49:25.524 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:49:25.529 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:49:26.984 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~298s 2023-11-28T18:49:33.595 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~305s 2023-11-28T18:49:33.595 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2023-11-28T18:49:33.596 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T18:49:33.596 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T18:49:33.607 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T18:49:33.660 INFO:teuthology.orchestra.run.smithi045.stderr:Traceback (most recent call last): 2023-11-28T18:49:33.660 INFO:teuthology.orchestra.run.smithi045.stderr: File "", line 20, in 2023-11-28T18:49:33.661 INFO:teuthology.orchestra.run.smithi045.stderr:ConnectionAbortedError: [Errno 103] Software caused connection abort: '/home/ubuntu/cephtest/mnt.0/bravo/file_0' 2023-11-28T18:49:33.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33 stdin-killer INFO: command exited with status 1: exiting normally with same code! 2023-11-28T18:49:33.674 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T18:49:33.674 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-28T18:49:33.675 DEBUG:teuthology.orchestra.run.smithi045:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T18:49:33.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33.806+0000 7fa03ced6640 1 Processor -- start 2023-11-28T18:49:33.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33.806+0000 7fa03ced6640 1 -- start start 2023-11-28T18:49:33.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33.806+0000 7fa03ced6640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa038144880 0x7fa03806c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:33.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33.806+0000 7fa03ced6640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa038070bb0 0x7fa03806c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:33.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33.806+0000 7fa03ced6640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa038071120 con 0x7fa0380721c0 2023-11-28T18:49:33.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33.806+0000 7fa03ced6640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa03815f050 con 0x7fa038144880 2023-11-28T18:49:33.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33.806+0000 7fa03ced6640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa038071400 con 0x7fa038070bb0 2023-11-28T18:49:33.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33.810+0000 7fa03659c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa038144880 0x7fa03806c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:33.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33.810+0000 7fa03659c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa038144880 0x7fa03806c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40258/0 (socket says 172.21.15.45:40258) 2023-11-28T18:49:33.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33.810+0000 7fa03659c640 1 -- 172.21.15.45:0/1612800632 learned_addr learned my addr 172.21.15.45:0/1612800632 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:49:33.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33.810+0000 7fa036d9d640 1 --2- 172.21.15.45:0/1612800632 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa038070bb0 0x7fa03806c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:33.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33.810+0000 7fa03659c640 1 -- 172.21.15.45:0/1612800632 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa038070bb0 msgr2=0x7fa03806c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:49:33.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33.810+0000 7fa03659c640 1 --2- 172.21.15.45:0/1612800632 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa038070bb0 0x7fa03806c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:33.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33.810+0000 7fa03659c640 1 -- 172.21.15.45:0/1612800632 >> v1:172.21.15.190:6789/0 conn(0x7fa0380721c0 legacy=0x7fa0380704a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:33.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33.810+0000 7fa03659c640 1 -- 172.21.15.45:0/1612800632 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0380716e0 con 0x7fa038144880 2023-11-28T18:49:33.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33.810+0000 7fa036d9d640 1 --2- 172.21.15.45:0/1612800632 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa038070bb0 0x7fa03806c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:49:33.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33.810+0000 7fa03659c640 1 --2- 172.21.15.45:0/1612800632 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa038144880 0x7fa03806c300 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fa028009870 tx=0x7fa02801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fafa96c6c7ad733 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:49:33.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33.810+0000 7fa035d9b640 1 -- 172.21.15.45:0/1612800632 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0280aa670 con 0x7fa038144880 2023-11-28T18:49:33.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33.810+0000 7fa035d9b640 1 -- 172.21.15.45:0/1612800632 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0280aa7d0 con 0x7fa038144880 2023-11-28T18:49:33.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33.810+0000 7fa035d9b640 1 -- 172.21.15.45:0/1612800632 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0280aab60 con 0x7fa038144880 2023-11-28T18:49:33.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33.814+0000 7fa03ced6640 1 -- 172.21.15.45:0/1612800632 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa038144880 msgr2=0x7fa03806c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:33.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33.814+0000 7fa03ced6640 1 --2- 172.21.15.45:0/1612800632 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa038144880 0x7fa03806c300 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fa028009870 tx=0x7fa02801c510 comp rx=0 tx=0).stop 2023-11-28T18:49:33.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33.814+0000 7fa03ced6640 1 -- 172.21.15.45:0/1612800632 shutdown_connections 2023-11-28T18:49:33.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33.814+0000 7fa03ced6640 1 --2- 172.21.15.45:0/1612800632 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa038070bb0 0x7fa03806c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:33.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33.814+0000 7fa03ced6640 1 --2- 172.21.15.45:0/1612800632 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa038144880 0x7fa03806c300 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:33.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33.814+0000 7fa03ced6640 1 -- 172.21.15.45:0/1612800632 >> 172.21.15.45:0/1612800632 conn(0x7fa03806a570 msgr2=0x7fa03806a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:49:33.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33.814+0000 7fa03ced6640 1 -- 172.21.15.45:0/1612800632 shutdown_connections 2023-11-28T18:49:33.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33.814+0000 7fa03ced6640 1 -- 172.21.15.45:0/1612800632 wait complete. 2023-11-28T18:49:33.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33.814+0000 7fa03ced6640 1 Processor -- start 2023-11-28T18:49:33.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33.814+0000 7fa03ced6640 1 -- start start 2023-11-28T18:49:33.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33.814+0000 7fa03ced6640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa038070bb0 0x7fa03813d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:33.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33.814+0000 7fa03ced6640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa0380721c0 0x7fa03813cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:33.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33.814+0000 7fa03ced6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa038144880 0x7fa0381408c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:33.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33.814+0000 7fa03ced6640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa03813d4f0 con 0x7fa038144880 2023-11-28T18:49:33.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33.814+0000 7fa03ced6640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa038165e70 con 0x7fa0380721c0 2023-11-28T18:49:33.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33.814+0000 7fa03ced6640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa03813d210 con 0x7fa038070bb0 2023-11-28T18:49:33.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33.814+0000 7fa036d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa038144880 0x7fa0381408c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:33.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33.814+0000 7fa036d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa038144880 0x7fa0381408c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40270/0 (socket says 172.21.15.45:40270) 2023-11-28T18:49:33.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33.814+0000 7fa036d9d640 1 -- 172.21.15.45:0/4057618739 learned_addr learned my addr 172.21.15.45:0/4057618739 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:49:33.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33.814+0000 7fa03659c640 1 --2- 172.21.15.45:0/4057618739 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa038070bb0 0x7fa03813d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:33.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33.814+0000 7fa02ffff640 1 --2- 172.21.15.45:0/4057618739 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa0380721c0 0x7fa03813cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:33.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33.818+0000 7fa036d9d640 1 -- 172.21.15.45:0/4057618739 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa038070bb0 msgr2=0x7fa03813d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:33.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33.818+0000 7fa036d9d640 1 --2- 172.21.15.45:0/4057618739 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa038070bb0 0x7fa03813d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:33.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33.818+0000 7fa036d9d640 1 -- 172.21.15.45:0/4057618739 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa0380721c0 msgr2=0x7fa03813cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:33.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33.818+0000 7fa036d9d640 1 --2- 172.21.15.45:0/4057618739 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa0380721c0 0x7fa03813cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:33.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33.818+0000 7fa036d9d640 1 -- 172.21.15.45:0/4057618739 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0280094d0 con 0x7fa038144880 2023-11-28T18:49:33.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33.818+0000 7fa03659c640 1 --2- 172.21.15.45:0/4057618739 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa038070bb0 0x7fa03813d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:49:33.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33.818+0000 7fa036d9d640 1 --2- 172.21.15.45:0/4057618739 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa038144880 0x7fa0381408c0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fa030009fa0 tx=0x7fa03000d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:49:33.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33.818+0000 7fa02effd640 1 -- 172.21.15.45:0/4057618739 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa030003ba0 con 0x7fa038144880 2023-11-28T18:49:33.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33.818+0000 7fa02effd640 1 -- 172.21.15.45:0/4057618739 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa03000f040 con 0x7fa038144880 2023-11-28T18:49:33.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33.818+0000 7fa02effd640 1 -- 172.21.15.45:0/4057618739 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa030004030 con 0x7fa038144880 2023-11-28T18:49:33.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33.818+0000 7fa03ced6640 1 -- 172.21.15.45:0/4057618739 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0381611f0 con 0x7fa038144880 2023-11-28T18:49:33.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33.818+0000 7fa03ced6640 1 -- 172.21.15.45:0/4057618739 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0381617b0 con 0x7fa038144880 2023-11-28T18:49:33.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33.818+0000 7fa03ced6640 1 -- 172.21.15.45:0/4057618739 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa038161050 con 0x7fa038144880 2023-11-28T18:49:33.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33.818+0000 7fa02effd640 1 -- 172.21.15.45:0/4057618739 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa030004190 con 0x7fa038144880 2023-11-28T18:49:33.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33.818+0000 7fa02effd640 1 --2- 172.21.15.45:0/4057618739 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa0180668d0 0x7fa018068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:33.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33.818+0000 7fa02effd640 1 -- 172.21.15.45:0/4057618739 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa030084710 con 0x7fa038144880 2023-11-28T18:49:33.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33.822+0000 7fa03659c640 1 --2- 172.21.15.45:0/4057618739 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa0180668d0 0x7fa018068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:33.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33.822+0000 7fa03659c640 1 --2- 172.21.15.45:0/4057618739 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa0180668d0 0x7fa018068d90 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fa0280ae000 tx=0x7fa0280a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:49:33.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33.826+0000 7fa02effd640 1 -- 172.21.15.45:0/4057618739 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa038161050 con 0x7fa038144880 2023-11-28T18:49:33.826 DEBUG:teuthology.orchestra.run.smithi190:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T18:49:33.910 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-28T18:49:33.910 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T18:49:33.910 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T18:49:33.920 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T18:49:33.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33.982+0000 7fa03ced6640 1 -- 172.21.15.45:0/4057618739 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa038161050 con 0x7fa038144880 2023-11-28T18:49:33.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33.986+0000 7fa02effd640 1 -- 172.21.15.45:0/4057618739 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+16529 (secure 0 0 0) 0x7fa038161050 con 0x7fa038144880 2023-11-28T18:49:33.984 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:49:33.984 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":60,"fsid":"d10f5cd6-1d00-4019-99b6-6fa435498a15","created":"2023-11-28T18:37:08.189030+0000","modified":"2023-11-28T18:44:00.269525+0000","last_up_change":"2023-11-28T18:37:20.196124+0000","last_in_change":"2023-11-28T18:37:10.742043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T18:37:21.293917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-28T18:43:57.069740+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-28T18:43:57.647964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"84465384-103c-4f2c-a45a-96f5bb9c835f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6809","nonce":555237322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6811","nonce":555237322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6815","nonce":555237322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6813","nonce":555237322}]},"public_addr":"172.21.15.45:6809/555237322","cluster_addr":"172.21.15.45:6811/555237322","heartbeat_back_addr":"172.21.15.45:6815/555237322","heartbeat_front_addr":"172.21.15.45:6813/555237322","state":["exists","up"]},{"osd":1,"uuid":"7d9eed24-a58f-42c7-a787-ac06be8553fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6801","nonce":2857063763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6803","nonce":2857063763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6807","nonce":2857063763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6805","nonce":2857063763}]},"public_addr":"172.21.15.45:6801/2857063763","cluster_addr":"172.21.15.45:6803/2857063763","heartbeat_back_addr":"172.21.15.45:6807/2857063763","heartbeat_front_addr":"172.21.15.45:6805/2857063763","state":["exists","up"]},{"osd":2,"uuid":"575eeccc-4abf-45b4-9caf-f3e797859588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6817","nonce":193884539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6819","nonce":193884539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6823","nonce":193884539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6821","nonce":193884539}]},"public_addr":"172.21.15.45:6817/193884539","cluster_addr":"172.21.15.45:6819/193884539","heartbeat_back_addr":"172.21.15.45:6823/193884539","heartbeat_front_addr":"172.21.15.45:6821/193884539","state":["exists","up"]},{"osd":3,"uuid":"9b0290d6-9a52-4bc8-b2a1-7622c5dc8e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6825","nonce":78541084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6827","nonce":78541084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6831","nonce":78541084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6829","nonce":78541084}]},"public_addr":"172.21.15.45:6825/78541084","cluster_addr":"172.21.15.45:6827/78541084","heartbeat_back_addr":"172.21.15.45:6831/78541084","heartbeat_front_addr":"172.21.15.45:6829/78541084","state":["exists","up"]},{"osd":4,"uuid":"ce632829-f027-4fbf-a627-02c571aa9d53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6809","nonce":1537591987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6811","nonce":1537591987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6815","nonce":1537591987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6813","nonce":1537591987}]},"public_addr":"172.21.15.190:6809/1537591987","cluster_addr":"172.21.15.190:6811/1537591987","heartbeat_back_addr":"172.21.15.190:6815/1537591987","heartbeat_front_addr":"172.21.15.190:6813/1537591987","state":["exists","up"]},{"osd":5,"uuid":"8700b609-27be-40bd-a251-4c0ae0a29ead","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6801","nonce":3296698407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6803","nonce":3296698407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6807","nonce":3296698407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6805","nonce":3296698407}]},"public_addr":"172.21.15.190:6801/3296698407","cluster_addr":"172.21.15.190:6803/3296698407","heartbeat_back_addr":"172.21.15.190:6807/3296698407","heartbeat_front_addr":"172.21.15.190:6805/3296698407","state":["exists","up"]},{"osd":6,"uuid":"44ce4a40-e6ff-4f4d-8e8a-7341e5c91f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6817","nonce":2317686718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6819","nonce":2317686718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6823","nonce":2317686718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6821","nonce":2317686718}]},"public_addr":"172.21.15.190:6817/2317686718","cluster_addr":"172.21.15.190:6819/2317686718","heartbeat_back_addr":"172.21.15.190:6823/2317686718","heartbeat_front_addr":"172.21.15.190:6821/2317686718","state":["exists","up"]},{"osd":7,"uuid":"192238c9-1423-4b7e-ac8f-84ba32113ddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6825","nonce":2493232051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6827","nonce":2493232051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6831","nonce":2493232051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6829","nonce":2493232051}]},"public_addr":"172.21.15.190:6825/2493232051","cluster_addr":"172.21.15.190:6827/2493232051","heartbeat_back_addr":"172.21.15.190:6831/2493232051","heartbeat_front_addr":"172.21.15.190:6829/2493232051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.393552+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.385453+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.361421+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.366408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.363226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.276007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.414605+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.445885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T18:49:33.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33.986+0000 7fa03ced6640 1 -- 172.21.15.45:0/4057618739 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa0180668d0 msgr2=0x7fa018068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:33.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33.986+0000 7fa03ced6640 1 --2- 172.21.15.45:0/4057618739 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa0180668d0 0x7fa018068d90 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fa0280ae000 tx=0x7fa0280a7000 comp rx=0 tx=0).stop 2023-11-28T18:49:33.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33.986+0000 7fa03ced6640 1 -- 172.21.15.45:0/4057618739 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa038144880 msgr2=0x7fa0381408c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:33.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33.986+0000 7fa03ced6640 1 --2- 172.21.15.45:0/4057618739 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa038144880 0x7fa0381408c0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fa030009fa0 tx=0x7fa03000d560 comp rx=0 tx=0).stop 2023-11-28T18:49:33.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33.986+0000 7fa03ced6640 1 -- 172.21.15.45:0/4057618739 shutdown_connections 2023-11-28T18:49:33.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33.986+0000 7fa03ced6640 1 --2- 172.21.15.45:0/4057618739 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa0180668d0 0x7fa018068d90 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:33.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33.986+0000 7fa03ced6640 1 --2- 172.21.15.45:0/4057618739 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa038144880 0x7fa0381408c0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:33.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33.986+0000 7fa03ced6640 1 --2- 172.21.15.45:0/4057618739 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa0380721c0 0x7fa03813cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:33.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33.986+0000 7fa03ced6640 1 --2- 172.21.15.45:0/4057618739 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa038070bb0 0x7fa03813d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:33.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33.986+0000 7fa03ced6640 1 -- 172.21.15.45:0/4057618739 >> 172.21.15.45:0/4057618739 conn(0x7fa03806a570 msgr2=0x7fa03813fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:49:33.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33.986+0000 7fa03ced6640 1 -- 172.21.15.45:0/4057618739 shutdown_connections 2023-11-28T18:49:33.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:33.986+0000 7fa03ced6640 1 -- 172.21.15.45:0/4057618739 wait complete. 2023-11-28T18:49:34.006 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T18:37:21.293917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T18:43:57.069740+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T18:43:57.647964+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T18:49:34.007 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T18:49:34.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.110+0000 7feebf432640 1 Processor -- start 2023-11-28T18:49:34.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.110+0000 7feebf432640 1 -- start start 2023-11-28T18:49:34.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.110+0000 7feebf432640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7feeb813cfc0 0x7feeb806f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:34.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.110+0000 7feebf432640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feeb8071560 0x7feeb80719e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:34.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.110+0000 7feebf432640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeb806f460 con 0x7feeb815a730 2023-11-28T18:49:34.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.110+0000 7feebf432640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeb8071f20 con 0x7feeb813cfc0 2023-11-28T18:49:34.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.110+0000 7feebf432640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeb813d3a0 con 0x7feeb8071560 2023-11-28T18:49:34.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.110+0000 7feebd1ce640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7feeb813cfc0 0x7feeb806f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:34.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.110+0000 7feebd1ce640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7feeb813cfc0 0x7feeb806f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40286/0 (socket says 172.21.15.45:40286) 2023-11-28T18:49:34.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.110+0000 7feebd1ce640 1 -- 172.21.15.45:0/3384524839 learned_addr learned my addr 172.21.15.45:0/3384524839 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:49:34.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.110+0000 7feebc9cd640 1 --2- 172.21.15.45:0/3384524839 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feeb8071560 0x7feeb80719e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:34.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.110+0000 7feebd1ce640 1 -- 172.21.15.45:0/3384524839 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feeb8071560 msgr2=0x7feeb80719e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:49:34.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.110+0000 7feebd1ce640 1 --2- 172.21.15.45:0/3384524839 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feeb8071560 0x7feeb80719e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:34.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.110+0000 7feebd1ce640 1 -- 172.21.15.45:0/3384524839 >> v1:172.21.15.190:6789/0 conn(0x7feeb815a730 legacy=0x7feeb815abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:34.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.110+0000 7feebd1ce640 1 -- 172.21.15.45:0/3384524839 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb815b490 con 0x7feeb813cfc0 2023-11-28T18:49:34.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.114+0000 7feebd1ce640 1 --2- 172.21.15.45:0/3384524839 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feeb813cfc0 0x7feeb806f8f0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7feeb4009870 tx=0x7feeb401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1be49537886ee6ce server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:49:34.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.114+0000 7feeaffff640 1 -- 172.21.15.45:0/3384524839 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb40aa620 con 0x7feeb813cfc0 2023-11-28T18:49:34.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.114+0000 7feeaffff640 1 -- 172.21.15.45:0/3384524839 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb40aa780 con 0x7feeb813cfc0 2023-11-28T18:49:34.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.114+0000 7feeaffff640 1 -- 172.21.15.45:0/3384524839 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb40aab10 con 0x7feeb813cfc0 2023-11-28T18:49:34.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.114+0000 7feebf432640 1 -- 172.21.15.45:0/3384524839 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feeb813cfc0 msgr2=0x7feeb806f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:34.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.114+0000 7feebf432640 1 --2- 172.21.15.45:0/3384524839 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feeb813cfc0 0x7feeb806f8f0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7feeb4009870 tx=0x7feeb401c540 comp rx=0 tx=0).stop 2023-11-28T18:49:34.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.114+0000 7feebf432640 1 -- 172.21.15.45:0/3384524839 shutdown_connections 2023-11-28T18:49:34.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.114+0000 7feebf432640 1 --2- 172.21.15.45:0/3384524839 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feeb8071560 0x7feeb80719e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:34.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.114+0000 7feebf432640 1 --2- 172.21.15.45:0/3384524839 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feeb813cfc0 0x7feeb806f8f0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:34.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.114+0000 7feebf432640 1 -- 172.21.15.45:0/3384524839 >> 172.21.15.45:0/3384524839 conn(0x7feeb80b1df0 msgr2=0x7feeb80b2200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:49:34.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.118+0000 7feebf432640 1 -- 172.21.15.45:0/3384524839 shutdown_connections 2023-11-28T18:49:34.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.118+0000 7feebf432640 1 -- 172.21.15.45:0/3384524839 wait complete. 2023-11-28T18:49:34.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.118+0000 7feebf432640 1 Processor -- start 2023-11-28T18:49:34.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.118+0000 7feebf432640 1 -- start start 2023-11-28T18:49:34.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.118+0000 7feebf432640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feeb8071560 0x7feeb813bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:34.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.118+0000 7feebf432640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feeb813cfc0 0x7feeb8137fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:34.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.118+0000 7feebf432640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feeb815a730 0x7feeb814f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:34.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.118+0000 7feebf432640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb81399c0 con 0x7feeb813cfc0 2023-11-28T18:49:34.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.118+0000 7feebf432640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb815ec50 con 0x7feeb815a730 2023-11-28T18:49:34.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.118+0000 7feebf432640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeb8139620 con 0x7feeb8071560 2023-11-28T18:49:34.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.118+0000 7feebc9cd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feeb813cfc0 0x7feeb8137fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:34.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.118+0000 7feebd1ce640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feeb8071560 0x7feeb813bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:34.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.118+0000 7feebc9cd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feeb813cfc0 0x7feeb8137fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40300/0 (socket says 172.21.15.45:40300) 2023-11-28T18:49:34.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.118+0000 7feebc9cd640 1 -- 172.21.15.45:0/248266563 learned_addr learned my addr 172.21.15.45:0/248266563 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:49:34.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.118+0000 7feebd9cf640 1 --2- 172.21.15.45:0/248266563 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feeb815a730 0x7feeb814f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:34.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.118+0000 7feebc9cd640 1 -- 172.21.15.45:0/248266563 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feeb8071560 msgr2=0x7feeb813bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:34.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.118+0000 7feebc9cd640 1 --2- 172.21.15.45:0/248266563 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feeb8071560 0x7feeb813bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:34.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.118+0000 7feebc9cd640 1 -- 172.21.15.45:0/248266563 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feeb815a730 msgr2=0x7feeb814f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:34.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.118+0000 7feebc9cd640 1 --2- 172.21.15.45:0/248266563 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feeb815a730 0x7feeb814f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:34.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.118+0000 7feebc9cd640 1 -- 172.21.15.45:0/248266563 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb40094d0 con 0x7feeb813cfc0 2023-11-28T18:49:34.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.118+0000 7feebd9cf640 1 --2- 172.21.15.45:0/248266563 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feeb815a730 0x7feeb814f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:49:34.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.118+0000 7feebc9cd640 1 --2- 172.21.15.45:0/248266563 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feeb813cfc0 0x7feeb8137fc0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7feea800d800 tx=0x7feea800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:49:34.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.122+0000 7feeadffb640 1 -- 172.21.15.45:0/248266563 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea800b6c0 con 0x7feeb813cfc0 2023-11-28T18:49:34.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.122+0000 7feeadffb640 1 -- 172.21.15.45:0/248266563 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea800b820 con 0x7feeb813cfc0 2023-11-28T18:49:34.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.122+0000 7feeadffb640 1 -- 172.21.15.45:0/248266563 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea800bb90 con 0x7feeb813cfc0 2023-11-28T18:49:34.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.122+0000 7feebf432640 1 -- 172.21.15.45:0/248266563 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeb815eea0 con 0x7feeb813cfc0 2023-11-28T18:49:34.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.122+0000 7feebf432640 1 -- 172.21.15.45:0/248266563 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeb815f180 con 0x7feeb813cfc0 2023-11-28T18:49:34.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.122+0000 7feebf432640 1 -- 172.21.15.45:0/248266563 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeb8139b00 con 0x7feeb813cfc0 2023-11-28T18:49:34.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.122+0000 7feeadffb640 1 -- 172.21.15.45:0/248266563 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7feea800bcf0 con 0x7feeb813cfc0 2023-11-28T18:49:34.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.122+0000 7feeadffb640 1 --2- 172.21.15.45:0/248266563 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fee9c066920 0x7fee9c068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:34.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.122+0000 7feeadffb640 1 -- 172.21.15.45:0/248266563 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feea8084760 con 0x7feeb813cfc0 2023-11-28T18:49:34.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.126+0000 7feebd1ce640 1 --2- 172.21.15.45:0/248266563 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fee9c066920 0x7fee9c068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:34.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.126+0000 7feebd1ce640 1 --2- 172.21.15.45:0/248266563 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fee9c066920 0x7fee9c068de0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7feeb40ae000 tx=0x7feeb40b5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:49:34.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.126+0000 7feeadffb640 1 -- 172.21.15.45:0/248266563 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7feeb8139b00 con 0x7feeb813cfc0 2023-11-28T18:49:34.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.202+0000 7fc8bee79640 1 Processor -- start 2023-11-28T18:49:34.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.202+0000 7fc8bee79640 1 -- start start 2023-11-28T18:49:34.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.202+0000 7fc8bee79640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc8b80d0330 0x7fc8b8168030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:34.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.202+0000 7fc8bee79640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8b80aff70 con 0x7fc8b815d6d0 2023-11-28T18:49:34.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.202+0000 7fc8bee79640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8b80d1f00 con 0x7fc8b815d2f0 2023-11-28T18:49:34.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.202+0000 7fc8bee79640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8b80b0210 con 0x7fc8b80d0330 2023-11-28T18:49:34.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.202+0000 7fc8bd416640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc8b80d0330 0x7fc8b8168030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:34.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.202+0000 7fc8b7fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fc8b815d6d0 0x7fc8b80cfc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38154/0 (socket says 172.21.15.45:38154) 2023-11-28T18:49:34.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.202+0000 7fc8b7fff640 1 -- 172.21.15.45:0/2146775119 learned_addr learned my addr 172.21.15.45:0/2146775119 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:49:34.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.202+0000 7fc8bd416640 1 -- 172.21.15.45:0/2146775119 >> v1:172.21.15.190:6789/0 conn(0x7fc8b815d2f0 legacy=0x7fc8b80d17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:34.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.202+0000 7fc8bd416640 1 -- 172.21.15.45:0/2146775119 >> v1:172.21.15.45:6789/0 conn(0x7fc8b815d6d0 legacy=0x7fc8b80cfc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:34.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.202+0000 7fc8bd416640 1 -- 172.21.15.45:0/2146775119 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8b80b04f0 con 0x7fc8b80d0330 2023-11-28T18:49:34.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.206+0000 7fc8bd416640 1 --2- 172.21.15.45:0/2146775119 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8b80d0330 0x7fc8b8168030 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0009d90 tx=0x7fc8b001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=443da20dc3bf0cff server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:49:34.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.206+0000 7fc8b77fe640 1 -- 172.21.15.45:0/2146775119 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b00a5980 con 0x7fc8b80d0330 2023-11-28T18:49:34.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.206+0000 7fc8b77fe640 1 -- 172.21.15.45:0/2146775119 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8b00a5ae0 con 0x7fc8b80d0330 2023-11-28T18:49:34.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.206+0000 7fc8b77fe640 1 -- 172.21.15.45:0/2146775119 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b00a5e70 con 0x7fc8b80d0330 2023-11-28T18:49:34.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.206+0000 7fc8bee79640 1 -- 172.21.15.45:0/2146775119 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8b80d0330 msgr2=0x7fc8b8168030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:34.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.206+0000 7fc8bee79640 1 --2- 172.21.15.45:0/2146775119 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8b80d0330 0x7fc8b8168030 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0009d90 tx=0x7fc8b001c920 comp rx=0 tx=0).stop 2023-11-28T18:49:34.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.206+0000 7fc8bee79640 1 -- 172.21.15.45:0/2146775119 shutdown_connections 2023-11-28T18:49:34.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.206+0000 7fc8bee79640 1 --2- 172.21.15.45:0/2146775119 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8b80d0330 0x7fc8b8168030 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:34.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.206+0000 7fc8bee79640 1 -- 172.21.15.45:0/2146775119 >> 172.21.15.45:0/2146775119 conn(0x7fc8b809c550 msgr2=0x7fc8b80d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:49:34.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.206+0000 7fc8bee79640 1 -- 172.21.15.45:0/2146775119 shutdown_connections 2023-11-28T18:49:34.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.206+0000 7fc8bee79640 1 -- 172.21.15.45:0/2146775119 wait complete. 2023-11-28T18:49:34.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.210+0000 7fc8bee79640 1 Processor -- start 2023-11-28T18:49:34.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.210+0000 7fc8bee79640 1 -- start start 2023-11-28T18:49:34.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.210+0000 7fc8bee79640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8b80d0330 0x7fc8b8157030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:34.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.210+0000 7fc8bee79640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc8b815d2f0 0x7fc8b80b6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:34.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.210+0000 7fc8bee79640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc8b815d6d0 0x7fc8b80b7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:34.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.210+0000 7fc8bee79640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b80c7780 con 0x7fc8b80d0330 2023-11-28T18:49:34.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.210+0000 7fc8bee79640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b8157570 con 0x7fc8b815d6d0 2023-11-28T18:49:34.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.210+0000 7fc8bee79640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b80c7ba0 con 0x7fc8b815d2f0 2023-11-28T18:49:34.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.210+0000 7fc8bcc15640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8b80d0330 0x7fc8b8157030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:34.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.210+0000 7fc8bcc15640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8b80d0330 0x7fc8b8157030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40314/0 (socket says 172.21.15.45:40314) 2023-11-28T18:49:34.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.210+0000 7fc8bcc15640 1 -- 172.21.15.45:0/4072722333 learned_addr learned my addr 172.21.15.45:0/4072722333 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:49:34.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.210+0000 7fc8b7fff640 1 --2- 172.21.15.45:0/4072722333 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc8b815d2f0 0x7fc8b80b6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:34.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.210+0000 7fc8bd416640 1 --2- 172.21.15.45:0/4072722333 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc8b815d6d0 0x7fc8b80b7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:34.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.210+0000 7fc8bcc15640 1 -- 172.21.15.45:0/4072722333 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc8b815d2f0 msgr2=0x7fc8b80b6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:34.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.210+0000 7fc8bcc15640 1 --2- 172.21.15.45:0/4072722333 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc8b815d2f0 0x7fc8b80b6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:34.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.210+0000 7fc8bcc15640 1 -- 172.21.15.45:0/4072722333 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc8b815d6d0 msgr2=0x7fc8b80b7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:34.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.210+0000 7fc8bcc15640 1 --2- 172.21.15.45:0/4072722333 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc8b815d6d0 0x7fc8b80b7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:34.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.210+0000 7fc8bcc15640 1 -- 172.21.15.45:0/4072722333 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8b0009a70 con 0x7fc8b80d0330 2023-11-28T18:49:34.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.210+0000 7fc8bcc15640 1 --2- 172.21.15.45:0/4072722333 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8b80d0330 0x7fc8b8157030 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac00c530 tx=0x7fc8ac00c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:49:34.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.210+0000 7fc8b57fa640 1 -- 172.21.15.45:0/4072722333 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac005220 con 0x7fc8b80d0330 2023-11-28T18:49:34.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.210+0000 7fc8b57fa640 1 -- 172.21.15.45:0/4072722333 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8ac005380 con 0x7fc8b80d0330 2023-11-28T18:49:34.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.210+0000 7fc8b57fa640 1 -- 172.21.15.45:0/4072722333 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac007270 con 0x7fc8b80d0330 2023-11-28T18:49:34.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.210+0000 7fc8bee79640 1 -- 172.21.15.45:0/4072722333 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8b80b8320 con 0x7fc8b80d0330 2023-11-28T18:49:34.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.210+0000 7fc8bee79640 1 -- 172.21.15.45:0/4072722333 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8b80c6de0 con 0x7fc8b80d0330 2023-11-28T18:49:34.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.214+0000 7fc8bee79640 1 -- 172.21.15.45:0/4072722333 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8b8067a30 con 0x7fc8b80d0330 2023-11-28T18:49:34.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.214+0000 7fc8b57fa640 1 -- 172.21.15.45:0/4072722333 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fc8ac0073d0 con 0x7fc8b80d0330 2023-11-28T18:49:34.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.214+0000 7fc8b57fa640 1 --2- 172.21.15.45:0/4072722333 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fc89c0668d0 0x7fc89c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:34.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.214+0000 7fc8b57fa640 1 -- 172.21.15.45:0/4072722333 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc8ac083b50 con 0x7fc8b80d0330 2023-11-28T18:49:34.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.214+0000 7fc8b7fff640 1 --2- 172.21.15.45:0/4072722333 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fc89c0668d0 0x7fc89c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:34.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.218+0000 7fc8b7fff640 1 --2- 172.21.15.45:0/4072722333 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fc89c0668d0 0x7fc89c068d90 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fc8b80c8dc0 tx=0x7fc8a4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:49:34.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.218+0000 7fc8b57fa640 1 -- 172.21.15.45:0/4072722333 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc8ac050e30 con 0x7fc8b80d0330 2023-11-28T18:49:34.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.290+0000 7feebf432640 1 -- 172.21.15.45:0/248266563 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feeb8139b00 con 0x7feeb813cfc0 2023-11-28T18:49:34.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.294+0000 7feeadffb640 1 -- 172.21.15.45:0/248266563 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+16529 (secure 0 0 0) 0x7feeb8139b00 con 0x7feeb813cfc0 2023-11-28T18:49:34.292 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:49:34.293 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":60,"fsid":"d10f5cd6-1d00-4019-99b6-6fa435498a15","created":"2023-11-28T18:37:08.189030+0000","modified":"2023-11-28T18:44:00.269525+0000","last_up_change":"2023-11-28T18:37:20.196124+0000","last_in_change":"2023-11-28T18:37:10.742043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T18:37:21.293917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-28T18:43:57.069740+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-28T18:43:57.647964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"84465384-103c-4f2c-a45a-96f5bb9c835f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6809","nonce":555237322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6811","nonce":555237322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6815","nonce":555237322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6813","nonce":555237322}]},"public_addr":"172.21.15.45:6809/555237322","cluster_addr":"172.21.15.45:6811/555237322","heartbeat_back_addr":"172.21.15.45:6815/555237322","heartbeat_front_addr":"172.21.15.45:6813/555237322","state":["exists","up"]},{"osd":1,"uuid":"7d9eed24-a58f-42c7-a787-ac06be8553fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6801","nonce":2857063763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6803","nonce":2857063763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6807","nonce":2857063763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6805","nonce":2857063763}]},"public_addr":"172.21.15.45:6801/2857063763","cluster_addr":"172.21.15.45:6803/2857063763","heartbeat_back_addr":"172.21.15.45:6807/2857063763","heartbeat_front_addr":"172.21.15.45:6805/2857063763","state":["exists","up"]},{"osd":2,"uuid":"575eeccc-4abf-45b4-9caf-f3e797859588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6817","nonce":193884539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6819","nonce":193884539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6823","nonce":193884539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6821","nonce":193884539}]},"public_addr":"172.21.15.45:6817/193884539","cluster_addr":"172.21.15.45:6819/193884539","heartbeat_back_addr":"172.21.15.45:6823/193884539","heartbeat_front_addr":"172.21.15.45:6821/193884539","state":["exists","up"]},{"osd":3,"uuid":"9b0290d6-9a52-4bc8-b2a1-7622c5dc8e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6825","nonce":78541084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6827","nonce":78541084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6831","nonce":78541084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6829","nonce":78541084}]},"public_addr":"172.21.15.45:6825/78541084","cluster_addr":"172.21.15.45:6827/78541084","heartbeat_back_addr":"172.21.15.45:6831/78541084","heartbeat_front_addr":"172.21.15.45:6829/78541084","state":["exists","up"]},{"osd":4,"uuid":"ce632829-f027-4fbf-a627-02c571aa9d53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6809","nonce":1537591987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6811","nonce":1537591987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6815","nonce":1537591987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6813","nonce":1537591987}]},"public_addr":"172.21.15.190:6809/1537591987","cluster_addr":"172.21.15.190:6811/1537591987","heartbeat_back_addr":"172.21.15.190:6815/1537591987","heartbeat_front_addr":"172.21.15.190:6813/1537591987","state":["exists","up"]},{"osd":5,"uuid":"8700b609-27be-40bd-a251-4c0ae0a29ead","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6801","nonce":3296698407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6803","nonce":3296698407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6807","nonce":3296698407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6805","nonce":3296698407}]},"public_addr":"172.21.15.190:6801/3296698407","cluster_addr":"172.21.15.190:6803/3296698407","heartbeat_back_addr":"172.21.15.190:6807/3296698407","heartbeat_front_addr":"172.21.15.190:6805/3296698407","state":["exists","up"]},{"osd":6,"uuid":"44ce4a40-e6ff-4f4d-8e8a-7341e5c91f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6817","nonce":2317686718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6819","nonce":2317686718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6823","nonce":2317686718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6821","nonce":2317686718}]},"public_addr":"172.21.15.190:6817/2317686718","cluster_addr":"172.21.15.190:6819/2317686718","heartbeat_back_addr":"172.21.15.190:6823/2317686718","heartbeat_front_addr":"172.21.15.190:6821/2317686718","state":["exists","up"]},{"osd":7,"uuid":"192238c9-1423-4b7e-ac8f-84ba32113ddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6825","nonce":2493232051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6827","nonce":2493232051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6831","nonce":2493232051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6829","nonce":2493232051}]},"public_addr":"172.21.15.190:6825/2493232051","cluster_addr":"172.21.15.190:6827/2493232051","heartbeat_back_addr":"172.21.15.190:6831/2493232051","heartbeat_front_addr":"172.21.15.190:6829/2493232051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.393552+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.385453+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.361421+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.366408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.363226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.276007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.414605+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.445885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T18:49:34.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.294+0000 7feebf432640 1 -- 172.21.15.45:0/248266563 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fee9c066920 msgr2=0x7fee9c068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:34.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.294+0000 7feebf432640 1 --2- 172.21.15.45:0/248266563 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fee9c066920 0x7fee9c068de0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7feeb40ae000 tx=0x7feeb40b5040 comp rx=0 tx=0).stop 2023-11-28T18:49:34.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.294+0000 7feebf432640 1 -- 172.21.15.45:0/248266563 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feeb813cfc0 msgr2=0x7feeb8137fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:34.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.294+0000 7feebf432640 1 --2- 172.21.15.45:0/248266563 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feeb813cfc0 0x7feeb8137fc0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7feea800d800 tx=0x7feea800dcc0 comp rx=0 tx=0).stop 2023-11-28T18:49:34.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.294+0000 7feebf432640 1 -- 172.21.15.45:0/248266563 shutdown_connections 2023-11-28T18:49:34.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.294+0000 7feebf432640 1 --2- 172.21.15.45:0/248266563 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fee9c066920 0x7fee9c068de0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:34.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.294+0000 7feebf432640 1 --2- 172.21.15.45:0/248266563 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feeb815a730 0x7feeb814f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:34.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.294+0000 7feebf432640 1 --2- 172.21.15.45:0/248266563 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feeb813cfc0 0x7feeb8137fc0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:34.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.294+0000 7feebf432640 1 --2- 172.21.15.45:0/248266563 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feeb8071560 0x7feeb813bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:34.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.294+0000 7feebf432640 1 -- 172.21.15.45:0/248266563 >> 172.21.15.45:0/248266563 conn(0x7feeb80b1df0 msgr2=0x7feeb80b05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:49:34.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.294+0000 7feebf432640 1 -- 172.21.15.45:0/248266563 shutdown_connections 2023-11-28T18:49:34.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.294+0000 7feebf432640 1 -- 172.21.15.45:0/248266563 wait complete. 2023-11-28T18:49:34.316 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T18:37:21.293917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T18:43:57.069740+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T18:43:57.647964+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T18:49:34.316 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T18:49:34.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.382+0000 7fc8bee79640 1 -- 172.21.15.45:0/4072722333 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc8b80c79f0 con 0x7fc8b80d0330 2023-11-28T18:49:34.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.382+0000 7fc8b57fa640 1 -- 172.21.15.45:0/4072722333 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v60) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc8ac054450 con 0x7fc8b80d0330 2023-11-28T18:49:34.384 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-11-28T18:49:34.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.386+0000 7fc8bee79640 1 -- 172.21.15.45:0/4072722333 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fc89c0668d0 msgr2=0x7fc89c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:34.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.386+0000 7fc8bee79640 1 --2- 172.21.15.45:0/4072722333 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fc89c0668d0 0x7fc89c068d90 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fc8b80c8dc0 tx=0x7fc8a4009040 comp rx=0 tx=0).stop 2023-11-28T18:49:34.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.386+0000 7fc8bee79640 1 -- 172.21.15.45:0/4072722333 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8b80d0330 msgr2=0x7fc8b8157030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:34.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.386+0000 7fc8bee79640 1 --2- 172.21.15.45:0/4072722333 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8b80d0330 0x7fc8b8157030 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac00c530 tx=0x7fc8ac00c9f0 comp rx=0 tx=0).stop 2023-11-28T18:49:34.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.386+0000 7fc8bee79640 1 -- 172.21.15.45:0/4072722333 shutdown_connections 2023-11-28T18:49:34.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.386+0000 7fc8bee79640 1 --2- 172.21.15.45:0/4072722333 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fc89c0668d0 0x7fc89c068d90 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:34.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.386+0000 7fc8bee79640 1 --2- 172.21.15.45:0/4072722333 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc8b815d6d0 0x7fc8b80b7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:34.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.386+0000 7fc8bee79640 1 --2- 172.21.15.45:0/4072722333 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc8b815d2f0 0x7fc8b80b6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:34.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.386+0000 7fc8bee79640 1 --2- 172.21.15.45:0/4072722333 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8b80d0330 0x7fc8b8157030 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:34.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.386+0000 7fc8bee79640 1 -- 172.21.15.45:0/4072722333 >> 172.21.15.45:0/4072722333 conn(0x7fc8b809c550 msgr2=0x7fc8b80cdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:49:34.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.386+0000 7fc8bee79640 1 -- 172.21.15.45:0/4072722333 shutdown_connections 2023-11-28T18:49:34.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.386+0000 7fc8bee79640 1 -- 172.21.15.45:0/4072722333 wait complete. 2023-11-28T18:49:34.406 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T18:49:34.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.466+0000 7f399752a640 1 Processor -- start 2023-11-28T18:49:34.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.466+0000 7f399752a640 1 -- start start 2023-11-28T18:49:34.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.466+0000 7f399752a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f399015d6d0 0x7f39900cfc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:34.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.466+0000 7f399752a640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39900d05b0 con 0x7f39900d0160 2023-11-28T18:49:34.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.466+0000 7f399752a640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39900aff70 con 0x7f399015d2f0 2023-11-28T18:49:34.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.466+0000 7f399752a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39900d1f00 con 0x7f399015d6d0 2023-11-28T18:49:34.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.466+0000 7f3995ac7640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f39900d0160 0x7f39900b0cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38162/0 (socket says 172.21.15.45:38162) 2023-11-28T18:49:34.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.466+0000 7f3995ac7640 1 -- 172.21.15.45:0/2396221074 learned_addr learned my addr 172.21.15.45:0/2396221074 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:49:34.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.466+0000 7f3994ac5640 1 --2- 172.21.15.45:0/2396221074 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f399015d6d0 0x7f39900cfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:34.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.466+0000 7f3987fff640 1 -- 172.21.15.45:0/2396221074 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2247775830 0 0) 0x7f39880014a0 con 0x7f39900d0160 2023-11-28T18:49:34.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.466+0000 7f3987fff640 1 -- 172.21.15.45:0/2396221074 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f397c003530 con 0x7f39900d0160 2023-11-28T18:49:34.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.466+0000 7f3987fff640 1 -- 172.21.15.45:0/2396221074 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 70616753 0 0) 0x7f39900aff70 con 0x7f399015d2f0 2023-11-28T18:49:34.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.466+0000 7f3987fff640 1 -- 172.21.15.45:0/2396221074 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39880014a0 con 0x7f399015d2f0 2023-11-28T18:49:34.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.466+0000 7f3987fff640 1 -- 172.21.15.45:0/2396221074 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3595662549 0 0) 0x7f397c003530 con 0x7f39900d0160 2023-11-28T18:49:34.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.466+0000 7f3987fff640 1 -- 172.21.15.45:0/2396221074 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f399015d6d0 msgr2=0x7f39900cfc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:49:34.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.466+0000 7f3987fff640 1 --2- 172.21.15.45:0/2396221074 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f399015d6d0 0x7f39900cfc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:34.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.466+0000 7f3987fff640 1 -- 172.21.15.45:0/2396221074 >> v1:172.21.15.190:6789/0 conn(0x7f399015d2f0 legacy=0x7f39900d17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:34.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.466+0000 7f3987fff640 1 -- 172.21.15.45:0/2396221074 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39900b0210 con 0x7f39900d0160 2023-11-28T18:49:34.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.466+0000 7f3987fff640 1 -- 172.21.15.45:0/2396221074 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4084481567 0 0) 0x7f3988001b90 con 0x7f39900d0160 2023-11-28T18:49:34.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.466+0000 7f3994ac5640 1 --2- 172.21.15.45:0/2396221074 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f399015d6d0 0x7f39900cfc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:49:34.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.466+0000 7f3987fff640 1 -- 172.21.15.45:0/2396221074 >> v1:172.21.15.45:6789/0 conn(0x7f39900d0160 legacy=0x7f39900b0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:34.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.466+0000 7f3987fff640 1 --2- 172.21.15.45:0/2396221074 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f397c003b40 0x7f397c003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:34.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.470+0000 7f3987fff640 1 --2- 172.21.15.45:0/2396221074 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f397c0047d0 0x7f397c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:34.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.470+0000 7f3987fff640 1 --2- 172.21.15.45:0/2396221074 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f397c005190 0x7f397c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:34.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.470+0000 7f3987fff640 1 -- 172.21.15.45:0/2396221074 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39900d1f00 con 0x7f397c005190 2023-11-28T18:49:34.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.470+0000 7f3987fff640 1 -- 172.21.15.45:0/2396221074 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f397c00bfb0 con 0x7f397c0047d0 2023-11-28T18:49:34.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.470+0000 7f3987fff640 1 -- 172.21.15.45:0/2396221074 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f397c00c170 con 0x7f397c003b40 2023-11-28T18:49:34.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.470+0000 7f39952c6640 1 --2- 172.21.15.45:0/2396221074 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f397c003b40 0x7f397c003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:34.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.470+0000 7f3994ac5640 1 --2- 172.21.15.45:0/2396221074 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f397c0047d0 0x7f397c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:34.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.470+0000 7f3995ac7640 1 --2- 172.21.15.45:0/2396221074 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f397c005190 0x7f397c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:34.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.470+0000 7f39952c6640 1 -- 172.21.15.45:0/2396221074 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f397c0047d0 msgr2=0x7f397c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:49:34.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.470+0000 7f39952c6640 1 --2- 172.21.15.45:0/2396221074 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f397c0047d0 0x7f397c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:34.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.470+0000 7f39952c6640 1 -- 172.21.15.45:0/2396221074 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f397c005190 msgr2=0x7f397c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:49:34.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.470+0000 7f39952c6640 1 --2- 172.21.15.45:0/2396221074 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f397c005190 0x7f397c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:34.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.470+0000 7f39952c6640 1 -- 172.21.15.45:0/2396221074 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f397c003530 con 0x7f397c003b40 2023-11-28T18:49:34.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.470+0000 7f3995ac7640 1 --2- 172.21.15.45:0/2396221074 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f397c005190 0x7f397c00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:49:34.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.470+0000 7f39952c6640 1 --2- 172.21.15.45:0/2396221074 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f397c003b40 0x7f397c003f40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f398c0018d0 tx=0x7f398c01c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31ad9667b02526ac server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:49:34.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.470+0000 7f3987fff640 1 -- 172.21.15.45:0/2396221074 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f398c0a6040 con 0x7f397c003b40 2023-11-28T18:49:34.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.470+0000 7f3987fff640 1 -- 172.21.15.45:0/2396221074 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f398c0052f0 con 0x7f397c003b40 2023-11-28T18:49:34.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.470+0000 7f3987fff640 1 -- 172.21.15.45:0/2396221074 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f398c003600 con 0x7f397c003b40 2023-11-28T18:49:34.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.474+0000 7f399752a640 1 -- 172.21.15.45:0/2396221074 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f397c003b40 msgr2=0x7f397c003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:34.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.474+0000 7f399752a640 1 --2- 172.21.15.45:0/2396221074 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f397c003b40 0x7f397c003f40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f398c0018d0 tx=0x7f398c01c560 comp rx=0 tx=0).stop 2023-11-28T18:49:34.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.474+0000 7f3995ac7640 1 -- 172.21.15.45:0/2396221074 reap_dead start 2023-11-28T18:49:34.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.474+0000 7f399752a640 1 -- 172.21.15.45:0/2396221074 shutdown_connections 2023-11-28T18:49:34.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.474+0000 7f399752a640 1 -- 172.21.15.45:0/2396221074 >> 172.21.15.45:0/2396221074 conn(0x7f399009c550 msgr2=0x7f39900d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:49:34.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.474+0000 7f399752a640 1 -- 172.21.15.45:0/2396221074 shutdown_connections 2023-11-28T18:49:34.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.474+0000 7f399752a640 1 -- 172.21.15.45:0/2396221074 wait complete. 2023-11-28T18:49:34.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.474+0000 7f399752a640 1 Processor -- start 2023-11-28T18:49:34.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.474+0000 7f399752a640 1 -- start start 2023-11-28T18:49:34.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.474+0000 7f399752a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f397c003b40 0x7f399015bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:34.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.474+0000 7f399752a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f39900cbaa0 0x7f39900cbf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:34.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.474+0000 7f399752a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39900ca2e0 0x7f39900ca760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:34.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.474+0000 7f399752a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39900c8340 con 0x7f39900ca2e0 2023-11-28T18:49:34.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.474+0000 7f399752a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39900cc440 con 0x7f397c003b40 2023-11-28T18:49:34.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.474+0000 7f399752a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39900caca0 con 0x7f39900cbaa0 2023-11-28T18:49:34.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.474+0000 7f3995ac7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39900ca2e0 0x7f39900ca760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:34.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.474+0000 7f3995ac7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39900ca2e0 0x7f39900ca760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40338/0 (socket says 172.21.15.45:40338) 2023-11-28T18:49:34.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.478+0000 7f3995ac7640 1 -- 172.21.15.45:0/245339994 learned_addr learned my addr 172.21.15.45:0/245339994 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:49:34.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.478+0000 7f39952c6640 1 --2- 172.21.15.45:0/245339994 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f397c003b40 0x7f399015bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:34.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.478+0000 7f3994ac5640 1 --2- 172.21.15.45:0/245339994 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f39900cbaa0 0x7f39900cbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:34.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.478+0000 7f3995ac7640 1 -- 172.21.15.45:0/245339994 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f39900cbaa0 msgr2=0x7f39900cbf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:34.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.478+0000 7f3995ac7640 1 --2- 172.21.15.45:0/245339994 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f39900cbaa0 0x7f39900cbf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:34.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.478+0000 7f3995ac7640 1 -- 172.21.15.45:0/245339994 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f397c003b40 msgr2=0x7f399015bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:34.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.478+0000 7f3995ac7640 1 --2- 172.21.15.45:0/245339994 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f397c003b40 0x7f399015bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:34.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.478+0000 7f3995ac7640 1 -- 172.21.15.45:0/245339994 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39901607a0 con 0x7f39900ca2e0 2023-11-28T18:49:34.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.478+0000 7f3995ac7640 1 --2- 172.21.15.45:0/245339994 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39900ca2e0 0x7f39900ca760 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f399008d7b0 tx=0x7f3988011c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:49:34.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.478+0000 7f3985ffb640 1 -- 172.21.15.45:0/245339994 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f398801a030 con 0x7f39900ca2e0 2023-11-28T18:49:34.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.478+0000 7f3985ffb640 1 -- 172.21.15.45:0/245339994 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f398800f8a0 con 0x7f39900ca2e0 2023-11-28T18:49:34.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.478+0000 7f3985ffb640 1 -- 172.21.15.45:0/245339994 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f398800fc50 con 0x7f39900ca2e0 2023-11-28T18:49:34.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.478+0000 7f399752a640 1 -- 172.21.15.45:0/245339994 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39900c7f80 con 0x7f39900ca2e0 2023-11-28T18:49:34.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.478+0000 7f399752a640 1 -- 172.21.15.45:0/245339994 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39900cb1d0 con 0x7f39900ca2e0 2023-11-28T18:49:34.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.478+0000 7f399752a640 1 -- 172.21.15.45:0/245339994 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3990067a30 con 0x7f39900ca2e0 2023-11-28T18:49:34.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.478+0000 7f3985ffb640 1 -- 172.21.15.45:0/245339994 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f398801d070 con 0x7f39900ca2e0 2023-11-28T18:49:34.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.482+0000 7f3985ffb640 1 --2- 172.21.15.45:0/245339994 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f3974066900 0x7f3974068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:34.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.482+0000 7f3985ffb640 1 -- 172.21.15.45:0/245339994 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f398801b070 con 0x7f39900ca2e0 2023-11-28T18:49:34.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.482+0000 7f39952c6640 1 --2- 172.21.15.45:0/245339994 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f3974066900 0x7f3974068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:34.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.482+0000 7f39952c6640 1 --2- 172.21.15.45:0/245339994 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f3974066900 0x7f3974068dc0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f398c0ac000 tx=0x7f398c0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:49:34.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.490+0000 7f3985ffb640 1 -- 172.21.15.45:0/245339994 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3988053fc0 con 0x7f39900ca2e0 2023-11-28T18:49:34.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.558+0000 7fb808957640 1 Processor -- start 2023-11-28T18:49:34.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.562+0000 7fb808957640 1 -- start start 2023-11-28T18:49:34.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.562+0000 7fb808957640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb80415d2f0 0x7fb8040d17f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:34.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.562+0000 7fb808957640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb8040d1d30 0x7fb8040cfc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:34.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.562+0000 7fb808957640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8040aff70 con 0x7fb80415d6d0 2023-11-28T18:49:34.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.562+0000 7fb808957640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8040b0210 con 0x7fb80415d2f0 2023-11-28T18:49:34.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.562+0000 7fb808957640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8040b04f0 con 0x7fb8040d1d30 2023-11-28T18:49:34.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.562+0000 7fb80259c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb80415d2f0 0x7fb8040d17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:34.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.562+0000 7fb80259c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb80415d2f0 0x7fb8040d17f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40352/0 (socket says 172.21.15.45:40352) 2023-11-28T18:49:34.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.562+0000 7fb80259c640 1 -- 172.21.15.45:0/747633722 learned_addr learned my addr 172.21.15.45:0/747633722 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:49:34.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.562+0000 7fb80259c640 1 -- 172.21.15.45:0/747633722 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb8040d1d30 msgr2=0x7fb8040cfc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:49:34.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.562+0000 7fb801d9b640 1 --2- 172.21.15.45:0/747633722 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb8040d1d30 0x7fb8040cfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:34.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.562+0000 7fb80259c640 1 --2- 172.21.15.45:0/747633722 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb8040d1d30 0x7fb8040cfc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:34.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.562+0000 7fb80259c640 1 -- 172.21.15.45:0/747633722 >> v1:172.21.15.190:6789/0 conn(0x7fb80415d6d0 legacy=0x7fb8040cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:34.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.562+0000 7fb80259c640 1 -- 172.21.15.45:0/747633722 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8040b07d0 con 0x7fb80415d2f0 2023-11-28T18:49:34.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.562+0000 7fb801d9b640 1 --2- 172.21.15.45:0/747633722 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb8040d1d30 0x7fb8040cfc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:49:34.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.566+0000 7fb80259c640 1 --2- 172.21.15.45:0/747633722 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb80415d2f0 0x7fb8040d17f0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fb7f4009870 tx=0x7fb7f401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e15a63446515660 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:49:34.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.566+0000 7fb80159a640 1 -- 172.21.15.45:0/747633722 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f40aa640 con 0x7fb80415d2f0 2023-11-28T18:49:34.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.566+0000 7fb80159a640 1 -- 172.21.15.45:0/747633722 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7f40aa7a0 con 0x7fb80415d2f0 2023-11-28T18:49:34.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.566+0000 7fb80159a640 1 -- 172.21.15.45:0/747633722 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f40aab30 con 0x7fb80415d2f0 2023-11-28T18:49:34.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.566+0000 7fb808957640 1 -- 172.21.15.45:0/747633722 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb80415d2f0 msgr2=0x7fb8040d17f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:34.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.566+0000 7fb808957640 1 --2- 172.21.15.45:0/747633722 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb80415d2f0 0x7fb8040d17f0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fb7f4009870 tx=0x7fb7f401c540 comp rx=0 tx=0).stop 2023-11-28T18:49:34.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.566+0000 7fb808957640 1 -- 172.21.15.45:0/747633722 shutdown_connections 2023-11-28T18:49:34.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.566+0000 7fb808957640 1 --2- 172.21.15.45:0/747633722 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb8040d1d30 0x7fb8040cfc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:34.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.566+0000 7fb808957640 1 --2- 172.21.15.45:0/747633722 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb80415d2f0 0x7fb8040d17f0 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:34.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.566+0000 7fb808957640 1 -- 172.21.15.45:0/747633722 >> 172.21.15.45:0/747633722 conn(0x7fb80409c550 msgr2=0x7fb8040d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:49:34.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.566+0000 7fb808957640 1 -- 172.21.15.45:0/747633722 shutdown_connections 2023-11-28T18:49:34.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.566+0000 7fb808957640 1 -- 172.21.15.45:0/747633722 wait complete. 2023-11-28T18:49:34.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.570+0000 7fb808957640 1 Processor -- start 2023-11-28T18:49:34.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.570+0000 7fb808957640 1 -- start start 2023-11-28T18:49:34.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.570+0000 7fb808957640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8040d1d30 0x7fb80415fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:34.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.570+0000 7fb808957640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb80415d2f0 0x7fb804150770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:34.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.570+0000 7fb808957640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb80415d6d0 0x7fb804155650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:34.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.570+0000 7fb808957640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8040cb240 con 0x7fb80415d2f0 2023-11-28T18:49:34.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.570+0000 7fb808957640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8040ca630 con 0x7fb8040d1d30 2023-11-28T18:49:34.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.570+0000 7fb808957640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8040ca910 con 0x7fb80415d6d0 2023-11-28T18:49:34.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.570+0000 7fb801d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb80415d2f0 0x7fb804150770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:34.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.570+0000 7fb80259c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8040d1d30 0x7fb80415fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:34.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.570+0000 7fb80259c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8040d1d30 0x7fb80415fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.45:49952/0 (socket says 172.21.15.45:49952) 2023-11-28T18:49:34.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.570+0000 7fb80259c640 1 -- 172.21.15.45:0/2254968758 learned_addr learned my addr 172.21.15.45:0/2254968758 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:49:34.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.570+0000 7fb801d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb80415d2f0 0x7fb804150770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40366/0 (socket says 172.21.15.45:40366) 2023-11-28T18:49:34.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.570+0000 7fb802d9d640 1 --2- 172.21.15.45:0/2254968758 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb80415d6d0 0x7fb804155650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:34.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.570+0000 7fb80259c640 1 -- 172.21.15.45:0/2254968758 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb80415d6d0 msgr2=0x7fb804155650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:34.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.570+0000 7fb80259c640 1 --2- 172.21.15.45:0/2254968758 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb80415d6d0 0x7fb804155650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:34.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.570+0000 7fb80259c640 1 -- 172.21.15.45:0/2254968758 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb80415d2f0 msgr2=0x7fb804150770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:34.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.570+0000 7fb80259c640 1 --2- 172.21.15.45:0/2254968758 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb80415d2f0 0x7fb804150770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:34.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.570+0000 7fb80259c640 1 -- 172.21.15.45:0/2254968758 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f40094d0 con 0x7fb8040d1d30 2023-11-28T18:49:34.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.570+0000 7fb801d9b640 1 --2- 172.21.15.45:0/2254968758 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb80415d2f0 0x7fb804150770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:49:34.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.570+0000 7fb80259c640 1 --2- 172.21.15.45:0/2254968758 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8040d1d30 0x7fb80415fb70 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fb7f40ac040 tx=0x7fb7f401ad80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:49:34.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.570+0000 7fb7f2ffd640 1 -- 172.21.15.45:0/2254968758 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f40bd5f0 con 0x7fb8040d1d30 2023-11-28T18:49:34.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.570+0000 7fb7f2ffd640 1 -- 172.21.15.45:0/2254968758 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7f40bd750 con 0x7fb8040d1d30 2023-11-28T18:49:34.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.570+0000 7fb808957640 1 -- 172.21.15.45:0/2254968758 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8040cabf0 con 0x7fb8040d1d30 2023-11-28T18:49:34.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.570+0000 7fb7f2ffd640 1 -- 172.21.15.45:0/2254968758 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f40bdb00 con 0x7fb8040d1d30 2023-11-28T18:49:34.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.570+0000 7fb808957640 1 -- 172.21.15.45:0/2254968758 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8040ca2e0 con 0x7fb8040d1d30 2023-11-28T18:49:34.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.570+0000 7fb808957640 1 -- 172.21.15.45:0/2254968758 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb804067a30 con 0x7fb8040d1d30 2023-11-28T18:49:34.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.574+0000 7fb7f2ffd640 1 -- 172.21.15.45:0/2254968758 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fb7f40a8050 con 0x7fb8040d1d30 2023-11-28T18:49:34.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.574+0000 7fb7f2ffd640 1 --2- 172.21.15.45:0/2254968758 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fb7e40668d0 0x7fb7e4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:34.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.574+0000 7fb7f2ffd640 1 -- 172.21.15.45:0/2254968758 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb7f411ed70 con 0x7fb8040d1d30 2023-11-28T18:49:34.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.574+0000 7fb801d9b640 1 --2- 172.21.15.45:0/2254968758 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fb7e40668d0 0x7fb7e4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:34.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.574+0000 7fb801d9b640 1 --2- 172.21.15.45:0/2254968758 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fb7e40668d0 0x7fb7e4068d90 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fb8040a1120 tx=0x7fb7f8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:49:34.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.578+0000 7fb7f2ffd640 1 -- 172.21.15.45:0/2254968758 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb7f40ec040 con 0x7fb8040d1d30 2023-11-28T18:49:34.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.650+0000 7f399752a640 1 -- 172.21.15.45:0/245339994 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f39900c8480 con 0x7f39900ca2e0 2023-11-28T18:49:34.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.650+0000 7f3985ffb640 1 -- 172.21.15.45:0/245339994 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v60) v1 ==== 93+0+10 (secure 0 0 0) 0x7f39900c8480 con 0x7f39900ca2e0 2023-11-28T18:49:34.650 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-11-28T18:49:34.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.654+0000 7f399752a640 1 -- 172.21.15.45:0/245339994 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f3974066900 msgr2=0x7f3974068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:34.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.654+0000 7f399752a640 1 --2- 172.21.15.45:0/245339994 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f3974066900 0x7f3974068dc0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f398c0ac000 tx=0x7f398c0a7000 comp rx=0 tx=0).stop 2023-11-28T18:49:34.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.654+0000 7f399752a640 1 -- 172.21.15.45:0/245339994 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39900ca2e0 msgr2=0x7f39900ca760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:34.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.654+0000 7f399752a640 1 --2- 172.21.15.45:0/245339994 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39900ca2e0 0x7f39900ca760 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f399008d7b0 tx=0x7f3988011c20 comp rx=0 tx=0).stop 2023-11-28T18:49:34.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.654+0000 7f399752a640 1 -- 172.21.15.45:0/245339994 shutdown_connections 2023-11-28T18:49:34.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.654+0000 7f399752a640 1 --2- 172.21.15.45:0/245339994 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f3974066900 0x7f3974068dc0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:34.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.654+0000 7f399752a640 1 --2- 172.21.15.45:0/245339994 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39900ca2e0 0x7f39900ca760 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:34.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.654+0000 7f399752a640 1 --2- 172.21.15.45:0/245339994 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f39900cbaa0 0x7f39900cbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:34.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.654+0000 7f399752a640 1 --2- 172.21.15.45:0/245339994 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f397c003b40 0x7f399015bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:34.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.654+0000 7f399752a640 1 -- 172.21.15.45:0/245339994 >> 172.21.15.45:0/245339994 conn(0x7f399009c550 msgr2=0x7f39900b0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:49:34.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.654+0000 7f399752a640 1 -- 172.21.15.45:0/245339994 shutdown_connections 2023-11-28T18:49:34.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.654+0000 7f399752a640 1 -- 172.21.15.45:0/245339994 wait complete. 2023-11-28T18:49:34.672 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T18:49:34.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.738+0000 7fb808957640 1 -- 172.21.15.45:0/2254968758 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb8040caa50 con 0x7fb8040d1d30 2023-11-28T18:49:34.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.738+0000 7fb7f2ffd640 1 -- 172.21.15.45:0/2254968758 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v60) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb8040caa50 con 0x7fb8040d1d30 2023-11-28T18:49:34.737 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-11-28T18:49:34.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.738+0000 7fb808957640 1 -- 172.21.15.45:0/2254968758 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fb7e40668d0 msgr2=0x7fb7e4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:34.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.738+0000 7fb808957640 1 --2- 172.21.15.45:0/2254968758 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fb7e40668d0 0x7fb7e4068d90 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fb8040a1120 tx=0x7fb7f8008040 comp rx=0 tx=0).stop 2023-11-28T18:49:34.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.738+0000 7fb808957640 1 -- 172.21.15.45:0/2254968758 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8040d1d30 msgr2=0x7fb80415fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:34.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.738+0000 7fb808957640 1 --2- 172.21.15.45:0/2254968758 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8040d1d30 0x7fb80415fb70 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fb7f40ac040 tx=0x7fb7f401ad80 comp rx=0 tx=0).stop 2023-11-28T18:49:34.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.738+0000 7fb808957640 1 -- 172.21.15.45:0/2254968758 shutdown_connections 2023-11-28T18:49:34.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.738+0000 7fb808957640 1 --2- 172.21.15.45:0/2254968758 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fb7e40668d0 0x7fb7e4068d90 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:34.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.738+0000 7fb808957640 1 --2- 172.21.15.45:0/2254968758 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb80415d6d0 0x7fb804155650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:34.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.738+0000 7fb808957640 1 --2- 172.21.15.45:0/2254968758 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb80415d2f0 0x7fb804150770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:34.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.738+0000 7fb808957640 1 --2- 172.21.15.45:0/2254968758 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8040d1d30 0x7fb80415fb70 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:34.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.738+0000 7fb808957640 1 -- 172.21.15.45:0/2254968758 >> 172.21.15.45:0/2254968758 conn(0x7fb80409c550 msgr2=0x7fb8040b2a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:49:34.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.738+0000 7fb808957640 1 -- 172.21.15.45:0/2254968758 shutdown_connections 2023-11-28T18:49:34.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.738+0000 7fb808957640 1 -- 172.21.15.45:0/2254968758 wait complete. 2023-11-28T18:49:34.758 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T18:49:34.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.822+0000 7f9ddd617640 1 Processor -- start 2023-11-28T18:49:34.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.822+0000 7f9ddd617640 1 -- start start 2023-11-28T18:49:34.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.822+0000 7f9ddd617640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9dd815d2f0 0x7f9dd80d17f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:34.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.822+0000 7f9ddd617640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9dd80d0330 0x7f9dd80b0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:34.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.822+0000 7f9ddd617640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dd80aff70 con 0x7f9dd80d1d30 2023-11-28T18:49:34.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.822+0000 7f9ddd617640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dd80b0210 con 0x7f9dd80d0330 2023-11-28T18:49:34.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.822+0000 7f9ddd617640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd80b04f0 con 0x7f9dd815d2f0 2023-11-28T18:49:34.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.822+0000 7f9dd77fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9dd80d0330 0x7f9dd80b0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:34.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.822+0000 7f9dd77fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9dd80d0330 0x7f9dd80b0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40372/0 (socket says 172.21.15.45:40372) 2023-11-28T18:49:34.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.822+0000 7f9dd67fc640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f9dd80d1d30 0x7f9dd80cfc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38164/0 (socket says 172.21.15.45:38164) 2023-11-28T18:49:34.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.822+0000 7f9dd77fe640 1 -- 172.21.15.45:0/2788517187 learned_addr learned my addr 172.21.15.45:0/2788517187 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:49:34.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.822+0000 7f9dd6ffd640 1 --2- 172.21.15.45:0/2788517187 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9dd815d2f0 0x7f9dd80d17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:34.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.822+0000 7f9dd77fe640 1 -- 172.21.15.45:0/2788517187 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9dd815d2f0 msgr2=0x7f9dd80d17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:49:34.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.822+0000 7f9dd77fe640 1 --2- 172.21.15.45:0/2788517187 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9dd815d2f0 0x7f9dd80d17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:34.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.822+0000 7f9dd77fe640 1 -- 172.21.15.45:0/2788517187 >> v1:172.21.15.45:6789/0 conn(0x7f9dd80d1d30 legacy=0x7f9dd80cfc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:34.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.822+0000 7f9dd77fe640 1 -- 172.21.15.45:0/2788517187 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dd80b07d0 con 0x7f9dd80d0330 2023-11-28T18:49:34.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.822+0000 7f9dd5ffb640 1 -- 172.21.15.45:0/2788517187 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1002024736 0 0) 0x7f9dd80aff70 con 0x7f9dd80d1d30 2023-11-28T18:49:34.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.826+0000 7f9dd77fe640 1 --2- 172.21.15.45:0/2788517187 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9dd80d0330 0x7f9dd80b0cf0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f9dd0009e50 tx=0x7f9dd001ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40bd214dfeb7d38d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:49:34.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.826+0000 7f9dd5ffb640 1 -- 172.21.15.45:0/2788517187 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd00a5880 con 0x7f9dd80d0330 2023-11-28T18:49:34.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.826+0000 7f9dd5ffb640 1 -- 172.21.15.45:0/2788517187 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dd00a59e0 con 0x7f9dd80d0330 2023-11-28T18:49:34.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.826+0000 7f9dd5ffb640 1 -- 172.21.15.45:0/2788517187 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd00a5d70 con 0x7f9dd80d0330 2023-11-28T18:49:34.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.826+0000 7f9ddd617640 1 -- 172.21.15.45:0/2788517187 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9dd80d0330 msgr2=0x7f9dd80b0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:34.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.826+0000 7f9ddd617640 1 --2- 172.21.15.45:0/2788517187 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9dd80d0330 0x7f9dd80b0cf0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f9dd0009e50 tx=0x7f9dd001ca10 comp rx=0 tx=0).stop 2023-11-28T18:49:34.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.826+0000 7f9ddd617640 1 -- 172.21.15.45:0/2788517187 shutdown_connections 2023-11-28T18:49:34.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.826+0000 7f9ddd617640 1 --2- 172.21.15.45:0/2788517187 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9dd80d0330 0x7f9dd80b0cf0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:34.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.826+0000 7f9ddd617640 1 --2- 172.21.15.45:0/2788517187 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9dd815d2f0 0x7f9dd80d17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:34.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.826+0000 7f9ddd617640 1 -- 172.21.15.45:0/2788517187 >> 172.21.15.45:0/2788517187 conn(0x7f9dd809c550 msgr2=0x7f9dd80d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:49:34.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.826+0000 7f9ddd617640 1 -- 172.21.15.45:0/2788517187 shutdown_connections 2023-11-28T18:49:34.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.826+0000 7f9ddd617640 1 -- 172.21.15.45:0/2788517187 wait complete. 2023-11-28T18:49:34.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.830+0000 7f9ddd617640 1 Processor -- start 2023-11-28T18:49:34.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.830+0000 7f9ddd617640 1 -- start start 2023-11-28T18:49:34.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.830+0000 7f9ddd617640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9dd80d0330 0x7f9dd80b7c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:34.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.830+0000 7f9ddd617640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9dd80d1d30 0x7f9dd8154280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:34.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.830+0000 7f9ddd617640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9dd815d2f0 0x7f9dd81547c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:34.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.830+0000 7f9ddd617640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd80b9130 con 0x7f9dd815d2f0 2023-11-28T18:49:34.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.830+0000 7f9ddd617640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd80b6260 con 0x7f9dd80d1d30 2023-11-28T18:49:34.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.830+0000 7f9ddd617640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd80b8650 con 0x7f9dd80d0330 2023-11-28T18:49:34.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.830+0000 7f9dd77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9dd815d2f0 0x7f9dd81547c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:34.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.830+0000 7f9dd6ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9dd80d0330 0x7f9dd80b7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:34.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.830+0000 7f9dd77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9dd815d2f0 0x7f9dd81547c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40386/0 (socket says 172.21.15.45:40386) 2023-11-28T18:49:34.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.830+0000 7f9dd77fe640 1 -- 172.21.15.45:0/3092027637 learned_addr learned my addr 172.21.15.45:0/3092027637 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:49:34.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.830+0000 7f9dd67fc640 1 --2- 172.21.15.45:0/3092027637 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9dd80d1d30 0x7f9dd8154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:34.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.830+0000 7f9dd77fe640 1 -- 172.21.15.45:0/3092027637 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9dd80d0330 msgr2=0x7f9dd80b7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:34.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.830+0000 7f9dd77fe640 1 --2- 172.21.15.45:0/3092027637 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9dd80d0330 0x7f9dd80b7c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:34.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.830+0000 7f9dd77fe640 1 -- 172.21.15.45:0/3092027637 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9dd80d1d30 msgr2=0x7f9dd8154280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:34.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.830+0000 7f9dd77fe640 1 --2- 172.21.15.45:0/3092027637 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9dd80d1d30 0x7f9dd8154280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:34.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.830+0000 7f9dd77fe640 1 -- 172.21.15.45:0/3092027637 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dd0009b30 con 0x7f9dd815d2f0 2023-11-28T18:49:34.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.830+0000 7f9dd77fe640 1 --2- 172.21.15.45:0/3092027637 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9dd815d2f0 0x7f9dd81547c0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f9dd001a640 tx=0x7f9dd00197b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:49:34.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.830+0000 7f9dbf7fe640 1 -- 172.21.15.45:0/3092027637 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd00b8670 con 0x7f9dd815d2f0 2023-11-28T18:49:34.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.830+0000 7f9dbf7fe640 1 -- 172.21.15.45:0/3092027637 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dd00b87f0 con 0x7f9dd815d2f0 2023-11-28T18:49:34.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.830+0000 7f9dbf7fe640 1 -- 172.21.15.45:0/3092027637 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd00b8ba0 con 0x7f9dd815d2f0 2023-11-28T18:49:34.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.830+0000 7f9ddd617640 1 -- 172.21.15.45:0/3092027637 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dd80b8930 con 0x7f9dd815d2f0 2023-11-28T18:49:34.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.830+0000 7f9ddd617640 1 -- 172.21.15.45:0/3092027637 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dd80b6540 con 0x7f9dd815d2f0 2023-11-28T18:49:34.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.830+0000 7f9ddd617640 1 -- 172.21.15.45:0/3092027637 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dd8067a30 con 0x7f9dd815d2f0 2023-11-28T18:49:34.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.834+0000 7f9dbf7fe640 1 -- 172.21.15.45:0/3092027637 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f9dd00b8d00 con 0x7f9dd815d2f0 2023-11-28T18:49:34.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.834+0000 7f9dbf7fe640 1 --2- 172.21.15.45:0/3092027637 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9dc40668d0 0x7f9dc4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:34.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.834+0000 7f9dbf7fe640 1 -- 172.21.15.45:0/3092027637 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9dd0120320 con 0x7f9dd815d2f0 2023-11-28T18:49:34.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.834+0000 7f9dd6ffd640 1 --2- 172.21.15.45:0/3092027637 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9dc40668d0 0x7f9dc4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:34.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.834+0000 7f9dd6ffd640 1 --2- 172.21.15.45:0/3092027637 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9dc40668d0 0x7f9dc4068d90 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f9dc80079c0 tx=0x7f9dc8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:49:34.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.838+0000 7f9dbf7fe640 1 -- 172.21.15.45:0/3092027637 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9dd00ed810 con 0x7f9dd815d2f0 2023-11-28T18:49:34.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.910+0000 7f6b88e6b640 1 Processor -- start 2023-11-28T18:49:34.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.910+0000 7f6b88e6b640 1 -- start start 2023-11-28T18:49:34.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.910+0000 7f6b88e6b640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f6b8415d2f0 0x7f6b840d17f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:34.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.910+0000 7f6b88e6b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6b840d1d30 0x7f6b840cfc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:34.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.910+0000 7f6b88e6b640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b840aff70 con 0x7f6b8415d6d0 2023-11-28T18:49:34.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.910+0000 7f6b88e6b640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b840b0210 con 0x7f6b8415d2f0 2023-11-28T18:49:34.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.910+0000 7f6b88e6b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b840b04f0 con 0x7f6b840d1d30 2023-11-28T18:49:34.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.910+0000 7f6b8259c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f6b8415d2f0 0x7f6b840d17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:34.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.910+0000 7f6b7bfff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6b840d1d30 0x7f6b840cfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:34.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.910+0000 7f6b8259c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f6b8415d2f0 0x7f6b840d17f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.45:49970/0 (socket says 172.21.15.45:49970) 2023-11-28T18:49:34.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.910+0000 7f6b8259c640 1 -- 172.21.15.45:0/1420136906 learned_addr learned my addr 172.21.15.45:0/1420136906 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:49:34.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.910+0000 7f6b82d9d640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f6b8415d6d0 0x7f6b840cddb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.45:53532/0 (socket says 172.21.15.45:53532) 2023-11-28T18:49:34.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.910+0000 7f6b7bfff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6b840d1d30 0x7f6b840cfc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.45:49086/0 (socket says 172.21.15.45:49086) 2023-11-28T18:49:34.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.914+0000 7f6b8259c640 1 -- 172.21.15.45:0/1420136906 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6b840d1d30 msgr2=0x7f6b840cfc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:49:34.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.914+0000 7f6b8259c640 1 --2- 172.21.15.45:0/1420136906 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6b840d1d30 0x7f6b840cfc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:34.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.914+0000 7f6b8259c640 1 -- 172.21.15.45:0/1420136906 >> v1:172.21.15.190:6789/0 conn(0x7f6b8415d6d0 legacy=0x7f6b840cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:34.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.914+0000 7f6b8259c640 1 -- 172.21.15.45:0/1420136906 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b840b07d0 con 0x7f6b8415d2f0 2023-11-28T18:49:34.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.914+0000 7f6b8259c640 1 --2- 172.21.15.45:0/1420136906 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6b8415d2f0 0x7f6b840d17f0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f6b74009870 tx=0x7f6b7401c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4c91e2c8c973b2d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:49:34.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.914+0000 7f6b81d9b640 1 -- 172.21.15.45:0/1420136906 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b740aa640 con 0x7f6b8415d2f0 2023-11-28T18:49:34.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.914+0000 7f6b81d9b640 1 -- 172.21.15.45:0/1420136906 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b740aa7a0 con 0x7f6b8415d2f0 2023-11-28T18:49:34.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.914+0000 7f6b81d9b640 1 -- 172.21.15.45:0/1420136906 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b740aab30 con 0x7f6b8415d2f0 2023-11-28T18:49:34.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.918+0000 7f6b88e6b640 1 -- 172.21.15.45:0/1420136906 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6b8415d2f0 msgr2=0x7f6b840d17f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:34.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.918+0000 7f6b88e6b640 1 --2- 172.21.15.45:0/1420136906 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6b8415d2f0 0x7f6b840d17f0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f6b74009870 tx=0x7f6b7401c540 comp rx=0 tx=0).stop 2023-11-28T18:49:34.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.918+0000 7f6b88e6b640 1 -- 172.21.15.45:0/1420136906 shutdown_connections 2023-11-28T18:49:34.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.918+0000 7f6b88e6b640 1 --2- 172.21.15.45:0/1420136906 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6b840d1d30 0x7f6b840cfc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:34.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.918+0000 7f6b88e6b640 1 --2- 172.21.15.45:0/1420136906 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6b8415d2f0 0x7f6b840d17f0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:34.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.918+0000 7f6b88e6b640 1 -- 172.21.15.45:0/1420136906 >> 172.21.15.45:0/1420136906 conn(0x7f6b8409c550 msgr2=0x7f6b840d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:49:34.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.918+0000 7f6b88e6b640 1 -- 172.21.15.45:0/1420136906 shutdown_connections 2023-11-28T18:49:34.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.918+0000 7f6b88e6b640 1 -- 172.21.15.45:0/1420136906 wait complete. 2023-11-28T18:49:34.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.918+0000 7f6b88e6b640 1 Processor -- start 2023-11-28T18:49:34.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.918+0000 7f6b88e6b640 1 -- start start 2023-11-28T18:49:34.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.918+0000 7f6b88e6b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6b840d1d30 0x7f6b840ccb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:34.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.918+0000 7f6b88e6b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6b8415d2f0 0x7f6b841601f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:34.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.918+0000 7f6b88e6b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b8415d6d0 0x7f6b841fe4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:34.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.918+0000 7f6b88e6b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b840c89e0 con 0x7f6b8415d6d0 2023-11-28T18:49:34.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.918+0000 7f6b88e6b640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b840c8cc0 con 0x7f6b8415d2f0 2023-11-28T18:49:34.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.918+0000 7f6b88e6b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b840c8fa0 con 0x7f6b840d1d30 2023-11-28T18:49:34.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.918+0000 7f6b82d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b8415d6d0 0x7f6b841fe4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:34.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.918+0000 7f6b82d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b8415d6d0 0x7f6b841fe4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40392/0 (socket says 172.21.15.45:40392) 2023-11-28T18:49:34.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.922+0000 7f6b82d9d640 1 -- 172.21.15.45:0/2426549937 learned_addr learned my addr 172.21.15.45:0/2426549937 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:49:34.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.922+0000 7f6b8259c640 1 --2- 172.21.15.45:0/2426549937 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6b840d1d30 0x7f6b840ccb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:34.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.922+0000 7f6b7bfff640 1 --2- 172.21.15.45:0/2426549937 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6b8415d2f0 0x7f6b841601f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:34.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.922+0000 7f6b82d9d640 1 -- 172.21.15.45:0/2426549937 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6b840d1d30 msgr2=0x7f6b840ccb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:34.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.922+0000 7f6b82d9d640 1 --2- 172.21.15.45:0/2426549937 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6b840d1d30 0x7f6b840ccb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:34.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.922+0000 7f6b82d9d640 1 -- 172.21.15.45:0/2426549937 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6b8415d2f0 msgr2=0x7f6b841601f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:34.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.922+0000 7f6b82d9d640 1 --2- 172.21.15.45:0/2426549937 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6b8415d2f0 0x7f6b841601f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:34.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.922+0000 7f6b82d9d640 1 -- 172.21.15.45:0/2426549937 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b740094d0 con 0x7f6b8415d6d0 2023-11-28T18:49:34.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.922+0000 7f6b82d9d640 1 --2- 172.21.15.45:0/2426549937 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b8415d6d0 0x7f6b841fe4f0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c00c7a0 tx=0x7f6b7c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:49:34.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.922+0000 7f6b7affd640 1 -- 172.21.15.45:0/2426549937 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7c00a640 con 0x7f6b8415d6d0 2023-11-28T18:49:34.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.922+0000 7f6b7affd640 1 -- 172.21.15.45:0/2426549937 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b7c00a7a0 con 0x7f6b8415d6d0 2023-11-28T18:49:34.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.922+0000 7f6b7affd640 1 -- 172.21.15.45:0/2426549937 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7c00ab10 con 0x7f6b8415d6d0 2023-11-28T18:49:34.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.922+0000 7f6b88e6b640 1 -- 172.21.15.45:0/2426549937 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b840c9280 con 0x7f6b8415d6d0 2023-11-28T18:49:34.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.922+0000 7f6b88e6b640 1 -- 172.21.15.45:0/2426549937 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b840cd080 con 0x7f6b8415d6d0 2023-11-28T18:49:34.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.922+0000 7f6b88e6b640 1 -- 172.21.15.45:0/2426549937 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b84067a30 con 0x7f6b8415d6d0 2023-11-28T18:49:34.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.922+0000 7f6b7affd640 1 -- 172.21.15.45:0/2426549937 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f6b7c00ac70 con 0x7f6b8415d6d0 2023-11-28T18:49:34.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.926+0000 7f6b7affd640 1 --2- 172.21.15.45:0/2426549937 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6b64066900 0x7f6b64068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:34.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.926+0000 7f6b7affd640 1 -- 172.21.15.45:0/2426549937 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6b7c083c30 con 0x7f6b8415d6d0 2023-11-28T18:49:34.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.926+0000 7f6b8259c640 1 --2- 172.21.15.45:0/2426549937 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6b64066900 0x7f6b64068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:34.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.926+0000 7f6b8259c640 1 --2- 172.21.15.45:0/2426549937 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6b64066900 0x7f6b64068dc0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f6b740ae000 tx=0x7f6b740b5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:49:34.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.930+0000 7f6b7affd640 1 -- 172.21.15.45:0/2426549937 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6b7c050e80 con 0x7f6b8415d6d0 2023-11-28T18:49:34.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.998+0000 7f9ddd617640 1 -- 172.21.15.45:0/3092027637 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9dd8069410 con 0x7f9dd815d2f0 2023-11-28T18:49:34.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:34.998+0000 7f9dbf7fe640 1 -- 172.21.15.45:0/3092027637 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v60) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9dd00f0e30 con 0x7f9dd815d2f0 2023-11-28T18:49:35.000 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-11-28T18:49:35.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.002+0000 7f9ddd617640 1 -- 172.21.15.45:0/3092027637 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9dc40668d0 msgr2=0x7f9dc4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:35.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.002+0000 7f9ddd617640 1 --2- 172.21.15.45:0/3092027637 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9dc40668d0 0x7f9dc4068d90 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f9dc80079c0 tx=0x7f9dc8008040 comp rx=0 tx=0).stop 2023-11-28T18:49:35.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.002+0000 7f9ddd617640 1 -- 172.21.15.45:0/3092027637 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9dd815d2f0 msgr2=0x7f9dd81547c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:35.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.002+0000 7f9ddd617640 1 --2- 172.21.15.45:0/3092027637 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9dd815d2f0 0x7f9dd81547c0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f9dd001a640 tx=0x7f9dd00197b0 comp rx=0 tx=0).stop 2023-11-28T18:49:35.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.002+0000 7f9ddd617640 1 -- 172.21.15.45:0/3092027637 shutdown_connections 2023-11-28T18:49:35.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.002+0000 7f9ddd617640 1 --2- 172.21.15.45:0/3092027637 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9dc40668d0 0x7f9dc4068d90 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:35.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.002+0000 7f9ddd617640 1 --2- 172.21.15.45:0/3092027637 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9dd815d2f0 0x7f9dd81547c0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:35.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.002+0000 7f9ddd617640 1 --2- 172.21.15.45:0/3092027637 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9dd80d1d30 0x7f9dd8154280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:35.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.002+0000 7f9ddd617640 1 --2- 172.21.15.45:0/3092027637 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9dd80d0330 0x7f9dd80b7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:35.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.002+0000 7f9ddd617640 1 -- 172.21.15.45:0/3092027637 >> 172.21.15.45:0/3092027637 conn(0x7f9dd809c550 msgr2=0x7f9dd8159d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:49:35.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.002+0000 7f9ddd617640 1 -- 172.21.15.45:0/3092027637 shutdown_connections 2023-11-28T18:49:35.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.002+0000 7f9ddd617640 1 -- 172.21.15.45:0/3092027637 wait complete. 2023-11-28T18:49:35.022 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T18:49:35.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.086+0000 7f6b88e6b640 1 -- 172.21.15.45:0/2426549937 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6b840ca2e0 con 0x7f6b8415d6d0 2023-11-28T18:49:35.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.086+0000 7f6b7affd640 1 -- 172.21.15.45:0/2426549937 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v60) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6b840ca2e0 con 0x7f6b8415d6d0 2023-11-28T18:49:35.087 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-11-28T18:49:35.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.090+0000 7f6b88e6b640 1 -- 172.21.15.45:0/2426549937 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6b64066900 msgr2=0x7f6b64068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:35.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.090+0000 7f6b88e6b640 1 --2- 172.21.15.45:0/2426549937 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6b64066900 0x7f6b64068dc0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f6b740ae000 tx=0x7f6b740b5040 comp rx=0 tx=0).stop 2023-11-28T18:49:35.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.090+0000 7f6b88e6b640 1 -- 172.21.15.45:0/2426549937 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b8415d6d0 msgr2=0x7f6b841fe4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:35.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.090+0000 7f6b88e6b640 1 --2- 172.21.15.45:0/2426549937 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b8415d6d0 0x7f6b841fe4f0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c00c7a0 tx=0x7f6b7c00cc60 comp rx=0 tx=0).stop 2023-11-28T18:49:35.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.090+0000 7f6b88e6b640 1 -- 172.21.15.45:0/2426549937 shutdown_connections 2023-11-28T18:49:35.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.090+0000 7f6b88e6b640 1 --2- 172.21.15.45:0/2426549937 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6b64066900 0x7f6b64068dc0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:35.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.090+0000 7f6b88e6b640 1 --2- 172.21.15.45:0/2426549937 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b8415d6d0 0x7f6b841fe4f0 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:35.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.090+0000 7f6b88e6b640 1 --2- 172.21.15.45:0/2426549937 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6b8415d2f0 0x7f6b841601f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:35.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.090+0000 7f6b88e6b640 1 --2- 172.21.15.45:0/2426549937 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6b840d1d30 0x7f6b840ccb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:35.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.090+0000 7f6b88e6b640 1 -- 172.21.15.45:0/2426549937 >> 172.21.15.45:0/2426549937 conn(0x7f6b8409c550 msgr2=0x7f6b840b46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:49:35.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.090+0000 7f6b88e6b640 1 -- 172.21.15.45:0/2426549937 shutdown_connections 2023-11-28T18:49:35.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.090+0000 7f6b88e6b640 1 -- 172.21.15.45:0/2426549937 wait complete. 2023-11-28T18:49:35.110 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T18:49:35.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.170+0000 7f76566c9640 1 Processor -- start 2023-11-28T18:49:35.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.170+0000 7f76566c9640 1 -- start start 2023-11-28T18:49:35.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.174+0000 7f76566c9640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f765015d2f0 0x7f76500d17f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:35.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.174+0000 7f76566c9640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f76500d1d30 0x7f76500cfc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:35.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.174+0000 7f76566c9640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f765015d6d0 0x7f76500d0160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:35.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.174+0000 7f76566c9640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76500aff70 con 0x7f765015d6d0 2023-11-28T18:49:35.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.174+0000 7f76566c9640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76500b0210 con 0x7f765015d2f0 2023-11-28T18:49:35.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.174+0000 7f76566c9640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76500b04f0 con 0x7f76500d1d30 2023-11-28T18:49:35.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.174+0000 7f7654c66640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f765015d6d0 0x7f76500d0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:35.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.174+0000 7f7654c66640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f765015d6d0 0x7f76500d0160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40400/0 (socket says 172.21.15.45:40400) 2023-11-28T18:49:35.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.174+0000 7f7654c66640 1 -- 172.21.15.45:0/2190323354 learned_addr learned my addr 172.21.15.45:0/2190323354 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:49:35.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.174+0000 7f764ffff640 1 --2- 172.21.15.45:0/2190323354 >> v2:172.21.15.190:3300/0 conn(0x7f765015d2f0 0x7f76500d17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:35.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.174+0000 7f764f7fe640 1 --2- 172.21.15.45:0/2190323354 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f76500d1d30 0x7f76500cfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:35.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.174+0000 7f7654c66640 1 -- 172.21.15.45:0/2190323354 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f76500d1d30 msgr2=0x7f76500cfc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:49:35.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.174+0000 7f7654c66640 1 --2- 172.21.15.45:0/2190323354 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f76500d1d30 0x7f76500cfc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:35.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.174+0000 7f7654c66640 1 -- 172.21.15.45:0/2190323354 >> v2:172.21.15.190:3300/0 conn(0x7f765015d2f0 msgr2=0x7f76500d17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:49:35.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.174+0000 7f7654c66640 1 --2- 172.21.15.45:0/2190323354 >> v2:172.21.15.190:3300/0 conn(0x7f765015d2f0 0x7f76500d17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:35.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.174+0000 7f7654c66640 1 -- 172.21.15.45:0/2190323354 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76500b07d0 con 0x7f765015d6d0 2023-11-28T18:49:35.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.174+0000 7f764ffff640 1 --2- 172.21.15.45:0/2190323354 >> v2:172.21.15.190:3300/0 conn(0x7f765015d2f0 0x7f76500d17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:49:35.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.178+0000 7f7654c66640 1 --2- 172.21.15.45:0/2190323354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f765015d6d0 0x7f76500d0160 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f765008bcf0 tx=0x7f764801c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1fa0ce206e2b6ca server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:49:35.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.178+0000 7f764effd640 1 -- 172.21.15.45:0/2190323354 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76480a56f0 con 0x7f765015d6d0 2023-11-28T18:49:35.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.178+0000 7f764effd640 1 -- 172.21.15.45:0/2190323354 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76480a5850 con 0x7f765015d6d0 2023-11-28T18:49:35.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.178+0000 7f764effd640 1 -- 172.21.15.45:0/2190323354 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76480a5be0 con 0x7f765015d6d0 2023-11-28T18:49:35.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.178+0000 7f76566c9640 1 -- 172.21.15.45:0/2190323354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f765015d6d0 msgr2=0x7f76500d0160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:35.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.178+0000 7f76566c9640 1 --2- 172.21.15.45:0/2190323354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f765015d6d0 0x7f76500d0160 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f765008bcf0 tx=0x7f764801c9d0 comp rx=0 tx=0).stop 2023-11-28T18:49:35.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.178+0000 7f76566c9640 1 -- 172.21.15.45:0/2190323354 shutdown_connections 2023-11-28T18:49:35.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.178+0000 7f76566c9640 1 --2- 172.21.15.45:0/2190323354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f765015d6d0 0x7f76500d0160 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:35.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.178+0000 7f76566c9640 1 --2- 172.21.15.45:0/2190323354 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f76500d1d30 0x7f76500cfc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:35.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.178+0000 7f76566c9640 1 --2- 172.21.15.45:0/2190323354 >> v2:172.21.15.190:3300/0 conn(0x7f765015d2f0 0x7f76500d17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:35.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.178+0000 7f76566c9640 1 -- 172.21.15.45:0/2190323354 >> 172.21.15.45:0/2190323354 conn(0x7f765009c550 msgr2=0x7f76500d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:49:35.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.178+0000 7f76566c9640 1 -- 172.21.15.45:0/2190323354 shutdown_connections 2023-11-28T18:49:35.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.178+0000 7f76566c9640 1 -- 172.21.15.45:0/2190323354 wait complete. 2023-11-28T18:49:35.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.178+0000 7f76566c9640 1 Processor -- start 2023-11-28T18:49:35.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.178+0000 7f76566c9640 1 -- start start 2023-11-28T18:49:35.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.182+0000 7f76566c9640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f76500d1d30 0x7f76500b6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:35.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.182+0000 7f76566c9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f765015d2f0 0x7f76500b8490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:35.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.182+0000 7f76566c9640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f765015d6d0 0x7f76501fe380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:35.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.182+0000 7f76566c9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76500b89d0 con 0x7f765015d2f0 2023-11-28T18:49:35.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.182+0000 7f76566c9640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76500b8c10 con 0x7f76500d1d30 2023-11-28T18:49:35.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.182+0000 7f76566c9640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76500b5e40 con 0x7f765015d6d0 2023-11-28T18:49:35.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.182+0000 7f764f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f765015d2f0 0x7f76500b8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:35.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.182+0000 7f764f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f765015d2f0 0x7f76500b8490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40402/0 (socket says 172.21.15.45:40402) 2023-11-28T18:49:35.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.182+0000 7f764f7fe640 1 -- 172.21.15.45:0/3761607639 learned_addr learned my addr 172.21.15.45:0/3761607639 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:49:35.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.182+0000 7f764ffff640 1 --2- 172.21.15.45:0/3761607639 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f76500d1d30 0x7f76500b6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:35.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.182+0000 7f7654c66640 1 --2- 172.21.15.45:0/3761607639 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f765015d6d0 0x7f76501fe380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:35.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.182+0000 7f764f7fe640 1 -- 172.21.15.45:0/3761607639 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f765015d6d0 msgr2=0x7f76501fe380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:35.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.182+0000 7f764f7fe640 1 --2- 172.21.15.45:0/3761607639 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f765015d6d0 0x7f76501fe380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:35.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.182+0000 7f764f7fe640 1 -- 172.21.15.45:0/3761607639 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f76500d1d30 msgr2=0x7f76500b6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:35.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.182+0000 7f764f7fe640 1 --2- 172.21.15.45:0/3761607639 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f76500d1d30 0x7f76500b6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:35.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.182+0000 7f764f7fe640 1 -- 172.21.15.45:0/3761607639 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7648009b30 con 0x7f765015d2f0 2023-11-28T18:49:35.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.182+0000 7f764ffff640 1 --2- 172.21.15.45:0/3761607639 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f76500d1d30 0x7f76500b6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:49:35.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.182+0000 7f764f7fe640 1 --2- 172.21.15.45:0/3761607639 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f765015d2f0 0x7f76500b8490 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f764400d800 tx=0x7f764400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:49:35.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.182+0000 7f764cff9640 1 -- 172.21.15.45:0/3761607639 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76440096a0 con 0x7f765015d2f0 2023-11-28T18:49:35.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.182+0000 7f764cff9640 1 -- 172.21.15.45:0/3761607639 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7644009800 con 0x7f765015d2f0 2023-11-28T18:49:35.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.182+0000 7f764cff9640 1 -- 172.21.15.45:0/3761607639 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7644009b70 con 0x7f765015d2f0 2023-11-28T18:49:35.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.182+0000 7f76566c9640 1 -- 172.21.15.45:0/3761607639 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76500b6120 con 0x7f765015d2f0 2023-11-28T18:49:35.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.182+0000 7f76566c9640 1 -- 172.21.15.45:0/3761607639 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76500b66e0 con 0x7f765015d2f0 2023-11-28T18:49:35.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.182+0000 7f76566c9640 1 -- 172.21.15.45:0/3761607639 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7650067a30 con 0x7f765015d2f0 2023-11-28T18:49:35.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.186+0000 7f764cff9640 1 -- 172.21.15.45:0/3761607639 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f7644009cd0 con 0x7f765015d2f0 2023-11-28T18:49:35.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.186+0000 7f764cff9640 1 --2- 172.21.15.45:0/3761607639 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f763c0668d0 0x7f763c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:35.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.186+0000 7f764cff9640 1 -- 172.21.15.45:0/3761607639 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7644084ae0 con 0x7f765015d2f0 2023-11-28T18:49:35.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.186+0000 7f764ffff640 1 --2- 172.21.15.45:0/3761607639 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f763c0668d0 0x7f763c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:35.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.186+0000 7f764ffff640 1 --2- 172.21.15.45:0/3761607639 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f763c0668d0 0x7f763c068d90 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f7640009d40 tx=0x7f7640008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:49:35.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.190+0000 7f764cff9640 1 -- 172.21.15.45:0/3761607639 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7644051d30 con 0x7f765015d2f0 2023-11-28T18:49:35.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.258+0000 7f6860993640 1 Processor -- start 2023-11-28T18:49:35.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.258+0000 7f6860993640 1 -- start start 2023-11-28T18:49:35.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.258+0000 7f6860993640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f685c15e490 0x7f685c0702a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:35.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.258+0000 7f6860993640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f685c15ae30 0x7f685c0707e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:35.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.258+0000 7f6860993640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f685c0cf760 con 0x7f685c1543b0 2023-11-28T18:49:35.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.258+0000 7f6860993640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f685c15e000 con 0x7f685c15e490 2023-11-28T18:49:35.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.258+0000 7f6860993640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f685c0cf480 con 0x7f685c15ae30 2023-11-28T18:49:35.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.258+0000 7f685b7fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f685c1543b0 0x7f685c0ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38170/0 (socket says 172.21.15.45:38170) 2023-11-28T18:49:35.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.258+0000 7f685b7fe640 1 -- 172.21.15.45:0/3007332519 learned_addr learned my addr 172.21.15.45:0/3007332519 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:49:35.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.258+0000 7f685bfff640 1 --2- 172.21.15.45:0/3007332519 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f685c15ae30 0x7f685c0707e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:35.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.258+0000 7f685affd640 1 --2- 172.21.15.45:0/3007332519 >> v2:172.21.15.190:3300/0 conn(0x7f685c15e490 0x7f685c0702a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:35.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.258+0000 7f685a7fc640 1 -- 172.21.15.45:0/3007332519 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 99154643 0 0) 0x7f685c0cf760 con 0x7f685c1543b0 2023-11-28T18:49:35.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.258+0000 7f685a7fc640 1 -- 172.21.15.45:0/3007332519 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6844005740 con 0x7f685c1543b0 2023-11-28T18:49:35.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.258+0000 7f685a7fc640 1 -- 172.21.15.45:0/3007332519 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3775081987 0 0) 0x7f6844005740 con 0x7f685c1543b0 2023-11-28T18:49:35.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.258+0000 7f685affd640 1 -- 172.21.15.45:0/3007332519 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f685c15ae30 msgr2=0x7f685c0707e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:49:35.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.258+0000 7f685affd640 1 --2- 172.21.15.45:0/3007332519 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f685c15ae30 0x7f685c0707e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:35.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.258+0000 7f685affd640 1 -- 172.21.15.45:0/3007332519 >> v1:172.21.15.45:6789/0 conn(0x7f685c1543b0 legacy=0x7f685c0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:35.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.258+0000 7f685affd640 1 -- 172.21.15.45:0/3007332519 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f685c15d9b0 con 0x7f685c15e490 2023-11-28T18:49:35.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.258+0000 7f685bfff640 1 --2- 172.21.15.45:0/3007332519 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f685c15ae30 0x7f685c0707e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:49:35.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.262+0000 7f685affd640 1 --2- 172.21.15.45:0/3007332519 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f685c15e490 0x7f685c0702a0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f68500097c0 tx=0x7f685001c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8915ee42d9453ee1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:49:35.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.262+0000 7f685a7fc640 1 -- 172.21.15.45:0/3007332519 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f684c001680 con 0x7f685c15e490 2023-11-28T18:49:35.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.262+0000 7f685a7fc640 1 -- 172.21.15.45:0/3007332519 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68500a7050 con 0x7f685c15e490 2023-11-28T18:49:35.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.262+0000 7f685a7fc640 1 -- 172.21.15.45:0/3007332519 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68500ab400 con 0x7f685c15e490 2023-11-28T18:49:35.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.262+0000 7f6860993640 1 -- 172.21.15.45:0/3007332519 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f685c15e490 msgr2=0x7f685c0702a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:35.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.262+0000 7f6860993640 1 --2- 172.21.15.45:0/3007332519 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f685c15e490 0x7f685c0702a0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f68500097c0 tx=0x7f685001c3a0 comp rx=0 tx=0).stop 2023-11-28T18:49:35.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.262+0000 7f6860993640 1 -- 172.21.15.45:0/3007332519 shutdown_connections 2023-11-28T18:49:35.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.262+0000 7f6860993640 1 --2- 172.21.15.45:0/3007332519 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f685c15ae30 0x7f685c0707e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:35.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.262+0000 7f6860993640 1 --2- 172.21.15.45:0/3007332519 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f685c15e490 0x7f685c0702a0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:35.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.262+0000 7f6860993640 1 -- 172.21.15.45:0/3007332519 >> 172.21.15.45:0/3007332519 conn(0x7f685c0b0960 msgr2=0x7f685c0b0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:49:35.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.262+0000 7f6860993640 1 -- 172.21.15.45:0/3007332519 shutdown_connections 2023-11-28T18:49:35.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.262+0000 7f6860993640 1 -- 172.21.15.45:0/3007332519 wait complete. 2023-11-28T18:49:35.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.266+0000 7f6860993640 1 Processor -- start 2023-11-28T18:49:35.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.266+0000 7f6860993640 1 -- start start 2023-11-28T18:49:35.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.266+0000 7f6860993640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f685c1543b0 0x7f685c142750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:35.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.266+0000 7f6860993640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f685c15ae30 0x7f685c14f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:35.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.266+0000 7f6860993640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f685c15e490 0x7f685c06c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:35.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.266+0000 7f6860993640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f685c151380 con 0x7f685c1543b0 2023-11-28T18:49:35.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.266+0000 7f6860993640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f685c14fa30 con 0x7f685c15ae30 2023-11-28T18:49:35.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.266+0000 7f6860993640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f685c1510a0 con 0x7f685c15e490 2023-11-28T18:49:35.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.266+0000 7f685b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f685c1543b0 0x7f685c142750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:35.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.266+0000 7f685b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f685c1543b0 0x7f685c142750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40406/0 (socket says 172.21.15.45:40406) 2023-11-28T18:49:35.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.266+0000 7f685b7fe640 1 -- 172.21.15.45:0/3724172710 learned_addr learned my addr 172.21.15.45:0/3724172710 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:49:35.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.266+0000 7f685affd640 1 --2- 172.21.15.45:0/3724172710 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f685c15ae30 0x7f685c14f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:35.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.266+0000 7f685bfff640 1 --2- 172.21.15.45:0/3724172710 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f685c15e490 0x7f685c06c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:35.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.266+0000 7f685b7fe640 1 -- 172.21.15.45:0/3724172710 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f685c15e490 msgr2=0x7f685c06c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:35.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.266+0000 7f685b7fe640 1 --2- 172.21.15.45:0/3724172710 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f685c15e490 0x7f685c06c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:35.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.266+0000 7f685b7fe640 1 -- 172.21.15.45:0/3724172710 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f685c15ae30 msgr2=0x7f685c14f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:35.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.266+0000 7f685b7fe640 1 --2- 172.21.15.45:0/3724172710 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f685c15ae30 0x7f685c14f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:35.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.266+0000 7f685b7fe640 1 -- 172.21.15.45:0/3724172710 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6854009a70 con 0x7f685c1543b0 2023-11-28T18:49:35.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.266+0000 7f685b7fe640 1 --2- 172.21.15.45:0/3724172710 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f685c1543b0 0x7f685c142750 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f684c00c780 tx=0x7f684c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:49:35.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.266+0000 7f6843fff640 1 -- 172.21.15.45:0/3724172710 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f684c005ae0 con 0x7f685c1543b0 2023-11-28T18:49:35.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.266+0000 7f6843fff640 1 -- 172.21.15.45:0/3724172710 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f684c005c40 con 0x7f685c1543b0 2023-11-28T18:49:35.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.266+0000 7f6860993640 1 -- 172.21.15.45:0/3724172710 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6850009420 con 0x7f685c1543b0 2023-11-28T18:49:35.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.266+0000 7f6843fff640 1 -- 172.21.15.45:0/3724172710 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f684c007070 con 0x7f685c1543b0 2023-11-28T18:49:35.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.266+0000 7f6860993640 1 -- 172.21.15.45:0/3724172710 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f685c0cdc80 con 0x7f685c1543b0 2023-11-28T18:49:35.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.270+0000 7f6860993640 1 -- 172.21.15.45:0/3724172710 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f685c164980 con 0x7f685c1543b0 2023-11-28T18:49:35.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.270+0000 7f6843fff640 1 -- 172.21.15.45:0/3724172710 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f684c0071d0 con 0x7f685c1543b0 2023-11-28T18:49:35.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.270+0000 7f6843fff640 1 --2- 172.21.15.45:0/3724172710 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f68480668d0 0x7f6848068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:35.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.270+0000 7f6843fff640 1 -- 172.21.15.45:0/3724172710 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f684c0841c0 con 0x7f685c1543b0 2023-11-28T18:49:35.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.270+0000 7f685affd640 1 --2- 172.21.15.45:0/3724172710 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f68480668d0 0x7f6848068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:35.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.270+0000 7f685affd640 1 --2- 172.21.15.45:0/3724172710 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f68480668d0 0x7f6848068d90 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f68500ad000 tx=0x7f68500a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:49:35.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.274+0000 7f6843fff640 1 -- 172.21.15.45:0/3724172710 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f684c0514b0 con 0x7f685c1543b0 2023-11-28T18:49:35.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.354+0000 7f76566c9640 1 -- 172.21.15.45:0/3761607639 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7650069410 con 0x7f765015d2f0 2023-11-28T18:49:35.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.354+0000 7f764cff9640 1 -- 172.21.15.45:0/3761607639 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v60) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7644055350 con 0x7f765015d2f0 2023-11-28T18:49:35.355 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-11-28T18:49:35.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.358+0000 7f76566c9640 1 -- 172.21.15.45:0/3761607639 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f763c0668d0 msgr2=0x7f763c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:35.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.358+0000 7f76566c9640 1 --2- 172.21.15.45:0/3761607639 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f763c0668d0 0x7f763c068d90 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f7640009d40 tx=0x7f7640008040 comp rx=0 tx=0).stop 2023-11-28T18:49:35.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.358+0000 7f76566c9640 1 -- 172.21.15.45:0/3761607639 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f765015d2f0 msgr2=0x7f76500b8490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:35.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.358+0000 7f76566c9640 1 --2- 172.21.15.45:0/3761607639 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f765015d2f0 0x7f76500b8490 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f764400d800 tx=0x7f764400dcc0 comp rx=0 tx=0).stop 2023-11-28T18:49:35.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.358+0000 7f76566c9640 1 -- 172.21.15.45:0/3761607639 shutdown_connections 2023-11-28T18:49:35.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.358+0000 7f76566c9640 1 --2- 172.21.15.45:0/3761607639 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f763c0668d0 0x7f763c068d90 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:35.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.358+0000 7f76566c9640 1 --2- 172.21.15.45:0/3761607639 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f765015d6d0 0x7f76501fe380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:35.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.358+0000 7f76566c9640 1 --2- 172.21.15.45:0/3761607639 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f765015d2f0 0x7f76500b8490 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:35.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.358+0000 7f76566c9640 1 --2- 172.21.15.45:0/3761607639 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f76500d1d30 0x7f76500b6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:35.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.358+0000 7f76566c9640 1 -- 172.21.15.45:0/3761607639 >> 172.21.15.45:0/3761607639 conn(0x7f765009c550 msgr2=0x7f76501594c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:49:35.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.358+0000 7f76566c9640 1 -- 172.21.15.45:0/3761607639 shutdown_connections 2023-11-28T18:49:35.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.358+0000 7f76566c9640 1 -- 172.21.15.45:0/3761607639 wait complete. 2023-11-28T18:49:35.378 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T18:49:35.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.450+0000 7f6860993640 1 -- 172.21.15.45:0/3724172710 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f685c04e970 con 0x7f685c1543b0 2023-11-28T18:49:35.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.450+0000 7f6843fff640 1 -- 172.21.15.45:0/3724172710 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v60) v1 ==== 80+0+0 (secure 0 0 0) 0x7f684c054ad0 con 0x7f685c1543b0 2023-11-28T18:49:35.452 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-11-28T18:49:35.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.454+0000 7f6860993640 1 -- 172.21.15.45:0/3724172710 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f68480668d0 msgr2=0x7f6848068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:35.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.454+0000 7f6860993640 1 --2- 172.21.15.45:0/3724172710 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f68480668d0 0x7f6848068d90 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f68500ad000 tx=0x7f68500a6000 comp rx=0 tx=0).stop 2023-11-28T18:49:35.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.454+0000 7f6860993640 1 -- 172.21.15.45:0/3724172710 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f685c1543b0 msgr2=0x7f685c142750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:35.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.454+0000 7f6860993640 1 --2- 172.21.15.45:0/3724172710 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f685c1543b0 0x7f685c142750 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f684c00c780 tx=0x7f684c00cc40 comp rx=0 tx=0).stop 2023-11-28T18:49:35.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.454+0000 7f6860993640 1 -- 172.21.15.45:0/3724172710 shutdown_connections 2023-11-28T18:49:35.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.454+0000 7f6860993640 1 --2- 172.21.15.45:0/3724172710 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f68480668d0 0x7f6848068d90 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:35.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.454+0000 7f6860993640 1 --2- 172.21.15.45:0/3724172710 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f685c15e490 0x7f685c06c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:35.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.454+0000 7f6860993640 1 --2- 172.21.15.45:0/3724172710 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f685c15ae30 0x7f685c14f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:35.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.454+0000 7f6860993640 1 --2- 172.21.15.45:0/3724172710 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f685c1543b0 0x7f685c142750 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:35.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.454+0000 7f6860993640 1 -- 172.21.15.45:0/3724172710 >> 172.21.15.45:0/3724172710 conn(0x7f685c0b0960 msgr2=0x7f685c0701a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:49:35.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.454+0000 7f6860993640 1 -- 172.21.15.45:0/3724172710 shutdown_connections 2023-11-28T18:49:35.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.454+0000 7f6860993640 1 -- 172.21.15.45:0/3724172710 wait complete. 2023-11-28T18:49:35.474 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T18:49:35.474 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T18:49:35.484 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T18:49:35.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.526+0000 7f96d52bb640 1 Processor -- start 2023-11-28T18:49:35.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.526+0000 7f96d52bb640 1 -- start start 2023-11-28T18:49:35.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.526+0000 7f96d52bb640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f96d015e430 0x7f96d00b2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:35.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.526+0000 7f96d52bb640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96d0146fe0 con 0x7f96d0146c00 2023-11-28T18:49:35.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.526+0000 7f96d52bb640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96d015e8b0 con 0x7f96d00b30f0 2023-11-28T18:49:35.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.526+0000 7f96d52bb640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96d00b3560 con 0x7f96d015e430 2023-11-28T18:49:35.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.526+0000 7f96ceffd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f96d0146c00 0x7f96d006e8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38172/0 (socket says 172.21.15.45:38172) 2023-11-28T18:49:35.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.526+0000 7f96ceffd640 1 -- 172.21.15.45:0/2545482346 learned_addr learned my addr 172.21.15.45:0/2545482346 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:49:35.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.526+0000 7f96ce7fc640 1 --2- 172.21.15.45:0/2545482346 >> v2:172.21.15.190:3300/0 conn(0x7f96d015e430 0x7f96d00b2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:35.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.526+0000 7f96cdffb640 1 -- 172.21.15.45:0/2545482346 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 584615292 0 0) 0x7f96d0146fe0 con 0x7f96d0146c00 2023-11-28T18:49:35.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.526+0000 7f96cdffb640 1 -- 172.21.15.45:0/2545482346 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96b8003530 con 0x7f96d0146c00 2023-11-28T18:49:35.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.526+0000 7f96ce7fc640 1 -- 172.21.15.45:0/2545482346 >> v1:172.21.15.190:6789/0 conn(0x7f96d00b30f0 legacy=0x7f96d0160f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:35.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.526+0000 7f96ce7fc640 1 -- 172.21.15.45:0/2545482346 >> v1:172.21.15.45:6789/0 conn(0x7f96d0146c00 legacy=0x7f96d006e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:35.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.526+0000 7f96ce7fc640 1 -- 172.21.15.45:0/2545482346 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96d006f390 con 0x7f96d015e430 2023-11-28T18:49:35.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.530+0000 7f96ce7fc640 1 --2- 172.21.15.45:0/2545482346 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f96d015e430 0x7f96d00b2bb0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f96c40097c0 tx=0x7f96c401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=534392232551831f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:49:35.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.530+0000 7f96cdffb640 1 -- 172.21.15.45:0/2545482346 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c40ab650 con 0x7f96d015e430 2023-11-28T18:49:35.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.530+0000 7f96cdffb640 1 -- 172.21.15.45:0/2545482346 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96c40ab7b0 con 0x7f96d015e430 2023-11-28T18:49:35.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.530+0000 7f96cdffb640 1 -- 172.21.15.45:0/2545482346 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c40abb40 con 0x7f96d015e430 2023-11-28T18:49:35.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.530+0000 7f96d52bb640 1 -- 172.21.15.45:0/2545482346 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f96d015e430 msgr2=0x7f96d00b2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:35.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.530+0000 7f96d52bb640 1 --2- 172.21.15.45:0/2545482346 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f96d015e430 0x7f96d00b2bb0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f96c40097c0 tx=0x7f96c401c450 comp rx=0 tx=0).stop 2023-11-28T18:49:35.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.530+0000 7f96d52bb640 1 -- 172.21.15.45:0/2545482346 shutdown_connections 2023-11-28T18:49:35.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.530+0000 7f96d52bb640 1 --2- 172.21.15.45:0/2545482346 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f96d015e430 0x7f96d00b2bb0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:35.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.530+0000 7f96d52bb640 1 -- 172.21.15.45:0/2545482346 >> 172.21.15.45:0/2545482346 conn(0x7f96d006a570 msgr2=0x7f96d006a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:49:35.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.530+0000 7f96d52bb640 1 -- 172.21.15.45:0/2545482346 shutdown_connections 2023-11-28T18:49:35.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.530+0000 7f96d52bb640 1 -- 172.21.15.45:0/2545482346 wait complete. 2023-11-28T18:49:35.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.534+0000 7f96d52bb640 1 Processor -- start 2023-11-28T18:49:35.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.534+0000 7f96d52bb640 1 -- start start 2023-11-28T18:49:35.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.534+0000 7f96d52bb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96d00b30f0 0x7f96d015c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:35.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.534+0000 7f96d52bb640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f96d0146c00 0x7f96d00b5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:35.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.534+0000 7f96d52bb640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f96d015e430 0x7f96d00b5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:35.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.534+0000 7f96d52bb640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96d015d2c0 con 0x7f96d00b30f0 2023-11-28T18:49:35.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.534+0000 7f96d52bb640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96d01408a0 con 0x7f96d015e430 2023-11-28T18:49:35.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.534+0000 7f96d52bb640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96d00b4ff0 con 0x7f96d0146c00 2023-11-28T18:49:35.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.534+0000 7f96ceffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96d00b30f0 0x7f96d015c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:35.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.534+0000 7f96ceffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96d00b30f0 0x7f96d015c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40414/0 (socket says 172.21.15.45:40414) 2023-11-28T18:49:35.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.534+0000 7f96ceffd640 1 -- 172.21.15.45:0/3559383540 learned_addr learned my addr 172.21.15.45:0/3559383540 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:49:35.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.534+0000 7f96cf7fe640 1 --2- 172.21.15.45:0/3559383540 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f96d015e430 0x7f96d00b5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:35.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.534+0000 7f96ce7fc640 1 --2- 172.21.15.45:0/3559383540 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f96d0146c00 0x7f96d00b5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:35.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.534+0000 7f96ceffd640 1 -- 172.21.15.45:0/3559383540 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f96d0146c00 msgr2=0x7f96d00b5720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:35.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.534+0000 7f96ceffd640 1 --2- 172.21.15.45:0/3559383540 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f96d0146c00 0x7f96d00b5720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:35.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.534+0000 7f96ceffd640 1 -- 172.21.15.45:0/3559383540 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f96d015e430 msgr2=0x7f96d00b5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:35.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.534+0000 7f96ceffd640 1 --2- 172.21.15.45:0/3559383540 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f96d015e430 0x7f96d00b5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:35.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.534+0000 7f96ceffd640 1 -- 172.21.15.45:0/3559383540 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96c4009420 con 0x7f96d00b30f0 2023-11-28T18:49:35.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.534+0000 7f96cf7fe640 1 --2- 172.21.15.45:0/3559383540 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f96d015e430 0x7f96d00b5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:49:35.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.534+0000 7f96ce7fc640 1 --2- 172.21.15.45:0/3559383540 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f96d0146c00 0x7f96d00b5720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:49:35.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.534+0000 7f96ceffd640 1 --2- 172.21.15.45:0/3559383540 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96d00b30f0 0x7f96d015c2d0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f96c000c4d0 tx=0x7f96c000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:49:35.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.534+0000 7f96b77fe640 1 -- 172.21.15.45:0/3559383540 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c0005cf0 con 0x7f96d00b30f0 2023-11-28T18:49:35.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.534+0000 7f96b77fe640 1 -- 172.21.15.45:0/3559383540 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96c0005e50 con 0x7f96d00b30f0 2023-11-28T18:49:35.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.534+0000 7f96b77fe640 1 -- 172.21.15.45:0/3559383540 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c0007270 con 0x7f96d00b30f0 2023-11-28T18:49:35.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.534+0000 7f96d52bb640 1 -- 172.21.15.45:0/3559383540 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96d00b52d0 con 0x7f96d00b30f0 2023-11-28T18:49:35.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.538+0000 7f96d52bb640 1 -- 172.21.15.45:0/3559383540 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96d0140530 con 0x7f96d00b30f0 2023-11-28T18:49:35.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.538+0000 7f96d52bb640 1 -- 172.21.15.45:0/3559383540 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96d0073cb0 con 0x7f96d00b30f0 2023-11-28T18:49:35.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.538+0000 7f96b77fe640 1 -- 172.21.15.45:0/3559383540 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f96c00073d0 con 0x7f96d00b30f0 2023-11-28T18:49:35.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.538+0000 7f96b77fe640 1 --2- 172.21.15.45:0/3559383540 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f96bc0668d0 0x7f96bc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:35.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.538+0000 7f96b77fe640 1 -- 172.21.15.45:0/3559383540 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f96c0083a30 con 0x7f96d00b30f0 2023-11-28T18:49:35.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.538+0000 7f96ce7fc640 1 --2- 172.21.15.45:0/3559383540 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f96bc0668d0 0x7f96bc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:35.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.542+0000 7f96ce7fc640 1 --2- 172.21.15.45:0/3559383540 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f96bc0668d0 0x7f96bc068d90 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f96c40af000 tx=0x7f96c40b6040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:49:35.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.542+0000 7f96b77fe640 1 -- 172.21.15.45:0/3559383540 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f96c0050c80 con 0x7f96d00b30f0 2023-11-28T18:49:35.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.670+0000 7f6fe55f5640 1 Processor -- start 2023-11-28T18:49:35.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.670+0000 7f6fe55f5640 1 -- start start 2023-11-28T18:49:35.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.674+0000 7f6fe55f5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6fe006cdf0 0x7f6fe0150290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:35.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.674+0000 7f6fe55f5640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6fe006d1d0 0x7f6fe01507d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:35.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.674+0000 7f6fe55f5640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f6fe0159de0 0x7f6fe015a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:35.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.674+0000 7f6fe55f5640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fe0150d10 con 0x7f6fe006cdf0 2023-11-28T18:49:35.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.674+0000 7f6fe55f5640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fe00704a0 con 0x7f6fe0159de0 2023-11-28T18:49:35.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.674+0000 7f6fe55f5640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe015ab60 con 0x7f6fe006d1d0 2023-11-28T18:49:35.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.674+0000 7f6fdeffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6fe006cdf0 0x7f6fe0150290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:35.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.674+0000 7f6fdeffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6fe006cdf0 0x7f6fe0150290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40426/0 (socket says 172.21.15.45:40426) 2023-11-28T18:49:35.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.674+0000 7f6fdeffd640 1 -- 172.21.15.45:0/1489770719 learned_addr learned my addr 172.21.15.45:0/1489770719 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:49:35.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.674+0000 7f6fd7fff640 1 --2- 172.21.15.45:0/1489770719 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6fe006d1d0 0x7f6fe01507d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:35.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.674+0000 7f6fdf7fe640 1 --2- 172.21.15.45:0/1489770719 >> v2:172.21.15.190:3300/0 conn(0x7f6fe0159de0 0x7f6fe015a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:35.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.674+0000 7f6fdeffd640 1 -- 172.21.15.45:0/1489770719 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6fe006d1d0 msgr2=0x7f6fe01507d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:49:35.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.674+0000 7f6fdeffd640 1 --2- 172.21.15.45:0/1489770719 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6fe006d1d0 0x7f6fe01507d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:35.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.674+0000 7f6fdeffd640 1 -- 172.21.15.45:0/1489770719 >> v2:172.21.15.190:3300/0 conn(0x7f6fe0159de0 msgr2=0x7f6fe015a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:49:35.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.674+0000 7f6fdeffd640 1 --2- 172.21.15.45:0/1489770719 >> v2:172.21.15.190:3300/0 conn(0x7f6fe0159de0 0x7f6fe015a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:35.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.674+0000 7f6fdeffd640 1 -- 172.21.15.45:0/1489770719 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe00706d0 con 0x7f6fe006cdf0 2023-11-28T18:49:35.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.678+0000 7f6fdeffd640 1 --2- 172.21.15.45:0/1489770719 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fe006cdf0 0x7f6fe0150290 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f6fe0070430 tx=0x7f6fd001d840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b612cae23f4354ed server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:49:35.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.678+0000 7f6fde7fc640 1 -- 172.21.15.45:0/1489770719 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd00a6720 con 0x7f6fe006cdf0 2023-11-28T18:49:35.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.678+0000 7f6fde7fc640 1 -- 172.21.15.45:0/1489770719 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fd00a6880 con 0x7f6fe006cdf0 2023-11-28T18:49:35.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.678+0000 7f6fde7fc640 1 -- 172.21.15.45:0/1489770719 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd00a6c10 con 0x7f6fe006cdf0 2023-11-28T18:49:35.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.678+0000 7f6fe55f5640 1 -- 172.21.15.45:0/1489770719 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fe006cdf0 msgr2=0x7f6fe0150290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:35.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.678+0000 7f6fe55f5640 1 --2- 172.21.15.45:0/1489770719 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fe006cdf0 0x7f6fe0150290 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f6fe0070430 tx=0x7f6fd001d840 comp rx=0 tx=0).stop 2023-11-28T18:49:35.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.678+0000 7f6fe55f5640 1 -- 172.21.15.45:0/1489770719 shutdown_connections 2023-11-28T18:49:35.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.678+0000 7f6fe55f5640 1 --2- 172.21.15.45:0/1489770719 >> v2:172.21.15.190:3300/0 conn(0x7f6fe0159de0 0x7f6fe015a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:35.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.678+0000 7f6fe55f5640 1 --2- 172.21.15.45:0/1489770719 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6fe006d1d0 0x7f6fe01507d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:35.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.678+0000 7f6fe55f5640 1 --2- 172.21.15.45:0/1489770719 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fe006cdf0 0x7f6fe0150290 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:35.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.678+0000 7f6fe55f5640 1 -- 172.21.15.45:0/1489770719 >> 172.21.15.45:0/1489770719 conn(0x7f6fe006a570 msgr2=0x7f6fe006a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:49:35.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.678+0000 7f6fe55f5640 1 -- 172.21.15.45:0/1489770719 shutdown_connections 2023-11-28T18:49:35.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.678+0000 7f6fe55f5640 1 -- 172.21.15.45:0/1489770719 wait complete. 2023-11-28T18:49:35.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.678+0000 7f6fe55f5640 1 Processor -- start 2023-11-28T18:49:35.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.678+0000 7f6fe55f5640 1 -- start start 2023-11-28T18:49:35.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.682+0000 7f6fe55f5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fe006cdf0 0x7f6fe0153970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:35.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.682+0000 7f6fe55f5640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6fe006d1d0 0x7f6fe012ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:35.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.682+0000 7f6fe55f5640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6fe0159de0 0x7f6fe0150e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:35.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.682+0000 7f6fe55f5640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe0151390 con 0x7f6fe006cdf0 2023-11-28T18:49:35.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.682+0000 7f6fe55f5640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe0152bb0 con 0x7f6fe0159de0 2023-11-28T18:49:35.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.682+0000 7f6fe55f5640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe0152e90 con 0x7f6fe006d1d0 2023-11-28T18:49:35.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.682+0000 7f6fdeffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fe006cdf0 0x7f6fe0153970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:35.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.682+0000 7f6fdeffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fe006cdf0 0x7f6fe0153970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40432/0 (socket says 172.21.15.45:40432) 2023-11-28T18:49:35.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.682+0000 7f6fdeffd640 1 -- 172.21.15.45:0/3421133399 learned_addr learned my addr 172.21.15.45:0/3421133399 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:49:35.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.682+0000 7f6fdf7fe640 1 --2- 172.21.15.45:0/3421133399 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6fe0159de0 0x7f6fe0150e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:35.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.682+0000 7f6fd7fff640 1 --2- 172.21.15.45:0/3421133399 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6fe006d1d0 0x7f6fe012ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:35.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.682+0000 7f6fdeffd640 1 -- 172.21.15.45:0/3421133399 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6fe006d1d0 msgr2=0x7f6fe012ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:35.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.682+0000 7f6fdeffd640 1 --2- 172.21.15.45:0/3421133399 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6fe006d1d0 0x7f6fe012ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:35.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.682+0000 7f6fdeffd640 1 -- 172.21.15.45:0/3421133399 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6fe0159de0 msgr2=0x7f6fe0150e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:35.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.682+0000 7f6fdeffd640 1 --2- 172.21.15.45:0/3421133399 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6fe0159de0 0x7f6fe0150e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:35.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.682+0000 7f6fdeffd640 1 -- 172.21.15.45:0/3421133399 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fd000a670 con 0x7f6fe006cdf0 2023-11-28T18:49:35.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.682+0000 7f6fdeffd640 1 --2- 172.21.15.45:0/3421133399 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fe006cdf0 0x7f6fe0153970 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f6fd000a1c0 tx=0x7f6fd001a5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:49:35.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.682+0000 7f6fd77fe640 1 -- 172.21.15.45:0/3421133399 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd00b9860 con 0x7f6fe006cdf0 2023-11-28T18:49:35.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.682+0000 7f6fd77fe640 1 -- 172.21.15.45:0/3421133399 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fd00b99c0 con 0x7f6fe006cdf0 2023-11-28T18:49:35.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.682+0000 7f6fd77fe640 1 -- 172.21.15.45:0/3421133399 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd00b9d50 con 0x7f6fe006cdf0 2023-11-28T18:49:35.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.682+0000 7f6fe55f5640 1 -- 172.21.15.45:0/3421133399 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fe0153170 con 0x7f6fe006cdf0 2023-11-28T18:49:35.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.682+0000 7f6fe55f5640 1 -- 172.21.15.45:0/3421133399 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fe0152860 con 0x7f6fe006cdf0 2023-11-28T18:49:35.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.682+0000 7f6fe55f5640 1 -- 172.21.15.45:0/3421133399 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fe0069480 con 0x7f6fe006cdf0 2023-11-28T18:49:35.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.686+0000 7f6fd77fe640 1 -- 172.21.15.45:0/3421133399 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f6fd00b5070 con 0x7f6fe006cdf0 2023-11-28T18:49:35.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.686+0000 7f6fd77fe640 1 --2- 172.21.15.45:0/3421133399 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6fc00668d0 0x7f6fc0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:35.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.686+0000 7f6fd77fe640 1 -- 172.21.15.45:0/3421133399 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6fd011f2a0 con 0x7f6fe006cdf0 2023-11-28T18:49:35.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.686+0000 7f6fd7fff640 1 --2- 172.21.15.45:0/3421133399 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6fc00668d0 0x7f6fc0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:35.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.686+0000 7f6fd7fff640 1 --2- 172.21.15.45:0/3421133399 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6fc00668d0 0x7f6fc0068d90 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f6fe0152460 tx=0x7f6fc8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:49:35.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.690+0000 7f6fd77fe640 1 -- 172.21.15.45:0/3421133399 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6fd00ec4d0 con 0x7f6fe006cdf0 2023-11-28T18:49:35.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.714+0000 7f96d52bb640 1 -- 172.21.15.45:0/3559383540 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f96d0069480 con 0x7f96d00b30f0 2023-11-28T18:49:35.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.714+0000 7f96b77fe640 1 -- 172.21.15.45:0/3559383540 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v60) v1 ==== 80+0+0 (secure 0 0 0) 0x7f96c0017020 con 0x7f96d00b30f0 2023-11-28T18:49:35.716 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-11-28T18:49:35.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.718+0000 7f96d52bb640 1 -- 172.21.15.45:0/3559383540 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f96bc0668d0 msgr2=0x7f96bc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:35.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.718+0000 7f96d52bb640 1 --2- 172.21.15.45:0/3559383540 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f96bc0668d0 0x7f96bc068d90 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f96c40af000 tx=0x7f96c40b6040 comp rx=0 tx=0).stop 2023-11-28T18:49:35.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.718+0000 7f96d52bb640 1 -- 172.21.15.45:0/3559383540 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96d00b30f0 msgr2=0x7f96d015c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:35.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.718+0000 7f96d52bb640 1 --2- 172.21.15.45:0/3559383540 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96d00b30f0 0x7f96d015c2d0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f96c000c4d0 tx=0x7f96c000c990 comp rx=0 tx=0).stop 2023-11-28T18:49:35.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.718+0000 7f96d52bb640 1 -- 172.21.15.45:0/3559383540 shutdown_connections 2023-11-28T18:49:35.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.718+0000 7f96d52bb640 1 --2- 172.21.15.45:0/3559383540 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f96bc0668d0 0x7f96bc068d90 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:35.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.718+0000 7f96d52bb640 1 --2- 172.21.15.45:0/3559383540 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f96d015e430 0x7f96d00b5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:35.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.718+0000 7f96d52bb640 1 --2- 172.21.15.45:0/3559383540 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f96d0146c00 0x7f96d00b5720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:35.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.718+0000 7f96d52bb640 1 --2- 172.21.15.45:0/3559383540 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96d00b30f0 0x7f96d015c2d0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:35.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.718+0000 7f96d52bb640 1 -- 172.21.15.45:0/3559383540 >> 172.21.15.45:0/3559383540 conn(0x7f96d006a570 msgr2=0x7f96d006e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:49:35.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.718+0000 7f96d52bb640 1 -- 172.21.15.45:0/3559383540 shutdown_connections 2023-11-28T18:49:35.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.718+0000 7f96d52bb640 1 -- 172.21.15.45:0/3559383540 wait complete. 2023-11-28T18:49:35.738 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi045.front.sepia.ceph.com... 2023-11-28T18:49:35.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:49:35.739 DEBUG:teuthology.orchestra.run.smithi045:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-28T18:49:35.807 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi045.front.sepia.ceph.com 2023-11-28T18:49:35.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:49:35.808 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-28T18:49:35.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.850+0000 7f6fe55f5640 1 -- 172.21.15.45:0/3421133399 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6fe0153620 con 0x7f6fe006cdf0 2023-11-28T18:49:35.852 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:49:35.852 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":60,"fsid":"d10f5cd6-1d00-4019-99b6-6fa435498a15","created":"2023-11-28T18:37:08.189030+0000","modified":"2023-11-28T18:44:00.269525+0000","last_up_change":"2023-11-28T18:37:20.196124+0000","last_in_change":"2023-11-28T18:37:10.742043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T18:37:21.293917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-28T18:43:57.069740+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-28T18:43:57.647964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"84465384-103c-4f2c-a45a-96f5bb9c835f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6809","nonce":555237322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6811","nonce":555237322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6815","nonce":555237322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6813","nonce":555237322}]},"public_addr":"172.21.15.45:6809/555237322","cluster_addr":"172.21.15.45:6811/555237322","heartbeat_back_addr":"172.21.15.45:6815/555237322","heartbeat_front_addr":"172.21.15.45:6813/555237322","state":["exists","up"]},{"osd":1,"uuid":"7d9eed24-a58f-42c7-a787-ac06be8553fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6801","nonce":2857063763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6803","nonce":2857063763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6807","nonce":2857063763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6805","nonce":2857063763}]},"public_addr":"172.21.15.45:6801/2857063763","cluster_addr":"172.21.15.45:6803/2857063763","heartbeat_back_addr":"172.21.15.45:6807/2857063763","heartbeat_front_addr":"172.21.15.45:6805/2857063763","state":["exists","up"]},{"osd":2,"uuid":"575eeccc-4abf-45b4-9caf-f3e797859588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6817","nonce":193884539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6819","nonce":193884539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6823","nonce":193884539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6821","nonce":193884539}]},"public_addr":"172.21.15.45:6817/193884539","cluster_addr":"172.21.15.45:6819/193884539","heartbeat_back_addr":"172.21.15.45:6823/193884539","heartbeat_front_addr":"172.21.15.45:6821/193884539","state":["exists","up"]},{"osd":3,"uuid":"9b0290d6-9a52-4bc8-b2a1-7622c5dc8e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6825","nonce":78541084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6827","nonce":78541084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6831","nonce":78541084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6829","nonce":78541084}]},"public_addr":"172.21.15.45:6825/78541084","cluster_addr":"172.21.15.45:6827/78541084","heartbeat_back_addr":"172.21.15.45:6831/78541084","heartbeat_front_addr":"172.21.15.45:6829/78541084","state":["exists","up"]},{"osd":4,"uuid":"ce632829-f027-4fbf-a627-02c571aa9d53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6809","nonce":1537591987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6811","nonce":1537591987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6815","nonce":1537591987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6813","nonce":1537591987}]},"public_addr":"172.21.15.190:6809/1537591987","cluster_addr":"172.21.15.190:6811/1537591987","heartbeat_back_addr":"172.21.15.190:6815/1537591987","heartbeat_front_addr":"172.21.15.190:6813/1537591987","state":["exists","up"]},{"osd":5,"uuid":"8700b609-27be-40bd-a251-4c0ae0a29ead","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6801","nonce":3296698407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6803","nonce":3296698407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6807","nonce":3296698407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6805","nonce":3296698407}]},"public_addr":"172.21.15.190:6801/3296698407","cluster_addr":"172.21.15.190:6803/3296698407","heartbeat_back_addr":"172.21.15.190:6807/3296698407","heartbeat_front_addr":"172.21.15.190:6805/3296698407","state":["exists","up"]},{"osd":6,"uuid":"44ce4a40-e6ff-4f4d-8e8a-7341e5c91f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6817","nonce":2317686718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6819","nonce":2317686718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6823","nonce":2317686718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6821","nonce":2317686718}]},"public_addr":"172.21.15.190:6817/2317686718","cluster_addr":"172.21.15.190:6819/2317686718","heartbeat_back_addr":"172.21.15.190:6823/2317686718","heartbeat_front_addr":"172.21.15.190:6821/2317686718","state":["exists","up"]},{"osd":7,"uuid":"192238c9-1423-4b7e-ac8f-84ba32113ddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6825","nonce":2493232051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6827","nonce":2493232051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6831","nonce":2493232051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6829","nonce":2493232051}]},"public_addr":"172.21.15.190:6825/2493232051","cluster_addr":"172.21.15.190:6827/2493232051","heartbeat_back_addr":"172.21.15.190:6831/2493232051","heartbeat_front_addr":"172.21.15.190:6829/2493232051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.393552+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.385453+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.361421+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.366408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.363226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.276007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.414605+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.445885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T18:49:35.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.850+0000 7f6fd77fe640 1 -- 172.21.15.45:0/3421133399 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+16529 (secure 0 0 0) 0x7f6fd00efaf0 con 0x7f6fe006cdf0 2023-11-28T18:49:35.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.850+0000 7f6fe55f5640 1 -- 172.21.15.45:0/3421133399 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6fc00668d0 msgr2=0x7f6fc0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:35.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.850+0000 7f6fe55f5640 1 --2- 172.21.15.45:0/3421133399 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6fc00668d0 0x7f6fc0068d90 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f6fe0152460 tx=0x7f6fc8008040 comp rx=0 tx=0).stop 2023-11-28T18:49:35.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.850+0000 7f6fe55f5640 1 -- 172.21.15.45:0/3421133399 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fe006cdf0 msgr2=0x7f6fe0153970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:35.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.850+0000 7f6fe55f5640 1 --2- 172.21.15.45:0/3421133399 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fe006cdf0 0x7f6fe0153970 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f6fd000a1c0 tx=0x7f6fd001a5e0 comp rx=0 tx=0).stop 2023-11-28T18:49:35.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.850+0000 7f6fe55f5640 1 -- 172.21.15.45:0/3421133399 shutdown_connections 2023-11-28T18:49:35.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.850+0000 7f6fe55f5640 1 --2- 172.21.15.45:0/3421133399 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6fc00668d0 0x7f6fc0068d90 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:35.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.850+0000 7f6fe55f5640 1 --2- 172.21.15.45:0/3421133399 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6fe0159de0 0x7f6fe0150e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:35.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.850+0000 7f6fe55f5640 1 --2- 172.21.15.45:0/3421133399 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6fe006d1d0 0x7f6fe012ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:35.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.850+0000 7f6fe55f5640 1 --2- 172.21.15.45:0/3421133399 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fe006cdf0 0x7f6fe0153970 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:35.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.850+0000 7f6fe55f5640 1 -- 172.21.15.45:0/3421133399 >> 172.21.15.45:0/3421133399 conn(0x7f6fe006a570 msgr2=0x7f6fe01489d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:49:35.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.850+0000 7f6fe55f5640 1 -- 172.21.15.45:0/3421133399 shutdown_connections 2023-11-28T18:49:35.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:35.850+0000 7f6fe55f5640 1 -- 172.21.15.45:0/3421133399 wait complete. 2023-11-28T18:49:35.858 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-28T18:49:35.858 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T18:49:35.868 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354684k,nr_inodes=4088671,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9377 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-28T18:49:35.869 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi190.front.sepia.ceph.com 2023-11-28T18:49:35.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:49:35.869 DEBUG:teuthology.orchestra.run.smithi190:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-28T18:49:35.871 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T18:37:21.293917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T18:43:57.069740+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T18:43:57.647964+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T18:49:35.871 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T18:49:35.919 INFO:teuthology.orchestra.run.smithi190.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-11-28T18:49:35.920 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T18:49:35.921 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T18:49:35.921 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T18:49:35.968 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357768k,nr_inodes=4089442,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9360 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276000k,nr_inodes=819000,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-28T18:49:35.968 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi045.front.sepia.ceph.com 2023-11-28T18:49:35.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:49:35.969 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-28T18:49:36.020 INFO:teuthology.orchestra.run.smithi045.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-28T18:49:36.020 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T18:49:36.021 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-28T18:49:36.021 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T18:49:36.030 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354684k,nr_inodes=4088671,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9377 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-28T18:49:36.030 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi190.front.sepia.ceph.com 2023-11-28T18:49:36.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:49:36.031 DEBUG:teuthology.orchestra.run.smithi190:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-28T18:49:36.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.062+0000 7f8703c9c640 1 Processor -- start 2023-11-28T18:49:36.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.062+0000 7f8703c9c640 1 -- start start 2023-11-28T18:49:36.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.062+0000 7f8703c9c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f86fc0cba50 0x7f86fc15be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:36.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.062+0000 7f8703c9c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f86fc0b4310 0x7f86fc0b4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:36.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.062+0000 7f8703c9c640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86fc0b4ca0 con 0x7f86fc158ce0 2023-11-28T18:49:36.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.062+0000 7f8703c9c640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86fc15b6b0 con 0x7f86fc0cba50 2023-11-28T18:49:36.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.062+0000 7f8703c9c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86fc15f450 con 0x7f86fc0b4310 2023-11-28T18:49:36.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.062+0000 7f8701237640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f86fc0cba50 0x7f86fc15be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:36.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.062+0000 7f8702239640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f86fc0b4310 0x7f86fc0b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:36.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.062+0000 7f8701237640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f86fc0cba50 0x7f86fc15be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.45:50040/0 (socket says 172.21.15.45:50040) 2023-11-28T18:49:36.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.062+0000 7f8701237640 1 -- 172.21.15.45:0/4222395192 learned_addr learned my addr 172.21.15.45:0/4222395192 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:49:36.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.062+0000 7f8701a38640 1 --1- 172.21.15.45:0/4222395192 >> v1:172.21.15.190:6789/0 conn(0x7f86fc158ce0 0x7f86fc15eb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.45:53558/0 (socket says 172.21.15.45:53558) 2023-11-28T18:49:36.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.066+0000 7f8702239640 1 -- 172.21.15.45:0/4222395192 >> v2:172.21.15.190:3300/0 conn(0x7f86fc0cba50 msgr2=0x7f86fc15be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:49:36.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.066+0000 7f8702239640 1 --2- 172.21.15.45:0/4222395192 >> v2:172.21.15.190:3300/0 conn(0x7f86fc0cba50 0x7f86fc15be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:36.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.066+0000 7f8702239640 1 -- 172.21.15.45:0/4222395192 >> v1:172.21.15.190:6789/0 conn(0x7f86fc158ce0 legacy=0x7f86fc15eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:36.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.066+0000 7f8702239640 1 -- 172.21.15.45:0/4222395192 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86fc15f730 con 0x7f86fc0b4310 2023-11-28T18:49:36.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.066+0000 7f8701237640 1 --2- 172.21.15.45:0/4222395192 >> v2:172.21.15.190:3300/0 conn(0x7f86fc0cba50 0x7f86fc15be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:49:36.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.066+0000 7f8702239640 1 --2- 172.21.15.45:0/4222395192 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f86fc0b4310 0x7f86fc0b4760 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f86f4009d90 tx=0x7f86f401c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebe3c895bf803fd0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:49:36.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.066+0000 7f8700a36640 1 -- 172.21.15.45:0/4222395192 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f40a5920 con 0x7f86fc0b4310 2023-11-28T18:49:36.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.066+0000 7f8700a36640 1 -- 172.21.15.45:0/4222395192 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86f40a5a80 con 0x7f86fc0b4310 2023-11-28T18:49:36.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.066+0000 7f8700a36640 1 -- 172.21.15.45:0/4222395192 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f40a5e10 con 0x7f86fc0b4310 2023-11-28T18:49:36.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.066+0000 7f8703c9c640 1 -- 172.21.15.45:0/4222395192 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f86fc0b4310 msgr2=0x7f86fc0b4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:36.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.066+0000 7f8703c9c640 1 --2- 172.21.15.45:0/4222395192 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f86fc0b4310 0x7f86fc0b4760 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f86f4009d90 tx=0x7f86f401c950 comp rx=0 tx=0).stop 2023-11-28T18:49:36.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.066+0000 7f8703c9c640 1 -- 172.21.15.45:0/4222395192 shutdown_connections 2023-11-28T18:49:36.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.066+0000 7f8703c9c640 1 --2- 172.21.15.45:0/4222395192 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f86fc0b4310 0x7f86fc0b4760 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:36.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.066+0000 7f8703c9c640 1 --2- 172.21.15.45:0/4222395192 >> v2:172.21.15.190:3300/0 conn(0x7f86fc0cba50 0x7f86fc15be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:36.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.066+0000 7f8703c9c640 1 -- 172.21.15.45:0/4222395192 >> 172.21.15.45:0/4222395192 conn(0x7f86fc0b0d00 msgr2=0x7f86fc0b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:49:36.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.070+0000 7f8703c9c640 1 -- 172.21.15.45:0/4222395192 shutdown_connections 2023-11-28T18:49:36.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.070+0000 7f8703c9c640 1 -- 172.21.15.45:0/4222395192 wait complete. 2023-11-28T18:49:36.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.070+0000 7f8703c9c640 1 Processor -- start 2023-11-28T18:49:36.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.070+0000 7f8703c9c640 1 -- start start 2023-11-28T18:49:36.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.070+0000 7f8703c9c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f86fc0b4310 0x7f86fc151290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:36.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.070+0000 7f8703c9c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f86fc0cba50 0x7f86fc1408b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:36.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.070+0000 7f8703c9c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86fc158ce0 0x7f86fc151850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:36.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.070+0000 7f8703c9c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86fc152d20 con 0x7f86fc158ce0 2023-11-28T18:49:36.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.070+0000 7f8703c9c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86fc140df0 con 0x7f86fc0cba50 2023-11-28T18:49:36.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.070+0000 7f8703c9c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86fc1520a0 con 0x7f86fc0b4310 2023-11-28T18:49:36.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.070+0000 7f8702239640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86fc158ce0 0x7f86fc151850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:36.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.070+0000 7f8702239640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86fc158ce0 0x7f86fc151850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40438/0 (socket says 172.21.15.45:40438) 2023-11-28T18:49:36.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.070+0000 7f8702239640 1 -- 172.21.15.45:0/2473556175 learned_addr learned my addr 172.21.15.45:0/2473556175 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:49:36.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.070+0000 7f8701237640 1 --2- 172.21.15.45:0/2473556175 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f86fc0cba50 0x7f86fc1408b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:36.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.070+0000 7f8701a38640 1 --2- 172.21.15.45:0/2473556175 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f86fc0b4310 0x7f86fc151290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:36.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.070+0000 7f8702239640 1 -- 172.21.15.45:0/2473556175 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f86fc0b4310 msgr2=0x7f86fc151290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:36.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.070+0000 7f8702239640 1 --2- 172.21.15.45:0/2473556175 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f86fc0b4310 0x7f86fc151290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:36.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.070+0000 7f8702239640 1 -- 172.21.15.45:0/2473556175 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f86fc0cba50 msgr2=0x7f86fc1408b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:36.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.070+0000 7f8702239640 1 --2- 172.21.15.45:0/2473556175 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f86fc0cba50 0x7f86fc1408b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:36.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.070+0000 7f8702239640 1 -- 172.21.15.45:0/2473556175 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86ec0094d0 con 0x7f86fc158ce0 2023-11-28T18:49:36.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.070+0000 7f8701a38640 1 --2- 172.21.15.45:0/2473556175 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f86fc0b4310 0x7f86fc151290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:49:36.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.070+0000 7f8702239640 1 --2- 172.21.15.45:0/2473556175 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86fc158ce0 0x7f86fc151850 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f86f401b000 tx=0x7f86f40196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:49:36.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.074+0000 7f86f27fc640 1 -- 172.21.15.45:0/2473556175 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f40aed80 con 0x7f86fc158ce0 2023-11-28T18:49:36.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.074+0000 7f86f27fc640 1 -- 172.21.15.45:0/2473556175 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86f4009450 con 0x7f86fc158ce0 2023-11-28T18:49:36.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.074+0000 7f86f27fc640 1 -- 172.21.15.45:0/2473556175 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f40b7650 con 0x7f86fc158ce0 2023-11-28T18:49:36.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.074+0000 7f8703c9c640 1 -- 172.21.15.45:0/2473556175 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86f4009a70 con 0x7f86fc158ce0 2023-11-28T18:49:36.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.074+0000 7f8703c9c640 1 -- 172.21.15.45:0/2473556175 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86fc152660 con 0x7f86fc158ce0 2023-11-28T18:49:36.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.074+0000 7f8703c9c640 1 -- 172.21.15.45:0/2473556175 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86fc152e60 con 0x7f86fc158ce0 2023-11-28T18:49:36.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.074+0000 7f86f27fc640 1 -- 172.21.15.45:0/2473556175 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f86f40b4050 con 0x7f86fc158ce0 2023-11-28T18:49:36.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.074+0000 7f86f27fc640 1 --2- 172.21.15.45:0/2473556175 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f86e00668d0 0x7f86e0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:36.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.074+0000 7f86f27fc640 1 -- 172.21.15.45:0/2473556175 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f86f411f630 con 0x7f86fc158ce0 2023-11-28T18:49:36.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.074+0000 7f8701a38640 1 --2- 172.21.15.45:0/2473556175 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f86e00668d0 0x7f86e0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:36.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.078+0000 7f8701a38640 1 --2- 172.21.15.45:0/2473556175 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f86e00668d0 0x7f86e0068d90 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f86f8000f70 tx=0x7f86f8007d70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:49:36.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.078+0000 7f86f27fc640 1 -- 172.21.15.45:0/2473556175 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f86fc152e60 con 0x7f86fc158ce0 2023-11-28T18:49:36.083 INFO:teuthology.orchestra.run.smithi190.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-28T18:49:36.084 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T18:49:36.085 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T18:49:36.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.230+0000 7fa658d2a640 1 Processor -- start 2023-11-28T18:49:36.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.230+0000 7fa658d2a640 1 -- start start 2023-11-28T18:49:36.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.230+0000 7fa658d2a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6540b47a0 0x7fa6540d10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:36.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.230+0000 7fa658d2a640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa65415d800 con 0x7fa6540b4b80 2023-11-28T18:49:36.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.230+0000 7fa658d2a640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa654140970 con 0x7fa6540d1620 2023-11-28T18:49:36.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.230+0000 7fa658d2a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6540d1a90 con 0x7fa6540b47a0 2023-11-28T18:49:36.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.230+0000 7fa64bfff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fa6540b4b80 0x7fa654142c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38180/0 (socket says 172.21.15.45:38180) 2023-11-28T18:49:36.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.230+0000 7fa64bfff640 1 -- 172.21.15.45:0/1730877164 learned_addr learned my addr 172.21.15.45:0/1730877164 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:49:36.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.230+0000 7fa65259c640 1 --2- 172.21.15.45:0/1730877164 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6540b47a0 0x7fa6540d10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:36.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.230+0000 7fa651d9b640 1 -- 172.21.15.45:0/1730877164 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2489572855 0 0) 0x7fa65415d800 con 0x7fa6540b4b80 2023-11-28T18:49:36.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.230+0000 7fa651d9b640 1 -- 172.21.15.45:0/1730877164 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa640003530 con 0x7fa6540b4b80 2023-11-28T18:49:36.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.230+0000 7fa651d9b640 1 -- 172.21.15.45:0/1730877164 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 638072616 0 0) 0x7fa654140970 con 0x7fa6540d1620 2023-11-28T18:49:36.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.234+0000 7fa651d9b640 1 -- 172.21.15.45:0/1730877164 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa65415d800 con 0x7fa6540d1620 2023-11-28T18:49:36.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.234+0000 7fa65259c640 1 -- 172.21.15.45:0/1730877164 >> v1:172.21.15.190:6789/0 conn(0x7fa6540d1620 legacy=0x7fa654160df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:36.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.234+0000 7fa65259c640 1 -- 172.21.15.45:0/1730877164 >> v1:172.21.15.45:6789/0 conn(0x7fa6540b4b80 legacy=0x7fa654142c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:36.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.234+0000 7fa65259c640 1 -- 172.21.15.45:0/1730877164 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa65415da50 con 0x7fa6540b47a0 2023-11-28T18:49:36.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.238+0000 7fa65259c640 1 --2- 172.21.15.45:0/1730877164 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6540b47a0 0x7fa6540d10e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa6440097f0 tx=0x7fa64401c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73c0e73fac1a15d5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:49:36.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.238+0000 7fa651d9b640 1 -- 172.21.15.45:0/1730877164 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6440ab600 con 0x7fa6540b47a0 2023-11-28T18:49:36.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.238+0000 7fa651d9b640 1 -- 172.21.15.45:0/1730877164 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6440a7050 con 0x7fa6540b47a0 2023-11-28T18:49:36.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.238+0000 7fa651d9b640 1 -- 172.21.15.45:0/1730877164 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6440ab980 con 0x7fa6540b47a0 2023-11-28T18:49:36.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.238+0000 7fa658d2a640 1 -- 172.21.15.45:0/1730877164 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6540b47a0 msgr2=0x7fa6540d10e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:36.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.238+0000 7fa658d2a640 1 --2- 172.21.15.45:0/1730877164 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6540b47a0 0x7fa6540d10e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa6440097f0 tx=0x7fa64401c4c0 comp rx=0 tx=0).stop 2023-11-28T18:49:36.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.238+0000 7fa658d2a640 1 -- 172.21.15.45:0/1730877164 shutdown_connections 2023-11-28T18:49:36.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.238+0000 7fa658d2a640 1 --2- 172.21.15.45:0/1730877164 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6540b47a0 0x7fa6540d10e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:36.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.238+0000 7fa658d2a640 1 -- 172.21.15.45:0/1730877164 >> 172.21.15.45:0/1730877164 conn(0x7fa65406a570 msgr2=0x7fa65406a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:49:36.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.238+0000 7fa658d2a640 1 -- 172.21.15.45:0/1730877164 shutdown_connections 2023-11-28T18:49:36.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.238+0000 7fa658d2a640 1 -- 172.21.15.45:0/1730877164 wait complete. 2023-11-28T18:49:36.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.238+0000 7fa658d2a640 1 Processor -- start 2023-11-28T18:49:36.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.242+0000 7fa658d2a640 1 -- start start 2023-11-28T18:49:36.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.242+0000 7fa658d2a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa6540b47a0 0x7fa65413b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:36.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.242+0000 7fa658d2a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa6540b4b80 0x7fa65413c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:36.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.242+0000 7fa658d2a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6540d1620 0x7fa654159650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:36.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.242+0000 7fa658d2a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa654159200 con 0x7fa6540b47a0 2023-11-28T18:49:36.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.242+0000 7fa658d2a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa65413be40 con 0x7fa6540b4b80 2023-11-28T18:49:36.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.242+0000 7fa658d2a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6541588d0 con 0x7fa6540d1620 2023-11-28T18:49:36.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.242+0000 7fa65259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa6540b47a0 0x7fa65413b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:36.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.242+0000 7fa65259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa6540b47a0 0x7fa65413b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40442/0 (socket says 172.21.15.45:40442) 2023-11-28T18:49:36.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.242+0000 7fa65259c640 1 -- 172.21.15.45:0/3765965441 learned_addr learned my addr 172.21.15.45:0/3765965441 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:49:36.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.242+0000 7fa64bfff640 1 --2- 172.21.15.45:0/3765965441 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa6540b4b80 0x7fa65413c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:36.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.242+0000 7fa652d9d640 1 --2- 172.21.15.45:0/3765965441 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6540d1620 0x7fa654159650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:36.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.242+0000 7fa65259c640 1 -- 172.21.15.45:0/3765965441 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6540d1620 msgr2=0x7fa654159650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:36.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.242+0000 7fa65259c640 1 --2- 172.21.15.45:0/3765965441 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6540d1620 0x7fa654159650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:36.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.242+0000 7fa65259c640 1 -- 172.21.15.45:0/3765965441 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa6540b4b80 msgr2=0x7fa65413c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:36.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.242+0000 7fa65259c640 1 --2- 172.21.15.45:0/3765965441 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa6540b4b80 0x7fa65413c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:36.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.242+0000 7fa65259c640 1 -- 172.21.15.45:0/3765965441 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa644009420 con 0x7fa6540b47a0 2023-11-28T18:49:36.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.242+0000 7fa64bfff640 1 --2- 172.21.15.45:0/3765965441 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa6540b4b80 0x7fa65413c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:49:36.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.242+0000 7fa65259c640 1 --2- 172.21.15.45:0/3765965441 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa6540b47a0 0x7fa65413b780 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fa6440097f0 tx=0x7fa64401ad00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:49:36.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.242+0000 7fa64affd640 1 -- 172.21.15.45:0/3765965441 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6440b7450 con 0x7fa6540b47a0 2023-11-28T18:49:36.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.242+0000 7fa64affd640 1 -- 172.21.15.45:0/3765965441 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6440b75b0 con 0x7fa6540b47a0 2023-11-28T18:49:36.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.242+0000 7fa64affd640 1 -- 172.21.15.45:0/3765965441 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6440b7960 con 0x7fa6540b47a0 2023-11-28T18:49:36.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.242+0000 7fa658d2a640 1 -- 172.21.15.45:0/3765965441 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa654158bb0 con 0x7fa6540b47a0 2023-11-28T18:49:36.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.242+0000 7fa658d2a640 1 -- 172.21.15.45:0/3765965441 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa654156c60 con 0x7fa6540b47a0 2023-11-28T18:49:36.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.242+0000 7f8703c9c640 1 -- 172.21.15.45:0/2473556175 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f86fc152e60 con 0x7f86fc158ce0 2023-11-28T18:49:36.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.242+0000 7fa658d2a640 1 -- 172.21.15.45:0/3765965441 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa65415b660 con 0x7fa6540b47a0 2023-11-28T18:49:36.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.246+0000 7f86f27fc640 1 -- 172.21.15.45:0/2473556175 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v60) v1 ==== 93+0+10 (secure 0 0 0) 0x7f86fc152e60 con 0x7f86fc158ce0 2023-11-28T18:49:36.247 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-11-28T18:49:36.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.246+0000 7fa64affd640 1 -- 172.21.15.45:0/3765965441 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa6440b7ac0 con 0x7fa6540b47a0 2023-11-28T18:49:36.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.246+0000 7fa64affd640 1 --2- 172.21.15.45:0/3765965441 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa6340668d0 0x7fa634068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:36.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.246+0000 7fa64affd640 1 -- 172.21.15.45:0/3765965441 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa64411eae0 con 0x7fa6540b47a0 2023-11-28T18:49:36.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.246+0000 7f8703c9c640 1 -- 172.21.15.45:0/2473556175 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f86e00668d0 msgr2=0x7f86e0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:36.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.246+0000 7f8703c9c640 1 --2- 172.21.15.45:0/2473556175 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f86e00668d0 0x7f86e0068d90 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f86f8000f70 tx=0x7f86f8007d70 comp rx=0 tx=0).stop 2023-11-28T18:49:36.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.246+0000 7f8703c9c640 1 -- 172.21.15.45:0/2473556175 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86fc158ce0 msgr2=0x7f86fc151850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:36.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.246+0000 7f8703c9c640 1 --2- 172.21.15.45:0/2473556175 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86fc158ce0 0x7f86fc151850 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f86f401b000 tx=0x7f86f40196f0 comp rx=0 tx=0).stop 2023-11-28T18:49:36.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.246+0000 7f8703c9c640 1 -- 172.21.15.45:0/2473556175 shutdown_connections 2023-11-28T18:49:36.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.246+0000 7f8703c9c640 1 --2- 172.21.15.45:0/2473556175 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f86e00668d0 0x7f86e0068d90 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:36.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.246+0000 7f8703c9c640 1 --2- 172.21.15.45:0/2473556175 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86fc158ce0 0x7f86fc151850 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:36.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.246+0000 7f8703c9c640 1 --2- 172.21.15.45:0/2473556175 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f86fc0cba50 0x7f86fc1408b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:36.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.246+0000 7f8703c9c640 1 --2- 172.21.15.45:0/2473556175 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f86fc0b4310 0x7f86fc151290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:36.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.246+0000 7f8703c9c640 1 -- 172.21.15.45:0/2473556175 >> 172.21.15.45:0/2473556175 conn(0x7f86fc0b0d00 msgr2=0x7f86fc165530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:49:36.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.246+0000 7fa64bfff640 1 --2- 172.21.15.45:0/3765965441 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa6340668d0 0x7fa634068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:36.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.246+0000 7f8703c9c640 1 -- 172.21.15.45:0/2473556175 shutdown_connections 2023-11-28T18:49:36.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.246+0000 7f8703c9c640 1 -- 172.21.15.45:0/2473556175 wait complete. 2023-11-28T18:49:36.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.246+0000 7fa64bfff640 1 --2- 172.21.15.45:0/3765965441 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa6340668d0 0x7fa634068d90 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fa65406af60 tx=0x7fa63c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:49:36.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.254+0000 7fa64affd640 1 -- 172.21.15.45:0/3765965441 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa6440ebc80 con 0x7fa6540b47a0 2023-11-28T18:49:36.274 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T18:49:36.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.426+0000 7f761e4fe640 1 Processor -- start 2023-11-28T18:49:36.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.426+0000 7f761e4fe640 1 -- start start 2023-11-28T18:49:36.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.426+0000 7f761e4fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f761815d6d0 0x7f76180cfc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:36.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.426+0000 7f761e4fe640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f76180d0160 0x7f76180b0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:36.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.426+0000 7f761e4fe640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76180d05b0 con 0x7f761815d2f0 2023-11-28T18:49:36.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.426+0000 7f761e4fe640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76180aff70 con 0x7f761815d6d0 2023-11-28T18:49:36.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.426+0000 7f761e4fe640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76180d1f00 con 0x7f76180d0160 2023-11-28T18:49:36.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.426+0000 7f76177fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f761815d6d0 0x7f76180cfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:36.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.426+0000 7f76177fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f761815d6d0 0x7f76180cfc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40444/0 (socket says 172.21.15.45:40444) 2023-11-28T18:49:36.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.426+0000 7f76177fe640 1 -- 172.21.15.45:0/879581145 learned_addr learned my addr 172.21.15.45:0/879581145 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:49:36.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.426+0000 7f7617fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f761815d2f0 0x7f76180d17f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38186/0 (socket says 172.21.15.45:38186) 2023-11-28T18:49:36.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.426+0000 7f761ca9b640 1 --2- 172.21.15.45:0/879581145 >> v2:172.21.15.190:3300/0 conn(0x7f76180d0160 0x7f76180b0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:36.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.426+0000 7f76177fe640 1 -- 172.21.15.45:0/879581145 >> v2:172.21.15.190:3300/0 conn(0x7f76180d0160 msgr2=0x7f76180b0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:49:36.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.426+0000 7f76177fe640 1 --2- 172.21.15.45:0/879581145 >> v2:172.21.15.190:3300/0 conn(0x7f76180d0160 0x7f76180b0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:36.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.426+0000 7f76177fe640 1 -- 172.21.15.45:0/879581145 >> v1:172.21.15.45:6789/0 conn(0x7f761815d2f0 legacy=0x7f76180d17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:36.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.426+0000 7f76177fe640 1 -- 172.21.15.45:0/879581145 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76180b0210 con 0x7f761815d6d0 2023-11-28T18:49:36.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.430+0000 7f76177fe640 1 --2- 172.21.15.45:0/879581145 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f761815d6d0 0x7f76180cfc20 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f76180cdb60 tx=0x7f760c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c45f1ff0f0dae895 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:49:36.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.430+0000 7f7616ffd640 1 -- 172.21.15.45:0/879581145 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760c0aa430 con 0x7f761815d6d0 2023-11-28T18:49:36.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.430+0000 7f7616ffd640 1 -- 172.21.15.45:0/879581145 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f760c0aa590 con 0x7f761815d6d0 2023-11-28T18:49:36.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.430+0000 7f7616ffd640 1 -- 172.21.15.45:0/879581145 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760c0aa920 con 0x7f761815d6d0 2023-11-28T18:49:36.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.430+0000 7f761e4fe640 1 -- 172.21.15.45:0/879581145 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f761815d6d0 msgr2=0x7f76180cfc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:36.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.430+0000 7f761e4fe640 1 --2- 172.21.15.45:0/879581145 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f761815d6d0 0x7f76180cfc20 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f76180cdb60 tx=0x7f760c01c4d0 comp rx=0 tx=0).stop 2023-11-28T18:49:36.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.430+0000 7f761e4fe640 1 -- 172.21.15.45:0/879581145 shutdown_connections 2023-11-28T18:49:36.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.430+0000 7f761e4fe640 1 --2- 172.21.15.45:0/879581145 >> v2:172.21.15.190:3300/0 conn(0x7f76180d0160 0x7f76180b0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:36.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.430+0000 7f761e4fe640 1 --2- 172.21.15.45:0/879581145 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f761815d6d0 0x7f76180cfc20 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:36.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.430+0000 7f761e4fe640 1 -- 172.21.15.45:0/879581145 >> 172.21.15.45:0/879581145 conn(0x7f761809c550 msgr2=0x7f76180d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:49:36.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.430+0000 7f761e4fe640 1 -- 172.21.15.45:0/879581145 shutdown_connections 2023-11-28T18:49:36.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.434+0000 7f761e4fe640 1 -- 172.21.15.45:0/879581145 wait complete. 2023-11-28T18:49:36.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.434+0000 7f761e4fe640 1 Processor -- start 2023-11-28T18:49:36.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.434+0000 7f761e4fe640 1 -- start start 2023-11-28T18:49:36.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.434+0000 7f761e4fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76180d0160 0x7f76180c7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:36.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.434+0000 7f761e4fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f761815d2f0 0x7f761806c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:36.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.434+0000 7f761e4fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f761815d6d0 0x7f7618153170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:36.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.434+0000 7f761e4fe640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7618160d50 con 0x7f76180d0160 2023-11-28T18:49:36.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.434+0000 7f761e4fe640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7618160790 con 0x7f761815d6d0 2023-11-28T18:49:36.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.434+0000 7f761e4fe640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7618160a70 con 0x7f761815d2f0 2023-11-28T18:49:36.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.434+0000 7f7617fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76180d0160 0x7f76180c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:36.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.434+0000 7f7617fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76180d0160 0x7f76180c7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40458/0 (socket says 172.21.15.45:40458) 2023-11-28T18:49:36.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.434+0000 7f7617fff640 1 -- 172.21.15.45:0/2668766656 learned_addr learned my addr 172.21.15.45:0/2668766656 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:49:36.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.434+0000 7f761ca9b640 1 --2- 172.21.15.45:0/2668766656 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f761815d6d0 0x7f7618153170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:36.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.434+0000 7f7617fff640 1 -- 172.21.15.45:0/2668766656 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f761815d2f0 msgr2=0x7f761806c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:36.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.434+0000 7f7617fff640 1 --2- 172.21.15.45:0/2668766656 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f761815d2f0 0x7f761806c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:36.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.434+0000 7f7617fff640 1 -- 172.21.15.45:0/2668766656 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f761815d6d0 msgr2=0x7f7618153170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:36.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.434+0000 7f7617fff640 1 --2- 172.21.15.45:0/2668766656 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f761815d6d0 0x7f7618153170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:36.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.434+0000 7f7617fff640 1 -- 172.21.15.45:0/2668766656 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f760c0094d0 con 0x7f76180d0160 2023-11-28T18:49:36.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.434+0000 7f761ca9b640 1 --2- 172.21.15.45:0/2668766656 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f761815d6d0 0x7f7618153170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:49:36.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.434+0000 7f7617fff640 1 --2- 172.21.15.45:0/2668766656 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76180d0160 0x7f76180c7250 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f760800c490 tx=0x7f760800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:49:36.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.434+0000 7f7614ff9640 1 -- 172.21.15.45:0/2668766656 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7608007480 con 0x7f76180d0160 2023-11-28T18:49:36.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.438+0000 7f7614ff9640 1 -- 172.21.15.45:0/2668766656 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76080075e0 con 0x7f76180d0160 2023-11-28T18:49:36.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.438+0000 7f7614ff9640 1 -- 172.21.15.45:0/2668766656 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7608004a10 con 0x7f76180d0160 2023-11-28T18:49:36.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.438+0000 7f761e4fe640 1 -- 172.21.15.45:0/2668766656 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7618153e60 con 0x7f76180d0160 2023-11-28T18:49:36.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.438+0000 7f761e4fe640 1 -- 172.21.15.45:0/2668766656 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76180c7790 con 0x7f76180d0160 2023-11-28T18:49:36.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.438+0000 7f761e4fe640 1 -- 172.21.15.45:0/2668766656 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7618067a30 con 0x7f76180d0160 2023-11-28T18:49:36.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.438+0000 7f7614ff9640 1 -- 172.21.15.45:0/2668766656 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f7608004b70 con 0x7f76180d0160 2023-11-28T18:49:36.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.438+0000 7f7614ff9640 1 --2- 172.21.15.45:0/2668766656 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f76040668d0 0x7f7604068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:36.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.438+0000 7f7614ff9640 1 -- 172.21.15.45:0/2668766656 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f76080834b0 con 0x7f76180d0160 2023-11-28T18:49:36.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.438+0000 7f76177fe640 1 --2- 172.21.15.45:0/2668766656 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f76040668d0 0x7f7604068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:36.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.442+0000 7f76177fe640 1 --2- 172.21.15.45:0/2668766656 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f76040668d0 0x7f7604068d90 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f760c0ae000 tx=0x7f760c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:49:36.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.442+0000 7f7614ff9640 1 -- 172.21.15.45:0/2668766656 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f76080506e0 con 0x7f76180d0160 2023-11-28T18:49:36.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.454+0000 7fa658d2a640 1 -- 172.21.15.45:0/3765965441 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa654069480 con 0x7fa6540b47a0 2023-11-28T18:49:36.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.454+0000 7fa64affd640 1 -- 172.21.15.45:0/3765965441 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4983 (secure 0 0 0) 0x7fa6440ef2a0 con 0x7fa6540b47a0 2023-11-28T18:49:36.454 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:49:36.454 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":56,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6002,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/1183598108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":1183598108},{"type":"v1","addr":"172.21.15.190:6836","nonce":1183598108}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6005,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/3723100406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":3723100406},{"type":"v1","addr":"172.21.15.190:6837","nonce":3723100406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":56,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T18:43:58.654090+0000","modified":"2023-11-28T18:47:31.316416+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6792,"mds_1":6789},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6789":{"gid":6789,"name":"c","rank":1,"incarnation":50,"state":"up:active","state_seq":5,"addr":"172.21.15.45:6833/1994543507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1994543507},{"type":"v1","addr":"172.21.15.45:6833","nonce":1994543507}]},"join_fscid":-1,"laggy_since":"2023-11-28T18:44:43.089016+0000","export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_6792":{"gid":6792,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":56,"addr":"172.21.15.45:6835/2107305848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2107305848},{"type":"v1","addr":"172.21.15.45:6835","nonce":2107305848}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-28T18:49:36.454 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 56 2023-11-28T18:49:36.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.458+0000 7fa658d2a640 1 -- 172.21.15.45:0/3765965441 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa6340668d0 msgr2=0x7fa634068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:36.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.458+0000 7fa658d2a640 1 --2- 172.21.15.45:0/3765965441 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa6340668d0 0x7fa634068d90 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fa65406af60 tx=0x7fa63c009040 comp rx=0 tx=0).stop 2023-11-28T18:49:36.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.458+0000 7fa658d2a640 1 -- 172.21.15.45:0/3765965441 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa6540b47a0 msgr2=0x7fa65413b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:36.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.458+0000 7fa658d2a640 1 --2- 172.21.15.45:0/3765965441 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa6540b47a0 0x7fa65413b780 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fa6440097f0 tx=0x7fa64401ad00 comp rx=0 tx=0).stop 2023-11-28T18:49:36.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.458+0000 7fa658d2a640 1 -- 172.21.15.45:0/3765965441 shutdown_connections 2023-11-28T18:49:36.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.458+0000 7fa658d2a640 1 --2- 172.21.15.45:0/3765965441 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa6340668d0 0x7fa634068d90 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:36.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.458+0000 7fa658d2a640 1 --2- 172.21.15.45:0/3765965441 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6540d1620 0x7fa654159650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:36.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.458+0000 7fa658d2a640 1 --2- 172.21.15.45:0/3765965441 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa6540b4b80 0x7fa65413c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:36.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.458+0000 7fa658d2a640 1 --2- 172.21.15.45:0/3765965441 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa6540b47a0 0x7fa65413b780 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:36.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.458+0000 7fa658d2a640 1 -- 172.21.15.45:0/3765965441 >> 172.21.15.45:0/3765965441 conn(0x7fa65406a570 msgr2=0x7fa654140870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:49:36.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.458+0000 7fa658d2a640 1 -- 172.21.15.45:0/3765965441 shutdown_connections 2023-11-28T18:49:36.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.458+0000 7fa658d2a640 1 -- 172.21.15.45:0/3765965441 wait complete. 2023-11-28T18:49:36.476 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T18:49:36.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.602+0000 7f761e4fe640 1 -- 172.21.15.45:0/2668766656 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f76180b0c60 con 0x7f76180d0160 2023-11-28T18:49:36.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.606+0000 7f7614ff9640 1 -- 172.21.15.45:0/2668766656 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v60) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7608053d00 con 0x7f76180d0160 2023-11-28T18:49:36.604 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-11-28T18:49:36.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.606+0000 7f761e4fe640 1 -- 172.21.15.45:0/2668766656 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f76040668d0 msgr2=0x7f7604068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:36.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.606+0000 7f761e4fe640 1 --2- 172.21.15.45:0/2668766656 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f76040668d0 0x7f7604068d90 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f760c0ae000 tx=0x7f760c008040 comp rx=0 tx=0).stop 2023-11-28T18:49:36.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.606+0000 7f761e4fe640 1 -- 172.21.15.45:0/2668766656 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76180d0160 msgr2=0x7f76180c7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:36.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.606+0000 7f761e4fe640 1 --2- 172.21.15.45:0/2668766656 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76180d0160 0x7f76180c7250 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f760800c490 tx=0x7f760800c950 comp rx=0 tx=0).stop 2023-11-28T18:49:36.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.606+0000 7f761e4fe640 1 -- 172.21.15.45:0/2668766656 shutdown_connections 2023-11-28T18:49:36.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.606+0000 7f761e4fe640 1 --2- 172.21.15.45:0/2668766656 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f76040668d0 0x7f7604068d90 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:36.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.606+0000 7f761e4fe640 1 --2- 172.21.15.45:0/2668766656 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f761815d6d0 0x7f7618153170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:36.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.606+0000 7f761e4fe640 1 --2- 172.21.15.45:0/2668766656 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f761815d2f0 0x7f761806c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:36.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.606+0000 7f761e4fe640 1 --2- 172.21.15.45:0/2668766656 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76180d0160 0x7f76180c7250 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:36.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.606+0000 7f761e4fe640 1 -- 172.21.15.45:0/2668766656 >> 172.21.15.45:0/2668766656 conn(0x7f761809c550 msgr2=0x7f76180b2610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:49:36.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.606+0000 7f761e4fe640 1 -- 172.21.15.45:0/2668766656 shutdown_connections 2023-11-28T18:49:36.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.606+0000 7f761e4fe640 1 -- 172.21.15.45:0/2668766656 wait complete. 2023-11-28T18:49:36.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.622+0000 7fa2a5817640 1 Processor -- start 2023-11-28T18:49:36.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.622+0000 7fa2a5817640 1 -- start start 2023-11-28T18:49:36.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.622+0000 7fa2a5817640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa2a01608b0 0x7fa2a00d2b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:36.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.622+0000 7fa2a5817640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa2a00b51e0 0x7fa2a00b5630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:36.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.622+0000 7fa2a5817640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2a00b5b70 con 0x7fa2a00cdb60 2023-11-28T18:49:36.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.622+0000 7fa2a5817640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2a0160c90 con 0x7fa2a01608b0 2023-11-28T18:49:36.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.622+0000 7fa2a5817640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a00d0db0 con 0x7fa2a00b51e0 2023-11-28T18:49:36.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.622+0000 7fa29effd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa2a01608b0 0x7fa2a00d2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:36.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.622+0000 7fa29effd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa2a01608b0 0x7fa2a00d2b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40468/0 (socket says 172.21.15.45:40468) 2023-11-28T18:49:36.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.622+0000 7fa29effd640 1 -- 172.21.15.45:0/909072256 learned_addr learned my addr 172.21.15.45:0/909072256 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:49:36.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.622+0000 7fa297fff640 1 --1- 172.21.15.45:0/909072256 >> v1:172.21.15.45:6789/0 conn(0x7fa2a00cdb60 0x7fa2a00b6270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38200/0 (socket says 172.21.15.45:38200) 2023-11-28T18:49:36.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.622+0000 7fa29f7fe640 1 --2- 172.21.15.45:0/909072256 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa2a00b51e0 0x7fa2a00b5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:36.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.622+0000 7fa29effd640 1 -- 172.21.15.45:0/909072256 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa2a00b51e0 msgr2=0x7fa2a00b5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:49:36.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.622+0000 7fa29effd640 1 --2- 172.21.15.45:0/909072256 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa2a00b51e0 0x7fa2a00b5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:36.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.622+0000 7fa29effd640 1 -- 172.21.15.45:0/909072256 >> v1:172.21.15.45:6789/0 conn(0x7fa2a00cdb60 legacy=0x7fa2a00b6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:36.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.622+0000 7fa29effd640 1 -- 172.21.15.45:0/909072256 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2a00b6980 con 0x7fa2a01608b0 2023-11-28T18:49:36.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.622+0000 7fa29e7fc640 1 -- 172.21.15.45:0/909072256 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1775706376 0 0) 0x7fa288001120 con 0x7fa2a00cdb60 2023-11-28T18:49:36.627 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T18:49:36.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.626+0000 7fa29effd640 1 --2- 172.21.15.45:0/909072256 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2a01608b0 0x7fa2a00d2b50 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fa290009870 tx=0x7fa29001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43964f6574152fc4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:49:36.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.626+0000 7fa29e7fc640 1 -- 172.21.15.45:0/909072256 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2900a7070 con 0x7fa2a01608b0 2023-11-28T18:49:36.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.626+0000 7fa29e7fc640 1 -- 172.21.15.45:0/909072256 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2900ab430 con 0x7fa2a01608b0 2023-11-28T18:49:36.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.626+0000 7fa29e7fc640 1 -- 172.21.15.45:0/909072256 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2900ab7c0 con 0x7fa2a01608b0 2023-11-28T18:49:36.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.626+0000 7fa2a5817640 1 -- 172.21.15.45:0/909072256 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2a01608b0 msgr2=0x7fa2a00d2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:36.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.626+0000 7fa2a5817640 1 --2- 172.21.15.45:0/909072256 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2a01608b0 0x7fa2a00d2b50 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fa290009870 tx=0x7fa29001c540 comp rx=0 tx=0).stop 2023-11-28T18:49:36.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.626+0000 7fa2a5817640 1 -- 172.21.15.45:0/909072256 shutdown_connections 2023-11-28T18:49:36.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.626+0000 7fa2a5817640 1 --2- 172.21.15.45:0/909072256 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa2a00b51e0 0x7fa2a00b5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:36.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.626+0000 7fa2a5817640 1 --2- 172.21.15.45:0/909072256 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2a01608b0 0x7fa2a00d2b50 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:36.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.626+0000 7fa2a5817640 1 -- 172.21.15.45:0/909072256 >> 172.21.15.45:0/909072256 conn(0x7fa2a00720a0 msgr2=0x7fa2a00724b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:49:36.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.630+0000 7fa2a5817640 1 -- 172.21.15.45:0/909072256 shutdown_connections 2023-11-28T18:49:36.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.630+0000 7fa2a5817640 1 -- 172.21.15.45:0/909072256 wait complete. 2023-11-28T18:49:36.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.630+0000 7fa2a5817640 1 Processor -- start 2023-11-28T18:49:36.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.630+0000 7fa2a5817640 1 -- start start 2023-11-28T18:49:36.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.630+0000 7fa2a5817640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2a00b51e0 0x7fa2a014e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:36.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.630+0000 7fa2a5817640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa2a00cdb60 0x7fa2a0156920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:36.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.630+0000 7fa2a5817640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa2a01608b0 0x7fa2a014c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:36.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.630+0000 7fa2a5817640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a00c8120 con 0x7fa2a00b51e0 2023-11-28T18:49:36.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.630+0000 7fa2a5817640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a00c7e40 con 0x7fa2a01608b0 2023-11-28T18:49:36.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.630+0000 7fa2a5817640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a014ddf0 con 0x7fa2a00cdb60 2023-11-28T18:49:36.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.630+0000 7fa29effd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2a00b51e0 0x7fa2a014e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:36.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.630+0000 7fa29effd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2a00b51e0 0x7fa2a014e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40482/0 (socket says 172.21.15.45:40482) 2023-11-28T18:49:36.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.630+0000 7fa29effd640 1 -- 172.21.15.45:0/1984942596 learned_addr learned my addr 172.21.15.45:0/1984942596 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:49:36.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.630+0000 7fa297fff640 1 --2- 172.21.15.45:0/1984942596 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa2a00cdb60 0x7fa2a0156920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:36.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.630+0000 7fa29f7fe640 1 --2- 172.21.15.45:0/1984942596 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa2a01608b0 0x7fa2a014c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:36.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.630+0000 7fa29effd640 1 -- 172.21.15.45:0/1984942596 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa2a00cdb60 msgr2=0x7fa2a0156920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:36.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.630+0000 7fa29effd640 1 --2- 172.21.15.45:0/1984942596 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa2a00cdb60 0x7fa2a0156920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:36.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.630+0000 7fa29effd640 1 -- 172.21.15.45:0/1984942596 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa2a01608b0 msgr2=0x7fa2a014c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:36.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.630+0000 7fa29effd640 1 --2- 172.21.15.45:0/1984942596 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa2a01608b0 0x7fa2a014c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:36.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.630+0000 7fa29effd640 1 -- 172.21.15.45:0/1984942596 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2900094d0 con 0x7fa2a00b51e0 2023-11-28T18:49:36.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.630+0000 7fa29f7fe640 1 --2- 172.21.15.45:0/1984942596 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa2a01608b0 0x7fa2a014c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:49:36.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.630+0000 7fa297fff640 1 --2- 172.21.15.45:0/1984942596 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa2a00cdb60 0x7fa2a0156920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:49:36.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.630+0000 7fa29effd640 1 --2- 172.21.15.45:0/1984942596 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2a00b51e0 0x7fa2a014e790 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fa2900ad040 tx=0x7fa2900192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:49:36.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.634+0000 7fa29cff9640 1 -- 172.21.15.45:0/1984942596 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2900b4830 con 0x7fa2a00b51e0 2023-11-28T18:49:36.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.634+0000 7fa29cff9640 1 -- 172.21.15.45:0/1984942596 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2900b4990 con 0x7fa2a00b51e0 2023-11-28T18:49:36.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.634+0000 7fa29cff9640 1 -- 172.21.15.45:0/1984942596 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2900b4d40 con 0x7fa2a00b51e0 2023-11-28T18:49:36.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.634+0000 7fa2a5817640 1 -- 172.21.15.45:0/1984942596 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2a014e0d0 con 0x7fa2a00b51e0 2023-11-28T18:49:36.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.634+0000 7fa2a5817640 1 -- 172.21.15.45:0/1984942596 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2a0156e60 con 0x7fa2a00b51e0 2023-11-28T18:49:36.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.634+0000 7fa2a5817640 1 -- 172.21.15.45:0/1984942596 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2a0157050 con 0x7fa2a00b51e0 2023-11-28T18:49:36.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.634+0000 7fa29cff9640 1 -- 172.21.15.45:0/1984942596 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa2900c2460 con 0x7fa2a00b51e0 2023-11-28T18:49:36.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.634+0000 7fa29cff9640 1 --2- 172.21.15.45:0/1984942596 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa2800668d0 0x7fa280068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:36.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.634+0000 7fa29cff9640 1 -- 172.21.15.45:0/1984942596 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa29011f170 con 0x7fa2a00b51e0 2023-11-28T18:49:36.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.634+0000 7fa297fff640 1 --2- 172.21.15.45:0/1984942596 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa2800668d0 0x7fa280068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:36.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.638+0000 7fa297fff640 1 --2- 172.21.15.45:0/1984942596 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa2800668d0 0x7fa280068d90 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fa288001380 tx=0x7fa288009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:49:36.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.638+0000 7fa29cff9640 1 -- 172.21.15.45:0/1984942596 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa2900ec3d0 con 0x7fa2a00b51e0 2023-11-28T18:49:36.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.778+0000 7f6da8e32640 1 Processor -- start 2023-11-28T18:49:36.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.778+0000 7f6da8e32640 1 -- start start 2023-11-28T18:49:36.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.778+0000 7f6da8e32640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6da415d2f0 0x7f6da40d17f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:36.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.778+0000 7f6da8e32640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f6da40d1d30 0x7f6da40cfc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:36.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.778+0000 7f6da8e32640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6da40aff70 con 0x7f6da415d6d0 2023-11-28T18:49:36.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.778+0000 7f6da8e32640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6da40b0210 con 0x7f6da40d1d30 2023-11-28T18:49:36.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.778+0000 7f6da8e32640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6da40b04f0 con 0x7f6da415d2f0 2023-11-28T18:49:36.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.778+0000 7f6da1d9b640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f6da40d1d30 0x7f6da40cfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:36.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.778+0000 7f6da259c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6da415d2f0 0x7f6da40d17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:36.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.778+0000 7f6da1d9b640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f6da40d1d30 0x7f6da40cfc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.45:50094/0 (socket says 172.21.15.45:50094) 2023-11-28T18:49:36.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.778+0000 7f6da1d9b640 1 -- 172.21.15.45:0/2698564634 learned_addr learned my addr 172.21.15.45:0/2698564634 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:49:36.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.778+0000 7f6da259c640 1 -- 172.21.15.45:0/2698564634 >> v2:172.21.15.190:3300/0 conn(0x7f6da40d1d30 msgr2=0x7f6da40cfc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:49:36.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.778+0000 7f6da259c640 1 --2- 172.21.15.45:0/2698564634 >> v2:172.21.15.190:3300/0 conn(0x7f6da40d1d30 0x7f6da40cfc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:36.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.778+0000 7f6da259c640 1 -- 172.21.15.45:0/2698564634 >> v1:172.21.15.190:6789/0 conn(0x7f6da415d6d0 legacy=0x7f6da40cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:36.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.778+0000 7f6da259c640 1 -- 172.21.15.45:0/2698564634 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6da40b07d0 con 0x7f6da415d2f0 2023-11-28T18:49:36.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.778+0000 7f6da1d9b640 1 --2- 172.21.15.45:0/2698564634 >> v2:172.21.15.190:3300/0 conn(0x7f6da40d1d30 0x7f6da40cfc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:49:36.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.782+0000 7f6da259c640 1 --2- 172.21.15.45:0/2698564634 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6da415d2f0 0x7f6da40d17f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6d940097c0 tx=0x7f6d9401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd4119a684f46cf2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:49:36.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.782+0000 7f6da159a640 1 -- 172.21.15.45:0/2698564634 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d940ab620 con 0x7f6da415d2f0 2023-11-28T18:49:36.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.782+0000 7f6da159a640 1 -- 172.21.15.45:0/2698564634 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d940ab780 con 0x7f6da415d2f0 2023-11-28T18:49:36.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.782+0000 7f6da159a640 1 -- 172.21.15.45:0/2698564634 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d940abb10 con 0x7f6da415d2f0 2023-11-28T18:49:36.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.782+0000 7f6da8e32640 1 -- 172.21.15.45:0/2698564634 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6da415d2f0 msgr2=0x7f6da40d17f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:36.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.782+0000 7f6da8e32640 1 --2- 172.21.15.45:0/2698564634 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6da415d2f0 0x7f6da40d17f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6d940097c0 tx=0x7f6d9401c480 comp rx=0 tx=0).stop 2023-11-28T18:49:36.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.782+0000 7f6da8e32640 1 -- 172.21.15.45:0/2698564634 shutdown_connections 2023-11-28T18:49:36.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.782+0000 7f6da8e32640 1 --2- 172.21.15.45:0/2698564634 >> v2:172.21.15.190:3300/0 conn(0x7f6da40d1d30 0x7f6da40cfc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:36.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.782+0000 7f6da8e32640 1 --2- 172.21.15.45:0/2698564634 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6da415d2f0 0x7f6da40d17f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:36.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.782+0000 7f6da8e32640 1 -- 172.21.15.45:0/2698564634 >> 172.21.15.45:0/2698564634 conn(0x7f6da409c550 msgr2=0x7f6da40d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:49:36.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.782+0000 7f6da8e32640 1 -- 172.21.15.45:0/2698564634 shutdown_connections 2023-11-28T18:49:36.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.782+0000 7f6da8e32640 1 -- 172.21.15.45:0/2698564634 wait complete. 2023-11-28T18:49:36.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.786+0000 7f6da8e32640 1 Processor -- start 2023-11-28T18:49:36.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.786+0000 7f6da8e32640 1 -- start start 2023-11-28T18:49:36.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.786+0000 7f6da8e32640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6da40d1d30 0x7f6da4153780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:36.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.786+0000 7f6da8e32640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6da415d2f0 0x7f6da4158080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:36.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.786+0000 7f6da8e32640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6da415d6d0 0x7f6da415be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:36.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.786+0000 7f6da8e32640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6da4153cc0 con 0x7f6da415d2f0 2023-11-28T18:49:36.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.786+0000 7f6da8e32640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6da41585c0 con 0x7f6da40d1d30 2023-11-28T18:49:36.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.786+0000 7f6da8e32640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6da4158840 con 0x7f6da415d6d0 2023-11-28T18:49:36.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.786+0000 7f6da1d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6da415d2f0 0x7f6da4158080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:36.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.786+0000 7f6da1d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6da415d2f0 0x7f6da4158080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40492/0 (socket says 172.21.15.45:40492) 2023-11-28T18:49:36.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.786+0000 7f6da1d9b640 1 -- 172.21.15.45:0/3014234006 learned_addr learned my addr 172.21.15.45:0/3014234006 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:49:36.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.786+0000 7f6da259c640 1 --2- 172.21.15.45:0/3014234006 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6da40d1d30 0x7f6da4153780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:36.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.786+0000 7f6da2d9d640 1 --2- 172.21.15.45:0/3014234006 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6da415d6d0 0x7f6da415be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:36.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.786+0000 7f6da1d9b640 1 -- 172.21.15.45:0/3014234006 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6da415d6d0 msgr2=0x7f6da415be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:36.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.786+0000 7f6da1d9b640 1 --2- 172.21.15.45:0/3014234006 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6da415d6d0 0x7f6da415be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:36.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.786+0000 7f6da1d9b640 1 -- 172.21.15.45:0/3014234006 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6da40d1d30 msgr2=0x7f6da4153780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:36.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.786+0000 7f6da1d9b640 1 --2- 172.21.15.45:0/3014234006 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6da40d1d30 0x7f6da4153780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:36.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.786+0000 7f6da1d9b640 1 -- 172.21.15.45:0/3014234006 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d980094d0 con 0x7f6da415d2f0 2023-11-28T18:49:36.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.786+0000 7f6da1d9b640 1 --2- 172.21.15.45:0/3014234006 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6da415d2f0 0x7f6da4158080 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f6d9800e9d0 tx=0x7f6d9800ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:49:36.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.786+0000 7f6d92ffd640 1 -- 172.21.15.45:0/3014234006 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d9800ca60 con 0x7f6da415d2f0 2023-11-28T18:49:36.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.786+0000 7f6d92ffd640 1 -- 172.21.15.45:0/3014234006 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d9800cbc0 con 0x7f6da415d2f0 2023-11-28T18:49:36.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.786+0000 7f6d92ffd640 1 -- 172.21.15.45:0/3014234006 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d98013470 con 0x7f6da415d2f0 2023-11-28T18:49:36.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.786+0000 7f6da8e32640 1 -- 172.21.15.45:0/3014234006 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d94009420 con 0x7f6da415d2f0 2023-11-28T18:49:36.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.786+0000 7f6da8e32640 1 -- 172.21.15.45:0/3014234006 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6da4158e00 con 0x7f6da415d2f0 2023-11-28T18:49:36.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.790+0000 7f6da8e32640 1 -- 172.21.15.45:0/3014234006 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6da4067a30 con 0x7f6da415d2f0 2023-11-28T18:49:36.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.790+0000 7f6d92ffd640 1 -- 172.21.15.45:0/3014234006 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f6d980135d0 con 0x7f6da415d2f0 2023-11-28T18:49:36.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.790+0000 7f6d92ffd640 1 --2- 172.21.15.45:0/3014234006 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6d840668d0 0x7f6d84068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:36.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.790+0000 7f6d92ffd640 1 -- 172.21.15.45:0/3014234006 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6d98084e40 con 0x7f6da415d2f0 2023-11-28T18:49:36.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.790+0000 7f6da259c640 1 --2- 172.21.15.45:0/3014234006 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6d840668d0 0x7f6d84068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:36.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.790+0000 7f6da259c640 1 --2- 172.21.15.45:0/3014234006 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6d840668d0 0x7f6d84068d90 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f6d940af000 tx=0x7f6d940a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:49:36.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.798+0000 7f6d92ffd640 1 -- 172.21.15.45:0/3014234006 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6d980521a0 con 0x7f6da415d2f0 2023-11-28T18:49:36.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.802+0000 7fa2a5817640 1 -- 172.21.15.45:0/1984942596 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa2a00cdf70 con 0x7fa2a00b51e0 2023-11-28T18:49:36.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.806+0000 7fa29cff9640 1 -- 172.21.15.45:0/1984942596 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+16529 (secure 0 0 0) 0x7fa2a00cdf70 con 0x7fa2a00b51e0 2023-11-28T18:49:36.805 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:49:36.806 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":60,"fsid":"d10f5cd6-1d00-4019-99b6-6fa435498a15","created":"2023-11-28T18:37:08.189030+0000","modified":"2023-11-28T18:44:00.269525+0000","last_up_change":"2023-11-28T18:37:20.196124+0000","last_in_change":"2023-11-28T18:37:10.742043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T18:37:21.293917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-28T18:43:57.069740+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-28T18:43:57.647964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"84465384-103c-4f2c-a45a-96f5bb9c835f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6809","nonce":555237322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6811","nonce":555237322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6815","nonce":555237322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6813","nonce":555237322}]},"public_addr":"172.21.15.45:6809/555237322","cluster_addr":"172.21.15.45:6811/555237322","heartbeat_back_addr":"172.21.15.45:6815/555237322","heartbeat_front_addr":"172.21.15.45:6813/555237322","state":["exists","up"]},{"osd":1,"uuid":"7d9eed24-a58f-42c7-a787-ac06be8553fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6801","nonce":2857063763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6803","nonce":2857063763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6807","nonce":2857063763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6805","nonce":2857063763}]},"public_addr":"172.21.15.45:6801/2857063763","cluster_addr":"172.21.15.45:6803/2857063763","heartbeat_back_addr":"172.21.15.45:6807/2857063763","heartbeat_front_addr":"172.21.15.45:6805/2857063763","state":["exists","up"]},{"osd":2,"uuid":"575eeccc-4abf-45b4-9caf-f3e797859588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6817","nonce":193884539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6819","nonce":193884539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6823","nonce":193884539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6821","nonce":193884539}]},"public_addr":"172.21.15.45:6817/193884539","cluster_addr":"172.21.15.45:6819/193884539","heartbeat_back_addr":"172.21.15.45:6823/193884539","heartbeat_front_addr":"172.21.15.45:6821/193884539","state":["exists","up"]},{"osd":3,"uuid":"9b0290d6-9a52-4bc8-b2a1-7622c5dc8e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6825","nonce":78541084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6827","nonce":78541084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6831","nonce":78541084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6829","nonce":78541084}]},"public_addr":"172.21.15.45:6825/78541084","cluster_addr":"172.21.15.45:6827/78541084","heartbeat_back_addr":"172.21.15.45:6831/78541084","heartbeat_front_addr":"172.21.15.45:6829/78541084","state":["exists","up"]},{"osd":4,"uuid":"ce632829-f027-4fbf-a627-02c571aa9d53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6809","nonce":1537591987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6811","nonce":1537591987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6815","nonce":1537591987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6813","nonce":1537591987}]},"public_addr":"172.21.15.190:6809/1537591987","cluster_addr":"172.21.15.190:6811/1537591987","heartbeat_back_addr":"172.21.15.190:6815/1537591987","heartbeat_front_addr":"172.21.15.190:6813/1537591987","state":["exists","up"]},{"osd":5,"uuid":"8700b609-27be-40bd-a251-4c0ae0a29ead","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6801","nonce":3296698407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6803","nonce":3296698407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6807","nonce":3296698407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6805","nonce":3296698407}]},"public_addr":"172.21.15.190:6801/3296698407","cluster_addr":"172.21.15.190:6803/3296698407","heartbeat_back_addr":"172.21.15.190:6807/3296698407","heartbeat_front_addr":"172.21.15.190:6805/3296698407","state":["exists","up"]},{"osd":6,"uuid":"44ce4a40-e6ff-4f4d-8e8a-7341e5c91f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6817","nonce":2317686718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6819","nonce":2317686718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6823","nonce":2317686718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6821","nonce":2317686718}]},"public_addr":"172.21.15.190:6817/2317686718","cluster_addr":"172.21.15.190:6819/2317686718","heartbeat_back_addr":"172.21.15.190:6823/2317686718","heartbeat_front_addr":"172.21.15.190:6821/2317686718","state":["exists","up"]},{"osd":7,"uuid":"192238c9-1423-4b7e-ac8f-84ba32113ddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6825","nonce":2493232051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6827","nonce":2493232051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6831","nonce":2493232051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6829","nonce":2493232051}]},"public_addr":"172.21.15.190:6825/2493232051","cluster_addr":"172.21.15.190:6827/2493232051","heartbeat_back_addr":"172.21.15.190:6831/2493232051","heartbeat_front_addr":"172.21.15.190:6829/2493232051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.393552+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.385453+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.361421+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.366408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.363226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.276007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.414605+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.445885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T18:49:36.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.806+0000 7fa2a5817640 1 -- 172.21.15.45:0/1984942596 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa2800668d0 msgr2=0x7fa280068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:36.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.806+0000 7fa2a5817640 1 --2- 172.21.15.45:0/1984942596 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa2800668d0 0x7fa280068d90 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fa288001380 tx=0x7fa288009040 comp rx=0 tx=0).stop 2023-11-28T18:49:36.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.806+0000 7fa2a5817640 1 -- 172.21.15.45:0/1984942596 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2a00b51e0 msgr2=0x7fa2a014e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:36.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.806+0000 7fa2a5817640 1 --2- 172.21.15.45:0/1984942596 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2a00b51e0 0x7fa2a014e790 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fa2900ad040 tx=0x7fa2900192e0 comp rx=0 tx=0).stop 2023-11-28T18:49:36.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.806+0000 7fa2a5817640 1 -- 172.21.15.45:0/1984942596 shutdown_connections 2023-11-28T18:49:36.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.806+0000 7fa2a5817640 1 --2- 172.21.15.45:0/1984942596 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fa2800668d0 0x7fa280068d90 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:36.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.806+0000 7fa2a5817640 1 --2- 172.21.15.45:0/1984942596 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa2a01608b0 0x7fa2a014c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:36.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.806+0000 7fa2a5817640 1 --2- 172.21.15.45:0/1984942596 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa2a00cdb60 0x7fa2a0156920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:36.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.806+0000 7fa2a5817640 1 --2- 172.21.15.45:0/1984942596 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2a00b51e0 0x7fa2a014e790 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:36.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.806+0000 7fa2a5817640 1 -- 172.21.15.45:0/1984942596 >> 172.21.15.45:0/1984942596 conn(0x7fa2a00720a0 msgr2=0x7fa2a015f1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:49:36.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.806+0000 7fa2a5817640 1 -- 172.21.15.45:0/1984942596 shutdown_connections 2023-11-28T18:49:36.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.806+0000 7fa2a5817640 1 -- 172.21.15.45:0/1984942596 wait complete. 2023-11-28T18:49:36.827 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T18:37:21.293917+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T18:43:57.069740+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T18:43:57.647964+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T18:49:36.828 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T18:49:36.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.954+0000 7f6da8e32640 1 -- 172.21.15.45:0/3014234006 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6da4069410 con 0x7f6da415d2f0 2023-11-28T18:49:36.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.954+0000 7f6d92ffd640 1 -- 172.21.15.45:0/3014234006 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v60) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6d98021020 con 0x7f6da415d2f0 2023-11-28T18:49:36.955 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-11-28T18:49:36.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.958+0000 7f6da8e32640 1 -- 172.21.15.45:0/3014234006 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6d840668d0 msgr2=0x7f6d84068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:36.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.958+0000 7f6da8e32640 1 --2- 172.21.15.45:0/3014234006 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6d840668d0 0x7f6d84068d90 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f6d940af000 tx=0x7f6d940a7000 comp rx=0 tx=0).stop 2023-11-28T18:49:36.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.958+0000 7f6da8e32640 1 -- 172.21.15.45:0/3014234006 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6da415d2f0 msgr2=0x7f6da4158080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:36.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.958+0000 7f6da8e32640 1 --2- 172.21.15.45:0/3014234006 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6da415d2f0 0x7f6da4158080 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f6d9800e9d0 tx=0x7f6d9800ee90 comp rx=0 tx=0).stop 2023-11-28T18:49:36.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.958+0000 7f6da8e32640 1 -- 172.21.15.45:0/3014234006 shutdown_connections 2023-11-28T18:49:36.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.958+0000 7f6da8e32640 1 --2- 172.21.15.45:0/3014234006 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f6d840668d0 0x7f6d84068d90 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:36.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.958+0000 7f6da8e32640 1 --2- 172.21.15.45:0/3014234006 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6da415d6d0 0x7f6da415be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:36.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.958+0000 7f6da8e32640 1 --2- 172.21.15.45:0/3014234006 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6da415d2f0 0x7f6da4158080 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:36.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.958+0000 7f6da8e32640 1 --2- 172.21.15.45:0/3014234006 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6da40d1d30 0x7f6da4153780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:36.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.958+0000 7f6da8e32640 1 -- 172.21.15.45:0/3014234006 >> 172.21.15.45:0/3014234006 conn(0x7f6da409c550 msgr2=0x7f6da4159a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:49:36.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.958+0000 7f6da8e32640 1 -- 172.21.15.45:0/3014234006 shutdown_connections 2023-11-28T18:49:36.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:36.958+0000 7f6da8e32640 1 -- 172.21.15.45:0/3014234006 wait complete. 2023-11-28T18:49:36.977 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T18:49:37.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.018+0000 7f95cdfaa640 1 Processor -- start 2023-11-28T18:49:37.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.018+0000 7f95cdfaa640 1 -- start start 2023-11-28T18:49:37.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.018+0000 7f95cdfaa640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f95c815d2f0 0x7f95c80d17f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:37.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.018+0000 7f95cdfaa640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95c80aff70 con 0x7f95c80d0330 2023-11-28T18:49:37.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.018+0000 7f95cdfaa640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95c80b0210 con 0x7f95c80d1d30 2023-11-28T18:49:37.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.018+0000 7f95cdfaa640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95c80b04f0 con 0x7f95c815d2f0 2023-11-28T18:49:37.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.022+0000 7f95c7fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f95c80d0330 0x7f95c80b0cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38208/0 (socket says 172.21.15.45:38208) 2023-11-28T18:49:37.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.022+0000 7f95c7fff640 1 -- 172.21.15.45:0/2377014922 learned_addr learned my addr 172.21.15.45:0/2377014922 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:49:37.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.022+0000 7f95c77fe640 1 --2- 172.21.15.45:0/2377014922 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f95c815d2f0 0x7f95c80d17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:37.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.022+0000 7f95c67fc640 1 -- 172.21.15.45:0/2377014922 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3903238436 0 0) 0x7f95c80b0210 con 0x7f95c80d1d30 2023-11-28T18:49:37.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.022+0000 7f95c67fc640 1 -- 172.21.15.45:0/2377014922 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95b0003530 con 0x7f95c80d1d30 2023-11-28T18:49:37.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.022+0000 7f95c67fc640 1 -- 172.21.15.45:0/2377014922 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1170857668 0 0) 0x7f95c80aff70 con 0x7f95c80d0330 2023-11-28T18:49:37.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.022+0000 7f95c67fc640 1 -- 172.21.15.45:0/2377014922 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95c80b0210 con 0x7f95c80d0330 2023-11-28T18:49:37.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.022+0000 7f95c77fe640 1 -- 172.21.15.45:0/2377014922 >> v1:172.21.15.190:6789/0 conn(0x7f95c80d1d30 legacy=0x7f95c80cfc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:37.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.022+0000 7f95c77fe640 1 -- 172.21.15.45:0/2377014922 >> v1:172.21.15.45:6789/0 conn(0x7f95c80d0330 legacy=0x7f95c80b0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:37.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.022+0000 7f95c77fe640 1 -- 172.21.15.45:0/2377014922 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95c80b07d0 con 0x7f95c815d2f0 2023-11-28T18:49:37.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.026+0000 7f95c77fe640 1 --2- 172.21.15.45:0/2377014922 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f95c815d2f0 0x7f95c80d17f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f95b80097f0 tx=0x7f95b801c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43e28a658c4f3e12 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:49:37.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.026+0000 7f95c67fc640 1 -- 172.21.15.45:0/2377014922 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b80ab660 con 0x7f95c815d2f0 2023-11-28T18:49:37.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.026+0000 7f95c67fc640 1 -- 172.21.15.45:0/2377014922 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95b80ab7c0 con 0x7f95c815d2f0 2023-11-28T18:49:37.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.026+0000 7f95c67fc640 1 -- 172.21.15.45:0/2377014922 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b80abb50 con 0x7f95c815d2f0 2023-11-28T18:49:37.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.026+0000 7f95cdfaa640 1 -- 172.21.15.45:0/2377014922 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f95c815d2f0 msgr2=0x7f95c80d17f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:37.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.026+0000 7f95cdfaa640 1 --2- 172.21.15.45:0/2377014922 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f95c815d2f0 0x7f95c80d17f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f95b80097f0 tx=0x7f95b801c4c0 comp rx=0 tx=0).stop 2023-11-28T18:49:37.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.026+0000 7f95cdfaa640 1 -- 172.21.15.45:0/2377014922 shutdown_connections 2023-11-28T18:49:37.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.026+0000 7f95cdfaa640 1 --2- 172.21.15.45:0/2377014922 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f95c815d2f0 0x7f95c80d17f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:37.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.026+0000 7f95cdfaa640 1 -- 172.21.15.45:0/2377014922 >> 172.21.15.45:0/2377014922 conn(0x7f95c809c550 msgr2=0x7f95c80d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:49:37.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.026+0000 7f95cdfaa640 1 -- 172.21.15.45:0/2377014922 shutdown_connections 2023-11-28T18:49:37.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.026+0000 7f95cdfaa640 1 -- 172.21.15.45:0/2377014922 wait complete. 2023-11-28T18:49:37.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.030+0000 7f95cdfaa640 1 Processor -- start 2023-11-28T18:49:37.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.030+0000 7f95cdfaa640 1 -- start start 2023-11-28T18:49:37.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.030+0000 7f95cdfaa640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f95c80d0330 0x7f95c8152460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:37.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.030+0000 7f95cdfaa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95c80d1d30 0x7f95c81529a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:37.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.030+0000 7f95cdfaa640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f95c815d2f0 0x7f95c81412a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:37.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.030+0000 7f95cdfaa640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c81602b0 con 0x7f95c80d1d30 2023-11-28T18:49:37.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.030+0000 7f95cdfaa640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c8160a80 con 0x7f95c815d2f0 2023-11-28T18:49:37.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.030+0000 7f95cdfaa640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95c8152ee0 con 0x7f95c80d0330 2023-11-28T18:49:37.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.030+0000 7f95c6ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95c80d1d30 0x7f95c81529a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:37.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.030+0000 7f95c6ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95c80d1d30 0x7f95c81529a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40508/0 (socket says 172.21.15.45:40508) 2023-11-28T18:49:37.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.030+0000 7f95c6ffd640 1 -- 172.21.15.45:0/953823243 learned_addr learned my addr 172.21.15.45:0/953823243 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:49:37.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.030+0000 7f95c77fe640 1 --2- 172.21.15.45:0/953823243 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f95c80d0330 0x7f95c8152460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:37.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.030+0000 7f95c7fff640 1 --2- 172.21.15.45:0/953823243 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f95c815d2f0 0x7f95c81412a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:37.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.030+0000 7f95c6ffd640 1 -- 172.21.15.45:0/953823243 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f95c80d0330 msgr2=0x7f95c8152460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:37.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.030+0000 7f95c6ffd640 1 --2- 172.21.15.45:0/953823243 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f95c80d0330 0x7f95c8152460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:37.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.030+0000 7f95c6ffd640 1 -- 172.21.15.45:0/953823243 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f95c815d2f0 msgr2=0x7f95c81412a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:37.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.030+0000 7f95c6ffd640 1 --2- 172.21.15.45:0/953823243 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f95c815d2f0 0x7f95c81412a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:37.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.030+0000 7f95c6ffd640 1 -- 172.21.15.45:0/953823243 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b8009420 con 0x7f95c80d1d30 2023-11-28T18:49:37.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.030+0000 7f95c6ffd640 1 --2- 172.21.15.45:0/953823243 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95c80d1d30 0x7f95c81529a0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f95bc0010f0 tx=0x7f95bc00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:49:37.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.034+0000 7f95affff640 1 -- 172.21.15.45:0/953823243 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95bc0052d0 con 0x7f95c80d1d30 2023-11-28T18:49:37.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.034+0000 7f95affff640 1 -- 172.21.15.45:0/953823243 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95bc005430 con 0x7f95c80d1d30 2023-11-28T18:49:37.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.034+0000 7f95cdfaa640 1 -- 172.21.15.45:0/953823243 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95c8155930 con 0x7f95c80d1d30 2023-11-28T18:49:37.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.034+0000 7f95affff640 1 -- 172.21.15.45:0/953823243 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95bc012830 con 0x7f95c80d1d30 2023-11-28T18:49:37.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.034+0000 7f95cdfaa640 1 -- 172.21.15.45:0/953823243 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95c81607a0 con 0x7f95c80d1d30 2023-11-28T18:49:37.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.034+0000 7f95cdfaa640 1 -- 172.21.15.45:0/953823243 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95c8067a30 con 0x7f95c80d1d30 2023-11-28T18:49:37.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.034+0000 7f95affff640 1 -- 172.21.15.45:0/953823243 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f95bc003600 con 0x7f95c80d1d30 2023-11-28T18:49:37.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.034+0000 7f95affff640 1 --2- 172.21.15.45:0/953823243 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f95b40668d0 0x7f95b4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:37.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.034+0000 7f95affff640 1 -- 172.21.15.45:0/953823243 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f95bc0838f0 con 0x7f95c80d1d30 2023-11-28T18:49:37.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.038+0000 7f95c77fe640 1 --2- 172.21.15.45:0/953823243 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f95b40668d0 0x7f95b4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:37.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.038+0000 7f95c77fe640 1 --2- 172.21.15.45:0/953823243 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f95b40668d0 0x7f95b4068d90 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f95b80af000 tx=0x7f95b80b6040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:49:37.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.042+0000 7f95affff640 1 -- 172.21.15.45:0/953823243 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f95bc050b40 con 0x7f95c80d1d30 2023-11-28T18:49:37.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.126+0000 7f940b12a640 1 Processor -- start 2023-11-28T18:49:37.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.126+0000 7f940b12a640 1 -- start start 2023-11-28T18:49:37.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.130+0000 7f940b12a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f94040b35f0 0x7f94040d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:37.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.130+0000 7f940b12a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f94040b3cb0 0x7f940415f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:37.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.130+0000 7f940b12a640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94040d38c0 con 0x7f94040cf7c0 2023-11-28T18:49:37.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.130+0000 7f940b12a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94040d40d0 con 0x7f94040b3cb0 2023-11-28T18:49:37.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.130+0000 7f940b12a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94040cdcc0 con 0x7f94040b35f0 2023-11-28T18:49:37.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.130+0000 7f9403fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f94040b3cb0 0x7f940415f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:37.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.130+0000 7f9403fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f94040b3cb0 0x7f940415f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40518/0 (socket says 172.21.15.45:40518) 2023-11-28T18:49:37.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.130+0000 7f9403fff640 1 -- 172.21.15.45:0/1702491083 learned_addr learned my addr 172.21.15.45:0/1702491083 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:49:37.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.130+0000 7f9408ec6640 1 --2- 172.21.15.45:0/1702491083 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f94040b35f0 0x7f94040d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:37.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.130+0000 7f9403fff640 1 -- 172.21.15.45:0/1702491083 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f94040b35f0 msgr2=0x7f94040d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:49:37.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.130+0000 7f9403fff640 1 --2- 172.21.15.45:0/1702491083 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f94040b35f0 0x7f94040d0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:37.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.130+0000 7f9403fff640 1 -- 172.21.15.45:0/1702491083 >> v1:172.21.15.190:6789/0 conn(0x7f94040cf7c0 legacy=0x7f94040ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:49:37.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.130+0000 7f9403fff640 1 -- 172.21.15.45:0/1702491083 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94040d3b10 con 0x7f94040b3cb0 2023-11-28T18:49:37.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.134+0000 7f9403fff640 1 --2- 172.21.15.45:0/1702491083 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94040b3cb0 0x7f940415f0a0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f93f0009870 tx=0x7f93f001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1669ec6d2e9ab8cc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:49:37.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.134+0000 7f94037fe640 1 -- 172.21.15.45:0/1702491083 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f00a9400 con 0x7f94040b3cb0 2023-11-28T18:49:37.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.134+0000 7f94037fe640 1 -- 172.21.15.45:0/1702491083 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93f00a9560 con 0x7f94040b3cb0 2023-11-28T18:49:37.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.134+0000 7f94037fe640 1 -- 172.21.15.45:0/1702491083 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f00a98f0 con 0x7f94040b3cb0 2023-11-28T18:49:37.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.134+0000 7f940b12a640 1 -- 172.21.15.45:0/1702491083 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94040b3cb0 msgr2=0x7f940415f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:37.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.134+0000 7f940b12a640 1 --2- 172.21.15.45:0/1702491083 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94040b3cb0 0x7f940415f0a0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f93f0009870 tx=0x7f93f001c540 comp rx=0 tx=0).stop 2023-11-28T18:49:37.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.134+0000 7f940b12a640 1 -- 172.21.15.45:0/1702491083 shutdown_connections 2023-11-28T18:49:37.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.134+0000 7f940b12a640 1 --2- 172.21.15.45:0/1702491083 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94040b3cb0 0x7f940415f0a0 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:37.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.134+0000 7f940b12a640 1 --2- 172.21.15.45:0/1702491083 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f94040b35f0 0x7f94040d0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:37.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.134+0000 7f940b12a640 1 -- 172.21.15.45:0/1702491083 >> 172.21.15.45:0/1702491083 conn(0x7f940409c4f0 msgr2=0x7f94040d31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:49:37.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.134+0000 7f940b12a640 1 -- 172.21.15.45:0/1702491083 shutdown_connections 2023-11-28T18:49:37.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.134+0000 7f940b12a640 1 -- 172.21.15.45:0/1702491083 wait complete. 2023-11-28T18:49:37.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.134+0000 7f940b12a640 1 Processor -- start 2023-11-28T18:49:37.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.134+0000 7f940b12a640 1 -- start start 2023-11-28T18:49:37.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.134+0000 7f940b12a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f94040b35f0 0x7f94040cbc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:37.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.134+0000 7f940b12a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f94040b3cb0 0x7f940409cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:37.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.138+0000 7f940b12a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94040cf7c0 0x7f940415abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:37.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.138+0000 7f940b12a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f940409fa10 con 0x7f94040cf7c0 2023-11-28T18:49:37.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.138+0000 7f940b12a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f940409fcf0 con 0x7f94040b3cb0 2023-11-28T18:49:37.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.138+0000 7f940b12a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f940409ffd0 con 0x7f94040b35f0 2023-11-28T18:49:37.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.138+0000 7f94096c7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94040cf7c0 0x7f940415abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:37.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.138+0000 7f94096c7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94040cf7c0 0x7f940415abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40526/0 (socket says 172.21.15.45:40526) 2023-11-28T18:49:37.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.138+0000 7f94096c7640 1 -- 172.21.15.45:0/1462629045 learned_addr learned my addr 172.21.15.45:0/1462629045 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:49:37.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.138+0000 7f9408ec6640 1 --2- 172.21.15.45:0/1462629045 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f94040b35f0 0x7f94040cbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:37.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.138+0000 7f9403fff640 1 --2- 172.21.15.45:0/1462629045 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f94040b3cb0 0x7f940409cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:37.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.138+0000 7f94096c7640 1 -- 172.21.15.45:0/1462629045 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f94040b35f0 msgr2=0x7f94040cbc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:37.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.138+0000 7f94096c7640 1 --2- 172.21.15.45:0/1462629045 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f94040b35f0 0x7f94040cbc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:37.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.138+0000 7f94096c7640 1 -- 172.21.15.45:0/1462629045 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f94040b3cb0 msgr2=0x7f940409cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:37.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.138+0000 7f94096c7640 1 --2- 172.21.15.45:0/1462629045 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f94040b3cb0 0x7f940409cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:37.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.138+0000 7f94096c7640 1 -- 172.21.15.45:0/1462629045 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f00094d0 con 0x7f94040cf7c0 2023-11-28T18:49:37.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.138+0000 7f94096c7640 1 --2- 172.21.15.45:0/1462629045 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94040cf7c0 0x7f940415abc0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f93fc00c730 tx=0x7f93fc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:49:37.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.138+0000 7f94017fa640 1 -- 172.21.15.45:0/1462629045 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93fc003b80 con 0x7f94040cf7c0 2023-11-28T18:49:37.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.138+0000 7f94017fa640 1 -- 172.21.15.45:0/1462629045 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93fc003ce0 con 0x7f94040cf7c0 2023-11-28T18:49:37.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.138+0000 7f940b12a640 1 -- 172.21.15.45:0/1462629045 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94040d0160 con 0x7f94040cf7c0 2023-11-28T18:49:37.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.138+0000 7f94017fa640 1 -- 172.21.15.45:0/1462629045 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93fc005310 con 0x7f94040cf7c0 2023-11-28T18:49:37.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.138+0000 7f940b12a640 1 -- 172.21.15.45:0/1462629045 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94040b5f70 con 0x7f94040cf7c0 2023-11-28T18:49:37.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.138+0000 7f940b12a640 1 -- 172.21.15.45:0/1462629045 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9404069480 con 0x7f94040cf7c0 2023-11-28T18:49:37.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.138+0000 7f94017fa640 1 -- 172.21.15.45:0/1462629045 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f93fc005680 con 0x7f94040cf7c0 2023-11-28T18:49:37.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.142+0000 7f94017fa640 1 --2- 172.21.15.45:0/1462629045 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f93e80668d0 0x7f93e8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:37.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.142+0000 7f94017fa640 1 -- 172.21.15.45:0/1462629045 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f93fc0841f0 con 0x7f94040cf7c0 2023-11-28T18:49:37.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.142+0000 7f9408ec6640 1 --2- 172.21.15.45:0/1462629045 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f93e80668d0 0x7f93e8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:37.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.142+0000 7f9408ec6640 1 --2- 172.21.15.45:0/1462629045 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f93e80668d0 0x7f93e8068d90 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f94040cc730 tx=0x7f93f8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:49:37.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.146+0000 7f94017fa640 1 -- 172.21.15.45:0/1462629045 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f93fc0514d0 con 0x7f94040cf7c0 2023-11-28T18:49:37.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.202+0000 7f95cdfaa640 1 -- 172.21.15.45:0/953823243 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f95c8069410 con 0x7f95c80d1d30 2023-11-28T18:49:37.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.202+0000 7f95affff640 1 -- 172.21.15.45:0/953823243 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v60) v1 ==== 93+0+10 (secure 0 0 0) 0x7f95bc0170a0 con 0x7f95c80d1d30 2023-11-28T18:49:37.201 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-11-28T18:49:37.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.202+0000 7f95cdfaa640 1 -- 172.21.15.45:0/953823243 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f95b40668d0 msgr2=0x7f95b4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:37.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.202+0000 7f95cdfaa640 1 --2- 172.21.15.45:0/953823243 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f95b40668d0 0x7f95b4068d90 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f95b80af000 tx=0x7f95b80b6040 comp rx=0 tx=0).stop 2023-11-28T18:49:37.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.202+0000 7f95cdfaa640 1 -- 172.21.15.45:0/953823243 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95c80d1d30 msgr2=0x7f95c81529a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:37.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.202+0000 7f95cdfaa640 1 --2- 172.21.15.45:0/953823243 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95c80d1d30 0x7f95c81529a0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f95bc0010f0 tx=0x7f95bc00c960 comp rx=0 tx=0).stop 2023-11-28T18:49:37.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.202+0000 7f95cdfaa640 1 -- 172.21.15.45:0/953823243 shutdown_connections 2023-11-28T18:49:37.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.202+0000 7f95cdfaa640 1 --2- 172.21.15.45:0/953823243 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f95b40668d0 0x7f95b4068d90 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:37.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.202+0000 7f95cdfaa640 1 --2- 172.21.15.45:0/953823243 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f95c815d2f0 0x7f95c81412a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:37.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.202+0000 7f95cdfaa640 1 --2- 172.21.15.45:0/953823243 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95c80d1d30 0x7f95c81529a0 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:37.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.202+0000 7f95cdfaa640 1 --2- 172.21.15.45:0/953823243 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f95c80d0330 0x7f95c8152460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:37.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.202+0000 7f95cdfaa640 1 -- 172.21.15.45:0/953823243 >> 172.21.15.45:0/953823243 conn(0x7f95c809c550 msgr2=0x7f95c80b3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:49:37.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.202+0000 7f95cdfaa640 1 -- 172.21.15.45:0/953823243 shutdown_connections 2023-11-28T18:49:37.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.202+0000 7f95cdfaa640 1 -- 172.21.15.45:0/953823243 wait complete. 2023-11-28T18:49:37.223 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T18:49:37.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.318+0000 7f940b12a640 1 -- 172.21.15.45:0/1462629045 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f94041683b0 con 0x7f94040cf7c0 2023-11-28T18:49:37.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.318+0000 7f94017fa640 1 -- 172.21.15.45:0/1462629045 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v60) v1 ==== 80+0+0 (secure 0 0 0) 0x7f93fc054af0 con 0x7f94040cf7c0 2023-11-28T18:49:37.317 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-11-28T18:49:37.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.318+0000 7f940b12a640 1 -- 172.21.15.45:0/1462629045 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f93e80668d0 msgr2=0x7f93e8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:37.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.318+0000 7f940b12a640 1 --2- 172.21.15.45:0/1462629045 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f93e80668d0 0x7f93e8068d90 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f94040cc730 tx=0x7f93f8008040 comp rx=0 tx=0).stop 2023-11-28T18:49:37.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.318+0000 7f940b12a640 1 -- 172.21.15.45:0/1462629045 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94040cf7c0 msgr2=0x7f940415abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:37.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.318+0000 7f940b12a640 1 --2- 172.21.15.45:0/1462629045 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94040cf7c0 0x7f940415abc0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f93fc00c730 tx=0x7f93fc00cbf0 comp rx=0 tx=0).stop 2023-11-28T18:49:37.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.318+0000 7f940b12a640 1 -- 172.21.15.45:0/1462629045 shutdown_connections 2023-11-28T18:49:37.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.318+0000 7f940b12a640 1 --2- 172.21.15.45:0/1462629045 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f93e80668d0 0x7f93e8068d90 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:37.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.318+0000 7f940b12a640 1 --2- 172.21.15.45:0/1462629045 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94040cf7c0 0x7f940415abc0 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:37.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.318+0000 7f940b12a640 1 --2- 172.21.15.45:0/1462629045 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f94040b3cb0 0x7f940409cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:37.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.318+0000 7f940b12a640 1 --2- 172.21.15.45:0/1462629045 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f94040b35f0 0x7f94040cbc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:37.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.318+0000 7f940b12a640 1 -- 172.21.15.45:0/1462629045 >> 172.21.15.45:0/1462629045 conn(0x7f940409c4f0 msgr2=0x7f94040d31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:49:37.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.318+0000 7f940b12a640 1 -- 172.21.15.45:0/1462629045 shutdown_connections 2023-11-28T18:49:37.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.318+0000 7f940b12a640 1 -- 172.21.15.45:0/1462629045 wait complete. 2023-11-28T18:49:37.339 ERROR:tasks.daemonwatchdog.daemon_watchdog:ignoring exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/daemonwatchdog.py", line 61, in bark mount.umount_wait(force=True) File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/cephfs/fuse_mount.py", line 399, in umount_wait self.umount(cleanup=False) File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/cephfs/fuse_mount.py", line 320, in umount if self.is_blocked(): File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/cephfs/mount.py", line 197, in is_blocked return self.addr in output TypeError: 'in ' requires string as left operand, not NoneType 2023-11-28T18:49:37.340 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T18:49:37.340 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T18:49:37.349 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357768k,nr_inodes=4089442,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9360 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276000k,nr_inodes=819000,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-28T18:49:37.349 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.2 is not mounted at ubuntu@smithi045.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.2 2023-11-28T18:49:37.350 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi045.front.sepia.ceph.com 2023-11-28T18:49:37.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:49:37.350 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-28T18:49:37.404 INFO:teuthology.orchestra.run.smithi045.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-28T18:49:37.405 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T18:49:37.405 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-28T18:49:37.406 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T18:49:37.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.410+0000 7f578bf1d640 1 Processor -- start 2023-11-28T18:49:37.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.410+0000 7f578bf1d640 1 -- start start 2023-11-28T18:49:37.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.414+0000 7f578bf1d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f57841469a0 0x7f578406cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:37.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.414+0000 7f578bf1d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f57840b4070 0x7f57840b44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:37.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.414+0000 7f578bf1d640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57840b4a10 con 0x7f578406e8e0 2023-11-28T18:49:37.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.414+0000 7f578bf1d640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f578415e940 con 0x7f57841469a0 2023-11-28T18:49:37.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.414+0000 7f578bf1d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f578415dd30 con 0x7f57840b4070 2023-11-28T18:49:37.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.414+0000 7f578a4ba640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f578406e8e0 0x7f578406ed30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38218/0 (socket says 172.21.15.45:38218) 2023-11-28T18:49:37.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.414+0000 7f578a4ba640 1 -- 172.21.15.45:0/4149427835 learned_addr learned my addr 172.21.15.45:0/4149427835 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:49:37.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.414+0000 7f5789cb9640 1 --2- 172.21.15.45:0/4149427835 >> v2:172.21.15.190:3300/0 conn(0x7f57841469a0 0x7f578406cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:37.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.414+0000 7f57894b8640 1 --2- 172.21.15.45:0/4149427835 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f57840b4070 0x7f57840b44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:37.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.414+0000 7f5788cb7640 1 -- 172.21.15.45:0/4149427835 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1245151305 0 0) 0x7f57840b4a10 con 0x7f578406e8e0 2023-11-28T18:49:37.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.414+0000 7f5788cb7640 1 -- 172.21.15.45:0/4149427835 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5770003530 con 0x7f578406e8e0 2023-11-28T18:49:37.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.414+0000 7f57894b8640 1 -- 172.21.15.45:0/4149427835 >> v2:172.21.15.190:3300/0 conn(0x7f57841469a0 msgr2=0x7f578406cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:49:37.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.414+0000 7f57894b8640 1 --2- 172.21.15.45:0/4149427835 >> v2:172.21.15.190:3300/0 conn(0x7f57841469a0 0x7f578406cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:37.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.414+0000 7f57894b8640 1 -- 172.21.15.45:0/4149427835 >> v1:172.21.15.45:6789/0 conn(0x7f578406e8e0 legacy=0x7f578406ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:37.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.414+0000 7f57894b8640 1 -- 172.21.15.45:0/4149427835 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f578415e010 con 0x7f57840b4070 2023-11-28T18:49:37.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.414+0000 7f5789cb9640 1 --2- 172.21.15.45:0/4149427835 >> v2:172.21.15.190:3300/0 conn(0x7f57841469a0 0x7f578406cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T18:49:37.416 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354684k,nr_inodes=4088671,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9377 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-28T18:49:37.416 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.1 is not mounted at ubuntu@smithi190.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1 2023-11-28T18:49:37.416 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi190.front.sepia.ceph.com 2023-11-28T18:49:37.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:49:37.416 DEBUG:teuthology.orchestra.run.smithi190:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-28T18:49:37.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.418+0000 7f57894b8640 1 --2- 172.21.15.45:0/4149427835 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f57840b4070 0x7f57840b44d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f57740097c0 tx=0x7f577401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa4a6dd44fb9f725 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:49:37.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.418+0000 7f5788cb7640 1 -- 172.21.15.45:0/4149427835 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57740ab600 con 0x7f57840b4070 2023-11-28T18:49:37.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.418+0000 7f5788cb7640 1 -- 172.21.15.45:0/4149427835 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57740a7050 con 0x7f57840b4070 2023-11-28T18:49:37.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.418+0000 7f5788cb7640 1 -- 172.21.15.45:0/4149427835 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57740ab980 con 0x7f57840b4070 2023-11-28T18:49:37.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.418+0000 7f578bf1d640 1 -- 172.21.15.45:0/4149427835 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f57840b4070 msgr2=0x7f57840b44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:37.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.418+0000 7f578bf1d640 1 --2- 172.21.15.45:0/4149427835 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f57840b4070 0x7f57840b44d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f57740097c0 tx=0x7f577401c480 comp rx=0 tx=0).stop 2023-11-28T18:49:37.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.418+0000 7f578bf1d640 1 -- 172.21.15.45:0/4149427835 shutdown_connections 2023-11-28T18:49:37.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.418+0000 7f578bf1d640 1 --2- 172.21.15.45:0/4149427835 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f57840b4070 0x7f57840b44d0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:37.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.418+0000 7f578bf1d640 1 --2- 172.21.15.45:0/4149427835 >> v2:172.21.15.190:3300/0 conn(0x7f57841469a0 0x7f578406cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:37.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.418+0000 7f578bf1d640 1 -- 172.21.15.45:0/4149427835 >> 172.21.15.45:0/4149427835 conn(0x7f5784070b80 msgr2=0x7f5784066360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:49:37.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.418+0000 7f578bf1d640 1 -- 172.21.15.45:0/4149427835 shutdown_connections 2023-11-28T18:49:37.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.418+0000 7f578bf1d640 1 -- 172.21.15.45:0/4149427835 wait complete. 2023-11-28T18:49:37.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.418+0000 7f578bf1d640 1 Processor -- start 2023-11-28T18:49:37.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.418+0000 7f578bf1d640 1 -- start start 2023-11-28T18:49:37.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.418+0000 7f578bf1d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f578406e8e0 0x7f578413eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:37.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.418+0000 7f578bf1d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57840b4070 0x7f5784157af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:37.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.418+0000 7f578bf1d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f57841469a0 0x7f5784158030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:37.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.418+0000 7f578bf1d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f578415a4c0 con 0x7f57840b4070 2023-11-28T18:49:37.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.418+0000 7f578bf1d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5784159840 con 0x7f57841469a0 2023-11-28T18:49:37.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.418+0000 7f578bf1d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5784159b20 con 0x7f578406e8e0 2023-11-28T18:49:37.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.422+0000 7f57894b8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57840b4070 0x7f5784157af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:37.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.422+0000 7f57894b8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57840b4070 0x7f5784157af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40542/0 (socket says 172.21.15.45:40542) 2023-11-28T18:49:37.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.422+0000 7f57894b8640 1 -- 172.21.15.45:0/4130466202 learned_addr learned my addr 172.21.15.45:0/4130466202 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:49:37.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.422+0000 7f5789cb9640 1 --2- 172.21.15.45:0/4130466202 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f578406e8e0 0x7f578413eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:37.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.422+0000 7f578a4ba640 1 --2- 172.21.15.45:0/4130466202 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f57841469a0 0x7f5784158030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:37.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.422+0000 7f57894b8640 1 -- 172.21.15.45:0/4130466202 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f578406e8e0 msgr2=0x7f578413eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:37.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.422+0000 7f57894b8640 1 --2- 172.21.15.45:0/4130466202 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f578406e8e0 0x7f578413eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:37.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.422+0000 7f57894b8640 1 -- 172.21.15.45:0/4130466202 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f57841469a0 msgr2=0x7f5784158030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:37.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.422+0000 7f57894b8640 1 --2- 172.21.15.45:0/4130466202 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f57841469a0 0x7f5784158030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:37.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.422+0000 7f57894b8640 1 -- 172.21.15.45:0/4130466202 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5780009420 con 0x7f57840b4070 2023-11-28T18:49:37.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.422+0000 7f578a4ba640 1 --2- 172.21.15.45:0/4130466202 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f57841469a0 0x7f5784158030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:49:37.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.422+0000 7f57894b8640 1 --2- 172.21.15.45:0/4130466202 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57840b4070 0x7f5784157af0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f57740ae040 tx=0x7f5774019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:49:37.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.422+0000 7f577a7fc640 1 -- 172.21.15.45:0/4130466202 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57740b4430 con 0x7f57840b4070 2023-11-28T18:49:37.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.422+0000 7f577a7fc640 1 -- 172.21.15.45:0/4130466202 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57740b45b0 con 0x7f57840b4070 2023-11-28T18:49:37.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.422+0000 7f577a7fc640 1 -- 172.21.15.45:0/4130466202 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57740b4960 con 0x7f57840b4070 2023-11-28T18:49:37.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.422+0000 7f578bf1d640 1 -- 172.21.15.45:0/4130466202 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5774009420 con 0x7f57840b4070 2023-11-28T18:49:37.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.422+0000 7f578bf1d640 1 -- 172.21.15.45:0/4130466202 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f578415a0e0 con 0x7f57840b4070 2023-11-28T18:49:37.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.422+0000 7f578bf1d640 1 -- 172.21.15.45:0/4130466202 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f578415a600 con 0x7f57840b4070 2023-11-28T18:49:37.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.422+0000 7f577a7fc640 1 -- 172.21.15.45:0/4130466202 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f57740b2040 con 0x7f57840b4070 2023-11-28T18:49:37.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.426+0000 7f577a7fc640 1 --2- 172.21.15.45:0/4130466202 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f5768066900 0x7f5768068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:37.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.426+0000 7f577a7fc640 1 -- 172.21.15.45:0/4130466202 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f577411e260 con 0x7f57840b4070 2023-11-28T18:49:37.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.426+0000 7f5789cb9640 1 --2- 172.21.15.45:0/4130466202 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f5768066900 0x7f5768068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:37.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.426+0000 7f5789cb9640 1 --2- 172.21.15.45:0/4130466202 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f5768066900 0x7f5768068dc0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f5780009cf0 tx=0x7f5780009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:49:37.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.430+0000 7f577a7fc640 1 -- 172.21.15.45:0/4130466202 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f578415a600 con 0x7f57840b4070 2023-11-28T18:49:37.471 INFO:teuthology.orchestra.run.smithi190.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-11-28T18:49:37.471 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T18:49:37.472 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-28T18:49:37.472 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T18:49:37.523 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354684k,nr_inodes=4088671,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9377 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-28T18:49:37.523 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.3 is not mounted at ubuntu@smithi190.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.3 2023-11-28T18:49:37.523 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi190.front.sepia.ceph.com 2023-11-28T18:49:37.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:49:37.524 DEBUG:teuthology.orchestra.run.smithi190:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-28T18:49:37.575 INFO:teuthology.orchestra.run.smithi190.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-28T18:49:37.575 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T18:49:37.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.586+0000 7f578bf1d640 1 -- 172.21.15.45:0/4130466202 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f578415a600 con 0x7f57840b4070 2023-11-28T18:49:37.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.586+0000 7f577a7fc640 1 -- 172.21.15.45:0/4130466202 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v60) v1 ==== 104+0+11 (secure 0 0 0) 0x7f578415a600 con 0x7f57840b4070 2023-11-28T18:49:37.587 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-11-28T18:49:37.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.590+0000 7f578bf1d640 1 -- 172.21.15.45:0/4130466202 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f5768066900 msgr2=0x7f5768068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:37.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.590+0000 7f578bf1d640 1 --2- 172.21.15.45:0/4130466202 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f5768066900 0x7f5768068dc0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f5780009cf0 tx=0x7f5780009190 comp rx=0 tx=0).stop 2023-11-28T18:49:37.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.590+0000 7f578bf1d640 1 -- 172.21.15.45:0/4130466202 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57840b4070 msgr2=0x7f5784157af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:37.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.590+0000 7f578bf1d640 1 --2- 172.21.15.45:0/4130466202 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57840b4070 0x7f5784157af0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f57740ae040 tx=0x7f5774019220 comp rx=0 tx=0).stop 2023-11-28T18:49:37.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.590+0000 7f578bf1d640 1 -- 172.21.15.45:0/4130466202 shutdown_connections 2023-11-28T18:49:37.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.590+0000 7f578bf1d640 1 --2- 172.21.15.45:0/4130466202 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f5768066900 0x7f5768068dc0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:37.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.590+0000 7f578bf1d640 1 --2- 172.21.15.45:0/4130466202 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f57841469a0 0x7f5784158030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:37.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.590+0000 7f578bf1d640 1 --2- 172.21.15.45:0/4130466202 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57840b4070 0x7f5784157af0 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:37.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.590+0000 7f578bf1d640 1 --2- 172.21.15.45:0/4130466202 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f578406e8e0 0x7f578413eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:37.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.590+0000 7f578bf1d640 1 -- 172.21.15.45:0/4130466202 >> 172.21.15.45:0/4130466202 conn(0x7f5784070b80 msgr2=0x7f578406ecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:49:37.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.590+0000 7f578bf1d640 1 -- 172.21.15.45:0/4130466202 shutdown_connections 2023-11-28T18:49:37.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.590+0000 7f578bf1d640 1 -- 172.21.15.45:0/4130466202 wait complete. 2023-11-28T18:49:37.608 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T18:49:37.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.798+0000 7f0bf59c3640 1 Processor -- start 2023-11-28T18:49:37.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.798+0000 7f0bf59c3640 1 -- start start 2023-11-28T18:49:37.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.798+0000 7f0bf59c3640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0bf0071dd0 0x7f0bf00721b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:37.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.798+0000 7f0bf59c3640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bf013d2f0 con 0x7f0bf015adf0 2023-11-28T18:49:37.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.798+0000 7f0bf59c3640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bf00cddb0 con 0x7f0bf013f630 2023-11-28T18:49:37.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.798+0000 7f0bf59c3640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf0140560 con 0x7f0bf0071dd0 2023-11-28T18:49:37.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.798+0000 7f0be7fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f0bf015adf0 0x7f0bf013d5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38222/0 (socket says 172.21.15.45:38222) 2023-11-28T18:49:37.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.798+0000 7f0be7fff640 1 -- 172.21.15.45:0/3239433628 learned_addr learned my addr 172.21.15.45:0/3239433628 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T18:49:37.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.798+0000 7f0beeffd640 1 --2- 172.21.15.45:0/3239433628 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0bf0071dd0 0x7f0bf00721b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:37.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.798+0000 7f0bee7fc640 1 -- 172.21.15.45:0/3239433628 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3018706111 0 0) 0x7f0bf013d2f0 con 0x7f0bf015adf0 2023-11-28T18:49:37.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.798+0000 7f0bee7fc640 1 -- 172.21.15.45:0/3239433628 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0bdc003530 con 0x7f0bf015adf0 2023-11-28T18:49:37.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.798+0000 7f0bee7fc640 1 -- 172.21.15.45:0/3239433628 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2712804982 0 0) 0x7f0bdc003530 con 0x7f0bf015adf0 2023-11-28T18:49:37.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.798+0000 7f0bee7fc640 1 -- 172.21.15.45:0/3239433628 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0bf0071dd0 msgr2=0x7f0bf00721b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:49:37.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.798+0000 7f0bee7fc640 1 --2- 172.21.15.45:0/3239433628 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0bf0071dd0 0x7f0bf00721b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:37.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.798+0000 7f0bee7fc640 1 -- 172.21.15.45:0/3239433628 >> v1:172.21.15.190:6789/0 conn(0x7f0bf013f630 legacy=0x7f0bf00ce240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:37.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.798+0000 7f0bee7fc640 1 -- 172.21.15.45:0/3239433628 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bf00726f0 con 0x7f0bf015adf0 2023-11-28T18:49:37.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.798+0000 7f0bee7fc640 1 -- 172.21.15.45:0/3239433628 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4084481567 0 0) 0x7f0bd8001680 con 0x7f0bf015adf0 2023-11-28T18:49:37.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.798+0000 7f0bee7fc640 1 -- 172.21.15.45:0/3239433628 >> v1:172.21.15.45:6789/0 conn(0x7f0bf015adf0 legacy=0x7f0bf013d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:37.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.798+0000 7f0bee7fc640 1 --2- 172.21.15.45:0/3239433628 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0bdc0039b0 0x7f0bdc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:37.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.798+0000 7f0bee7fc640 1 --2- 172.21.15.45:0/3239433628 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0bf0071dd0 0x7f0bdc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:37.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.798+0000 7f0bee7fc640 1 --2- 172.21.15.45:0/3239433628 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bdc004d10 0x7f0bdc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:37.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.798+0000 7f0bee7fc640 1 -- 172.21.15.45:0/3239433628 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf0140560 con 0x7f0bdc004d10 2023-11-28T18:49:37.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.798+0000 7f0bee7fc640 1 -- 172.21.15.45:0/3239433628 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bdc00ba40 con 0x7f0bdc0039b0 2023-11-28T18:49:37.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.798+0000 7f0bee7fc640 1 -- 172.21.15.45:0/3239433628 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bdc00bbb0 con 0x7f0bf0071dd0 2023-11-28T18:49:37.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.798+0000 7f0bef7fe640 1 --2- 172.21.15.45:0/3239433628 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bdc004d10 0x7f0bdc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:37.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.798+0000 7f0beeffd640 1 --2- 172.21.15.45:0/3239433628 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0bdc0039b0 0x7f0bdc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:37.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.798+0000 7f0be7fff640 1 --2- 172.21.15.45:0/3239433628 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0bf0071dd0 0x7f0bdc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:37.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.798+0000 7f0bef7fe640 1 -- 172.21.15.45:0/3239433628 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0bf0071dd0 msgr2=0x7f0bdc0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:49:37.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.798+0000 7f0bef7fe640 1 --2- 172.21.15.45:0/3239433628 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0bf0071dd0 0x7f0bdc0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:37.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.798+0000 7f0bef7fe640 1 -- 172.21.15.45:0/3239433628 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0bdc0039b0 msgr2=0x7f0bdc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:49:37.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.798+0000 7f0bef7fe640 1 --2- 172.21.15.45:0/3239433628 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0bdc0039b0 0x7f0bdc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:37.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.798+0000 7f0bef7fe640 1 -- 172.21.15.45:0/3239433628 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bdc003530 con 0x7f0bdc004d10 2023-11-28T18:49:37.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.802+0000 7f0bef7fe640 1 --2- 172.21.15.45:0/3239433628 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bdc004d10 0x7f0bdc005190 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f0be8001f60 tx=0x7f0be801c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6912d9e404f45bee server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:49:37.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.802+0000 7f0bee7fc640 1 -- 172.21.15.45:0/3239433628 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be80a5750 con 0x7f0bdc004d10 2023-11-28T18:49:37.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.802+0000 7f0bee7fc640 1 -- 172.21.15.45:0/3239433628 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0be80a58b0 con 0x7f0bdc004d10 2023-11-28T18:49:37.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.802+0000 7f0bee7fc640 1 -- 172.21.15.45:0/3239433628 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be80a5c60 con 0x7f0bdc004d10 2023-11-28T18:49:37.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.802+0000 7f0bf59c3640 1 -- 172.21.15.45:0/3239433628 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bdc004d10 msgr2=0x7f0bdc005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:37.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.802+0000 7f0bf59c3640 1 --2- 172.21.15.45:0/3239433628 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bdc004d10 0x7f0bdc005190 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f0be8001f60 tx=0x7f0be801c860 comp rx=0 tx=0).stop 2023-11-28T18:49:37.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.802+0000 7f0bef7fe640 1 -- 172.21.15.45:0/3239433628 reap_dead start 2023-11-28T18:49:37.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.802+0000 7f0bf59c3640 1 -- 172.21.15.45:0/3239433628 shutdown_connections 2023-11-28T18:49:37.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.802+0000 7f0bf59c3640 1 -- 172.21.15.45:0/3239433628 >> 172.21.15.45:0/3239433628 conn(0x7f0bf00b0d00 msgr2=0x7f0bf00b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:49:37.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.802+0000 7f0bf59c3640 1 -- 172.21.15.45:0/3239433628 shutdown_connections 2023-11-28T18:49:37.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.802+0000 7f0bf59c3640 1 -- 172.21.15.45:0/3239433628 wait complete. 2023-11-28T18:49:37.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.806+0000 7f0bf59c3640 1 Processor -- start 2023-11-28T18:49:37.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.806+0000 7f0bf59c3640 1 -- start start 2023-11-28T18:49:37.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.806+0000 7f0bf59c3640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0bdc004d10 0x7f0bf01595e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:37.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.806+0000 7f0bf59c3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bf00b0900 0x7f0bf00acfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:37.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.806+0000 7f0bf59c3640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0bf01f0310 0x7f0bf00ad520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:37.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.806+0000 7f0bf59c3640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf00aaea0 con 0x7f0bf00b0900 2023-11-28T18:49:37.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.806+0000 7f0bf59c3640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf00aa290 con 0x7f0bdc004d10 2023-11-28T18:49:37.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.806+0000 7f0bf59c3640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf00aa570 con 0x7f0bf01f0310 2023-11-28T18:49:37.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.806+0000 7f0be7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bf00b0900 0x7f0bf00acfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:37.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.806+0000 7f0be7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bf00b0900 0x7f0bf00acfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40568/0 (socket says 172.21.15.45:40568) 2023-11-28T18:49:37.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.806+0000 7f0be7fff640 1 -- 172.21.15.45:0/4037882546 learned_addr learned my addr 172.21.15.45:0/4037882546 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:49:37.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.806+0000 7f0beeffd640 1 --2- 172.21.15.45:0/4037882546 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0bdc004d10 0x7f0bf01595e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:37.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.806+0000 7f0bef7fe640 1 --2- 172.21.15.45:0/4037882546 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0bf01f0310 0x7f0bf00ad520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:37.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.806+0000 7f0be7fff640 1 -- 172.21.15.45:0/4037882546 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0bf01f0310 msgr2=0x7f0bf00ad520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:37.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.806+0000 7f0be7fff640 1 --2- 172.21.15.45:0/4037882546 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0bf01f0310 0x7f0bf00ad520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:37.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.806+0000 7f0be7fff640 1 -- 172.21.15.45:0/4037882546 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0bdc004d10 msgr2=0x7f0bf01595e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:37.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.806+0000 7f0be7fff640 1 --2- 172.21.15.45:0/4037882546 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0bdc004d10 0x7f0bf01595e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:37.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.806+0000 7f0be7fff640 1 -- 172.21.15.45:0/4037882546 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bf00aa850 con 0x7f0bf00b0900 2023-11-28T18:49:37.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.806+0000 7f0be7fff640 1 --2- 172.21.15.45:0/4037882546 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bf00b0900 0x7f0bf00acfe0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f0bd80124c0 tx=0x7f0bd80128c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:49:37.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.806+0000 7f0becff9640 1 -- 172.21.15.45:0/4037882546 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd8014810 con 0x7f0bf00b0900 2023-11-28T18:49:37.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.806+0000 7f0becff9640 1 -- 172.21.15.45:0/4037882546 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bd8014990 con 0x7f0bf00b0900 2023-11-28T18:49:37.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.806+0000 7f0becff9640 1 -- 172.21.15.45:0/4037882546 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd8014d40 con 0x7f0bf00b0900 2023-11-28T18:49:37.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.806+0000 7f0bf59c3640 1 -- 172.21.15.45:0/4037882546 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bf00aab30 con 0x7f0bf00b0900 2023-11-28T18:49:37.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.806+0000 7f0bf59c3640 1 -- 172.21.15.45:0/4037882546 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bf00ada60 con 0x7f0bf00b0900 2023-11-28T18:49:37.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.810+0000 7f0bf59c3640 1 -- 172.21.15.45:0/4037882546 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bf00ab050 con 0x7f0bf00b0900 2023-11-28T18:49:37.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.810+0000 7f0becff9640 1 -- 172.21.15.45:0/4037882546 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f0bd80153e0 con 0x7f0bf00b0900 2023-11-28T18:49:37.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.810+0000 7f0becff9640 1 --2- 172.21.15.45:0/4037882546 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f0bd0066900 0x7f0bd0068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:37.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.810+0000 7f0becff9640 1 -- 172.21.15.45:0/4037882546 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0bd8086c50 con 0x7f0bf00b0900 2023-11-28T18:49:37.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.810+0000 7f0beeffd640 1 --2- 172.21.15.45:0/4037882546 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f0bd0066900 0x7f0bd0068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:37.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.810+0000 7f0beeffd640 1 --2- 172.21.15.45:0/4037882546 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f0bd0066900 0x7f0bd0068dc0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f0be0009be0 tx=0x7f0be0009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:49:37.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.814+0000 7f0becff9640 1 -- 172.21.15.45:0/4037882546 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0bf00ab050 con 0x7f0bf00b0900 2023-11-28T18:49:37.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.970+0000 7f0bf59c3640 1 -- 172.21.15.45:0/4037882546 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0bf0069410 con 0x7f0bf00b0900 2023-11-28T18:49:37.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.970+0000 7f0becff9640 1 -- 172.21.15.45:0/4037882546 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v60) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0bd801c020 con 0x7f0bf00b0900 2023-11-28T18:49:37.970 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-11-28T18:49:37.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.970+0000 7f0bf59c3640 1 -- 172.21.15.45:0/4037882546 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f0bd0066900 msgr2=0x7f0bd0068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:37.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.970+0000 7f0bf59c3640 1 --2- 172.21.15.45:0/4037882546 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f0bd0066900 0x7f0bd0068dc0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f0be0009be0 tx=0x7f0be0009190 comp rx=0 tx=0).stop 2023-11-28T18:49:37.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.970+0000 7f0bf59c3640 1 -- 172.21.15.45:0/4037882546 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bf00b0900 msgr2=0x7f0bf00acfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:37.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.970+0000 7f0bf59c3640 1 --2- 172.21.15.45:0/4037882546 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bf00b0900 0x7f0bf00acfe0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f0bd80124c0 tx=0x7f0bd80128c0 comp rx=0 tx=0).stop 2023-11-28T18:49:37.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.970+0000 7f0bf59c3640 1 -- 172.21.15.45:0/4037882546 shutdown_connections 2023-11-28T18:49:37.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.970+0000 7f0bf59c3640 1 --2- 172.21.15.45:0/4037882546 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f0bd0066900 0x7f0bd0068dc0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:37.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.970+0000 7f0bf59c3640 1 --2- 172.21.15.45:0/4037882546 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0bf01f0310 0x7f0bf00ad520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:37.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.970+0000 7f0bf59c3640 1 --2- 172.21.15.45:0/4037882546 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bf00b0900 0x7f0bf00acfe0 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:37.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.970+0000 7f0bf59c3640 1 --2- 172.21.15.45:0/4037882546 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0bdc004d10 0x7f0bf01595e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:37.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.970+0000 7f0bf59c3640 1 -- 172.21.15.45:0/4037882546 >> 172.21.15.45:0/4037882546 conn(0x7f0bf00b0d00 msgr2=0x7f0bf013b0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:49:37.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.970+0000 7f0bf59c3640 1 -- 172.21.15.45:0/4037882546 shutdown_connections 2023-11-28T18:49:37.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:37.970+0000 7f0bf59c3640 1 -- 172.21.15.45:0/4037882546 wait complete. 2023-11-28T18:49:37.991 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T18:49:38.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.134+0000 7fea5d8fe640 1 Processor -- start 2023-11-28T18:49:38.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.134+0000 7fea5d8fe640 1 -- start start 2023-11-28T18:49:38.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.134+0000 7fea5d8fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fea580b35f0 0x7fea580d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:38.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.134+0000 7fea5d8fe640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fea580b3cb0 0x7fea5815f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:38.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.134+0000 7fea5d8fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fea580cf7c0 0x7fea580cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:38.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.134+0000 7fea5d8fe640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea580d40d0 con 0x7fea580b35f0 2023-11-28T18:49:38.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.134+0000 7fea5d8fe640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea580d0150 con 0x7fea580b3cb0 2023-11-28T18:49:38.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.134+0000 7fea5d8fe640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea580d38c0 con 0x7fea580cf7c0 2023-11-28T18:49:38.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.134+0000 7fea56ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fea580b35f0 0x7fea580d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:38.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.134+0000 7fea56ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fea580b35f0 0x7fea580d0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34160/0 (socket says 172.21.15.45:34160) 2023-11-28T18:49:38.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.134+0000 7fea56ffd640 1 -- 172.21.15.45:0/558628342 learned_addr learned my addr 172.21.15.45:0/558628342 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:49:38.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.138+0000 7fea4e7fc640 1 --2- 172.21.15.45:0/558628342 >> v2:172.21.15.190:3300/0 conn(0x7fea580b3cb0 0x7fea5815f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:38.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.138+0000 7fea577fe640 1 --2- 172.21.15.45:0/558628342 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fea580cf7c0 0x7fea580cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:38.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.138+0000 7fea56ffd640 1 -- 172.21.15.45:0/558628342 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fea580cf7c0 msgr2=0x7fea580cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:49:38.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.138+0000 7fea56ffd640 1 --2- 172.21.15.45:0/558628342 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fea580cf7c0 0x7fea580cfc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:38.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.138+0000 7fea56ffd640 1 -- 172.21.15.45:0/558628342 >> v2:172.21.15.190:3300/0 conn(0x7fea580b3cb0 msgr2=0x7fea5815f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:49:38.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.138+0000 7fea56ffd640 1 --2- 172.21.15.45:0/558628342 >> v2:172.21.15.190:3300/0 conn(0x7fea580b3cb0 0x7fea5815f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:38.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.138+0000 7fea56ffd640 1 -- 172.21.15.45:0/558628342 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea580cdcc0 con 0x7fea580b35f0 2023-11-28T18:49:38.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.138+0000 7fea56ffd640 1 --2- 172.21.15.45:0/558628342 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea580b35f0 0x7fea580d0f90 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fea5808be20 tx=0x7fea4801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19b776d450d772f5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:49:38.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.138+0000 7fea567fc640 1 -- 172.21.15.45:0/558628342 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea480aa620 con 0x7fea580b35f0 2023-11-28T18:49:38.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.138+0000 7fea567fc640 1 -- 172.21.15.45:0/558628342 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea480aa780 con 0x7fea580b35f0 2023-11-28T18:49:38.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.138+0000 7fea567fc640 1 -- 172.21.15.45:0/558628342 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea480aab10 con 0x7fea580b35f0 2023-11-28T18:49:38.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.142+0000 7fea5d8fe640 1 -- 172.21.15.45:0/558628342 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea580b35f0 msgr2=0x7fea580d0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:38.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.142+0000 7fea5d8fe640 1 --2- 172.21.15.45:0/558628342 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea580b35f0 0x7fea580d0f90 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fea5808be20 tx=0x7fea4801c500 comp rx=0 tx=0).stop 2023-11-28T18:49:38.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.142+0000 7fea5d8fe640 1 -- 172.21.15.45:0/558628342 shutdown_connections 2023-11-28T18:49:38.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.142+0000 7fea5d8fe640 1 --2- 172.21.15.45:0/558628342 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fea580cf7c0 0x7fea580cfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:38.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.142+0000 7fea5d8fe640 1 --2- 172.21.15.45:0/558628342 >> v2:172.21.15.190:3300/0 conn(0x7fea580b3cb0 0x7fea5815f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:38.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.142+0000 7fea5d8fe640 1 --2- 172.21.15.45:0/558628342 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea580b35f0 0x7fea580d0f90 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:38.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.142+0000 7fea5d8fe640 1 -- 172.21.15.45:0/558628342 >> 172.21.15.45:0/558628342 conn(0x7fea5809c4f0 msgr2=0x7fea580d31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:49:38.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.142+0000 7fea5d8fe640 1 -- 172.21.15.45:0/558628342 shutdown_connections 2023-11-28T18:49:38.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.142+0000 7fea5d8fe640 1 -- 172.21.15.45:0/558628342 wait complete. 2023-11-28T18:49:38.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.142+0000 7fea5d8fe640 1 Processor -- start 2023-11-28T18:49:38.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.142+0000 7fea5d8fe640 1 -- start start 2023-11-28T18:49:38.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.142+0000 7fea5d8fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fea580b35f0 0x7fea5815bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:38.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.142+0000 7fea5d8fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea580b3cb0 0x7fea580cb830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:38.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.142+0000 7fea5d8fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fea580cf7c0 0x7fea580cbd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:38.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.142+0000 7fea5d8fe640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea5815c150 con 0x7fea580b3cb0 2023-11-28T18:49:38.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.142+0000 7fea5d8fe640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea5809e360 con 0x7fea580b35f0 2023-11-28T18:49:38.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.142+0000 7fea5d8fe640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea5809e5b0 con 0x7fea580cf7c0 2023-11-28T18:49:38.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.142+0000 7fea4e7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea580b3cb0 0x7fea580cb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:38.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.142+0000 7fea4e7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea580b3cb0 0x7fea580cb830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34170/0 (socket says 172.21.15.45:34170) 2023-11-28T18:49:38.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.142+0000 7fea4e7fc640 1 -- 172.21.15.45:0/1119521944 learned_addr learned my addr 172.21.15.45:0/1119521944 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:49:38.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.142+0000 7fea56ffd640 1 --2- 172.21.15.45:0/1119521944 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fea580b35f0 0x7fea5815bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:38.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.142+0000 7fea577fe640 1 --2- 172.21.15.45:0/1119521944 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fea580cf7c0 0x7fea580cbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:38.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.146+0000 7fea4e7fc640 1 -- 172.21.15.45:0/1119521944 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fea580cf7c0 msgr2=0x7fea580cbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:38.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.146+0000 7fea4e7fc640 1 --2- 172.21.15.45:0/1119521944 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fea580cf7c0 0x7fea580cbd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:38.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.146+0000 7fea4e7fc640 1 -- 172.21.15.45:0/1119521944 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fea580b35f0 msgr2=0x7fea5815bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:38.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.146+0000 7fea4e7fc640 1 --2- 172.21.15.45:0/1119521944 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fea580b35f0 0x7fea5815bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:38.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.146+0000 7fea4e7fc640 1 -- 172.21.15.45:0/1119521944 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea480094d0 con 0x7fea580b3cb0 2023-11-28T18:49:38.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.146+0000 7fea4e7fc640 1 --2- 172.21.15.45:0/1119521944 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea580b3cb0 0x7fea580cb830 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fea4000e8e0 tx=0x7fea4000eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:49:38.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.146+0000 7fea54ff9640 1 -- 172.21.15.45:0/1119521944 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4000ca00 con 0x7fea580b3cb0 2023-11-28T18:49:38.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.146+0000 7fea54ff9640 1 -- 172.21.15.45:0/1119521944 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea4000cb60 con 0x7fea580b3cb0 2023-11-28T18:49:38.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.146+0000 7fea5d8fe640 1 -- 172.21.15.45:0/1119521944 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea5809e890 con 0x7fea580b3cb0 2023-11-28T18:49:38.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.146+0000 7fea54ff9640 1 -- 172.21.15.45:0/1119521944 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea40013470 con 0x7fea580b3cb0 2023-11-28T18:49:38.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.146+0000 7fea5d8fe640 1 -- 172.21.15.45:0/1119521944 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea5809ee50 con 0x7fea580b3cb0 2023-11-28T18:49:38.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.146+0000 7fea5d8fe640 1 -- 172.21.15.45:0/1119521944 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea58069480 con 0x7fea580b3cb0 2023-11-28T18:49:38.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.146+0000 7fea54ff9640 1 -- 172.21.15.45:0/1119521944 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fea400135d0 con 0x7fea580b3cb0 2023-11-28T18:49:38.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.150+0000 7fea54ff9640 1 --2- 172.21.15.45:0/1119521944 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fea38066900 0x7fea38068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:38.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.150+0000 7fea54ff9640 1 -- 172.21.15.45:0/1119521944 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fea40084500 con 0x7fea580b3cb0 2023-11-28T18:49:38.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.150+0000 7fea56ffd640 1 --2- 172.21.15.45:0/1119521944 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fea38066900 0x7fea38068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:38.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.150+0000 7fea56ffd640 1 --2- 172.21.15.45:0/1119521944 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fea38066900 0x7fea38068dc0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fea480ae000 tx=0x7fea480b5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:49:38.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.154+0000 7fea54ff9640 1 -- 172.21.15.45:0/1119521944 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fea40051880 con 0x7fea580b3cb0 2023-11-28T18:49:38.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.342+0000 7fea5d8fe640 1 -- 172.21.15.45:0/1119521944 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fea581683b0 con 0x7fea580b3cb0 2023-11-28T18:49:38.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.342+0000 7fea54ff9640 1 -- 172.21.15.45:0/1119521944 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4983 (secure 0 0 0) 0x7fea40054ea0 con 0x7fea580b3cb0 2023-11-28T18:49:38.343 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:49:38.344 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":56,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6002,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/1183598108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":1183598108},{"type":"v1","addr":"172.21.15.190:6836","nonce":1183598108}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6005,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/3723100406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":3723100406},{"type":"v1","addr":"172.21.15.190:6837","nonce":3723100406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":56,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T18:43:58.654090+0000","modified":"2023-11-28T18:47:31.316416+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6792,"mds_1":6789},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6789":{"gid":6789,"name":"c","rank":1,"incarnation":50,"state":"up:active","state_seq":5,"addr":"172.21.15.45:6833/1994543507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1994543507},{"type":"v1","addr":"172.21.15.45:6833","nonce":1994543507}]},"join_fscid":-1,"laggy_since":"2023-11-28T18:44:43.089016+0000","export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_6792":{"gid":6792,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":56,"addr":"172.21.15.45:6835/2107305848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2107305848},{"type":"v1","addr":"172.21.15.45:6835","nonce":2107305848}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-28T18:49:38.344 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 56 2023-11-28T18:49:38.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.346+0000 7fea5d8fe640 1 -- 172.21.15.45:0/1119521944 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fea38066900 msgr2=0x7fea38068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:38.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.346+0000 7fea5d8fe640 1 --2- 172.21.15.45:0/1119521944 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fea38066900 0x7fea38068dc0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fea480ae000 tx=0x7fea480b5040 comp rx=0 tx=0).stop 2023-11-28T18:49:38.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.346+0000 7fea5d8fe640 1 -- 172.21.15.45:0/1119521944 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea580b3cb0 msgr2=0x7fea580cb830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:38.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.346+0000 7fea5d8fe640 1 --2- 172.21.15.45:0/1119521944 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea580b3cb0 0x7fea580cb830 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fea4000e8e0 tx=0x7fea4000eda0 comp rx=0 tx=0).stop 2023-11-28T18:49:38.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.346+0000 7fea5d8fe640 1 -- 172.21.15.45:0/1119521944 shutdown_connections 2023-11-28T18:49:38.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.346+0000 7fea5d8fe640 1 --2- 172.21.15.45:0/1119521944 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7fea38066900 0x7fea38068dc0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:38.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.346+0000 7fea5d8fe640 1 --2- 172.21.15.45:0/1119521944 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fea580cf7c0 0x7fea580cbd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:38.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.346+0000 7fea5d8fe640 1 --2- 172.21.15.45:0/1119521944 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea580b3cb0 0x7fea580cb830 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:38.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.346+0000 7fea5d8fe640 1 --2- 172.21.15.45:0/1119521944 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fea580b35f0 0x7fea5815bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:38.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.346+0000 7fea5d8fe640 1 -- 172.21.15.45:0/1119521944 >> 172.21.15.45:0/1119521944 conn(0x7fea5809c4f0 msgr2=0x7fea580734a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:49:38.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.346+0000 7fea5d8fe640 1 -- 172.21.15.45:0/1119521944 shutdown_connections 2023-11-28T18:49:38.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.346+0000 7fea5d8fe640 1 -- 172.21.15.45:0/1119521944 wait complete. 2023-11-28T18:49:38.365 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T18:49:38.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.510+0000 7f0bbe548640 1 Processor -- start 2023-11-28T18:49:38.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.510+0000 7f0bbe548640 1 -- start start 2023-11-28T18:49:38.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.510+0000 7f0bbe548640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0bb80d0440 0x7f0bb8161250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:38.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.510+0000 7f0bbe548640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0bb8161790 0x7f0bb8161be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:38.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.510+0000 7f0bbe548640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bb80c7000 con 0x7f0bb80cf950 2023-11-28T18:49:38.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.510+0000 7f0bbe548640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bb80cf0a0 con 0x7f0bb8161790 2023-11-28T18:49:38.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.510+0000 7f0bbe548640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb8162120 con 0x7f0bb80d0440 2023-11-28T18:49:38.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.510+0000 7f0bbdd47640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0bb8161790 0x7f0bb8161be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:38.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.510+0000 7f0bbdd47640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0bb8161790 0x7f0bb8161be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34172/0 (socket says 172.21.15.45:34172) 2023-11-28T18:49:38.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.510+0000 7f0bbdd47640 1 -- 172.21.15.45:0/2009845057 learned_addr learned my addr 172.21.15.45:0/2009845057 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:49:38.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.510+0000 7f0bbdd47640 1 -- 172.21.15.45:0/2009845057 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0bb80d0440 msgr2=0x7f0bb8161250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:49:38.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.510+0000 7f0bbcd45640 1 --2- 172.21.15.45:0/2009845057 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0bb80d0440 0x7f0bb8161250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:38.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.510+0000 7f0bbdd47640 1 --2- 172.21.15.45:0/2009845057 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0bb80d0440 0x7f0bb8161250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:38.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.510+0000 7f0bbdd47640 1 -- 172.21.15.45:0/2009845057 >> v1:172.21.15.190:6789/0 conn(0x7f0bb80cf950 legacy=0x7f0bb80cfd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:49:38.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.510+0000 7f0bbdd47640 1 -- 172.21.15.45:0/2009845057 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb80ceae0 con 0x7f0bb8161790 2023-11-28T18:49:38.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.510+0000 7f0bbcd45640 1 --2- 172.21.15.45:0/2009845057 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0bb80d0440 0x7f0bb8161250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T18:49:38.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.514+0000 7f0bbdd47640 1 --2- 172.21.15.45:0/2009845057 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bb8161790 0x7f0bb8161be0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0009e50 tx=0x7f0bb001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eaae854d24c0f46 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:49:38.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.514+0000 7f0baffff640 1 -- 172.21.15.45:0/2009845057 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb00a5790 con 0x7f0bb8161790 2023-11-28T18:49:38.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.514+0000 7f0baffff640 1 -- 172.21.15.45:0/2009845057 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bb00a58f0 con 0x7f0bb8161790 2023-11-28T18:49:38.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.514+0000 7f0baffff640 1 -- 172.21.15.45:0/2009845057 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb00a5c80 con 0x7f0bb8161790 2023-11-28T18:49:38.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.514+0000 7f0bbe548640 1 -- 172.21.15.45:0/2009845057 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bb8161790 msgr2=0x7f0bb8161be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:38.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.514+0000 7f0bbe548640 1 --2- 172.21.15.45:0/2009845057 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bb8161790 0x7f0bb8161be0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0009e50 tx=0x7f0bb001c910 comp rx=0 tx=0).stop 2023-11-28T18:49:38.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.514+0000 7f0bbe548640 1 -- 172.21.15.45:0/2009845057 shutdown_connections 2023-11-28T18:49:38.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.514+0000 7f0bbe548640 1 --2- 172.21.15.45:0/2009845057 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bb8161790 0x7f0bb8161be0 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:38.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.514+0000 7f0bbe548640 1 --2- 172.21.15.45:0/2009845057 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0bb80d0440 0x7f0bb8161250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:38.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.514+0000 7f0bbe548640 1 -- 172.21.15.45:0/2009845057 >> 172.21.15.45:0/2009845057 conn(0x7f0bb80d2fa0 msgr2=0x7f0bb80d3380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:49:38.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.514+0000 7f0bbe548640 1 -- 172.21.15.45:0/2009845057 shutdown_connections 2023-11-28T18:49:38.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.514+0000 7f0bbe548640 1 -- 172.21.15.45:0/2009845057 wait complete. 2023-11-28T18:49:38.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.518+0000 7f0bbe548640 1 Processor -- start 2023-11-28T18:49:38.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.518+0000 7f0bbe548640 1 -- start start 2023-11-28T18:49:38.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.518+0000 7f0bbe548640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0bb80cf950 0x7f0bb815a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:38.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.518+0000 7f0bbe548640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bb80d0440 0x7f0bb80cce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:38.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.518+0000 7f0bbe548640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0bb8161790 0x7f0bb80cb180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:38.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.518+0000 7f0bbe548640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb80a0620 con 0x7f0bb80d0440 2023-11-28T18:49:38.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.518+0000 7f0bbe548640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb80caa80 con 0x7f0bb8161790 2023-11-28T18:49:38.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.518+0000 7f0bbe548640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb80a0800 con 0x7f0bb80cf950 2023-11-28T18:49:38.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.518+0000 7f0bbcd45640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bb80d0440 0x7f0bb80cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:38.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.518+0000 7f0bbcd45640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bb80d0440 0x7f0bb80cce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34186/0 (socket says 172.21.15.45:34186) 2023-11-28T18:49:38.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.518+0000 7f0bbcd45640 1 -- 172.21.15.45:0/1122060410 learned_addr learned my addr 172.21.15.45:0/1122060410 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:49:38.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.518+0000 7f0bbdd47640 1 --2- 172.21.15.45:0/1122060410 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0bb8161790 0x7f0bb80cb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:38.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.518+0000 7f0bbd546640 1 --2- 172.21.15.45:0/1122060410 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0bb80cf950 0x7f0bb815a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:38.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.518+0000 7f0bbcd45640 1 -- 172.21.15.45:0/1122060410 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0bb80cf950 msgr2=0x7f0bb815a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:38.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.518+0000 7f0bbcd45640 1 --2- 172.21.15.45:0/1122060410 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0bb80cf950 0x7f0bb815a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:38.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.518+0000 7f0bbcd45640 1 -- 172.21.15.45:0/1122060410 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0bb8161790 msgr2=0x7f0bb80cb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:38.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.518+0000 7f0bbcd45640 1 --2- 172.21.15.45:0/1122060410 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0bb8161790 0x7f0bb80cb180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:38.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.518+0000 7f0bbcd45640 1 -- 172.21.15.45:0/1122060410 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb0009b30 con 0x7f0bb80d0440 2023-11-28T18:49:38.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.518+0000 7f0bbd546640 1 --2- 172.21.15.45:0/1122060410 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0bb80cf950 0x7f0bb815a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T18:49:38.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.518+0000 7f0bbcd45640 1 --2- 172.21.15.45:0/1122060410 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bb80d0440 0x7f0bb80cce70 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f0ba800c7c0 tx=0x7f0ba800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:49:38.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.518+0000 7f0badffb640 1 -- 172.21.15.45:0/1122060410 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba8007a30 con 0x7f0bb80d0440 2023-11-28T18:49:38.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.518+0000 7f0badffb640 1 -- 172.21.15.45:0/1122060410 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ba8007b90 con 0x7f0bb80d0440 2023-11-28T18:49:38.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.518+0000 7f0badffb640 1 -- 172.21.15.45:0/1122060410 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba800ce70 con 0x7f0bb80d0440 2023-11-28T18:49:38.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.518+0000 7f0bbe548640 1 -- 172.21.15.45:0/1122060410 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bb80a0ae0 con 0x7f0bb80d0440 2023-11-28T18:49:38.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.518+0000 7f0bbe548640 1 -- 172.21.15.45:0/1122060410 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bb80cb6c0 con 0x7f0bb80d0440 2023-11-28T18:49:38.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.522+0000 7f0bbe548640 1 -- 172.21.15.45:0/1122060410 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bb80a0d00 con 0x7f0bb80d0440 2023-11-28T18:49:38.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.522+0000 7f0badffb640 1 -- 172.21.15.45:0/1122060410 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f0ba80113f0 con 0x7f0bb80d0440 2023-11-28T18:49:38.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.522+0000 7f0badffb640 1 --2- 172.21.15.45:0/1122060410 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f0b9c0668d0 0x7f0b9c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:38.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.522+0000 7f0badffb640 1 -- 172.21.15.45:0/1122060410 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0ba8084920 con 0x7f0bb80d0440 2023-11-28T18:49:38.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.522+0000 7f0bbd546640 1 --2- 172.21.15.45:0/1122060410 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f0b9c0668d0 0x7f0b9c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:38.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.522+0000 7f0bbd546640 1 --2- 172.21.15.45:0/1122060410 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f0b9c0668d0 0x7f0b9c068d90 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f0bb4003ec0 tx=0x7f0bb4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:49:38.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.526+0000 7f0badffb640 1 -- 172.21.15.45:0/1122060410 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0ba8051ae0 con 0x7f0bb80d0440 2023-11-28T18:49:38.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.690+0000 7f0bbe548640 1 -- 172.21.15.45:0/1122060410 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0bb80a0f70 con 0x7f0bb80d0440 2023-11-28T18:49:38.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.694+0000 7f0badffb640 1 -- 172.21.15.45:0/1122060410 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+16529 (secure 0 0 0) 0x7f0ba801e020 con 0x7f0bb80d0440 2023-11-28T18:49:38.693 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:49:38.693 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":60,"fsid":"d10f5cd6-1d00-4019-99b6-6fa435498a15","created":"2023-11-28T18:37:08.189030+0000","modified":"2023-11-28T18:44:00.269525+0000","last_up_change":"2023-11-28T18:37:20.196124+0000","last_in_change":"2023-11-28T18:37:10.742043+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T18:37:21.293917+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-28T18:43:57.069740+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-28T18:43:57.647964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"84465384-103c-4f2c-a45a-96f5bb9c835f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6809","nonce":555237322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6811","nonce":555237322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6815","nonce":555237322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":555237322},{"type":"v1","addr":"172.21.15.45:6813","nonce":555237322}]},"public_addr":"172.21.15.45:6809/555237322","cluster_addr":"172.21.15.45:6811/555237322","heartbeat_back_addr":"172.21.15.45:6815/555237322","heartbeat_front_addr":"172.21.15.45:6813/555237322","state":["exists","up"]},{"osd":1,"uuid":"7d9eed24-a58f-42c7-a787-ac06be8553fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6801","nonce":2857063763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6803","nonce":2857063763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6807","nonce":2857063763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2857063763},{"type":"v1","addr":"172.21.15.45:6805","nonce":2857063763}]},"public_addr":"172.21.15.45:6801/2857063763","cluster_addr":"172.21.15.45:6803/2857063763","heartbeat_back_addr":"172.21.15.45:6807/2857063763","heartbeat_front_addr":"172.21.15.45:6805/2857063763","state":["exists","up"]},{"osd":2,"uuid":"575eeccc-4abf-45b4-9caf-f3e797859588","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6817","nonce":193884539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6819","nonce":193884539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6823","nonce":193884539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":193884539},{"type":"v1","addr":"172.21.15.45:6821","nonce":193884539}]},"public_addr":"172.21.15.45:6817/193884539","cluster_addr":"172.21.15.45:6819/193884539","heartbeat_back_addr":"172.21.15.45:6823/193884539","heartbeat_front_addr":"172.21.15.45:6821/193884539","state":["exists","up"]},{"osd":3,"uuid":"9b0290d6-9a52-4bc8-b2a1-7622c5dc8e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6825","nonce":78541084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6827","nonce":78541084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6831","nonce":78541084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":78541084},{"type":"v1","addr":"172.21.15.45:6829","nonce":78541084}]},"public_addr":"172.21.15.45:6825/78541084","cluster_addr":"172.21.15.45:6827/78541084","heartbeat_back_addr":"172.21.15.45:6831/78541084","heartbeat_front_addr":"172.21.15.45:6829/78541084","state":["exists","up"]},{"osd":4,"uuid":"ce632829-f027-4fbf-a627-02c571aa9d53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6809","nonce":1537591987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6811","nonce":1537591987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6815","nonce":1537591987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":1537591987},{"type":"v1","addr":"172.21.15.190:6813","nonce":1537591987}]},"public_addr":"172.21.15.190:6809/1537591987","cluster_addr":"172.21.15.190:6811/1537591987","heartbeat_back_addr":"172.21.15.190:6815/1537591987","heartbeat_front_addr":"172.21.15.190:6813/1537591987","state":["exists","up"]},{"osd":5,"uuid":"8700b609-27be-40bd-a251-4c0ae0a29ead","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6801","nonce":3296698407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6803","nonce":3296698407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6807","nonce":3296698407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":3296698407},{"type":"v1","addr":"172.21.15.190:6805","nonce":3296698407}]},"public_addr":"172.21.15.190:6801/3296698407","cluster_addr":"172.21.15.190:6803/3296698407","heartbeat_back_addr":"172.21.15.190:6807/3296698407","heartbeat_front_addr":"172.21.15.190:6805/3296698407","state":["exists","up"]},{"osd":6,"uuid":"44ce4a40-e6ff-4f4d-8e8a-7341e5c91f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6817","nonce":2317686718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6819","nonce":2317686718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6823","nonce":2317686718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2317686718},{"type":"v1","addr":"172.21.15.190:6821","nonce":2317686718}]},"public_addr":"172.21.15.190:6817/2317686718","cluster_addr":"172.21.15.190:6819/2317686718","heartbeat_back_addr":"172.21.15.190:6823/2317686718","heartbeat_front_addr":"172.21.15.190:6821/2317686718","state":["exists","up"]},{"osd":7,"uuid":"192238c9-1423-4b7e-ac8f-84ba32113ddf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6825","nonce":2493232051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6827","nonce":2493232051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6831","nonce":2493232051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2493232051},{"type":"v1","addr":"172.21.15.190:6829","nonce":2493232051}]},"public_addr":"172.21.15.190:6825/2493232051","cluster_addr":"172.21.15.190:6827/2493232051","heartbeat_back_addr":"172.21.15.190:6831/2493232051","heartbeat_front_addr":"172.21.15.190:6829/2493232051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.393552+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.385453+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.361421+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.366408+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.363226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.276007+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.414605+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T18:37:16.445885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T18:49:38.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.694+0000 7f0bbe548640 1 -- 172.21.15.45:0/1122060410 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f0b9c0668d0 msgr2=0x7f0b9c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:38.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.694+0000 7f0bbe548640 1 --2- 172.21.15.45:0/1122060410 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f0b9c0668d0 0x7f0b9c068d90 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f0bb4003ec0 tx=0x7f0bb4009040 comp rx=0 tx=0).stop 2023-11-28T18:49:38.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.694+0000 7f0bbe548640 1 -- 172.21.15.45:0/1122060410 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bb80d0440 msgr2=0x7f0bb80cce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:38.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.694+0000 7f0bbe548640 1 --2- 172.21.15.45:0/1122060410 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bb80d0440 0x7f0bb80cce70 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f0ba800c7c0 tx=0x7f0ba800cc80 comp rx=0 tx=0).stop 2023-11-28T18:49:38.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.694+0000 7f0bbe548640 1 -- 172.21.15.45:0/1122060410 shutdown_connections 2023-11-28T18:49:38.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.694+0000 7f0bbe548640 1 --2- 172.21.15.45:0/1122060410 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f0b9c0668d0 0x7f0b9c068d90 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:38.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.694+0000 7f0bbe548640 1 --2- 172.21.15.45:0/1122060410 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0bb8161790 0x7f0bb80cb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:38.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.694+0000 7f0bbe548640 1 --2- 172.21.15.45:0/1122060410 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bb80d0440 0x7f0bb80cce70 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:38.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.694+0000 7f0bbe548640 1 --2- 172.21.15.45:0/1122060410 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0bb80cf950 0x7f0bb815a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:38.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.694+0000 7f0bbe548640 1 -- 172.21.15.45:0/1122060410 >> 172.21.15.45:0/1122060410 conn(0x7f0bb80d2fa0 msgr2=0x7f0bb80b7bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:49:38.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.694+0000 7f0bbe548640 1 -- 172.21.15.45:0/1122060410 shutdown_connections 2023-11-28T18:49:38.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.694+0000 7f0bbe548640 1 -- 172.21.15.45:0/1122060410 wait complete. 2023-11-28T18:49:38.714 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-28T18:49:38.715 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T18:49:38.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.858+0000 7f90bc4fe640 1 Processor -- start 2023-11-28T18:49:38.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.858+0000 7f90bc4fe640 1 -- start start 2023-11-28T18:49:38.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.858+0000 7f90bc4fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f90b406ca10 0x7f90b415a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:38.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.858+0000 7f90bc4fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f90b415abb0 0x7f90b40cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:38.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.858+0000 7f90bc4fe640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90b415b3e0 con 0x7f90b413cf70 2023-11-28T18:49:38.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.858+0000 7f90bc4fe640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90b413d350 con 0x7f90b406ca10 2023-11-28T18:49:38.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.858+0000 7f90bc4fe640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90b4140520 con 0x7f90b415abb0 2023-11-28T18:49:38.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.858+0000 7f90b9a99640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f90b406ca10 0x7f90b415a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:38.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.858+0000 7f90b9a99640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f90b406ca10 0x7f90b415a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34192/0 (socket says 172.21.15.45:34192) 2023-11-28T18:49:38.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.858+0000 7f90b9a99640 1 -- 172.21.15.45:0/2691390343 learned_addr learned my addr 172.21.15.45:0/2691390343 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:49:38.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.858+0000 7f90baa9b640 1 --2- 172.21.15.45:0/2691390343 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f90b415abb0 0x7f90b40cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:38.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.858+0000 7f90b9a99640 1 -- 172.21.15.45:0/2691390343 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f90b415abb0 msgr2=0x7f90b40cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T18:49:38.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.858+0000 7f90b9a99640 1 --2- 172.21.15.45:0/2691390343 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f90b415abb0 0x7f90b40cd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:38.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.862+0000 7f90b9a99640 1 -- 172.21.15.45:0/2691390343 >> v1:172.21.15.190:6789/0 conn(0x7f90b413cf70 legacy=0x7f90b406c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:38.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.862+0000 7f90b9a99640 1 -- 172.21.15.45:0/2691390343 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90b413f760 con 0x7f90b406ca10 2023-11-28T18:49:38.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.862+0000 7f90b9a99640 1 --2- 172.21.15.45:0/2691390343 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90b406ca10 0x7f90b415a670 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f90a40098a0 tx=0x7f90a401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6ac0b14f76a4f59 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:49:38.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.862+0000 7f90b9298640 1 -- 172.21.15.45:0/2691390343 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a40ab660 con 0x7f90b406ca10 2023-11-28T18:49:38.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.862+0000 7f90b9298640 1 -- 172.21.15.45:0/2691390343 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90a40ab7c0 con 0x7f90b406ca10 2023-11-28T18:49:38.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.862+0000 7f90b9298640 1 -- 172.21.15.45:0/2691390343 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a40abb50 con 0x7f90b406ca10 2023-11-28T18:49:38.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.862+0000 7f90bc4fe640 1 -- 172.21.15.45:0/2691390343 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90b406ca10 msgr2=0x7f90b415a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:38.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.862+0000 7f90bc4fe640 1 --2- 172.21.15.45:0/2691390343 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90b406ca10 0x7f90b415a670 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f90a40098a0 tx=0x7f90a401c460 comp rx=0 tx=0).stop 2023-11-28T18:49:38.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.862+0000 7f90bc4fe640 1 -- 172.21.15.45:0/2691390343 shutdown_connections 2023-11-28T18:49:38.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.862+0000 7f90bc4fe640 1 --2- 172.21.15.45:0/2691390343 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f90b415abb0 0x7f90b40cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:38.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.862+0000 7f90bc4fe640 1 --2- 172.21.15.45:0/2691390343 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90b406ca10 0x7f90b415a670 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:38.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.862+0000 7f90bc4fe640 1 -- 172.21.15.45:0/2691390343 >> 172.21.15.45:0/2691390343 conn(0x7f90b406a570 msgr2=0x7f90b406a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:49:38.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.862+0000 7f90bc4fe640 1 -- 172.21.15.45:0/2691390343 shutdown_connections 2023-11-28T18:49:38.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.866+0000 7f90bc4fe640 1 -- 172.21.15.45:0/2691390343 wait complete. 2023-11-28T18:49:38.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.866+0000 7f90bc4fe640 1 Processor -- start 2023-11-28T18:49:38.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.866+0000 7f90bc4fe640 1 -- start start 2023-11-28T18:49:38.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.866+0000 7f90bc4fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90b406ca10 0x7f90b4138b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:38.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.866+0000 7f90bc4fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f90b413cf70 0x7f90b4135b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:38.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.866+0000 7f90bc4fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f90b415abb0 0x7f90b41517f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:38.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.866+0000 7f90bc4fe640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90b41377c0 con 0x7f90b406ca10 2023-11-28T18:49:38.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.866+0000 7f90bc4fe640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90b41366b0 con 0x7f90b413cf70 2023-11-28T18:49:38.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.866+0000 7f90bc4fe640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90b4156c30 con 0x7f90b415abb0 2023-11-28T18:49:38.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.866+0000 7f90ba29a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90b406ca10 0x7f90b4138b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:38.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.866+0000 7f90ba29a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90b406ca10 0x7f90b4138b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34200/0 (socket says 172.21.15.45:34200) 2023-11-28T18:49:38.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.866+0000 7f90ba29a640 1 -- 172.21.15.45:0/542657740 learned_addr learned my addr 172.21.15.45:0/542657740 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T18:49:38.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.866+0000 7f90b9a99640 1 --2- 172.21.15.45:0/542657740 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f90b413cf70 0x7f90b4135b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:38.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.866+0000 7f90baa9b640 1 --2- 172.21.15.45:0/542657740 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f90b415abb0 0x7f90b41517f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:38.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.866+0000 7f90ba29a640 1 -- 172.21.15.45:0/542657740 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f90b415abb0 msgr2=0x7f90b41517f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:38.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.866+0000 7f90ba29a640 1 --2- 172.21.15.45:0/542657740 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f90b415abb0 0x7f90b41517f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:38.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.866+0000 7f90ba29a640 1 -- 172.21.15.45:0/542657740 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f90b413cf70 msgr2=0x7f90b4135b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:38.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.866+0000 7f90ba29a640 1 --2- 172.21.15.45:0/542657740 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f90b413cf70 0x7f90b4135b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:38.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.866+0000 7f90ba29a640 1 -- 172.21.15.45:0/542657740 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a40094d0 con 0x7f90b406ca10 2023-11-28T18:49:38.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.866+0000 7f90ba29a640 1 --2- 172.21.15.45:0/542657740 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90b406ca10 0x7f90b4138b50 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f90b000c500 tx=0x7f90b000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:49:38.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.866+0000 7f90aaffd640 1 -- 172.21.15.45:0/542657740 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b0005220 con 0x7f90b406ca10 2023-11-28T18:49:38.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.870+0000 7f90aaffd640 1 -- 172.21.15.45:0/542657740 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90b0005380 con 0x7f90b406ca10 2023-11-28T18:49:38.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.870+0000 7f90aaffd640 1 -- 172.21.15.45:0/542657740 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b0007270 con 0x7f90b406ca10 2023-11-28T18:49:38.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.870+0000 7f90bc4fe640 1 -- 172.21.15.45:0/542657740 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90b4156950 con 0x7f90b406ca10 2023-11-28T18:49:38.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.870+0000 7f90bc4fe640 1 -- 172.21.15.45:0/542657740 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90b4137450 con 0x7f90b406ca10 2023-11-28T18:49:38.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.870+0000 7f90bc4fe640 1 -- 172.21.15.45:0/542657740 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90b40cc6a0 con 0x7f90b406ca10 2023-11-28T18:49:38.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.870+0000 7f90aaffd640 1 -- 172.21.15.45:0/542657740 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f90b00073d0 con 0x7f90b406ca10 2023-11-28T18:49:38.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.870+0000 7f90aaffd640 1 --2- 172.21.15.45:0/542657740 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9098066900 0x7f9098068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:38.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.870+0000 7f90aaffd640 1 -- 172.21.15.45:0/542657740 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f90b0083ba0 con 0x7f90b406ca10 2023-11-28T18:49:38.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.870+0000 7f90b9a99640 1 --2- 172.21.15.45:0/542657740 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9098066900 0x7f9098068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T18:49:38.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.870+0000 7f90b9a99640 1 --2- 172.21.15.45:0/542657740 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9098066900 0x7f9098068dc0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f90a40af000 tx=0x7f90a40b6040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T18:49:38.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:38.874+0000 7f90aaffd640 1 -- 172.21.15.45:0/542657740 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f90b0050ea0 con 0x7f90b406ca10 2023-11-28T18:49:39.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:39.062+0000 7f90bc4fe640 1 -- 172.21.15.45:0/542657740 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f90b4069480 con 0x7f90b406ca10 2023-11-28T18:49:39.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:39.066+0000 7f90aaffd640 1 -- 172.21.15.45:0/542657740 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4983 (secure 0 0 0) 0x7f90b00544c0 con 0x7f90b406ca10 2023-11-28T18:49:39.064 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T18:49:39.064 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":56,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6002,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/1183598108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":1183598108},{"type":"v1","addr":"172.21.15.190:6836","nonce":1183598108}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6005,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/3723100406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":3723100406},{"type":"v1","addr":"172.21.15.190:6837","nonce":3723100406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":56,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T18:43:58.654090+0000","modified":"2023-11-28T18:47:31.316416+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6792,"mds_1":6789},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6789":{"gid":6789,"name":"c","rank":1,"incarnation":50,"state":"up:active","state_seq":5,"addr":"172.21.15.45:6833/1994543507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1994543507},{"type":"v1","addr":"172.21.15.45:6833","nonce":1994543507}]},"join_fscid":-1,"laggy_since":"2023-11-28T18:44:43.089016+0000","export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_6792":{"gid":6792,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":56,"addr":"172.21.15.45:6835/2107305848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2107305848},{"type":"v1","addr":"172.21.15.45:6835","nonce":2107305848}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-28T18:49:39.064 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 56 2023-11-28T18:49:39.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:39.066+0000 7f90bc4fe640 1 -- 172.21.15.45:0/542657740 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9098066900 msgr2=0x7f9098068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:39.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:39.066+0000 7f90bc4fe640 1 --2- 172.21.15.45:0/542657740 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9098066900 0x7f9098068dc0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f90a40af000 tx=0x7f90a40b6040 comp rx=0 tx=0).stop 2023-11-28T18:49:39.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:39.066+0000 7f90bc4fe640 1 -- 172.21.15.45:0/542657740 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90b406ca10 msgr2=0x7f90b4138b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T18:49:39.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:39.066+0000 7f90bc4fe640 1 --2- 172.21.15.45:0/542657740 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90b406ca10 0x7f90b4138b50 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f90b000c500 tx=0x7f90b000c9c0 comp rx=0 tx=0).stop 2023-11-28T18:49:39.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:39.066+0000 7f90bc4fe640 1 -- 172.21.15.45:0/542657740 shutdown_connections 2023-11-28T18:49:39.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:39.066+0000 7f90bc4fe640 1 --2- 172.21.15.45:0/542657740 >> [v2:172.21.15.190:6832/645101166,v1:172.21.15.190:6833/645101166] conn(0x7f9098066900 0x7f9098068dc0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:39.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:39.066+0000 7f90bc4fe640 1 --2- 172.21.15.45:0/542657740 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f90b415abb0 0x7f90b41517f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:39.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:39.066+0000 7f90bc4fe640 1 --2- 172.21.15.45:0/542657740 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f90b413cf70 0x7f90b4135b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:39.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:39.066+0000 7f90bc4fe640 1 --2- 172.21.15.45:0/542657740 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90b406ca10 0x7f90b4138b50 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:39.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:39.066+0000 7f90bc4fe640 1 -- 172.21.15.45:0/542657740 >> 172.21.15.45:0/542657740 conn(0x7f90b406a570 msgr2=0x7f90b4158a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T18:49:39.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:39.066+0000 7f90bc4fe640 1 -- 172.21.15.45:0/542657740 shutdown_connections 2023-11-28T18:49:39.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:39.066+0000 7f90bc4fe640 1 -- 172.21.15.45:0/542657740 wait complete. 2023-11-28T18:49:39.086 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T18:49:39.185 INFO:tasks.ceph.osd.0:Sent signal 15 2023-11-28T18:49:39.186 INFO:tasks.ceph.osd.1:Sent signal 15 2023-11-28T18:49:39.186 INFO:tasks.ceph.osd.2:Sent signal 15 2023-11-28T18:49:39.186 INFO:tasks.ceph.osd.3:Sent signal 15 2023-11-28T18:49:39.187 INFO:tasks.ceph.osd.4:Sent signal 15 2023-11-28T18:49:39.187 INFO:tasks.ceph.osd.5:Sent signal 15 2023-11-28T18:49:39.187 INFO:tasks.ceph.osd.6:Sent signal 15 2023-11-28T18:49:39.187 INFO:tasks.ceph.osd.7:Sent signal 15 2023-11-28T18:49:39.188 INFO:tasks.ceph.mds.a:Sent signal 15 2023-11-28T18:49:39.188 INFO:tasks.ceph.mds.b:Sent signal 15 2023-11-28T18:49:39.188 INFO:tasks.ceph.mds.d:Sent signal 15 2023-11-28T18:49:39.188 INFO:tasks.ceph.mon.a:Sent signal 15 2023-11-28T18:49:39.189 INFO:tasks.ceph.mon.b:Sent signal 15 2023-11-28T18:49:39.189 INFO:tasks.ceph.mon.c:Sent signal 15 2023-11-28T18:49:39.189 INFO:tasks.ceph.mgr.y:Sent signal 15 2023-11-28T18:49:39.189 INFO:tasks.ceph.mgr.x:Sent signal 15 2023-11-28T18:49:39.190 INFO:tasks.ceph.osd.4.smithi190.stderr:2023-11-28T18:49:39.193+0000 7ff9228dd640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 38550) UID: 0 2023-11-28T18:49:39.190 INFO:tasks.ceph.osd.4.smithi190.stderr:2023-11-28T18:49:39.193+0000 7ff9228dd640 -1 osd.4 60 *** Got signal Terminated *** 2023-11-28T18:49:39.190 INFO:tasks.ceph.osd.4.smithi190.stderr:2023-11-28T18:49:39.193+0000 7ff9228dd640 -1 osd.4 60 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-28T18:49:39.191 INFO:tasks.ceph.osd.5.smithi190.stderr:2023-11-28T18:49:39.193+0000 7f43a41ac640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 38551) UID: 0 2023-11-28T18:49:39.191 INFO:tasks.ceph.osd.5.smithi190.stderr:2023-11-28T18:49:39.193+0000 7f43a41ac640 -1 osd.5 60 *** Got signal Terminated *** 2023-11-28T18:49:39.191 INFO:tasks.ceph.osd.5.smithi190.stderr:2023-11-28T18:49:39.193+0000 7f43a41ac640 -1 osd.5 60 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-28T18:49:39.191 INFO:tasks.ceph.osd.6.smithi190.stderr:2023-11-28T18:49:39.193+0000 7f310eb87640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 38554) UID: 0 2023-11-28T18:49:39.191 INFO:tasks.ceph.osd.6.smithi190.stderr:2023-11-28T18:49:39.193+0000 7f310eb87640 -1 osd.6 60 *** Got signal Terminated *** 2023-11-28T18:49:39.191 INFO:tasks.ceph.osd.6.smithi190.stderr:2023-11-28T18:49:39.193+0000 7f310eb87640 -1 osd.6 60 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-28T18:49:39.192 INFO:tasks.ceph.osd.7.smithi190.stderr:2023-11-28T18:49:39.193+0000 7f0fde059640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 38556) UID: 0 2023-11-28T18:49:39.192 INFO:tasks.ceph.osd.7.smithi190.stderr:2023-11-28T18:49:39.193+0000 7f0fde059640 -1 osd.7 60 *** Got signal Terminated *** 2023-11-28T18:49:39.192 INFO:tasks.ceph.osd.7.smithi190.stderr:2023-11-28T18:49:39.193+0000 7f0fde059640 -1 osd.7 60 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-28T18:49:39.192 INFO:tasks.ceph.mds.b.smithi190.stderr:2023-11-28T18:49:39.193+0000 7fc2e7d92640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-mds -f --cluster ceph -i b (PID: 44068) UID: 0 2023-11-28T18:49:39.192 INFO:tasks.ceph.mds.b.smithi190.stderr:2023-11-28T18:49:39.193+0000 7fc2e7d92640 -1 mds.b *** got signal Terminated *** 2023-11-28T18:49:39.193 INFO:tasks.ceph.mds.d.smithi190.stderr:2023-11-28T18:49:39.193+0000 7f3d25a84640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-mds -f --cluster ceph -i d (PID: 44069) UID: 0 2023-11-28T18:49:39.193 INFO:tasks.ceph.mds.d.smithi190.stderr:2023-11-28T18:49:39.193+0000 7f3d25a84640 -1 mds.d *** got signal Terminated *** 2023-11-28T18:49:39.193 INFO:tasks.ceph.mon.c.smithi190.stderr:2023-11-28T18:49:39.193+0000 7f4ff0667640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-mon -f --cluster ceph -i c (PID: 38239) UID: 0 2023-11-28T18:49:39.193 INFO:tasks.ceph.mon.c.smithi190.stderr:2023-11-28T18:49:39.193+0000 7f4ff0667640 -1 mon.c@2(peon) e1 *** Got Signal Terminated *** 2023-11-28T18:49:39.193 INFO:tasks.ceph.mon.b.smithi190.stderr:2023-11-28T18:49:39.197+0000 7f44c2ec9640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-mon -f --cluster ceph -i b (PID: 38237) UID: 0 2023-11-28T18:49:39.194 INFO:tasks.ceph.mon.b.smithi190.stderr:2023-11-28T18:49:39.197+0000 7f44c2ec9640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2023-11-28T18:49:39.194 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-11-28T18:49:39.185+0000 7ff9809e4640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38241) UID: 0 2023-11-28T18:49:39.194 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-11-28T18:49:39.185+0000 7ff9809e4640 -1 osd.0 60 *** Got signal Terminated *** 2023-11-28T18:49:39.194 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-11-28T18:49:39.185+0000 7ff9809e4640 -1 osd.0 60 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-28T18:49:39.194 INFO:tasks.ceph.osd.1.smithi045.stderr:2023-11-28T18:49:39.185+0000 7fd8df9d5640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 38243) UID: 0 2023-11-28T18:49:39.195 INFO:tasks.ceph.osd.1.smithi045.stderr:2023-11-28T18:49:39.185+0000 7fd8df9d5640 -1 osd.1 60 *** Got signal Terminated *** 2023-11-28T18:49:39.195 INFO:tasks.ceph.osd.1.smithi045.stderr:2023-11-28T18:49:39.185+0000 7fd8df9d5640 -1 osd.1 60 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-28T18:49:39.195 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-11-28T18:49:39.185+0000 7f00d195a640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 38247) UID: 0 2023-11-28T18:49:39.195 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-11-28T18:49:39.185+0000 7f00d195a640 -1 osd.3 60 *** Got signal Terminated *** 2023-11-28T18:49:39.195 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-11-28T18:49:39.185+0000 7f00d195a640 -1 osd.3 60 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-28T18:49:39.195 INFO:tasks.ceph.osd.2.smithi045.stderr:2023-11-28T18:49:39.185+0000 7f2961cc2640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 38245) UID: 0 2023-11-28T18:49:39.196 INFO:tasks.ceph.osd.2.smithi045.stderr:2023-11-28T18:49:39.185+0000 7f2961cc2640 -1 osd.2 60 *** Got signal Terminated *** 2023-11-28T18:49:39.196 INFO:tasks.ceph.osd.2.smithi045.stderr:2023-11-28T18:49:39.185+0000 7f2961cc2640 -1 osd.2 60 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-28T18:49:39.196 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-11-28T18:49:39.189+0000 7f366fa89640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-mds -f --cluster ceph -i a (PID: 52536) UID: 0 2023-11-28T18:49:39.196 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-11-28T18:49:39.189+0000 7f366fa89640 -1 mds.a *** got signal Terminated *** 2023-11-28T18:49:39.196 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-11-28T18:49:39.189+0000 7f566e6be640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-mon -f --cluster ceph -i a (PID: 38136) UID: 0 2023-11-28T18:49:39.196 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-11-28T18:49:39.189+0000 7f566e6be640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-11-28T18:49:39.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:39.233+0000 7f31cf3d1640 1 Processor -- start 2023-11-28T18:49:39.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:39.233+0000 7f31cf3d1640 1 -- start start 2023-11-28T18:49:39.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:39.233+0000 7f31cf3d1640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31c80cd0d0 0x7f31c806ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:39.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:39.233+0000 7f31cf3d1640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c806d980 con 0x7f31c806b580 2023-11-28T18:49:39.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:39.233+0000 7f31cf3d1640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c806e520 con 0x7f31c80aed20 2023-11-28T18:49:39.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:39.233+0000 7f31cf3d1640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c806bf70 con 0x7f31c80cd0d0 2023-11-28T18:49:39.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:39.233+0000 7f31cc96c640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31c806b580 legacy=0x7f31c80cc9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:49:39.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:39.233+0000 7f31cd96e640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31c80cd0d0 msgr2=0x7f31c806ba30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:49:39.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:39.233+0000 7f31cd96e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31c80cd0d0 0x7f31c806ba30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:49:39.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:39.233+0000 7f31cd16d640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31c80aed20 legacy=0x7f31c806de10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:49:39.390 INFO:tasks.ceph.mgr.y.smithi045.stderr:daemon-helper: command crashed with signal 15 2023-11-28T18:49:39.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:39.437+0000 7f31cc96c640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31c806b580 legacy=0x7f31c80cc9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:49:39.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:39.437+0000 7f31cd96e640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31c80cd0d0 msgr2=0x7f31c806ba30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:49:39.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:39.437+0000 7f31cd96e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31c80cd0d0 0x7f31c806ba30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:49:39.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:39.437+0000 7f31cd16d640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31c80aed20 legacy=0x7f31c806de10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:49:39.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:39.841+0000 7f31cc96c640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31c806b580 legacy=0x7f31c80cc9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:49:39.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:39.841+0000 7f31cd96e640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31c80cd0d0 msgr2=0x7f31c806ba30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:49:39.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:39.841+0000 7f31cd96e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31c80cd0d0 0x7f31c806ba30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:49:39.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:39.841+0000 7f31cd16d640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31c80aed20 legacy=0x7f31c806de10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:49:40.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:40.645+0000 7f31cc96c640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31c806b580 legacy=0x7f31c80cc9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:49:40.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:40.645+0000 7f31cd96e640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31c80cd0d0 msgr2=0x7f31c806ba30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:49:40.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:40.645+0000 7f31cd96e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31c80cd0d0 0x7f31c806ba30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:49:40.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:40.645+0000 7f31cd16d640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31c80aed20 legacy=0x7f31c806de10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:49:42.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:42.233+0000 7f31beffd640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31c80cd0d0 msgr2=0x7f31c806ba30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:49:42.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:42.233+0000 7f31beffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31c80cd0d0 0x7f31c806ba30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:42.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:42.233+0000 7f31beffd640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31c80aed20 legacy=0x7f31c806de10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:49:42.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:42.233+0000 7f31beffd640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31c806b580 legacy=0x7f31c80cc9c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:49:42.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:42.233+0000 7f31beffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0036b0 0x7f31ac005b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:42.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:42.233+0000 7f31beffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0061c0 0x7f31ac008680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:42.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:42.233+0000 7f31beffd640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c806bf70 con 0x7f31ac0036b0 2023-11-28T18:49:42.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:42.233+0000 7f31beffd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31ac008d60 con 0x7f31ac0061c0 2023-11-28T18:49:42.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:42.233+0000 7f31cc96c640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0061c0 msgr2=0x7f31ac008680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:49:42.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:42.233+0000 7f31cd16d640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0036b0 msgr2=0x7f31ac005b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:49:42.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:42.233+0000 7f31cc96c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0061c0 0x7f31ac008680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:49:42.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:42.233+0000 7f31cd16d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0036b0 0x7f31ac005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:49:42.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:42.437+0000 7f31cc96c640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0061c0 msgr2=0x7f31ac008680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:49:42.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:42.437+0000 7f31cd16d640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0036b0 msgr2=0x7f31ac005b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:49:42.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:42.437+0000 7f31cc96c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0061c0 0x7f31ac008680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:49:42.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:42.437+0000 7f31cd16d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0036b0 0x7f31ac005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:49:42.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:42.841+0000 7f31cc96c640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0061c0 msgr2=0x7f31ac008680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:49:42.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:42.841+0000 7f31cd16d640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0036b0 msgr2=0x7f31ac005b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:49:42.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:42.841+0000 7f31cc96c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0061c0 0x7f31ac008680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:49:42.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:42.841+0000 7f31cd16d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0036b0 0x7f31ac005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:49:43.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:43.645+0000 7f31cc96c640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0061c0 msgr2=0x7f31ac008680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:49:43.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:43.645+0000 7f31cd16d640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0036b0 msgr2=0x7f31ac005b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:49:43.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:43.645+0000 7f31cd16d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0036b0 0x7f31ac005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:49:43.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:43.645+0000 7f31cc96c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0061c0 0x7f31ac008680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:49:45.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:45.233+0000 7f31beffd640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0061c0 msgr2=0x7f31ac008680 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:49:45.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:45.233+0000 7f31beffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0061c0 0x7f31ac008680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:45.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:45.233+0000 7f31beffd640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0036b0 msgr2=0x7f31ac005b30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:49:45.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:45.233+0000 7f31beffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0036b0 0x7f31ac005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:45.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:45.233+0000 7f31cd96e640 1 -- reap_dead start 2023-11-28T18:49:45.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:45.233+0000 7f31beffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31c80cd0d0 0x7f31ac00e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:45.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:45.233+0000 7f31beffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0061c0 0x7f31ac00ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:45.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:45.233+0000 7f31beffd640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c8155a70 con 0x7f31c806b580 2023-11-28T18:49:45.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:45.233+0000 7f31beffd640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c806bf70 con 0x7f31c80cd0d0 2023-11-28T18:49:45.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:45.233+0000 7f31beffd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31ac008d60 con 0x7f31ac0061c0 2023-11-28T18:49:45.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:45.233+0000 7f31cd16d640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31c806b580 legacy=0x7f31ac00b0b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:49:45.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:45.233+0000 7f31cc96c640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31c80cd0d0 msgr2=0x7f31ac00e7e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:49:45.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:45.233+0000 7f31cc96c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31c80cd0d0 0x7f31ac00e7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:49:45.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:45.233+0000 7f31cd96e640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0061c0 msgr2=0x7f31ac00ed50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:49:45.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:45.233+0000 7f31cd96e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0061c0 0x7f31ac00ed50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:49:45.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:45.437+0000 7f31cc96c640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31c80cd0d0 msgr2=0x7f31ac00e7e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:49:45.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:45.437+0000 7f31cd16d640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31c806b580 legacy=0x7f31ac00b0b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:49:45.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:45.437+0000 7f31cc96c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31c80cd0d0 0x7f31ac00e7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:49:45.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:45.437+0000 7f31cd96e640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0061c0 msgr2=0x7f31ac00ed50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:49:45.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:45.437+0000 7f31cd96e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0061c0 0x7f31ac00ed50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:49:45.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:45.841+0000 7f31cd16d640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31c806b580 legacy=0x7f31ac00b0b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:49:45.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:45.841+0000 7f31cc96c640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31c80cd0d0 msgr2=0x7f31ac00e7e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:49:45.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:45.841+0000 7f31cc96c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31c80cd0d0 0x7f31ac00e7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:49:45.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:45.841+0000 7f31cd96e640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0061c0 msgr2=0x7f31ac00ed50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:49:45.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:45.841+0000 7f31cd96e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0061c0 0x7f31ac00ed50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:49:46.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:46.645+0000 7f31cd16d640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31c806b580 legacy=0x7f31ac00b0b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:49:46.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:46.645+0000 7f31cc96c640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31c80cd0d0 msgr2=0x7f31ac00e7e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:49:46.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:46.645+0000 7f31cc96c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31c80cd0d0 0x7f31ac00e7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:49:46.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:46.645+0000 7f31cd96e640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0061c0 msgr2=0x7f31ac00ed50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:49:46.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:46.645+0000 7f31cd96e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0061c0 0x7f31ac00ed50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:49:48.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:48.233+0000 7f31beffd640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0061c0 msgr2=0x7f31ac00ed50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:49:48.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:48.233+0000 7f31beffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0061c0 0x7f31ac00ed50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:48.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:48.233+0000 7f31beffd640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31c80cd0d0 msgr2=0x7f31ac00e7e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:49:48.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:48.233+0000 7f31beffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31c80cd0d0 0x7f31ac00e7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:48.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:48.233+0000 7f31beffd640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31c806b580 legacy=0x7f31ac00b0b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:49:48.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:48.233+0000 7f31beffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0087d0 0x7f31ac005b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:48.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:48.233+0000 7f31beffd640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c806d980 con 0x7f31ac00f410 2023-11-28T18:49:48.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:48.233+0000 7f31beffd640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c806bf70 con 0x7f31ac0087d0 2023-11-28T18:49:48.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:48.233+0000 7f31cd16d640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0087d0 msgr2=0x7f31ac005b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:49:48.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:48.233+0000 7f31cc96c640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac00f410 legacy=0x7f31ac0118d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:49:48.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:48.233+0000 7f31cd16d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0087d0 0x7f31ac005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:49:48.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:48.437+0000 7f31cc96c640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac00f410 legacy=0x7f31ac0118d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:49:48.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:48.437+0000 7f31cd16d640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0087d0 msgr2=0x7f31ac005b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:49:48.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:48.437+0000 7f31cd16d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0087d0 0x7f31ac005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:49:48.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:48.841+0000 7f31cc96c640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac00f410 legacy=0x7f31ac0118d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:49:48.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:48.841+0000 7f31cd16d640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0087d0 msgr2=0x7f31ac005b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:49:48.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:48.841+0000 7f31cd16d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0087d0 0x7f31ac005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:49:49.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:49.645+0000 7f31cd16d640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0087d0 msgr2=0x7f31ac005b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:49:49.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:49.645+0000 7f31cc96c640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac00f410 legacy=0x7f31ac0118d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:49:49.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:49.645+0000 7f31cd16d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0087d0 0x7f31ac005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:49:51.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:51.233+0000 7f31beffd640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0087d0 msgr2=0x7f31ac005b30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:49:51.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:51.233+0000 7f31beffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0087d0 0x7f31ac005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:51.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:51.233+0000 7f31beffd640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac00f410 legacy=0x7f31ac0118d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:49:51.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:51.233+0000 7f31cd96e640 1 -- reap_dead start 2023-11-28T18:49:51.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:51.233+0000 7f31beffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0061c0 0x7f31ac00ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:51.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:51.233+0000 7f31beffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31c80cd0d0 0x7f31ac0137c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:51.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:51.233+0000 7f31beffd640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c8155a70 con 0x7f31c806b580 2023-11-28T18:49:51.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:51.233+0000 7f31beffd640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c806bf70 con 0x7f31c80cd0d0 2023-11-28T18:49:51.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:51.233+0000 7f31beffd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31ac008d60 con 0x7f31ac0061c0 2023-11-28T18:49:51.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:51.233+0000 7f31cd16d640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31c806b580 legacy=0x7f31ac0130b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:49:51.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:51.233+0000 7f31cd96e640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31c80cd0d0 msgr2=0x7f31ac0137c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:49:51.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:51.233+0000 7f31cd96e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31c80cd0d0 0x7f31ac0137c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:49:51.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:51.233+0000 7f31cc96c640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0061c0 msgr2=0x7f31ac00ed50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:49:51.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:51.233+0000 7f31cc96c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0061c0 0x7f31ac00ed50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:49:51.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:51.437+0000 7f31cd16d640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31c806b580 legacy=0x7f31ac0130b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:49:51.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:51.437+0000 7f31cd96e640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31c80cd0d0 msgr2=0x7f31ac0137c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:49:51.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:51.437+0000 7f31cd96e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31c80cd0d0 0x7f31ac0137c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:49:51.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:51.437+0000 7f31cc96c640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0061c0 msgr2=0x7f31ac00ed50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:49:51.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:51.437+0000 7f31cc96c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0061c0 0x7f31ac00ed50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:49:51.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:51.841+0000 7f31cd96e640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31c80cd0d0 msgr2=0x7f31ac0137c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:49:51.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:51.841+0000 7f31cd16d640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31c806b580 legacy=0x7f31ac0130b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:49:51.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:51.841+0000 7f31cd96e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31c80cd0d0 0x7f31ac0137c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:49:51.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:51.841+0000 7f31cc96c640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0061c0 msgr2=0x7f31ac00ed50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:49:51.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:51.841+0000 7f31cc96c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0061c0 0x7f31ac00ed50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:49:52.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:52.645+0000 7f31cd96e640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31c80cd0d0 msgr2=0x7f31ac0137c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:49:52.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:52.645+0000 7f31cd16d640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31c806b580 legacy=0x7f31ac0130b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:49:52.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:52.645+0000 7f31cd96e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31c80cd0d0 0x7f31ac0137c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:49:52.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:52.645+0000 7f31cc96c640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0061c0 msgr2=0x7f31ac00ed50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:49:52.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:52.645+0000 7f31cc96c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0061c0 0x7f31ac00ed50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:49:54.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:54.237+0000 7f31beffd640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0061c0 msgr2=0x7f31ac00ed50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:49:54.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:54.237+0000 7f31beffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0061c0 0x7f31ac00ed50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:54.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:54.237+0000 7f31beffd640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31c80cd0d0 msgr2=0x7f31ac0137c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:49:54.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:54.237+0000 7f31beffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31c80cd0d0 0x7f31ac0137c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:54.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:54.237+0000 7f31beffd640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31c806b580 legacy=0x7f31ac0130b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:49:54.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:54.237+0000 7f31beffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac005b30 0x7f31ac0118d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:54.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:54.237+0000 7f31beffd640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c806d980 con 0x7f31ac00e0d0 2023-11-28T18:49:54.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:54.237+0000 7f31beffd640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c806bf70 con 0x7f31ac005b30 2023-11-28T18:49:54.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:54.237+0000 7f31cd16d640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac00e0d0 legacy=0x7f31ac00e4b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:49:54.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:54.237+0000 7f31cc96c640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac005b30 msgr2=0x7f31ac0118d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:49:54.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:54.237+0000 7f31cc96c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac005b30 0x7f31ac0118d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:49:54.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:54.441+0000 7f31cd16d640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac00e0d0 legacy=0x7f31ac00e4b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:49:54.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:54.441+0000 7f31cc96c640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac005b30 msgr2=0x7f31ac0118d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:49:54.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:54.441+0000 7f31cc96c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac005b30 0x7f31ac0118d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:49:54.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:54.845+0000 7f31cd16d640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac00e0d0 legacy=0x7f31ac00e4b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:49:54.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:54.845+0000 7f31cc96c640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac005b30 msgr2=0x7f31ac0118d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:49:54.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:54.845+0000 7f31cc96c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac005b30 0x7f31ac0118d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:49:55.605 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:49:55.609 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:49:55.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:55.649+0000 7f31cc96c640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac005b30 msgr2=0x7f31ac0118d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:49:55.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:55.649+0000 7f31cd16d640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac00e0d0 legacy=0x7f31ac00e4b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:49:55.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:55.649+0000 7f31cc96c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac005b30 0x7f31ac0118d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:49:57.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:57.237+0000 7f31beffd640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac005b30 msgr2=0x7f31ac0118d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:49:57.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:57.237+0000 7f31beffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac005b30 0x7f31ac0118d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:49:57.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:57.237+0000 7f31beffd640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac00e0d0 legacy=0x7f31ac00e4b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:49:57.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:57.237+0000 7f31cd96e640 1 -- reap_dead start 2023-11-28T18:49:57.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:57.237+0000 7f31beffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0061c0 0x7f31ac00ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:57.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:57.237+0000 7f31beffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac005b30 0x7f31ac0118d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:49:57.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:57.237+0000 7f31beffd640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c8155a70 con 0x7f31c806b580 2023-11-28T18:49:57.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:57.237+0000 7f31beffd640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c806bf70 con 0x7f31ac005b30 2023-11-28T18:49:57.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:57.237+0000 7f31beffd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31ac008d60 con 0x7f31ac0061c0 2023-11-28T18:49:57.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:57.237+0000 7f31cc96c640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31c806b580 legacy=0x7f31ac0130b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:49:57.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:57.237+0000 7f31cd16d640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0061c0 msgr2=0x7f31ac00ed50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:49:57.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:57.237+0000 7f31cd96e640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac005b30 msgr2=0x7f31ac0118d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:49:57.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:57.237+0000 7f31cd16d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0061c0 0x7f31ac00ed50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:49:57.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:57.237+0000 7f31cd96e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac005b30 0x7f31ac0118d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:49:57.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:57.441+0000 7f31cc96c640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31c806b580 legacy=0x7f31ac0130b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:49:57.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:57.441+0000 7f31cd96e640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac005b30 msgr2=0x7f31ac0118d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:49:57.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:57.441+0000 7f31cd16d640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0061c0 msgr2=0x7f31ac00ed50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:49:57.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:57.441+0000 7f31cd16d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0061c0 0x7f31ac00ed50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:49:57.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:57.441+0000 7f31cd96e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac005b30 0x7f31ac0118d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:49:57.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:57.845+0000 7f31cc96c640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31c806b580 legacy=0x7f31ac0130b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:49:57.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:57.845+0000 7f31cd96e640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac005b30 msgr2=0x7f31ac0118d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:49:57.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:57.845+0000 7f31cd16d640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0061c0 msgr2=0x7f31ac00ed50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:49:57.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:57.845+0000 7f31cd16d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0061c0 0x7f31ac00ed50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:49:57.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:57.845+0000 7f31cd96e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac005b30 0x7f31ac0118d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:49:58.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:58.649+0000 7f31cc96c640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31c806b580 legacy=0x7f31ac0130b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:49:58.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:58.649+0000 7f31cd96e640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac005b30 msgr2=0x7f31ac0118d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:49:58.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:58.649+0000 7f31cd16d640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0061c0 msgr2=0x7f31ac00ed50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:49:58.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:58.649+0000 7f31cd16d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0061c0 0x7f31ac00ed50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:49:58.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:49:58.649+0000 7f31cd96e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac005b30 0x7f31ac0118d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:50:00.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:00.237+0000 7f31beffd640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0061c0 msgr2=0x7f31ac00ed50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:50:00.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:00.237+0000 7f31beffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0061c0 0x7f31ac00ed50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:50:00.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:00.237+0000 7f31beffd640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac005b30 msgr2=0x7f31ac0118d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:50:00.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:00.237+0000 7f31beffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac005b30 0x7f31ac0118d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:50:00.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:00.237+0000 7f31beffd640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31c806b580 legacy=0x7f31ac0130b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:50:00.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:00.237+0000 7f31beffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00c0c0 0x7f31ac00c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:50:00.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:00.237+0000 7f31beffd640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c806d980 con 0x7f31ac0137c0 2023-11-28T18:50:00.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:00.237+0000 7f31beffd640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c806bf70 con 0x7f31ac00c0c0 2023-11-28T18:50:00.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:00.237+0000 7f31cc96c640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00c0c0 msgr2=0x7f31ac00c4d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:50:00.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:00.237+0000 7f31cc96c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00c0c0 0x7f31ac00c4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:50:00.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:00.237+0000 7f31cd16d640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac0137c0 legacy=0x7f31ac00e4b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:50:00.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:00.441+0000 7f31cc96c640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00c0c0 msgr2=0x7f31ac00c4d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:50:00.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:00.441+0000 7f31cc96c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00c0c0 0x7f31ac00c4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:50:00.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:00.441+0000 7f31cd16d640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac0137c0 legacy=0x7f31ac00e4b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:50:00.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:00.845+0000 7f31cc96c640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00c0c0 msgr2=0x7f31ac00c4d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:50:00.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:00.845+0000 7f31cc96c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00c0c0 0x7f31ac00c4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:50:00.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:00.845+0000 7f31cd16d640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac0137c0 legacy=0x7f31ac00e4b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:50:01.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:01.649+0000 7f31cc96c640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00c0c0 msgr2=0x7f31ac00c4d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:50:01.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:01.649+0000 7f31cc96c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00c0c0 0x7f31ac00c4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:50:01.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:01.649+0000 7f31cd16d640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac0137c0 legacy=0x7f31ac00e4b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:50:03.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:03.237+0000 7f31beffd640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00c0c0 msgr2=0x7f31ac00c4d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:50:03.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:03.237+0000 7f31beffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00c0c0 0x7f31ac00c4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:50:03.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:03.237+0000 7f31beffd640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac0137c0 legacy=0x7f31ac00e4b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:50:03.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:03.237+0000 7f31cd96e640 1 -- reap_dead start 2023-11-28T18:50:03.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:03.237+0000 7f31beffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00ca10 0x7f31ac00cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:50:03.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:03.237+0000 7f31beffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac005b30 0x7f31ac00c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:50:03.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:03.237+0000 7f31beffd640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c8155a70 con 0x7f31ac0137c0 2023-11-28T18:50:03.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:03.237+0000 7f31beffd640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c806bf70 con 0x7f31ac00ca10 2023-11-28T18:50:03.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:03.237+0000 7f31beffd640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31ac008d60 con 0x7f31ac005b30 2023-11-28T18:50:03.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:03.237+0000 7f31cd16d640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00ca10 msgr2=0x7f31ac00cdf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:50:03.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:03.237+0000 7f31cd16d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00ca10 0x7f31ac00cdf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:50:03.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:03.237+0000 7f31cd96e640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac0137c0 legacy=0x7f31ac00e4b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:50:03.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:03.237+0000 7f31cc96c640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac005b30 msgr2=0x7f31ac00c4d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:50:03.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:03.237+0000 7f31cc96c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac005b30 0x7f31ac00c4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:50:03.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:03.441+0000 7f31cd16d640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00ca10 msgr2=0x7f31ac00cdf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:50:03.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:03.441+0000 7f31cd16d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00ca10 0x7f31ac00cdf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:50:03.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:03.441+0000 7f31cd96e640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac0137c0 legacy=0x7f31ac00e4b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:50:03.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:03.441+0000 7f31cc96c640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac005b30 msgr2=0x7f31ac00c4d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:50:03.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:03.441+0000 7f31cc96c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac005b30 0x7f31ac00c4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:50:03.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:03.845+0000 7f31cd16d640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00ca10 msgr2=0x7f31ac00cdf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:50:03.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:03.845+0000 7f31cd16d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00ca10 0x7f31ac00cdf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:50:03.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:03.845+0000 7f31cd96e640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac0137c0 legacy=0x7f31ac00e4b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:50:03.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:03.845+0000 7f31cc96c640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac005b30 msgr2=0x7f31ac00c4d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:50:03.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:03.845+0000 7f31cc96c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac005b30 0x7f31ac00c4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:50:04.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:04.649+0000 7f31cd16d640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00ca10 msgr2=0x7f31ac00cdf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:50:04.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:04.649+0000 7f31cd16d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00ca10 0x7f31ac00cdf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:50:04.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:04.649+0000 7f31cd96e640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac0137c0 legacy=0x7f31ac00e4b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:50:04.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:04.649+0000 7f31cc96c640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac005b30 msgr2=0x7f31ac00c4d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:50:04.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:04.649+0000 7f31cc96c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac005b30 0x7f31ac00c4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:50:06.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:06.237+0000 7f31beffd640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac005b30 msgr2=0x7f31ac00c4d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:50:06.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:06.237+0000 7f31beffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac005b30 0x7f31ac00c4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:50:06.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:06.237+0000 7f31beffd640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00ca10 msgr2=0x7f31ac00cdf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:50:06.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:06.237+0000 7f31beffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00ca10 0x7f31ac00cdf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:50:06.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:06.237+0000 7f31beffd640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac0137c0 legacy=0x7f31ac00e4b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:50:06.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:06.237+0000 7f31beffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00ed50 0x7f31ac0130b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:50:06.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:06.237+0000 7f31beffd640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c806d980 con 0x7f31ac00d330 2023-11-28T18:50:06.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:06.237+0000 7f31beffd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31c806bf70 con 0x7f31ac00ed50 2023-11-28T18:50:06.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:06.237+0000 7f31cc96c640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac00d330 legacy=0x7f31ac00d7b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:50:06.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:06.237+0000 7f31cd16d640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00ed50 msgr2=0x7f31ac0130b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:50:06.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:06.237+0000 7f31cd16d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00ed50 0x7f31ac0130b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:50:06.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:06.441+0000 7f31cc96c640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac00d330 legacy=0x7f31ac00d7b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:50:06.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:06.441+0000 7f31cd16d640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00ed50 msgr2=0x7f31ac0130b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:50:06.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:06.441+0000 7f31cd16d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00ed50 0x7f31ac0130b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:50:06.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:06.845+0000 7f31cc96c640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac00d330 legacy=0x7f31ac00d7b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:50:06.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:06.845+0000 7f31cd16d640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00ed50 msgr2=0x7f31ac0130b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:50:06.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:06.845+0000 7f31cd16d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00ed50 0x7f31ac0130b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:50:07.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:07.649+0000 7f31cc96c640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac00d330 legacy=0x7f31ac00d7b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:50:07.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:07.649+0000 7f31cd16d640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00ed50 msgr2=0x7f31ac0130b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:50:07.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:07.649+0000 7f31cd16d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00ed50 0x7f31ac0130b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:50:09.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:09.237+0000 7f31beffd640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00ed50 msgr2=0x7f31ac0130b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:50:09.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:09.237+0000 7f31beffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00ed50 0x7f31ac0130b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:50:09.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:09.237+0000 7f31beffd640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac00d330 legacy=0x7f31ac00d7b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:50:09.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:09.237+0000 7f31beffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00ca10 0x7f31ac00cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:50:09.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:09.237+0000 7f31cd96e640 1 -- reap_dead start 2023-11-28T18:50:09.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:09.237+0000 7f31beffd640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c8155a70 con 0x7f31ac0118d0 2023-11-28T18:50:09.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:09.237+0000 7f31beffd640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c806d980 con 0x7f31ac0137c0 2023-11-28T18:50:09.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:09.237+0000 7f31beffd640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c806bf70 con 0x7f31ac00ca10 2023-11-28T18:50:09.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:09.237+0000 7f31cd16d640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00ca10 msgr2=0x7f31ac00cdf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:50:09.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:09.237+0000 7f31cc96c640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac0118d0 legacy=0x7f31ac01c1d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:50:09.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:09.237+0000 7f31cd16d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00ca10 0x7f31ac00cdf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:50:09.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:09.237+0000 7f31cd96e640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac0137c0 legacy=0x7f31ac00e4b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:50:09.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:09.441+0000 7f31cd16d640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00ca10 msgr2=0x7f31ac00cdf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:50:09.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:09.441+0000 7f31cc96c640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac0118d0 legacy=0x7f31ac01c1d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:50:09.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:09.441+0000 7f31cd16d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00ca10 0x7f31ac00cdf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:50:09.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:09.441+0000 7f31cd96e640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac0137c0 legacy=0x7f31ac00e4b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:50:09.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:09.845+0000 7f31cc96c640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac0118d0 legacy=0x7f31ac01c1d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:50:09.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:09.845+0000 7f31cd16d640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00ca10 msgr2=0x7f31ac00cdf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:50:09.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:09.845+0000 7f31cd16d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00ca10 0x7f31ac00cdf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:50:09.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:09.845+0000 7f31cd96e640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac0137c0 legacy=0x7f31ac00e4b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:50:10.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:10.649+0000 7f31cd16d640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00ca10 msgr2=0x7f31ac00cdf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:50:10.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:10.649+0000 7f31cc96c640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac0118d0 legacy=0x7f31ac01c1d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:50:10.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:10.649+0000 7f31cd16d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00ca10 0x7f31ac00cdf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:50:10.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:10.649+0000 7f31cd96e640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac0137c0 legacy=0x7f31ac00e4b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:50:12.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:12.237+0000 7f31beffd640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00ca10 msgr2=0x7f31ac00cdf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:50:12.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:12.237+0000 7f31beffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00ca10 0x7f31ac00cdf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:50:12.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:12.237+0000 7f31beffd640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac0137c0 legacy=0x7f31ac00e4b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:50:12.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:12.237+0000 7f31beffd640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac0118d0 legacy=0x7f31ac01c1d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:50:12.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:12.237+0000 7f31beffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00ed50 0x7f31ac00c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:50:12.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:12.237+0000 7f31beffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac005b30 0x7f31ac0130b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:50:12.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:12.237+0000 7f31beffd640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c806bf70 con 0x7f31ac005b30 2023-11-28T18:50:12.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:12.237+0000 7f31beffd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31ac008d60 con 0x7f31ac00ed50 2023-11-28T18:50:12.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:12.237+0000 7f31cc96c640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac005b30 msgr2=0x7f31ac0130b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:50:12.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:12.237+0000 7f31cd16d640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00ed50 msgr2=0x7f31ac00c4d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:50:12.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:12.237+0000 7f31cd16d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00ed50 0x7f31ac00c4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:50:12.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:12.237+0000 7f31cc96c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac005b30 0x7f31ac0130b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:50:12.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:12.441+0000 7f31cc96c640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac005b30 msgr2=0x7f31ac0130b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:50:12.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:12.441+0000 7f31cd16d640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00ed50 msgr2=0x7f31ac00c4d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:50:12.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:12.441+0000 7f31cd16d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00ed50 0x7f31ac00c4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:50:12.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:12.441+0000 7f31cc96c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac005b30 0x7f31ac0130b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:50:12.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:12.845+0000 7f31cd16d640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00ed50 msgr2=0x7f31ac00c4d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:50:12.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:12.845+0000 7f31cc96c640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac005b30 msgr2=0x7f31ac0130b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:50:12.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:12.845+0000 7f31cc96c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac005b30 0x7f31ac0130b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:50:12.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:12.845+0000 7f31cd16d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00ed50 0x7f31ac00c4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:50:13.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:13.649+0000 7f31cd16d640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00ed50 msgr2=0x7f31ac00c4d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:50:13.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:13.649+0000 7f31cc96c640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac005b30 msgr2=0x7f31ac0130b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:50:13.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:13.649+0000 7f31cc96c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac005b30 0x7f31ac0130b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:50:13.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:13.649+0000 7f31cd16d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00ed50 0x7f31ac00c4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:50:15.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:15.237+0000 7f31beffd640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00ed50 msgr2=0x7f31ac00c4d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:50:15.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:15.237+0000 7f31beffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00ed50 0x7f31ac00c4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:50:15.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:15.237+0000 7f31beffd640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac005b30 msgr2=0x7f31ac0130b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:50:15.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:15.237+0000 7f31beffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac005b30 0x7f31ac0130b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:50:15.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:15.237+0000 7f31beffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00d7b0 0x7f31ac00db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:50:15.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:15.237+0000 7f31cd96e640 1 -- reap_dead start 2023-11-28T18:50:15.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:15.237+0000 7f31beffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac005b30 0x7f31ac0130b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:50:15.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:15.237+0000 7f31beffd640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c806e520 con 0x7f31ac0118d0 2023-11-28T18:50:15.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:15.237+0000 7f31beffd640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c806bf70 con 0x7f31ac005b30 2023-11-28T18:50:15.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:15.237+0000 7f31beffd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31ac008d60 con 0x7f31ac00d7b0 2023-11-28T18:50:15.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:15.237+0000 7f31cc96c640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac0118d0 legacy=0x7f31ac0090a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:50:15.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:15.237+0000 7f31cd16d640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00d7b0 msgr2=0x7f31ac00db90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:50:15.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:15.237+0000 7f31cd96e640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac005b30 msgr2=0x7f31ac0130b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:50:15.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:15.237+0000 7f31cd16d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00d7b0 0x7f31ac00db90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:50:15.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:15.237+0000 7f31cd96e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac005b30 0x7f31ac0130b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:50:15.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:15.441+0000 7f31cc96c640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac0118d0 legacy=0x7f31ac0090a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:50:15.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:15.441+0000 7f31cd16d640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00d7b0 msgr2=0x7f31ac00db90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:50:15.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:15.441+0000 7f31cd96e640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac005b30 msgr2=0x7f31ac0130b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:50:15.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:15.441+0000 7f31cd16d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00d7b0 0x7f31ac00db90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:50:15.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:15.441+0000 7f31cd96e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac005b30 0x7f31ac0130b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:50:15.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:15.845+0000 7f31cc96c640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac0118d0 legacy=0x7f31ac0090a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:50:15.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:15.845+0000 7f31cd16d640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00d7b0 msgr2=0x7f31ac00db90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:50:15.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:15.845+0000 7f31cd96e640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac005b30 msgr2=0x7f31ac0130b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:50:15.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:15.845+0000 7f31cd16d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00d7b0 0x7f31ac00db90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:50:15.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:15.845+0000 7f31cd96e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac005b30 0x7f31ac0130b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:50:16.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:16.649+0000 7f31cc96c640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac0118d0 legacy=0x7f31ac0090a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:50:16.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:16.649+0000 7f31cd96e640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac005b30 msgr2=0x7f31ac0130b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:50:16.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:16.649+0000 7f31cd16d640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00d7b0 msgr2=0x7f31ac00db90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:50:16.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:16.649+0000 7f31cd16d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00d7b0 0x7f31ac00db90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:50:16.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:16.649+0000 7f31cd96e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac005b30 0x7f31ac0130b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:50:18.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:18.237+0000 7f31beffd640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00d7b0 msgr2=0x7f31ac00db90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:50:18.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:18.237+0000 7f31beffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00d7b0 0x7f31ac00db90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:50:18.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:18.237+0000 7f31beffd640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac005b30 msgr2=0x7f31ac0130b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:50:18.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:18.237+0000 7f31beffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac005b30 0x7f31ac0130b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:50:18.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:18.237+0000 7f31beffd640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac0118d0 legacy=0x7f31ac0090a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:50:18.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:18.237+0000 7f31beffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00e5f0 0x7f31ac00cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:50:18.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:18.237+0000 7f31beffd640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c8155a70 con 0x7f31ac0137c0 2023-11-28T18:50:18.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:18.237+0000 7f31beffd640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c806bf70 con 0x7f31ac00e5f0 2023-11-28T18:50:18.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:18.237+0000 7f31cc96c640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00e5f0 msgr2=0x7f31ac00cbe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:50:18.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:18.237+0000 7f31cc96c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00e5f0 0x7f31ac00cbe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:50:18.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:18.237+0000 7f31cd16d640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac0137c0 legacy=0x7f31ac00c4d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:50:18.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:18.441+0000 7f31cc96c640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00e5f0 msgr2=0x7f31ac00cbe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:50:18.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:18.441+0000 7f31cc96c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00e5f0 0x7f31ac00cbe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:50:18.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:18.441+0000 7f31cd16d640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac0137c0 legacy=0x7f31ac00c4d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:50:18.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:18.845+0000 7f31cc96c640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00e5f0 msgr2=0x7f31ac00cbe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:50:18.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:18.845+0000 7f31cc96c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00e5f0 0x7f31ac00cbe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:50:18.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:18.845+0000 7f31cd16d640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac0137c0 legacy=0x7f31ac00c4d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:50:19.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:19.649+0000 7f31cc96c640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00e5f0 msgr2=0x7f31ac00cbe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:50:19.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:19.649+0000 7f31cc96c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00e5f0 0x7f31ac00cbe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:50:19.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:19.649+0000 7f31cd16d640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac0137c0 legacy=0x7f31ac00c4d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:50:21.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:21.237+0000 7f31beffd640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00e5f0 msgr2=0x7f31ac00cbe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:50:21.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:21.237+0000 7f31beffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00e5f0 0x7f31ac00cbe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:50:21.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:21.237+0000 7f31beffd640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac0137c0 legacy=0x7f31ac00c4d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:50:21.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:21.237+0000 7f31cd96e640 1 -- reap_dead start 2023-11-28T18:50:21.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:21.237+0000 7f31beffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00e5f0 0x7f31ac00cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:50:21.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:21.237+0000 7f31beffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac005b30 0x7f31ac0130b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:50:21.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:21.237+0000 7f31beffd640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c806e520 con 0x7f31ac0118d0 2023-11-28T18:50:21.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:21.237+0000 7f31beffd640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c806bf70 con 0x7f31ac00e5f0 2023-11-28T18:50:21.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:21.237+0000 7f31beffd640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31ac008d60 con 0x7f31ac005b30 2023-11-28T18:50:21.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:21.237+0000 7f31cc96c640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00e5f0 msgr2=0x7f31ac00cbe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:50:21.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:21.237+0000 7f31cd16d640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac0118d0 legacy=0x7f31ac0090a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:50:21.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:21.237+0000 7f31cc96c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00e5f0 0x7f31ac00cbe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:50:21.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:21.237+0000 7f31cd96e640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac005b30 msgr2=0x7f31ac0130b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:50:21.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:21.237+0000 7f31cd96e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac005b30 0x7f31ac0130b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:50:21.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:21.441+0000 7f31cd16d640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac0118d0 legacy=0x7f31ac0090a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:50:21.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:21.441+0000 7f31cc96c640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00e5f0 msgr2=0x7f31ac00cbe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:50:21.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:21.441+0000 7f31cc96c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00e5f0 0x7f31ac00cbe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:50:21.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:21.441+0000 7f31cd96e640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac005b30 msgr2=0x7f31ac0130b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:50:21.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:21.441+0000 7f31cd96e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac005b30 0x7f31ac0130b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:50:21.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:21.845+0000 7f31cc96c640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00e5f0 msgr2=0x7f31ac00cbe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:50:21.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:21.845+0000 7f31cd16d640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac0118d0 legacy=0x7f31ac0090a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:50:21.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:21.845+0000 7f31cc96c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00e5f0 0x7f31ac00cbe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:50:21.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:21.845+0000 7f31cd96e640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac005b30 msgr2=0x7f31ac0130b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:50:21.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:21.845+0000 7f31cd96e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac005b30 0x7f31ac0130b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:50:22.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:22.649+0000 7f31cd16d640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac0118d0 legacy=0x7f31ac0090a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:50:22.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:22.649+0000 7f31cc96c640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00e5f0 msgr2=0x7f31ac00cbe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:50:22.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:22.649+0000 7f31cc96c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00e5f0 0x7f31ac00cbe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:50:22.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:22.649+0000 7f31cd96e640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac005b30 msgr2=0x7f31ac0130b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:50:22.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:22.649+0000 7f31cd96e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac005b30 0x7f31ac0130b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:50:24.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:24.237+0000 7f31beffd640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac005b30 msgr2=0x7f31ac0130b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:50:24.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:24.237+0000 7f31beffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac005b30 0x7f31ac0130b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:50:24.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:24.237+0000 7f31beffd640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00e5f0 msgr2=0x7f31ac00cbe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:50:24.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:24.237+0000 7f31beffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00e5f0 0x7f31ac00cbe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:50:24.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:24.237+0000 7f31beffd640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac0118d0 legacy=0x7f31ac0090a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:50:24.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:24.237+0000 7f31beffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0137c0 0x7f31ac00c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:50:24.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:24.237+0000 7f31beffd640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c8155a70 con 0x7f31ac00b7c0 2023-11-28T18:50:24.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:24.237+0000 7f31beffd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31c806bf70 con 0x7f31ac0137c0 2023-11-28T18:50:24.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:24.237+0000 7f31cd16d640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0137c0 msgr2=0x7f31ac00c4d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:50:24.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:24.237+0000 7f31cc96c640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac00b7c0 legacy=0x7f31ac00d7b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:50:24.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:24.237+0000 7f31cd16d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0137c0 0x7f31ac00c4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:50:24.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:24.441+0000 7f31cd16d640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0137c0 msgr2=0x7f31ac00c4d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:50:24.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:24.441+0000 7f31cc96c640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac00b7c0 legacy=0x7f31ac00d7b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:50:24.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:24.441+0000 7f31cd16d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0137c0 0x7f31ac00c4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:50:24.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:24.845+0000 7f31cd16d640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0137c0 msgr2=0x7f31ac00c4d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:50:24.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:24.845+0000 7f31cd16d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0137c0 0x7f31ac00c4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:50:24.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:24.845+0000 7f31cc96c640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac00b7c0 legacy=0x7f31ac00d7b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:50:25.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:25.649+0000 7f31cc96c640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac00b7c0 legacy=0x7f31ac00d7b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:50:25.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:25.649+0000 7f31cd16d640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0137c0 msgr2=0x7f31ac00c4d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:50:25.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:25.649+0000 7f31cd16d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0137c0 0x7f31ac00c4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:50:25.665 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:50:25.670 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:50:27.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:27.237+0000 7f31beffd640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0137c0 msgr2=0x7f31ac00c4d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:50:27.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:27.237+0000 7f31beffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0137c0 0x7f31ac00c4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:50:27.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:27.237+0000 7f31beffd640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac00b7c0 legacy=0x7f31ac00d7b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:50:27.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:27.237+0000 7f31beffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00e5f0 0x7f31ac00ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:50:27.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:27.237+0000 7f31cd96e640 1 -- reap_dead start 2023-11-28T18:50:27.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:27.237+0000 7f31beffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0137c0 0x7f31ac00c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:50:27.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:27.237+0000 7f31beffd640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c806e520 con 0x7f31ac00b7c0 2023-11-28T18:50:27.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:27.237+0000 7f31beffd640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c806bf70 con 0x7f31ac00e5f0 2023-11-28T18:50:27.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:27.237+0000 7f31beffd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31ac008d60 con 0x7f31ac0137c0 2023-11-28T18:50:27.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:27.237+0000 7f31cd16d640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00e5f0 msgr2=0x7f31ac00ca10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:50:27.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:27.237+0000 7f31cd16d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00e5f0 0x7f31ac00ca10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:50:27.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:27.237+0000 7f31cd96e640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac00b7c0 legacy=0x7f31ac00d7b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:50:27.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:27.237+0000 7f31cc96c640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0137c0 msgr2=0x7f31ac00c4d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:50:27.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:27.237+0000 7f31cc96c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0137c0 0x7f31ac00c4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:50:27.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:27.441+0000 7f31cd16d640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00e5f0 msgr2=0x7f31ac00ca10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:50:27.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:27.441+0000 7f31cd16d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00e5f0 0x7f31ac00ca10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:50:27.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:27.441+0000 7f31cd96e640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac00b7c0 legacy=0x7f31ac00d7b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:50:27.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:27.441+0000 7f31cc96c640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0137c0 msgr2=0x7f31ac00c4d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:50:27.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:27.441+0000 7f31cc96c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0137c0 0x7f31ac00c4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:50:27.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:27.845+0000 7f31cd16d640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00e5f0 msgr2=0x7f31ac00ca10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:50:27.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:27.845+0000 7f31cd16d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00e5f0 0x7f31ac00ca10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:50:27.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:27.845+0000 7f31cd96e640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac00b7c0 legacy=0x7f31ac00d7b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:50:27.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:27.845+0000 7f31cc96c640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0137c0 msgr2=0x7f31ac00c4d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:50:27.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:27.845+0000 7f31cc96c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0137c0 0x7f31ac00c4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:50:28.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:28.648+0000 7f31cd16d640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00e5f0 msgr2=0x7f31ac00ca10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:50:28.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:28.648+0000 7f31cd16d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00e5f0 0x7f31ac00ca10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:50:28.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:28.648+0000 7f31cd96e640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac00b7c0 legacy=0x7f31ac00d7b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:50:28.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:28.648+0000 7f31cc96c640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0137c0 msgr2=0x7f31ac00c4d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:50:28.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:28.648+0000 7f31cc96c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0137c0 0x7f31ac00c4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:50:30.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:30.240+0000 7f31beffd640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0137c0 msgr2=0x7f31ac00c4d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:50:30.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:30.240+0000 7f31beffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0137c0 0x7f31ac00c4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:50:30.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:30.240+0000 7f31beffd640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00e5f0 msgr2=0x7f31ac00ca10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:50:30.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:30.240+0000 7f31beffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00e5f0 0x7f31ac00ca10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:50:30.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:30.240+0000 7f31beffd640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac00b7c0 legacy=0x7f31ac00d7b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:50:30.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:30.240+0000 7f31beffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0118d0 0x7f31ac013090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:50:30.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:30.240+0000 7f31beffd640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c8155a70 con 0x7f31ac00cf50 2023-11-28T18:50:30.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:30.240+0000 7f31beffd640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c806bf70 con 0x7f31ac0118d0 2023-11-28T18:50:30.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:30.240+0000 7f31cd16d640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac00cf50 legacy=0x7f31ac0090a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:50:30.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:30.240+0000 7f31cc96c640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0118d0 msgr2=0x7f31ac013090 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:50:30.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:30.240+0000 7f31cc96c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0118d0 0x7f31ac013090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:50:30.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:30.444+0000 7f31cd16d640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac00cf50 legacy=0x7f31ac0090a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:50:30.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:30.444+0000 7f31cc96c640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0118d0 msgr2=0x7f31ac013090 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:50:30.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:30.444+0000 7f31cc96c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0118d0 0x7f31ac013090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:50:30.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:30.848+0000 7f31cd16d640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac00cf50 legacy=0x7f31ac0090a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:50:30.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:30.848+0000 7f31cc96c640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0118d0 msgr2=0x7f31ac013090 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:50:30.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:30.848+0000 7f31cc96c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0118d0 0x7f31ac013090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:50:31.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:31.652+0000 7f31cd16d640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac00cf50 legacy=0x7f31ac0090a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:50:31.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:31.652+0000 7f31cc96c640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0118d0 msgr2=0x7f31ac013090 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:50:31.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:31.652+0000 7f31cc96c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0118d0 0x7f31ac013090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:50:33.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:33.240+0000 7f31beffd640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0118d0 msgr2=0x7f31ac013090 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:50:33.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:33.240+0000 7f31beffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0118d0 0x7f31ac013090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:50:33.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:33.240+0000 7f31beffd640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac00cf50 legacy=0x7f31ac0090a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:50:33.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:33.240+0000 7f31cd96e640 1 -- reap_dead start 2023-11-28T18:50:33.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:33.240+0000 7f31beffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0118d0 0x7f31ac013090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:50:33.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:33.240+0000 7f31beffd640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c806e520 con 0x7f31ac005b30 2023-11-28T18:50:33.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:33.240+0000 7f31beffd640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c8155a70 con 0x7f31ac00b7c0 2023-11-28T18:50:33.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:33.240+0000 7f31beffd640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c806bf70 con 0x7f31ac0118d0 2023-11-28T18:50:33.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:33.240+0000 7f31cd16d640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac005b30 legacy=0x7f31ac014d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:50:33.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:33.240+0000 7f31cd96e640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac00b7c0 legacy=0x7f31ac0090a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:50:33.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:33.240+0000 7f31cc96c640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0118d0 msgr2=0x7f31ac013090 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:50:33.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:33.240+0000 7f31cc96c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0118d0 0x7f31ac013090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:50:33.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:33.444+0000 7f31cd16d640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac005b30 legacy=0x7f31ac014d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:50:33.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:33.444+0000 7f31cd96e640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac00b7c0 legacy=0x7f31ac0090a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:50:33.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:33.444+0000 7f31cc96c640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0118d0 msgr2=0x7f31ac013090 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:50:33.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:33.444+0000 7f31cc96c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0118d0 0x7f31ac013090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:50:33.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:33.848+0000 7f31cd16d640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac005b30 legacy=0x7f31ac014d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:50:33.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:33.848+0000 7f31cd96e640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac00b7c0 legacy=0x7f31ac0090a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:50:33.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:33.848+0000 7f31cc96c640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0118d0 msgr2=0x7f31ac013090 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:50:33.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:33.848+0000 7f31cc96c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0118d0 0x7f31ac013090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:50:34.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:34.652+0000 7f31cd16d640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac005b30 legacy=0x7f31ac014d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:50:34.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:34.652+0000 7f31cd96e640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac00b7c0 legacy=0x7f31ac0090a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:50:34.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:34.652+0000 7f31cc96c640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0118d0 msgr2=0x7f31ac013090 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:50:34.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:34.652+0000 7f31cc96c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0118d0 0x7f31ac013090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:50:36.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:36.240+0000 7f31beffd640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0118d0 msgr2=0x7f31ac013090 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:50:36.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:36.240+0000 7f31beffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0118d0 0x7f31ac013090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:50:36.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:36.240+0000 7f31beffd640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac00b7c0 legacy=0x7f31ac0090a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:50:36.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:36.240+0000 7f31beffd640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac005b30 legacy=0x7f31ac014d50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:50:36.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:36.240+0000 7f31beffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00e5f0 0x7f31ac015460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:50:36.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:36.240+0000 7f31beffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac0137a0 0x7f31ac00d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:50:36.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:36.240+0000 7f31beffd640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c806bf70 con 0x7f31ac0137a0 2023-11-28T18:50:36.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:36.240+0000 7f31beffd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31ac008d60 con 0x7f31ac00e5f0 2023-11-28T18:50:36.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:36.240+0000 7f31cc96c640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac0137a0 msgr2=0x7f31ac00d790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:50:36.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:36.240+0000 7f31cc96c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac0137a0 0x7f31ac00d790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:50:36.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:36.240+0000 7f31cd16d640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00e5f0 msgr2=0x7f31ac015460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:50:36.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:36.240+0000 7f31cd16d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00e5f0 0x7f31ac015460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:50:36.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:36.444+0000 7f31cc96c640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac0137a0 msgr2=0x7f31ac00d790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:50:36.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:36.444+0000 7f31cc96c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac0137a0 0x7f31ac00d790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:50:36.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:36.444+0000 7f31cd16d640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00e5f0 msgr2=0x7f31ac015460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:50:36.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:36.444+0000 7f31cd16d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00e5f0 0x7f31ac015460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:50:36.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:36.848+0000 7f31cc96c640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac0137a0 msgr2=0x7f31ac00d790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:50:36.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:36.848+0000 7f31cc96c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac0137a0 0x7f31ac00d790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:50:36.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:36.848+0000 7f31cd16d640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00e5f0 msgr2=0x7f31ac015460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:50:36.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:36.848+0000 7f31cd16d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00e5f0 0x7f31ac015460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:50:37.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:37.652+0000 7f31cc96c640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac0137a0 msgr2=0x7f31ac00d790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:50:37.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:37.652+0000 7f31cc96c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac0137a0 0x7f31ac00d790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:50:37.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:37.652+0000 7f31cd16d640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00e5f0 msgr2=0x7f31ac015460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:50:37.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:37.652+0000 7f31cd16d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00e5f0 0x7f31ac015460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:50:39.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:39.240+0000 7f31beffd640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00e5f0 msgr2=0x7f31ac015460 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:50:39.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:39.240+0000 7f31beffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00e5f0 0x7f31ac015460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:50:39.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:39.240+0000 7f31beffd640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac0137a0 msgr2=0x7f31ac00d790 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:50:39.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:39.240+0000 7f31beffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac0137a0 0x7f31ac00d790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:50:39.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:39.240+0000 7f31beffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00dcd0 0x7f31ac00c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:50:39.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:39.240+0000 7f31cd96e640 1 -- reap_dead start 2023-11-28T18:50:39.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:39.240+0000 7f31beffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0118d0 0x7f31ac013090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:50:39.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:39.240+0000 7f31beffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00e5f0 0x7f31ac00d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:50:39.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:39.240+0000 7f31beffd640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c806bf70 con 0x7f31ac00dcd0 2023-11-28T18:50:39.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:39.240+0000 7f31beffd640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31ac008d60 con 0x7f31ac0118d0 2023-11-28T18:50:39.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:39.240+0000 7f31beffd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31ac00bbe0 con 0x7f31ac00e5f0 2023-11-28T18:50:39.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:39.240+0000 7f31cd16d640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00dcd0 msgr2=0x7f31ac00c4d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:50:39.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:39.240+0000 7f31cd16d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00dcd0 0x7f31ac00c4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:50:39.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:39.240+0000 7f31cc96c640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0118d0 msgr2=0x7f31ac013090 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:50:39.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:39.240+0000 7f31cd96e640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00e5f0 msgr2=0x7f31ac00d790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:50:39.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:39.240+0000 7f31cc96c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0118d0 0x7f31ac013090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:50:39.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:39.240+0000 7f31cd96e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00e5f0 0x7f31ac00d790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:50:39.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:39.444+0000 7f31cd16d640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00dcd0 msgr2=0x7f31ac00c4d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:50:39.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:39.444+0000 7f31cd16d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00dcd0 0x7f31ac00c4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:50:39.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:39.444+0000 7f31cc96c640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0118d0 msgr2=0x7f31ac013090 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:50:39.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:39.444+0000 7f31cd96e640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00e5f0 msgr2=0x7f31ac00d790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:50:39.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:39.444+0000 7f31cc96c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0118d0 0x7f31ac013090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:50:39.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:39.444+0000 7f31cd96e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00e5f0 0x7f31ac00d790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:50:39.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:39.848+0000 7f31cd16d640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00dcd0 msgr2=0x7f31ac00c4d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:50:39.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:39.848+0000 7f31cd16d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00dcd0 0x7f31ac00c4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:50:39.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:39.848+0000 7f31cc96c640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0118d0 msgr2=0x7f31ac013090 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:50:39.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:39.848+0000 7f31cd96e640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00e5f0 msgr2=0x7f31ac00d790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:50:39.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:39.848+0000 7f31cc96c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0118d0 0x7f31ac013090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:50:39.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:39.848+0000 7f31cd96e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00e5f0 0x7f31ac00d790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:50:40.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:40.652+0000 7f31cd16d640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00dcd0 msgr2=0x7f31ac00c4d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:50:40.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:40.652+0000 7f31cd16d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00dcd0 0x7f31ac00c4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:50:40.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:40.652+0000 7f31cd96e640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00e5f0 msgr2=0x7f31ac00d790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:50:40.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:40.652+0000 7f31cc96c640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0118d0 msgr2=0x7f31ac013090 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:50:40.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:40.652+0000 7f31cc96c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0118d0 0x7f31ac013090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:50:40.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:40.652+0000 7f31cd96e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00e5f0 0x7f31ac00d790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:50:42.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:42.240+0000 7f31beffd640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00e5f0 msgr2=0x7f31ac00d790 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:50:42.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:42.240+0000 7f31beffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00e5f0 0x7f31ac00d790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:50:42.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:42.240+0000 7f31beffd640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0118d0 msgr2=0x7f31ac013090 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:50:42.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:42.240+0000 7f31beffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0118d0 0x7f31ac013090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:50:42.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:42.240+0000 7f31beffd640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00dcd0 msgr2=0x7f31ac00c4d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:50:42.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:42.240+0000 7f31beffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac00dcd0 0x7f31ac00c4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:50:42.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:42.240+0000 7f31beffd640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c806d980 con 0x7f31ac00ca10 2023-11-28T18:50:42.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:42.240+0000 7f31beffd640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c806e520 con 0x7f31ac0126b0 2023-11-28T18:50:42.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:42.240+0000 7f31cd16d640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac00ca10 legacy=0x7f31ac011fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:50:42.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:42.240+0000 7f31cc96c640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac0126b0 legacy=0x7f31ac00b0b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:50:42.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:42.444+0000 7f31cd16d640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac00ca10 legacy=0x7f31ac011fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:50:42.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:42.444+0000 7f31cc96c640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac0126b0 legacy=0x7f31ac00b0b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:50:42.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:42.848+0000 7f31cd16d640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac00ca10 legacy=0x7f31ac011fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:50:42.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:42.848+0000 7f31cc96c640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac0126b0 legacy=0x7f31ac00b0b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:50:43.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:43.652+0000 7f31cd16d640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac00ca10 legacy=0x7f31ac011fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:50:43.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:43.652+0000 7f31cc96c640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac0126b0 legacy=0x7f31ac00b0b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:50:45.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:45.240+0000 7f31beffd640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac0126b0 legacy=0x7f31ac00b0b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:50:45.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:45.240+0000 7f31beffd640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac00ca10 legacy=0x7f31ac011fa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:50:45.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:45.240+0000 7f31beffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00e5f0 0x7f31ac00d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:50:45.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:45.240+0000 7f31beffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0118d0 0x7f31ac013090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:50:45.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:45.240+0000 7f31cd96e640 1 -- reap_dead start 2023-11-28T18:50:45.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:45.240+0000 7f31beffd640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c8155a70 con 0x7f31ac00dcd0 2023-11-28T18:50:45.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:45.240+0000 7f31beffd640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c806bf70 con 0x7f31ac0118d0 2023-11-28T18:50:45.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:45.240+0000 7f31beffd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31ac008d60 con 0x7f31ac00e5f0 2023-11-28T18:50:45.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:45.240+0000 7f31cd96e640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac00dcd0 legacy=0x7f31ac011fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:50:45.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:45.240+0000 7f31cd16d640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00e5f0 msgr2=0x7f31ac00d790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:50:45.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:45.240+0000 7f31cc96c640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0118d0 msgr2=0x7f31ac013090 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:50:45.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:45.240+0000 7f31cd16d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00e5f0 0x7f31ac00d790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:50:45.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:45.240+0000 7f31cc96c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0118d0 0x7f31ac013090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:50:45.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:45.444+0000 7f31cd96e640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac00dcd0 legacy=0x7f31ac011fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:50:45.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:45.444+0000 7f31cc96c640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0118d0 msgr2=0x7f31ac013090 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:50:45.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:45.444+0000 7f31cd16d640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00e5f0 msgr2=0x7f31ac00d790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:50:45.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:45.444+0000 7f31cd16d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00e5f0 0x7f31ac00d790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:50:45.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:45.444+0000 7f31cc96c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0118d0 0x7f31ac013090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:50:45.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:45.848+0000 7f31cd96e640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac00dcd0 legacy=0x7f31ac011fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:50:45.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:45.848+0000 7f31cd16d640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00e5f0 msgr2=0x7f31ac00d790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:50:45.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:45.848+0000 7f31cc96c640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0118d0 msgr2=0x7f31ac013090 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:50:45.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:45.848+0000 7f31cd16d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00e5f0 0x7f31ac00d790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:50:45.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:45.848+0000 7f31cc96c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0118d0 0x7f31ac013090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:50:46.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:46.652+0000 7f31cd96e640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac00dcd0 legacy=0x7f31ac011fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:50:46.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:46.652+0000 7f31cd16d640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00e5f0 msgr2=0x7f31ac00d790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:50:46.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:46.652+0000 7f31cc96c640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0118d0 msgr2=0x7f31ac013090 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:50:46.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:46.652+0000 7f31cd16d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00e5f0 0x7f31ac00d790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:50:46.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:46.652+0000 7f31cc96c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0118d0 0x7f31ac013090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:50:48.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:48.240+0000 7f31beffd640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00e5f0 msgr2=0x7f31ac00d790 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:50:48.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:48.240+0000 7f31beffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00e5f0 0x7f31ac00d790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:50:48.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:48.240+0000 7f31beffd640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0118d0 msgr2=0x7f31ac013090 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:50:48.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:48.240+0000 7f31beffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0118d0 0x7f31ac013090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:50:48.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:48.240+0000 7f31beffd640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac00dcd0 legacy=0x7f31ac011fa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:50:48.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:48.240+0000 7f31beffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac005b30 0x7f31ac00c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:50:48.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:48.240+0000 7f31beffd640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c806d980 con 0x7f31ac012a90 2023-11-28T18:50:48.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:48.240+0000 7f31beffd640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c806bf70 con 0x7f31ac005b30 2023-11-28T18:50:48.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:48.240+0000 7f31cc96c640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac005b30 msgr2=0x7f31ac00c4d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:50:48.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:48.240+0000 7f31cc96c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac005b30 0x7f31ac00c4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:50:48.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:48.240+0000 7f31cd16d640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac012a90 legacy=0x7f31ac014d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:50:48.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:48.444+0000 7f31cc96c640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac005b30 msgr2=0x7f31ac00c4d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:50:48.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:48.444+0000 7f31cc96c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac005b30 0x7f31ac00c4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:50:48.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:48.444+0000 7f31cd16d640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac012a90 legacy=0x7f31ac014d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:50:48.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:48.848+0000 7f31cc96c640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac005b30 msgr2=0x7f31ac00c4d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:50:48.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:48.848+0000 7f31cc96c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac005b30 0x7f31ac00c4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:50:48.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:48.848+0000 7f31cd16d640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac012a90 legacy=0x7f31ac014d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:50:49.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:49.652+0000 7f31cc96c640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac005b30 msgr2=0x7f31ac00c4d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:50:49.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:49.652+0000 7f31cc96c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac005b30 0x7f31ac00c4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:50:49.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:49.652+0000 7f31cd16d640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac012a90 legacy=0x7f31ac014d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:50:51.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:51.240+0000 7f31beffd640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac005b30 msgr2=0x7f31ac00c4d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:50:51.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:51.240+0000 7f31beffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac005b30 0x7f31ac00c4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:50:51.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:51.240+0000 7f31beffd640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac012a90 legacy=0x7f31ac014d50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:50:51.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:51.240+0000 7f31cd96e640 1 -- reap_dead start 2023-11-28T18:50:51.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:51.240+0000 7f31beffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac015460 0x7f31ac00a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:50:51.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:51.240+0000 7f31beffd640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c8155a70 con 0x7f31ac00dcd0 2023-11-28T18:50:51.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:51.240+0000 7f31beffd640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c806d980 con 0x7f31ac012a90 2023-11-28T18:50:51.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:51.240+0000 7f31beffd640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c806bf70 con 0x7f31ac015460 2023-11-28T18:50:51.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:51.240+0000 7f31cd16d640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac015460 msgr2=0x7f31ac00a0b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:50:51.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:51.240+0000 7f31cc96c640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac00dcd0 legacy=0x7f31ac011fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:50:51.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:51.240+0000 7f31cd16d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac015460 0x7f31ac00a0b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:50:51.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:51.240+0000 7f31cd96e640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac012a90 legacy=0x7f31ac014d30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:50:51.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:51.444+0000 7f31cd16d640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac015460 msgr2=0x7f31ac00a0b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:50:51.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:51.444+0000 7f31cc96c640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac00dcd0 legacy=0x7f31ac011fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:50:51.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:51.444+0000 7f31cd16d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac015460 0x7f31ac00a0b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:50:51.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:51.444+0000 7f31cd96e640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac012a90 legacy=0x7f31ac014d30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:50:51.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:51.848+0000 7f31cc96c640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac00dcd0 legacy=0x7f31ac011fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:50:51.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:51.848+0000 7f31cd16d640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac015460 msgr2=0x7f31ac00a0b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:50:51.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:51.848+0000 7f31cd16d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac015460 0x7f31ac00a0b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:50:51.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:51.848+0000 7f31cd96e640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac012a90 legacy=0x7f31ac014d30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:50:52.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:52.652+0000 7f31cd16d640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac015460 msgr2=0x7f31ac00a0b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:50:52.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:52.652+0000 7f31cc96c640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac00dcd0 legacy=0x7f31ac011fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:50:52.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:52.652+0000 7f31cd16d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac015460 0x7f31ac00a0b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:50:52.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:52.652+0000 7f31cd96e640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac012a90 legacy=0x7f31ac014d30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:50:54.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:54.244+0000 7f31beffd640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac015460 msgr2=0x7f31ac00a0b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:50:54.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:54.244+0000 7f31beffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac015460 0x7f31ac00a0b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:50:54.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:54.244+0000 7f31beffd640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac012a90 legacy=0x7f31ac014d30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:50:54.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:54.244+0000 7f31beffd640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac00dcd0 legacy=0x7f31ac011fa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:50:54.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:54.244+0000 7f31beffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac00e5f0 0x7f31ac00d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:50:54.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:54.244+0000 7f31beffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0118b0 0x7f31ac00c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:50:54.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:54.244+0000 7f31beffd640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c806bf70 con 0x7f31ac00e5f0 2023-11-28T18:50:54.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:54.244+0000 7f31beffd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31ac008d60 con 0x7f31ac0118b0 2023-11-28T18:50:54.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:54.244+0000 7f31cd16d640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac00e5f0 msgr2=0x7f31ac00d790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:50:54.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:54.244+0000 7f31cc96c640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0118b0 msgr2=0x7f31ac00c4d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:50:54.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:54.244+0000 7f31cc96c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0118b0 0x7f31ac00c4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:50:54.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:54.244+0000 7f31cd16d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac00e5f0 0x7f31ac00d790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:50:54.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:54.448+0000 7f31cc96c640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0118b0 msgr2=0x7f31ac00c4d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:50:54.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:54.448+0000 7f31cd16d640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac00e5f0 msgr2=0x7f31ac00d790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:50:54.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:54.448+0000 7f31cd16d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac00e5f0 0x7f31ac00d790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:50:54.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:54.448+0000 7f31cc96c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0118b0 0x7f31ac00c4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:50:54.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:54.852+0000 7f31cc96c640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0118b0 msgr2=0x7f31ac00c4d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:50:54.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:54.852+0000 7f31cd16d640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac00e5f0 msgr2=0x7f31ac00d790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:50:54.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:54.852+0000 7f31cd16d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac00e5f0 0x7f31ac00d790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:50:54.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:54.852+0000 7f31cc96c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0118b0 0x7f31ac00c4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:50:55.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:55.656+0000 7f31cd16d640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac00e5f0 msgr2=0x7f31ac00d790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:50:55.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:55.656+0000 7f31cc96c640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0118b0 msgr2=0x7f31ac00c4d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:50:55.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:55.656+0000 7f31cd16d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac00e5f0 0x7f31ac00d790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:50:55.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:55.656+0000 7f31cc96c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0118b0 0x7f31ac00c4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:50:55.729 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:50:55.733 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:50:57.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:57.244+0000 7f31beffd640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0118b0 msgr2=0x7f31ac00c4d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:50:57.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:57.244+0000 7f31beffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0118b0 0x7f31ac00c4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:50:57.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:57.244+0000 7f31beffd640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac00e5f0 msgr2=0x7f31ac00d790 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:50:57.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:57.244+0000 7f31beffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac00e5f0 0x7f31ac00d790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:50:57.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:57.244+0000 7f31cd96e640 1 -- reap_dead start 2023-11-28T18:50:57.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:57.244+0000 7f31beffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac015460 0x7f31ac015840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:50:57.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:57.244+0000 7f31beffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0118b0 0x7f31ac00c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:50:57.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:57.244+0000 7f31beffd640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c806e520 con 0x7f31ac00dcd0 2023-11-28T18:50:57.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:57.244+0000 7f31beffd640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c806bf70 con 0x7f31ac015460 2023-11-28T18:50:57.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:57.244+0000 7f31beffd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31ac008d60 con 0x7f31ac0118b0 2023-11-28T18:50:57.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:57.244+0000 7f31cd16d640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac015460 msgr2=0x7f31ac015840 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:50:57.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:57.244+0000 7f31cd96e640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac00dcd0 legacy=0x7f31ac011fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:50:57.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:57.244+0000 7f31cd16d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac015460 0x7f31ac015840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:50:57.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:57.244+0000 7f31cc96c640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0118b0 msgr2=0x7f31ac00c4d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:50:57.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:57.244+0000 7f31cc96c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0118b0 0x7f31ac00c4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:50:57.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:57.448+0000 7f31cd96e640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac00dcd0 legacy=0x7f31ac011fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:50:57.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:57.448+0000 7f31cd16d640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac015460 msgr2=0x7f31ac015840 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:50:57.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:57.448+0000 7f31cd16d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac015460 0x7f31ac015840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:50:57.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:57.448+0000 7f31cc96c640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0118b0 msgr2=0x7f31ac00c4d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:50:57.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:57.448+0000 7f31cc96c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0118b0 0x7f31ac00c4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:50:57.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:57.852+0000 7f31cd96e640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac00dcd0 legacy=0x7f31ac011fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:50:57.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:57.852+0000 7f31cd16d640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac015460 msgr2=0x7f31ac015840 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:50:57.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:57.852+0000 7f31cd16d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac015460 0x7f31ac015840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:50:57.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:57.852+0000 7f31cc96c640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0118b0 msgr2=0x7f31ac00c4d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:50:57.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:57.852+0000 7f31cc96c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0118b0 0x7f31ac00c4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:50:58.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:58.656+0000 7f31cd96e640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac00dcd0 legacy=0x7f31ac011fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:50:58.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:58.656+0000 7f31cd16d640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac015460 msgr2=0x7f31ac015840 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:50:58.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:58.656+0000 7f31cd16d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac015460 0x7f31ac015840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:50:58.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:58.656+0000 7f31cc96c640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0118b0 msgr2=0x7f31ac00c4d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:50:58.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:50:58.656+0000 7f31cc96c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0118b0 0x7f31ac00c4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:51:00.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:00.244+0000 7f31beffd640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0118b0 msgr2=0x7f31ac00c4d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:51:00.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:00.244+0000 7f31beffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac0118b0 0x7f31ac00c4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:51:00.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:00.244+0000 7f31beffd640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac015460 msgr2=0x7f31ac015840 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:51:00.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:00.244+0000 7f31beffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac015460 0x7f31ac015840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:51:00.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:00.244+0000 7f31beffd640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac00dcd0 legacy=0x7f31ac011fa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:51:00.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:00.244+0000 7f31beffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac00e5d0 0x7f31ac00d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:51:00.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:00.244+0000 7f31beffd640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c8155a70 con 0x7f31ac012a90 2023-11-28T18:51:00.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:00.244+0000 7f31beffd640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c806bf70 con 0x7f31ac00e5d0 2023-11-28T18:51:00.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:00.244+0000 7f31cd16d640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac012a90 legacy=0x7f31ac014d30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:51:00.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:00.244+0000 7f31cc96c640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac00e5d0 msgr2=0x7f31ac00d790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:51:00.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:00.244+0000 7f31cc96c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac00e5d0 0x7f31ac00d790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:51:00.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:00.448+0000 7f31cd16d640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac012a90 legacy=0x7f31ac014d30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:51:00.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:00.448+0000 7f31cc96c640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac00e5d0 msgr2=0x7f31ac00d790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:51:00.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:00.448+0000 7f31cc96c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac00e5d0 0x7f31ac00d790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:51:00.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:00.852+0000 7f31cd16d640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac012a90 legacy=0x7f31ac014d30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:51:00.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:00.852+0000 7f31cc96c640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac00e5d0 msgr2=0x7f31ac00d790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:51:00.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:00.852+0000 7f31cc96c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac00e5d0 0x7f31ac00d790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:51:01.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:01.656+0000 7f31cc96c640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac00e5d0 msgr2=0x7f31ac00d790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:51:01.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:01.656+0000 7f31cd16d640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac012a90 legacy=0x7f31ac014d30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:51:01.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:01.656+0000 7f31cc96c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac00e5d0 0x7f31ac00d790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:51:03.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:03.244+0000 7f31beffd640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac00e5d0 msgr2=0x7f31ac00d790 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:51:03.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:03.244+0000 7f31beffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac00e5d0 0x7f31ac00d790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:51:03.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:03.244+0000 7f31beffd640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac012a90 legacy=0x7f31ac014d30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:51:03.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:03.244+0000 7f31beffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac015460 0x7f31ac015840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:51:03.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:03.244+0000 7f31beffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac013090 0x7f31ac00b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:51:03.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:03.244+0000 7f31cd96e640 1 -- reap_dead start 2023-11-28T18:51:03.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:03.244+0000 7f31beffd640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c806e520 con 0x7f31ac0118b0 2023-11-28T18:51:03.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:03.244+0000 7f31beffd640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c806bf70 con 0x7f31ac015460 2023-11-28T18:51:03.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:03.244+0000 7f31beffd640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31ac008d60 con 0x7f31ac013090 2023-11-28T18:51:03.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:03.244+0000 7f31cd16d640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac015460 msgr2=0x7f31ac015840 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:51:03.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:03.244+0000 7f31cd16d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac015460 0x7f31ac015840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:51:03.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:03.244+0000 7f31cd96e640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac0118b0 legacy=0x7f31ac011fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:51:03.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:03.244+0000 7f31cc96c640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac013090 msgr2=0x7f31ac00b070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:51:03.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:03.244+0000 7f31cc96c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac013090 0x7f31ac00b070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:51:03.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:03.448+0000 7f31cd96e640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac0118b0 legacy=0x7f31ac011fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:51:03.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:03.448+0000 7f31cd16d640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac015460 msgr2=0x7f31ac015840 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:51:03.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:03.448+0000 7f31cd16d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac015460 0x7f31ac015840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:51:03.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:03.448+0000 7f31cc96c640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac013090 msgr2=0x7f31ac00b070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:51:03.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:03.448+0000 7f31cc96c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac013090 0x7f31ac00b070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:51:03.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:03.852+0000 7f31cd96e640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac0118b0 legacy=0x7f31ac011fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:51:03.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:03.852+0000 7f31cd16d640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac015460 msgr2=0x7f31ac015840 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:51:03.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:03.852+0000 7f31cd16d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac015460 0x7f31ac015840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:51:03.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:03.852+0000 7f31cc96c640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac013090 msgr2=0x7f31ac00b070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:51:03.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:03.852+0000 7f31cc96c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac013090 0x7f31ac00b070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:51:04.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:04.656+0000 7f31cd96e640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac0118b0 legacy=0x7f31ac011fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:51:04.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:04.656+0000 7f31cd16d640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac015460 msgr2=0x7f31ac015840 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:51:04.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:04.656+0000 7f31cd16d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac015460 0x7f31ac015840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:51:04.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:04.656+0000 7f31cc96c640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac013090 msgr2=0x7f31ac00b070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:51:04.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:04.656+0000 7f31cc96c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac013090 0x7f31ac00b070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:51:06.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:06.240+0000 7f31beffd640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac013090 msgr2=0x7f31ac00b070 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:51:06.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:06.240+0000 7f31beffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac013090 0x7f31ac00b070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:51:06.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:06.240+0000 7f31beffd640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac015460 msgr2=0x7f31ac015840 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:51:06.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:06.240+0000 7f31beffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac015460 0x7f31ac015840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:51:06.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:06.240+0000 7f31beffd640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac0118b0 legacy=0x7f31ac011fa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:51:06.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:06.240+0000 7f31beffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00b5b0 0x7f31ac00d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:51:06.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:06.240+0000 7f31beffd640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c8155a70 con 0x7f31ac00c4d0 2023-11-28T18:51:06.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:06.240+0000 7f31beffd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31c806bf70 con 0x7f31ac00b5b0 2023-11-28T18:51:06.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:06.240+0000 7f31cd16d640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac00c4d0 legacy=0x7f31ac014d30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:51:06.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:06.240+0000 7f31cc96c640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00b5b0 msgr2=0x7f31ac00d790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:51:06.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:06.240+0000 7f31cc96c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00b5b0 0x7f31ac00d790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:51:06.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:06.444+0000 7f31cd16d640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac00c4d0 legacy=0x7f31ac014d30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:51:06.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:06.444+0000 7f31cc96c640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00b5b0 msgr2=0x7f31ac00d790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:51:06.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:06.444+0000 7f31cc96c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00b5b0 0x7f31ac00d790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:51:06.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:06.848+0000 7f31cc96c640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00b5b0 msgr2=0x7f31ac00d790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:51:06.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:06.848+0000 7f31cd16d640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac00c4d0 legacy=0x7f31ac014d30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:51:06.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:06.848+0000 7f31cc96c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00b5b0 0x7f31ac00d790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:51:07.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:07.652+0000 7f31cd16d640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac00c4d0 legacy=0x7f31ac014d30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:51:07.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:07.652+0000 7f31cc96c640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00b5b0 msgr2=0x7f31ac00d790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:51:07.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:07.652+0000 7f31cc96c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00b5b0 0x7f31ac00d790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:51:09.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:09.244+0000 7f31beffd640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00b5b0 msgr2=0x7f31ac00d790 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:51:09.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:09.244+0000 7f31beffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00b5b0 0x7f31ac00d790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:51:09.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:09.244+0000 7f31beffd640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac00c4d0 legacy=0x7f31ac014d30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:51:09.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:09.244+0000 7f31cd96e640 1 -- reap_dead start 2023-11-28T18:51:09.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:09.244+0000 7f31beffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac013090 0x7f31ac00b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:51:09.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:09.244+0000 7f31beffd640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c806e520 con 0x7f31ac0118b0 2023-11-28T18:51:09.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:09.244+0000 7f31beffd640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c8155a70 con 0x7f31ac00dcd0 2023-11-28T18:51:09.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:09.244+0000 7f31beffd640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c806bf70 con 0x7f31ac013090 2023-11-28T18:51:09.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:09.244+0000 7f31cd16d640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac0118b0 legacy=0x7f31ac011fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:51:09.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:09.244+0000 7f31cc96c640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac00dcd0 legacy=0x7f31ac0076c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:51:09.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:09.244+0000 7f31cd96e640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac013090 msgr2=0x7f31ac00b070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:51:09.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:09.244+0000 7f31cd96e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac013090 0x7f31ac00b070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:51:09.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:09.448+0000 7f31cd16d640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac0118b0 legacy=0x7f31ac011fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:51:09.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:09.448+0000 7f31cc96c640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac00dcd0 legacy=0x7f31ac0076c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:51:09.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:09.448+0000 7f31cd96e640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac013090 msgr2=0x7f31ac00b070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:51:09.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:09.448+0000 7f31cd96e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac013090 0x7f31ac00b070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:51:09.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:09.852+0000 7f31cd16d640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac0118b0 legacy=0x7f31ac011fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:51:09.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:09.852+0000 7f31cc96c640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac00dcd0 legacy=0x7f31ac0076c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:51:09.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:09.852+0000 7f31cd96e640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac013090 msgr2=0x7f31ac00b070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:51:09.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:09.852+0000 7f31cd96e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac013090 0x7f31ac00b070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:51:10.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:10.656+0000 7f31cd16d640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac0118b0 legacy=0x7f31ac011fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:51:10.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:10.656+0000 7f31cc96c640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac00dcd0 legacy=0x7f31ac0076c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:51:10.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:10.656+0000 7f31cd96e640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac013090 msgr2=0x7f31ac00b070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:51:10.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:10.656+0000 7f31cd96e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac013090 0x7f31ac00b070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:51:12.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:12.244+0000 7f31beffd640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac013090 msgr2=0x7f31ac00b070 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:51:12.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:12.244+0000 7f31beffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac013090 0x7f31ac00b070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:51:12.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:12.244+0000 7f31beffd640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac00dcd0 legacy=0x7f31ac0076c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:51:12.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:12.244+0000 7f31beffd640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac0118b0 legacy=0x7f31ac011fa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:51:12.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:12.244+0000 7f31beffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00b5b0 0x7f31ac00d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:51:12.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:12.244+0000 7f31beffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac014d30 0x7f31ac007dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:51:12.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:12.244+0000 7f31beffd640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c806bf70 con 0x7f31ac014d30 2023-11-28T18:51:12.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:12.244+0000 7f31beffd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31ac008d60 con 0x7f31ac00b5b0 2023-11-28T18:51:12.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:12.244+0000 7f31cc96c640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac014d30 msgr2=0x7f31ac007dd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:51:12.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:12.244+0000 7f31cc96c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac014d30 0x7f31ac007dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:51:12.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:12.244+0000 7f31cd16d640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00b5b0 msgr2=0x7f31ac00d790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:51:12.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:12.244+0000 7f31cd16d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00b5b0 0x7f31ac00d790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:51:12.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:12.448+0000 7f31cc96c640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac014d30 msgr2=0x7f31ac007dd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:51:12.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:12.448+0000 7f31cc96c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac014d30 0x7f31ac007dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:51:12.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:12.448+0000 7f31cd16d640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00b5b0 msgr2=0x7f31ac00d790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:51:12.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:12.448+0000 7f31cd16d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00b5b0 0x7f31ac00d790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:51:12.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:12.852+0000 7f31cc96c640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac014d30 msgr2=0x7f31ac007dd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:51:12.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:12.852+0000 7f31cc96c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac014d30 0x7f31ac007dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:51:12.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:12.852+0000 7f31cd16d640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00b5b0 msgr2=0x7f31ac00d790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:51:12.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:12.852+0000 7f31cd16d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00b5b0 0x7f31ac00d790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:51:13.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:13.656+0000 7f31cc96c640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac014d30 msgr2=0x7f31ac007dd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:51:18.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:13.656+0000 7f31cc96c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac014d30 0x7f31ac007dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:51:18.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:13.656+0000 7f31cd16d640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00b5b0 msgr2=0x7f31ac00d790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:51:18.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:13.656+0000 7f31cd16d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00b5b0 0x7f31ac00d790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:51:18.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:15.244+0000 7f31beffd640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00b5b0 msgr2=0x7f31ac00d790 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:51:18.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:15.244+0000 7f31beffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00b5b0 0x7f31ac00d790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:51:18.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:15.244+0000 7f31beffd640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac014d30 msgr2=0x7f31ac007dd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:51:18.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:15.244+0000 7f31beffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac014d30 0x7f31ac007dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:51:18.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:15.244+0000 7f31beffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac013090 0x7f31ac00b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:51:18.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:15.244+0000 7f31cd96e640 1 -- reap_dead start 2023-11-28T18:51:18.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:15.244+0000 7f31beffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac015460 0x7f31ac006690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:51:18.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:15.244+0000 7f31beffd640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c806d980 con 0x7f31ac00dcd0 2023-11-28T18:51:18.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:15.244+0000 7f31beffd640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c806bf70 con 0x7f31ac013090 2023-11-28T18:51:18.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:15.244+0000 7f31beffd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31ac008d60 con 0x7f31ac015460 2023-11-28T18:51:18.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:15.244+0000 7f31cd96e640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac00dcd0 legacy=0x7f31ac006bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:51:18.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:15.244+0000 7f31cc96c640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac015460 msgr2=0x7f31ac006690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:51:18.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:15.244+0000 7f31cd16d640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac013090 msgr2=0x7f31ac00b070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:51:18.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:15.244+0000 7f31cc96c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac015460 0x7f31ac006690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:51:18.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:15.244+0000 7f31cd16d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac013090 0x7f31ac00b070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:51:18.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:15.448+0000 7f31cd96e640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac00dcd0 legacy=0x7f31ac006bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:51:18.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:15.448+0000 7f31cc96c640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac015460 msgr2=0x7f31ac006690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:51:18.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:15.448+0000 7f31cd16d640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac013090 msgr2=0x7f31ac00b070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:51:18.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:15.448+0000 7f31cd16d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac013090 0x7f31ac00b070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:51:18.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:15.448+0000 7f31cc96c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac015460 0x7f31ac006690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:51:18.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:15.852+0000 7f31cd96e640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac00dcd0 legacy=0x7f31ac006bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:51:18.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:15.852+0000 7f31cc96c640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac015460 msgr2=0x7f31ac006690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:51:18.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:15.852+0000 7f31cd16d640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac013090 msgr2=0x7f31ac00b070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:51:18.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:15.852+0000 7f31cc96c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac015460 0x7f31ac006690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:51:18.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:15.852+0000 7f31cd16d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac013090 0x7f31ac00b070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:51:18.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:16.656+0000 7f31cd96e640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac00dcd0 legacy=0x7f31ac006bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:51:18.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:16.656+0000 7f31cc96c640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac015460 msgr2=0x7f31ac006690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:51:18.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:16.656+0000 7f31cd16d640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac013090 msgr2=0x7f31ac00b070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:51:18.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:16.656+0000 7f31cd16d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac013090 0x7f31ac00b070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:51:18.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:16.656+0000 7f31cc96c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac015460 0x7f31ac006690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:51:18.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:18.244+0000 7f31beffd640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac015460 msgr2=0x7f31ac006690 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:51:18.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:18.244+0000 7f31beffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac015460 0x7f31ac006690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:51:18.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:18.244+0000 7f31beffd640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac013090 msgr2=0x7f31ac00b070 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:51:18.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:18.244+0000 7f31beffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac013090 0x7f31ac00b070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:51:18.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:18.244+0000 7f31beffd640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac00dcd0 legacy=0x7f31ac006bd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:51:18.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:18.244+0000 7f31beffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac0118b0 0x7f31ac00d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:51:18.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:18.244+0000 7f31beffd640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c806e520 con 0x7f31ac0158a0 2023-11-28T18:51:18.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:18.244+0000 7f31beffd640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c806bf70 con 0x7f31ac0118b0 2023-11-28T18:51:18.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:18.244+0000 7f31cc96c640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac0158a0 legacy=0x7f31ac011fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:51:18.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:18.244+0000 7f31cd16d640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac0118b0 msgr2=0x7f31ac00d790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:51:18.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:18.244+0000 7f31cd16d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac0118b0 0x7f31ac00d790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:51:18.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:18.448+0000 7f31cd16d640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac0118b0 msgr2=0x7f31ac00d790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:51:18.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:18.448+0000 7f31cc96c640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac0158a0 legacy=0x7f31ac011fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:51:18.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:18.448+0000 7f31cd16d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac0118b0 0x7f31ac00d790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:51:18.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:18.852+0000 7f31cc96c640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac0158a0 legacy=0x7f31ac011fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:51:18.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:18.852+0000 7f31cd16d640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac0118b0 msgr2=0x7f31ac00d790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:51:18.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:18.852+0000 7f31cd16d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac0118b0 0x7f31ac00d790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:51:19.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:19.656+0000 7f31cd16d640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac0118b0 msgr2=0x7f31ac00d790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:51:19.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:19.656+0000 7f31cc96c640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac0158a0 legacy=0x7f31ac011fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:51:19.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:19.656+0000 7f31cd16d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac0118b0 0x7f31ac00d790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:51:21.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:21.243+0000 7f31beffd640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac0118b0 msgr2=0x7f31ac00d790 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:51:21.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:21.243+0000 7f31beffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac0118b0 0x7f31ac00d790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:51:21.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:21.243+0000 7f31beffd640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac0158a0 legacy=0x7f31ac011fa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:51:21.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:21.243+0000 7f31beffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac015460 0x7f31ac006690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:51:21.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:21.243+0000 7f31cd96e640 1 -- reap_dead start 2023-11-28T18:51:21.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:21.243+0000 7f31beffd640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c806d980 con 0x7f31ac0158a0 2023-11-28T18:51:21.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:21.243+0000 7f31beffd640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c806e520 con 0x7f31ac00dcd0 2023-11-28T18:51:21.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:21.243+0000 7f31beffd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31c806bf70 con 0x7f31ac015460 2023-11-28T18:51:21.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:21.243+0000 7f31cd96e640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac0158a0 legacy=0x7f31ac011fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:51:21.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:21.243+0000 7f31cc96c640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac00dcd0 legacy=0x7f31ac006bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:51:21.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:21.243+0000 7f31cd16d640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac015460 msgr2=0x7f31ac006690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:51:21.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:21.243+0000 7f31cd16d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac015460 0x7f31ac006690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:51:21.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:21.447+0000 7f31cd96e640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac0158a0 legacy=0x7f31ac011fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:51:21.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:21.447+0000 7f31cd16d640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac015460 msgr2=0x7f31ac006690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:51:21.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:21.447+0000 7f31cc96c640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac00dcd0 legacy=0x7f31ac006bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:51:21.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:21.447+0000 7f31cd16d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac015460 0x7f31ac006690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:51:21.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:21.851+0000 7f31cd96e640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac0158a0 legacy=0x7f31ac011fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:51:21.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:21.851+0000 7f31cd16d640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac015460 msgr2=0x7f31ac006690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:51:21.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:21.851+0000 7f31cc96c640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac00dcd0 legacy=0x7f31ac006bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:51:21.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:21.851+0000 7f31cd16d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac015460 0x7f31ac006690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:51:22.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:22.655+0000 7f31cd96e640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac0158a0 legacy=0x7f31ac011fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:51:22.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:22.655+0000 7f31cc96c640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac00dcd0 legacy=0x7f31ac006bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:51:22.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:22.655+0000 7f31cd16d640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac015460 msgr2=0x7f31ac006690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:51:22.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:22.655+0000 7f31cd16d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac015460 0x7f31ac006690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:51:24.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:24.243+0000 7f31beffd640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac015460 msgr2=0x7f31ac006690 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:51:24.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:24.243+0000 7f31beffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac015460 0x7f31ac006690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:51:24.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:24.243+0000 7f31beffd640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac00dcd0 legacy=0x7f31ac006bd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:51:24.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:24.243+0000 7f31beffd640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac0158a0 legacy=0x7f31ac011fa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:51:24.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:24.243+0000 7f31beffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac013090 0x7f31ac00b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:51:24.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:24.243+0000 7f31beffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0082f0 0x7f31ac00d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:51:24.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:24.243+0000 7f31beffd640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c806bf70 con 0x7f31ac013090 2023-11-28T18:51:24.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:24.243+0000 7f31beffd640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31ac008d60 con 0x7f31ac0082f0 2023-11-28T18:51:24.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:24.243+0000 7f31cd16d640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac013090 msgr2=0x7f31ac00b070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:51:24.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:24.243+0000 7f31cd16d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac013090 0x7f31ac00b070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:51:24.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:24.243+0000 7f31cc96c640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0082f0 msgr2=0x7f31ac00d790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:51:24.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:24.243+0000 7f31cc96c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0082f0 0x7f31ac00d790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:51:24.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:24.447+0000 7f31cd16d640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac013090 msgr2=0x7f31ac00b070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:51:24.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:24.447+0000 7f31cd16d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac013090 0x7f31ac00b070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:51:24.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:24.447+0000 7f31cc96c640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0082f0 msgr2=0x7f31ac00d790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:51:24.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:24.447+0000 7f31cc96c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0082f0 0x7f31ac00d790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:51:24.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:24.851+0000 7f31cd16d640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac013090 msgr2=0x7f31ac00b070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:51:24.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:24.851+0000 7f31cd16d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac013090 0x7f31ac00b070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:51:24.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:24.851+0000 7f31cc96c640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0082f0 msgr2=0x7f31ac00d790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:51:24.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:24.851+0000 7f31cc96c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0082f0 0x7f31ac00d790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:51:25.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:25.655+0000 7f31cd16d640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac013090 msgr2=0x7f31ac00b070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:51:25.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:25.655+0000 7f31cd16d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac013090 0x7f31ac00b070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:51:25.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:25.655+0000 7f31cc96c640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0082f0 msgr2=0x7f31ac00d790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:51:25.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:25.655+0000 7f31cc96c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0082f0 0x7f31ac00d790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:51:26.091 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:51:26.095 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:51:27.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:27.247+0000 7f31beffd640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0082f0 msgr2=0x7f31ac00d790 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:51:27.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:27.247+0000 7f31beffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac0082f0 0x7f31ac00d790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:51:27.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:27.247+0000 7f31beffd640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac013090 msgr2=0x7f31ac00b070 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:51:27.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:27.247+0000 7f31beffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac013090 0x7f31ac00b070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:51:27.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:27.247+0000 7f31beffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac014d30 0x7f31ac0201f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:51:27.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:27.247+0000 7f31cd96e640 1 -- reap_dead start 2023-11-28T18:51:27.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:27.247+0000 7f31beffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac015460 0x7f31ac00d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:51:27.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:27.247+0000 7f31beffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac013090 0x7f31ac006690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:51:27.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:27.247+0000 7f31beffd640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c806bf70 con 0x7f31ac013090 2023-11-28T18:51:27.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:27.247+0000 7f31beffd640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31ac008d60 con 0x7f31ac014d30 2023-11-28T18:51:27.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:27.247+0000 7f31beffd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31ac00bbe0 con 0x7f31ac015460 2023-11-28T18:51:27.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:27.247+0000 7f31cd96e640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac013090 msgr2=0x7f31ac006690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:51:27.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:27.247+0000 7f31cd96e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac013090 0x7f31ac006690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:51:27.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:27.247+0000 7f31cd16d640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac014d30 msgr2=0x7f31ac0201f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:51:27.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:27.247+0000 7f31cc96c640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac015460 msgr2=0x7f31ac00d790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:51:27.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:27.247+0000 7f31cd16d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac014d30 0x7f31ac0201f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:51:27.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:27.247+0000 7f31cc96c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac015460 0x7f31ac00d790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:51:27.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:27.451+0000 7f31cd96e640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac013090 msgr2=0x7f31ac006690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:51:27.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:27.451+0000 7f31cd96e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac013090 0x7f31ac006690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:51:27.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:27.451+0000 7f31cd16d640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac014d30 msgr2=0x7f31ac0201f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:51:27.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:27.451+0000 7f31cc96c640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac015460 msgr2=0x7f31ac00d790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:51:27.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:27.451+0000 7f31cd16d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac014d30 0x7f31ac0201f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:51:27.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:27.451+0000 7f31cc96c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac015460 0x7f31ac00d790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:51:27.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:27.855+0000 7f31cd96e640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac013090 msgr2=0x7f31ac006690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:51:27.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:27.855+0000 7f31cd96e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac013090 0x7f31ac006690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:51:27.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:27.855+0000 7f31cc96c640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac015460 msgr2=0x7f31ac00d790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:51:27.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:27.855+0000 7f31cd16d640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac014d30 msgr2=0x7f31ac0201f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:51:27.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:27.855+0000 7f31cc96c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac015460 0x7f31ac00d790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:51:27.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:27.855+0000 7f31cd16d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac014d30 0x7f31ac0201f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:51:28.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:28.659+0000 7f31cd96e640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac013090 msgr2=0x7f31ac006690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:51:28.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:28.659+0000 7f31cd96e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac013090 0x7f31ac006690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:51:28.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:28.659+0000 7f31cc96c640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac015460 msgr2=0x7f31ac00d790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:51:28.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:28.659+0000 7f31cd16d640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac014d30 msgr2=0x7f31ac0201f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:51:28.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:28.659+0000 7f31cc96c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac015460 0x7f31ac00d790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:51:28.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:28.659+0000 7f31cd16d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac014d30 0x7f31ac0201f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:51:30.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:30.243+0000 7f31beffd640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac015460 msgr2=0x7f31ac00d790 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:51:30.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:30.243+0000 7f31beffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac015460 0x7f31ac00d790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:51:30.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:30.243+0000 7f31beffd640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac014d30 msgr2=0x7f31ac0201f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:51:30.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:30.243+0000 7f31beffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac014d30 0x7f31ac0201f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:51:30.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:30.243+0000 7f31beffd640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac013090 msgr2=0x7f31ac006690 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:51:30.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:30.243+0000 7f31beffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac013090 0x7f31ac006690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:51:30.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:30.243+0000 7f31beffd640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c8155a70 con 0x7f31ac00dcd0 2023-11-28T18:51:30.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:30.243+0000 7f31beffd640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c806d980 con 0x7f31ac015860 2023-11-28T18:51:30.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:30.243+0000 7f31cd16d640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac00dcd0 legacy=0x7f31ac011fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:51:30.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:30.243+0000 7f31cc96c640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac015860 legacy=0x7f31ac006bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:51:30.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:30.447+0000 7f31cd16d640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac00dcd0 legacy=0x7f31ac011fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:51:30.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:30.447+0000 7f31cc96c640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac015860 legacy=0x7f31ac006bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:51:30.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:30.851+0000 7f31cd16d640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac00dcd0 legacy=0x7f31ac011fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:51:30.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:30.851+0000 7f31cc96c640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac015860 legacy=0x7f31ac006bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:51:31.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:31.655+0000 7f31cd16d640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac00dcd0 legacy=0x7f31ac011fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:51:31.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:31.655+0000 7f31cc96c640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac015860 legacy=0x7f31ac006bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:51:33.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:33.247+0000 7f31beffd640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac015860 legacy=0x7f31ac006bd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:51:33.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:33.247+0000 7f31beffd640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac00dcd0 legacy=0x7f31ac011fa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:51:33.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:33.247+0000 7f31beffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac013090 0x7f31ac006690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:51:33.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:33.247+0000 7f31cd96e640 1 -- reap_dead start 2023-11-28T18:51:33.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:33.247+0000 7f31beffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac014d30 0x7f31ac0201f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:51:33.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:33.247+0000 7f31beffd640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c806e520 con 0x7f31ac0118b0 2023-11-28T18:51:33.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:33.247+0000 7f31beffd640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c806bf70 con 0x7f31ac013090 2023-11-28T18:51:33.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:33.247+0000 7f31beffd640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31ac008d60 con 0x7f31ac014d30 2023-11-28T18:51:33.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:33.247+0000 7f31cc96c640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac013090 msgr2=0x7f31ac006690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:51:33.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:33.247+0000 7f31cc96c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac013090 0x7f31ac006690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:51:33.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:33.247+0000 7f31cd16d640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac0118b0 legacy=0x7f31ac020730 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:51:33.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:33.247+0000 7f31cd96e640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac014d30 msgr2=0x7f31ac0201f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:51:33.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:33.247+0000 7f31cd96e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac014d30 0x7f31ac0201f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:51:33.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:33.451+0000 7f31cc96c640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac013090 msgr2=0x7f31ac006690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:51:33.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:33.451+0000 7f31cc96c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac013090 0x7f31ac006690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:51:33.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:33.451+0000 7f31cd96e640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac014d30 msgr2=0x7f31ac0201f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:51:33.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:33.451+0000 7f31cd16d640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac0118b0 legacy=0x7f31ac020730 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:51:33.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:33.451+0000 7f31cd96e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac014d30 0x7f31ac0201f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:51:33.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:33.855+0000 7f31cc96c640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac013090 msgr2=0x7f31ac006690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:51:33.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:33.855+0000 7f31cc96c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac013090 0x7f31ac006690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:51:33.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:33.855+0000 7f31cd96e640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac014d30 msgr2=0x7f31ac0201f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:51:33.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:33.855+0000 7f31cd16d640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac0118b0 legacy=0x7f31ac020730 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:51:33.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:33.855+0000 7f31cd96e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac014d30 0x7f31ac0201f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:51:34.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:34.659+0000 7f31cc96c640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac013090 msgr2=0x7f31ac006690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:51:34.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:34.659+0000 7f31cc96c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac013090 0x7f31ac006690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:51:34.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:34.659+0000 7f31cd16d640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac0118b0 legacy=0x7f31ac020730 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:51:34.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:34.659+0000 7f31cd96e640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac014d30 msgr2=0x7f31ac0201f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:51:34.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:34.659+0000 7f31cd96e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac014d30 0x7f31ac0201f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:51:36.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:36.247+0000 7f31beffd640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7f31ac014d30 msgr2=0x7f31ac0201f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:51:36.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:36.247+0000 7f31beffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f31ac014d30 0x7f31ac0201f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:51:36.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:36.247+0000 7f31beffd640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7f31ac013090 msgr2=0x7f31ac006690 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:51:36.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:36.247+0000 7f31beffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ac013090 0x7f31ac006690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:51:36.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:36.247+0000 7f31beffd640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7f31ac0118b0 legacy=0x7f31ac020730 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:51:36.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:36.247+0000 7f31beffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00d790 0x7f31ac0152c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:51:36.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:36.247+0000 7f31beffd640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c8155a70 con 0x7f31ac00b070 2023-11-28T18:51:36.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:36.247+0000 7f31beffd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31c806bf70 con 0x7f31ac00d790 2023-11-28T18:51:36.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:36.247+0000 7f31cd16d640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac00b070 legacy=0x7f31ac011fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:51:36.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:36.247+0000 7f31cc96c640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00d790 msgr2=0x7f31ac0152c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:51:36.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:36.247+0000 7f31cc96c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00d790 0x7f31ac0152c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:51:36.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:36.451+0000 7f31cd16d640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac00b070 legacy=0x7f31ac011fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:51:36.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:36.451+0000 7f31cc96c640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00d790 msgr2=0x7f31ac0152c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:51:36.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:36.451+0000 7f31cc96c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00d790 0x7f31ac0152c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:51:36.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:36.855+0000 7f31cd16d640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac00b070 legacy=0x7f31ac011fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:51:36.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:36.855+0000 7f31cc96c640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00d790 msgr2=0x7f31ac0152c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:51:36.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:36.855+0000 7f31cc96c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00d790 0x7f31ac0152c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:51:37.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:37.659+0000 7f31cd16d640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7f31ac00b070 legacy=0x7f31ac011fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:51:37.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:37.659+0000 7f31cc96c640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00d790 msgr2=0x7f31ac0152c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:51:37.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:37.659+0000 7f31cc96c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31ac00d790 0x7f31ac0152c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:51:39.117 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-11-28T18:51:39.119 INFO:tasks.cephfs_test_runner:That after forcibly modifying the backing store, we can get back into ... ERROR 2023-11-28T18:51:39.120 INFO:tasks.cephfs_test_runner:ERROR 2023-11-28T18:51:39.121 INFO:tasks.cephfs_test_runner: 2023-11-28T18:51:39.121 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-28T18:51:39.121 INFO:tasks.cephfs_test_runner:ERROR: test_reset (tasks.cephfs.test_journal_repair.TestJournalRepair) 2023-11-28T18:51:39.121 INFO:tasks.cephfs_test_runner:That after forcibly modifying the backing store, we can get back into 2023-11-28T18:51:39.121 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-28T18:51:39.121 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-28T18:51:39.121 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/cephfs/test_journal_repair.py", line 177, in test_reset 2023-11-28T18:51:39.121 INFO:tasks.cephfs_test_runner: self.mount_a.create_n_files("bravo/file", 1000) 2023-11-28T18:51:39.122 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/cephfs/mount.py", line 1367, in create_n_files 2023-11-28T18:51:39.122 INFO:tasks.cephfs_test_runner: self.run_python(pyscript) 2023-11-28T18:51:39.122 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/cephfs/mount.py", line 775, in run_python 2023-11-28T18:51:39.122 INFO:tasks.cephfs_test_runner: p.wait() 2023-11-28T18:51:39.122 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 161, in wait 2023-11-28T18:51:39.122 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-11-28T18:51:39.122 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-11-28T18:51:39.122 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-11-28T18:51:39.122 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi045 with status 1: 'stdin-killer -- python3 -c \'\nimport os\nimport uuid\n\nn = 1000\ncreate_hard_links = False\nif 0 > 0:\n create_hard_links = True\npath = "/home/ubuntu/cephtest/mnt.0/bravo/file"\n\ndpath = os.path.dirname(path)\nfnameprefix = os.path.basename(path)\nos.makedirs(dpath, exist_ok=True)\n\ntry:\n dirfd = os.open(dpath, os.O_DIRECTORY)\n\n for i in range(n):\n fpath = os.path.join(dpath, f"{fnameprefix}_{i}")\n with open(fpath, \'"\'"\'w\'"\'"\') as f:\n f.write(f"{i}")\n if False:\n f.flush()\n os.fsync(f.fileno())\n if False:\n os.unlink(fpath)\n if False:\n os.fsync(dirfd)\n if create_hard_links:\n for j in range(0):\n os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") \n if False:\n os.fsync(dirfd)\nfinally:\n os.close(dirfd)\n\'' 2023-11-28T18:51:39.122 INFO:tasks.cephfs_test_runner: 2023-11-28T18:51:39.122 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-28T18:51:39.122 INFO:tasks.cephfs_test_runner:ERROR: test_reset (tasks.cephfs.test_journal_repair.TestJournalRepair) 2023-11-28T18:51:39.122 INFO:tasks.cephfs_test_runner:That after forcibly modifying the backing store, we can get back into 2023-11-28T18:51:39.122 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-28T18:51:39.123 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-28T18:51:39.123 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/cephfs/cephfs_test_case.py", line 208, in tearDown 2023-11-28T18:51:39.123 INFO:tasks.cephfs_test_runner: self.mds_cluster.delete_all_filesystems() 2023-11-28T18:51:39.123 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/cephfs/filesystem.py", line 494, in delete_all_filesystems 2023-11-28T18:51:39.123 INFO:tasks.cephfs_test_runner: Filesystem(ctx=self._ctx, fscid=fs['id']).destroy() 2023-11-28T18:51:39.123 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/cephfs/filesystem.py", line 840, in destroy 2023-11-28T18:51:39.123 INFO:tasks.cephfs_test_runner: data_pools = self.get_data_pool_names(refresh=True) 2023-11-28T18:51:39.123 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/cephfs/filesystem.py", line 970, in get_data_pool_names 2023-11-28T18:51:39.123 INFO:tasks.cephfs_test_runner: self.get_pool_names(refresh = True) 2023-11-28T18:51:39.123 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/cephfs/filesystem.py", line 939, in get_pool_names 2023-11-28T18:51:39.123 INFO:tasks.cephfs_test_runner: status = self.status() 2023-11-28T18:51:39.123 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/cephfs/filesystem.py", line 396, in status 2023-11-28T18:51:39.123 INFO:tasks.cephfs_test_runner: return FSStatus(self.mon_manager, epoch) 2023-11-28T18:51:39.123 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/cephfs/filesystem.py", line 88, in __init__ 2023-11-28T18:51:39.123 INFO:tasks.cephfs_test_runner: self.map = json.loads(self.get_ceph_cmd_stdout(*cmd)) 2023-11-28T18:51:39.124 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2023-11-28T18:51:39.124 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2023-11-28T18:51:39.124 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2023-11-28T18:51:39.124 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2023-11-28T18:51:39.124 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd 2023-11-28T18:51:39.124 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2023-11-28T18:51:39.124 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/remote.py", line 523, in run 2023-11-28T18:51:39.124 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-11-28T18:51:39.124 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 455, in run 2023-11-28T18:51:39.124 INFO:tasks.cephfs_test_runner: r.wait() 2023-11-28T18:51:39.124 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 161, in wait 2023-11-28T18:51:39.124 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-11-28T18:51:39.124 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-11-28T18:51:39.124 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-11-28T18:51:39.124 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi045 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json' 2023-11-28T18:51:39.125 INFO:tasks.cephfs_test_runner: 2023-11-28T18:51:39.125 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-28T18:51:39.125 INFO:tasks.cephfs_test_runner:Ran 3 tests in 815.944s 2023-11-28T18:51:39.125 INFO:tasks.cephfs_test_runner: 2023-11-28T18:51:39.125 INFO:tasks.cephfs_test_runner:FAILED (errors=2) 2023-11-28T18:51:39.125 INFO:tasks.cephfs_test_runner: 2023-11-28T18:51:39.125 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-28T18:51:39.125 INFO:tasks.cephfs_test_runner:ERROR: test_reset (tasks.cephfs.test_journal_repair.TestJournalRepair) 2023-11-28T18:51:39.125 INFO:tasks.cephfs_test_runner:That after forcibly modifying the backing store, we can get back into 2023-11-28T18:51:39.125 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-28T18:51:39.125 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-28T18:51:39.125 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/cephfs/test_journal_repair.py", line 177, in test_reset 2023-11-28T18:51:39.126 INFO:tasks.cephfs_test_runner: self.mount_a.create_n_files("bravo/file", 1000) 2023-11-28T18:51:39.126 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/cephfs/mount.py", line 1367, in create_n_files 2023-11-28T18:51:39.126 INFO:tasks.cephfs_test_runner: self.run_python(pyscript) 2023-11-28T18:51:39.126 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/cephfs/mount.py", line 775, in run_python 2023-11-28T18:51:39.126 INFO:tasks.cephfs_test_runner: p.wait() 2023-11-28T18:51:39.126 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 161, in wait 2023-11-28T18:51:39.126 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-11-28T18:51:39.126 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-11-28T18:51:39.126 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-11-28T18:51:39.126 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi045 with status 1: 'stdin-killer -- python3 -c \'\nimport os\nimport uuid\n\nn = 1000\ncreate_hard_links = False\nif 0 > 0:\n create_hard_links = True\npath = "/home/ubuntu/cephtest/mnt.0/bravo/file"\n\ndpath = os.path.dirname(path)\nfnameprefix = os.path.basename(path)\nos.makedirs(dpath, exist_ok=True)\n\ntry:\n dirfd = os.open(dpath, os.O_DIRECTORY)\n\n for i in range(n):\n fpath = os.path.join(dpath, f"{fnameprefix}_{i}")\n with open(fpath, \'"\'"\'w\'"\'"\') as f:\n f.write(f"{i}")\n if False:\n f.flush()\n os.fsync(f.fileno())\n if False:\n os.unlink(fpath)\n if False:\n os.fsync(dirfd)\n if create_hard_links:\n for j in range(0):\n os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") \n if False:\n os.fsync(dirfd)\nfinally:\n os.close(dirfd)\n\'' 2023-11-28T18:51:39.126 INFO:tasks.cephfs_test_runner: 2023-11-28T18:51:39.126 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-28T18:51:39.126 INFO:tasks.cephfs_test_runner:ERROR: test_reset (tasks.cephfs.test_journal_repair.TestJournalRepair) 2023-11-28T18:51:39.126 INFO:tasks.cephfs_test_runner:That after forcibly modifying the backing store, we can get back into 2023-11-28T18:51:39.127 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-28T18:51:39.127 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-28T18:51:39.127 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/cephfs/cephfs_test_case.py", line 208, in tearDown 2023-11-28T18:51:39.127 INFO:tasks.cephfs_test_runner: self.mds_cluster.delete_all_filesystems() 2023-11-28T18:51:39.127 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/cephfs/filesystem.py", line 494, in delete_all_filesystems 2023-11-28T18:51:39.127 INFO:tasks.cephfs_test_runner: Filesystem(ctx=self._ctx, fscid=fs['id']).destroy() 2023-11-28T18:51:39.127 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/cephfs/filesystem.py", line 840, in destroy 2023-11-28T18:51:39.127 INFO:tasks.cephfs_test_runner: data_pools = self.get_data_pool_names(refresh=True) 2023-11-28T18:51:39.127 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/cephfs/filesystem.py", line 970, in get_data_pool_names 2023-11-28T18:51:39.127 INFO:tasks.cephfs_test_runner: self.get_pool_names(refresh = True) 2023-11-28T18:51:39.127 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/cephfs/filesystem.py", line 939, in get_pool_names 2023-11-28T18:51:39.127 INFO:tasks.cephfs_test_runner: status = self.status() 2023-11-28T18:51:39.128 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/cephfs/filesystem.py", line 396, in status 2023-11-28T18:51:39.128 INFO:tasks.cephfs_test_runner: return FSStatus(self.mon_manager, epoch) 2023-11-28T18:51:39.129 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/cephfs/filesystem.py", line 88, in __init__ 2023-11-28T18:51:39.129 INFO:tasks.cephfs_test_runner: self.map = json.loads(self.get_ceph_cmd_stdout(*cmd)) 2023-11-28T18:51:39.129 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2023-11-28T18:51:39.129 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2023-11-28T18:51:39.129 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2023-11-28T18:51:39.129 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2023-11-28T18:51:39.129 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd 2023-11-28T18:51:39.129 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2023-11-28T18:51:39.129 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/remote.py", line 523, in run 2023-11-28T18:51:39.129 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-11-28T18:51:39.129 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 455, in run 2023-11-28T18:51:39.129 INFO:tasks.cephfs_test_runner: r.wait() 2023-11-28T18:51:39.129 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 161, in wait 2023-11-28T18:51:39.130 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-11-28T18:51:39.130 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-11-28T18:51:39.130 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-11-28T18:51:39.130 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi045 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json' 2023-11-28T18:51:39.130 INFO:tasks.cephfs_test_runner: 2023-11-28T18:51:39.130 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_reset (tasks.cephfs.test_journal_repair.TestJournalRepair), test_reset (tasks.cephfs.test_journal_repair.TestJournalRepair) 2023-11-28T18:51:39.210 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=37686a0a69f34edabc34082d7f380747 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_reset (tasks.cephfs.test_journal_repair.TestJournalRepair), test_reset (tasks.cephfs.test_journal_repair.TestJournalRepair) 2023-11-28T18:51:39.212 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-11-28T18:51:39.222 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-11-28T18:51:39.416 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-11-28T18:51:39.417 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T18:51:39.417 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T18:51:39.441 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357768k,nr_inodes=4089442,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9360 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276000k,nr_inodes=819000,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-28T18:51:39.441 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T18:51:39.442 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T18:51:39.493 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357768k,nr_inodes=4089442,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9360 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276000k,nr_inodes=819000,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-28T18:51:39.494 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-28T18:51:39.494 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T18:51:39.504 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354684k,nr_inodes=4088671,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9377 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-28T18:51:39.505 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-11-28T18:51:39.505 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T18:51:39.555 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354684k,nr_inodes=4088671,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9377 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-28T18:51:39.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:51:39.556 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-11-28T18:51:39.567 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-28T18:51:39.567 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-28T18:51:39.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:51:39.567 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T18:51:39.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:51:39.635 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T18:51:39.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:51:39.712 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link delete ceph-brx 2023-11-28T18:51:39.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:51:39.912 DEBUG:teuthology.orchestra.run.smithi190:> ip netns list 2023-11-28T18:51:39.922 INFO:teuthology.orchestra.run.smithi190.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-28T18:51:39.922 INFO:teuthology.orchestra.run.smithi190.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-11-28T18:51:39.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:51:39.923 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-28T18:51:39.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:51:39.990 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-28T18:51:40.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T18:51:40.072 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip link delete ceph-brx 2023-11-28T18:51:40.246 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-11-28T18:51:40.255 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-28T18:51:40.255 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T18:51:40.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:40.407+0000 7fd4934aa640 1 Processor -- start 2023-11-28T18:51:40.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:40.407+0000 7fd4934aa640 1 -- start start 2023-11-28T18:51:40.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:40.407+0000 7fd4934aa640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd48c15d4d0 0x7fd48c0b62d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:51:40.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:40.407+0000 7fd4934aa640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd48c0d1500 0x7fd48c0d1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:51:40.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:40.407+0000 7fd4934aa640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd48c0d2230 con 0x7fd48c0b5220 2023-11-28T18:51:40.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:40.407+0000 7fd4934aa640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd48c0d3120 con 0x7fd48c15d4d0 2023-11-28T18:51:40.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:40.407+0000 7fd4934aa640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd48c0d2780 con 0x7fd48c0d1500 2023-11-28T18:51:40.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:40.407+0000 7fd490a45640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd48c15d4d0 msgr2=0x7fd48c0b62d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:51:40.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:40.407+0000 7fd491246640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd48c0b5220 legacy=0x7fd48c0b5600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:51:40.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:40.407+0000 7fd490a45640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd48c15d4d0 0x7fd48c0b62d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:51:40.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:40.407+0000 7fd491a47640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd48c0d1500 msgr2=0x7fd48c0d1990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:51:40.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:40.407+0000 7fd491a47640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd48c0d1500 0x7fd48c0d1990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:51:40.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:40.611+0000 7fd490a45640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd48c15d4d0 msgr2=0x7fd48c0b62d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:51:40.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:40.611+0000 7fd490a45640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd48c15d4d0 0x7fd48c0b62d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:51:40.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:40.611+0000 7fd491a47640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd48c0d1500 msgr2=0x7fd48c0d1990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:51:40.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:40.611+0000 7fd491246640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd48c0b5220 legacy=0x7fd48c0b5600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:51:40.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:40.611+0000 7fd491a47640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd48c0d1500 0x7fd48c0d1990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:51:41.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:41.015+0000 7fd490a45640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd48c15d4d0 msgr2=0x7fd48c0b62d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:51:41.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:41.015+0000 7fd490a45640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd48c15d4d0 0x7fd48c0b62d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:51:41.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:41.015+0000 7fd491246640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd48c0b5220 legacy=0x7fd48c0b5600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:51:41.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:41.015+0000 7fd491a47640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd48c0d1500 msgr2=0x7fd48c0d1990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:51:41.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:41.015+0000 7fd491a47640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd48c0d1500 0x7fd48c0d1990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:51:41.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:41.819+0000 7fd490a45640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd48c15d4d0 msgr2=0x7fd48c0b62d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:51:41.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:41.819+0000 7fd490a45640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd48c15d4d0 0x7fd48c0b62d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:51:41.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:41.819+0000 7fd491246640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd48c0b5220 legacy=0x7fd48c0b5600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:51:41.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:41.819+0000 7fd491a47640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd48c0d1500 msgr2=0x7fd48c0d1990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:51:41.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:41.819+0000 7fd491a47640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd48c0d1500 0x7fd48c0d1990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:51:43.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:43.411+0000 7fd482ffd640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd48c0d1500 msgr2=0x7fd48c0d1990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:51:43.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:43.411+0000 7fd482ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd48c0d1500 0x7fd48c0d1990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:51:43.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:43.411+0000 7fd482ffd640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd48c15d4d0 msgr2=0x7fd48c0b62d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:51:43.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:43.411+0000 7fd482ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd48c15d4d0 0x7fd48c0b62d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:51:43.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:43.411+0000 7fd482ffd640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd48c0b5220 legacy=0x7fd48c0b5600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:51:43.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:43.411+0000 7fd482ffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd4700036d0 0x7fd470005b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:51:43.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:43.411+0000 7fd482ffd640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd48c0d2a60 con 0x7fd4700061a0 2023-11-28T18:51:43.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:43.411+0000 7fd482ffd640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd48c0d3120 con 0x7fd4700036d0 2023-11-28T18:51:43.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:43.411+0000 7fd490a45640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd4700061a0 legacy=0x7fd470008660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:51:43.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:43.411+0000 7fd491246640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd4700036d0 msgr2=0x7fd470005b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:51:43.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:43.411+0000 7fd491246640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd4700036d0 0x7fd470005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:51:43.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:43.615+0000 7fd490a45640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd4700061a0 legacy=0x7fd470008660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:51:43.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:43.615+0000 7fd491246640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd4700036d0 msgr2=0x7fd470005b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:51:43.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:43.615+0000 7fd491246640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd4700036d0 0x7fd470005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:51:44.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:44.019+0000 7fd490a45640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd4700061a0 legacy=0x7fd470008660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:51:44.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:44.019+0000 7fd491246640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd4700036d0 msgr2=0x7fd470005b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:51:44.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:44.019+0000 7fd491246640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd4700036d0 0x7fd470005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:51:44.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:44.823+0000 7fd490a45640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd4700061a0 legacy=0x7fd470008660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:51:44.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:44.823+0000 7fd491246640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd4700036d0 msgr2=0x7fd470005b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:51:44.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:44.823+0000 7fd491246640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd4700036d0 0x7fd470005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:51:46.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:46.407+0000 7fd482ffd640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd4700036d0 msgr2=0x7fd470005b50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:51:46.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:46.407+0000 7fd482ffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd4700036d0 0x7fd470005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:51:46.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:46.407+0000 7fd482ffd640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd4700061a0 legacy=0x7fd470008660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:51:46.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:46.407+0000 7fd491a47640 1 -- reap_dead start 2023-11-28T18:51:46.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:46.407+0000 7fd482ffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd4700036d0 0x7fd470005af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:51:46.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:46.407+0000 7fd482ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd48c15d4d0 0x7fd47000a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:51:46.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:46.407+0000 7fd482ffd640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd48c0d2230 con 0x7fd48c0b5220 2023-11-28T18:51:46.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:46.407+0000 7fd482ffd640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd48c0d3120 con 0x7fd48c15d4d0 2023-11-28T18:51:46.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:46.407+0000 7fd482ffd640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd48c0d2780 con 0x7fd4700036d0 2023-11-28T18:51:46.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:46.407+0000 7fd491a47640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd48c15d4d0 msgr2=0x7fd47000a690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:51:46.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:46.407+0000 7fd491a47640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd48c15d4d0 0x7fd47000a690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:51:46.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:46.407+0000 7fd490a45640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd4700036d0 msgr2=0x7fd470005af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:51:46.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:46.407+0000 7fd491246640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd48c0b5220 legacy=0x7fd470009f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:51:46.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:46.407+0000 7fd490a45640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd4700036d0 0x7fd470005af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:51:46.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:46.611+0000 7fd491a47640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd48c15d4d0 msgr2=0x7fd47000a690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:51:46.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:46.611+0000 7fd491a47640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd48c15d4d0 0x7fd47000a690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:51:46.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:46.611+0000 7fd491246640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd48c0b5220 legacy=0x7fd470009f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:51:46.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:46.611+0000 7fd490a45640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd4700036d0 msgr2=0x7fd470005af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:51:46.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:46.611+0000 7fd490a45640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd4700036d0 0x7fd470005af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:51:47.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:47.015+0000 7fd491a47640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd48c15d4d0 msgr2=0x7fd47000a690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:51:47.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:47.015+0000 7fd491a47640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd48c15d4d0 0x7fd47000a690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:51:47.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:47.015+0000 7fd491246640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd48c0b5220 legacy=0x7fd470009f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:51:47.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:47.015+0000 7fd490a45640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd4700036d0 msgr2=0x7fd470005af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:51:47.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:47.015+0000 7fd490a45640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd4700036d0 0x7fd470005af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:51:47.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:47.819+0000 7fd491a47640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd48c15d4d0 msgr2=0x7fd47000a690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:51:47.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:47.819+0000 7fd491a47640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd48c15d4d0 0x7fd47000a690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:51:47.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:47.819+0000 7fd491246640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd48c0b5220 legacy=0x7fd470009f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:51:47.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:47.819+0000 7fd490a45640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd4700036d0 msgr2=0x7fd470005af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:51:47.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:47.819+0000 7fd490a45640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd4700036d0 0x7fd470005af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:51:49.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:49.411+0000 7fd482ffd640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd4700036d0 msgr2=0x7fd470005af0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:51:49.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:49.411+0000 7fd482ffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd4700036d0 0x7fd470005af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:51:49.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:49.411+0000 7fd482ffd640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd48c15d4d0 msgr2=0x7fd47000a690 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:51:49.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:49.411+0000 7fd482ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd48c15d4d0 0x7fd47000a690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:51:49.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:49.411+0000 7fd482ffd640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd48c0b5220 legacy=0x7fd470009f40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:51:49.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:49.411+0000 7fd482ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700091d0 0x7fd4700095e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:51:49.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:49.411+0000 7fd482ffd640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd48c0d2a60 con 0x7fd470008d90 2023-11-28T18:51:49.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:49.411+0000 7fd482ffd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd48c0d3120 con 0x7fd4700091d0 2023-11-28T18:51:49.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:49.411+0000 7fd491246640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd470008d90 legacy=0x7fd470008660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:51:49.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:49.411+0000 7fd490a45640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700091d0 msgr2=0x7fd4700095e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:51:49.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:49.411+0000 7fd490a45640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700091d0 0x7fd4700095e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:51:49.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:49.615+0000 7fd491246640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd470008d90 legacy=0x7fd470008660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:51:49.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:49.615+0000 7fd490a45640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700091d0 msgr2=0x7fd4700095e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:51:49.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:49.615+0000 7fd490a45640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700091d0 0x7fd4700095e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:51:50.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:50.019+0000 7fd491246640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd470008d90 legacy=0x7fd470008660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:51:50.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:50.019+0000 7fd490a45640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700091d0 msgr2=0x7fd4700095e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:51:50.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:50.019+0000 7fd490a45640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700091d0 0x7fd4700095e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:51:50.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:50.823+0000 7fd491246640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd470008d90 legacy=0x7fd470008660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:51:50.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:50.823+0000 7fd490a45640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700091d0 msgr2=0x7fd4700095e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:51:50.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:50.823+0000 7fd490a45640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700091d0 0x7fd4700095e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:51:52.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:52.411+0000 7fd482ffd640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700091d0 msgr2=0x7fd4700095e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:51:52.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:52.411+0000 7fd482ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700091d0 0x7fd4700095e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:51:52.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:52.411+0000 7fd482ffd640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd470008d90 legacy=0x7fd470008660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:51:52.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:52.411+0000 7fd482ffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd4700036d0 0x7fd470005ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:51:52.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:52.411+0000 7fd491a47640 1 -- reap_dead start 2023-11-28T18:51:52.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:52.411+0000 7fd482ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700095b0 0x7fd470009f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:51:52.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:52.411+0000 7fd482ffd640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd48c0d2230 con 0x7fd47000a690 2023-11-28T18:51:52.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:52.411+0000 7fd482ffd640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd48c0d3120 con 0x7fd4700036d0 2023-11-28T18:51:52.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:52.411+0000 7fd482ffd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd48c0d2780 con 0x7fd4700095b0 2023-11-28T18:51:52.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:52.411+0000 7fd490a45640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd47000a690 legacy=0x7fd470008620 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:51:52.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:52.411+0000 7fd491246640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd4700036d0 msgr2=0x7fd470005ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:51:52.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:52.411+0000 7fd491246640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd4700036d0 0x7fd470005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:51:52.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:52.411+0000 7fd491a47640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700095b0 msgr2=0x7fd470009f10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:51:52.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:52.411+0000 7fd491a47640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700095b0 0x7fd470009f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:51:52.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:52.615+0000 7fd490a45640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd47000a690 legacy=0x7fd470008620 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:51:52.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:52.615+0000 7fd491246640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd4700036d0 msgr2=0x7fd470005ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:51:52.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:52.615+0000 7fd491a47640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700095b0 msgr2=0x7fd470009f10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:51:52.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:52.615+0000 7fd491246640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd4700036d0 0x7fd470005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:51:52.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:52.615+0000 7fd491a47640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700095b0 0x7fd470009f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:51:53.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:53.019+0000 7fd490a45640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd47000a690 legacy=0x7fd470008620 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:51:53.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:53.019+0000 7fd491a47640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700095b0 msgr2=0x7fd470009f10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:51:53.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:53.019+0000 7fd491246640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd4700036d0 msgr2=0x7fd470005ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:51:53.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:53.019+0000 7fd491246640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd4700036d0 0x7fd470005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:51:53.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:53.019+0000 7fd491a47640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700095b0 0x7fd470009f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:51:53.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:53.823+0000 7fd490a45640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd47000a690 legacy=0x7fd470008620 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:51:53.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:53.823+0000 7fd491a47640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700095b0 msgr2=0x7fd470009f10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:51:53.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:53.823+0000 7fd491246640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd4700036d0 msgr2=0x7fd470005ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:51:53.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:53.823+0000 7fd491a47640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700095b0 0x7fd470009f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:51:53.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:53.823+0000 7fd491246640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd4700036d0 0x7fd470005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:51:55.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:55.411+0000 7fd482ffd640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700095b0 msgr2=0x7fd470009f10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:51:55.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:55.411+0000 7fd482ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700095b0 0x7fd470009f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:51:55.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:55.411+0000 7fd482ffd640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd4700036d0 msgr2=0x7fd470005ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:51:55.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:55.411+0000 7fd482ffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd4700036d0 0x7fd470005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:51:55.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:55.411+0000 7fd482ffd640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd47000a690 legacy=0x7fd470008620 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:51:55.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:55.411+0000 7fd482ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd470011b90 0x7fd470013f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:51:55.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:55.411+0000 7fd482ffd640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd48c0d2a60 con 0x7fd47000e080 2023-11-28T18:51:55.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:55.411+0000 7fd482ffd640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd48c0d3120 con 0x7fd470011b90 2023-11-28T18:51:55.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:55.411+0000 7fd490a45640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd470011b90 msgr2=0x7fd470013f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:51:55.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:55.411+0000 7fd491246640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd47000e080 legacy=0x7fd470010470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:51:55.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:55.411+0000 7fd490a45640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd470011b90 0x7fd470013f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:51:55.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:55.615+0000 7fd490a45640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd470011b90 msgr2=0x7fd470013f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:51:55.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:55.615+0000 7fd490a45640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd470011b90 0x7fd470013f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:51:55.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:55.615+0000 7fd491246640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd47000e080 legacy=0x7fd470010470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:51:56.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:56.019+0000 7fd490a45640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd470011b90 msgr2=0x7fd470013f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:51:56.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:56.019+0000 7fd490a45640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd470011b90 0x7fd470013f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:51:56.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:56.019+0000 7fd491246640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd47000e080 legacy=0x7fd470010470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:51:56.162 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:51:56.167 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:51:56.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:56.823+0000 7fd490a45640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd470011b90 msgr2=0x7fd470013f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:51:56.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:56.823+0000 7fd490a45640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd470011b90 0x7fd470013f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:51:56.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:56.823+0000 7fd491246640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd47000e080 legacy=0x7fd470010470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:51:58.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:58.411+0000 7fd482ffd640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd470011b90 msgr2=0x7fd470013f80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:51:58.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:58.411+0000 7fd482ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd470011b90 0x7fd470013f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:51:58.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:58.411+0000 7fd482ffd640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd47000e080 legacy=0x7fd470010470 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:51:58.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:58.411+0000 7fd482ffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd4700036d0 0x7fd470005ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:51:58.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:58.411+0000 7fd491a47640 1 -- reap_dead start 2023-11-28T18:51:58.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:58.411+0000 7fd482ffd640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd48c0d2230 con 0x7fd47000a690 2023-11-28T18:51:58.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:58.411+0000 7fd482ffd640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd48c0d2a60 con 0x7fd4700095b0 2023-11-28T18:51:58.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:58.411+0000 7fd482ffd640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd48c0d3120 con 0x7fd4700036d0 2023-11-28T18:51:58.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:58.411+0000 7fd491246640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd47000a690 legacy=0x7fd470008600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:51:58.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:58.411+0000 7fd490a45640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd4700036d0 msgr2=0x7fd470005ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:51:58.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:58.411+0000 7fd491a47640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd4700095b0 legacy=0x7fd470013f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:51:58.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:58.411+0000 7fd490a45640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd4700036d0 0x7fd470005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:51:58.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:58.615+0000 7fd491246640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd47000a690 legacy=0x7fd470008600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:51:58.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:58.615+0000 7fd491a47640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd4700095b0 legacy=0x7fd470013f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:51:58.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:58.615+0000 7fd490a45640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd4700036d0 msgr2=0x7fd470005ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:51:58.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:58.615+0000 7fd490a45640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd4700036d0 0x7fd470005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:51:59.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:59.019+0000 7fd491246640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd47000a690 legacy=0x7fd470008600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:51:59.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:59.019+0000 7fd491a47640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd4700095b0 legacy=0x7fd470013f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:51:59.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:59.019+0000 7fd490a45640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd4700036d0 msgr2=0x7fd470005ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:51:59.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:59.019+0000 7fd490a45640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd4700036d0 0x7fd470005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:51:59.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:59.823+0000 7fd491246640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd47000a690 legacy=0x7fd470008600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:51:59.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:59.823+0000 7fd491a47640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd4700095b0 legacy=0x7fd470013f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:51:59.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:59.823+0000 7fd490a45640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd4700036d0 msgr2=0x7fd470005ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:51:59.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:51:59.823+0000 7fd490a45640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd4700036d0 0x7fd470005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:52:01.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:01.415+0000 7fd482ffd640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd4700036d0 msgr2=0x7fd470005ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:52:01.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:01.415+0000 7fd482ffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd4700036d0 0x7fd470005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:52:01.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:01.415+0000 7fd482ffd640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd4700095b0 legacy=0x7fd470013f80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:52:01.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:01.415+0000 7fd482ffd640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd47000a690 legacy=0x7fd470008600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:52:01.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:01.415+0000 7fd482ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd470014690 0x7fd470014af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:52:01.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:01.415+0000 7fd482ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470015030 0x7fd4700110a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:52:01.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:01.415+0000 7fd482ffd640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd48c0d3120 con 0x7fd470014690 2023-11-28T18:52:01.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:01.415+0000 7fd482ffd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd48c0d2780 con 0x7fd470015030 2023-11-28T18:52:01.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:01.415+0000 7fd491246640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd470014690 msgr2=0x7fd470014af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:52:01.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:01.415+0000 7fd491246640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd470014690 0x7fd470014af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:52:01.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:01.415+0000 7fd490a45640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470015030 msgr2=0x7fd4700110a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:52:01.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:01.415+0000 7fd490a45640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470015030 0x7fd4700110a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:52:01.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:01.619+0000 7fd491246640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd470014690 msgr2=0x7fd470014af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:52:01.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:01.619+0000 7fd491246640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd470014690 0x7fd470014af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:52:01.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:01.619+0000 7fd490a45640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470015030 msgr2=0x7fd4700110a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:52:01.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:01.619+0000 7fd490a45640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470015030 0x7fd4700110a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:52:02.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:02.023+0000 7fd491246640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd470014690 msgr2=0x7fd470014af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:52:02.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:02.023+0000 7fd491246640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd470014690 0x7fd470014af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:52:02.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:02.023+0000 7fd490a45640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470015030 msgr2=0x7fd4700110a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:52:02.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:02.023+0000 7fd490a45640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470015030 0x7fd4700110a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:52:02.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:02.827+0000 7fd491246640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd470014690 msgr2=0x7fd470014af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:52:02.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:02.827+0000 7fd491246640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd470014690 0x7fd470014af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:52:02.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:02.827+0000 7fd490a45640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470015030 msgr2=0x7fd4700110a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:52:02.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:02.827+0000 7fd490a45640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470015030 0x7fd4700110a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:52:04.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:04.415+0000 7fd482ffd640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470015030 msgr2=0x7fd4700110a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:52:04.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:04.415+0000 7fd482ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470015030 0x7fd4700110a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:52:04.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:04.415+0000 7fd482ffd640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd470014690 msgr2=0x7fd470014af0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:52:04.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:04.415+0000 7fd482ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd470014690 0x7fd470014af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:52:04.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:04.415+0000 7fd482ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700115e0 0x7fd470017590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:52:04.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:04.415+0000 7fd491a47640 1 -- reap_dead start 2023-11-28T18:52:04.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:04.415+0000 7fd482ffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd4700036d0 0x7fd470005ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:52:04.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:04.415+0000 7fd482ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd470014690 0x7fd470014af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:52:04.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:04.415+0000 7fd482ffd640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd48c0d3120 con 0x7fd470014690 2023-11-28T18:52:04.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:04.415+0000 7fd482ffd640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd48c0d2780 con 0x7fd4700036d0 2023-11-28T18:52:04.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:04.415+0000 7fd482ffd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4700119c0 con 0x7fd4700115e0 2023-11-28T18:52:04.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:04.415+0000 7fd491a47640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd470014690 msgr2=0x7fd470014af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:52:04.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:04.415+0000 7fd491a47640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd470014690 0x7fd470014af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:52:04.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:04.415+0000 7fd491246640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700115e0 msgr2=0x7fd470017590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:52:04.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:04.415+0000 7fd490a45640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd4700036d0 msgr2=0x7fd470005ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:52:04.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:04.415+0000 7fd491246640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700115e0 0x7fd470017590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:52:04.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:04.415+0000 7fd490a45640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd4700036d0 0x7fd470005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:52:04.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:04.619+0000 7fd491a47640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd470014690 msgr2=0x7fd470014af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:52:04.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:04.619+0000 7fd491a47640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd470014690 0x7fd470014af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:52:04.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:04.619+0000 7fd491246640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700115e0 msgr2=0x7fd470017590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:52:04.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:04.619+0000 7fd490a45640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd4700036d0 msgr2=0x7fd470005ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:52:04.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:04.619+0000 7fd491246640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700115e0 0x7fd470017590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:52:04.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:04.619+0000 7fd490a45640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd4700036d0 0x7fd470005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:52:05.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:05.023+0000 7fd491a47640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd470014690 msgr2=0x7fd470014af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:52:05.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:05.023+0000 7fd491a47640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd470014690 0x7fd470014af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:52:05.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:05.023+0000 7fd491246640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700115e0 msgr2=0x7fd470017590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:52:05.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:05.023+0000 7fd490a45640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd4700036d0 msgr2=0x7fd470005ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:52:05.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:05.023+0000 7fd491246640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700115e0 0x7fd470017590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:52:05.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:05.023+0000 7fd490a45640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd4700036d0 0x7fd470005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:52:05.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:05.827+0000 7fd491a47640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd470014690 msgr2=0x7fd470014af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:52:05.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:05.827+0000 7fd491a47640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd470014690 0x7fd470014af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:52:05.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:05.827+0000 7fd490a45640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd4700036d0 msgr2=0x7fd470005ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:52:05.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:05.827+0000 7fd491246640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700115e0 msgr2=0x7fd470017590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:52:05.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:05.827+0000 7fd490a45640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd4700036d0 0x7fd470005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:52:05.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:05.827+0000 7fd491246640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700115e0 0x7fd470017590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:52:07.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:07.415+0000 7fd482ffd640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700115e0 msgr2=0x7fd470017590 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:52:07.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:07.415+0000 7fd482ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700115e0 0x7fd470017590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:52:07.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:07.415+0000 7fd482ffd640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd4700036d0 msgr2=0x7fd470005ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:52:07.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:07.415+0000 7fd482ffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd4700036d0 0x7fd470005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:52:07.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:07.415+0000 7fd482ffd640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd470014690 msgr2=0x7fd470014af0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:52:07.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:07.415+0000 7fd482ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd470014690 0x7fd470014af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:52:07.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:07.415+0000 7fd482ffd640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd470009f10 con 0x7fd47000a660 2023-11-28T18:52:07.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:07.415+0000 7fd482ffd640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd48c0d2230 con 0x7fd4700095b0 2023-11-28T18:52:07.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:07.415+0000 7fd490a45640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd47000a660 legacy=0x7fd470013f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:52:07.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:07.415+0000 7fd491246640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd4700095b0 legacy=0x7fd47000f090 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:52:07.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:07.619+0000 7fd490a45640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd47000a660 legacy=0x7fd470013f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:52:07.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:07.619+0000 7fd491246640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd4700095b0 legacy=0x7fd47000f090 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:52:08.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:08.023+0000 7fd490a45640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd47000a660 legacy=0x7fd470013f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:52:08.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:08.023+0000 7fd491246640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd4700095b0 legacy=0x7fd47000f090 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:52:08.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:08.827+0000 7fd490a45640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd47000a660 legacy=0x7fd470013f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:52:08.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:08.827+0000 7fd491246640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd4700095b0 legacy=0x7fd47000f090 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:52:10.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:10.415+0000 7fd482ffd640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd4700095b0 legacy=0x7fd47000f090 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:52:10.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:10.415+0000 7fd482ffd640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd47000a660 legacy=0x7fd470013f80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:52:10.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:10.415+0000 7fd482ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700115e0 0x7fd4700107b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:52:10.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:10.415+0000 7fd491a47640 1 -- reap_dead start 2023-11-28T18:52:10.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:10.415+0000 7fd482ffd640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd48c0d2a60 con 0x7fd47000a660 2023-11-28T18:52:10.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:10.415+0000 7fd482ffd640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd470009f10 con 0x7fd470010cf0 2023-11-28T18:52:10.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:10.415+0000 7fd482ffd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd48c0d3120 con 0x7fd4700115e0 2023-11-28T18:52:10.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:10.415+0000 7fd491a47640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd47000a660 legacy=0x7fd4700065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:52:10.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:10.415+0000 7fd491246640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700115e0 msgr2=0x7fd4700107b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:52:10.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:10.415+0000 7fd490a45640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd470010cf0 legacy=0x7fd470007600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:52:10.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:10.415+0000 7fd491246640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700115e0 0x7fd4700107b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:52:10.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:10.619+0000 7fd491a47640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd47000a660 legacy=0x7fd4700065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:52:10.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:10.619+0000 7fd490a45640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd470010cf0 legacy=0x7fd470007600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:52:10.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:10.619+0000 7fd491246640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700115e0 msgr2=0x7fd4700107b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:52:10.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:10.619+0000 7fd491246640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700115e0 0x7fd4700107b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:52:11.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:11.023+0000 7fd491a47640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd47000a660 legacy=0x7fd4700065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:52:11.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:11.023+0000 7fd490a45640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd470010cf0 legacy=0x7fd470007600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:52:11.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:11.023+0000 7fd491246640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700115e0 msgr2=0x7fd4700107b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:52:11.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:11.023+0000 7fd491246640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700115e0 0x7fd4700107b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:52:11.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:11.827+0000 7fd491a47640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd47000a660 legacy=0x7fd4700065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:52:11.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:11.827+0000 7fd490a45640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd470010cf0 legacy=0x7fd470007600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:52:11.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:11.827+0000 7fd491246640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700115e0 msgr2=0x7fd4700107b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:52:11.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:11.827+0000 7fd491246640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700115e0 0x7fd4700107b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:52:13.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:13.415+0000 7fd482ffd640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700115e0 msgr2=0x7fd4700107b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:52:13.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:13.415+0000 7fd482ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700115e0 0x7fd4700107b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:52:13.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:13.415+0000 7fd482ffd640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd470010cf0 legacy=0x7fd470007600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:52:13.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:13.415+0000 7fd482ffd640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd47000a660 legacy=0x7fd4700065b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:52:13.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:13.415+0000 7fd482ffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd470011140 0x7fd470014af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:52:13.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:13.415+0000 7fd482ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd4700100a0 0x7fd470006cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:52:13.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:13.415+0000 7fd482ffd640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd48c0d3120 con 0x7fd4700100a0 2023-11-28T18:52:13.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:13.415+0000 7fd482ffd640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd48c0d2780 con 0x7fd470011140 2023-11-28T18:52:13.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:13.415+0000 7fd490a45640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd4700100a0 msgr2=0x7fd470006cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:52:13.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:13.415+0000 7fd490a45640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd4700100a0 0x7fd470006cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:52:13.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:13.415+0000 7fd491246640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd470011140 msgr2=0x7fd470014af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:52:13.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:13.415+0000 7fd491246640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd470011140 0x7fd470014af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:52:13.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:13.619+0000 7fd490a45640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd4700100a0 msgr2=0x7fd470006cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:52:13.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:13.619+0000 7fd490a45640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd4700100a0 0x7fd470006cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:52:13.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:13.619+0000 7fd491246640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd470011140 msgr2=0x7fd470014af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:52:13.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:13.619+0000 7fd491246640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd470011140 0x7fd470014af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:52:14.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:14.023+0000 7fd490a45640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd4700100a0 msgr2=0x7fd470006cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:52:14.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:14.023+0000 7fd490a45640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd4700100a0 0x7fd470006cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:52:14.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:14.023+0000 7fd491246640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd470011140 msgr2=0x7fd470014af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:52:14.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:14.023+0000 7fd491246640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd470011140 0x7fd470014af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:52:14.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:14.827+0000 7fd490a45640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd4700100a0 msgr2=0x7fd470006cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:52:14.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:14.827+0000 7fd490a45640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd4700100a0 0x7fd470006cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:52:14.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:14.827+0000 7fd491246640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd470011140 msgr2=0x7fd470014af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:52:14.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:14.827+0000 7fd491246640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd470011140 0x7fd470014af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:52:16.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:16.415+0000 7fd482ffd640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd470011140 msgr2=0x7fd470014af0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:52:16.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:16.415+0000 7fd482ffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd470011140 0x7fd470014af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:52:16.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:16.415+0000 7fd482ffd640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd4700100a0 msgr2=0x7fd470006cc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:52:16.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:16.415+0000 7fd482ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd4700100a0 0x7fd470006cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:52:16.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:16.415+0000 7fd482ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700115e0 0x7fd470010640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:52:16.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:16.415+0000 7fd491a47640 1 -- reap_dead start 2023-11-28T18:52:16.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:16.415+0000 7fd482ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd4700100a0 0x7fd470006cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:52:16.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:16.415+0000 7fd482ffd640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd48c0d2230 con 0x7fd470010cf0 2023-11-28T18:52:16.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:16.415+0000 7fd482ffd640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd48c0d3120 con 0x7fd4700100a0 2023-11-28T18:52:16.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:16.415+0000 7fd482ffd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd48c0d2780 con 0x7fd4700115e0 2023-11-28T18:52:16.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:16.415+0000 7fd491a47640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd4700100a0 msgr2=0x7fd470006cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:52:16.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:16.415+0000 7fd491a47640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd4700100a0 0x7fd470006cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:52:16.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:16.415+0000 7fd491246640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700115e0 msgr2=0x7fd470010640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:52:16.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:16.415+0000 7fd490a45640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd470010cf0 legacy=0x7fd4700056e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:52:16.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:16.415+0000 7fd491246640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700115e0 0x7fd470010640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:52:16.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:16.619+0000 7fd491a47640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd4700100a0 msgr2=0x7fd470006cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:52:16.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:16.619+0000 7fd491a47640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd4700100a0 0x7fd470006cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:52:16.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:16.619+0000 7fd491246640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700115e0 msgr2=0x7fd470010640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:52:16.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:16.619+0000 7fd490a45640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd470010cf0 legacy=0x7fd4700056e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:52:16.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:16.619+0000 7fd491246640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700115e0 0x7fd470010640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:52:17.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:17.023+0000 7fd491a47640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd4700100a0 msgr2=0x7fd470006cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:52:17.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:17.023+0000 7fd491a47640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd4700100a0 0x7fd470006cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:52:17.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:17.023+0000 7fd491246640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700115e0 msgr2=0x7fd470010640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:52:17.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:17.023+0000 7fd490a45640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd470010cf0 legacy=0x7fd4700056e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:52:17.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:17.023+0000 7fd491246640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700115e0 0x7fd470010640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:52:17.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:17.826+0000 7fd491a47640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd4700100a0 msgr2=0x7fd470006cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:52:17.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:17.826+0000 7fd491a47640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd4700100a0 0x7fd470006cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:52:17.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:17.826+0000 7fd490a45640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd470010cf0 legacy=0x7fd4700056e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:52:17.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:17.826+0000 7fd491246640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700115e0 msgr2=0x7fd470010640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:52:17.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:17.826+0000 7fd491246640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700115e0 0x7fd470010640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:52:19.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:19.414+0000 7fd482ffd640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700115e0 msgr2=0x7fd470010640 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:52:19.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:19.414+0000 7fd482ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700115e0 0x7fd470010640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:52:19.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:19.414+0000 7fd482ffd640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd4700100a0 msgr2=0x7fd470006cc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:52:19.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:19.414+0000 7fd482ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd4700100a0 0x7fd470006cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:52:19.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:19.414+0000 7fd482ffd640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd470010cf0 legacy=0x7fd4700056e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:52:19.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:19.414+0000 7fd482ffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd470011140 0x7fd470014af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:52:19.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:19.414+0000 7fd482ffd640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd48c0d2a60 con 0x7fd47000a660 2023-11-28T18:52:19.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:19.414+0000 7fd482ffd640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd48c0d3120 con 0x7fd470011140 2023-11-28T18:52:19.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:19.414+0000 7fd490a45640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd47000a660 legacy=0x7fd4700065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:52:19.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:19.414+0000 7fd491246640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd470011140 msgr2=0x7fd470014af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:52:19.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:19.414+0000 7fd491246640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd470011140 0x7fd470014af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:52:19.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:19.618+0000 7fd490a45640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd47000a660 legacy=0x7fd4700065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:52:19.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:19.618+0000 7fd491246640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd470011140 msgr2=0x7fd470014af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:52:19.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:19.618+0000 7fd491246640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd470011140 0x7fd470014af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:52:20.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:20.022+0000 7fd490a45640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd47000a660 legacy=0x7fd4700065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:52:20.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:20.022+0000 7fd491246640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd470011140 msgr2=0x7fd470014af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:52:20.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:20.022+0000 7fd491246640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd470011140 0x7fd470014af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:52:20.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:20.826+0000 7fd490a45640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd47000a660 legacy=0x7fd4700065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:52:20.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:20.826+0000 7fd491246640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd470011140 msgr2=0x7fd470014af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:52:20.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:20.826+0000 7fd491246640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd470011140 0x7fd470014af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:52:22.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:22.414+0000 7fd482ffd640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd470011140 msgr2=0x7fd470014af0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:52:22.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:22.414+0000 7fd482ffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd470011140 0x7fd470014af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:52:22.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:22.414+0000 7fd482ffd640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd47000a660 legacy=0x7fd4700065b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:52:22.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:22.414+0000 7fd482ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700115e0 0x7fd470010640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:52:22.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:22.414+0000 7fd482ffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd470013f80 0x7fd4700143c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:52:22.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:22.414+0000 7fd491a47640 1 -- reap_dead start 2023-11-28T18:52:22.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:22.414+0000 7fd482ffd640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd48c0d2230 con 0x7fd470010cf0 2023-11-28T18:52:22.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:22.414+0000 7fd482ffd640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd48c0d3120 con 0x7fd470013f80 2023-11-28T18:52:22.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:22.414+0000 7fd482ffd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd48c0d2780 con 0x7fd4700115e0 2023-11-28T18:52:22.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:22.414+0000 7fd490a45640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd470010cf0 legacy=0x7fd4700056e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:52:22.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:22.414+0000 7fd491246640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700115e0 msgr2=0x7fd470010640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:52:22.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:22.414+0000 7fd491a47640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd470013f80 msgr2=0x7fd4700143c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:52:22.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:22.414+0000 7fd491a47640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd470013f80 0x7fd4700143c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:52:22.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:22.414+0000 7fd491246640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700115e0 0x7fd470010640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:52:22.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:22.618+0000 7fd490a45640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd470010cf0 legacy=0x7fd4700056e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:52:22.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:22.618+0000 7fd491a47640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd470013f80 msgr2=0x7fd4700143c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:52:22.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:22.618+0000 7fd491246640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700115e0 msgr2=0x7fd470010640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:52:22.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:22.618+0000 7fd491a47640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd470013f80 0x7fd4700143c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:52:22.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:22.618+0000 7fd491246640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700115e0 0x7fd470010640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:52:23.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:23.022+0000 7fd490a45640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd470010cf0 legacy=0x7fd4700056e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:52:23.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:23.022+0000 7fd491a47640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd470013f80 msgr2=0x7fd4700143c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:52:23.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:23.022+0000 7fd491246640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700115e0 msgr2=0x7fd470010640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:52:23.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:23.022+0000 7fd491246640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700115e0 0x7fd470010640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:52:23.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:23.022+0000 7fd491a47640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd470013f80 0x7fd4700143c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:52:23.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:23.826+0000 7fd490a45640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd470010cf0 legacy=0x7fd4700056e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:52:23.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:23.826+0000 7fd491246640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700115e0 msgr2=0x7fd470010640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:52:23.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:23.826+0000 7fd491a47640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd470013f80 msgr2=0x7fd4700143c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:52:23.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:23.826+0000 7fd491a47640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd470013f80 0x7fd4700143c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:52:23.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:23.826+0000 7fd491246640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700115e0 0x7fd470010640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:52:25.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:25.414+0000 7fd482ffd640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700115e0 msgr2=0x7fd470010640 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:52:25.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:25.414+0000 7fd482ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700115e0 0x7fd470010640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:52:25.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:25.414+0000 7fd482ffd640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd470013f80 msgr2=0x7fd4700143c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:52:25.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:25.414+0000 7fd482ffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd470013f80 0x7fd4700143c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:52:25.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:25.414+0000 7fd482ffd640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd470010cf0 legacy=0x7fd4700056e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:52:25.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:25.414+0000 7fd482ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd47000a660 0x7fd470014af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:52:25.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:25.414+0000 7fd482ffd640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd48c0d2a60 con 0x7fd470008210 2023-11-28T18:52:25.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:25.414+0000 7fd482ffd640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd48c0d3120 con 0x7fd47000a660 2023-11-28T18:52:25.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:25.414+0000 7fd491246640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd47000a660 msgr2=0x7fd470014af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:52:25.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:25.414+0000 7fd491246640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd47000a660 0x7fd470014af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:52:25.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:25.414+0000 7fd490a45640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd470008210 legacy=0x7fd4700085f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:52:25.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:25.618+0000 7fd491246640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd47000a660 msgr2=0x7fd470014af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:52:25.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:25.618+0000 7fd490a45640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd470008210 legacy=0x7fd4700085f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:52:25.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:25.618+0000 7fd491246640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd47000a660 0x7fd470014af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:52:26.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:26.022+0000 7fd491246640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd47000a660 msgr2=0x7fd470014af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:52:26.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:26.022+0000 7fd490a45640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd470008210 legacy=0x7fd4700085f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:52:26.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:26.022+0000 7fd491246640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd47000a660 0x7fd470014af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:52:26.392 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:52:26.397 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:52:26.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:26.826+0000 7fd490a45640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd470008210 legacy=0x7fd4700085f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:52:26.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:26.826+0000 7fd491246640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd47000a660 msgr2=0x7fd470014af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:52:26.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:26.826+0000 7fd491246640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd47000a660 0x7fd470014af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:52:28.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:28.414+0000 7fd482ffd640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd47000a660 msgr2=0x7fd470014af0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:52:28.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:28.414+0000 7fd482ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd47000a660 0x7fd470014af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:52:28.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:28.414+0000 7fd482ffd640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd470008210 legacy=0x7fd4700085f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:52:28.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:28.414+0000 7fd491a47640 1 -- reap_dead start 2023-11-28T18:52:28.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:28.414+0000 7fd482ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd4700065b0 0x7fd470006990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:52:28.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:28.414+0000 7fd482ffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd470013f80 0x7fd4700143c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:52:28.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:28.414+0000 7fd482ffd640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd48c0d2230 con 0x7fd470010cf0 2023-11-28T18:52:28.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:28.414+0000 7fd482ffd640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd48c0d3120 con 0x7fd4700065b0 2023-11-28T18:52:28.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:28.414+0000 7fd482ffd640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd48c0d2780 con 0x7fd470013f80 2023-11-28T18:52:28.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:28.414+0000 7fd491246640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd4700065b0 msgr2=0x7fd470006990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:52:28.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:28.414+0000 7fd491246640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd4700065b0 0x7fd470006990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:52:28.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:28.414+0000 7fd490a45640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd470010cf0 legacy=0x7fd4700056e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:52:28.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:28.414+0000 7fd491a47640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd470013f80 msgr2=0x7fd4700143c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:52:28.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:28.414+0000 7fd491a47640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd470013f80 0x7fd4700143c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:52:28.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:28.618+0000 7fd491246640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd4700065b0 msgr2=0x7fd470006990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:52:28.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:28.618+0000 7fd491246640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd4700065b0 0x7fd470006990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:52:28.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:28.618+0000 7fd490a45640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd470010cf0 legacy=0x7fd4700056e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:52:28.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:28.618+0000 7fd491a47640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd470013f80 msgr2=0x7fd4700143c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:52:28.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:28.618+0000 7fd491a47640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd470013f80 0x7fd4700143c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:52:29.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:29.022+0000 7fd491246640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd4700065b0 msgr2=0x7fd470006990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:52:29.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:29.022+0000 7fd491246640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd4700065b0 0x7fd470006990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:52:29.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:29.022+0000 7fd490a45640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd470010cf0 legacy=0x7fd4700056e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:52:29.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:29.022+0000 7fd491a47640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd470013f80 msgr2=0x7fd4700143c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:52:29.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:29.022+0000 7fd491a47640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd470013f80 0x7fd4700143c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:52:29.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:29.826+0000 7fd491246640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd4700065b0 msgr2=0x7fd470006990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:52:29.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:29.826+0000 7fd491246640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd4700065b0 0x7fd470006990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:52:29.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:29.826+0000 7fd490a45640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd470010cf0 legacy=0x7fd4700056e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:52:29.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:29.826+0000 7fd491a47640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd470013f80 msgr2=0x7fd4700143c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:52:29.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:29.826+0000 7fd491a47640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd470013f80 0x7fd4700143c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:52:31.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:31.414+0000 7fd482ffd640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd470013f80 msgr2=0x7fd4700143c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:52:31.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:31.414+0000 7fd482ffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd470013f80 0x7fd4700143c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:52:31.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:31.414+0000 7fd482ffd640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd4700065b0 msgr2=0x7fd470006990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:52:31.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:31.414+0000 7fd482ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd4700065b0 0x7fd470006990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:52:31.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:31.414+0000 7fd482ffd640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd470010cf0 legacy=0x7fd4700056e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:52:31.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:31.414+0000 7fd482ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470010060 0x7fd470010640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:52:31.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:31.414+0000 7fd482ffd640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd48c0d2a60 con 0x7fd4700115e0 2023-11-28T18:52:31.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:31.414+0000 7fd482ffd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd48c0d3120 con 0x7fd470010060 2023-11-28T18:52:31.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:31.414+0000 7fd491246640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd4700115e0 legacy=0x7fd470007ee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:52:31.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:31.414+0000 7fd490a45640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470010060 msgr2=0x7fd470010640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:52:31.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:31.414+0000 7fd490a45640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470010060 0x7fd470010640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:52:31.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:31.618+0000 7fd491246640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd4700115e0 legacy=0x7fd470007ee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:52:31.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:31.618+0000 7fd490a45640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470010060 msgr2=0x7fd470010640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:52:31.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:31.618+0000 7fd490a45640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470010060 0x7fd470010640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:52:32.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:32.022+0000 7fd491246640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd4700115e0 legacy=0x7fd470007ee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:52:32.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:32.022+0000 7fd490a45640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470010060 msgr2=0x7fd470010640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:52:32.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:32.022+0000 7fd490a45640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470010060 0x7fd470010640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:52:32.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:32.826+0000 7fd491246640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd4700115e0 legacy=0x7fd470007ee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:52:32.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:32.826+0000 7fd490a45640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470010060 msgr2=0x7fd470010640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:52:32.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:32.826+0000 7fd490a45640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470010060 0x7fd470010640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:52:34.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:34.418+0000 7fd482ffd640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470010060 msgr2=0x7fd470010640 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:52:34.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:34.418+0000 7fd482ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470010060 0x7fd470010640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:52:34.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:34.418+0000 7fd482ffd640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd4700115e0 legacy=0x7fd470007ee0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:52:34.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:34.418+0000 7fd482ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 0x7fd4700085f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:52:34.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:34.418+0000 7fd482ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd4700065b0 0x7fd470010640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:52:34.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:34.418+0000 7fd491a47640 1 -- reap_dead start 2023-11-28T18:52:34.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:34.418+0000 7fd482ffd640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd48c0d2230 con 0x7fd470010cf0 2023-11-28T18:52:34.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:34.418+0000 7fd482ffd640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd48c0d3120 con 0x7fd4700065b0 2023-11-28T18:52:34.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:34.418+0000 7fd482ffd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd48c0d2780 con 0x7fd470014ad0 2023-11-28T18:52:34.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:34.418+0000 7fd490a45640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd4700065b0 msgr2=0x7fd470010640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:52:34.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:34.418+0000 7fd491246640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 msgr2=0x7fd4700085f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:52:34.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:34.418+0000 7fd490a45640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd4700065b0 0x7fd470010640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:52:34.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:34.418+0000 7fd491246640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 0x7fd4700085f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:52:34.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:34.418+0000 7fd491a47640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd470010cf0 legacy=0x7fd4700056e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:52:34.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:34.622+0000 7fd490a45640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd4700065b0 msgr2=0x7fd470010640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:52:34.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:34.622+0000 7fd490a45640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd4700065b0 0x7fd470010640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:52:34.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:34.622+0000 7fd491a47640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd470010cf0 legacy=0x7fd4700056e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:52:34.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:34.622+0000 7fd491246640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 msgr2=0x7fd4700085f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:52:34.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:34.622+0000 7fd491246640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 0x7fd4700085f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:52:35.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:35.026+0000 7fd490a45640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd4700065b0 msgr2=0x7fd470010640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:52:35.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:35.026+0000 7fd490a45640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd4700065b0 0x7fd470010640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:52:35.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:35.026+0000 7fd491a47640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd470010cf0 legacy=0x7fd4700056e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:52:35.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:35.026+0000 7fd491246640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 msgr2=0x7fd4700085f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:52:35.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:35.026+0000 7fd491246640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 0x7fd4700085f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:52:35.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:35.830+0000 7fd490a45640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd4700065b0 msgr2=0x7fd470010640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:52:35.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:35.830+0000 7fd490a45640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd4700065b0 0x7fd470010640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:52:35.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:35.830+0000 7fd491246640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 msgr2=0x7fd4700085f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:52:35.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:35.830+0000 7fd491a47640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd470010cf0 legacy=0x7fd4700056e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:52:35.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:35.830+0000 7fd491246640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 0x7fd4700085f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:52:37.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:37.418+0000 7fd482ffd640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 msgr2=0x7fd4700085f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:52:37.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:37.418+0000 7fd482ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 0x7fd4700085f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:52:37.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:37.418+0000 7fd482ffd640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd4700065b0 msgr2=0x7fd470010640 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:52:37.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:37.418+0000 7fd482ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd4700065b0 0x7fd470010640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:52:37.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:37.418+0000 7fd482ffd640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd470010cf0 legacy=0x7fd4700056e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:52:37.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:37.418+0000 7fd482ffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd4700115e0 0x7fd4700079a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:52:37.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:37.418+0000 7fd482ffd640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd48c0d2a60 con 0x7fd470007ee0 2023-11-28T18:52:37.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:37.418+0000 7fd482ffd640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd48c0d3120 con 0x7fd4700115e0 2023-11-28T18:52:37.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:37.418+0000 7fd490a45640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd470007ee0 legacy=0x7fd47000d040 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:52:37.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:37.418+0000 7fd491246640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd4700115e0 msgr2=0x7fd4700079a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:52:37.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:37.418+0000 7fd491246640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd4700115e0 0x7fd4700079a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:52:37.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:37.622+0000 7fd490a45640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd470007ee0 legacy=0x7fd47000d040 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:52:37.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:37.622+0000 7fd491246640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd4700115e0 msgr2=0x7fd4700079a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:52:37.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:37.622+0000 7fd491246640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd4700115e0 0x7fd4700079a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:52:38.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:38.026+0000 7fd490a45640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd470007ee0 legacy=0x7fd47000d040 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:52:38.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:38.026+0000 7fd491246640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd4700115e0 msgr2=0x7fd4700079a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:52:38.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:38.026+0000 7fd491246640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd4700115e0 0x7fd4700079a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:52:38.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:38.830+0000 7fd490a45640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd470007ee0 legacy=0x7fd47000d040 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:52:38.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:38.830+0000 7fd491246640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd4700115e0 msgr2=0x7fd4700079a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:52:38.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:38.830+0000 7fd491246640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd4700115e0 0x7fd4700079a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:52:40.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:40.418+0000 7fd482ffd640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd4700115e0 msgr2=0x7fd4700079a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:52:40.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:40.418+0000 7fd482ffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd4700115e0 0x7fd4700079a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:52:40.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:40.418+0000 7fd482ffd640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd470007ee0 legacy=0x7fd47000d040 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:52:40.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:40.418+0000 7fd482ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 0x7fd47000d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:52:40.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:40.418+0000 7fd491a47640 1 -- reap_dead start 2023-11-28T18:52:40.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:40.418+0000 7fd482ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd4700065b0 0x7fd470010640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:52:40.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:40.418+0000 7fd482ffd640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd48c0d2230 con 0x7fd4700082c0 2023-11-28T18:52:40.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:40.418+0000 7fd482ffd640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd48c0d3120 con 0x7fd4700065b0 2023-11-28T18:52:40.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:40.418+0000 7fd482ffd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd48c0d2780 con 0x7fd470014ad0 2023-11-28T18:52:40.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:40.418+0000 7fd490a45640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd4700082c0 legacy=0x7fd470012f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:52:40.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:40.418+0000 7fd491a47640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd4700065b0 msgr2=0x7fd470010640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:52:40.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:40.418+0000 7fd491a47640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd4700065b0 0x7fd470010640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:52:40.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:40.418+0000 7fd491246640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 msgr2=0x7fd47000d750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:52:40.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:40.418+0000 7fd491246640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 0x7fd47000d750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:52:40.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:40.622+0000 7fd490a45640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd4700082c0 legacy=0x7fd470012f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:52:40.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:40.622+0000 7fd491a47640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd4700065b0 msgr2=0x7fd470010640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:52:40.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:40.622+0000 7fd491a47640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd4700065b0 0x7fd470010640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:52:40.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:40.622+0000 7fd491246640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 msgr2=0x7fd47000d750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:52:40.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:40.622+0000 7fd491246640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 0x7fd47000d750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:52:41.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:41.026+0000 7fd490a45640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd4700082c0 legacy=0x7fd470012f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:52:41.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:41.026+0000 7fd491a47640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd4700065b0 msgr2=0x7fd470010640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:52:41.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:41.026+0000 7fd491a47640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd4700065b0 0x7fd470010640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:52:41.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:41.026+0000 7fd491246640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 msgr2=0x7fd47000d750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:52:41.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:41.026+0000 7fd491246640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 0x7fd47000d750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:52:41.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:41.830+0000 7fd490a45640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd4700082c0 legacy=0x7fd470012f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:52:41.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:41.830+0000 7fd491a47640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd4700065b0 msgr2=0x7fd470010640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:52:41.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:41.830+0000 7fd491a47640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd4700065b0 0x7fd470010640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:52:41.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:41.830+0000 7fd491246640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 msgr2=0x7fd47000d750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:52:41.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:41.830+0000 7fd491246640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 0x7fd47000d750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:52:43.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:43.418+0000 7fd482ffd640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 msgr2=0x7fd47000d750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:52:43.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:43.418+0000 7fd482ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 0x7fd47000d750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:52:43.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:43.418+0000 7fd482ffd640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd4700065b0 msgr2=0x7fd470010640 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:52:43.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:43.418+0000 7fd482ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd4700065b0 0x7fd470010640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:52:43.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:43.418+0000 7fd482ffd640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd4700082c0 legacy=0x7fd470012f80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:52:43.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:43.418+0000 7fd482ffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd470010ca0 0x7fd4700086a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:52:43.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:43.418+0000 7fd482ffd640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd48c0d2a60 con 0x7fd4700115e0 2023-11-28T18:52:43.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:43.418+0000 7fd482ffd640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd48c0d3120 con 0x7fd470010ca0 2023-11-28T18:52:43.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:43.418+0000 7fd490a45640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd470010ca0 msgr2=0x7fd4700086a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:52:43.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:43.418+0000 7fd491246640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd4700115e0 legacy=0x7fd47000d040 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:52:43.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:43.418+0000 7fd490a45640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd470010ca0 0x7fd4700086a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:52:43.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:43.622+0000 7fd491246640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd4700115e0 legacy=0x7fd47000d040 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:52:43.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:43.622+0000 7fd490a45640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd470010ca0 msgr2=0x7fd4700086a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:52:43.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:43.622+0000 7fd490a45640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd470010ca0 0x7fd4700086a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:52:44.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:44.026+0000 7fd490a45640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd470010ca0 msgr2=0x7fd4700086a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:52:44.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:44.026+0000 7fd491246640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd4700115e0 legacy=0x7fd47000d040 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:52:44.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:44.026+0000 7fd490a45640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd470010ca0 0x7fd4700086a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:52:44.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:44.830+0000 7fd490a45640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd470010ca0 msgr2=0x7fd4700086a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:52:44.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:44.830+0000 7fd491246640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd4700115e0 legacy=0x7fd47000d040 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:52:44.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:44.830+0000 7fd490a45640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd470010ca0 0x7fd4700086a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:52:46.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:46.418+0000 7fd482ffd640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd470010ca0 msgr2=0x7fd4700086a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:52:46.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:46.418+0000 7fd482ffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd470010ca0 0x7fd4700086a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:52:46.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:46.418+0000 7fd482ffd640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd4700115e0 legacy=0x7fd47000d040 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:52:46.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:46.418+0000 7fd482ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd4700065b0 0x7fd470010640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:52:46.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:46.418+0000 7fd491a47640 1 -- reap_dead start 2023-11-28T18:52:46.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:46.418+0000 7fd482ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 0x7fd47000d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:52:46.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:46.418+0000 7fd482ffd640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd48c0d2230 con 0x7fd4700082c0 2023-11-28T18:52:46.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:46.418+0000 7fd482ffd640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd48c0d3120 con 0x7fd4700065b0 2023-11-28T18:52:46.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:46.418+0000 7fd482ffd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd48c0d2780 con 0x7fd470014ad0 2023-11-28T18:52:46.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:46.418+0000 7fd491246640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd4700065b0 msgr2=0x7fd470010640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:52:46.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:46.418+0000 7fd490a45640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd4700082c0 legacy=0x7fd4700056e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:52:46.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:46.418+0000 7fd491246640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd4700065b0 0x7fd470010640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:52:46.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:46.418+0000 7fd491a47640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 msgr2=0x7fd47000d750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:52:46.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:46.418+0000 7fd491a47640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 0x7fd47000d750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:52:46.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:46.622+0000 7fd490a45640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd4700082c0 legacy=0x7fd4700056e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:52:46.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:46.622+0000 7fd491246640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd4700065b0 msgr2=0x7fd470010640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:52:46.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:46.622+0000 7fd491246640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd4700065b0 0x7fd470010640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:52:46.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:46.622+0000 7fd491a47640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 msgr2=0x7fd47000d750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:52:46.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:46.622+0000 7fd491a47640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 0x7fd47000d750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:52:47.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:47.026+0000 7fd490a45640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd4700082c0 legacy=0x7fd4700056e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:52:47.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:47.026+0000 7fd491246640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd4700065b0 msgr2=0x7fd470010640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:52:47.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:47.026+0000 7fd491246640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd4700065b0 0x7fd470010640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:52:47.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:47.026+0000 7fd491a47640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 msgr2=0x7fd47000d750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:52:47.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:47.026+0000 7fd491a47640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 0x7fd47000d750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:52:47.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:47.830+0000 7fd490a45640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd4700082c0 legacy=0x7fd4700056e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:52:47.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:47.830+0000 7fd491246640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd4700065b0 msgr2=0x7fd470010640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:52:47.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:47.830+0000 7fd491246640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd4700065b0 0x7fd470010640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:52:47.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:47.830+0000 7fd491a47640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 msgr2=0x7fd47000d750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:52:47.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:47.830+0000 7fd491a47640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 0x7fd47000d750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:52:49.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:49.418+0000 7fd482ffd640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 msgr2=0x7fd47000d750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:52:49.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:49.418+0000 7fd482ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 0x7fd47000d750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:52:49.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:49.418+0000 7fd482ffd640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd4700065b0 msgr2=0x7fd470010640 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:52:49.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:49.418+0000 7fd482ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd4700065b0 0x7fd470010640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:52:49.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:49.418+0000 7fd482ffd640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd4700082c0 legacy=0x7fd4700056e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:52:49.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:49.418+0000 7fd482ffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd470010ca0 0x7fd4700086a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:52:49.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:49.418+0000 7fd482ffd640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd48c0d2a60 con 0x7fd4700115e0 2023-11-28T18:52:49.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:49.418+0000 7fd482ffd640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd48c0d3120 con 0x7fd470010ca0 2023-11-28T18:52:49.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:49.418+0000 7fd491246640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd470010ca0 msgr2=0x7fd4700086a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:52:49.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:49.418+0000 7fd490a45640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd4700115e0 legacy=0x7fd47000d040 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:52:49.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:49.418+0000 7fd491246640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd470010ca0 0x7fd4700086a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:52:49.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:49.622+0000 7fd490a45640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd4700115e0 legacy=0x7fd47000d040 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:52:49.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:49.622+0000 7fd491246640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd470010ca0 msgr2=0x7fd4700086a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:52:49.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:49.622+0000 7fd491246640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd470010ca0 0x7fd4700086a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:52:50.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:50.026+0000 7fd490a45640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd4700115e0 legacy=0x7fd47000d040 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:52:50.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:50.026+0000 7fd491246640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd470010ca0 msgr2=0x7fd4700086a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:52:50.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:50.026+0000 7fd491246640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd470010ca0 0x7fd4700086a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:52:50.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:50.830+0000 7fd491246640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd470010ca0 msgr2=0x7fd4700086a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:52:50.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:50.830+0000 7fd490a45640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd4700115e0 legacy=0x7fd47000d040 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:52:50.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:50.830+0000 7fd491246640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd470010ca0 0x7fd4700086a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:52:52.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:52.418+0000 7fd482ffd640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd470010ca0 msgr2=0x7fd4700086a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:52:52.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:52.418+0000 7fd482ffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd470010ca0 0x7fd4700086a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:52:52.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:52.418+0000 7fd482ffd640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd4700115e0 legacy=0x7fd47000d040 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:52:52.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:52.418+0000 7fd482ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 0x7fd47000d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:52:52.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:52.418+0000 7fd491a47640 1 -- reap_dead start 2023-11-28T18:52:52.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:52.418+0000 7fd482ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd4700065b0 0x7fd470010640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:52:52.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:52.418+0000 7fd482ffd640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd48c0d2230 con 0x7fd4700079a0 2023-11-28T18:52:52.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:52.418+0000 7fd482ffd640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd48c0d3120 con 0x7fd4700065b0 2023-11-28T18:52:52.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:52.418+0000 7fd482ffd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd48c0d2780 con 0x7fd470014ad0 2023-11-28T18:52:52.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:52.418+0000 7fd491a47640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd4700065b0 msgr2=0x7fd470010640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:52:52.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:52.418+0000 7fd491a47640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd4700065b0 0x7fd470010640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:52:52.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:52.418+0000 7fd491246640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd4700079a0 legacy=0x7fd470012f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:52:52.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:52.418+0000 7fd490a45640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 msgr2=0x7fd47000d750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:52:52.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:52.418+0000 7fd490a45640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 0x7fd47000d750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:52:52.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:52.622+0000 7fd491a47640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd4700065b0 msgr2=0x7fd470010640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:52:52.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:52.622+0000 7fd491a47640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd4700065b0 0x7fd470010640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:52:52.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:52.622+0000 7fd490a45640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 msgr2=0x7fd47000d750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:52:52.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:52.622+0000 7fd491246640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd4700079a0 legacy=0x7fd470012f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:52:52.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:52.622+0000 7fd490a45640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 0x7fd47000d750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:52:53.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:53.026+0000 7fd491a47640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd4700065b0 msgr2=0x7fd470010640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:52:53.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:53.026+0000 7fd491a47640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd4700065b0 0x7fd470010640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:52:53.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:53.026+0000 7fd491246640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd4700079a0 legacy=0x7fd470012f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:52:53.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:53.026+0000 7fd490a45640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 msgr2=0x7fd47000d750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:52:53.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:53.026+0000 7fd490a45640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 0x7fd47000d750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:52:53.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:53.830+0000 7fd491a47640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd4700065b0 msgr2=0x7fd470010640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:52:53.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:53.830+0000 7fd491a47640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd4700065b0 0x7fd470010640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:52:53.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:53.830+0000 7fd490a45640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 msgr2=0x7fd47000d750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:52:53.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:53.830+0000 7fd491246640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd4700079a0 legacy=0x7fd470012f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:52:53.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:53.830+0000 7fd490a45640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 0x7fd47000d750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:52:55.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:55.418+0000 7fd482ffd640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 msgr2=0x7fd47000d750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:52:55.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:55.418+0000 7fd482ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 0x7fd47000d750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:52:55.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:55.418+0000 7fd482ffd640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd4700065b0 msgr2=0x7fd470010640 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:52:55.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:55.418+0000 7fd482ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd4700065b0 0x7fd470010640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:52:55.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:55.418+0000 7fd482ffd640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd4700079a0 legacy=0x7fd470012f80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:52:55.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:55.418+0000 7fd482ffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd4700082c0 0x7fd4700086a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:52:55.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:55.418+0000 7fd482ffd640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd48c0d2a60 con 0x7fd470010ca0 2023-11-28T18:52:55.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:55.418+0000 7fd482ffd640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd48c0d3120 con 0x7fd4700082c0 2023-11-28T18:52:55.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:55.418+0000 7fd491246640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd470010ca0 legacy=0x7fd47000d040 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:52:55.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:55.418+0000 7fd490a45640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd4700082c0 msgr2=0x7fd4700086a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:52:55.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:55.418+0000 7fd490a45640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd4700082c0 0x7fd4700086a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:52:55.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:55.622+0000 7fd491246640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd470010ca0 legacy=0x7fd47000d040 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:52:55.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:55.622+0000 7fd490a45640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd4700082c0 msgr2=0x7fd4700086a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:52:55.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:55.622+0000 7fd490a45640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd4700082c0 0x7fd4700086a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:52:56.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:56.026+0000 7fd491246640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd470010ca0 legacy=0x7fd47000d040 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:52:56.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:56.026+0000 7fd490a45640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd4700082c0 msgr2=0x7fd4700086a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:52:56.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:56.026+0000 7fd490a45640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd4700082c0 0x7fd4700086a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:52:56.466 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:52:56.471 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:52:56.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:56.830+0000 7fd491246640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd470010ca0 legacy=0x7fd47000d040 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:52:56.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:56.830+0000 7fd490a45640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd4700082c0 msgr2=0x7fd4700086a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:52:56.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:56.830+0000 7fd490a45640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd4700082c0 0x7fd4700086a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:52:58.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:58.418+0000 7fd482ffd640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd4700082c0 msgr2=0x7fd4700086a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:52:58.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:58.418+0000 7fd482ffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd4700082c0 0x7fd4700086a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:52:58.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:58.418+0000 7fd482ffd640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd470010ca0 legacy=0x7fd47000d040 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:52:58.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:58.418+0000 7fd482ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 0x7fd47000d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:52:58.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:58.418+0000 7fd491a47640 1 -- reap_dead start 2023-11-28T18:52:58.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:58.418+0000 7fd482ffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd4700065b0 0x7fd470010610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:52:58.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:58.418+0000 7fd482ffd640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd48c0d2230 con 0x7fd470006990 2023-11-28T18:52:58.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:58.418+0000 7fd482ffd640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd48c0d3120 con 0x7fd4700065b0 2023-11-28T18:52:58.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:58.418+0000 7fd482ffd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd48c0d2780 con 0x7fd470014ad0 2023-11-28T18:52:58.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:58.418+0000 7fd490a45640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd470006990 legacy=0x7fd4700056e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:52:58.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:58.418+0000 7fd491246640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 msgr2=0x7fd47000d750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:52:58.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:58.418+0000 7fd491a47640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd4700065b0 msgr2=0x7fd470010610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:52:58.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:58.418+0000 7fd491246640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 0x7fd47000d750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:52:58.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:58.418+0000 7fd491a47640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd4700065b0 0x7fd470010610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:52:58.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:58.622+0000 7fd490a45640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd470006990 legacy=0x7fd4700056e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:52:58.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:58.622+0000 7fd491a47640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd4700065b0 msgr2=0x7fd470010610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:52:58.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:58.622+0000 7fd491246640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 msgr2=0x7fd47000d750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:52:58.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:58.622+0000 7fd491a47640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd4700065b0 0x7fd470010610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:52:58.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:58.622+0000 7fd491246640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 0x7fd47000d750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:52:59.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:59.026+0000 7fd490a45640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd470006990 legacy=0x7fd4700056e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:52:59.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:59.026+0000 7fd491a47640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd4700065b0 msgr2=0x7fd470010610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:52:59.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:59.026+0000 7fd491246640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 msgr2=0x7fd47000d750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:52:59.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:59.026+0000 7fd491a47640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd4700065b0 0x7fd470010610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:52:59.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:59.026+0000 7fd491246640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 0x7fd47000d750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:52:59.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:59.830+0000 7fd490a45640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd470006990 legacy=0x7fd4700056e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:52:59.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:59.830+0000 7fd491a47640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd4700065b0 msgr2=0x7fd470010610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:52:59.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:59.830+0000 7fd491246640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 msgr2=0x7fd47000d750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:52:59.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:59.830+0000 7fd491a47640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd4700065b0 0x7fd470010610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:52:59.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:52:59.830+0000 7fd491246640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 0x7fd47000d750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:53:01.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:01.418+0000 7fd482ffd640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 msgr2=0x7fd47000d750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:53:01.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:01.418+0000 7fd482ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 0x7fd47000d750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:53:01.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:01.418+0000 7fd482ffd640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd4700065b0 msgr2=0x7fd470010610 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:53:01.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:01.418+0000 7fd482ffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd4700065b0 0x7fd470010610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:53:01.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:01.418+0000 7fd482ffd640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd470006990 legacy=0x7fd4700056e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:53:01.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:01.418+0000 7fd482ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd47000afc0 0x7fd47000b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:53:01.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:01.418+0000 7fd482ffd640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd48c0d2a60 con 0x7fd47000d040 2023-11-28T18:53:01.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:01.418+0000 7fd482ffd640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd48c0d3120 con 0x7fd47000afc0 2023-11-28T18:53:01.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:01.418+0000 7fd490a45640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd47000afc0 msgr2=0x7fd47000b470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:53:01.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:01.418+0000 7fd490a45640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd47000afc0 0x7fd47000b470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:53:01.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:01.418+0000 7fd491246640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd47000d040 legacy=0x7fd4700082c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:53:01.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:01.622+0000 7fd490a45640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd47000afc0 msgr2=0x7fd47000b470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:53:01.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:01.622+0000 7fd490a45640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd47000afc0 0x7fd47000b470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:53:01.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:01.622+0000 7fd491246640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd47000d040 legacy=0x7fd4700082c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:53:02.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:02.026+0000 7fd490a45640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd47000afc0 msgr2=0x7fd47000b470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:53:02.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:02.026+0000 7fd490a45640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd47000afc0 0x7fd47000b470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:53:02.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:02.026+0000 7fd491246640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd47000d040 legacy=0x7fd4700082c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:53:02.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:02.830+0000 7fd490a45640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd47000afc0 msgr2=0x7fd47000b470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:53:02.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:02.830+0000 7fd490a45640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd47000afc0 0x7fd47000b470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:53:02.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:02.830+0000 7fd491246640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd47000d040 legacy=0x7fd4700082c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:53:04.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:04.418+0000 7fd482ffd640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd47000afc0 msgr2=0x7fd47000b470 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:53:04.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:04.418+0000 7fd482ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd47000afc0 0x7fd47000b470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:53:04.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:04.418+0000 7fd482ffd640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd47000d040 legacy=0x7fd4700082c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:53:04.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:04.418+0000 7fd482ffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd4700065b0 0x7fd470010610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:53:04.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:04.418+0000 7fd482ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 0x7fd47000d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:53:04.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:04.418+0000 7fd491a47640 1 -- reap_dead start 2023-11-28T18:53:04.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:04.418+0000 7fd482ffd640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd48c0d2230 con 0x7fd470006990 2023-11-28T18:53:04.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:04.418+0000 7fd482ffd640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd48c0d3120 con 0x7fd4700065b0 2023-11-28T18:53:04.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:04.418+0000 7fd482ffd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd48c0d2780 con 0x7fd470014ad0 2023-11-28T18:53:04.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:04.418+0000 7fd491a47640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd470006990 legacy=0x7fd4700056e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:53:04.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:04.422+0000 7fd491246640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd4700065b0 msgr2=0x7fd470010610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:53:04.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:04.422+0000 7fd491246640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd4700065b0 0x7fd470010610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:53:04.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:04.422+0000 7fd490a45640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 msgr2=0x7fd47000d420 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:53:04.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:04.422+0000 7fd490a45640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 0x7fd47000d420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:53:04.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:04.622+0000 7fd491a47640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd470006990 legacy=0x7fd4700056e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:53:04.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:04.626+0000 7fd491246640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd4700065b0 msgr2=0x7fd470010610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:53:04.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:04.626+0000 7fd490a45640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 msgr2=0x7fd47000d420 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:53:04.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:04.626+0000 7fd491246640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd4700065b0 0x7fd470010610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:53:04.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:04.626+0000 7fd490a45640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 0x7fd47000d420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:53:05.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:05.026+0000 7fd491a47640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd470006990 legacy=0x7fd4700056e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:53:05.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:05.030+0000 7fd490a45640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 msgr2=0x7fd47000d420 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:53:05.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:05.030+0000 7fd491246640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd4700065b0 msgr2=0x7fd470010610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:53:05.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:05.030+0000 7fd490a45640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 0x7fd47000d420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:53:05.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:05.030+0000 7fd491246640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd4700065b0 0x7fd470010610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:53:05.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:05.830+0000 7fd491a47640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd470006990 legacy=0x7fd4700056e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:53:05.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:05.834+0000 7fd491246640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd4700065b0 msgr2=0x7fd470010610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:53:05.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:05.834+0000 7fd491246640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd4700065b0 0x7fd470010610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:53:05.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:05.834+0000 7fd490a45640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 msgr2=0x7fd47000d420 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:53:05.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:05.834+0000 7fd490a45640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 0x7fd47000d420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:53:07.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:07.418+0000 7fd482ffd640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 msgr2=0x7fd47000d420 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:53:07.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:07.418+0000 7fd482ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 0x7fd47000d420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:53:07.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:07.418+0000 7fd482ffd640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd4700065b0 msgr2=0x7fd470010610 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:53:07.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:07.418+0000 7fd482ffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd4700065b0 0x7fd470010610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:53:07.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:07.418+0000 7fd482ffd640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd470006990 legacy=0x7fd4700056e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:53:07.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:07.422+0000 7fd482ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd47000afc0 0x7fd47000b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:53:07.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:07.422+0000 7fd482ffd640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd48c0d2a60 con 0x7fd47000d040 2023-11-28T18:53:07.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:07.422+0000 7fd482ffd640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd48c0d3120 con 0x7fd47000afc0 2023-11-28T18:53:07.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:07.422+0000 7fd491246640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd47000afc0 msgr2=0x7fd47000b470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:53:07.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:07.422+0000 7fd491246640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd47000afc0 0x7fd47000b470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:53:07.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:07.422+0000 7fd490a45640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd47000d040 legacy=0x7fd4700082c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:53:07.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:07.626+0000 7fd491246640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd47000afc0 msgr2=0x7fd47000b470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:53:07.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:07.626+0000 7fd491246640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd47000afc0 0x7fd47000b470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:53:07.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:07.626+0000 7fd490a45640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd47000d040 legacy=0x7fd4700082c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:53:08.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:08.030+0000 7fd491246640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd47000afc0 msgr2=0x7fd47000b470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:53:08.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:08.030+0000 7fd491246640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd47000afc0 0x7fd47000b470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:53:08.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:08.030+0000 7fd490a45640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd47000d040 legacy=0x7fd4700082c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:53:08.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:08.834+0000 7fd491246640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd47000afc0 msgr2=0x7fd47000b470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:53:08.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:08.834+0000 7fd491246640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd47000afc0 0x7fd47000b470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:53:08.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:08.834+0000 7fd490a45640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd47000d040 legacy=0x7fd4700082c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:53:10.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:10.422+0000 7fd482ffd640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd47000afc0 msgr2=0x7fd47000b470 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:53:10.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:10.422+0000 7fd482ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd47000afc0 0x7fd47000b470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:53:10.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:10.422+0000 7fd482ffd640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd47000d040 legacy=0x7fd4700082c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:53:10.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:10.422+0000 7fd482ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd47000c9c0 0x7fd47000f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:53:10.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:10.422+0000 7fd482ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 0x7fd47000d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:53:10.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:10.422+0000 7fd491a47640 1 -- reap_dead start 2023-11-28T18:53:10.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:10.422+0000 7fd482ffd640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd48c0d2230 con 0x7fd470006990 2023-11-28T18:53:10.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:10.422+0000 7fd482ffd640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd48c0d3120 con 0x7fd47000c9c0 2023-11-28T18:53:10.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:10.422+0000 7fd482ffd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd48c0d2780 con 0x7fd470014ad0 2023-11-28T18:53:10.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:10.422+0000 7fd491a47640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd470006990 legacy=0x7fd4700056e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:53:10.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:10.422+0000 7fd491246640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd47000c9c0 msgr2=0x7fd47000f970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:53:10.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:10.422+0000 7fd491246640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd47000c9c0 0x7fd47000f970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:53:10.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:10.422+0000 7fd490a45640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 msgr2=0x7fd47000d420 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:53:10.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:10.422+0000 7fd490a45640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 0x7fd47000d420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:53:10.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:10.626+0000 7fd491a47640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd470006990 legacy=0x7fd4700056e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:53:10.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:10.626+0000 7fd491246640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd47000c9c0 msgr2=0x7fd47000f970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:53:10.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:10.626+0000 7fd491246640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd47000c9c0 0x7fd47000f970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:53:10.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:10.626+0000 7fd490a45640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 msgr2=0x7fd47000d420 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:53:10.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:10.626+0000 7fd490a45640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 0x7fd47000d420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:53:11.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:11.030+0000 7fd491a47640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd470006990 legacy=0x7fd4700056e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:53:11.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:11.030+0000 7fd491246640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd47000c9c0 msgr2=0x7fd47000f970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:53:11.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:11.030+0000 7fd491246640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd47000c9c0 0x7fd47000f970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:53:11.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:11.030+0000 7fd490a45640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 msgr2=0x7fd47000d420 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:53:11.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:11.030+0000 7fd490a45640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 0x7fd47000d420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:53:11.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:11.834+0000 7fd491246640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd47000c9c0 msgr2=0x7fd47000f970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:53:11.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:11.834+0000 7fd491a47640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd470006990 legacy=0x7fd4700056e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:53:11.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:11.834+0000 7fd491246640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd47000c9c0 0x7fd47000f970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:53:11.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:11.834+0000 7fd490a45640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 msgr2=0x7fd47000d420 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:53:11.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:11.834+0000 7fd490a45640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 0x7fd47000d420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:53:13.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:13.422+0000 7fd482ffd640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 msgr2=0x7fd47000d420 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:53:13.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:13.422+0000 7fd482ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd470014ad0 0x7fd47000d420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:53:13.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:13.422+0000 7fd482ffd640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd47000c9c0 msgr2=0x7fd47000f970 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:53:13.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:13.422+0000 7fd482ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd47000c9c0 0x7fd47000f970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:53:13.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:13.422+0000 7fd482ffd640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd470006990 legacy=0x7fd4700056e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:53:13.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:13.422+0000 7fd482ffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd4700065b0 0x7fd47000b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:53:13.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:13.422+0000 7fd482ffd640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd48c0d2a60 con 0x7fd470010610 2023-11-28T18:53:13.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:13.422+0000 7fd482ffd640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd48c0d3120 con 0x7fd4700065b0 2023-11-28T18:53:13.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:13.422+0000 7fd490a45640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd470010610 legacy=0x7fd4700082c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:53:13.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:13.422+0000 7fd491246640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd4700065b0 msgr2=0x7fd47000b470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:53:13.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:13.422+0000 7fd491246640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd4700065b0 0x7fd47000b470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:53:13.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:13.626+0000 7fd490a45640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd470010610 legacy=0x7fd4700082c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:53:13.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:13.626+0000 7fd491246640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd4700065b0 msgr2=0x7fd47000b470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:53:13.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:13.626+0000 7fd491246640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd4700065b0 0x7fd47000b470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:53:14.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:14.030+0000 7fd490a45640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd470010610 legacy=0x7fd4700082c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:53:14.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:14.030+0000 7fd491246640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd4700065b0 msgr2=0x7fd47000b470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:53:14.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:14.030+0000 7fd491246640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd4700065b0 0x7fd47000b470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:53:14.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:14.834+0000 7fd491246640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd4700065b0 msgr2=0x7fd47000b470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:53:14.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:14.834+0000 7fd490a45640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd470010610 legacy=0x7fd4700082c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:53:14.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:14.834+0000 7fd491246640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd4700065b0 0x7fd47000b470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:53:16.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:16.422+0000 7fd482ffd640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd4700065b0 msgr2=0x7fd47000b470 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:53:16.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:16.422+0000 7fd482ffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd4700065b0 0x7fd47000b470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:53:16.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:16.422+0000 7fd482ffd640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd470010610 legacy=0x7fd4700082c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:53:16.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:16.422+0000 7fd482ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd47000c9c0 0x7fd47000f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:53:16.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:16.422+0000 7fd482ffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd470013f80 0x7fd470014400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:53:16.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:16.422+0000 7fd491a47640 1 -- reap_dead start 2023-11-28T18:53:16.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:16.422+0000 7fd482ffd640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd48c0d2230 con 0x7fd470006990 2023-11-28T18:53:16.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:16.422+0000 7fd482ffd640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd48c0d3120 con 0x7fd47000c9c0 2023-11-28T18:53:16.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:16.422+0000 7fd482ffd640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd48c0d2780 con 0x7fd470013f80 2023-11-28T18:53:16.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:16.422+0000 7fd491246640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd47000c9c0 msgr2=0x7fd47000f970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:53:16.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:16.422+0000 7fd490a45640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd470006990 legacy=0x7fd470005670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:53:16.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:16.422+0000 7fd491246640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd47000c9c0 0x7fd47000f970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:53:16.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:16.422+0000 7fd491a47640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd470013f80 msgr2=0x7fd470014400 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:53:16.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:16.422+0000 7fd491a47640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd470013f80 0x7fd470014400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:53:16.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:16.626+0000 7fd490a45640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd470006990 legacy=0x7fd470005670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:53:16.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:16.626+0000 7fd491246640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd47000c9c0 msgr2=0x7fd47000f970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:53:16.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:16.626+0000 7fd491246640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd47000c9c0 0x7fd47000f970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:53:16.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:16.626+0000 7fd491a47640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd470013f80 msgr2=0x7fd470014400 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:53:16.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:16.626+0000 7fd491a47640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd470013f80 0x7fd470014400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:53:17.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:17.030+0000 7fd490a45640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd470006990 legacy=0x7fd470005670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:53:17.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:17.030+0000 7fd491246640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd47000c9c0 msgr2=0x7fd47000f970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:53:17.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:17.030+0000 7fd491246640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd47000c9c0 0x7fd47000f970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:53:17.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:17.030+0000 7fd491a47640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd470013f80 msgr2=0x7fd470014400 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:53:17.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:17.030+0000 7fd491a47640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd470013f80 0x7fd470014400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:53:17.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:17.834+0000 7fd490a45640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd470006990 legacy=0x7fd470005670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:53:17.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:17.834+0000 7fd491246640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd47000c9c0 msgr2=0x7fd47000f970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:53:17.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:17.834+0000 7fd491246640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd47000c9c0 0x7fd47000f970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:53:17.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:17.834+0000 7fd491a47640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd470013f80 msgr2=0x7fd470014400 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:53:17.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:17.834+0000 7fd491a47640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd470013f80 0x7fd470014400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:53:19.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:19.421+0000 7fd482ffd640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd470013f80 msgr2=0x7fd470014400 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:53:19.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:19.421+0000 7fd482ffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd470013f80 0x7fd470014400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:53:19.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:19.421+0000 7fd482ffd640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd47000c9c0 msgr2=0x7fd47000f970 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:53:19.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:19.421+0000 7fd482ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd47000c9c0 0x7fd47000f970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:53:19.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:19.421+0000 7fd482ffd640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd470006990 legacy=0x7fd470005670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:53:19.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:19.421+0000 7fd482ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd47000b470 0x7fd47000f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:53:19.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:19.421+0000 7fd482ffd640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd48c0d2a60 con 0x7fd470014940 2023-11-28T18:53:19.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:19.421+0000 7fd482ffd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd48c0d3120 con 0x7fd47000b470 2023-11-28T18:53:19.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:19.421+0000 7fd490a45640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd470014940 legacy=0x7fd4700082c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:53:19.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:19.421+0000 7fd491246640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd47000b470 msgr2=0x7fd47000f430 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:53:19.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:19.421+0000 7fd491246640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd47000b470 0x7fd47000f430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:53:19.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:19.625+0000 7fd490a45640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd470014940 legacy=0x7fd4700082c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:53:19.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:19.625+0000 7fd491246640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd47000b470 msgr2=0x7fd47000f430 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:53:19.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:19.625+0000 7fd491246640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd47000b470 0x7fd47000f430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:53:20.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:20.029+0000 7fd490a45640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd470014940 legacy=0x7fd4700082c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:53:20.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:20.029+0000 7fd491246640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd47000b470 msgr2=0x7fd47000f430 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:53:20.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:20.029+0000 7fd491246640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd47000b470 0x7fd47000f430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:53:20.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:20.833+0000 7fd491246640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd47000b470 msgr2=0x7fd47000f430 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:53:20.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:20.833+0000 7fd490a45640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd470014940 legacy=0x7fd4700082c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:53:20.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:20.833+0000 7fd491246640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd47000b470 0x7fd47000f430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:53:22.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:22.421+0000 7fd482ffd640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd47000b470 msgr2=0x7fd47000f430 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:53:22.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:22.421+0000 7fd482ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd47000b470 0x7fd47000f430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:53:22.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:22.421+0000 7fd482ffd640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd470014940 legacy=0x7fd4700082c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:53:22.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:22.421+0000 7fd482ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd47000c9c0 0x7fd47000f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:53:22.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:22.421+0000 7fd491a47640 1 -- reap_dead start 2023-11-28T18:53:22.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:22.421+0000 7fd482ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd47000b470 0x7fd47000f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:53:22.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:22.421+0000 7fd482ffd640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd48c0d2230 con 0x7fd470006990 2023-11-28T18:53:22.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:22.421+0000 7fd482ffd640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd48c0d3120 con 0x7fd47000c9c0 2023-11-28T18:53:22.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:22.421+0000 7fd482ffd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd48c0d2780 con 0x7fd47000b470 2023-11-28T18:53:22.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:22.421+0000 7fd491246640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd47000c9c0 msgr2=0x7fd47000f970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:53:22.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:22.421+0000 7fd490a45640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd470006990 legacy=0x7fd47000b8f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:53:22.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:22.421+0000 7fd491246640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd47000c9c0 0x7fd47000f970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:53:22.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:22.421+0000 7fd491a47640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd47000b470 msgr2=0x7fd47000f430 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:53:22.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:22.421+0000 7fd491a47640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd47000b470 0x7fd47000f430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:53:22.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:22.625+0000 7fd490a45640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd470006990 legacy=0x7fd47000b8f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:53:22.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:22.625+0000 7fd491246640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd47000c9c0 msgr2=0x7fd47000f970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:53:22.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:22.625+0000 7fd491246640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd47000c9c0 0x7fd47000f970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:53:22.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:22.625+0000 7fd491a47640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd47000b470 msgr2=0x7fd47000f430 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:53:22.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:22.625+0000 7fd491a47640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd47000b470 0x7fd47000f430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:53:23.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:23.029+0000 7fd490a45640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd470006990 legacy=0x7fd47000b8f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:53:23.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:23.029+0000 7fd491246640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd47000c9c0 msgr2=0x7fd47000f970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:53:23.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:23.029+0000 7fd491246640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd47000c9c0 0x7fd47000f970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:53:23.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:23.029+0000 7fd491a47640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd47000b470 msgr2=0x7fd47000f430 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:53:23.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:23.029+0000 7fd491a47640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd47000b470 0x7fd47000f430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:53:23.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:23.833+0000 7fd490a45640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd470006990 legacy=0x7fd47000b8f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:53:23.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:23.833+0000 7fd491246640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd47000c9c0 msgr2=0x7fd47000f970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:53:23.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:23.833+0000 7fd491246640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd47000c9c0 0x7fd47000f970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:53:23.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:23.833+0000 7fd491a47640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd47000b470 msgr2=0x7fd47000f430 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:53:23.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:23.833+0000 7fd491a47640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd47000b470 0x7fd47000f430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:53:25.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:25.421+0000 7fd482ffd640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd47000b470 msgr2=0x7fd47000f430 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:53:25.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:25.421+0000 7fd482ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd47000b470 0x7fd47000f430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:53:25.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:25.421+0000 7fd482ffd640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd47000c9c0 msgr2=0x7fd47000f970 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:53:25.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:25.421+0000 7fd482ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd47000c9c0 0x7fd47000f970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:53:25.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:25.421+0000 7fd482ffd640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd470006990 legacy=0x7fd47000b8f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:53:25.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:25.421+0000 7fd482ffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd47000c000 0x7fd47000c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:53:25.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:25.421+0000 7fd482ffd640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd48c0d2a60 con 0x7fd470013f80 2023-11-28T18:53:25.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:25.421+0000 7fd482ffd640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd48c0d3120 con 0x7fd47000c000 2023-11-28T18:53:25.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:25.421+0000 7fd491246640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd470013f80 legacy=0x7fd4700082c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:53:25.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:25.421+0000 7fd490a45640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd47000c000 msgr2=0x7fd47000c460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:53:25.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:25.421+0000 7fd490a45640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd47000c000 0x7fd47000c460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:53:25.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:25.625+0000 7fd490a45640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd47000c000 msgr2=0x7fd47000c460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:53:25.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:25.625+0000 7fd491246640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd470013f80 legacy=0x7fd4700082c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:53:25.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:25.625+0000 7fd490a45640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd47000c000 0x7fd47000c460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:53:26.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:26.029+0000 7fd490a45640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd47000c000 msgr2=0x7fd47000c460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:53:26.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:26.029+0000 7fd491246640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd470013f80 legacy=0x7fd4700082c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:53:26.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:26.029+0000 7fd490a45640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd47000c000 0x7fd47000c460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:53:26.544 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:53:26.550 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:53:26.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:26.833+0000 7fd490a45640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd47000c000 msgr2=0x7fd47000c460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:53:26.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:26.833+0000 7fd491246640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd470013f80 legacy=0x7fd4700082c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:53:26.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:26.833+0000 7fd490a45640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd47000c000 0x7fd47000c460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:53:28.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:28.421+0000 7fd482ffd640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd47000c000 msgr2=0x7fd47000c460 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:53:28.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:28.421+0000 7fd482ffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd47000c000 0x7fd47000c460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:53:28.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:28.421+0000 7fd482ffd640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd470013f80 legacy=0x7fd4700082c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:53:28.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:28.421+0000 7fd482ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd47000c9c0 0x7fd47000f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:53:28.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:28.421+0000 7fd491a47640 1 -- reap_dead start 2023-11-28T18:53:28.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:28.421+0000 7fd482ffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd47000b470 0x7fd47000c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:53:28.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:28.421+0000 7fd482ffd640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd48c0d2230 con 0x7fd470006990 2023-11-28T18:53:28.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:28.421+0000 7fd482ffd640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd48c0d3120 con 0x7fd47000c9c0 2023-11-28T18:53:28.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:28.421+0000 7fd482ffd640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd48c0d2780 con 0x7fd47000b470 2023-11-28T18:53:28.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:28.421+0000 7fd491246640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd470006990 legacy=0x7fd47000b8f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:53:28.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:28.421+0000 7fd490a45640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd47000c9c0 msgr2=0x7fd47000f970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:53:28.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:28.421+0000 7fd490a45640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd47000c9c0 0x7fd47000f970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:53:28.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:28.421+0000 7fd491a47640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd47000b470 msgr2=0x7fd47000c440 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:53:28.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:28.421+0000 7fd491a47640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd47000b470 0x7fd47000c440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:53:28.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:28.625+0000 7fd490a45640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd47000c9c0 msgr2=0x7fd47000f970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:53:28.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:28.625+0000 7fd490a45640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd47000c9c0 0x7fd47000f970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:53:28.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:28.625+0000 7fd491246640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd470006990 legacy=0x7fd47000b8f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:53:28.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:28.625+0000 7fd491a47640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd47000b470 msgr2=0x7fd47000c440 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:53:28.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:28.625+0000 7fd491a47640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd47000b470 0x7fd47000c440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:53:29.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:29.029+0000 7fd490a45640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd47000c9c0 msgr2=0x7fd47000f970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:53:29.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:29.029+0000 7fd491246640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd470006990 legacy=0x7fd47000b8f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:53:29.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:29.029+0000 7fd490a45640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd47000c9c0 0x7fd47000f970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:53:29.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:29.029+0000 7fd491a47640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd47000b470 msgr2=0x7fd47000c440 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:53:29.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:29.029+0000 7fd491a47640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd47000b470 0x7fd47000c440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:53:29.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:29.833+0000 7fd490a45640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd47000c9c0 msgr2=0x7fd47000f970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:53:29.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:29.833+0000 7fd490a45640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd47000c9c0 0x7fd47000f970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:53:29.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:29.833+0000 7fd491246640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd470006990 legacy=0x7fd47000b8f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:53:29.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:29.833+0000 7fd491a47640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd47000b470 msgr2=0x7fd47000c440 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:53:29.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:29.833+0000 7fd491a47640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd47000b470 0x7fd47000c440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:53:31.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:31.421+0000 7fd482ffd640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd47000b470 msgr2=0x7fd47000c440 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:53:31.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:31.421+0000 7fd482ffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd47000b470 0x7fd47000c440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:53:31.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:31.421+0000 7fd482ffd640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd47000c9c0 msgr2=0x7fd47000f970 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:53:31.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:31.421+0000 7fd482ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd47000c9c0 0x7fd47000f970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:53:31.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:31.421+0000 7fd482ffd640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd470006990 legacy=0x7fd47000b8f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:53:31.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:31.421+0000 7fd482ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd47000c000 0x7fd47000f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:53:31.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:31.421+0000 7fd482ffd640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd48c0d2a60 con 0x7fd470013f80 2023-11-28T18:53:31.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:31.421+0000 7fd482ffd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd48c0d3120 con 0x7fd47000c000 2023-11-28T18:53:31.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:31.421+0000 7fd490a45640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd470013f80 legacy=0x7fd4700082c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:53:31.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:31.421+0000 7fd491246640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd47000c000 msgr2=0x7fd47000f430 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:53:31.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:31.421+0000 7fd491246640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd47000c000 0x7fd47000f430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:53:31.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:31.625+0000 7fd490a45640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd470013f80 legacy=0x7fd4700082c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:53:31.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:31.625+0000 7fd491246640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd47000c000 msgr2=0x7fd47000f430 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:53:31.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:31.625+0000 7fd491246640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd47000c000 0x7fd47000f430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:53:32.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:32.029+0000 7fd490a45640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd470013f80 legacy=0x7fd4700082c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:53:32.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:32.029+0000 7fd491246640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd47000c000 msgr2=0x7fd47000f430 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:53:32.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:32.029+0000 7fd491246640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd47000c000 0x7fd47000f430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:53:32.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:32.833+0000 7fd490a45640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd470013f80 legacy=0x7fd4700082c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:53:32.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:32.833+0000 7fd491246640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd47000c000 msgr2=0x7fd47000f430 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:53:32.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:32.833+0000 7fd491246640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd47000c000 0x7fd47000f430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:53:34.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:34.421+0000 7fd482ffd640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd47000c000 msgr2=0x7fd47000f430 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:53:34.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:34.421+0000 7fd482ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd47000c000 0x7fd47000f430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:53:34.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:34.421+0000 7fd482ffd640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd470013f80 legacy=0x7fd4700082c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:53:34.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:34.421+0000 7fd491a47640 1 -- reap_dead start 2023-11-28T18:53:34.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:34.421+0000 7fd482ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700143e0 0x7fd4700147c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:53:34.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:34.421+0000 7fd482ffd640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd48c0d2230 con 0x7fd470006990 2023-11-28T18:53:34.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:34.421+0000 7fd482ffd640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd48c0d2a60 con 0x7fd470013f80 2023-11-28T18:53:34.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:34.421+0000 7fd482ffd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd48c0d3120 con 0x7fd4700143e0 2023-11-28T18:53:34.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:34.421+0000 7fd491a47640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd470006990 legacy=0x7fd47000b850 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:53:34.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:34.421+0000 7fd490a45640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd470013f80 legacy=0x7fd4700082c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:53:34.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:34.421+0000 7fd491246640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700143e0 msgr2=0x7fd4700147c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:53:34.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:34.421+0000 7fd491246640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700143e0 0x7fd4700147c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:53:34.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:34.625+0000 7fd491a47640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd470006990 legacy=0x7fd47000b850 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:53:34.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:34.625+0000 7fd490a45640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd470013f80 legacy=0x7fd4700082c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:53:34.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:34.625+0000 7fd491246640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700143e0 msgr2=0x7fd4700147c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:53:34.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:34.625+0000 7fd491246640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700143e0 0x7fd4700147c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:53:35.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:35.029+0000 7fd491a47640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd470006990 legacy=0x7fd47000b850 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:53:35.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:35.029+0000 7fd490a45640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd470013f80 legacy=0x7fd4700082c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:53:35.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:35.029+0000 7fd491246640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700143e0 msgr2=0x7fd4700147c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:53:35.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:35.029+0000 7fd491246640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700143e0 0x7fd4700147c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:53:35.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:35.833+0000 7fd491a47640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd470006990 legacy=0x7fd47000b850 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.45:6789/0 2023-11-28T18:53:35.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:35.833+0000 7fd491246640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700143e0 msgr2=0x7fd4700147c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3301/0 2023-11-28T18:53:35.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:35.833+0000 7fd490a45640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd470013f80 legacy=0x7fd4700082c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.190:6789/0 2023-11-28T18:53:35.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:35.833+0000 7fd491246640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700143e0 0x7fd4700147c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:53:37.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:37.421+0000 7fd482ffd640 1 -- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700143e0 msgr2=0x7fd4700147c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:53:37.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:37.421+0000 7fd482ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd4700143e0 0x7fd4700147c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T18:53:37.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:37.421+0000 7fd482ffd640 1 -- >> v1:172.21.15.190:6789/0 conn(0x7fd470013f80 legacy=0x7fd4700082c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:53:37.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:37.421+0000 7fd482ffd640 1 -- >> v1:172.21.15.45:6789/0 conn(0x7fd470006990 legacy=0x7fd47000b850 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T18:53:37.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:37.421+0000 7fd482ffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd47000c9c0 0x7fd47000c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:53:37.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:37.421+0000 7fd482ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd47000b470 0x7fd47000e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T18:53:37.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:37.421+0000 7fd482ffd640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd48c0d3120 con 0x7fd47000b470 2023-11-28T18:53:37.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:37.421+0000 7fd482ffd640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd48c0d2780 con 0x7fd47000c9c0 2023-11-28T18:53:37.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:37.421+0000 7fd490a45640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd47000b470 msgr2=0x7fd47000e430 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:53:37.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:37.421+0000 7fd490a45640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd47000b470 0x7fd47000e430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:53:37.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:37.421+0000 7fd491246640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd47000c9c0 msgr2=0x7fd47000c440 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:53:37.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:37.421+0000 7fd491246640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd47000c9c0 0x7fd47000c440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T18:53:37.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:37.625+0000 7fd490a45640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd47000b470 msgr2=0x7fd47000e430 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:53:37.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:37.625+0000 7fd490a45640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd47000b470 0x7fd47000e430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:53:37.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:37.625+0000 7fd491246640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd47000c9c0 msgr2=0x7fd47000c440 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:53:37.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:37.625+0000 7fd491246640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd47000c9c0 0x7fd47000c440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T18:53:38.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:38.029+0000 7fd490a45640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd47000b470 msgr2=0x7fd47000e430 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:53:38.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:38.029+0000 7fd490a45640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd47000b470 0x7fd47000e430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:53:38.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:38.029+0000 7fd491246640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd47000c9c0 msgr2=0x7fd47000c440 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:53:38.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:38.029+0000 7fd491246640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd47000c9c0 0x7fd47000c440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T18:53:38.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:38.833+0000 7fd490a45640 1 -- >> v2:172.21.15.45:3300/0 conn(0x7fd47000b470 msgr2=0x7fd47000e430 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.45:3300/0 2023-11-28T18:53:38.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:38.833+0000 7fd490a45640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd47000b470 0x7fd47000e430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:53:38.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:38.833+0000 7fd491246640 1 -- >> v2:172.21.15.190:3300/0 conn(0x7fd47000c9c0 msgr2=0x7fd47000c440 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.190:3300/0 2023-11-28T18:53:38.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T18:53:38.833+0000 7fd491246640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd47000c9c0 0x7fd47000c440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T18:53:40.288 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-11-28T18:53:40.288 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi045 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-11-28T18:53:40.301 INFO:teuthology.misc:Shutting down mds daemons... 2023-11-28T18:53:40.302 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-28T18:53:40.302 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T18:53:40.305 INFO:tasks.ceph.mds.a:Stopped 2023-11-28T18:53:40.305 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-28T18:53:40.305 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T18:53:40.306 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T18:53:40.306 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi045 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi045 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c' 2023-11-28T18:53:40.324 INFO:tasks.ceph.mds.c:Stopped 2023-11-28T18:53:40.324 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-28T18:53:40.324 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T18:53:40.324 INFO:tasks.ceph.mds.b:Stopped 2023-11-28T18:53:40.325 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-28T18:53:40.325 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T18:53:40.325 INFO:tasks.ceph.mds.d:Stopped 2023-11-28T18:53:40.325 INFO:teuthology.misc:Shutting down osd daemons... 2023-11-28T18:53:40.325 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-11-28T18:53:40.325 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T18:53:40.326 INFO:tasks.ceph.osd.0:Stopped 2023-11-28T18:53:40.326 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-11-28T18:53:40.326 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T18:53:40.326 INFO:tasks.ceph.osd.1:Stopped 2023-11-28T18:53:40.326 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-11-28T18:53:40.327 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T18:53:40.327 INFO:tasks.ceph.osd.2:Stopped 2023-11-28T18:53:40.327 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-11-28T18:53:40.327 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T18:53:40.327 INFO:tasks.ceph.osd.3:Stopped 2023-11-28T18:53:40.327 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-11-28T18:53:40.327 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T18:53:40.328 INFO:tasks.ceph.osd.4:Stopped 2023-11-28T18:53:40.328 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-11-28T18:53:40.328 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T18:53:40.330 INFO:tasks.ceph.osd.5:Stopped 2023-11-28T18:53:40.330 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-11-28T18:53:40.330 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T18:53:40.330 INFO:tasks.ceph.osd.6:Stopped 2023-11-28T18:53:40.331 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-11-28T18:53:40.331 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T18:53:40.331 INFO:tasks.ceph.osd.7:Stopped 2023-11-28T18:53:40.331 INFO:teuthology.misc:Shutting down mgr daemons... 2023-11-28T18:53:40.331 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-11-28T18:53:40.331 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T18:53:40.332 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T18:53:40.332 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi045 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi045 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y' 2023-11-28T18:53:40.342 INFO:tasks.ceph.mgr.y:Stopped 2023-11-28T18:53:40.343 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-11-28T18:53:40.343 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T18:53:40.343 INFO:tasks.ceph.mgr.x:Stopped 2023-11-28T18:53:40.343 INFO:teuthology.misc:Shutting down mon daemons... 2023-11-28T18:53:40.344 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-11-28T18:53:40.344 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T18:53:40.344 INFO:tasks.ceph.mon.a:Stopped 2023-11-28T18:53:40.344 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-11-28T18:53:40.344 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T18:53:40.345 INFO:tasks.ceph.mon.b:Stopped 2023-11-28T18:53:40.345 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-11-28T18:53:40.345 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T18:53:40.345 INFO:tasks.ceph.mon.c:Stopped 2023-11-28T18:53:40.345 INFO:tasks.ceph:Checking cluster log for badness... 2023-11-28T18:53:40.346 DEBUG:teuthology.orchestra.run.smithi045:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'bad backtrace on directory inode' | egrep -v 'error reading table object' | egrep -v 'Metadata damage detected' | egrep -v 'slow requests are blocked' | egrep -v 'Behind on trimming' | egrep -v 'error reading sessionmap' | head -n 1 2023-11-28T18:53:40.386 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi045.front.sepia.ceph.com 2023-11-28T18:53:40.386 DEBUG:teuthology.orchestra.run.smithi045:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-11-28T18:53:40.591 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi045.front.sepia.ceph.com 2023-11-28T18:53:40.591 DEBUG:teuthology.orchestra.run.smithi045:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-11-28T18:53:40.756 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi045.front.sepia.ceph.com 2023-11-28T18:53:40.756 DEBUG:teuthology.orchestra.run.smithi045:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-11-28T18:53:40.898 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi045.front.sepia.ceph.com 2023-11-28T18:53:40.898 DEBUG:teuthology.orchestra.run.smithi045:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-11-28T18:53:41.061 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi190.front.sepia.ceph.com 2023-11-28T18:53:41.062 DEBUG:teuthology.orchestra.run.smithi190:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-11-28T18:53:41.267 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi190.front.sepia.ceph.com 2023-11-28T18:53:41.267 DEBUG:teuthology.orchestra.run.smithi190:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-11-28T18:53:41.448 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi190.front.sepia.ceph.com 2023-11-28T18:53:41.448 DEBUG:teuthology.orchestra.run.smithi190:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-11-28T18:53:41.633 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi190.front.sepia.ceph.com 2023-11-28T18:53:41.634 DEBUG:teuthology.orchestra.run.smithi190:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-11-28T18:53:41.808 INFO:tasks.ceph:Archiving mon data... 2023-11-28T18:53:41.810 DEBUG:teuthology.misc:Transferring archived files from smithi045:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/vshankar-2023-11-28_06:23:42-fs-wip-vshankar-testing-20231127.102654-testing-default-smithi/7469486/data/mon.a.tgz 2023-11-28T18:53:41.810 DEBUG:teuthology.orchestra.run.smithi045:> mktemp 2023-11-28T18:53:41.821 INFO:teuthology.orchestra.run.smithi045.stdout:/tmp/tmp.pWppzNlCZm 2023-11-28T18:53:41.821 DEBUG:teuthology.orchestra.run.smithi045:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.pWppzNlCZm 2023-11-28T18:53:41.949 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 0666 /tmp/tmp.pWppzNlCZm 2023-11-28T18:53:42.026 DEBUG:teuthology.orchestra.remote:smithi045:/tmp/tmp.pWppzNlCZm is 272KB 2023-11-28T18:53:42.103 DEBUG:teuthology.orchestra.run.smithi045:> rm -fr /tmp/tmp.pWppzNlCZm 2023-11-28T18:53:42.112 DEBUG:teuthology.misc:Transferring archived files from smithi190:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/vshankar-2023-11-28_06:23:42-fs-wip-vshankar-testing-20231127.102654-testing-default-smithi/7469486/data/mon.b.tgz 2023-11-28T18:53:42.112 DEBUG:teuthology.orchestra.run.smithi190:> mktemp 2023-11-28T18:53:42.123 INFO:teuthology.orchestra.run.smithi190.stdout:/tmp/tmp.ZBZlzZSTD5 2023-11-28T18:53:42.125 DEBUG:teuthology.orchestra.run.smithi190:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.ZBZlzZSTD5 2023-11-28T18:53:42.244 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod 0666 /tmp/tmp.ZBZlzZSTD5 2023-11-28T18:53:42.323 DEBUG:teuthology.orchestra.remote:smithi190:/tmp/tmp.ZBZlzZSTD5 is 276KB 2023-11-28T18:53:42.394 DEBUG:teuthology.orchestra.run.smithi190:> rm -fr /tmp/tmp.ZBZlzZSTD5 2023-11-28T18:53:42.403 DEBUG:teuthology.misc:Transferring archived files from smithi190:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2023-11-28_06:23:42-fs-wip-vshankar-testing-20231127.102654-testing-default-smithi/7469486/data/mon.c.tgz 2023-11-28T18:53:42.404 DEBUG:teuthology.orchestra.run.smithi190:> mktemp 2023-11-28T18:53:42.455 INFO:teuthology.orchestra.run.smithi190.stdout:/tmp/tmp.kGRV18soE4 2023-11-28T18:53:42.455 DEBUG:teuthology.orchestra.run.smithi190:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.kGRV18soE4 2023-11-28T18:53:42.573 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod 0666 /tmp/tmp.kGRV18soE4 2023-11-28T18:53:42.648 DEBUG:teuthology.orchestra.remote:smithi190:/tmp/tmp.kGRV18soE4 is 276KB 2023-11-28T18:53:42.725 DEBUG:teuthology.orchestra.run.smithi190:> rm -fr /tmp/tmp.kGRV18soE4 2023-11-28T18:53:42.733 INFO:tasks.ceph:Cleaning ceph cluster... 2023-11-28T18:53:42.734 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-28T18:53:42.738 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-28T18:53:42.794 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-11-28T18:53:42.794 DEBUG:teuthology.orchestra.run.smithi045:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-28T18:53:42.808 DEBUG:teuthology.orchestra.run.smithi190:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-28T18:53:42.838 INFO:teuthology.orchestra.run.smithi045.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-28T18:53:42.872 INFO:teuthology.orchestra.run.smithi190.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-28T18:53:42.878 INFO:tasks.ceph:Archiving crash dumps... 2023-11-28T18:53:42.881 DEBUG:teuthology.misc:Transferring archived files from smithi045:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2023-11-28_06:23:42-fs-wip-vshankar-testing-20231127.102654-testing-default-smithi/7469486/remote/smithi045/crash 2023-11-28T18:53:42.883 DEBUG:teuthology.orchestra.run.smithi045:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-28T18:53:42.963 DEBUG:teuthology.misc:Transferring archived files from smithi190:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2023-11-28_06:23:42-fs-wip-vshankar-testing-20231127.102654-testing-default-smithi/7469486/remote/smithi190/crash 2023-11-28T18:53:42.964 DEBUG:teuthology.orchestra.run.smithi190:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-28T18:53:42.984 INFO:tasks.ceph:Shutting down logrotate 2023-11-28T18:53:42.985 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:53:42.989 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:53:43.074 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-28T18:53:43.097 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-28T18:53:43.136 INFO:tasks.ceph:Compressing logs... 2023-11-28T18:53:43.137 DEBUG:teuthology.orchestra.run.smithi045:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-28T18:53:43.143 DEBUG:teuthology.orchestra.run.smithi190:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-28T18:53:43.182 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.44517.log 2023-11-28T18:53:43.183 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53113.log 2023-11-28T18:53:43.184 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.2.44517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53738.log 2023-11-28T18:53:43.185 INFO:teuthology.orchestra.run.smithi045.stderr: 90.7%/var/log/ceph/ceph-client.admin.53113.log: -- replaced with /var/log/ceph/ceph-client.2.44517.log.gz 2023-11-28T18:53:43.185 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43609.log 2023-11-28T18:53:43.185 INFO:teuthology.orchestra.run.smithi045.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53113.log.gz 2023-11-28T18:53:43.186 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.53738.log: gzip -5 87.8% --verbose -- replaced with /var/log/ceph/ceph-client.admin.53738.log.gz -- 2023-11-28T18:53:43.187 INFO:teuthology.orchestra.run.smithi045.stderr: /var/log/ceph/ceph-client.admin.53037.log 2023-11-28T18:53:43.187 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43609.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43609.log.gz 2023-11-28T18:53:43.188 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48887.log 2023-11-28T18:53:43.189 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.53037.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53037.log.gz 2023-11-28T18:53:43.189 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53277.log 2023-11-28T18:53:43.190 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48887.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48887.log.gz 2023-11-28T18:53:43.190 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51235.log 2023-11-28T18:53:43.191 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.53277.log: gzip -5 --verbose 88.9% -- -- replaced with /var/log/ceph/ceph-client.admin.53277.log.gz /var/log/ceph/ceph-client.admin.46867.log 2023-11-28T18:53:43.191 INFO:teuthology.orchestra.run.smithi045.stderr: 2023-11-28T18:53:43.193 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.51235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45011.log 2023-11-28T18:53:43.193 INFO:teuthology.orchestra.run.smithi045.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.51235.log.gz 2023-11-28T18:53:43.194 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46867.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46867.log.gz 2023-11-28T18:53:43.194 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49997.log 2023-11-28T18:53:43.195 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45011.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45011.log.gz 2023-11-28T18:53:43.195 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49699.log 2023-11-28T18:53:43.197 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49997.log: gzip 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49997.log.gz 2023-11-28T18:53:43.198 INFO:teuthology.orchestra.run.smithi045.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.47113.log 2023-11-28T18:53:43.199 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49699.log: gzip 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49699.log.gz 2023-11-28T18:53:43.199 INFO:teuthology.orchestra.run.smithi045.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.45200.log 2023-11-28T18:53:43.199 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47113.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47113.log.gz 2023-11-28T18:53:43.200 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42446.log 2023-11-28T18:53:43.200 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45200.log: gzip -5 88.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.45200.log.gz -- 2023-11-28T18:53:43.200 INFO:teuthology.orchestra.run.smithi045.stderr: /var/log/ceph/ceph-client.admin.46462.log 2023-11-28T18:53:43.200 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42446.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42446.log.gz 2023-11-28T18:53:43.200 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44073.log 2023-11-28T18:53:43.201 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43943.log 2023-11-28T18:53:43.201 INFO:teuthology.orchestra.run.smithi045.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46462.log.gz 2023-11-28T18:53:43.202 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.44073.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44073.log.gz 2023-11-28T18:53:43.202 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-11-28T18:53:43.206 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52473.log 2023-11-28T18:53:43.206 INFO:teuthology.orchestra.run.smithi045.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43943.log.gz 2023-11-28T18:53:43.208 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48513.log 2023-11-28T18:53:43.209 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.52473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43009.log 2023-11-28T18:53:43.209 INFO:teuthology.orchestra.run.smithi045.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52473.log.gz 2023-11-28T18:53:43.209 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48513.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48513.log.gz 2023-11-28T18:53:43.209 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52959.log 2023-11-28T18:53:43.209 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52605.log 2023-11-28T18:53:43.210 INFO:teuthology.orchestra.run.smithi045.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43009.log.gz 2023-11-28T18:53:43.210 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.52959.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52959.log.gz 2023-11-28T18:53:43.210 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43839.log 2023-11-28T18:53:43.213 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.52605.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52605.log.gz 2023-11-28T18:53:43.213 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52342.log 2023-11-28T18:53:43.213 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43839.log: gzip -5 88.4% --verbose -- replaced with /var/log/ceph/ceph-client.admin.43839.log.gz -- 2023-11-28T18:53:43.214 INFO:teuthology.orchestra.run.smithi045.stderr: /var/log/ceph/ceph-client.admin.52420.log 2023-11-28T18:53:43.214 INFO:teuthology.orchestra.run.smithi045.stderr: 94.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-11-28T18:53:43.214 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.52342.log: gzip -5 88.1% --verbose -- replaced with /var/log/ceph/ceph-client.admin.52342.log.gz -- 2023-11-28T18:53:43.214 INFO:teuthology.orchestra.run.smithi045.stderr: /var/log/ceph/ceph-client.admin.54064.log 2023-11-28T18:53:43.214 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.52420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44382.log 2023-11-28T18:53:43.214 INFO:teuthology.orchestra.run.smithi045.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52420.log.gz 2023-11-28T18:53:43.214 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.54064.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.54064.log.gz 2023-11-28T18:53:43.215 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51478.log 2023-11-28T18:53:43.215 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38427.log 2023-11-28T18:53:43.215 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38403.log 2023-11-28T18:53:43.215 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-client.admin.38427.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-11-28T18:53:43.215 INFO:teuthology.orchestra.run.smithi190.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38427.log.gz 2023-11-28T18:53:43.215 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-client.admin.38403.log: gzip 88.3% -5 -- replaced with /var/log/ceph/ceph-client.admin.38403.log.gz --verbose 2023-11-28T18:53:43.215 INFO:teuthology.orchestra.run.smithi190.stderr: -- /var/log/ceph/ceph-osd.6.log 2023-11-28T18:53:43.216 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38379.log 2023-11-28T18:53:43.216 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-11-28T18:53:43.219 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-client.admin.38379.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38379.log.gz 2023-11-28T18:53:43.219 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38451.log 2023-11-28T18:53:43.219 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38499.log 2023-11-28T18:53:43.220 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-client.admin.38451.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38451.log.gz 2023-11-28T18:53:43.220 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38355.log 2023-11-28T18:53:43.220 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-client.admin.38499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.43826.log 2023-11-28T18:53:43.220 INFO:teuthology.orchestra.run.smithi190.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38499.log.gz 2023-11-28T18:53:43.220 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-client.admin.38355.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38355.log.gz 2023-11-28T18:53:43.220 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-11-28T18:53:43.223 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.0.44382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47271.log 2023-11-28T18:53:43.223 INFO:teuthology.orchestra.run.smithi045.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.0.44382.log.gz 2023-11-28T18:53:43.223 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.51478.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51478.log.gz 2023-11-28T18:53:43.223 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49183.log 2023-11-28T18:53:43.223 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42745.log 2023-11-28T18:53:43.224 INFO:teuthology.orchestra.run.smithi045.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47271.log.gz 2023-11-28T18:53:43.224 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49183.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49183.log.gz 2023-11-28T18:53:43.224 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49566.log 2023-11-28T18:53:43.224 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42745.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42745.log.gz 2023-11-28T18:53:43.224 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45622.log 2023-11-28T18:53:43.224 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49566.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49566.log.gz 2023-11-28T18:53:43.225 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54012.log 2023-11-28T18:53:43.225 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53851.log 2023-11-28T18:53:43.225 INFO:teuthology.orchestra.run.smithi045.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45622.log.gz 2023-11-28T18:53:43.225 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.54012.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.54012.log.gz 2023-11-28T18:53:43.225 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-11-28T18:53:43.225 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.53851.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53851.log.gz 2023-11-28T18:53:43.226 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42719.log 2023-11-28T18:53:43.227 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-client.3.43826.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-28T18:53:43.228 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-mgr.x.log: 90.7% -- replaced with /var/log/ceph/ceph-client.3.43826.log.gz 2023-11-28T18:53:43.228 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38523.log 2023-11-28T18:53:43.228 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-11-28T18:53:43.228 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-client.admin.38523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38475.log 2023-11-28T18:53:43.228 INFO:teuthology.orchestra.run.smithi190.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38523.log.gz 2023-11-28T18:53:43.228 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-mon.c.log: 92.9% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-28T18:53:43.228 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-28T18:53:43.229 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-client.admin.38475.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-11-28T18:53:43.229 INFO:teuthology.orchestra.run.smithi190.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.38475.log.gz 2023-11-28T18:53:43.230 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-11-28T18:53:43.233 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46971.log 2023-11-28T18:53:43.233 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42719.log: gzip 89.5% -- replaced with /var/log/ceph/ceph-client.admin.42719.log.gz 2023-11-28T18:53:43.233 INFO:teuthology.orchestra.run.smithi045.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.51925.log 2023-11-28T18:53:43.233 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46971.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46971.log.gz 2023-11-28T18:53:43.233 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47245.log 2023-11-28T18:53:43.233 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.51925.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51925.log.gz 2023-11-28T18:53:43.233 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51558.log 2023-11-28T18:53:43.234 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47245.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47245.log.gz 2023-11-28T18:53:43.234 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47785.log 2023-11-28T18:53:43.234 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.51558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51821.log 2023-11-28T18:53:43.234 INFO:teuthology.orchestra.run.smithi045.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.51558.log.gz 2023-11-28T18:53:43.234 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47785.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47785.log.gz 2023-11-28T18:53:43.234 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42499.log 2023-11-28T18:53:43.234 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.51821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50023.log 2023-11-28T18:53:43.234 INFO:teuthology.orchestra.run.smithi045.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51821.log.gz 2023-11-28T18:53:43.235 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42499.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42499.log.gz 2023-11-28T18:53:43.235 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43865.log 2023-11-28T18:53:43.236 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-mds.d.log: /var/log/ceph/ceph-mds.b.log: 93.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-28T18:53:43.236 INFO:teuthology.orchestra.run.smithi190.stderr: 93.6% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-11-28T18:53:43.236 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-11-28T18:53:43.236 INFO:teuthology.orchestra.run.smithi190.stderr: 93.6% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-11-28T18:53:43.237 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.50023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45492.log 2023-11-28T18:53:43.237 INFO:teuthology.orchestra.run.smithi045.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.50023.log.gz 2023-11-28T18:53:43.238 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50860.log 2023-11-28T18:53:43.238 INFO:teuthology.orchestra.run.smithi045.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.43865.log.gz 2023-11-28T18:53:43.238 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48861.log 2023-11-28T18:53:43.238 INFO:teuthology.orchestra.run.smithi045.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45492.log.gz 2023-11-28T18:53:43.238 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.50860.log: gzip -5 90.9% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.50860.log.gz /var/log/ceph/ceph-client.admin.42825.log 2023-11-28T18:53:43.238 INFO:teuthology.orchestra.run.smithi045.stderr: 2023-11-28T18:53:43.238 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45596.log 2023-11-28T18:53:43.239 INFO:teuthology.orchestra.run.smithi045.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48861.log.gz 2023-11-28T18:53:43.240 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-11-28T18:53:43.240 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43720.log 2023-11-28T18:53:43.241 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42825.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42825.log.gz 2023-11-28T18:53:43.241 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47625.log 2023-11-28T18:53:43.241 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50334.log 2023-11-28T18:53:43.241 INFO:teuthology.orchestra.run.smithi045.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45596.log.gz 2023-11-28T18:53:43.241 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47625.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.47625.log.gz 2023-11-28T18:53:43.242 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52801.log 2023-11-28T18:53:43.242 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph-client.1.43720.log: 89.7% -- replaced with /var/log/ceph/ceph-client.1.43720.log.gz 2023-11-28T18:53:43.243 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.50334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51007.log 2023-11-28T18:53:43.244 INFO:teuthology.orchestra.run.smithi045.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50334.log.gz 2023-11-28T18:53:43.244 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.52801.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52801.log.gz 2023-11-28T18:53:43.244 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42993.log 2023-11-28T18:53:43.245 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.51007.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.51007.log.gz 2023-11-28T18:53:43.245 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45885.log 2023-11-28T18:53:43.246 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42993.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42993.log.gz 2023-11-28T18:53:43.246 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48705.log 2023-11-28T18:53:43.246 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45885.log: gzip 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45885.log.gz -5 2023-11-28T18:53:43.246 INFO:teuthology.orchestra.run.smithi045.stderr: --verbose -- /var/log/ceph/ceph-client.admin.45141.log 2023-11-28T18:53:43.247 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.0.48705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49841.log 2023-11-28T18:53:43.249 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48539.log 2023-11-28T18:53:43.249 INFO:teuthology.orchestra.run.smithi045.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45141.log.gz 2023-11-28T18:53:43.250 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42693.log 2023-11-28T18:53:43.250 INFO:teuthology.orchestra.run.smithi045.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49841.log.gz 2023-11-28T18:53:43.250 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48539.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48539.log.gz 2023-11-28T18:53:43.251 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.33292.log 2023-11-28T18:53:43.251 INFO:teuthology.orchestra.run.smithi045.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.0.48705.log.gz 2023-11-28T18:53:43.252 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50551.log 2023-11-28T18:53:43.252 INFO:teuthology.orchestra.run.smithi045.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42693.log.gz 2023-11-28T18:53:43.253 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph.tmp-client.admin.33292.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.33292.log.gz 2023-11-28T18:53:43.253 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45648.log 2023-11-28T18:53:43.254 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.50551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49077.log 2023-11-28T18:53:43.254 INFO:teuthology.orchestra.run.smithi045.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50551.log.gz 2023-11-28T18:53:43.255 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42851.log 2023-11-28T18:53:43.255 INFO:teuthology.orchestra.run.smithi045.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45648.log.gz 2023-11-28T18:53:43.256 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44829.log 2023-11-28T18:53:43.256 INFO:teuthology.orchestra.run.smithi045.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49077.log.gz 2023-11-28T18:53:43.257 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45994.log 2023-11-28T18:53:43.257 INFO:teuthology.orchestra.run.smithi045.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42851.log.gz 2023-11-28T18:53:43.258 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.44829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42903.log 2023-11-28T18:53:43.258 INFO:teuthology.orchestra.run.smithi045.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44829.log.gz 2023-11-28T18:53:43.259 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51067.log 2023-11-28T18:53:43.259 INFO:teuthology.orchestra.run.smithi045.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45994.log.gz 2023-11-28T18:53:43.260 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43605.log 2023-11-28T18:53:43.260 INFO:teuthology.orchestra.run.smithi045.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42903.log.gz 2023-11-28T18:53:43.261 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.51067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43198.log 2023-11-28T18:53:43.261 INFO:teuthology.orchestra.run.smithi045.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.51067.log.gz 2023-11-28T18:53:43.262 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43605.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-11-28T18:53:43.262 INFO:teuthology.orchestra.run.smithi045.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43605.log.gz 2023-11-28T18:53:43.263 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52219.log 2023-11-28T18:53:43.263 INFO:teuthology.orchestra.run.smithi045.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43198.log.gz 2023-11-28T18:53:43.264 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38143.log 2023-11-28T18:53:43.265 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.52219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52089.log 2023-11-28T18:53:43.265 INFO:teuthology.orchestra.run.smithi045.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52219.log.gz 2023-11-28T18:53:43.266 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.38143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48921.log 2023-11-28T18:53:43.266 INFO:teuthology.orchestra.run.smithi045.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.38143.log.gz 2023-11-28T18:53:43.267 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.52089.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52089.log.gz 2023-11-28T18:53:43.267 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44647.log 2023-11-28T18:53:43.268 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45435.log 2023-11-28T18:53:43.269 INFO:teuthology.orchestra.run.smithi045.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48921.log.gz 2023-11-28T18:53:43.270 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.44647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49945.log 2023-11-28T18:53:43.270 INFO:teuthology.orchestra.run.smithi045.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44647.log.gz 2023-11-28T18:53:43.271 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45435.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45435.log.gz 2023-11-28T18:53:43.271 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49410.log 2023-11-28T18:53:43.272 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48050.log 2023-11-28T18:53:43.272 INFO:teuthology.orchestra.run.smithi045.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49945.log.gz 2023-11-28T18:53:43.273 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49410.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.49410.log.gz 2023-11-28T18:53:43.273 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52037.log 2023-11-28T18:53:43.274 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51289.log 2023-11-28T18:53:43.275 INFO:teuthology.orchestra.run.smithi045.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48050.log.gz 2023-11-28T18:53:43.276 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.52037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43405.log 2023-11-28T18:53:43.276 INFO:teuthology.orchestra.run.smithi045.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52037.log.gz 2023-11-28T18:53:43.277 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.51289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45963.log 2023-11-28T18:53:43.277 INFO:teuthology.orchestra.run.smithi045.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.51289.log.gz 2023-11-28T18:53:43.278 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46893.log 2023-11-28T18:53:43.278 INFO:teuthology.orchestra.run.smithi045.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43405.log.gz 2023-11-28T18:53:43.279 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45963.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45963.log.gz 2023-11-28T18:53:43.279 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-11-28T18:53:43.281 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46945.log 2023-11-28T18:53:43.281 INFO:teuthology.orchestra.run.smithi045.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46893.log.gz 2023-11-28T18:53:43.282 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45226.log 2023-11-28T18:53:43.283 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46945.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46945.log.gz 2023-11-28T18:53:43.283 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46542.log 2023-11-28T18:53:43.284 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46763.log 2023-11-28T18:53:43.285 INFO:teuthology.orchestra.run.smithi045.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45226.log.gz 2023-11-28T18:53:43.285 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46542.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46542.log.gz 2023-11-28T18:53:43.286 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42955.log 2023-11-28T18:53:43.287 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47979.log 2023-11-28T18:53:43.287 INFO:teuthology.orchestra.run.smithi045.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46763.log.gz 2023-11-28T18:53:43.288 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42955.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42955.log.gz 2023-11-28T18:53:43.288 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50833.log 2023-11-28T18:53:43.289 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50914.log 2023-11-28T18:53:43.290 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.50833.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.50833.log.gz 2023-11-28T18:53:43.291 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47349.log 2023-11-28T18:53:43.292 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.50914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52115.log 2023-11-28T18:53:43.293 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47349.log: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.50914.log.gz 2023-11-28T18:53:43.293 INFO:teuthology.orchestra.run.smithi045.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.47979.log.gz 2023-11-28T18:53:43.293 INFO:teuthology.orchestra.run.smithi045.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47349.log.gz 2023-11-28T18:53:43.294 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46384.log 2023-11-28T18:53:43.294 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.52115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48835.log 2023-11-28T18:53:43.295 INFO:teuthology.orchestra.run.smithi045.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52115.log.gz 2023-11-28T18:53:43.295 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46384.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46384.log.gz 2023-11-28T18:53:43.296 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46228.log 2023-11-28T18:53:43.297 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50282.log 2023-11-28T18:53:43.297 INFO:teuthology.orchestra.run.smithi045.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48835.log.gz 2023-11-28T18:53:43.298 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46228.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46228.log.gz 2023-11-28T18:53:43.298 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42799.log 2023-11-28T18:53:43.300 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.50282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54038.log 2023-11-28T18:53:43.300 INFO:teuthology.orchestra.run.smithi045.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50282.log.gz 2023-11-28T18:53:43.301 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42799.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42799.log.gz 2023-11-28T18:53:43.301 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43969.log 2023-11-28T18:53:43.302 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.54038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42472.log 2023-11-28T18:53:43.302 INFO:teuthology.orchestra.run.smithi045.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.54038.log.gz 2023-11-28T18:53:43.303 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43969.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43969.log.gz 2023-11-28T18:53:43.303 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51316.log 2023-11-28T18:53:43.304 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51985.log 2023-11-28T18:53:43.305 INFO:teuthology.orchestra.run.smithi045.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42472.log.gz 2023-11-28T18:53:43.306 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.51316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47759.log 2023-11-28T18:53:43.307 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.51985.log: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.51316.log.gz 2023-11-28T18:53:43.308 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50413.log 2023-11-28T18:53:43.308 INFO:teuthology.orchestra.run.smithi045.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51985.log.gz 2023-11-28T18:53:43.309 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47706.log 2023-11-28T18:53:43.309 INFO:teuthology.orchestra.run.smithi045.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.47759.log.gz 2023-11-28T18:53:43.310 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.50413.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50413.log.gz 2023-11-28T18:53:43.310 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48486.log 2023-11-28T18:53:43.311 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44258.log 2023-11-28T18:53:43.312 INFO:teuthology.orchestra.run.smithi045.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47706.log.gz 2023-11-28T18:53:43.312 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48486.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48486.log.gz 2023-11-28T18:53:43.313 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52541.log 2023-11-28T18:53:43.314 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.44258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45911.log 2023-11-28T18:53:43.314 INFO:teuthology.orchestra.run.smithi045.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44258.log.gz 2023-11-28T18:53:43.315 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.52541.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52541.log.gz 2023-11-28T18:53:43.315 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42577.log 2023-11-28T18:53:43.316 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45728.log 2023-11-28T18:53:43.317 INFO:teuthology.orchestra.run.smithi045.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45911.log.gz 2023-11-28T18:53:43.317 INFO:teuthology.orchestra.run.smithi190.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-11-28T18:53:43.318 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42577.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42577.log.gz 2023-11-28T18:53:43.318 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47477.log 2023-11-28T18:53:43.319 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43648.log 2023-11-28T18:53:43.319 INFO:teuthology.orchestra.run.smithi045.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45728.log.gz 2023-11-28T18:53:43.320 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47477.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47477.log.gz 2023-11-28T18:53:43.320 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48006.log 2023-11-28T18:53:43.321 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52507.log 2023-11-28T18:53:43.322 INFO:teuthology.orchestra.run.smithi045.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43648.log.gz 2023-11-28T18:53:43.322 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48006.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.48006.log.gz 2023-11-28T18:53:43.323 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44203.log 2023-11-28T18:53:43.324 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.52507.log: /var/log/ceph/ceph-client.admin.53877.log 2023-11-28T18:53:43.324 INFO:teuthology.orchestra.run.smithi045.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52507.log.gz 2023-11-28T18:53:43.325 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.44203.log: gzip 91.5% -5 -- replaced with /var/log/ceph/ceph-client.admin.44203.log.gz --verbose 2023-11-28T18:53:43.326 INFO:teuthology.orchestra.run.smithi045.stderr: -- /var/log/ceph/ceph-client.admin.47732.log 2023-11-28T18:53:43.326 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.53877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46516.log 2023-11-28T18:53:43.327 INFO:teuthology.orchestra.run.smithi045.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53877.log.gz 2023-11-28T18:53:43.327 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47732.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47732.log.gz 2023-11-28T18:53:43.328 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49787.log 2023-11-28T18:53:43.329 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49358.log 2023-11-28T18:53:43.330 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46516.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46516.log.gz 2023-11-28T18:53:43.330 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49787.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49787.log.gz 2023-11-28T18:53:43.331 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43216.log 2023-11-28T18:53:43.331 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47652.log 2023-11-28T18:53:43.332 INFO:teuthology.orchestra.run.smithi045.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49358.log.gz 2023-11-28T18:53:43.332 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43216.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43216.log.gz 2023-11-28T18:53:43.333 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46436.log 2023-11-28T18:53:43.334 INFO:teuthology.orchestra.run.smithi045.stderr:gzip/var/log/ceph/ceph-client.admin.47652.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.44907.log 2023-11-28T18:53:43.335 INFO:teuthology.orchestra.run.smithi045.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47652.log.gz 2023-11-28T18:53:43.335 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46436.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46436.log.gz 2023-11-28T18:53:43.335 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45037.log 2023-11-28T18:53:43.336 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.44907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47811.log 2023-11-28T18:53:43.337 INFO:teuthology.orchestra.run.smithi045.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44907.log.gz 2023-11-28T18:53:43.338 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45037.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45037.log.gz 2023-11-28T18:53:43.338 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52881.log 2023-11-28T18:53:43.339 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47811.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47811.log.gz 2023-11-28T18:53:43.340 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53935.log 2023-11-28T18:53:43.341 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.52881.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.52881.log.gz 2023-11-28T18:53:43.341 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53765.log 2023-11-28T18:53:43.343 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.53935.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53935.log.gz 2023-11-28T18:53:43.343 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52141.log 2023-11-28T18:53:43.344 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.53765.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.53765.log.gz 2023-11-28T18:53:43.344 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38378.log 2023-11-28T18:53:43.346 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.52141.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52141.log.gz 2023-11-28T18:53:43.346 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48408.log 2023-11-28T18:53:43.347 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.38378.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.38378.log.gz 2023-11-28T18:53:43.348 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49051.log 2023-11-28T18:53:43.349 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48408.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48408.log.gz 2023-11-28T18:53:43.349 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46737.log 2023-11-28T18:53:43.351 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49051.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49051.log.gz 2023-11-28T18:53:43.351 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42551.log 2023-11-28T18:53:43.360 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46737.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46737.log.gz 2023-11-28T18:53:43.360 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43651.log 2023-11-28T18:53:43.360 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42551.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42551.log.gzgzip 2023-11-28T18:53:43.360 INFO:teuthology.orchestra.run.smithi045.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.47323.log 2023-11-28T18:53:43.361 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43651.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43651.log.gz 2023-11-28T18:53:43.361 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47401.log 2023-11-28T18:53:43.361 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47323.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47323.log.gz 2023-11-28T18:53:43.361 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43403.log 2023-11-28T18:53:43.361 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47401.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47401.log.gz 2023-11-28T18:53:43.361 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45089.log 2023-11-28T18:53:43.361 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43403.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43403.log.gz 2023-11-28T18:53:43.362 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42773.log 2023-11-28T18:53:43.363 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45089.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45089.log.gz 2023-11-28T18:53:43.363 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44933.log 2023-11-28T18:53:43.364 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42773.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42773.log.gz 2023-11-28T18:53:43.364 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53168.log 2023-11-28T18:53:43.366 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.44933.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44933.log.gz 2023-11-28T18:53:43.367 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49436.log 2023-11-28T18:53:43.367 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.0.53168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50887.log 2023-11-28T18:53:43.368 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49436.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49436.log.gz 2023-11-28T18:53:43.368 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43424.log 2023-11-28T18:53:43.369 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.50887.log: gzip -5 90.5% --verbose -- replaced with /var/log/ceph/ceph-client.admin.50887.log.gz -- 2023-11-28T18:53:43.369 INFO:teuthology.orchestra.run.smithi045.stderr: /var/log/ceph/ceph-client.admin.43891.log 2023-11-28T18:53:43.370 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43424.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43424.log.gz 2023-11-28T18:53:43.371 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49893.log 2023-11-28T18:53:43.372 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43891.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-11-28T18:53:43.372 INFO:teuthology.orchestra.run.smithi045.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43891.log.gz 2023-11-28T18:53:43.374 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51899.log 2023-11-28T18:53:43.374 INFO:teuthology.orchestra.run.smithi045.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49893.log.gz 2023-11-28T18:53:43.375 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48947.log 2023-11-28T18:53:43.378 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.51899.log: gzip 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51899.log.gz -5 2023-11-28T18:53:43.378 INFO:teuthology.orchestra.run.smithi045.stderr: --verbose -- /var/log/ceph/ceph-client.admin.52290.log 2023-11-28T18:53:43.378 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48947.log: gzip -5 --verbose 87.7% -- /var/log/ceph/ceph-client.admin.44985.log -- replaced with /var/log/ceph/ceph-client.admin.48947.log.gz 2023-11-28T18:53:43.379 INFO:teuthology.orchestra.run.smithi045.stderr: 2023-11-28T18:53:43.380 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.52290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45780.log 2023-11-28T18:53:43.380 INFO:teuthology.orchestra.run.smithi045.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52290.log.gz 2023-11-28T18:53:43.382 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.44985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53588.log 2023-11-28T18:53:43.383 INFO:teuthology.orchestra.run.smithi045.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44985.log.gz 2023-11-28T18:53:43.384 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47957.log 2023-11-28T18:53:43.384 INFO:teuthology.orchestra.run.smithi045.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45780.log.gz 2023-11-28T18:53:43.384 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.53588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51034.log 2023-11-28T18:53:43.385 INFO:teuthology.orchestra.run.smithi045.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53588.log.gz 2023-11-28T18:53:43.386 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47957.log: gzip -5 --verbose 89.6% -- -- replaced with /var/log/ceph/ceph-client.admin.47957.log.gz /var/log/ceph/ceph-client.admin.50980.log 2023-11-28T18:53:43.386 INFO:teuthology.orchestra.run.smithi045.stderr: 2023-11-28T18:53:43.387 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.51034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48973.log 2023-11-28T18:53:43.388 INFO:teuthology.orchestra.run.smithi045.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.51034.log.gz 2023-11-28T18:53:43.389 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.50980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49384.log 2023-11-28T18:53:43.390 INFO:teuthology.orchestra.run.smithi045.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.50980.log.gz 2023-11-28T18:53:43.390 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48973.log: 87.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.48973.log.gz -5 2023-11-28T18:53:43.391 INFO:teuthology.orchestra.run.smithi045.stderr: --verbose -- /var/log/ceph/ceph-client.admin.43917.log 2023-11-28T18:53:43.392 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49384.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49384.log.gz 2023-11-28T18:53:43.392 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47141.log 2023-11-28T18:53:43.393 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53640.log 2023-11-28T18:53:43.394 INFO:teuthology.orchestra.run.smithi045.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43917.log.gz 2023-11-28T18:53:43.395 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44125.log 2023-11-28T18:53:43.396 INFO:teuthology.orchestra.run.smithi045.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47141.log.gz 2023-11-28T18:53:43.396 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.53640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42290.log 2023-11-28T18:53:43.396 INFO:teuthology.orchestra.run.smithi045.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53640.log.gz 2023-11-28T18:53:43.398 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.44125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47532.log 2023-11-28T18:53:43.398 INFO:teuthology.orchestra.run.smithi045.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44125.log.gz 2023-11-28T18:53:43.400 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53500.log 2023-11-28T18:53:43.400 INFO:teuthology.orchestra.run.smithi045.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42290.log.gz 2023-11-28T18:53:43.401 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.0.47532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48276.log 2023-11-28T18:53:43.402 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.53500.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.53500.log.gz 2023-11-28T18:53:43.404 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48276.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.48276.log.gz 2023-11-28T18:53:43.404 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42348.log 2023-11-28T18:53:43.406 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49919.log 2023-11-28T18:53:43.407 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42348.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42348.log.gz 2023-11-28T18:53:43.408 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49919.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.49919.log.gz 2023-11-28T18:53:43.409 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47027.log 2023-11-28T18:53:43.411 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53692.log 2023-11-28T18:53:43.413 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47027.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47027.log.gz 2023-11-28T18:53:43.413 INFO:teuthology.orchestra.run.smithi045.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.0.47532.log.gz 2023-11-28T18:53:43.413 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.53692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50713.log 2023-11-28T18:53:43.413 INFO:teuthology.orchestra.run.smithi045.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53692.log.gz 2023-11-28T18:53:43.414 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45357.log 2023-11-28T18:53:43.416 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.50713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53536.log 2023-11-28T18:53:43.416 INFO:teuthology.orchestra.run.smithi045.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.50713.log.gz 2023-11-28T18:53:43.417 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45357.log: gzip 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45357.log.gz 2023-11-28T18:53:43.418 INFO:teuthology.orchestra.run.smithi045.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.45278.log 2023-11-28T18:53:43.419 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.53536.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53536.log.gz 2023-11-28T18:53:43.419 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44151.log 2023-11-28T18:53:43.420 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46841.log 2023-11-28T18:53:43.421 INFO:teuthology.orchestra.run.smithi045.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45278.log.gz 2023-11-28T18:53:43.422 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.44151.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44151.log.gz 2023-11-28T18:53:43.422 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52985.log 2023-11-28T18:53:43.423 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45754.log 2023-11-28T18:53:43.423 INFO:teuthology.orchestra.run.smithi045.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46841.log.gz 2023-11-28T18:53:43.425 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.52985.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52985.log.gz 2023-11-28T18:53:43.425 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43404.log 2023-11-28T18:53:43.427 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45754.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-11-28T18:53:43.427 INFO:teuthology.orchestra.run.smithi045.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45754.log.gz 2023-11-28T18:53:43.430 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44751.log 2023-11-28T18:53:43.431 INFO:teuthology.orchestra.run.smithi045.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43404.log.gz 2023-11-28T18:53:43.431 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51094.log 2023-11-28T18:53:43.432 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.44751.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44751.log.gz 2023-11-28T18:53:43.432 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.51094.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.51094.log.gz 2023-11-28T18:53:43.433 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44803.log 2023-11-28T18:53:43.435 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52631.log 2023-11-28T18:53:43.436 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.44803.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44803.log.gz 2023-11-28T18:53:43.438 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.52631.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52631.log.gz 2023-11-28T18:53:43.438 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45859.log 2023-11-28T18:53:43.439 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53303.log 2023-11-28T18:53:43.441 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45859.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45859.log.gz 2023-11-28T18:53:43.443 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.53303.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.53303.log.gz 2023-11-28T18:53:43.443 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45252.log 2023-11-28T18:53:43.449 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52446.log 2023-11-28T18:53:43.450 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45252.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45252.log.gz 2023-11-28T18:53:43.450 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.52446.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52446.log.gz 2023-11-28T18:53:43.450 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52685.log 2023-11-28T18:53:43.450 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45570.log 2023-11-28T18:53:43.451 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.52685.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52685.log.gz 2023-11-28T18:53:43.452 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45570.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45570.log.gz 2023-11-28T18:53:43.453 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53353.log 2023-11-28T18:53:43.455 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51148.log 2023-11-28T18:53:43.457 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.53353.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.53353.log.gz 2023-11-28T18:53:43.457 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.51148.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.51148.log.gz 2023-11-28T18:53:43.458 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51403.log 2023-11-28T18:53:43.460 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51208.log 2023-11-28T18:53:43.462 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.51403.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.51403.log.gz 2023-11-28T18:53:43.463 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.51208.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.51208.log.gz 2023-11-28T18:53:43.463 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50773.log 2023-11-28T18:53:43.465 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45115.log 2023-11-28T18:53:43.468 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.50773.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.50773.log.gz 2023-11-28T18:53:43.468 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45115.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45115.log.gz 2023-11-28T18:53:43.469 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47917.log 2023-11-28T18:53:43.470 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49867.log 2023-11-28T18:53:43.472 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47917.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47917.log.gz 2023-11-28T18:53:43.475 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49867.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49867.log.gz 2023-11-28T18:53:43.475 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43425.log 2023-11-28T18:53:43.475 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48172.log 2023-11-28T18:53:43.477 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43425.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43425.log.gz 2023-11-28T18:53:43.478 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48172.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48172.log.gz 2023-11-28T18:53:43.478 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43217.log 2023-11-28T18:53:43.482 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45383.log 2023-11-28T18:53:43.482 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43217.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43217.log.gz 2023-11-28T18:53:43.483 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45383.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45383.log.gz 2023-11-28T18:53:43.483 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46020.log 2023-11-28T18:53:43.490 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46254.log 2023-11-28T18:53:43.490 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46020.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46020.log.gz 2023-11-28T18:53:43.490 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46254.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46254.log.gz 2023-11-28T18:53:43.491 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42929.log 2023-11-28T18:53:43.491 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53582.log 2023-11-28T18:53:43.491 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42929.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42929.log.gz 2023-11-28T18:53:43.492 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.53582.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53582.log.gz 2023-11-28T18:53:43.493 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50806.log 2023-11-28T18:53:43.516 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51873.log 2023-11-28T18:53:43.517 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.50806.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.50806.log.gz 2023-11-28T18:53:43.517 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.51873.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51873.log.gz 2023-11-28T18:53:43.517 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44563.log 2023-11-28T18:53:43.517 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48809.log 2023-11-28T18:53:43.517 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.44563.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44563.log.gz 2023-11-28T18:53:43.517 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48809.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48809.log.gz 2023-11-28T18:53:43.517 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49592.log 2023-11-28T18:53:43.518 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49103.log 2023-11-28T18:53:43.518 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49592.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49592.log.gz 2023-11-28T18:53:43.518 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49103.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49103.log.gz 2023-11-28T18:53:43.518 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43215.log 2023-11-28T18:53:43.518 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53798.log 2023-11-28T18:53:43.518 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43215.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43215.log.gz 2023-11-28T18:53:43.519 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.53798.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53798.log.gz 2023-11-28T18:53:43.519 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49332.log 2023-11-28T18:53:43.519 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52193.log 2023-11-28T18:53:43.519 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49332.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49332.log.gz 2023-11-28T18:53:43.520 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.52193.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52193.log.gz 2023-11-28T18:53:43.520 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48434.log 2023-11-28T18:53:43.520 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46410.log 2023-11-28T18:53:43.521 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48434.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.48434.log.gz 2023-11-28T18:53:43.522 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46410.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.46410.log.gz 2023-11-28T18:53:43.522 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49155.log 2023-11-28T18:53:43.533 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48460.log 2023-11-28T18:53:43.534 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49155.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49155.log.gz 2023-11-28T18:53:43.534 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48460.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48460.log.gz 2023-11-28T18:53:43.534 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43995.log 2023-11-28T18:53:43.535 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45937.log 2023-11-28T18:53:43.535 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43995.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43995.log.gz 2023-11-28T18:53:43.535 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45937.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45937.log.gz 2023-11-28T18:53:43.535 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49501.log 2023-11-28T18:53:43.537 INFO:teuthology.orchestra.run.smithi190.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-11-28T18:53:43.539 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51504.log 2023-11-28T18:53:43.539 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49501.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49501.log.gz 2023-11-28T18:53:43.539 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.51504.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51504.log.gz 2023-11-28T18:53:43.539 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42995.log 2023-11-28T18:53:43.541 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53216.log 2023-11-28T18:53:43.541 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42995.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42995.log.gz 2023-11-28T18:53:43.542 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.53216.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53216.log.gz 2023-11-28T18:53:43.543 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45466.log 2023-11-28T18:53:43.544 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47427.log 2023-11-28T18:53:43.556 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45466.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45466.log.gz 2023-11-28T18:53:43.557 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47427.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.47427.log.gz 2023-11-28T18:53:43.557 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49306.log 2023-11-28T18:53:43.557 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44425.log 2023-11-28T18:53:43.557 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49306.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49306.log.gz 2023-11-28T18:53:43.558 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.44425.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44425.log.gz 2023-11-28T18:53:43.559 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52368.log 2023-11-28T18:53:43.559 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-28T18:53:43.561 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.52368.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52368.log.gz 2023-11-28T18:53:43.561 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph.log: 87.3% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-28T18:53:43.561 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43205.log 2023-11-28T18:53:43.564 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52316.log 2023-11-28T18:53:43.565 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43205.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43205.log.gz 2023-11-28T18:53:43.565 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.52316.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52316.log.gz 2023-11-28T18:53:43.565 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45674.log 2023-11-28T18:53:43.566 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49254.log 2023-11-28T18:53:43.567 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45674.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45674.log.gz 2023-11-28T18:53:43.568 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49254.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49254.log.gz 2023-11-28T18:53:43.569 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51663.log 2023-11-28T18:53:43.571 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48145.log 2023-11-28T18:53:43.574 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.0.51663.log: /var/log/ceph/ceph-client.admin.48145.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48145.log.gz 2023-11-28T18:53:43.574 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44047.log 2023-11-28T18:53:43.578 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.44047.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44047.log.gz 2023-11-28T18:53:43.578 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43650.log 2023-11-28T18:53:43.579 INFO:teuthology.orchestra.run.smithi045.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.0.51663.log.gz 2023-11-28T18:53:43.580 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43650.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43650.log.gz 2023-11-28T18:53:43.581 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46332.log 2023-11-28T18:53:43.582 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51121.log 2023-11-28T18:53:43.584 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46332.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46332.log.gz 2023-11-28T18:53:43.585 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.51121.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.51121.log.gz 2023-11-28T18:53:43.586 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44699.log 2023-11-28T18:53:43.587 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53532.log 2023-11-28T18:53:43.590 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.44699.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44699.log.gz 2023-11-28T18:53:43.595 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.53532.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53532.log.gz 2023-11-28T18:53:43.596 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52011.log 2023-11-28T18:53:43.596 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50465.log 2023-11-28T18:53:43.596 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.52011.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52011.log.gz 2023-11-28T18:53:43.596 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.50465.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50465.log.gz 2023-11-28T18:53:43.596 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48226.log 2023-11-28T18:53:43.596 INFO:teuthology.orchestra.run.smithi190.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-11-28T18:53:43.597 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42631.log 2023-11-28T18:53:43.599 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48226.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.48226.log.gz 2023-11-28T18:53:43.600 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42631.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42631.log.gz 2023-11-28T18:53:43.600 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46358.log 2023-11-28T18:53:43.602 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48331.log 2023-11-28T18:53:43.603 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46358.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46358.log.gz 2023-11-28T18:53:43.608 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.0.48331.log: 92.9% -- replaced with /var/log/ceph/ceph-client.0.48331.log.gz 2023-11-28T18:53:43.608 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47061.log 2023-11-28T18:53:43.610 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52907.log 2023-11-28T18:53:43.611 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47061.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47061.log.gz 2023-11-28T18:53:43.612 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.52907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44855.log 2023-11-28T18:53:43.613 INFO:teuthology.orchestra.run.smithi045.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52907.log.gz 2023-11-28T18:53:43.614 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44621.log 2023-11-28T18:53:43.615 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.44855.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44855.log.gz 2023-11-28T18:53:43.617 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.44621.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44621.log.gz 2023-11-28T18:53:43.617 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44021.log 2023-11-28T18:53:43.619 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45409.log 2023-11-28T18:53:43.620 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.44021.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44021.log.gz 2023-11-28T18:53:43.622 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45409.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45409.log.gz 2023-11-28T18:53:43.622 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45544.log 2023-11-28T18:53:43.624 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53063.log 2023-11-28T18:53:43.625 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45544.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45544.log.gz 2023-11-28T18:53:43.627 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.53063.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.53063.log.gz 2023-11-28T18:53:43.628 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46098.log 2023-11-28T18:53:43.630 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38252.log 2023-11-28T18:53:43.631 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46098.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46098.log.gz 2023-11-28T18:53:43.633 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.38252.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38252.log.gz 2023-11-28T18:53:43.633 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52657.log 2023-11-28T18:53:43.635 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53634.log 2023-11-28T18:53:43.636 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.52657.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52657.log.gz 2023-11-28T18:53:43.637 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.53634.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53634.log.gz 2023-11-28T18:53:43.638 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48072.log 2023-11-28T18:53:43.639 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45700.log 2023-11-28T18:53:43.642 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48072.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.48072.log.gz 2023-11-28T18:53:43.642 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45700.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45700.log.gz 2023-11-28T18:53:43.643 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50439.log 2023-11-28T18:53:43.647 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45806.log 2023-11-28T18:53:43.648 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.50439.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50439.log.gz 2023-11-28T18:53:43.648 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45806.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45806.log.gz 2023-11-28T18:53:43.648 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48200.log 2023-11-28T18:53:43.649 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48028.log 2023-11-28T18:53:43.651 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48200.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48200.log.gz 2023-11-28T18:53:43.652 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48028.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.48028.log.gz 2023-11-28T18:53:43.653 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45331.log 2023-11-28T18:53:43.655 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53903.log 2023-11-28T18:53:43.655 INFO:teuthology.orchestra.run.smithi190.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-11-28T18:53:43.656 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45331.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45331.log.gz 2023-11-28T18:53:43.657 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.53903.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53903.log.gz 2023-11-28T18:53:43.658 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47219.log 2023-11-28T18:53:43.659 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44099.log 2023-11-28T18:53:43.662 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47219.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47219.log.gz 2023-11-28T18:53:43.663 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.44099.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44099.log.gz 2023-11-28T18:53:43.664 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51608.log 2023-11-28T18:53:43.668 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43640.log 2023-11-28T18:53:43.668 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.51608.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51608.log.gz 2023-11-28T18:53:43.669 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43640.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43640.log.gz 2023-11-28T18:53:43.669 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49727.log 2023-11-28T18:53:43.669 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43008.log 2023-11-28T18:53:43.671 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49727.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49727.log.gz 2023-11-28T18:53:43.676 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43008.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43008.log.gz 2023-11-28T18:53:43.676 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48382.log 2023-11-28T18:53:43.676 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48783.log 2023-11-28T18:53:43.676 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48382.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48382.log.gz 2023-11-28T18:53:43.677 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52711.log 2023-11-28T18:53:43.678 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48783.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48783.log.gz 2023-11-28T18:53:43.679 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42659.log 2023-11-28T18:53:43.680 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.52711.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52711.log.gz 2023-11-28T18:53:43.683 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42659.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42659.log.gz 2023-11-28T18:53:43.683 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52394.log 2023-11-28T18:53:43.684 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44725.log 2023-11-28T18:53:43.699 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.52394.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52394.log.gz 2023-11-28T18:53:43.699 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.44725.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44725.log.gz 2023-11-28T18:53:43.699 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44177.log 2023-11-28T18:53:43.699 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43613.log 2023-11-28T18:53:43.700 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.44177.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44177.log.gz 2023-11-28T18:53:43.700 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43613.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43613.log.gz 2023-11-28T18:53:43.700 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50740.log 2023-11-28T18:53:43.700 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45304.log 2023-11-28T18:53:43.700 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.50740.log: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.50740.log.gz 2023-11-28T18:53:43.700 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50128.log 2023-11-28T18:53:43.700 INFO:teuthology.orchestra.run.smithi045.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45304.log.gz 2023-11-28T18:53:43.700 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49813.log 2023-11-28T18:53:43.702 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.0.50128.log: /var/log/ceph/ceph-client.admin.49813.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49813.log.gz 2023-11-28T18:53:43.703 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43423.log 2023-11-28T18:53:43.705 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43423.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43423.log.gz 2023-11-28T18:53:43.705 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43200.log 2023-11-28T18:53:43.708 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43200.log: 93.7% -- replaced with /var/log/ceph/ceph-client.0.50128.log.gz 2023-11-28T18:53:43.709 INFO:teuthology.orchestra.run.smithi045.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43200.log.gz 2023-11-28T18:53:43.709 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48650.log 2023-11-28T18:53:43.710 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46280.log 2023-11-28T18:53:43.711 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48650.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.48650.log.gz 2023-11-28T18:53:43.712 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46919.log 2023-11-28T18:53:43.714 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46280.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46280.log.gz 2023-11-28T18:53:43.714 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51175.log 2023-11-28T18:53:43.715 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46919.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46919.log.gz 2023-11-28T18:53:43.716 INFO:teuthology.orchestra.run.smithi190.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-11-28T18:53:43.717 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.51175.log: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.51175.log.gz 2023-11-28T18:53:43.718 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50947.log 2023-11-28T18:53:43.720 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49280.log 2023-11-28T18:53:43.722 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.50947.log: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.50947.log.gz 2023-11-28T18:53:43.724 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49280.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.49280.log.gz 2023-11-28T18:53:43.725 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46711.log 2023-11-28T18:53:43.725 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44881.log 2023-11-28T18:53:43.727 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46711.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46711.log.gz 2023-11-28T18:53:43.728 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.44881.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44881.log.gz 2023-11-28T18:53:43.729 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52853.log 2023-11-28T18:53:43.730 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47087.log 2023-11-28T18:53:43.732 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.52853.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52853.log.gz 2023-11-28T18:53:43.734 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47087.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47087.log.gz 2023-11-28T18:53:43.734 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49761.log 2023-11-28T18:53:43.734 INFO:teuthology.orchestra.run.smithi045.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-11-28T18:53:43.735 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45518.log 2023-11-28T18:53:43.737 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49761.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-28T18:53:43.737 INFO:teuthology.orchestra.run.smithi045.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.49761.log.gz 2023-11-28T18:53:43.738 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45518.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45518.log.gz 2023-11-28T18:53:43.739 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47297.log 2023-11-28T18:53:43.740 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-11-28T18:53:43.742 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47297.log: 88.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-28T18:53:43.742 INFO:teuthology.orchestra.run.smithi045.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47297.log.gz 2023-11-28T18:53:43.742 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51959.log 2023-11-28T18:53:43.744 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47837.log 2023-11-28T18:53:43.745 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.51959.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51959.log.gz 2023-11-28T18:53:43.747 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47837.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47837.log.gz 2023-11-28T18:53:43.747 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-11-28T18:53:43.749 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50386.log 2023-11-28T18:53:43.752 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.50386.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50386.log.gz 2023-11-28T18:53:43.752 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46150.log 2023-11-28T18:53:43.754 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51370.log 2023-11-28T18:53:43.756 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46150.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46150.log.gz 2023-11-28T18:53:43.760 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.51370.log: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.51370.log.gz 2023-11-28T18:53:43.760 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49129.log 2023-11-28T18:53:43.763 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49129.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49129.log.gz 2023-11-28T18:53:43.763 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43653.log 2023-11-28T18:53:43.767 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43653.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43653.log.gz 2023-11-28T18:53:43.767 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46490.log 2023-11-28T18:53:43.771 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46490.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46490.log.gz 2023-11-28T18:53:43.771 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50517.log 2023-11-28T18:53:43.774 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.50517.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50517.log.gz 2023-11-28T18:53:43.774 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47894.log 2023-11-28T18:53:43.776 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53981.log 2023-11-28T18:53:43.777 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47894.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47894.log.gz 2023-11-28T18:53:43.781 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.53981.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53981.log.gz 2023-11-28T18:53:43.781 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49209.log 2023-11-28T18:53:43.784 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49209.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49209.log.gz 2023-11-28T18:53:43.784 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44673.log 2023-11-28T18:53:43.787 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.44673.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44673.log.gz 2023-11-28T18:53:43.788 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46613.log 2023-11-28T18:53:43.791 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46613.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46613.log.gz 2023-11-28T18:53:43.791 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51262.log 2023-11-28T18:53:43.795 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.51262.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.51262.log.gz 2023-11-28T18:53:43.795 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53825.log 2023-11-28T18:53:43.797 INFO:teuthology.orchestra.run.smithi190.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-11-28T18:53:43.798 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.53825.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53825.log.gz 2023-11-28T18:53:43.799 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54090.log 2023-11-28T18:53:43.802 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.54090.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54090.log.gz 2023-11-28T18:53:43.802 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47680.log 2023-11-28T18:53:43.805 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46306.log 2023-11-28T18:53:43.806 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47680.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47680.log.gz 2023-11-28T18:53:43.809 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46306.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46306.log.gz 2023-11-28T18:53:43.810 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51442.log 2023-11-28T18:53:43.812 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.51442.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51442.log.gz 2023-11-28T18:53:43.812 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50491.log 2023-11-28T18:53:43.816 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.50491.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50491.log.gz 2023-11-28T18:53:43.816 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44589.log 2023-11-28T18:53:43.820 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.44589.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44589.log.gz 2023-11-28T18:53:43.820 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43413.log 2023-11-28T18:53:43.823 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43413.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43413.log.gz 2023-11-28T18:53:43.823 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48565.log 2023-11-28T18:53:43.826 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48565.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48565.log.gz 2023-11-28T18:53:43.827 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46999.log 2023-11-28T18:53:43.830 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46999.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46999.log.gz 2023-11-28T18:53:43.830 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51847.log 2023-11-28T18:53:43.833 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43001.log 2023-11-28T18:53:43.834 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.51847.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51847.log.gz 2023-11-28T18:53:43.837 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45832.log 2023-11-28T18:53:43.837 INFO:teuthology.orchestra.run.smithi045.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43001.log.gz 2023-11-28T18:53:43.839 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47167.log 2023-11-28T18:53:43.839 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45832.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45832.log.gz 2023-11-28T18:53:43.842 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47167.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47167.log.gz 2023-11-28T18:53:43.843 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43004.log 2023-11-28T18:53:43.846 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43004.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43004.log.gz 2023-11-28T18:53:43.847 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52739.log 2023-11-28T18:53:43.848 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46072.log 2023-11-28T18:53:43.853 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.52739.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52739.log.gz 2023-11-28T18:53:43.854 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46072.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46072.log.gz 2023-11-28T18:53:43.854 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42992.log 2023-11-28T18:53:43.857 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42992.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42992.log.gz 2023-11-28T18:53:43.858 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46587.log 2023-11-28T18:53:43.861 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46587.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46587.log.gz 2023-11-28T18:53:43.861 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42525.log 2023-11-28T18:53:43.864 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42525.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42525.log.gz 2023-11-28T18:53:43.865 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50686.log 2023-11-28T18:53:43.868 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.50686.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.50686.log.gz 2023-11-28T18:53:43.868 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49618.log 2023-11-28T18:53:43.871 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49618.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49618.log.gz 2023-11-28T18:53:43.872 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48109.log 2023-11-28T18:53:43.873 INFO:teuthology.orchestra.run.smithi190.stderr: 94.2% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-11-28T18:53:43.875 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48109.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48109.log.gz 2023-11-28T18:53:43.875 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53403.log 2023-11-28T18:53:43.876 INFO:teuthology.orchestra.run.smithi190.stderr: 2023-11-28T18:53:43.876 INFO:teuthology.orchestra.run.smithi190.stderr:real 0m0.690s 2023-11-28T18:53:43.876 INFO:teuthology.orchestra.run.smithi190.stderr:user 0m2.773s 2023-11-28T18:53:43.876 INFO:teuthology.orchestra.run.smithi190.stderr:sys 0m0.246s 2023-11-28T18:53:43.878 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.53403.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53403.log.gz 2023-11-28T18:53:43.878 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42603.log 2023-11-28T18:53:43.882 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42603.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42603.log.gz 2023-11-28T18:53:43.882 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52167.log 2023-11-28T18:53:43.884 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.52167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50073.log 2023-11-28T18:53:43.885 INFO:teuthology.orchestra.run.smithi045.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52167.log.gz 2023-11-28T18:53:43.887 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43005.log 2023-11-28T18:53:43.889 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.50073.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50073.log.gz 2023-11-28T18:53:43.893 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43005.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43005.log.gz 2023-11-28T18:53:43.893 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46815.log 2023-11-28T18:53:43.902 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46815.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.46815.log.gz 2023-11-28T18:53:43.902 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46645.log 2023-11-28T18:53:43.902 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46645.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46645.log.gz 2023-11-28T18:53:43.904 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51343.log 2023-11-28T18:53:43.905 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.51343.log: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.51343.log.gz 2023-11-28T18:53:43.905 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46202.log 2023-11-28T18:53:43.907 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46202.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46202.log.gz 2023-11-28T18:53:43.907 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52933.log 2023-11-28T18:53:43.911 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.52933.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52933.log.gz 2023-11-28T18:53:43.911 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44777.log 2023-11-28T18:53:43.914 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48619.log 2023-11-28T18:53:43.915 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.44777.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44777.log.gz 2023-11-28T18:53:43.918 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48619.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48619.log.gz 2023-11-28T18:53:43.918 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49025.log 2023-11-28T18:53:43.924 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44959.log 2023-11-28T18:53:43.924 INFO:teuthology.orchestra.run.smithi045.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49025.log.gz 2023-11-28T18:53:43.924 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46789.log 2023-11-28T18:53:43.926 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.44959.log: /var/log/ceph/ceph-client.admin.46789.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46789.log.gz 2023-11-28T18:53:43.927 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47193.log 2023-11-28T18:53:43.927 INFO:teuthology.orchestra.run.smithi045.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44959.log.gz 2023-11-28T18:53:43.931 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47193.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47193.log.gz 2023-11-28T18:53:43.932 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53250.log 2023-11-28T18:53:43.934 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.53250.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.53250.log.gz 2023-11-28T18:53:43.934 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52245.log 2023-11-28T18:53:43.938 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50308.log 2023-11-28T18:53:43.942 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.50308.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50308.log.gz 2023-11-28T18:53:43.942 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.52245.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52245.log.gz 2023-11-28T18:53:43.942 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50360.log 2023-11-28T18:53:43.943 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46046.log 2023-11-28T18:53:43.946 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.50360.log: gzip/var/log/ceph/ceph-client.admin.46046.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.47863.log 2023-11-28T18:53:43.946 INFO:teuthology.orchestra.run.smithi045.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46046.log.gz 2023-11-28T18:53:43.947 INFO:teuthology.orchestra.run.smithi045.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50360.log.gz 2023-11-28T18:53:43.949 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52767.log 2023-11-28T18:53:43.954 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47863.log: /var/log/ceph/ceph-client.admin.52767.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47863.log.gz 2023-11-28T18:53:43.954 INFO:teuthology.orchestra.run.smithi045.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52767.log.gz 2023-11-28T18:53:43.954 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49671.log 2023-11-28T18:53:43.956 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52063.log 2023-11-28T18:53:43.961 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.52063.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52063.log.gz 2023-11-28T18:53:43.961 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49671.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49671.log.gz 2023-11-28T18:53:43.962 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43813.log 2023-11-28T18:53:43.963 INFO:teuthology.orchestra.run.smithi045.stderr: 92.8% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-11-28T18:53:43.964 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53929.log 2023-11-28T18:53:43.964 INFO:teuthology.orchestra.run.smithi045.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43813.log.gz 2023-11-28T18:53:43.965 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42381.log 2023-11-28T18:53:43.967 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.53929.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53929.log.gz 2023-11-28T18:53:43.967 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49469.log 2023-11-28T18:53:43.969 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42381.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.42381.log.gz 2023-11-28T18:53:43.970 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49645.log 2023-11-28T18:53:43.971 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49469.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49469.log.gz 2023-11-28T18:53:43.971 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43209.log 2023-11-28T18:53:43.974 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49645.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49645.log.gz 2023-11-28T18:53:43.974 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48999.log 2023-11-28T18:53:43.975 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43209.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43209.log.gz 2023-11-28T18:53:43.976 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48593.log 2023-11-28T18:53:43.977 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48999.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48999.log.gz 2023-11-28T18:53:43.978 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53686.log 2023-11-28T18:53:43.979 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48593.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48593.log.gz 2023-11-28T18:53:43.980 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54116.log 2023-11-28T18:53:43.982 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.53686.log: 93.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-11-28T18:53:43.982 INFO:teuthology.orchestra.run.smithi045.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.53686.log.gz 2023-11-28T18:53:43.982 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45063.log 2023-11-28T18:53:43.983 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.54116.log: 90.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-11-28T18:53:43.984 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49971.log 2023-11-28T18:53:43.985 INFO:teuthology.orchestra.run.smithi045.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45063.log.gz 2023-11-28T18:53:43.985 INFO:teuthology.orchestra.run.smithi045.stderr: 95.6% -- replaced with /var/log/ceph/ceph-client.admin.54116.log.gz 2023-11-28T18:53:43.985 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51532.log 2023-11-28T18:53:43.986 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52827.log 2023-11-28T18:53:43.987 INFO:teuthology.orchestra.run.smithi045.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49971.log.gz 2023-11-28T18:53:43.988 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.51532.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51532.log.gz 2023-11-28T18:53:43.989 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47375.log 2023-11-28T18:53:43.989 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.52827.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.52827.log.gz 2023-11-28T18:53:43.995 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46124.log 2023-11-28T18:53:43.995 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53011.log 2023-11-28T18:53:43.995 INFO:teuthology.orchestra.run.smithi045.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47375.log.gz 2023-11-28T18:53:43.996 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46124.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46124.log.gz 2023-11-28T18:53:43.996 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43410.log 2023-11-28T18:53:43.996 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.53011.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53011.log.gz 2023-11-28T18:53:43.997 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54166.log 2023-11-28T18:53:43.999 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43410.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43410.log.gz 2023-11-28T18:53:43.999 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46176.log 2023-11-28T18:53:43.999 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.54166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45167.log 2023-11-28T18:53:44.003 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42877.log 2023-11-28T18:53:44.004 INFO:teuthology.orchestra.run.smithi045.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46176.log.gz 2023-11-28T18:53:44.004 INFO:teuthology.orchestra.run.smithi045.stderr: 95.7% -- replaced with /var/log/ceph/ceph-client.admin.54166.log.gz 2023-11-28T18:53:44.004 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43213.log 2023-11-28T18:53:44.004 INFO:teuthology.orchestra.run.smithi045.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45167.log.gz 2023-11-28T18:53:44.004 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42877.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42877.log.gz 2023-11-28T18:53:44.004 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43213.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43213.log.gz 2023-11-28T18:53:44.055 INFO:teuthology.orchestra.run.smithi045.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-11-28T18:53:44.104 INFO:teuthology.orchestra.run.smithi045.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.0.53168.log.gz 2023-11-28T18:53:44.113 INFO:teuthology.orchestra.run.smithi045.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-11-28T18:53:45.475 INFO:teuthology.orchestra.run.smithi045.stderr: 94.4% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-11-28T18:53:45.476 INFO:teuthology.orchestra.run.smithi045.stderr: 2023-11-28T18:53:45.476 INFO:teuthology.orchestra.run.smithi045.stderr:real 0m2.326s 2023-11-28T18:53:45.476 INFO:teuthology.orchestra.run.smithi045.stderr:user 0m6.042s 2023-11-28T18:53:45.476 INFO:teuthology.orchestra.run.smithi045.stderr:sys 0m1.271s 2023-11-28T18:53:45.476 INFO:tasks.ceph:Archiving logs... 2023-11-28T18:53:45.477 DEBUG:teuthology.misc:Transferring archived files from smithi045:/var/log/ceph to /home/teuthworker/archive/vshankar-2023-11-28_06:23:42-fs-wip-vshankar-testing-20231127.102654-testing-default-smithi/7469486/remote/smithi045/log 2023-11-28T18:53:45.478 DEBUG:teuthology.orchestra.run.smithi045:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-28T18:53:46.616 DEBUG:teuthology.misc:Transferring archived files from smithi190:/var/log/ceph to /home/teuthworker/archive/vshankar-2023-11-28_06:23:42-fs-wip-vshankar-testing-20231127.102654-testing-default-smithi/7469486/remote/smithi190/log 2023-11-28T18:53:46.618 DEBUG:teuthology.orchestra.run.smithi190:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-28T18:53:46.991 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi045 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-11-28T18:53:47.004 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-11-28T18:53:47.014 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi045 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-11-28T18:53:47.019 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-11-28T18:53:47.019 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-28T18:53:47.029 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-28T18:53:47.110 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-11-28T18:53:47.119 INFO:teuthology.task.clock:Checking final clock skew... 2023-11-28T18:53:47.119 DEBUG:teuthology.orchestra.run.smithi045:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-28T18:53:47.123 DEBUG:teuthology.orchestra.run.smithi190:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-28T18:53:47.136 INFO:teuthology.orchestra.run.smithi045.stdout: remote refid st t when poll reach delay offset jitter 2023-11-28T18:53:47.137 INFO:teuthology.orchestra.run.smithi045.stdout:============================================================================== 2023-11-28T18:53:47.137 INFO:teuthology.orchestra.run.smithi045.stdout:*hv01.front.sepi 44.4.53.2 2 u 41 64 377 0.076 -3.240 0.354 2023-11-28T18:53:47.137 INFO:teuthology.orchestra.run.smithi045.stdout:+hv02.front.sepi 63.231.80.2 3 u 44 64 377 0.079 -2.074 0.518 2023-11-28T18:53:47.137 INFO:teuthology.orchestra.run.smithi045.stdout:+hv03.front.sepi 74.6.168.72 3 u 45 64 377 0.077 -2.674 0.386 2023-11-28T18:53:47.137 INFO:teuthology.orchestra.run.smithi045.stdout: hv04.front.sepi .INIT. 16 u - 512 0 0.000 +0.000 0.000 2023-11-28T18:53:47.140 INFO:teuthology.orchestra.run.smithi190.stdout: remote refid st t when poll reach delay offset jitter 2023-11-28T18:53:47.140 INFO:teuthology.orchestra.run.smithi190.stdout:============================================================================== 2023-11-28T18:53:47.141 INFO:teuthology.orchestra.run.smithi190.stdout:*hv01.front.sepi 44.4.53.2 2 u 39 64 377 0.092 -8.178 0.914 2023-11-28T18:53:47.141 INFO:teuthology.orchestra.run.smithi190.stdout:+hv02.front.sepi 63.231.80.2 3 u 41 64 377 0.059 -6.675 0.644 2023-11-28T18:53:47.141 INFO:teuthology.orchestra.run.smithi190.stdout:+hv03.front.sepi 74.6.168.72 3 u 41 64 377 0.104 -7.490 0.728 2023-11-28T18:53:47.142 INFO:teuthology.orchestra.run.smithi190.stdout: hv04.front.sepi .INIT. 16 u - 512 0 0.000 +0.000 0.000 2023-11-28T18:53:47.143 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-11-28T18:53:47.168 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-11-28T18:53:47.168 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-11-28T18:53:47.201 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-11-28T18:53:47.233 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-11-28T18:53:47.246 INFO:teuthology.task.internal:Duration was 1764.070588 seconds 2023-11-28T18:53:47.246 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-11-28T18:53:47.282 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-11-28T18:53:47.283 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-28T18:53:47.287 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-28T18:53:47.389 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-11-28T18:53:47.389 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi045.front.sepia.ceph.com 2023-11-28T18:53:47.390 DEBUG:teuthology.orchestra.run.smithi045:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-28T18:53:47.417 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi190.front.sepia.ceph.com 2023-11-28T18:53:47.417 DEBUG:teuthology.orchestra.run.smithi190:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-28T18:53:47.440 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-11-28T18:53:47.441 DEBUG:teuthology.orchestra.run.smithi045:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-28T18:53:47.467 DEBUG:teuthology.orchestra.run.smithi190:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-28T18:53:47.516 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-11-28T18:53:47.517 DEBUG:teuthology.orchestra.run.smithi045:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-28T18:53:47.547 DEBUG:teuthology.orchestra.run.smithi190:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-28T18:53:47.625 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-11-28T18:53:47.638 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-11-28T18:53:47.638 DEBUG:teuthology.orchestra.run.smithi045:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-28T18:53:47.660 DEBUG:teuthology.orchestra.run.smithi190:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-28T18:53:47.681 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-11-28T18:53:47.697 DEBUG:teuthology.orchestra.run.smithi045:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-28T18:53:47.707 DEBUG:teuthology.orchestra.run.smithi190:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-28T18:53:47.722 INFO:teuthology.orchestra.run.smithi045.stdout:kernel.core_pattern = core 2023-11-28T18:53:47.740 INFO:teuthology.orchestra.run.smithi190.stdout:kernel.core_pattern = core 2023-11-28T18:53:47.760 DEBUG:teuthology.orchestra.run.smithi045:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-28T18:53:47.803 WARNING:teuthology.task.internal:Found coredumps on ubuntu@smithi045.front.sepia.ceph.com, flagging run as failed 2023-11-28T18:53:47.804 DEBUG:teuthology.orchestra.run.smithi190:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-28T18:53:47.811 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T18:53:47.812 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-11-28T18:53:47.829 INFO:teuthology.task.internal:Transferring archived files... 2023-11-28T18:53:47.829 DEBUG:teuthology.misc:Transferring archived files from smithi045:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2023-11-28_06:23:42-fs-wip-vshankar-testing-20231127.102654-testing-default-smithi/7469486/remote/smithi045 2023-11-28T18:53:47.830 DEBUG:teuthology.orchestra.run.smithi045:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-28T18:53:55.415 INFO:teuthology.task.internal:Transferring binaries for coredumps... 2023-11-28T18:53:55.534 INFO:teuthology.task.internal: core looks like: /home/teuthworker/archive/vshankar-2023-11-28_06:23:42-fs-wip-vshankar-testing-20231127.102654-testing-default-smithi/7469486/remote/smithi045/coredump/1701197066.52542.core.gz: gzip compressed data, was "1701197066.52542.core", last modified: Tue Nov 28 18:53:47 2023, max compression, original size modulo 2^32 244105216 2023-11-28T18:53:55.534 INFO:teuthology.task.internal:core is compressed, try accessing gzip file ... 2023-11-28T18:53:56.539 INFO:teuthology.task.internal: core looks like: /tmp/tmp_i13hnqe: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mds -f --cluster ceph -i c', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/usr/bin/ceph-mds', platform: 'x86_64' 2023-11-28T18:53:56.573 INFO:teuthology.task.internal: dump_program: ceph-mds -f --cluster ceph -i c 2023-11-28T18:53:56.573 DEBUG:teuthology.orchestra.run.smithi045:> which 'ceph-mds -f --cluster ceph -i c' 2023-11-28T18:53:56.585 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T18:53:56.586 ERROR:teuthology.run_tasks:Manager failed: internal.archive Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/task/internal/__init__.py", line 392, in archive yield File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi045 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/task/internal/__init__.py", line 420, in archive fetch_binaries_for_coredumps(path, rem) File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/task/internal/__init__.py", line 345, in fetch_binaries_for_coredumps remote_path = remote.sh(['which', dump_program]).rstrip() File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/remote.py", line 97, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi045 with status 1: "which 'ceph-mds -f --cluster ceph -i c'" 2023-11-28T18:53:56.612 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-11-28T18:53:56.625 INFO:teuthology.task.internal:Not uploading archives. 2023-11-28T18:53:56.625 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-11-28T18:53:56.663 INFO:teuthology.task.internal:Tidying up after the test... 2023-11-28T18:53:56.664 DEBUG:teuthology.orchestra.run.smithi045:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-28T18:53:56.673 DEBUG:teuthology.orchestra.run.smithi190:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-28T18:53:56.679 INFO:teuthology.orchestra.run.smithi045.stdout: 658043 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Nov 28 18:53 /home/ubuntu/cephtest 2023-11-28T18:53:56.680 INFO:teuthology.orchestra.run.smithi045.stdout: 658044 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Nov 28 18:24 /home/ubuntu/cephtest/archive 2023-11-28T18:53:56.680 INFO:teuthology.orchestra.run.smithi045.stdout: 658047 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 28 18:53 /home/ubuntu/cephtest/archive/syslog 2023-11-28T18:53:56.680 INFO:teuthology.orchestra.run.smithi045.stdout: 658049 4 -rw-rw-rw- 1 ubuntu ubuntu 2224 Nov 28 18:53 /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-11-28T18:53:56.680 INFO:teuthology.orchestra.run.smithi045.stdout: 658048 112 -rw-rw-r-- 1 ubuntu ubuntu 111834 Nov 28 18:53 /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-28T18:53:56.680 INFO:teuthology.orchestra.run.smithi045.stdout: 658050 100 -rw-rw-rw- 1 ubuntu ubuntu 102331 Nov 28 18:53 /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-11-28T18:53:56.680 INFO:teuthology.orchestra.run.smithi045.stdout: 658045 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 28 18:44 /home/ubuntu/cephtest/archive/coredump 2023-11-28T18:53:56.680 INFO:teuthology.orchestra.run.smithi045.stdout: 663205 38312 -rw------- 1 root root 244105216 Nov 28 18:44 /home/ubuntu/cephtest/archive/coredump/1701197066.52542.core 2023-11-28T18:53:56.682 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T18:53:56.683 INFO:teuthology.orchestra.run.smithi045.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-11-28T18:53:56.683 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi045 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi045 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-11-28T18:53:56.698 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-11-28T18:53:56.708 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-11-28T18:53:56.745 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi045 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-11-28T18:53:56.746 INFO:teuthology.nuke:Checking targets against current locks 2023-11-28T18:53:56.753 INFO:teuthology.orchestra.run.smithi190.stdout: 658042 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Nov 28 18:53 /home/ubuntu/cephtest 2023-11-28T18:53:56.754 INFO:teuthology.orchestra.run.smithi190.stdout: 658043 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Nov 28 18:53 /home/ubuntu/cephtest/archive 2023-11-28T18:53:56.754 INFO:teuthology.orchestra.run.smithi190.stdout: 658045 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 28 18:53 /home/ubuntu/cephtest/archive/syslog 2023-11-28T18:53:56.754 INFO:teuthology.orchestra.run.smithi190.stdout: 658047 4 -rw-rw-rw- 1 ubuntu ubuntu 2161 Nov 28 18:53 /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-11-28T18:53:56.754 INFO:teuthology.orchestra.run.smithi190.stdout: 658046 104 -rw-rw-r-- 1 ubuntu ubuntu 102622 Nov 28 18:53 /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-28T18:53:56.754 INFO:teuthology.orchestra.run.smithi190.stdout: 658048 88 -rw-rw-rw- 1 ubuntu ubuntu 88480 Nov 28 18:53 /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-11-28T18:53:56.755 INFO:teuthology.orchestra.run.smithi190.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-11-28T18:53:56.780 DEBUG:teuthology.nuke:shortname: smithi045 2023-11-28T18:53:56.780 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-28T18:53:56.804 DEBUG:teuthology.nuke:shortname: smithi190 2023-11-28T18:53:56.804 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-28T18:53:56.808 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi045.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-11-28_06:23:42-fs-wip-vshankar-testing-20231127.102654-testing-default-smithi/7469486', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 18:14:17.617708', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO16mfo2YJwKMp9bM1nAYO5R82ro39MRsb9PrdrGfzI43Z0tLZWGKA2T5lA7/xusESnDMyyu2qu3FCDOmFHy5fg='} 2023-11-28T18:53:56.833 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi190.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-11-28_06:23:42-fs-wip-vshankar-testing-20231127.102654-testing-default-smithi/7469486', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 18:14:17.618887', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHXujc9ROsTW79sBjfOC7xjF7CZ5m3fIs4Q/SQfbq0OH3J5zRh+BxWYYOwmXayzav2UV2K5W6iMSNkNHSZ4j8vI='} 2023-11-28T18:53:56.875 INFO:teuthology.orchestra.console.smithi045:Power off 2023-11-28T18:53:56.875 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T18:53:56.901 DEBUG:teuthology.orchestra.console.smithi045:power off output: Chassis Power Control: Down/Off 2023-11-28T18:53:56.901 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T18:53:56.921 INFO:teuthology.orchestra.console.smithi190:Power off 2023-11-28T18:53:56.922 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T18:53:56.932 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is on 2023-11-28T18:53:56.948 DEBUG:teuthology.orchestra.console.smithi190:power off output: Chassis Power Control: Down/Off 2023-11-28T18:53:56.948 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T18:53:56.972 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on 2023-11-28T18:54:00.933 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T18:54:00.973 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T18:54:01.047 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is on 2023-11-28T18:54:01.089 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on 2023-11-28T18:54:05.050 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T18:54:05.090 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T18:54:05.161 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is on 2023-11-28T18:54:05.205 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on 2023-11-28T18:54:09.167 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T18:54:09.206 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T18:54:09.279 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is off 2023-11-28T18:54:09.318 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off 2023-11-28T18:54:09.381 INFO:teuthology.orchestra.console.smithi045:Power off completed 2023-11-28T18:54:09.420 INFO:teuthology.orchestra.console.smithi190:Power off completed 2023-11-28T18:54:09.526 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/journal-repair} duration: 1764.070588350296 failure_reason: 'Test failure: test_reset (tasks.cephfs.test_journal_repair.TestJournalRepair), test_reset (tasks.cephfs.test_journal_repair.TestJournalRepair)' flavor: default mon.a-kernel-sha1: 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 mon.b-kernel-sha1: 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 owner: scheduled_vshankar@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=37686a0a69f34edabc34082d7f380747 status: fail success: false 2023-11-28T18:54:09.526 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T18:54:09.619 INFO:teuthology.run:FAIL